-- Logs begin at Sat 2022-09-17 20:01:16 UTC, end at Sat 2022-09-17 22:19:00 UTC. -- Sep 17 20:39:13.805149 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Sep 17 20:39:13.814352 ncdv-master-1 devstack@n-api.service[124050]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 17 20:39:13.816496 ncdv-master-1 devstack@n-api.service[124050]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 17 20:39:13 2022] *** Sep 17 20:39:13.816496 ncdv-master-1 devstack@n-api.service[124050]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 17 20:39:13.816496 ncdv-master-1 devstack@n-api.service[124050]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 17 20:39:13.816496 ncdv-master-1 devstack@n-api.service[124050]: nodename: ncdv-master-1 Sep 17 20:39:13.816496 ncdv-master-1 devstack@n-api.service[124050]: machine: x86_64 Sep 17 20:39:13.816496 ncdv-master-1 devstack@n-api.service[124050]: clock source: unix Sep 17 20:39:13.816496 ncdv-master-1 devstack@n-api.service[124050]: pcre jit disabled Sep 17 20:39:13.816496 ncdv-master-1 devstack@n-api.service[124050]: detected number of CPU cores: 4 Sep 17 20:39:13.816496 ncdv-master-1 devstack@n-api.service[124050]: current working directory: / Sep 17 20:39:13.816496 ncdv-master-1 devstack@n-api.service[124050]: detected binary path: /usr/bin/uwsgi-core Sep 17 20:39:13.816496 ncdv-master-1 devstack@n-api.service[124050]: your processes number limit is 47680 Sep 17 20:39:13.816496 ncdv-master-1 devstack@n-api.service[124050]: your memory page size is 4096 bytes Sep 17 20:39:13.816496 ncdv-master-1 devstack@n-api.service[124050]: detected max file descriptor number: 2048 Sep 17 20:39:13.816496 ncdv-master-1 devstack@n-api.service[124050]: lock engine: pthread robust mutexes Sep 17 20:39:13.817444 ncdv-master-1 devstack@n-api.service[124050]: thunder lock: enabled Sep 17 20:39:13.817444 ncdv-master-1 devstack@n-api.service[124050]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 17 20:39:13.817444 ncdv-master-1 devstack@n-api.service[124050]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 17 20:39:13.860822 ncdv-master-1 devstack@n-api.service[124050]: Python main interpreter initialized at 0x563d3233e9c0 Sep 17 20:39:13.860822 ncdv-master-1 devstack@n-api.service[124050]: python threads support enabled Sep 17 20:39:13.860822 ncdv-master-1 devstack@n-api.service[124050]: your server socket listen backlog is limited to 100 connections Sep 17 20:39:13.860822 ncdv-master-1 devstack@n-api.service[124050]: your mercy for graceful operations on workers is 90 seconds Sep 17 20:39:13.861191 ncdv-master-1 devstack@n-api.service[124050]: mapped 403077 bytes (393 KB) for 2 cores Sep 17 20:39:13.861191 ncdv-master-1 devstack@n-api.service[124050]: *** Operational MODE: preforking *** Sep 17 20:39:13.861499 ncdv-master-1 devstack@n-api.service[124050]: *** uWSGI is running in multiple interpreter mode *** Sep 17 20:39:13.861499 ncdv-master-1 devstack@n-api.service[124050]: spawned uWSGI master process (pid: 124050) Sep 17 20:39:13.861670 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Sep 17 20:39:13.862537 ncdv-master-1 devstack@n-api.service[124050]: spawned uWSGI worker 1 (pid: 124051, cores: 1) Sep 17 20:39:13.862537 ncdv-master-1 devstack@n-api.service[124050]: spawned uWSGI worker 2 (pid: 124052, cores: 1) Sep 17 20:39:13.862708 ncdv-master-1 devstack@n-api.service[124050]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 17 20:39:15.151999 ncdv-master-1 devstack@n-api.service[124052]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 17 20:39:15.152651 ncdv-master-1 devstack@n-api.service[124051]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 17 20:39:15.819186 ncdv-master-1 devstack@n-api.service[124052]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 20:39:15.819186 ncdv-master-1 devstack@n-api.service[124052]: from cryptography.utils import int_from_bytes Sep 17 20:39:15.819512 ncdv-master-1 devstack@n-api.service[124051]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 20:39:15.819512 ncdv-master-1 devstack@n-api.service[124051]: from cryptography.utils import int_from_bytes Sep 17 20:39:15.819512 ncdv-master-1 devstack@n-api.service[124051]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 20:39:15.819512 ncdv-master-1 devstack@n-api.service[124051]: from cryptography.utils import int_from_bytes Sep 17 20:39:15.819764 ncdv-master-1 devstack@n-api.service[124052]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 20:39:15.819764 ncdv-master-1 devstack@n-api.service[124052]: from cryptography.utils import int_from_bytes Sep 17 20:39:18.346727 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 17 20:39:18.347449 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 17 20:39:18.347544 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 17 20:39:18.347898 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 17 20:39:18.347966 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 17 20:39:18.348030 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 17 20:39:18.348030 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 17 20:39:18.348171 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 17 20:39:18.348415 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.348514 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 17 20:39:18.348739 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 17 20:39:18.348869 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.349025 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.349114 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.349367 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.349543 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.349700 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.349805 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.350028 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.350171 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.350329 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.350469 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.350638 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.350783 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.350954 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.351086 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.351196 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.351278 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.351506 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.351707 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.351838 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.351960 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.352082 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.352203 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.352417 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.352604 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.352739 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.352875 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.352997 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.353116 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.353246 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.353368 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.353609 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.353788 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.353919 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.354136 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.354262 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.354390 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.354555 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.355704 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.355924 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.356128 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.356275 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.356451 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.356658 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.356805 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.357030 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.357215 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.357367 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.357557 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.357730 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.357903 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.358127 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.358307 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.358459 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.358679 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.358859 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.359047 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.359243 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.359390 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.359562 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.359777 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.359964 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.360244 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.360401 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.360563 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.360723 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.360873 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.361001 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.361137 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.361295 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.361431 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.361582 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.361702 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.361838 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.361998 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.362132 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.362252 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.362373 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.362492 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.362612 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.362740 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.362868 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.362994 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.362994 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.363242 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.363387 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.363517 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.363641 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.363759 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.363878 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.363996 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.364124 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.364254 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.364380 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.364499 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.364618 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.364744 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.364872 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.364999 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.365119 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.365238 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.365367 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.365513 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.365644 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.365765 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.365884 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.366069 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.366200 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.366333 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.366452 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.366585 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.366713 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.366837 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.366970 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.367091 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.367210 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.367327 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.367446 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.367564 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.367696 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.367815 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.367933 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.368058 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.368185 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.368303 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.368432 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.368551 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.368677 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.368807 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.368926 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.369052 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.369171 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.369295 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.369413 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.369576 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.369712 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.369846 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.369966 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.370083 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.370201 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.370406 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.370547 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.370748 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.370872 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.370999 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.371118 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.371236 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.371354 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.371481 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.371604 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.371731 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.371850 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.371967 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.372092 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.372220 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.372338 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.372456 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.372574 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.372692 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.372818 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.372943 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.373070 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.373196 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.373317 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.373525 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.373672 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.373828 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.373956 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.374166 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.374354 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.374486 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.374622 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.374747 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.374874 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.374995 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.375115 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.375236 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.375365 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.375557 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.375733 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.375866 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.376003 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.376145 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.376268 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.376412 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.376548 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.376742 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.376922 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.377075 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.377201 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.377322 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.377569 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.377698 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.377833 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.377969 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.378099 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.378220 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.378346 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.378543 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.378730 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.378952 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.379082 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.379203 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.379324 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.379442 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.379560 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.379696 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.379877 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.380005 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.380124 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.380243 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.380541 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.380682 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.380882 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.381016 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.381144 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.381265 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.381396 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.381540 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.381687 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.381809 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.381932 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.382055 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.382174 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.382301 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.382421 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.382586 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.382717 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.382895 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.383028 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.383194 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.383327 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.383491 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.383613 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.383800 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.383930 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.384095 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.384219 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.384395 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.384518 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.384701 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.384843 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.384994 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.385116 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.385289 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.385418 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.385606 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.385745 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.385908 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.386030 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.386203 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.386333 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.386505 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.386641 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.386793 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.386916 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.387087 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.387221 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.387378 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.387502 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.387673 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.387807 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.387970 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.388106 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.388264 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.388391 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.388560 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.388682 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.388857 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.388992 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.389167 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.389298 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.389490 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.389617 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.389789 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.389929 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.390103 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:39:18.390227 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.390433 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.390571 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.390756 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.390904 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.391089 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.391220 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.391340 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.391460 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.391648 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.391782 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.391954 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.392086 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.392272 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.392395 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.392576 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.392713 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.392878 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.393014 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.393250 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.393372 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.393584 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.393709 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.393889 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.394011 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.394198 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.394336 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.394509 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.394642 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.394820 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.394944 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.395130 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.395260 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.395435 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.395559 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.395744 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.395868 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.396056 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.396178 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.396364 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.396488 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.396666 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.396789 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.396987 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.397110 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.397303 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.397428 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.397644 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.397778 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.397960 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.398094 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.398273 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.398397 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.398579 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.398702 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.398883 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.399084 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.399208 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.399335 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.399500 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.399623 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.399813 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.399949 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.400116 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.400238 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.400424 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.400547 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.400810 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.400964 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.401101 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.401283 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.401406 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.401561 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.401684 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.401815 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.401935 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.402056 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.402233 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.402365 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.402537 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.402661 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.402842 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.402971 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.403149 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.403281 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.403455 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.403580 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.403762 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.403893 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.404067 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.404200 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.404379 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.404504 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.404685 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.404824 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.404990 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.405114 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.405685 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.405824 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.405992 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.406115 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.406289 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.406411 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.406593 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.406719 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.406886 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.407009 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.407181 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.407318 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.407478 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.407601 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.407782 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.407907 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.408080 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.408213 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.408397 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.408529 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.408720 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.408850 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.409027 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.409159 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.409331 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.409486 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.409660 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.409802 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.409961 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.410095 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.410267 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.410390 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.410571 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.410692 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.410877 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.411015 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.411179 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.411278 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.411482 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.411579 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.411781 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.411880 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.412096 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.412204 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.412395 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.412527 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.412693 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.412816 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.412999 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.413129 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.413298 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.413427 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.413630 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.413751 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.413918 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.414042 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.414224 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.414366 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.414533 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.414658 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.414835 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.414956 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.415137 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.415270 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.415452 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.415581 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.415759 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.415884 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.416061 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.416192 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.416375 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.416500 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.416698 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.416821 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.416997 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.417135 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.417293 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.417415 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.417621 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.417746 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.417920 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.418044 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.418219 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.418342 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.418515 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.418639 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.418816 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.418941 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.419113 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.419236 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.419410 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.419532 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.419705 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.419829 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.419999 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.420122 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.420295 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.420419 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.420593 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.420715 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.420920 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.421115 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.421239 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.421384 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.421587 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.421711 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.421831 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.421966 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.422097 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.422225 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.422380 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.422499 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.422625 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.422746 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.422964 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.423105 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.423267 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.423391 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.423602 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.423733 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.423904 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.424036 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.424211 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.424371 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.424581 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.424704 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.424887 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.425010 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.425189 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.425313 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.425510 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.425649 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.425819 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.425945 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.426123 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.426248 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.426426 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.426551 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.426740 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.426865 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.427046 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.427171 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.427354 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.427477 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.427665 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.427785 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.427952 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.428075 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.428254 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.428376 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.428570 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.428702 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.428872 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.429004 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.429181 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.429315 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.429517 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.429641 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.429824 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.429995 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.430131 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.430263 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.430422 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.430546 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.430721 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.430848 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.431024 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.431231 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.431366 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.431487 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.431619 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.431809 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.431933 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.432061 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.432205 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.432330 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.432507 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.432635 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.432809 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.432940 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.433110 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.433231 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.433416 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.433574 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.433736 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.433868 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.434043 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.434166 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.434352 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.434475 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.434652 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.434784 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.434961 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.435091 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.435262 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.435393 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.435578 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.435711 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.435885 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.436015 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.436187 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.436328 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.436491 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.436615 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.436790 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.436922 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.437087 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.437220 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.437390 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.437532 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.437716 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.437840 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.438017 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.438150 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.438320 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.438442 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.438619 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.438744 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.438926 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.439060 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.439228 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.439349 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.439526 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.439647 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.439826 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.439949 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.440158 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.440282 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.440458 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.440588 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.440757 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.440883 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.441067 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.441213 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.441395 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.441588 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.441721 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.441918 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.442042 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.442162 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.442281 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.442408 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.442567 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.442686 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.442864 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.442982 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.443161 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.443284 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.443458 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.443589 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.443765 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.443887 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.444066 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.444199 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.444367 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.444489 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.444676 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.444807 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.444988 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.445125 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.445286 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.445409 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.445619 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.445741 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.445927 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.446072 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.446230 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.446353 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.446536 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.446657 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.446843 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.446973 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.447144 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.447268 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.447444 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.447568 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.447747 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.447870 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.448048 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.448172 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.448348 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.448475 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.448650 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.448773 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.448950 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.449072 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.449254 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.449377 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.449593 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.449728 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.449888 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.450011 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.450188 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.450324 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.450493 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.450615 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.450775 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.451042 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.451165 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.451449 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.451584 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.451712 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.451962 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.452096 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.452253 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.452391 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.452565 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.452698 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.452879 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.453002 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.453212 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.453335 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.453572 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.453816 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.453957 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.454079 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.454199 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.454318 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.454438 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.454572 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.454700 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.454821 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.454981 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.455127 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.455278 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.455432 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.455649 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.455798 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.455955 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.456107 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.456259 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.456413 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.456559 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.456715 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.456867 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.457015 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.457164 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.457320 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.457454 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.457650 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.457775 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.457953 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.458087 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.458254 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.458378 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.458555 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.458680 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.458874 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.459008 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.459175 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.459299 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.459482 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.459615 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.459790 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.459923 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.460082 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.460214 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.460401 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.460524 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.460703 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.460836 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.461005 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.461137 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.461304 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.461432 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.461662 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.461803 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.461953 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.462152 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.462275 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.462392 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.462558 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.462682 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.462857 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.462978 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.463153 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.463275 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.463450 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.463574 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.463754 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.463878 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.464059 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.464200 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.464356 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.464479 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.464657 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.464780 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.464960 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.465090 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.465261 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.465381 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.465582 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.465705 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.465884 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.466021 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.466186 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.466309 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.466483 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.466605 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.466786 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.466921 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.467088 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.467212 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.467383 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.467504 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.467681 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.467821 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.467983 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.468109 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.468285 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.468413 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.468580 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.468702 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.468875 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.468997 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.469170 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.469297 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.469510 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.469636 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.469795 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.469916 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.470092 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.470228 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.470389 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.470512 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.470691 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.470820 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.470990 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.471106 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.471314 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.471437 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.471614 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.471811 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.471944 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.472072 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.472276 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.472401 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.472524 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.472644 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.472772 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.472902 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.473060 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.473183 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.473357 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.473499 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.473684 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.473821 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.473988 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.474112 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.474288 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.474414 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.474583 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.474717 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.474885 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.475014 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.475180 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.475310 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.475477 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.475608 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.475774 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.475898 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.476079 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.476202 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.476377 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.476500 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.476673 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.476803 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.476969 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.477101 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.477264 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.477388 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.477580 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.477882 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.478181 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.478481 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.478779 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.479095 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.479400 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.479530 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.479705 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.479910 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.480145 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.480271 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.480391 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.480510 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.480632 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.480761 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.480890 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.481011 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.481236 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.481555 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.481873 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.482021 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.482187 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.482384 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.482507 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.482627 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.482789 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.482928 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.483096 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.483230 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.483397 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.483521 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.483710 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.483836 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.484014 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.484138 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.484321 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.484453 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.484621 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.484746 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.484920 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.485044 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.485238 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.485564 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.485874 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.486189 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.486508 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.487363 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.487508 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.487631 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.487631 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.487871 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.487992 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.488112 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.488231 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.488363 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.488484 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.488604 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.488724 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.488852 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.488980 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.489110 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.489230 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.489349 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.489609 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.489732 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.489864 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.489994 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.490125 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.490273 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.490424 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.490731 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.491035 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.491335 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.491653 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.491965 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.492251 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.492611 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.492853 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.495531 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.495803 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.495950 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.496077 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.496198 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.496340 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.496472 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.496592 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.496712 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.496831 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.496999 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.497130 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.497258 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.497386 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.497521 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.497642 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.497773 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.497904 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.498672 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.498803 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.498924 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.499053 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.499182 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.499312 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.499433 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.499554 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.499674 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.499841 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.499970 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.500090 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.500223 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.500347 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.500469 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.500599 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.500728 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.501022 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.501192 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.501327 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.501456 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.501706 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.501881 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.502061 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.502324 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.502519 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.502783 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.502981 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.503153 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.503302 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.503458 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.503616 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.503786 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.503956 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.504113 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.504306 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.504447 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.504570 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.504697 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.504832 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.504958 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.505080 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.505203 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.505325 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.505448 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.505608 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.505733 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.505858 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.505980 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.506103 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.506234 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.506358 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.506481 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.506612 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.506736 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.506863 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.506995 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.507119 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.507242 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.507365 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.507496 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.507620 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.507772 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.507907 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.508045 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.508172 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.508172 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.508404 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.508528 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.508651 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.508651 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.508893 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.509021 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.509144 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.509144 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.509385 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.509385 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.509670 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.509796 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.509919 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.510044 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.510177 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.510301 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.510424 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.510555 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.510679 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.510803 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.510939 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.511068 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.511191 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.511320 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.511448 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.511570 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.511701 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.511826 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.511950 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.512074 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.512197 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.512334 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.512536 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.512665 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.512867 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.513004 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.513131 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.513262 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.513389 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.513542 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.513668 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.513801 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.513934 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.514072 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.514198 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.514330 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.514454 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.514577 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.514700 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.514835 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.514959 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.515084 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.515208 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.515331 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.515453 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.515585 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.515711 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.515841 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.515965 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.516096 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.516229 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.516356 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.516479 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.516611 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.516736 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.516859 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.516991 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.517124 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.517248 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.517380 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.517543 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.517669 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.517808 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.517941 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.518072 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.518283 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.518417 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.518549 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.518683 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.518810 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.518933 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.519055 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.519184 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.519317 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.519451 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.519584 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.519715 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.519838 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.519962 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.520098 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.520230 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.520354 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.520479 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.520602 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.520725 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.520894 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.521023 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.521146 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.521268 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.521399 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.521541 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.521685 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.521881 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.522009 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.522132 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.522256 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.522394 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.522564 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.522756 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.522896 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.523092 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.523227 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.523360 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.523477 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.523608 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.523732 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.523855 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.523979 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.524117 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.524241 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.524364 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.524487 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.524617 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.524742 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.524880 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.524994 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.525116 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.525239 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.525361 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.525622 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.525752 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.525884 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.526016 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.526147 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.526271 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.526407 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.526532 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.526693 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.526836 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.527034 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.527216 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.527443 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.527575 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.527701 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.527828 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.527960 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.528085 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.528218 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.528343 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.528504 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.528637 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.528805 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.528949 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.529141 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.529332 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.529505 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.529662 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.529795 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.530018 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.530610 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.530742 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.530858 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.530996 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.531131 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.531271 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.531397 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.531557 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.531692 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.531886 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.532081 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.532236 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.532367 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.532492 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.532623 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.532766 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.532991 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.533209 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.533348 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.533527 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.533680 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.533809 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.533950 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.534076 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.534202 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.534325 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.534449 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.534669 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.534936 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.534936 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.535192 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.535318 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.535443 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.535584 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.535793 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.535974 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.536113 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.536254 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.536383 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.536518 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.536711 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.536907 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.537043 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.537171 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.537298 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.537435 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.537589 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.537728 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.537932 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.538125 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.538274 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.538406 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.538532 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.538666 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.538791 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.538915 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.539132 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.539327 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.539476 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.539613 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.539740 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.539865 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.540075 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.540255 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.540393 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.540521 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.540646 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.540789 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.540953 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.541098 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.541268 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.541403 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.541573 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.541723 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.541958 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.542148 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.542287 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.542416 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.542555 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.542681 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.542814 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.543045 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.543199 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.543391 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.543532 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.543667 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.543792 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.543917 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.544048 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.544253 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.544448 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.544588 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.544719 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.544844 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.544971 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.545095 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.545219 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.545420 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.545626 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.545771 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.545899 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.546046 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.546174 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.546308 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.546432 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.546630 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.546816 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.546966 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.547096 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.547231 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.547356 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.547742 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.547925 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.548076 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.548217 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.548343 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.548467 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.548689 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.548890 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.549039 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.549179 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.549356 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.549526 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.549665 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.549807 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.549935 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.550059 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.550268 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.550450 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.550586 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.550728 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.550856 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.550982 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.551106 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.551239 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.551433 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.551631 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.551769 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.551898 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.552025 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.552150 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.552285 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.552424 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.552575 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.552716 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.552915 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.553116 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.553354 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.553614 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.553750 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.553875 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.554000 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.554126 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.554268 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.554395 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.554520 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.554651 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.554776 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.554988 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.555186 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.555313 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.555441 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.555577 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.555712 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.555852 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.555986 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.556113 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.556237 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.556466 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.556648 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.556797 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.556928 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.557061 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.557189 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.557324 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.557450 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.557626 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.557754 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.557915 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.558067 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.558200 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.558327 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.558501 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.558636 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.558833 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.559016 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.559163 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.559313 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.559449 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.559574 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.559698 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.559823 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.559955 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.560091 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.560254 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.560390 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.560550 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.560686 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.560854 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.560999 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.561126 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.561258 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.561516 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.561783 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.561963 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.562125 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.562257 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.562382 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.562516 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.562649 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.562857 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.562986 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.563110 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.563236 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.563461 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.563609 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.563812 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.563946 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.564078 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.564204 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.564328 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.564460 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.564597 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.564729 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.564854 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.565040 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.565165 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.565322 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.565490 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.565694 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.565876 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.566031 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.566162 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.566301 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.566428 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.566590 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.566726 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.566920 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.567101 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.567250 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.567426 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.567563 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.567777 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.567959 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.568108 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.568250 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.568390 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.568523 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.568648 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.568775 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.569008 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.569186 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.569322 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.569450 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.569640 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.569767 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.569913 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.570055 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.570181 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.570306 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.570514 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.570696 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.570849 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.570980 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.571105 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.571229 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.571353 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.571476 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.571697 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.571880 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.572029 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.572159 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.572286 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.572428 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.572554 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.572678 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.572877 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.573172 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.573356 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.573627 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.573780 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.573980 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.574121 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.574247 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.574379 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.574515 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.574641 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.574765 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.574890 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.575016 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.575159 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.575286 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.575417 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.575542 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.575668 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.575873 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.576070 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.576219 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.576349 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.576464 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.576587 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.576726 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.576896 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.577027 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.577217 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.577346 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.577607 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.577759 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.577888 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.578012 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.578139 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.578263 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.578426 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.578740 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.578867 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.579048 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.579177 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.579349 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.579481 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.579654 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.579791 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.579959 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.580086 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.580311 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.580451 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.580615 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.580745 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.580869 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.581037 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.581167 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.581355 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.581516 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.581685 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.581814 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.582011 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.582140 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.582336 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.582465 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.582635 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.582770 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.582933 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.583061 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.583230 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.583361 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.583532 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.583752 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.583892 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.584117 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.584255 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.584381 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.584381 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.584631 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.584756 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.584894 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.585019 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.585142 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.585265 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.585387 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.585584 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.585729 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.585882 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.586018 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.586178 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.586306 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.586475 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.586605 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.586771 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.586899 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.587073 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.587200 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.587370 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.587499 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.587666 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.587793 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.587960 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.588087 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.588254 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.588391 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.588549 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.588686 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.588844 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.588975 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.589144 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.589273 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.589438 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.589585 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.589754 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.589896 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.590064 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.590192 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.590361 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.590489 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.590662 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.590872 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.591009 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.591135 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.591297 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.591425 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.591604 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.591742 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.591917 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.592045 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.592217 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.592352 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.592534 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.592670 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.592835 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.592962 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.593148 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.593276 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.593451 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.593634 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.593772 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.593977 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.594121 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.594311 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.594453 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.594588 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.594712 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.594839 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.594967 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.595090 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.595222 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.595347 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.595531 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.595664 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.595835 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.595978 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.596156 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.596295 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.596477 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.596615 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.596851 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.597000 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.597127 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.597250 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.597402 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.597563 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.597744 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.597883 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.598062 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.598191 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.598371 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.598500 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.598675 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.598812 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.598995 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.599133 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.599299 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.599430 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.599603 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.599731 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.599902 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.600028 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.600161 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124051) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 17 20:39:18.600286 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.600494 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.600800 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.601233 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.601406 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.601738 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.602046 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.602363 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.602682 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.602984 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.603303 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.603620 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.603961 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.604268 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.604602 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.604921 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.605225 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.605552 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.605854 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:39:18.606089 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124052) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 17 20:39:18.666355 ncdv-master-1 devstack@n-api.service[124051]: INFO dbcounter [None req-9241068a-f7b8-479a-b7e9-5bfd89168065 None None] Registered counter for database nova_api Sep 17 20:39:18.671146 ncdv-master-1 devstack@n-api.service[124052]: INFO dbcounter [None req-3398fd44-d2bf-4d39-ba32-bf26fa481b52 None None] Registered counter for database nova_api Sep 17 20:39:18.687763 ncdv-master-1 devstack@n-api.service[124051]: DEBUG oslo_db.sqlalchemy.engines [None req-9241068a-f7b8-479a-b7e9-5bfd89168065 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124051) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 20:39:18.694007 ncdv-master-1 devstack@n-api.service[124052]: DEBUG oslo_db.sqlalchemy.engines [None req-3398fd44-d2bf-4d39-ba32-bf26fa481b52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124052) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 20:39:18.694680 ncdv-master-1 devstack@n-api.service[124051]: DEBUG dbcounter [-] [124051] Writer thread running {{(pid=124051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 20:39:18.700609 ncdv-master-1 devstack@n-api.service[124052]: DEBUG dbcounter [-] [124052] Writer thread running {{(pid=124052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 20:39:18.750540 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.context [None req-9241068a-f7b8-479a-b7e9-5bfd89168065 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),056db90a-cdd9-42b2-a8c3-cd5ab36662a4(cell1) {{(pid=124051) load_cells /opt/stack/nova/nova/context.py:464}} Sep 17 20:39:18.754741 ncdv-master-1 devstack@n-api.service[124051]: DEBUG oslo_concurrency.lockutils [None req-9241068a-f7b8-479a-b7e9-5bfd89168065 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:39:18.755263 ncdv-master-1 devstack@n-api.service[124051]: DEBUG oslo_concurrency.lockutils [None req-9241068a-f7b8-479a-b7e9-5bfd89168065 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:39:18.755641 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.context [None req-3398fd44-d2bf-4d39-ba32-bf26fa481b52 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),056db90a-cdd9-42b2-a8c3-cd5ab36662a4(cell1) {{(pid=124052) load_cells /opt/stack/nova/nova/context.py:464}} Sep 17 20:39:18.756862 ncdv-master-1 devstack@n-api.service[124051]: DEBUG oslo_concurrency.lockutils [None req-9241068a-f7b8-479a-b7e9-5bfd89168065 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:39:18.757604 ncdv-master-1 devstack@n-api.service[124051]: DEBUG oslo_concurrency.lockutils [None req-9241068a-f7b8-479a-b7e9-5bfd89168065 None None] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:39:18.758047 ncdv-master-1 devstack@n-api.service[124051]: DEBUG oslo_concurrency.lockutils [None req-9241068a-f7b8-479a-b7e9-5bfd89168065 None None] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:39:18.759497 ncdv-master-1 devstack@n-api.service[124052]: DEBUG oslo_concurrency.lockutils [None req-3398fd44-d2bf-4d39-ba32-bf26fa481b52 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:39:18.759971 ncdv-master-1 devstack@n-api.service[124052]: DEBUG oslo_concurrency.lockutils [None req-3398fd44-d2bf-4d39-ba32-bf26fa481b52 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:39:18.760075 ncdv-master-1 devstack@n-api.service[124051]: DEBUG oslo_concurrency.lockutils [None req-9241068a-f7b8-479a-b7e9-5bfd89168065 None None] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124051) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:39:18.761555 ncdv-master-1 devstack@n-api.service[124052]: DEBUG oslo_concurrency.lockutils [None req-3398fd44-d2bf-4d39-ba32-bf26fa481b52 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:39:18.762082 ncdv-master-1 devstack@n-api.service[124051]: INFO dbcounter [None req-9241068a-f7b8-479a-b7e9-5bfd89168065 None None] Registered counter for database nova_cell0 Sep 17 20:39:18.762255 ncdv-master-1 devstack@n-api.service[124052]: DEBUG oslo_concurrency.lockutils [None req-3398fd44-d2bf-4d39-ba32-bf26fa481b52 None None] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:39:18.762699 ncdv-master-1 devstack@n-api.service[124052]: DEBUG oslo_concurrency.lockutils [None req-3398fd44-d2bf-4d39-ba32-bf26fa481b52 None None] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:39:18.764655 ncdv-master-1 devstack@n-api.service[124052]: DEBUG oslo_concurrency.lockutils [None req-3398fd44-d2bf-4d39-ba32-bf26fa481b52 None None] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:39:18.766704 ncdv-master-1 devstack@n-api.service[124052]: INFO dbcounter [None req-3398fd44-d2bf-4d39-ba32-bf26fa481b52 None None] Registered counter for database nova_cell0 Sep 17 20:39:18.767636 ncdv-master-1 devstack@n-api.service[124051]: INFO dbcounter [None req-9241068a-f7b8-479a-b7e9-5bfd89168065 None None] Registered counter for database nova_cell1 Sep 17 20:39:18.772087 ncdv-master-1 devstack@n-api.service[124052]: INFO dbcounter [None req-3398fd44-d2bf-4d39-ba32-bf26fa481b52 None None] Registered counter for database nova_cell1 Sep 17 20:39:18.775724 ncdv-master-1 devstack@n-api.service[124051]: DEBUG oslo_db.sqlalchemy.engines [None req-9241068a-f7b8-479a-b7e9-5bfd89168065 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124051) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 20:39:18.777640 ncdv-master-1 devstack@n-api.service[124051]: DEBUG oslo_db.sqlalchemy.engines [None req-9241068a-f7b8-479a-b7e9-5bfd89168065 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124051) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 20:39:18.782388 ncdv-master-1 devstack@n-api.service[124052]: DEBUG oslo_db.sqlalchemy.engines [None req-3398fd44-d2bf-4d39-ba32-bf26fa481b52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124052) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 20:39:18.784124 ncdv-master-1 devstack@n-api.service[124052]: DEBUG oslo_db.sqlalchemy.engines [None req-3398fd44-d2bf-4d39-ba32-bf26fa481b52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124052) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 20:39:18.784949 ncdv-master-1 devstack@n-api.service[124051]: DEBUG dbcounter [-] [124051] Writer thread running {{(pid=124051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 20:39:18.786253 ncdv-master-1 devstack@n-api.service[124051]: DEBUG dbcounter [-] [124051] Writer thread running {{(pid=124051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 20:39:18.790958 ncdv-master-1 devstack@n-api.service[124052]: DEBUG dbcounter [-] [124052] Writer thread running {{(pid=124052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 20:39:18.794676 ncdv-master-1 devstack@n-api.service[124052]: DEBUG dbcounter [-] [124052] Writer thread running {{(pid=124052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 20:39:18.930238 ncdv-master-1 devstack@n-api.service[124051]: INFO dbcounter [None req-9241068a-f7b8-479a-b7e9-5bfd89168065 None None] Registered counter for database nova_cell0 Sep 17 20:39:18.939596 ncdv-master-1 devstack@n-api.service[124051]: DEBUG oslo_db.sqlalchemy.engines [None req-9241068a-f7b8-479a-b7e9-5bfd89168065 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124051) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 20:39:18.940968 ncdv-master-1 devstack@n-api.service[124052]: INFO dbcounter [None req-3398fd44-d2bf-4d39-ba32-bf26fa481b52 None None] Registered counter for database nova_cell0 Sep 17 20:39:18.945441 ncdv-master-1 devstack@n-api.service[124051]: DEBUG dbcounter [-] [124051] Writer thread running {{(pid=124051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 20:39:18.949687 ncdv-master-1 devstack@n-api.service[124052]: DEBUG oslo_db.sqlalchemy.engines [None req-3398fd44-d2bf-4d39-ba32-bf26fa481b52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124052) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 20:39:18.953916 ncdv-master-1 devstack@n-api.service[124052]: DEBUG dbcounter [-] [124052] Writer thread running {{(pid=124052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 20:39:19.404575 ncdv-master-1 devstack@n-api.service[124052]: WARNING keystonemiddleware.auth_token [None req-3398fd44-d2bf-4d39-ba32-bf26fa481b52 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 17 20:39:19.410048 ncdv-master-1 devstack@n-api.service[124051]: WARNING keystonemiddleware.auth_token [None req-9241068a-f7b8-479a-b7e9-5bfd89168065 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 17 20:39:19.412381 ncdv-master-1 devstack@n-api.service[124052]: WARNING keystonemiddleware.auth_token [None req-3398fd44-d2bf-4d39-ba32-bf26fa481b52 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 17 20:39:19.417562 ncdv-master-1 devstack@n-api.service[124051]: WARNING keystonemiddleware.auth_token [None req-9241068a-f7b8-479a-b7e9-5bfd89168065 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 17 20:39:19.632951 ncdv-master-1 devstack@n-api.service[124051]: WARNING keystonemiddleware.auth_token [None req-9241068a-f7b8-479a-b7e9-5bfd89168065 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 17 20:39:19.634113 ncdv-master-1 devstack@n-api.service[124052]: WARNING keystonemiddleware.auth_token [None req-3398fd44-d2bf-4d39-ba32-bf26fa481b52 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 17 20:39:19.639174 ncdv-master-1 devstack@n-api.service[124051]: WARNING keystonemiddleware.auth_token [None req-9241068a-f7b8-479a-b7e9-5bfd89168065 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 17 20:39:19.640077 ncdv-master-1 devstack@n-api.service[124052]: WARNING keystonemiddleware.auth_token [None req-3398fd44-d2bf-4d39-ba32-bf26fa481b52 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 17 20:39:19.644585 ncdv-master-1 devstack@n-api.service[124051]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563d3233e9c0 pid: 124051 (default app) Sep 17 20:39:19.645344 ncdv-master-1 devstack@n-api.service[124052]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563d3233e9c0 pid: 124052 (default app) Sep 17 20:39:19.646734 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-9241068a-f7b8-479a-b7e9-5bfd89168065 None None] Calling method '>' {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:39:19.647901 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-9241068a-f7b8-479a-b7e9-5bfd89168065 None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001708 Sep 17 20:39:19.648308 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Sat Sep 17 20:39:19 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:40:46.857005 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-3398fd44-d2bf-4d39-ba32-bf26fa481b52 None None] Calling method '>' {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:40:46.858539 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-3398fd44-d2bf-4d39-ba32-bf26fa481b52 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002248 Sep 17 20:40:46.859890 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 931 bytes} [Sat Sep 17 20:40:46 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:40:46.871438 ncdv-master-1 devstack@n-api.service[124051]: DEBUG dbcounter [-] [124051] Writing DB stats nova_api:SELECT=3 {{(pid=124051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:40:46.872791 ncdv-master-1 devstack@n-api.service[124051]: DEBUG dbcounter [-] [124051] Writing DB stats nova_cell0:SELECT=3 {{(pid=124051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:40:46.873879 ncdv-master-1 devstack@n-api.service[124051]: DEBUG dbcounter [-] [124051] Writing DB stats nova_cell1:SELECT=3 {{(pid=124051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:40:46.874714 ncdv-master-1 devstack@n-api.service[124051]: DEBUG dbcounter [-] [124051] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=124051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:40:47.732121 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-2f559523-4cbf-49a7-ae03-03d3c744d5f4 admin admin] Calling method '>' {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:40:47.765468 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-2f559523-4cbf-49a7-ae03-03d3c744d5f4 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.899796 Sep 17 20:40:47.769694 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 2/3] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Sep 17 20:40:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:40:50.675494 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-3398fd44-d2bf-4d39-ba32-bf26fa481b52 None None] Calling method '>' {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:40:50.676590 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-3398fd44-d2bf-4d39-ba32-bf26fa481b52 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Sep 17 20:40:50.676953 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 2/4] 10.222.0.26 () {54 vars in 931 bytes} [Sat Sep 17 20:40:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:40:51.098688 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-d514b16d-0663-4acc-ae93-17464ee09f7c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "id": "c1", "ram": 256, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "cirros256", "rxtx_factor": 1.0}} {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:40:51.147418 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-d514b16d-0663-4acc-ae93-17464ee09f7c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.463646 Sep 17 20:40:51.148162 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 3/5] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Sep 17 20:40:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:40:51.161965 ncdv-master-1 devstack@n-api.service[124052]: DEBUG dbcounter [-] [124052] Writing DB stats nova_api:SELECT=3 {{(pid=124052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:40:51.163220 ncdv-master-1 devstack@n-api.service[124052]: DEBUG dbcounter [-] [124052] Writing DB stats nova_cell1:SELECT=3 {{(pid=124052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:40:51.164197 ncdv-master-1 devstack@n-api.service[124052]: DEBUG dbcounter [-] [124052] Writing DB stats nova_cell0:SELECT=3 {{(pid=124052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:40:51.164928 ncdv-master-1 devstack@n-api.service[124052]: DEBUG dbcounter [-] [124052] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=124052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:40:51.365968 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-fdc0b0b2-62a7-4313-9d56-fb191d20f125 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:40:51.434319 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-fdc0b0b2-62a7-4313-9d56-fb191d20f125 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.277755 Sep 17 20:40:51.434905 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 3/6] 10.222.0.26 () {64 vars in 1336 bytes} [Sat Sep 17 20:40:51 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:40:54.395410 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-d514b16d-0663-4acc-ae93-17464ee09f7c admin admin] Calling method '>' {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:40:54.396837 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-d514b16d-0663-4acc-ae93-17464ee09f7c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Sep 17 20:40:54.397622 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 4/7] 10.222.0.26 () {54 vars in 931 bytes} [Sat Sep 17 20:40:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:40:55.268759 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-a6711ef0-367f-47b8-ab87-e6bbd471358a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 5, "rxtx_factor": 1.0, "id": "d1"}} {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:40:55.318962 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-a6711ef0-367f-47b8-ab87-e6bbd471358a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.913986 Sep 17 20:40:55.328375 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 4/8] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Sep 17 20:40:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:40:55.332700 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-e93b323d-185f-461d-a173-21e2b491ca39 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:40:55.376868 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-e93b323d-185f-461d-a173-21e2b491ca39 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048244 Sep 17 20:40:55.391559 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 5/9] 10.222.0.26 () {64 vars in 1336 bytes} [Sat Sep 17 20:40:55 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:40:58.725219 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-a6711ef0-367f-47b8-ab87-e6bbd471358a admin admin] Calling method '>' {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:40:58.727108 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-a6711ef0-367f-47b8-ab87-e6bbd471358a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002363 Sep 17 20:40:58.730471 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 931 bytes} [Sat Sep 17 20:40:58 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:40:59.169019 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-1cbec23a-630c-44e7-b72b-0db88e483004 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "id": "d2", "rxtx_factor": 1.0, "vcpus": 1, "ram": 1024, "disk": 10, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:40:59.197076 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-1cbec23a-630c-44e7-b72b-0db88e483004 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.461831 Sep 17 20:40:59.197839 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 6/11] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Sep 17 20:40:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:40:59.211489 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-fcf0b688-199f-46ef-820d-bbcb01b9d421 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:40:59.243119 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-fcf0b688-199f-46ef-820d-bbcb01b9d421 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035568 Sep 17 20:40:59.244784 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 6/12] 10.222.0.26 () {64 vars in 1336 bytes} [Sat Sep 17 20:40:59 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:41:02.458009 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-1cbec23a-630c-44e7-b72b-0db88e483004 admin admin] Calling method '>' {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:41:02.459023 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-1cbec23a-630c-44e7-b72b-0db88e483004 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Sep 17 20:41:02.459424 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 7/13] 10.222.0.26 () {54 vars in 931 bytes} [Sat Sep 17 20:41:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:41:02.885757 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-4df3b9c3-d63c-44c0-bb04-5bf68e180ff9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "rxtx_factor": 1.0, "vcpus": 2, "swap": 0, "id": "d3", "os-flavor-access:is_public": true, "ram": 2048, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:41:02.907006 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-4df3b9c3-d63c-44c0-bb04-5bf68e180ff9 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.441325 Sep 17 20:41:02.907932 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 7/14] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Sep 17 20:41:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:41:02.919974 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-fa6f4d71-6713-4889-a633-1acc51a13989 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:41:02.948428 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-fa6f4d71-6713-4889-a633-1acc51a13989 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032187 Sep 17 20:41:02.949042 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 8/15] 10.222.0.26 () {64 vars in 1336 bytes} [Sat Sep 17 20:41:02 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:41:05.908424 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-4df3b9c3-d63c-44c0-bb04-5bf68e180ff9 admin admin] Calling method '>' {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:41:05.911077 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-4df3b9c3-d63c-44c0-bb04-5bf68e180ff9 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003158 Sep 17 20:41:05.922947 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 8/16] 10.222.0.26 () {54 vars in 931 bytes} [Sat Sep 17 20:41:05 2022] GET /compute/v2.1 => generated 388 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:41:06.359047 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-47dacf25-997b-4302-acfa-7f36a2c4079d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "rxtx_factor": 1.0, "swap": 0, "vcpus": 4, "disk": 20, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds4G"}} {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:41:06.380705 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-47dacf25-997b-4302-acfa-7f36a2c4079d admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.460923 Sep 17 20:41:06.381356 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 9/17] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Sep 17 20:41:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:41:06.393331 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-1a881361-7640-4245-b67b-f23d2b97ed7a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:41:06.418768 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-1a881361-7640-4245-b67b-f23d2b97ed7a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029038 Sep 17 20:41:06.419419 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 9/18] 10.222.0.26 () {64 vars in 1336 bytes} [Sat Sep 17 20:41:06 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:41:09.457405 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-47dacf25-997b-4302-acfa-7f36a2c4079d admin admin] Calling method '>' {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:41:09.458466 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-47dacf25-997b-4302-acfa-7f36a2c4079d admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001716 Sep 17 20:41:09.458885 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 10/19] 10.222.0.26 () {54 vars in 931 bytes} [Sat Sep 17 20:41:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:41:09.960746 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-23c83548-0568-4bd9-b362-5d49c1e463d5 admin admin] Calling method '>' {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:41:09.992990 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-23c83548-0568-4bd9-b362-5d49c1e463d5 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.526255 Sep 17 20:41:09.993662 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 10/20] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Sep 17 20:41:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:41:13.078613 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-47dacf25-997b-4302-acfa-7f36a2c4079d admin admin] Calling method '>' {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:41:13.079675 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-47dacf25-997b-4302-acfa-7f36a2c4079d admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Sep 17 20:41:13.080107 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 11/21] 10.222.0.26 () {54 vars in 931 bytes} [Sat Sep 17 20:41:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:41:13.541315 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-c7bbffa6-777f-4428-93be-07ae3d3fea38 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "vcpus": 1, "name": "m1.tiny"}} {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:41:13.565590 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-c7bbffa6-777f-4428-93be-07ae3d3fea38 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.478798 Sep 17 20:41:13.566270 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 11/22] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Sep 17 20:41:13 2022] POST /compute/v2.1/flavors => generated 402 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:41:13.579256 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-922fc3dd-6bc4-41ad-9882-79b33116fba8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:41:13.611996 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-922fc3dd-6bc4-41ad-9882-79b33116fba8 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036469 Sep 17 20:41:13.612801 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 12/23] 10.222.0.26 () {64 vars in 1333 bytes} [Sat Sep 17 20:41:13 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:41:16.710781 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-c7bbffa6-777f-4428-93be-07ae3d3fea38 admin admin] Calling method '>' {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:41:16.711798 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-c7bbffa6-777f-4428-93be-07ae3d3fea38 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Sep 17 20:41:16.712200 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 12/24] 10.222.0.26 () {54 vars in 931 bytes} [Sat Sep 17 20:41:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:41:17.119415 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-a6d82996-4f7a-40a9-adb3-1b6d23d686ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 1, "swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "rxtx_factor": 1.0, "name": "m1.small", "os-flavor-access:is_public": true}} {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:41:17.125315 ncdv-master-1 devstack@n-api.service[124051]: DEBUG dbcounter [-] [124051] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=124051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:17.140185 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-a6d82996-4f7a-40a9-adb3-1b6d23d686ce admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.421869 Sep 17 20:41:17.140736 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 13/25] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Sep 17 20:41:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:41:17.153333 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-901a1e59-875f-46ea-8747-252bab2fbcc6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:41:17.178810 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-901a1e59-875f-46ea-8747-252bab2fbcc6 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029339 Sep 17 20:41:17.179382 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 13/26] 10.222.0.26 () {64 vars in 1333 bytes} [Sat Sep 17 20:41:17 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:41:20.063879 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-a6d82996-4f7a-40a9-adb3-1b6d23d686ce admin admin] Calling method '>' {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:41:20.065767 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-a6d82996-4f7a-40a9-adb3-1b6d23d686ce admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002441 Sep 17 20:41:20.069801 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 14/27] 10.222.0.26 () {54 vars in 931 bytes} [Sat Sep 17 20:41:20 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:41:20.493497 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-a2b1540a-1402-44b2-8e6b-37df0b2cf0fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 2, "disk": 40, "os-flavor-access:is_public": true, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.medium", "swap": 0}} {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:41:20.528216 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-a2b1540a-1402-44b2-8e6b-37df0b2cf0fa admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.455237 Sep 17 20:41:20.529165 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 14/28] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Sep 17 20:41:20 2022] POST /compute/v2.1/flavors => generated 406 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:41:20.543331 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-e376aa8e-783b-48b9-b26f-d5aa92be9a6e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:41:20.575272 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-e376aa8e-783b-48b9-b26f-d5aa92be9a6e admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036803 Sep 17 20:41:20.575974 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 15/29] 10.222.0.26 () {64 vars in 1333 bytes} [Sat Sep 17 20:41:20 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:41:23.592579 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-a2b1540a-1402-44b2-8e6b-37df0b2cf0fa admin admin] Calling method '>' {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:41:23.594642 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-a2b1540a-1402-44b2-8e6b-37df0b2cf0fa admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002503 Sep 17 20:41:23.607046 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 15/30] 10.222.0.26 () {54 vars in 931 bytes} [Sat Sep 17 20:41:23 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:41:24.050640 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-91ebba04-143a-44c9-932a-e89ad6244799 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "disk": 80, "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.large", "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:41:24.070844 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-91ebba04-143a-44c9-932a-e89ad6244799 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.468313 Sep 17 20:41:24.071811 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 16/31] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Sep 17 20:41:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:41:24.087852 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-a3a239d0-6622-40ad-8a45-a7c7e5cb0353 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:41:24.094185 ncdv-master-1 devstack@n-api.service[124052]: DEBUG dbcounter [-] [124052] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=124052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:24.115558 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-a3a239d0-6622-40ad-8a45-a7c7e5cb0353 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033274 Sep 17 20:41:24.116364 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 16/32] 10.222.0.26 () {64 vars in 1333 bytes} [Sat Sep 17 20:41:24 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:41:27.068800 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-91ebba04-143a-44c9-932a-e89ad6244799 admin admin] Calling method '>' {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:41:27.069781 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-91ebba04-143a-44c9-932a-e89ad6244799 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 17 20:41:27.070162 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 17/33] 10.222.0.26 () {54 vars in 931 bytes} [Sat Sep 17 20:41:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:41:27.552824 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-c07d8a87-cb64-47c5-9e3e-b1e57e2b86ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 16384, "id": "5", "name": "m1.xlarge", "disk": 160, "vcpus": 8}} {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:41:27.574226 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-c07d8a87-cb64-47c5-9e3e-b1e57e2b86ee admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.497958 Sep 17 20:41:27.582251 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 17/34] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Sep 17 20:41:27 2022] POST /compute/v2.1/flavors => generated 408 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:41:27.588286 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-07923c51-5007-4fcd-bef9-4759268c09c6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:41:27.615867 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-07923c51-5007-4fcd-bef9-4759268c09c6 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031422 Sep 17 20:41:27.629487 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 18/35] 10.222.0.26 () {64 vars in 1333 bytes} [Sat Sep 17 20:41:27 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:41:46.651974 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-c07d8a87-cb64-47c5-9e3e-b1e57e2b86ee admin admin] Calling method '>' {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:41:46.653498 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-c07d8a87-cb64-47c5-9e3e-b1e57e2b86ee admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002350 Sep 17 20:41:46.654184 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 18/36] 10.222.0.26 () {54 vars in 931 bytes} [Sat Sep 17 20:41:46 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:41:46.670496 ncdv-master-1 devstack@n-api.service[124051]: DEBUG dbcounter [-] [124051] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=124051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:47.102296 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-16ff6eff-1964-4c05-894a-008363bfa54d admin admin] Calling method '>' {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:41:47.120437 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-16ff6eff-1964-4c05-894a-008363bfa54d admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.455731 Sep 17 20:41:47.120972 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 19/37] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Sep 17 20:41:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:41:49.016607 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-c07d8a87-cb64-47c5-9e3e-b1e57e2b86ee admin admin] Calling method '>' {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:41:49.017649 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-c07d8a87-cb64-47c5-9e3e-b1e57e2b86ee admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 17 20:41:49.018038 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 19/38] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Sep 17 20:41:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:41:49.649063 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-ba4ee974-1022-4ff8-aaf0-7e3088b93e53 admin admin] Calling method '>' {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:41:49.654844 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.wsgi [None req-ba4ee974-1022-4ff8-aaf0-7e3088b93e53 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 17 20:41:49.663111 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-ba4ee974-1022-4ff8-aaf0-7e3088b93e53 admin admin] Request method failure captured: Sep 17 20:41:49.663111 ncdv-master-1 devstack@n-api.service[124051]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 17 20:41:49.663111 ncdv-master-1 devstack@n-api.service[124051]: Accept: application/json Sep 17 20:41:49.663111 ncdv-master-1 devstack@n-api.service[124051]: Accept-Encoding: gzip, deflate Sep 17 20:41:49.663111 ncdv-master-1 devstack@n-api.service[124051]: Connection: keep-alive Sep 17 20:41:49.663111 ncdv-master-1 devstack@n-api.service[124051]: Content-Length: 0 Sep 17 20:41:49.663111 ncdv-master-1 devstack@n-api.service[124051]: Host: 10.222.0.26 Sep 17 20:41:49.663111 ncdv-master-1 devstack@n-api.service[124051]: Openstack-Api-Version: compute 2.92 Sep 17 20:41:49.663111 ncdv-master-1 devstack@n-api.service[124051]: Openstack-System-Scope: None Sep 17 20:41:49.663111 ncdv-master-1 devstack@n-api.service[124051]: User-Agent: python-novaclient Sep 17 20:41:49.663111 ncdv-master-1 devstack@n-api.service[124051]: X-Auth-Token: gAAAAABjJjEMDiz4wxgLAI-fbnTuniVn_G0YWVVsfnoYdB8tY4gAR_sp0RKHz9PQ0hHAsED2tY4-cN0MrVSIxYOUWFoeQSaCvRxTOISmNh-ERsVWou3cg_5RMXn-7QwF7EjQM-z5p3dreRBfnToqoQLaeDLaEIHuFIu5TfADy_JifptHRf1HYtM Sep 17 20:41:49.663111 ncdv-master-1 devstack@n-api.service[124051]: X-Domain-Id: None Sep 17 20:41:49.663111 ncdv-master-1 devstack@n-api.service[124051]: X-Domain-Name: None Sep 17 20:41:49.663111 ncdv-master-1 devstack@n-api.service[124051]: X-Identity-Status: Confirmed Sep 17 20:41:49.663111 ncdv-master-1 devstack@n-api.service[124051]: X-Is-Admin-Project: True Sep 17 20:41:49.663111 ncdv-master-1 devstack@n-api.service[124051]: X-Openstack-Nova-Api-Version: 2.92 Sep 17 20:41:49.663111 ncdv-master-1 devstack@n-api.service[124051]: X-Project-Domain-Id: default Sep 17 20:41:49.663111 ncdv-master-1 devstack@n-api.service[124051]: X-Project-Domain-Name: Default Sep 17 20:41:49.663111 ncdv-master-1 devstack@n-api.service[124051]: X-Project-Id: c8633d9055db49bfa42074c66a0581c2 Sep 17 20:41:49.663111 ncdv-master-1 devstack@n-api.service[124051]: X-Project-Name: admin Sep 17 20:41:49.663111 ncdv-master-1 devstack@n-api.service[124051]: X-Role: admin,member,reader Sep 17 20:41:49.663111 ncdv-master-1 devstack@n-api.service[124051]: X-Roles: admin,member,reader Sep 17 20:41:49.664648 ncdv-master-1 devstack@n-api.service[124051]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c8633d9055db49bfa42074c66a0581c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c8633d9055db49bfa42074c66a0581c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c8633d9055db49bfa42074c66a0581c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c8633d9055db49bfa42074c66a0581c2", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:41:49.664648 ncdv-master-1 devstack@n-api.service[124051]: X-Tenant: admin Sep 17 20:41:49.664648 ncdv-master-1 devstack@n-api.service[124051]: X-Tenant-Id: c8633d9055db49bfa42074c66a0581c2 Sep 17 20:41:49.664648 ncdv-master-1 devstack@n-api.service[124051]: X-Tenant-Name: admin Sep 17 20:41:49.664648 ncdv-master-1 devstack@n-api.service[124051]: X-User: admin Sep 17 20:41:49.664648 ncdv-master-1 devstack@n-api.service[124051]: X-User-Domain-Id: default Sep 17 20:41:49.664648 ncdv-master-1 devstack@n-api.service[124051]: X-User-Domain-Name: Default Sep 17 20:41:49.664648 ncdv-master-1 devstack@n-api.service[124051]: X-User-Id: fef6fab9131d4c1e89e0107005eb3caa Sep 17 20:41:49.664648 ncdv-master-1 devstack@n-api.service[124051]: X-User-Name: admin Sep 17 20:41:49.664648 ncdv-master-1 devstack@n-api.service[124051]: method: > Sep 17 20:41:49.664648 ncdv-master-1 devstack@n-api.service[124051]: exception: Flavor 42 could not be found. Sep 17 20:41:49.664648 ncdv-master-1 devstack@n-api.service[124051]: action_args: {'id': '42'} Sep 17 20:41:49.664648 ncdv-master-1 devstack@n-api.service[124051]: {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:41:49.664648 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:41:49.665660 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 17 20:41:49.665660 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 17 20:41:49.665660 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 17 20:41:49.665660 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 17 20:41:49.665660 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:41:49.665660 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:41:49.665660 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 17 20:41:49.665660 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 17 20:41:49.665660 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 17 20:41:49.665660 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:41:49.665660 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 17 20:41:49.665660 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 17 20:41:49.665660 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 17 20:41:49.665660 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi Sep 17 20:41:49.665660 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:41:49.665660 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi Sep 17 20:41:49.665660 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:41:49.665660 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:41:49.665660 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:41:49.666948 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:41:49.666948 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:41:49.666948 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:41:49.666948 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:41:49.666948 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 17 20:41:49.666948 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:41:49.666948 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 17 20:41:49.666948 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi Sep 17 20:41:49.666948 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:41:49.666948 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi Sep 17 20:41:49.666948 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:41:49.666948 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:41:49.666948 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:41:49.666948 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:41:49.666948 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:41:49.666948 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 17 20:41:49.666948 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi Sep 17 20:41:49.666948 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-ba4ee974-1022-4ff8-aaf0-7e3088b93e53 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=124051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:41:49.668026 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-ba4ee974-1022-4ff8-aaf0-7e3088b93e53 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.435307 Sep 17 20:41:49.668026 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 20/39] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Sep 17 20:41:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 436 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 17 20:41:49.674912 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-3e6e8847-2d46-489b-b4fe-5df6069bb0c5 admin admin] Calling method '>' {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:41:49.679114 ncdv-master-1 devstack@n-api.service[124052]: DEBUG dbcounter [-] [124052] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=124052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:41:49.698234 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-3e6e8847-2d46-489b-b4fe-5df6069bb0c5 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026886 Sep 17 20:41:49.698800 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 20/40] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Sep 17 20:41:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 20:41:49.713432 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-d6ddbc5c-1774-4a44-aa02-adb45d5cd23c admin admin] Calling method '>' {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:41:49.743964 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-d6ddbc5c-1774-4a44-aa02-adb45d5cd23c admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.038168 Sep 17 20:41:49.744495 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 21/41] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Sep 17 20:41:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:41:49.756593 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-c5389cec-1908-4ae9-aed7-a14cbb614026 admin admin] Calling method '>' {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:41:49.763798 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.wsgi [None req-c5389cec-1908-4ae9-aed7-a14cbb614026 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 17 20:41:49.768949 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-c5389cec-1908-4ae9-aed7-a14cbb614026 admin admin] Request method failure captured: Sep 17 20:41:49.768949 ncdv-master-1 devstack@n-api.service[124052]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 17 20:41:49.768949 ncdv-master-1 devstack@n-api.service[124052]: Accept: application/json Sep 17 20:41:49.768949 ncdv-master-1 devstack@n-api.service[124052]: Accept-Encoding: gzip, deflate Sep 17 20:41:49.768949 ncdv-master-1 devstack@n-api.service[124052]: Connection: keep-alive Sep 17 20:41:49.768949 ncdv-master-1 devstack@n-api.service[124052]: Content-Length: 0 Sep 17 20:41:49.768949 ncdv-master-1 devstack@n-api.service[124052]: Host: 10.222.0.26 Sep 17 20:41:49.768949 ncdv-master-1 devstack@n-api.service[124052]: Openstack-Api-Version: compute 2.92 Sep 17 20:41:49.768949 ncdv-master-1 devstack@n-api.service[124052]: Openstack-System-Scope: None Sep 17 20:41:49.768949 ncdv-master-1 devstack@n-api.service[124052]: User-Agent: python-novaclient Sep 17 20:41:49.768949 ncdv-master-1 devstack@n-api.service[124052]: X-Auth-Token: gAAAAABjJjEMDiz4wxgLAI-fbnTuniVn_G0YWVVsfnoYdB8tY4gAR_sp0RKHz9PQ0hHAsED2tY4-cN0MrVSIxYOUWFoeQSaCvRxTOISmNh-ERsVWou3cg_5RMXn-7QwF7EjQM-z5p3dreRBfnToqoQLaeDLaEIHuFIu5TfADy_JifptHRf1HYtM Sep 17 20:41:49.768949 ncdv-master-1 devstack@n-api.service[124052]: X-Domain-Id: None Sep 17 20:41:49.768949 ncdv-master-1 devstack@n-api.service[124052]: X-Domain-Name: None Sep 17 20:41:49.768949 ncdv-master-1 devstack@n-api.service[124052]: X-Identity-Status: Confirmed Sep 17 20:41:49.768949 ncdv-master-1 devstack@n-api.service[124052]: X-Is-Admin-Project: True Sep 17 20:41:49.768949 ncdv-master-1 devstack@n-api.service[124052]: X-Openstack-Nova-Api-Version: 2.92 Sep 17 20:41:49.768949 ncdv-master-1 devstack@n-api.service[124052]: X-Project-Domain-Id: default Sep 17 20:41:49.768949 ncdv-master-1 devstack@n-api.service[124052]: X-Project-Domain-Name: Default Sep 17 20:41:49.768949 ncdv-master-1 devstack@n-api.service[124052]: X-Project-Id: c8633d9055db49bfa42074c66a0581c2 Sep 17 20:41:49.768949 ncdv-master-1 devstack@n-api.service[124052]: X-Project-Name: admin Sep 17 20:41:49.768949 ncdv-master-1 devstack@n-api.service[124052]: X-Role: admin,member,reader Sep 17 20:41:49.768949 ncdv-master-1 devstack@n-api.service[124052]: X-Roles: admin,member,reader Sep 17 20:41:49.771068 ncdv-master-1 devstack@n-api.service[124052]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c8633d9055db49bfa42074c66a0581c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c8633d9055db49bfa42074c66a0581c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c8633d9055db49bfa42074c66a0581c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c8633d9055db49bfa42074c66a0581c2", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:41:49.771068 ncdv-master-1 devstack@n-api.service[124052]: X-Tenant: admin Sep 17 20:41:49.771068 ncdv-master-1 devstack@n-api.service[124052]: X-Tenant-Id: c8633d9055db49bfa42074c66a0581c2 Sep 17 20:41:49.771068 ncdv-master-1 devstack@n-api.service[124052]: X-Tenant-Name: admin Sep 17 20:41:49.771068 ncdv-master-1 devstack@n-api.service[124052]: X-User: admin Sep 17 20:41:49.771068 ncdv-master-1 devstack@n-api.service[124052]: X-User-Domain-Id: default Sep 17 20:41:49.771068 ncdv-master-1 devstack@n-api.service[124052]: X-User-Domain-Name: Default Sep 17 20:41:49.771068 ncdv-master-1 devstack@n-api.service[124052]: X-User-Id: fef6fab9131d4c1e89e0107005eb3caa Sep 17 20:41:49.771068 ncdv-master-1 devstack@n-api.service[124052]: X-User-Name: admin Sep 17 20:41:49.771068 ncdv-master-1 devstack@n-api.service[124052]: method: > Sep 17 20:41:49.771068 ncdv-master-1 devstack@n-api.service[124052]: exception: Flavor 42 could not be found. Sep 17 20:41:49.771068 ncdv-master-1 devstack@n-api.service[124052]: action_args: {'id': '42'} Sep 17 20:41:49.771068 ncdv-master-1 devstack@n-api.service[124052]: {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:41:49.771068 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:41:49.772055 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 17 20:41:49.772055 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 17 20:41:49.772055 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 17 20:41:49.772055 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 17 20:41:49.772055 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:41:49.772055 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:41:49.772055 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 17 20:41:49.772055 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 17 20:41:49.772055 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 17 20:41:49.772055 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:41:49.772055 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 17 20:41:49.772055 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 17 20:41:49.772055 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 17 20:41:49.772055 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi Sep 17 20:41:49.772055 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:41:49.772055 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi Sep 17 20:41:49.772055 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:41:49.772055 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:41:49.772055 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:41:49.773128 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:41:49.773128 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:41:49.773128 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:41:49.773128 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:41:49.773128 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 17 20:41:49.773128 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:41:49.773128 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 17 20:41:49.773128 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi Sep 17 20:41:49.773128 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:41:49.773128 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi Sep 17 20:41:49.773128 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:41:49.773128 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:41:49.773128 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:41:49.773128 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:41:49.773128 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:41:49.773128 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 17 20:41:49.773128 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi Sep 17 20:41:49.773128 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-c5389cec-1908-4ae9-aed7-a14cbb614026 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=124052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:41:49.774187 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-c5389cec-1908-4ae9-aed7-a14cbb614026 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.019879 Sep 17 20:41:49.774187 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 21/42] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Sep 17 20:41:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 17 20:41:51.553504 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-d6ddbc5c-1774-4a44-aa02-adb45d5cd23c admin admin] Calling method '>' {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:41:51.555242 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-d6ddbc5c-1774-4a44-aa02-adb45d5cd23c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002473 Sep 17 20:41:51.555889 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 22/43] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Sep 17 20:41:51 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:41:52.116201 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-8973e9c1-2f63-4193-ae0e-8761624d1d86 admin admin] Calling method '>' {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:41:52.121273 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.wsgi [None req-8973e9c1-2f63-4193-ae0e-8761624d1d86 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 17 20:41:52.122805 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-8973e9c1-2f63-4193-ae0e-8761624d1d86 admin admin] Request method failure captured: Sep 17 20:41:52.122805 ncdv-master-1 devstack@n-api.service[124052]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 17 20:41:52.122805 ncdv-master-1 devstack@n-api.service[124052]: Accept: application/json Sep 17 20:41:52.122805 ncdv-master-1 devstack@n-api.service[124052]: Accept-Encoding: gzip, deflate Sep 17 20:41:52.122805 ncdv-master-1 devstack@n-api.service[124052]: Connection: keep-alive Sep 17 20:41:52.122805 ncdv-master-1 devstack@n-api.service[124052]: Content-Length: 0 Sep 17 20:41:52.122805 ncdv-master-1 devstack@n-api.service[124052]: Host: 10.222.0.26 Sep 17 20:41:52.122805 ncdv-master-1 devstack@n-api.service[124052]: Openstack-Api-Version: compute 2.92 Sep 17 20:41:52.122805 ncdv-master-1 devstack@n-api.service[124052]: Openstack-System-Scope: None Sep 17 20:41:52.122805 ncdv-master-1 devstack@n-api.service[124052]: User-Agent: python-novaclient Sep 17 20:41:52.122805 ncdv-master-1 devstack@n-api.service[124052]: X-Auth-Token: gAAAAABjJjEP6kWuJAe6HB5rsvZqXYSUEsJfI9KscFf1a0RIkYtSbTFC2-uDUL55jFebZ1tOwcx1mbD26FfTUlkpsIK9o2FO8Na91bnuI_Rsea9GiL2hqgrfA0QD9J2cKHqktPD04w12GrpI5y1puHQJvOGJka-o_pdrd0N8yMFcs16N76BjO5E Sep 17 20:41:52.122805 ncdv-master-1 devstack@n-api.service[124052]: X-Domain-Id: None Sep 17 20:41:52.122805 ncdv-master-1 devstack@n-api.service[124052]: X-Domain-Name: None Sep 17 20:41:52.122805 ncdv-master-1 devstack@n-api.service[124052]: X-Identity-Status: Confirmed Sep 17 20:41:52.122805 ncdv-master-1 devstack@n-api.service[124052]: X-Is-Admin-Project: True Sep 17 20:41:52.122805 ncdv-master-1 devstack@n-api.service[124052]: X-Openstack-Nova-Api-Version: 2.92 Sep 17 20:41:52.122805 ncdv-master-1 devstack@n-api.service[124052]: X-Project-Domain-Id: default Sep 17 20:41:52.122805 ncdv-master-1 devstack@n-api.service[124052]: X-Project-Domain-Name: Default Sep 17 20:41:52.122805 ncdv-master-1 devstack@n-api.service[124052]: X-Project-Id: c8633d9055db49bfa42074c66a0581c2 Sep 17 20:41:52.122805 ncdv-master-1 devstack@n-api.service[124052]: X-Project-Name: admin Sep 17 20:41:52.122805 ncdv-master-1 devstack@n-api.service[124052]: X-Role: admin,member,reader Sep 17 20:41:52.122805 ncdv-master-1 devstack@n-api.service[124052]: X-Roles: admin,member,reader Sep 17 20:41:52.124496 ncdv-master-1 devstack@n-api.service[124052]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c8633d9055db49bfa42074c66a0581c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c8633d9055db49bfa42074c66a0581c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c8633d9055db49bfa42074c66a0581c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c8633d9055db49bfa42074c66a0581c2", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:41:52.124496 ncdv-master-1 devstack@n-api.service[124052]: X-Tenant: admin Sep 17 20:41:52.124496 ncdv-master-1 devstack@n-api.service[124052]: X-Tenant-Id: c8633d9055db49bfa42074c66a0581c2 Sep 17 20:41:52.124496 ncdv-master-1 devstack@n-api.service[124052]: X-Tenant-Name: admin Sep 17 20:41:52.124496 ncdv-master-1 devstack@n-api.service[124052]: X-User: admin Sep 17 20:41:52.124496 ncdv-master-1 devstack@n-api.service[124052]: X-User-Domain-Id: default Sep 17 20:41:52.124496 ncdv-master-1 devstack@n-api.service[124052]: X-User-Domain-Name: Default Sep 17 20:41:52.124496 ncdv-master-1 devstack@n-api.service[124052]: X-User-Id: fef6fab9131d4c1e89e0107005eb3caa Sep 17 20:41:52.124496 ncdv-master-1 devstack@n-api.service[124052]: X-User-Name: admin Sep 17 20:41:52.124496 ncdv-master-1 devstack@n-api.service[124052]: method: > Sep 17 20:41:52.124496 ncdv-master-1 devstack@n-api.service[124052]: exception: Flavor 84 could not be found. Sep 17 20:41:52.124496 ncdv-master-1 devstack@n-api.service[124052]: action_args: {'id': '84'} Sep 17 20:41:52.124496 ncdv-master-1 devstack@n-api.service[124052]: {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:41:52.124496 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:41:52.125503 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 17 20:41:52.125503 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 17 20:41:52.125503 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 17 20:41:52.125503 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 17 20:41:52.125503 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:41:52.125503 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:41:52.125503 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 17 20:41:52.125503 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 17 20:41:52.125503 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 17 20:41:52.125503 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:41:52.125503 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 17 20:41:52.125503 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 17 20:41:52.125503 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 17 20:41:52.125503 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi Sep 17 20:41:52.125503 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:41:52.125503 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi Sep 17 20:41:52.125503 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:41:52.125503 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:41:52.125503 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:41:52.126916 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:41:52.126916 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:41:52.126916 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:41:52.126916 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:41:52.126916 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 17 20:41:52.126916 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:41:52.126916 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 17 20:41:52.126916 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi Sep 17 20:41:52.126916 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:41:52.126916 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi Sep 17 20:41:52.126916 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:41:52.126916 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:41:52.126916 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:41:52.126916 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:41:52.126916 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:41:52.126916 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 17 20:41:52.126916 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi Sep 17 20:41:52.126916 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-8973e9c1-2f63-4193-ae0e-8761624d1d86 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=124052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:41:52.128180 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-8973e9c1-2f63-4193-ae0e-8761624d1d86 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.422059 Sep 17 20:41:52.128180 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 22/44] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Sep 17 20:41:51 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 423 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 17 20:41:52.134168 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-84ee23b7-56c5-46a7-8f58-938548206ed5 admin admin] Calling method '>' {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:41:52.152149 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-84ee23b7-56c5-46a7-8f58-938548206ed5 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021757 Sep 17 20:41:52.152683 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 23/45] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Sep 17 20:41:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:41:52.162942 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-fa4c906b-313d-417b-a7cb-c2449c67ae3f admin admin] Calling method '>' {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:41:52.180589 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-fa4c906b-313d-417b-a7cb-c2449c67ae3f admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021336 Sep 17 20:41:52.181124 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 23/46] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Sep 17 20:41:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:41:52.190665 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-32c64fc9-0037-4fd9-8182-ab2a46eed9ff admin admin] Calling method '>' {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:41:52.195781 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.wsgi [None req-32c64fc9-0037-4fd9-8182-ab2a46eed9ff admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 17 20:41:52.197272 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-32c64fc9-0037-4fd9-8182-ab2a46eed9ff admin admin] Request method failure captured: Sep 17 20:41:52.197272 ncdv-master-1 devstack@n-api.service[124051]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 17 20:41:52.197272 ncdv-master-1 devstack@n-api.service[124051]: Accept: application/json Sep 17 20:41:52.197272 ncdv-master-1 devstack@n-api.service[124051]: Accept-Encoding: gzip, deflate Sep 17 20:41:52.197272 ncdv-master-1 devstack@n-api.service[124051]: Connection: keep-alive Sep 17 20:41:52.197272 ncdv-master-1 devstack@n-api.service[124051]: Content-Length: 0 Sep 17 20:41:52.197272 ncdv-master-1 devstack@n-api.service[124051]: Host: 10.222.0.26 Sep 17 20:41:52.197272 ncdv-master-1 devstack@n-api.service[124051]: Openstack-Api-Version: compute 2.92 Sep 17 20:41:52.197272 ncdv-master-1 devstack@n-api.service[124051]: Openstack-System-Scope: None Sep 17 20:41:52.197272 ncdv-master-1 devstack@n-api.service[124051]: User-Agent: python-novaclient Sep 17 20:41:52.197272 ncdv-master-1 devstack@n-api.service[124051]: X-Auth-Token: gAAAAABjJjEP6kWuJAe6HB5rsvZqXYSUEsJfI9KscFf1a0RIkYtSbTFC2-uDUL55jFebZ1tOwcx1mbD26FfTUlkpsIK9o2FO8Na91bnuI_Rsea9GiL2hqgrfA0QD9J2cKHqktPD04w12GrpI5y1puHQJvOGJka-o_pdrd0N8yMFcs16N76BjO5E Sep 17 20:41:52.197272 ncdv-master-1 devstack@n-api.service[124051]: X-Domain-Id: None Sep 17 20:41:52.197272 ncdv-master-1 devstack@n-api.service[124051]: X-Domain-Name: None Sep 17 20:41:52.197272 ncdv-master-1 devstack@n-api.service[124051]: X-Identity-Status: Confirmed Sep 17 20:41:52.197272 ncdv-master-1 devstack@n-api.service[124051]: X-Is-Admin-Project: True Sep 17 20:41:52.197272 ncdv-master-1 devstack@n-api.service[124051]: X-Openstack-Nova-Api-Version: 2.92 Sep 17 20:41:52.197272 ncdv-master-1 devstack@n-api.service[124051]: X-Project-Domain-Id: default Sep 17 20:41:52.197272 ncdv-master-1 devstack@n-api.service[124051]: X-Project-Domain-Name: Default Sep 17 20:41:52.197272 ncdv-master-1 devstack@n-api.service[124051]: X-Project-Id: c8633d9055db49bfa42074c66a0581c2 Sep 17 20:41:52.197272 ncdv-master-1 devstack@n-api.service[124051]: X-Project-Name: admin Sep 17 20:41:52.197272 ncdv-master-1 devstack@n-api.service[124051]: X-Role: admin,member,reader Sep 17 20:41:52.197272 ncdv-master-1 devstack@n-api.service[124051]: X-Roles: admin,member,reader Sep 17 20:41:52.198640 ncdv-master-1 devstack@n-api.service[124051]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c8633d9055db49bfa42074c66a0581c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c8633d9055db49bfa42074c66a0581c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c8633d9055db49bfa42074c66a0581c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c8633d9055db49bfa42074c66a0581c2", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:41:52.198640 ncdv-master-1 devstack@n-api.service[124051]: X-Tenant: admin Sep 17 20:41:52.198640 ncdv-master-1 devstack@n-api.service[124051]: X-Tenant-Id: c8633d9055db49bfa42074c66a0581c2 Sep 17 20:41:52.198640 ncdv-master-1 devstack@n-api.service[124051]: X-Tenant-Name: admin Sep 17 20:41:52.198640 ncdv-master-1 devstack@n-api.service[124051]: X-User: admin Sep 17 20:41:52.198640 ncdv-master-1 devstack@n-api.service[124051]: X-User-Domain-Id: default Sep 17 20:41:52.198640 ncdv-master-1 devstack@n-api.service[124051]: X-User-Domain-Name: Default Sep 17 20:41:52.198640 ncdv-master-1 devstack@n-api.service[124051]: X-User-Id: fef6fab9131d4c1e89e0107005eb3caa Sep 17 20:41:52.198640 ncdv-master-1 devstack@n-api.service[124051]: X-User-Name: admin Sep 17 20:41:52.198640 ncdv-master-1 devstack@n-api.service[124051]: method: > Sep 17 20:41:52.198640 ncdv-master-1 devstack@n-api.service[124051]: exception: Flavor 84 could not be found. Sep 17 20:41:52.198640 ncdv-master-1 devstack@n-api.service[124051]: action_args: {'id': '84'} Sep 17 20:41:52.198640 ncdv-master-1 devstack@n-api.service[124051]: {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:41:52.198640 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:41:52.199473 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 17 20:41:52.199473 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 17 20:41:52.199473 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 17 20:41:52.199473 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 17 20:41:52.199473 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:41:52.199473 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:41:52.199473 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 17 20:41:52.199473 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 17 20:41:52.199473 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 17 20:41:52.199473 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:41:52.199473 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 17 20:41:52.199473 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 17 20:41:52.199473 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 17 20:41:52.199473 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi Sep 17 20:41:52.199473 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:41:52.199473 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi Sep 17 20:41:52.199473 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:41:52.199473 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:41:52.199473 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:41:52.200621 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:41:52.200621 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:41:52.200621 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:41:52.200621 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:41:52.200621 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 17 20:41:52.200621 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:41:52.200621 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 17 20:41:52.200621 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi Sep 17 20:41:52.200621 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:41:52.200621 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi Sep 17 20:41:52.200621 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:41:52.200621 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:41:52.200621 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:41:52.200621 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:41:52.200621 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:41:52.200621 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 17 20:41:52.200621 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi Sep 17 20:41:52.200621 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-32c64fc9-0037-4fd9-8182-ab2a46eed9ff admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=124051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:41:52.201984 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-32c64fc9-0037-4fd9-8182-ab2a46eed9ff admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011694 Sep 17 20:41:52.201984 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 24/47] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Sep 17 20:41:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 17 20:41:53.956463 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-fa4c906b-313d-417b-a7cb-c2449c67ae3f admin admin] Calling method '>' {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:41:53.957734 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-fa4c906b-313d-417b-a7cb-c2449c67ae3f admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001920 Sep 17 20:41:53.958305 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 24/48] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Sep 17 20:41:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:41:54.550720 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-742ff98e-3ad4-49e5-badd-a5a4bb440fd5 admin admin] Calling method '>' {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:41:54.556751 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.wsgi [None req-742ff98e-3ad4-49e5-badd-a5a4bb440fd5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 17 20:41:54.558276 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-742ff98e-3ad4-49e5-badd-a5a4bb440fd5 admin admin] Request method failure captured: Sep 17 20:41:54.558276 ncdv-master-1 devstack@n-api.service[124051]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 17 20:41:54.558276 ncdv-master-1 devstack@n-api.service[124051]: Accept: application/json Sep 17 20:41:54.558276 ncdv-master-1 devstack@n-api.service[124051]: Accept-Encoding: gzip, deflate Sep 17 20:41:54.558276 ncdv-master-1 devstack@n-api.service[124051]: Connection: keep-alive Sep 17 20:41:54.558276 ncdv-master-1 devstack@n-api.service[124051]: Content-Length: 0 Sep 17 20:41:54.558276 ncdv-master-1 devstack@n-api.service[124051]: Host: 10.222.0.26 Sep 17 20:41:54.558276 ncdv-master-1 devstack@n-api.service[124051]: Openstack-Api-Version: compute 2.92 Sep 17 20:41:54.558276 ncdv-master-1 devstack@n-api.service[124051]: Openstack-System-Scope: None Sep 17 20:41:54.558276 ncdv-master-1 devstack@n-api.service[124051]: User-Agent: python-novaclient Sep 17 20:41:54.558276 ncdv-master-1 devstack@n-api.service[124051]: X-Auth-Token: gAAAAABjJjER3ySG9cBA2fCtojgQP6CUSe9IPpDh0P_Wddv1V3l2g2mvT9NpAQi4L5tVd3LAJAsv1MToFgI0VuO-jFcI0giOlqFN6B8X08u2h7za45wu3ywZefCLvGYU969c8w8kL9v8G0Q2bkgkGSGACPcaVa0lWa8sVQ-Ly8KHozCFAnv6CPo Sep 17 20:41:54.558276 ncdv-master-1 devstack@n-api.service[124051]: X-Domain-Id: None Sep 17 20:41:54.558276 ncdv-master-1 devstack@n-api.service[124051]: X-Domain-Name: None Sep 17 20:41:54.558276 ncdv-master-1 devstack@n-api.service[124051]: X-Identity-Status: Confirmed Sep 17 20:41:54.558276 ncdv-master-1 devstack@n-api.service[124051]: X-Is-Admin-Project: True Sep 17 20:41:54.558276 ncdv-master-1 devstack@n-api.service[124051]: X-Openstack-Nova-Api-Version: 2.92 Sep 17 20:41:54.558276 ncdv-master-1 devstack@n-api.service[124051]: X-Project-Domain-Id: default Sep 17 20:41:54.558276 ncdv-master-1 devstack@n-api.service[124051]: X-Project-Domain-Name: Default Sep 17 20:41:54.558276 ncdv-master-1 devstack@n-api.service[124051]: X-Project-Id: c8633d9055db49bfa42074c66a0581c2 Sep 17 20:41:54.558276 ncdv-master-1 devstack@n-api.service[124051]: X-Project-Name: admin Sep 17 20:41:54.558276 ncdv-master-1 devstack@n-api.service[124051]: X-Role: admin,member,reader Sep 17 20:41:54.558276 ncdv-master-1 devstack@n-api.service[124051]: X-Roles: admin,member,reader Sep 17 20:41:54.559650 ncdv-master-1 devstack@n-api.service[124051]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c8633d9055db49bfa42074c66a0581c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c8633d9055db49bfa42074c66a0581c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c8633d9055db49bfa42074c66a0581c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c8633d9055db49bfa42074c66a0581c2", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:41:54.559650 ncdv-master-1 devstack@n-api.service[124051]: X-Tenant: admin Sep 17 20:41:54.559650 ncdv-master-1 devstack@n-api.service[124051]: X-Tenant-Id: c8633d9055db49bfa42074c66a0581c2 Sep 17 20:41:54.559650 ncdv-master-1 devstack@n-api.service[124051]: X-Tenant-Name: admin Sep 17 20:41:54.559650 ncdv-master-1 devstack@n-api.service[124051]: X-User: admin Sep 17 20:41:54.559650 ncdv-master-1 devstack@n-api.service[124051]: X-User-Domain-Id: default Sep 17 20:41:54.559650 ncdv-master-1 devstack@n-api.service[124051]: X-User-Domain-Name: Default Sep 17 20:41:54.559650 ncdv-master-1 devstack@n-api.service[124051]: X-User-Id: fef6fab9131d4c1e89e0107005eb3caa Sep 17 20:41:54.559650 ncdv-master-1 devstack@n-api.service[124051]: X-User-Name: admin Sep 17 20:41:54.559650 ncdv-master-1 devstack@n-api.service[124051]: method: > Sep 17 20:41:54.559650 ncdv-master-1 devstack@n-api.service[124051]: exception: Flavor 451 could not be found. Sep 17 20:41:54.559650 ncdv-master-1 devstack@n-api.service[124051]: action_args: {'id': '451'} Sep 17 20:41:54.559650 ncdv-master-1 devstack@n-api.service[124051]: {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:41:54.559650 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:41:54.560569 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 17 20:41:54.560569 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 17 20:41:54.560569 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 17 20:41:54.560569 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 17 20:41:54.560569 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:41:54.560569 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:41:54.560569 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 17 20:41:54.560569 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 17 20:41:54.560569 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 17 20:41:54.560569 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:41:54.560569 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 17 20:41:54.560569 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 17 20:41:54.560569 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 17 20:41:54.560569 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi Sep 17 20:41:54.560569 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:41:54.560569 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi Sep 17 20:41:54.560569 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:41:54.560569 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:41:54.560569 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:41:54.562011 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:41:54.562011 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:41:54.562011 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:41:54.562011 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:41:54.562011 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 17 20:41:54.562011 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:41:54.562011 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 17 20:41:54.562011 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi Sep 17 20:41:54.562011 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:41:54.562011 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi Sep 17 20:41:54.562011 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:41:54.562011 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:41:54.562011 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:41:54.562011 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:41:54.562011 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:41:54.562011 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 17 20:41:54.562011 ncdv-master-1 devstack@n-api.service[124051]: ERROR nova.api.openstack.wsgi Sep 17 20:41:54.562011 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-742ff98e-3ad4-49e5-badd-a5a4bb440fd5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=124051) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:41:54.563278 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-742ff98e-3ad4-49e5-badd-a5a4bb440fd5 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.444822 Sep 17 20:41:54.563278 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 25/49] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Sep 17 20:41:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 446 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 17 20:41:54.570521 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-15a07cb9-c0c0-473d-a18d-b0e82d031a62 admin admin] Calling method '>' {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:41:54.585444 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-15a07cb9-c0c0-473d-a18d-b0e82d031a62 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019458 Sep 17 20:41:54.585992 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 25/50] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Sep 17 20:41:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:41:54.595424 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-37c4ba24-f3b0-4449-97de-5ac2bc81584a admin admin] Calling method '>' {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:41:54.610751 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-37c4ba24-f3b0-4449-97de-5ac2bc81584a admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018898 Sep 17 20:41:54.611271 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 26/51] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Sep 17 20:41:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:41:54.620499 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-a6ad1cdd-a1d3-4ece-85fc-bcc4526bb793 admin admin] Calling method '>' {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:41:54.625895 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.wsgi [None req-a6ad1cdd-a1d3-4ece-85fc-bcc4526bb793 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 17 20:41:54.627444 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-a6ad1cdd-a1d3-4ece-85fc-bcc4526bb793 admin admin] Request method failure captured: Sep 17 20:41:54.627444 ncdv-master-1 devstack@n-api.service[124052]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 17 20:41:54.627444 ncdv-master-1 devstack@n-api.service[124052]: Accept: application/json Sep 17 20:41:54.627444 ncdv-master-1 devstack@n-api.service[124052]: Accept-Encoding: gzip, deflate Sep 17 20:41:54.627444 ncdv-master-1 devstack@n-api.service[124052]: Connection: keep-alive Sep 17 20:41:54.627444 ncdv-master-1 devstack@n-api.service[124052]: Content-Length: 0 Sep 17 20:41:54.627444 ncdv-master-1 devstack@n-api.service[124052]: Host: 10.222.0.26 Sep 17 20:41:54.627444 ncdv-master-1 devstack@n-api.service[124052]: Openstack-Api-Version: compute 2.92 Sep 17 20:41:54.627444 ncdv-master-1 devstack@n-api.service[124052]: Openstack-System-Scope: None Sep 17 20:41:54.627444 ncdv-master-1 devstack@n-api.service[124052]: User-Agent: python-novaclient Sep 17 20:41:54.627444 ncdv-master-1 devstack@n-api.service[124052]: X-Auth-Token: gAAAAABjJjER3ySG9cBA2fCtojgQP6CUSe9IPpDh0P_Wddv1V3l2g2mvT9NpAQi4L5tVd3LAJAsv1MToFgI0VuO-jFcI0giOlqFN6B8X08u2h7za45wu3ywZefCLvGYU969c8w8kL9v8G0Q2bkgkGSGACPcaVa0lWa8sVQ-Ly8KHozCFAnv6CPo Sep 17 20:41:54.627444 ncdv-master-1 devstack@n-api.service[124052]: X-Domain-Id: None Sep 17 20:41:54.627444 ncdv-master-1 devstack@n-api.service[124052]: X-Domain-Name: None Sep 17 20:41:54.627444 ncdv-master-1 devstack@n-api.service[124052]: X-Identity-Status: Confirmed Sep 17 20:41:54.627444 ncdv-master-1 devstack@n-api.service[124052]: X-Is-Admin-Project: True Sep 17 20:41:54.627444 ncdv-master-1 devstack@n-api.service[124052]: X-Openstack-Nova-Api-Version: 2.92 Sep 17 20:41:54.627444 ncdv-master-1 devstack@n-api.service[124052]: X-Project-Domain-Id: default Sep 17 20:41:54.627444 ncdv-master-1 devstack@n-api.service[124052]: X-Project-Domain-Name: Default Sep 17 20:41:54.627444 ncdv-master-1 devstack@n-api.service[124052]: X-Project-Id: c8633d9055db49bfa42074c66a0581c2 Sep 17 20:41:54.627444 ncdv-master-1 devstack@n-api.service[124052]: X-Project-Name: admin Sep 17 20:41:54.627444 ncdv-master-1 devstack@n-api.service[124052]: X-Role: admin,member,reader Sep 17 20:41:54.627444 ncdv-master-1 devstack@n-api.service[124052]: X-Roles: admin,member,reader Sep 17 20:41:54.629055 ncdv-master-1 devstack@n-api.service[124052]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c8633d9055db49bfa42074c66a0581c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c8633d9055db49bfa42074c66a0581c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c8633d9055db49bfa42074c66a0581c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c8633d9055db49bfa42074c66a0581c2", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:41:54.629055 ncdv-master-1 devstack@n-api.service[124052]: X-Tenant: admin Sep 17 20:41:54.629055 ncdv-master-1 devstack@n-api.service[124052]: X-Tenant-Id: c8633d9055db49bfa42074c66a0581c2 Sep 17 20:41:54.629055 ncdv-master-1 devstack@n-api.service[124052]: X-Tenant-Name: admin Sep 17 20:41:54.629055 ncdv-master-1 devstack@n-api.service[124052]: X-User: admin Sep 17 20:41:54.629055 ncdv-master-1 devstack@n-api.service[124052]: X-User-Domain-Id: default Sep 17 20:41:54.629055 ncdv-master-1 devstack@n-api.service[124052]: X-User-Domain-Name: Default Sep 17 20:41:54.629055 ncdv-master-1 devstack@n-api.service[124052]: X-User-Id: fef6fab9131d4c1e89e0107005eb3caa Sep 17 20:41:54.629055 ncdv-master-1 devstack@n-api.service[124052]: X-User-Name: admin Sep 17 20:41:54.629055 ncdv-master-1 devstack@n-api.service[124052]: method: > Sep 17 20:41:54.629055 ncdv-master-1 devstack@n-api.service[124052]: exception: Flavor 451 could not be found. Sep 17 20:41:54.629055 ncdv-master-1 devstack@n-api.service[124052]: action_args: {'id': '451'} Sep 17 20:41:54.629055 ncdv-master-1 devstack@n-api.service[124052]: {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:41:54.629055 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:41:54.630001 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 17 20:41:54.630001 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 17 20:41:54.630001 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 17 20:41:54.630001 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 17 20:41:54.630001 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:41:54.630001 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:41:54.630001 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 17 20:41:54.630001 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 17 20:41:54.630001 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 17 20:41:54.630001 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:41:54.630001 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 17 20:41:54.630001 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 17 20:41:54.630001 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 17 20:41:54.630001 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi Sep 17 20:41:54.630001 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:41:54.630001 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi Sep 17 20:41:54.630001 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:41:54.630001 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:41:54.630001 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:41:54.631199 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:41:54.631199 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:41:54.631199 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:41:54.631199 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:41:54.631199 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 17 20:41:54.631199 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:41:54.631199 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 17 20:41:54.631199 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi Sep 17 20:41:54.631199 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:41:54.631199 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi Sep 17 20:41:54.631199 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:41:54.631199 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:41:54.631199 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:41:54.631199 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:41:54.631199 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:41:54.631199 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 17 20:41:54.631199 ncdv-master-1 devstack@n-api.service[124052]: ERROR nova.api.openstack.wsgi Sep 17 20:41:54.631199 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-a6ad1cdd-a1d3-4ece-85fc-bcc4526bb793 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=124052) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:41:54.632223 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-a6ad1cdd-a1d3-4ece-85fc-bcc4526bb793 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011796 Sep 17 20:41:54.632223 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 26/52] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Sep 17 20:41:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 17 20:41:56.421808 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-37c4ba24-f3b0-4449-97de-5ac2bc81584a admin admin] Calling method '>' {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:41:56.422820 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-37c4ba24-f3b0-4449-97de-5ac2bc81584a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 Sep 17 20:41:56.423245 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 27/53] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Sep 17 20:41:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:41:56.986493 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-bd57366b-7253-4a39-a7a2-d45afc48722a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:41:57.007942 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-bd57366b-7253-4a39-a7a2-d45afc48722a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.435943 Sep 17 20:41:57.008486 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 27/54] 10.222.0.26 () {64 vars in 1235 bytes} [Sat Sep 17 20:41:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:41:58.787440 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-37c4ba24-f3b0-4449-97de-5ac2bc81584a admin admin] Calling method '>' {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:41:58.788540 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-37c4ba24-f3b0-4449-97de-5ac2bc81584a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001652 Sep 17 20:41:58.788895 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 28/55] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Sep 17 20:41:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:41:59.379723 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-d940bb67-b6c4-4512-9054-e93571ea7d33 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:41:59.401025 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-d940bb67-b6c4-4512-9054-e93571ea7d33 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.461729 Sep 17 20:41:59.401578 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 28/56] 10.222.0.26 () {64 vars in 1235 bytes} [Sat Sep 17 20:41:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:42:01.183529 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-37c4ba24-f3b0-4449-97de-5ac2bc81584a admin admin] Calling method '>' {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:42:01.184571 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-37c4ba24-f3b0-4449-97de-5ac2bc81584a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Sep 17 20:42:01.184956 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 29/57] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Sep 17 20:42:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:42:01.752649 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-b71c54f0-abda-442a-95a2-33ec8ba2b91e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:42:01.773427 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-b71c54f0-abda-442a-95a2-33ec8ba2b91e admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.441630 Sep 17 20:42:01.774071 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 29/58] 10.222.0.26 () {64 vars in 1235 bytes} [Sat Sep 17 20:42:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 17 20:42:03.551982 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-37c4ba24-f3b0-4449-97de-5ac2bc81584a admin admin] Calling method '>' {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:42:03.553058 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-37c4ba24-f3b0-4449-97de-5ac2bc81584a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Sep 17 20:42:03.553502 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 30/59] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Sep 17 20:42:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:42:04.095888 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-65674166-5757-4e14-b155-90fc738c80ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:42:04.117419 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-65674166-5757-4e14-b155-90fc738c80ff admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.416972 Sep 17 20:42:04.118009 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 30/60] 10.222.0.26 () {64 vars in 1235 bytes} [Sat Sep 17 20:42:03 2022] POST /compute/v2.1/flavors => generated 409 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:42:05.902492 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-37c4ba24-f3b0-4449-97de-5ac2bc81584a admin admin] Calling method '>' {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:42:05.903506 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-37c4ba24-f3b0-4449-97de-5ac2bc81584a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 17 20:42:05.903915 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 31/61] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Sep 17 20:42:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:42:06.469063 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-7fb81e23-d687-42d9-9e9e-e25c24cea485 admin admin] Calling method '>' {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:42:06.489741 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-7fb81e23-d687-42d9-9e9e-e25c24cea485 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.440542 Sep 17 20:42:06.490462 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 31/62] 10.222.0.26 () {60 vars in 1202 bytes} [Sat Sep 17 20:42:06 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:43:11.932776 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-37c4ba24-f3b0-4449-97de-5ac2bc81584a admin admin] Calling method '>' {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:43:11.933887 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-37c4ba24-f3b0-4449-97de-5ac2bc81584a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001774 Sep 17 20:43:11.934287 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 32/63] 10.222.0.26 () {54 vars in 931 bytes} [Sat Sep 17 20:43:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:43:11.942538 ncdv-master-1 devstack@n-api.service[124052]: DEBUG dbcounter [-] [124052] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=124052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:43:12.348239 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-95f3d26d-af1e-4b2d-b43c-039762789f58 admin admin] Calling method '>' {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:43:12.369023 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-95f3d26d-af1e-4b2d-b43c-039762789f58 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.428180 Sep 17 20:43:12.369604 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 32/64] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Sep 17 20:43:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:43:12.397666 ncdv-master-1 devstack@n-api.service[124051]: DEBUG dbcounter [-] [124051] Writing DB stats nova_api:SELECT=14 {{(pid=124051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:43:12.402778 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-26295bb3-8490-489b-8f3c-f4f8752cc74e admin admin] Calling method '>' {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:43:12.413409 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-26295bb3-8490-489b-8f3c-f4f8752cc74e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017864 Sep 17 20:43:12.414052 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 33/65] 10.222.0.26 () {60 vars in 1283 bytes} [Sat Sep 17 20:43:12 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:43:12.426066 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-346db4a6-8ede-404d-ace5-503d0883e91f admin admin] Calling method '>' {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:43:12.433319 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-346db4a6-8ede-404d-ace5-503d0883e91f admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010959 Sep 17 20:43:12.433858 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 33/66] 10.222.0.26 () {60 vars in 1286 bytes} [Sat Sep 17 20:43:12 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:43:12.445493 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-93a4a2f9-69c0-424c-a883-c02e19c047f2 admin admin] Calling method '>' {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:43:12.452827 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-93a4a2f9-69c0-424c-a883-c02e19c047f2 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011133 Sep 17 20:43:12.453341 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 34/67] 10.222.0.26 () {60 vars in 1286 bytes} [Sat Sep 17 20:43:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:43:12.465029 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-b3a5455a-7879-4492-b034-cbbc34b71dfa admin admin] Calling method '>' {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:43:12.472345 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-b3a5455a-7879-4492-b034-cbbc34b71dfa admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010890 Sep 17 20:43:12.472858 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 34/68] 10.222.0.26 () {60 vars in 1283 bytes} [Sat Sep 17 20:43:12 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:48:50.516454 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-93a4a2f9-69c0-424c-a883-c02e19c047f2 admin admin] Calling method '>' {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:48:50.517508 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-93a4a2f9-69c0-424c-a883-c02e19c047f2 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 17 20:48:50.517904 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 35/69] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Sep 17 20:48:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:48:50.671590 ncdv-master-1 devstack@n-api.service[124052]: DEBUG dbcounter [-] [124052] Writing DB stats nova_api:SELECT=6 {{(pid=124052) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:48:50.820234 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-7821ab1b-bd87-4e0a-b88b-7b587b48b154 admin admin] Calling method '>' {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:48:50.827683 ncdv-master-1 devstack@n-api.service[124052]: DEBUG oslo_concurrency.lockutils [None req-7821ab1b-bd87-4e0a-b88b-7b587b48b154 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:48:50.828391 ncdv-master-1 devstack@n-api.service[124052]: DEBUG oslo_concurrency.lockutils [None req-7821ab1b-bd87-4e0a-b88b-7b587b48b154 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:48:50.828911 ncdv-master-1 devstack@n-api.service[124052]: DEBUG oslo_concurrency.lockutils [None req-7821ab1b-bd87-4e0a-b88b-7b587b48b154 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:48:50.830001 ncdv-master-1 devstack@n-api.service[124052]: DEBUG oslo_concurrency.lockutils [None req-7821ab1b-bd87-4e0a-b88b-7b587b48b154 admin admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:48:50.830610 ncdv-master-1 devstack@n-api.service[124052]: DEBUG oslo_concurrency.lockutils [None req-7821ab1b-bd87-4e0a-b88b-7b587b48b154 admin admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:48:50.831243 ncdv-master-1 devstack@n-api.service[124052]: DEBUG oslo_concurrency.lockutils [None req-7821ab1b-bd87-4e0a-b88b-7b587b48b154 admin admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:48:50.870167 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-7821ab1b-bd87-4e0a-b88b-7b587b48b154 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.92 time: 0.199797 Sep 17 20:48:50.870738 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 35/70] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Sep 17 20:48:50 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:48:52.516769 ncdv-master-1 devstack@n-api.service[124051]: DEBUG nova.api.openstack.wsgi [None req-93a4a2f9-69c0-424c-a883-c02e19c047f2 admin admin] Calling method '>' {{(pid=124051) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:48:52.517823 ncdv-master-1 devstack@n-api.service[124051]: INFO nova.api.openstack.requestlog [None req-93a4a2f9-69c0-424c-a883-c02e19c047f2 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 17 20:48:52.518210 ncdv-master-1 devstack@n-api.service[124051]: [pid: 124051|app: 0|req: 36/71] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Sep 17 20:48:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:48:52.727459 ncdv-master-1 devstack@n-api.service[124052]: DEBUG nova.api.openstack.wsgi [None req-15f23448-7804-4ce5-a011-dd5003a6ff24 admin admin] Calling method '>' {{(pid=124052) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:48:52.730880 ncdv-master-1 devstack@n-api.service[124052]: DEBUG oslo_concurrency.lockutils [None req-15f23448-7804-4ce5-a011-dd5003a6ff24 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:48:52.731356 ncdv-master-1 devstack@n-api.service[124052]: DEBUG oslo_concurrency.lockutils [None req-15f23448-7804-4ce5-a011-dd5003a6ff24 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:48:52.731780 ncdv-master-1 devstack@n-api.service[124052]: DEBUG oslo_concurrency.lockutils [None req-15f23448-7804-4ce5-a011-dd5003a6ff24 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:48:52.732481 ncdv-master-1 devstack@n-api.service[124052]: DEBUG oslo_concurrency.lockutils [None req-15f23448-7804-4ce5-a011-dd5003a6ff24 admin admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:48:52.732917 ncdv-master-1 devstack@n-api.service[124052]: DEBUG oslo_concurrency.lockutils [None req-15f23448-7804-4ce5-a011-dd5003a6ff24 admin admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:48:52.733328 ncdv-master-1 devstack@n-api.service[124052]: DEBUG oslo_concurrency.lockutils [None req-15f23448-7804-4ce5-a011-dd5003a6ff24 admin admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124052) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:48:52.756031 ncdv-master-1 devstack@n-api.service[124052]: INFO nova.api.openstack.requestlog [None req-15f23448-7804-4ce5-a011-dd5003a6ff24 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.92 time: 0.091119 Sep 17 20:48:52.756587 ncdv-master-1 devstack@n-api.service[124052]: [pid: 124052|app: 0|req: 36/72] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Sep 17 20:48:52 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:49:38.475955 ncdv-master-1 devstack@n-api.service[124050]: Sat Sep 17 20:49:38 2022 - graceful shutdown triggered... Sep 17 20:49:38.476566 ncdv-master-1 devstack@n-api.service[124051]: Gracefully killing worker 1 (pid: 124051)... Sep 17 20:49:38.476045 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Sep 17 20:49:38.477420 ncdv-master-1 devstack@n-api.service[124052]: Gracefully killing worker 2 (pid: 124052)... Sep 17 20:49:38.620765 ncdv-master-1 devstack@n-api.service[124051]: DEBUG dbcounter [-] [124051] Writing DB stats nova_api:SELECT=4 {{(pid=124051) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:49:39.477314 ncdv-master-1 devstack@n-api.service[124050]: worker 1 buried after 1 seconds Sep 17 20:49:39.477314 ncdv-master-1 devstack@n-api.service[124050]: worker 2 buried after 1 seconds Sep 17 20:49:39.477314 ncdv-master-1 devstack@n-api.service[124050]: goodbye to uWSGI. Sep 17 20:49:39.479745 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. Sep 17 20:49:39.480835 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Sep 17 20:49:39.484226 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Sep 17 20:49:39.532967 ncdv-master-1 devstack@n-api.service[140506]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 17 20:49:39.535689 ncdv-master-1 devstack@n-api.service[140506]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 17 20:49:39 2022] *** Sep 17 20:49:39.535689 ncdv-master-1 devstack@n-api.service[140506]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 17 20:49:39.535689 ncdv-master-1 devstack@n-api.service[140506]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 17 20:49:39.535689 ncdv-master-1 devstack@n-api.service[140506]: nodename: ncdv-master-1 Sep 17 20:49:39.535689 ncdv-master-1 devstack@n-api.service[140506]: machine: x86_64 Sep 17 20:49:39.535689 ncdv-master-1 devstack@n-api.service[140506]: clock source: unix Sep 17 20:49:39.535689 ncdv-master-1 devstack@n-api.service[140506]: pcre jit disabled Sep 17 20:49:39.535689 ncdv-master-1 devstack@n-api.service[140506]: detected number of CPU cores: 4 Sep 17 20:49:39.535689 ncdv-master-1 devstack@n-api.service[140506]: current working directory: / Sep 17 20:49:39.535689 ncdv-master-1 devstack@n-api.service[140506]: detected binary path: /usr/bin/uwsgi-core Sep 17 20:49:39.535689 ncdv-master-1 devstack@n-api.service[140506]: your processes number limit is 47680 Sep 17 20:49:39.535689 ncdv-master-1 devstack@n-api.service[140506]: your memory page size is 4096 bytes Sep 17 20:49:39.535689 ncdv-master-1 devstack@n-api.service[140506]: detected max file descriptor number: 2048 Sep 17 20:49:39.535689 ncdv-master-1 devstack@n-api.service[140506]: lock engine: pthread robust mutexes Sep 17 20:49:39.536828 ncdv-master-1 devstack@n-api.service[140506]: thunder lock: enabled Sep 17 20:49:39.536828 ncdv-master-1 devstack@n-api.service[140506]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 17 20:49:39.536828 ncdv-master-1 devstack@n-api.service[140506]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 17 20:49:39.581729 ncdv-master-1 devstack@n-api.service[140506]: Python main interpreter initialized at 0x56045de079c0 Sep 17 20:49:39.581729 ncdv-master-1 devstack@n-api.service[140506]: python threads support enabled Sep 17 20:49:39.581729 ncdv-master-1 devstack@n-api.service[140506]: your server socket listen backlog is limited to 100 connections Sep 17 20:49:39.581729 ncdv-master-1 devstack@n-api.service[140506]: your mercy for graceful operations on workers is 90 seconds Sep 17 20:49:39.582222 ncdv-master-1 devstack@n-api.service[140506]: mapped 403077 bytes (393 KB) for 2 cores Sep 17 20:49:39.582222 ncdv-master-1 devstack@n-api.service[140506]: *** Operational MODE: preforking *** Sep 17 20:49:39.582446 ncdv-master-1 devstack@n-api.service[140506]: *** uWSGI is running in multiple interpreter mode *** Sep 17 20:49:39.582446 ncdv-master-1 devstack@n-api.service[140506]: spawned uWSGI master process (pid: 140506) Sep 17 20:49:39.582634 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Sep 17 20:49:39.585496 ncdv-master-1 devstack@n-api.service[140506]: spawned uWSGI worker 1 (pid: 140523, cores: 1) Sep 17 20:49:39.585496 ncdv-master-1 devstack@n-api.service[140506]: spawned uWSGI worker 2 (pid: 140524, cores: 1) Sep 17 20:49:39.585496 ncdv-master-1 devstack@n-api.service[140506]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 17 20:49:40.883015 ncdv-master-1 devstack@n-api.service[140524]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 17 20:49:40.883813 ncdv-master-1 devstack@n-api.service[140523]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 17 20:49:41.633990 ncdv-master-1 devstack@n-api.service[140524]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 20:49:41.633990 ncdv-master-1 devstack@n-api.service[140524]: from cryptography.utils import int_from_bytes Sep 17 20:49:41.634329 ncdv-master-1 devstack@n-api.service[140523]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 20:49:41.634329 ncdv-master-1 devstack@n-api.service[140523]: from cryptography.utils import int_from_bytes Sep 17 20:49:41.634468 ncdv-master-1 devstack@n-api.service[140524]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 20:49:41.634468 ncdv-master-1 devstack@n-api.service[140524]: from cryptography.utils import int_from_bytes Sep 17 20:49:41.634609 ncdv-master-1 devstack@n-api.service[140523]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 20:49:41.634609 ncdv-master-1 devstack@n-api.service[140523]: from cryptography.utils import int_from_bytes Sep 17 20:49:44.033281 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 17 20:49:44.033913 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 17 20:49:44.034096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 17 20:49:44.034448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 17 20:49:44.034706 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 17 20:49:44.035090 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.035417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.035747 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.036049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.036399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.036719 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.037018 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.037337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.037700 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.037960 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.038274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.038597 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.038918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.039220 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.039543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.039843 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.040149 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.044156 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.044156 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.044156 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.044156 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.044156 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.044156 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.046319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.046319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.046319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.046319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.046319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.046319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.046737 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 17 20:49:44.047119 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.047205 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 17 20:49:44.047291 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.047291 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.047447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 17 20:49:44.047529 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.047613 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 17 20:49:44.047696 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.047778 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 17 20:49:44.047861 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.047945 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.048023 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.048094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.048165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.048248 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.048323 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.048395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.048467 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.048545 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.048632 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.048721 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.048794 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.048866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.048949 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.049032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.049104 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.049188 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.049269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.049347 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.049421 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.050401 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.050576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.050740 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.050910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.051062 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.051354 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.051497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.051604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.051703 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.051798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.051895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.051989 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.052081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.052198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.052198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.052385 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.052385 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.052556 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.052556 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.052556 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.052804 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.052910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.053011 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.053100 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.053195 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.053293 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.053496 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.053655 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.053837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.053998 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.054105 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.054201 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.054453 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.054593 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.054783 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.054939 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.055054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.055145 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.055409 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.055557 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.055674 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.055775 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.056017 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.056220 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.056371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.056476 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.056625 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.056779 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.056919 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.057009 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.057259 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.057410 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.057656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.057770 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.057935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.058076 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.058226 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.058343 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.058582 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.058733 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.058926 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.059080 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.059185 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.059323 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.059535 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.059674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.059843 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.059953 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.060149 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.060328 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.060425 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.060573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.060743 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.060888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.061063 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.061169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.061373 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.061559 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.061705 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.061805 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.061945 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.062118 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.062254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.062431 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.062614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.062758 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.062908 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.063059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.063208 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.063355 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.063497 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.063647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.063814 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.063961 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.064101 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.064249 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.064391 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.064537 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.064686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.064835 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.064975 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.065114 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.065264 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.065421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.065574 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.065725 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.065823 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.066024 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.066130 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.066338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.066446 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.066642 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.066738 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.066948 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.067054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.067260 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.067365 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.067576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.067682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.067879 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.067989 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.068181 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.068278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.068488 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.068591 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.068794 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.068890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.069112 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.069215 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.069417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.069615 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.069761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.069867 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.070069 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.070166 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.070374 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.070470 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.070678 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.070783 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.070992 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.071102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.071298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.071403 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.071588 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.071711 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.071911 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.072026 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.072223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.072344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.072526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.072630 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.072843 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.072950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.073146 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.073245 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.073402 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.073519 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.073720 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.073831 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.074031 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.074132 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.074396 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.074496 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.074704 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.074812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.075008 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.075108 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.075312 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.075413 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.075610 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.075711 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.075924 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.076025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.076237 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.076336 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.076543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.076646 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.076855 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.076946 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.077154 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.077246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.077560 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.077660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.077805 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.077910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.078118 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.078326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.078425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.078520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.078725 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.078827 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.079051 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.079160 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.079375 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.079467 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.079686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.079779 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.079997 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.080099 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.080308 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.080413 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.080632 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.080737 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.080956 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.081050 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.081269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.081361 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.081616 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.081735 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.081993 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.082219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.082340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.082597 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.082718 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.082878 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.082983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.083190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.083300 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.083505 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.083606 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.083823 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.083934 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.084131 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.084231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.084448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.084549 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.084774 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.084881 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.085086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.085187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.085394 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.085530 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.085781 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.085884 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.086033 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.086136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.086339 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.086473 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.086642 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.086753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.087061 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.087192 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.087280 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.087367 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.087551 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.087694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.087876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.088062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.088231 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.088362 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.088544 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.088656 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.088856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.088954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.089167 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.089288 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.089492 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.089606 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 20:49:44.089835 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.089944 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.090179 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.090351 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.090588 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.090747 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.090892 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.091036 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.091196 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.091357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.091515 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.091673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.091827 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.092002 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.092272 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.092421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.092568 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.092719 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.092865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.093026 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.093174 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.093326 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.093506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.093682 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.093836 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.093997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.094149 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.094309 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.094455 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.094601 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.094753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.094914 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.095068 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.095222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.095381 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.095535 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.095703 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.095877 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.096094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.096245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.096400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.096548 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.096708 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.096864 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.097217 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.097384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.097559 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.097709 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.097899 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.098085 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.098085 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.098530 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.098678 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.098883 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.099046 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.099206 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.099354 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.099507 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.099664 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.099809 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.099970 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.099970 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.100257 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.100409 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.100554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.100816 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.100980 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.101135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.101280 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.101437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.101617 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.101780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.101926 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.102071 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.102215 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.102460 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.102619 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.102776 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.102959 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.103110 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.103270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.103424 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.103578 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.103740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.103886 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.104048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.104286 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.104459 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.104622 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.104776 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.104930 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.105087 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.105234 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.105387 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.105615 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.105778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.105935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.106108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.106328 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.106481 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.106651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.106808 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.106960 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.107264 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.107484 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.107634 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.107789 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.107936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.108090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.108251 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.108513 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.108683 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.108830 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.108997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.108997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.109293 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.109439 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.109624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.109774 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.109919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.110065 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.110218 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.110365 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.110521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.110727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.110978 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.111152 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.111308 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.111457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.111620 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.111833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.111984 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.112143 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.112297 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.112472 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.112693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.112850 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.113004 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.113175 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.113330 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.113520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.113672 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.113827 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.113979 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.114134 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.114279 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.114434 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.114590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.114736 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.114888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.115035 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.115193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.115353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.115499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.115653 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.115798 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.115951 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.116229 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.116465 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.116616 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.116763 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.116914 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.117067 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.117353 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.117593 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.117755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.117903 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.118048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.118193 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.118352 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.118516 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.118669 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.118825 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.118979 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.119135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.119296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.119442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.119610 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.119757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.119910 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.120054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.120212 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.120360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.120504 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.120665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.120825 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.120999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.121256 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.121408 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.121613 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.121861 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.122012 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.122168 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.122325 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.122471 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.122624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.122850 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.123016 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.123178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.123330 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.123475 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.123628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.123785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.123930 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.124086 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.124239 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.124385 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.124538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.124684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.124845 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.125005 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.125152 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.125297 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.125448 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.125637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.125814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.125964 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.126123 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.126269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.126421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.126664 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.126824 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.126971 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.127125 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.127280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.127659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.127822 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.127979 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.128145 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.128303 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.128451 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.128604 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.128760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.128906 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.129058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.129204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.129358 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.129524 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.129698 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.129853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.129998 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.130153 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.130300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.130455 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.130619 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.130772 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.130927 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.130927 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.131414 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.131571 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.131727 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.131874 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.132019 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.132188 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.132188 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.132188 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.132629 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.132784 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.133021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.133185 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.133338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.133521 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.133674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.133828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.133981 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.134128 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.134360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.134911 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.135075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.135223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.135384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.135532 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.135678 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.135838 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.135992 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.136138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.136138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.136454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.136724 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.137009 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.137161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.137306 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.137499 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.137743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.137907 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.138063 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.138210 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.138365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.138520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.138667 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.138840 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.138840 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.139137 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.139282 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.139427 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.139579 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.139742 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.139896 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.140041 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.140194 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.140340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.140485 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.140652 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.140803 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.140970 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.141125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.141278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.141433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.141433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.141846 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.141999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.142151 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.142296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.142456 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.142456 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.142742 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.142887 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.143129 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.143291 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.143447 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.143601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.143754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.143908 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.143908 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.144202 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.144363 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.144528 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.144673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.144827 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.144982 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.145168 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.145315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.145521 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.145674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.145915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.146072 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.146227 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.146383 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.146529 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.146685 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.146846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.147017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.147245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.147245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.147547 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.147731 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.147883 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.148029 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.148175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.148328 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.148473 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.148628 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.148773 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.148919 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.149063 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.149218 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.149382 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.149566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.149725 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.149878 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.150033 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.150188 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.150350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.150520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.150682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.150915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.151067 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.151224 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.151392 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.151539 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.151684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.151857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.152096 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.152248 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.152429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.152600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.152749 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.152903 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.153059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.153284 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.153917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.154084 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.154241 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.154388 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.154543 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.154697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.154853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.154999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.155145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.155291 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.155436 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.155590 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.155736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.155881 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.156045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.156192 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.156337 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.156492 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.156647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.156798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.156949 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.157112 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.157349 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.157545 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.157706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.157867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.158034 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.158186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.158186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.158486 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.158652 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.158812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.158973 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.159125 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.159287 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.159287 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.159585 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.159740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.159899 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.160072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.160235 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.160388 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.160549 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.160727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.160882 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.161034 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.161194 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.161355 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.161538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.161716 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.161871 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.162024 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.162292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.162460 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.162614 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.162777 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.162930 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.163082 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.163233 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.163468 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.163635 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.163799 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.163960 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.164114 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.164114 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.164429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.164597 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.164750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.164905 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.165057 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.165209 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.165361 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.165544 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.165712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.165874 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.166037 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.166192 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.166352 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.166525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.166678 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.166830 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.166990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.167143 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.167302 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.167560 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.167719 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.167872 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.168105 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.168271 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.168439 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.168609 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.168761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.168922 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.169077 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.169230 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.169394 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.169573 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.169740 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.169895 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.170053 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.170216 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.170417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.170580 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.170762 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.170917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.171069 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.171222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.171382 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.171544 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.171695 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.171858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.172027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.172191 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.172446 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.172605 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.172766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.172938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.173099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.173263 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.173416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.173687 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.173844 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.173997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.174163 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.174332 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.174493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.174655 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.174819 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.174982 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.175134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.175296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.175450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.175611 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.175764 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.175916 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.176077 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.176232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.176383 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.176545 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.176705 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.176945 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.177125 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.177290 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.177452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.177708 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.177865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.178018 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.178263 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.178428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.178591 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.178752 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.178914 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.179067 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.179229 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.179403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.179564 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.179727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.179891 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.180045 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.180218 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.180382 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.180536 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.180710 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.181829 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.182017 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.182188 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.182352 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.182621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.182785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.182947 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.183117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.183271 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.183432 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.183593 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.183860 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.184031 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.184196 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.184350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.184502 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.184654 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.184819 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.184971 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.185137 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.185299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.185528 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.185688 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.185842 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.186008 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.186338 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.186690 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.186847 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.187010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.187178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.187416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.187572 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.187750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.187989 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.188150 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.188310 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.188472 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.188627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.188780 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.188933 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.189087 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.189240 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.189418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.189609 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.189765 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.189918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.190072 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.190239 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.190394 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.190554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.190713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.190870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.191030 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.191195 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.191356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.191532 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.191686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.191847 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.192000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.192167 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.192331 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.192484 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.192663 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.192915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.193073 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.193237 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.193390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.193602 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.193782 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.194018 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.194189 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.194345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.194498 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.194659 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.194812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.194965 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.195126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.195290 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.195458 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.195613 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.195780 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.195945 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.196111 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.196273 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.196435 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.196597 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.196749 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.196909 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.197071 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.197232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.197386 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.197570 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.197735 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.197910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.198152 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.198311 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.198475 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.198629 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.198788 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.198956 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.199117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.199294 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.199490 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.199654 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.199807 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.199969 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.200133 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.200286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.200446 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.200602 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.200762 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.200932 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.201086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.201253 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.201407 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.201583 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.201750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.201905 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.202055 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.202219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.202370 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.202530 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.202693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.202855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.203115 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.203285 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.203438 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.203600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.203764 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.203916 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.204158 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.204158 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.204642 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.204810 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.204979 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.205133 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.205285 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.205440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.205634 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.205803 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.205956 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.205956 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.206254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.206408 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.206578 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.206748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.206912 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.207078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.207246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.207413 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.207575 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.207737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.207892 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.208052 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.208302 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.208476 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.208638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.208803 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.208956 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.209109 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.209260 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.209429 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.209621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.209786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.209947 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.210696 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.210872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.211122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.211288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.211442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.211611 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.211765 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.211928 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.212094 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.212255 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.212418 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.212580 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.212827 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.212999 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.213764 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.213930 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.214084 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.214332 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.214493 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.214661 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.214816 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.215007 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.215172 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.215333 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.215496 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.215496 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.262661 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.266328 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.266842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.266968 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.267054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.267124 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.267265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.267384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.267458 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.267520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.267635 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.267708 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.267860 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.267931 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.267998 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.268053 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.268115 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.268215 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.268288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.268344 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.268415 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.268512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.268634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.268711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.268780 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.268836 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.268907 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.268971 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.269027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.269089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.269156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.269236 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.269236 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.269444 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.269597 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.269671 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.269728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.269782 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.269854 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.269933 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.269999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.270067 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.270125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.270258 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.270359 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.270463 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.270550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.270622 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.270679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.270742 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.270799 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.270860 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.270928 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.271010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.271110 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.271217 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.271289 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.271346 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.271401 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.271469 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.271537 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.271612 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.271682 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.271750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.271817 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.271884 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.271959 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.272030 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.272097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.272164 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.272231 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.272298 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.272373 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.272443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.272510 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.272577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.272652 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.272721 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.272789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.272856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.272924 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.272998 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.273068 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.273135 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.273203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.273270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.273344 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.273413 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.273501 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.273573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.273640 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.273708 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.273789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.273860 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.273928 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.273996 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.274063 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.274144 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.274214 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.274282 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.274349 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.274417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.274484 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.274559 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.274653 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.274724 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.275237 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.275322 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.275393 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.275461 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.275529 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.275606 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.275676 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.275745 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.275813 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.275881 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.275967 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.276046 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.276117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.276117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.276241 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.276317 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.276388 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.276388 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.276512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.276583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.276652 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.276727 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.276798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.276867 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.276936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.277005 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.277081 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.277151 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.277219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.277287 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.277356 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.277452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.277681 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.277744 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.277801 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.277858 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.277914 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.277914 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.278022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.278080 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.278136 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.278192 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.278248 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.278304 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.278367 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.278785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.278845 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.278901 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.278957 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.279020 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.279078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.279149 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.279218 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.279288 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.279357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.279433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.279503 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.279572 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.279630 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.279686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.279742 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.279806 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.279877 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.279946 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.280015 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.280120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.280276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.280359 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.280470 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.280590 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.280673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.280733 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.280798 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.280911 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.281006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.281094 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.281153 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.281222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.281300 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.281372 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.281525 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.281603 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.281603 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.281838 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.281945 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.282021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.282092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.282185 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.282296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.282296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.282446 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.282446 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.282550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.282607 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.282676 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.282753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.282856 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.282932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.283002 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.283071 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.283140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.283224 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.283335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.283410 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.283481 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.283571 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.283684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.283812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.283888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.283959 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.284062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.284161 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.284263 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.284338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.284409 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.285192 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.285192 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.285192 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.285192 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.285192 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.285192 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.285591 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.285666 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.285666 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.285791 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.285860 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.285938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.286017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.286087 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.286157 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.286223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.286293 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.286362 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.286439 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.286510 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.286579 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.286647 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.286715 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.286784 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.286860 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.286931 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.286999 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.287068 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.287136 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.287212 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.287343 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.287439 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.287532 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.287632 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.287724 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.287825 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.287919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.287919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.288089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.288181 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.288289 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.288289 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.288507 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.288617 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.288726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.288726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.288929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.289045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.289164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.289274 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.289382 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.289573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.289699 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.289811 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.289919 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.290028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.290137 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.290245 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.290362 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.290472 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.290581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.290581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.290786 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.290896 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.291014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.291014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.291219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.291219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.291423 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.291532 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.291650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.291650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.291857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.291966 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.292074 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.292192 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.292302 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.292302 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.292302 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.292302 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.292302 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.292302 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.292302 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.292302 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.293120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.293120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.293120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.293427 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.293556 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.293556 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.293758 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.293866 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.293975 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.294098 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.294213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.294324 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.294433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.294542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.294659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.294769 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.294880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.294989 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.295097 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.295325 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.295325 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.295546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.295656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.295656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.295656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.295656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.295656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.295656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.295656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.296345 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.296454 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.296572 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.296786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.296786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.297015 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.297127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.297127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.297333 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.297442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.297570 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.297693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.297693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.297693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.297997 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.298108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.298256 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.298377 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.298377 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.298377 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.298377 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.298377 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.298883 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.298993 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.298993 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.299215 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.299326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.299436 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.299545 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.299545 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.299759 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.299871 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.299981 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.300091 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.300091 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.300299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.300418 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.300529 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.300639 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.300639 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.300846 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.300846 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.301115 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.301226 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.301336 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.301336 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.301590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.301714 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.301714 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.301924 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.302034 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.302034 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.302242 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.302360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.302360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.302568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.302679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.302679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.302886 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.303004 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.303004 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.303214 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.303326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.303326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.303541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.303652 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.303652 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.303867 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.303978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.304089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.304209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.304607 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.304758 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.304978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.305093 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.305296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.305543 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.305829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.306103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.306228 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.306537 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.306694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.307139 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.307325 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.307440 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.307662 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.307924 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.308135 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.308393 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.308538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.308793 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.309182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.309449 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.309679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.309823 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.309952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.310220 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.310415 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.310573 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.310813 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.310949 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.311153 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.311287 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.311525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.311661 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.311831 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.311967 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.312191 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.312327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.312517 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.312685 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.312819 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.312945 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.313150 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.313285 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.313491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.313643 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.313822 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.314018 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.315673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.315673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.315954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.316104 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.316360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.316497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.316497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.316839 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.316980 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.317206 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.317338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.317485 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.317632 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.317761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.317901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.317901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.318154 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.318281 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.318457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.318589 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.318725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.318853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.318853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.319096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.319223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.319368 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.319497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.319624 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.319751 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.319877 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.320005 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.320190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.320326 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.320525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.320659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.320868 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.321010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.321210 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.321345 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.321565 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.321701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.321883 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.322017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.322207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.322394 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.322554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.322762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.322960 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.323103 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.323287 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.323430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.323616 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.323750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.323950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.324099 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.324296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.324528 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.324662 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.324850 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.324983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.325120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 17 20:49:44.325248 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.325603 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.325925 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.326386 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.326766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.327072 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.327416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.327729 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.328060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.328360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.328675 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.329003 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.329321 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.329659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.329975 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.330292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.330605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.330920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.331231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.331544 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.331863 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.332175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.332488 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.332800 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.333111 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.333421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.333758 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.334075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.334403 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.334809 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.335061 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.335357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.335670 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.336070 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.336540 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.336943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.337251 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.337589 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.337977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.338360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.338634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.339006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.339312 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.339647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.340462 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.340462 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.340735 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.341081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.345197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.345197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.345197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.345197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.345197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.345197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.345197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.345197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.346336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.346336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.346336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.346336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.346336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.346336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.347243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.347243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.347243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.347569 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.347763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.348020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.348348 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.348670 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.349007 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.349348 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.349678 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.350017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.350354 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.350717 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.351042 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.351398 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.351736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.352060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.352383 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.352698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 20:49:44.352948 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=140523) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 17 20:49:44.398021 ncdv-master-1 devstack@n-api.service[140524]: INFO dbcounter [None req-27b7475f-2f80-4d18-a2de-c02951edae24 None None] Registered counter for database nova_api Sep 17 20:49:44.419399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_db.sqlalchemy.engines [None req-27b7475f-2f80-4d18-a2de-c02951edae24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 20:49:44.421535 ncdv-master-1 devstack@n-api.service[140523]: INFO dbcounter [None req-caef14de-0c06-49a5-9819-db43885268a8 None None] Registered counter for database nova_api Sep 17 20:49:44.426178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writer thread running {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 20:49:44.442491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_db.sqlalchemy.engines [None req-caef14de-0c06-49a5-9819-db43885268a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 20:49:44.451047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writer thread running {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 20:49:44.484079 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.context [None req-27b7475f-2f80-4d18-a2de-c02951edae24 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),056db90a-cdd9-42b2-a8c3-cd5ab36662a4(cell1) {{(pid=140524) load_cells /opt/stack/nova/nova/context.py:464}} Sep 17 20:49:44.488064 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27b7475f-2f80-4d18-a2de-c02951edae24 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:49:44.488562 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27b7475f-2f80-4d18-a2de-c02951edae24 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:49:44.490171 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27b7475f-2f80-4d18-a2de-c02951edae24 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:49:44.490944 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27b7475f-2f80-4d18-a2de-c02951edae24 None None] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:49:44.491401 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27b7475f-2f80-4d18-a2de-c02951edae24 None None] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:49:44.493418 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27b7475f-2f80-4d18-a2de-c02951edae24 None None] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:49:44.495570 ncdv-master-1 devstack@n-api.service[140524]: INFO dbcounter [None req-27b7475f-2f80-4d18-a2de-c02951edae24 None None] Registered counter for database nova_cell0 Sep 17 20:49:44.499826 ncdv-master-1 devstack@n-api.service[140524]: INFO dbcounter [None req-27b7475f-2f80-4d18-a2de-c02951edae24 None None] Registered counter for database nova_cell1 Sep 17 20:49:44.506994 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_db.sqlalchemy.engines [None req-27b7475f-2f80-4d18-a2de-c02951edae24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 20:49:44.508755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.context [None req-caef14de-0c06-49a5-9819-db43885268a8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),056db90a-cdd9-42b2-a8c3-cd5ab36662a4(cell1) {{(pid=140523) load_cells /opt/stack/nova/nova/context.py:464}} Sep 17 20:49:44.510372 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_db.sqlalchemy.engines [None req-27b7475f-2f80-4d18-a2de-c02951edae24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 20:49:44.512856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-caef14de-0c06-49a5-9819-db43885268a8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:49:44.513342 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-caef14de-0c06-49a5-9819-db43885268a8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:49:44.514960 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-caef14de-0c06-49a5-9819-db43885268a8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:49:44.515840 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-caef14de-0c06-49a5-9819-db43885268a8 None None] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:49:44.516176 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-caef14de-0c06-49a5-9819-db43885268a8 None None] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:49:44.517327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writer thread running {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 20:49:44.518199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-caef14de-0c06-49a5-9819-db43885268a8 None None] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:49:44.518687 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writer thread running {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 20:49:44.520365 ncdv-master-1 devstack@n-api.service[140523]: INFO dbcounter [None req-caef14de-0c06-49a5-9819-db43885268a8 None None] Registered counter for database nova_cell0 Sep 17 20:49:44.524649 ncdv-master-1 devstack@n-api.service[140523]: INFO dbcounter [None req-caef14de-0c06-49a5-9819-db43885268a8 None None] Registered counter for database nova_cell1 Sep 17 20:49:44.532746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_db.sqlalchemy.engines [None req-caef14de-0c06-49a5-9819-db43885268a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 20:49:44.535121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_db.sqlalchemy.engines [None req-caef14de-0c06-49a5-9819-db43885268a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 20:49:44.541790 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writer thread running {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 20:49:44.543962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writer thread running {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 20:49:44.663120 ncdv-master-1 devstack@n-api.service[140524]: INFO dbcounter [None req-27b7475f-2f80-4d18-a2de-c02951edae24 None None] Registered counter for database nova_cell0 Sep 17 20:49:44.673689 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_db.sqlalchemy.engines [None req-27b7475f-2f80-4d18-a2de-c02951edae24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 20:49:44.675554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writer thread running {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 20:49:44.694352 ncdv-master-1 devstack@n-api.service[140523]: INFO dbcounter [None req-caef14de-0c06-49a5-9819-db43885268a8 None None] Registered counter for database nova_cell0 Sep 17 20:49:44.701960 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_db.sqlalchemy.engines [None req-caef14de-0c06-49a5-9819-db43885268a8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=140523) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 20:49:44.707941 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writer thread running {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 20:49:45.117596 ncdv-master-1 devstack@n-api.service[140524]: WARNING keystonemiddleware.auth_token [None req-27b7475f-2f80-4d18-a2de-c02951edae24 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 17 20:49:45.125390 ncdv-master-1 devstack@n-api.service[140524]: WARNING keystonemiddleware.auth_token [None req-27b7475f-2f80-4d18-a2de-c02951edae24 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 17 20:49:45.158893 ncdv-master-1 devstack@n-api.service[140523]: WARNING keystonemiddleware.auth_token [None req-caef14de-0c06-49a5-9819-db43885268a8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 17 20:49:45.166511 ncdv-master-1 devstack@n-api.service[140523]: WARNING keystonemiddleware.auth_token [None req-caef14de-0c06-49a5-9819-db43885268a8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 17 20:49:45.344897 ncdv-master-1 devstack@n-api.service[140524]: WARNING keystonemiddleware.auth_token [None req-27b7475f-2f80-4d18-a2de-c02951edae24 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 17 20:49:45.351363 ncdv-master-1 devstack@n-api.service[140524]: WARNING keystonemiddleware.auth_token [None req-27b7475f-2f80-4d18-a2de-c02951edae24 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 17 20:49:45.356736 ncdv-master-1 devstack@n-api.service[140524]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56045de079c0 pid: 140524 (default app) Sep 17 20:49:45.392513 ncdv-master-1 devstack@n-api.service[140523]: WARNING keystonemiddleware.auth_token [None req-caef14de-0c06-49a5-9819-db43885268a8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 17 20:49:45.398733 ncdv-master-1 devstack@n-api.service[140523]: WARNING keystonemiddleware.auth_token [None req-caef14de-0c06-49a5-9819-db43885268a8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 17 20:49:45.404534 ncdv-master-1 devstack@n-api.service[140523]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56045de079c0 pid: 140523 (default app) Sep 17 20:50:25.671995 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:50:25.673912 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:50:25.674809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:50:25.675559 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:50:27.056294 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-55793380-b474-4921-8a19-d105d80cc86e tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Calling method '.version_select at 0x7f25a7084430>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:27.063300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-55793380-b474-4921-8a19-d105d80cc86e tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),056db90a-cdd9-42b2-a8c3-cd5ab36662a4(cell1) {{(pid=140524) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 17 20:50:27.064056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55793380-b474-4921-8a19-d105d80cc86e tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:27.064543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55793380-b474-4921-8a19-d105d80cc86e tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:27.064985 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55793380-b474-4921-8a19-d105d80cc86e tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:27.090673 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55793380-b474-4921-8a19-d105d80cc86e tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:27.091174 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55793380-b474-4921-8a19-d105d80cc86e tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:27.091620 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55793380-b474-4921-8a19-d105d80cc86e tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:27.106720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55793380-b474-4921-8a19-d105d80cc86e tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:27.107435 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55793380-b474-4921-8a19-d105d80cc86e tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:27.108237 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55793380-b474-4921-8a19-d105d80cc86e tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:27.115933 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-55793380-b474-4921-8a19-d105d80cc86e tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 1.454973 Sep 17 20:50:27.116627 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1/1] 10.222.0.26 () {58 vars in 1167 bytes} [Sat Sep 17 20:50:25 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:50:27.346097 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-591a1b9c-6a20-4b9a-8eac-a37e10c9fe6d tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-924258848", "name": "tempest-test_aggregate-1027440719"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:27.381016 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.aggregate [None req-591a1b9c-6a20-4b9a-8eac-a37e10c9fe6d tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Generated uuid d0c1550f-ac57-4958-960d-114ef8881062 for aggregate {{(pid=140523) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 17 20:50:27.389243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:50:27.390031 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:50:27.390729 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:50:27.391444 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:50:27.473795 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-591a1b9c-6a20-4b9a-8eac-a37e10c9fe6d tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.340646 Sep 17 20:50:27.474860 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1/2] 10.222.0.26 () {60 vars in 1165 bytes} [Sat Sep 17 20:50:27 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:27.486629 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1ecf5d5e-09c2-413e-805b-946a09b1a352 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:27.504018 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1ecf5d5e-09c2-413e-805b-946a09b1a352 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 200 len: 301 microversion: 2.1 time: 0.021296 Sep 17 20:50:27.505283 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Sep 17 20:50:27 2022] GET /compute/v2.1/os-aggregates => generated 301 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:27.518196 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5cec4c2e-c973-48da-8d94-87bcbb0095ee tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:27.535989 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5cec4c2e-c973-48da-8d94-87bcbb0095ee tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:27.536479 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5cec4c2e-c973-48da-8d94-87bcbb0095ee tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:27.537103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5cec4c2e-c973-48da-8d94-87bcbb0095ee tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:27.842963 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2fae318e-7c41-495b-8b81-6db9d0acc050 tempest-FlavorsV255TestJSON-1092383649 tempest-FlavorsV255TestJSON-1092383649-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-388081320", "id": 854446651, "os-flavor-access:is_public": "True"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:27.898509 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2fae318e-7c41-495b-8b81-6db9d0acc050 tempest-FlavorsV255TestJSON-1092383649 tempest-FlavorsV255TestJSON-1092383649-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 445 microversion: 2.55 time: 0.353039 Sep 17 20:50:27.908483 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3/4] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Sep 17 20:50:27 2022] POST /compute/v2.1/flavors => generated 445 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 17 20:50:28.351469 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-20aeef20-1674-47ba-9ea8-d58c903dfc73 tempest-FlavorsV255TestJSON-1717478331 tempest-FlavorsV255TestJSON-1717478331-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:28.389266 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-20aeef20-1674-47ba-9ea8-d58c903dfc73 tempest-FlavorsV255TestJSON-1717478331 tempest-FlavorsV255TestJSON-1717478331-project] 10.222.0.26 "GET /compute/v2.1/flavors/854446651" status: 200 len: 445 microversion: 2.55 time: 0.478220 Sep 17 20:50:28.389891 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 4/5] 10.222.0.26 () {60 vars in 1196 bytes} [Sat Sep 17 20:50:27 2022] GET /compute/v2.1/flavors/854446651 => generated 445 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:50:28.832896 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9762b1b6-45fc-41ec-aaaf-e5e23dec76c2 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1720058277", "id": 110641848, "os-flavor-access:is_public": "True"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:28.855982 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9762b1b6-45fc-41ec-aaaf-e5e23dec76c2 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.464233 Sep 17 20:50:28.865400 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 5/6] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:50:28 2022] POST /compute/v2.1/flavors => generated 427 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:28.865400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5ab4f051-5e95-47bf-882e-f6034637544e tempest-FlavorsV255TestJSON-1092383649 tempest-FlavorsV255TestJSON-1092383649-project-admin] Action: 'update', calling method: .version_select at 0x7f25a743f430>, body: {"flavor": {"description": "new"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:28.917132 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5ab4f051-5e95-47bf-882e-f6034637544e tempest-FlavorsV255TestJSON-1092383649 tempest-FlavorsV255TestJSON-1092383649-project-admin] 10.222.0.26 "PUT /compute/v2.1/flavors/854446651" status: 200 len: 446 microversion: 2.55 time: 0.059366 Sep 17 20:50:28.926442 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 6/7] 10.222.0.26 () {62 vars in 1216 bytes} [Sat Sep 17 20:50:28 2022] PUT /compute/v2.1/flavors/854446651 => generated 446 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:50:28.995110 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5cec4c2e-c973-48da-8d94-87bcbb0095ee tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.1 time: 1.482117 Sep 17 20:50:29.008730 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2/8] 10.222.0.26 () {60 vars in 1191 bytes} [Sat Sep 17 20:50:27 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:50:29.102289 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ff010fa0-d820-45a5-99d1-5d5dd6087ffe tempest-AggregatesAdminTestV241-1202500803 tempest-AggregatesAdminTestV241-1202500803-project-admin] Calling method '.version_select at 0x7f25a6ea5e50>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:29.108338 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff010fa0-d820-45a5-99d1-5d5dd6087ffe tempest-AggregatesAdminTestV241-1202500803 tempest-AggregatesAdminTestV241-1202500803-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:29.108980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff010fa0-d820-45a5-99d1-5d5dd6087ffe tempest-AggregatesAdminTestV241-1202500803 tempest-AggregatesAdminTestV241-1202500803-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:29.109533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff010fa0-d820-45a5-99d1-5d5dd6087ffe tempest-AggregatesAdminTestV241-1202500803 tempest-AggregatesAdminTestV241-1202500803-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:29.127301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff010fa0-d820-45a5-99d1-5d5dd6087ffe tempest-AggregatesAdminTestV241-1202500803 tempest-AggregatesAdminTestV241-1202500803-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:29.128065 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff010fa0-d820-45a5-99d1-5d5dd6087ffe tempest-AggregatesAdminTestV241-1202500803 tempest-AggregatesAdminTestV241-1202500803-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:29.128608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff010fa0-d820-45a5-99d1-5d5dd6087ffe tempest-AggregatesAdminTestV241-1202500803 tempest-AggregatesAdminTestV241-1202500803-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:29.140069 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff010fa0-d820-45a5-99d1-5d5dd6087ffe tempest-AggregatesAdminTestV241-1202500803 tempest-AggregatesAdminTestV241-1202500803-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:29.140637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff010fa0-d820-45a5-99d1-5d5dd6087ffe tempest-AggregatesAdminTestV241-1202500803 tempest-AggregatesAdminTestV241-1202500803-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:29.141156 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff010fa0-d820-45a5-99d1-5d5dd6087ffe tempest-AggregatesAdminTestV241-1202500803 tempest-AggregatesAdminTestV241-1202500803-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:29.147599 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ff010fa0-d820-45a5-99d1-5d5dd6087ffe tempest-AggregatesAdminTestV241-1202500803 tempest-AggregatesAdminTestV241-1202500803-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.220032 Sep 17 20:50:29.148186 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 7/9] 10.222.0.26 () {60 vars in 1208 bytes} [Sat Sep 17 20:50:28 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:50:29.152877 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-99744fb2-b857-43d6-8cfa-591d8398ded6 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:29.182750 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-99744fb2-b857-43d6-8cfa-591d8398ded6 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/110641848" status: 202 len: 0 microversion: 2.1 time: 0.033141 Sep 17 20:50:29.187909 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 8/10] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Sep 17 20:50:29 2022] DELETE /compute/v2.1/flavors/110641848 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:50:29.194738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a4b0bd8e-3556-4380-b47f-e2f4b8d37697 tempest-FlavorsV255TestJSON-1717478331 tempest-FlavorsV255TestJSON-1717478331-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:29.230002 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a4b0bd8e-3556-4380-b47f-e2f4b8d37697 tempest-FlavorsV255TestJSON-1717478331 tempest-FlavorsV255TestJSON-1717478331-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5721 microversion: 2.55 time: 0.040396 Sep 17 20:50:29.231236 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 9/11] 10.222.0.26 () {60 vars in 1187 bytes} [Sat Sep 17 20:50:29 2022] GET /compute/v2.1/flavors/detail => generated 5721 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:50:29.408997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c799bb14-5ec6-47e6-9a00-3d5ffff61c97 tempest-AZAdminNegativeTestJSON-559203044 tempest-AZAdminNegativeTestJSON-559203044-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:29.410764 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c799bb14-5ec6-47e6-9a00-3d5ffff61c97 tempest-AZAdminNegativeTestJSON-559203044 tempest-AZAdminNegativeTestJSON-559203044-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '8c6db72795fc47bd8c820ac966cbd731', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332a658e83ff48de8b6c50ff0a113463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:29.415289 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c799bb14-5ec6-47e6-9a00-3d5ffff61c97 tempest-AZAdminNegativeTestJSON-559203044 tempest-AZAdminNegativeTestJSON-559203044-project] Request method failure captured: Sep 17 20:50:29.415289 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Sep 17 20:50:29.415289 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:50:29.415289 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:50:29.415289 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:50:29.415289 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:50:29.415289 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:50:29.415289 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:50:29.415289 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:50:29.415289 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:50:29.415289 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjMSYMi010FIaZVvZpyvhG4GVHN8oDlYhGK4A6o8Lolpda-VAiZvetCWns33f7O-dQRjzBcg0mvCU3_aY0ulu0F8pRlcW9YeJLy2RHbzTrNyG2-9ovkP3uK2UHKk-DEG6Y0E84kgZgz3KdWhQ8XvwmQPWmYChYLTqCDPwbuYtpE4k4w Sep 17 20:50:29.415289 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:50:29.415289 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:50:29.415289 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:50:29.415289 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:50:29.415289 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:50:29.415289 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:50:29.415289 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 332a658e83ff48de8b6c50ff0a113463 Sep 17 20:50:29.415289 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-AZAdminNegativeTestJSON-559203044 Sep 17 20:50:29.415289 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:50:29.415289 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:50:29.416440 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/332a658e83ff48de8b6c50ff0a113463"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/332a658e83ff48de8b6c50ff0a113463"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/332a658e83ff48de8b6c50ff0a113463"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_332a658e83ff48de8b6c50ff0a113463", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:50:29.416440 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-AZAdminNegativeTestJSON-559203044 Sep 17 20:50:29.416440 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 332a658e83ff48de8b6c50ff0a113463 Sep 17 20:50:29.416440 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-559203044 Sep 17 20:50:29.416440 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-AZAdminNegativeTestJSON-559203044-project Sep 17 20:50:29.416440 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:50:29.416440 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:50:29.416440 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 8c6db72795fc47bd8c820ac966cbd731 Sep 17 20:50:29.416440 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-AZAdminNegativeTestJSON-559203044-project Sep 17 20:50:29.416440 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:50:29.416440 ncdv-master-1 devstack@n-api.service[140524]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 17 20:50:29.416440 ncdv-master-1 devstack@n-api.service[140524]: action_args: {} Sep 17 20:50:29.417164 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:50:29.417164 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:29.417164 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:29.417164 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:29.417164 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:50:29.417164 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:50:29.417164 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:50:29.417164 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:50:29.417164 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Sep 17 20:50:29.417164 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Sep 17 20:50:29.417164 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 17 20:50:29.417164 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 17 20:50:29.417164 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 17 20:50:29.417164 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 17 20:50:29.417164 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:50:29.417164 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:50:29.417164 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:50:29.417164 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:50:29.417164 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 17 20:50:29.418731 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 17 20:50:29.418731 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 17 20:50:29.418731 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 17 20:50:29.418731 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 17 20:50:29.418731 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 17 20:50:29.418731 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 17 20:50:29.418731 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:29.418731 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:29.418731 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:29.418731 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:29.418731 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:29.418731 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:29.418731 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 17 20:50:29.418731 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 17 20:50:29.418731 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 17 20:50:29.418731 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:29.418731 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c799bb14-5ec6-47e6-9a00-3d5ffff61c97 tempest-AZAdminNegativeTestJSON-559203044 tempest-AZAdminNegativeTestJSON-559203044-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:50:29.419811 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c799bb14-5ec6-47e6-9a00-3d5ffff61c97 tempest-AZAdminNegativeTestJSON-559203044 tempest-AZAdminNegativeTestJSON-559203044-project] 10.222.0.26 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.184418 Sep 17 20:50:29.421965 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 10/12] 10.222.0.26 () {58 vars in 1185 bytes} [Sat Sep 17 20:50:29 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 190 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:50:29.427240 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-304f56e2-c69a-495d-828c-d88abbf3a2a5 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:29.458010 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-304f56e2-c69a-495d-828c-d88abbf3a2a5 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5405 microversion: 2.1 time: 0.032550 Sep 17 20:50:29.466536 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 11/13] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:50:29 2022] GET /compute/v2.1/flavors/detail => generated 5405 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:29.472293 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8c6e89b1-5a89-448b-9fa7-6be934e616df tempest-AZAdminV2TestJSON-275179393 tempest-AZAdminV2TestJSON-275179393-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:29.475895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c6e89b1-5a89-448b-9fa7-6be934e616df tempest-AZAdminV2TestJSON-275179393 tempest-AZAdminV2TestJSON-275179393-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:29.476397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c6e89b1-5a89-448b-9fa7-6be934e616df tempest-AZAdminV2TestJSON-275179393 tempest-AZAdminV2TestJSON-275179393-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:29.477571 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c6e89b1-5a89-448b-9fa7-6be934e616df tempest-AZAdminV2TestJSON-275179393 tempest-AZAdminV2TestJSON-275179393-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:29.478926 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c6e89b1-5a89-448b-9fa7-6be934e616df tempest-AZAdminV2TestJSON-275179393 tempest-AZAdminV2TestJSON-275179393-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:29.480163 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c6e89b1-5a89-448b-9fa7-6be934e616df tempest-AZAdminV2TestJSON-275179393 tempest-AZAdminV2TestJSON-275179393-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:29.480763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c6e89b1-5a89-448b-9fa7-6be934e616df tempest-AZAdminV2TestJSON-275179393 tempest-AZAdminV2TestJSON-275179393-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:29.519985 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8c6e89b1-5a89-448b-9fa7-6be934e616df tempest-AZAdminV2TestJSON-275179393 tempest-AZAdminV2TestJSON-275179393-project-admin] 10.222.0.26 "GET /compute/v2.1/os-availability-zone" status: 200 len: 189 microversion: 2.1 time: 0.509716 Sep 17 20:50:29.520795 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3/14] 10.222.0.26 () {58 vars in 1164 bytes} [Sat Sep 17 20:50:29 2022] GET /compute/v2.1/os-availability-zone => generated 189 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:29.525560 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4f7469a2-f405-4c9f-9991-252eea867217 tempest-FlavorsV255TestJSON-1717478331 tempest-FlavorsV255TestJSON-1717478331-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:29.564615 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4f7469a2-f405-4c9f-9991-252eea867217 tempest-FlavorsV255TestJSON-1717478331 tempest-FlavorsV255TestJSON-1717478331-project] 10.222.0.26 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.55 time: 0.042602 Sep 17 20:50:29.565206 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 4/15] 10.222.0.26 () {60 vars in 1166 bytes} [Sat Sep 17 20:50:29 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:50:29.573296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dd6121db-1002-40f2-b723-7db27c637ed0 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-563166882", "id": 1909949085, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:29.604930 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dd6121db-1002-40f2-b723-7db27c637ed0 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.038321 Sep 17 20:50:29.605943 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 5/16] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:50:29 2022] POST /compute/v2.1/flavors => generated 416 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:29.610259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-98bcc50a-0293-42c0-a7c4-49234b6a7a72 tempest-AZAdminV2TestJSON-275179393 tempest-AZAdminV2TestJSON-275179393-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:29.611953 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98bcc50a-0293-42c0-a7c4-49234b6a7a72 tempest-AZAdminV2TestJSON-275179393 tempest-AZAdminV2TestJSON-275179393-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:29.612434 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98bcc50a-0293-42c0-a7c4-49234b6a7a72 tempest-AZAdminV2TestJSON-275179393 tempest-AZAdminV2TestJSON-275179393-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:29.612875 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98bcc50a-0293-42c0-a7c4-49234b6a7a72 tempest-AZAdminV2TestJSON-275179393 tempest-AZAdminV2TestJSON-275179393-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:29.613671 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98bcc50a-0293-42c0-a7c4-49234b6a7a72 tempest-AZAdminV2TestJSON-275179393 tempest-AZAdminV2TestJSON-275179393-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:29.614127 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98bcc50a-0293-42c0-a7c4-49234b6a7a72 tempest-AZAdminV2TestJSON-275179393 tempest-AZAdminV2TestJSON-275179393-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:29.614557 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98bcc50a-0293-42c0-a7c4-49234b6a7a72 tempest-AZAdminV2TestJSON-275179393 tempest-AZAdminV2TestJSON-275179393-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:29.640351 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-98bcc50a-0293-42c0-a7c4-49234b6a7a72 tempest-AZAdminV2TestJSON-275179393 tempest-AZAdminV2TestJSON-275179393-project-admin] 10.222.0.26 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 701 microversion: 2.1 time: 0.033471 Sep 17 20:50:29.640959 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 6/17] 10.222.0.26 () {58 vars in 1185 bytes} [Sat Sep 17 20:50:29 2022] GET /compute/v2.1/os-availability-zone/detail => generated 701 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:29.646011 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a4a661c0-f67d-4327-8b68-d68998e696bc tempest-FlavorsV255TestJSON-1092383649 tempest-FlavorsV255TestJSON-1092383649-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:29.673562 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a4a661c0-f67d-4327-8b68-d68998e696bc tempest-FlavorsV255TestJSON-1092383649 tempest-FlavorsV255TestJSON-1092383649-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/854446651" status: 202 len: 0 microversion: 2.55 time: 0.031218 Sep 17 20:50:29.674342 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 7/18] 10.222.0.26 () {60 vars in 1199 bytes} [Sat Sep 17 20:50:29 2022] DELETE /compute/v2.1/flavors/854446651 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:50:29.678462 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6bc7998d-744d-4bf6-b77e-4c1508a3fe55 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:29.715946 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6bc7998d-744d-4bf6-b77e-4c1508a3fe55 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.040712 Sep 17 20:50:29.716635 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 8/19] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:50:29 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:29.721014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a5803927-549c-4cd5-b11b-584ff43f07c2 tempest-FlavorsV255TestJSON-1092383649 tempest-FlavorsV255TestJSON-1092383649-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:29.743557 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a5803927-549c-4cd5-b11b-584ff43f07c2 tempest-FlavorsV255TestJSON-1092383649 tempest-FlavorsV255TestJSON-1092383649-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5712 microversion: 2.55 time: 0.025806 Sep 17 20:50:29.744257 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 9/20] 10.222.0.26 () {60 vars in 1187 bytes} [Sat Sep 17 20:50:29 2022] GET /compute/v2.1/flavors/detail => generated 5712 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:50:29.748797 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-756cdc38-f9cc-431f-8eaf-e56314ad589c tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:29.769137 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-756cdc38-f9cc-431f-8eaf-e56314ad589c tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1909949085" status: 202 len: 0 microversion: 2.1 time: 0.023475 Sep 17 20:50:29.770504 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 10/21] 10.222.0.26 () {58 vars in 1161 bytes} [Sat Sep 17 20:50:29 2022] DELETE /compute/v2.1/flavors/1909949085 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:50:29.780101 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b4b05024-0d5a-4a30-befe-0f99ed66ea72 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:29.802772 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b4b05024-0d5a-4a30-befe-0f99ed66ea72 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028079 Sep 17 20:50:29.803695 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 11/22] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:50:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:50:29.823984 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e71efeac-a6eb-4d31-9a60-92e867702219 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-519912675", "id": 1194156056, "os-flavor-access:is_public": "True"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:29.843351 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e71efeac-a6eb-4d31-9a60-92e867702219 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.023705 Sep 17 20:50:29.844430 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 12/23] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:50:29 2022] POST /compute/v2.1/flavors => generated 428 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:50:29.856241 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a8b4380d-103f-4b89-9ec4-9a3c675a421c tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:29.875593 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a8b4380d-103f-4b89-9ec4-9a3c675a421c tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1194156056" status: 202 len: 0 microversion: 2.1 time: 0.022925 Sep 17 20:50:29.877509 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 13/24] 10.222.0.26 () {58 vars in 1161 bytes} [Sat Sep 17 20:50:29 2022] DELETE /compute/v2.1/flavors/1194156056 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 17 20:50:29.884493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2ff7eaa4-886c-416b-827f-d1d5b59bf458 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:29.898586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7a34b148-ae9e-4359-88cf-2ac8558ea7c8 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1951761682", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "availability_zone": "tempest-test_az-924258848"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:29.905718 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2ff7eaa4-886c-416b-827f-d1d5b59bf458 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024734 Sep 17 20:50:29.906439 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 14/25] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:50:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:50:29.912221 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a34b148-ae9e-4359-88cf-2ac8558ea7c8 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:29.912724 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a34b148-ae9e-4359-88cf-2ac8558ea7c8 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:29.913153 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a34b148-ae9e-4359-88cf-2ac8558ea7c8 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:29.914144 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a34b148-ae9e-4359-88cf-2ac8558ea7c8 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:29.914742 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a34b148-ae9e-4359-88cf-2ac8558ea7c8 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:29.915307 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a34b148-ae9e-4359-88cf-2ac8558ea7c8 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:29.927485 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6ff886b9-2ca1-4339-b307-d271d6b33db3 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-865726144", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:29.954174 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6ff886b9-2ca1-4339-b307-d271d6b33db3 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.031343 Sep 17 20:50:29.955029 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 15/26] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:50:29 2022] POST /compute/v2.1/flavors => generated 506 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:50:29.969376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-88509ebb-cd08-4f0b-a675-49e12fa8ddbe tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:29.989188 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-88509ebb-cd08-4f0b-a675-49e12fa8ddbe tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/cac5747b-2a23-490a-9b3f-0516456f7a32" status: 202 len: 0 microversion: 2.1 time: 0.023982 Sep 17 20:50:29.989961 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 16/27] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:50:29 2022] DELETE /compute/v2.1/flavors/cac5747b-2a23-490a-9b3f-0516456f7a32 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:50:30.001777 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-db5fbac6-8426-487b-9eb2-6bf88465c3f6 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:30.024240 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-db5fbac6-8426-487b-9eb2-6bf88465c3f6 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029751 Sep 17 20:50:30.025029 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 17/28] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:50:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:50:30.048196 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f4ea9ef2-7ca0-4a80-b4e1-6dca9a07e94d tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-785111199", "id": "32f18e87-9a96-4150-b580-426f325b1910", "os-flavor-access:is_public": "True"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:30.068329 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f4ea9ef2-7ca0-4a80-b4e1-6dca9a07e94d tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.027019 Sep 17 20:50:30.068966 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 18/29] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:50:30 2022] POST /compute/v2.1/flavors => generated 506 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:50:30.081580 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a14c3675-0fe8-4cdf-bb6a-85b4bff6ee8a tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:30.101980 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a14c3675-0fe8-4cdf-bb6a-85b4bff6ee8a tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/32f18e87-9a96-4150-b580-426f325b1910" status: 202 len: 0 microversion: 2.1 time: 0.024157 Sep 17 20:50:30.102805 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 19/30] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:50:30 2022] DELETE /compute/v2.1/flavors/32f18e87-9a96-4150-b580-426f325b1910 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 17 20:50:30.110418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-90a65d19-be71-4755-bc7e-a083e4477b24 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:30.129961 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-90a65d19-be71-4755-bc7e-a083e4477b24 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022813 Sep 17 20:50:30.130542 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 20/31] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:50:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:30.151114 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-487139d1-186d-40a7-86f9-532ed0e20d30 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1455862784", "id": 677500632, "os-flavor-access:is_public": "True"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:30.174221 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-487139d1-186d-40a7-86f9-532ed0e20d30 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.028005 Sep 17 20:50:30.175321 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 21/32] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:50:30 2022] POST /compute/v2.1/flavors => generated 411 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:50:30.187220 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9b6f7815-d1c9-4510-8379-a1d6b4e3bc03 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:30.201379 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9b6f7815-d1c9-4510-8379-a1d6b4e3bc03 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/677500632" status: 200 len: 411 microversion: 2.1 time: 0.018002 Sep 17 20:50:30.202273 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 22/33] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Sep 17 20:50:30 2022] GET /compute/v2.1/flavors/677500632 => generated 411 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:30.537730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a9b03124-1517-47aa-bded-decd78d3ff67 tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1394283482", "id": 421468582, "os-flavor-access:is_public": "False"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:30.548324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=9,nova_api:DELETE=15 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:50:30.567155 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a9b03124-1517-47aa-bded-decd78d3ff67 tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.361718 Sep 17 20:50:30.568396 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 23/34] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:50:30 2022] POST /compute/v2.1/flavors => generated 436 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:50:30.940933 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-7a34b148-ae9e-4359-88cf-2ac8558ea7c8 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] validate_networks() for None {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:50:31.049376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-acccebb0-20b9-422c-a069-c8a34a8f7e4b tempest-FlavorsAdminTestJSON-1242601050 tempest-FlavorsAdminTestJSON-1242601050-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:31.092019 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-acccebb0-20b9-422c-a069-c8a34a8f7e4b tempest-FlavorsAdminTestJSON-1242601050 tempest-FlavorsAdminTestJSON-1242601050-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.522304 Sep 17 20:50:31.096239 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 24/35] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:50:30 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:31.117143 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ed520861-7581-4cef-aa60-07af5c53dd87 tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0a55519ffc224c849e9be490acb4596e"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:31.219111 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-7a34b148-ae9e-4359-88cf-2ac8558ea7c8 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:50:31.219556 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-7a34b148-ae9e-4359-88cf-2ac8558ea7c8 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:50:31.220021 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-7a34b148-ae9e-4359-88cf-2ac8558ea7c8 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:50:31.220441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-7a34b148-ae9e-4359-88cf-2ac8558ea7c8 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:50:31.220850 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-7a34b148-ae9e-4359-88cf-2ac8558ea7c8 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:50:31.240685 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a34b148-ae9e-4359-88cf-2ac8558ea7c8 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:31.241423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a34b148-ae9e-4359-88cf-2ac8558ea7c8 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:31.242150 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a34b148-ae9e-4359-88cf-2ac8558ea7c8 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:31.243082 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a34b148-ae9e-4359-88cf-2ac8558ea7c8 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:31.243741 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a34b148-ae9e-4359-88cf-2ac8558ea7c8 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:31.244335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a34b148-ae9e-4359-88cf-2ac8558ea7c8 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:31.287814 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-7a34b148-ae9e-4359-88cf-2ac8558ea7c8 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Getting quotas for project aa4ffd27d7414061b67e053657044400. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:50:31.295457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-7a34b148-ae9e-4359-88cf-2ac8558ea7c8 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Getting quotas for user f05aab669547487d8876a70e338d3e4a and project aa4ffd27d7414061b67e053657044400. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:50:31.310737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7a34b148-ae9e-4359-88cf-2ac8558ea7c8 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:50:31.314085 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7a34b148-ae9e-4359-88cf-2ac8558ea7c8 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] [instance: 07019932-c686-4174-9828-3035fcc1694a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:50:31.397100 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7a34b148-ae9e-4359-88cf-2ac8558ea7c8 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.929383 Sep 17 20:50:31.405014 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 12/36] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:50:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:50:31.405014 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e45eee5b-e57c-47a7-af19-5d6802e6400b tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:31.429145 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e45eee5b-e57c-47a7-af19-5d6802e6400b tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/677500632" status: 202 len: 0 microversion: 2.1 time: 0.029872 Sep 17 20:50:31.429929 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 13/37] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Sep 17 20:50:31 2022] DELETE /compute/v2.1/flavors/677500632 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:50:31.434931 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d14c6d3f-7f20-429b-a3c3-7c739ab91c3c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:31.435826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d14c6d3f-7f20-429b-a3c3-7c739ab91c3c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] [instance: 07019932-c686-4174-9828-3035fcc1694a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:31.555521 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d14c6d3f-7f20-429b-a3c3-7c739ab91c3c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05aab669547487d8876a70e338d3e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4ffd27d7414061b67e053657044400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:31.582387 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d14c6d3f-7f20-429b-a3c3-7c739ab91c3c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] 10.222.0.26 "GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a" status: 200 len: 1242 microversion: 2.1 time: 0.150945 Sep 17 20:50:31.582986 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 14/38] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:31 2022] GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a => generated 1242 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:31.589247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3f3acd3e-6a7e-42d7-81f4-5e76e667490b tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:31.620651 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3f3acd3e-6a7e-42d7-81f4-5e76e667490b tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036344 Sep 17 20:50:31.621617 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 15/39] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:50:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:31.644459 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-27fde8be-7f5a-4cb1-8bc9-3645fc5c28df tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1479326735", "id": 177010291, "os-flavor-access:is_public": "False"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:31.688205 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-27fde8be-7f5a-4cb1-8bc9-3645fc5c28df tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.049356 Sep 17 20:50:31.689364 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 16/40] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:50:31 2022] POST /compute/v2.1/flavors => generated 427 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:31.702013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f3bc1f39-e008-4497-8478-aaf2b856b35d tempest-FlavorsAdminTestJSON-1242601050 tempest-FlavorsAdminTestJSON-1242601050-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "177010291"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:31.715267 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-f3bc1f39-e008-4497-8478-aaf2b856b35d tempest-FlavorsAdminTestJSON-1242601050 tempest-FlavorsAdminTestJSON-1242601050-project] HTTP exception thrown: Flavor 177010291 could not be found. Sep 17 20:50:31.726190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f3bc1f39-e008-4497-8478-aaf2b856b35d tempest-FlavorsAdminTestJSON-1242601050 tempest-FlavorsAdminTestJSON-1242601050-project] Request method failure captured: Sep 17 20:50:31.726190 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 17 20:50:31.726190 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:50:31.726190 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:50:31.726190 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:50:31.726190 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 106 Sep 17 20:50:31.726190 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:50:31.726190 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:50:31.726190 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:50:31.726190 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:50:31.726190 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjMRu2-zTn_stP8NvCsi4VRQCRCg_ag6986z5DT2bWt0kOvLuJtFzWYJg-mkFWew0j12ERnE0lHrhq2ItZOFfogiqdo3-3L0SQh9U0ugUlCsGTDb20T_QARmmEARowdEzBCy0rCfPwhgTmKJkb5Nd7fMpA9-9qdd7nfJHNBoa0e5C4Y Sep 17 20:50:31.726190 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:50:31.726190 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:50:31.726190 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:50:31.726190 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:50:31.726190 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:50:31.726190 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:50:31.726190 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 84675c7d7632442ead7879973c5a87ed Sep 17 20:50:31.726190 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-FlavorsAdminTestJSON-1242601050 Sep 17 20:50:31.726190 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:50:31.726190 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:50:31.727674 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/84675c7d7632442ead7879973c5a87ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/84675c7d7632442ead7879973c5a87ed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/84675c7d7632442ead7879973c5a87ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_84675c7d7632442ead7879973c5a87ed", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:50:31.727674 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-FlavorsAdminTestJSON-1242601050 Sep 17 20:50:31.727674 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 84675c7d7632442ead7879973c5a87ed Sep 17 20:50:31.727674 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1242601050 Sep 17 20:50:31.727674 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-FlavorsAdminTestJSON-1242601050-project Sep 17 20:50:31.727674 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:50:31.727674 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:50:31.727674 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 65c1fa6cebe54ac2898f8a615802b4ea Sep 17 20:50:31.727674 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-FlavorsAdminTestJSON-1242601050-project Sep 17 20:50:31.727674 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:50:31.727674 ncdv-master-1 devstack@n-api.service[140524]: {"server": {"name": "test", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "177010291"}} Sep 17 20:50:31.727674 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:50:31.727674 ncdv-master-1 devstack@n-api.service[140524]: exception: Flavor 177010291 could not be found. Sep 17 20:50:31.728525 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4', 'flavorRef': '177010291'}}} Sep 17 20:50:31.728525 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:50:31.728525 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:31.728525 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 17 20:50:31.728525 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 17 20:50:31.728525 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 17 20:50:31.728525 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 17 20:50:31.728525 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:50:31.728525 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:50:31.728525 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 17 20:50:31.728525 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 17 20:50:31.728525 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 17 20:50:31.728525 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:50:31.728525 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 17 20:50:31.728525 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 17 20:50:31.728525 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 177010291 could not be found. Sep 17 20:50:31.728525 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:31.728525 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:31.728525 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:31.728525 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:31.729735 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:31.729735 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:31.729735 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:50:31.729735 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:50:31.729735 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:50:31.729735 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:50:31.729735 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:50:31.729735 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:50:31.729735 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:50:31.729735 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:50:31.729735 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:50:31.729735 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:50:31.729735 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 17 20:50:31.729735 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 17 20:50:31.729735 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 17 20:50:31.729735 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 177010291 could not be found. Sep 17 20:50:31.729735 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:31.729735 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:31.729735 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:31.729735 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:31.729735 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:31.731262 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:31.731262 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:50:31.731262 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:50:31.731262 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 177010291 could not be found. Sep 17 20:50:31.731262 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:31.731785 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ed520861-7581-4cef-aa60-07af5c53dd87 tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/421468582/action" status: 200 len: 96 microversion: 2.1 time: 0.631694 Sep 17 20:50:31.733018 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f3bc1f39-e008-4497-8478-aaf2b856b35d tempest-FlavorsAdminTestJSON-1242601050 tempest-FlavorsAdminTestJSON-1242601050-project] Returning 400 to user: Flavor 177010291 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:50:31.734087 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f3bc1f39-e008-4497-8478-aaf2b856b35d tempest-FlavorsAdminTestJSON-1242601050 tempest-FlavorsAdminTestJSON-1242601050-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.036274 Sep 17 20:50:31.735106 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 25/41] 10.222.0.26 () {60 vars in 1197 bytes} [Sat Sep 17 20:50:31 2022] POST /compute/v2.1/flavors/421468582/action => generated 96 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:50:31.735631 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 17/42] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:50:31 2022] POST /compute/v2.1/servers => generated 80 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 17 20:50:31.743477 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fe715065-c131-4af1-ac76-d623fbfde918 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:31.746961 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a4fa9493-64d9-4076-a0ac-3eb47c50147d tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0a55519ffc224c849e9be490acb4596e"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:31.770429 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fe715065-c131-4af1-ac76-d623fbfde918 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/177010291" status: 202 len: 0 microversion: 2.1 time: 0.030917 Sep 17 20:50:31.771026 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 18/43] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Sep 17 20:50:31 2022] DELETE /compute/v2.1/flavors/177010291 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:50:31.780385 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2e6abbe9-9712-4d1d-8b3a-177c1e06823f tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:31.801072 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2e6abbe9-9712-4d1d-8b3a-177c1e06823f tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024814 Sep 17 20:50:31.802034 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 19/44] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:50:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:31.827085 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-591604e5-74a7-4d63-bf94-6db7e68e22d0 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-494492059", "id": 426358563, "os-flavor-access:is_public": "False"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:31.863107 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-591604e5-74a7-4d63-bf94-6db7e68e22d0 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.039944 Sep 17 20:50:31.864100 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 20/45] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:50:31 2022] POST /compute/v2.1/flavors => generated 411 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:31.879047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9be71a13-cc9b-46f9-95cf-2eecf40fd375 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1129097894", "id": 1116039978, "os-flavor-access:is_public": "True"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:31.910897 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9be71a13-cc9b-46f9-95cf-2eecf40fd375 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.037754 Sep 17 20:50:31.913668 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 21/46] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:50:31 2022] POST /compute/v2.1/flavors => generated 414 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:50:31.923741 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e2a43a27-464c-4cb1-9582-a3bc3ba86856 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:31.943378 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e2a43a27-464c-4cb1-9582-a3bc3ba86856 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 840 microversion: 2.1 time: 0.023345 Sep 17 20:50:31.944006 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 22/47] 10.222.0.26 () {58 vars in 1169 bytes} [Sat Sep 17 20:50:31 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 840 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:50:31.957419 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8751993e-b92b-489d-90f0-43a4facbde51 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:31.967160 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=8,nova_api:UPDATE=1,nova_api:DELETE=9 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:50:31.972711 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8751993e-b92b-489d-90f0-43a4facbde51 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 840 microversion: 2.1 time: 0.018759 Sep 17 20:50:31.973972 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 23/48] 10.222.0.26 () {58 vars in 1177 bytes} [Sat Sep 17 20:50:31 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 840 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:31.988646 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7777475f-399f-42a3-a4eb-b2c0623d62d1 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:32.003395 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7777475f-399f-42a3-a4eb-b2c0623d62d1 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 840 microversion: 2.1 time: 0.019923 Sep 17 20:50:32.004571 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 24/49] 10.222.0.26 () {58 vars in 1171 bytes} [Sat Sep 17 20:50:31 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 840 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:50:32.017600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b23ae44f-338e-4dfa-8563-0a14fd7b6e59 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:32.036211 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b23ae44f-338e-4dfa-8563-0a14fd7b6e59 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 840 microversion: 2.1 time: 0.022222 Sep 17 20:50:32.037031 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 25/50] 10.222.0.26 () {58 vars in 1169 bytes} [Sat Sep 17 20:50:32 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 840 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:50:32.051335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6f1182ff-0afa-4f0b-bf7b-6e3cb612bb1f tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:32.078687 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6f1182ff-0afa-4f0b-bf7b-6e3cb612bb1f tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.030859 Sep 17 20:50:32.079769 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 26/51] 10.222.0.26 () {58 vars in 1169 bytes} [Sat Sep 17 20:50:32 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:50:32.105671 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5470354a-e579-4fbb-a506-ba8add237b33 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:32.130926 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5470354a-e579-4fbb-a506-ba8add237b33 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.031210 Sep 17 20:50:32.132850 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 27/52] 10.222.0.26 () {58 vars in 1175 bytes} [Sat Sep 17 20:50:32 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:50:32.152366 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-740f3f24-3763-452a-bfff-70c0972661ab tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:32.176850 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-740f3f24-3763-452a-bfff-70c0972661ab tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.028065 Sep 17 20:50:32.181806 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 28/53] 10.222.0.26 () {58 vars in 1173 bytes} [Sat Sep 17 20:50:32 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:32.205152 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-71c6b916-6d05-4103-b76f-668bd2c494fc tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:32.231739 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-71c6b916-6d05-4103-b76f-668bd2c494fc tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.038834 Sep 17 20:50:32.235473 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 29/54] 10.222.0.26 () {58 vars in 1169 bytes} [Sat Sep 17 20:50:32 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:32.252745 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7e03c0ec-2523-474a-9588-c5150de4ba6a tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:32.279041 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7e03c0ec-2523-474a-9588-c5150de4ba6a tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1116039978" status: 202 len: 0 microversion: 2.1 time: 0.030119 Sep 17 20:50:32.280535 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 30/55] 10.222.0.26 () {58 vars in 1161 bytes} [Sat Sep 17 20:50:32 2022] DELETE /compute/v2.1/flavors/1116039978 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 17 20:50:32.290046 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2277dc92-e033-4c22-b998-1d0d38c342c2 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:32.311072 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2277dc92-e033-4c22-b998-1d0d38c342c2 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026362 Sep 17 20:50:32.312561 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 31/56] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:50:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:32.331880 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ad6fa01f-f26e-4a16-b165-2c656d8ac991 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:32.358471 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ad6fa01f-f26e-4a16-b165-2c656d8ac991 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/426358563" status: 202 len: 0 microversion: 2.1 time: 0.031916 Sep 17 20:50:32.362451 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 32/57] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Sep 17 20:50:32 2022] DELETE /compute/v2.1/flavors/426358563 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:50:32.368279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-dfeca12c-c766-4cfc-9609-09663a909868 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:32.402316 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-dfeca12c-c766-4cfc-9609-09663a909868 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038581 Sep 17 20:50:32.411396 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 33/58] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:50:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:32.424150 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3b320912-348d-4934-ad2d-8a39f3b0d4ad tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-704579283", "id": 1902310946, "os-flavor-access:is_public": "False"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:32.452243 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3b320912-348d-4934-ad2d-8a39f3b0d4ad tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.033069 Sep 17 20:50:32.453082 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 34/59] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:50:32 2022] POST /compute/v2.1/flavors => generated 414 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:32.465401 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2fdc7cfb-15a7-41ca-92b0-b0eca795a592 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:32.491214 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2fdc7cfb-15a7-41ca-92b0-b0eca795a592 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029700 Sep 17 20:50:32.504755 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 35/60] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:50:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:32.512421 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b18b4e2a-9ab4-466e-b72c-8b3242f23553 tempest-FlavorsAdminTestJSON-1242601050 tempest-FlavorsAdminTestJSON-1242601050-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:32.542611 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b18b4e2a-9ab4-466e-b72c-8b3242f23553 tempest-FlavorsAdminTestJSON-1242601050 tempest-FlavorsAdminTestJSON-1242601050-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036222 Sep 17 20:50:32.556638 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 36/61] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:50:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:50:32.563203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-da0aed3f-f977-4da4-a02f-e46e0c1da4b1 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:32.584487 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-da0aed3f-f977-4da4-a02f-e46e0c1da4b1 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1902310946" status: 202 len: 0 microversion: 2.1 time: 0.026237 Sep 17 20:50:32.588218 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 37/62] 10.222.0.26 () {58 vars in 1161 bytes} [Sat Sep 17 20:50:32 2022] DELETE /compute/v2.1/flavors/1902310946 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 17 20:50:32.593855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8a7eed9a-443c-44d2-a01e-590b1be208a6 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:32.642112 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8a7eed9a-443c-44d2-a01e-590b1be208a6 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052398 Sep 17 20:50:32.642726 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 38/63] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:50:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:32.653989 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-a4fa9493-64d9-4076-a0ac-3eb47c50147d tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] HTTP exception thrown: Flavor access already exists for flavor 22 and project 0a55519ffc224c849e9be490acb4596e combination. Sep 17 20:50:32.661207 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-934bb9a3-0bc9-4e6f-93ae-f39c47500b8a tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:32.663337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-934bb9a3-0bc9-4e6f-93ae-f39c47500b8a tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] [instance: 07019932-c686-4174-9828-3035fcc1694a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:32.689106 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a4fa9493-64d9-4076-a0ac-3eb47c50147d tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] Request method failure captured: Sep 17 20:50:32.689106 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/flavors/421468582/action HTTP/1.1 Sep 17 20:50:32.689106 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:50:32.689106 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:50:32.689106 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:50:32.689106 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 67 Sep 17 20:50:32.689106 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:50:32.689106 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:50:32.689106 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:50:32.689106 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:50:32.689106 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjMUFQdOozlnxD8usOW2tu_1eAJCt5lFgVSkEGVbTVW7Kj4-xlNuC9CRsnxnZllSZFZ-UaQplI_avLg_VPjmRrRFvAUEtg7MEh0Q81sxW06CPIN0PwnYcmvxMTzi4AN8koywckPobdno8BSmMHoHn013c__w0_P5KlilDpFvHW5LidM Sep 17 20:50:32.689106 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:50:32.689106 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:50:32.689106 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:50:32.689106 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:50:32.689106 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:50:32.689106 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:50:32.689106 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: d0af2d58b8994eeeb64cec26101d4816 Sep 17 20:50:32.689106 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-36790199 Sep 17 20:50:32.689106 ncdv-master-1 devstack@n-api.service[140523]: X-Role: admin,member,reader Sep 17 20:50:32.689106 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: admin,member,reader Sep 17 20:50:32.690512 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d0af2d58b8994eeeb64cec26101d4816"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d0af2d58b8994eeeb64cec26101d4816"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d0af2d58b8994eeeb64cec26101d4816"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d0af2d58b8994eeeb64cec26101d4816", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:50:32.690512 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-36790199 Sep 17 20:50:32.690512 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: d0af2d58b8994eeeb64cec26101d4816 Sep 17 20:50:32.690512 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-36790199 Sep 17 20:50:32.690512 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin Sep 17 20:50:32.690512 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:50:32.690512 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:50:32.690512 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 62d984d1cf7c41f783ddbe05bc545e4a Sep 17 20:50:32.690512 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin Sep 17 20:50:32.690512 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 20:50:32.690512 ncdv-master-1 devstack@n-api.service[140523]: {"addTenantAccess": {"tenant": "0a55519ffc224c849e9be490acb4596e"}} Sep 17 20:50:32.690512 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:50:32.691268 ncdv-master-1 devstack@n-api.service[140523]: exception: Flavor access already exists for flavor 22 and project 0a55519ffc224c849e9be490acb4596e combination. Sep 17 20:50:32.691268 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '421468582', 'body': {'addTenantAccess': {'tenant': '0a55519ffc224c849e9be490acb4596e'}}} Sep 17 20:50:32.691268 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:50:32.691268 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:32.691268 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 20:50:32.691268 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 17 20:50:32.691268 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 20:50:32.691268 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 17 20:50:32.691268 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 20:50:32.691268 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 17 20:50:32.691268 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 20:50:32.691268 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 17 20:50:32.691268 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 20:50:32.691268 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 20:50:32.691268 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 20:50:32.691268 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result.read() Sep 17 20:50:32.691268 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 20:50:32.691268 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 17 20:50:32.692734 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 20:50:32.692734 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 17 20:50:32.692734 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 20:50:32.692734 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 17 20:50:32.692734 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 20:50:32.692734 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 17 20:50:32.692734 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '22-0a55519ffc224c849e9be490acb4596e' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 17 20:50:32.692734 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:32.692734 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 17 20:50:32.692734 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:32.692734 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:32.692734 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Sep 17 20:50:32.692734 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi project.save(context.session) Sep 17 20:50:32.692734 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 17 20:50:32.692734 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi session.flush() Sep 17 20:50:32.692734 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 17 20:50:32.692734 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 17 20:50:32.692734 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 17 20:50:32.692734 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 17 20:50:32.693894 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 17 20:50:32.693894 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 17 20:50:32.693894 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 20:50:32.693894 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception Sep 17 20:50:32.693894 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 17 20:50:32.693894 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 17 20:50:32.693894 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 17 20:50:32.693894 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 17 20:50:32.693894 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 17 20:50:32.693894 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 17 20:50:32.693894 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 17 20:50:32.693894 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 17 20:50:32.693894 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 17 20:50:32.693894 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 17 20:50:32.693894 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 17 20:50:32.693894 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 17 20:50:32.693894 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 17 20:50:32.693894 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 17 20:50:32.695070 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 17 20:50:32.695070 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 17 20:50:32.695070 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 17 20:50:32.695070 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 17 20:50:32.695070 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 17 20:50:32.695070 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 17 20:50:32.695070 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 20:50:32.695070 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception Sep 17 20:50:32.695070 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 20:50:32.695070 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 17 20:50:32.695070 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 20:50:32.695070 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 17 20:50:32.695070 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 20:50:32.695070 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 17 20:50:32.695070 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 20:50:32.695070 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 17 20:50:32.695070 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 20:50:32.695070 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 20:50:32.698643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 20:50:32.698643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result.read() Sep 17 20:50:32.698643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 20:50:32.698643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 17 20:50:32.698643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 20:50:32.698643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 17 20:50:32.698643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 20:50:32.698643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 17 20:50:32.698643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 20:50:32.698643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 17 20:50:32.698643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '22-0a55519ffc224c849e9be490acb4596e' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 17 20:50:32.698643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Sep 17 20:50:32.698643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 17, 20, 50, 32, 639885), 'updated_at': None, 'flavor_id': 22, 'project_id': '0a55519ffc224c849e9be490acb4596e'}] Sep 17 20:50:32.698643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 17 20:50:32.698643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:32.698643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:32.698643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:32.700736 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:32.700736 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Sep 17 20:50:32.700736 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Sep 17 20:50:32.700736 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 17 20:50:32.700736 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 17 20:50:32.700736 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Sep 17 20:50:32.700736 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Sep 17 20:50:32.700736 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Sep 17 20:50:32.700736 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Sep 17 20:50:32.700736 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Sep 17 20:50:32.700736 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Sep 17 20:50:32.700736 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 17 20:50:32.700736 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 17 20:50:32.700736 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Sep 17 20:50:32.700736 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Sep 17 20:50:32.700736 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 22 and project 0a55519ffc224c849e9be490acb4596e combination. Sep 17 20:50:32.700736 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:32.700736 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:32.700736 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:32.704885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:32.704885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:32.704885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:32.704885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:50:32.704885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:50:32.704885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:50:32.704885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:50:32.704885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:50:32.704885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:50:32.704885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Sep 17 20:50:32.704885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Sep 17 20:50:32.704885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 22 and project 0a55519ffc224c849e9be490acb4596e combination. Sep 17 20:50:32.704885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:32.704885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:32.704885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:32.704885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:32.704885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:32.704885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:32.704885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:50:32.704885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:50:32.708801 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 22 and project 0a55519ffc224c849e9be490acb4596e combination. Sep 17 20:50:32.708801 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:32.710072 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a4fa9493-64d9-4076-a0ac-3eb47c50147d tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] Returning 409 to user: Flavor access already exists for flavor 22 and project 0a55519ffc224c849e9be490acb4596e combination. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:50:32.716200 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a4fa9493-64d9-4076-a0ac-3eb47c50147d tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/421468582/action" status: 409 len: 152 microversion: 2.1 time: 0.972333 Sep 17 20:50:32.717625 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 26/64] 10.222.0.26 () {60 vars in 1197 bytes} [Sat Sep 17 20:50:31 2022] POST /compute/v2.1/flavors/421468582/action => generated 152 bytes in 982 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 17 20:50:32.724048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e7299c8f-91fc-4b97-9b84-ed2499a5a5a2 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1427008486", "id": 425114160, "os-flavor-access:is_public": "True"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:32.759063 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e7299c8f-91fc-4b97-9b84-ed2499a5a5a2 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.038165 Sep 17 20:50:32.760072 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 27/65] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:50:32 2022] POST /compute/v2.1/flavors => generated 411 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:32.770614 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3c835aa8-92c8-4d13-bcbf-64d5d30b0708 tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0a55519ffc224c849e9be490acb4596e"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:32.779354 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-934bb9a3-0bc9-4e6f-93ae-f39c47500b8a tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05aab669547487d8876a70e338d3e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4ffd27d7414061b67e053657044400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:32.789446 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-934bb9a3-0bc9-4e6f-93ae-f39c47500b8a tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] 10.222.0.26 "GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a" status: 200 len: 1242 microversion: 2.1 time: 0.139484 Sep 17 20:50:32.790486 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 39/66] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:32 2022] GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a => generated 1242 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:32.796102 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1454554a-da3d-4ee5-9646-3250c9a64ff7 tempest-FlavorsAdminTestJSON-1242601050 tempest-FlavorsAdminTestJSON-1242601050-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:32.832293 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1454554a-da3d-4ee5-9646-3250c9a64ff7 tempest-FlavorsAdminTestJSON-1242601050 tempest-FlavorsAdminTestJSON-1242601050-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.040513 Sep 17 20:50:32.833246 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 40/67] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:50:32 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:32.863422 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0a9c500a-3f17-4a48-bfa5-fd7a453d8e40 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:32.895882 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0a9c500a-3f17-4a48-bfa5-fd7a453d8e40 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/425114160" status: 202 len: 0 microversion: 2.1 time: 0.048263 Sep 17 20:50:32.896491 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 41/68] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Sep 17 20:50:32 2022] DELETE /compute/v2.1/flavors/425114160 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 17 20:50:32.922422 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-805c0800-0536-4f9f-935d-ed5cafd8abd7 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:32.943695 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-805c0800-0536-4f9f-935d-ed5cafd8abd7 tempest-FlavorsAdminTestJSON-943868847 tempest-FlavorsAdminTestJSON-943868847-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028315 Sep 17 20:50:32.945515 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 42/69] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:50:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:33.330808 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3c835aa8-92c8-4d13-bcbf-64d5d30b0708 tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/421468582/action" status: 200 len: 21 microversion: 2.1 time: 0.569659 Sep 17 20:50:33.331927 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 28/70] 10.222.0.26 () {60 vars in 1197 bytes} [Sat Sep 17 20:50:32 2022] POST /compute/v2.1/flavors/421468582/action => generated 21 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:50:33.343162 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7e8ba3f7-8485-435a-9025-e3edcf486eae tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:33.366441 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7e8ba3f7-8485-435a-9025-e3edcf486eae tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/421468582" status: 202 len: 0 microversion: 2.1 time: 0.027575 Sep 17 20:50:33.367204 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 43/71] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Sep 17 20:50:33 2022] DELETE /compute/v2.1/flavors/421468582 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:50:33.375591 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1e230529-6294-4305-b344-aa3d381763d8 tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:33.399667 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1e230529-6294-4305-b344-aa3d381763d8 tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027850 Sep 17 20:50:33.400568 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 29/72] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:50:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:33.421575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cecd9f55-557d-438a-9679-54a732dead24 tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-964832508", "id": 800532074, "os-flavor-access:is_public": "True"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:33.450835 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cecd9f55-557d-438a-9679-54a732dead24 tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.033060 Sep 17 20:50:33.453640 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 44/73] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:50:33 2022] POST /compute/v2.1/flavors => generated 434 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:33.464706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3c581842-b937-470e-868b-442bcfa65243 tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:33.472532 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-3c581842-b937-470e-868b-442bcfa65243 tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] HTTP exception thrown: Access list not available for public flavors. Sep 17 20:50:33.479627 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3c581842-b937-470e-868b-442bcfa65243 tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] Request method failure captured: Sep 17 20:50:33.479627 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/flavors/800532074/os-flavor-access HTTP/1.1 Sep 17 20:50:33.479627 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:50:33.479627 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:50:33.479627 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:50:33.479627 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:50:33.479627 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:50:33.479627 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:50:33.479627 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:50:33.479627 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:50:33.479627 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjMUFQdOozlnxD8usOW2tu_1eAJCt5lFgVSkEGVbTVW7Kj4-xlNuC9CRsnxnZllSZFZ-UaQplI_avLg_VPjmRrRFvAUEtg7MEh0Q81sxW06CPIN0PwnYcmvxMTzi4AN8koywckPobdno8BSmMHoHn013c__w0_P5KlilDpFvHW5LidM Sep 17 20:50:33.479627 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:50:33.479627 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:50:33.479627 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:50:33.479627 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:50:33.479627 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:50:33.479627 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:50:33.479627 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: d0af2d58b8994eeeb64cec26101d4816 Sep 17 20:50:33.479627 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-36790199 Sep 17 20:50:33.479627 ncdv-master-1 devstack@n-api.service[140523]: X-Role: admin,member,reader Sep 17 20:50:33.479627 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: admin,member,reader Sep 17 20:50:33.480835 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d0af2d58b8994eeeb64cec26101d4816"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d0af2d58b8994eeeb64cec26101d4816"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d0af2d58b8994eeeb64cec26101d4816"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d0af2d58b8994eeeb64cec26101d4816", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:50:33.480835 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-36790199 Sep 17 20:50:33.480835 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: d0af2d58b8994eeeb64cec26101d4816 Sep 17 20:50:33.480835 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-36790199 Sep 17 20:50:33.480835 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin Sep 17 20:50:33.480835 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:50:33.480835 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:50:33.480835 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 62d984d1cf7c41f783ddbe05bc545e4a Sep 17 20:50:33.480835 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin Sep 17 20:50:33.480835 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:50:33.480835 ncdv-master-1 devstack@n-api.service[140523]: exception: Access list not available for public flavors. Sep 17 20:50:33.480835 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'flavor_id': '800532074'} Sep 17 20:50:33.481452 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:50:33.481452 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:33.481452 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:33.481452 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:33.481452 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:50:33.481452 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:50:33.481452 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:50:33.481452 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:50:33.481452 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Sep 17 20:50:33.481452 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 17 20:50:33.481452 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Sep 17 20:50:33.481452 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:33.481452 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:33.481452 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:33.481452 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:33.481452 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:33.481452 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:33.481452 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:50:33.481452 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:50:33.481452 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Sep 17 20:50:33.481452 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:33.483647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3c581842-b937-470e-868b-442bcfa65243 tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:50:33.484532 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3c581842-b937-470e-868b-442bcfa65243 tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/800532074/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.023711 Sep 17 20:50:33.488151 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 30/74] 10.222.0.26 () {58 vars in 1206 bytes} [Sat Sep 17 20:50:33 2022] GET /compute/v2.1/flavors/800532074/os-flavor-access => generated 91 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 20:50:33.494289 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b6fef2e7-e953-4ad7-86e3-5e9b14620c92 tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:33.521716 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b6fef2e7-e953-4ad7-86e3-5e9b14620c92 tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/800532074" status: 202 len: 0 microversion: 2.1 time: 0.031915 Sep 17 20:50:33.525272 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 45/75] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Sep 17 20:50:33 2022] DELETE /compute/v2.1/flavors/800532074 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:50:33.536342 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c84b5c5b-8a1b-43bf-bf7a-189d790d6ea6 tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:33.559756 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c84b5c5b-8a1b-43bf-bf7a-189d790d6ea6 tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029490 Sep 17 20:50:33.560592 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 31/76] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:50:33 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:33.581810 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-713a0f74-0167-429d-8111-a76ed57a92de tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1800863811", "id": 956887215, "os-flavor-access:is_public": "False"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:33.605907 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-713a0f74-0167-429d-8111-a76ed57a92de tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.027379 Sep 17 20:50:33.606402 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 46/77] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:50:33 2022] POST /compute/v2.1/flavors => generated 436 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:33.995529 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-039a3e69-8fb1-4f32-9bc8-7bb63c29f12c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-364907394", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:34.023142 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-092a23d4-64d4-4754-8214-6e88fd9f154b tempest-FlavorsAccessNegativeTestJSON-2109805960 tempest-FlavorsAccessNegativeTestJSON-2109805960-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0a55519ffc224c849e9be490acb4596e"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:34.026539 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-092a23d4-64d4-4754-8214-6e88fd9f154b tempest-FlavorsAccessNegativeTestJSON-2109805960 tempest-FlavorsAccessNegativeTestJSON-2109805960-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '1e865b793b834802a2bfa7146987d8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55519ffc224c849e9be490acb4596e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:34.030114 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-092a23d4-64d4-4754-8214-6e88fd9f154b tempest-FlavorsAccessNegativeTestJSON-2109805960 tempest-FlavorsAccessNegativeTestJSON-2109805960-project] Request method failure captured: Sep 17 20:50:34.030114 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/flavors/956887215/action HTTP/1.1 Sep 17 20:50:34.030114 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:50:34.030114 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:50:34.030114 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:50:34.030114 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 67 Sep 17 20:50:34.030114 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:50:34.030114 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:50:34.030114 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:50:34.030114 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:50:34.030114 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjMSRQXGc8fGgmKjE82qaC5a4E2wCSXlTp2d95UWlF9DOB3x6YFXi0sLEDQwl1hADaHT1K_s4VnWpKsuXH5GTRloj9VAh7PoGQfEYyka7vRkYV3XsOkAMdFLxx_2n1E_TCUkhKxnYi5dbalZOYqq3dUYxfSndrHZ6RUV4T2Cv382JBA Sep 17 20:50:34.030114 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:50:34.030114 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:50:34.030114 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:50:34.030114 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:50:34.030114 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:50:34.030114 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:50:34.030114 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 0a55519ffc224c849e9be490acb4596e Sep 17 20:50:34.030114 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2109805960 Sep 17 20:50:34.030114 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:50:34.030114 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:50:34.031344 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0a55519ffc224c849e9be490acb4596e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0a55519ffc224c849e9be490acb4596e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0a55519ffc224c849e9be490acb4596e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0a55519ffc224c849e9be490acb4596e", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:50:34.031344 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2109805960 Sep 17 20:50:34.031344 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 0a55519ffc224c849e9be490acb4596e Sep 17 20:50:34.031344 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2109805960 Sep 17 20:50:34.031344 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-FlavorsAccessNegativeTestJSON-2109805960-project Sep 17 20:50:34.031344 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:50:34.031344 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:50:34.031344 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 1e865b793b834802a2bfa7146987d8f2 Sep 17 20:50:34.031344 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2109805960-project Sep 17 20:50:34.031344 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:50:34.031344 ncdv-master-1 devstack@n-api.service[140524]: {"addTenantAccess": {"tenant": "0a55519ffc224c849e9be490acb4596e"}} Sep 17 20:50:34.031344 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:50:34.031978 ncdv-master-1 devstack@n-api.service[140524]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 17 20:50:34.031978 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '956887215', 'body': {'addTenantAccess': {'tenant': '0a55519ffc224c849e9be490acb4596e'}}} Sep 17 20:50:34.031978 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:50:34.031978 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:34.031978 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:34.031978 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:34.031978 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:50:34.031978 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:50:34.031978 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:50:34.031978 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:50:34.031978 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:50:34.031978 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:50:34.031978 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Sep 17 20:50:34.031978 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Sep 17 20:50:34.031978 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 17 20:50:34.031978 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 17 20:50:34.031978 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 17 20:50:34.031978 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 17 20:50:34.031978 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:50:34.032952 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:50:34.032952 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:50:34.032952 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:50:34.032952 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 17 20:50:34.032952 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 17 20:50:34.032952 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 17 20:50:34.032952 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 17 20:50:34.032952 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 17 20:50:34.032952 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 17 20:50:34.032952 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 17 20:50:34.032952 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:34.032952 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:34.032952 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:34.032952 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:34.032952 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:34.032952 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:34.032952 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 17 20:50:34.032952 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 17 20:50:34.032952 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 17 20:50:34.032952 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:34.033986 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-092a23d4-64d4-4754-8214-6e88fd9f154b tempest-FlavorsAccessNegativeTestJSON-2109805960 tempest-FlavorsAccessNegativeTestJSON-2109805960-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:50:34.034780 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-092a23d4-64d4-4754-8214-6e88fd9f154b tempest-FlavorsAccessNegativeTestJSON-2109805960 tempest-FlavorsAccessNegativeTestJSON-2109805960-project] 10.222.0.26 "POST /compute/v2.1/flavors/956887215/action" status: 403 len: 130 microversion: 2.1 time: 0.416484 Sep 17 20:50:34.037689 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 47/78] 10.222.0.26 () {60 vars in 1197 bytes} [Sat Sep 17 20:50:33 2022] POST /compute/v2.1/flavors/956887215/action => generated 130 bytes in 420 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:50:34.047784 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1a5a69bb-12f8-41f3-a197-50fc8226cd42 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:34.053754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1a5a69bb-12f8-41f3-a197-50fc8226cd42 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] [instance: 07019932-c686-4174-9828-3035fcc1694a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:34.064572 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a5a69bb-12f8-41f3-a197-50fc8226cd42 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:34.065074 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a5a69bb-12f8-41f3-a197-50fc8226cd42 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:34.065532 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a5a69bb-12f8-41f3-a197-50fc8226cd42 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:34.066563 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a5a69bb-12f8-41f3-a197-50fc8226cd42 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:34.067701 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a5a69bb-12f8-41f3-a197-50fc8226cd42 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:34.068398 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a5a69bb-12f8-41f3-a197-50fc8226cd42 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:34.366158 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1a5a69bb-12f8-41f3-a197-50fc8226cd42 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05aab669547487d8876a70e338d3e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4ffd27d7414061b67e053657044400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:34.380585 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1a5a69bb-12f8-41f3-a197-50fc8226cd42 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] 10.222.0.26 "GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a" status: 200 len: 1290 microversion: 2.1 time: 0.336442 Sep 17 20:50:34.382159 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 48/79] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:34 2022] GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a => generated 1290 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:34.386911 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-94c79aa1-bdef-4efc-bc14-19f44145a0a5 tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:34.408861 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-94c79aa1-bdef-4efc-bc14-19f44145a0a5 tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/956887215" status: 202 len: 0 microversion: 2.1 time: 0.025178 Sep 17 20:50:34.410391 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 49/80] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Sep 17 20:50:34 2022] DELETE /compute/v2.1/flavors/956887215 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:50:34.426465 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6b67ddd6-c335-495c-bcee-9a54b50b44e5 tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:34.446175 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6b67ddd6-c335-495c-bcee-9a54b50b44e5 tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023307 Sep 17 20:50:34.447121 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 50/81] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:50:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:34.468779 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2d8e3064-5d8c-4df5-8825-468630838346 tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-813882542", "id": 294612599, "os-flavor-access:is_public": "False"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:34.498703 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2d8e3064-5d8c-4df5-8825-468630838346 tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.034679 Sep 17 20:50:34.499481 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 51/82] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:50:34 2022] POST /compute/v2.1/flavors => generated 435 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:50:34.512188 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6ef1a0e0-3e2e-45d4-bfd4-dcda1d2b28ae tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0a55519ffc224c849e9be490acb4596e"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:34.772729 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-039a3e69-8fb1-4f32-9bc8-7bb63c29f12c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] validate_networks() for None {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:50:35.103697 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-039a3e69-8fb1-4f32-9bc8-7bb63c29f12c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:50:35.105140 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-039a3e69-8fb1-4f32-9bc8-7bb63c29f12c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:50:35.106533 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-039a3e69-8fb1-4f32-9bc8-7bb63c29f12c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:50:35.108016 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-039a3e69-8fb1-4f32-9bc8-7bb63c29f12c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:50:35.110302 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-039a3e69-8fb1-4f32-9bc8-7bb63c29f12c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:50:35.168926 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-039a3e69-8fb1-4f32-9bc8-7bb63c29f12c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:35.169783 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-039a3e69-8fb1-4f32-9bc8-7bb63c29f12c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:35.170453 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-039a3e69-8fb1-4f32-9bc8-7bb63c29f12c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:35.171376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-039a3e69-8fb1-4f32-9bc8-7bb63c29f12c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:35.175907 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-039a3e69-8fb1-4f32-9bc8-7bb63c29f12c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:35.178098 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-039a3e69-8fb1-4f32-9bc8-7bb63c29f12c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:35.218330 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-039a3e69-8fb1-4f32-9bc8-7bb63c29f12c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Getting quotas for project 07ce9fd746374b478a743261eb014e5c. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:50:35.226225 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-039a3e69-8fb1-4f32-9bc8-7bb63c29f12c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Getting quotas for user 226a87a1f393420b8d19ec2390e9d063 and project 07ce9fd746374b478a743261eb014e5c. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:50:35.240131 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-039a3e69-8fb1-4f32-9bc8-7bb63c29f12c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:50:35.244177 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-039a3e69-8fb1-4f32-9bc8-7bb63c29f12c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:50:35.340817 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-039a3e69-8fb1-4f32-9bc8-7bb63c29f12c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.731537 Sep 17 20:50:35.348778 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 32/83] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:50:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:50:35.355305 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-016a574a-b81d-4b2f-a035-671633e916f3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:35.356414 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-016a574a-b81d-4b2f-a035-671633e916f3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:35.491016 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-016a574a-b81d-4b2f-a035-671633e916f3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:35.520028 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-016a574a-b81d-4b2f-a035-671633e916f3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1212 microversion: 2.1 time: 0.169504 Sep 17 20:50:35.523744 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 33/84] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:35 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1212 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:50:35.529395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2406ab2b-ad0c-4268-8603-7dea05105271 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:35.530217 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2406ab2b-ad0c-4268-8603-7dea05105271 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] [instance: 07019932-c686-4174-9828-3035fcc1694a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:35.541653 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2406ab2b-ad0c-4268-8603-7dea05105271 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:35.542604 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2406ab2b-ad0c-4268-8603-7dea05105271 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:35.543295 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2406ab2b-ad0c-4268-8603-7dea05105271 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:35.544620 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2406ab2b-ad0c-4268-8603-7dea05105271 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:35.545340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2406ab2b-ad0c-4268-8603-7dea05105271 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:35.546426 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2406ab2b-ad0c-4268-8603-7dea05105271 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:35.596952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=21,nova_api:INSERT=4 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:50:35.653026 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6ef1a0e0-3e2e-45d4-bfd4-dcda1d2b28ae tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/294612599/action" status: 200 len: 96 microversion: 2.1 time: 1.144797 Sep 17 20:50:35.654525 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 52/85] 10.222.0.26 () {60 vars in 1197 bytes} [Sat Sep 17 20:50:34 2022] POST /compute/v2.1/flavors/294612599/action => generated 96 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:50:35.687255 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-14bbb3b7-228c-45fb-a861-678e5dafa901 tempest-FlavorsAccessNegativeTestJSON-2109805960 tempest-FlavorsAccessNegativeTestJSON-2109805960-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0a55519ffc224c849e9be490acb4596e"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:35.699184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-14bbb3b7-228c-45fb-a861-678e5dafa901 tempest-FlavorsAccessNegativeTestJSON-2109805960 tempest-FlavorsAccessNegativeTestJSON-2109805960-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '1e865b793b834802a2bfa7146987d8f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55519ffc224c849e9be490acb4596e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:35.700922 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-14bbb3b7-228c-45fb-a861-678e5dafa901 tempest-FlavorsAccessNegativeTestJSON-2109805960 tempest-FlavorsAccessNegativeTestJSON-2109805960-project] Request method failure captured: Sep 17 20:50:35.700922 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/flavors/294612599/action HTTP/1.1 Sep 17 20:50:35.700922 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:50:35.700922 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:50:35.700922 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:50:35.700922 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 70 Sep 17 20:50:35.700922 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:50:35.700922 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:50:35.700922 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:50:35.700922 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:50:35.700922 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjMSRQXGc8fGgmKjE82qaC5a4E2wCSXlTp2d95UWlF9DOB3x6YFXi0sLEDQwl1hADaHT1K_s4VnWpKsuXH5GTRloj9VAh7PoGQfEYyka7vRkYV3XsOkAMdFLxx_2n1E_TCUkhKxnYi5dbalZOYqq3dUYxfSndrHZ6RUV4T2Cv382JBA Sep 17 20:50:35.700922 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:50:35.700922 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:50:35.700922 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:50:35.700922 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:50:35.700922 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:50:35.700922 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:50:35.700922 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 0a55519ffc224c849e9be490acb4596e Sep 17 20:50:35.700922 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2109805960 Sep 17 20:50:35.700922 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:50:35.700922 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:50:35.702059 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0a55519ffc224c849e9be490acb4596e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0a55519ffc224c849e9be490acb4596e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0a55519ffc224c849e9be490acb4596e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0a55519ffc224c849e9be490acb4596e", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:50:35.702059 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2109805960 Sep 17 20:50:35.702059 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 0a55519ffc224c849e9be490acb4596e Sep 17 20:50:35.702059 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2109805960 Sep 17 20:50:35.702059 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-FlavorsAccessNegativeTestJSON-2109805960-project Sep 17 20:50:35.702059 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:50:35.702059 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:50:35.702059 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 1e865b793b834802a2bfa7146987d8f2 Sep 17 20:50:35.702059 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2109805960-project Sep 17 20:50:35.702059 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:50:35.702059 ncdv-master-1 devstack@n-api.service[140524]: {"removeTenantAccess": {"tenant": "0a55519ffc224c849e9be490acb4596e"}} Sep 17 20:50:35.702059 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:50:35.702708 ncdv-master-1 devstack@n-api.service[140524]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 17 20:50:35.702708 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '294612599', 'body': {'removeTenantAccess': {'tenant': '0a55519ffc224c849e9be490acb4596e'}}} Sep 17 20:50:35.702708 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:50:35.702708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:35.702708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:35.702708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:35.702708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:50:35.702708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:50:35.702708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:50:35.702708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:50:35.702708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:50:35.702708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:50:35.702708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Sep 17 20:50:35.702708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi context.can( Sep 17 20:50:35.702708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 17 20:50:35.702708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 17 20:50:35.702708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 17 20:50:35.702708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 17 20:50:35.702708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:50:35.702708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:50:35.703734 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:50:35.703734 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:50:35.703734 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 17 20:50:35.703734 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 17 20:50:35.703734 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 17 20:50:35.703734 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 17 20:50:35.703734 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 17 20:50:35.703734 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 17 20:50:35.703734 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 17 20:50:35.703734 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:35.703734 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:35.703734 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:35.703734 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:35.703734 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:35.703734 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:35.703734 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 17 20:50:35.703734 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 17 20:50:35.703734 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 17 20:50:35.703734 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:35.705195 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-14bbb3b7-228c-45fb-a861-678e5dafa901 tempest-FlavorsAccessNegativeTestJSON-2109805960 tempest-FlavorsAccessNegativeTestJSON-2109805960-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:50:35.705195 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-14bbb3b7-228c-45fb-a861-678e5dafa901 tempest-FlavorsAccessNegativeTestJSON-2109805960 tempest-FlavorsAccessNegativeTestJSON-2109805960-project] 10.222.0.26 "POST /compute/v2.1/flavors/294612599/action" status: 403 len: 133 microversion: 2.1 time: 0.038853 Sep 17 20:50:35.708028 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 53/86] 10.222.0.26 () {60 vars in 1197 bytes} [Sat Sep 17 20:50:35 2022] POST /compute/v2.1/flavors/294612599/action => generated 133 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:50:35.723422 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c2dc0f45-e250-4452-b2da-f84d563d2734 tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0a55519ffc224c849e9be490acb4596e"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:35.918660 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2406ab2b-ad0c-4268-8603-7dea05105271 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05aab669547487d8876a70e338d3e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4ffd27d7414061b67e053657044400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:35.943247 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2406ab2b-ad0c-4268-8603-7dea05105271 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] 10.222.0.26 "GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a" status: 200 len: 1296 microversion: 2.1 time: 0.417444 Sep 17 20:50:35.943661 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 34/87] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:35 2022] GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a => generated 1296 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:36.551677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-22ea534e-60f1-48ac-8ed0-e55615e643f2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:36.552347 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-22ea534e-60f1-48ac-8ed0-e55615e643f2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:36.702686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-22ea534e-60f1-48ac-8ed0-e55615e643f2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:36.711197 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-22ea534e-60f1-48ac-8ed0-e55615e643f2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1212 microversion: 2.1 time: 0.165813 Sep 17 20:50:36.713562 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 35/88] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:36 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1212 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:50:36.938939 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c2dc0f45-e250-4452-b2da-f84d563d2734 tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/294612599/action" status: 200 len: 21 microversion: 2.1 time: 1.228216 Sep 17 20:50:36.939617 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 54/89] 10.222.0.26 () {60 vars in 1197 bytes} [Sat Sep 17 20:50:35 2022] POST /compute/v2.1/flavors/294612599/action => generated 21 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:50:36.955768 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bd4265dc-bcba-4542-9a46-75db5f3083e0 tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:36.968666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0dcb5ec9-8c66-415a-91be-3047158ec3db tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:36.969710 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0dcb5ec9-8c66-415a-91be-3047158ec3db tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] [instance: 07019932-c686-4174-9828-3035fcc1694a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:36.977930 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0dcb5ec9-8c66-415a-91be-3047158ec3db tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:36.983750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0dcb5ec9-8c66-415a-91be-3047158ec3db tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:36.985193 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0dcb5ec9-8c66-415a-91be-3047158ec3db tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:36.986263 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0dcb5ec9-8c66-415a-91be-3047158ec3db tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:36.988055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0dcb5ec9-8c66-415a-91be-3047158ec3db tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:36.990002 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0dcb5ec9-8c66-415a-91be-3047158ec3db tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:37.003484 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bd4265dc-bcba-4542-9a46-75db5f3083e0 tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/294612599" status: 202 len: 0 microversion: 2.1 time: 0.057305 Sep 17 20:50:37.014088 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 36/90] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Sep 17 20:50:36 2022] DELETE /compute/v2.1/flavors/294612599 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:50:37.022770 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-911e6f91-1d88-4497-8af2-9053798a089e tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:37.063923 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-911e6f91-1d88-4497-8af2-9053798a089e tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047413 Sep 17 20:50:37.078496 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 37/91] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:50:37 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:37.086055 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f1297215-8547-44f8-9ca1-e93f43a1a65d tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-272659637", "id": 352203965, "os-flavor-access:is_public": "False"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:37.117889 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f1297215-8547-44f8-9ca1-e93f43a1a65d tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.035927 Sep 17 20:50:37.118804 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 38/92] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:50:37 2022] POST /compute/v2.1/flavors => generated 435 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:37.133839 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5a293f97-602b-4707-a180-cb8e81c6144f tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "ceac6247852c48a99cc782fb135c6a28"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:37.254964 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0dcb5ec9-8c66-415a-91be-3047158ec3db tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05aab669547487d8876a70e338d3e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4ffd27d7414061b67e053657044400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:37.266934 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0dcb5ec9-8c66-415a-91be-3047158ec3db tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] 10.222.0.26 "GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a" status: 200 len: 1338 microversion: 2.1 time: 0.303507 Sep 17 20:50:37.267914 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 55/93] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:36 2022] GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a => generated 1338 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:37.745044 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a6df94b8-bced-4c83-b74f-3b3aac716be8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:37.746104 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a6df94b8-bced-4c83-b74f-3b3aac716be8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:37.757815 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6df94b8-bced-4c83-b74f-3b3aac716be8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:37.759454 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6df94b8-bced-4c83-b74f-3b3aac716be8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:37.760125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6df94b8-bced-4c83-b74f-3b3aac716be8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:37.763129 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6df94b8-bced-4c83-b74f-3b3aac716be8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:37.766058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6df94b8-bced-4c83-b74f-3b3aac716be8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:37.767861 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6df94b8-bced-4c83-b74f-3b3aac716be8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:37.916812 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a6df94b8-bced-4c83-b74f-3b3aac716be8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:37.927980 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a6df94b8-bced-4c83-b74f-3b3aac716be8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1264 microversion: 2.1 time: 0.188584 Sep 17 20:50:37.929292 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 56/94] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:37 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1264 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:50:38.122747 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-5a293f97-602b-4707-a180-cb8e81c6144f tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] HTTP exception thrown: Flavor access not found for 31 / ceac6247852c48a99cc782fb135c6a28 combination. Sep 17 20:50:38.130939 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5a293f97-602b-4707-a180-cb8e81c6144f tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] Request method failure captured: Sep 17 20:50:38.130939 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/flavors/352203965/action HTTP/1.1 Sep 17 20:50:38.130939 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:50:38.130939 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:50:38.130939 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:50:38.130939 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 70 Sep 17 20:50:38.130939 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:50:38.130939 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:50:38.130939 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:50:38.130939 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:50:38.130939 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjMUFQdOozlnxD8usOW2tu_1eAJCt5lFgVSkEGVbTVW7Kj4-xlNuC9CRsnxnZllSZFZ-UaQplI_avLg_VPjmRrRFvAUEtg7MEh0Q81sxW06CPIN0PwnYcmvxMTzi4AN8koywckPobdno8BSmMHoHn013c__w0_P5KlilDpFvHW5LidM Sep 17 20:50:38.130939 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:50:38.130939 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:50:38.130939 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:50:38.130939 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:50:38.130939 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:50:38.130939 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:50:38.130939 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: d0af2d58b8994eeeb64cec26101d4816 Sep 17 20:50:38.130939 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-36790199 Sep 17 20:50:38.130939 ncdv-master-1 devstack@n-api.service[140523]: X-Role: admin,member,reader Sep 17 20:50:38.130939 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: admin,member,reader Sep 17 20:50:38.132211 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d0af2d58b8994eeeb64cec26101d4816"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d0af2d58b8994eeeb64cec26101d4816"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d0af2d58b8994eeeb64cec26101d4816"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d0af2d58b8994eeeb64cec26101d4816", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:50:38.132211 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-36790199 Sep 17 20:50:38.132211 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: d0af2d58b8994eeeb64cec26101d4816 Sep 17 20:50:38.132211 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-36790199 Sep 17 20:50:38.132211 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin Sep 17 20:50:38.132211 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:50:38.132211 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:50:38.132211 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 62d984d1cf7c41f783ddbe05bc545e4a Sep 17 20:50:38.132211 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin Sep 17 20:50:38.132211 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 20:50:38.132211 ncdv-master-1 devstack@n-api.service[140523]: {"removeTenantAccess": {"tenant": "ceac6247852c48a99cc782fb135c6a28"}} Sep 17 20:50:38.132211 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:50:38.132873 ncdv-master-1 devstack@n-api.service[140523]: exception: Flavor access not found for 31 / ceac6247852c48a99cc782fb135c6a28 combination. Sep 17 20:50:38.132873 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '352203965', 'body': {'removeTenantAccess': {'tenant': 'ceac6247852c48a99cc782fb135c6a28'}}} Sep 17 20:50:38.132873 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:50:38.132873 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:38.132873 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Sep 17 20:50:38.132873 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Sep 17 20:50:38.132873 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 17 20:50:38.132873 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 17 20:50:38.132873 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Sep 17 20:50:38.132873 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Sep 17 20:50:38.132873 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Sep 17 20:50:38.132873 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Sep 17 20:50:38.132873 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Sep 17 20:50:38.132873 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Sep 17 20:50:38.132873 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 17 20:50:38.132873 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 17 20:50:38.132873 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Sep 17 20:50:38.132873 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Sep 17 20:50:38.133967 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 31 / ceac6247852c48a99cc782fb135c6a28 combination. Sep 17 20:50:38.133967 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:38.133967 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:38.133967 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:38.133967 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:38.133967 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:38.133967 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:38.133967 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:50:38.133967 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:50:38.133967 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:50:38.133967 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:50:38.133967 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:50:38.133967 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:50:38.133967 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Sep 17 20:50:38.133967 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:50:38.133967 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 31 / ceac6247852c48a99cc782fb135c6a28 combination. Sep 17 20:50:38.133967 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:38.133967 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:38.133967 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:38.133967 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:38.135019 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:38.135019 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:38.135019 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:50:38.135019 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:50:38.135019 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 31 / ceac6247852c48a99cc782fb135c6a28 combination. Sep 17 20:50:38.135019 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:38.135019 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5a293f97-602b-4707-a180-cb8e81c6144f tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] Returning 404 to user: Flavor access not found for 31 / ceac6247852c48a99cc782fb135c6a28 combination. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:50:38.135019 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5a293f97-602b-4707-a180-cb8e81c6144f tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/352203965/action" status: 404 len: 124 microversion: 2.1 time: 1.005984 Sep 17 20:50:38.140098 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 39/95] 10.222.0.26 () {60 vars in 1197 bytes} [Sat Sep 17 20:50:37 2022] POST /compute/v2.1/flavors/352203965/action => generated 124 bytes in 1013 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:50:38.147828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2a4601b9-cd6e-45e0-994c-733ebe414633 tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:38.189584 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2a4601b9-cd6e-45e0-994c-733ebe414633 tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/352203965" status: 202 len: 0 microversion: 2.1 time: 0.050487 Sep 17 20:50:38.190769 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 57/96] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Sep 17 20:50:38 2022] DELETE /compute/v2.1/flavors/352203965 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 17 20:50:38.205821 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-27dff8d3-b29d-463d-bd4d-87979b1a75e3 tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:38.248428 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-27dff8d3-b29d-463d-bd4d-87979b1a75e3 tempest-FlavorsAccessNegativeTestJSON-36790199 tempest-FlavorsAccessNegativeTestJSON-36790199-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047698 Sep 17 20:50:38.271505 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 40/97] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:50:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:38.303971 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d53e57b1-67b1-4d7c-8f28-057ca28cb1bf tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:38.305057 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d53e57b1-67b1-4d7c-8f28-057ca28cb1bf tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] [instance: 07019932-c686-4174-9828-3035fcc1694a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:38.313453 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d53e57b1-67b1-4d7c-8f28-057ca28cb1bf tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:38.314262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d53e57b1-67b1-4d7c-8f28-057ca28cb1bf tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:38.314980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d53e57b1-67b1-4d7c-8f28-057ca28cb1bf tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:38.315898 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d53e57b1-67b1-4d7c-8f28-057ca28cb1bf tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:38.316523 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d53e57b1-67b1-4d7c-8f28-057ca28cb1bf tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:38.317115 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d53e57b1-67b1-4d7c-8f28-057ca28cb1bf tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:38.601953 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d53e57b1-67b1-4d7c-8f28-057ca28cb1bf tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05aab669547487d8876a70e338d3e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4ffd27d7414061b67e053657044400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:38.614756 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d53e57b1-67b1-4d7c-8f28-057ca28cb1bf tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] 10.222.0.26 "GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a" status: 200 len: 1338 microversion: 2.1 time: 0.318958 Sep 17 20:50:38.616518 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 58/98] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:38 2022] GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a => generated 1338 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:38.957254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6743ebcf-6dea-46a4-95a0-ef7b9ff666fb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:38.957994 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6743ebcf-6dea-46a4-95a0-ef7b9ff666fb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:38.964192 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6743ebcf-6dea-46a4-95a0-ef7b9ff666fb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:38.964736 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6743ebcf-6dea-46a4-95a0-ef7b9ff666fb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:38.977814 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6743ebcf-6dea-46a4-95a0-ef7b9ff666fb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:38.979463 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6743ebcf-6dea-46a4-95a0-ef7b9ff666fb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:38.980517 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6743ebcf-6dea-46a4-95a0-ef7b9ff666fb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:38.981107 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6743ebcf-6dea-46a4-95a0-ef7b9ff666fb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:39.129558 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6743ebcf-6dea-46a4-95a0-ef7b9ff666fb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:39.159462 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6743ebcf-6dea-46a4-95a0-ef7b9ff666fb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1270 microversion: 2.1 time: 0.200896 Sep 17 20:50:39.164652 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 59/99] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:38 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1270 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:39.337076 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-97eec3c0-47df-4fdc-9295-1352f4889c58 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1755882171", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:40.001773 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-eb6060cf-e58e-4d53-9245-1fb2a1878ff6 tempest-InstanceUsageAuditLogNegativeTestJSON-642111592 tempest-InstanceUsageAuditLogNegativeTestJSON-642111592-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:40.007952 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-eb6060cf-e58e-4d53-9245-1fb2a1878ff6 tempest-InstanceUsageAuditLogNegativeTestJSON-642111592 tempest-InstanceUsageAuditLogNegativeTestJSON-642111592-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Sep 17 20:50:40.023702 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-eb6060cf-e58e-4d53-9245-1fb2a1878ff6 tempest-InstanceUsageAuditLogNegativeTestJSON-642111592 tempest-InstanceUsageAuditLogNegativeTestJSON-642111592-project-admin] Request method failure captured: Sep 17 20:50:40.023702 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Sep 17 20:50:40.023702 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:50:40.023702 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:50:40.023702 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:50:40.023702 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:50:40.023702 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:50:40.023702 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:50:40.023702 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:50:40.023702 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:50:40.023702 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjMet8SNQnixbw1lml_IcpMQK2-jIDZzwubFr2Q0AwIlolXUuuSSfvVz78ptf5K_1o99fPRHLeE1noLm7qjpWfVkphmKqNGBW0Viycx2KlrgFWxiE8yOh7NCOm9s2WlZDnXTO5CaFi1MlKPkw3sXWwqk9gB3g49Mxt30Go66eVPBP2s Sep 17 20:50:40.023702 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:50:40.023702 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:50:40.023702 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:50:40.023702 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:50:40.023702 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:50:40.023702 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:50:40.023702 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: b710ac6f05774b7380c602a99891b955 Sep 17 20:50:40.023702 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-642111592 Sep 17 20:50:40.023702 ncdv-master-1 devstack@n-api.service[140524]: X-Role: admin,member,reader Sep 17 20:50:40.023702 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: admin,member,reader Sep 17 20:50:40.024841 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b710ac6f05774b7380c602a99891b955"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b710ac6f05774b7380c602a99891b955"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b710ac6f05774b7380c602a99891b955"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b710ac6f05774b7380c602a99891b955", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:50:40.024841 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-642111592 Sep 17 20:50:40.024841 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: b710ac6f05774b7380c602a99891b955 Sep 17 20:50:40.024841 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-642111592 Sep 17 20:50:40.024841 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-642111592-project-admin Sep 17 20:50:40.024841 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:50:40.024841 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:50:40.024841 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 1de2d93fba78404bbe0f2f76317f903c Sep 17 20:50:40.024841 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-642111592-project-admin Sep 17 20:50:40.024841 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:50:40.024841 ncdv-master-1 devstack@n-api.service[140524]: exception: Invalid timestamp for date invalid_time Sep 17 20:50:40.025703 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'invalid_time'} Sep 17 20:50:40.025703 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:50:40.025703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:40.025703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Sep 17 20:50:40.025703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Sep 17 20:50:40.025703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Sep 17 20:50:40.025703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Sep 17 20:50:40.025703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Sep 17 20:50:40.025703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Sep 17 20:50:40.025703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Sep 17 20:50:40.025703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:40.025703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:40.025703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:40.025703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:40.025703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:40.025703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:40.025703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:50:40.025703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:50:40.025703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:50:40.025703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:50:40.026904 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Sep 17 20:50:40.026904 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Sep 17 20:50:40.026904 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Sep 17 20:50:40.026904 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:40.026904 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:40.026904 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:40.026904 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:40.026904 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:40.026904 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:40.026904 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:50:40.026904 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:50:40.026904 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Sep 17 20:50:40.026904 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:40.026904 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-eb6060cf-e58e-4d53-9245-1fb2a1878ff6 tempest-InstanceUsageAuditLogNegativeTestJSON-642111592 tempest-InstanceUsageAuditLogNegativeTestJSON-642111592-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:50:40.026904 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-eb6060cf-e58e-4d53-9245-1fb2a1878ff6 tempest-InstanceUsageAuditLogNegativeTestJSON-642111592 tempest-InstanceUsageAuditLogNegativeTestJSON-642111592-project-admin] 10.222.0.26 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.858515 Sep 17 20:50:40.029579 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 60/100] 10.222.0.26 () {58 vars in 1224 bytes} [Sat Sep 17 20:50:39 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 863 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 17 20:50:40.036803 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8219b5bd-7748-4bb9-a5c8-b45713222369 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:40.037631 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8219b5bd-7748-4bb9-a5c8-b45713222369 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] [instance: 07019932-c686-4174-9828-3035fcc1694a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:40.051796 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8219b5bd-7748-4bb9-a5c8-b45713222369 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:40.052277 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8219b5bd-7748-4bb9-a5c8-b45713222369 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:40.052736 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8219b5bd-7748-4bb9-a5c8-b45713222369 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:40.053481 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8219b5bd-7748-4bb9-a5c8-b45713222369 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:40.053946 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8219b5bd-7748-4bb9-a5c8-b45713222369 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:40.054381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8219b5bd-7748-4bb9-a5c8-b45713222369 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:40.372171 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8219b5bd-7748-4bb9-a5c8-b45713222369 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05aab669547487d8876a70e338d3e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4ffd27d7414061b67e053657044400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:40.391384 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8219b5bd-7748-4bb9-a5c8-b45713222369 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] 10.222.0.26 "GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a" status: 200 len: 1338 microversion: 2.1 time: 0.360532 Sep 17 20:50:40.423567 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 61/101] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:40 2022] GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a => generated 1338 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:41.001108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b182ca63-c214-458d-872e-a35508786362 tempest-FlavorsV261TestJSON-715210416 tempest-FlavorsV261TestJSON-715210416-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1422549379", "id": 1254369704, "os-flavor-access:is_public": "True"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:41.051936 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b182ca63-c214-458d-872e-a35508786362 tempest-FlavorsV261TestJSON-715210416 tempest-FlavorsV261TestJSON-715210416-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.626897 Sep 17 20:50:41.061899 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 62/102] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Sep 17 20:50:40 2022] POST /compute/v2.1/flavors => generated 468 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:50:41.259467 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=4 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:50:41.602987 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-69755ba1-3e32-4269-bc17-d0a815c6bbc8 tempest-InstanceUsageAuditLogNegativeTestJSON-1683861902 tempest-InstanceUsageAuditLogNegativeTestJSON-1683861902-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:41.605826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-69755ba1-3e32-4269-bc17-d0a815c6bbc8 tempest-InstanceUsageAuditLogNegativeTestJSON-1683861902 tempest-InstanceUsageAuditLogNegativeTestJSON-1683861902-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'a9626c56a7af47e292e3c3b61e35cd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7251e61bfc7e4fdcb7ede9dc59b61138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:41.610428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-69755ba1-3e32-4269-bc17-d0a815c6bbc8 tempest-InstanceUsageAuditLogNegativeTestJSON-1683861902 tempest-InstanceUsageAuditLogNegativeTestJSON-1683861902-project] Request method failure captured: Sep 17 20:50:41.610428 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Sep 17 20:50:41.610428 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:50:41.610428 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:50:41.610428 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:50:41.610428 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:50:41.610428 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:50:41.610428 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:50:41.610428 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:50:41.610428 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:50:41.610428 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjMbh4JhQT3I6tsngBIaWMmiXs6Xw7-2ku1hmqiu7_xjqGgOBWCWb_ZCoc7sJOkJtB7CaTtP5sIC1fPGjGwcNVxvDLOzB1_P_ywiZasVhXeWlCVRtFqxX3uhTW8uX77b60AMX1w7bbQl64jHYsE8AQVDbqNNIpNsUgEhVltLRifqDew Sep 17 20:50:41.610428 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:50:41.610428 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:50:41.610428 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:50:41.610428 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:50:41.610428 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:50:41.610428 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:50:41.610428 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 7251e61bfc7e4fdcb7ede9dc59b61138 Sep 17 20:50:41.610428 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1683861902 Sep 17 20:50:41.610428 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:50:41.610428 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:50:41.611661 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7251e61bfc7e4fdcb7ede9dc59b61138"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7251e61bfc7e4fdcb7ede9dc59b61138"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7251e61bfc7e4fdcb7ede9dc59b61138"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7251e61bfc7e4fdcb7ede9dc59b61138", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:50:41.611661 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1683861902 Sep 17 20:50:41.611661 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 7251e61bfc7e4fdcb7ede9dc59b61138 Sep 17 20:50:41.611661 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1683861902 Sep 17 20:50:41.611661 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1683861902-project Sep 17 20:50:41.611661 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:50:41.611661 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:50:41.611661 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: a9626c56a7af47e292e3c3b61e35cd7b Sep 17 20:50:41.611661 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1683861902-project Sep 17 20:50:41.611661 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:50:41.612247 ncdv-master-1 devstack@n-api.service[140524]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 17 20:50:41.612247 ncdv-master-1 devstack@n-api.service[140524]: action_args: {} Sep 17 20:50:41.612247 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:50:41.612247 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:41.612247 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:41.612247 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:41.612247 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:50:41.612247 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:50:41.612247 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:50:41.612247 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:50:41.612247 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Sep 17 20:50:41.612247 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Sep 17 20:50:41.612247 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 17 20:50:41.612247 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 17 20:50:41.612247 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 17 20:50:41.612247 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 17 20:50:41.612247 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:50:41.612247 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:50:41.612247 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:50:41.612247 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:50:41.613371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 17 20:50:41.613371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 17 20:50:41.613371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 17 20:50:41.613371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 17 20:50:41.613371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 17 20:50:41.613371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 17 20:50:41.613371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 17 20:50:41.613371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:41.613371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:41.613371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:41.613371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:41.613371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:41.613371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:41.613371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 17 20:50:41.613371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 17 20:50:41.613371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 17 20:50:41.613371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:41.618787 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-69755ba1-3e32-4269-bc17-d0a815c6bbc8 tempest-InstanceUsageAuditLogNegativeTestJSON-1683861902 tempest-InstanceUsageAuditLogNegativeTestJSON-1683861902-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:50:41.621701 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-69755ba1-3e32-4269-bc17-d0a815c6bbc8 tempest-InstanceUsageAuditLogNegativeTestJSON-1683861902 tempest-InstanceUsageAuditLogNegativeTestJSON-1683861902-project] 10.222.0.26 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.556871 Sep 17 20:50:41.626417 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 63/103] 10.222.0.26 () {58 vars in 1185 bytes} [Sat Sep 17 20:50:41 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 560 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:50:41.733286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-94b4bb6c-d86f-44f9-8c72-a53d194d619b req-234e8f95-11cb-4e95-ade9-b4c243784c4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07019932-c686-4174-9828-3035fcc1694a", "tag": "8d4f5ca3-4a66-4ee2-a709-cc73b8cb7ac3"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:41.775625 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-94b4bb6c-d86f-44f9-8c72-a53d194d619b req-234e8f95-11cb-4e95-ade9-b4c243784c4a service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:41.780369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-94b4bb6c-d86f-44f9-8c72-a53d194d619b req-234e8f95-11cb-4e95-ade9-b4c243784c4a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:41.780942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-94b4bb6c-d86f-44f9-8c72-a53d194d619b req-234e8f95-11cb-4e95-ade9-b4c243784c4a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:41.821003 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-94b4bb6c-d86f-44f9-8c72-a53d194d619b req-234e8f95-11cb-4e95-ade9-b4c243784c4a service nova] Creating event network-changed:8d4f5ca3-4a66-4ee2-a709-cc73b8cb7ac3 for instance 07019932-c686-4174-9828-3035fcc1694a on nch2-master-1 Sep 17 20:50:41.823270 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-94b4bb6c-d86f-44f9-8c72-a53d194d619b req-234e8f95-11cb-4e95-ade9-b4c243784c4a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=140524) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 17 20:50:41.828383 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-94b4bb6c-d86f-44f9-8c72-a53d194d619b req-234e8f95-11cb-4e95-ade9-b4c243784c4a service nova] Acquired lock "compute-rpcapi-router" {{(pid=140524) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 17 20:50:41.829985 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fff70d18-72a0-4a15-bdee-859c3c0640bc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:41.830791 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fff70d18-72a0-4a15-bdee-859c3c0640bc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:41.831417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fff70d18-72a0-4a15-bdee-859c3c0640bc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:41.832252 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fff70d18-72a0-4a15-bdee-859c3c0640bc None None] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:41.834041 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fff70d18-72a0-4a15-bdee-859c3c0640bc None None] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:41.834585 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fff70d18-72a0-4a15-bdee-859c3c0640bc None None] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:41.857523 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.compute.rpcapi [None req-fff70d18-72a0-4a15-bdee-859c3c0640bc None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 17 20:50:41.859502 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fff70d18-72a0-4a15-bdee-859c3c0640bc None None] Releasing lock "compute-rpcapi-router" {{(pid=140524) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 17 20:50:41.905330 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fff70d18-72a0-4a15-bdee-859c3c0640bc None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.279493 Sep 17 20:50:41.908585 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 64/104] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:41.922021 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e49a6d0d-1780-4444-8234-5621e1b87bd7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:41.924707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e49a6d0d-1780-4444-8234-5621e1b87bd7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:41.947161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e49a6d0d-1780-4444-8234-5621e1b87bd7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:41.948075 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e49a6d0d-1780-4444-8234-5621e1b87bd7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:41.948714 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e49a6d0d-1780-4444-8234-5621e1b87bd7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:41.950048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e49a6d0d-1780-4444-8234-5621e1b87bd7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:41.954135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e49a6d0d-1780-4444-8234-5621e1b87bd7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:41.954923 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e49a6d0d-1780-4444-8234-5621e1b87bd7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:42.328789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e49a6d0d-1780-4444-8234-5621e1b87bd7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:42.347741 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e49a6d0d-1780-4444-8234-5621e1b87bd7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1312 microversion: 2.1 time: 0.437472 Sep 17 20:50:42.348343 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 65/105] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:41 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1312 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:42.785692 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=10 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:50:42.799730 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f504974c-0933-4857-8cad-ee9abb315040 tempest-FlavorsV261TestJSON-1362443557 tempest-FlavorsV261TestJSON-1362443557-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:42.811198 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f504974c-0933-4857-8cad-ee9abb315040 tempest-FlavorsV261TestJSON-1362443557 tempest-FlavorsV261TestJSON-1362443557-project] 10.222.0.26 "GET /compute/v2.1/flavors/1254369704" status: 200 len: 468 microversion: 2.61 time: 0.455745 Sep 17 20:50:42.812202 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 66/106] 10.222.0.26 () {60 vars in 1199 bytes} [Sat Sep 17 20:50:42 2022] GET /compute/v2.1/flavors/1254369704 => generated 468 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:50:42.823165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1d932eb0-f4ff-4b25-9d86-2a09291cf23b tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:42.823825 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1d932eb0-f4ff-4b25-9d86-2a09291cf23b tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] [instance: 07019932-c686-4174-9828-3035fcc1694a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:42.839951 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d932eb0-f4ff-4b25-9d86-2a09291cf23b tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:42.840724 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d932eb0-f4ff-4b25-9d86-2a09291cf23b tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:42.841183 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d932eb0-f4ff-4b25-9d86-2a09291cf23b tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:42.842122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d932eb0-f4ff-4b25-9d86-2a09291cf23b tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:42.842980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d932eb0-f4ff-4b25-9d86-2a09291cf23b tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:42.843824 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d932eb0-f4ff-4b25-9d86-2a09291cf23b tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:43.093300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1d932eb0-f4ff-4b25-9d86-2a09291cf23b tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05aab669547487d8876a70e338d3e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4ffd27d7414061b67e053657044400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:43.105521 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1d932eb0-f4ff-4b25-9d86-2a09291cf23b tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] 10.222.0.26 "GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a" status: 200 len: 1338 microversion: 2.1 time: 0.291214 Sep 17 20:50:43.107149 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 67/107] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:42 2022] GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a => generated 1338 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:43.125671 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4d90019a-9e2b-41af-b2ab-134b155588df tempest-InstanceUsageAuditLogNegativeTestJSON-1683861902 tempest-InstanceUsageAuditLogNegativeTestJSON-1683861902-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:43.127828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4d90019a-9e2b-41af-b2ab-134b155588df tempest-InstanceUsageAuditLogNegativeTestJSON-1683861902 tempest-InstanceUsageAuditLogNegativeTestJSON-1683861902-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'a9626c56a7af47e292e3c3b61e35cd7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7251e61bfc7e4fdcb7ede9dc59b61138', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:43.130403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4d90019a-9e2b-41af-b2ab-134b155588df tempest-InstanceUsageAuditLogNegativeTestJSON-1683861902 tempest-InstanceUsageAuditLogNegativeTestJSON-1683861902-project] Request method failure captured: Sep 17 20:50:43.130403 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-09-17%2020:50:41 HTTP/1.1 Sep 17 20:50:43.130403 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:50:43.130403 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:50:43.130403 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:50:43.130403 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:50:43.130403 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:50:43.130403 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:50:43.130403 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:50:43.130403 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:50:43.130403 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjMbh4JhQT3I6tsngBIaWMmiXs6Xw7-2ku1hmqiu7_xjqGgOBWCWb_ZCoc7sJOkJtB7CaTtP5sIC1fPGjGwcNVxvDLOzB1_P_ywiZasVhXeWlCVRtFqxX3uhTW8uX77b60AMX1w7bbQl64jHYsE8AQVDbqNNIpNsUgEhVltLRifqDew Sep 17 20:50:43.130403 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:50:43.130403 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:50:43.130403 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:50:43.130403 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:50:43.130403 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:50:43.130403 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:50:43.130403 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 7251e61bfc7e4fdcb7ede9dc59b61138 Sep 17 20:50:43.130403 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1683861902 Sep 17 20:50:43.130403 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:50:43.130403 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:50:43.131607 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7251e61bfc7e4fdcb7ede9dc59b61138"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7251e61bfc7e4fdcb7ede9dc59b61138"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7251e61bfc7e4fdcb7ede9dc59b61138"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7251e61bfc7e4fdcb7ede9dc59b61138", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:50:43.131607 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1683861902 Sep 17 20:50:43.131607 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 7251e61bfc7e4fdcb7ede9dc59b61138 Sep 17 20:50:43.131607 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1683861902 Sep 17 20:50:43.131607 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1683861902-project Sep 17 20:50:43.131607 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:50:43.131607 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:50:43.131607 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: a9626c56a7af47e292e3c3b61e35cd7b Sep 17 20:50:43.131607 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1683861902-project Sep 17 20:50:43.131607 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:50:43.132146 ncdv-master-1 devstack@n-api.service[140524]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 17 20:50:43.132146 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '2022-09-17 20:50:41'} Sep 17 20:50:43.132146 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:50:43.132146 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:43.132146 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:43.132146 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:43.132146 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:50:43.132146 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:50:43.132146 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:50:43.132146 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:50:43.132146 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Sep 17 20:50:43.132146 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Sep 17 20:50:43.132146 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 17 20:50:43.132146 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 17 20:50:43.132146 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 17 20:50:43.132146 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 17 20:50:43.132146 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:50:43.132146 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:50:43.132146 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:50:43.132146 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:50:43.133129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 17 20:50:43.133129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 17 20:50:43.133129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 17 20:50:43.133129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 17 20:50:43.133129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 17 20:50:43.133129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 17 20:50:43.133129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 17 20:50:43.133129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:43.133129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:43.133129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:43.133129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:43.133129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:43.133129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:43.133129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 17 20:50:43.133129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 17 20:50:43.133129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 17 20:50:43.133129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:43.134987 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4d90019a-9e2b-41af-b2ab-134b155588df tempest-InstanceUsageAuditLogNegativeTestJSON-1683861902 tempest-InstanceUsageAuditLogNegativeTestJSON-1683861902-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:50:43.137230 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4d90019a-9e2b-41af-b2ab-134b155588df tempest-InstanceUsageAuditLogNegativeTestJSON-1683861902 tempest-InstanceUsageAuditLogNegativeTestJSON-1683861902-project] 10.222.0.26 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-17 20:50:41" status: 403 len: 128 microversion: 2.1 time: 0.028896 Sep 17 20:50:43.140348 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 68/108] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Sep 17 20:50:43 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-17%2020%3A50%3A41 => generated 128 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:50:43.609889 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-49ac3e9e-13fc-4727-a105-d1cba3ec9920 tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Calling method '.version_select at 0x7f25a63f4160>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:43.612012 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49ac3e9e-13fc-4727-a105-d1cba3ec9920 tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:43.613221 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49ac3e9e-13fc-4727-a105-d1cba3ec9920 tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:43.613980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49ac3e9e-13fc-4727-a105-d1cba3ec9920 tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:43.660257 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49ac3e9e-13fc-4727-a105-d1cba3ec9920 tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:43.661780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49ac3e9e-13fc-4727-a105-d1cba3ec9920 tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:43.664348 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49ac3e9e-13fc-4727-a105-d1cba3ec9920 tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:43.692346 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49ac3e9e-13fc-4727-a105-d1cba3ec9920 tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:43.693903 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49ac3e9e-13fc-4727-a105-d1cba3ec9920 tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:43.695371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49ac3e9e-13fc-4727-a105-d1cba3ec9920 tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:43.713444 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-49ac3e9e-13fc-4727-a105-d1cba3ec9920 tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.570343 Sep 17 20:50:43.715907 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 69/109] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:50:43 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:43.730464 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5ab60150-326b-4751-8804-fcaa053ced9a tempest-FlavorsV261TestJSON-715210416 tempest-FlavorsV261TestJSON-715210416-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:43.790986 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5ab60150-326b-4751-8804-fcaa053ced9a tempest-FlavorsV261TestJSON-715210416 tempest-FlavorsV261TestJSON-715210416-project-admin] 10.222.0.26 "PUT /compute/v2.1/flavors/1254369704" status: 200 len: 469 microversion: 2.61 time: 0.071110 Sep 17 20:50:43.795375 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 70/110] 10.222.0.26 () {62 vars in 1219 bytes} [Sat Sep 17 20:50:43 2022] PUT /compute/v2.1/flavors/1254369704 => generated 469 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:50:43.803462 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-dc70c773-95c8-4373-9ab6-a283d496a854 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:43.808658 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-dc70c773-95c8-4373-9ab6-a283d496a854 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:43.822116 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dc70c773-95c8-4373-9ab6-a283d496a854 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:43.828309 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dc70c773-95c8-4373-9ab6-a283d496a854 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:43.831169 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dc70c773-95c8-4373-9ab6-a283d496a854 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:43.832420 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dc70c773-95c8-4373-9ab6-a283d496a854 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:43.836781 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dc70c773-95c8-4373-9ab6-a283d496a854 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:43.837695 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dc70c773-95c8-4373-9ab6-a283d496a854 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:44.043656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-dc70c773-95c8-4373-9ab6-a283d496a854 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:44.051777 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-dc70c773-95c8-4373-9ab6-a283d496a854 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1312 microversion: 2.1 time: 0.254635 Sep 17 20:50:44.062848 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 71/111] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:43 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1312 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:44.072348 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5127b7ff-c43d-458b-9538-1b6f0b755579 tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Calling method '.version_select at 0x7f25a63f44c0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:44.085725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5127b7ff-c43d-458b-9538-1b6f0b755579 tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:44.086241 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5127b7ff-c43d-458b-9538-1b6f0b755579 tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:44.087320 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5127b7ff-c43d-458b-9538-1b6f0b755579 tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:44.146826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5127b7ff-c43d-458b-9538-1b6f0b755579 tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:44.148675 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5127b7ff-c43d-458b-9538-1b6f0b755579 tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:44.161877 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5127b7ff-c43d-458b-9538-1b6f0b755579 tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:44.209872 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5127b7ff-c43d-458b-9538-1b6f0b755579 tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:44.210488 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5127b7ff-c43d-458b-9538-1b6f0b755579 tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:44.211089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5127b7ff-c43d-458b-9538-1b6f0b755579 tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:44.218097 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5127b7ff-c43d-458b-9538-1b6f0b755579 tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/nch2-master-1/servers" status: 200 len: 196 microversion: 2.1 time: 0.163109 Sep 17 20:50:44.226170 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 72/112] 10.222.0.26 () {58 vars in 1212 bytes} [Sat Sep 17 20:50:44 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/servers => generated 196 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:44.233117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-11050d82-be38-48e2-91c5-ddad5d424ec6 tempest-FlavorsV261TestJSON-1362443557 tempest-FlavorsV261TestJSON-1362443557-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:44.270152 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-11050d82-be38-48e2-91c5-ddad5d424ec6 tempest-FlavorsV261TestJSON-1362443557 tempest-FlavorsV261TestJSON-1362443557-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.042342 Sep 17 20:50:44.271034 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 73/113] 10.222.0.26 () {60 vars in 1187 bytes} [Sat Sep 17 20:50:44 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:50:44.301393 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-849849c2-b5a6-4854-b775-931196bbc935 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:44.303686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-849849c2-b5a6-4854-b775-931196bbc935 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] [instance: 07019932-c686-4174-9828-3035fcc1694a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:44.318573 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-849849c2-b5a6-4854-b775-931196bbc935 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:44.325849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-849849c2-b5a6-4854-b775-931196bbc935 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:44.326417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-849849c2-b5a6-4854-b775-931196bbc935 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:44.327200 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-849849c2-b5a6-4854-b775-931196bbc935 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:44.327723 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-849849c2-b5a6-4854-b775-931196bbc935 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:44.328093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-849849c2-b5a6-4854-b775-931196bbc935 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:44.867540 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-849849c2-b5a6-4854-b775-931196bbc935 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05aab669547487d8876a70e338d3e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4ffd27d7414061b67e053657044400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:44.877022 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-849849c2-b5a6-4854-b775-931196bbc935 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] 10.222.0.26 "GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a" status: 200 len: 1338 microversion: 2.1 time: 0.585907 Sep 17 20:50:44.879105 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 74/114] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:44 2022] GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a => generated 1338 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:44.897857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8fb5ebe6-33c4-4674-a071-a186733932fe tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Calling method '.version_select at 0x7f25a631c5e0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:44.901695 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8fb5ebe6-33c4-4674-a071-a186733932fe tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:44.902411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8fb5ebe6-33c4-4674-a071-a186733932fe tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:44.903510 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8fb5ebe6-33c4-4674-a071-a186733932fe tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:44.960621 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8fb5ebe6-33c4-4674-a071-a186733932fe tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:44.968117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8fb5ebe6-33c4-4674-a071-a186733932fe tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:44.973739 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8fb5ebe6-33c4-4674-a071-a186733932fe tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:45.076606 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8fb5ebe6-33c4-4674-a071-a186733932fe tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:45.077284 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8fb5ebe6-33c4-4674-a071-a186733932fe tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:45.078967 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8fb5ebe6-33c4-4674-a071-a186733932fe tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:45.082908 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:50:45.088220 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8fb5ebe6-33c4-4674-a071-a186733932fe tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.207652 Sep 17 20:50:45.095141 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 75/115] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:50:44 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:45.100070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9e188de4-ea99-4101-8424-8f745e9707ce tempest-FlavorsV261TestJSON-1362443557 tempest-FlavorsV261TestJSON-1362443557-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:45.130656 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9e188de4-ea99-4101-8424-8f745e9707ce tempest-FlavorsV261TestJSON-1362443557 tempest-FlavorsV261TestJSON-1362443557-project] 10.222.0.26 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.61 time: 0.035061 Sep 17 20:50:45.142993 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 76/116] 10.222.0.26 () {60 vars in 1166 bytes} [Sat Sep 17 20:50:45 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:50:45.166189 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-11e26fb4-f953-4fbe-a5ca-aa565d4732ab req-165ab1a1-dc58-44d7-965a-3b4a512a3b44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63955de3-b0fa-4f96-a2db-26ae995db228", "tag": "17d8bcdf-2e72-4ea0-a129-6fda20d5053a"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:45.195566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-11e26fb4-f953-4fbe-a5ca-aa565d4732ab req-165ab1a1-dc58-44d7-965a-3b4a512a3b44 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:45.196163 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-11e26fb4-f953-4fbe-a5ca-aa565d4732ab req-165ab1a1-dc58-44d7-965a-3b4a512a3b44 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:45.196683 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-11e26fb4-f953-4fbe-a5ca-aa565d4732ab req-165ab1a1-dc58-44d7-965a-3b4a512a3b44 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:45.204058 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:50:45.212725 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-11e26fb4-f953-4fbe-a5ca-aa565d4732ab req-165ab1a1-dc58-44d7-965a-3b4a512a3b44 service nova] Creating event network-changed:17d8bcdf-2e72-4ea0-a129-6fda20d5053a for instance 63955de3-b0fa-4f96-a2db-26ae995db228 on nch1-master-1 Sep 17 20:50:45.220359 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-11e26fb4-f953-4fbe-a5ca-aa565d4732ab req-165ab1a1-dc58-44d7-965a-3b4a512a3b44 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074496 Sep 17 20:50:45.221342 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 77/117] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:45.227099 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-66a2bfde-60d7-4ba6-a1f6-d0321f4b5a57 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:45.227847 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-66a2bfde-60d7-4ba6-a1f6-d0321f4b5a57 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:45.234813 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66a2bfde-60d7-4ba6-a1f6-d0321f4b5a57 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:45.235314 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66a2bfde-60d7-4ba6-a1f6-d0321f4b5a57 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:45.235749 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66a2bfde-60d7-4ba6-a1f6-d0321f4b5a57 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:45.236707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66a2bfde-60d7-4ba6-a1f6-d0321f4b5a57 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:45.236909 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66a2bfde-60d7-4ba6-a1f6-d0321f4b5a57 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:45.237326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66a2bfde-60d7-4ba6-a1f6-d0321f4b5a57 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:45.497909 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-66a2bfde-60d7-4ba6-a1f6-d0321f4b5a57 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:45.508606 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-66a2bfde-60d7-4ba6-a1f6-d0321f4b5a57 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1312 microversion: 2.1 time: 0.285933 Sep 17 20:50:45.510211 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 78/118] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:45 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1312 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:45.535564 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4b16ea0d-4be9-4e60-9ee5-9bd9b46f7ddf tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Calling method '.version_select at 0x7f25a64fcb80>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:45.542561 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b16ea0d-4be9-4e60-9ee5-9bd9b46f7ddf tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:45.543991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b16ea0d-4be9-4e60-9ee5-9bd9b46f7ddf tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:45.546753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b16ea0d-4be9-4e60-9ee5-9bd9b46f7ddf tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:45.584109 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b16ea0d-4be9-4e60-9ee5-9bd9b46f7ddf tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:45.589694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b16ea0d-4be9-4e60-9ee5-9bd9b46f7ddf tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:45.590382 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b16ea0d-4be9-4e60-9ee5-9bd9b46f7ddf tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:45.608383 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4b16ea0d-4be9-4e60-9ee5-9bd9b46f7ddf tempest-HypervisorAdminUnderV252Test-443363844 tempest-HypervisorAdminUnderV252Test-443363844-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.096524 Sep 17 20:50:45.609585 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 79/119] 10.222.0.26 () {58 vars in 1209 bytes} [Sat Sep 17 20:50:45 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 104 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:45.624186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1ea6f8b7-9bf4-4bbe-9100-65955caf24ce tempest-FlavorsV261TestJSON-715210416 tempest-FlavorsV261TestJSON-715210416-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:45.660293 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1ea6f8b7-9bf4-4bbe-9100-65955caf24ce tempest-FlavorsV261TestJSON-715210416 tempest-FlavorsV261TestJSON-715210416-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1254369704" status: 202 len: 0 microversion: 2.61 time: 0.049201 Sep 17 20:50:45.661724 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 80/120] 10.222.0.26 () {60 vars in 1202 bytes} [Sat Sep 17 20:50:45 2022] DELETE /compute/v2.1/flavors/1254369704 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:50:45.672244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bb8cc1f7-3fba-494f-bbcb-92854db28ecf tempest-FlavorsV261TestJSON-715210416 tempest-FlavorsV261TestJSON-715210416-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:45.723180 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bb8cc1f7-3fba-494f-bbcb-92854db28ecf tempest-FlavorsV261TestJSON-715210416 tempest-FlavorsV261TestJSON-715210416-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.056645 Sep 17 20:50:45.724696 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 81/121] 10.222.0.26 () {60 vars in 1187 bytes} [Sat Sep 17 20:50:45 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 20:50:45.905330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0f7e2811-10d4-4387-b0a9-da2adcc9b61e tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:45.907084 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0f7e2811-10d4-4387-b0a9-da2adcc9b61e tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] [instance: 07019932-c686-4174-9828-3035fcc1694a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:45.923954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f7e2811-10d4-4387-b0a9-da2adcc9b61e tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:45.927165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f7e2811-10d4-4387-b0a9-da2adcc9b61e tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:45.927773 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f7e2811-10d4-4387-b0a9-da2adcc9b61e tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:45.931162 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f7e2811-10d4-4387-b0a9-da2adcc9b61e tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:45.931397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=16 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:50:45.935002 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f7e2811-10d4-4387-b0a9-da2adcc9b61e tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:45.935822 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f7e2811-10d4-4387-b0a9-da2adcc9b61e tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:46.332182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0f7e2811-10d4-4387-b0a9-da2adcc9b61e tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05aab669547487d8876a70e338d3e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4ffd27d7414061b67e053657044400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:46.342077 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0f7e2811-10d4-4387-b0a9-da2adcc9b61e tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] 10.222.0.26 "GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a" status: 200 len: 1338 microversion: 2.1 time: 0.444281 Sep 17 20:50:46.360826 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 82/122] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:45 2022] GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a => generated 1338 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:50:46.533400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a29be5fa-9589-4b5a-8be2-20db44081883 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:46.534304 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a29be5fa-9589-4b5a-8be2-20db44081883 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:46.540592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a29be5fa-9589-4b5a-8be2-20db44081883 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:46.541212 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a29be5fa-9589-4b5a-8be2-20db44081883 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:46.545540 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a29be5fa-9589-4b5a-8be2-20db44081883 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:46.550746 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a29be5fa-9589-4b5a-8be2-20db44081883 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:46.551491 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a29be5fa-9589-4b5a-8be2-20db44081883 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:46.552096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a29be5fa-9589-4b5a-8be2-20db44081883 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:46.712191 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=10 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:50:46.844691 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a29be5fa-9589-4b5a-8be2-20db44081883 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:46.855092 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a29be5fa-9589-4b5a-8be2-20db44081883 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1312 microversion: 2.1 time: 0.326131 Sep 17 20:50:46.856570 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 83/123] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:46 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1312 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:50:47.383853 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6903937b-9957-4ce8-9d5c-cbb560a1454f tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:47.385622 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6903937b-9957-4ce8-9d5c-cbb560a1454f tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] [instance: 07019932-c686-4174-9828-3035fcc1694a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:47.398585 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6903937b-9957-4ce8-9d5c-cbb560a1454f tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:47.401596 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6903937b-9957-4ce8-9d5c-cbb560a1454f tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:47.406436 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6903937b-9957-4ce8-9d5c-cbb560a1454f tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:47.407864 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6903937b-9957-4ce8-9d5c-cbb560a1454f tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:47.409181 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6903937b-9957-4ce8-9d5c-cbb560a1454f tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:47.409654 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6903937b-9957-4ce8-9d5c-cbb560a1454f tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:47.705880 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6903937b-9957-4ce8-9d5c-cbb560a1454f tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05aab669547487d8876a70e338d3e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4ffd27d7414061b67e053657044400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:47.724915 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6903937b-9957-4ce8-9d5c-cbb560a1454f tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] 10.222.0.26 "GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a" status: 200 len: 1338 microversion: 2.1 time: 0.351218 Sep 17 20:50:47.725574 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 84/124] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:47 2022] GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a => generated 1338 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:50:48.509550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9dfada6c-217d-4c09-8f05-80d72c6798f0 tempest-FlavorMetadataValidation-418695883 tempest-FlavorMetadataValidation-418695883-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-330470224", "id": 789604188, "os-flavor-access:is_public": "True"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:48.556195 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9dfada6c-217d-4c09-8f05-80d72c6798f0 tempest-FlavorMetadataValidation-418695883 tempest-FlavorMetadataValidation-418695883-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.769069 Sep 17 20:50:48.567446 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 85/125] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Sep 17 20:50:47 2022] POST /compute/v2.1/flavors => generated 467 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:50:48.580366 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-00ac52e4-31e5-4019-9c43-f2a05512fa68 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:48.583282 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-00ac52e4-31e5-4019-9c43-f2a05512fa68 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:48.597749 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00ac52e4-31e5-4019-9c43-f2a05512fa68 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:48.600016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00ac52e4-31e5-4019-9c43-f2a05512fa68 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:48.600967 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00ac52e4-31e5-4019-9c43-f2a05512fa68 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:48.601742 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00ac52e4-31e5-4019-9c43-f2a05512fa68 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:48.602699 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00ac52e4-31e5-4019-9c43-f2a05512fa68 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:48.604805 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00ac52e4-31e5-4019-9c43-f2a05512fa68 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:49.009504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-00ac52e4-31e5-4019-9c43-f2a05512fa68 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:49.031073 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-00ac52e4-31e5-4019-9c43-f2a05512fa68 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1312 microversion: 2.1 time: 0.459504 Sep 17 20:50:49.038864 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-97eec3c0-47df-4fdc-9295-1352f4889c58 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] validate_networks() for None {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:50:49.062676 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 86/126] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:48 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1312 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:49.084138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-621997b3-879f-4908-896d-3d7c9f0c433c tempest-FlavorMetadataValidation-418695883 tempest-FlavorMetadataValidation-418695883-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:49.359917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=7,nova_api:DELETE=5 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:50:49.391140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:DELETE=7,nova_api:UPDATE=1,nova_api:SAVEPOINT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:50:49.415045 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-621997b3-879f-4908-896d-3d7c9f0c433c tempest-FlavorMetadataValidation-418695883 tempest-FlavorMetadataValidation-418695883-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/789604188/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.349141 Sep 17 20:50:49.416950 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 87/127] 10.222.0.26 () {62 vars in 1262 bytes} [Sat Sep 17 20:50:49 2022] POST /compute/v2.1/flavors/789604188/os-extra_specs => generated 62 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:49.433072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ae0c09a2-0161-49c0-b758-1ee739beaf82 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:49.434110 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ae0c09a2-0161-49c0-b758-1ee739beaf82 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] [instance: 07019932-c686-4174-9828-3035fcc1694a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:49.456515 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae0c09a2-0161-49c0-b758-1ee739beaf82 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:49.457333 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae0c09a2-0161-49c0-b758-1ee739beaf82 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:49.458432 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae0c09a2-0161-49c0-b758-1ee739beaf82 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:49.459300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae0c09a2-0161-49c0-b758-1ee739beaf82 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:49.459893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae0c09a2-0161-49c0-b758-1ee739beaf82 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:49.462231 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae0c09a2-0161-49c0-b758-1ee739beaf82 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:49.570542 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-97eec3c0-47df-4fdc-9295-1352f4889c58 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:50:49.577277 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-97eec3c0-47df-4fdc-9295-1352f4889c58 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:50:49.578686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-97eec3c0-47df-4fdc-9295-1352f4889c58 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:50:49.579619 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-97eec3c0-47df-4fdc-9295-1352f4889c58 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:50:49.580354 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-97eec3c0-47df-4fdc-9295-1352f4889c58 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:50:49.613234 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-97eec3c0-47df-4fdc-9295-1352f4889c58 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:49.618251 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-97eec3c0-47df-4fdc-9295-1352f4889c58 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:49.618921 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-97eec3c0-47df-4fdc-9295-1352f4889c58 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:49.622317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-97eec3c0-47df-4fdc-9295-1352f4889c58 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:49.626330 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-97eec3c0-47df-4fdc-9295-1352f4889c58 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:49.627941 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-97eec3c0-47df-4fdc-9295-1352f4889c58 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:49.724492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-97eec3c0-47df-4fdc-9295-1352f4889c58 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Getting quotas for project ea88200545ae4003b42b0d475f482c9d. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:50:49.728001 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ae0c09a2-0161-49c0-b758-1ee739beaf82 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05aab669547487d8876a70e338d3e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4ffd27d7414061b67e053657044400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:49.730035 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-97eec3c0-47df-4fdc-9295-1352f4889c58 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Getting quotas for user eb8bfe1d590a4500b7e7b5c79a6a4e6b and project ea88200545ae4003b42b0d475f482c9d. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:50:49.740468 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ae0c09a2-0161-49c0-b758-1ee739beaf82 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] 10.222.0.26 "GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a" status: 200 len: 1338 microversion: 2.1 time: 0.321511 Sep 17 20:50:49.742217 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 88/128] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:49 2022] GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a => generated 1338 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:49.753448 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-97eec3c0-47df-4fdc-9295-1352f4889c58 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:50:49.754959 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-df2b873f-818d-4684-b1da-84a039ab2c19 tempest-FlavorMetadataValidation-418695883 tempest-FlavorMetadataValidation-418695883-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:49.764723 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-97eec3c0-47df-4fdc-9295-1352f4889c58 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:50:49.794055 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-df2b873f-818d-4684-b1da-84a039ab2c19 tempest-FlavorMetadataValidation-418695883 tempest-FlavorMetadataValidation-418695883-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/789604188" status: 202 len: 0 microversion: 2.86 time: 0.043019 Sep 17 20:50:49.795310 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 89/129] 10.222.0.26 () {60 vars in 1199 bytes} [Sat Sep 17 20:50:49 2022] DELETE /compute/v2.1/flavors/789604188 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:50:49.812655 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-688d7fe4-ce47-4233-90a7-b312eadba256 tempest-FlavorMetadataValidation-418695883 tempest-FlavorMetadataValidation-418695883-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:49.868361 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-97eec3c0-47df-4fdc-9295-1352f4889c58 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 11.291710 Sep 17 20:50:49.869269 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 41/130] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:50:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 11294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 17 20:50:49.883483 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f2d0a7e6-2e2c-44f9-8c29-c11c42a9bf1a tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:49.885336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f2d0a7e6-2e2c-44f9-8c29-c11c42a9bf1a tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:49.886010 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-688d7fe4-ce47-4233-90a7-b312eadba256 tempest-FlavorMetadataValidation-418695883 tempest-FlavorMetadataValidation-418695883-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.082118 Sep 17 20:50:49.897622 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 90/131] 10.222.0.26 () {60 vars in 1187 bytes} [Sat Sep 17 20:50:49 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:50:49.951381 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f2d0a7e6-2e2c-44f9-8c29-c11c42a9bf1a tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8bfe1d590a4500b7e7b5c79a6a4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea88200545ae4003b42b0d475f482c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:49.960270 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f2d0a7e6-2e2c-44f9-8c29-c11c42a9bf1a tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] 10.222.0.26 "GET /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c" status: 200 len: 1220 microversion: 2.1 time: 0.082185 Sep 17 20:50:49.960872 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 42/132] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:49 2022] GET /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c => generated 1220 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:50.069615 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b552b0d7-2782-4946-8645-8ebaf0691353 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:50.071239 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b552b0d7-2782-4946-8645-8ebaf0691353 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:50.080553 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b552b0d7-2782-4946-8645-8ebaf0691353 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:50.081245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b552b0d7-2782-4946-8645-8ebaf0691353 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:50.081725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b552b0d7-2782-4946-8645-8ebaf0691353 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:50.082444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b552b0d7-2782-4946-8645-8ebaf0691353 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:50.082907 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b552b0d7-2782-4946-8645-8ebaf0691353 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:50.083325 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b552b0d7-2782-4946-8645-8ebaf0691353 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:50.299361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b552b0d7-2782-4946-8645-8ebaf0691353 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:50.307553 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b552b0d7-2782-4946-8645-8ebaf0691353 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1312 microversion: 2.1 time: 0.247327 Sep 17 20:50:50.308727 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 91/133] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:50 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1312 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:50.764068 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2090ac2e-ee5f-4913-ac43-1431946f783c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:50.765359 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2090ac2e-ee5f-4913-ac43-1431946f783c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] [instance: 07019932-c686-4174-9828-3035fcc1694a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:50.772886 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2090ac2e-ee5f-4913-ac43-1431946f783c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:50.773553 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2090ac2e-ee5f-4913-ac43-1431946f783c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:50.774147 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2090ac2e-ee5f-4913-ac43-1431946f783c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:50.774998 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2090ac2e-ee5f-4913-ac43-1431946f783c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:50.775592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2090ac2e-ee5f-4913-ac43-1431946f783c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:50.776207 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2090ac2e-ee5f-4913-ac43-1431946f783c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:50.907581 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-239be8d5-ea98-4295-8535-c609ccf39387 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Calling method '.version_select at 0x7f25a6212b80>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:50.950096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2090ac2e-ee5f-4913-ac43-1431946f783c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05aab669547487d8876a70e338d3e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4ffd27d7414061b67e053657044400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:50.961208 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2090ac2e-ee5f-4913-ac43-1431946f783c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] 10.222.0.26 "GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a" status: 200 len: 1338 microversion: 2.1 time: 0.202294 Sep 17 20:50:50.962366 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 92/134] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:50 2022] GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a => generated 1338 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:50:50.989403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a9e841f9-baab-4194-a97d-b8fdb5a5af4a tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:50.990077 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a9e841f9-baab-4194-a97d-b8fdb5a5af4a tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:50.999872 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a9e841f9-baab-4194-a97d-b8fdb5a5af4a tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:51.000698 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a9e841f9-baab-4194-a97d-b8fdb5a5af4a tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:51.001625 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a9e841f9-baab-4194-a97d-b8fdb5a5af4a tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:51.002994 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a9e841f9-baab-4194-a97d-b8fdb5a5af4a tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:51.003709 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a9e841f9-baab-4194-a97d-b8fdb5a5af4a tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:51.004140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a9e841f9-baab-4194-a97d-b8fdb5a5af4a tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:51.070717 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a9e841f9-baab-4194-a97d-b8fdb5a5af4a tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8bfe1d590a4500b7e7b5c79a6a4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea88200545ae4003b42b0d475f482c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:51.081571 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a9e841f9-baab-4194-a97d-b8fdb5a5af4a tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] 10.222.0.26 "GET /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c" status: 200 len: 1224 microversion: 2.1 time: 0.096465 Sep 17 20:50:51.082362 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 93/135] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:50 2022] GET /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:51.317927 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-239be8d5-ea98-4295-8535-c609ccf39387 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/33f1d412d4a44e09b51be3b14530c077" status: 200 len: 371 microversion: 2.1 time: 0.775580 Sep 17 20:50:51.318452 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 43/136] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Sep 17 20:50:50 2022] GET /compute/v2.1/os-quota-sets/33f1d412d4a44e09b51be3b14530c077 => generated 371 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:51.331654 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5b1eaa8b-da2d-40fc-900f-18a7bf01b5e6 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Action: 'update', calling method: .version_select at 0x7f25a64fcaf0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:51.331908 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fc504c56-f457-4fa1-8de7-1faf1feb732d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:51.332702 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fc504c56-f457-4fa1-8de7-1faf1feb732d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:51.339347 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc504c56-f457-4fa1-8de7-1faf1feb732d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:51.340437 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc504c56-f457-4fa1-8de7-1faf1feb732d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:51.341116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc504c56-f457-4fa1-8de7-1faf1feb732d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:51.342538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc504c56-f457-4fa1-8de7-1faf1feb732d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:51.343209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc504c56-f457-4fa1-8de7-1faf1feb732d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:51.343723 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc504c56-f457-4fa1-8de7-1faf1feb732d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:51.496752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fc504c56-f457-4fa1-8de7-1faf1feb732d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:51.504573 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fc504c56-f457-4fa1-8de7-1faf1feb732d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1312 microversion: 2.1 time: 0.176611 Sep 17 20:50:51.512455 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 44/137] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:51 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1312 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:51.775778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b1eaa8b-da2d-40fc-900f-18a7bf01b5e6 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:51.778700 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b1eaa8b-da2d-40fc-900f-18a7bf01b5e6 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:51.783641 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b1eaa8b-da2d-40fc-900f-18a7bf01b5e6 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:51.784769 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b1eaa8b-da2d-40fc-900f-18a7bf01b5e6 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:51.786475 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b1eaa8b-da2d-40fc-900f-18a7bf01b5e6 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:51.787123 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b1eaa8b-da2d-40fc-900f-18a7bf01b5e6 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:51.873509 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5b1eaa8b-da2d-40fc-900f-18a7bf01b5e6 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/33f1d412d4a44e09b51be3b14530c077" status: 200 len: 328 microversion: 2.1 time: 0.544690 Sep 17 20:50:51.888696 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 94/138] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Sep 17 20:50:51 2022] PUT /compute/v2.1/os-quota-sets/33f1d412d4a44e09b51be3b14530c077 => generated 328 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:51.984229 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7240937d-4e83-4b82-824b-2c8c714adf6c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:51.987849 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7240937d-4e83-4b82-824b-2c8c714adf6c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] [instance: 07019932-c686-4174-9828-3035fcc1694a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:52.002056 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7240937d-4e83-4b82-824b-2c8c714adf6c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:52.002686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7240937d-4e83-4b82-824b-2c8c714adf6c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:52.003263 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7240937d-4e83-4b82-824b-2c8c714adf6c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:52.004078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7240937d-4e83-4b82-824b-2c8c714adf6c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:52.004744 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7240937d-4e83-4b82-824b-2c8c714adf6c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:52.005374 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7240937d-4e83-4b82-824b-2c8c714adf6c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:52.151828 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7240937d-4e83-4b82-824b-2c8c714adf6c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05aab669547487d8876a70e338d3e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4ffd27d7414061b67e053657044400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:52.161428 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7240937d-4e83-4b82-824b-2c8c714adf6c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] 10.222.0.26 "GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a" status: 200 len: 1338 microversion: 2.1 time: 0.181066 Sep 17 20:50:52.177382 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 45/139] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:51 2022] GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a => generated 1338 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:52.182321 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-164e1cb7-e982-4a33-ae3f-d480511c458c tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:52.182930 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-164e1cb7-e982-4a33-ae3f-d480511c458c tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:52.189023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-164e1cb7-e982-4a33-ae3f-d480511c458c tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:52.189636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-164e1cb7-e982-4a33-ae3f-d480511c458c tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:52.189963 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-164e1cb7-e982-4a33-ae3f-d480511c458c tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:52.190661 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-164e1cb7-e982-4a33-ae3f-d480511c458c tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:52.191114 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-164e1cb7-e982-4a33-ae3f-d480511c458c tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:52.191530 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-164e1cb7-e982-4a33-ae3f-d480511c458c tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:52.258952 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-164e1cb7-e982-4a33-ae3f-d480511c458c tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8bfe1d590a4500b7e7b5c79a6a4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea88200545ae4003b42b0d475f482c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:52.272818 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-164e1cb7-e982-4a33-ae3f-d480511c458c tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] 10.222.0.26 "GET /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c" status: 200 len: 1272 microversion: 2.1 time: 0.094076 Sep 17 20:50:52.274461 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 46/140] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:52 2022] GET /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c => generated 1272 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:52.337915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5ef4267b-4c99-44c3-aa59-afff6265b8b3 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-503471111", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:52.419978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-5ef4267b-4c99-44c3-aa59-afff6265b8b3 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] validate_networks() for None {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:50:52.716456 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-5ef4267b-4c99-44c3-aa59-afff6265b8b3 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:50:52.717280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-5ef4267b-4c99-44c3-aa59-afff6265b8b3 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:50:52.717988 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-5ef4267b-4c99-44c3-aa59-afff6265b8b3 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:50:52.718601 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-5ef4267b-4c99-44c3-aa59-afff6265b8b3 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:50:52.719217 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-5ef4267b-4c99-44c3-aa59-afff6265b8b3 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:50:52.731074 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5ef4267b-4c99-44c3-aa59-afff6265b8b3 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:52.732088 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5ef4267b-4c99-44c3-aa59-afff6265b8b3 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:52.733131 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5ef4267b-4c99-44c3-aa59-afff6265b8b3 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:52.735798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5ef4267b-4c99-44c3-aa59-afff6265b8b3 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:52.736444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5ef4267b-4c99-44c3-aa59-afff6265b8b3 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:52.737262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5ef4267b-4c99-44c3-aa59-afff6265b8b3 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:52.761696 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-5ef4267b-4c99-44c3-aa59-afff6265b8b3 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Getting quotas for project 33f1d412d4a44e09b51be3b14530c077. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:50:52.768691 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-5ef4267b-4c99-44c3-aa59-afff6265b8b3 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Getting quotas for user ee3d8ef713bd4844833d9374766452d8 and project 33f1d412d4a44e09b51be3b14530c077. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:50:52.781804 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.utils [None req-5ef4267b-4c99-44c3-aa59-afff6265b8b3 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] cores quota exceeded for 33f1d412d4a44e09b51be3b14530c077, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=140524) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 17 20:50:52.782628 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-5ef4267b-4c99-44c3-aa59-afff6265b8b3 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 17 20:50:52.789291 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5ef4267b-4c99-44c3-aa59-afff6265b8b3 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Request method failure captured: Sep 17 20:50:52.789291 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 17 20:50:52.789291 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:50:52.789291 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:50:52.789291 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:50:52.789291 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 144 Sep 17 20:50:52.789291 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:50:52.789291 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:50:52.789291 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:50:52.789291 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:50:52.789291 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjMorfY1IaiX_nlTF6-vfKrPRniweyxQdL_zIcWo2OcbyQiD0zsaGsEjbIIe5O_NaKtXwkJ9VyZi7i6yxrmHR7zeW9tUXd1NG0qNXbk8wBk4T0D0PmtSzZTJtxK03nF8LrFHR21GbWXSXR5rU9QKKKG9KDMJuIdu6EG5PuLWF2Aiyog Sep 17 20:50:52.789291 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:50:52.789291 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:50:52.789291 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:50:52.789291 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:50:52.789291 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:50:52.789291 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:50:52.789291 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 33f1d412d4a44e09b51be3b14530c077 Sep 17 20:50:52.789291 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-QuotasAdminNegativeTest-734910182 Sep 17 20:50:52.789291 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:50:52.789291 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:50:52.790882 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/33f1d412d4a44e09b51be3b14530c077"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/33f1d412d4a44e09b51be3b14530c077"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/33f1d412d4a44e09b51be3b14530c077"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_33f1d412d4a44e09b51be3b14530c077", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:50:52.790882 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-QuotasAdminNegativeTest-734910182 Sep 17 20:50:52.790882 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 33f1d412d4a44e09b51be3b14530c077 Sep 17 20:50:52.790882 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-734910182 Sep 17 20:50:52.790882 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-QuotasAdminNegativeTest-734910182-project Sep 17 20:50:52.790882 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:50:52.790882 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:50:52.790882 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: ee3d8ef713bd4844833d9374766452d8 Sep 17 20:50:52.790882 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-QuotasAdminNegativeTest-734910182-project Sep 17 20:50:52.790882 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:50:52.790882 ncdv-master-1 devstack@n-api.service[140524]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-503471111", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452"}} Sep 17 20:50:52.790882 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:50:52.791625 ncdv-master-1 devstack@n-api.service[140524]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 17 20:50:52.791625 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-503471111', 'imageRef': '1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4', 'flavorRef': '452'}}} Sep 17 20:50:52.791625 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:50:52.791625 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:52.791625 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 17 20:50:52.791625 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 17 20:50:52.791625 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:50:52.791625 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:50:52.791625 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 17 20:50:52.791625 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc Sep 17 20:50:52.791625 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 17 20:50:52.791625 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 17 20:50:52.791625 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:50:52.791625 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:50:52.791625 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 17 20:50:52.791625 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 17 20:50:52.791625 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 17 20:50:52.791625 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 17 20:50:52.792659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 17 20:50:52.792659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 17 20:50:52.792659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 17 20:50:52.792659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:52.792659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:52.792659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:52.792659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:52.792659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 17 20:50:52.792659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 17 20:50:52.792659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 17 20:50:52.792659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 17 20:50:52.792659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 17 20:50:52.792659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 17 20:50:52.792659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 17 20:50:52.792659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 17 20:50:52.792659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 17 20:50:52.792659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 17 20:50:52.792659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 17 20:50:52.792659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:52.792659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:52.792659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:52.794374 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:52.794374 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:52.794374 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:52.794374 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:50:52.794374 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:50:52.794374 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:50:52.794374 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:50:52.794374 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:50:52.794374 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:50:52.794374 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:50:52.794374 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:50:52.794374 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:50:52.794374 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:50:52.794374 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 17 20:50:52.794374 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 17 20:50:52.794374 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 17 20:50:52.794374 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 17 20:50:52.794374 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:52.794374 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:52.794374 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:52.794374 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:52.795494 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:52.795494 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:52.795494 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:50:52.795494 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:50:52.795494 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 17 20:50:52.795494 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:52.795494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5ef4267b-4c99-44c3-aa59-afff6265b8b3 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:50:52.795494 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5ef4267b-4c99-44c3-aa59-afff6265b8b3 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.787389 Sep 17 20:50:52.795494 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 95/141] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:50:52 2022] POST /compute/v2.1/servers => generated 111 bytes in 789 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:50:52.803162 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d572d90f-a9e6-4081-891f-b165ecad3ecc tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:52.803859 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d572d90f-a9e6-4081-891f-b165ecad3ecc tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:52.812736 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d572d90f-a9e6-4081-891f-b165ecad3ecc tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:52.813229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d572d90f-a9e6-4081-891f-b165ecad3ecc tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:52.814934 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d572d90f-a9e6-4081-891f-b165ecad3ecc tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:52.815898 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d572d90f-a9e6-4081-891f-b165ecad3ecc tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:52.816535 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d572d90f-a9e6-4081-891f-b165ecad3ecc tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:52.817270 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d572d90f-a9e6-4081-891f-b165ecad3ecc tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:52.858977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ad0e5e79-1f62-4686-9e1c-6f7d9c8b1bc1 tempest-KeyPairsV210TestJSON-1951794193 tempest-KeyPairsV210TestJSON-1951794193-project-admin] Action: 'create', calling method: .version_select at 0x7f25a61f0670>, body: {"keypair": {"name": "tempest-keypair-2056913455", "type": "ssh", "user_id": "19067517f42f4ac5869e1c3d3b840e41", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG9834NkXNtNxNjcI0lX1anEMlYA5bAgV0wDIF2pxQmt6dcW0J0ewS8+Ir8saWhfglcFq+EOkPzYAvQl8lvb5flDCmPBdL7e4z996BnVW+lJqPRCWC2IOhV7ebyKTFwvw=="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:52.902920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-ad0e5e79-1f62-4686-9e1c-6f7d9c8b1bc1 tempest-KeyPairsV210TestJSON-1951794193 tempest-KeyPairsV210TestJSON-1951794193-project-admin] Getting quotas for project 1f2f1aec1aea493d957becfaa2ac27d0. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:50:52.908489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-ad0e5e79-1f62-4686-9e1c-6f7d9c8b1bc1 tempest-KeyPairsV210TestJSON-1951794193 tempest-KeyPairsV210TestJSON-1951794193-project-admin] Getting quotas for user ad0c03ce425d4e4caf000253c0bb526e and project 1f2f1aec1aea493d957becfaa2ac27d0. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:50:52.944014 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ad0e5e79-1f62-4686-9e1c-6f7d9c8b1bc1 tempest-KeyPairsV210TestJSON-1951794193 tempest-KeyPairsV210TestJSON-1951794193-project-admin] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.421911 Sep 17 20:50:52.944818 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 47/142] 10.222.0.26 () {62 vars in 1200 bytes} [Sat Sep 17 20:50:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 423 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 17 20:50:52.951637 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f4dd9456-a221-4052-a5e6-9183cc00cf3a tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Action: 'update', calling method: .version_select at 0x7f25a6197af0>, body: {"quota_set": {"cores": 20}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:53.047103 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d572d90f-a9e6-4081-891f-b165ecad3ecc tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:53.057506 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d572d90f-a9e6-4081-891f-b165ecad3ecc tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1312 microversion: 2.1 time: 0.258606 Sep 17 20:50:53.058086 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 96/143] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:52 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1312 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:53.065512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ec6a83a4-3416-41c9-ba3f-f9a8ab760296 tempest-KeyPairsV210TestJSON-1951794193 tempest-KeyPairsV210TestJSON-1951794193-project-admin] Action: 'create', calling method: .version_select at 0x7f25a616a310>, body: {"keypair": {"name": "tempest-keypair-1465272622", "type": "ssh", "user_id": "19067517f42f4ac5869e1c3d3b840e41", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1wZ4pJjEcFp0vtmVMMy5fF+DJiRvcVS94iBBrLHiDwJTfT8QsADz2KMwZsZR8z/ZwMk+rQP2wk5SQIPsHvGuJQbmUUCoUPlrUCo/0PYTb84a/Z8T1qHFgYVFkMof2pQw=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:53.091459 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-ec6a83a4-3416-41c9-ba3f-f9a8ab760296 tempest-KeyPairsV210TestJSON-1951794193 tempest-KeyPairsV210TestJSON-1951794193-project-admin] Getting quotas for project 1f2f1aec1aea493d957becfaa2ac27d0. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:50:53.096658 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-ec6a83a4-3416-41c9-ba3f-f9a8ab760296 tempest-KeyPairsV210TestJSON-1951794193 tempest-KeyPairsV210TestJSON-1951794193-project-admin] Getting quotas for user ad0c03ce425d4e4caf000253c0bb526e and project 1f2f1aec1aea493d957becfaa2ac27d0. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:50:53.152306 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ec6a83a4-3416-41c9-ba3f-f9a8ab760296 tempest-KeyPairsV210TestJSON-1951794193 tempest-KeyPairsV210TestJSON-1951794193-project-admin] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.092785 Sep 17 20:50:53.158851 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 97/144] 10.222.0.26 () {62 vars in 1200 bytes} [Sat Sep 17 20:50:53 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 95 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 17 20:50:53.164626 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2e5012c6-d7c5-41fc-a101-96f6c4cb80e2 tempest-KeyPairsV210TestJSON-1951794193 tempest-KeyPairsV210TestJSON-1951794193-project-admin] Calling method '.version_select at 0x7f25a616a790>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:53.197430 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2e5012c6-d7c5-41fc-a101-96f6c4cb80e2 tempest-KeyPairsV210TestJSON-1951794193 tempest-KeyPairsV210TestJSON-1951794193-project-admin] 10.222.0.26 "GET /compute/v2.1/os-keypairs/tempest-keypair-2056913455?user_id=19067517f42f4ac5869e1c3d3b840e41" status: 200 len: 512 microversion: 2.10 time: 0.031801 Sep 17 20:50:53.198195 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 98/145] 10.222.0.26 () {60 vars in 1340 bytes} [Sat Sep 17 20:50:53 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2056913455?user_id=19067517f42f4ac5869e1c3d3b840e41 => generated 512 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:50:53.208097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4c15ce54-366f-4d5c-9c70-73edce9ea282 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:53.208097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4c15ce54-366f-4d5c-9c70-73edce9ea282 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] [instance: 07019932-c686-4174-9828-3035fcc1694a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:53.225164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c15ce54-366f-4d5c-9c70-73edce9ea282 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:53.225343 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c15ce54-366f-4d5c-9c70-73edce9ea282 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:53.225730 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c15ce54-366f-4d5c-9c70-73edce9ea282 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:53.226444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c15ce54-366f-4d5c-9c70-73edce9ea282 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:53.226906 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c15ce54-366f-4d5c-9c70-73edce9ea282 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:53.227352 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c15ce54-366f-4d5c-9c70-73edce9ea282 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:53.419076 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4c15ce54-366f-4d5c-9c70-73edce9ea282 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05aab669547487d8876a70e338d3e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4ffd27d7414061b67e053657044400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:53.429071 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4c15ce54-366f-4d5c-9c70-73edce9ea282 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] 10.222.0.26 "GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a" status: 200 len: 1338 microversion: 2.1 time: 0.227440 Sep 17 20:50:53.434127 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 99/146] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:53 2022] GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a => generated 1338 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:53.461950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a766dd18-3569-4373-8634-fedb62fe2b76 tempest-KeyPairsV210TestJSON-1951794193 tempest-KeyPairsV210TestJSON-1951794193-project-admin] Action: 'create', calling method: .version_select at 0x7f25a611a040>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1762173566", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTMCSoTnTh/Pg5pdz2xG7xTLreahmGWhK/V8JP/1SiLLW7EnkngNPJaIhFbq9L0Qzap4T0G8yzLxJiHDZzDagCJISYL4BJdKjJzl9hrJFYoWAlHL3x4nWr96MuuHt1duw=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:53.484258 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f4dd9456-a221-4052-a5e6-9183cc00cf3a tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:53.484831 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f4dd9456-a221-4052-a5e6-9183cc00cf3a tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:53.485173 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f4dd9456-a221-4052-a5e6-9183cc00cf3a tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:53.486165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f4dd9456-a221-4052-a5e6-9183cc00cf3a tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:53.486637 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f4dd9456-a221-4052-a5e6-9183cc00cf3a tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:53.487325 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f4dd9456-a221-4052-a5e6-9183cc00cf3a tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:53.496712 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-a766dd18-3569-4373-8634-fedb62fe2b76 tempest-KeyPairsV210TestJSON-1951794193 tempest-KeyPairsV210TestJSON-1951794193-project-admin] Getting quotas for project 1f2f1aec1aea493d957becfaa2ac27d0. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:50:53.501920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-a766dd18-3569-4373-8634-fedb62fe2b76 tempest-KeyPairsV210TestJSON-1951794193 tempest-KeyPairsV210TestJSON-1951794193-project-admin] Getting quotas for user ad0c03ce425d4e4caf000253c0bb526e and project 1f2f1aec1aea493d957becfaa2ac27d0. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:50:53.536538 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a766dd18-3569-4373-8634-fedb62fe2b76 tempest-KeyPairsV210TestJSON-1951794193 tempest-KeyPairsV210TestJSON-1951794193-project-admin] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.098871 Sep 17 20:50:53.537176 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 100/147] 10.222.0.26 () {62 vars in 1200 bytes} [Sat Sep 17 20:50:53 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 102 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 17 20:50:53.562917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9ce0afcd-421f-4ebc-89c8-e96dc3d77564 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:53.563988 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9ce0afcd-421f-4ebc-89c8-e96dc3d77564 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:53.571468 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ce0afcd-421f-4ebc-89c8-e96dc3d77564 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:53.572300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ce0afcd-421f-4ebc-89c8-e96dc3d77564 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:53.572938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ce0afcd-421f-4ebc-89c8-e96dc3d77564 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:53.573848 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ce0afcd-421f-4ebc-89c8-e96dc3d77564 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:53.574403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ce0afcd-421f-4ebc-89c8-e96dc3d77564 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:53.574886 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ce0afcd-421f-4ebc-89c8-e96dc3d77564 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:53.659577 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f4dd9456-a221-4052-a5e6-9183cc00cf3a tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/33f1d412d4a44e09b51be3b14530c077" status: 200 len: 329 microversion: 2.1 time: 0.713719 Sep 17 20:50:53.660099 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 48/148] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Sep 17 20:50:52 2022] PUT /compute/v2.1/os-quota-sets/33f1d412d4a44e09b51be3b14530c077 => generated 329 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:53.793359 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9ce0afcd-421f-4ebc-89c8-e96dc3d77564 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8bfe1d590a4500b7e7b5c79a6a4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea88200545ae4003b42b0d475f482c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:53.810191 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9ce0afcd-421f-4ebc-89c8-e96dc3d77564 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] 10.222.0.26 "GET /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c" status: 200 len: 1320 microversion: 2.1 time: 0.253846 Sep 17 20:50:53.811534 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 101/149] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:53 2022] GET /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c => generated 1320 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:53.824080 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-93d16dfb-8eab-420d-88f9-2865b7c7701a tempest-KeyPairsV210TestJSON-1951794193 tempest-KeyPairsV210TestJSON-1951794193-project-admin] Calling method '.version_select at 0x7f25a6127550>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:53.830515 ncdv-master-1 devstack@n-api.service[140524]: WARNING oslo_db.sqlalchemy.utils [None req-93d16dfb-8eab-420d-88f9-2865b7c7701a tempest-KeyPairsV210TestJSON-1951794193 tempest-KeyPairsV210TestJSON-1951794193-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Sep 17 20:50:53.839485 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-93d16dfb-8eab-420d-88f9-2865b7c7701a tempest-KeyPairsV210TestJSON-1951794193 tempest-KeyPairsV210TestJSON-1951794193-project-admin] 10.222.0.26 "GET /compute/v2.1/os-keypairs?user_id=19067517f42f4ac5869e1c3d3b840e41" status: 200 len: 726 microversion: 2.10 time: 0.026396 Sep 17 20:50:53.840737 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 102/150] 10.222.0.26 () {60 vars in 1259 bytes} [Sat Sep 17 20:50:53 2022] GET /compute/v2.1/os-keypairs?user_id=19067517f42f4ac5869e1c3d3b840e41 => generated 726 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:50:53.856611 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fba0a233-13d2-4091-86c1-ecd3ef10dfd7 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Calling method '.version_select at 0x7f25a611aaf0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:53.975180 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a2ccf9d7-ab10-490d-b25c-819e206e505a tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] Calling method '.version_select at 0x7f25a61b9f70>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:53.979178 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2ccf9d7-ab10-490d-b25c-819e206e505a tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:53.979847 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2ccf9d7-ab10-490d-b25c-819e206e505a tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:53.980602 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2ccf9d7-ab10-490d-b25c-819e206e505a tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:53.981346 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2ccf9d7-ab10-490d-b25c-819e206e505a tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:53.981966 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2ccf9d7-ab10-490d-b25c-819e206e505a tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:53.982543 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2ccf9d7-ab10-490d-b25c-819e206e505a tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:54.014701 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a2ccf9d7-ab10-490d-b25c-819e206e505a tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts" status: 200 len: 400 microversion: 2.1 time: 0.350821 Sep 17 20:50:54.021837 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 49/151] 10.222.0.26 () {58 vars in 1128 bytes} [Sat Sep 17 20:50:53 2022] GET /compute/v2.1/os-hosts => generated 400 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:54.027304 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4b86c463-94ec-496e-9f9e-25c863a5b8ed tempest-KeyPairsV210TestJSON-1951794193 tempest-KeyPairsV210TestJSON-1951794193-project-admin] Calling method '.version_select at 0x7f25a62a5940>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:54.057746 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4b86c463-94ec-496e-9f9e-25c863a5b8ed tempest-KeyPairsV210TestJSON-1951794193 tempest-KeyPairsV210TestJSON-1951794193-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1762173566" status: 204 len: 0 microversion: 2.10 time: 0.034101 Sep 17 20:50:54.057980 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 50/152] 10.222.0.26 () {60 vars in 1325 bytes} [Sat Sep 17 20:50:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1762173566 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 20:50:54.323158 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fba0a233-13d2-4091-86c1-ecd3ef10dfd7 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/33f1d412d4a44e09b51be3b14530c077" status: 200 len: 371 microversion: 2.1 time: 0.481127 Sep 17 20:50:54.324196 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 103/153] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Sep 17 20:50:53 2022] GET /compute/v2.1/os-quota-sets/33f1d412d4a44e09b51be3b14530c077 => generated 371 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:54.330608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6a1181b2-0e5f-41e4-9b05-d4728d8caf30 tempest-KeyPairsV210TestJSON-1951794193 tempest-KeyPairsV210TestJSON-1951794193-project-admin] Calling method '.version_select at 0x7f25a6127f70>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:54.332893 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-894c881c-2ca3-4a89-ad27-f2c40f5bafa5 tempest-HostsAdminNegativeTestJSON-1385868446 tempest-HostsAdminNegativeTestJSON-1385868446-project] Calling method '.version_select at 0x7f25a6173310>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:54.336373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-894c881c-2ca3-4a89-ad27-f2c40f5bafa5 tempest-HostsAdminNegativeTestJSON-1385868446 tempest-HostsAdminNegativeTestJSON-1385868446-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'f9354d166ad84d42b03e222288d5a717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0daa58ea49e4b2dbf7a2081940572cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:54.341078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-894c881c-2ca3-4a89-ad27-f2c40f5bafa5 tempest-HostsAdminNegativeTestJSON-1385868446 tempest-HostsAdminNegativeTestJSON-1385868446-project] Request method failure captured: Sep 17 20:50:54.341078 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Sep 17 20:50:54.341078 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:50:54.341078 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:50:54.341078 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:50:54.341078 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:50:54.341078 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:50:54.341078 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:50:54.341078 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:50:54.341078 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:50:54.341078 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjMrx_qKdTqSTZVtkd8B37P2-rPoTdql8_Qj991wxY0kB-i3SIXr52KOiRnXKuDM4w5boVS603R80UiBDw-yc1uxUcdfcsW0U1klrz9LPV9EPpBF8ZznfF9NWjvfOTkUu76Gu2NEJJxnhG7EniVs6qjy-vFF0PEwzcSLbKBvXQNY3EA Sep 17 20:50:54.341078 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:50:54.341078 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:50:54.341078 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:50:54.341078 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:50:54.341078 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:50:54.341078 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:50:54.341078 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: e0daa58ea49e4b2dbf7a2081940572cc Sep 17 20:50:54.341078 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1385868446 Sep 17 20:50:54.341078 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:50:54.341078 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:50:54.342317 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e0daa58ea49e4b2dbf7a2081940572cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e0daa58ea49e4b2dbf7a2081940572cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e0daa58ea49e4b2dbf7a2081940572cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e0daa58ea49e4b2dbf7a2081940572cc", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:50:54.342317 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1385868446 Sep 17 20:50:54.342317 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: e0daa58ea49e4b2dbf7a2081940572cc Sep 17 20:50:54.342317 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1385868446 Sep 17 20:50:54.342317 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-HostsAdminNegativeTestJSON-1385868446-project Sep 17 20:50:54.342317 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:50:54.342317 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:50:54.342317 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: f9354d166ad84d42b03e222288d5a717 Sep 17 20:50:54.342317 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1385868446-project Sep 17 20:50:54.342317 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 20:50:54.342317 ncdv-master-1 devstack@n-api.service[140523]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 17 20:50:54.342317 ncdv-master-1 devstack@n-api.service[140523]: action_args: {} Sep 17 20:50:54.342317 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:50:54.343029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:54.343029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:54.343029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:54.343029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:50:54.343029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:50:54.343029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:50:54.343029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:50:54.343029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 17 20:50:54.343029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:50:54.343029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:50:54.343029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:50:54.343029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Sep 17 20:50:54.343029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Sep 17 20:50:54.343029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 17 20:50:54.343029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 17 20:50:54.343029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 17 20:50:54.343029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 17 20:50:54.343029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:50:54.343029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:50:54.344193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:50:54.344193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:50:54.344193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 17 20:50:54.344193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 17 20:50:54.344193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 17 20:50:54.344193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 17 20:50:54.344193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 17 20:50:54.344193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 17 20:50:54.344193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 17 20:50:54.344193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:54.344193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:54.344193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:54.344193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:54.344193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:54.344193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:54.344193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 17 20:50:54.344193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 17 20:50:54.344193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 17 20:50:54.344193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:54.345210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-894c881c-2ca3-4a89-ad27-f2c40f5bafa5 tempest-HostsAdminNegativeTestJSON-1385868446 tempest-HostsAdminNegativeTestJSON-1385868446-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:50:54.345210 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-894c881c-2ca3-4a89-ad27-f2c40f5bafa5 tempest-HostsAdminNegativeTestJSON-1385868446 tempest-HostsAdminNegativeTestJSON-1385868446-project] 10.222.0.26 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.282335 Sep 17 20:50:54.345210 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 51/154] 10.222.0.26 () {58 vars in 1128 bytes} [Sat Sep 17 20:50:54 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 284 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:50:54.354218 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-943d5f8d-ece7-46b1-bd63-58c4134ddeb1 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:54.354834 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-943d5f8d-ece7-46b1-bd63-58c4134ddeb1 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:54.363648 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-943d5f8d-ece7-46b1-bd63-58c4134ddeb1 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:54.364501 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-943d5f8d-ece7-46b1-bd63-58c4134ddeb1 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:54.365379 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-943d5f8d-ece7-46b1-bd63-58c4134ddeb1 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:54.366380 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-943d5f8d-ece7-46b1-bd63-58c4134ddeb1 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:54.367044 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-943d5f8d-ece7-46b1-bd63-58c4134ddeb1 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:54.367669 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-943d5f8d-ece7-46b1-bd63-58c4134ddeb1 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:54.383923 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6a1181b2-0e5f-41e4-9b05-d4728d8caf30 tempest-KeyPairsV210TestJSON-1951794193 tempest-KeyPairsV210TestJSON-1951794193-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1465272622?user_id=19067517f42f4ac5869e1c3d3b840e41" status: 204 len: 0 microversion: 2.10 time: 0.058385 Sep 17 20:50:54.390260 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 104/155] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Sep 17 20:50:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1465272622?user_id=19067517f42f4ac5869e1c3d3b840e41 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 20:50:54.399190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-49e99855-a743-421c-b574-6e8ef0f9d900 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Action: 'update', calling method: .version_select at 0x7f25a611a3a0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:54.504207 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49e99855-a743-421c-b574-6e8ef0f9d900 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:54.504874 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49e99855-a743-421c-b574-6e8ef0f9d900 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:54.505742 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49e99855-a743-421c-b574-6e8ef0f9d900 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:54.506490 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49e99855-a743-421c-b574-6e8ef0f9d900 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:54.507932 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49e99855-a743-421c-b574-6e8ef0f9d900 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:54.508371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49e99855-a743-421c-b574-6e8ef0f9d900 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:54.571553 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-943d5f8d-ece7-46b1-bd63-58c4134ddeb1 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:54.581025 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-943d5f8d-ece7-46b1-bd63-58c4134ddeb1 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1312 microversion: 2.1 time: 0.235410 Sep 17 20:50:54.581590 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:RELEASE=2,nova_api:SAVEPOINT=1,nova_api:INSERT=4,nova_api:SELECT=89,nova_api:DELETE=4 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:50:54.597028 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 52/156] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:54 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1312 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:54.610595 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0cefafc4-77ac-4ec6-aa18-8e9eb10b07e1 tempest-HostsAdminNegativeTestJSON-1385868446 tempest-HostsAdminNegativeTestJSON-1385868446-project] Calling method '.version_select at 0x7f25a613f8b0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:54.615907 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0cefafc4-77ac-4ec6-aa18-8e9eb10b07e1 tempest-HostsAdminNegativeTestJSON-1385868446 tempest-HostsAdminNegativeTestJSON-1385868446-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'f9354d166ad84d42b03e222288d5a717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0daa58ea49e4b2dbf7a2081940572cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:54.616082 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-49e99855-a743-421c-b574-6e8ef0f9d900 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/33f1d412d4a44e09b51be3b14530c077" status: 200 len: 328 microversion: 2.1 time: 0.224655 Sep 17 20:50:54.617201 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 105/157] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Sep 17 20:50:54 2022] PUT /compute/v2.1/os-quota-sets/33f1d412d4a44e09b51be3b14530c077 => generated 328 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:54.621534 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0cefafc4-77ac-4ec6-aa18-8e9eb10b07e1 tempest-HostsAdminNegativeTestJSON-1385868446 tempest-HostsAdminNegativeTestJSON-1385868446-project] Request method failure captured: Sep 17 20:50:54.621534 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/reboot HTTP/1.1 Sep 17 20:50:54.621534 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:50:54.621534 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:50:54.621534 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:50:54.621534 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:50:54.621534 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:50:54.621534 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:50:54.621534 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:50:54.621534 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:50:54.621534 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjMrx_qKdTqSTZVtkd8B37P2-rPoTdql8_Qj991wxY0kB-i3SIXr52KOiRnXKuDM4w5boVS603R80UiBDw-yc1uxUcdfcsW0U1klrz9LPV9EPpBF8ZznfF9NWjvfOTkUu76Gu2NEJJxnhG7EniVs6qjy-vFF0PEwzcSLbKBvXQNY3EA Sep 17 20:50:54.621534 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:50:54.621534 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:50:54.621534 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:50:54.621534 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:50:54.621534 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:50:54.621534 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:50:54.621534 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: e0daa58ea49e4b2dbf7a2081940572cc Sep 17 20:50:54.621534 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1385868446 Sep 17 20:50:54.621534 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:50:54.621534 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:50:54.622891 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e0daa58ea49e4b2dbf7a2081940572cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e0daa58ea49e4b2dbf7a2081940572cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e0daa58ea49e4b2dbf7a2081940572cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e0daa58ea49e4b2dbf7a2081940572cc", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:50:54.622891 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1385868446 Sep 17 20:50:54.622891 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: e0daa58ea49e4b2dbf7a2081940572cc Sep 17 20:50:54.622891 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1385868446 Sep 17 20:50:54.622891 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-HostsAdminNegativeTestJSON-1385868446-project Sep 17 20:50:54.622891 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:50:54.622891 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:50:54.622891 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: f9354d166ad84d42b03e222288d5a717 Sep 17 20:50:54.622891 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1385868446-project Sep 17 20:50:54.622891 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 20:50:54.622891 ncdv-master-1 devstack@n-api.service[140523]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 17 20:50:54.622891 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'ncdv-master-1'} Sep 17 20:50:54.622891 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:50:54.623581 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:54.623581 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:54.623581 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:54.623581 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:50:54.623581 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:50:54.623581 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:50:54.623581 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:50:54.623581 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:50:54.623581 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:50:54.623581 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Sep 17 20:50:54.623581 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Sep 17 20:50:54.623581 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 17 20:50:54.623581 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 17 20:50:54.623581 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 17 20:50:54.623581 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 17 20:50:54.623581 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:50:54.623581 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:50:54.623581 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:50:54.623581 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:50:54.624561 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 17 20:50:54.624561 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 17 20:50:54.624561 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 17 20:50:54.624561 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 17 20:50:54.624561 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 17 20:50:54.624561 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 17 20:50:54.624561 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 17 20:50:54.624561 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:54.624561 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:54.624561 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:54.624561 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:54.624561 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:54.624561 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:54.624561 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 17 20:50:54.624561 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 17 20:50:54.624561 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 17 20:50:54.624561 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:54.627010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0cefafc4-77ac-4ec6-aa18-8e9eb10b07e1 tempest-HostsAdminNegativeTestJSON-1385868446 tempest-HostsAdminNegativeTestJSON-1385868446-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:50:54.628781 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0cefafc4-77ac-4ec6-aa18-8e9eb10b07e1 tempest-HostsAdminNegativeTestJSON-1385868446 tempest-HostsAdminNegativeTestJSON-1385868446-project] 10.222.0.26 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.027942 Sep 17 20:50:54.629783 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 53/158] 10.222.0.26 () {58 vars in 1191 bytes} [Sat Sep 17 20:50:54 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:50:54.637289 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c7b99aa2-4d39-47de-9497-af4f74629721 tempest-KeyPairsV210TestJSON-1951794193 tempest-KeyPairsV210TestJSON-1951794193-project-admin] Calling method '.version_select at 0x7f25a6183790>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:54.639624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-67948099-f998-4c7c-b472-ebb6a01178af tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:54.640485 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-67948099-f998-4c7c-b472-ebb6a01178af tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] [instance: 07019932-c686-4174-9828-3035fcc1694a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:54.648647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67948099-f998-4c7c-b472-ebb6a01178af tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:54.649598 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67948099-f998-4c7c-b472-ebb6a01178af tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:54.650305 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67948099-f998-4c7c-b472-ebb6a01178af tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:54.651234 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67948099-f998-4c7c-b472-ebb6a01178af tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:54.652331 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67948099-f998-4c7c-b472-ebb6a01178af tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:54.652835 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67948099-f998-4c7c-b472-ebb6a01178af tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:54.674403 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c7b99aa2-4d39-47de-9497-af4f74629721 tempest-KeyPairsV210TestJSON-1951794193 tempest-KeyPairsV210TestJSON-1951794193-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2056913455?user_id=19067517f42f4ac5869e1c3d3b840e41" status: 204 len: 0 microversion: 2.10 time: 0.055579 Sep 17 20:50:54.675245 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 106/159] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Sep 17 20:50:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2056913455?user_id=19067517f42f4ac5869e1c3d3b840e41 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 20:50:54.683150 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-df6ee328-ddc5-4575-bd9d-e0cd5baca0a4 req-2b25fbd6-7321-4508-98cc-966b7f7b9e59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dbd958b-d480-41e3-b36b-4d3c7fa55d1c", "tag": "5dfa3fc2-0525-47cd-8ef7-b5446595e1bb"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:54.694662 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-df6ee328-ddc5-4575-bd9d-e0cd5baca0a4 req-2b25fbd6-7321-4508-98cc-966b7f7b9e59 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:54.695143 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-df6ee328-ddc5-4575-bd9d-e0cd5baca0a4 req-2b25fbd6-7321-4508-98cc-966b7f7b9e59 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:54.695576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-df6ee328-ddc5-4575-bd9d-e0cd5baca0a4 req-2b25fbd6-7321-4508-98cc-966b7f7b9e59 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:54.707221 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-df6ee328-ddc5-4575-bd9d-e0cd5baca0a4 req-2b25fbd6-7321-4508-98cc-966b7f7b9e59 service nova] Creating event network-changed:5dfa3fc2-0525-47cd-8ef7-b5446595e1bb for instance 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c on nch1-master-1 Sep 17 20:50:54.717033 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-df6ee328-ddc5-4575-bd9d-e0cd5baca0a4 req-2b25fbd6-7321-4508-98cc-966b7f7b9e59 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040761 Sep 17 20:50:54.726491 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 107/160] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:54.731776 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4f63d4de-ee06-4da6-abf0-451b60ab363a tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] Calling method '.version_select at 0x7f25a6127430>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:54.766821 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-4f63d4de-ee06-4da6-abf0-451b60ab363a tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 17 20:50:54.770916 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4f63d4de-ee06-4da6-abf0-451b60ab363a tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] Request method failure captured: Sep 17 20:50:54.770916 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Sep 17 20:50:54.770916 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:50:54.770916 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:50:54.770916 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:50:54.770916 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:50:54.770916 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:50:54.770916 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:50:54.770916 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:50:54.770916 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:50:54.770916 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjMtAZWiZT97RhRtYrm7NWEQPAvQaEm0-Nnyo-dQWcXNAI089iRfXcieXFsce_6E7B13Lb0kiVR4GhulXLY97I87e99xa5vgnupcG4aao1ZSd3o7VJD1uU3pdlKMAWVwehLhQYKIsQWRo4XJl4-VUPHfx1L-V3hxaKsE0BAZKK427_k Sep 17 20:50:54.770916 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:50:54.770916 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:50:54.770916 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:50:54.770916 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:50:54.770916 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:50:54.770916 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:50:54.770916 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 8aafc4a713d94652bd4ee89c1448fc39 Sep 17 20:50:54.770916 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1700771831 Sep 17 20:50:54.770916 ncdv-master-1 devstack@n-api.service[140524]: X-Role: admin,member,reader Sep 17 20:50:54.770916 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: admin,member,reader Sep 17 20:50:54.772141 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8aafc4a713d94652bd4ee89c1448fc39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8aafc4a713d94652bd4ee89c1448fc39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8aafc4a713d94652bd4ee89c1448fc39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8aafc4a713d94652bd4ee89c1448fc39", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:50:54.772141 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1700771831 Sep 17 20:50:54.772141 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 8aafc4a713d94652bd4ee89c1448fc39 Sep 17 20:50:54.772141 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1700771831 Sep 17 20:50:54.772141 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-HostsAdminNegativeTestJSON-1700771831-project-admin Sep 17 20:50:54.772141 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:50:54.772141 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:50:54.772141 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 05052d8e3de14ff19f64a71c8608c064 Sep 17 20:50:54.772141 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1700771831-project-admin Sep 17 20:50:54.772141 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:50:54.772141 ncdv-master-1 devstack@n-api.service[140524]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 17 20:50:54.772141 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'nonexistent_hostname'} Sep 17 20:50:54.772141 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:50:54.772873 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:54.772873 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 17 20:50:54.772873 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 17 20:50:54.772873 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 17 20:50:54.772873 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 17 20:50:54.772873 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:50:54.772873 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:50:54.772873 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:50:54.772873 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:50:54.772873 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 17 20:50:54.772873 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 17 20:50:54.772873 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 17 20:50:54.772873 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 17 20:50:54.772873 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:50:54.772873 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:50:54.772873 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 17 20:50:54.772873 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 17 20:50:54.772873 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 17 20:50:54.772873 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 17 20:50:54.773929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 17 20:50:54.773929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 17 20:50:54.773929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 17 20:50:54.773929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:54.773929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:54.773929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:54.773929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:54.773929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:54.773929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:54.773929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:50:54.773929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:50:54.773929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:50:54.773929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:50:54.773929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:50:54.773929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:50:54.773929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Sep 17 20:50:54.773929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Sep 17 20:50:54.773929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 17 20:50:54.773929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:50:54.774935 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 17 20:50:54.774935 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:54.774935 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:54.774935 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:54.774935 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:54.774935 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:54.774935 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:54.774935 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:50:54.774935 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:50:54.774935 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 17 20:50:54.774935 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:54.774935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4f63d4de-ee06-4da6-abf0-451b60ab363a tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:50:54.775583 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4f63d4de-ee06-4da6-abf0-451b60ab363a tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.047632 Sep 17 20:50:54.784616 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 108/161] 10.222.0.26 () {58 vars in 1212 bytes} [Sat Sep 17 20:50:54 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 20:50:54.832987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-67948099-f998-4c7c-b472-ebb6a01178af tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05aab669547487d8876a70e338d3e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4ffd27d7414061b67e053657044400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:54.841391 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-67948099-f998-4c7c-b472-ebb6a01178af tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] 10.222.0.26 "GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a" status: 200 len: 1338 microversion: 2.1 time: 0.210363 Sep 17 20:50:54.842423 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 54/162] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:54 2022] GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a => generated 1338 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:54.859808 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dba75faf-b5a7-4f40-a81e-3cf31c55375e tempest-HostsAdminNegativeTestJSON-1385868446 tempest-HostsAdminNegativeTestJSON-1385868446-project] Calling method '.version_select at 0x7f25a60d0ee0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:54.862299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dba75faf-b5a7-4f40-a81e-3cf31c55375e tempest-HostsAdminNegativeTestJSON-1385868446 tempest-HostsAdminNegativeTestJSON-1385868446-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'f9354d166ad84d42b03e222288d5a717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0daa58ea49e4b2dbf7a2081940572cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:54.864575 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dba75faf-b5a7-4f40-a81e-3cf31c55375e tempest-HostsAdminNegativeTestJSON-1385868446 tempest-HostsAdminNegativeTestJSON-1385868446-project] Request method failure captured: Sep 17 20:50:54.864575 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Sep 17 20:50:54.864575 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:50:54.864575 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:50:54.864575 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:50:54.864575 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:50:54.864575 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:50:54.864575 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:50:54.864575 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:50:54.864575 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:50:54.864575 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjMrx_qKdTqSTZVtkd8B37P2-rPoTdql8_Qj991wxY0kB-i3SIXr52KOiRnXKuDM4w5boVS603R80UiBDw-yc1uxUcdfcsW0U1klrz9LPV9EPpBF8ZznfF9NWjvfOTkUu76Gu2NEJJxnhG7EniVs6qjy-vFF0PEwzcSLbKBvXQNY3EA Sep 17 20:50:54.864575 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:50:54.864575 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:50:54.864575 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:50:54.864575 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:50:54.864575 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:50:54.864575 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:50:54.864575 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: e0daa58ea49e4b2dbf7a2081940572cc Sep 17 20:50:54.864575 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1385868446 Sep 17 20:50:54.864575 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:50:54.864575 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:50:54.865880 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e0daa58ea49e4b2dbf7a2081940572cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e0daa58ea49e4b2dbf7a2081940572cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e0daa58ea49e4b2dbf7a2081940572cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e0daa58ea49e4b2dbf7a2081940572cc", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:50:54.865880 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1385868446 Sep 17 20:50:54.865880 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: e0daa58ea49e4b2dbf7a2081940572cc Sep 17 20:50:54.865880 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1385868446 Sep 17 20:50:54.865880 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-HostsAdminNegativeTestJSON-1385868446-project Sep 17 20:50:54.865880 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:50:54.865880 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:50:54.865880 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: f9354d166ad84d42b03e222288d5a717 Sep 17 20:50:54.865880 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1385868446-project Sep 17 20:50:54.865880 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 20:50:54.865880 ncdv-master-1 devstack@n-api.service[140523]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 17 20:50:54.865880 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'ncdv-master-1'} Sep 17 20:50:54.865880 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:50:54.866712 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:54.866712 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:54.866712 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:54.866712 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:50:54.866712 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:50:54.866712 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:50:54.866712 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:50:54.866712 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:50:54.866712 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:50:54.866712 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Sep 17 20:50:54.866712 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Sep 17 20:50:54.866712 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 17 20:50:54.866712 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 17 20:50:54.866712 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 17 20:50:54.866712 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 17 20:50:54.866712 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:50:54.866712 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:50:54.866712 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:50:54.866712 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:50:54.868073 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 17 20:50:54.868073 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 17 20:50:54.868073 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 17 20:50:54.868073 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 17 20:50:54.868073 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 17 20:50:54.868073 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 17 20:50:54.868073 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 17 20:50:54.868073 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:54.868073 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:54.868073 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:54.868073 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:54.868073 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:54.868073 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:54.868073 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 17 20:50:54.868073 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 17 20:50:54.868073 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 17 20:50:54.868073 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:54.869125 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dba75faf-b5a7-4f40-a81e-3cf31c55375e tempest-HostsAdminNegativeTestJSON-1385868446 tempest-HostsAdminNegativeTestJSON-1385868446-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:50:54.869125 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dba75faf-b5a7-4f40-a81e-3cf31c55375e tempest-HostsAdminNegativeTestJSON-1385868446 tempest-HostsAdminNegativeTestJSON-1385868446-project] 10.222.0.26 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.022678 Sep 17 20:50:54.869125 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 55/163] 10.222.0.26 () {58 vars in 1170 bytes} [Sat Sep 17 20:50:54 2022] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:50:54.872815 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-afb740f3-d627-42ee-a09e-6bf78feb51bb tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-199812549", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:54.928804 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-afb740f3-d627-42ee-a09e-6bf78feb51bb tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] validate_networks() for None {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:50:54.965927 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7e2c135b-d745-4599-b1b5-b6620d613205 tempest-FlavorsExtraSpecsTestJSON-157833883 tempest-FlavorsExtraSpecsTestJSON-157833883-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-184899255", "ram": 512, "vcpus": 1, "disk": 10, "id": 401033111, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:54.997671 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7e2c135b-d745-4599-b1b5-b6620d613205 tempest-FlavorsExtraSpecsTestJSON-157833883 tempest-FlavorsExtraSpecsTestJSON-157833883-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.209731 Sep 17 20:50:54.998981 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 109/164] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:50:54 2022] POST /compute/v2.1/flavors => generated 412 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:55.004854 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f511a754-bd5f-4290-8de4-24ac6d075097 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:55.005909 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f511a754-bd5f-4290-8de4-24ac6d075097 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:55.014553 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f511a754-bd5f-4290-8de4-24ac6d075097 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:55.015373 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f511a754-bd5f-4290-8de4-24ac6d075097 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:55.016342 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f511a754-bd5f-4290-8de4-24ac6d075097 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:55.018614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f511a754-bd5f-4290-8de4-24ac6d075097 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:55.019327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f511a754-bd5f-4290-8de4-24ac6d075097 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:55.020007 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f511a754-bd5f-4290-8de4-24ac6d075097 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:55.237151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f511a754-bd5f-4290-8de4-24ac6d075097 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8bfe1d590a4500b7e7b5c79a6a4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea88200545ae4003b42b0d475f482c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:55.247413 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f511a754-bd5f-4290-8de4-24ac6d075097 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] 10.222.0.26 "GET /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c" status: 200 len: 1320 microversion: 2.1 time: 0.246808 Sep 17 20:50:55.248811 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 110/165] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:54 2022] GET /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c => generated 1320 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:55.254254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-22d681c1-292e-48a7-a416-100f8a654d3f tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] Calling method '.version_select at 0x7f25a62ca280>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:55.260765 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-22d681c1-292e-48a7-a416-100f8a654d3f tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 17 20:50:55.263535 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-22d681c1-292e-48a7-a416-100f8a654d3f tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] Request method failure captured: Sep 17 20:50:55.263535 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 17 20:50:55.263535 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:50:55.263535 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:50:55.263535 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:50:55.263535 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:50:55.263535 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:50:55.263535 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:50:55.263535 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:50:55.263535 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:50:55.263535 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjMtAZWiZT97RhRtYrm7NWEQPAvQaEm0-Nnyo-dQWcXNAI089iRfXcieXFsce_6E7B13Lb0kiVR4GhulXLY97I87e99xa5vgnupcG4aao1ZSd3o7VJD1uU3pdlKMAWVwehLhQYKIsQWRo4XJl4-VUPHfx1L-V3hxaKsE0BAZKK427_k Sep 17 20:50:55.263535 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:50:55.263535 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:50:55.263535 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:50:55.263535 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:50:55.263535 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:50:55.263535 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:50:55.263535 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 8aafc4a713d94652bd4ee89c1448fc39 Sep 17 20:50:55.263535 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1700771831 Sep 17 20:50:55.263535 ncdv-master-1 devstack@n-api.service[140524]: X-Role: admin,member,reader Sep 17 20:50:55.263535 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: admin,member,reader Sep 17 20:50:55.264687 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8aafc4a713d94652bd4ee89c1448fc39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8aafc4a713d94652bd4ee89c1448fc39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8aafc4a713d94652bd4ee89c1448fc39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8aafc4a713d94652bd4ee89c1448fc39", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:50:55.264687 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1700771831 Sep 17 20:50:55.264687 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 8aafc4a713d94652bd4ee89c1448fc39 Sep 17 20:50:55.264687 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1700771831 Sep 17 20:50:55.264687 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-HostsAdminNegativeTestJSON-1700771831-project-admin Sep 17 20:50:55.264687 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:50:55.264687 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:50:55.264687 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 05052d8e3de14ff19f64a71c8608c064 Sep 17 20:50:55.264687 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1700771831-project-admin Sep 17 20:50:55.264687 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:50:55.264687 ncdv-master-1 devstack@n-api.service[140524]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 17 20:50:55.264687 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'nonexistent_hostname'} Sep 17 20:50:55.264687 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:50:55.265390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:55.265390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Sep 17 20:50:55.265390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 17 20:50:55.265390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:50:55.265390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:50:55.265390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 17 20:50:55.265390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 17 20:50:55.265390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 17 20:50:55.265390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 17 20:50:55.265390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 17 20:50:55.265390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 17 20:50:55.265390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 17 20:50:55.265390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:55.265390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:55.265390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:55.265390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:55.265390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:55.265390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:55.265390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:50:55.266435 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:50:55.266435 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:50:55.266435 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:50:55.266435 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:50:55.266435 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:50:55.266435 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Sep 17 20:50:55.266435 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:50:55.266435 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 17 20:50:55.266435 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:55.266435 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:55.266435 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:55.266435 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:55.266435 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:55.266435 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:55.266435 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:50:55.266435 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:50:55.266435 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 17 20:50:55.266435 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:55.267355 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-22d681c1-292e-48a7-a416-100f8a654d3f tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:50:55.267355 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-22d681c1-292e-48a7-a416-100f8a654d3f tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.014797 Sep 17 20:50:55.267355 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 111/166] 10.222.0.26 () {58 vars in 1191 bytes} [Sat Sep 17 20:50:55 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 20:50:55.273748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7ebb40d9-d792-4cf8-bdc2-1ca8a9f93ee5 tempest-FlavorsExtraSpecsTestJSON-157833883 tempest-FlavorsExtraSpecsTestJSON-157833883-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:55.282646 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-afb740f3-d627-42ee-a09e-6bf78feb51bb tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:50:55.283070 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-afb740f3-d627-42ee-a09e-6bf78feb51bb tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:50:55.283581 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-afb740f3-d627-42ee-a09e-6bf78feb51bb tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:50:55.283992 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-afb740f3-d627-42ee-a09e-6bf78feb51bb tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:50:55.284406 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-afb740f3-d627-42ee-a09e-6bf78feb51bb tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:50:55.294359 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afb740f3-d627-42ee-a09e-6bf78feb51bb tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:55.294866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afb740f3-d627-42ee-a09e-6bf78feb51bb tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:55.295273 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afb740f3-d627-42ee-a09e-6bf78feb51bb tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:55.296008 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afb740f3-d627-42ee-a09e-6bf78feb51bb tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:55.296463 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afb740f3-d627-42ee-a09e-6bf78feb51bb tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:55.297062 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afb740f3-d627-42ee-a09e-6bf78feb51bb tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:55.317992 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-afb740f3-d627-42ee-a09e-6bf78feb51bb tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Getting quotas for project 33f1d412d4a44e09b51be3b14530c077. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:50:55.324065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-afb740f3-d627-42ee-a09e-6bf78feb51bb tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Getting quotas for user ee3d8ef713bd4844833d9374766452d8 and project 33f1d412d4a44e09b51be3b14530c077. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:50:55.334053 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7ebb40d9-d792-4cf8-bdc2-1ca8a9f93ee5 tempest-FlavorsExtraSpecsTestJSON-157833883 tempest-FlavorsExtraSpecsTestJSON-157833883-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/401033111/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.067161 Sep 17 20:50:55.337198 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 112/167] 10.222.0.26 () {60 vars in 1221 bytes} [Sat Sep 17 20:50:55 2022] POST /compute/v2.1/flavors/401033111/os-extra_specs => generated 66 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:50:55.339824 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.utils [None req-afb740f3-d627-42ee-a09e-6bf78feb51bb tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] instances quota exceeded for 33f1d412d4a44e09b51be3b14530c077, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=140523) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 17 20:50:55.340889 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-afb740f3-d627-42ee-a09e-6bf78feb51bb tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 17 20:50:55.346244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6937b1b7-028c-4903-891a-4ef00d8e7913 tempest-HostsAdminNegativeTestJSON-1385868446 tempest-HostsAdminNegativeTestJSON-1385868446-project] Calling method '.version_select at 0x7f25a61274c0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:55.348059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-afb740f3-d627-42ee-a09e-6bf78feb51bb tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Request method failure captured: Sep 17 20:50:55.348059 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 17 20:50:55.348059 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:50:55.348059 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:50:55.348059 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:50:55.348059 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 144 Sep 17 20:50:55.348059 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:50:55.348059 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:50:55.348059 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:50:55.348059 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:50:55.348059 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjMorfY1IaiX_nlTF6-vfKrPRniweyxQdL_zIcWo2OcbyQiD0zsaGsEjbIIe5O_NaKtXwkJ9VyZi7i6yxrmHR7zeW9tUXd1NG0qNXbk8wBk4T0D0PmtSzZTJtxK03nF8LrFHR21GbWXSXR5rU9QKKKG9KDMJuIdu6EG5PuLWF2Aiyog Sep 17 20:50:55.348059 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:50:55.348059 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:50:55.348059 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:50:55.348059 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:50:55.348059 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:50:55.348059 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:50:55.348059 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 33f1d412d4a44e09b51be3b14530c077 Sep 17 20:50:55.348059 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-QuotasAdminNegativeTest-734910182 Sep 17 20:50:55.348059 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:50:55.348059 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:50:55.349208 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/33f1d412d4a44e09b51be3b14530c077"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/33f1d412d4a44e09b51be3b14530c077"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/33f1d412d4a44e09b51be3b14530c077"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_33f1d412d4a44e09b51be3b14530c077", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:50:55.349208 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-QuotasAdminNegativeTest-734910182 Sep 17 20:50:55.349208 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 33f1d412d4a44e09b51be3b14530c077 Sep 17 20:50:55.349208 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-734910182 Sep 17 20:50:55.349208 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-QuotasAdminNegativeTest-734910182-project Sep 17 20:50:55.349208 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:50:55.349208 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:50:55.349208 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: ee3d8ef713bd4844833d9374766452d8 Sep 17 20:50:55.349208 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-QuotasAdminNegativeTest-734910182-project Sep 17 20:50:55.349208 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 20:50:55.349208 ncdv-master-1 devstack@n-api.service[140523]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-199812549", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452"}} Sep 17 20:50:55.349208 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:50:55.349978 ncdv-master-1 devstack@n-api.service[140523]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 17 20:50:55.349978 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-199812549', 'imageRef': '1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4', 'flavorRef': '452'}}} Sep 17 20:50:55.349978 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:50:55.349978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:55.349978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 17 20:50:55.349978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 17 20:50:55.349978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:50:55.349978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:50:55.349978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 17 20:50:55.349978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc Sep 17 20:50:55.349978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 17 20:50:55.349978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 17 20:50:55.349978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:50:55.349978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:50:55.349978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 17 20:50:55.349978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 17 20:50:55.349978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 17 20:50:55.349978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 17 20:50:55.351006 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 17 20:50:55.351006 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 17 20:50:55.351006 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Sep 17 20:50:55.351006 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:55.351006 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:55.351006 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:55.351006 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:55.351006 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 17 20:50:55.351006 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 17 20:50:55.351006 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 17 20:50:55.351006 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 17 20:50:55.351006 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 17 20:50:55.351006 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 17 20:50:55.351006 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 17 20:50:55.351006 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 17 20:50:55.351006 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 17 20:50:55.351006 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 17 20:50:55.351006 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 17 20:50:55.351006 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:55.351006 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:55.351006 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:55.352117 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:55.352117 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:55.352117 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:55.352117 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:50:55.352117 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:50:55.352117 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:50:55.352117 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:50:55.352117 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:50:55.352117 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:50:55.352117 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:50:55.352117 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:50:55.352117 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:50:55.352117 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:50:55.352117 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 17 20:50:55.352117 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 17 20:50:55.352117 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 17 20:50:55.352117 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 17 20:50:55.352117 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:55.352117 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:55.352117 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:55.352117 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:55.353209 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:55.353209 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:55.353209 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:50:55.353209 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:50:55.353209 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 17 20:50:55.353209 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:55.354569 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6937b1b7-028c-4903-891a-4ef00d8e7913 tempest-HostsAdminNegativeTestJSON-1385868446 tempest-HostsAdminNegativeTestJSON-1385868446-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'f9354d166ad84d42b03e222288d5a717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0daa58ea49e4b2dbf7a2081940572cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:55.355668 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-afb740f3-d627-42ee-a09e-6bf78feb51bb tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:50:55.355773 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6937b1b7-028c-4903-891a-4ef00d8e7913 tempest-HostsAdminNegativeTestJSON-1385868446 tempest-HostsAdminNegativeTestJSON-1385868446-project] Request method failure captured: Sep 17 20:50:55.355773 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown HTTP/1.1 Sep 17 20:50:55.355773 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:50:55.355773 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:50:55.355773 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:50:55.355773 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:50:55.355773 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:50:55.355773 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:50:55.355773 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:50:55.355773 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:50:55.355773 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjMrx_qKdTqSTZVtkd8B37P2-rPoTdql8_Qj991wxY0kB-i3SIXr52KOiRnXKuDM4w5boVS603R80UiBDw-yc1uxUcdfcsW0U1klrz9LPV9EPpBF8ZznfF9NWjvfOTkUu76Gu2NEJJxnhG7EniVs6qjy-vFF0PEwzcSLbKBvXQNY3EA Sep 17 20:50:55.355773 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:50:55.355773 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:50:55.355773 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:50:55.355773 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:50:55.355773 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:50:55.355773 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:50:55.355773 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: e0daa58ea49e4b2dbf7a2081940572cc Sep 17 20:50:55.355773 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1385868446 Sep 17 20:50:55.355773 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:50:55.355773 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:50:55.356870 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e0daa58ea49e4b2dbf7a2081940572cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e0daa58ea49e4b2dbf7a2081940572cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e0daa58ea49e4b2dbf7a2081940572cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e0daa58ea49e4b2dbf7a2081940572cc", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:50:55.356870 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1385868446 Sep 17 20:50:55.356870 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: e0daa58ea49e4b2dbf7a2081940572cc Sep 17 20:50:55.356870 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1385868446 Sep 17 20:50:55.356870 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-HostsAdminNegativeTestJSON-1385868446-project Sep 17 20:50:55.356870 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:50:55.356870 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:50:55.356870 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: f9354d166ad84d42b03e222288d5a717 Sep 17 20:50:55.356870 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1385868446-project Sep 17 20:50:55.356870 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:50:55.356870 ncdv-master-1 devstack@n-api.service[140524]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 17 20:50:55.356870 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'ncdv-master-1'} Sep 17 20:50:55.356870 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:50:55.357578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:55.357578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:55.357578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:55.357578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:50:55.357578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:50:55.357578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:50:55.357578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:50:55.357578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:50:55.357578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:50:55.357578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Sep 17 20:50:55.357578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Sep 17 20:50:55.357578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 17 20:50:55.357578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 17 20:50:55.357578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 17 20:50:55.357578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 17 20:50:55.357578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:50:55.357578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:50:55.357578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:50:55.357578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:50:55.358563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 17 20:50:55.358563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 17 20:50:55.358563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 17 20:50:55.358563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 17 20:50:55.358563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 17 20:50:55.358563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 17 20:50:55.358563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 17 20:50:55.358563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:55.358563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:55.358563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:55.358563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:55.358563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:55.358563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:55.358563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 17 20:50:55.358563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 17 20:50:55.358563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 17 20:50:55.358563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:55.359437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6937b1b7-028c-4903-891a-4ef00d8e7913 tempest-HostsAdminNegativeTestJSON-1385868446 tempest-HostsAdminNegativeTestJSON-1385868446-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:50:55.359437 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6937b1b7-028c-4903-891a-4ef00d8e7913 tempest-HostsAdminNegativeTestJSON-1385868446 tempest-HostsAdminNegativeTestJSON-1385868446-project] 10.222.0.26 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.019173 Sep 17 20:50:55.363399 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-afb740f3-d627-42ee-a09e-6bf78feb51bb tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.495602 Sep 17 20:50:55.364496 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 113/168] 10.222.0.26 () {58 vars in 1197 bytes} [Sat Sep 17 20:50:55 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:50:55.364827 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 56/169] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:50:54 2022] POST /compute/v2.1/servers => generated 119 bytes in 497 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:50:55.370333 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b12e9bf6-4ff8-414c-966b-72510845cfba tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] Calling method '.version_select at 0x7f25a5f91a60>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:55.411152 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-b12e9bf6-4ff8-414c-966b-72510845cfba tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 17 20:50:55.415180 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b12e9bf6-4ff8-414c-966b-72510845cfba tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] Request method failure captured: Sep 17 20:50:55.415180 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Sep 17 20:50:55.415180 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:50:55.415180 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:50:55.415180 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:50:55.415180 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:50:55.415180 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:50:55.415180 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:50:55.415180 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:50:55.415180 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:50:55.415180 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjMtAZWiZT97RhRtYrm7NWEQPAvQaEm0-Nnyo-dQWcXNAI089iRfXcieXFsce_6E7B13Lb0kiVR4GhulXLY97I87e99xa5vgnupcG4aao1ZSd3o7VJD1uU3pdlKMAWVwehLhQYKIsQWRo4XJl4-VUPHfx1L-V3hxaKsE0BAZKK427_k Sep 17 20:50:55.415180 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:50:55.415180 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:50:55.415180 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:50:55.415180 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:50:55.415180 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:50:55.415180 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:50:55.415180 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 8aafc4a713d94652bd4ee89c1448fc39 Sep 17 20:50:55.415180 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1700771831 Sep 17 20:50:55.415180 ncdv-master-1 devstack@n-api.service[140523]: X-Role: admin,member,reader Sep 17 20:50:55.415180 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: admin,member,reader Sep 17 20:50:55.416402 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8aafc4a713d94652bd4ee89c1448fc39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8aafc4a713d94652bd4ee89c1448fc39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8aafc4a713d94652bd4ee89c1448fc39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8aafc4a713d94652bd4ee89c1448fc39", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:50:55.416402 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1700771831 Sep 17 20:50:55.416402 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 8aafc4a713d94652bd4ee89c1448fc39 Sep 17 20:50:55.416402 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1700771831 Sep 17 20:50:55.416402 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-HostsAdminNegativeTestJSON-1700771831-project-admin Sep 17 20:50:55.416402 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:50:55.416402 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:50:55.416402 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 05052d8e3de14ff19f64a71c8608c064 Sep 17 20:50:55.416402 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1700771831-project-admin Sep 17 20:50:55.416402 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 20:50:55.416402 ncdv-master-1 devstack@n-api.service[140523]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 17 20:50:55.416402 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'nonexistent_hostname'} Sep 17 20:50:55.416402 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:50:55.417102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:55.417102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 17 20:50:55.417102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 17 20:50:55.417102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 17 20:50:55.417102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 17 20:50:55.417102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:50:55.417102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:50:55.417102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:50:55.417102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:50:55.417102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 17 20:50:55.417102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 17 20:50:55.417102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 17 20:50:55.417102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 17 20:50:55.417102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:50:55.417102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:50:55.417102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 17 20:50:55.417102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 17 20:50:55.417102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 17 20:50:55.417102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 17 20:50:55.418261 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 17 20:50:55.418261 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 17 20:50:55.418261 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 17 20:50:55.418261 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:55.418261 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:55.418261 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:55.418261 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:55.418261 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:55.418261 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:55.418261 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:50:55.418261 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:50:55.418261 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:50:55.418261 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:50:55.418261 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:50:55.418261 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:50:55.418261 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Sep 17 20:50:55.418261 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Sep 17 20:50:55.418261 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 17 20:50:55.418261 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:50:55.419237 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 17 20:50:55.419237 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:55.419237 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:55.419237 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:55.419237 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:55.419237 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:55.419237 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:55.419237 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:50:55.419237 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:50:55.419237 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 17 20:50:55.419237 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:55.424021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b12e9bf6-4ff8-414c-966b-72510845cfba tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:50:55.425018 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b12e9bf6-4ff8-414c-966b-72510845cfba tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.058922 Sep 17 20:50:55.434117 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 57/170] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Sep 17 20:50:55 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 20:50:55.439135 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1f62a982-7255-4977-91d5-6c125d53f83d tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Action: 'update', calling method: .version_select at 0x7f25a613f9d0>, body: {"quota_set": {"instances": 10}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:55.668197 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-686b20f0-a21d-4139-9fca-b0ac2876cd24 tempest-FlavorsExtraSpecsTestJSON-1789915181 tempest-FlavorsExtraSpecsTestJSON-1789915181-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:55.682063 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1f62a982-7255-4977-91d5-6c125d53f83d tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:55.683444 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-686b20f0-a21d-4139-9fca-b0ac2876cd24 tempest-FlavorsExtraSpecsTestJSON-1789915181 tempest-FlavorsExtraSpecsTestJSON-1789915181-project] 10.222.0.26 "GET /compute/v2.1/flavors/401033111/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.317510 Sep 17 20:50:55.683810 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 114/171] 10.222.0.26 () {58 vars in 1200 bytes} [Sat Sep 17 20:50:55 2022] GET /compute/v2.1/flavors/401033111/os-extra_specs => generated 66 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:50:55.691314 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f675621c-4ab9-41ba-80ec-4a1556984eba tempest-HostsAdminNegativeTestJSON-1385868446 tempest-HostsAdminNegativeTestJSON-1385868446-project] Calling method '.version_select at 0x7f25a62ca310>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:55.693201 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1f62a982-7255-4977-91d5-6c125d53f83d tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:55.693339 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f675621c-4ab9-41ba-80ec-4a1556984eba tempest-HostsAdminNegativeTestJSON-1385868446 tempest-HostsAdminNegativeTestJSON-1385868446-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'f9354d166ad84d42b03e222288d5a717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0daa58ea49e4b2dbf7a2081940572cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:55.694245 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1f62a982-7255-4977-91d5-6c125d53f83d tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:55.694853 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f675621c-4ab9-41ba-80ec-4a1556984eba tempest-HostsAdminNegativeTestJSON-1385868446 tempest-HostsAdminNegativeTestJSON-1385868446-project] Request method failure captured: Sep 17 20:50:55.694853 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/os-hosts/ncdv-master-1/startup HTTP/1.1 Sep 17 20:50:55.694853 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:50:55.694853 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:50:55.694853 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:50:55.694853 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:50:55.694853 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:50:55.694853 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:50:55.694853 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:50:55.694853 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:50:55.694853 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjMrx_qKdTqSTZVtkd8B37P2-rPoTdql8_Qj991wxY0kB-i3SIXr52KOiRnXKuDM4w5boVS603R80UiBDw-yc1uxUcdfcsW0U1klrz9LPV9EPpBF8ZznfF9NWjvfOTkUu76Gu2NEJJxnhG7EniVs6qjy-vFF0PEwzcSLbKBvXQNY3EA Sep 17 20:50:55.694853 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:50:55.694853 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:50:55.694853 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:50:55.694853 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:50:55.694853 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:50:55.694853 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:50:55.694853 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: e0daa58ea49e4b2dbf7a2081940572cc Sep 17 20:50:55.694853 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1385868446 Sep 17 20:50:55.694853 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:50:55.694853 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:50:55.696013 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e0daa58ea49e4b2dbf7a2081940572cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e0daa58ea49e4b2dbf7a2081940572cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e0daa58ea49e4b2dbf7a2081940572cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e0daa58ea49e4b2dbf7a2081940572cc", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:50:55.696013 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1385868446 Sep 17 20:50:55.696013 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: e0daa58ea49e4b2dbf7a2081940572cc Sep 17 20:50:55.696013 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1385868446 Sep 17 20:50:55.696013 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-HostsAdminNegativeTestJSON-1385868446-project Sep 17 20:50:55.696013 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:50:55.696013 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:50:55.696013 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: f9354d166ad84d42b03e222288d5a717 Sep 17 20:50:55.696013 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1385868446-project Sep 17 20:50:55.696013 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:50:55.696013 ncdv-master-1 devstack@n-api.service[140524]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 17 20:50:55.696013 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'ncdv-master-1'} Sep 17 20:50:55.696013 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:50:55.696797 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:55.696797 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:55.696797 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:55.696797 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:50:55.696797 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:50:55.696797 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:50:55.696797 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:50:55.696797 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:50:55.696797 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:50:55.696797 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Sep 17 20:50:55.696797 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Sep 17 20:50:55.696797 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 17 20:50:55.696797 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 17 20:50:55.696797 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 17 20:50:55.696797 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 17 20:50:55.696797 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:50:55.696797 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:50:55.696797 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:50:55.696797 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:50:55.697909 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 17 20:50:55.697909 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 17 20:50:55.697909 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 17 20:50:55.697909 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 17 20:50:55.697909 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 17 20:50:55.697909 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 17 20:50:55.697909 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 17 20:50:55.697909 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:55.697909 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:55.697909 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:55.697909 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:55.697909 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:55.697909 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:55.697909 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 17 20:50:55.697909 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 17 20:50:55.697909 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 17 20:50:55.697909 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:55.700667 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f675621c-4ab9-41ba-80ec-4a1556984eba tempest-HostsAdminNegativeTestJSON-1385868446 tempest-HostsAdminNegativeTestJSON-1385868446-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:50:55.700667 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f675621c-4ab9-41ba-80ec-4a1556984eba tempest-HostsAdminNegativeTestJSON-1385868446 tempest-HostsAdminNegativeTestJSON-1385868446-project] 10.222.0.26 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.011758 Sep 17 20:50:55.701824 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 115/172] 10.222.0.26 () {58 vars in 1194 bytes} [Sat Sep 17 20:50:55 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:50:55.706544 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1f62a982-7255-4977-91d5-6c125d53f83d tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:55.714398 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1f62a982-7255-4977-91d5-6c125d53f83d tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:55.715090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1f62a982-7255-4977-91d5-6c125d53f83d tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:55.764050 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-02751e5e-3183-4626-8fd9-dff22e284b97 req-eb1e154b-999b-4da5-a81c-c3aa680c4045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07019932-c686-4174-9828-3035fcc1694a", "name": "network-vif-plugged", "status": "completed", "tag": "8d4f5ca3-4a66-4ee2-a709-cc73b8cb7ac3"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:55.776094 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-02751e5e-3183-4626-8fd9-dff22e284b97 req-eb1e154b-999b-4da5-a81c-c3aa680c4045 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:55.776568 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-02751e5e-3183-4626-8fd9-dff22e284b97 req-eb1e154b-999b-4da5-a81c-c3aa680c4045 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:55.777018 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-02751e5e-3183-4626-8fd9-dff22e284b97 req-eb1e154b-999b-4da5-a81c-c3aa680c4045 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:55.783396 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1f62a982-7255-4977-91d5-6c125d53f83d tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/33f1d412d4a44e09b51be3b14530c077" status: 200 len: 329 microversion: 2.1 time: 0.347894 Sep 17 20:50:55.783985 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 58/173] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Sep 17 20:50:55 2022] PUT /compute/v2.1/os-quota-sets/33f1d412d4a44e09b51be3b14530c077 => generated 329 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:55.788932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-317cdc98-f238-4bdc-92ab-826e2ee60d81 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:55.789640 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-317cdc98-f238-4bdc-92ab-826e2ee60d81 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:55.792083 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-02751e5e-3183-4626-8fd9-dff22e284b97 req-eb1e154b-999b-4da5-a81c-c3aa680c4045 service nova] Creating event network-vif-plugged:8d4f5ca3-4a66-4ee2-a709-cc73b8cb7ac3 for instance 07019932-c686-4174-9828-3035fcc1694a on nch2-master-1 Sep 17 20:50:55.792841 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:50:55.798968 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-02751e5e-3183-4626-8fd9-dff22e284b97 req-eb1e154b-999b-4da5-a81c-c3aa680c4045 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095160 Sep 17 20:50:55.799140 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-317cdc98-f238-4bdc-92ab-826e2ee60d81 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:55.799563 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-317cdc98-f238-4bdc-92ab-826e2ee60d81 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:55.800143 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-317cdc98-f238-4bdc-92ab-826e2ee60d81 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:55.800970 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-317cdc98-f238-4bdc-92ab-826e2ee60d81 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:55.801096 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 116/174] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:55.801488 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-317cdc98-f238-4bdc-92ab-826e2ee60d81 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:55.802007 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-317cdc98-f238-4bdc-92ab-826e2ee60d81 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:55.810602 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d79c16f0-1c7e-4449-89e4-bd56c49e4096 tempest-FlavorsExtraSpecsTestJSON-157833883 tempest-FlavorsExtraSpecsTestJSON-157833883-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:55.843464 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d79c16f0-1c7e-4449-89e4-bd56c49e4096 tempest-FlavorsExtraSpecsTestJSON-157833883 tempest-FlavorsExtraSpecsTestJSON-157833883-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/401033111/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.037340 Sep 17 20:50:55.844551 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 117/175] 10.222.0.26 () {60 vars in 1221 bytes} [Sat Sep 17 20:50:55 2022] POST /compute/v2.1/flavors/401033111/os-extra_specs => generated 66 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:50:55.853280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-db380ab5-37ff-4422-bb24-23dbbe09fc97 tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] Calling method '.version_select at 0x7f25a60ff040>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:55.869705 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-db380ab5-37ff-4422-bb24-23dbbe09fc97 tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 17 20:50:55.872252 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-db380ab5-37ff-4422-bb24-23dbbe09fc97 tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] Request method failure captured: Sep 17 20:50:55.872252 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Sep 17 20:50:55.872252 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:50:55.872252 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:50:55.872252 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:50:55.872252 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:50:55.872252 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:50:55.872252 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:50:55.872252 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:50:55.872252 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:50:55.872252 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjMtAZWiZT97RhRtYrm7NWEQPAvQaEm0-Nnyo-dQWcXNAI089iRfXcieXFsce_6E7B13Lb0kiVR4GhulXLY97I87e99xa5vgnupcG4aao1ZSd3o7VJD1uU3pdlKMAWVwehLhQYKIsQWRo4XJl4-VUPHfx1L-V3hxaKsE0BAZKK427_k Sep 17 20:50:55.872252 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:50:55.872252 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:50:55.872252 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:50:55.872252 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:50:55.872252 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:50:55.872252 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:50:55.872252 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 8aafc4a713d94652bd4ee89c1448fc39 Sep 17 20:50:55.872252 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1700771831 Sep 17 20:50:55.872252 ncdv-master-1 devstack@n-api.service[140524]: X-Role: admin,member,reader Sep 17 20:50:55.872252 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: admin,member,reader Sep 17 20:50:55.873661 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8aafc4a713d94652bd4ee89c1448fc39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8aafc4a713d94652bd4ee89c1448fc39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8aafc4a713d94652bd4ee89c1448fc39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8aafc4a713d94652bd4ee89c1448fc39", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:50:55.873661 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1700771831 Sep 17 20:50:55.873661 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 8aafc4a713d94652bd4ee89c1448fc39 Sep 17 20:50:55.873661 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1700771831 Sep 17 20:50:55.873661 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-HostsAdminNegativeTestJSON-1700771831-project-admin Sep 17 20:50:55.873661 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:50:55.873661 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:50:55.873661 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 05052d8e3de14ff19f64a71c8608c064 Sep 17 20:50:55.873661 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1700771831-project-admin Sep 17 20:50:55.873661 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:50:55.873661 ncdv-master-1 devstack@n-api.service[140524]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 17 20:50:55.873661 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'nonexistent_hostname'} Sep 17 20:50:55.873661 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:50:55.874512 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:55.874512 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 17 20:50:55.874512 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 17 20:50:55.874512 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 17 20:50:55.874512 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 17 20:50:55.874512 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:50:55.874512 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:50:55.874512 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:50:55.874512 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:50:55.874512 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 17 20:50:55.874512 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 17 20:50:55.874512 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 17 20:50:55.874512 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 17 20:50:55.874512 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:50:55.874512 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:50:55.874512 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 17 20:50:55.874512 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 17 20:50:55.874512 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 17 20:50:55.874512 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 17 20:50:55.875723 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 17 20:50:55.875723 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 17 20:50:55.875723 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 17 20:50:55.875723 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:55.875723 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:55.875723 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:55.875723 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:55.875723 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:55.875723 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:55.875723 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:50:55.875723 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:50:55.875723 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:50:55.875723 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:50:55.875723 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:50:55.875723 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:50:55.875723 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Sep 17 20:50:55.875723 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Sep 17 20:50:55.875723 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 17 20:50:55.875723 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:50:55.876933 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 17 20:50:55.876933 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:55.876933 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:55.876933 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:55.876933 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:55.876933 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:55.876933 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:55.876933 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:50:55.876933 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:50:55.876933 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 17 20:50:55.876933 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:55.879300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-db380ab5-37ff-4422-bb24-23dbbe09fc97 tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:50:55.880895 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-db380ab5-37ff-4422-bb24-23dbbe09fc97 tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.034118 Sep 17 20:50:55.881691 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 118/176] 10.222.0.26 () {58 vars in 1215 bytes} [Sat Sep 17 20:50:55 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 20:50:55.886570 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-38f124f0-f8a7-4449-bf5b-7905ba0daf58 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Calling method '.version_select at 0x7f25a631c3a0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:56.019023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-317cdc98-f238-4bdc-92ab-826e2ee60d81 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:56.027639 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-317cdc98-f238-4bdc-92ab-826e2ee60d81 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1312 microversion: 2.1 time: 0.242321 Sep 17 20:50:56.029342 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 59/177] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:55 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1312 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:56.035084 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a52a800b-7b02-491f-8d4d-bcf1d14eba3a tempest-FlavorsExtraSpecsTestJSON-1789915181 tempest-FlavorsExtraSpecsTestJSON-1789915181-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:56.045291 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a52a800b-7b02-491f-8d4d-bcf1d14eba3a tempest-FlavorsExtraSpecsTestJSON-1789915181 tempest-FlavorsExtraSpecsTestJSON-1789915181-project] 10.222.0.26 "GET /compute/v2.1/flavors/401033111/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.014713 Sep 17 20:50:56.045887 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 60/178] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Sep 17 20:50:56 2022] GET /compute/v2.1/flavors/401033111/os-extra_specs/hw:numa_nodes => generated 22 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:50:56.050387 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-79ebe81a-98a6-41ec-ade6-a22665933403 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:56.051224 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-79ebe81a-98a6-41ec-ade6-a22665933403 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] [instance: 07019932-c686-4174-9828-3035fcc1694a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:56.058370 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79ebe81a-98a6-41ec-ade6-a22665933403 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:56.058891 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79ebe81a-98a6-41ec-ade6-a22665933403 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:56.059331 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79ebe81a-98a6-41ec-ade6-a22665933403 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:56.060262 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79ebe81a-98a6-41ec-ade6-a22665933403 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:56.061129 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79ebe81a-98a6-41ec-ade6-a22665933403 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:56.062012 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79ebe81a-98a6-41ec-ade6-a22665933403 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:56.216676 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-38f124f0-f8a7-4449-bf5b-7905ba0daf58 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/33f1d412d4a44e09b51be3b14530c077" status: 200 len: 371 microversion: 2.1 time: 0.333545 Sep 17 20:50:56.224402 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 119/179] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Sep 17 20:50:55 2022] GET /compute/v2.1/os-quota-sets/33f1d412d4a44e09b51be3b14530c077 => generated 371 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:56.227028 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c5a457fb-9ada-4bff-b13c-4d84281872ec tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] Action: 'update', calling method: .version_select at 0x7f25a611aee0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:56.253109 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c5a457fb-9ada-4bff-b13c-4d84281872ec tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] Request method failure captured: Sep 17 20:50:56.253109 ncdv-master-1 devstack@n-api.service[140524]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Sep 17 20:50:56.253109 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:50:56.253109 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:50:56.253109 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:50:56.253109 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 51 Sep 17 20:50:56.253109 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:50:56.253109 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:50:56.253109 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:50:56.253109 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:50:56.253109 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjMtAZWiZT97RhRtYrm7NWEQPAvQaEm0-Nnyo-dQWcXNAI089iRfXcieXFsce_6E7B13Lb0kiVR4GhulXLY97I87e99xa5vgnupcG4aao1ZSd3o7VJD1uU3pdlKMAWVwehLhQYKIsQWRo4XJl4-VUPHfx1L-V3hxaKsE0BAZKK427_k Sep 17 20:50:56.253109 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:50:56.253109 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:50:56.253109 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:50:56.253109 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:50:56.253109 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:50:56.253109 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:50:56.253109 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 8aafc4a713d94652bd4ee89c1448fc39 Sep 17 20:50:56.253109 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1700771831 Sep 17 20:50:56.253109 ncdv-master-1 devstack@n-api.service[140524]: X-Role: admin,member,reader Sep 17 20:50:56.253109 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: admin,member,reader Sep 17 20:50:56.254334 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8aafc4a713d94652bd4ee89c1448fc39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8aafc4a713d94652bd4ee89c1448fc39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8aafc4a713d94652bd4ee89c1448fc39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8aafc4a713d94652bd4ee89c1448fc39", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:50:56.254334 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1700771831 Sep 17 20:50:56.254334 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 8aafc4a713d94652bd4ee89c1448fc39 Sep 17 20:50:56.254334 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1700771831 Sep 17 20:50:56.254334 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-HostsAdminNegativeTestJSON-1700771831-project-admin Sep 17 20:50:56.254334 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:50:56.254334 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:50:56.254334 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 05052d8e3de14ff19f64a71c8608c064 Sep 17 20:50:56.254334 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1700771831-project-admin Sep 17 20:50:56.254334 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:50:56.254334 ncdv-master-1 devstack@n-api.service[140524]: {"status": "enable", "maintenance_mode": "invalid"} Sep 17 20:50:56.254334 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:50:56.254334 ncdv-master-1 devstack@n-api.service[140524]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 17 20:50:56.255092 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Sep 17 20:50:56.255092 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:50:56.255092 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:56.255092 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 20:50:56.255092 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 20:50:56.255092 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 20:50:56.255092 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise error Sep 17 20:50:56.255092 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 17 20:50:56.255092 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:56.255092 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Sep 17 20:50:56.255092 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 17 20:50:56.255092 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'disable', Sep 17 20:50:56.255092 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'Enable', Sep 17 20:50:56.255092 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'Disable', Sep 17 20:50:56.255092 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 17 20:50:56.255092 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 17 20:50:56.255092 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 17 20:50:56.255092 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:56.255092 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi On instance: Sep 17 20:50:56.255092 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'invalid' Sep 17 20:50:56.255092 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:56.255092 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:56.255092 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:56.255092 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:56.255092 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:56.256529 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:56.256529 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:50:56.256529 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:50:56.256529 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:50:56.256529 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:50:56.256529 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:50:56.256529 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:50:56.256529 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 20:50:56.256529 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 20:50:56.256529 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 20:50:56.256529 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 20:50:56.256529 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 20:50:56.256529 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 20:50:56.256529 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 17 20:50:56.256529 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:56.256529 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:56.256529 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:56.256529 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:56.256529 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:56.257813 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:56.257813 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 20:50:56.257813 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 20:50:56.257813 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 17 20:50:56.257813 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:56.258154 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-79ebe81a-98a6-41ec-ade6-a22665933403 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05aab669547487d8876a70e338d3e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4ffd27d7414061b67e053657044400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:56.258255 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c5a457fb-9ada-4bff-b13c-4d84281872ec tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:50:56.258600 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c5a457fb-9ada-4bff-b13c-4d84281872ec tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.037949 Sep 17 20:50:56.259201 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 120/180] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Sep 17 20:50:56 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 20:50:56.268438 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-79ebe81a-98a6-41ec-ade6-a22665933403 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] 10.222.0.26 "GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a" status: 200 len: 1338 microversion: 2.1 time: 0.221452 Sep 17 20:50:56.269011 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 61/181] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:56 2022] GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a => generated 1338 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:56.272428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4c24f694-0d50-43e8-bfa1-d32f04646628 tempest-FlavorsExtraSpecsTestJSON-157833883 tempest-FlavorsExtraSpecsTestJSON-157833883-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:56.279740 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f2cdd483-c868-4f88-af40-5319641dd684 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Action: 'update', calling method: .version_select at 0x7f25a5f91820>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:56.317474 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4c24f694-0d50-43e8-bfa1-d32f04646628 tempest-FlavorsExtraSpecsTestJSON-157833883 tempest-FlavorsExtraSpecsTestJSON-157833883-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/401033111/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.055476 Sep 17 20:50:56.324221 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 121/182] 10.222.0.26 () {60 vars in 1221 bytes} [Sat Sep 17 20:50:56 2022] POST /compute/v2.1/flavors/401033111/os-extra_specs => generated 66 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:50:56.332445 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-554f4b29-6109-4a4a-af76-f5e714cb6633 tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] Action: 'update', calling method: .version_select at 0x7f25a62cab80>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:56.358965 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-554f4b29-6109-4a4a-af76-f5e714cb6633 tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] Request method failure captured: Sep 17 20:50:56.358965 ncdv-master-1 devstack@n-api.service[140524]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Sep 17 20:50:56.358965 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:50:56.358965 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:50:56.358965 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:50:56.358965 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 51 Sep 17 20:50:56.358965 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:50:56.358965 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:50:56.358965 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:50:56.358965 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:50:56.358965 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjMtAZWiZT97RhRtYrm7NWEQPAvQaEm0-Nnyo-dQWcXNAI089iRfXcieXFsce_6E7B13Lb0kiVR4GhulXLY97I87e99xa5vgnupcG4aao1ZSd3o7VJD1uU3pdlKMAWVwehLhQYKIsQWRo4XJl4-VUPHfx1L-V3hxaKsE0BAZKK427_k Sep 17 20:50:56.358965 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:50:56.358965 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:50:56.358965 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:50:56.358965 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:50:56.358965 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:50:56.358965 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:50:56.358965 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 8aafc4a713d94652bd4ee89c1448fc39 Sep 17 20:50:56.358965 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1700771831 Sep 17 20:50:56.358965 ncdv-master-1 devstack@n-api.service[140524]: X-Role: admin,member,reader Sep 17 20:50:56.358965 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: admin,member,reader Sep 17 20:50:56.360141 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8aafc4a713d94652bd4ee89c1448fc39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8aafc4a713d94652bd4ee89c1448fc39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8aafc4a713d94652bd4ee89c1448fc39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8aafc4a713d94652bd4ee89c1448fc39", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:50:56.360141 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1700771831 Sep 17 20:50:56.360141 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 8aafc4a713d94652bd4ee89c1448fc39 Sep 17 20:50:56.360141 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1700771831 Sep 17 20:50:56.360141 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-HostsAdminNegativeTestJSON-1700771831-project-admin Sep 17 20:50:56.360141 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:50:56.360141 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:50:56.360141 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 05052d8e3de14ff19f64a71c8608c064 Sep 17 20:50:56.360141 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1700771831-project-admin Sep 17 20:50:56.360141 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:50:56.360141 ncdv-master-1 devstack@n-api.service[140524]: {"status": "invalid", "maintenance_mode": "enable"} Sep 17 20:50:56.360141 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:50:56.360141 ncdv-master-1 devstack@n-api.service[140524]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 17 20:50:56.361149 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Sep 17 20:50:56.361149 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:50:56.361149 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:56.361149 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 20:50:56.361149 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 20:50:56.361149 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 20:50:56.361149 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise error Sep 17 20:50:56.361149 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 17 20:50:56.361149 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:56.361149 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Sep 17 20:50:56.361149 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 17 20:50:56.361149 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'disable', Sep 17 20:50:56.361149 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'Enable', Sep 17 20:50:56.361149 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'Disable', Sep 17 20:50:56.361149 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 17 20:50:56.361149 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 17 20:50:56.361149 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 17 20:50:56.361149 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:56.361149 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi On instance: Sep 17 20:50:56.361149 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'invalid' Sep 17 20:50:56.361149 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:56.361149 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:56.361149 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:56.361149 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:56.361149 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:56.364505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:56.364505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:50:56.364505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:50:56.364505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:50:56.364505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:50:56.364505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:50:56.364505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:50:56.364505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 20:50:56.364505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 20:50:56.364505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 20:50:56.364505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 20:50:56.364505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 20:50:56.364505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 20:50:56.364505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 17 20:50:56.364505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:56.364505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:56.364505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:56.364505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:56.364505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:56.366504 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:56.366504 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 20:50:56.366504 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 20:50:56.366504 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 17 20:50:56.366504 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:56.375638 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-554f4b29-6109-4a4a-af76-f5e714cb6633 tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:50:56.380549 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-554f4b29-6109-4a4a-af76-f5e714cb6633 tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.053584 Sep 17 20:50:56.381554 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 122/183] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Sep 17 20:50:56 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 20:50:56.393411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-43c111e3-da71-4840-9643-96a22cc4eb2e tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:56.396347 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-43c111e3-da71-4840-9643-96a22cc4eb2e tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:56.414377 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43c111e3-da71-4840-9643-96a22cc4eb2e tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:56.414891 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43c111e3-da71-4840-9643-96a22cc4eb2e tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:56.415363 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43c111e3-da71-4840-9643-96a22cc4eb2e tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:56.416090 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43c111e3-da71-4840-9643-96a22cc4eb2e tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:56.416541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43c111e3-da71-4840-9643-96a22cc4eb2e tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:56.417453 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43c111e3-da71-4840-9643-96a22cc4eb2e tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:56.469357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2cdd483-c868-4f88-af40-5319641dd684 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:56.470510 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2cdd483-c868-4f88-af40-5319641dd684 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:56.471091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2cdd483-c868-4f88-af40-5319641dd684 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:56.473007 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2cdd483-c868-4f88-af40-5319641dd684 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:56.473586 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2cdd483-c868-4f88-af40-5319641dd684 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:56.474830 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2cdd483-c868-4f88-af40-5319641dd684 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:56.541179 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f2cdd483-c868-4f88-af40-5319641dd684 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/33f1d412d4a44e09b51be3b14530c077" status: 200 len: 325 microversion: 2.1 time: 0.267112 Sep 17 20:50:56.557709 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 62/184] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Sep 17 20:50:56 2022] PUT /compute/v2.1/os-quota-sets/33f1d412d4a44e09b51be3b14530c077 => generated 325 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:56.564936 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-af0f4f34-a2d4-48de-a032-4751e2a0a0d2 tempest-FlavorsExtraSpecsTestJSON-157833883 tempest-FlavorsExtraSpecsTestJSON-157833883-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:56.574412 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-af0f4f34-a2d4-48de-a032-4751e2a0a0d2 tempest-FlavorsExtraSpecsTestJSON-157833883 tempest-FlavorsExtraSpecsTestJSON-157833883-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/401033111/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.014915 Sep 17 20:50:56.575607 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 63/185] 10.222.0.26 () {58 vars in 1200 bytes} [Sat Sep 17 20:50:56 2022] GET /compute/v2.1/flavors/401033111/os-extra_specs => generated 66 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:50:56.584077 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e567c55e-adcd-4366-84ac-d73c5a054223 tempest-HostsAdminNegativeTestJSON-1385868446 tempest-HostsAdminNegativeTestJSON-1385868446-project] Action: 'update', calling method: .version_select at 0x7f25a5faa790>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:56.591134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e567c55e-adcd-4366-84ac-d73c5a054223 tempest-HostsAdminNegativeTestJSON-1385868446 tempest-HostsAdminNegativeTestJSON-1385868446-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'f9354d166ad84d42b03e222288d5a717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0daa58ea49e4b2dbf7a2081940572cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:56.593013 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e567c55e-adcd-4366-84ac-d73c5a054223 tempest-HostsAdminNegativeTestJSON-1385868446 tempest-HostsAdminNegativeTestJSON-1385868446-project] Request method failure captured: Sep 17 20:50:56.593013 ncdv-master-1 devstack@n-api.service[140523]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Sep 17 20:50:56.593013 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:50:56.593013 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:50:56.593013 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:50:56.593013 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 50 Sep 17 20:50:56.593013 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:50:56.593013 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:50:56.593013 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:50:56.593013 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:50:56.593013 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjMrx_qKdTqSTZVtkd8B37P2-rPoTdql8_Qj991wxY0kB-i3SIXr52KOiRnXKuDM4w5boVS603R80UiBDw-yc1uxUcdfcsW0U1klrz9LPV9EPpBF8ZznfF9NWjvfOTkUu76Gu2NEJJxnhG7EniVs6qjy-vFF0PEwzcSLbKBvXQNY3EA Sep 17 20:50:56.593013 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:50:56.593013 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:50:56.593013 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:50:56.593013 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:50:56.593013 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:50:56.593013 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:50:56.593013 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: e0daa58ea49e4b2dbf7a2081940572cc Sep 17 20:50:56.593013 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1385868446 Sep 17 20:50:56.593013 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:50:56.593013 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:50:56.594228 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e0daa58ea49e4b2dbf7a2081940572cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e0daa58ea49e4b2dbf7a2081940572cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e0daa58ea49e4b2dbf7a2081940572cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e0daa58ea49e4b2dbf7a2081940572cc", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:50:56.594228 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1385868446 Sep 17 20:50:56.594228 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: e0daa58ea49e4b2dbf7a2081940572cc Sep 17 20:50:56.594228 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1385868446 Sep 17 20:50:56.594228 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-HostsAdminNegativeTestJSON-1385868446-project Sep 17 20:50:56.594228 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:50:56.594228 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:50:56.594228 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: f9354d166ad84d42b03e222288d5a717 Sep 17 20:50:56.594228 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1385868446-project Sep 17 20:50:56.594228 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 20:50:56.594228 ncdv-master-1 devstack@n-api.service[140523]: {"status": "enable", "maintenance_mode": "enable"} Sep 17 20:50:56.594228 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 20:50:56.594228 ncdv-master-1 devstack@n-api.service[140523]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 17 20:50:56.594228 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'ncdv-master-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 17 20:50:56.594991 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:50:56.594991 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:56.594991 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:56.594991 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:56.594991 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:50:56.594991 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:50:56.594991 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:50:56.594991 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:50:56.594991 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:50:56.594991 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:50:56.594991 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:50:56.594991 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:50:56.594991 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Sep 17 20:50:56.594991 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Sep 17 20:50:56.594991 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 17 20:50:56.594991 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 17 20:50:56.594991 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 17 20:50:56.594991 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 17 20:50:56.594991 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:50:56.594991 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:50:56.596050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:50:56.596050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:50:56.596050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 17 20:50:56.596050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 17 20:50:56.596050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 17 20:50:56.596050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 17 20:50:56.596050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 17 20:50:56.596050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 17 20:50:56.596050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 17 20:50:56.596050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:56.596050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:56.596050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:56.596050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:56.596050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:56.596050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:56.596050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 17 20:50:56.596050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 17 20:50:56.596050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 17 20:50:56.596050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:56.597070 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e567c55e-adcd-4366-84ac-d73c5a054223 tempest-HostsAdminNegativeTestJSON-1385868446 tempest-HostsAdminNegativeTestJSON-1385868446-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:50:56.597070 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e567c55e-adcd-4366-84ac-d73c5a054223 tempest-HostsAdminNegativeTestJSON-1385868446 tempest-HostsAdminNegativeTestJSON-1385868446-project] 10.222.0.26 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.017697 Sep 17 20:50:56.597070 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 64/186] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Sep 17 20:50:56 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:50:56.602802 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-917dedf4-2549-4d07-a865-28cce9634da4 tempest-FlavorsExtraSpecsTestJSON-157833883 tempest-FlavorsExtraSpecsTestJSON-157833883-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:56.650509 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-917dedf4-2549-4d07-a865-28cce9634da4 tempest-FlavorsExtraSpecsTestJSON-157833883 tempest-FlavorsExtraSpecsTestJSON-157833883-project-admin] 10.222.0.26 "PUT /compute/v2.1/flavors/401033111/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.053445 Sep 17 20:50:56.654085 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 65/187] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Sep 17 20:50:56 2022] PUT /compute/v2.1/flavors/401033111/os-extra_specs/hw:numa_nodes => generated 22 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:50:56.669554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b074755f-5836-4ec4-aba3-ab1b200be422 tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] Action: 'update', calling method: .version_select at 0x7f25a5faa4c0>, body: {"status": null, "maintenance_mode": null} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:56.677004 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b074755f-5836-4ec4-aba3-ab1b200be422 tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] Request method failure captured: Sep 17 20:50:56.677004 ncdv-master-1 devstack@n-api.service[140523]: request: PUT /compute/v2.1/os-hosts/ncdv-master-1 HTTP/1.1 Sep 17 20:50:56.677004 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:50:56.677004 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:50:56.677004 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:50:56.677004 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 42 Sep 17 20:50:56.677004 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:50:56.677004 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:50:56.677004 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:50:56.677004 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:50:56.677004 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjMtAZWiZT97RhRtYrm7NWEQPAvQaEm0-Nnyo-dQWcXNAI089iRfXcieXFsce_6E7B13Lb0kiVR4GhulXLY97I87e99xa5vgnupcG4aao1ZSd3o7VJD1uU3pdlKMAWVwehLhQYKIsQWRo4XJl4-VUPHfx1L-V3hxaKsE0BAZKK427_k Sep 17 20:50:56.677004 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:50:56.677004 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:50:56.677004 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:50:56.677004 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:50:56.677004 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:50:56.677004 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:50:56.677004 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 8aafc4a713d94652bd4ee89c1448fc39 Sep 17 20:50:56.677004 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1700771831 Sep 17 20:50:56.677004 ncdv-master-1 devstack@n-api.service[140523]: X-Role: admin,member,reader Sep 17 20:50:56.677004 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: admin,member,reader Sep 17 20:50:56.678316 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8aafc4a713d94652bd4ee89c1448fc39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8aafc4a713d94652bd4ee89c1448fc39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8aafc4a713d94652bd4ee89c1448fc39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8aafc4a713d94652bd4ee89c1448fc39", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:50:56.678316 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1700771831 Sep 17 20:50:56.678316 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 8aafc4a713d94652bd4ee89c1448fc39 Sep 17 20:50:56.678316 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1700771831 Sep 17 20:50:56.678316 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-HostsAdminNegativeTestJSON-1700771831-project-admin Sep 17 20:50:56.678316 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:50:56.678316 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:50:56.678316 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 05052d8e3de14ff19f64a71c8608c064 Sep 17 20:50:56.678316 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1700771831-project-admin Sep 17 20:50:56.678316 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 20:50:56.678316 ncdv-master-1 devstack@n-api.service[140523]: {"status": null, "maintenance_mode": null} Sep 17 20:50:56.678316 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 20:50:56.678316 ncdv-master-1 devstack@n-api.service[140523]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 17 20:50:56.678316 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'ncdv-master-1', 'body': {'status': None, 'maintenance_mode': None}} Sep 17 20:50:56.679067 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:50:56.679067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:56.679067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 20:50:56.679067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 20:50:56.679067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 20:50:56.679067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise error Sep 17 20:50:56.679067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Sep 17 20:50:56.679067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:56.679067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Sep 17 20:50:56.679067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 17 20:50:56.679067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi 'disable', Sep 17 20:50:56.679067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi 'Enable', Sep 17 20:50:56.679067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi 'Disable', Sep 17 20:50:56.679067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 17 20:50:56.679067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 17 20:50:56.679067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 17 20:50:56.679067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:56.679067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi On instance: Sep 17 20:50:56.679067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi None Sep 17 20:50:56.679067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:56.679067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:56.679067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:56.679067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:56.679067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:56.679067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:56.681072 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:50:56.681072 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:50:56.681072 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:50:56.681072 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:50:56.681072 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:50:56.681072 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:50:56.681072 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 20:50:56.681072 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 20:50:56.681072 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 20:50:56.681072 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 20:50:56.681072 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 20:50:56.681072 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 20:50:56.681072 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 17 20:50:56.681072 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:56.681072 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:56.681072 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:56.681072 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:56.681072 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:56.681072 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:56.683463 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 20:50:56.683463 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 20:50:56.683463 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 17 20:50:56.683463 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:56.683463 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b074755f-5836-4ec4-aba3-ab1b200be422 tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:50:56.686808 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b074755f-5836-4ec4-aba3-ab1b200be422 tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.023365 Sep 17 20:50:56.692183 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 66/188] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Sep 17 20:50:56 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 20:50:56.702530 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5dd7be5c-b0ac-44ee-b00c-b099ac4a05e8 tempest-FlavorsExtraSpecsTestJSON-157833883 tempest-FlavorsExtraSpecsTestJSON-157833883-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:56.705317 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-43c111e3-da71-4840-9643-96a22cc4eb2e tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8bfe1d590a4500b7e7b5c79a6a4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea88200545ae4003b42b0d475f482c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:56.708945 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:50:56.711307 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5dd7be5c-b0ac-44ee-b00c-b099ac4a05e8 tempest-FlavorsExtraSpecsTestJSON-157833883 tempest-FlavorsExtraSpecsTestJSON-157833883-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/401033111/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.014009 Sep 17 20:50:56.712461 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 67/189] 10.222.0.26 () {58 vars in 1200 bytes} [Sat Sep 17 20:50:56 2022] GET /compute/v2.1/flavors/401033111/os-extra_specs => generated 66 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:50:56.717827 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d88b1229-72c8-44db-9fd9-0b55232ff674 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1078661158", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:56.721071 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-43c111e3-da71-4840-9643-96a22cc4eb2e tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] 10.222.0.26 "GET /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c" status: 200 len: 1320 microversion: 2.1 time: 0.338416 Sep 17 20:50:56.732709 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 123/190] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:56 2022] GET /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c => generated 1320 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:56.742895 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f445f1f2-4bb8-41a9-8dae-2d4ae28e5924 tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] Action: 'update', calling method: .version_select at 0x7f25a611a4c0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:56.746750 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.hosts [None req-f445f1f2-4bb8-41a9-8dae-2d4ae28e5924 tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] Enabling host nonexistent_hostname. Sep 17 20:50:56.756043 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-f445f1f2-4bb8-41a9-8dae-2d4ae28e5924 tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 17 20:50:56.758082 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f445f1f2-4bb8-41a9-8dae-2d4ae28e5924 tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] Request method failure captured: Sep 17 20:50:56.758082 ncdv-master-1 devstack@n-api.service[140524]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 17 20:50:56.758082 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:50:56.758082 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:50:56.758082 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:50:56.758082 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 50 Sep 17 20:50:56.758082 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:50:56.758082 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:50:56.758082 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:50:56.758082 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:50:56.758082 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjMtAZWiZT97RhRtYrm7NWEQPAvQaEm0-Nnyo-dQWcXNAI089iRfXcieXFsce_6E7B13Lb0kiVR4GhulXLY97I87e99xa5vgnupcG4aao1ZSd3o7VJD1uU3pdlKMAWVwehLhQYKIsQWRo4XJl4-VUPHfx1L-V3hxaKsE0BAZKK427_k Sep 17 20:50:56.758082 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:50:56.758082 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:50:56.758082 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:50:56.758082 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:50:56.758082 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:50:56.758082 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:50:56.758082 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 8aafc4a713d94652bd4ee89c1448fc39 Sep 17 20:50:56.758082 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1700771831 Sep 17 20:50:56.758082 ncdv-master-1 devstack@n-api.service[140524]: X-Role: admin,member,reader Sep 17 20:50:56.758082 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: admin,member,reader Sep 17 20:50:56.759488 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8aafc4a713d94652bd4ee89c1448fc39"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8aafc4a713d94652bd4ee89c1448fc39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8aafc4a713d94652bd4ee89c1448fc39"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8aafc4a713d94652bd4ee89c1448fc39", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:50:56.759488 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1700771831 Sep 17 20:50:56.759488 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 8aafc4a713d94652bd4ee89c1448fc39 Sep 17 20:50:56.759488 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1700771831 Sep 17 20:50:56.759488 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-HostsAdminNegativeTestJSON-1700771831-project-admin Sep 17 20:50:56.759488 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:50:56.759488 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:50:56.759488 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 05052d8e3de14ff19f64a71c8608c064 Sep 17 20:50:56.759488 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1700771831-project-admin Sep 17 20:50:56.759488 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:50:56.759488 ncdv-master-1 devstack@n-api.service[140524]: {"status": "enable", "maintenance_mode": "enable"} Sep 17 20:50:56.759488 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:50:56.759488 ncdv-master-1 devstack@n-api.service[140524]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 17 20:50:56.759488 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 17 20:50:56.760405 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:50:56.760405 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:56.760405 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Sep 17 20:50:56.760405 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Sep 17 20:50:56.760405 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 17 20:50:56.760405 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 17 20:50:56.760405 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:50:56.760405 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:50:56.760405 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:50:56.760405 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:50:56.760405 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 17 20:50:56.760405 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 17 20:50:56.760405 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 17 20:50:56.760405 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 17 20:50:56.760405 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:50:56.760405 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:50:56.760405 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 17 20:50:56.760405 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 17 20:50:56.761663 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 17 20:50:56.761663 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 17 20:50:56.761663 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 17 20:50:56.761663 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 17 20:50:56.761663 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 17 20:50:56.761663 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:56.761663 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:56.761663 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:56.761663 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:56.761663 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:56.761663 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:56.761663 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:50:56.761663 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:50:56.761663 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:50:56.761663 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:50:56.761663 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:50:56.761663 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:50:56.761663 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:50:56.761663 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:50:56.761663 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Sep 17 20:50:56.764037 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Sep 17 20:50:56.764037 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Sep 17 20:50:56.764037 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:50:56.764037 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 17 20:50:56.764037 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:56.764037 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:56.764037 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:56.764037 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:56.764037 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:56.764037 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:56.764037 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:50:56.764037 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:50:56.764037 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 17 20:50:56.764037 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:56.764037 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f445f1f2-4bb8-41a9-8dae-2d4ae28e5924 tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:50:56.765264 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f445f1f2-4bb8-41a9-8dae-2d4ae28e5924 tempest-HostsAdminNegativeTestJSON-1700771831 tempest-HostsAdminNegativeTestJSON-1700771831-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.025243 Sep 17 20:50:56.765264 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 124/191] 10.222.0.26 () {60 vars in 1211 bytes} [Sat Sep 17 20:50:56 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 20:50:56.774311 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a3cbd204-0597-4585-bc2d-ca923917f70d tempest-FlavorsExtraSpecsTestJSON-157833883 tempest-FlavorsExtraSpecsTestJSON-157833883-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:56.788092 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-d88b1229-72c8-44db-9fd9-0b55232ff674 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] validate_networks() for None {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:50:56.830437 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a3cbd204-0597-4585-bc2d-ca923917f70d tempest-FlavorsExtraSpecsTestJSON-157833883 tempest-FlavorsExtraSpecsTestJSON-157833883-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/401033111/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.067613 Sep 17 20:50:56.834115 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 125/192] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Sep 17 20:50:56 2022] DELETE /compute/v2.1/flavors/401033111/os-extra_specs/hw:numa_nodes => generated 0 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 17 20:50:56.843653 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7a6eb1a6-d806-40df-ad12-56d2ac0bc0a6 tempest-FlavorsExtraSpecsTestJSON-157833883 tempest-FlavorsExtraSpecsTestJSON-157833883-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:56.876081 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7a6eb1a6-d806-40df-ad12-56d2ac0bc0a6 tempest-FlavorsExtraSpecsTestJSON-157833883 tempest-FlavorsExtraSpecsTestJSON-157833883-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/401033111/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.039749 Sep 17 20:50:56.876757 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 126/193] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Sep 17 20:50:56 2022] DELETE /compute/v2.1/flavors/401033111/os-extra_specs/hw:cpu_policy => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 17 20:50:56.886696 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-67405ca0-3524-4eb9-b902-9fb9c099614a tempest-FlavorsExtraSpecsTestJSON-157833883 tempest-FlavorsExtraSpecsTestJSON-157833883-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:56.895283 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-67405ca0-3524-4eb9-b902-9fb9c099614a tempest-FlavorsExtraSpecsTestJSON-157833883 tempest-FlavorsExtraSpecsTestJSON-157833883-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/401033111/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013364 Sep 17 20:50:56.895859 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 127/194] 10.222.0.26 () {58 vars in 1200 bytes} [Sat Sep 17 20:50:56 2022] GET /compute/v2.1/flavors/401033111/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 17 20:50:56.910292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b17fe148-6ed0-45ac-be3f-7b74d65e01b8 tempest-FlavorsExtraSpecsTestJSON-157833883 tempest-FlavorsExtraSpecsTestJSON-157833883-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:56.937166 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b17fe148-6ed0-45ac-be3f-7b74d65e01b8 tempest-FlavorsExtraSpecsTestJSON-157833883 tempest-FlavorsExtraSpecsTestJSON-157833883-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/401033111" status: 202 len: 0 microversion: 2.1 time: 0.033574 Sep 17 20:50:56.941605 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 128/195] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Sep 17 20:50:56 2022] DELETE /compute/v2.1/flavors/401033111 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 17 20:50:56.952104 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-11e74c44-d53a-4751-a874-d34656c1c897 tempest-FlavorsExtraSpecsTestJSON-157833883 tempest-FlavorsExtraSpecsTestJSON-157833883-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:56.998826 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-11e74c44-d53a-4751-a874-d34656c1c897 tempest-FlavorsExtraSpecsTestJSON-157833883 tempest-FlavorsExtraSpecsTestJSON-157833883-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053938 Sep 17 20:50:57.006064 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 129/196] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:50:56 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:57.053327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ede34728-d5b7-4113-a106-db08df057d0d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:57.055225 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ede34728-d5b7-4113-a106-db08df057d0d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:57.058463 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-d88b1229-72c8-44db-9fd9-0b55232ff674 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:50:57.058895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-d88b1229-72c8-44db-9fd9-0b55232ff674 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:50:57.059373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-d88b1229-72c8-44db-9fd9-0b55232ff674 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:50:57.059944 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-d88b1229-72c8-44db-9fd9-0b55232ff674 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:50:57.060519 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-d88b1229-72c8-44db-9fd9-0b55232ff674 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:50:57.067553 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ede34728-d5b7-4113-a106-db08df057d0d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:57.068958 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ede34728-d5b7-4113-a106-db08df057d0d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:57.069679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ede34728-d5b7-4113-a106-db08df057d0d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:57.070603 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d88b1229-72c8-44db-9fd9-0b55232ff674 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:57.070984 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ede34728-d5b7-4113-a106-db08df057d0d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:57.071089 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d88b1229-72c8-44db-9fd9-0b55232ff674 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:57.071515 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d88b1229-72c8-44db-9fd9-0b55232ff674 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:57.071960 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ede34728-d5b7-4113-a106-db08df057d0d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:57.072250 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d88b1229-72c8-44db-9fd9-0b55232ff674 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:57.072826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ede34728-d5b7-4113-a106-db08df057d0d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:57.072946 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d88b1229-72c8-44db-9fd9-0b55232ff674 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:57.073284 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d88b1229-72c8-44db-9fd9-0b55232ff674 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:57.091013 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-d88b1229-72c8-44db-9fd9-0b55232ff674 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Getting quotas for project 33f1d412d4a44e09b51be3b14530c077. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:50:57.095021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-d88b1229-72c8-44db-9fd9-0b55232ff674 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Getting quotas for user ee3d8ef713bd4844833d9374766452d8 and project 33f1d412d4a44e09b51be3b14530c077. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:50:57.106183 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.utils [None req-d88b1229-72c8-44db-9fd9-0b55232ff674 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] ram quota exceeded for 33f1d412d4a44e09b51be3b14530c077, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=140523) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 17 20:50:57.106749 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-d88b1229-72c8-44db-9fd9-0b55232ff674 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 17 20:50:57.114692 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d88b1229-72c8-44db-9fd9-0b55232ff674 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Request method failure captured: Sep 17 20:50:57.114692 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 17 20:50:57.114692 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:50:57.114692 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:50:57.114692 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:50:57.114692 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 145 Sep 17 20:50:57.114692 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:50:57.114692 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:50:57.114692 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:50:57.114692 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:50:57.114692 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjMorfY1IaiX_nlTF6-vfKrPRniweyxQdL_zIcWo2OcbyQiD0zsaGsEjbIIe5O_NaKtXwkJ9VyZi7i6yxrmHR7zeW9tUXd1NG0qNXbk8wBk4T0D0PmtSzZTJtxK03nF8LrFHR21GbWXSXR5rU9QKKKG9KDMJuIdu6EG5PuLWF2Aiyog Sep 17 20:50:57.114692 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:50:57.114692 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:50:57.114692 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:50:57.114692 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:50:57.114692 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:50:57.114692 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:50:57.114692 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 33f1d412d4a44e09b51be3b14530c077 Sep 17 20:50:57.114692 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-QuotasAdminNegativeTest-734910182 Sep 17 20:50:57.114692 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:50:57.114692 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:50:57.116411 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/33f1d412d4a44e09b51be3b14530c077"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/33f1d412d4a44e09b51be3b14530c077"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/33f1d412d4a44e09b51be3b14530c077"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_33f1d412d4a44e09b51be3b14530c077", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:50:57.116411 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-QuotasAdminNegativeTest-734910182 Sep 17 20:50:57.116411 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 33f1d412d4a44e09b51be3b14530c077 Sep 17 20:50:57.116411 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-734910182 Sep 17 20:50:57.116411 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-QuotasAdminNegativeTest-734910182-project Sep 17 20:50:57.116411 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:50:57.116411 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:50:57.116411 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: ee3d8ef713bd4844833d9374766452d8 Sep 17 20:50:57.116411 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-QuotasAdminNegativeTest-734910182-project Sep 17 20:50:57.116411 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 20:50:57.116411 ncdv-master-1 devstack@n-api.service[140523]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1078661158", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452"}} Sep 17 20:50:57.116411 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:50:57.117168 ncdv-master-1 devstack@n-api.service[140523]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 17 20:50:57.117168 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1078661158', 'imageRef': '1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4', 'flavorRef': '452'}}} Sep 17 20:50:57.117168 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:50:57.117168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:57.117168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 17 20:50:57.117168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 17 20:50:57.117168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:50:57.117168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:50:57.117168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 17 20:50:57.117168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc Sep 17 20:50:57.117168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 17 20:50:57.117168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 17 20:50:57.117168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:50:57.117168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:50:57.117168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 17 20:50:57.117168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 17 20:50:57.117168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 17 20:50:57.117168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 17 20:50:57.118376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 17 20:50:57.118376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 17 20:50:57.118376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 17 20:50:57.118376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:57.118376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:57.118376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:57.118376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:57.118376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 17 20:50:57.118376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 17 20:50:57.118376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 17 20:50:57.118376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 17 20:50:57.118376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 17 20:50:57.118376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 17 20:50:57.118376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 17 20:50:57.118376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 17 20:50:57.118376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 17 20:50:57.118376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 17 20:50:57.118376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 17 20:50:57.118376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:57.118376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:57.118376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:57.119753 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:57.119753 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:57.119753 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:57.119753 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:50:57.119753 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:50:57.119753 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:50:57.119753 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:50:57.119753 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:50:57.119753 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:50:57.119753 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:50:57.119753 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:50:57.119753 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:50:57.119753 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:50:57.119753 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 17 20:50:57.119753 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 17 20:50:57.119753 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 17 20:50:57.119753 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 17 20:50:57.119753 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:57.119753 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:57.119753 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:57.119753 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:57.121212 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:57.121212 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:57.121212 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:50:57.121212 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:50:57.121212 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 17 20:50:57.121212 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:50:57.121212 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d88b1229-72c8-44db-9fd9-0b55232ff674 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:50:57.121212 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d88b1229-72c8-44db-9fd9-0b55232ff674 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.402611 Sep 17 20:50:57.121212 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 68/197] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:50:56 2022] POST /compute/v2.1/servers => generated 110 bytes in 404 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:50:57.125072 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a877180c-658b-44bd-9eac-0a5e7071b2d2 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Action: 'update', calling method: .version_select at 0x7f25a5f91d30>, body: {"quota_set": {"ram": 51200}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:57.229042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ede34728-d5b7-4113-a106-db08df057d0d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:57.236926 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ede34728-d5b7-4113-a106-db08df057d0d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1312 microversion: 2.1 time: 0.187999 Sep 17 20:50:57.243597 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 130/198] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:57 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1312 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:50:57.293890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-002af3ee-4d07-416e-b483-81179e531df9 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:57.294735 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-002af3ee-4d07-416e-b483-81179e531df9 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] [instance: 07019932-c686-4174-9828-3035fcc1694a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:57.301622 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-002af3ee-4d07-416e-b483-81179e531df9 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:57.302047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-002af3ee-4d07-416e-b483-81179e531df9 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:57.302860 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-002af3ee-4d07-416e-b483-81179e531df9 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:57.303563 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-002af3ee-4d07-416e-b483-81179e531df9 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:57.304190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-002af3ee-4d07-416e-b483-81179e531df9 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:57.304631 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-002af3ee-4d07-416e-b483-81179e531df9 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:57.531654 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-002af3ee-4d07-416e-b483-81179e531df9 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05aab669547487d8876a70e338d3e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4ffd27d7414061b67e053657044400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:57.544818 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-002af3ee-4d07-416e-b483-81179e531df9 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] 10.222.0.26 "GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a" status: 200 len: 1338 microversion: 2.1 time: 0.255686 Sep 17 20:50:57.545176 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 131/199] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:57 2022] GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a => generated 1338 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:50:57.731345 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a877180c-658b-44bd-9eac-0a5e7071b2d2 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:57.733246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a877180c-658b-44bd-9eac-0a5e7071b2d2 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:57.734957 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a877180c-658b-44bd-9eac-0a5e7071b2d2 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:57.739049 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a877180c-658b-44bd-9eac-0a5e7071b2d2 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:57.739703 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a877180c-658b-44bd-9eac-0a5e7071b2d2 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:57.740442 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a877180c-658b-44bd-9eac-0a5e7071b2d2 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:57.744055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2c32f43e-3e0f-4eaa-b2e2-3936ff03af0f tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:57.744743 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2c32f43e-3e0f-4eaa-b2e2-3936ff03af0f tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:57.749144 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=76,nova_api:DELETE=6,nova_api:SAVEPOINT=7,nova_api:RELEASE=7 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:50:57.760998 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c32f43e-3e0f-4eaa-b2e2-3936ff03af0f tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:57.763153 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c32f43e-3e0f-4eaa-b2e2-3936ff03af0f tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:57.764014 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c32f43e-3e0f-4eaa-b2e2-3936ff03af0f tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:57.767397 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c32f43e-3e0f-4eaa-b2e2-3936ff03af0f tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:57.769364 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c32f43e-3e0f-4eaa-b2e2-3936ff03af0f tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:57.770668 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c32f43e-3e0f-4eaa-b2e2-3936ff03af0f tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:57.872020 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a877180c-658b-44bd-9eac-0a5e7071b2d2 tempest-QuotasAdminNegativeTest-1218234253 tempest-QuotasAdminNegativeTest-1218234253-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/33f1d412d4a44e09b51be3b14530c077" status: 200 len: 329 microversion: 2.1 time: 0.750512 Sep 17 20:50:57.874671 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 69/200] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Sep 17 20:50:57 2022] PUT /compute/v2.1/os-quota-sets/33f1d412d4a44e09b51be3b14530c077 => generated 329 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:57.884990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-74f21657-a6bc-43ac-a375-9b0d13bbcc73 req-7c34108a-2cce-49fc-9e44-e6395d2b348d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63955de3-b0fa-4f96-a2db-26ae995db228", "name": "network-vif-plugged", "status": "completed", "tag": "17d8bcdf-2e72-4ea0-a129-6fda20d5053a"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:57.929374 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-74f21657-a6bc-43ac-a375-9b0d13bbcc73 req-7c34108a-2cce-49fc-9e44-e6395d2b348d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:57.931645 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-74f21657-a6bc-43ac-a375-9b0d13bbcc73 req-7c34108a-2cce-49fc-9e44-e6395d2b348d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:57.932441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-74f21657-a6bc-43ac-a375-9b0d13bbcc73 req-7c34108a-2cce-49fc-9e44-e6395d2b348d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:58.006033 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-74f21657-a6bc-43ac-a375-9b0d13bbcc73 req-7c34108a-2cce-49fc-9e44-e6395d2b348d service nova] Creating event network-vif-plugged:17d8bcdf-2e72-4ea0-a129-6fda20d5053a for instance 63955de3-b0fa-4f96-a2db-26ae995db228 on nch1-master-1 Sep 17 20:50:58.007011 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-74f21657-a6bc-43ac-a375-9b0d13bbcc73 req-7c34108a-2cce-49fc-9e44-e6395d2b348d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=140523) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 17 20:50:58.011743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-74f21657-a6bc-43ac-a375-9b0d13bbcc73 req-7c34108a-2cce-49fc-9e44-e6395d2b348d service nova] Acquired lock "compute-rpcapi-router" {{(pid=140523) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 17 20:50:58.013143 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-899edfa7-b01d-4522-8cf9-a1d84aa9c57e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:58.014927 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-899edfa7-b01d-4522-8cf9-a1d84aa9c57e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:58.015391 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-899edfa7-b01d-4522-8cf9-a1d84aa9c57e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:58.016154 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-899edfa7-b01d-4522-8cf9-a1d84aa9c57e None None] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:58.016488 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2c32f43e-3e0f-4eaa-b2e2-3936ff03af0f tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8bfe1d590a4500b7e7b5c79a6a4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea88200545ae4003b42b0d475f482c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:58.017832 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-899edfa7-b01d-4522-8cf9-a1d84aa9c57e None None] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:58.023397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-899edfa7-b01d-4522-8cf9-a1d84aa9c57e None None] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:58.025559 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2c32f43e-3e0f-4eaa-b2e2-3936ff03af0f tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] 10.222.0.26 "GET /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c" status: 200 len: 1320 microversion: 2.1 time: 0.285609 Sep 17 20:50:58.053646 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 132/201] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:57 2022] GET /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c => generated 1320 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:50:58.057852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8b7b1974-fe2d-4619-b6e5-bc46903993d6 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Action: 'update', calling method: .version_select at 0x7f25a6127430>, body: {"quota_set": {"ram": 0}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:50:58.059765 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.compute.rpcapi [None req-899edfa7-b01d-4522-8cf9-a1d84aa9c57e None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 17 20:50:58.067510 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8b7b1974-fe2d-4619-b6e5-bc46903993d6 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'ee3d8ef713bd4844833d9374766452d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33f1d412d4a44e09b51be3b14530c077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:58.069392 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-899edfa7-b01d-4522-8cf9-a1d84aa9c57e None None] Releasing lock "compute-rpcapi-router" {{(pid=140523) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 17 20:50:58.080179 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8b7b1974-fe2d-4619-b6e5-bc46903993d6 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Request method failure captured: Sep 17 20:50:58.080179 ncdv-master-1 devstack@n-api.service[140524]: request: PUT /compute/v2.1/os-quota-sets/33f1d412d4a44e09b51be3b14530c077 HTTP/1.1 Sep 17 20:50:58.080179 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:50:58.080179 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:50:58.080179 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:50:58.080179 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 25 Sep 17 20:50:58.080179 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:50:58.080179 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:50:58.080179 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:50:58.080179 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:50:58.080179 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjMorfY1IaiX_nlTF6-vfKrPRniweyxQdL_zIcWo2OcbyQiD0zsaGsEjbIIe5O_NaKtXwkJ9VyZi7i6yxrmHR7zeW9tUXd1NG0qNXbk8wBk4T0D0PmtSzZTJtxK03nF8LrFHR21GbWXSXR5rU9QKKKG9KDMJuIdu6EG5PuLWF2Aiyog Sep 17 20:50:58.080179 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:50:58.080179 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:50:58.080179 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:50:58.080179 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:50:58.080179 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:50:58.080179 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:50:58.080179 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 33f1d412d4a44e09b51be3b14530c077 Sep 17 20:50:58.080179 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-QuotasAdminNegativeTest-734910182 Sep 17 20:50:58.080179 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:50:58.080179 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:50:58.081706 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/33f1d412d4a44e09b51be3b14530c077"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/33f1d412d4a44e09b51be3b14530c077"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/33f1d412d4a44e09b51be3b14530c077"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_33f1d412d4a44e09b51be3b14530c077", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:50:58.081706 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-QuotasAdminNegativeTest-734910182 Sep 17 20:50:58.081706 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 33f1d412d4a44e09b51be3b14530c077 Sep 17 20:50:58.081706 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-734910182 Sep 17 20:50:58.081706 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-QuotasAdminNegativeTest-734910182-project Sep 17 20:50:58.081706 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:50:58.081706 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:50:58.081706 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: ee3d8ef713bd4844833d9374766452d8 Sep 17 20:50:58.081706 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-QuotasAdminNegativeTest-734910182-project Sep 17 20:50:58.081706 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:50:58.081706 ncdv-master-1 devstack@n-api.service[140524]: {"quota_set": {"ram": 0}} Sep 17 20:50:58.081706 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:50:58.081706 ncdv-master-1 devstack@n-api.service[140524]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 17 20:50:58.081706 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '33f1d412d4a44e09b51be3b14530c077', 'body': {'quota_set': {'ram': 0}}} Sep 17 20:50:58.082655 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:50:58.082655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:58.082655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:58.082655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:58.082655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:50:58.082655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:50:58.082655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:50:58.082655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:50:58.082655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:50:58.082655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:50:58.082655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:50:58.082655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:50:58.082655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Sep 17 20:50:58.082655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Sep 17 20:50:58.082655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 17 20:50:58.082655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:50:58.082655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 17 20:50:58.082655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:50:58.082655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Sep 17 20:50:58.085221 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Sep 17 20:50:58.085221 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 17 20:50:58.085221 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 17 20:50:58.085221 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 17 20:50:58.085221 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 17 20:50:58.085221 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:50:58.085221 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:50:58.085221 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:50:58.085221 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:50:58.085221 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 17 20:50:58.085221 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 17 20:50:58.085221 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 17 20:50:58.085221 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 17 20:50:58.085221 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 17 20:50:58.085221 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 17 20:50:58.085221 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 17 20:50:58.085221 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:58.085221 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:50:58.085221 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:58.085221 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:50:58.089207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:50:58.089207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:50:58.089207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 17 20:50:58.089207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 17 20:50:58.089207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 17 20:50:58.089207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:50:58.092307 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8b7b1974-fe2d-4619-b6e5-bc46903993d6 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:50:58.094810 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8b7b1974-fe2d-4619-b6e5-bc46903993d6 tempest-QuotasAdminNegativeTest-734910182 tempest-QuotasAdminNegativeTest-734910182-project] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/33f1d412d4a44e09b51be3b14530c077" status: 403 len: 116 microversion: 2.1 time: 0.062709 Sep 17 20:50:58.102514 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 133/202] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Sep 17 20:50:58 2022] PUT /compute/v2.1/os-quota-sets/33f1d412d4a44e09b51be3b14530c077 => generated 116 bytes in 71 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:50:58.108270 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-899edfa7-b01d-4522-8cf9-a1d84aa9c57e None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.230497 Sep 17 20:50:58.114084 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 70/203] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:50:58.263185 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c5cd48ad-c595-4753-b81d-d8a27bbc99ed tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:58.264455 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c5cd48ad-c595-4753-b81d-d8a27bbc99ed tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:58.275233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c5cd48ad-c595-4753-b81d-d8a27bbc99ed tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:58.275833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c5cd48ad-c595-4753-b81d-d8a27bbc99ed tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:58.276384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c5cd48ad-c595-4753-b81d-d8a27bbc99ed tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:58.277218 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c5cd48ad-c595-4753-b81d-d8a27bbc99ed tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:58.277831 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c5cd48ad-c595-4753-b81d-d8a27bbc99ed tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:58.278841 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c5cd48ad-c595-4753-b81d-d8a27bbc99ed tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:58.450811 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c5cd48ad-c595-4753-b81d-d8a27bbc99ed tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:58.459779 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c5cd48ad-c595-4753-b81d-d8a27bbc99ed tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1312 microversion: 2.1 time: 0.203363 Sep 17 20:50:58.475391 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 134/204] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:58 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1312 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:58.570783 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0944c08a-15e4-472d-9cdd-03c7fd365956 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:58.571952 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0944c08a-15e4-472d-9cdd-03c7fd365956 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] [instance: 07019932-c686-4174-9828-3035fcc1694a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:58.593049 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0944c08a-15e4-472d-9cdd-03c7fd365956 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:58.594664 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0944c08a-15e4-472d-9cdd-03c7fd365956 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:58.595558 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0944c08a-15e4-472d-9cdd-03c7fd365956 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:58.597968 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0944c08a-15e4-472d-9cdd-03c7fd365956 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:58.599587 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0944c08a-15e4-472d-9cdd-03c7fd365956 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:58.603197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0944c08a-15e4-472d-9cdd-03c7fd365956 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:58.815948 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0944c08a-15e4-472d-9cdd-03c7fd365956 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05aab669547487d8876a70e338d3e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4ffd27d7414061b67e053657044400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:58.825147 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0944c08a-15e4-472d-9cdd-03c7fd365956 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] 10.222.0.26 "GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a" status: 200 len: 1488 microversion: 2.1 time: 0.259934 Sep 17 20:50:58.837678 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 71/205] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:58 2022] GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a => generated 1488 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:58.854247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e153f22d-a98d-4c98-bde2-c75abc6ae6cc tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:58.855703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e153f22d-a98d-4c98-bde2-c75abc6ae6cc tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] [instance: 07019932-c686-4174-9828-3035fcc1694a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:58.864274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e153f22d-a98d-4c98-bde2-c75abc6ae6cc tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:58.864778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e153f22d-a98d-4c98-bde2-c75abc6ae6cc tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:58.865213 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e153f22d-a98d-4c98-bde2-c75abc6ae6cc tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:58.865945 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e153f22d-a98d-4c98-bde2-c75abc6ae6cc tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:58.866547 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e153f22d-a98d-4c98-bde2-c75abc6ae6cc tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:58.866965 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e153f22d-a98d-4c98-bde2-c75abc6ae6cc tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:59.069353 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-194684e9-f059-4345-a6d7-772855c073de tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:59.069813 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-194684e9-f059-4345-a6d7-772855c073de tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:59.080362 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-194684e9-f059-4345-a6d7-772855c073de tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:59.083724 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-194684e9-f059-4345-a6d7-772855c073de tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:59.084788 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-194684e9-f059-4345-a6d7-772855c073de tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:59.087042 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-194684e9-f059-4345-a6d7-772855c073de tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:59.089371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-194684e9-f059-4345-a6d7-772855c073de tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:59.090067 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-194684e9-f059-4345-a6d7-772855c073de tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:59.362046 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e153f22d-a98d-4c98-bde2-c75abc6ae6cc tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a" status: 200 len: 1639 microversion: 2.1 time: 0.512335 Sep 17 20:50:59.384305 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 135/206] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:58 2022] GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a => generated 1639 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:50:59.397411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bcb1d767-85de-4cb2-b335-3567becc804c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:59.398295 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bcb1d767-85de-4cb2-b335-3567becc804c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] [instance: 07019932-c686-4174-9828-3035fcc1694a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:59.408586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bcb1d767-85de-4cb2-b335-3567becc804c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:59.409526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bcb1d767-85de-4cb2-b335-3567becc804c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:59.410507 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bcb1d767-85de-4cb2-b335-3567becc804c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:59.411448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bcb1d767-85de-4cb2-b335-3567becc804c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:59.412528 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-194684e9-f059-4345-a6d7-772855c073de tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8bfe1d590a4500b7e7b5c79a6a4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea88200545ae4003b42b0d475f482c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:59.413527 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bcb1d767-85de-4cb2-b335-3567becc804c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:59.414605 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bcb1d767-85de-4cb2-b335-3567becc804c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:59.425139 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-194684e9-f059-4345-a6d7-772855c073de tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] 10.222.0.26 "GET /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c" status: 200 len: 1320 microversion: 2.1 time: 0.361589 Sep 17 20:50:59.425769 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 72/207] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:59 2022] GET /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c => generated 1320 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:50:59.464372 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bcb1d767-85de-4cb2-b335-3567becc804c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] [instance: 07019932-c686-4174-9828-3035fcc1694a] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:50:59.483379 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2dd44fb9-f78f-4673-a0e9-33c810918253 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:59.484011 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2dd44fb9-f78f-4673-a0e9-33c810918253 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:59.495216 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2dd44fb9-f78f-4673-a0e9-33c810918253 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:59.498651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2dd44fb9-f78f-4673-a0e9-33c810918253 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:59.500174 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2dd44fb9-f78f-4673-a0e9-33c810918253 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:59.501424 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2dd44fb9-f78f-4673-a0e9-33c810918253 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:59.502634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2dd44fb9-f78f-4673-a0e9-33c810918253 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:59.506223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2dd44fb9-f78f-4673-a0e9-33c810918253 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:59.687880 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bcb1d767-85de-4cb2-b335-3567becc804c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] 10.222.0.26 "DELETE /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a" status: 204 len: 0 microversion: 2.1 time: 0.299436 Sep 17 20:50:59.688874 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 136/208] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:50:59 2022] DELETE /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:50:59.708145 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6ab97dd4-6ee6-4cf9-8f67-75e39ef436b9 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:50:59.708880 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6ab97dd4-6ee6-4cf9-8f67-75e39ef436b9 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] [instance: 07019932-c686-4174-9828-3035fcc1694a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:50:59.721106 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2dd44fb9-f78f-4673-a0e9-33c810918253 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:59.727445 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2dd44fb9-f78f-4673-a0e9-33c810918253 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1312 microversion: 2.1 time: 0.248807 Sep 17 20:50:59.731139 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 73/209] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:59 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1312 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:50:59.748452 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ab97dd4-6ee6-4cf9-8f67-75e39ef436b9 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:59.748955 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ab97dd4-6ee6-4cf9-8f67-75e39ef436b9 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:59.749658 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ab97dd4-6ee6-4cf9-8f67-75e39ef436b9 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:59.750759 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ab97dd4-6ee6-4cf9-8f67-75e39ef436b9 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:50:59.751437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ab97dd4-6ee6-4cf9-8f67-75e39ef436b9 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:50:59.752536 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ab97dd4-6ee6-4cf9-8f67-75e39ef436b9 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:50:59.915472 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6ab97dd4-6ee6-4cf9-8f67-75e39ef436b9 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05aab669547487d8876a70e338d3e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4ffd27d7414061b67e053657044400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:50:59.925289 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6ab97dd4-6ee6-4cf9-8f67-75e39ef436b9 tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] 10.222.0.26 "GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a" status: 200 len: 1494 microversion: 2.1 time: 0.229572 Sep 17 20:50:59.926274 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 137/210] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:50:59 2022] GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a => generated 1494 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:00.128304 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-85a2e03c-e087-4e77-af88-0ab957a617b7 req-eaef33b5-d456-40d4-92f9-5cc98fd4e14e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dbd958b-d480-41e3-b36b-4d3c7fa55d1c", "name": "network-vif-plugged", "status": "completed", "tag": "5dfa3fc2-0525-47cd-8ef7-b5446595e1bb"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:00.139925 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-85a2e03c-e087-4e77-af88-0ab957a617b7 req-eaef33b5-d456-40d4-92f9-5cc98fd4e14e service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:00.140810 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-85a2e03c-e087-4e77-af88-0ab957a617b7 req-eaef33b5-d456-40d4-92f9-5cc98fd4e14e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:00.141634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-85a2e03c-e087-4e77-af88-0ab957a617b7 req-eaef33b5-d456-40d4-92f9-5cc98fd4e14e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:00.156830 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-85a2e03c-e087-4e77-af88-0ab957a617b7 req-eaef33b5-d456-40d4-92f9-5cc98fd4e14e service nova] Creating event network-vif-plugged:5dfa3fc2-0525-47cd-8ef7-b5446595e1bb for instance 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c on nch1-master-1 Sep 17 20:51:00.162440 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-85a2e03c-e087-4e77-af88-0ab957a617b7 req-eaef33b5-d456-40d4-92f9-5cc98fd4e14e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038044 Sep 17 20:51:00.163753 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 74/211] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:00.455528 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f58ad735-12c9-4902-9b07-3d5fcdee30ba tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:00.456577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f58ad735-12c9-4902-9b07-3d5fcdee30ba tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:00.464388 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f58ad735-12c9-4902-9b07-3d5fcdee30ba tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:00.465589 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f58ad735-12c9-4902-9b07-3d5fcdee30ba tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:00.466417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f58ad735-12c9-4902-9b07-3d5fcdee30ba tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:00.467738 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f58ad735-12c9-4902-9b07-3d5fcdee30ba tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:00.478547 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f58ad735-12c9-4902-9b07-3d5fcdee30ba tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:00.485230 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f58ad735-12c9-4902-9b07-3d5fcdee30ba tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:00.571893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-61b420f5-01b7-4abd-9b09-d9f554f2c7ac tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1044145411", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:00.648748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-61b420f5-01b7-4abd-9b09-d9f554f2c7ac tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] validate_networks() for None {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:51:00.771758 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f58ad735-12c9-4902-9b07-3d5fcdee30ba tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8bfe1d590a4500b7e7b5c79a6a4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea88200545ae4003b42b0d475f482c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:00.783508 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f58ad735-12c9-4902-9b07-3d5fcdee30ba tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] 10.222.0.26 "GET /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c" status: 200 len: 1320 microversion: 2.1 time: 0.333647 Sep 17 20:51:00.797686 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 75/212] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:00 2022] GET /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c => generated 1320 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:51:00.809800 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-273055cb-3e49-42b2-868e-74fe070877e8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:00.810640 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-273055cb-3e49-42b2-868e-74fe070877e8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:00.819351 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-273055cb-3e49-42b2-868e-74fe070877e8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:00.822806 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-273055cb-3e49-42b2-868e-74fe070877e8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:00.824229 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-273055cb-3e49-42b2-868e-74fe070877e8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:00.825012 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-273055cb-3e49-42b2-868e-74fe070877e8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:00.825592 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-273055cb-3e49-42b2-868e-74fe070877e8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:00.826926 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-273055cb-3e49-42b2-868e-74fe070877e8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:00.978797 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-61b420f5-01b7-4abd-9b09-d9f554f2c7ac tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:51:00.982995 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-61b420f5-01b7-4abd-9b09-d9f554f2c7ac tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:51:00.983572 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-61b420f5-01b7-4abd-9b09-d9f554f2c7ac tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:51:00.985008 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-61b420f5-01b7-4abd-9b09-d9f554f2c7ac tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:51:00.985656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-61b420f5-01b7-4abd-9b09-d9f554f2c7ac tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:51:00.995617 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-61b420f5-01b7-4abd-9b09-d9f554f2c7ac tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:00.996606 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-61b420f5-01b7-4abd-9b09-d9f554f2c7ac tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:00.997485 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-61b420f5-01b7-4abd-9b09-d9f554f2c7ac tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:00.998817 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-61b420f5-01b7-4abd-9b09-d9f554f2c7ac tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:00.999683 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-61b420f5-01b7-4abd-9b09-d9f554f2c7ac tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:01.000506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-61b420f5-01b7-4abd-9b09-d9f554f2c7ac tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:01.019785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-61b420f5-01b7-4abd-9b09-d9f554f2c7ac tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Getting quotas for project f273bfff7ced4f2e885d1ead94a9a486. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:51:01.023868 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-61b420f5-01b7-4abd-9b09-d9f554f2c7ac tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Getting quotas for user ec6d47d564174aceb110b3354ff7db2a and project f273bfff7ced4f2e885d1ead94a9a486. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:51:01.045223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-273055cb-3e49-42b2-868e-74fe070877e8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:01.057275 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-61b420f5-01b7-4abd-9b09-d9f554f2c7ac tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:51:01.057729 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-273055cb-3e49-42b2-868e-74fe070877e8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1461 microversion: 2.1 time: 0.266474 Sep 17 20:51:01.058386 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 76/213] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:00 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1461 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:01.061111 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-61b420f5-01b7-4abd-9b09-d9f554f2c7ac tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] [instance: f297915d-a9fc-44c9-8bc6-a4a682978ed9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:51:01.066708 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cbb903f4-2835-4d1f-9ac9-7d7169d7b35c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:01.067850 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cbb903f4-2835-4d1f-9ac9-7d7169d7b35c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] [instance: 07019932-c686-4174-9828-3035fcc1694a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:01.083154 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbb903f4-2835-4d1f-9ac9-7d7169d7b35c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:01.083837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbb903f4-2835-4d1f-9ac9-7d7169d7b35c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:01.084505 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbb903f4-2835-4d1f-9ac9-7d7169d7b35c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:01.085476 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbb903f4-2835-4d1f-9ac9-7d7169d7b35c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:01.086285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbb903f4-2835-4d1f-9ac9-7d7169d7b35c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:01.086730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbb903f4-2835-4d1f-9ac9-7d7169d7b35c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:01.135823 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-61b420f5-01b7-4abd-9b09-d9f554f2c7ac tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.789259 Sep 17 20:51:01.137341 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 138/214] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:51:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:51:01.347793 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cbb903f4-2835-4d1f-9ac9-7d7169d7b35c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05aab669547487d8876a70e338d3e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4ffd27d7414061b67e053657044400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:01.351634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:51:01.358316 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cbb903f4-2835-4d1f-9ac9-7d7169d7b35c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] 10.222.0.26 "GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a" status: 200 len: 1494 microversion: 2.1 time: 0.298931 Sep 17 20:51:01.359947 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 77/215] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:01 2022] GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a => generated 1494 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:01.373897 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-90e9ad7d-a5c8-48b4-8de2-bcb7f92c640c tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:01.380998 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-90e9ad7d-a5c8-48b4-8de2-bcb7f92c640c tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] [instance: f297915d-a9fc-44c9-8bc6-a4a682978ed9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:01.541380 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-90e9ad7d-a5c8-48b4-8de2-bcb7f92c640c tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6d47d564174aceb110b3354ff7db2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f273bfff7ced4f2e885d1ead94a9a486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:01.550040 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-90e9ad7d-a5c8-48b4-8de2-bcb7f92c640c tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] 10.222.0.26 "GET /compute/v2.1/servers/f297915d-a9fc-44c9-8bc6-a4a682978ed9" status: 200 len: 1214 microversion: 2.1 time: 0.188893 Sep 17 20:51:01.550629 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 78/216] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:01 2022] GET /compute/v2.1/servers/f297915d-a9fc-44c9-8bc6-a4a682978ed9 => generated 1214 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:01.618427 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fb491302-aba5-456a-894f-ce237f5f585a tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:01.619246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fb491302-aba5-456a-894f-ce237f5f585a tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:01.630691 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fb491302-aba5-456a-894f-ce237f5f585a tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:01.631182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fb491302-aba5-456a-894f-ce237f5f585a tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:01.631616 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fb491302-aba5-456a-894f-ce237f5f585a tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:01.632320 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fb491302-aba5-456a-894f-ce237f5f585a tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:01.640004 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fb491302-aba5-456a-894f-ce237f5f585a tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:01.642187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fb491302-aba5-456a-894f-ce237f5f585a tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:01.807158 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cc1d9728-b303-497e-925a-b12ccdb311b7 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:01.807763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cc1d9728-b303-497e-925a-b12ccdb311b7 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:01.814939 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc1d9728-b303-497e-925a-b12ccdb311b7 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:01.817298 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc1d9728-b303-497e-925a-b12ccdb311b7 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:01.825028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc1d9728-b303-497e-925a-b12ccdb311b7 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:01.826310 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc1d9728-b303-497e-925a-b12ccdb311b7 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:01.827637 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc1d9728-b303-497e-925a-b12ccdb311b7 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:01.829977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc1d9728-b303-497e-925a-b12ccdb311b7 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:02.168378 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fb491302-aba5-456a-894f-ce237f5f585a tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1612 microversion: 2.1 time: 1.029644 Sep 17 20:51:02.168988 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 139/217] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:01 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1612 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:02.197709 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-438575bf-18e7-4f40-bf89-2f1b9769fbea req-f6bb7ae6-70a0-49d2-8088-cfb042ebf4aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07019932-c686-4174-9828-3035fcc1694a", "name": "network-vif-deleted", "tag": "8d4f5ca3-4a66-4ee2-a709-cc73b8cb7ac3"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:02.209904 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cc1d9728-b303-497e-925a-b12ccdb311b7 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8bfe1d590a4500b7e7b5c79a6a4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea88200545ae4003b42b0d475f482c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:02.218424 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-438575bf-18e7-4f40-bf89-2f1b9769fbea req-f6bb7ae6-70a0-49d2-8088-cfb042ebf4aa service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:02.219758 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-438575bf-18e7-4f40-bf89-2f1b9769fbea req-f6bb7ae6-70a0-49d2-8088-cfb042ebf4aa service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:02.220367 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-438575bf-18e7-4f40-bf89-2f1b9769fbea req-f6bb7ae6-70a0-49d2-8088-cfb042ebf4aa service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:02.230764 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cc1d9728-b303-497e-925a-b12ccdb311b7 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] 10.222.0.26 "GET /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c" status: 200 len: 1470 microversion: 2.1 time: 0.427367 Sep 17 20:51:02.232679 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 79/218] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:01 2022] GET /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c => generated 1470 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:51:02.239137 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cc17b4de-26d1-4058-a995-f1fa5870f74b tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:02.252699 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cc17b4de-26d1-4058-a995-f1fa5870f74b tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:02.262542 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-438575bf-18e7-4f40-bf89-2f1b9769fbea req-f6bb7ae6-70a0-49d2-8088-cfb042ebf4aa service nova] Creating event network-vif-deleted:8d4f5ca3-4a66-4ee2-a709-cc73b8cb7ac3 for instance 07019932-c686-4174-9828-3035fcc1694a on nch2-master-1 Sep 17 20:51:02.264027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc17b4de-26d1-4058-a995-f1fa5870f74b tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:02.265258 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc17b4de-26d1-4058-a995-f1fa5870f74b tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:02.267677 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-438575bf-18e7-4f40-bf89-2f1b9769fbea req-f6bb7ae6-70a0-49d2-8088-cfb042ebf4aa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097294 Sep 17 20:51:02.268775 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 140/219] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:02.274517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc17b4de-26d1-4058-a995-f1fa5870f74b tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:02.276452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc17b4de-26d1-4058-a995-f1fa5870f74b tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:02.278491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc17b4de-26d1-4058-a995-f1fa5870f74b tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:02.279047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc17b4de-26d1-4058-a995-f1fa5870f74b tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:02.639861 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d9757fe7-8dbc-4821-95ef-9c426561fef3 tempest-DeleteServersAdminTestJSON-235619281 tempest-DeleteServersAdminTestJSON-235619281-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:02.640466 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d9757fe7-8dbc-4821-95ef-9c426561fef3 tempest-DeleteServersAdminTestJSON-235619281 tempest-DeleteServersAdminTestJSON-235619281-project-admin] [instance: 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:02.647053 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d9757fe7-8dbc-4821-95ef-9c426561fef3 tempest-DeleteServersAdminTestJSON-235619281 tempest-DeleteServersAdminTestJSON-235619281-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:02.647531 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d9757fe7-8dbc-4821-95ef-9c426561fef3 tempest-DeleteServersAdminTestJSON-235619281 tempest-DeleteServersAdminTestJSON-235619281-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:02.648144 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d9757fe7-8dbc-4821-95ef-9c426561fef3 tempest-DeleteServersAdminTestJSON-235619281 tempest-DeleteServersAdminTestJSON-235619281-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:02.648838 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d9757fe7-8dbc-4821-95ef-9c426561fef3 tempest-DeleteServersAdminTestJSON-235619281 tempest-DeleteServersAdminTestJSON-235619281-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:02.649298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d9757fe7-8dbc-4821-95ef-9c426561fef3 tempest-DeleteServersAdminTestJSON-235619281 tempest-DeleteServersAdminTestJSON-235619281-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:02.649745 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d9757fe7-8dbc-4821-95ef-9c426561fef3 tempest-DeleteServersAdminTestJSON-235619281 tempest-DeleteServersAdminTestJSON-235619281-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:02.677274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d9757fe7-8dbc-4821-95ef-9c426561fef3 tempest-DeleteServersAdminTestJSON-235619281 tempest-DeleteServersAdminTestJSON-235619281-project-admin] [instance: 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:51:02.791490 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cc17b4de-26d1-4058-a995-f1fa5870f74b tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '27c681039283443c8dd284f22277bc8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe06cc27b4f403faac35ee3521893ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:02.792046 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cc17b4de-26d1-4058-a995-f1fa5870f74b tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] flavor_id is None. Assuming migration. {{(pid=140523) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 17 20:51:02.792828 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cc17b4de-26d1-4058-a995-f1fa5870f74b tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140523) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 17 20:51:02.836732 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d9757fe7-8dbc-4821-95ef-9c426561fef3 tempest-DeleteServersAdminTestJSON-235619281 tempest-DeleteServersAdminTestJSON-235619281-project-admin] 10.222.0.26 "DELETE /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c" status: 204 len: 0 microversion: 2.1 time: 0.565035 Sep 17 20:51:02.838053 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 141/220] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:51:02 2022] DELETE /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c => generated 0 bytes in 569 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:51:02.844832 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-658d29dd-f47f-4e33-8e38-1f71b451720a tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:02.845880 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-658d29dd-f47f-4e33-8e38-1f71b451720a tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] [instance: 07019932-c686-4174-9828-3035fcc1694a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:02.870388 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-658d29dd-f47f-4e33-8e38-1f71b451720a tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:02.873350 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-658d29dd-f47f-4e33-8e38-1f71b451720a tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:02.874472 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-658d29dd-f47f-4e33-8e38-1f71b451720a tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:02.876897 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-658d29dd-f47f-4e33-8e38-1f71b451720a tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:02.877754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-658d29dd-f47f-4e33-8e38-1f71b451720a tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:02.878201 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-658d29dd-f47f-4e33-8e38-1f71b451720a tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:02.949803 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-658d29dd-f47f-4e33-8e38-1f71b451720a tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:02.950506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-658d29dd-f47f-4e33-8e38-1f71b451720a tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:02.950955 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-658d29dd-f47f-4e33-8e38-1f71b451720a tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:02.951427 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-658d29dd-f47f-4e33-8e38-1f71b451720a tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lazy-loading 'fault' on Instance uuid 07019932-c686-4174-9828-3035fcc1694a {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:51:03.009160 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-658d29dd-f47f-4e33-8e38-1f71b451720a tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f05aab669547487d8876a70e338d3e4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa4ffd27d7414061b67e053657044400', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:03.017820 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-658d29dd-f47f-4e33-8e38-1f71b451720a tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] 10.222.0.26 "GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a" status: 200 len: 1328 microversion: 2.1 time: 0.178058 Sep 17 20:51:03.018565 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 142/221] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:02 2022] GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a => generated 1328 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:03.045282 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cc17b4de-26d1-4058-a995-f1fa5870f74b tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228/action" status: 202 len: 0 microversion: 2.1 time: 0.809888 Sep 17 20:51:03.046899 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 80/222] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:51:02 2022] POST /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228/action => generated 0 bytes in 813 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:51:03.305814 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1aedc050-2a97-4d5e-b708-5c8218b668cc tempest-HypervisorAdminV228Test-1507968804 tempest-HypervisorAdminV228Test-1507968804-project-admin] Calling method '.version_select at 0x7f25a6127af0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:03.308576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1aedc050-2a97-4d5e-b708-5c8218b668cc tempest-HypervisorAdminV228Test-1507968804 tempest-HypervisorAdminV228Test-1507968804-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:03.309351 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1aedc050-2a97-4d5e-b708-5c8218b668cc tempest-HypervisorAdminV228Test-1507968804 tempest-HypervisorAdminV228Test-1507968804-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:03.310502 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1aedc050-2a97-4d5e-b708-5c8218b668cc tempest-HypervisorAdminV228Test-1507968804 tempest-HypervisorAdminV228Test-1507968804-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:03.332330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1aedc050-2a97-4d5e-b708-5c8218b668cc tempest-HypervisorAdminV228Test-1507968804 tempest-HypervisorAdminV228Test-1507968804-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:03.333062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1aedc050-2a97-4d5e-b708-5c8218b668cc tempest-HypervisorAdminV228Test-1507968804 tempest-HypervisorAdminV228Test-1507968804-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:03.333697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1aedc050-2a97-4d5e-b708-5c8218b668cc tempest-HypervisorAdminV228Test-1507968804 tempest-HypervisorAdminV228Test-1507968804-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:03.358804 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1aedc050-2a97-4d5e-b708-5c8218b668cc tempest-HypervisorAdminV228Test-1507968804 tempest-HypervisorAdminV228Test-1507968804-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:03.360364 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1aedc050-2a97-4d5e-b708-5c8218b668cc tempest-HypervisorAdminV228Test-1507968804 tempest-HypervisorAdminV228Test-1507968804-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:03.361054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1aedc050-2a97-4d5e-b708-5c8218b668cc tempest-HypervisorAdminV228Test-1507968804 tempest-HypervisorAdminV228Test-1507968804-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:03.362509 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7781b8ce-d831-4c67-bc8b-0416db1029be tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Calling method '.version_select at 0x7f25a6197310>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:03.368353 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1aedc050-2a97-4d5e-b708-5c8218b668cc tempest-HypervisorAdminV228Test-1507968804 tempest-HypervisorAdminV228Test-1507968804-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.348412 Sep 17 20:51:03.369643 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 143/223] 10.222.0.26 () {60 vars in 1187 bytes} [Sat Sep 17 20:51:03 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:51:03.379634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7781b8ce-d831-4c67-bc8b-0416db1029be tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),056db90a-cdd9-42b2-a8c3-cd5ab36662a4(cell1) {{(pid=140523) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 17 20:51:03.380491 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b02bf5d9-188c-4eb7-982d-b9af587aebd9 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:03.381739 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7781b8ce-d831-4c67-bc8b-0416db1029be tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:03.382275 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b02bf5d9-188c-4eb7-982d-b9af587aebd9 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] [instance: f297915d-a9fc-44c9-8bc6-a4a682978ed9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:03.382796 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7781b8ce-d831-4c67-bc8b-0416db1029be tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:03.386036 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7781b8ce-d831-4c67-bc8b-0416db1029be tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:03.397928 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b02bf5d9-188c-4eb7-982d-b9af587aebd9 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:03.398963 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b02bf5d9-188c-4eb7-982d-b9af587aebd9 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:03.402508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b02bf5d9-188c-4eb7-982d-b9af587aebd9 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:03.404734 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b02bf5d9-188c-4eb7-982d-b9af587aebd9 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:03.405972 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b02bf5d9-188c-4eb7-982d-b9af587aebd9 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:03.407997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b02bf5d9-188c-4eb7-982d-b9af587aebd9 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:03.417513 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7781b8ce-d831-4c67-bc8b-0416db1029be tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:03.418371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7781b8ce-d831-4c67-bc8b-0416db1029be tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:03.419005 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7781b8ce-d831-4c67-bc8b-0416db1029be tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:03.462242 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7781b8ce-d831-4c67-bc8b-0416db1029be tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:03.463226 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7781b8ce-d831-4c67-bc8b-0416db1029be tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:03.463902 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7781b8ce-d831-4c67-bc8b-0416db1029be tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:03.476826 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7781b8ce-d831-4c67-bc8b-0416db1029be tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:03.477359 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7781b8ce-d831-4c67-bc8b-0416db1029be tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:03.478109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7781b8ce-d831-4c67-bc8b-0416db1029be tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:03.512393 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b02bf5d9-188c-4eb7-982d-b9af587aebd9 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6d47d564174aceb110b3354ff7db2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f273bfff7ced4f2e885d1ead94a9a486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:03.523680 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b02bf5d9-188c-4eb7-982d-b9af587aebd9 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] 10.222.0.26 "GET /compute/v2.1/servers/f297915d-a9fc-44c9-8bc6-a4a682978ed9" status: 200 len: 1293 microversion: 2.1 time: 0.152620 Sep 17 20:51:03.524272 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 144/224] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:03 2022] GET /compute/v2.1/servers/f297915d-a9fc-44c9-8bc6-a4a682978ed9 => generated 1293 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:03.532464 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-02f2e26b-c0a3-470b-8818-dd7ca33f2b70 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:03.533443 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-02f2e26b-c0a3-470b-8818-dd7ca33f2b70 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:03.539092 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7781b8ce-d831-4c67-bc8b-0416db1029be tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:03.539588 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7781b8ce-d831-4c67-bc8b-0416db1029be tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:03.540029 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7781b8ce-d831-4c67-bc8b-0416db1029be tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:03.542846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02f2e26b-c0a3-470b-8818-dd7ca33f2b70 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:03.543542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02f2e26b-c0a3-470b-8818-dd7ca33f2b70 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:03.544152 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02f2e26b-c0a3-470b-8818-dd7ca33f2b70 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:03.545159 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02f2e26b-c0a3-470b-8818-dd7ca33f2b70 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:03.545821 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02f2e26b-c0a3-470b-8818-dd7ca33f2b70 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:03.546420 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02f2e26b-c0a3-470b-8818-dd7ca33f2b70 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:03.551014 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7781b8ce-d831-4c67-bc8b-0416db1029be tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1836 microversion: 2.53 time: 0.502594 Sep 17 20:51:03.551576 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 81/225] 10.222.0.26 () {60 vars in 1243 bytes} [Sat Sep 17 20:51:03 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1836 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:51:03.556043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-05ac8157-bbf5-47a6-96c9-fd616a5830da tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:03.556783 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-05ac8157-bbf5-47a6-96c9-fd616a5830da tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:03.570221 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:51:03.574629 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-05ac8157-bbf5-47a6-96c9-fd616a5830da tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:03.575439 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-05ac8157-bbf5-47a6-96c9-fd616a5830da tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:03.575887 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-05ac8157-bbf5-47a6-96c9-fd616a5830da tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:03.576618 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-05ac8157-bbf5-47a6-96c9-fd616a5830da tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:03.577539 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-05ac8157-bbf5-47a6-96c9-fd616a5830da tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:03.578001 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-05ac8157-bbf5-47a6-96c9-fd616a5830da tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:03.822260 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-05ac8157-bbf5-47a6-96c9-fd616a5830da tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:03.834952 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-05ac8157-bbf5-47a6-96c9-fd616a5830da tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1470 microversion: 2.1 time: 0.282278 Sep 17 20:51:03.837775 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 82/226] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:03 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1470 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:03.857867 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-07d3f01b-7f5b-4c1f-875f-55f8cd05d37c tempest-HypervisorAdminV228Test-1507968804 tempest-HypervisorAdminV228Test-1507968804-project-admin] Calling method '.version_select at 0x7f25a5e655e0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:03.860532 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-07d3f01b-7f5b-4c1f-875f-55f8cd05d37c tempest-HypervisorAdminV228Test-1507968804 tempest-HypervisorAdminV228Test-1507968804-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:03.861031 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-07d3f01b-7f5b-4c1f-875f-55f8cd05d37c tempest-HypervisorAdminV228Test-1507968804 tempest-HypervisorAdminV228Test-1507968804-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:03.861505 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-07d3f01b-7f5b-4c1f-875f-55f8cd05d37c tempest-HypervisorAdminV228Test-1507968804 tempest-HypervisorAdminV228Test-1507968804-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:03.862729 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-02f2e26b-c0a3-470b-8818-dd7ca33f2b70 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8bfe1d590a4500b7e7b5c79a6a4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea88200545ae4003b42b0d475f482c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:03.873153 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-02f2e26b-c0a3-470b-8818-dd7ca33f2b70 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] 10.222.0.26 "GET /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c" status: 200 len: 1476 microversion: 2.1 time: 0.347495 Sep 17 20:51:03.876546 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 145/227] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:03 2022] GET /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c => generated 1476 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:03.881573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=2,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:51:03.884065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-07d3f01b-7f5b-4c1f-875f-55f8cd05d37c tempest-HypervisorAdminV228Test-1507968804 tempest-HypervisorAdminV228Test-1507968804-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:03.884718 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-07d3f01b-7f5b-4c1f-875f-55f8cd05d37c tempest-HypervisorAdminV228Test-1507968804 tempest-HypervisorAdminV228Test-1507968804-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:03.885158 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-07d3f01b-7f5b-4c1f-875f-55f8cd05d37c tempest-HypervisorAdminV228Test-1507968804 tempest-HypervisorAdminV228Test-1507968804-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:03.886184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-759b0c04-c949-41b0-8d0a-836eb425f1cc tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Calling method '.version_select at 0x7f25a5f0c280>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:03.893071 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-07d3f01b-7f5b-4c1f-875f-55f8cd05d37c tempest-HypervisorAdminV228Test-1507968804 tempest-HypervisorAdminV228Test-1507968804-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.053856 Sep 17 20:51:03.899330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-759b0c04-c949-41b0-8d0a-836eb425f1cc tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:03.902151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-759b0c04-c949-41b0-8d0a-836eb425f1cc tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:03.904180 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-759b0c04-c949-41b0-8d0a-836eb425f1cc tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:03.905077 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 83/228] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Sep 17 20:51:03 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:51:03.926598 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-759b0c04-c949-41b0-8d0a-836eb425f1cc tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:03.927468 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-759b0c04-c949-41b0-8d0a-836eb425f1cc tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:03.928118 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-759b0c04-c949-41b0-8d0a-836eb425f1cc tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:03.976684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-759b0c04-c949-41b0-8d0a-836eb425f1cc tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:03.977401 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-759b0c04-c949-41b0-8d0a-836eb425f1cc tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:03.978659 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-759b0c04-c949-41b0-8d0a-836eb425f1cc tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:04.002922 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-759b0c04-c949-41b0-8d0a-836eb425f1cc tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:04.003687 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-759b0c04-c949-41b0-8d0a-836eb425f1cc tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:04.004372 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-759b0c04-c949-41b0-8d0a-836eb425f1cc tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:04.032195 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-759b0c04-c949-41b0-8d0a-836eb425f1cc tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:04.034898 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-759b0c04-c949-41b0-8d0a-836eb425f1cc tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:04.035600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-759b0c04-c949-41b0-8d0a-836eb425f1cc tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:04.049810 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-759b0c04-c949-41b0-8d0a-836eb425f1cc tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 528 microversion: 2.53 time: 0.171913 Sep 17 20:51:04.051970 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 146/229] 10.222.0.26 () {60 vars in 1222 bytes} [Sat Sep 17 20:51:03 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 528 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:51:04.070567 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-482aff02-82c0-42b6-b83b-09cff6ef6ddc tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:04.073168 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-482aff02-82c0-42b6-b83b-09cff6ef6ddc tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] [instance: 07019932-c686-4174-9828-3035fcc1694a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:04.080313 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-482aff02-82c0-42b6-b83b-09cff6ef6ddc tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:04.080902 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-482aff02-82c0-42b6-b83b-09cff6ef6ddc tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:04.081430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-482aff02-82c0-42b6-b83b-09cff6ef6ddc tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:04.082393 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-482aff02-82c0-42b6-b83b-09cff6ef6ddc tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:04.083052 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-482aff02-82c0-42b6-b83b-09cff6ef6ddc tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:04.083699 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-482aff02-82c0-42b6-b83b-09cff6ef6ddc tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:04.104034 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-482aff02-82c0-42b6-b83b-09cff6ef6ddc tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] HTTP exception thrown: Instance 07019932-c686-4174-9828-3035fcc1694a could not be found. Sep 17 20:51:04.111802 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-482aff02-82c0-42b6-b83b-09cff6ef6ddc tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Request method failure captured: Sep 17 20:51:04.111802 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a HTTP/1.1 Sep 17 20:51:04.111802 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:51:04.111802 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:51:04.111802 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:51:04.111802 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:51:04.111802 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:51:04.111802 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:51:04.111802 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:51:04.111802 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:04.111802 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjMP34TYun5BBq97IkaCVfqR_d5rT2Cqj-QpNSGP2nA9ZnhVRfAkuqse8FF4chJS5sGWxf9TEjAkBIvGEU7LAz1I1mZdnEBKRa-YLSYxugejYiiZJCOb2l8f21fquwt6bs6C_s_g6O6jpWM9eeltUhSFiTe8CYMYhnI-4FrEQ8Vusf8 Sep 17 20:51:04.111802 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:51:04.111802 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:51:04.111802 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:51:04.111802 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:51:04.111802 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:51:04.111802 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:51:04.111802 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: aa4ffd27d7414061b67e053657044400 Sep 17 20:51:04.111802 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-AggregatesAdminTestJSON-2039352809 Sep 17 20:51:04.111802 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:51:04.111802 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:51:04.113287 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aa4ffd27d7414061b67e053657044400"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/aa4ffd27d7414061b67e053657044400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aa4ffd27d7414061b67e053657044400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_aa4ffd27d7414061b67e053657044400", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:04.113287 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-AggregatesAdminTestJSON-2039352809 Sep 17 20:51:04.113287 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: aa4ffd27d7414061b67e053657044400 Sep 17 20:51:04.113287 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2039352809 Sep 17 20:51:04.113287 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-AggregatesAdminTestJSON-2039352809-project Sep 17 20:51:04.113287 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:51:04.113287 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:51:04.113287 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: f05aab669547487d8876a70e338d3e4a Sep 17 20:51:04.113287 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-AggregatesAdminTestJSON-2039352809-project Sep 17 20:51:04.113287 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:51:04.113287 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 07019932-c686-4174-9828-3035fcc1694a could not be found. Sep 17 20:51:04.113287 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '07019932-c686-4174-9828-3035fcc1694a'} Sep 17 20:51:04.114324 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:04.114324 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:04.114324 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:51:04.114324 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:51:04.114324 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:51:04.114324 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:51:04.114324 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:51:04.114324 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:51:04.114324 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:51:04.114324 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:51:04.114324 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07019932-c686-4174-9828-3035fcc1694a could not be found. Sep 17 20:51:04.114324 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:04.114324 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:04.114324 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:04.114324 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:04.114324 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:04.114324 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:04.114324 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:04.114324 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:04.114324 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:04.115676 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:04.115676 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:51:04.115676 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:51:04.115676 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:51:04.115676 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:51:04.115676 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:51:04.115676 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:51:04.115676 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07019932-c686-4174-9828-3035fcc1694a could not be found. Sep 17 20:51:04.115676 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:04.115676 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:04.115676 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:04.115676 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:04.115676 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:04.115676 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:04.115676 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:04.115676 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:04.115676 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07019932-c686-4174-9828-3035fcc1694a could not be found. Sep 17 20:51:04.115676 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:04.121841 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-482aff02-82c0-42b6-b83b-09cff6ef6ddc tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Returning 404 to user: Instance 07019932-c686-4174-9828-3035fcc1694a could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:04.123415 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-482aff02-82c0-42b6-b83b-09cff6ef6ddc tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] 10.222.0.26 "GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a" status: 404 len: 111 microversion: 2.1 time: 0.069459 Sep 17 20:51:04.124737 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 147/230] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:04 2022] GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:04.135298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3f333d4a-4fd9-4c85-a9e9-7c07d87c9c74 tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Calling method '.version_select at 0x7f25a5ffd700>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:04.139529 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f333d4a-4fd9-4c85-a9e9-7c07d87c9c74 tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:04.142008 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f333d4a-4fd9-4c85-a9e9-7c07d87c9c74 tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:04.142617 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f333d4a-4fd9-4c85-a9e9-7c07d87c9c74 tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:04.169021 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f333d4a-4fd9-4c85-a9e9-7c07d87c9c74 tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:04.169663 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f333d4a-4fd9-4c85-a9e9-7c07d87c9c74 tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:04.170171 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f333d4a-4fd9-4c85-a9e9-7c07d87c9c74 tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:04.183952 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3f333d4a-4fd9-4c85-a9e9-7c07d87c9c74 tempest-HypervisorAdminV253TestBase-1991334315 tempest-HypervisorAdminV253TestBase-1991334315-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/7e61048c-3be9-40c0-a2b2-3c2a600dc4fc" status: 200 len: 792 microversion: 2.53 time: 0.056879 Sep 17 20:51:04.186171 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 148/231] 10.222.0.26 () {60 vars in 1298 bytes} [Sat Sep 17 20:51:04 2022] GET /compute/v2.1/os-hypervisors/7e61048c-3be9-40c0-a2b2-3c2a600dc4fc => generated 792 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:51:04.206458 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-693f7e8b-6f8f-4095-930c-fa9e79c59f5c tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:04.233984 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-693f7e8b-6f8f-4095-930c-fa9e79c59f5c tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:04.235410 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-693f7e8b-6f8f-4095-930c-fa9e79c59f5c tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:04.235925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-693f7e8b-6f8f-4095-930c-fa9e79c59f5c tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:04.380429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f8420007-92b3-49ca-88ee-ae625b4c7233 tempest-SecurityGroupsTestAdminJSON-42007216 tempest-SecurityGroupsTestAdminJSON-42007216-project] Action: 'create', calling method: .version_select at 0x7f25a5e65c10>, body: {"security_group": {"name": "tempest-securitygroup-975694547", "description": "tempest-description-17799538"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:04.777606 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f8420007-92b3-49ca-88ee-ae625b4c7233 tempest-SecurityGroupsTestAdminJSON-42007216 tempest-SecurityGroupsTestAdminJSON-42007216-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 0.818212 Sep 17 20:51:04.778531 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 84/232] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Sep 17 20:51:03 2022] POST /compute/v2.1/os-security-groups => generated 218 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:04.783118 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6680e900-7582-42a8-9232-d74934d6a07f tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:04.783728 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6680e900-7582-42a8-9232-d74934d6a07f tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] [instance: f297915d-a9fc-44c9-8bc6-a4a682978ed9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:04.792429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6680e900-7582-42a8-9232-d74934d6a07f tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:04.793014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6680e900-7582-42a8-9232-d74934d6a07f tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:04.793643 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6680e900-7582-42a8-9232-d74934d6a07f tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:04.794508 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6680e900-7582-42a8-9232-d74934d6a07f tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:04.795110 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6680e900-7582-42a8-9232-d74934d6a07f tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:04.795684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6680e900-7582-42a8-9232-d74934d6a07f tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:05.072724 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6680e900-7582-42a8-9232-d74934d6a07f tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6d47d564174aceb110b3354ff7db2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f273bfff7ced4f2e885d1ead94a9a486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:05.083497 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6680e900-7582-42a8-9232-d74934d6a07f tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] 10.222.0.26 "GET /compute/v2.1/servers/f297915d-a9fc-44c9-8bc6-a4a682978ed9" status: 200 len: 1335 microversion: 2.1 time: 0.303821 Sep 17 20:51:05.102667 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 85/233] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:04 2022] GET /compute/v2.1/servers/f297915d-a9fc-44c9-8bc6-a4a682978ed9 => generated 1335 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:05.109303 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-14d46ebf-e395-4645-ae09-bf1d1c74820f tempest-SecurityGroupsTestAdminJSON-42007216 tempest-SecurityGroupsTestAdminJSON-42007216-project] Action: 'create', calling method: .version_select at 0x7f25a5e30550>, body: {"security_group": {"name": "tempest-securitygroup-1424967786", "description": "tempest-description-21432718"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:05.236893 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-693f7e8b-6f8f-4095-930c-fa9e79c59f5c tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.1 time: 1.039300 Sep 17 20:51:05.237974 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 149/234] 10.222.0.26 () {60 vars in 1191 bytes} [Sat Sep 17 20:51:04 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:05.265833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-20ebdef3-7a1d-4548-9ca9-11fc3b65ab9c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:05.265833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-20ebdef3-7a1d-4548-9ca9-11fc3b65ab9c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:05.279191 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-20ebdef3-7a1d-4548-9ca9-11fc3b65ab9c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:05.280518 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-20ebdef3-7a1d-4548-9ca9-11fc3b65ab9c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:05.282615 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-20ebdef3-7a1d-4548-9ca9-11fc3b65ab9c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:05.284771 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-20ebdef3-7a1d-4548-9ca9-11fc3b65ab9c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:05.285999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-20ebdef3-7a1d-4548-9ca9-11fc3b65ab9c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:05.288512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-20ebdef3-7a1d-4548-9ca9-11fc3b65ab9c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:05.574673 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-20ebdef3-7a1d-4548-9ca9-11fc3b65ab9c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:05.584888 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-20ebdef3-7a1d-4548-9ca9-11fc3b65ab9c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1470 microversion: 2.1 time: 0.335791 Sep 17 20:51:05.588401 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 150/235] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:05 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1470 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:05.594190 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-14d46ebf-e395-4645-ae09-bf1d1c74820f tempest-SecurityGroupsTestAdminJSON-42007216 tempest-SecurityGroupsTestAdminJSON-42007216-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.490164 Sep 17 20:51:05.595758 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 86/236] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Sep 17 20:51:05 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:05.605677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-79c16360-d193-4952-8b52-cce5d89c572b req-04b232c1-7551-4b85-965a-9e95b8926175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dbd958b-d480-41e3-b36b-4d3c7fa55d1c", "name": "network-vif-deleted", "tag": "5dfa3fc2-0525-47cd-8ef7-b5446595e1bb"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:05.613499 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5662deab-4df9-47e2-8181-b17226983907 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:05.614205 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5662deab-4df9-47e2-8181-b17226983907 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:05.627858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5662deab-4df9-47e2-8181-b17226983907 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:05.628869 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5662deab-4df9-47e2-8181-b17226983907 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:05.629836 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5662deab-4df9-47e2-8181-b17226983907 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:05.630780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5662deab-4df9-47e2-8181-b17226983907 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:05.631650 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5662deab-4df9-47e2-8181-b17226983907 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:05.632291 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5662deab-4df9-47e2-8181-b17226983907 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:05.633061 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-79c16360-d193-4952-8b52-cce5d89c572b req-04b232c1-7551-4b85-965a-9e95b8926175 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:05.633752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-79c16360-d193-4952-8b52-cce5d89c572b req-04b232c1-7551-4b85-965a-9e95b8926175 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:05.634223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-79c16360-d193-4952-8b52-cce5d89c572b req-04b232c1-7551-4b85-965a-9e95b8926175 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:05.647035 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-79c16360-d193-4952-8b52-cce5d89c572b req-04b232c1-7551-4b85-965a-9e95b8926175 service nova] Creating event network-vif-deleted:5dfa3fc2-0525-47cd-8ef7-b5446595e1bb for instance 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c on nch1-master-1 Sep 17 20:51:05.652843 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-79c16360-d193-4952-8b52-cce5d89c572b req-04b232c1-7551-4b85-965a-9e95b8926175 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055894 Sep 17 20:51:05.654378 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 87/237] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:05.659823 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7caf54fe-4f04-4267-8cd0-119e28277f8f tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:05.683302 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5662deab-4df9-47e2-8181-b17226983907 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:05.683857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5662deab-4df9-47e2-8181-b17226983907 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:05.684433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5662deab-4df9-47e2-8181-b17226983907 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:05.684959 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-5662deab-4df9-47e2-8181-b17226983907 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lazy-loading 'fault' on Instance uuid 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:51:05.696341 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7caf54fe-4f04-4267-8cd0-119e28277f8f tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.040421 Sep 17 20:51:05.697079 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 88/238] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Sep 17 20:51:05 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 17 20:51:05.764207 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5662deab-4df9-47e2-8181-b17226983907 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8bfe1d590a4500b7e7b5c79a6a4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea88200545ae4003b42b0d475f482c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:05.775222 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5662deab-4df9-47e2-8181-b17226983907 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] 10.222.0.26 "GET /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c" status: 200 len: 1310 microversion: 2.1 time: 0.175848 Sep 17 20:51:05.776156 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 151/239] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:05 2022] GET /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c => generated 1310 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:05.782486 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-89e2baa0-65c1-4480-93f4-9109e42cc0aa tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1252729687"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:05.786835 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.aggregate [None req-89e2baa0-65c1-4480-93f4-9109e42cc0aa tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Generated uuid df7b1be0-2670-4435-abb4-eda5c12a19c0 for aggregate {{(pid=140524) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 17 20:51:05.839756 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-89e2baa0-65c1-4480-93f4-9109e42cc0aa tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.062108 Sep 17 20:51:05.847899 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 152/240] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Sep 17 20:51:05 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:05.853167 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-eeb2ac92-1b12-4774-9f58-46055d2e3dcf tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:05.868272 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eeb2ac92-1b12-4774-9f58-46055d2e3dcf tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:05.869402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eeb2ac92-1b12-4774-9f58-46055d2e3dcf tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:05.869402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eeb2ac92-1b12-4774-9f58-46055d2e3dcf tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:05.893278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6a804966-08a0-4285-b2d1-f6d964d6e49c tempest-SecurityGroupsTestAdminJSON-1853209631 tempest-SecurityGroupsTestAdminJSON-1853209631-project-admin] Action: 'create', calling method: .version_select at 0x7f25a613f700>, body: {"security_group": {"name": "tempest-securitygroup-1271442388", "description": "tempest-description-559426351"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:06.072875 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-eeb2ac92-1b12-4774-9f58-46055d2e3dcf tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.223798 Sep 17 20:51:06.080237 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 153/241] 10.222.0.26 () {60 vars in 1191 bytes} [Sat Sep 17 20:51:05 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:06.088716 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-59f5fd74-7a43-4f50-b39a-28d84a7008b9 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:06.108194 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-59f5fd74-7a43-4f50-b39a-28d84a7008b9 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 242 microversion: 2.1 time: 0.026542 Sep 17 20:51:06.108819 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 154/242] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Sep 17 20:51:06 2022] GET /compute/v2.1/os-aggregates/2 => generated 242 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:06.123472 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-de80ea7e-9017-4621-9e85-9219b1dee0ba tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:06.134250 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-de80ea7e-9017-4621-9e85-9219b1dee0ba tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:06.134752 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-de80ea7e-9017-4621-9e85-9219b1dee0ba tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:06.135186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-de80ea7e-9017-4621-9e85-9219b1dee0ba tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:06.331903 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:51:06.357324 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-de80ea7e-9017-4621-9e85-9219b1dee0ba tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.240672 Sep 17 20:51:06.367632 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 155/243] 10.222.0.26 () {60 vars in 1191 bytes} [Sat Sep 17 20:51:06 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:06.381324 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-25bba1ce-1a3e-4bf7-84c6-d504821214ed tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:06.386017 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-25bba1ce-1a3e-4bf7-84c6-d504821214ed tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] [instance: f297915d-a9fc-44c9-8bc6-a4a682978ed9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:06.402736 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-25bba1ce-1a3e-4bf7-84c6-d504821214ed tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:06.404244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-25bba1ce-1a3e-4bf7-84c6-d504821214ed tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:06.405446 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-25bba1ce-1a3e-4bf7-84c6-d504821214ed tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:06.406813 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-25bba1ce-1a3e-4bf7-84c6-d504821214ed tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:06.408339 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-25bba1ce-1a3e-4bf7-84c6-d504821214ed tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:06.408802 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-25bba1ce-1a3e-4bf7-84c6-d504821214ed tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:06.427755 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6a804966-08a0-4285-b2d1-f6d964d6e49c tempest-SecurityGroupsTestAdminJSON-1853209631 tempest-SecurityGroupsTestAdminJSON-1853209631-project-admin] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.729332 Sep 17 20:51:06.428398 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 89/244] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Sep 17 20:51:05 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:06.443710 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-53dbe149-281a-4e73-8fa8-aba8c9811379 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:06.493015 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-53dbe149-281a-4e73-8fa8-aba8c9811379 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.053660 Sep 17 20:51:06.493631 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 90/245] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Sep 17 20:51:06 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 17 20:51:06.502440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0393715d-86fa-4088-85d3-911ed165b00a tempest-SecurityGroupsTestAdminJSON-1853209631 tempest-SecurityGroupsTestAdminJSON-1853209631-project-admin] Action: 'create', calling method: .version_select at 0x7f25a5f7aca0>, body: {"security_group": {"name": "tempest-securitygroup-1262840746", "description": "tempest-description-1442621507"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:06.678345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-25bba1ce-1a3e-4bf7-84c6-d504821214ed tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6d47d564174aceb110b3354ff7db2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f273bfff7ced4f2e885d1ead94a9a486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:06.707945 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-25bba1ce-1a3e-4bf7-84c6-d504821214ed tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] 10.222.0.26 "GET /compute/v2.1/servers/f297915d-a9fc-44c9-8bc6-a4a682978ed9" status: 200 len: 1314 microversion: 2.1 time: 0.336321 Sep 17 20:51:06.708830 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 156/246] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:06 2022] GET /compute/v2.1/servers/f297915d-a9fc-44c9-8bc6-a4a682978ed9 => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:06.713950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e896ddd0-bd24-4ba8-ae5b-9ffda507e784 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1883353217"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:06.717765 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.aggregate [None req-e896ddd0-bd24-4ba8-ae5b-9ffda507e784 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Generated uuid faaf5906-78ee-4fc5-aed2-a867265ba5fe for aggregate {{(pid=140524) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 17 20:51:06.741996 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e896ddd0-bd24-4ba8-ae5b-9ffda507e784 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.031700 Sep 17 20:51:06.745779 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 157/247] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Sep 17 20:51:06 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:06.754943 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-58556d52-4021-4666-b3dd-f2765e016097 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:06.756873 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-58556d52-4021-4666-b3dd-f2765e016097 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:06.769052 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58556d52-4021-4666-b3dd-f2765e016097 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:06.770686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58556d52-4021-4666-b3dd-f2765e016097 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:06.771289 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58556d52-4021-4666-b3dd-f2765e016097 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:06.772238 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58556d52-4021-4666-b3dd-f2765e016097 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:06.773244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58556d52-4021-4666-b3dd-f2765e016097 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:06.773932 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58556d52-4021-4666-b3dd-f2765e016097 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:06.810428 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0393715d-86fa-4088-85d3-911ed165b00a tempest-SecurityGroupsTestAdminJSON-1853209631 tempest-SecurityGroupsTestAdminJSON-1853209631-project-admin] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.314825 Sep 17 20:51:06.811436 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 91/248] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Sep 17 20:51:06 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:06.816227 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-534e6160-7ce2-46a6-b1fc-0272a814a86c tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:06.829408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-534e6160-7ce2-46a6-b1fc-0272a814a86c tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:06.830285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-534e6160-7ce2-46a6-b1fc-0272a814a86c tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:06.830957 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-534e6160-7ce2-46a6-b1fc-0272a814a86c tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:06.968033 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-58556d52-4021-4666-b3dd-f2765e016097 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:06.983050 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-58556d52-4021-4666-b3dd-f2765e016097 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1470 microversion: 2.1 time: 0.237964 Sep 17 20:51:06.985519 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 158/249] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:06 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1470 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:06.999216 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-426f8f52-0dcf-4794-a85a-0168d1a6d143 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:07.000419 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-426f8f52-0dcf-4794-a85a-0168d1a6d143 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:07.008270 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-534e6160-7ce2-46a6-b1fc-0272a814a86c tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.195405 Sep 17 20:51:07.009434 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 92/250] 10.222.0.26 () {60 vars in 1191 bytes} [Sat Sep 17 20:51:06 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:07.018892 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-426f8f52-0dcf-4794-a85a-0168d1a6d143 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:07.019423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-426f8f52-0dcf-4794-a85a-0168d1a6d143 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:07.019886 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-426f8f52-0dcf-4794-a85a-0168d1a6d143 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:07.020724 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-426f8f52-0dcf-4794-a85a-0168d1a6d143 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:07.021228 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-426f8f52-0dcf-4794-a85a-0168d1a6d143 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:07.021947 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-426f8f52-0dcf-4794-a85a-0168d1a6d143 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:07.031115 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3a579a9b-8a66-4fd8-b5bb-ab354d053fd1 tempest-SecurityGroupsTestAdminJSON-1853209631 tempest-SecurityGroupsTestAdminJSON-1853209631-project-admin] Calling method '.version_select at 0x7f25a5f91a60>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:07.042398 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-426f8f52-0dcf-4794-a85a-0168d1a6d143 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] HTTP exception thrown: Instance 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c could not be found. Sep 17 20:51:07.044739 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-426f8f52-0dcf-4794-a85a-0168d1a6d143 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Request method failure captured: Sep 17 20:51:07.044739 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c HTTP/1.1 Sep 17 20:51:07.044739 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:51:07.044739 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:51:07.044739 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:51:07.044739 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:51:07.044739 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:51:07.044739 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:51:07.044739 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:51:07.044739 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:07.044739 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjMaYrxIL6h4qcGuFMeqKqphq1adSMhKHrjNGVVp5u0pH6PnPcBcNEhis_Uane9mEDAD2XrnYVR6zfaST-lIE2PllyUvTM9burnMTmywv5i-OBgbvw_OqjpozQbRG-mW7T0vuT25AtljnxKKm16V3oLjIFH_Y8C9a3xknUQStmaS5xM Sep 17 20:51:07.044739 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:51:07.044739 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:51:07.044739 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:51:07.044739 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:51:07.044739 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:51:07.044739 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:51:07.044739 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: ea88200545ae4003b42b0d475f482c9d Sep 17 20:51:07.044739 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-DeleteServersAdminTestJSON-281195364 Sep 17 20:51:07.044739 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:51:07.044739 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:51:07.046059 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ea88200545ae4003b42b0d475f482c9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ea88200545ae4003b42b0d475f482c9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ea88200545ae4003b42b0d475f482c9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ea88200545ae4003b42b0d475f482c9d", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:07.046059 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-DeleteServersAdminTestJSON-281195364 Sep 17 20:51:07.046059 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: ea88200545ae4003b42b0d475f482c9d Sep 17 20:51:07.046059 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-281195364 Sep 17 20:51:07.046059 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-DeleteServersAdminTestJSON-281195364-project Sep 17 20:51:07.046059 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:51:07.046059 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:51:07.046059 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: eb8bfe1d590a4500b7e7b5c79a6a4e6b Sep 17 20:51:07.046059 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-DeleteServersAdminTestJSON-281195364-project Sep 17 20:51:07.046059 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:51:07.046059 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c could not be found. Sep 17 20:51:07.046059 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '7dbd958b-d480-41e3-b36b-4d3c7fa55d1c'} Sep 17 20:51:07.046762 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:07.046762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:07.046762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:51:07.046762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:51:07.046762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:51:07.046762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:51:07.046762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:51:07.046762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:51:07.046762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:51:07.046762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:51:07.046762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c could not be found. Sep 17 20:51:07.046762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:07.046762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:07.046762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:07.046762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:07.046762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:07.046762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:07.046762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:07.046762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:07.046762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:07.049061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:07.049061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:51:07.049061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:51:07.049061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:51:07.049061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:51:07.049061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:51:07.049061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:51:07.049061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c could not be found. Sep 17 20:51:07.049061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:07.049061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:07.049061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:07.049061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:07.049061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:07.049061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:07.049061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:07.049061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:07.049061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c could not be found. Sep 17 20:51:07.049061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:07.050076 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-426f8f52-0dcf-4794-a85a-0168d1a6d143 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Returning 404 to user: Instance 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:07.050076 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-426f8f52-0dcf-4794-a85a-0168d1a6d143 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] 10.222.0.26 "GET /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c" status: 404 len: 111 microversion: 2.1 time: 0.057154 Sep 17 20:51:07.050076 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 159/251] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:06 2022] GET /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:07.059276 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e602da2d-8928-4e37-bad3-9bb66dab85e8 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:07.069199 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e602da2d-8928-4e37-bad3-9bb66dab85e8 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.019399 Sep 17 20:51:07.078019 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 160/252] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Sep 17 20:51:07 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:07.085820 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-71317256-79f8-4d49-9d80-0f4839ae6bae tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:07.101875 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71317256-79f8-4d49-9d80-0f4839ae6bae tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:07.102911 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71317256-79f8-4d49-9d80-0f4839ae6bae tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:07.103518 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71317256-79f8-4d49-9d80-0f4839ae6bae tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:07.253330 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-71317256-79f8-4d49-9d80-0f4839ae6bae tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.172811 Sep 17 20:51:07.254743 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 161/253] 10.222.0.26 () {60 vars in 1191 bytes} [Sat Sep 17 20:51:07 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:07.260016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e0a64cf1-10ac-4a23-b428-db3846bdb100 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-338185108", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:07.327694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-e0a64cf1-10ac-4a23-b428-db3846bdb100 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] validate_networks() for None {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:51:07.842428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-e0a64cf1-10ac-4a23-b428-db3846bdb100 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:51:07.843527 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-e0a64cf1-10ac-4a23-b428-db3846bdb100 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:51:07.844407 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-e0a64cf1-10ac-4a23-b428-db3846bdb100 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:51:07.845072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-e0a64cf1-10ac-4a23-b428-db3846bdb100 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:51:07.845744 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-e0a64cf1-10ac-4a23-b428-db3846bdb100 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:51:07.858537 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e0a64cf1-10ac-4a23-b428-db3846bdb100 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:07.859474 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e0a64cf1-10ac-4a23-b428-db3846bdb100 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:07.860201 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e0a64cf1-10ac-4a23-b428-db3846bdb100 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:07.861793 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e0a64cf1-10ac-4a23-b428-db3846bdb100 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:07.862679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e0a64cf1-10ac-4a23-b428-db3846bdb100 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:07.863700 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e0a64cf1-10ac-4a23-b428-db3846bdb100 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:07.891622 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-e0a64cf1-10ac-4a23-b428-db3846bdb100 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Getting quotas for project ea88200545ae4003b42b0d475f482c9d. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:51:07.897388 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-e0a64cf1-10ac-4a23-b428-db3846bdb100 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Getting quotas for user eb8bfe1d590a4500b7e7b5c79a6a4e6b and project ea88200545ae4003b42b0d475f482c9d. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:51:07.914802 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e0a64cf1-10ac-4a23-b428-db3846bdb100 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:51:07.918986 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e0a64cf1-10ac-4a23-b428-db3846bdb100 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 22274a46-3915-4c4a-891b-e5da0ab9423b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:51:08.011592 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e0a64cf1-10ac-4a23-b428-db3846bdb100 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.755412 Sep 17 20:51:08.012647 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 162/254] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:51:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:51:08.018091 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b22cf9ce-244a-4566-a3d3-72ae78684351 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:08.035844 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=18 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:51:08.067289 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b22cf9ce-244a-4566-a3d3-72ae78684351 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.053454 Sep 17 20:51:08.075248 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 163/255] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Sep 17 20:51:08 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 17 20:51:08.081025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a0ebb08e-0789-460d-804e-3e68e1f53770 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:08.082600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a0ebb08e-0789-460d-804e-3e68e1f53770 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] [instance: f297915d-a9fc-44c9-8bc6-a4a682978ed9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:08.090672 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0ebb08e-0789-460d-804e-3e68e1f53770 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:08.091871 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0ebb08e-0789-460d-804e-3e68e1f53770 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:08.092321 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0ebb08e-0789-460d-804e-3e68e1f53770 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:08.093045 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0ebb08e-0789-460d-804e-3e68e1f53770 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:08.093524 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0ebb08e-0789-460d-804e-3e68e1f53770 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:08.094274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0ebb08e-0789-460d-804e-3e68e1f53770 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:08.341785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a0ebb08e-0789-460d-804e-3e68e1f53770 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6d47d564174aceb110b3354ff7db2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f273bfff7ced4f2e885d1ead94a9a486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:08.350535 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a0ebb08e-0789-460d-804e-3e68e1f53770 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] 10.222.0.26 "GET /compute/v2.1/servers/f297915d-a9fc-44c9-8bc6-a4a682978ed9" status: 200 len: 1314 microversion: 2.1 time: 0.273872 Sep 17 20:51:08.351248 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 164/256] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:08 2022] GET /compute/v2.1/servers/f297915d-a9fc-44c9-8bc6-a4a682978ed9 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:08.362004 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-8313e7d4-87f4-414c-8a99-ee543a2c6c10 req-817a3655-2e64-47f6-b269-c389ee5b0c5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f297915d-a9fc-44c9-8bc6-a4a682978ed9", "tag": "cb30ce08-bf71-4a71-a3c2-55fe12f9aadd"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:08.384787 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8313e7d4-87f4-414c-8a99-ee543a2c6c10 req-817a3655-2e64-47f6-b269-c389ee5b0c5b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:08.385273 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8313e7d4-87f4-414c-8a99-ee543a2c6c10 req-817a3655-2e64-47f6-b269-c389ee5b0c5b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:08.389222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8313e7d4-87f4-414c-8a99-ee543a2c6c10 req-817a3655-2e64-47f6-b269-c389ee5b0c5b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:08.405172 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-8313e7d4-87f4-414c-8a99-ee543a2c6c10 req-817a3655-2e64-47f6-b269-c389ee5b0c5b service nova] Creating event network-changed:cb30ce08-bf71-4a71-a3c2-55fe12f9aadd for instance f297915d-a9fc-44c9-8bc6-a4a682978ed9 on nch2-master-1 Sep 17 20:51:08.411838 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-8313e7d4-87f4-414c-8a99-ee543a2c6c10 req-817a3655-2e64-47f6-b269-c389ee5b0c5b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059294 Sep 17 20:51:08.417187 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 165/257] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:08.423861 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-476753ca-6b54-4439-be5c-f49e86283e36 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:08.425005 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-476753ca-6b54-4439-be5c-f49e86283e36 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:08.432828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-476753ca-6b54-4439-be5c-f49e86283e36 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:08.433751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-476753ca-6b54-4439-be5c-f49e86283e36 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:08.434512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-476753ca-6b54-4439-be5c-f49e86283e36 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:08.435479 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-476753ca-6b54-4439-be5c-f49e86283e36 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:08.436172 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-476753ca-6b54-4439-be5c-f49e86283e36 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:08.436753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-476753ca-6b54-4439-be5c-f49e86283e36 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:08.512191 ncdv-master-1 devstack@n-api.service[140523]: DEBUG neutronclient.v2_0.client [None req-3a579a9b-8a66-4fd8-b5bb-ab354d053fd1 tempest-SecurityGroupsTestAdminJSON-1853209631 tempest-SecurityGroupsTestAdminJSON-1853209631-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8c7edb4e-be54-4fc1-b5f6-6b49a5b5ca96 does not exist", "detail": ""}} {{(pid=140523) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 17 20:51:08.512917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.security_group_api [None req-3a579a9b-8a66-4fd8-b5bb-ab354d053fd1 tempest-SecurityGroupsTestAdminJSON-1853209631 tempest-SecurityGroupsTestAdminJSON-1853209631-project-admin] Neutron security group 8c7edb4e-be54-4fc1-b5f6-6b49a5b5ca96 not found {{(pid=140523) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 17 20:51:08.513390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.compute.security_groups [None req-3a579a9b-8a66-4fd8-b5bb-ab354d053fd1 tempest-SecurityGroupsTestAdminJSON-1853209631 tempest-SecurityGroupsTestAdminJSON-1853209631-project-admin] Security Group ID 8c7edb4e-be54-4fc1-b5f6-6b49a5b5ca96 does not exist {{(pid=140523) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Sep 17 20:51:08.566812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG neutronclient.v2_0.client [None req-3a579a9b-8a66-4fd8-b5bb-ab354d053fd1 tempest-SecurityGroupsTestAdminJSON-1853209631 tempest-SecurityGroupsTestAdminJSON-1853209631-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8c7edb4e-be54-4fc1-b5f6-6b49a5b5ca96 does not exist", "detail": ""}} {{(pid=140523) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 17 20:51:08.567477 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.security_group_api [None req-3a579a9b-8a66-4fd8-b5bb-ab354d053fd1 tempest-SecurityGroupsTestAdminJSON-1853209631 tempest-SecurityGroupsTestAdminJSON-1853209631-project-admin] Neutron security group 8c7edb4e-be54-4fc1-b5f6-6b49a5b5ca96 not found {{(pid=140523) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 17 20:51:08.568018 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.compute.security_groups [None req-3a579a9b-8a66-4fd8-b5bb-ab354d053fd1 tempest-SecurityGroupsTestAdminJSON-1853209631 tempest-SecurityGroupsTestAdminJSON-1853209631-project-admin] Security Group ID 8c7edb4e-be54-4fc1-b5f6-6b49a5b5ca96 does not exist {{(pid=140523) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Sep 17 20:51:08.810716 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-476753ca-6b54-4439-be5c-f49e86283e36 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:08.823316 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-476753ca-6b54-4439-be5c-f49e86283e36 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1475 microversion: 2.1 time: 0.402562 Sep 17 20:51:08.825803 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 166/258] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:08 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1475 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:08.839533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-aa22a6be-ed97-4747-b938-5c95ed10ed26 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:08.840248 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-aa22a6be-ed97-4747-b938-5c95ed10ed26 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 22274a46-3915-4c4a-891b-e5da0ab9423b] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:08.860426 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa22a6be-ed97-4747-b938-5c95ed10ed26 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:08.861218 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa22a6be-ed97-4747-b938-5c95ed10ed26 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:08.862750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa22a6be-ed97-4747-b938-5c95ed10ed26 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:08.864683 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa22a6be-ed97-4747-b938-5c95ed10ed26 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:08.867882 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa22a6be-ed97-4747-b938-5c95ed10ed26 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:08.868869 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa22a6be-ed97-4747-b938-5c95ed10ed26 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:08.985137 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-aa22a6be-ed97-4747-b938-5c95ed10ed26 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8bfe1d590a4500b7e7b5c79a6a4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea88200545ae4003b42b0d475f482c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:08.999468 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-aa22a6be-ed97-4747-b938-5c95ed10ed26 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] 10.222.0.26 "GET /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b" status: 200 len: 1215 microversion: 2.1 time: 0.171647 Sep 17 20:51:09.000439 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 167/259] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:08 2022] GET /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b => generated 1215 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:09.010280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e5fdd298-60c1-4e25-a5f0-f909494eccd8 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-919235691"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:09.023791 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.aggregate [None req-e5fdd298-60c1-4e25-a5f0-f909494eccd8 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Generated uuid 50359348-ccf7-4e9b-b78f-52d190a23a78 for aggregate {{(pid=140524) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 17 20:51:09.066799 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e5fdd298-60c1-4e25-a5f0-f909494eccd8 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.064934 Sep 17 20:51:09.068035 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 168/260] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Sep 17 20:51:09 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:09.094241 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-733515c4-c53f-41c3-9ca8-462ebc046be0 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:09.142070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-733515c4-c53f-41c3-9ca8-462ebc046be0 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:09.142850 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-733515c4-c53f-41c3-9ca8-462ebc046be0 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:09.143806 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-733515c4-c53f-41c3-9ca8-462ebc046be0 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:09.378999 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-733515c4-c53f-41c3-9ca8-462ebc046be0 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 241 microversion: 2.1 time: 0.303328 Sep 17 20:51:09.381024 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 169/261] 10.222.0.26 () {60 vars in 1191 bytes} [Sat Sep 17 20:51:09 2022] POST /compute/v2.1/os-aggregates/4/action => generated 241 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:09.395797 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f112a47c-f53a-46b3-b1eb-d029ba4bed62 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:09.398733 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f112a47c-f53a-46b3-b1eb-d029ba4bed62 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] [instance: f297915d-a9fc-44c9-8bc6-a4a682978ed9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:09.409064 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f112a47c-f53a-46b3-b1eb-d029ba4bed62 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:09.409591 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f112a47c-f53a-46b3-b1eb-d029ba4bed62 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:09.410488 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f112a47c-f53a-46b3-b1eb-d029ba4bed62 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:09.411938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f112a47c-f53a-46b3-b1eb-d029ba4bed62 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:09.412536 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f112a47c-f53a-46b3-b1eb-d029ba4bed62 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:09.413105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f112a47c-f53a-46b3-b1eb-d029ba4bed62 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:09.530576 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3a579a9b-8a66-4fd8-b5bb-ab354d053fd1 tempest-SecurityGroupsTestAdminJSON-1853209631 tempest-SecurityGroupsTestAdminJSON-1853209631-project-admin] 10.222.0.26 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 8543 microversion: 2.1 time: 2.519841 Sep 17 20:51:09.533262 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 93/262] 10.222.0.26 () {58 vars in 1191 bytes} [Sat Sep 17 20:51:07 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 8543 bytes in 2523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:09.539866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-09c62b71-f7af-4a0d-92c6-5d939aa89991 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:09.561979 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09c62b71-f7af-4a0d-92c6-5d939aa89991 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:09.562961 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09c62b71-f7af-4a0d-92c6-5d939aa89991 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:09.563780 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09c62b71-f7af-4a0d-92c6-5d939aa89991 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:09.614788 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f112a47c-f53a-46b3-b1eb-d029ba4bed62 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6d47d564174aceb110b3354ff7db2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f273bfff7ced4f2e885d1ead94a9a486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:09.629761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:51:09.633329 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f112a47c-f53a-46b3-b1eb-d029ba4bed62 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] 10.222.0.26 "GET /compute/v2.1/servers/f297915d-a9fc-44c9-8bc6-a4a682978ed9" status: 200 len: 1314 microversion: 2.1 time: 0.245936 Sep 17 20:51:09.637754 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 170/263] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:09 2022] GET /compute/v2.1/servers/f297915d-a9fc-44c9-8bc6-a4a682978ed9 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:09.648661 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a9912af9-7c23-4df1-8481-2471ec3ba3de tempest-SecurityGroupsTestAdminJSON-42007216 tempest-SecurityGroupsTestAdminJSON-42007216-project] Calling method '.version_select at 0x7f25a5ec1e50>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:09.796117 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-09c62b71-f7af-4a0d-92c6-5d939aa89991 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.261636 Sep 17 20:51:09.797289 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 94/264] 10.222.0.26 () {60 vars in 1191 bytes} [Sat Sep 17 20:51:09 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:09.824617 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6dec25e4-7143-4f2a-8a6e-91ef95f86353 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:09.884887 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6dec25e4-7143-4f2a-8a6e-91ef95f86353 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.079034 Sep 17 20:51:09.886142 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 95/265] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Sep 17 20:51:09 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 17 20:51:09.898776 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-856279ce-5e12-4d6b-ac63-594b02c396a4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:09.899574 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-856279ce-5e12-4d6b-ac63-594b02c396a4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:09.912254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-856279ce-5e12-4d6b-ac63-594b02c396a4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:09.912555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-856279ce-5e12-4d6b-ac63-594b02c396a4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:09.914109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-856279ce-5e12-4d6b-ac63-594b02c396a4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:09.914875 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-856279ce-5e12-4d6b-ac63-594b02c396a4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:09.915604 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-856279ce-5e12-4d6b-ac63-594b02c396a4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:09.916046 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-856279ce-5e12-4d6b-ac63-594b02c396a4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:09.993431 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a9912af9-7c23-4df1-8481-2471ec3ba3de tempest-SecurityGroupsTestAdminJSON-42007216 tempest-SecurityGroupsTestAdminJSON-42007216-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1108 microversion: 2.1 time: 0.353684 Sep 17 20:51:09.994554 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 171/266] 10.222.0.26 () {58 vars in 1191 bytes} [Sat Sep 17 20:51:09 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1108 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:10.000016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1b5475fa-9454-4840-9c6c-9a718a2f452b tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-601701566"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:10.006373 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.aggregate [None req-1b5475fa-9454-4840-9c6c-9a718a2f452b tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Generated uuid 87dadda4-3d60-4d6d-80c8-a596c4228984 for aggregate {{(pid=140524) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 17 20:51:10.071814 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1b5475fa-9454-4840-9c6c-9a718a2f452b tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.075172 Sep 17 20:51:10.072504 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 172/267] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Sep 17 20:51:09 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:10.084089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-798f1d00-5027-4afc-87e4-6d8d25d88794 tempest-AggregatesAdminTestV241-1202500803 tempest-AggregatesAdminTestV241-1202500803-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-338765722"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:10.088961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.aggregate [None req-798f1d00-5027-4afc-87e4-6d8d25d88794 tempest-AggregatesAdminTestV241-1202500803 tempest-AggregatesAdminTestV241-1202500803-project-admin] Generated uuid 6a9d572c-5f63-49a9-a254-1d355fb9abbc for aggregate {{(pid=140524) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 17 20:51:10.103930 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-856279ce-5e12-4d6b-ac63-594b02c396a4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:10.113730 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-798f1d00-5027-4afc-87e4-6d8d25d88794 tempest-AggregatesAdminTestV241-1202500803 tempest-AggregatesAdminTestV241-1202500803-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.039844 Sep 17 20:51:10.114426 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-856279ce-5e12-4d6b-ac63-594b02c396a4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1475 microversion: 2.1 time: 0.226684 Sep 17 20:51:10.115279 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 173/268] 10.222.0.26 () {62 vars in 1205 bytes} [Sat Sep 17 20:51:10 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:51:10.119977 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b075fcb1-970c-419e-8c44-dcd987415e9c tempest-SecurityGroupsTestAdminJSON-1853209631 tempest-SecurityGroupsTestAdminJSON-1853209631-project-admin] Calling method '.version_select at 0x7f25a5eea3a0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:10.128189 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 96/269] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:09 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1475 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:10.135808 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-44c14bc3-3a93-40c0-963a-f36d5e677397 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:10.136447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-44c14bc3-3a93-40c0-963a-f36d5e677397 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 22274a46-3915-4c4a-891b-e5da0ab9423b] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:10.142688 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44c14bc3-3a93-40c0-963a-f36d5e677397 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:10.143365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44c14bc3-3a93-40c0-963a-f36d5e677397 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:10.143806 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44c14bc3-3a93-40c0-963a-f36d5e677397 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:10.144507 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44c14bc3-3a93-40c0-963a-f36d5e677397 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:10.145142 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44c14bc3-3a93-40c0-963a-f36d5e677397 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:10.145592 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44c14bc3-3a93-40c0-963a-f36d5e677397 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:10.227388 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-44c14bc3-3a93-40c0-963a-f36d5e677397 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8bfe1d590a4500b7e7b5c79a6a4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea88200545ae4003b42b0d475f482c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:10.236693 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-44c14bc3-3a93-40c0-963a-f36d5e677397 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] 10.222.0.26 "GET /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b" status: 200 len: 1277 microversion: 2.1 time: 0.107399 Sep 17 20:51:10.237645 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 97/270] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:10 2022] GET /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b => generated 1277 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:10.323125 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b075fcb1-970c-419e-8c44-dcd987415e9c tempest-SecurityGroupsTestAdminJSON-1853209631 tempest-SecurityGroupsTestAdminJSON-1853209631-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/7bcd63ab-4fbe-4483-8372-f0c2305db55e" status: 202 len: 0 microversion: 2.1 time: 0.206461 Sep 17 20:51:10.327450 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 174/271] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 20:51:10 2022] DELETE /compute/v2.1/os-security-groups/7bcd63ab-4fbe-4483-8372-f0c2305db55e => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:51:10.375625 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-60b2f2bb-1f9c-469b-ad0d-49089716bd56 tempest-InstanceUsageAuditLogTestJSON-1557682732 tempest-InstanceUsageAuditLogTestJSON-1557682732-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:10.396662 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-dcdf49a3-ca8b-4d96-90eb-e01c31e27186 tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] Calling method '.version_select at 0x7f25a5e8c700>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:10.398768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dcdf49a3-ca8b-4d96-90eb-e01c31e27186 tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:10.399645 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dcdf49a3-ca8b-4d96-90eb-e01c31e27186 tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:10.400257 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dcdf49a3-ca8b-4d96-90eb-e01c31e27186 tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:10.413982 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-60b2f2bb-1f9c-469b-ad0d-49089716bd56 tempest-InstanceUsageAuditLogTestJSON-1557682732 tempest-InstanceUsageAuditLogTestJSON-1557682732-project-admin] 10.222.0.26 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-17 20:51:10" status: 200 len: 318 microversion: 2.1 time: 0.174626 Sep 17 20:51:10.414862 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 98/272] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Sep 17 20:51:10 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-17%2020%3A51%3A10 => generated 318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:10.421699 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dcdf49a3-ca8b-4d96-90eb-e01c31e27186 tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:10.422329 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dcdf49a3-ca8b-4d96-90eb-e01c31e27186 tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:10.422844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dcdf49a3-ca8b-4d96-90eb-e01c31e27186 tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:10.429004 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-db5eb3c8-36f3-451d-b3ff-068773e5c16c tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:10.443688 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dcdf49a3-ca8b-4d96-90eb-e01c31e27186 tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:10.444513 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dcdf49a3-ca8b-4d96-90eb-e01c31e27186 tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:10.445054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dcdf49a3-ca8b-4d96-90eb-e01c31e27186 tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:10.451661 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-db5eb3c8-36f3-451d-b3ff-068773e5c16c tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.035569 Sep 17 20:51:10.452411 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 99/273] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Sep 17 20:51:10 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 17 20:51:10.456546 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-dcdf49a3-ca8b-4d96-90eb-e01c31e27186 tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.127649 Sep 17 20:51:10.457281 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 175/274] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:51:10 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:10.461649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9c4827eb-0280-4145-826e-22b9926ac506 tempest-SecurityGroupsTestAdminJSON-1853209631 tempest-SecurityGroupsTestAdminJSON-1853209631-project-admin] Calling method '.version_select at 0x7f25a5eead30>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:10.463737 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7c8255f2-512b-4575-88ef-84a8c044dd7c tempest-AggregatesAdminTestV241-1202500803 tempest-AggregatesAdminTestV241-1202500803-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1295985208"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:10.569362 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7c8255f2-512b-4575-88ef-84a8c044dd7c tempest-AggregatesAdminTestV241-1202500803 tempest-AggregatesAdminTestV241-1202500803-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-aggregates/6" status: 200 len: 299 microversion: 2.41 time: 0.115638 Sep 17 20:51:10.573501 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 100/275] 10.222.0.26 () {62 vars in 1210 bytes} [Sat Sep 17 20:51:10 2022] PUT /compute/v2.1/os-aggregates/6 => generated 299 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:51:10.583321 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ddf80090-9015-4099-9b85-5193ef6f2b9b tempest-InstanceUsageAuditLogTestJSON-1557682732 tempest-InstanceUsageAuditLogTestJSON-1557682732-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:10.596357 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ddf80090-9015-4099-9b85-5193ef6f2b9b tempest-InstanceUsageAuditLogTestJSON-1557682732 tempest-InstanceUsageAuditLogTestJSON-1557682732-project-admin] 10.222.0.26 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.016996 Sep 17 20:51:10.596940 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 101/276] 10.222.0.26 () {58 vars in 1185 bytes} [Sat Sep 17 20:51:10 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:10.601876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-caed6c3e-0c0c-4314-a590-265eb00bf498 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:10.609597 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-caed6c3e-0c0c-4314-a590-265eb00bf498 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Sep 17 20:51:10.611953 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-caed6c3e-0c0c-4314-a590-265eb00bf498 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Request method failure captured: Sep 17 20:51:10.611953 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Sep 17 20:51:10.611953 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:51:10.611953 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:51:10.611953 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:51:10.611953 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:51:10.611953 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:51:10.611953 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:51:10.611953 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:51:10.611953 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:10.611953 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjMRwmiyxSh1Lt24aMN0uwRRZXltSOfmQ2fbppwg_vU6Nxo4cPZkWNK8sIDxEWxbiyvY1pQijLbOwBKfmKM5c-RAA0Pg2U9wr9kj3SBbKPhju_9ZHboK64wRPkpDNsxF7KMWS9rADEpAn_-0eRZZexi67Fy9fSZujBVhCT5sWeecvCA Sep 17 20:51:10.611953 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:51:10.611953 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:51:10.611953 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:51:10.611953 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:51:10.611953 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:51:10.611953 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:51:10.611953 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 13bb5c9671214f449194584247b12e4d Sep 17 20:51:10.611953 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-AggregatesAdminTestJSON-212244595 Sep 17 20:51:10.611953 ncdv-master-1 devstack@n-api.service[140523]: X-Role: admin,member,reader Sep 17 20:51:10.611953 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: admin,member,reader Sep 17 20:51:10.613378 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13bb5c9671214f449194584247b12e4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/13bb5c9671214f449194584247b12e4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13bb5c9671214f449194584247b12e4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_13bb5c9671214f449194584247b12e4d", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:10.613378 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-AggregatesAdminTestJSON-212244595 Sep 17 20:51:10.613378 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 13bb5c9671214f449194584247b12e4d Sep 17 20:51:10.613378 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-212244595 Sep 17 20:51:10.613378 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-AggregatesAdminTestJSON-212244595-project-admin Sep 17 20:51:10.613378 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:51:10.613378 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:51:10.613378 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 553cf96465f34dbcb6cc26d9fe1bd72e Sep 17 20:51:10.613378 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-AggregatesAdminTestJSON-212244595-project-admin Sep 17 20:51:10.613378 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:51:10.613378 ncdv-master-1 devstack@n-api.service[140523]: exception: Aggregate 5 could not be found. Sep 17 20:51:10.613378 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '5'} Sep 17 20:51:10.613378 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:10.614283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:10.614283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 17 20:51:10.614283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 17 20:51:10.614283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 17 20:51:10.614283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 17 20:51:10.614283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:51:10.614283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:51:10.614283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 17 20:51:10.614283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 17 20:51:10.614283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 17 20:51:10.614283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 17 20:51:10.614283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 17 20:51:10.614283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 17 20:51:10.614283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Sep 17 20:51:10.614283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:10.614283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:10.614283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:10.614283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:10.614283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:10.615513 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:10.615513 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:10.615513 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:10.615513 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:10.615513 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:10.615513 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 17 20:51:10.615513 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:51:10.615513 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Sep 17 20:51:10.615513 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:10.615513 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:10.615513 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:10.615513 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:10.615513 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:10.615513 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:10.615513 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:10.615513 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:10.615513 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Sep 17 20:51:10.615513 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:10.617411 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-caed6c3e-0c0c-4314-a590-265eb00bf498 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:10.618447 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-caed6c3e-0c0c-4314-a590-265eb00bf498 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.020366 Sep 17 20:51:10.619467 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 102/277] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Sep 17 20:51:10 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 20:51:10.677871 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9c4827eb-0280-4145-826e-22b9926ac506 tempest-SecurityGroupsTestAdminJSON-1853209631 tempest-SecurityGroupsTestAdminJSON-1853209631-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/43366b23-e1a7-4992-a1a8-aa97b54418ae" status: 202 len: 0 microversion: 2.1 time: 0.219373 Sep 17 20:51:10.679094 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 176/278] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 20:51:10 2022] DELETE /compute/v2.1/os-security-groups/43366b23-e1a7-4992-a1a8-aa97b54418ae => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:51:10.692197 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cc53649e-9b58-4268-9d2f-1b656c066c5b tempest-AggregatesAdminTestV241-1202500803 tempest-AggregatesAdminTestV241-1202500803-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:10.723141 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cc53649e-9b58-4268-9d2f-1b656c066c5b tempest-AggregatesAdminTestV241-1202500803 tempest-AggregatesAdminTestV241-1202500803-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/6" status: 200 len: 299 microversion: 2.41 time: 0.037891 Sep 17 20:51:10.724692 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 177/279] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Sep 17 20:51:10 2022] GET /compute/v2.1/os-aggregates/6 => generated 299 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:51:10.738544 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-94f31c05-e284-4e2a-98b6-173b50b05a3d tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:10.768923 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-94f31c05-e284-4e2a-98b6-173b50b05a3d tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Sep 17 20:51:10.772937 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-94f31c05-e284-4e2a-98b6-173b50b05a3d tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Request method failure captured: Sep 17 20:51:10.772937 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Sep 17 20:51:10.772937 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:51:10.772937 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:51:10.772937 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:51:10.772937 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:51:10.772937 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:51:10.772937 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:51:10.772937 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:51:10.772937 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:10.772937 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjMRwmiyxSh1Lt24aMN0uwRRZXltSOfmQ2fbppwg_vU6Nxo4cPZkWNK8sIDxEWxbiyvY1pQijLbOwBKfmKM5c-RAA0Pg2U9wr9kj3SBbKPhju_9ZHboK64wRPkpDNsxF7KMWS9rADEpAn_-0eRZZexi67Fy9fSZujBVhCT5sWeecvCA Sep 17 20:51:10.772937 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:51:10.772937 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:51:10.772937 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:51:10.772937 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:51:10.772937 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:51:10.772937 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:51:10.772937 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 13bb5c9671214f449194584247b12e4d Sep 17 20:51:10.772937 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-AggregatesAdminTestJSON-212244595 Sep 17 20:51:10.772937 ncdv-master-1 devstack@n-api.service[140524]: X-Role: admin,member,reader Sep 17 20:51:10.772937 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: admin,member,reader Sep 17 20:51:10.774537 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13bb5c9671214f449194584247b12e4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/13bb5c9671214f449194584247b12e4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13bb5c9671214f449194584247b12e4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_13bb5c9671214f449194584247b12e4d", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:10.774537 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-AggregatesAdminTestJSON-212244595 Sep 17 20:51:10.774537 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 13bb5c9671214f449194584247b12e4d Sep 17 20:51:10.774537 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-212244595 Sep 17 20:51:10.774537 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-AggregatesAdminTestJSON-212244595-project-admin Sep 17 20:51:10.774537 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:51:10.774537 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:51:10.774537 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 553cf96465f34dbcb6cc26d9fe1bd72e Sep 17 20:51:10.774537 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-AggregatesAdminTestJSON-212244595-project-admin Sep 17 20:51:10.774537 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:51:10.774537 ncdv-master-1 devstack@n-api.service[140524]: exception: Aggregate 5 could not be found. Sep 17 20:51:10.774537 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '5'} Sep 17 20:51:10.774537 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:10.775363 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:10.775363 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 17 20:51:10.775363 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 17 20:51:10.775363 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 17 20:51:10.775363 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 17 20:51:10.775363 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:51:10.775363 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:51:10.775363 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:51:10.775363 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:51:10.775363 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 17 20:51:10.775363 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 17 20:51:10.775363 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 17 20:51:10.775363 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 17 20:51:10.775363 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:51:10.775363 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:51:10.775363 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 17 20:51:10.775363 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 17 20:51:10.775363 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 17 20:51:10.775363 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 17 20:51:10.776578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 17 20:51:10.776578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 17 20:51:10.776578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Sep 17 20:51:10.776578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:10.776578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:10.776578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:10.776578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:10.776578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:10.776578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:10.776578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:10.776578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:10.776578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:10.776578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:10.776578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 17 20:51:10.776578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:51:10.776578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Sep 17 20:51:10.776578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:10.776578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:10.776578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:10.776578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:10.776578 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:10.779001 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:10.779001 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:10.779001 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:10.779001 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Sep 17 20:51:10.779001 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:10.779001 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-94f31c05-e284-4e2a-98b6-173b50b05a3d tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:10.789053 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-94f31c05-e284-4e2a-98b6-173b50b05a3d tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.049389 Sep 17 20:51:10.791158 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6755ae9b-506b-4858-9f50-a328cf2f24bd tempest-HypervisorAdminNegativeUnderV252Test-564872281 tempest-HypervisorAdminNegativeUnderV252Test-564872281-project] Calling method '.version_select at 0x7f25a6197160>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:10.793259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6755ae9b-506b-4858-9f50-a328cf2f24bd tempest-HypervisorAdminNegativeUnderV252Test-564872281 tempest-HypervisorAdminNegativeUnderV252Test-564872281-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'c46036360ef3496c9104d08a7251ac6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb661478603944d4b3fef3ef84a2eaba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:10.797544 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 178/280] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Sep 17 20:51:10 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 20:51:10.797682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6755ae9b-506b-4858-9f50-a328cf2f24bd tempest-HypervisorAdminNegativeUnderV252Test-564872281 tempest-HypervisorAdminNegativeUnderV252Test-564872281-project] Request method failure captured: Sep 17 20:51:10.797682 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/os-hypervisors/nch2-master-1/search HTTP/1.1 Sep 17 20:51:10.797682 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:51:10.797682 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:51:10.797682 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:51:10.797682 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:51:10.797682 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:51:10.797682 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:51:10.797682 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:51:10.797682 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:10.797682 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjM8CQ3Dlac97IiwOzJEVgBeYZQOKyc2GGICX3mJXK1KkxYRaqZ9TdNfa1-yZaYFfup-VXvla96-AwKm20u2y69WtAh8O7WhGlAwZ_lc8KNHU8JO3iimzTk5glTGaXOIv2zzb2z3OlCzLqtfuHP13gVa3mmpD63sHiOq9FTI0H5w9tM Sep 17 20:51:10.797682 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:51:10.797682 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:51:10.797682 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:51:10.797682 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:51:10.797682 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:51:10.797682 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:51:10.797682 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: cb661478603944d4b3fef3ef84a2eaba Sep 17 20:51:10.797682 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-564872281 Sep 17 20:51:10.797682 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:51:10.797682 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:51:10.798865 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cb661478603944d4b3fef3ef84a2eaba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cb661478603944d4b3fef3ef84a2eaba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cb661478603944d4b3fef3ef84a2eaba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cb661478603944d4b3fef3ef84a2eaba", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:10.798865 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-564872281 Sep 17 20:51:10.798865 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: cb661478603944d4b3fef3ef84a2eaba Sep 17 20:51:10.798865 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-564872281 Sep 17 20:51:10.798865 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-564872281-project Sep 17 20:51:10.798865 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:51:10.798865 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:51:10.798865 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: c46036360ef3496c9104d08a7251ac6b Sep 17 20:51:10.798865 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-564872281-project Sep 17 20:51:10.798865 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 20:51:10.798865 ncdv-master-1 devstack@n-api.service[140523]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 17 20:51:10.798865 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'nch2-master-1'} Sep 17 20:51:10.799529 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:10.799529 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:10.799529 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:10.799529 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:10.799529 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:10.799529 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:10.799529 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:51:10.799529 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:51:10.799529 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:10.799529 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:10.799529 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Sep 17 20:51:10.799529 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Sep 17 20:51:10.799529 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 17 20:51:10.799529 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 17 20:51:10.799529 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 17 20:51:10.799529 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 17 20:51:10.799529 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:51:10.799529 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:51:10.799529 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:51:10.800519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:51:10.800519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 17 20:51:10.800519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 17 20:51:10.800519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 17 20:51:10.800519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 17 20:51:10.800519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 17 20:51:10.800519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 17 20:51:10.800519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 17 20:51:10.800519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:10.800519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:10.800519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:10.800519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:10.800519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:10.800519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:10.800519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 17 20:51:10.800519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 17 20:51:10.800519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 17 20:51:10.800519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:10.801453 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6755ae9b-506b-4858-9f50-a328cf2f24bd tempest-HypervisorAdminNegativeUnderV252Test-564872281 tempest-HypervisorAdminNegativeUnderV252Test-564872281-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:10.801453 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6755ae9b-506b-4858-9f50-a328cf2f24bd tempest-HypervisorAdminNegativeUnderV252Test-564872281 tempest-HypervisorAdminNegativeUnderV252Test-564872281-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/nch2-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.176316 Sep 17 20:51:10.801453 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 103/281] 10.222.0.26 () {58 vars in 1209 bytes} [Sat Sep 17 20:51:10 2022] GET /compute/v2.1/os-hypervisors/nch2-master-1/search => generated 117 bytes in 177 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:10.806118 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-902f3be5-4855-4cb6-99d5-c4129c49ca0c tempest-SecurityGroupsTestAdminJSON-42007216 tempest-SecurityGroupsTestAdminJSON-42007216-project] Calling method '.version_select at 0x7f25a5deb280>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:10.806726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-df307b10-c96f-4527-b822-b18cb4408a91 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:10.807412 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-df307b10-c96f-4527-b822-b18cb4408a91 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] [instance: f297915d-a9fc-44c9-8bc6-a4a682978ed9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:10.826875 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-df307b10-c96f-4527-b822-b18cb4408a91 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:10.834101 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-df307b10-c96f-4527-b822-b18cb4408a91 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:10.834966 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-df307b10-c96f-4527-b822-b18cb4408a91 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:10.836299 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-df307b10-c96f-4527-b822-b18cb4408a91 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:10.837014 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-df307b10-c96f-4527-b822-b18cb4408a91 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:10.838262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-df307b10-c96f-4527-b822-b18cb4408a91 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:11.068230 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-df307b10-c96f-4527-b822-b18cb4408a91 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6d47d564174aceb110b3354ff7db2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f273bfff7ced4f2e885d1ead94a9a486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:11.081170 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-df307b10-c96f-4527-b822-b18cb4408a91 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] 10.222.0.26 "GET /compute/v2.1/servers/f297915d-a9fc-44c9-8bc6-a4a682978ed9" status: 200 len: 1314 microversion: 2.1 time: 0.285812 Sep 17 20:51:11.103222 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 179/282] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:10 2022] GET /compute/v2.1/servers/f297915d-a9fc-44c9-8bc6-a4a682978ed9 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:11.111885 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d98a6d7e-4406-4d16-9e3e-5a21c208324b tempest-AggregatesAdminTestV241-1202500803 tempest-AggregatesAdminTestV241-1202500803-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:11.139335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d98a6d7e-4406-4d16-9e3e-5a21c208324b tempest-AggregatesAdminTestV241-1202500803 tempest-AggregatesAdminTestV241-1202500803-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:11.140444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d98a6d7e-4406-4d16-9e3e-5a21c208324b tempest-AggregatesAdminTestV241-1202500803 tempest-AggregatesAdminTestV241-1202500803-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:11.141300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d98a6d7e-4406-4d16-9e3e-5a21c208324b tempest-AggregatesAdminTestV241-1202500803 tempest-AggregatesAdminTestV241-1202500803-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:11.167826 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-902f3be5-4855-4cb6-99d5-c4129c49ca0c tempest-SecurityGroupsTestAdminJSON-42007216 tempest-SecurityGroupsTestAdminJSON-42007216-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/01d7a626-d6ec-4082-a8c8-3daee06c8c0a" status: 202 len: 0 microversion: 2.1 time: 0.369078 Sep 17 20:51:11.169384 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 104/283] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 20:51:10 2022] DELETE /compute/v2.1/os-security-groups/01d7a626-d6ec-4082-a8c8-3daee06c8c0a => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:51:11.175949 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-693aae55-abb6-4ee3-9850-4fac97e26264 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1584957070", "name": "tempest-test_aggregate-159207033"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:11.202756 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=4,nova_api:INSERT=9 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:51:11.205264 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.aggregate [None req-693aae55-abb6-4ee3-9850-4fac97e26264 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Generated uuid 41aeebe2-56c0-4127-b193-be66b9b473f5 for aggregate {{(pid=140523) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 17 20:51:11.296742 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-693aae55-abb6-4ee3-9850-4fac97e26264 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.124543 Sep 17 20:51:11.297757 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 105/284] 10.222.0.26 () {60 vars in 1165 bytes} [Sat Sep 17 20:51:11 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:11.325821 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e193aaac-aab4-4fe0-aafa-cd83748b7dc0 tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] Calling method '.version_select at 0x7f25a5deb8b0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:11.327901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e193aaac-aab4-4fe0-aafa-cd83748b7dc0 tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:11.334661 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e193aaac-aab4-4fe0-aafa-cd83748b7dc0 tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:11.335453 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e193aaac-aab4-4fe0-aafa-cd83748b7dc0 tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:11.352329 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-e193aaac-aab4-4fe0-aafa-cd83748b7dc0 tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 17 20:51:11.354166 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e193aaac-aab4-4fe0-aafa-cd83748b7dc0 tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] Request method failure captured: Sep 17 20:51:11.354166 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Sep 17 20:51:11.354166 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:51:11.354166 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:51:11.354166 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:51:11.354166 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:51:11.354166 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:51:11.354166 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:51:11.354166 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:51:11.354166 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:11.354166 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjM9M_eb5R5dUiB9KxVimhNcjh5eh25hF2f6-SzQwWBuI5lKbz-XoVJpLDZoa_4QPrur_ERfyd2VPwxWNANWs4TRxFV3O1PnF7WkB3m44pPZbh6fBWBAbdBJ4yL-2JQF8WR6zaqLZR1tCFs7IR7LORxczDUpjADxEeXxYQoanHem6i4 Sep 17 20:51:11.354166 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:51:11.354166 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:51:11.354166 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:51:11.354166 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:51:11.354166 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:51:11.354166 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:51:11.354166 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 21281fd8f1714b81a541a5711dddef9f Sep 17 20:51:11.354166 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1147752151 Sep 17 20:51:11.354166 ncdv-master-1 devstack@n-api.service[140523]: X-Role: admin,member,reader Sep 17 20:51:11.354166 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: admin,member,reader Sep 17 20:51:11.355657 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/21281fd8f1714b81a541a5711dddef9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/21281fd8f1714b81a541a5711dddef9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/21281fd8f1714b81a541a5711dddef9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_21281fd8f1714b81a541a5711dddef9f", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:11.355657 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1147752151 Sep 17 20:51:11.355657 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 21281fd8f1714b81a541a5711dddef9f Sep 17 20:51:11.355657 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1147752151 Sep 17 20:51:11.355657 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin Sep 17 20:51:11.355657 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:51:11.355657 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:51:11.355657 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 1905e658a7984328a82ac7cae4e7d5d9 Sep 17 20:51:11.355657 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin Sep 17 20:51:11.355657 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 20:51:11.355657 ncdv-master-1 devstack@n-api.service[140523]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 17 20:51:11.355657 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'nonexistent_hypervisor_name'} Sep 17 20:51:11.357256 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:11.357256 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:11.357256 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:11.357256 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:11.357256 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:11.357256 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:11.357256 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:51:11.357256 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:51:11.357256 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:11.357256 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:11.357256 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Sep 17 20:51:11.357256 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 17 20:51:11.357256 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 17 20:51:11.357256 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 17 20:51:11.357256 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 17 20:51:11.357256 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:11.357256 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:11.357256 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:11.357256 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:11.357256 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:11.360569 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:11.360569 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:11.360569 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:11.360569 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 17 20:51:11.360569 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:11.362769 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e193aaac-aab4-4fe0-aafa-cd83748b7dc0 tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:11.363967 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e193aaac-aab4-4fe0-aafa-cd83748b7dc0 tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.065127 Sep 17 20:51:11.364756 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 106/285] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Sep 17 20:51:11 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:11.373301 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cfc7ee11-0bdc-4904-9d36-a7a8a081294e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:11.374373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cfc7ee11-0bdc-4904-9d36-a7a8a081294e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:11.384862 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cfc7ee11-0bdc-4904-9d36-a7a8a081294e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:11.384862 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cfc7ee11-0bdc-4904-9d36-a7a8a081294e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:11.385305 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cfc7ee11-0bdc-4904-9d36-a7a8a081294e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:11.386702 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cfc7ee11-0bdc-4904-9d36-a7a8a081294e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:11.387483 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cfc7ee11-0bdc-4904-9d36-a7a8a081294e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:11.388150 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cfc7ee11-0bdc-4904-9d36-a7a8a081294e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:11.478406 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d98a6d7e-4406-4d16-9e3e-5a21c208324b tempest-AggregatesAdminTestV241-1202500803 tempest-AggregatesAdminTestV241-1202500803-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 314 microversion: 2.41 time: 0.373290 Sep 17 20:51:11.480650 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 180/286] 10.222.0.26 () {62 vars in 1232 bytes} [Sat Sep 17 20:51:11 2022] POST /compute/v2.1/os-aggregates/6/action => generated 314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:51:11.496173 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bcafa195-af57-44b2-92c6-ba511036f237 tempest-SecurityGroupsTestAdminJSON-42007216 tempest-SecurityGroupsTestAdminJSON-42007216-project] Calling method '.version_select at 0x7f25a5eea430>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:11.755621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cfc7ee11-0bdc-4904-9d36-a7a8a081294e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:11.764866 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cfc7ee11-0bdc-4904-9d36-a7a8a081294e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1475 microversion: 2.1 time: 0.398811 Sep 17 20:51:11.779318 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 107/287] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:11 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1475 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:11.785968 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-10dcd78a-5739-49b2-b0e4-70f6e18a9346 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:11.787133 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-10dcd78a-5739-49b2-b0e4-70f6e18a9346 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 22274a46-3915-4c4a-891b-e5da0ab9423b] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:11.798294 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10dcd78a-5739-49b2-b0e4-70f6e18a9346 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:11.798789 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10dcd78a-5739-49b2-b0e4-70f6e18a9346 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:11.799221 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10dcd78a-5739-49b2-b0e4-70f6e18a9346 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:11.801221 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10dcd78a-5739-49b2-b0e4-70f6e18a9346 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:11.801710 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10dcd78a-5739-49b2-b0e4-70f6e18a9346 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:11.802293 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10dcd78a-5739-49b2-b0e4-70f6e18a9346 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:11.980748 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bcafa195-af57-44b2-92c6-ba511036f237 tempest-SecurityGroupsTestAdminJSON-42007216 tempest-SecurityGroupsTestAdminJSON-42007216-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/a568f462-ad53-4452-9911-34224e236af4" status: 202 len: 0 microversion: 2.1 time: 0.498447 Sep 17 20:51:11.982050 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 181/288] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 20:51:11 2022] DELETE /compute/v2.1/os-security-groups/a568f462-ad53-4452-9911-34224e236af4 => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:51:11.986863 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8d6144fb-b210-4858-941b-17e61a417585 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:12.059036 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8d6144fb-b210-4858-941b-17e61a417585 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.075695 Sep 17 20:51:12.064489 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 182/289] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Sep 17 20:51:11 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 17 20:51:12.077792 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e47c5613-5ba0-4249-96dc-fcaccef4201d tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] Calling method '.version_select at 0x7f25a5e8c8b0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:12.081032 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e47c5613-5ba0-4249-96dc-fcaccef4201d tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:12.084298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e47c5613-5ba0-4249-96dc-fcaccef4201d tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:12.084844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e47c5613-5ba0-4249-96dc-fcaccef4201d tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:12.102449 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-10dcd78a-5739-49b2-b0e4-70f6e18a9346 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8bfe1d590a4500b7e7b5c79a6a4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea88200545ae4003b42b0d475f482c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:12.115289 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-10dcd78a-5739-49b2-b0e4-70f6e18a9346 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] 10.222.0.26 "GET /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b" status: 200 len: 1319 microversion: 2.1 time: 0.334329 Sep 17 20:51:12.116019 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 108/290] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:11 2022] GET /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b => generated 1319 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:12.123712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-636a15f2-33c9-422e-a82f-709a6b933f54 tempest-AggregatesAdminTestV241-1202500803 tempest-AggregatesAdminTestV241-1202500803-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:12.125749 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e47c5613-5ba0-4249-96dc-fcaccef4201d tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:12.129785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e47c5613-5ba0-4249-96dc-fcaccef4201d tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:12.130320 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e47c5613-5ba0-4249-96dc-fcaccef4201d tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:12.141705 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-636a15f2-33c9-422e-a82f-709a6b933f54 tempest-AggregatesAdminTestV241-1202500803 tempest-AggregatesAdminTestV241-1202500803-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:12.144851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-636a15f2-33c9-422e-a82f-709a6b933f54 tempest-AggregatesAdminTestV241-1202500803 tempest-AggregatesAdminTestV241-1202500803-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:12.145111 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e47c5613-5ba0-4249-96dc-fcaccef4201d tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:12.145651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e47c5613-5ba0-4249-96dc-fcaccef4201d tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:12.146094 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e47c5613-5ba0-4249-96dc-fcaccef4201d tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:12.146451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-636a15f2-33c9-422e-a82f-709a6b933f54 tempest-AggregatesAdminTestV241-1202500803 tempest-AggregatesAdminTestV241-1202500803-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:12.152402 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e47c5613-5ba0-4249-96dc-fcaccef4201d tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.086749 Sep 17 20:51:12.152992 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 183/291] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:51:12 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:12.165223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-08b09db6-d470-4978-a83e-e0f52f4525d2 req-c128cb39-766e-480c-ad04-e56deb0be5e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22274a46-3915-4c4a-891b-e5da0ab9423b", "tag": "27b42713-be20-4875-931b-d88248412715"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:12.175322 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-08b09db6-d470-4978-a83e-e0f52f4525d2 req-c128cb39-766e-480c-ad04-e56deb0be5e0 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:12.175798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-08b09db6-d470-4978-a83e-e0f52f4525d2 req-c128cb39-766e-480c-ad04-e56deb0be5e0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:12.176242 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-08b09db6-d470-4978-a83e-e0f52f4525d2 req-c128cb39-766e-480c-ad04-e56deb0be5e0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:12.188323 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-08b09db6-d470-4978-a83e-e0f52f4525d2 req-c128cb39-766e-480c-ad04-e56deb0be5e0 service nova] Creating event network-changed:27b42713-be20-4875-931b-d88248412715 for instance 22274a46-3915-4c4a-891b-e5da0ab9423b on nch1-master-1 Sep 17 20:51:12.194463 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-08b09db6-d470-4978-a83e-e0f52f4525d2 req-c128cb39-766e-480c-ad04-e56deb0be5e0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032844 Sep 17 20:51:12.196264 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 184/292] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:12.202512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7ba3d412-303c-4031-9fe9-b6ef5c1ed9a8 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:12.209976 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-7ba3d412-303c-4031-9fe9-b6ef5c1ed9a8 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Sep 17 20:51:12.211985 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7ba3d412-303c-4031-9fe9-b6ef5c1ed9a8 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Request method failure captured: Sep 17 20:51:12.211985 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Sep 17 20:51:12.211985 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:51:12.211985 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:51:12.211985 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:51:12.211985 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:51:12.211985 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:51:12.211985 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:51:12.211985 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:51:12.211985 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:12.211985 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjMRwmiyxSh1Lt24aMN0uwRRZXltSOfmQ2fbppwg_vU6Nxo4cPZkWNK8sIDxEWxbiyvY1pQijLbOwBKfmKM5c-RAA0Pg2U9wr9kj3SBbKPhju_9ZHboK64wRPkpDNsxF7KMWS9rADEpAn_-0eRZZexi67Fy9fSZujBVhCT5sWeecvCA Sep 17 20:51:12.211985 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:51:12.211985 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:51:12.211985 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:51:12.211985 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:51:12.211985 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:51:12.211985 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:51:12.211985 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 13bb5c9671214f449194584247b12e4d Sep 17 20:51:12.211985 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-AggregatesAdminTestJSON-212244595 Sep 17 20:51:12.211985 ncdv-master-1 devstack@n-api.service[140524]: X-Role: admin,member,reader Sep 17 20:51:12.211985 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: admin,member,reader Sep 17 20:51:12.213346 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13bb5c9671214f449194584247b12e4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/13bb5c9671214f449194584247b12e4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13bb5c9671214f449194584247b12e4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_13bb5c9671214f449194584247b12e4d", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:12.213346 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-AggregatesAdminTestJSON-212244595 Sep 17 20:51:12.213346 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 13bb5c9671214f449194584247b12e4d Sep 17 20:51:12.213346 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-212244595 Sep 17 20:51:12.213346 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-AggregatesAdminTestJSON-212244595-project-admin Sep 17 20:51:12.213346 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:51:12.213346 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:51:12.213346 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 553cf96465f34dbcb6cc26d9fe1bd72e Sep 17 20:51:12.213346 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-AggregatesAdminTestJSON-212244595-project-admin Sep 17 20:51:12.213346 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:51:12.213346 ncdv-master-1 devstack@n-api.service[140524]: exception: Aggregate 7 could not be found. Sep 17 20:51:12.213346 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '7'} Sep 17 20:51:12.213346 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:12.214106 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:12.214106 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 17 20:51:12.214106 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 17 20:51:12.214106 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 17 20:51:12.214106 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 17 20:51:12.214106 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:51:12.214106 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:51:12.214106 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 17 20:51:12.214106 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 17 20:51:12.214106 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 17 20:51:12.214106 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 17 20:51:12.214106 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 17 20:51:12.214106 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 17 20:51:12.214106 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Sep 17 20:51:12.214106 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:12.214106 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:12.214106 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:12.214106 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:12.214106 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:12.215231 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:12.215231 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:12.215231 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:12.215231 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:12.215231 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:12.215231 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 17 20:51:12.215231 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:51:12.215231 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Sep 17 20:51:12.215231 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:12.215231 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:12.215231 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:12.215231 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:12.215231 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:12.215231 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:12.215231 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:12.215231 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:12.215231 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Sep 17 20:51:12.215231 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:12.216219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7ba3d412-303c-4031-9fe9-b6ef5c1ed9a8 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:12.217145 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7ba3d412-303c-4031-9fe9-b6ef5c1ed9a8 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.018840 Sep 17 20:51:12.218177 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 185/293] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Sep 17 20:51:12 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 20:51:12.223813 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1666f84d-89ca-47f4-a72d-2213190e0b0c tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:12.224950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1666f84d-89ca-47f4-a72d-2213190e0b0c tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] [instance: f297915d-a9fc-44c9-8bc6-a4a682978ed9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:12.232464 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1666f84d-89ca-47f4-a72d-2213190e0b0c tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:12.233328 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1666f84d-89ca-47f4-a72d-2213190e0b0c tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:12.234189 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1666f84d-89ca-47f4-a72d-2213190e0b0c tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:12.235141 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1666f84d-89ca-47f4-a72d-2213190e0b0c tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:12.235742 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1666f84d-89ca-47f4-a72d-2213190e0b0c tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:12.236322 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1666f84d-89ca-47f4-a72d-2213190e0b0c tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:12.310073 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-636a15f2-33c9-422e-a82f-709a6b933f54 tempest-AggregatesAdminTestV241-1202500803 tempest-AggregatesAdminTestV241-1202500803-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 299 microversion: 2.41 time: 0.192769 Sep 17 20:51:12.312581 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 109/294] 10.222.0.26 () {62 vars in 1232 bytes} [Sat Sep 17 20:51:12 2022] POST /compute/v2.1/os-aggregates/6/action => generated 299 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:51:12.318990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7c3b24c3-4cf9-475f-8903-bd035a499167 tempest-HypervisorAdminNegativeUnderV252Test-564872281 tempest-HypervisorAdminNegativeUnderV252Test-564872281-project] Calling method '.version_select at 0x7f25a5d8f310>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:12.320976 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7c3b24c3-4cf9-475f-8903-bd035a499167 tempest-HypervisorAdminNegativeUnderV252Test-564872281 tempest-HypervisorAdminNegativeUnderV252Test-564872281-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'c46036360ef3496c9104d08a7251ac6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb661478603944d4b3fef3ef84a2eaba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:12.322813 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7c3b24c3-4cf9-475f-8903-bd035a499167 tempest-HypervisorAdminNegativeUnderV252Test-564872281 tempest-HypervisorAdminNegativeUnderV252Test-564872281-project] Request method failure captured: Sep 17 20:51:12.322813 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Sep 17 20:51:12.322813 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:51:12.322813 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:51:12.322813 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:51:12.322813 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:51:12.322813 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:51:12.322813 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:51:12.322813 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:51:12.322813 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:12.322813 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjM8CQ3Dlac97IiwOzJEVgBeYZQOKyc2GGICX3mJXK1KkxYRaqZ9TdNfa1-yZaYFfup-VXvla96-AwKm20u2y69WtAh8O7WhGlAwZ_lc8KNHU8JO3iimzTk5glTGaXOIv2zzb2z3OlCzLqtfuHP13gVa3mmpD63sHiOq9FTI0H5w9tM Sep 17 20:51:12.322813 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:51:12.322813 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:51:12.322813 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:51:12.322813 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:51:12.322813 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:51:12.322813 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:51:12.322813 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: cb661478603944d4b3fef3ef84a2eaba Sep 17 20:51:12.322813 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-564872281 Sep 17 20:51:12.322813 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:51:12.322813 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:51:12.324080 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cb661478603944d4b3fef3ef84a2eaba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cb661478603944d4b3fef3ef84a2eaba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cb661478603944d4b3fef3ef84a2eaba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cb661478603944d4b3fef3ef84a2eaba", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:12.324080 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-564872281 Sep 17 20:51:12.324080 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: cb661478603944d4b3fef3ef84a2eaba Sep 17 20:51:12.324080 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-564872281 Sep 17 20:51:12.324080 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-564872281-project Sep 17 20:51:12.324080 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:51:12.324080 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:51:12.324080 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: c46036360ef3496c9104d08a7251ac6b Sep 17 20:51:12.324080 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-564872281-project Sep 17 20:51:12.324080 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 20:51:12.324080 ncdv-master-1 devstack@n-api.service[140523]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 17 20:51:12.324080 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '1'} Sep 17 20:51:12.324746 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:12.324746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:12.324746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:12.324746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:12.324746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:12.324746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:12.324746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:51:12.324746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:51:12.324746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:12.324746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:12.324746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Sep 17 20:51:12.324746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Sep 17 20:51:12.324746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 17 20:51:12.324746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 17 20:51:12.324746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 17 20:51:12.324746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 17 20:51:12.324746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:51:12.324746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:51:12.324746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:51:12.325806 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:51:12.325806 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 17 20:51:12.325806 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 17 20:51:12.325806 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 17 20:51:12.325806 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 17 20:51:12.325806 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 17 20:51:12.325806 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 17 20:51:12.325806 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 17 20:51:12.325806 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:12.325806 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:12.325806 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:12.325806 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:12.325806 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:12.325806 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:12.325806 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 17 20:51:12.325806 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 17 20:51:12.325806 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 17 20:51:12.325806 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:12.328128 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7c3b24c3-4cf9-475f-8903-bd035a499167 tempest-HypervisorAdminNegativeUnderV252Test-564872281 tempest-HypervisorAdminNegativeUnderV252Test-564872281-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:12.329132 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7c3b24c3-4cf9-475f-8903-bd035a499167 tempest-HypervisorAdminNegativeUnderV252Test-564872281 tempest-HypervisorAdminNegativeUnderV252Test-564872281-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.014780 Sep 17 20:51:12.334640 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 110/295] 10.222.0.26 () {58 vars in 1176 bytes} [Sat Sep 17 20:51:12 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:12.341690 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-afd02b49-77fb-4c42-9c25-bb9d9441f066 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:12.354046 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-afd02b49-77fb-4c42-9c25-bb9d9441f066 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Sep 17 20:51:12.355753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-afd02b49-77fb-4c42-9c25-bb9d9441f066 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Request method failure captured: Sep 17 20:51:12.355753 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Sep 17 20:51:12.355753 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:51:12.355753 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:51:12.355753 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:51:12.355753 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:51:12.355753 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:51:12.355753 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:51:12.355753 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:51:12.355753 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:12.355753 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjMRwmiyxSh1Lt24aMN0uwRRZXltSOfmQ2fbppwg_vU6Nxo4cPZkWNK8sIDxEWxbiyvY1pQijLbOwBKfmKM5c-RAA0Pg2U9wr9kj3SBbKPhju_9ZHboK64wRPkpDNsxF7KMWS9rADEpAn_-0eRZZexi67Fy9fSZujBVhCT5sWeecvCA Sep 17 20:51:12.355753 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:51:12.355753 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:51:12.355753 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:51:12.355753 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:51:12.355753 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:51:12.355753 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:51:12.355753 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 13bb5c9671214f449194584247b12e4d Sep 17 20:51:12.355753 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-AggregatesAdminTestJSON-212244595 Sep 17 20:51:12.355753 ncdv-master-1 devstack@n-api.service[140523]: X-Role: admin,member,reader Sep 17 20:51:12.355753 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: admin,member,reader Sep 17 20:51:12.357067 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13bb5c9671214f449194584247b12e4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/13bb5c9671214f449194584247b12e4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13bb5c9671214f449194584247b12e4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_13bb5c9671214f449194584247b12e4d", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:12.357067 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-AggregatesAdminTestJSON-212244595 Sep 17 20:51:12.357067 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 13bb5c9671214f449194584247b12e4d Sep 17 20:51:12.357067 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-212244595 Sep 17 20:51:12.357067 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-AggregatesAdminTestJSON-212244595-project-admin Sep 17 20:51:12.357067 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:51:12.357067 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:51:12.357067 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 553cf96465f34dbcb6cc26d9fe1bd72e Sep 17 20:51:12.357067 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-AggregatesAdminTestJSON-212244595-project-admin Sep 17 20:51:12.357067 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:51:12.357067 ncdv-master-1 devstack@n-api.service[140523]: exception: Aggregate 7 could not be found. Sep 17 20:51:12.357067 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '7'} Sep 17 20:51:12.357067 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:12.357802 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:12.357802 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 17 20:51:12.357802 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 17 20:51:12.357802 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 17 20:51:12.357802 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 17 20:51:12.357802 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:51:12.357802 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:51:12.357802 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:51:12.357802 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:51:12.357802 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 17 20:51:12.357802 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 17 20:51:12.357802 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 17 20:51:12.357802 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 17 20:51:12.357802 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:51:12.357802 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:51:12.357802 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 17 20:51:12.357802 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 17 20:51:12.357802 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 17 20:51:12.357802 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 17 20:51:12.358853 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 17 20:51:12.358853 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 17 20:51:12.358853 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Sep 17 20:51:12.358853 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:12.358853 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:12.358853 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:12.358853 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:12.358853 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:12.358853 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:12.358853 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:12.358853 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:12.358853 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:12.358853 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:12.358853 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 17 20:51:12.358853 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:51:12.358853 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Sep 17 20:51:12.358853 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:12.358853 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:12.358853 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:12.358853 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:12.358853 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:12.360854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:12.360854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:12.360854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:12.360854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Sep 17 20:51:12.360854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:12.360854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-afd02b49-77fb-4c42-9c25-bb9d9441f066 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:12.360854 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-afd02b49-77fb-4c42-9c25-bb9d9441f066 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.021188 Sep 17 20:51:12.360854 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 111/296] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Sep 17 20:51:12 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 20:51:12.363720 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7179663d-539d-4e3f-85d4-7654bd4810ad tempest-AggregatesAdminTestV241-1202500803 tempest-AggregatesAdminTestV241-1202500803-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:12.390943 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7179663d-539d-4e3f-85d4-7654bd4810ad tempest-AggregatesAdminTestV241-1202500803 tempest-AggregatesAdminTestV241-1202500803-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.41 time: 0.030934 Sep 17 20:51:12.392080 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 112/297] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Sep 17 20:51:12 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:12.403385 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4059185d-496d-4167-8c0d-a93725a7dac6 tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] Calling method '.version_select at 0x7f25a5e30b80>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:12.405530 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4059185d-496d-4167-8c0d-a93725a7dac6 tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:12.407156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4059185d-496d-4167-8c0d-a93725a7dac6 tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:12.408799 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4059185d-496d-4167-8c0d-a93725a7dac6 tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:12.417118 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-4059185d-496d-4167-8c0d-a93725a7dac6 tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] HTTP exception thrown: No hypervisor matching 'd080f106-7c56-4354-9100-8a72dc8432bd' could be found. Sep 17 20:51:12.419104 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4059185d-496d-4167-8c0d-a93725a7dac6 tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] Request method failure captured: Sep 17 20:51:12.419104 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/os-hypervisors/d080f106-7c56-4354-9100-8a72dc8432bd/servers HTTP/1.1 Sep 17 20:51:12.419104 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:51:12.419104 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:51:12.419104 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:51:12.419104 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:51:12.419104 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:51:12.419104 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:51:12.419104 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:51:12.419104 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:12.419104 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjM9M_eb5R5dUiB9KxVimhNcjh5eh25hF2f6-SzQwWBuI5lKbz-XoVJpLDZoa_4QPrur_ERfyd2VPwxWNANWs4TRxFV3O1PnF7WkB3m44pPZbh6fBWBAbdBJ4yL-2JQF8WR6zaqLZR1tCFs7IR7LORxczDUpjADxEeXxYQoanHem6i4 Sep 17 20:51:12.419104 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:51:12.419104 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:51:12.419104 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:51:12.419104 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:51:12.419104 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:51:12.419104 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:51:12.419104 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 21281fd8f1714b81a541a5711dddef9f Sep 17 20:51:12.419104 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1147752151 Sep 17 20:51:12.419104 ncdv-master-1 devstack@n-api.service[140523]: X-Role: admin,member,reader Sep 17 20:51:12.419104 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: admin,member,reader Sep 17 20:51:12.420351 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/21281fd8f1714b81a541a5711dddef9f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/21281fd8f1714b81a541a5711dddef9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/21281fd8f1714b81a541a5711dddef9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_21281fd8f1714b81a541a5711dddef9f", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:12.420351 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1147752151 Sep 17 20:51:12.420351 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 21281fd8f1714b81a541a5711dddef9f Sep 17 20:51:12.420351 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1147752151 Sep 17 20:51:12.420351 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin Sep 17 20:51:12.420351 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:51:12.420351 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:51:12.420351 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 1905e658a7984328a82ac7cae4e7d5d9 Sep 17 20:51:12.420351 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin Sep 17 20:51:12.420351 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 20:51:12.420351 ncdv-master-1 devstack@n-api.service[140523]: exception: No hypervisor matching 'd080f106-7c56-4354-9100-8a72dc8432bd' could be found. Sep 17 20:51:12.420351 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'd080f106-7c56-4354-9100-8a72dc8432bd'} Sep 17 20:51:12.421010 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:12.421010 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:12.421010 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:12.421010 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:12.421010 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:12.421010 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:12.421010 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:51:12.421010 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:51:12.421010 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:12.421010 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:12.421010 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Sep 17 20:51:12.421010 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 17 20:51:12.421010 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 17 20:51:12.421010 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 17 20:51:12.421010 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'd080f106-7c56-4354-9100-8a72dc8432bd' could be found. Sep 17 20:51:12.421010 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:12.421010 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:12.421010 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:12.421010 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:12.422065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:12.422065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:12.422065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:12.422065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:12.422065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'd080f106-7c56-4354-9100-8a72dc8432bd' could be found. Sep 17 20:51:12.422065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:12.423636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4059185d-496d-4167-8c0d-a93725a7dac6 tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] Returning 404 to user: No hypervisor matching 'd080f106-7c56-4354-9100-8a72dc8432bd' could be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:12.424679 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4059185d-496d-4167-8c0d-a93725a7dac6 tempest-HypervisorAdminNegativeUnderV252Test-1147752151 tempest-HypervisorAdminNegativeUnderV252Test-1147752151-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/d080f106-7c56-4354-9100-8a72dc8432bd/servers" status: 404 len: 123 microversion: 2.1 time: 0.030600 Sep 17 20:51:12.425914 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 113/298] 10.222.0.26 () {58 vars in 1281 bytes} [Sat Sep 17 20:51:12 2022] GET /compute/v2.1/os-hypervisors/d080f106-7c56-4354-9100-8a72dc8432bd/servers => generated 123 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:12.438914 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2539a38a-5860-4e0d-b981-f7f20b244809 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1567121230"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:12.444839 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.aggregate [None req-2539a38a-5860-4e0d-b981-f7f20b244809 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Generated uuid a539eb9c-fe9d-4ea0-bd20-5e9f1b37f84b for aggregate {{(pid=140523) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 17 20:51:12.449324 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1666f84d-89ca-47f4-a72d-2213190e0b0c tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6d47d564174aceb110b3354ff7db2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f273bfff7ced4f2e885d1ead94a9a486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:12.458797 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1666f84d-89ca-47f4-a72d-2213190e0b0c tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] 10.222.0.26 "GET /compute/v2.1/servers/f297915d-a9fc-44c9-8bc6-a4a682978ed9" status: 200 len: 1314 microversion: 2.1 time: 0.239166 Sep 17 20:51:12.460254 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 186/299] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:12 2022] GET /compute/v2.1/servers/f297915d-a9fc-44c9-8bc6-a4a682978ed9 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:12.485903 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2539a38a-5860-4e0d-b981-f7f20b244809 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.058727 Sep 17 20:51:12.493494 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 114/300] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Sep 17 20:51:12 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:12.498954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-af0c155a-ef37-4caa-82e8-999ab8afc2be tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:12.511648 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-af0c155a-ef37-4caa-82e8-999ab8afc2be tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.016343 Sep 17 20:51:12.514228 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 187/301] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Sep 17 20:51:12 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:12.525714 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-270541c9-5122-41cd-8ce7-e58a3a3b7e6c tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:12.558171 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-270541c9-5122-41cd-8ce7-e58a3a3b7e6c tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.036352 Sep 17 20:51:12.559337 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 115/302] 10.222.0.26 () {60 vars in 1191 bytes} [Sat Sep 17 20:51:12 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:12.571901 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-011910e0-d119-42d7-9c61-ea6fc92d3de3 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:12.585779 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-011910e0-d119-42d7-9c61-ea6fc92d3de3 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.018569 Sep 17 20:51:12.586745 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 188/303] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Sep 17 20:51:12 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:12.601419 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e07e19ba-3a0d-4596-852f-e19c6114d368 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:12.633879 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e07e19ba-3a0d-4596-852f-e19c6114d368 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.038070 Sep 17 20:51:12.634475 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 116/304] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Sep 17 20:51:12 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 17 20:51:12.643875 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5ac5f690-4484-4d19-8a5f-0dcac6630445 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-310661612", "availability_zone": "tempest-test_az-1856968611"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:12.668534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.aggregate [None req-5ac5f690-4484-4d19-8a5f-0dcac6630445 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Generated uuid 5772e149-3f56-4026-ae37-f0e371978907 for aggregate {{(pid=140524) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 17 20:51:12.710836 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5ac5f690-4484-4d19-8a5f-0dcac6630445 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.070419 Sep 17 20:51:12.719062 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 189/305] 10.222.0.26 () {60 vars in 1165 bytes} [Sat Sep 17 20:51:12 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:12.724253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f83c0e34-8180-4538-8005-1d9190f3e386 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-310661612_new", "availability_zone": "tempest-test_az-1856968611_new"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:12.782234 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=14,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:51:12.790404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b4b5f882-392c-4742-9daa-61f39aaf4811 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:12.791245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b4b5f882-392c-4742-9daa-61f39aaf4811 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:12.797419 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b4b5f882-392c-4742-9daa-61f39aaf4811 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:12.797918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b4b5f882-392c-4742-9daa-61f39aaf4811 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:12.798347 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b4b5f882-392c-4742-9daa-61f39aaf4811 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:12.800302 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f83c0e34-8180-4538-8005-1d9190f3e386 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:12.800781 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f83c0e34-8180-4538-8005-1d9190f3e386 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:12.801208 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f83c0e34-8180-4538-8005-1d9190f3e386 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:12.804379 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b4b5f882-392c-4742-9daa-61f39aaf4811 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:12.804855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b4b5f882-392c-4742-9daa-61f39aaf4811 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:12.805286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b4b5f882-392c-4742-9daa-61f39aaf4811 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:12.866985 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f83c0e34-8180-4538-8005-1d9190f3e386 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 335 microversion: 2.1 time: 0.146948 Sep 17 20:51:12.867941 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 117/306] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Sep 17 20:51:12 2022] PUT /compute/v2.1/os-aggregates/9 => generated 335 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:51:12.885343 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-97a6e188-18b1-42a0-99f7-5f7457690ab0 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:12.915355 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-97a6e188-18b1-42a0-99f7-5f7457690ab0 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.038500 Sep 17 20:51:12.916447 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 118/307] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Sep 17 20:51:12 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:12.943658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-515abf16-8be8-473e-be5b-80baff1f5bc0 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:13.003629 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-515abf16-8be8-473e-be5b-80baff1f5bc0 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.078359 Sep 17 20:51:13.004556 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 119/308] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Sep 17 20:51:12 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 17 20:51:13.013961 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-02a65689-afdb-41b4-b90e-0734cc8f2a3e tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-688727000"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:13.017439 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.aggregate [None req-02a65689-afdb-41b4-b90e-0734cc8f2a3e tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Generated uuid a6bc2640-e7cd-4ff0-a6b8-972372616884 for aggregate {{(pid=140523) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 17 20:51:13.058063 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-02a65689-afdb-41b4-b90e-0734cc8f2a3e tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.047512 Sep 17 20:51:13.059449 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 120/309] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Sep 17 20:51:13 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:13.073227 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0be1a34d-bee0-4a7e-8f99-723ffd34e2cd tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:13.090656 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0be1a34d-bee0-4a7e-8f99-723ffd34e2cd tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.023893 Sep 17 20:51:13.094692 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 121/310] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Sep 17 20:51:13 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:13.106058 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-89c38bd9-f92c-430e-9a75-9fc4a7dd3926 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:13.131884 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b4b5f882-392c-4742-9daa-61f39aaf4811 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:13.142550 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b4b5f882-392c-4742-9daa-61f39aaf4811 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1475 microversion: 2.1 time: 0.355907 Sep 17 20:51:13.145888 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 190/311] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:12 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1475 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:51:13.154063 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9b319ea7-17a6-4850-a371-c49dc7431bc1 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:13.154920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9b319ea7-17a6-4850-a371-c49dc7431bc1 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 22274a46-3915-4c4a-891b-e5da0ab9423b] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:13.164533 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-89c38bd9-f92c-430e-9a75-9fc4a7dd3926 tempest-AggregatesAdminTestJSON-212244595 tempest-AggregatesAdminTestJSON-212244595-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.062304 Sep 17 20:51:13.165699 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 122/312] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Sep 17 20:51:13 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 17 20:51:13.177396 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ef2c29c2-f812-49c0-a47b-9bb6dac3612a tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:13.178643 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b319ea7-17a6-4850-a371-c49dc7431bc1 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:13.179741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ef2c29c2-f812-49c0-a47b-9bb6dac3612a tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] [instance: 07019932-c686-4174-9828-3035fcc1694a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:13.180134 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b319ea7-17a6-4850-a371-c49dc7431bc1 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:13.180786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b319ea7-17a6-4850-a371-c49dc7431bc1 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:13.185059 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b319ea7-17a6-4850-a371-c49dc7431bc1 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:13.185923 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b319ea7-17a6-4850-a371-c49dc7431bc1 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:13.188168 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b319ea7-17a6-4850-a371-c49dc7431bc1 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:13.196807 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef2c29c2-f812-49c0-a47b-9bb6dac3612a tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:13.197425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef2c29c2-f812-49c0-a47b-9bb6dac3612a tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:13.198097 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef2c29c2-f812-49c0-a47b-9bb6dac3612a tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:13.199080 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef2c29c2-f812-49c0-a47b-9bb6dac3612a tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:13.199731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef2c29c2-f812-49c0-a47b-9bb6dac3612a tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:13.200351 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef2c29c2-f812-49c0-a47b-9bb6dac3612a tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:13.216339 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-ef2c29c2-f812-49c0-a47b-9bb6dac3612a tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] HTTP exception thrown: Instance 07019932-c686-4174-9828-3035fcc1694a could not be found. Sep 17 20:51:13.219370 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ef2c29c2-f812-49c0-a47b-9bb6dac3612a tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Request method failure captured: Sep 17 20:51:13.219370 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a HTTP/1.1 Sep 17 20:51:13.219370 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:51:13.219370 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:51:13.219370 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:51:13.219370 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:51:13.219370 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:51:13.219370 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:51:13.219370 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:51:13.219370 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:13.219370 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjMP34TYun5BBq97IkaCVfqR_d5rT2Cqj-QpNSGP2nA9ZnhVRfAkuqse8FF4chJS5sGWxf9TEjAkBIvGEU7LAz1I1mZdnEBKRa-YLSYxugejYiiZJCOb2l8f21fquwt6bs6C_s_g6O6jpWM9eeltUhSFiTe8CYMYhnI-4FrEQ8Vusf8 Sep 17 20:51:13.219370 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:51:13.219370 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:51:13.219370 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:51:13.219370 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:51:13.219370 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:51:13.219370 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:51:13.219370 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: aa4ffd27d7414061b67e053657044400 Sep 17 20:51:13.219370 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-AggregatesAdminTestJSON-2039352809 Sep 17 20:51:13.219370 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:51:13.219370 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:51:13.220556 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aa4ffd27d7414061b67e053657044400"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/aa4ffd27d7414061b67e053657044400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aa4ffd27d7414061b67e053657044400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_aa4ffd27d7414061b67e053657044400", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:13.220556 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-AggregatesAdminTestJSON-2039352809 Sep 17 20:51:13.220556 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: aa4ffd27d7414061b67e053657044400 Sep 17 20:51:13.220556 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2039352809 Sep 17 20:51:13.220556 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-AggregatesAdminTestJSON-2039352809-project Sep 17 20:51:13.220556 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:51:13.220556 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:51:13.220556 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: f05aab669547487d8876a70e338d3e4a Sep 17 20:51:13.220556 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-AggregatesAdminTestJSON-2039352809-project Sep 17 20:51:13.220556 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:51:13.220556 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 07019932-c686-4174-9828-3035fcc1694a could not be found. Sep 17 20:51:13.220556 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '07019932-c686-4174-9828-3035fcc1694a'} Sep 17 20:51:13.221245 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:13.221245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:13.221245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:51:13.221245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:51:13.221245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:51:13.221245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:51:13.221245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:51:13.221245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:51:13.221245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:51:13.221245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:51:13.221245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07019932-c686-4174-9828-3035fcc1694a could not be found. Sep 17 20:51:13.221245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:13.221245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:13.221245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:13.221245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:13.221245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:13.221245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:13.221245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:13.221245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:13.221245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:13.222557 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:13.222557 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 20:51:13.222557 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 20:51:13.222557 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 20:51:13.222557 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 20:51:13.222557 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:51:13.222557 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:51:13.222557 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:51:13.222557 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:51:13.222557 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07019932-c686-4174-9828-3035fcc1694a could not be found. Sep 17 20:51:13.222557 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:13.222557 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:13.222557 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:13.222557 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:13.222557 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:13.222557 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:13.222557 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:13.222557 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:13.222557 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07019932-c686-4174-9828-3035fcc1694a could not be found. Sep 17 20:51:13.222557 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:13.225720 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ef2c29c2-f812-49c0-a47b-9bb6dac3612a tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Returning 404 to user: Instance 07019932-c686-4174-9828-3035fcc1694a could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:13.226879 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ef2c29c2-f812-49c0-a47b-9bb6dac3612a tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] 10.222.0.26 "DELETE /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a" status: 404 len: 111 microversion: 2.1 time: 0.056463 Sep 17 20:51:13.227964 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 123/313] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:51:13 2022] DELETE /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:13.240140 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ab7b4112-3b1b-4a7c-9676-385b504a984c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:13.244293 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ab7b4112-3b1b-4a7c-9676-385b504a984c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] [instance: 07019932-c686-4174-9828-3035fcc1694a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:13.256832 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab7b4112-3b1b-4a7c-9676-385b504a984c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:13.258672 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab7b4112-3b1b-4a7c-9676-385b504a984c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:13.262819 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab7b4112-3b1b-4a7c-9676-385b504a984c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:13.265147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab7b4112-3b1b-4a7c-9676-385b504a984c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:13.265763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab7b4112-3b1b-4a7c-9676-385b504a984c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:13.266265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab7b4112-3b1b-4a7c-9676-385b504a984c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:13.293866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:51:13.296378 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-ab7b4112-3b1b-4a7c-9676-385b504a984c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] HTTP exception thrown: Instance 07019932-c686-4174-9828-3035fcc1694a could not be found. Sep 17 20:51:13.298431 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ab7b4112-3b1b-4a7c-9676-385b504a984c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Request method failure captured: Sep 17 20:51:13.298431 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a HTTP/1.1 Sep 17 20:51:13.298431 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:51:13.298431 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:51:13.298431 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:51:13.298431 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:51:13.298431 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:51:13.298431 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:51:13.298431 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:51:13.298431 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:13.298431 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjMP34TYun5BBq97IkaCVfqR_d5rT2Cqj-QpNSGP2nA9ZnhVRfAkuqse8FF4chJS5sGWxf9TEjAkBIvGEU7LAz1I1mZdnEBKRa-YLSYxugejYiiZJCOb2l8f21fquwt6bs6C_s_g6O6jpWM9eeltUhSFiTe8CYMYhnI-4FrEQ8Vusf8 Sep 17 20:51:13.298431 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:51:13.298431 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:51:13.298431 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:51:13.298431 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:51:13.298431 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:51:13.298431 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:51:13.298431 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: aa4ffd27d7414061b67e053657044400 Sep 17 20:51:13.298431 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-AggregatesAdminTestJSON-2039352809 Sep 17 20:51:13.298431 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:51:13.298431 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:51:13.300110 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aa4ffd27d7414061b67e053657044400"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/aa4ffd27d7414061b67e053657044400"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aa4ffd27d7414061b67e053657044400"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_aa4ffd27d7414061b67e053657044400", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:13.300110 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-AggregatesAdminTestJSON-2039352809 Sep 17 20:51:13.300110 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: aa4ffd27d7414061b67e053657044400 Sep 17 20:51:13.300110 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2039352809 Sep 17 20:51:13.300110 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-AggregatesAdminTestJSON-2039352809-project Sep 17 20:51:13.300110 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:51:13.300110 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:51:13.300110 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: f05aab669547487d8876a70e338d3e4a Sep 17 20:51:13.300110 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-AggregatesAdminTestJSON-2039352809-project Sep 17 20:51:13.300110 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:51:13.300110 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 07019932-c686-4174-9828-3035fcc1694a could not be found. Sep 17 20:51:13.300110 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '07019932-c686-4174-9828-3035fcc1694a'} Sep 17 20:51:13.301029 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:13.301029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:13.301029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:51:13.301029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:51:13.301029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:51:13.301029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:51:13.301029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:51:13.301029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:51:13.301029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:51:13.301029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:51:13.301029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07019932-c686-4174-9828-3035fcc1694a could not be found. Sep 17 20:51:13.301029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:13.301029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:13.301029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:13.301029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:13.301029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:13.301029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:13.301029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:13.301029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:13.301029 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:13.302321 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:13.302321 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:51:13.302321 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:51:13.302321 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:51:13.302321 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:51:13.302321 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:51:13.302321 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:51:13.302321 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07019932-c686-4174-9828-3035fcc1694a could not be found. Sep 17 20:51:13.302321 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:13.302321 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:13.302321 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:13.302321 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:13.302321 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:13.302321 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:13.302321 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:13.302321 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:13.302321 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07019932-c686-4174-9828-3035fcc1694a could not be found. Sep 17 20:51:13.302321 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:13.310866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ab7b4112-3b1b-4a7c-9676-385b504a984c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] Returning 404 to user: Instance 07019932-c686-4174-9828-3035fcc1694a could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:13.312557 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ab7b4112-3b1b-4a7c-9676-385b504a984c tempest-AggregatesAdminTestJSON-2039352809 tempest-AggregatesAdminTestJSON-2039352809-project] 10.222.0.26 "GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a" status: 404 len: 111 microversion: 2.1 time: 0.080173 Sep 17 20:51:13.313661 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 124/314] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:13 2022] GET /compute/v2.1/servers/07019932-c686-4174-9828-3035fcc1694a => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:13.471138 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-8f75da24-d6c2-41b3-9c46-087faa397bce req-aa91fc08-2820-4801-aeea-ebf3eaf48376 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f297915d-a9fc-44c9-8bc6-a4a682978ed9", "name": "network-vif-plugged", "status": "completed", "tag": "cb30ce08-bf71-4a71-a3c2-55fe12f9aadd"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:13.497580 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8f75da24-d6c2-41b3-9c46-087faa397bce req-aa91fc08-2820-4801-aeea-ebf3eaf48376 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:13.498459 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8f75da24-d6c2-41b3-9c46-087faa397bce req-aa91fc08-2820-4801-aeea-ebf3eaf48376 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:13.500081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8f75da24-d6c2-41b3-9c46-087faa397bce req-aa91fc08-2820-4801-aeea-ebf3eaf48376 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:13.518164 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-8f75da24-d6c2-41b3-9c46-087faa397bce req-aa91fc08-2820-4801-aeea-ebf3eaf48376 service nova] Creating event network-vif-plugged:cb30ce08-bf71-4a71-a3c2-55fe12f9aadd for instance f297915d-a9fc-44c9-8bc6-a4a682978ed9 on nch2-master-1 Sep 17 20:51:13.525013 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-8f75da24-d6c2-41b3-9c46-087faa397bce req-aa91fc08-2820-4801-aeea-ebf3eaf48376 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058451 Sep 17 20:51:13.525978 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 125/315] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:51:13.533278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-47b0dcb5-1cd0-485f-8b4b-7669221b3619 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:13.534636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-47b0dcb5-1cd0-485f-8b4b-7669221b3619 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] [instance: f297915d-a9fc-44c9-8bc6-a4a682978ed9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:13.540415 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9b319ea7-17a6-4850-a371-c49dc7431bc1 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8bfe1d590a4500b7e7b5c79a6a4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea88200545ae4003b42b0d475f482c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:13.543535 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47b0dcb5-1cd0-485f-8b4b-7669221b3619 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:13.544276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47b0dcb5-1cd0-485f-8b4b-7669221b3619 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:13.544865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47b0dcb5-1cd0-485f-8b4b-7669221b3619 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:13.545985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47b0dcb5-1cd0-485f-8b4b-7669221b3619 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:13.547000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47b0dcb5-1cd0-485f-8b4b-7669221b3619 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:13.547576 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47b0dcb5-1cd0-485f-8b4b-7669221b3619 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:13.567479 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9b319ea7-17a6-4850-a371-c49dc7431bc1 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] 10.222.0.26 "GET /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b" status: 200 len: 1319 microversion: 2.1 time: 0.415671 Sep 17 20:51:13.571889 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 191/316] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:13 2022] GET /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b => generated 1319 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:13.972183 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-47b0dcb5-1cd0-485f-8b4b-7669221b3619 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6d47d564174aceb110b3354ff7db2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f273bfff7ced4f2e885d1ead94a9a486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:13.983191 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-47b0dcb5-1cd0-485f-8b4b-7669221b3619 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] 10.222.0.26 "GET /compute/v2.1/servers/f297915d-a9fc-44c9-8bc6-a4a682978ed9" status: 200 len: 1314 microversion: 2.1 time: 0.453648 Sep 17 20:51:13.983815 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 126/317] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:13 2022] GET /compute/v2.1/servers/f297915d-a9fc-44c9-8bc6-a4a682978ed9 => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:14.178738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b4323d3d-d77d-49ad-b8ee-8b5bebc97670 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:14.180724 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b4323d3d-d77d-49ad-b8ee-8b5bebc97670 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:14.193028 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b4323d3d-d77d-49ad-b8ee-8b5bebc97670 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:14.193822 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b4323d3d-d77d-49ad-b8ee-8b5bebc97670 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:14.195330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b4323d3d-d77d-49ad-b8ee-8b5bebc97670 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:14.196676 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b4323d3d-d77d-49ad-b8ee-8b5bebc97670 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:14.198147 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b4323d3d-d77d-49ad-b8ee-8b5bebc97670 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:14.199842 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b4323d3d-d77d-49ad-b8ee-8b5bebc97670 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:14.466755 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b4323d3d-d77d-49ad-b8ee-8b5bebc97670 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:14.497681 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b4323d3d-d77d-49ad-b8ee-8b5bebc97670 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1475 microversion: 2.1 time: 0.326332 Sep 17 20:51:14.500388 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 192/318] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:14 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1475 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:14.598837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4d85585a-4ae7-4c5b-b2a7-89bbf7ac9253 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:14.599591 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4d85585a-4ae7-4c5b-b2a7-89bbf7ac9253 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 22274a46-3915-4c4a-891b-e5da0ab9423b] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:14.605955 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d85585a-4ae7-4c5b-b2a7-89bbf7ac9253 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:14.606473 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d85585a-4ae7-4c5b-b2a7-89bbf7ac9253 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:14.607106 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d85585a-4ae7-4c5b-b2a7-89bbf7ac9253 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:14.607964 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d85585a-4ae7-4c5b-b2a7-89bbf7ac9253 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:14.608571 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d85585a-4ae7-4c5b-b2a7-89bbf7ac9253 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:14.609447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d85585a-4ae7-4c5b-b2a7-89bbf7ac9253 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:14.775781 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4d85585a-4ae7-4c5b-b2a7-89bbf7ac9253 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8bfe1d590a4500b7e7b5c79a6a4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea88200545ae4003b42b0d475f482c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:14.786142 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4d85585a-4ae7-4c5b-b2a7-89bbf7ac9253 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] 10.222.0.26 "GET /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b" status: 200 len: 1319 microversion: 2.1 time: 0.191385 Sep 17 20:51:14.787180 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 127/319] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:14 2022] GET /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:51:15.007298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-27d8f5ce-108d-415f-92a6-ec254a432610 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:15.007975 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-27d8f5ce-108d-415f-92a6-ec254a432610 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] [instance: f297915d-a9fc-44c9-8bc6-a4a682978ed9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:15.016254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27d8f5ce-108d-415f-92a6-ec254a432610 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:15.016722 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27d8f5ce-108d-415f-92a6-ec254a432610 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:15.017159 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27d8f5ce-108d-415f-92a6-ec254a432610 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:15.018086 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27d8f5ce-108d-415f-92a6-ec254a432610 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:15.019002 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27d8f5ce-108d-415f-92a6-ec254a432610 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:15.019571 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27d8f5ce-108d-415f-92a6-ec254a432610 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:15.186153 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-27d8f5ce-108d-415f-92a6-ec254a432610 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6d47d564174aceb110b3354ff7db2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f273bfff7ced4f2e885d1ead94a9a486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:15.196655 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-27d8f5ce-108d-415f-92a6-ec254a432610 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] 10.222.0.26 "GET /compute/v2.1/servers/f297915d-a9fc-44c9-8bc6-a4a682978ed9" status: 200 len: 1314 microversion: 2.1 time: 0.192257 Sep 17 20:51:15.197495 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 193/320] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:15 2022] GET /compute/v2.1/servers/f297915d-a9fc-44c9-8bc6-a4a682978ed9 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:15.522842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-04f402ba-ab06-4d7b-a704-5c66de2e3a56 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:15.524154 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-04f402ba-ab06-4d7b-a704-5c66de2e3a56 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:15.538422 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04f402ba-ab06-4d7b-a704-5c66de2e3a56 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:15.539451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04f402ba-ab06-4d7b-a704-5c66de2e3a56 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:15.540097 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04f402ba-ab06-4d7b-a704-5c66de2e3a56 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:15.541036 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04f402ba-ab06-4d7b-a704-5c66de2e3a56 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:15.541743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04f402ba-ab06-4d7b-a704-5c66de2e3a56 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:15.542351 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04f402ba-ab06-4d7b-a704-5c66de2e3a56 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:15.814718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2f5371a9-f13d-4125-93d5-a5015c5a9358 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:15.827519 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-04f402ba-ab06-4d7b-a704-5c66de2e3a56 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:15.827909 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2f5371a9-f13d-4125-93d5-a5015c5a9358 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 22274a46-3915-4c4a-891b-e5da0ab9423b] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:15.849077 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-04f402ba-ab06-4d7b-a704-5c66de2e3a56 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1475 microversion: 2.1 time: 0.330485 Sep 17 20:51:15.850560 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 128/321] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:15 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1475 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:15.858922 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f5371a9-f13d-4125-93d5-a5015c5a9358 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:15.859454 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f5371a9-f13d-4125-93d5-a5015c5a9358 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:15.859939 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f5371a9-f13d-4125-93d5-a5015c5a9358 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:15.860695 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f5371a9-f13d-4125-93d5-a5015c5a9358 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:15.861148 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f5371a9-f13d-4125-93d5-a5015c5a9358 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:15.861826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f5371a9-f13d-4125-93d5-a5015c5a9358 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:16.040920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2f5371a9-f13d-4125-93d5-a5015c5a9358 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8bfe1d590a4500b7e7b5c79a6a4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea88200545ae4003b42b0d475f482c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:16.054566 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2f5371a9-f13d-4125-93d5-a5015c5a9358 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] 10.222.0.26 "GET /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b" status: 200 len: 1319 microversion: 2.1 time: 0.246197 Sep 17 20:51:16.056254 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 194/322] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:15 2022] GET /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:16.220578 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e5bce020-8314-4a59-bd52-54e7a58165c4 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:16.221299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e5bce020-8314-4a59-bd52-54e7a58165c4 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] [instance: f297915d-a9fc-44c9-8bc6-a4a682978ed9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:16.228286 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5bce020-8314-4a59-bd52-54e7a58165c4 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:16.229057 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5bce020-8314-4a59-bd52-54e7a58165c4 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:16.229756 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5bce020-8314-4a59-bd52-54e7a58165c4 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:16.230755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5bce020-8314-4a59-bd52-54e7a58165c4 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:16.231394 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5bce020-8314-4a59-bd52-54e7a58165c4 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:16.232005 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5bce020-8314-4a59-bd52-54e7a58165c4 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:16.400326 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e5bce020-8314-4a59-bd52-54e7a58165c4 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6d47d564174aceb110b3354ff7db2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f273bfff7ced4f2e885d1ead94a9a486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:16.411970 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e5bce020-8314-4a59-bd52-54e7a58165c4 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] 10.222.0.26 "GET /compute/v2.1/servers/f297915d-a9fc-44c9-8bc6-a4a682978ed9" status: 200 len: 1464 microversion: 2.1 time: 0.195316 Sep 17 20:51:16.417587 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 129/323] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:16 2022] GET /compute/v2.1/servers/f297915d-a9fc-44c9-8bc6-a4a682978ed9 => generated 1464 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:16.755415 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-af186951-bd0b-4e7d-b1c2-cff272d608ab tempest-TenantUsagesTestJSON-1714752801 tempest-TenantUsagesTestJSON-1714752801-project-admin] Calling method '.version_select at 0x7f25a5ec1d30>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:16.769254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af186951-bd0b-4e7d-b1c2-cff272d608ab tempest-TenantUsagesTestJSON-1714752801 tempest-TenantUsagesTestJSON-1714752801-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:16.769869 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af186951-bd0b-4e7d-b1c2-cff272d608ab tempest-TenantUsagesTestJSON-1714752801 tempest-TenantUsagesTestJSON-1714752801-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:16.770875 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af186951-bd0b-4e7d-b1c2-cff272d608ab tempest-TenantUsagesTestJSON-1714752801 tempest-TenantUsagesTestJSON-1714752801-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:16.788628 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=13 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:51:16.795402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af186951-bd0b-4e7d-b1c2-cff272d608ab tempest-TenantUsagesTestJSON-1714752801 tempest-TenantUsagesTestJSON-1714752801-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:16.796167 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af186951-bd0b-4e7d-b1c2-cff272d608ab tempest-TenantUsagesTestJSON-1714752801 tempest-TenantUsagesTestJSON-1714752801-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:16.796548 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af186951-bd0b-4e7d-b1c2-cff272d608ab tempest-TenantUsagesTestJSON-1714752801 tempest-TenantUsagesTestJSON-1714752801-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:16.821199 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-af186951-bd0b-4e7d-b1c2-cff272d608ab tempest-TenantUsagesTestJSON-1714752801 tempest-TenantUsagesTestJSON-1714752801-project-admin] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage/f273bfff7ced4f2e885d1ead94a9a486?start=2022-09-16T20%3A51%3A16.428770&end=2022-09-18T20%3A51%3A16.428770" status: 200 len: 695 microversion: 2.1 time: 0.388707 Sep 17 20:51:16.822663 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 195/324] 10.222.0.26 () {58 vars in 1412 bytes} [Sat Sep 17 20:51:16 2022] GET /compute/v2.1/os-simple-tenant-usage/f273bfff7ced4f2e885d1ead94a9a486?start=2022-09-16T20%3A51%3A16.428770&end=2022-09-18T20%3A51%3A16.428770 => generated 695 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:16.837643 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2b7587cc-706d-4d5d-9ba9-1feb647f87aa tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Calling method '.version_select at 0x7f25a5e30d30>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:16.849306 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b7587cc-706d-4d5d-9ba9-1feb647f87aa tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:16.849858 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b7587cc-706d-4d5d-9ba9-1feb647f87aa tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:16.850299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b7587cc-706d-4d5d-9ba9-1feb647f87aa tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:16.870545 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b7587cc-706d-4d5d-9ba9-1feb647f87aa tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:16.871102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b7587cc-706d-4d5d-9ba9-1feb647f87aa tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:16.871543 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b7587cc-706d-4d5d-9ba9-1feb647f87aa tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:16.882687 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0cb28d7b-d4c3-4e91-839c-055396fc1990 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:16.885245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0cb28d7b-d4c3-4e91-839c-055396fc1990 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:16.898504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0cb28d7b-d4c3-4e91-839c-055396fc1990 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:16.899466 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0cb28d7b-d4c3-4e91-839c-055396fc1990 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:16.899936 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2b7587cc-706d-4d5d-9ba9-1feb647f87aa tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage/f273bfff7ced4f2e885d1ead94a9a486?start=2022-09-16T20%3A51%3A16.428770&end=2022-09-18T20%3A51%3A16.428770" status: 200 len: 695 microversion: 2.1 time: 0.065892 Sep 17 20:51:16.900662 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0cb28d7b-d4c3-4e91-839c-055396fc1990 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:16.902952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0cb28d7b-d4c3-4e91-839c-055396fc1990 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:16.904884 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0cb28d7b-d4c3-4e91-839c-055396fc1990 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:16.905599 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0cb28d7b-d4c3-4e91-839c-055396fc1990 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:16.910108 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 130/325] 10.222.0.26 () {58 vars in 1412 bytes} [Sat Sep 17 20:51:16 2022] GET /compute/v2.1/os-simple-tenant-usage/f273bfff7ced4f2e885d1ead94a9a486?start=2022-09-16T20%3A51%3A16.428770&end=2022-09-18T20%3A51%3A16.428770 => generated 695 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:16.916458 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-895cdd24-6f68-4850-b435-2a8f87ce7151 tempest-TenantUsagesTestJSON-1714752801 tempest-TenantUsagesTestJSON-1714752801-project-admin] Calling method '.version_select at 0x7f25a5d8f1f0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:16.926023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-895cdd24-6f68-4850-b435-2a8f87ce7151 tempest-TenantUsagesTestJSON-1714752801 tempest-TenantUsagesTestJSON-1714752801-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:16.926504 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-895cdd24-6f68-4850-b435-2a8f87ce7151 tempest-TenantUsagesTestJSON-1714752801 tempest-TenantUsagesTestJSON-1714752801-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:16.926934 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-895cdd24-6f68-4850-b435-2a8f87ce7151 tempest-TenantUsagesTestJSON-1714752801 tempest-TenantUsagesTestJSON-1714752801-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:16.944284 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-895cdd24-6f68-4850-b435-2a8f87ce7151 tempest-TenantUsagesTestJSON-1714752801 tempest-TenantUsagesTestJSON-1714752801-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:16.944756 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-895cdd24-6f68-4850-b435-2a8f87ce7151 tempest-TenantUsagesTestJSON-1714752801 tempest-TenantUsagesTestJSON-1714752801-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:16.945376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-895cdd24-6f68-4850-b435-2a8f87ce7151 tempest-TenantUsagesTestJSON-1714752801 tempest-TenantUsagesTestJSON-1714752801-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:16.969453 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-895cdd24-6f68-4850-b435-2a8f87ce7151 tempest-TenantUsagesTestJSON-1714752801 tempest-TenantUsagesTestJSON-1714752801-project-admin] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-16T20%3A51%3A16.428770&end=2022-09-18T20%3A51%3A16.428770&detailed=1" status: 200 len: 2794 microversion: 2.1 time: 0.056937 Sep 17 20:51:16.970351 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 131/326] 10.222.0.26 () {58 vars in 1335 bytes} [Sat Sep 17 20:51:16 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-16T20%3A51%3A16.428770&end=2022-09-18T20%3A51%3A16.428770&detailed=1 => generated 2794 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:16.988538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5feac5fe-b8a3-4e6f-ae2f-da32ec0dbf62 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:16.989701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5feac5fe-b8a3-4e6f-ae2f-da32ec0dbf62 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] [instance: f297915d-a9fc-44c9-8bc6-a4a682978ed9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:16.998937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5feac5fe-b8a3-4e6f-ae2f-da32ec0dbf62 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:16.999662 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5feac5fe-b8a3-4e6f-ae2f-da32ec0dbf62 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:17.000426 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5feac5fe-b8a3-4e6f-ae2f-da32ec0dbf62 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:17.002211 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5feac5fe-b8a3-4e6f-ae2f-da32ec0dbf62 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:17.002835 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5feac5fe-b8a3-4e6f-ae2f-da32ec0dbf62 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:17.003338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5feac5fe-b8a3-4e6f-ae2f-da32ec0dbf62 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:17.041792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5feac5fe-b8a3-4e6f-ae2f-da32ec0dbf62 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] [instance: f297915d-a9fc-44c9-8bc6-a4a682978ed9] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:51:17.069423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0cb28d7b-d4c3-4e91-839c-055396fc1990 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:17.078824 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0cb28d7b-d4c3-4e91-839c-055396fc1990 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1475 microversion: 2.1 time: 0.203049 Sep 17 20:51:17.079406 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 196/327] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:16 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1475 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:51:17.084096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-23002107-fcf1-47e8-a549-f20dc71b58d7 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:17.084846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-23002107-fcf1-47e8-a549-f20dc71b58d7 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 22274a46-3915-4c4a-891b-e5da0ab9423b] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:17.103063 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23002107-fcf1-47e8-a549-f20dc71b58d7 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:17.103758 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23002107-fcf1-47e8-a549-f20dc71b58d7 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:17.104510 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23002107-fcf1-47e8-a549-f20dc71b58d7 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:17.105665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23002107-fcf1-47e8-a549-f20dc71b58d7 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:17.109121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23002107-fcf1-47e8-a549-f20dc71b58d7 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:17.111895 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23002107-fcf1-47e8-a549-f20dc71b58d7 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:17.218652 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5feac5fe-b8a3-4e6f-ae2f-da32ec0dbf62 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f297915d-a9fc-44c9-8bc6-a4a682978ed9" status: 204 len: 0 microversion: 2.1 time: 0.234910 Sep 17 20:51:17.220064 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 132/328] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:51:16 2022] DELETE /compute/v2.1/servers/f297915d-a9fc-44c9-8bc6-a4a682978ed9 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 17 20:51:17.233582 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c19d7c96-22d8-4db0-8d2f-17b709abb22e tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:17.239994 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c19d7c96-22d8-4db0-8d2f-17b709abb22e tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] [instance: f297915d-a9fc-44c9-8bc6-a4a682978ed9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:17.249587 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c19d7c96-22d8-4db0-8d2f-17b709abb22e tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:17.250135 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c19d7c96-22d8-4db0-8d2f-17b709abb22e tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:17.250501 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c19d7c96-22d8-4db0-8d2f-17b709abb22e tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:17.251315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c19d7c96-22d8-4db0-8d2f-17b709abb22e tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:17.252001 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c19d7c96-22d8-4db0-8d2f-17b709abb22e tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:17.252625 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c19d7c96-22d8-4db0-8d2f-17b709abb22e tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:17.404966 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-23002107-fcf1-47e8-a549-f20dc71b58d7 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8bfe1d590a4500b7e7b5c79a6a4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea88200545ae4003b42b0d475f482c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:17.414260 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-23002107-fcf1-47e8-a549-f20dc71b58d7 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] 10.222.0.26 "GET /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b" status: 200 len: 1319 microversion: 2.1 time: 0.333770 Sep 17 20:51:17.415325 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 197/329] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:17 2022] GET /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b => generated 1319 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:17.510916 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c19d7c96-22d8-4db0-8d2f-17b709abb22e tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6d47d564174aceb110b3354ff7db2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f273bfff7ced4f2e885d1ead94a9a486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:17.522417 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c19d7c96-22d8-4db0-8d2f-17b709abb22e tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] 10.222.0.26 "GET /compute/v2.1/servers/f297915d-a9fc-44c9-8bc6-a4a682978ed9" status: 200 len: 1470 microversion: 2.1 time: 0.297318 Sep 17 20:51:17.523456 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 133/330] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:17 2022] GET /compute/v2.1/servers/f297915d-a9fc-44c9-8bc6-a4a682978ed9 => generated 1470 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:17.662038 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-72cc41d0-fa79-4a56-9713-38298aac5e67 req-d8ee2feb-ae3b-4082-80f9-8dae8369d49b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22274a46-3915-4c4a-891b-e5da0ab9423b", "name": "network-vif-plugged", "status": "completed", "tag": "27b42713-be20-4875-931b-d88248412715"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:17.673912 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-72cc41d0-fa79-4a56-9713-38298aac5e67 req-d8ee2feb-ae3b-4082-80f9-8dae8369d49b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:17.674647 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-72cc41d0-fa79-4a56-9713-38298aac5e67 req-d8ee2feb-ae3b-4082-80f9-8dae8369d49b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:17.675513 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-72cc41d0-fa79-4a56-9713-38298aac5e67 req-d8ee2feb-ae3b-4082-80f9-8dae8369d49b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:17.692395 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-72cc41d0-fa79-4a56-9713-38298aac5e67 req-d8ee2feb-ae3b-4082-80f9-8dae8369d49b service nova] Creating event network-vif-plugged:27b42713-be20-4875-931b-d88248412715 for instance 22274a46-3915-4c4a-891b-e5da0ab9423b on nch1-master-1 Sep 17 20:51:17.715820 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-72cc41d0-fa79-4a56-9713-38298aac5e67 req-d8ee2feb-ae3b-4082-80f9-8dae8369d49b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058181 Sep 17 20:51:17.717642 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 198/331] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:18.099620 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=46 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:51:18.104314 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-be5269cc-5237-4a87-9394-566d83718824 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:18.105353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-be5269cc-5237-4a87-9394-566d83718824 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:18.125642 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be5269cc-5237-4a87-9394-566d83718824 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:18.126139 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be5269cc-5237-4a87-9394-566d83718824 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:18.128039 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be5269cc-5237-4a87-9394-566d83718824 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:18.128795 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be5269cc-5237-4a87-9394-566d83718824 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:18.129261 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be5269cc-5237-4a87-9394-566d83718824 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:18.129737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be5269cc-5237-4a87-9394-566d83718824 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:18.794533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-be5269cc-5237-4a87-9394-566d83718824 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:18.809866 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-be5269cc-5237-4a87-9394-566d83718824 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1475 microversion: 2.1 time: 0.709027 Sep 17 20:51:18.811544 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 199/332] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:18 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1475 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:18.828361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3829641a-529d-4b40-8c9f-0cab6268875f tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:18.829019 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3829641a-529d-4b40-8c9f-0cab6268875f tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 22274a46-3915-4c4a-891b-e5da0ab9423b] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:18.848733 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3829641a-529d-4b40-8c9f-0cab6268875f tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:18.849076 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3829641a-529d-4b40-8c9f-0cab6268875f tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:18.851149 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3829641a-529d-4b40-8c9f-0cab6268875f tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:18.852802 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3829641a-529d-4b40-8c9f-0cab6268875f tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:18.853325 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3829641a-529d-4b40-8c9f-0cab6268875f tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:18.853826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3829641a-529d-4b40-8c9f-0cab6268875f tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:18.880736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-43ab0a3c-2eea-4622-a58e-cd3facbe523b tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Calling method '.version_select at 0x7f25a5d42700>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:19.174577 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3829641a-529d-4b40-8c9f-0cab6268875f tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8bfe1d590a4500b7e7b5c79a6a4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea88200545ae4003b42b0d475f482c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:19.191135 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3829641a-529d-4b40-8c9f-0cab6268875f tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] 10.222.0.26 "GET /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b" status: 200 len: 1319 microversion: 2.1 time: 0.376346 Sep 17 20:51:19.195051 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 200/333] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:18 2022] GET /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b => generated 1319 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:19.210240 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-37276ada-8cc3-4e36-8607-34c331bf160a tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:19.214056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-37276ada-8cc3-4e36-8607-34c331bf160a tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] [instance: f297915d-a9fc-44c9-8bc6-a4a682978ed9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:19.230557 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-37276ada-8cc3-4e36-8607-34c331bf160a tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:19.231978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-37276ada-8cc3-4e36-8607-34c331bf160a tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:19.234819 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-37276ada-8cc3-4e36-8607-34c331bf160a tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:19.235641 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-37276ada-8cc3-4e36-8607-34c331bf160a tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:19.236181 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-37276ada-8cc3-4e36-8607-34c331bf160a tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:19.238384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-37276ada-8cc3-4e36-8607-34c331bf160a tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:19.486655 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=69 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:51:19.506473 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-43ab0a3c-2eea-4622-a58e-cd3facbe523b tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/394b1bbcff6d4a509ae2c2acadcac0b6" status: 200 len: 371 microversion: 2.1 time: 1.449160 Sep 17 20:51:19.514883 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 134/334] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Sep 17 20:51:18 2022] GET /compute/v2.1/os-quota-sets/394b1bbcff6d4a509ae2c2acadcac0b6 => generated 371 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:19.521130 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e54633e1-b19e-449c-9a32-3db6f1958ac1 tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Action: 'update', calling method: .version_select at 0x7f25a5deb820>, body: {"quota_set": {"ram": "5120"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:19.826952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-37276ada-8cc3-4e36-8607-34c331bf160a tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec6d47d564174aceb110b3354ff7db2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f273bfff7ced4f2e885d1ead94a9a486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:19.843023 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-37276ada-8cc3-4e36-8607-34c331bf160a tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] 10.222.0.26 "GET /compute/v2.1/servers/f297915d-a9fc-44c9-8bc6-a4a682978ed9" status: 200 len: 1470 microversion: 2.1 time: 0.645993 Sep 17 20:51:19.847518 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 201/335] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:19 2022] GET /compute/v2.1/servers/f297915d-a9fc-44c9-8bc6-a4a682978ed9 => generated 1470 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:19.863353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-82e947fe-9ac7-4cdb-9b66-1c04e0f2c9ad req-18a50ef1-46b5-4daf-9332-57aac82dac7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f297915d-a9fc-44c9-8bc6-a4a682978ed9", "name": "network-vif-deleted", "tag": "cb30ce08-bf71-4a71-a3c2-55fe12f9aadd"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:19.896627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-82e947fe-9ac7-4cdb-9b66-1c04e0f2c9ad req-18a50ef1-46b5-4daf-9332-57aac82dac7b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:19.910834 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-82e947fe-9ac7-4cdb-9b66-1c04e0f2c9ad req-18a50ef1-46b5-4daf-9332-57aac82dac7b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:19.913627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-82e947fe-9ac7-4cdb-9b66-1c04e0f2c9ad req-18a50ef1-46b5-4daf-9332-57aac82dac7b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:19.940848 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-82e947fe-9ac7-4cdb-9b66-1c04e0f2c9ad req-18a50ef1-46b5-4daf-9332-57aac82dac7b service nova] Creating event network-vif-deleted:cb30ce08-bf71-4a71-a3c2-55fe12f9aadd for instance f297915d-a9fc-44c9-8bc6-a4a682978ed9 on nch2-master-1 Sep 17 20:51:19.959978 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-82e947fe-9ac7-4cdb-9b66-1c04e0f2c9ad req-18a50ef1-46b5-4daf-9332-57aac82dac7b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106832 Sep 17 20:51:19.962967 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 202/336] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:19.984424 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2ee9b4d8-c6c2-4473-9ec1-b5ad69e1dd48 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:19.985603 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2ee9b4d8-c6c2-4473-9ec1-b5ad69e1dd48 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:20.002027 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ee9b4d8-c6c2-4473-9ec1-b5ad69e1dd48 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:20.002736 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ee9b4d8-c6c2-4473-9ec1-b5ad69e1dd48 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:20.003910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ee9b4d8-c6c2-4473-9ec1-b5ad69e1dd48 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:20.005926 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ee9b4d8-c6c2-4473-9ec1-b5ad69e1dd48 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:20.009351 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ee9b4d8-c6c2-4473-9ec1-b5ad69e1dd48 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:20.010383 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ee9b4d8-c6c2-4473-9ec1-b5ad69e1dd48 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:20.049386 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:51:20.148969 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e54633e1-b19e-449c-9a32-3db6f1958ac1 tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:20.149578 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e54633e1-b19e-449c-9a32-3db6f1958ac1 tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:20.149927 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e54633e1-b19e-449c-9a32-3db6f1958ac1 tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:20.151517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e54633e1-b19e-449c-9a32-3db6f1958ac1 tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:20.152175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e54633e1-b19e-449c-9a32-3db6f1958ac1 tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:20.152819 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e54633e1-b19e-449c-9a32-3db6f1958ac1 tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:20.227958 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e54633e1-b19e-449c-9a32-3db6f1958ac1 tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/394b1bbcff6d4a509ae2c2acadcac0b6" status: 200 len: 328 microversion: 2.1 time: 0.711241 Sep 17 20:51:20.229328 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 135/337] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Sep 17 20:51:19 2022] PUT /compute/v2.1/os-quota-sets/394b1bbcff6d4a509ae2c2acadcac0b6 => generated 328 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:20.450876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9e1422e6-e8e2-45a4-bb8f-54b0e706bb96 tempest-HypervisorAdminNegativeTestJSON-1329849698 tempest-HypervisorAdminNegativeTestJSON-1329849698-project] Calling method '.version_select at 0x7f25a5c5bca0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:20.453119 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9e1422e6-e8e2-45a4-bb8f-54b0e706bb96 tempest-HypervisorAdminNegativeTestJSON-1329849698 tempest-HypervisorAdminNegativeTestJSON-1329849698-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'bef3da9984ab4171955b0bdfdaa259f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e1743a6fc742b094552a4f35de8110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:20.455108 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9e1422e6-e8e2-45a4-bb8f-54b0e706bb96 tempest-HypervisorAdminNegativeTestJSON-1329849698 tempest-HypervisorAdminNegativeTestJSON-1329849698-project] Request method failure captured: Sep 17 20:51:20.455108 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Sep 17 20:51:20.455108 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:51:20.455108 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:51:20.455108 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:51:20.455108 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:51:20.455108 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:51:20.455108 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:51:20.455108 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:51:20.455108 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:20.455108 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjNGuuG4N893JqKtHT7dW42NLdbysoX8b2EJsfEZh5u0_Vl_0wNvhz8sfGNA8M2Gdzso4xjeSQJfQUYG7AQ98093XQ2IkaOcIzZfG2W2Xp0jP3N6Vvag5r_572JiBjUMMS-iUfOSt2RRsOjOByxY-qkN6TcGT9Js-__M0UmzvTN7RCM Sep 17 20:51:20.455108 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:51:20.455108 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:51:20.455108 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:51:20.455108 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:51:20.455108 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:51:20.455108 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:51:20.455108 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 75e1743a6fc742b094552a4f35de8110 Sep 17 20:51:20.455108 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1329849698 Sep 17 20:51:20.455108 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:51:20.455108 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:51:20.456653 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/75e1743a6fc742b094552a4f35de8110"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/75e1743a6fc742b094552a4f35de8110"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/75e1743a6fc742b094552a4f35de8110"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_75e1743a6fc742b094552a4f35de8110", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:20.456653 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1329849698 Sep 17 20:51:20.456653 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 75e1743a6fc742b094552a4f35de8110 Sep 17 20:51:20.456653 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1329849698 Sep 17 20:51:20.456653 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-HypervisorAdminNegativeTestJSON-1329849698-project Sep 17 20:51:20.456653 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:51:20.456653 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:51:20.456653 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: bef3da9984ab4171955b0bdfdaa259f2 Sep 17 20:51:20.456653 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1329849698-project Sep 17 20:51:20.456653 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 20:51:20.456653 ncdv-master-1 devstack@n-api.service[140523]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 17 20:51:20.456653 ncdv-master-1 devstack@n-api.service[140523]: action_args: {} Sep 17 20:51:20.456653 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:20.457772 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:20.457772 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:20.457772 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:20.457772 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:20.457772 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:20.457772 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:51:20.457772 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:51:20.457772 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:20.457772 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:20.457772 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Sep 17 20:51:20.457772 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._detail(req) Sep 17 20:51:20.457772 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Sep 17 20:51:20.457772 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Sep 17 20:51:20.457772 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 17 20:51:20.457772 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 17 20:51:20.457772 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 17 20:51:20.457772 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 17 20:51:20.457772 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:51:20.457772 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:51:20.459155 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:51:20.459155 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:51:20.459155 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 17 20:51:20.459155 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 17 20:51:20.459155 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 17 20:51:20.459155 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 17 20:51:20.459155 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 17 20:51:20.459155 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 17 20:51:20.459155 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 17 20:51:20.459155 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:20.459155 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:20.459155 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:20.459155 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:20.459155 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:20.459155 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:20.459155 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 17 20:51:20.459155 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 17 20:51:20.459155 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 17 20:51:20.459155 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:20.460441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9e1422e6-e8e2-45a4-bb8f-54b0e706bb96 tempest-HypervisorAdminNegativeTestJSON-1329849698 tempest-HypervisorAdminNegativeTestJSON-1329849698-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:20.460441 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9e1422e6-e8e2-45a4-bb8f-54b0e706bb96 tempest-HypervisorAdminNegativeTestJSON-1329849698 tempest-HypervisorAdminNegativeTestJSON-1329849698-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.226026 Sep 17 20:51:20.461221 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 136/338] 10.222.0.26 () {58 vars in 1167 bytes} [Sat Sep 17 20:51:20 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 231 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:20.466074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-84629c78-a400-4861-96eb-efb884bc7e12 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:20.466681 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-84629c78-a400-4861-96eb-efb884bc7e12 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 22274a46-3915-4c4a-891b-e5da0ab9423b] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:20.474761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84629c78-a400-4861-96eb-efb884bc7e12 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:20.475255 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84629c78-a400-4861-96eb-efb884bc7e12 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:20.475700 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84629c78-a400-4861-96eb-efb884bc7e12 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:20.476415 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84629c78-a400-4861-96eb-efb884bc7e12 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:20.476863 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84629c78-a400-4861-96eb-efb884bc7e12 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:20.477286 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84629c78-a400-4861-96eb-efb884bc7e12 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:20.483389 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2ee9b4d8-c6c2-4473-9ec1-b5ad69e1dd48 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:20.493192 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2ee9b4d8-c6c2-4473-9ec1-b5ad69e1dd48 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1475 microversion: 2.1 time: 0.528999 Sep 17 20:51:20.494680 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 203/339] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:19 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1475 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:20.560782 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d99f8833-a7fe-4d41-84b9-94e2fc90fe22 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:20.564678 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d99f8833-a7fe-4d41-84b9-94e2fc90fe22 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:20.565165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d99f8833-a7fe-4d41-84b9-94e2fc90fe22 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:20.565626 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d99f8833-a7fe-4d41-84b9-94e2fc90fe22 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:20.566353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d99f8833-a7fe-4d41-84b9-94e2fc90fe22 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:20.566803 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d99f8833-a7fe-4d41-84b9-94e2fc90fe22 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:20.567219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d99f8833-a7fe-4d41-84b9-94e2fc90fe22 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:20.595019 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d99f8833-a7fe-4d41-84b9-94e2fc90fe22 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.099197 Sep 17 20:51:20.595788 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 204/340] 10.222.0.26 () {58 vars in 1176 bytes} [Sat Sep 17 20:51:20 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:20.599993 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-28a4b44e-2f72-4b38-939e-94ce40e6a20d tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:20.612049 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-28a4b44e-2f72-4b38-939e-94ce40e6a20d tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-quota-sets/394b1bbcff6d4a509ae2c2acadcac0b6" status: 202 len: 0 microversion: 2.1 time: 0.015298 Sep 17 20:51:20.616221 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 205/341] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Sep 17 20:51:20 2022] DELETE /compute/v2.1/os-quota-sets/394b1bbcff6d4a509ae2c2acadcac0b6 => generated 0 bytes in 17 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:51:20.619953 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-be60015c-5063-4631-89e1-1a284f91b722 tempest-HypervisorAdminNegativeTestJSON-1329849698 tempest-HypervisorAdminNegativeTestJSON-1329849698-project] Calling method '.version_select at 0x7f25a5eea310>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:20.622276 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-be60015c-5063-4631-89e1-1a284f91b722 tempest-HypervisorAdminNegativeTestJSON-1329849698 tempest-HypervisorAdminNegativeTestJSON-1329849698-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'bef3da9984ab4171955b0bdfdaa259f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e1743a6fc742b094552a4f35de8110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:20.624376 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-be60015c-5063-4631-89e1-1a284f91b722 tempest-HypervisorAdminNegativeTestJSON-1329849698 tempest-HypervisorAdminNegativeTestJSON-1329849698-project] Request method failure captured: Sep 17 20:51:20.624376 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Sep 17 20:51:20.624376 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:51:20.624376 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:51:20.624376 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:51:20.624376 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:51:20.624376 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:51:20.624376 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:51:20.624376 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:51:20.624376 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:20.624376 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjNGuuG4N893JqKtHT7dW42NLdbysoX8b2EJsfEZh5u0_Vl_0wNvhz8sfGNA8M2Gdzso4xjeSQJfQUYG7AQ98093XQ2IkaOcIzZfG2W2Xp0jP3N6Vvag5r_572JiBjUMMS-iUfOSt2RRsOjOByxY-qkN6TcGT9Js-__M0UmzvTN7RCM Sep 17 20:51:20.624376 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:51:20.624376 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:51:20.624376 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:51:20.624376 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:51:20.624376 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:51:20.624376 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:51:20.624376 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 75e1743a6fc742b094552a4f35de8110 Sep 17 20:51:20.624376 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1329849698 Sep 17 20:51:20.624376 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:51:20.624376 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:51:20.625646 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/75e1743a6fc742b094552a4f35de8110"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/75e1743a6fc742b094552a4f35de8110"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/75e1743a6fc742b094552a4f35de8110"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_75e1743a6fc742b094552a4f35de8110", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:20.625646 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1329849698 Sep 17 20:51:20.625646 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 75e1743a6fc742b094552a4f35de8110 Sep 17 20:51:20.625646 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1329849698 Sep 17 20:51:20.625646 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-HypervisorAdminNegativeTestJSON-1329849698-project Sep 17 20:51:20.625646 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:51:20.625646 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:51:20.625646 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: bef3da9984ab4171955b0bdfdaa259f2 Sep 17 20:51:20.625646 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1329849698-project Sep 17 20:51:20.625646 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:51:20.625646 ncdv-master-1 devstack@n-api.service[140524]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 17 20:51:20.625646 ncdv-master-1 devstack@n-api.service[140524]: action_args: {} Sep 17 20:51:20.625646 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:20.626392 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:20.626392 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:20.626392 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:20.626392 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:20.626392 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:20.626392 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:51:20.626392 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:51:20.626392 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:20.626392 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:20.626392 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Sep 17 20:51:20.626392 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 17 20:51:20.626392 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Sep 17 20:51:20.626392 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Sep 17 20:51:20.626392 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 17 20:51:20.626392 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 17 20:51:20.626392 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 17 20:51:20.626392 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 17 20:51:20.626392 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:51:20.626392 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:51:20.627498 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:51:20.627498 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:51:20.627498 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 17 20:51:20.627498 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 17 20:51:20.627498 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 17 20:51:20.627498 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 17 20:51:20.627498 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 17 20:51:20.627498 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 17 20:51:20.627498 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 17 20:51:20.627498 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:20.627498 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:20.627498 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:20.627498 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:20.627498 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:20.627498 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:20.627498 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 17 20:51:20.627498 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 17 20:51:20.627498 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 17 20:51:20.627498 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:20.628576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-be60015c-5063-4631-89e1-1a284f91b722 tempest-HypervisorAdminNegativeTestJSON-1329849698 tempest-HypervisorAdminNegativeTestJSON-1329849698-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:20.628576 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-be60015c-5063-4631-89e1-1a284f91b722 tempest-HypervisorAdminNegativeTestJSON-1329849698 tempest-HypervisorAdminNegativeTestJSON-1329849698-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.011614 Sep 17 20:51:20.628576 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 206/342] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:51:20 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:20.634245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5c47b3b6-4818-4a4f-a43a-d0e5d46a8140 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-503469516"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:20.638338 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.aggregate [None req-5c47b3b6-4818-4a4f-a43a-d0e5d46a8140 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Generated uuid 9b25a79f-dc63-4dcf-8bbb-2be91a6abb05 for aggregate {{(pid=140524) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 17 20:51:20.665775 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5c47b3b6-4818-4a4f-a43a-d0e5d46a8140 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.037466 Sep 17 20:51:20.666769 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 207/343] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Sep 17 20:51:20 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:20.687189 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-283f2310-0502-415b-9fae-dca2e40825bc tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Calling method '.version_select at 0x7f25a5eea280>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:20.760235 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-283f2310-0502-415b-9fae-dca2e40825bc tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/394b1bbcff6d4a509ae2c2acadcac0b6" status: 200 len: 371 microversion: 2.1 time: 0.091840 Sep 17 20:51:20.771491 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 208/344] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Sep 17 20:51:20 2022] GET /compute/v2.1/os-quota-sets/394b1bbcff6d4a509ae2c2acadcac0b6 => generated 371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:20.777139 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1406a4a5-8e6d-4f23-934c-2b64eca7d2d9 tempest-HypervisorAdminNegativeTestJSON-1329849698 tempest-HypervisorAdminNegativeTestJSON-1329849698-project] Calling method '.version_select at 0x7f25a5e5ab80>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:20.780139 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1406a4a5-8e6d-4f23-934c-2b64eca7d2d9 tempest-HypervisorAdminNegativeTestJSON-1329849698 tempest-HypervisorAdminNegativeTestJSON-1329849698-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'bef3da9984ab4171955b0bdfdaa259f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e1743a6fc742b094552a4f35de8110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:20.782181 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1406a4a5-8e6d-4f23-934c-2b64eca7d2d9 tempest-HypervisorAdminNegativeTestJSON-1329849698 tempest-HypervisorAdminNegativeTestJSON-1329849698-project] Request method failure captured: Sep 17 20:51:20.782181 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Sep 17 20:51:20.782181 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:51:20.782181 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:51:20.782181 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:51:20.782181 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:51:20.782181 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:51:20.782181 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:51:20.782181 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:51:20.782181 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:20.782181 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjNGuuG4N893JqKtHT7dW42NLdbysoX8b2EJsfEZh5u0_Vl_0wNvhz8sfGNA8M2Gdzso4xjeSQJfQUYG7AQ98093XQ2IkaOcIzZfG2W2Xp0jP3N6Vvag5r_572JiBjUMMS-iUfOSt2RRsOjOByxY-qkN6TcGT9Js-__M0UmzvTN7RCM Sep 17 20:51:20.782181 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:51:20.782181 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:51:20.782181 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:51:20.782181 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:51:20.782181 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:51:20.782181 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:51:20.782181 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 75e1743a6fc742b094552a4f35de8110 Sep 17 20:51:20.782181 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1329849698 Sep 17 20:51:20.782181 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:51:20.782181 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:51:20.783376 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/75e1743a6fc742b094552a4f35de8110"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/75e1743a6fc742b094552a4f35de8110"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/75e1743a6fc742b094552a4f35de8110"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_75e1743a6fc742b094552a4f35de8110", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:20.783376 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1329849698 Sep 17 20:51:20.783376 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 75e1743a6fc742b094552a4f35de8110 Sep 17 20:51:20.783376 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1329849698 Sep 17 20:51:20.783376 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-HypervisorAdminNegativeTestJSON-1329849698-project Sep 17 20:51:20.783376 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:51:20.783376 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:51:20.783376 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: bef3da9984ab4171955b0bdfdaa259f2 Sep 17 20:51:20.783376 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1329849698-project Sep 17 20:51:20.783376 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:51:20.783376 ncdv-master-1 devstack@n-api.service[140524]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 17 20:51:20.783376 ncdv-master-1 devstack@n-api.service[140524]: action_args: {} Sep 17 20:51:20.783376 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:20.784091 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:20.784091 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:20.784091 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:20.784091 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:20.784091 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:20.784091 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:51:20.784091 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:51:20.784091 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:20.784091 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:20.784091 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Sep 17 20:51:20.784091 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Sep 17 20:51:20.784091 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 17 20:51:20.784091 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 17 20:51:20.784091 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 17 20:51:20.784091 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 17 20:51:20.784091 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:51:20.784091 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:51:20.784091 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:51:20.784091 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:51:20.785107 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 17 20:51:20.785107 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 17 20:51:20.785107 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 17 20:51:20.785107 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 17 20:51:20.785107 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 17 20:51:20.785107 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 17 20:51:20.785107 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 17 20:51:20.785107 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:20.785107 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:20.785107 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:20.785107 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:20.785107 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:20.785107 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:20.785107 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 17 20:51:20.785107 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 17 20:51:20.785107 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 17 20:51:20.785107 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:20.788014 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1406a4a5-8e6d-4f23-934c-2b64eca7d2d9 tempest-HypervisorAdminNegativeTestJSON-1329849698 tempest-HypervisorAdminNegativeTestJSON-1329849698-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:20.789268 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1406a4a5-8e6d-4f23-934c-2b64eca7d2d9 tempest-HypervisorAdminNegativeTestJSON-1329849698 tempest-HypervisorAdminNegativeTestJSON-1329849698-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.016465 Sep 17 20:51:20.796384 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 209/345] 10.222.0.26 () {58 vars in 1179 bytes} [Sat Sep 17 20:51:20 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:20.809029 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e70fbad9-1c30-46eb-960f-2b6468382453 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:20.819194 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-84629c78-a400-4861-96eb-efb884bc7e12 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8bfe1d590a4500b7e7b5c79a6a4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea88200545ae4003b42b0d475f482c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:20.823083 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e70fbad9-1c30-46eb-960f-2b6468382453 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:20.823577 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e70fbad9-1c30-46eb-960f-2b6468382453 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:20.824321 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e70fbad9-1c30-46eb-960f-2b6468382453 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:20.838125 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-84629c78-a400-4861-96eb-efb884bc7e12 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] 10.222.0.26 "GET /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b" status: 200 len: 1468 microversion: 2.1 time: 0.375739 Sep 17 20:51:20.842728 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 137/346] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:20 2022] GET /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b => generated 1468 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:21.055563 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e70fbad9-1c30-46eb-960f-2b6468382453 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.258031 Sep 17 20:51:21.063238 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 210/347] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Sep 17 20:51:20 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:21.066014 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5e29cff9-610b-4b71-975a-f7e2531757f1 tempest-DeleteServersAdminTestJSON-235619281 tempest-DeleteServersAdminTestJSON-235619281-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:21.072346 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5e29cff9-610b-4b71-975a-f7e2531757f1 tempest-DeleteServersAdminTestJSON-235619281 tempest-DeleteServersAdminTestJSON-235619281-project-admin] [instance: 22274a46-3915-4c4a-891b-e5da0ab9423b] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:21.093667 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e29cff9-610b-4b71-975a-f7e2531757f1 tempest-DeleteServersAdminTestJSON-235619281 tempest-DeleteServersAdminTestJSON-235619281-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:21.094189 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e29cff9-610b-4b71-975a-f7e2531757f1 tempest-DeleteServersAdminTestJSON-235619281 tempest-DeleteServersAdminTestJSON-235619281-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:21.096866 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e29cff9-610b-4b71-975a-f7e2531757f1 tempest-DeleteServersAdminTestJSON-235619281 tempest-DeleteServersAdminTestJSON-235619281-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:21.098860 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e29cff9-610b-4b71-975a-f7e2531757f1 tempest-DeleteServersAdminTestJSON-235619281 tempest-DeleteServersAdminTestJSON-235619281-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:21.101322 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e29cff9-610b-4b71-975a-f7e2531757f1 tempest-DeleteServersAdminTestJSON-235619281 tempest-DeleteServersAdminTestJSON-235619281-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:21.101733 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e29cff9-610b-4b71-975a-f7e2531757f1 tempest-DeleteServersAdminTestJSON-235619281 tempest-DeleteServersAdminTestJSON-235619281-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:21.138832 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1c644065-2bfb-49e6-9469-701d7c4e8cd9 tempest-HypervisorAdminNegativeTestJSON-527292234 tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin] Calling method '.version_select at 0x7f25a5c868b0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:21.141076 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c644065-2bfb-49e6-9469-701d7c4e8cd9 tempest-HypervisorAdminNegativeTestJSON-527292234 tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:21.141849 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c644065-2bfb-49e6-9469-701d7c4e8cd9 tempest-HypervisorAdminNegativeTestJSON-527292234 tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:21.142436 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c644065-2bfb-49e6-9469-701d7c4e8cd9 tempest-HypervisorAdminNegativeTestJSON-527292234 tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:21.165389 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c644065-2bfb-49e6-9469-701d7c4e8cd9 tempest-HypervisorAdminNegativeTestJSON-527292234 tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:21.166096 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c644065-2bfb-49e6-9469-701d7c4e8cd9 tempest-HypervisorAdminNegativeTestJSON-527292234 tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:21.166464 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c644065-2bfb-49e6-9469-701d7c4e8cd9 tempest-HypervisorAdminNegativeTestJSON-527292234 tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:21.181189 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c644065-2bfb-49e6-9469-701d7c4e8cd9 tempest-HypervisorAdminNegativeTestJSON-527292234 tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:21.181863 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c644065-2bfb-49e6-9469-701d7c4e8cd9 tempest-HypervisorAdminNegativeTestJSON-527292234 tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:21.182687 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c644065-2bfb-49e6-9469-701d7c4e8cd9 tempest-HypervisorAdminNegativeTestJSON-527292234 tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:21.190643 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1c644065-2bfb-49e6-9469-701d7c4e8cd9 tempest-HypervisorAdminNegativeTestJSON-527292234 tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.346776 Sep 17 20:51:21.191338 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 138/348] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:51:20 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:21.203059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-64c1f090-9937-4d56-8782-a11078cade52 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:21.203830 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-64c1f090-9937-4d56-8782-a11078cade52 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] [instance: f297915d-a9fc-44c9-8bc6-a4a682978ed9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:21.211142 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-64c1f090-9937-4d56-8782-a11078cade52 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:21.211741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-64c1f090-9937-4d56-8782-a11078cade52 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:21.212231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-64c1f090-9937-4d56-8782-a11078cade52 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:21.213043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-64c1f090-9937-4d56-8782-a11078cade52 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:21.213725 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-64c1f090-9937-4d56-8782-a11078cade52 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:21.214207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-64c1f090-9937-4d56-8782-a11078cade52 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:21.216960 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5e29cff9-610b-4b71-975a-f7e2531757f1 tempest-DeleteServersAdminTestJSON-235619281 tempest-DeleteServersAdminTestJSON-235619281-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b/action" status: 202 len: 0 microversion: 2.1 time: 0.158058 Sep 17 20:51:21.221710 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 211/349] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:51:21 2022] POST /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:51:21.226580 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-23875c4c-45f0-4b8d-9f6a-7b4bba865f7c tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:21.236688 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-64c1f090-9937-4d56-8782-a11078cade52 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] HTTP exception thrown: Instance f297915d-a9fc-44c9-8bc6-a4a682978ed9 could not be found. Sep 17 20:51:21.238637 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-64c1f090-9937-4d56-8782-a11078cade52 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Request method failure captured: Sep 17 20:51:21.238637 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/f297915d-a9fc-44c9-8bc6-a4a682978ed9 HTTP/1.1 Sep 17 20:51:21.238637 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:51:21.238637 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:51:21.238637 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:51:21.238637 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:51:21.238637 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:51:21.238637 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:51:21.238637 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:51:21.238637 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:21.238637 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjMyxj4cSPydSu4KsveEwXFJJL7ItXcMx3xJ_BRoMp-kDT_V8iTNRkq-SW7gesaeWs0NXQQ4wT39LTJtA0_bO80l_B6BKe0Dx0JN6SWQNTL0vVNNfppsnxtjgSv6RfmPSSKXirlU6u3Ej6XbmfkZJ6LHd8ZbugB8eXA4jAyEgKufiGc Sep 17 20:51:21.238637 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:51:21.238637 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:51:21.238637 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:51:21.238637 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:51:21.238637 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:51:21.238637 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:51:21.238637 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: f273bfff7ced4f2e885d1ead94a9a486 Sep 17 20:51:21.238637 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-TenantUsagesTestJSON-1889558455 Sep 17 20:51:21.238637 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:51:21.238637 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:51:21.239868 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f273bfff7ced4f2e885d1ead94a9a486"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f273bfff7ced4f2e885d1ead94a9a486"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f273bfff7ced4f2e885d1ead94a9a486"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f273bfff7ced4f2e885d1ead94a9a486", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:21.239868 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-TenantUsagesTestJSON-1889558455 Sep 17 20:51:21.239868 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: f273bfff7ced4f2e885d1ead94a9a486 Sep 17 20:51:21.239868 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1889558455 Sep 17 20:51:21.239868 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-TenantUsagesTestJSON-1889558455-project Sep 17 20:51:21.239868 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:51:21.239868 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:51:21.239868 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: ec6d47d564174aceb110b3354ff7db2a Sep 17 20:51:21.239868 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-TenantUsagesTestJSON-1889558455-project Sep 17 20:51:21.239868 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:51:21.239868 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance f297915d-a9fc-44c9-8bc6-a4a682978ed9 could not be found. Sep 17 20:51:21.239868 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'f297915d-a9fc-44c9-8bc6-a4a682978ed9'} Sep 17 20:51:21.240543 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:21.240543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:21.240543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:51:21.240543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:51:21.240543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:51:21.240543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:51:21.240543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:51:21.240543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:51:21.240543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:51:21.240543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:51:21.240543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f297915d-a9fc-44c9-8bc6-a4a682978ed9 could not be found. Sep 17 20:51:21.240543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:21.240543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:21.240543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:21.240543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:21.240543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:21.240543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:21.240543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:21.240543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:21.240543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:21.241719 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:21.241719 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:51:21.241719 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:51:21.241719 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:51:21.241719 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:51:21.241719 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:51:21.241719 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:51:21.241719 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f297915d-a9fc-44c9-8bc6-a4a682978ed9 could not be found. Sep 17 20:51:21.241719 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:21.241719 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:21.241719 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:21.241719 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:21.241719 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:21.241719 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:21.241719 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:21.241719 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:21.241719 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f297915d-a9fc-44c9-8bc6-a4a682978ed9 could not be found. Sep 17 20:51:21.241719 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:21.244121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23875c4c-45f0-4b8d-9f6a-7b4bba865f7c tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:21.244121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23875c4c-45f0-4b8d-9f6a-7b4bba865f7c tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:21.244121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23875c4c-45f0-4b8d-9f6a-7b4bba865f7c tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:21.245929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-64c1f090-9937-4d56-8782-a11078cade52 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] Returning 404 to user: Instance f297915d-a9fc-44c9-8bc6-a4a682978ed9 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:21.247093 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-64c1f090-9937-4d56-8782-a11078cade52 tempest-TenantUsagesTestJSON-1889558455 tempest-TenantUsagesTestJSON-1889558455-project] 10.222.0.26 "GET /compute/v2.1/servers/f297915d-a9fc-44c9-8bc6-a4a682978ed9" status: 404 len: 111 microversion: 2.1 time: 0.048849 Sep 17 20:51:21.248208 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 139/350] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:21 2022] GET /compute/v2.1/servers/f297915d-a9fc-44c9-8bc6-a4a682978ed9 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:21.254488 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d4969029-2e0a-4054-8060-0091d75ad390 tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Calling method '.version_select at 0x7f25a5d42700>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:21.277249 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-23875c4c-45f0-4b8d-9f6a-7b4bba865f7c tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] HTTP exception thrown: Aggregate 11 already has host nch2-master-1. Sep 17 20:51:21.292688 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-23875c4c-45f0-4b8d-9f6a-7b4bba865f7c tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Request method failure captured: Sep 17 20:51:21.292688 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Sep 17 20:51:21.292688 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:51:21.292688 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:51:21.292688 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:51:21.292688 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 39 Sep 17 20:51:21.292688 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:51:21.292688 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:51:21.292688 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:51:21.292688 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:21.292688 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjNIistXvmaDMzDb4OArfIQfJMLOCKe4sVvi6E7xMm93sC2sCSdGrEIMlHjm4LcJzzbdYq7jED-w0aT93P87kgHmXi3uifQIbli7EeqhyK28jfoR4g85_jQGDfGTV0sZE-KiKx8ayKfbN_ASQqb6YhSBXcGYktOMynSp-opCnDS2e30 Sep 17 20:51:21.292688 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:51:21.292688 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:51:21.292688 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:51:21.292688 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:51:21.292688 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:51:21.292688 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:51:21.292688 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 4938af1a380d4294aeac011134799031 Sep 17 20:51:21.292688 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1771198131 Sep 17 20:51:21.292688 ncdv-master-1 devstack@n-api.service[140524]: X-Role: admin,member,reader Sep 17 20:51:21.292688 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: admin,member,reader Sep 17 20:51:21.294245 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4938af1a380d4294aeac011134799031"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4938af1a380d4294aeac011134799031"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4938af1a380d4294aeac011134799031"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4938af1a380d4294aeac011134799031", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:21.294245 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1771198131 Sep 17 20:51:21.294245 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 4938af1a380d4294aeac011134799031 Sep 17 20:51:21.294245 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1771198131 Sep 17 20:51:21.294245 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin Sep 17 20:51:21.294245 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:51:21.294245 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:51:21.294245 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 3db3d87bec8d48e3adb1f9e210152018 Sep 17 20:51:21.294245 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin Sep 17 20:51:21.294245 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:51:21.294245 ncdv-master-1 devstack@n-api.service[140524]: {"add_host": {"host": "nch2-master-1"}} Sep 17 20:51:21.294245 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:51:21.294245 ncdv-master-1 devstack@n-api.service[140524]: exception: Aggregate 11 already has host nch2-master-1. Sep 17 20:51:21.295002 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '11', 'body': {'add_host': {'host': 'nch2-master-1'}}} Sep 17 20:51:21.295002 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:21.295002 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:21.295002 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 20:51:21.295002 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 17 20:51:21.295002 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 20:51:21.295002 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 17 20:51:21.295002 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 20:51:21.295002 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 17 20:51:21.295002 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 20:51:21.295002 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 17 20:51:21.295002 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 20:51:21.295002 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 20:51:21.295002 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 20:51:21.295002 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result.read() Sep 17 20:51:21.295002 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 20:51:21.295002 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 17 20:51:21.295002 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 20:51:21.295002 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 17 20:51:21.296054 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 20:51:21.296054 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 17 20:51:21.296054 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 20:51:21.296054 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 17 20:51:21.296054 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'nch2-master-1-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 17 20:51:21.296054 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:21.296054 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 17 20:51:21.296054 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:21.296054 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:21.296054 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Sep 17 20:51:21.296054 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Sep 17 20:51:21.296054 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 17 20:51:21.296054 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi session.flush() Sep 17 20:51:21.296054 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 17 20:51:21.296054 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 17 20:51:21.296054 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 17 20:51:21.296054 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 17 20:51:21.296054 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 17 20:51:21.296054 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 17 20:51:21.299167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 20:51:21.299167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception Sep 17 20:51:21.299167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 17 20:51:21.299167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 17 20:51:21.299167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 17 20:51:21.299167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 17 20:51:21.299167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 17 20:51:21.299167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 17 20:51:21.299167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 17 20:51:21.299167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 17 20:51:21.299167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 17 20:51:21.299167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 17 20:51:21.299167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 17 20:51:21.299167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 17 20:51:21.299167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 17 20:51:21.299167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 17 20:51:21.299167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 17 20:51:21.299167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 17 20:51:21.301118 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 17 20:51:21.301118 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 17 20:51:21.301118 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 17 20:51:21.301118 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 17 20:51:21.301118 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 20:51:21.301118 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception Sep 17 20:51:21.301118 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 20:51:21.301118 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 17 20:51:21.301118 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 20:51:21.301118 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 17 20:51:21.301118 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 20:51:21.301118 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 17 20:51:21.301118 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 20:51:21.301118 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 17 20:51:21.301118 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 20:51:21.301118 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 20:51:21.301118 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 20:51:21.301118 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result.read() Sep 17 20:51:21.303484 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 20:51:21.303484 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 17 20:51:21.303484 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 20:51:21.303484 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 17 20:51:21.303484 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 20:51:21.303484 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 17 20:51:21.303484 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 20:51:21.303484 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 17 20:51:21.303484 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'nch2-master-1-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 17 20:51:21.303484 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Sep 17 20:51:21.303484 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 17, 20, 51, 21, 258391), 'updated_at': None, 'host': 'nch2-master-1', 'aggregate_id': 11}] Sep 17 20:51:21.303484 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 17 20:51:21.303484 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:21.303484 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:21.303484 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:21.303484 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:21.303484 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 17 20:51:21.306755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 17 20:51:21.306755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 17 20:51:21.306755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 17 20:51:21.306755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:51:21.306755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:51:21.306755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:51:21.306755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:51:21.306755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 17 20:51:21.306755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 17 20:51:21.306755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Sep 17 20:51:21.306755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Sep 17 20:51:21.306755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 17 20:51:21.306755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 17 20:51:21.306755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Sep 17 20:51:21.306755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Sep 17 20:51:21.306755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Sep 17 20:51:21.306755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Sep 17 20:51:21.306755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host nch2-master-1. Sep 17 20:51:21.306755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:21.306755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:21.314555 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:21.314555 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:21.314555 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:21.314555 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:21.314555 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:21.314555 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:21.314555 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:21.314555 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:21.314555 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:51:21.314555 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:51:21.314555 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Sep 17 20:51:21.314555 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 17 20:51:21.314555 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host nch2-master-1. Sep 17 20:51:21.314555 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:21.314555 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:21.314555 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:21.314555 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:21.314555 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:21.314555 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:21.314555 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:21.314555 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:21.317218 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host nch2-master-1. Sep 17 20:51:21.317218 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:21.317218 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-23875c4c-45f0-4b8d-9f6a-7b4bba865f7c tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Returning 409 to user: Aggregate 11 already has host nch2-master-1. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:21.317218 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-23875c4c-45f0-4b8d-9f6a-7b4bba865f7c tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 96 microversion: 2.1 time: 0.072821 Sep 17 20:51:21.317218 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 212/351] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Sep 17 20:51:21 2022] POST /compute/v2.1/os-aggregates/11/action => generated 96 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Sep 17 20:51:21.317218 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-87421558-1194-474d-af8b-550ff12ecbc4 tempest-HypervisorAdminNegativeTestJSON-1329849698 tempest-HypervisorAdminNegativeTestJSON-1329849698-project] Calling method '.version_select at 0x7f25a5c2cdc0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:21.318072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-87421558-1194-474d-af8b-550ff12ecbc4 tempest-HypervisorAdminNegativeTestJSON-1329849698 tempest-HypervisorAdminNegativeTestJSON-1329849698-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'bef3da9984ab4171955b0bdfdaa259f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e1743a6fc742b094552a4f35de8110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:21.318072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-87421558-1194-474d-af8b-550ff12ecbc4 tempest-HypervisorAdminNegativeTestJSON-1329849698 tempest-HypervisorAdminNegativeTestJSON-1329849698-project] Request method failure captured: Sep 17 20:51:21.318072 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Sep 17 20:51:21.318072 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:51:21.318072 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:51:21.318072 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:51:21.318072 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:51:21.318072 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:51:21.318072 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:51:21.318072 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:51:21.318072 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:21.318072 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjNGuuG4N893JqKtHT7dW42NLdbysoX8b2EJsfEZh5u0_Vl_0wNvhz8sfGNA8M2Gdzso4xjeSQJfQUYG7AQ98093XQ2IkaOcIzZfG2W2Xp0jP3N6Vvag5r_572JiBjUMMS-iUfOSt2RRsOjOByxY-qkN6TcGT9Js-__M0UmzvTN7RCM Sep 17 20:51:21.318072 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:51:21.318072 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:51:21.318072 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:51:21.318072 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:51:21.318072 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:51:21.318072 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:51:21.318072 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 75e1743a6fc742b094552a4f35de8110 Sep 17 20:51:21.318072 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1329849698 Sep 17 20:51:21.318072 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:51:21.318072 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:51:21.320800 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/75e1743a6fc742b094552a4f35de8110"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/75e1743a6fc742b094552a4f35de8110"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/75e1743a6fc742b094552a4f35de8110"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_75e1743a6fc742b094552a4f35de8110", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:21.320800 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1329849698 Sep 17 20:51:21.320800 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 75e1743a6fc742b094552a4f35de8110 Sep 17 20:51:21.320800 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1329849698 Sep 17 20:51:21.320800 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-HypervisorAdminNegativeTestJSON-1329849698-project Sep 17 20:51:21.320800 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:51:21.320800 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:51:21.320800 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: bef3da9984ab4171955b0bdfdaa259f2 Sep 17 20:51:21.320800 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1329849698-project Sep 17 20:51:21.320800 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:51:21.320800 ncdv-master-1 devstack@n-api.service[140524]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 17 20:51:21.320800 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '1'} Sep 17 20:51:21.320800 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:21.322526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:21.322526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:21.322526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:21.322526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:21.322526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:21.322526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:51:21.322526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:51:21.322526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:21.322526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:21.322526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Sep 17 20:51:21.322526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Sep 17 20:51:21.322526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 17 20:51:21.322526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 17 20:51:21.322526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 17 20:51:21.322526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 17 20:51:21.322526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:51:21.322526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:51:21.322526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:51:21.322526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:51:21.325372 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 17 20:51:21.325372 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 17 20:51:21.325372 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 17 20:51:21.325372 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 17 20:51:21.325372 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 17 20:51:21.325372 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 17 20:51:21.325372 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 17 20:51:21.325372 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:21.325372 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:21.325372 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:21.325372 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:21.325372 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:21.325372 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:21.325372 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 17 20:51:21.325372 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 17 20:51:21.325372 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 17 20:51:21.325372 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:21.327558 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-87421558-1194-474d-af8b-550ff12ecbc4 tempest-HypervisorAdminNegativeTestJSON-1329849698 tempest-HypervisorAdminNegativeTestJSON-1329849698-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:21.327558 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-87421558-1194-474d-af8b-550ff12ecbc4 tempest-HypervisorAdminNegativeTestJSON-1329849698 tempest-HypervisorAdminNegativeTestJSON-1329849698-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.011398 Sep 17 20:51:21.327558 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 213/352] 10.222.0.26 () {58 vars in 1173 bytes} [Sat Sep 17 20:51:21 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:21.327558 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a70eb32c-95a0-47e3-81f7-34dcff711232 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:21.327558 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a70eb32c-95a0-47e3-81f7-34dcff711232 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 22274a46-3915-4c4a-891b-e5da0ab9423b] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:21.328231 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a70eb32c-95a0-47e3-81f7-34dcff711232 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:21.328456 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a70eb32c-95a0-47e3-81f7-34dcff711232 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:21.328891 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a70eb32c-95a0-47e3-81f7-34dcff711232 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:21.329649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a70eb32c-95a0-47e3-81f7-34dcff711232 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:21.330100 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a70eb32c-95a0-47e3-81f7-34dcff711232 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:21.330574 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a70eb32c-95a0-47e3-81f7-34dcff711232 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:21.377955 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a70eb32c-95a0-47e3-81f7-34dcff711232 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:21.378581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a70eb32c-95a0-47e3-81f7-34dcff711232 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:21.379445 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a70eb32c-95a0-47e3-81f7-34dcff711232 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:21.379984 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-a70eb32c-95a0-47e3-81f7-34dcff711232 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lazy-loading 'fault' on Instance uuid 22274a46-3915-4c4a-891b-e5da0ab9423b {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:51:21.752171 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d4969029-2e0a-4054-8060-0091d75ad390 tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/b01f4e11e8674f35a6781fa05a0a727f/defaults" status: 200 len: 371 microversion: 2.1 time: 0.502208 Sep 17 20:51:21.752766 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 140/353] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Sep 17 20:51:21 2022] GET /compute/v2.1/os-quota-sets/b01f4e11e8674f35a6781fa05a0a727f/defaults => generated 371 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:21.769031 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-89ee8d3c-8f98-4e31-ad74-0e9bb71a1729 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:21.807801 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89ee8d3c-8f98-4e31-ad74-0e9bb71a1729 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:21.808286 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89ee8d3c-8f98-4e31-ad74-0e9bb71a1729 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:21.808776 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89ee8d3c-8f98-4e31-ad74-0e9bb71a1729 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:21.890295 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a70eb32c-95a0-47e3-81f7-34dcff711232 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8bfe1d590a4500b7e7b5c79a6a4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea88200545ae4003b42b0d475f482c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:21.903351 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a70eb32c-95a0-47e3-81f7-34dcff711232 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] 10.222.0.26 "GET /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b" status: 200 len: 1451 microversion: 2.1 time: 0.588648 Sep 17 20:51:21.904215 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 214/354] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:21 2022] GET /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b => generated 1451 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:21.913726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-95be69bc-5983-494e-984c-1a208cb9b4fb tempest-HypervisorAdminNegativeTestJSON-527292234 tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin] Calling method '.version_select at 0x7f25a5c2caf0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:21.915579 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-95be69bc-5983-494e-984c-1a208cb9b4fb tempest-HypervisorAdminNegativeTestJSON-527292234 tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin] HTTP exception thrown: Hypervisor with ID '73b572cb-3426-4fdc-ae2c-6353c8912eaa' could not be found. Sep 17 20:51:21.933155 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-95be69bc-5983-494e-984c-1a208cb9b4fb tempest-HypervisorAdminNegativeTestJSON-527292234 tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin] Request method failure captured: Sep 17 20:51:21.933155 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/os-hypervisors/73b572cb-3426-4fdc-ae2c-6353c8912eaa/uptime HTTP/1.1 Sep 17 20:51:21.933155 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:51:21.933155 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:51:21.933155 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:51:21.933155 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:51:21.933155 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:51:21.933155 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:51:21.933155 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:51:21.933155 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:21.933155 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjNHKYQEGcj8EFBccOU4B1hqD8EDFHw08AC5aG0F0G7fk6sEpkwds_34W8JMua4EquAKULbcrAEvI3YXEw9ZKF8cCnH23Qy-fh8s7pIEFFGO3Eio3Nmr6j4iuMfGJ5uYRmkDuJEPcho3obURqhoA8A4MuCW0z0GF-Sr0NLvo5Ii6obU Sep 17 20:51:21.933155 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:51:21.933155 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:51:21.933155 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:51:21.933155 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:51:21.933155 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:51:21.933155 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:51:21.933155 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 11c1a049afe54eecbf96b5d469374cda Sep 17 20:51:21.933155 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-527292234 Sep 17 20:51:21.933155 ncdv-master-1 devstack@n-api.service[140524]: X-Role: admin,member,reader Sep 17 20:51:21.933155 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: admin,member,reader Sep 17 20:51:21.934783 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/11c1a049afe54eecbf96b5d469374cda"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/11c1a049afe54eecbf96b5d469374cda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/11c1a049afe54eecbf96b5d469374cda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_11c1a049afe54eecbf96b5d469374cda", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:21.934783 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-527292234 Sep 17 20:51:21.934783 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 11c1a049afe54eecbf96b5d469374cda Sep 17 20:51:21.934783 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-527292234 Sep 17 20:51:21.934783 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin Sep 17 20:51:21.934783 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:51:21.934783 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:51:21.934783 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: c6261e6f72b24aeb9868a4fc6a08f5b9 Sep 17 20:51:21.934783 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin Sep 17 20:51:21.934783 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:51:21.934783 ncdv-master-1 devstack@n-api.service[140524]: exception: Hypervisor with ID '73b572cb-3426-4fdc-ae2c-6353c8912eaa' could not be found. Sep 17 20:51:21.934783 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '73b572cb-3426-4fdc-ae2c-6353c8912eaa'} Sep 17 20:51:21.935624 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:21.935624 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:21.935624 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 17 20:51:21.935624 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 17 20:51:21.935624 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '73b572cb-3426-4fdc-ae2c-6353c8912eaa' Sep 17 20:51:21.935624 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:21.935624 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:21.935624 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:21.935624 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:21.935624 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 17 20:51:21.935624 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 17 20:51:21.935624 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 17 20:51:21.935624 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 17 20:51:21.935624 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 17 20:51:21.935624 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:21.935624 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:21.935624 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:21.935624 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:21.935624 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 17 20:51:21.935624 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 17 20:51:21.935624 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 17 20:51:21.935624 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 17 20:51:21.937127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 17 20:51:21.937127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:21.937127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:21.937127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:21.937127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:21.937127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:21.937127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:21.937127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:21.937127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:21.937127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:51:21.937127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:51:21.937127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:21.937127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:21.937127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Sep 17 20:51:21.937127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 17 20:51:21.937127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 17 20:51:21.937127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 17 20:51:21.937127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '73b572cb-3426-4fdc-ae2c-6353c8912eaa' could not be found. Sep 17 20:51:21.937127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:21.937127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:21.937127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:21.942951 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:21.942951 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:21.942951 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:21.942951 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:21.942951 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:21.942951 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '73b572cb-3426-4fdc-ae2c-6353c8912eaa' could not be found. Sep 17 20:51:21.942951 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:21.942951 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-95be69bc-5983-494e-984c-1a208cb9b4fb tempest-HypervisorAdminNegativeTestJSON-527292234 tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin] Returning 404 to user: Hypervisor with ID '73b572cb-3426-4fdc-ae2c-6353c8912eaa' could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:21.942951 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-95be69bc-5983-494e-984c-1a208cb9b4fb tempest-HypervisorAdminNegativeTestJSON-527292234 tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/73b572cb-3426-4fdc-ae2c-6353c8912eaa/uptime" status: 404 len: 123 microversion: 2.1 time: 0.031651 Sep 17 20:51:21.942951 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 215/355] 10.222.0.26 () {58 vars in 1278 bytes} [Sat Sep 17 20:51:21 2022] GET /compute/v2.1/os-hypervisors/73b572cb-3426-4fdc-ae2c-6353c8912eaa/uptime => generated 123 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:21.946126 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-66cc8db4-a8f0-456c-828f-1ae5bb8f0754 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:21.946846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-66cc8db4-a8f0-456c-828f-1ae5bb8f0754 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:21.960127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66cc8db4-a8f0-456c-828f-1ae5bb8f0754 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:21.962560 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66cc8db4-a8f0-456c-828f-1ae5bb8f0754 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:21.963783 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66cc8db4-a8f0-456c-828f-1ae5bb8f0754 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:21.967113 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66cc8db4-a8f0-456c-828f-1ae5bb8f0754 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:21.967846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66cc8db4-a8f0-456c-828f-1ae5bb8f0754 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:21.968385 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66cc8db4-a8f0-456c-828f-1ae5bb8f0754 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:22.101406 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-89ee8d3c-8f98-4e31-ad74-0e9bb71a1729 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.347464 Sep 17 20:51:22.102863 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 141/356] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Sep 17 20:51:21 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:22.114003 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-17257abd-2a36-4ff6-a559-68e5cf31fec8 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:22.114762 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-17257abd-2a36-4ff6-a559-68e5cf31fec8 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 22274a46-3915-4c4a-891b-e5da0ab9423b] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:22.133651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17257abd-2a36-4ff6-a559-68e5cf31fec8 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:22.134776 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17257abd-2a36-4ff6-a559-68e5cf31fec8 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:22.137557 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17257abd-2a36-4ff6-a559-68e5cf31fec8 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:22.140232 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17257abd-2a36-4ff6-a559-68e5cf31fec8 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:22.140998 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17257abd-2a36-4ff6-a559-68e5cf31fec8 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:22.144144 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17257abd-2a36-4ff6-a559-68e5cf31fec8 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:22.215767 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-17257abd-2a36-4ff6-a559-68e5cf31fec8 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 22274a46-3915-4c4a-891b-e5da0ab9423b] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:51:22.359551 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-17257abd-2a36-4ff6-a559-68e5cf31fec8 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] 10.222.0.26 "DELETE /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b" status: 204 len: 0 microversion: 2.1 time: 0.254868 Sep 17 20:51:22.363754 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 142/357] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:51:22 2022] DELETE /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:51:22.372031 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-816df091-0c4e-4b75-98f9-bf32d235ebf4 tempest-HypervisorAdminNegativeTestJSON-527292234 tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin] Calling method '.version_select at 0x7f25a5c86820>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:22.373373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-816df091-0c4e-4b75-98f9-bf32d235ebf4 tempest-HypervisorAdminNegativeTestJSON-527292234 tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:22.373892 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-816df091-0c4e-4b75-98f9-bf32d235ebf4 tempest-HypervisorAdminNegativeTestJSON-527292234 tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:22.374337 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-816df091-0c4e-4b75-98f9-bf32d235ebf4 tempest-HypervisorAdminNegativeTestJSON-527292234 tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:22.388861 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=3,nova_api:DELETE=5,nova_api:INSERT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:51:22.393447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-816df091-0c4e-4b75-98f9-bf32d235ebf4 tempest-HypervisorAdminNegativeTestJSON-527292234 tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:22.394926 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-816df091-0c4e-4b75-98f9-bf32d235ebf4 tempest-HypervisorAdminNegativeTestJSON-527292234 tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:22.395377 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-816df091-0c4e-4b75-98f9-bf32d235ebf4 tempest-HypervisorAdminNegativeTestJSON-527292234 tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:22.414150 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-816df091-0c4e-4b75-98f9-bf32d235ebf4 tempest-HypervisorAdminNegativeTestJSON-527292234 tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:22.414849 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-816df091-0c4e-4b75-98f9-bf32d235ebf4 tempest-HypervisorAdminNegativeTestJSON-527292234 tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:22.415813 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-816df091-0c4e-4b75-98f9-bf32d235ebf4 tempest-HypervisorAdminNegativeTestJSON-527292234 tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:22.427159 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-816df091-0c4e-4b75-98f9-bf32d235ebf4 tempest-HypervisorAdminNegativeTestJSON-527292234 tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.064277 Sep 17 20:51:22.433900 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 143/358] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:51:22 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:22.433900 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5324de71-f8c1-4126-a930-45ae1de6d439 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:22.462903 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5324de71-f8c1-4126-a930-45ae1de6d439 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.033728 Sep 17 20:51:22.463865 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 144/359] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Sep 17 20:51:22 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 17 20:51:22.470728 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-97617414-229e-4eaf-b41d-f769ae564a03 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:22.471477 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-97617414-229e-4eaf-b41d-f769ae564a03 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 22274a46-3915-4c4a-891b-e5da0ab9423b] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:22.479586 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-97617414-229e-4eaf-b41d-f769ae564a03 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:22.480285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-97617414-229e-4eaf-b41d-f769ae564a03 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:22.481285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-97617414-229e-4eaf-b41d-f769ae564a03 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:22.482716 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-97617414-229e-4eaf-b41d-f769ae564a03 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:22.483253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-97617414-229e-4eaf-b41d-f769ae564a03 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:22.483735 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-97617414-229e-4eaf-b41d-f769ae564a03 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:22.522080 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-66cc8db4-a8f0-456c-828f-1ae5bb8f0754 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:22.527154 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-97617414-229e-4eaf-b41d-f769ae564a03 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:22.527763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-97617414-229e-4eaf-b41d-f769ae564a03 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:22.528560 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-97617414-229e-4eaf-b41d-f769ae564a03 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:22.529022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-97617414-229e-4eaf-b41d-f769ae564a03 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lazy-loading 'fault' on Instance uuid 22274a46-3915-4c4a-891b-e5da0ab9423b {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:51:22.532929 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-66cc8db4-a8f0-456c-828f-1ae5bb8f0754 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1475 microversion: 2.1 time: 0.592676 Sep 17 20:51:22.537825 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:51:22.539377 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 216/360] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:21 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1475 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:22.545800 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f4615dfa-2681-4c91-b960-db5b84cb0a5d tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Action: 'update', calling method: .version_select at 0x7f25a5c38ca0>, body: {"quota_set": {"ram": "5120"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:22.733866 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=4,nova_api:INSERT=5 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:51:22.744364 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4615dfa-2681-4c91-b960-db5b84cb0a5d tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:22.745050 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4615dfa-2681-4c91-b960-db5b84cb0a5d tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:22.745987 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4615dfa-2681-4c91-b960-db5b84cb0a5d tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:22.747178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4615dfa-2681-4c91-b960-db5b84cb0a5d tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:22.747852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4615dfa-2681-4c91-b960-db5b84cb0a5d tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:22.748526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4615dfa-2681-4c91-b960-db5b84cb0a5d tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:22.784250 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-97617414-229e-4eaf-b41d-f769ae564a03 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8bfe1d590a4500b7e7b5c79a6a4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea88200545ae4003b42b0d475f482c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:22.797105 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-97617414-229e-4eaf-b41d-f769ae564a03 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] 10.222.0.26 "GET /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b" status: 200 len: 1457 microversion: 2.1 time: 0.328871 Sep 17 20:51:22.798138 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 145/361] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:22 2022] GET /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b => generated 1457 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:22.805665 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8e982ef4-66d3-4c15-88b4-3f5c16f591e9 tempest-HypervisorAdminNegativeTestJSON-1329849698 tempest-HypervisorAdminNegativeTestJSON-1329849698-project] Calling method '.version_select at 0x7f25a5c863a0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:22.810383 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8e982ef4-66d3-4c15-88b4-3f5c16f591e9 tempest-HypervisorAdminNegativeTestJSON-1329849698 tempest-HypervisorAdminNegativeTestJSON-1329849698-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'bef3da9984ab4171955b0bdfdaa259f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75e1743a6fc742b094552a4f35de8110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:22.812465 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8e982ef4-66d3-4c15-88b4-3f5c16f591e9 tempest-HypervisorAdminNegativeTestJSON-1329849698 tempest-HypervisorAdminNegativeTestJSON-1329849698-project] Request method failure captured: Sep 17 20:51:22.812465 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Sep 17 20:51:22.812465 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:51:22.812465 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:51:22.812465 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:51:22.812465 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:51:22.812465 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:51:22.812465 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:51:22.812465 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:51:22.812465 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:22.812465 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjNGuuG4N893JqKtHT7dW42NLdbysoX8b2EJsfEZh5u0_Vl_0wNvhz8sfGNA8M2Gdzso4xjeSQJfQUYG7AQ98093XQ2IkaOcIzZfG2W2Xp0jP3N6Vvag5r_572JiBjUMMS-iUfOSt2RRsOjOByxY-qkN6TcGT9Js-__M0UmzvTN7RCM Sep 17 20:51:22.812465 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:51:22.812465 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:51:22.812465 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:51:22.812465 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:51:22.812465 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:51:22.812465 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:51:22.812465 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 75e1743a6fc742b094552a4f35de8110 Sep 17 20:51:22.812465 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1329849698 Sep 17 20:51:22.812465 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:51:22.812465 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:51:22.813743 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/75e1743a6fc742b094552a4f35de8110"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/75e1743a6fc742b094552a4f35de8110"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/75e1743a6fc742b094552a4f35de8110"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_75e1743a6fc742b094552a4f35de8110", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:22.813743 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1329849698 Sep 17 20:51:22.813743 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 75e1743a6fc742b094552a4f35de8110 Sep 17 20:51:22.813743 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1329849698 Sep 17 20:51:22.813743 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-HypervisorAdminNegativeTestJSON-1329849698-project Sep 17 20:51:22.813743 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:51:22.813743 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:51:22.813743 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: bef3da9984ab4171955b0bdfdaa259f2 Sep 17 20:51:22.813743 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1329849698-project Sep 17 20:51:22.813743 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 20:51:22.813743 ncdv-master-1 devstack@n-api.service[140523]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 17 20:51:22.813743 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '1'} Sep 17 20:51:22.813743 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:22.814467 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:22.814467 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:22.814467 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:22.814467 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:22.814467 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:22.814467 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:51:22.814467 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:51:22.814467 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:22.814467 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:22.814467 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 17 20:51:22.814467 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 17 20:51:22.814467 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Sep 17 20:51:22.814467 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Sep 17 20:51:22.814467 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 17 20:51:22.814467 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 17 20:51:22.814467 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 17 20:51:22.814467 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 17 20:51:22.814467 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:51:22.814467 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:51:22.820346 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:51:22.820346 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:51:22.820346 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 17 20:51:22.820346 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 17 20:51:22.820346 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 17 20:51:22.820346 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 17 20:51:22.820346 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 17 20:51:22.820346 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 17 20:51:22.820346 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 17 20:51:22.820346 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:22.820346 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:22.820346 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:22.820346 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:22.820346 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:22.820346 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:22.820346 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 17 20:51:22.820346 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 17 20:51:22.820346 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 17 20:51:22.820346 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:22.821403 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8e982ef4-66d3-4c15-88b4-3f5c16f591e9 tempest-HypervisorAdminNegativeTestJSON-1329849698 tempest-HypervisorAdminNegativeTestJSON-1329849698-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:22.821403 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8e982ef4-66d3-4c15-88b4-3f5c16f591e9 tempest-HypervisorAdminNegativeTestJSON-1329849698 tempest-HypervisorAdminNegativeTestJSON-1329849698-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.014812 Sep 17 20:51:22.821403 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 146/362] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Sep 17 20:51:22 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:22.837081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0f5e842e-263e-433b-9f5c-330fdd131005 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-533234705"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:22.853962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.aggregate [None req-0f5e842e-263e-433b-9f5c-330fdd131005 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Generated uuid 7a230336-9046-4c55-9e4e-5469ec50838b for aggregate {{(pid=140523) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 17 20:51:22.889675 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f4615dfa-2681-4c91-b960-db5b84cb0a5d tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/dd77aee47f9d487c9fa48a05d2e6f6d7" status: 200 len: 328 microversion: 2.1 time: 0.348126 Sep 17 20:51:22.897358 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 217/363] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Sep 17 20:51:22 2022] PUT /compute/v2.1/os-quota-sets/dd77aee47f9d487c9fa48a05d2e6f6d7 => generated 328 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:22.909154 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7bc8733b-3540-4e45-8efb-39a62efbccc9 tempest-HypervisorAdminNegativeTestJSON-527292234 tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin] Calling method '.version_select at 0x7f25a5c2cca0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:22.909928 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0f5e842e-263e-433b-9f5c-330fdd131005 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.093020 Sep 17 20:51:22.910709 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 147/364] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Sep 17 20:51:22 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:22.910813 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-7bc8733b-3540-4e45-8efb-39a62efbccc9 tempest-HypervisorAdminNegativeTestJSON-527292234 tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin] HTTP exception thrown: Hypervisor with ID '9a781100-c9aa-4a5f-8863-ed642a412a9b' could not be found. Sep 17 20:51:22.913089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7bc8733b-3540-4e45-8efb-39a62efbccc9 tempest-HypervisorAdminNegativeTestJSON-527292234 tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin] Request method failure captured: Sep 17 20:51:22.913089 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/os-hypervisors/9a781100-c9aa-4a5f-8863-ed642a412a9b HTTP/1.1 Sep 17 20:51:22.913089 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:51:22.913089 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:51:22.913089 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:51:22.913089 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:51:22.913089 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:51:22.913089 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:51:22.913089 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:51:22.913089 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:22.913089 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjNHKYQEGcj8EFBccOU4B1hqD8EDFHw08AC5aG0F0G7fk6sEpkwds_34W8JMua4EquAKULbcrAEvI3YXEw9ZKF8cCnH23Qy-fh8s7pIEFFGO3Eio3Nmr6j4iuMfGJ5uYRmkDuJEPcho3obURqhoA8A4MuCW0z0GF-Sr0NLvo5Ii6obU Sep 17 20:51:22.913089 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:51:22.913089 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:51:22.913089 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:51:22.913089 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:51:22.913089 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:51:22.913089 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:51:22.913089 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 11c1a049afe54eecbf96b5d469374cda Sep 17 20:51:22.913089 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-527292234 Sep 17 20:51:22.913089 ncdv-master-1 devstack@n-api.service[140524]: X-Role: admin,member,reader Sep 17 20:51:22.913089 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: admin,member,reader Sep 17 20:51:22.914527 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/11c1a049afe54eecbf96b5d469374cda"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/11c1a049afe54eecbf96b5d469374cda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/11c1a049afe54eecbf96b5d469374cda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_11c1a049afe54eecbf96b5d469374cda", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:22.914527 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-527292234 Sep 17 20:51:22.914527 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 11c1a049afe54eecbf96b5d469374cda Sep 17 20:51:22.914527 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-527292234 Sep 17 20:51:22.914527 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin Sep 17 20:51:22.914527 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:51:22.914527 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:51:22.914527 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: c6261e6f72b24aeb9868a4fc6a08f5b9 Sep 17 20:51:22.914527 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin Sep 17 20:51:22.914527 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:51:22.914527 ncdv-master-1 devstack@n-api.service[140524]: exception: Hypervisor with ID '9a781100-c9aa-4a5f-8863-ed642a412a9b' could not be found. Sep 17 20:51:22.914527 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '9a781100-c9aa-4a5f-8863-ed642a412a9b'} Sep 17 20:51:22.915325 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:22.915325 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:22.915325 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 17 20:51:22.915325 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 17 20:51:22.915325 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '9a781100-c9aa-4a5f-8863-ed642a412a9b' Sep 17 20:51:22.915325 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:22.915325 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:22.915325 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:22.915325 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:22.915325 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 17 20:51:22.915325 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 17 20:51:22.915325 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 17 20:51:22.915325 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 17 20:51:22.915325 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 17 20:51:22.915325 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:22.915325 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:22.915325 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:22.915325 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:22.915325 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 17 20:51:22.915325 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 17 20:51:22.915325 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 17 20:51:22.915325 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 17 20:51:22.916608 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 17 20:51:22.916608 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:22.916608 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:22.916608 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:22.916608 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:22.916608 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:22.916608 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:22.916608 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:22.916608 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:22.916608 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:51:22.916608 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:51:22.916608 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:22.916608 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:22.916608 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 17 20:51:22.916608 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 17 20:51:22.916608 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Sep 17 20:51:22.916608 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 17 20:51:22.916608 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 17 20:51:22.916608 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 17 20:51:22.916608 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '9a781100-c9aa-4a5f-8863-ed642a412a9b' could not be found. Sep 17 20:51:22.917819 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:22.917819 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:22.917819 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:22.917819 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:22.917819 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:22.917819 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:22.917819 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:22.917819 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:22.917819 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '9a781100-c9aa-4a5f-8863-ed642a412a9b' could not be found. Sep 17 20:51:22.917819 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:22.917819 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7bc8733b-3540-4e45-8efb-39a62efbccc9 tempest-HypervisorAdminNegativeTestJSON-527292234 tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin] Returning 404 to user: Hypervisor with ID '9a781100-c9aa-4a5f-8863-ed642a412a9b' could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:22.917819 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7bc8733b-3540-4e45-8efb-39a62efbccc9 tempest-HypervisorAdminNegativeTestJSON-527292234 tempest-HypervisorAdminNegativeTestJSON-527292234-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/9a781100-c9aa-4a5f-8863-ed642a412a9b" status: 404 len: 123 microversion: 2.1 time: 0.017202 Sep 17 20:51:22.917819 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 218/365] 10.222.0.26 () {58 vars in 1257 bytes} [Sat Sep 17 20:51:22 2022] GET /compute/v2.1/os-hypervisors/9a781100-c9aa-4a5f-8863-ed642a412a9b => generated 123 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:22.931803 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a1403768-eefe-4b4e-b48e-b1f3eb990a00 tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Calling method '.version_select at 0x7f25a5d42160>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:23.237971 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-75d1644a-469f-4ed8-a2a8-348edd870601 tempest-AggregatesAdminNegativeTestJSON-1844150482 tempest-AggregatesAdminNegativeTestJSON-1844150482-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:23.241617 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-75d1644a-469f-4ed8-a2a8-348edd870601 tempest-AggregatesAdminNegativeTestJSON-1844150482 tempest-AggregatesAdminNegativeTestJSON-1844150482-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'e075fe44101842fab2d6be231517cd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06b859ea6d468bb45b4c6b9633d368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:23.243288 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-75d1644a-469f-4ed8-a2a8-348edd870601 tempest-AggregatesAdminNegativeTestJSON-1844150482 tempest-AggregatesAdminNegativeTestJSON-1844150482-project] Request method failure captured: Sep 17 20:51:23.243288 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Sep 17 20:51:23.243288 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:51:23.243288 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:51:23.243288 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:51:23.243288 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 39 Sep 17 20:51:23.243288 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:51:23.243288 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:51:23.243288 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:51:23.243288 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:23.243288 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjNG4wQ9jlwxp3l-Xl_2iyOWJY-XMj2qvTp_clfIgbHICGIIdVzj3Y1SlSjLCRrUjgqOB4-b47btFU6kvmKqSIrSJoC6BiTWpkvTPRz0E0csQEisfGQnES96LZPOgGTNRzR4Pzmjip_IzlVN1j3m3cVkXDyH10SLaaqlIOMv1Hw18mY Sep 17 20:51:23.243288 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:51:23.243288 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:51:23.243288 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:51:23.243288 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:51:23.243288 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:51:23.243288 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:51:23.243288 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 5c06b859ea6d468bb45b4c6b9633d368 Sep 17 20:51:23.243288 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1844150482 Sep 17 20:51:23.243288 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:51:23.243288 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:51:23.244762 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c06b859ea6d468bb45b4c6b9633d368"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5c06b859ea6d468bb45b4c6b9633d368"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c06b859ea6d468bb45b4c6b9633d368"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5c06b859ea6d468bb45b4c6b9633d368", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:23.244762 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1844150482 Sep 17 20:51:23.244762 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 5c06b859ea6d468bb45b4c6b9633d368 Sep 17 20:51:23.244762 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1844150482 Sep 17 20:51:23.244762 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-AggregatesAdminNegativeTestJSON-1844150482-project Sep 17 20:51:23.244762 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:51:23.244762 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:51:23.244762 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: e075fe44101842fab2d6be231517cd5f Sep 17 20:51:23.244762 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1844150482-project Sep 17 20:51:23.244762 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:51:23.244762 ncdv-master-1 devstack@n-api.service[140524]: {"add_host": {"host": "nch2-master-1"}} Sep 17 20:51:23.244762 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:51:23.244762 ncdv-master-1 devstack@n-api.service[140524]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 17 20:51:23.245760 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '12', 'body': {'add_host': {'host': 'nch2-master-1'}}} Sep 17 20:51:23.245760 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:23.245760 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:23.245760 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:23.245760 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:23.245760 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:23.245760 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:23.245760 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:23.245760 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:23.245760 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:51:23.245760 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:51:23.245760 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Sep 17 20:51:23.245760 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Sep 17 20:51:23.245760 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 17 20:51:23.245760 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 17 20:51:23.245760 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 17 20:51:23.245760 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 17 20:51:23.245760 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:51:23.245760 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:51:23.247041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:51:23.247041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:51:23.247041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 17 20:51:23.247041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 17 20:51:23.247041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 17 20:51:23.247041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 17 20:51:23.247041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 17 20:51:23.247041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 17 20:51:23.247041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 17 20:51:23.247041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:23.247041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:23.247041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:23.247041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:23.247041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:23.247041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:23.247041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 17 20:51:23.247041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 17 20:51:23.247041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 17 20:51:23.247041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:23.248401 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-75d1644a-469f-4ed8-a2a8-348edd870601 tempest-AggregatesAdminNegativeTestJSON-1844150482 tempest-AggregatesAdminNegativeTestJSON-1844150482-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:23.248401 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-75d1644a-469f-4ed8-a2a8-348edd870601 tempest-AggregatesAdminNegativeTestJSON-1844150482 tempest-AggregatesAdminNegativeTestJSON-1844150482-project] 10.222.0.26 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.325891 Sep 17 20:51:23.256949 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 219/366] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Sep 17 20:51:22 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 338 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:23.263872 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-db65513e-2a28-4bdd-a447-b9a11b0fea85 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:23.332389 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-db65513e-2a28-4bdd-a447-b9a11b0fea85 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.074267 Sep 17 20:51:23.334753 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 220/367] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Sep 17 20:51:23 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 17 20:51:23.352182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3f1ac039-4661-4414-b94e-4d89f9781a09 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1584418406"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:23.360706 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.aggregate [None req-3f1ac039-4661-4414-b94e-4d89f9781a09 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Generated uuid 61894bac-89dc-422a-9a5e-a1f13d35b281 for aggregate {{(pid=140524) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 17 20:51:23.422204 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3f1ac039-4661-4414-b94e-4d89f9781a09 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.077210 Sep 17 20:51:23.425934 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 221/368] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Sep 17 20:51:23 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:23.437798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6a5b8b54-b407-4904-bcea-906839a96fa8 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-998348096"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:23.458813 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a5b8b54-b407-4904-bcea-906839a96fa8 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:23.459660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a5b8b54-b407-4904-bcea-906839a96fa8 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:23.460390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a5b8b54-b407-4904-bcea-906839a96fa8 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:23.473857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a5b8b54-b407-4904-bcea-906839a96fa8 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:23.474727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a5b8b54-b407-4904-bcea-906839a96fa8 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:23.476049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a5b8b54-b407-4904-bcea-906839a96fa8 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:23.495708 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-6a5b8b54-b407-4904-bcea-906839a96fa8 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-998348096 could not be found. Sep 17 20:51:23.498264 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6a5b8b54-b407-4904-bcea-906839a96fa8 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Request method failure captured: Sep 17 20:51:23.498264 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Sep 17 20:51:23.498264 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:51:23.498264 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:51:23.498264 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:51:23.498264 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 57 Sep 17 20:51:23.498264 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:51:23.498264 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:51:23.498264 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:51:23.498264 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:23.498264 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjNIistXvmaDMzDb4OArfIQfJMLOCKe4sVvi6E7xMm93sC2sCSdGrEIMlHjm4LcJzzbdYq7jED-w0aT93P87kgHmXi3uifQIbli7EeqhyK28jfoR4g85_jQGDfGTV0sZE-KiKx8ayKfbN_ASQqb6YhSBXcGYktOMynSp-opCnDS2e30 Sep 17 20:51:23.498264 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:51:23.498264 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:51:23.498264 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:51:23.498264 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:51:23.498264 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:51:23.498264 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:51:23.498264 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 4938af1a380d4294aeac011134799031 Sep 17 20:51:23.498264 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1771198131 Sep 17 20:51:23.498264 ncdv-master-1 devstack@n-api.service[140524]: X-Role: admin,member,reader Sep 17 20:51:23.498264 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: admin,member,reader Sep 17 20:51:23.499505 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4938af1a380d4294aeac011134799031"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4938af1a380d4294aeac011134799031"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4938af1a380d4294aeac011134799031"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4938af1a380d4294aeac011134799031", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:23.499505 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1771198131 Sep 17 20:51:23.499505 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 4938af1a380d4294aeac011134799031 Sep 17 20:51:23.499505 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1771198131 Sep 17 20:51:23.499505 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin Sep 17 20:51:23.499505 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:51:23.499505 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:51:23.499505 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 3db3d87bec8d48e3adb1f9e210152018 Sep 17 20:51:23.499505 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin Sep 17 20:51:23.499505 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:51:23.499505 ncdv-master-1 devstack@n-api.service[140524]: {"add_host": {"host": "tempest-nonexist_host-998348096"}} Sep 17 20:51:23.499505 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:51:23.500211 ncdv-master-1 devstack@n-api.service[140524]: exception: Compute host tempest-nonexist_host-998348096 could not be found. Sep 17 20:51:23.500211 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-998348096'}}} Sep 17 20:51:23.500211 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:23.500211 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:23.500211 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 17 20:51:23.500211 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 17 20:51:23.500211 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:51:23.500211 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:51:23.500211 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 17 20:51:23.500211 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 17 20:51:23.500211 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 17 20:51:23.500211 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 17 20:51:23.500211 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 17 20:51:23.500211 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 17 20:51:23.500211 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-998348096' is not mapped to any cell Sep 17 20:51:23.500211 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:23.500211 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:23.500211 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:23.500211 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:23.500211 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 17 20:51:23.501306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 17 20:51:23.501306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 17 20:51:23.501306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 17 20:51:23.501306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 17 20:51:23.501306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:23.501306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:23.501306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:23.501306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:23.501306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 17 20:51:23.501306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 17 20:51:23.501306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 17 20:51:23.501306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 17 20:51:23.501306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:51:23.501306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:51:23.501306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:51:23.501306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:51:23.501306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 17 20:51:23.501306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 17 20:51:23.501306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Sep 17 20:51:23.501306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Sep 17 20:51:23.502593 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 17 20:51:23.502593 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 17 20:51:23.502593 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-998348096 could not be found. Sep 17 20:51:23.502593 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:23.502593 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:23.502593 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:23.502593 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:23.502593 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:23.502593 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:23.502593 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:23.502593 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:23.502593 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:23.502593 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:23.502593 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:51:23.502593 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:51:23.502593 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Sep 17 20:51:23.502593 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:51:23.502593 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-998348096 could not be found. Sep 17 20:51:23.502593 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:23.502593 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:23.502593 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:23.503785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:23.503785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:23.503785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:23.503785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:23.503785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:23.503785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-998348096 could not be found. Sep 17 20:51:23.503785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:23.507791 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6a5b8b54-b407-4904-bcea-906839a96fa8 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-998348096 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:23.509310 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6a5b8b54-b407-4904-bcea-906839a96fa8 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 110 microversion: 2.1 time: 0.075833 Sep 17 20:51:23.511253 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 222/369] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Sep 17 20:51:23 2022] POST /compute/v2.1/os-aggregates/13/action => generated 110 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:23.527760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6398ac4a-0e25-47e5-b95d-d07f540c22ad tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:23.601986 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6398ac4a-0e25-47e5-b95d-d07f540c22ad tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.083455 Sep 17 20:51:23.631678 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 223/370] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Sep 17 20:51:23 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 17 20:51:23.637795 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-735c634c-db2a-4965-943c-89b11f4d0430 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:23.642854 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-735c634c-db2a-4965-943c-89b11f4d0430 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:23.656689 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-735c634c-db2a-4965-943c-89b11f4d0430 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:23.657181 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-735c634c-db2a-4965-943c-89b11f4d0430 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:23.660285 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-735c634c-db2a-4965-943c-89b11f4d0430 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:23.666151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-735c634c-db2a-4965-943c-89b11f4d0430 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:23.666654 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-735c634c-db2a-4965-943c-89b11f4d0430 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:23.667100 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-735c634c-db2a-4965-943c-89b11f4d0430 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:24.010566 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1403768-eefe-4b4e-b48e-b1f3eb990a00 tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:24.011131 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1403768-eefe-4b4e-b48e-b1f3eb990a00 tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:24.016706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1403768-eefe-4b4e-b48e-b1f3eb990a00 tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:24.017547 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1403768-eefe-4b4e-b48e-b1f3eb990a00 tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:24.018692 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1403768-eefe-4b4e-b48e-b1f3eb990a00 tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:24.019578 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1403768-eefe-4b4e-b48e-b1f3eb990a00 tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:24.070864 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a1403768-eefe-4b4e-b48e-b1f3eb990a00 tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/dd77aee47f9d487c9fa48a05d2e6f6d7/detail" status: 200 len: 916 microversion: 2.1 time: 1.157357 Sep 17 20:51:24.073449 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 148/371] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Sep 17 20:51:22 2022] GET /compute/v2.1/os-quota-sets/dd77aee47f9d487c9fa48a05d2e6f6d7/detail => generated 916 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:24.085123 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5f9c7989-30e1-4858-af00-bb1e1d8e3fbf tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:24.105624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5f9c7989-30e1-4858-af00-bb1e1d8e3fbf tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Request method failure captured: Sep 17 20:51:24.105624 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 17 20:51:24.105624 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:51:24.105624 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:51:24.105624 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:51:24.105624 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 283 Sep 17 20:51:24.105624 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:51:24.105624 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:51:24.105624 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:51:24.105624 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:24.105624 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjNIistXvmaDMzDb4OArfIQfJMLOCKe4sVvi6E7xMm93sC2sCSdGrEIMlHjm4LcJzzbdYq7jED-w0aT93P87kgHmXi3uifQIbli7EeqhyK28jfoR4g85_jQGDfGTV0sZE-KiKx8ayKfbN_ASQqb6YhSBXcGYktOMynSp-opCnDS2e30 Sep 17 20:51:24.105624 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:51:24.105624 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:51:24.105624 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:51:24.105624 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:51:24.105624 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:51:24.105624 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:51:24.105624 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 4938af1a380d4294aeac011134799031 Sep 17 20:51:24.105624 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1771198131 Sep 17 20:51:24.105624 ncdv-master-1 devstack@n-api.service[140523]: X-Role: admin,member,reader Sep 17 20:51:24.105624 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: admin,member,reader Sep 17 20:51:24.107159 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4938af1a380d4294aeac011134799031"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4938af1a380d4294aeac011134799031"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4938af1a380d4294aeac011134799031"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4938af1a380d4294aeac011134799031", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:24.107159 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1771198131 Sep 17 20:51:24.107159 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 4938af1a380d4294aeac011134799031 Sep 17 20:51:24.107159 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1771198131 Sep 17 20:51:24.107159 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin Sep 17 20:51:24.107159 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:51:24.107159 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:51:24.107159 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 3db3d87bec8d48e3adb1f9e210152018 Sep 17 20:51:24.107159 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin Sep 17 20:51:24.107159 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 20:51:24.107827 ncdv-master-1 devstack@n-api.service[140523]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 17 20:51:24.107827 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:51:24.107827 ncdv-master-1 devstack@n-api.service[140523]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 17 20:51:24.107827 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 17 20:51:24.107827 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:24.107827 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:24.107827 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 20:51:24.107827 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 20:51:24.107827 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 20:51:24.107827 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise error Sep 17 20:51:24.108582 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 17 20:51:24.108582 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:24.108582 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Sep 17 20:51:24.108582 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 17 20:51:24.108582 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:24.108582 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 17 20:51:24.108582 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 17 20:51:24.108582 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:24.108582 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:24.108582 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:24.108582 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:24.108582 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:24.108582 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:24.108582 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:24.108582 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:24.108582 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:24.108582 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:24.110365 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:51:24.110365 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:51:24.110365 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 20:51:24.110365 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 20:51:24.110365 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 20:51:24.110365 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 20:51:24.110365 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 20:51:24.110365 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 20:51:24.110365 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 17 20:51:24.110365 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:24.110365 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:24.110365 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:24.110365 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:24.110365 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:24.110365 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:24.111396 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 20:51:24.111396 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 20:51:24.111396 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 17 20:51:24.111396 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:24.114133 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5f9c7989-30e1-4858-af00-bb1e1d8e3fbf tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:24.118539 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5f9c7989-30e1-4858-af00-bb1e1d8e3fbf tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.041686 Sep 17 20:51:24.123198 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 149/372] 10.222.0.26 () {60 vars in 1165 bytes} [Sat Sep 17 20:51:24 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 20:51:24.141483 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-199e1e04-b78b-453c-bfb0-b2f479350d86 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:24.142491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-199e1e04-b78b-453c-bfb0-b2f479350d86 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 22274a46-3915-4c4a-891b-e5da0ab9423b] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:24.168367 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-199e1e04-b78b-453c-bfb0-b2f479350d86 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:24.170000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-199e1e04-b78b-453c-bfb0-b2f479350d86 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:24.177511 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-199e1e04-b78b-453c-bfb0-b2f479350d86 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:24.178381 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-199e1e04-b78b-453c-bfb0-b2f479350d86 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:24.181183 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-199e1e04-b78b-453c-bfb0-b2f479350d86 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:24.182443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-199e1e04-b78b-453c-bfb0-b2f479350d86 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:24.273074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-199e1e04-b78b-453c-bfb0-b2f479350d86 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:24.274036 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-199e1e04-b78b-453c-bfb0-b2f479350d86 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:24.277425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-199e1e04-b78b-453c-bfb0-b2f479350d86 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:24.278548 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-199e1e04-b78b-453c-bfb0-b2f479350d86 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lazy-loading 'fault' on Instance uuid 22274a46-3915-4c4a-891b-e5da0ab9423b {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:51:24.368485 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-735c634c-db2a-4965-943c-89b11f4d0430 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:24.388140 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-735c634c-db2a-4965-943c-89b11f4d0430 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1475 microversion: 2.1 time: 0.755060 Sep 17 20:51:24.390025 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 224/373] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:23 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1475 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:24.415343 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c8ccee15-6332-477c-aa5c-68c7269cfeac tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:24.420038 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c8ccee15-6332-477c-aa5c-68c7269cfeac tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Request method failure captured: Sep 17 20:51:24.420038 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 17 20:51:24.420038 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:51:24.420038 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:51:24.420038 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:51:24.420038 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 27 Sep 17 20:51:24.420038 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:51:24.420038 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:51:24.420038 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:51:24.420038 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:24.420038 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjNIistXvmaDMzDb4OArfIQfJMLOCKe4sVvi6E7xMm93sC2sCSdGrEIMlHjm4LcJzzbdYq7jED-w0aT93P87kgHmXi3uifQIbli7EeqhyK28jfoR4g85_jQGDfGTV0sZE-KiKx8ayKfbN_ASQqb6YhSBXcGYktOMynSp-opCnDS2e30 Sep 17 20:51:24.420038 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:51:24.420038 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:51:24.420038 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:51:24.420038 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:51:24.420038 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:51:24.420038 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:51:24.420038 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 4938af1a380d4294aeac011134799031 Sep 17 20:51:24.420038 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1771198131 Sep 17 20:51:24.420038 ncdv-master-1 devstack@n-api.service[140524]: X-Role: admin,member,reader Sep 17 20:51:24.420038 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: admin,member,reader Sep 17 20:51:24.421574 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4938af1a380d4294aeac011134799031"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4938af1a380d4294aeac011134799031"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4938af1a380d4294aeac011134799031"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4938af1a380d4294aeac011134799031", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:24.421574 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1771198131 Sep 17 20:51:24.421574 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 4938af1a380d4294aeac011134799031 Sep 17 20:51:24.421574 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1771198131 Sep 17 20:51:24.421574 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin Sep 17 20:51:24.421574 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:51:24.421574 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:51:24.421574 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 3db3d87bec8d48e3adb1f9e210152018 Sep 17 20:51:24.421574 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin Sep 17 20:51:24.421574 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:51:24.421574 ncdv-master-1 devstack@n-api.service[140524]: {"aggregate": {"name": ""}} Sep 17 20:51:24.421574 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:51:24.421574 ncdv-master-1 devstack@n-api.service[140524]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 17 20:51:24.422463 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'body': {'aggregate': {'name': ''}}} Sep 17 20:51:24.422463 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:24.422463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:24.422463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 20:51:24.422463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 20:51:24.422463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 20:51:24.422463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise error Sep 17 20:51:24.422463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 17 20:51:24.422463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:24.422463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Sep 17 20:51:24.422463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 17 20:51:24.422463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:24.422463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 17 20:51:24.422463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi '' Sep 17 20:51:24.422463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:24.422463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:24.422463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:24.422463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:24.422463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:24.422463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:24.422463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:24.422463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:24.422463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:24.424075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:24.424075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:51:24.424075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:51:24.424075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 20:51:24.424075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 20:51:24.424075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 20:51:24.424075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 20:51:24.424075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 20:51:24.424075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 20:51:24.424075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 17 20:51:24.424075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:24.424075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:24.424075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:24.424075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:24.424075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:24.424075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:24.424075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 20:51:24.424075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 20:51:24.424075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 17 20:51:24.424075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:24.425185 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c8ccee15-6332-477c-aa5c-68c7269cfeac tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:24.425185 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c8ccee15-6332-477c-aa5c-68c7269cfeac tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.030252 Sep 17 20:51:24.431236 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 225/374] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Sep 17 20:51:24 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 20:51:24.436181 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-746ec6dc-dff5-474f-a172-9205aab1f9e0 tempest-AggregatesAdminNegativeTestJSON-1844150482 tempest-AggregatesAdminNegativeTestJSON-1844150482-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-716445173"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:24.448657 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-746ec6dc-dff5-474f-a172-9205aab1f9e0 tempest-AggregatesAdminNegativeTestJSON-1844150482 tempest-AggregatesAdminNegativeTestJSON-1844150482-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'e075fe44101842fab2d6be231517cd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06b859ea6d468bb45b4c6b9633d368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:24.450425 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-746ec6dc-dff5-474f-a172-9205aab1f9e0 tempest-AggregatesAdminNegativeTestJSON-1844150482 tempest-AggregatesAdminNegativeTestJSON-1844150482-project] Request method failure captured: Sep 17 20:51:24.450425 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 17 20:51:24.450425 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:51:24.450425 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:51:24.450425 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:51:24.450425 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 59 Sep 17 20:51:24.450425 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:51:24.450425 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:51:24.450425 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:51:24.450425 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:24.450425 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjNG4wQ9jlwxp3l-Xl_2iyOWJY-XMj2qvTp_clfIgbHICGIIdVzj3Y1SlSjLCRrUjgqOB4-b47btFU6kvmKqSIrSJoC6BiTWpkvTPRz0E0csQEisfGQnES96LZPOgGTNRzR4Pzmjip_IzlVN1j3m3cVkXDyH10SLaaqlIOMv1Hw18mY Sep 17 20:51:24.450425 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:51:24.450425 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:51:24.450425 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:51:24.450425 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:51:24.450425 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:51:24.450425 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:51:24.450425 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 5c06b859ea6d468bb45b4c6b9633d368 Sep 17 20:51:24.450425 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1844150482 Sep 17 20:51:24.450425 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:51:24.450425 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:51:24.451937 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c06b859ea6d468bb45b4c6b9633d368"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5c06b859ea6d468bb45b4c6b9633d368"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c06b859ea6d468bb45b4c6b9633d368"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5c06b859ea6d468bb45b4c6b9633d368", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:24.451937 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1844150482 Sep 17 20:51:24.451937 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 5c06b859ea6d468bb45b4c6b9633d368 Sep 17 20:51:24.451937 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1844150482 Sep 17 20:51:24.451937 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-AggregatesAdminNegativeTestJSON-1844150482-project Sep 17 20:51:24.451937 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:51:24.451937 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:51:24.451937 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: e075fe44101842fab2d6be231517cd5f Sep 17 20:51:24.451937 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1844150482-project Sep 17 20:51:24.451937 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:51:24.451937 ncdv-master-1 devstack@n-api.service[140524]: {"aggregate": {"name": "tempest-test_aggregate-716445173"}} Sep 17 20:51:24.451937 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:51:24.451937 ncdv-master-1 devstack@n-api.service[140524]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 17 20:51:24.452847 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-716445173'}}} Sep 17 20:51:24.452847 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:24.452847 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:24.452847 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:24.452847 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:24.452847 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:24.452847 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:24.452847 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:24.452847 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:24.452847 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:51:24.452847 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:51:24.452847 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:51:24.452847 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:51:24.452847 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Sep 17 20:51:24.452847 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Sep 17 20:51:24.452847 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 17 20:51:24.452847 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 17 20:51:24.452847 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 17 20:51:24.452847 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 17 20:51:24.454151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:51:24.454151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:51:24.454151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:51:24.454151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:51:24.454151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 17 20:51:24.454151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 17 20:51:24.454151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 17 20:51:24.454151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 17 20:51:24.454151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 17 20:51:24.454151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 17 20:51:24.454151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 17 20:51:24.454151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:24.454151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:24.454151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:24.454151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:24.454151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:24.454151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:24.454151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 17 20:51:24.454151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 17 20:51:24.454151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 17 20:51:24.455490 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:24.458539 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-746ec6dc-dff5-474f-a172-9205aab1f9e0 tempest-AggregatesAdminNegativeTestJSON-1844150482 tempest-AggregatesAdminNegativeTestJSON-1844150482-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:24.465082 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-746ec6dc-dff5-474f-a172-9205aab1f9e0 tempest-AggregatesAdminNegativeTestJSON-1844150482 tempest-AggregatesAdminNegativeTestJSON-1844150482-project] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.032075 Sep 17 20:51:24.471674 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 226/375] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Sep 17 20:51:24 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:24.483883 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2fe6b1d0-a8e6-4b07-81bc-f830f8e643c8 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-448675569"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:24.494746 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.aggregate [None req-2fe6b1d0-a8e6-4b07-81bc-f830f8e643c8 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Generated uuid dd4bad6b-1db8-48e5-a2b7-6134b93d2238 for aggregate {{(pid=140524) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 17 20:51:24.527805 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2fe6b1d0-a8e6-4b07-81bc-f830f8e643c8 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.054903 Sep 17 20:51:24.529648 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 227/376] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Sep 17 20:51:24 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:24.559857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9d22c655-6558-477f-8cc3-1140fd306dbc tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-448675569"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:24.564981 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.aggregate [None req-9d22c655-6558-477f-8cc3-1140fd306dbc tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Generated uuid 823862e4-9821-4047-8d88-bc78ceb65ac6 for aggregate {{(pid=140524) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 17 20:51:24.578824 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-9d22c655-6558-477f-8cc3-1140fd306dbc tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-448675569 already exists. Sep 17 20:51:24.582126 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9d22c655-6558-477f-8cc3-1140fd306dbc tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Request method failure captured: Sep 17 20:51:24.582126 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 17 20:51:24.582126 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:51:24.582126 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:51:24.582126 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:51:24.582126 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 59 Sep 17 20:51:24.582126 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:51:24.582126 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:51:24.582126 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:51:24.582126 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:24.582126 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjNIistXvmaDMzDb4OArfIQfJMLOCKe4sVvi6E7xMm93sC2sCSdGrEIMlHjm4LcJzzbdYq7jED-w0aT93P87kgHmXi3uifQIbli7EeqhyK28jfoR4g85_jQGDfGTV0sZE-KiKx8ayKfbN_ASQqb6YhSBXcGYktOMynSp-opCnDS2e30 Sep 17 20:51:24.582126 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:51:24.582126 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:51:24.582126 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:51:24.582126 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:51:24.582126 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:51:24.582126 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:51:24.582126 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 4938af1a380d4294aeac011134799031 Sep 17 20:51:24.582126 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1771198131 Sep 17 20:51:24.582126 ncdv-master-1 devstack@n-api.service[140524]: X-Role: admin,member,reader Sep 17 20:51:24.582126 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: admin,member,reader Sep 17 20:51:24.583346 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4938af1a380d4294aeac011134799031"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4938af1a380d4294aeac011134799031"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4938af1a380d4294aeac011134799031"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4938af1a380d4294aeac011134799031", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:24.583346 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1771198131 Sep 17 20:51:24.583346 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 4938af1a380d4294aeac011134799031 Sep 17 20:51:24.583346 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1771198131 Sep 17 20:51:24.583346 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin Sep 17 20:51:24.583346 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:51:24.583346 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:51:24.583346 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 3db3d87bec8d48e3adb1f9e210152018 Sep 17 20:51:24.583346 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin Sep 17 20:51:24.583346 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:51:24.583346 ncdv-master-1 devstack@n-api.service[140524]: {"aggregate": {"name": "tempest-test_aggregate-448675569"}} Sep 17 20:51:24.583346 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:51:24.583346 ncdv-master-1 devstack@n-api.service[140524]: exception: Aggregate tempest-test_aggregate-448675569 already exists. Sep 17 20:51:24.584073 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-448675569'}}} Sep 17 20:51:24.584073 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:24.584073 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:24.584073 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Sep 17 20:51:24.584073 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Sep 17 20:51:24.584073 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 17 20:51:24.584073 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 17 20:51:24.584073 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:51:24.584073 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:51:24.584073 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:51:24.584073 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:51:24.584073 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 17 20:51:24.584073 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 17 20:51:24.584073 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Sep 17 20:51:24.584073 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi aggregate.create() Sep 17 20:51:24.584073 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 17 20:51:24.584073 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 17 20:51:24.584073 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Sep 17 20:51:24.584073 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Sep 17 20:51:24.585306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 17 20:51:24.585306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 17 20:51:24.585306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Sep 17 20:51:24.585306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Sep 17 20:51:24.585306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-448675569 already exists. Sep 17 20:51:24.585306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:24.585306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:24.585306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:24.585306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:24.585306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:24.585306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:24.585306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:24.585306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:24.585306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:24.585306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:24.585306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:51:24.585306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:51:24.585306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:51:24.585306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:51:24.585306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Sep 17 20:51:24.587034 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 17 20:51:24.587034 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-448675569 already exists. Sep 17 20:51:24.587034 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:24.587034 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:24.587034 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:24.587034 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:24.587034 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:24.587034 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:24.587034 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:24.587034 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:24.587034 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-448675569 already exists. Sep 17 20:51:24.587034 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:24.590637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9d22c655-6558-477f-8cc3-1140fd306dbc tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-448675569 already exists. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:24.591731 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9d22c655-6558-477f-8cc3-1140fd306dbc tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.053785 Sep 17 20:51:24.593019 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 228/377] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Sep 17 20:51:24 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 17 20:51:24.599548 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-113c9e19-5401-494b-b50a-53ad36ae2baa tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Action: 'update', calling method: .version_select at 0x7f25a5b8b9d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:24.761398 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-199e1e04-b78b-453c-bfb0-b2f479350d86 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb8bfe1d590a4500b7e7b5c79a6a4e6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea88200545ae4003b42b0d475f482c9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:24.774994 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-199e1e04-b78b-453c-bfb0-b2f479350d86 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] 10.222.0.26 "GET /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b" status: 200 len: 1457 microversion: 2.1 time: 0.645803 Sep 17 20:51:24.791091 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 150/378] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:24 2022] GET /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b => generated 1457 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:24.805181 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-97349d80-e849-4013-ba25-92c7038c6715 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:24.860367 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-97349d80-e849-4013-ba25-92c7038c6715 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.068051 Sep 17 20:51:24.860961 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 151/379] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Sep 17 20:51:24 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 17 20:51:24.867541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-a83aea85-76c6-47ca-9bf0-e8bdafc2c511 req-464689c7-b890-44f6-ae65-f27539cf6f95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22274a46-3915-4c4a-891b-e5da0ab9423b", "name": "network-vif-deleted", "tag": "27b42713-be20-4875-931b-d88248412715"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:24.903564 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-a83aea85-76c6-47ca-9bf0-e8bdafc2c511 req-464689c7-b890-44f6-ae65-f27539cf6f95 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:24.904047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-a83aea85-76c6-47ca-9bf0-e8bdafc2c511 req-464689c7-b890-44f6-ae65-f27539cf6f95 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:24.904521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-a83aea85-76c6-47ca-9bf0-e8bdafc2c511 req-464689c7-b890-44f6-ae65-f27539cf6f95 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:24.936058 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-a83aea85-76c6-47ca-9bf0-e8bdafc2c511 req-464689c7-b890-44f6-ae65-f27539cf6f95 service nova] Creating event network-vif-deleted:27b42713-be20-4875-931b-d88248412715 for instance 22274a46-3915-4c4a-891b-e5da0ab9423b on nch1-master-1 Sep 17 20:51:24.947424 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-a83aea85-76c6-47ca-9bf0-e8bdafc2c511 req-464689c7-b890-44f6-ae65-f27539cf6f95 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085170 Sep 17 20:51:24.949055 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 152/380] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:24.971439 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-27f90d5b-84c7-46a6-bb47-bf655d4bf8e8 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2075083027"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:24.978603 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.aggregate [None req-27f90d5b-84c7-46a6-bb47-bf655d4bf8e8 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Generated uuid 318eb8d2-8e55-47b3-8a1a-f65a63eb697a for aggregate {{(pid=140523) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 17 20:51:24.989214 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-113c9e19-5401-494b-b50a-53ad36ae2baa tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:24.990083 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-113c9e19-5401-494b-b50a-53ad36ae2baa tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:24.990700 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-113c9e19-5401-494b-b50a-53ad36ae2baa tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:24.992624 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-113c9e19-5401-494b-b50a-53ad36ae2baa tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:24.994407 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-113c9e19-5401-494b-b50a-53ad36ae2baa tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:24.995944 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-113c9e19-5401-494b-b50a-53ad36ae2baa tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:25.050329 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-113c9e19-5401-494b-b50a-53ad36ae2baa tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:25.051461 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-113c9e19-5401-494b-b50a-53ad36ae2baa tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:25.052237 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-113c9e19-5401-494b-b50a-53ad36ae2baa tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:25.053553 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-113c9e19-5401-494b-b50a-53ad36ae2baa tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:25.054836 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-113c9e19-5401-494b-b50a-53ad36ae2baa tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:25.055737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-113c9e19-5401-494b-b50a-53ad36ae2baa tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:25.055848 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-27f90d5b-84c7-46a6-bb47-bf655d4bf8e8 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.105299 Sep 17 20:51:25.057411 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 153/381] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Sep 17 20:51:24 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:25.067796 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e2e72352-112b-43a2-93ea-cff9e19d5cb9 tempest-AggregatesAdminNegativeTestJSON-1844150482 tempest-AggregatesAdminNegativeTestJSON-1844150482-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:25.069272 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e2e72352-112b-43a2-93ea-cff9e19d5cb9 tempest-AggregatesAdminNegativeTestJSON-1844150482 tempest-AggregatesAdminNegativeTestJSON-1844150482-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'e075fe44101842fab2d6be231517cd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06b859ea6d468bb45b4c6b9633d368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:25.082611 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e2e72352-112b-43a2-93ea-cff9e19d5cb9 tempest-AggregatesAdminNegativeTestJSON-1844150482 tempest-AggregatesAdminNegativeTestJSON-1844150482-project] Request method failure captured: Sep 17 20:51:25.082611 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Sep 17 20:51:25.082611 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:51:25.082611 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:51:25.082611 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:51:25.082611 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:51:25.082611 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:51:25.082611 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:51:25.082611 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:51:25.082611 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:25.082611 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjNG4wQ9jlwxp3l-Xl_2iyOWJY-XMj2qvTp_clfIgbHICGIIdVzj3Y1SlSjLCRrUjgqOB4-b47btFU6kvmKqSIrSJoC6BiTWpkvTPRz0E0csQEisfGQnES96LZPOgGTNRzR4Pzmjip_IzlVN1j3m3cVkXDyH10SLaaqlIOMv1Hw18mY Sep 17 20:51:25.082611 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:51:25.082611 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:51:25.082611 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:51:25.082611 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:51:25.082611 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:51:25.082611 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:51:25.082611 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 5c06b859ea6d468bb45b4c6b9633d368 Sep 17 20:51:25.082611 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1844150482 Sep 17 20:51:25.082611 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:51:25.082611 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:51:25.084094 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c06b859ea6d468bb45b4c6b9633d368"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5c06b859ea6d468bb45b4c6b9633d368"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c06b859ea6d468bb45b4c6b9633d368"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5c06b859ea6d468bb45b4c6b9633d368", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:25.084094 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1844150482 Sep 17 20:51:25.084094 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 5c06b859ea6d468bb45b4c6b9633d368 Sep 17 20:51:25.084094 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1844150482 Sep 17 20:51:25.084094 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-AggregatesAdminNegativeTestJSON-1844150482-project Sep 17 20:51:25.084094 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:51:25.084094 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:51:25.084094 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: e075fe44101842fab2d6be231517cd5f Sep 17 20:51:25.084094 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1844150482-project Sep 17 20:51:25.084094 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:51:25.084094 ncdv-master-1 devstack@n-api.service[140523]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 17 20:51:25.084094 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '15'} Sep 17 20:51:25.084906 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:25.084906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:25.084906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:25.084906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:25.084906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:25.084906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:25.084906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:25.084906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:25.084906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Sep 17 20:51:25.084906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Sep 17 20:51:25.084906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 17 20:51:25.084906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 17 20:51:25.084906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 17 20:51:25.084906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 17 20:51:25.084906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:51:25.084906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:51:25.084906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:51:25.084906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:51:25.084906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 17 20:51:25.086264 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 17 20:51:25.086264 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 17 20:51:25.086264 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 17 20:51:25.086264 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 17 20:51:25.086264 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 17 20:51:25.086264 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 17 20:51:25.086264 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:25.086264 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:25.086264 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:25.086264 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:25.086264 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:25.086264 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:25.086264 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 17 20:51:25.086264 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 17 20:51:25.086264 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 17 20:51:25.086264 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:25.090287 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e2e72352-112b-43a2-93ea-cff9e19d5cb9 tempest-AggregatesAdminNegativeTestJSON-1844150482 tempest-AggregatesAdminNegativeTestJSON-1844150482-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:25.094879 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e2e72352-112b-43a2-93ea-cff9e19d5cb9 tempest-AggregatesAdminNegativeTestJSON-1844150482 tempest-AggregatesAdminNegativeTestJSON-1844150482-project] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.027235 Sep 17 20:51:25.097675 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 154/382] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Sep 17 20:51:25 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 17 20:51:25.105378 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0a11eab6-421a-4e33-a43f-5bbf17ed2fa9 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:25.148645 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0a11eab6-421a-4e33-a43f-5bbf17ed2fa9 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.047128 Sep 17 20:51:25.149231 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 155/383] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Sep 17 20:51:25 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 17 20:51:25.167715 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cf77772c-27a6-413c-93ef-be971c869a09 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:25.190696 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-113c9e19-5401-494b-b50a-53ad36ae2baa tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/dd77aee47f9d487c9fa48a05d2e6f6d7?user_id=83724eaa491747faa79304257713cdcd" status: 200 len: 328 microversion: 2.1 time: 0.594640 Sep 17 20:51:25.193813 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-cf77772c-27a6-413c-93ef-be971c869a09 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 17 20:51:25.194266 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 229/384] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Sep 17 20:51:24 2022] PUT /compute/v2.1/os-quota-sets/dd77aee47f9d487c9fa48a05d2e6f6d7?user_id=83724eaa491747faa79304257713cdcd => generated 328 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:25.195873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cf77772c-27a6-413c-93ef-be971c869a09 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Request method failure captured: Sep 17 20:51:25.195873 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 17 20:51:25.195873 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:51:25.195873 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:51:25.195873 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:51:25.195873 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:51:25.195873 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:51:25.195873 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:51:25.195873 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:51:25.195873 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:25.195873 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjNIistXvmaDMzDb4OArfIQfJMLOCKe4sVvi6E7xMm93sC2sCSdGrEIMlHjm4LcJzzbdYq7jED-w0aT93P87kgHmXi3uifQIbli7EeqhyK28jfoR4g85_jQGDfGTV0sZE-KiKx8ayKfbN_ASQqb6YhSBXcGYktOMynSp-opCnDS2e30 Sep 17 20:51:25.195873 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:51:25.195873 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:51:25.195873 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:51:25.195873 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:51:25.195873 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:51:25.195873 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:51:25.195873 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 4938af1a380d4294aeac011134799031 Sep 17 20:51:25.195873 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1771198131 Sep 17 20:51:25.195873 ncdv-master-1 devstack@n-api.service[140523]: X-Role: admin,member,reader Sep 17 20:51:25.195873 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: admin,member,reader Sep 17 20:51:25.197157 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4938af1a380d4294aeac011134799031"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4938af1a380d4294aeac011134799031"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4938af1a380d4294aeac011134799031"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4938af1a380d4294aeac011134799031", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:25.197157 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1771198131 Sep 17 20:51:25.197157 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 4938af1a380d4294aeac011134799031 Sep 17 20:51:25.197157 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1771198131 Sep 17 20:51:25.197157 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin Sep 17 20:51:25.197157 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:51:25.197157 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:51:25.197157 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 3db3d87bec8d48e3adb1f9e210152018 Sep 17 20:51:25.197157 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin Sep 17 20:51:25.197157 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:51:25.197157 ncdv-master-1 devstack@n-api.service[140523]: exception: Aggregate -1 could not be found. Sep 17 20:51:25.197157 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '-1'} Sep 17 20:51:25.197869 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:25.197869 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:25.197869 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 17 20:51:25.197869 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 17 20:51:25.197869 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 17 20:51:25.197869 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 17 20:51:25.197869 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:51:25.197869 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:51:25.197869 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:51:25.197869 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:51:25.197869 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 17 20:51:25.197869 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 17 20:51:25.197869 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 17 20:51:25.197869 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 17 20:51:25.197869 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:51:25.197869 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:51:25.197869 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 17 20:51:25.197869 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 17 20:51:25.197869 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 17 20:51:25.199002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 17 20:51:25.199002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 17 20:51:25.199002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 17 20:51:25.199002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 17 20:51:25.199002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:25.199002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:25.199002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:25.199002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:25.199002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:25.199002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:25.199002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:25.199002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:25.199002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:25.199002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:25.199002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 17 20:51:25.199002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:51:25.199002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 17 20:51:25.199002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:25.199002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:25.199002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:25.199002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:25.200173 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:25.200173 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:25.200173 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:25.200173 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:25.200173 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 17 20:51:25.200173 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:25.200173 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cf77772c-27a6-413c-93ef-be971c869a09 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:25.200173 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cf77772c-27a6-413c-93ef-be971c869a09 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.041789 Sep 17 20:51:25.204544 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 156/385] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Sep 17 20:51:25 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 20:51:25.205009 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-223f86e0-4cb4-45d6-90dd-9817c809db7f tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Calling method '.version_select at 0x7f25a5c2c670>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:25.209237 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-003f42a8-0eef-4ffa-aaea-7b0e89831d58 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1516768162"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:25.213780 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.aggregate [None req-003f42a8-0eef-4ffa-aaea-7b0e89831d58 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Generated uuid 5a74b3d0-8b4e-4300-a4c1-79694d918755 for aggregate {{(pid=140523) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 17 20:51:25.241505 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-003f42a8-0eef-4ffa-aaea-7b0e89831d58 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.034904 Sep 17 20:51:25.250112 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 157/386] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Sep 17 20:51:25 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:25.256223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5048fa87-4cb4-4e7f-a2d4-1d839f5b9718 tempest-AggregatesAdminNegativeTestJSON-1844150482 tempest-AggregatesAdminNegativeTestJSON-1844150482-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:25.257991 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5048fa87-4cb4-4e7f-a2d4-1d839f5b9718 tempest-AggregatesAdminNegativeTestJSON-1844150482 tempest-AggregatesAdminNegativeTestJSON-1844150482-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'e075fe44101842fab2d6be231517cd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06b859ea6d468bb45b4c6b9633d368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:25.259713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5048fa87-4cb4-4e7f-a2d4-1d839f5b9718 tempest-AggregatesAdminNegativeTestJSON-1844150482 tempest-AggregatesAdminNegativeTestJSON-1844150482-project] Request method failure captured: Sep 17 20:51:25.259713 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Sep 17 20:51:25.259713 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:51:25.259713 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:51:25.259713 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:51:25.259713 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:51:25.259713 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:51:25.259713 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:51:25.259713 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:51:25.259713 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:25.259713 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjNG4wQ9jlwxp3l-Xl_2iyOWJY-XMj2qvTp_clfIgbHICGIIdVzj3Y1SlSjLCRrUjgqOB4-b47btFU6kvmKqSIrSJoC6BiTWpkvTPRz0E0csQEisfGQnES96LZPOgGTNRzR4Pzmjip_IzlVN1j3m3cVkXDyH10SLaaqlIOMv1Hw18mY Sep 17 20:51:25.259713 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:51:25.259713 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:51:25.259713 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:51:25.259713 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:51:25.259713 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:51:25.259713 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:51:25.259713 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 5c06b859ea6d468bb45b4c6b9633d368 Sep 17 20:51:25.259713 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1844150482 Sep 17 20:51:25.259713 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:51:25.259713 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:51:25.261329 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c06b859ea6d468bb45b4c6b9633d368"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5c06b859ea6d468bb45b4c6b9633d368"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c06b859ea6d468bb45b4c6b9633d368"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5c06b859ea6d468bb45b4c6b9633d368", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:25.261329 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1844150482 Sep 17 20:51:25.261329 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 5c06b859ea6d468bb45b4c6b9633d368 Sep 17 20:51:25.261329 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1844150482 Sep 17 20:51:25.261329 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-AggregatesAdminNegativeTestJSON-1844150482-project Sep 17 20:51:25.261329 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:51:25.261329 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:51:25.261329 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: e075fe44101842fab2d6be231517cd5f Sep 17 20:51:25.261329 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1844150482-project Sep 17 20:51:25.261329 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:51:25.261329 ncdv-master-1 devstack@n-api.service[140523]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 17 20:51:25.261329 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '16'} Sep 17 20:51:25.262234 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:25.262234 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:25.262234 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:25.262234 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:25.262234 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:25.262234 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:25.262234 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:25.262234 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:25.262234 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Sep 17 20:51:25.262234 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Sep 17 20:51:25.262234 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 17 20:51:25.262234 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 17 20:51:25.262234 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 17 20:51:25.262234 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 17 20:51:25.262234 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:51:25.262234 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:51:25.262234 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:51:25.262234 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:51:25.262234 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 17 20:51:25.263408 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 17 20:51:25.263408 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 17 20:51:25.263408 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 17 20:51:25.263408 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 17 20:51:25.263408 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 17 20:51:25.263408 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 17 20:51:25.263408 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:25.263408 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:25.263408 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:25.263408 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:25.263408 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:25.263408 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:25.263408 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 17 20:51:25.263408 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 17 20:51:25.263408 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 17 20:51:25.263408 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:25.265434 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5048fa87-4cb4-4e7f-a2d4-1d839f5b9718 tempest-AggregatesAdminNegativeTestJSON-1844150482 tempest-AggregatesAdminNegativeTestJSON-1844150482-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:25.266581 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5048fa87-4cb4-4e7f-a2d4-1d839f5b9718 tempest-AggregatesAdminNegativeTestJSON-1844150482 tempest-AggregatesAdminNegativeTestJSON-1844150482-project] 10.222.0.26 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.015245 Sep 17 20:51:25.270767 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 158/387] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Sep 17 20:51:25 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:25.277058 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-df12c84d-2b07-44bc-9452-7be42648368d tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:25.311927 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-df12c84d-2b07-44bc-9452-7be42648368d tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.039560 Sep 17 20:51:25.312890 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 159/388] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Sep 17 20:51:25 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 17 20:51:25.323570 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8e3562b4-b908-4a4d-85b8-6b15bee8e9ff tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:25.340889 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-8e3562b4-b908-4a4d-85b8-6b15bee8e9ff tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 17 20:51:25.350557 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-223f86e0-4cb4-45d6-90dd-9817c809db7f tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/dd77aee47f9d487c9fa48a05d2e6f6d7?user_id=83724eaa491747faa79304257713cdcd" status: 200 len: 370 microversion: 2.1 time: 0.148997 Sep 17 20:51:25.351959 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 230/389] 10.222.0.26 () {58 vars in 1323 bytes} [Sat Sep 17 20:51:25 2022] GET /compute/v2.1/os-quota-sets/dd77aee47f9d487c9fa48a05d2e6f6d7?user_id=83724eaa491747faa79304257713cdcd => generated 370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:25.359861 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8e3562b4-b908-4a4d-85b8-6b15bee8e9ff tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Request method failure captured: Sep 17 20:51:25.359861 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 17 20:51:25.359861 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:51:25.359861 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:51:25.359861 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:51:25.359861 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:51:25.359861 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:51:25.359861 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:51:25.359861 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:51:25.359861 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:25.359861 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjNIistXvmaDMzDb4OArfIQfJMLOCKe4sVvi6E7xMm93sC2sCSdGrEIMlHjm4LcJzzbdYq7jED-w0aT93P87kgHmXi3uifQIbli7EeqhyK28jfoR4g85_jQGDfGTV0sZE-KiKx8ayKfbN_ASQqb6YhSBXcGYktOMynSp-opCnDS2e30 Sep 17 20:51:25.359861 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:51:25.359861 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:51:25.359861 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:51:25.359861 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:51:25.359861 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:51:25.359861 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:51:25.359861 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 4938af1a380d4294aeac011134799031 Sep 17 20:51:25.359861 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1771198131 Sep 17 20:51:25.359861 ncdv-master-1 devstack@n-api.service[140523]: X-Role: admin,member,reader Sep 17 20:51:25.359861 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: admin,member,reader Sep 17 20:51:25.361278 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4938af1a380d4294aeac011134799031"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4938af1a380d4294aeac011134799031"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4938af1a380d4294aeac011134799031"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4938af1a380d4294aeac011134799031", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:25.361278 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1771198131 Sep 17 20:51:25.361278 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 4938af1a380d4294aeac011134799031 Sep 17 20:51:25.361278 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1771198131 Sep 17 20:51:25.361278 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin Sep 17 20:51:25.361278 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:51:25.361278 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:51:25.361278 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 3db3d87bec8d48e3adb1f9e210152018 Sep 17 20:51:25.361278 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin Sep 17 20:51:25.361278 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:51:25.361278 ncdv-master-1 devstack@n-api.service[140523]: exception: Aggregate -1 could not be found. Sep 17 20:51:25.361278 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '-1'} Sep 17 20:51:25.362115 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:25.362115 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:25.362115 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 17 20:51:25.362115 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 17 20:51:25.362115 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 17 20:51:25.362115 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 17 20:51:25.362115 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:51:25.362115 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:51:25.362115 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 17 20:51:25.362115 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 17 20:51:25.362115 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 17 20:51:25.362115 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 17 20:51:25.362115 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 17 20:51:25.362115 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 17 20:51:25.362115 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 17 20:51:25.362115 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:25.362115 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:25.362115 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:25.362115 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:25.362115 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:25.363218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:25.363218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:25.363218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:25.363218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:25.363218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:25.363218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 17 20:51:25.363218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:51:25.363218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 17 20:51:25.363218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:25.363218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:25.363218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:25.363218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:25.363218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:25.363218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:25.363218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:25.363218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:25.363218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 17 20:51:25.363218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:25.365771 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8e3562b4-b908-4a4d-85b8-6b15bee8e9ff tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:25.367132 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8e3562b4-b908-4a4d-85b8-6b15bee8e9ff tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.047053 Sep 17 20:51:25.368729 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 160/390] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Sep 17 20:51:25 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 20:51:25.378211 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6b414a0f-9e82-4a9a-bfb4-6c41d091cb27 tempest-AggregatesAdminNegativeTestJSON-1844150482 tempest-AggregatesAdminNegativeTestJSON-1844150482-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:25.380513 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6b414a0f-9e82-4a9a-bfb4-6c41d091cb27 tempest-AggregatesAdminNegativeTestJSON-1844150482 tempest-AggregatesAdminNegativeTestJSON-1844150482-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'e075fe44101842fab2d6be231517cd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06b859ea6d468bb45b4c6b9633d368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:25.383837 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6b414a0f-9e82-4a9a-bfb4-6c41d091cb27 tempest-AggregatesAdminNegativeTestJSON-1844150482 tempest-AggregatesAdminNegativeTestJSON-1844150482-project] Request method failure captured: Sep 17 20:51:25.383837 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Sep 17 20:51:25.383837 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:51:25.383837 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:51:25.383837 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:51:25.383837 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:51:25.383837 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:51:25.383837 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:51:25.383837 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:51:25.383837 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:25.383837 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjNG4wQ9jlwxp3l-Xl_2iyOWJY-XMj2qvTp_clfIgbHICGIIdVzj3Y1SlSjLCRrUjgqOB4-b47btFU6kvmKqSIrSJoC6BiTWpkvTPRz0E0csQEisfGQnES96LZPOgGTNRzR4Pzmjip_IzlVN1j3m3cVkXDyH10SLaaqlIOMv1Hw18mY Sep 17 20:51:25.383837 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:51:25.383837 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:51:25.383837 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:51:25.383837 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:51:25.383837 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:51:25.383837 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:51:25.383837 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 5c06b859ea6d468bb45b4c6b9633d368 Sep 17 20:51:25.383837 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1844150482 Sep 17 20:51:25.383837 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:51:25.383837 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:51:25.385113 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c06b859ea6d468bb45b4c6b9633d368"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5c06b859ea6d468bb45b4c6b9633d368"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c06b859ea6d468bb45b4c6b9633d368"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5c06b859ea6d468bb45b4c6b9633d368", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:25.385113 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1844150482 Sep 17 20:51:25.385113 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 5c06b859ea6d468bb45b4c6b9633d368 Sep 17 20:51:25.385113 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1844150482 Sep 17 20:51:25.385113 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-AggregatesAdminNegativeTestJSON-1844150482-project Sep 17 20:51:25.385113 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:51:25.385113 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:51:25.385113 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: e075fe44101842fab2d6be231517cd5f Sep 17 20:51:25.385113 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1844150482-project Sep 17 20:51:25.385113 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:51:25.385113 ncdv-master-1 devstack@n-api.service[140524]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 17 20:51:25.385113 ncdv-master-1 devstack@n-api.service[140524]: action_args: {} Sep 17 20:51:25.385839 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:25.385839 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:25.385839 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:25.385839 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:25.385839 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:25.385839 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:25.385839 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:25.385839 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:25.385839 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Sep 17 20:51:25.385839 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Sep 17 20:51:25.385839 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 17 20:51:25.385839 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 17 20:51:25.385839 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 17 20:51:25.385839 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 17 20:51:25.385839 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:51:25.385839 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:51:25.385839 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:51:25.385839 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:51:25.385839 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 17 20:51:25.386934 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 17 20:51:25.386934 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 17 20:51:25.386934 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 17 20:51:25.386934 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 17 20:51:25.386934 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 17 20:51:25.386934 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 17 20:51:25.386934 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:25.386934 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:25.386934 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:25.386934 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:25.386934 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:25.386934 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:25.386934 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 17 20:51:25.386934 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 17 20:51:25.386934 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 17 20:51:25.386934 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:25.389973 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6b414a0f-9e82-4a9a-bfb4-6c41d091cb27 tempest-AggregatesAdminNegativeTestJSON-1844150482 tempest-AggregatesAdminNegativeTestJSON-1844150482-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:25.391170 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6b414a0f-9e82-4a9a-bfb4-6c41d091cb27 tempest-AggregatesAdminNegativeTestJSON-1844150482 tempest-AggregatesAdminNegativeTestJSON-1844150482-project] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.017733 Sep 17 20:51:25.392538 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 231/391] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Sep 17 20:51:25 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:25.403622 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d751832e-0457-42c5-9f56-a1e399affb65 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-279368799"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:25.415869 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.aggregate [None req-d751832e-0457-42c5-9f56-a1e399affb65 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Generated uuid ee957c2b-76a7-42ba-acac-f426a34a2455 for aggregate {{(pid=140523) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 17 20:51:25.438835 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-defe264b-9b8f-4e48-83c1-19200d57855a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:25.440377 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-defe264b-9b8f-4e48-83c1-19200d57855a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:25.455736 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-defe264b-9b8f-4e48-83c1-19200d57855a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:25.458322 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-defe264b-9b8f-4e48-83c1-19200d57855a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:25.459034 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-defe264b-9b8f-4e48-83c1-19200d57855a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:25.475688 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-defe264b-9b8f-4e48-83c1-19200d57855a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:25.482296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-defe264b-9b8f-4e48-83c1-19200d57855a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:25.484193 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-defe264b-9b8f-4e48-83c1-19200d57855a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:25.486345 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d751832e-0457-42c5-9f56-a1e399affb65 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.087428 Sep 17 20:51:25.495881 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 161/392] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Sep 17 20:51:25 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:25.505364 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-34179728-bfbb-4a13-8166-33f9c8d44097 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:25.533563 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34179728-bfbb-4a13-8166-33f9c8d44097 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:25.534076 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34179728-bfbb-4a13-8166-33f9c8d44097 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:25.534514 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34179728-bfbb-4a13-8166-33f9c8d44097 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:25.802865 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-34179728-bfbb-4a13-8166-33f9c8d44097 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 242 microversion: 2.1 time: 0.305649 Sep 17 20:51:25.810731 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 162/393] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Sep 17 20:51:25 2022] POST /compute/v2.1/os-aggregates/17/action => generated 242 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:25.815904 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-16f00454-e105-4d46-bc4a-843325a30bd7 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:25.820917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-16f00454-e105-4d46-bc4a-843325a30bd7 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 22274a46-3915-4c4a-891b-e5da0ab9423b] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:25.845747 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-16f00454-e105-4d46-bc4a-843325a30bd7 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:25.846230 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-16f00454-e105-4d46-bc4a-843325a30bd7 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:25.846680 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-16f00454-e105-4d46-bc4a-843325a30bd7 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:25.847429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-16f00454-e105-4d46-bc4a-843325a30bd7 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:25.847884 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-16f00454-e105-4d46-bc4a-843325a30bd7 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:25.848306 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-16f00454-e105-4d46-bc4a-843325a30bd7 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:25.904473 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-16f00454-e105-4d46-bc4a-843325a30bd7 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] HTTP exception thrown: Instance 22274a46-3915-4c4a-891b-e5da0ab9423b could not be found. Sep 17 20:51:25.908480 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-16f00454-e105-4d46-bc4a-843325a30bd7 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Request method failure captured: Sep 17 20:51:25.908480 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b HTTP/1.1 Sep 17 20:51:25.908480 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:51:25.908480 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:51:25.908480 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:51:25.908480 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:51:25.908480 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:51:25.908480 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:51:25.908480 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:51:25.908480 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:25.908480 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjMaYrxIL6h4qcGuFMeqKqphq1adSMhKHrjNGVVp5u0pH6PnPcBcNEhis_Uane9mEDAD2XrnYVR6zfaST-lIE2PllyUvTM9burnMTmywv5i-OBgbvw_OqjpozQbRG-mW7T0vuT25AtljnxKKm16V3oLjIFH_Y8C9a3xknUQStmaS5xM Sep 17 20:51:25.908480 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:51:25.908480 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:51:25.908480 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:51:25.908480 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:51:25.908480 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:51:25.908480 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:51:25.908480 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: ea88200545ae4003b42b0d475f482c9d Sep 17 20:51:25.908480 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-DeleteServersAdminTestJSON-281195364 Sep 17 20:51:25.908480 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:51:25.908480 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:51:25.909924 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ea88200545ae4003b42b0d475f482c9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ea88200545ae4003b42b0d475f482c9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ea88200545ae4003b42b0d475f482c9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ea88200545ae4003b42b0d475f482c9d", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:25.909924 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-DeleteServersAdminTestJSON-281195364 Sep 17 20:51:25.909924 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: ea88200545ae4003b42b0d475f482c9d Sep 17 20:51:25.909924 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-281195364 Sep 17 20:51:25.909924 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-DeleteServersAdminTestJSON-281195364-project Sep 17 20:51:25.909924 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:51:25.909924 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:51:25.909924 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: eb8bfe1d590a4500b7e7b5c79a6a4e6b Sep 17 20:51:25.909924 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-DeleteServersAdminTestJSON-281195364-project Sep 17 20:51:25.909924 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:51:25.909924 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 22274a46-3915-4c4a-891b-e5da0ab9423b could not be found. Sep 17 20:51:25.909924 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '22274a46-3915-4c4a-891b-e5da0ab9423b'} Sep 17 20:51:25.910750 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:25.910750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:25.910750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:51:25.910750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:51:25.910750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:51:25.910750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:51:25.910750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:51:25.910750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:51:25.910750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:51:25.910750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:51:25.910750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22274a46-3915-4c4a-891b-e5da0ab9423b could not be found. Sep 17 20:51:25.910750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:25.910750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:25.910750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:25.910750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:25.910750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:25.910750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:25.910750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:25.910750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:25.910750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:25.911870 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:25.911870 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:51:25.911870 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:51:25.911870 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:51:25.911870 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:51:25.911870 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:51:25.911870 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:51:25.911870 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22274a46-3915-4c4a-891b-e5da0ab9423b could not be found. Sep 17 20:51:25.911870 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:25.911870 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:25.911870 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:25.911870 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:25.911870 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:25.911870 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:25.911870 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:25.911870 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:25.911870 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22274a46-3915-4c4a-891b-e5da0ab9423b could not be found. Sep 17 20:51:25.911870 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:25.922332 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-16f00454-e105-4d46-bc4a-843325a30bd7 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Returning 404 to user: Instance 22274a46-3915-4c4a-891b-e5da0ab9423b could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:25.924654 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-16f00454-e105-4d46-bc4a-843325a30bd7 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] 10.222.0.26 "GET /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b" status: 404 len: 111 microversion: 2.1 time: 0.112769 Sep 17 20:51:25.933474 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 163/394] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:25 2022] GET /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:25.938836 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0a1245e7-f508-45a4-bea8-524cb4a55533 tempest-AggregatesAdminNegativeTestJSON-1844150482 tempest-AggregatesAdminNegativeTestJSON-1844150482-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:25.947760 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0a1245e7-f508-45a4-bea8-524cb4a55533 tempest-AggregatesAdminNegativeTestJSON-1844150482 tempest-AggregatesAdminNegativeTestJSON-1844150482-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'e075fe44101842fab2d6be231517cd5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c06b859ea6d468bb45b4c6b9633d368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:25.955561 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0a1245e7-f508-45a4-bea8-524cb4a55533 tempest-AggregatesAdminNegativeTestJSON-1844150482 tempest-AggregatesAdminNegativeTestJSON-1844150482-project] Request method failure captured: Sep 17 20:51:25.955561 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Sep 17 20:51:25.955561 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:51:25.955561 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:51:25.955561 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:51:25.955561 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 42 Sep 17 20:51:25.955561 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:51:25.955561 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:51:25.955561 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:51:25.955561 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:25.955561 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjNG4wQ9jlwxp3l-Xl_2iyOWJY-XMj2qvTp_clfIgbHICGIIdVzj3Y1SlSjLCRrUjgqOB4-b47btFU6kvmKqSIrSJoC6BiTWpkvTPRz0E0csQEisfGQnES96LZPOgGTNRzR4Pzmjip_IzlVN1j3m3cVkXDyH10SLaaqlIOMv1Hw18mY Sep 17 20:51:25.955561 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:51:25.955561 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:51:25.955561 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:51:25.955561 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:51:25.955561 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:51:25.955561 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:51:25.955561 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 5c06b859ea6d468bb45b4c6b9633d368 Sep 17 20:51:25.955561 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1844150482 Sep 17 20:51:25.955561 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:51:25.955561 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:51:25.956996 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c06b859ea6d468bb45b4c6b9633d368"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5c06b859ea6d468bb45b4c6b9633d368"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5c06b859ea6d468bb45b4c6b9633d368"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5c06b859ea6d468bb45b4c6b9633d368", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:25.956996 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1844150482 Sep 17 20:51:25.956996 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 5c06b859ea6d468bb45b4c6b9633d368 Sep 17 20:51:25.956996 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1844150482 Sep 17 20:51:25.956996 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-AggregatesAdminNegativeTestJSON-1844150482-project Sep 17 20:51:25.956996 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:51:25.956996 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:51:25.956996 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: e075fe44101842fab2d6be231517cd5f Sep 17 20:51:25.956996 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1844150482-project Sep 17 20:51:25.956996 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 20:51:25.956996 ncdv-master-1 devstack@n-api.service[140523]: {"remove_host": {"host": "nch2-master-1"}} Sep 17 20:51:25.956996 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:51:25.956996 ncdv-master-1 devstack@n-api.service[140523]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 17 20:51:25.957979 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'nch2-master-1'}}} Sep 17 20:51:25.957979 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:25.957979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:25.957979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:25.957979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:25.957979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:25.957979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:25.957979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:25.957979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:25.957979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:51:25.957979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:51:25.957979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Sep 17 20:51:25.957979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Sep 17 20:51:25.957979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 17 20:51:25.957979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 17 20:51:25.957979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 17 20:51:25.957979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 17 20:51:25.957979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:51:25.957979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:51:25.958997 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:51:25.958997 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:51:25.958997 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 17 20:51:25.958997 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 17 20:51:25.958997 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 17 20:51:25.958997 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 17 20:51:25.958997 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 17 20:51:25.958997 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 17 20:51:25.958997 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 17 20:51:25.958997 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:25.958997 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:25.958997 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:25.958997 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:25.958997 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:25.958997 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:25.958997 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 17 20:51:25.958997 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 17 20:51:25.958997 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 17 20:51:25.958997 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:25.961429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0a1245e7-f508-45a4-bea8-524cb4a55533 tempest-AggregatesAdminNegativeTestJSON-1844150482 tempest-AggregatesAdminNegativeTestJSON-1844150482-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:25.962515 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0a1245e7-f508-45a4-bea8-524cb4a55533 tempest-AggregatesAdminNegativeTestJSON-1844150482 tempest-AggregatesAdminNegativeTestJSON-1844150482-project] 10.222.0.26 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.027668 Sep 17 20:51:25.968225 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 164/395] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Sep 17 20:51:25 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 32 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:25.986079 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-15600532-e238-46ff-b4bd-27613f3bca9c tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:25.986741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-15600532-e238-46ff-b4bd-27613f3bca9c tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 22274a46-3915-4c4a-891b-e5da0ab9423b] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:26.006922 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-15600532-e238-46ff-b4bd-27613f3bca9c tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:26.007449 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-15600532-e238-46ff-b4bd-27613f3bca9c tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:26.007899 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-15600532-e238-46ff-b4bd-27613f3bca9c tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:26.008637 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-15600532-e238-46ff-b4bd-27613f3bca9c tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:26.009106 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-15600532-e238-46ff-b4bd-27613f3bca9c tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:26.014859 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-15600532-e238-46ff-b4bd-27613f3bca9c tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:26.049510 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-15600532-e238-46ff-b4bd-27613f3bca9c tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] HTTP exception thrown: Instance 22274a46-3915-4c4a-891b-e5da0ab9423b could not be found. Sep 17 20:51:26.055469 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-15600532-e238-46ff-b4bd-27613f3bca9c tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Request method failure captured: Sep 17 20:51:26.055469 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b HTTP/1.1 Sep 17 20:51:26.055469 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:51:26.055469 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:51:26.055469 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:51:26.055469 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:51:26.055469 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:51:26.055469 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:51:26.055469 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:51:26.055469 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:26.055469 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjMaYrxIL6h4qcGuFMeqKqphq1adSMhKHrjNGVVp5u0pH6PnPcBcNEhis_Uane9mEDAD2XrnYVR6zfaST-lIE2PllyUvTM9burnMTmywv5i-OBgbvw_OqjpozQbRG-mW7T0vuT25AtljnxKKm16V3oLjIFH_Y8C9a3xknUQStmaS5xM Sep 17 20:51:26.055469 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:51:26.055469 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:51:26.055469 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:51:26.055469 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:51:26.055469 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:51:26.055469 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:51:26.055469 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: ea88200545ae4003b42b0d475f482c9d Sep 17 20:51:26.055469 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-DeleteServersAdminTestJSON-281195364 Sep 17 20:51:26.055469 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:51:26.055469 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:51:26.057518 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ea88200545ae4003b42b0d475f482c9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ea88200545ae4003b42b0d475f482c9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ea88200545ae4003b42b0d475f482c9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ea88200545ae4003b42b0d475f482c9d", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:26.057518 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-DeleteServersAdminTestJSON-281195364 Sep 17 20:51:26.057518 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: ea88200545ae4003b42b0d475f482c9d Sep 17 20:51:26.057518 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-281195364 Sep 17 20:51:26.057518 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-DeleteServersAdminTestJSON-281195364-project Sep 17 20:51:26.057518 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:51:26.057518 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:51:26.057518 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: eb8bfe1d590a4500b7e7b5c79a6a4e6b Sep 17 20:51:26.057518 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-DeleteServersAdminTestJSON-281195364-project Sep 17 20:51:26.057518 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:51:26.057518 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 22274a46-3915-4c4a-891b-e5da0ab9423b could not be found. Sep 17 20:51:26.057518 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '22274a46-3915-4c4a-891b-e5da0ab9423b'} Sep 17 20:51:26.058405 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:26.058405 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:26.058405 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:51:26.058405 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:51:26.058405 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:51:26.058405 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:51:26.058405 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:51:26.058405 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:51:26.058405 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:51:26.058405 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:51:26.058405 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22274a46-3915-4c4a-891b-e5da0ab9423b could not be found. Sep 17 20:51:26.058405 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:26.058405 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:26.058405 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:26.058405 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:26.058405 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:26.058405 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:26.058405 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:26.058405 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:26.058405 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:26.059851 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:26.059851 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 20:51:26.059851 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 20:51:26.059851 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 20:51:26.059851 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 20:51:26.059851 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:51:26.059851 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:51:26.059851 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:51:26.059851 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:51:26.059851 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22274a46-3915-4c4a-891b-e5da0ab9423b could not be found. Sep 17 20:51:26.059851 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:26.059851 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:26.059851 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:26.059851 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:26.059851 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:26.059851 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:26.059851 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:26.059851 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:26.059851 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22274a46-3915-4c4a-891b-e5da0ab9423b could not be found. Sep 17 20:51:26.059851 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:26.065488 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-15600532-e238-46ff-b4bd-27613f3bca9c tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Returning 404 to user: Instance 22274a46-3915-4c4a-891b-e5da0ab9423b could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:26.067932 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-15600532-e238-46ff-b4bd-27613f3bca9c tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] 10.222.0.26 "DELETE /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b" status: 404 len: 111 microversion: 2.1 time: 0.099023 Sep 17 20:51:26.069981 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 165/396] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:51:25 2022] DELETE /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:26.082226 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-50e00b89-b5d8-4317-8d34-be9006243b73 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:26.101941 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-50e00b89-b5d8-4317-8d34-be9006243b73 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:26.103918 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-50e00b89-b5d8-4317-8d34-be9006243b73 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:26.104642 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-50e00b89-b5d8-4317-8d34-be9006243b73 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:26.310104 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-50e00b89-b5d8-4317-8d34-be9006243b73 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.237688 Sep 17 20:51:26.310720 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 166/397] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Sep 17 20:51:26 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:26.318433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ee713d36-c84c-4763-8ca6-3e30217d8b52 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:26.319059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ee713d36-c84c-4763-8ca6-3e30217d8b52 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 22274a46-3915-4c4a-891b-e5da0ab9423b] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:26.335118 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee713d36-c84c-4763-8ca6-3e30217d8b52 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:26.336642 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee713d36-c84c-4763-8ca6-3e30217d8b52 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:26.337661 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee713d36-c84c-4763-8ca6-3e30217d8b52 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:26.340156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee713d36-c84c-4763-8ca6-3e30217d8b52 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:26.340817 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee713d36-c84c-4763-8ca6-3e30217d8b52 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:26.341894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee713d36-c84c-4763-8ca6-3e30217d8b52 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:26.370092 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-ee713d36-c84c-4763-8ca6-3e30217d8b52 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] HTTP exception thrown: Instance 22274a46-3915-4c4a-891b-e5da0ab9423b could not be found. Sep 17 20:51:26.385207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ee713d36-c84c-4763-8ca6-3e30217d8b52 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Request method failure captured: Sep 17 20:51:26.385207 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b HTTP/1.1 Sep 17 20:51:26.385207 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:51:26.385207 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:51:26.385207 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:51:26.385207 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:51:26.385207 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:51:26.385207 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:51:26.385207 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:51:26.385207 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:26.385207 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjMaYrxIL6h4qcGuFMeqKqphq1adSMhKHrjNGVVp5u0pH6PnPcBcNEhis_Uane9mEDAD2XrnYVR6zfaST-lIE2PllyUvTM9burnMTmywv5i-OBgbvw_OqjpozQbRG-mW7T0vuT25AtljnxKKm16V3oLjIFH_Y8C9a3xknUQStmaS5xM Sep 17 20:51:26.385207 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:51:26.385207 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:51:26.385207 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:51:26.385207 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:51:26.385207 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:51:26.385207 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:51:26.385207 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: ea88200545ae4003b42b0d475f482c9d Sep 17 20:51:26.385207 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-DeleteServersAdminTestJSON-281195364 Sep 17 20:51:26.385207 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:51:26.385207 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:51:26.387256 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ea88200545ae4003b42b0d475f482c9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ea88200545ae4003b42b0d475f482c9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ea88200545ae4003b42b0d475f482c9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ea88200545ae4003b42b0d475f482c9d", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:26.387256 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-DeleteServersAdminTestJSON-281195364 Sep 17 20:51:26.387256 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: ea88200545ae4003b42b0d475f482c9d Sep 17 20:51:26.387256 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-281195364 Sep 17 20:51:26.387256 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-DeleteServersAdminTestJSON-281195364-project Sep 17 20:51:26.387256 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:51:26.387256 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:51:26.387256 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: eb8bfe1d590a4500b7e7b5c79a6a4e6b Sep 17 20:51:26.387256 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-DeleteServersAdminTestJSON-281195364-project Sep 17 20:51:26.387256 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:51:26.387256 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 22274a46-3915-4c4a-891b-e5da0ab9423b could not be found. Sep 17 20:51:26.387256 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '22274a46-3915-4c4a-891b-e5da0ab9423b'} Sep 17 20:51:26.388107 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:26.388107 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:26.388107 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:51:26.388107 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:51:26.388107 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:51:26.388107 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:51:26.388107 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:51:26.388107 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:51:26.388107 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:51:26.388107 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:51:26.388107 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22274a46-3915-4c4a-891b-e5da0ab9423b could not be found. Sep 17 20:51:26.388107 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:26.388107 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:26.388107 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:26.388107 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:26.388107 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:26.388107 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:26.388107 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:26.388107 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:26.388107 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:26.389415 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:26.389415 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:51:26.389415 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:51:26.389415 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:51:26.389415 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:51:26.389415 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:51:26.389415 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:51:26.389415 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22274a46-3915-4c4a-891b-e5da0ab9423b could not be found. Sep 17 20:51:26.389415 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:26.389415 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:26.389415 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:26.389415 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:26.389415 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:26.389415 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:26.389415 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:26.389415 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:26.389415 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22274a46-3915-4c4a-891b-e5da0ab9423b could not be found. Sep 17 20:51:26.389415 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:26.390774 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ee713d36-c84c-4763-8ca6-3e30217d8b52 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Returning 404 to user: Instance 22274a46-3915-4c4a-891b-e5da0ab9423b could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:26.390774 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ee713d36-c84c-4763-8ca6-3e30217d8b52 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] 10.222.0.26 "GET /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b" status: 404 len: 111 microversion: 2.1 time: 0.075400 Sep 17 20:51:26.392518 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 167/398] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:26 2022] GET /compute/v2.1/servers/22274a46-3915-4c4a-891b-e5da0ab9423b => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:26.400238 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-84e43f17-5699-470e-99d3-a53c2baac973 tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Calling method '.version_select at 0x7f25a5d42670>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:26.560447 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-defe264b-9b8f-4e48-83c1-19200d57855a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:26.582751 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-defe264b-9b8f-4e48-83c1-19200d57855a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1475 microversion: 2.1 time: 1.138384 Sep 17 20:51:26.589575 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 232/399] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:25 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1475 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:51:26.612059 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6f200452-9cc3-42c0-bb26-dbd9c0fc4eb3 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:26.659873 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6f200452-9cc3-42c0-bb26-dbd9c0fc4eb3 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.064743 Sep 17 20:51:26.665731 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 233/400] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Sep 17 20:51:26 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 17 20:51:26.671093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f573a77f-8245-4776-96a4-e752bde76a51 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:26.672176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f573a77f-8245-4776-96a4-e752bde76a51 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:26.704228 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f573a77f-8245-4776-96a4-e752bde76a51 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:26.705040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f573a77f-8245-4776-96a4-e752bde76a51 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:26.707559 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f573a77f-8245-4776-96a4-e752bde76a51 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:26.710402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f573a77f-8245-4776-96a4-e752bde76a51 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:26.711100 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f573a77f-8245-4776-96a4-e752bde76a51 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:26.711758 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f573a77f-8245-4776-96a4-e752bde76a51 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:26.771705 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-f573a77f-8245-4776-96a4-e752bde76a51 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] HTTP exception thrown: Instance 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c could not be found. Sep 17 20:51:26.780306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f573a77f-8245-4776-96a4-e752bde76a51 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Request method failure captured: Sep 17 20:51:26.780306 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c HTTP/1.1 Sep 17 20:51:26.780306 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:51:26.780306 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:51:26.780306 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:51:26.780306 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:51:26.780306 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:51:26.780306 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:51:26.780306 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:51:26.780306 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:26.780306 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjMaYrxIL6h4qcGuFMeqKqphq1adSMhKHrjNGVVp5u0pH6PnPcBcNEhis_Uane9mEDAD2XrnYVR6zfaST-lIE2PllyUvTM9burnMTmywv5i-OBgbvw_OqjpozQbRG-mW7T0vuT25AtljnxKKm16V3oLjIFH_Y8C9a3xknUQStmaS5xM Sep 17 20:51:26.780306 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:51:26.780306 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:51:26.780306 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:51:26.780306 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:51:26.780306 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:51:26.780306 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:51:26.780306 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: ea88200545ae4003b42b0d475f482c9d Sep 17 20:51:26.780306 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-DeleteServersAdminTestJSON-281195364 Sep 17 20:51:26.780306 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:51:26.780306 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:51:26.781581 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ea88200545ae4003b42b0d475f482c9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ea88200545ae4003b42b0d475f482c9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ea88200545ae4003b42b0d475f482c9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ea88200545ae4003b42b0d475f482c9d", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:26.781581 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-DeleteServersAdminTestJSON-281195364 Sep 17 20:51:26.781581 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: ea88200545ae4003b42b0d475f482c9d Sep 17 20:51:26.781581 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-281195364 Sep 17 20:51:26.781581 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-DeleteServersAdminTestJSON-281195364-project Sep 17 20:51:26.781581 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:51:26.781581 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:51:26.781581 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: eb8bfe1d590a4500b7e7b5c79a6a4e6b Sep 17 20:51:26.781581 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-DeleteServersAdminTestJSON-281195364-project Sep 17 20:51:26.781581 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:51:26.781581 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c could not be found. Sep 17 20:51:26.781581 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '7dbd958b-d480-41e3-b36b-4d3c7fa55d1c'} Sep 17 20:51:26.783065 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:26.783065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:26.783065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:51:26.783065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:51:26.783065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:51:26.783065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:51:26.783065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:51:26.783065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:51:26.783065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:51:26.783065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:51:26.783065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c could not be found. Sep 17 20:51:26.783065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:26.783065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:26.783065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:26.783065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:26.783065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:26.783065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:26.783065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:26.783065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:26.783065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:26.784150 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:26.784150 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 20:51:26.784150 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 20:51:26.784150 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 20:51:26.784150 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 20:51:26.784150 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:51:26.784150 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:51:26.784150 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:51:26.784150 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:51:26.784150 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c could not be found. Sep 17 20:51:26.784150 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:26.784150 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:26.784150 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:26.784150 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:26.784150 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:26.784150 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:26.784150 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:26.784150 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:26.784150 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c could not be found. Sep 17 20:51:26.784150 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:26.787448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f573a77f-8245-4776-96a4-e752bde76a51 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Returning 404 to user: Instance 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:26.791009 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f573a77f-8245-4776-96a4-e752bde76a51 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c" status: 404 len: 111 microversion: 2.1 time: 0.128921 Sep 17 20:51:26.793603 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 234/401] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:51:26 2022] DELETE /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:26.809966 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-124ec39f-4869-491a-8df9-e29079def376 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1673154744"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:26.817981 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.aggregate [None req-124ec39f-4869-491a-8df9-e29079def376 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Generated uuid 9e684770-e334-446f-acdc-e24876031181 for aggregate {{(pid=140524) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 17 20:51:26.895246 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-124ec39f-4869-491a-8df9-e29079def376 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.100075 Sep 17 20:51:26.897041 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 235/402] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Sep 17 20:51:26 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:26.914563 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5d73df4f-a3f5-43cf-97bb-3894293e5e83 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:26.915563 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5d73df4f-a3f5-43cf-97bb-3894293e5e83 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] [instance: 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:26.931975 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d73df4f-a3f5-43cf-97bb-3894293e5e83 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:26.942223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d73df4f-a3f5-43cf-97bb-3894293e5e83 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:26.942916 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d73df4f-a3f5-43cf-97bb-3894293e5e83 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:26.943799 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d73df4f-a3f5-43cf-97bb-3894293e5e83 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:26.944367 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d73df4f-a3f5-43cf-97bb-3894293e5e83 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:26.944971 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d73df4f-a3f5-43cf-97bb-3894293e5e83 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:26.982565 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-5d73df4f-a3f5-43cf-97bb-3894293e5e83 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] HTTP exception thrown: Instance 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c could not be found. Sep 17 20:51:26.988547 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5d73df4f-a3f5-43cf-97bb-3894293e5e83 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Request method failure captured: Sep 17 20:51:26.988547 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c HTTP/1.1 Sep 17 20:51:26.988547 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:51:26.988547 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:51:26.988547 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:51:26.988547 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:51:26.988547 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:51:26.988547 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:51:26.988547 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:51:26.988547 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:26.988547 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjMaYrxIL6h4qcGuFMeqKqphq1adSMhKHrjNGVVp5u0pH6PnPcBcNEhis_Uane9mEDAD2XrnYVR6zfaST-lIE2PllyUvTM9burnMTmywv5i-OBgbvw_OqjpozQbRG-mW7T0vuT25AtljnxKKm16V3oLjIFH_Y8C9a3xknUQStmaS5xM Sep 17 20:51:26.988547 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:51:26.988547 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:51:26.988547 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:51:26.988547 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:51:26.988547 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:51:26.988547 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:51:26.988547 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: ea88200545ae4003b42b0d475f482c9d Sep 17 20:51:26.988547 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-DeleteServersAdminTestJSON-281195364 Sep 17 20:51:26.988547 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:51:26.988547 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:51:26.990000 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ea88200545ae4003b42b0d475f482c9d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ea88200545ae4003b42b0d475f482c9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ea88200545ae4003b42b0d475f482c9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ea88200545ae4003b42b0d475f482c9d", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:26.990000 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-DeleteServersAdminTestJSON-281195364 Sep 17 20:51:26.990000 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: ea88200545ae4003b42b0d475f482c9d Sep 17 20:51:26.990000 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-281195364 Sep 17 20:51:26.990000 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-DeleteServersAdminTestJSON-281195364-project Sep 17 20:51:26.990000 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:51:26.990000 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:51:26.990000 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: eb8bfe1d590a4500b7e7b5c79a6a4e6b Sep 17 20:51:26.990000 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-DeleteServersAdminTestJSON-281195364-project Sep 17 20:51:26.990000 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:51:26.990000 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c could not be found. Sep 17 20:51:26.990000 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '7dbd958b-d480-41e3-b36b-4d3c7fa55d1c'} Sep 17 20:51:26.990703 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:26.990703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:26.990703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:51:26.990703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:51:26.990703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:51:26.990703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:51:26.990703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:51:26.990703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:51:26.990703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:51:26.990703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:51:26.990703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c could not be found. Sep 17 20:51:26.990703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:26.990703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:26.990703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:26.990703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:26.990703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:26.990703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:26.990703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:26.990703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:26.990703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:26.991772 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:26.991772 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:51:26.991772 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:51:26.991772 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:51:26.991772 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:51:26.991772 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:51:26.991772 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:51:26.991772 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c could not be found. Sep 17 20:51:26.991772 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:26.991772 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:26.991772 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:26.991772 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:26.991772 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:26.991772 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:26.991772 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:26.991772 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:26.991772 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c could not be found. Sep 17 20:51:26.991772 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:26.994152 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5d73df4f-a3f5-43cf-97bb-3894293e5e83 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] Returning 404 to user: Instance 7dbd958b-d480-41e3-b36b-4d3c7fa55d1c could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:26.997552 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5d73df4f-a3f5-43cf-97bb-3894293e5e83 tempest-DeleteServersAdminTestJSON-281195364 tempest-DeleteServersAdminTestJSON-281195364-project] 10.222.0.26 "GET /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c" status: 404 len: 111 microversion: 2.1 time: 0.096632 Sep 17 20:51:26.999581 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 236/403] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:26 2022] GET /compute/v2.1/servers/7dbd958b-d480-41e3-b36b-4d3c7fa55d1c => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:27.014690 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-de275511-55e4-4d95-9704-21be8f9739aa tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:27.032507 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-84e43f17-5699-470e-99d3-a53c2baac973 tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/b01f4e11e8674f35a6781fa05a0a727f/defaults" status: 200 len: 371 microversion: 2.1 time: 0.638513 Sep 17 20:51:27.040137 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 168/404] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Sep 17 20:51:26 2022] GET /compute/v2.1/os-quota-sets/b01f4e11e8674f35a6781fa05a0a727f/defaults => generated 371 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:27.057175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-762c797c-2988-4740-b4db-08837bf5dc48 tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Action: 'update', calling method: .version_select at 0x7f25a5d8f1f0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:27.059294 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-de275511-55e4-4d95-9704-21be8f9739aa tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:27.064062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-de275511-55e4-4d95-9704-21be8f9739aa tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:27.064547 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-de275511-55e4-4d95-9704-21be8f9739aa tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:27.087697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-de275511-55e4-4d95-9704-21be8f9739aa tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:27.088374 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-de275511-55e4-4d95-9704-21be8f9739aa tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:27.093605 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-de275511-55e4-4d95-9704-21be8f9739aa tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:27.127395 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.compute.aggregates [None req-de275511-55e4-4d95-9704-21be8f9739aa tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 17 20:51:27.142198 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-de275511-55e4-4d95-9704-21be8f9739aa tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Sep 17 20:51:27.144391 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-de275511-55e4-4d95-9704-21be8f9739aa tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Request method failure captured: Sep 17 20:51:27.144391 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Sep 17 20:51:27.144391 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:51:27.144391 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:51:27.144391 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:51:27.144391 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 42 Sep 17 20:51:27.144391 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:51:27.144391 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:51:27.144391 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:51:27.144391 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:27.144391 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjNIistXvmaDMzDb4OArfIQfJMLOCKe4sVvi6E7xMm93sC2sCSdGrEIMlHjm4LcJzzbdYq7jED-w0aT93P87kgHmXi3uifQIbli7EeqhyK28jfoR4g85_jQGDfGTV0sZE-KiKx8ayKfbN_ASQqb6YhSBXcGYktOMynSp-opCnDS2e30 Sep 17 20:51:27.144391 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:51:27.144391 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:51:27.144391 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:51:27.144391 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:51:27.144391 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:51:27.144391 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:51:27.144391 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 4938af1a380d4294aeac011134799031 Sep 17 20:51:27.144391 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1771198131 Sep 17 20:51:27.144391 ncdv-master-1 devstack@n-api.service[140524]: X-Role: admin,member,reader Sep 17 20:51:27.144391 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: admin,member,reader Sep 17 20:51:27.145674 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4938af1a380d4294aeac011134799031"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4938af1a380d4294aeac011134799031"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4938af1a380d4294aeac011134799031"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4938af1a380d4294aeac011134799031", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:27.145674 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1771198131 Sep 17 20:51:27.145674 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 4938af1a380d4294aeac011134799031 Sep 17 20:51:27.145674 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1771198131 Sep 17 20:51:27.145674 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin Sep 17 20:51:27.145674 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:51:27.145674 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:51:27.145674 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 3db3d87bec8d48e3adb1f9e210152018 Sep 17 20:51:27.145674 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin Sep 17 20:51:27.145674 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:51:27.145674 ncdv-master-1 devstack@n-api.service[140524]: {"remove_host": {"host": "nonexist_host"}} Sep 17 20:51:27.145674 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:51:27.145674 ncdv-master-1 devstack@n-api.service[140524]: exception: Cannot remove host nonexist_host in aggregate 18 Sep 17 20:51:27.146390 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Sep 17 20:51:27.146390 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:27.146390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:27.146390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 17 20:51:27.146390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 17 20:51:27.146390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:51:27.146390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:51:27.146390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 17 20:51:27.146390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 17 20:51:27.146390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 17 20:51:27.146390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 17 20:51:27.146390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 17 20:51:27.146390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 17 20:51:27.146390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Sep 17 20:51:27.146390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:27.146390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:27.146390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:27.146390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:27.146390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 17 20:51:27.146390 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 17 20:51:27.147472 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 17 20:51:27.147472 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 17 20:51:27.147472 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 17 20:51:27.147472 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:27.147472 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:27.147472 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:27.147472 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:27.147472 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Sep 17 20:51:27.147472 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Sep 17 20:51:27.147472 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 17 20:51:27.147472 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 17 20:51:27.147472 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:51:27.147472 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:51:27.147472 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:51:27.147472 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:51:27.147472 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 17 20:51:27.147472 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 17 20:51:27.147472 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Sep 17 20:51:27.147472 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Sep 17 20:51:27.147472 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 17 20:51:27.148551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 17 20:51:27.148551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 17 20:51:27.148551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:27.148551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:27.148551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:27.148551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:27.148551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:27.148551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:27.148551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:27.148551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:27.148551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:27.148551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:27.148551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:51:27.148551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:51:27.148551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Sep 17 20:51:27.148551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 17 20:51:27.148551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Sep 17 20:51:27.148551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:27.148551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:27.148551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:27.148551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:27.149834 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:27.149834 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:27.149834 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:27.149834 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:27.149834 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Sep 17 20:51:27.149834 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:27.156696 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-de275511-55e4-4d95-9704-21be8f9739aa tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:27.157854 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-de275511-55e4-4d95-9704-21be8f9739aa tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.154550 Sep 17 20:51:27.159124 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 237/405] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Sep 17 20:51:26 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 20:51:27.167849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ac77c613-f1a7-4962-8a3f-102e21fc95d4 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:27.221127 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ac77c613-f1a7-4962-8a3f-102e21fc95d4 tempest-AggregatesAdminNegativeTestJSON-1771198131 tempest-AggregatesAdminNegativeTestJSON-1771198131-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.056409 Sep 17 20:51:27.222406 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 238/406] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Sep 17 20:51:27 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 17 20:51:27.613429 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5ccfec08-28ed-4eb7-bde6-a574f3e20887 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:27.614916 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5ccfec08-28ed-4eb7-bde6-a574f3e20887 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:27.627204 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5ccfec08-28ed-4eb7-bde6-a574f3e20887 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:27.627723 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5ccfec08-28ed-4eb7-bde6-a574f3e20887 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:27.628167 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5ccfec08-28ed-4eb7-bde6-a574f3e20887 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:27.628890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5ccfec08-28ed-4eb7-bde6-a574f3e20887 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:27.632086 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5ccfec08-28ed-4eb7-bde6-a574f3e20887 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:27.635200 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5ccfec08-28ed-4eb7-bde6-a574f3e20887 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:28.174474 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5ccfec08-28ed-4eb7-bde6-a574f3e20887 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:28.187098 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5ccfec08-28ed-4eb7-bde6-a574f3e20887 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1475 microversion: 2.1 time: 0.578498 Sep 17 20:51:28.187508 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 239/407] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:27 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1475 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:28.511538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-762c797c-2988-4740-b4db-08837bf5dc48 tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:28.516336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-762c797c-2988-4740-b4db-08837bf5dc48 tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:28.518442 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-762c797c-2988-4740-b4db-08837bf5dc48 tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:28.521610 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-762c797c-2988-4740-b4db-08837bf5dc48 tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:28.529081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-762c797c-2988-4740-b4db-08837bf5dc48 tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:28.529718 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-762c797c-2988-4740-b4db-08837bf5dc48 tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:28.749200 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=9,nova_api:INSERT=8 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:51:29.067426 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-762c797c-2988-4740-b4db-08837bf5dc48 tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/b01f4e11e8674f35a6781fa05a0a727f" status: 200 len: 329 microversion: 2.1 time: 2.018237 Sep 17 20:51:29.068092 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 169/408] 10.222.0.26 () {60 vars in 1263 bytes} [Sat Sep 17 20:51:27 2022] PUT /compute/v2.1/os-quota-sets/b01f4e11e8674f35a6781fa05a0a727f => generated 329 bytes in 2020 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:29.080602 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ae2ecbb0-defb-4522-8abb-37ded5324aca tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Action: 'update', calling method: .version_select at 0x7f25a5c38d30>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:29.215881 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7c803721-4cbf-4ca8-b911-393d21bb793b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:29.216856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7c803721-4cbf-4ca8-b911-393d21bb793b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:29.225974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c803721-4cbf-4ca8-b911-393d21bb793b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:29.226442 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c803721-4cbf-4ca8-b911-393d21bb793b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:29.237084 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c803721-4cbf-4ca8-b911-393d21bb793b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:29.238041 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c803721-4cbf-4ca8-b911-393d21bb793b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:29.238865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c803721-4cbf-4ca8-b911-393d21bb793b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:29.239317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c803721-4cbf-4ca8-b911-393d21bb793b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:29.561978 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7c803721-4cbf-4ca8-b911-393d21bb793b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:29.595764 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae2ecbb0-defb-4522-8abb-37ded5324aca tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:29.599917 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7c803721-4cbf-4ca8-b911-393d21bb793b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1475 microversion: 2.1 time: 0.376781 Sep 17 20:51:29.602108 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 170/409] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:29 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1475 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:29.602450 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae2ecbb0-defb-4522-8abb-37ded5324aca tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:29.603114 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae2ecbb0-defb-4522-8abb-37ded5324aca tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:29.604029 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae2ecbb0-defb-4522-8abb-37ded5324aca tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:29.610025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae2ecbb0-defb-4522-8abb-37ded5324aca tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:29.610728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae2ecbb0-defb-4522-8abb-37ded5324aca tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:29.657216 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=5,nova_api:DELETE=8 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:51:30.264659 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ae2ecbb0-defb-4522-8abb-37ded5324aca tempest-QuotasAdminTestJSON-754300214 tempest-QuotasAdminTestJSON-754300214-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/b01f4e11e8674f35a6781fa05a0a727f" status: 200 len: 329 microversion: 2.1 time: 1.186235 Sep 17 20:51:30.274997 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 240/410] 10.222.0.26 () {60 vars in 1263 bytes} [Sat Sep 17 20:51:29 2022] PUT /compute/v2.1/os-quota-sets/b01f4e11e8674f35a6781fa05a0a727f => generated 329 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:51:30.457663 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-132111cd-94aa-44a1-ac0b-58f5eea2d7bf tempest-TenantUsagesNegativeTestJSON-735782304 tempest-TenantUsagesNegativeTestJSON-735782304-project-admin] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-16T20%3A51%3A29.842074&end=2022-09-18T20%3A51%3A29.842074" status: 404 len: 112 microversion: - time: 0.610603 Sep 17 20:51:30.457663 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 171/411] 10.222.0.26 () {58 vars in 1316 bytes} [Sat Sep 17 20:51:29 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-16T20%3A51%3A29.842074&end=2022-09-18T20%3A51%3A29.842074 => generated 112 bytes in 612 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 17 20:51:30.467915 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d01949fa-97cc-45f9-9ca4-baf8334de0dd tempest-TenantUsagesNegativeTestJSON-735782304 tempest-TenantUsagesNegativeTestJSON-735782304-project-admin] Calling method '.version_select at 0x7f25a5da58b0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:30.472504 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-d01949fa-97cc-45f9-9ca4-baf8334de0dd tempest-TenantUsagesNegativeTestJSON-735782304 tempest-TenantUsagesNegativeTestJSON-735782304-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Sep 17 20:51:30.482276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d01949fa-97cc-45f9-9ca4-baf8334de0dd tempest-TenantUsagesNegativeTestJSON-735782304 tempest-TenantUsagesNegativeTestJSON-735782304-project-admin] Request method failure captured: Sep 17 20:51:30.482276 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/os-simple-tenant-usage/9ddaad0529a24a0ca7afcfc96d79c945?start=2022-09-18T20%3A51%3A29.842074&end=2022-09-16T20%3A51%3A29.842074 HTTP/1.1 Sep 17 20:51:30.482276 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:51:30.482276 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:51:30.482276 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:51:30.482276 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:51:30.482276 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:51:30.482276 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:51:30.482276 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:51:30.482276 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:30.482276 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjNR-GSem_kDaDhzFY-BHx2x6j0TnRsQ6kT7lbXeVyRavj59C9_7R3TCtXYByX5qBVD3Sgek1mztjZGXCeRW0uOkphDGPzka-xzCAiGPuF3Q-i-cyy6mY8Y_G6k6kJ93Fq0tihRxp8m80lhq8_tU2IOosbsQkH7dss9zgtIY1gggnTY Sep 17 20:51:30.482276 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:51:30.482276 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:51:30.482276 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:51:30.482276 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:51:30.482276 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:51:30.482276 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:51:30.482276 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 51f4fbbe06c3403ca745e73589256154 Sep 17 20:51:30.482276 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-735782304 Sep 17 20:51:30.482276 ncdv-master-1 devstack@n-api.service[140523]: X-Role: admin,member,reader Sep 17 20:51:30.482276 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: admin,member,reader Sep 17 20:51:30.483726 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/51f4fbbe06c3403ca745e73589256154"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/51f4fbbe06c3403ca745e73589256154"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/51f4fbbe06c3403ca745e73589256154"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_51f4fbbe06c3403ca745e73589256154", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:30.483726 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-735782304 Sep 17 20:51:30.483726 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 51f4fbbe06c3403ca745e73589256154 Sep 17 20:51:30.483726 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-735782304 Sep 17 20:51:30.483726 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-TenantUsagesNegativeTestJSON-735782304-project-admin Sep 17 20:51:30.483726 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:51:30.483726 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:51:30.483726 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 75484a214b604859b65ff05f3be67989 Sep 17 20:51:30.483726 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-735782304-project-admin Sep 17 20:51:30.483726 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 20:51:30.483726 ncdv-master-1 devstack@n-api.service[140523]: exception: Invalid start time. The start time cannot occur after the end time. Sep 17 20:51:30.483726 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '9ddaad0529a24a0ca7afcfc96d79c945'} Sep 17 20:51:30.484632 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:30.484632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:30.484632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:30.484632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:30.484632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:30.484632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:30.484632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:51:30.484632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:51:30.484632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 17 20:51:30.484632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:51:30.484632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:30.484632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:30.484632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Sep 17 20:51:30.484632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 17 20:51:30.484632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Sep 17 20:51:30.484632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Sep 17 20:51:30.484632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Sep 17 20:51:30.484632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 17 20:51:30.484632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Sep 17 20:51:30.485874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:30.485874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:30.485874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:30.485874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:30.485874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:30.485874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:30.485874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:30.485874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:30.485874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Sep 17 20:51:30.485874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:30.485874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d01949fa-97cc-45f9-9ca4-baf8334de0dd tempest-TenantUsagesNegativeTestJSON-735782304 tempest-TenantUsagesNegativeTestJSON-735782304-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:30.485874 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d01949fa-97cc-45f9-9ca4-baf8334de0dd tempest-TenantUsagesNegativeTestJSON-735782304 tempest-TenantUsagesNegativeTestJSON-735782304-project-admin] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage/9ddaad0529a24a0ca7afcfc96d79c945?start=2022-09-18T20%3A51%3A29.842074&end=2022-09-16T20%3A51%3A29.842074" status: 400 len: 111 microversion: 2.1 time: 0.019578 Sep 17 20:51:30.486572 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 172/412] 10.222.0.26 () {58 vars in 1412 bytes} [Sat Sep 17 20:51:30 2022] GET /compute/v2.1/os-simple-tenant-usage/9ddaad0529a24a0ca7afcfc96d79c945?start=2022-09-18T20%3A51%3A29.842074&end=2022-09-16T20%3A51%3A29.842074 => generated 111 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 17 20:51:31.099440 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9e906618-26f3-4a75-a747-ef566fbfcd7e tempest-FloatingIPsTestJSON-1970796804 tempest-FloatingIPsTestJSON-1970796804-project] Action: 'create', calling method: .version_select at 0x7f25a5dd9820>, body: {"pool": null} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:31.526142 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1ce1fa7b-66f4-48d3-b5f0-5191dfe6a9b7 tempest-TenantUsagesNegativeTestJSON-1321493676 tempest-TenantUsagesNegativeTestJSON-1321493676-project] Calling method '.version_select at 0x7f25a5d42c10>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:31.531539 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1ce1fa7b-66f4-48d3-b5f0-5191dfe6a9b7 tempest-TenantUsagesNegativeTestJSON-1321493676 tempest-TenantUsagesNegativeTestJSON-1321493676-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '3f911bb25f06441b9a23baa0bcc2f509', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddaad0529a24a0ca7afcfc96d79c945', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:31.537047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1ce1fa7b-66f4-48d3-b5f0-5191dfe6a9b7 tempest-TenantUsagesNegativeTestJSON-1321493676 tempest-TenantUsagesNegativeTestJSON-1321493676-project] Request method failure captured: Sep 17 20:51:31.537047 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-16T20%3A51%3A29.842074&end=2022-09-18T20%3A51%3A29.842074&detailed=1 HTTP/1.1 Sep 17 20:51:31.537047 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:51:31.537047 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:51:31.537047 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:51:31.537047 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:51:31.537047 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:51:31.537047 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:51:31.537047 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:51:31.537047 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:31.537047 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjNPMX1qcCLhoNVulnKEQN5JGqwU-RkaEXeLA7fOqmS0BH-VWHdmCcpdH3dRdtqp17NjgXqHuujgmzaExh3z7iBwb2YaUtTFmshL8GhCAviARkhBg2LT6Yp8wdQ1C-jOEznZ4J2XrRvlAVrGNCCht793MBWzb6C84k4pzCV0w-VEA5c Sep 17 20:51:31.537047 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:51:31.537047 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:51:31.537047 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:51:31.537047 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:51:31.537047 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:51:31.537047 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:51:31.537047 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 9ddaad0529a24a0ca7afcfc96d79c945 Sep 17 20:51:31.537047 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1321493676 Sep 17 20:51:31.537047 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:51:31.537047 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:51:31.538342 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ddaad0529a24a0ca7afcfc96d79c945"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9ddaad0529a24a0ca7afcfc96d79c945"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ddaad0529a24a0ca7afcfc96d79c945"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9ddaad0529a24a0ca7afcfc96d79c945", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:31.538342 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1321493676 Sep 17 20:51:31.538342 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 9ddaad0529a24a0ca7afcfc96d79c945 Sep 17 20:51:31.538342 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1321493676 Sep 17 20:51:31.538342 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-TenantUsagesNegativeTestJSON-1321493676-project Sep 17 20:51:31.538342 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:51:31.538342 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:51:31.538342 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 3f911bb25f06441b9a23baa0bcc2f509 Sep 17 20:51:31.538342 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1321493676-project Sep 17 20:51:31.538342 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 20:51:31.538342 ncdv-master-1 devstack@n-api.service[140523]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 17 20:51:31.538342 ncdv-master-1 devstack@n-api.service[140523]: action_args: {} Sep 17 20:51:31.538342 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:31.539102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:31.539102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:31.539102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:31.539102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:31.539102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:31.539102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:51:31.539102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:51:31.539102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 17 20:51:31.539102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:51:31.539102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:31.539102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:31.539102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Sep 17 20:51:31.539102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 17 20:51:31.539102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Sep 17 20:51:31.539102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Sep 17 20:51:31.539102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 17 20:51:31.539102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 17 20:51:31.539102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 17 20:51:31.539102 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 17 20:51:31.540179 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:51:31.540179 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:51:31.540179 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:51:31.540179 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:51:31.540179 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 17 20:51:31.540179 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 17 20:51:31.540179 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 17 20:51:31.540179 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 17 20:51:31.540179 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 17 20:51:31.540179 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 17 20:51:31.540179 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 17 20:51:31.540179 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:31.540179 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:31.540179 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:31.540179 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:31.540179 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:31.540179 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:31.540179 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 17 20:51:31.540179 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 17 20:51:31.541335 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 17 20:51:31.541335 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:31.543693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1ce1fa7b-66f4-48d3-b5f0-5191dfe6a9b7 tempest-TenantUsagesNegativeTestJSON-1321493676 tempest-TenantUsagesNegativeTestJSON-1321493676-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:31.544940 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1ce1fa7b-66f4-48d3-b5f0-5191dfe6a9b7 tempest-TenantUsagesNegativeTestJSON-1321493676 tempest-TenantUsagesNegativeTestJSON-1321493676-project] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-16T20%3A51%3A29.842074&end=2022-09-18T20%3A51%3A29.842074&detailed=1" status: 403 len: 123 microversion: 2.1 time: 1.049924 Sep 17 20:51:31.546215 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 173/413] 10.222.0.26 () {58 vars in 1335 bytes} [Sat Sep 17 20:51:30 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-16T20%3A51%3A29.842074&end=2022-09-18T20%3A51%3A29.842074&detailed=1 => generated 123 bytes in 1055 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:31.551845 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-94993e3b-7d31-4045-a9d8-a6e80d8ffb66 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:31.553529 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-94993e3b-7d31-4045-a9d8-a6e80d8ffb66 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:31.574094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-94993e3b-7d31-4045-a9d8-a6e80d8ffb66 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:31.577206 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-94993e3b-7d31-4045-a9d8-a6e80d8ffb66 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:31.578850 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-94993e3b-7d31-4045-a9d8-a6e80d8ffb66 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:31.582300 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-94993e3b-7d31-4045-a9d8-a6e80d8ffb66 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:31.584842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-94993e3b-7d31-4045-a9d8-a6e80d8ffb66 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:31.585319 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-94993e3b-7d31-4045-a9d8-a6e80d8ffb66 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:32.136436 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-94993e3b-7d31-4045-a9d8-a6e80d8ffb66 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:32.151967 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-94993e3b-7d31-4045-a9d8-a6e80d8ffb66 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1474 microversion: 2.1 time: 0.600913 Sep 17 20:51:32.152597 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 174/414] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:31 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1474 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:32.169263 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-3805ac55-888d-4eb2-aa7d-26fdc46fa8f4 req-ff106f53-d102-43b7-9d01-7155452d2dbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63955de3-b0fa-4f96-a2db-26ae995db228", "name": "network-vif-unplugged", "status": "completed", "tag": "17d8bcdf-2e72-4ea0-a129-6fda20d5053a"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:32.209972 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-3805ac55-888d-4eb2-aa7d-26fdc46fa8f4 req-ff106f53-d102-43b7-9d01-7155452d2dbd service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:32.210466 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-3805ac55-888d-4eb2-aa7d-26fdc46fa8f4 req-ff106f53-d102-43b7-9d01-7155452d2dbd service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:32.210897 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-3805ac55-888d-4eb2-aa7d-26fdc46fa8f4 req-ff106f53-d102-43b7-9d01-7155452d2dbd service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:32.252250 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-3805ac55-888d-4eb2-aa7d-26fdc46fa8f4 req-ff106f53-d102-43b7-9d01-7155452d2dbd service nova] Creating event network-vif-unplugged:17d8bcdf-2e72-4ea0-a129-6fda20d5053a for instance 63955de3-b0fa-4f96-a2db-26ae995db228 on nch2-master-1 Sep 17 20:51:32.287084 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [req-3805ac55-888d-4eb2-aa7d-26fdc46fa8f4 req-ff106f53-d102-43b7-9d01-7155452d2dbd service nova] Instance 63955de3-b0fa-4f96-a2db-26ae995db228 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140523) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 20:51:32.323085 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-3805ac55-888d-4eb2-aa7d-26fdc46fa8f4 req-ff106f53-d102-43b7-9d01-7155452d2dbd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.163549 Sep 17 20:51:32.324080 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 175/415] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:33.184150 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1bd37f95-d17d-4ffa-9799-0f03d5e05d98 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:33.185033 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1bd37f95-d17d-4ffa-9799-0f03d5e05d98 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:33.206008 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1bd37f95-d17d-4ffa-9799-0f03d5e05d98 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:33.208156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1bd37f95-d17d-4ffa-9799-0f03d5e05d98 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:33.209669 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1bd37f95-d17d-4ffa-9799-0f03d5e05d98 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:33.213293 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1bd37f95-d17d-4ffa-9799-0f03d5e05d98 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:33.214430 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1bd37f95-d17d-4ffa-9799-0f03d5e05d98 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:33.218188 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1bd37f95-d17d-4ffa-9799-0f03d5e05d98 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:33.667987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1bd37f95-d17d-4ffa-9799-0f03d5e05d98 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:33.680637 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1bd37f95-d17d-4ffa-9799-0f03d5e05d98 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1474 microversion: 2.1 time: 0.500799 Sep 17 20:51:33.682055 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 176/416] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:33 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1474 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:34.519099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-989f2283-d8dc-46be-af07-71a5663a84d7 req-62866841-2e28-42d9-a170-abe9da729708 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63955de3-b0fa-4f96-a2db-26ae995db228", "tag": "17d8bcdf-2e72-4ea0-a129-6fda20d5053a"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:34.543274 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-989f2283-d8dc-46be-af07-71a5663a84d7 req-62866841-2e28-42d9-a170-abe9da729708 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:34.546761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-989f2283-d8dc-46be-af07-71a5663a84d7 req-62866841-2e28-42d9-a170-abe9da729708 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:34.547514 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-989f2283-d8dc-46be-af07-71a5663a84d7 req-62866841-2e28-42d9-a170-abe9da729708 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:34.583159 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-989f2283-d8dc-46be-af07-71a5663a84d7 req-62866841-2e28-42d9-a170-abe9da729708 service nova] Creating event network-changed:17d8bcdf-2e72-4ea0-a129-6fda20d5053a for instance 63955de3-b0fa-4f96-a2db-26ae995db228 on nch2-master-1 Sep 17 20:51:34.602606 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [req-989f2283-d8dc-46be-af07-71a5663a84d7 req-62866841-2e28-42d9-a170-abe9da729708 service nova] Instance 63955de3-b0fa-4f96-a2db-26ae995db228 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140523) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 20:51:34.629227 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-989f2283-d8dc-46be-af07-71a5663a84d7 req-62866841-2e28-42d9-a170-abe9da729708 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115048 Sep 17 20:51:34.636961 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 177/417] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:34.696280 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9e906618-26f3-4a75-a747-ef566fbfcd7e tempest-FloatingIPsTestJSON-1970796804 tempest-FloatingIPsTestJSON-1970796804-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.420096 Sep 17 20:51:34.697844 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 241/418] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Sep 17 20:51:30 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:34.708244 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-14b178ba-0d0c-4458-949c-ec1930e32307 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:34.709234 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-14b178ba-0d0c-4458-949c-ec1930e32307 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:34.712918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c5af01e5-48f8-404c-91ad-31e2ded6db8d tempest-FloatingIPsTestJSON-1970796804 tempest-FloatingIPsTestJSON-1970796804-project] Calling method '.version_select at 0x7f25a5b8bdc0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:34.723445 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-14b178ba-0d0c-4458-949c-ec1930e32307 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:34.723956 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-14b178ba-0d0c-4458-949c-ec1930e32307 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:34.724409 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-14b178ba-0d0c-4458-949c-ec1930e32307 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:34.725130 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-14b178ba-0d0c-4458-949c-ec1930e32307 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:34.737443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-14b178ba-0d0c-4458-949c-ec1930e32307 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:34.737443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-14b178ba-0d0c-4458-949c-ec1930e32307 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:35.439078 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c5af01e5-48f8-404c-91ad-31e2ded6db8d tempest-FloatingIPsTestJSON-1970796804 tempest-FloatingIPsTestJSON-1970796804-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips/2339788f-8d45-43fe-905b-d34caeaa932d" status: 200 len: 142 microversion: 2.1 time: 0.732779 Sep 17 20:51:35.445923 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 242/419] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Sep 17 20:51:34 2022] GET /compute/v2.1/os-floating-ips/2339788f-8d45-43fe-905b-d34caeaa932d => generated 142 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:35.459538 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0b685e4d-5783-4787-a0b9-3c580c398d99 tempest-FloatingIPsTestJSON-1970796804 tempest-FloatingIPsTestJSON-1970796804-project] Calling method '.version_select at 0x7f25a5bd4940>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:35.626020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-14b178ba-0d0c-4458-949c-ec1930e32307 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:35.641281 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-14b178ba-0d0c-4458-949c-ec1930e32307 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1472 microversion: 2.1 time: 0.937887 Sep 17 20:51:35.657133 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 178/420] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:34 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1472 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:36.359422 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0b685e4d-5783-4787-a0b9-3c580c398d99 tempest-FloatingIPsTestJSON-1970796804 tempest-FloatingIPsTestJSON-1970796804-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.903687 Sep 17 20:51:36.360087 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 243/421] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Sep 17 20:51:35 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:36.381360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-389fd8c7-35af-4f16-b8b5-0257c01b559c tempest-FloatingIPsTestJSON-1970796804 tempest-FloatingIPsTestJSON-1970796804-project] Calling method '.version_select at 0x7f25a5bcd670>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:36.670989 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4a83411b-5dbc-499e-a6fc-071271c19b4e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:36.671601 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4a83411b-5dbc-499e-a6fc-071271c19b4e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:36.690136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a83411b-5dbc-499e-a6fc-071271c19b4e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:36.690593 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a83411b-5dbc-499e-a6fc-071271c19b4e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:36.691036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a83411b-5dbc-499e-a6fc-071271c19b4e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:36.691770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a83411b-5dbc-499e-a6fc-071271c19b4e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:36.692224 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a83411b-5dbc-499e-a6fc-071271c19b4e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:36.692646 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a83411b-5dbc-499e-a6fc-071271c19b4e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:37.486161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4a83411b-5dbc-499e-a6fc-071271c19b4e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:37.497964 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4a83411b-5dbc-499e-a6fc-071271c19b4e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1469 microversion: 2.1 time: 0.831987 Sep 17 20:51:37.500999 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 244/422] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:36 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1469 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:38.203727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0f2883c8-758b-4b27-a03a-223250c91991 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-218040151", "ram": 512, "vcpus": 1, "disk": 10, "id": 543145230, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:38.243544 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0f2883c8-758b-4b27-a03a-223250c91991 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.740464 Sep 17 20:51:38.244934 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 245/423] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:51:37 2022] POST /compute/v2.1/flavors => generated 412 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:38.250976 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8e0bda21-0093-4d51-8d98-bd9eb91524cc tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:38.253105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8e0bda21-0093-4d51-8d98-bd9eb91524cc tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:38.265106 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e0bda21-0093-4d51-8d98-bd9eb91524cc tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:38.266735 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e0bda21-0093-4d51-8d98-bd9eb91524cc tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:38.268632 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e0bda21-0093-4d51-8d98-bd9eb91524cc tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:38.270978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e0bda21-0093-4d51-8d98-bd9eb91524cc tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:38.274076 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e0bda21-0093-4d51-8d98-bd9eb91524cc tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:38.274950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e0bda21-0093-4d51-8d98-bd9eb91524cc tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:38.473945 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8e0bda21-0093-4d51-8d98-bd9eb91524cc tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "POST /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228/action" status: 204 len: 0 microversion: 2.1 time: 0.226548 Sep 17 20:51:38.479302 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 246/424] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:51:38 2022] POST /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228/action => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:51:38.561627 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=10 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:51:39.003438 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-71b1f96a-50d3-45d8-851d-abaaae999f0a tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254 tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:39.017191 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-71b1f96a-50d3-45d8-851d-abaaae999f0a tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254 tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254-project] HTTP exception thrown: Flavor 543145230 has no extra specs with key hw:cpu_thread_policy. Sep 17 20:51:39.023057 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-71b1f96a-50d3-45d8-851d-abaaae999f0a tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254 tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254-project] Request method failure captured: Sep 17 20:51:39.023057 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/flavors/543145230/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 17 20:51:39.023057 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:51:39.023057 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:51:39.023057 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:51:39.023057 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:51:39.023057 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:51:39.023057 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:51:39.023057 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:51:39.023057 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:39.023057 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjNXhEFeTPxWPFf8f2_eV1ICOq-vweGWDTZQo7QPWRzTMIQrk6ryv8XVxy3mHRcN2M5ayt2hhjiQwpB9TaGdVnl14N-DWmNLm0075Vnf1CtuRSRSJOQ2Lk44oJtq6Ky4Tp9lV4QysqHSuWjPO1RDO40UYZ1sUa_rlkuKJfsc5cgcYo8 Sep 17 20:51:39.023057 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:51:39.023057 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:51:39.023057 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:51:39.023057 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:51:39.023057 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:51:39.023057 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:51:39.023057 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: fb724c88a4d841489ed1a5c9364025a0 Sep 17 20:51:39.023057 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254 Sep 17 20:51:39.023057 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:51:39.023057 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:51:39.024468 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb724c88a4d841489ed1a5c9364025a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fb724c88a4d841489ed1a5c9364025a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb724c88a4d841489ed1a5c9364025a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fb724c88a4d841489ed1a5c9364025a0", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:39.024468 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254 Sep 17 20:51:39.024468 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: fb724c88a4d841489ed1a5c9364025a0 Sep 17 20:51:39.024468 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254 Sep 17 20:51:39.024468 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254-project Sep 17 20:51:39.024468 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:51:39.024468 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:51:39.024468 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 3d90b14b5f5948b0a915dfd56b41af29 Sep 17 20:51:39.024468 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254-project Sep 17 20:51:39.024468 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:51:39.024468 ncdv-master-1 devstack@n-api.service[140524]: exception: Flavor 543145230 has no extra specs with key hw:cpu_thread_policy. Sep 17 20:51:39.025113 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'flavor_id': '543145230', 'id': 'hw:cpu_thread_policy'} Sep 17 20:51:39.025113 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:39.025113 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:39.025113 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Sep 17 20:51:39.025113 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Sep 17 20:51:39.025113 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 17 20:51:39.025113 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:39.025113 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:39.025113 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:39.025113 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:39.025113 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:39.025113 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:39.025113 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:39.025113 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:39.025113 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:39.025113 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:39.025113 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Sep 17 20:51:39.025113 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 17 20:51:39.025113 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 543145230 has no extra specs with key hw:cpu_thread_policy. Sep 17 20:51:39.025113 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:39.025113 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:39.025113 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:39.026415 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:39.026415 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:39.026415 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:39.026415 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:39.026415 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:39.026415 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 543145230 has no extra specs with key hw:cpu_thread_policy. Sep 17 20:51:39.026415 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:39.026415 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-71b1f96a-50d3-45d8-851d-abaaae999f0a tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254 tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254-project] Returning 404 to user: Flavor 543145230 has no extra specs with key hw:cpu_thread_policy. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:39.027459 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-71b1f96a-50d3-45d8-851d-abaaae999f0a tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254 tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254-project] 10.222.0.26 "GET /compute/v2.1/flavors/543145230/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.546753 Sep 17 20:51:39.029700 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 247/425] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Sep 17 20:51:38 2022] GET /compute/v2.1/flavors/543145230/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 550 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:39.043728 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=45 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:51:39.045822 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-270e933b-40d0-4c7e-8e5c-f7b8c97ad4d4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:39.047634 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-270e933b-40d0-4c7e-8e5c-f7b8c97ad4d4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:39.068516 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-270e933b-40d0-4c7e-8e5c-f7b8c97ad4d4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:39.070025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-270e933b-40d0-4c7e-8e5c-f7b8c97ad4d4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:39.072029 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-270e933b-40d0-4c7e-8e5c-f7b8c97ad4d4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:39.072964 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-270e933b-40d0-4c7e-8e5c-f7b8c97ad4d4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:39.075793 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-270e933b-40d0-4c7e-8e5c-f7b8c97ad4d4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:39.080034 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-270e933b-40d0-4c7e-8e5c-f7b8c97ad4d4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:39.171453 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-389fd8c7-35af-4f16-b8b5-0257c01b559c tempest-FloatingIPsTestJSON-1970796804 tempest-FloatingIPsTestJSON-1970796804-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/2339788f-8d45-43fe-905b-d34caeaa932d" status: 202 len: 0 microversion: 2.1 time: 2.795527 Sep 17 20:51:39.172449 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 179/426] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Sep 17 20:51:36 2022] DELETE /compute/v2.1/os-floating-ips/2339788f-8d45-43fe-905b-d34caeaa932d => generated 0 bytes in 2798 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:51:39.179535 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8ab0c734-c9c4-4e4e-8cdb-3c4cdef307dc tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254 tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:39.187844 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8ab0c734-c9c4-4e4e-8cdb-3c4cdef307dc tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254 tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '3d90b14b5f5948b0a915dfd56b41af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb724c88a4d841489ed1a5c9364025a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:39.195859 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8ab0c734-c9c4-4e4e-8cdb-3c4cdef307dc tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254 tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254-project] Request method failure captured: Sep 17 20:51:39.195859 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/flavors/543145230/os-extra_specs HTTP/1.1 Sep 17 20:51:39.195859 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:51:39.195859 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:51:39.195859 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:51:39.195859 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 66 Sep 17 20:51:39.195859 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:51:39.195859 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:51:39.195859 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:51:39.195859 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:39.195859 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjNXhEFeTPxWPFf8f2_eV1ICOq-vweGWDTZQo7QPWRzTMIQrk6ryv8XVxy3mHRcN2M5ayt2hhjiQwpB9TaGdVnl14N-DWmNLm0075Vnf1CtuRSRSJOQ2Lk44oJtq6Ky4Tp9lV4QysqHSuWjPO1RDO40UYZ1sUa_rlkuKJfsc5cgcYo8 Sep 17 20:51:39.195859 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:51:39.195859 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:51:39.195859 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:51:39.195859 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:51:39.195859 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:51:39.195859 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:51:39.195859 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: fb724c88a4d841489ed1a5c9364025a0 Sep 17 20:51:39.195859 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254 Sep 17 20:51:39.195859 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:51:39.195859 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:51:39.197034 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb724c88a4d841489ed1a5c9364025a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fb724c88a4d841489ed1a5c9364025a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb724c88a4d841489ed1a5c9364025a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fb724c88a4d841489ed1a5c9364025a0", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:39.197034 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254 Sep 17 20:51:39.197034 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: fb724c88a4d841489ed1a5c9364025a0 Sep 17 20:51:39.197034 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254 Sep 17 20:51:39.197034 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254-project Sep 17 20:51:39.197034 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:51:39.197034 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:51:39.197034 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 3d90b14b5f5948b0a915dfd56b41af29 Sep 17 20:51:39.197034 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254-project Sep 17 20:51:39.197034 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 20:51:39.197034 ncdv-master-1 devstack@n-api.service[140523]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Sep 17 20:51:39.197034 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:51:39.198075 ncdv-master-1 devstack@n-api.service[140523]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 17 20:51:39.198075 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'flavor_id': '543145230', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Sep 17 20:51:39.198075 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:39.198075 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:39.198075 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:39.198075 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:39.198075 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:39.198075 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:39.198075 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:39.198075 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:39.198075 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:51:39.198075 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:51:39.198075 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Sep 17 20:51:39.198075 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Sep 17 20:51:39.198075 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 17 20:51:39.198075 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 17 20:51:39.198075 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 17 20:51:39.198075 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 17 20:51:39.198075 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:51:39.199244 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:51:39.199244 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:51:39.199244 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:51:39.199244 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 17 20:51:39.199244 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 17 20:51:39.199244 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 17 20:51:39.199244 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 17 20:51:39.199244 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 17 20:51:39.199244 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 17 20:51:39.199244 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 17 20:51:39.199244 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:39.199244 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:39.199244 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:39.199244 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:39.199244 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:39.199244 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:39.199244 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 17 20:51:39.199244 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 17 20:51:39.199244 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 17 20:51:39.199244 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:39.201840 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8ab0c734-c9c4-4e4e-8cdb-3c4cdef307dc tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254 tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:39.202939 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8ab0c734-c9c4-4e4e-8cdb-3c4cdef307dc tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254 tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254-project] 10.222.0.26 "POST /compute/v2.1/flavors/543145230/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.029481 Sep 17 20:51:39.204256 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 180/427] 10.222.0.26 () {60 vars in 1221 bytes} [Sat Sep 17 20:51:39 2022] POST /compute/v2.1/flavors/543145230/os-extra_specs => generated 124 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:39.221749 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bf08e2dc-1ea3-4d23-bd31-b46234ed9f3d tempest-FloatingIPsTestJSON-1970796804 tempest-FloatingIPsTestJSON-1970796804-project] Action: 'create', calling method: .version_select at 0x7f25a5bef550>, body: {"pool": null} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:39.542892 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-270e933b-40d0-4c7e-8e5c-f7b8c97ad4d4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:39.556187 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-270e933b-40d0-4c7e-8e5c-f7b8c97ad4d4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1469 microversion: 2.1 time: 0.521731 Sep 17 20:51:39.559980 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 248/428] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:39 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1469 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:39.569631 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8d99e793-540f-4b3e-b4f5-0c62df55d6c6 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:39.630222 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8d99e793-540f-4b3e-b4f5-0c62df55d6c6 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/543145230/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.068687 Sep 17 20:51:39.636989 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 249/429] 10.222.0.26 () {60 vars in 1221 bytes} [Sat Sep 17 20:51:39 2022] POST /compute/v2.1/flavors/543145230/os-extra_specs => generated 66 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:51:39.644139 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-268303c6-af10-49a9-a576-41769073f7d9 tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254 tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:39.646189 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-268303c6-af10-49a9-a576-41769073f7d9 tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254 tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '3d90b14b5f5948b0a915dfd56b41af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb724c88a4d841489ed1a5c9364025a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:39.648470 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-268303c6-af10-49a9-a576-41769073f7d9 tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254 tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254-project] Request method failure captured: Sep 17 20:51:39.648470 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/flavors/543145230/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 17 20:51:39.648470 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:51:39.648470 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:51:39.648470 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:51:39.648470 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:51:39.648470 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:51:39.648470 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:51:39.648470 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:51:39.648470 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:39.648470 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjNXhEFeTPxWPFf8f2_eV1ICOq-vweGWDTZQo7QPWRzTMIQrk6ryv8XVxy3mHRcN2M5ayt2hhjiQwpB9TaGdVnl14N-DWmNLm0075Vnf1CtuRSRSJOQ2Lk44oJtq6Ky4Tp9lV4QysqHSuWjPO1RDO40UYZ1sUa_rlkuKJfsc5cgcYo8 Sep 17 20:51:39.648470 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:51:39.648470 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:51:39.648470 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:51:39.648470 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:51:39.648470 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:51:39.648470 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:51:39.648470 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: fb724c88a4d841489ed1a5c9364025a0 Sep 17 20:51:39.648470 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254 Sep 17 20:51:39.648470 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:51:39.648470 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:51:39.650225 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb724c88a4d841489ed1a5c9364025a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fb724c88a4d841489ed1a5c9364025a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb724c88a4d841489ed1a5c9364025a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fb724c88a4d841489ed1a5c9364025a0", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:39.650225 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254 Sep 17 20:51:39.650225 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: fb724c88a4d841489ed1a5c9364025a0 Sep 17 20:51:39.650225 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254 Sep 17 20:51:39.650225 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254-project Sep 17 20:51:39.650225 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:51:39.650225 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:51:39.650225 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 3d90b14b5f5948b0a915dfd56b41af29 Sep 17 20:51:39.650225 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254-project Sep 17 20:51:39.650225 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:51:39.650225 ncdv-master-1 devstack@n-api.service[140524]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 17 20:51:39.650969 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'flavor_id': '543145230', 'id': 'hw:numa_nodes'} Sep 17 20:51:39.650969 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:39.650969 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:39.650969 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:39.650969 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:39.650969 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:39.650969 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:39.650969 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:39.650969 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:39.650969 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Sep 17 20:51:39.650969 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Sep 17 20:51:39.650969 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 17 20:51:39.650969 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 17 20:51:39.650969 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 17 20:51:39.650969 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 17 20:51:39.650969 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:51:39.650969 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:51:39.650969 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:51:39.650969 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:51:39.650969 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 17 20:51:39.652526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 17 20:51:39.652526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 17 20:51:39.652526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 17 20:51:39.652526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 17 20:51:39.652526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 17 20:51:39.652526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 17 20:51:39.652526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:39.652526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:39.652526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:39.652526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:39.652526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:39.652526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:39.652526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 17 20:51:39.652526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 17 20:51:39.652526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 17 20:51:39.652526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:39.655792 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-268303c6-af10-49a9-a576-41769073f7d9 tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254 tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:39.657100 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-268303c6-af10-49a9-a576-41769073f7d9 tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254 tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254-project] 10.222.0.26 "DELETE /compute/v2.1/flavors/543145230/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.018479 Sep 17 20:51:39.663170 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 250/430] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Sep 17 20:51:39 2022] DELETE /compute/v2.1/flavors/543145230/os-extra_specs/hw:numa_nodes => generated 124 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:39.665399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=16 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:51:39.683178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ce7c1166-e9cb-42b4-bc30-107bbaa51179 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:39.715496 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ce7c1166-e9cb-42b4-bc30-107bbaa51179 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/543145230/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.049962 Sep 17 20:51:39.722174 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 251/431] 10.222.0.26 () {60 vars in 1221 bytes} [Sat Sep 17 20:51:39 2022] POST /compute/v2.1/flavors/543145230/os-extra_specs => generated 66 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:51:39.728182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6ac40fab-b803-4fbc-8957-f3fd76f65f4d tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254 tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:39.731716 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6ac40fab-b803-4fbc-8957-f3fd76f65f4d tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254 tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '3d90b14b5f5948b0a915dfd56b41af29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb724c88a4d841489ed1a5c9364025a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:39.733662 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6ac40fab-b803-4fbc-8957-f3fd76f65f4d tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254 tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254-project] Request method failure captured: Sep 17 20:51:39.733662 ncdv-master-1 devstack@n-api.service[140524]: request: PUT /compute/v2.1/flavors/543145230/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 17 20:51:39.733662 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:51:39.733662 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:51:39.733662 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:51:39.733662 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 22 Sep 17 20:51:39.733662 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:51:39.733662 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:51:39.733662 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:51:39.733662 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:39.733662 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjNXhEFeTPxWPFf8f2_eV1ICOq-vweGWDTZQo7QPWRzTMIQrk6ryv8XVxy3mHRcN2M5ayt2hhjiQwpB9TaGdVnl14N-DWmNLm0075Vnf1CtuRSRSJOQ2Lk44oJtq6Ky4Tp9lV4QysqHSuWjPO1RDO40UYZ1sUa_rlkuKJfsc5cgcYo8 Sep 17 20:51:39.733662 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:51:39.733662 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:51:39.733662 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:51:39.733662 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:51:39.733662 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:51:39.733662 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:51:39.733662 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: fb724c88a4d841489ed1a5c9364025a0 Sep 17 20:51:39.733662 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254 Sep 17 20:51:39.733662 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:51:39.733662 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:51:39.735020 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb724c88a4d841489ed1a5c9364025a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fb724c88a4d841489ed1a5c9364025a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb724c88a4d841489ed1a5c9364025a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fb724c88a4d841489ed1a5c9364025a0", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:39.735020 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254 Sep 17 20:51:39.735020 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: fb724c88a4d841489ed1a5c9364025a0 Sep 17 20:51:39.735020 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254 Sep 17 20:51:39.735020 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254-project Sep 17 20:51:39.735020 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:51:39.735020 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:51:39.735020 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 3d90b14b5f5948b0a915dfd56b41af29 Sep 17 20:51:39.735020 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254-project Sep 17 20:51:39.735020 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:51:39.735020 ncdv-master-1 devstack@n-api.service[140524]: {"hw:numa_nodes": "1"} Sep 17 20:51:39.735020 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:51:39.735020 ncdv-master-1 devstack@n-api.service[140524]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 17 20:51:39.735920 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'flavor_id': '543145230', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Sep 17 20:51:39.735920 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:39.735920 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:39.735920 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:39.735920 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:39.735920 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:39.735920 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:39.735920 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:39.735920 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:39.735920 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:51:39.735920 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:51:39.735920 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Sep 17 20:51:39.735920 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Sep 17 20:51:39.735920 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 17 20:51:39.735920 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 17 20:51:39.735920 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 17 20:51:39.735920 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 17 20:51:39.735920 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:51:39.735920 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:51:39.737192 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:51:39.737192 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:51:39.737192 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 17 20:51:39.737192 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 17 20:51:39.737192 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 17 20:51:39.737192 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 17 20:51:39.737192 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 17 20:51:39.737192 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 17 20:51:39.737192 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 17 20:51:39.737192 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:39.737192 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:39.737192 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:39.737192 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:39.737192 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:39.737192 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:39.737192 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 17 20:51:39.737192 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 17 20:51:39.737192 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 17 20:51:39.737192 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:39.739666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6ac40fab-b803-4fbc-8957-f3fd76f65f4d tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254 tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:39.740539 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6ac40fab-b803-4fbc-8957-f3fd76f65f4d tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254 tempest-FlavorsExtraSpecsNegativeTestJSON-1441823254-project] 10.222.0.26 "PUT /compute/v2.1/flavors/543145230/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.017186 Sep 17 20:51:39.741123 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 252/432] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Sep 17 20:51:39 2022] PUT /compute/v2.1/flavors/543145230/os-extra_specs/hw:numa_nodes => generated 124 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:39.750864 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7646a202-5781-4c0a-ad95-c256e49862c5 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:39.760709 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-7646a202-5781-4c0a-ad95-c256e49862c5 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802-project-admin] HTTP exception thrown: Flavor 543145230 has no extra specs with key hw:cpu_thread_policy. Sep 17 20:51:39.762886 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7646a202-5781-4c0a-ad95-c256e49862c5 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802-project-admin] Request method failure captured: Sep 17 20:51:39.762886 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/flavors/543145230/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 17 20:51:39.762886 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:51:39.762886 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:51:39.762886 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:51:39.762886 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:51:39.762886 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:51:39.762886 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:51:39.762886 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:51:39.762886 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:39.762886 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjNYQOB5WOQOrtrCOZjd4TmTJ8-Pv2-4x1uMcrVwS7v_Qpn-YQND7Q5Jqzp9zH7WrRq6sEV028FYm_mKjOFQ14UgzrhwX6hI3g638rVNi5S0Fp-hgLNXy3Bomv7Z7Js7pK9xxZzdTplNuZYGpPZEn7RJL5cQl43RGXSIKA5ozPGA6ZY Sep 17 20:51:39.762886 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:51:39.762886 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:51:39.762886 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:51:39.762886 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:51:39.762886 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:51:39.762886 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:51:39.762886 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 0cebe9dbf7d049799b007300b7c1ce41 Sep 17 20:51:39.762886 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802 Sep 17 20:51:39.762886 ncdv-master-1 devstack@n-api.service[140524]: X-Role: admin,member,reader Sep 17 20:51:39.762886 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: admin,member,reader Sep 17 20:51:39.764118 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0cebe9dbf7d049799b007300b7c1ce41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0cebe9dbf7d049799b007300b7c1ce41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0cebe9dbf7d049799b007300b7c1ce41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0cebe9dbf7d049799b007300b7c1ce41", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:39.764118 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802 Sep 17 20:51:39.764118 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 0cebe9dbf7d049799b007300b7c1ce41 Sep 17 20:51:39.764118 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802 Sep 17 20:51:39.764118 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802-project-admin Sep 17 20:51:39.764118 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:51:39.764118 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:51:39.764118 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 0cda1f7458294fcd8087ff7c65edbd6a Sep 17 20:51:39.764118 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802-project-admin Sep 17 20:51:39.764118 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:51:39.764118 ncdv-master-1 devstack@n-api.service[140524]: exception: Flavor 543145230 has no extra specs with key hw:cpu_thread_policy. Sep 17 20:51:39.764833 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'flavor_id': '543145230', 'id': 'hw:cpu_thread_policy'} Sep 17 20:51:39.764833 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:39.764833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:39.764833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Sep 17 20:51:39.764833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Sep 17 20:51:39.764833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 17 20:51:39.764833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:39.764833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:39.764833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:39.764833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:39.764833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:39.764833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:39.764833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:39.764833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:39.764833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:39.764833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:39.764833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Sep 17 20:51:39.764833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 17 20:51:39.764833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 543145230 has no extra specs with key hw:cpu_thread_policy. Sep 17 20:51:39.764833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:39.764833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:39.764833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:39.766108 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:39.766108 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:39.766108 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:39.766108 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:39.766108 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:39.766108 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 543145230 has no extra specs with key hw:cpu_thread_policy. Sep 17 20:51:39.766108 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:39.768086 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7646a202-5781-4c0a-ad95-c256e49862c5 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802-project-admin] Returning 404 to user: Flavor 543145230 has no extra specs with key hw:cpu_thread_policy. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:39.769199 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7646a202-5781-4c0a-ad95-c256e49862c5 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/543145230/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.022339 Sep 17 20:51:39.772906 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 253/433] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Sep 17 20:51:39 2022] DELETE /compute/v2.1/flavors/543145230/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:39.798239 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7eb1a5e7-4ba5-4501-bfbd-042f141fced3 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:39.804470 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-7eb1a5e7-4ba5-4501-bfbd-042f141fced3 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802-project-admin] HTTP exception thrown: Request body and URI mismatch Sep 17 20:51:39.810095 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7eb1a5e7-4ba5-4501-bfbd-042f141fced3 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802-project-admin] Request method failure captured: Sep 17 20:51:39.810095 ncdv-master-1 devstack@n-api.service[140524]: request: PUT /compute/v2.1/flavors/543145230/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 17 20:51:39.810095 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:51:39.810095 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:51:39.810095 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:51:39.810095 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 27 Sep 17 20:51:39.810095 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:51:39.810095 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:51:39.810095 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:51:39.810095 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:39.810095 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjNYQOB5WOQOrtrCOZjd4TmTJ8-Pv2-4x1uMcrVwS7v_Qpn-YQND7Q5Jqzp9zH7WrRq6sEV028FYm_mKjOFQ14UgzrhwX6hI3g638rVNi5S0Fp-hgLNXy3Bomv7Z7Js7pK9xxZzdTplNuZYGpPZEn7RJL5cQl43RGXSIKA5ozPGA6ZY Sep 17 20:51:39.810095 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:51:39.810095 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:51:39.810095 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:51:39.810095 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:51:39.810095 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:51:39.810095 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:51:39.810095 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 0cebe9dbf7d049799b007300b7c1ce41 Sep 17 20:51:39.810095 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802 Sep 17 20:51:39.810095 ncdv-master-1 devstack@n-api.service[140524]: X-Role: admin,member,reader Sep 17 20:51:39.810095 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: admin,member,reader Sep 17 20:51:39.811309 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0cebe9dbf7d049799b007300b7c1ce41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0cebe9dbf7d049799b007300b7c1ce41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0cebe9dbf7d049799b007300b7c1ce41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0cebe9dbf7d049799b007300b7c1ce41", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:39.811309 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802 Sep 17 20:51:39.811309 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 0cebe9dbf7d049799b007300b7c1ce41 Sep 17 20:51:39.811309 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802 Sep 17 20:51:39.811309 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802-project-admin Sep 17 20:51:39.811309 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:51:39.811309 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:51:39.811309 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 0cda1f7458294fcd8087ff7c65edbd6a Sep 17 20:51:39.811309 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802-project-admin Sep 17 20:51:39.811309 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:51:39.811309 ncdv-master-1 devstack@n-api.service[140524]: {"hw:cpu_policy": "shared"} Sep 17 20:51:39.811309 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:51:39.811309 ncdv-master-1 devstack@n-api.service[140524]: exception: Request body and URI mismatch Sep 17 20:51:39.812161 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'flavor_id': '543145230', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Sep 17 20:51:39.812161 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:39.812161 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:39.812161 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:39.812161 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:39.812161 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:39.812161 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:39.812161 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:39.812161 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:39.812161 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:51:39.812161 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:51:39.812161 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Sep 17 20:51:39.812161 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Sep 17 20:51:39.812161 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Sep 17 20:51:39.812161 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:39.812161 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:39.812161 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:39.812161 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:39.812161 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:39.812161 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:39.813294 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:39.813294 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:39.813294 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Sep 17 20:51:39.813294 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:39.815070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7eb1a5e7-4ba5-4501-bfbd-042f141fced3 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:39.816013 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7eb1a5e7-4ba5-4501-bfbd-042f141fced3 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802-project-admin] 10.222.0.26 "PUT /compute/v2.1/flavors/543145230/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.031964 Sep 17 20:51:39.819642 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 254/434] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Sep 17 20:51:39 2022] PUT /compute/v2.1/flavors/543145230/os-extra_specs/hw:numa_nodes => generated 73 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 17 20:51:39.834208 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d5c4c0c0-c262-4326-8dbd-b6a9ab619058 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:39.838866 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d5c4c0c0-c262-4326-8dbd-b6a9ab619058 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802-project-admin] Request method failure captured: Sep 17 20:51:39.838866 ncdv-master-1 devstack@n-api.service[140524]: request: PUT /compute/v2.1/flavors/543145230/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 17 20:51:39.838866 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:51:39.838866 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:51:39.838866 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:51:39.838866 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 49 Sep 17 20:51:39.838866 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:51:39.838866 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:51:39.838866 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:51:39.838866 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:39.838866 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjNYQOB5WOQOrtrCOZjd4TmTJ8-Pv2-4x1uMcrVwS7v_Qpn-YQND7Q5Jqzp9zH7WrRq6sEV028FYm_mKjOFQ14UgzrhwX6hI3g638rVNi5S0Fp-hgLNXy3Bomv7Z7Js7pK9xxZzdTplNuZYGpPZEn7RJL5cQl43RGXSIKA5ozPGA6ZY Sep 17 20:51:39.838866 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:51:39.838866 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:51:39.838866 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:51:39.838866 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:51:39.838866 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:51:39.838866 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:51:39.838866 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 0cebe9dbf7d049799b007300b7c1ce41 Sep 17 20:51:39.838866 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802 Sep 17 20:51:39.838866 ncdv-master-1 devstack@n-api.service[140524]: X-Role: admin,member,reader Sep 17 20:51:39.838866 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: admin,member,reader Sep 17 20:51:39.840257 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0cebe9dbf7d049799b007300b7c1ce41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0cebe9dbf7d049799b007300b7c1ce41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0cebe9dbf7d049799b007300b7c1ce41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0cebe9dbf7d049799b007300b7c1ce41", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:39.840257 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802 Sep 17 20:51:39.840257 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 0cebe9dbf7d049799b007300b7c1ce41 Sep 17 20:51:39.840257 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802 Sep 17 20:51:39.840257 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802-project-admin Sep 17 20:51:39.840257 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:51:39.840257 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:51:39.840257 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 0cda1f7458294fcd8087ff7c65edbd6a Sep 17 20:51:39.840257 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802-project-admin Sep 17 20:51:39.840257 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:51:39.840257 ncdv-master-1 devstack@n-api.service[140524]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Sep 17 20:51:39.840257 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:51:39.840918 ncdv-master-1 devstack@n-api.service[140524]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 17 20:51:39.840918 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'flavor_id': '543145230', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Sep 17 20:51:39.840918 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:39.840918 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:39.840918 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 20:51:39.840918 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 20:51:39.840918 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 20:51:39.840918 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise error Sep 17 20:51:39.840918 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 17 20:51:39.840918 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:39.840918 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Sep 17 20:51:39.840918 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 17 20:51:39.840918 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Sep 17 20:51:39.840918 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Sep 17 20:51:39.840918 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 17 20:51:39.840918 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'type': ['string', Sep 17 20:51:39.840918 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'number']}}, Sep 17 20:51:39.840918 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 17 20:51:39.840918 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:39.840918 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi On instance: Sep 17 20:51:39.840918 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Sep 17 20:51:39.840918 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:39.842197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:39.842197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:39.842197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:39.842197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:39.842197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:39.842197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:39.842197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:39.842197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:39.842197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:39.842197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 20:51:39.842197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 20:51:39.842197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 20:51:39.842197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 20:51:39.842197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 20:51:39.842197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 20:51:39.842197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 17 20:51:39.842197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:39.842197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:39.842197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:39.842197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:39.843291 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:39.843291 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:39.843291 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 20:51:39.843291 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 20:51:39.843291 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 17 20:51:39.843291 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:39.855831 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d5c4c0c0-c262-4326-8dbd-b6a9ab619058 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:39.857018 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d5c4c0c0-c262-4326-8dbd-b6a9ab619058 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802-project-admin] 10.222.0.26 "PUT /compute/v2.1/flavors/543145230/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.030885 Sep 17 20:51:39.858206 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 255/435] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Sep 17 20:51:39 2022] PUT /compute/v2.1/flavors/543145230/os-extra_specs/hw:numa_nodes => generated 117 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 20:51:39.868346 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7cc44985-dec5-4c58-a30d-fa90f4dc641d tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:39.905117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=17,nova_api:UPDATE=14,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:51:39.916710 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7cc44985-dec5-4c58-a30d-fa90f4dc641d tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/543145230" status: 202 len: 0 microversion: 2.1 time: 0.053430 Sep 17 20:51:39.918381 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 256/436] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Sep 17 20:51:39 2022] DELETE /compute/v2.1/flavors/543145230 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:51:39.926970 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fc9eb1dc-4b7e-491b-81de-4bfecb8a9df5 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:39.975722 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fc9eb1dc-4b7e-491b-81de-4bfecb8a9df5 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802 tempest-FlavorsExtraSpecsNegativeTestJSON-1524748802-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052330 Sep 17 20:51:39.978804 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 257/437] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:51:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:51:40.584199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6299f271-3c64-4f46-9cd8-51503fbf3f22 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:40.586000 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6299f271-3c64-4f46-9cd8-51503fbf3f22 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:40.596094 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=60 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:51:40.617307 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6299f271-3c64-4f46-9cd8-51503fbf3f22 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:40.617981 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6299f271-3c64-4f46-9cd8-51503fbf3f22 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:40.620890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6299f271-3c64-4f46-9cd8-51503fbf3f22 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:40.621703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6299f271-3c64-4f46-9cd8-51503fbf3f22 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:40.625321 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6299f271-3c64-4f46-9cd8-51503fbf3f22 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:40.628677 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6299f271-3c64-4f46-9cd8-51503fbf3f22 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:40.649330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:51:41.207196 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6299f271-3c64-4f46-9cd8-51503fbf3f22 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:41.222464 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6299f271-3c64-4f46-9cd8-51503fbf3f22 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1469 microversion: 2.1 time: 0.643042 Sep 17 20:51:41.223213 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 258/438] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:40 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1469 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:42.254425 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-31ec2659-c2d1-4e60-abde-b3052f381097 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:42.255052 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-31ec2659-c2d1-4e60-abde-b3052f381097 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:42.264746 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31ec2659-c2d1-4e60-abde-b3052f381097 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:42.274346 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31ec2659-c2d1-4e60-abde-b3052f381097 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:42.276741 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31ec2659-c2d1-4e60-abde-b3052f381097 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:42.277771 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31ec2659-c2d1-4e60-abde-b3052f381097 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:42.279887 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31ec2659-c2d1-4e60-abde-b3052f381097 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:42.280520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31ec2659-c2d1-4e60-abde-b3052f381097 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:43.455329 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-31ec2659-c2d1-4e60-abde-b3052f381097 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:43.463459 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-31ec2659-c2d1-4e60-abde-b3052f381097 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1469 microversion: 2.1 time: 1.213126 Sep 17 20:51:43.477896 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 259/439] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:42 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1469 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:51:43.485243 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-b246162f-5ff9-45ca-95dd-d8c604c33275 req-b3b7cc17-24fa-4399-8fa9-344b06173951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63955de3-b0fa-4f96-a2db-26ae995db228", "name": "network-vif-plugged", "status": "completed", "tag": "17d8bcdf-2e72-4ea0-a129-6fda20d5053a"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:43.499455 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b246162f-5ff9-45ca-95dd-d8c604c33275 req-b3b7cc17-24fa-4399-8fa9-344b06173951 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:43.500182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b246162f-5ff9-45ca-95dd-d8c604c33275 req-b3b7cc17-24fa-4399-8fa9-344b06173951 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:43.500786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b246162f-5ff9-45ca-95dd-d8c604c33275 req-b3b7cc17-24fa-4399-8fa9-344b06173951 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:43.513724 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-b246162f-5ff9-45ca-95dd-d8c604c33275 req-b3b7cc17-24fa-4399-8fa9-344b06173951 service nova] Creating event network-vif-plugged:17d8bcdf-2e72-4ea0-a129-6fda20d5053a for instance 63955de3-b0fa-4f96-a2db-26ae995db228 on nch2-master-1 Sep 17 20:51:43.519504 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-b246162f-5ff9-45ca-95dd-d8c604c33275 req-b3b7cc17-24fa-4399-8fa9-344b06173951 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040235 Sep 17 20:51:43.520332 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 260/440] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:44.507269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bbf0054f-9dca-4f3e-be56-59d5f0988930 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:44.510630 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bbf0054f-9dca-4f3e-be56-59d5f0988930 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:44.523129 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbf0054f-9dca-4f3e-be56-59d5f0988930 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:44.524013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbf0054f-9dca-4f3e-be56-59d5f0988930 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:44.524682 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbf0054f-9dca-4f3e-be56-59d5f0988930 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:44.526500 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbf0054f-9dca-4f3e-be56-59d5f0988930 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:44.527764 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbf0054f-9dca-4f3e-be56-59d5f0988930 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:44.528935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbf0054f-9dca-4f3e-be56-59d5f0988930 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:44.554776 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bf08e2dc-1ea3-4d23-bd31-b46234ed9f3d tempest-FloatingIPsTestJSON-1970796804 tempest-FloatingIPsTestJSON-1970796804-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.348910 Sep 17 20:51:44.561729 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 181/441] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Sep 17 20:51:39 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:44.568902 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dbcbb213-91e4-4790-976b-d3137ca64aeb tempest-FloatingIPsTestJSON-1970796804 tempest-FloatingIPsTestJSON-1970796804-project] Calling method '.version_select at 0x7f25a5c869d0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:44.714451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:INSERT=11,nova_api:SELECT=26 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:51:45.554016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bbf0054f-9dca-4f3e-be56-59d5f0988930 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:45.579369 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bbf0054f-9dca-4f3e-be56-59d5f0988930 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1461 microversion: 2.1 time: 1.088927 Sep 17 20:51:45.594260 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 261/442] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:44 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1461 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:45.603690 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-132d2dbd-e14b-455a-a7f3-e4202b2a42fc tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:45.604739 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-132d2dbd-e14b-455a-a7f3-e4202b2a42fc tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:45.611260 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-132d2dbd-e14b-455a-a7f3-e4202b2a42fc tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:45.612264 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-132d2dbd-e14b-455a-a7f3-e4202b2a42fc tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:45.612949 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-132d2dbd-e14b-455a-a7f3-e4202b2a42fc tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:45.613940 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-132d2dbd-e14b-455a-a7f3-e4202b2a42fc tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:45.614599 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-132d2dbd-e14b-455a-a7f3-e4202b2a42fc tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:45.615223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-132d2dbd-e14b-455a-a7f3-e4202b2a42fc tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:45.636898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=62 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:51:46.257706 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-132d2dbd-e14b-455a-a7f3-e4202b2a42fc tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1612 microversion: 2.1 time: 0.657596 Sep 17 20:51:46.275805 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 262/443] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:45 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1612 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:46.496870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d472ef0b-c750-4e5d-bb85-8ed5bd7f8bad tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Action: 'create', calling method: .version_select at 0x7f25a5c388b0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0mLwh9jBNl7Q8GApdCCueFVD4k9ONaMelD2oI2gHk5ETTEcWEoUTXeZh+V8dWWkfyJjfOlAVY7JkXoOLbyWSm95+F/+g+g/mLalOIE/LpmQLKsG2m15s9/nExKaWvyzw=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:46.503021 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d472ef0b-c750-4e5d-bb85-8ed5bd7f8bad tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Request method failure captured: Sep 17 20:51:46.503021 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 17 20:51:46.503021 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:51:46.503021 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:51:46.503021 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:51:46.503021 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 257 Sep 17 20:51:46.503021 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:51:46.503021 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:51:46.503021 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:51:46.503021 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:46.503021 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjNhqWDadAYj7tkrsQxP81sLyIMF4uAk706a1wX3aNAvx3asZ5GL4xgZbrPkuvT3mdkifAosg0TVNNKoCtbXAG1JvkAuv8oWUzBiB26FxduhLq6-GvqheVh_Sb4nQcWjgvJScn4BhwrN7WWNUkkjNDgi7Zgwt38U74jE96ooqg1Wg44 Sep 17 20:51:46.503021 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:51:46.503021 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:51:46.503021 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:51:46.503021 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:51:46.503021 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:51:46.503021 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:51:46.503021 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 0eaaf70380604bbd9496ca1f77b8e4b0 Sep 17 20:51:46.503021 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1985576567 Sep 17 20:51:46.503021 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:51:46.503021 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:51:46.504393 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0eaaf70380604bbd9496ca1f77b8e4b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0eaaf70380604bbd9496ca1f77b8e4b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0eaaf70380604bbd9496ca1f77b8e4b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0eaaf70380604bbd9496ca1f77b8e4b0", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:46.504393 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1985576567 Sep 17 20:51:46.504393 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 0eaaf70380604bbd9496ca1f77b8e4b0 Sep 17 20:51:46.504393 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1985576567 Sep 17 20:51:46.504393 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-KeyPairsNegativeTestJSON-1985576567-project Sep 17 20:51:46.504393 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:51:46.504393 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:51:46.504393 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 13e22fbbe5164ea9995633bab30ad42e Sep 17 20:51:46.504393 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1985576567-project Sep 17 20:51:46.504393 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:51:46.504393 ncdv-master-1 devstack@n-api.service[140524]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0mLwh9jBNl7Q8GApdCCueFVD4k9ONaMelD2oI2gHk5ETTEcWEoUTXeZh+V8dWWkfyJjfOlAVY7JkXoOLbyWSm95+F/+g+g/mLalOIE/LpmQLKsG2m15s9/nExKaWvyzw=="}} Sep 17 20:51:46.505066 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:51:46.505066 ncdv-master-1 devstack@n-api.service[140524]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 17 20:51:46.505066 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0mLwh9jBNl7Q8GApdCCueFVD4k9ONaMelD2oI2gHk5ETTEcWEoUTXeZh+V8dWWkfyJjfOlAVY7JkXoOLbyWSm95+F/+g+g/mLalOIE/LpmQLKsG2m15s9/nExKaWvyzw=='}}} Sep 17 20:51:46.505066 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:46.505066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:46.505066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 17 20:51:46.505066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 17 20:51:46.505066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Sep 17 20:51:46.505066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Sep 17 20:51:46.505066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Sep 17 20:51:46.505066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Sep 17 20:51:46.505066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 17 20:51:46.505066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:46.505066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 17 20:51:46.505066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:46.505066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:46.505066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 20:51:46.508388 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 20:51:46.508388 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 20:51:46.508388 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise error Sep 17 20:51:46.508388 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Sep 17 20:51:46.508388 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:46.508388 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Sep 17 20:51:46.508388 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Sep 17 20:51:46.508388 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Sep 17 20:51:46.508388 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'minLength': 1, Sep 17 20:51:46.508388 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 17 20:51:46.508388 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:46.508388 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Sep 17 20:51:46.508388 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Sep 17 20:51:46.508388 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:46.508388 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:46.508388 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:46.508388 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:46.508388 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:46.508388 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:46.508388 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:46.508388 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:46.508388 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:51:46.508388 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:51:46.510695 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:46.510695 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:46.510695 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:51:46.510695 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:51:46.510695 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 20:51:46.510695 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 20:51:46.510695 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 20:51:46.510695 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 20:51:46.510695 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 20:51:46.510695 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 20:51:46.510695 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 17 20:51:46.510695 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:46.510695 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:46.510695 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:46.510695 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:46.510695 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:46.510695 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:46.510695 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 20:51:46.510695 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 20:51:46.511878 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 17 20:51:46.511878 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:46.519200 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d472ef0b-c750-4e5d-bb85-8ed5bd7f8bad tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:46.522099 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d472ef0b-c750-4e5d-bb85-8ed5bd7f8bad tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.260597 Sep 17 20:51:46.525579 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 263/444] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 20:51:46 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 265 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 20:51:46.536760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7a78fc12-1e87-4e11-82ea-c7f34aa14dc3 tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Calling method '.version_select at 0x7f25a5bc05e0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:46.541018 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a78fc12-1e87-4e11-82ea-c7f34aa14dc3 tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:46.542111 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a78fc12-1e87-4e11-82ea-c7f34aa14dc3 tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:46.542812 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a78fc12-1e87-4e11-82ea-c7f34aa14dc3 tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:46.566179 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7a78fc12-1e87-4e11-82ea-c7f34aa14dc3 tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.039090 Sep 17 20:51:46.569249 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 264/445] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Sep 17 20:51:46 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:46.586258 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-52c68d9c-6a6e-412c-b56c-331e5f3457f5 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Action: 'create', calling method: .version_select at 0x7f25a5c383a0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1795256707", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:46.626615 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-52c68d9c-6a6e-412c-b56c-331e5f3457f5 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Getting quotas for project 0eaaf70380604bbd9496ca1f77b8e4b0. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:51:46.643892 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-52c68d9c-6a6e-412c-b56c-331e5f3457f5 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Getting quotas for user 13e22fbbe5164ea9995633bab30ad42e and project 0eaaf70380604bbd9496ca1f77b8e4b0. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:51:46.748849 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-52c68d9c-6a6e-412c-b56c-331e5f3457f5 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-52c68d9c-6a6e-412c-b56c-331e5f3457f5 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Request method failure captured: Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 2167 Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjNhqWDadAYj7tkrsQxP81sLyIMF4uAk706a1wX3aNAvx3asZ5GL4xgZbrPkuvT3mdkifAosg0TVNNKoCtbXAG1JvkAuv8oWUzBiB26FxduhLq6-GvqheVh_Sb4nQcWjgvJScn4BhwrN7WWNUkkjNDgi7Zgwt38U74jE96ooqg1Wg44 Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 0eaaf70380604bbd9496ca1f77b8e4b0 Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1985576567 Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0eaaf70380604bbd9496ca1f77b8e4b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0eaaf70380604bbd9496ca1f77b8e4b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0eaaf70380604bbd9496ca1f77b8e4b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0eaaf70380604bbd9496ca1f77b8e4b0", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1985576567 Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 0eaaf70380604bbd9496ca1f77b8e4b0 Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1985576567 Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-KeyPairsNegativeTestJSON-1985576567-project Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 13e22fbbe5164ea9995633bab30ad42e Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1985576567-project Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1795256707", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:51:46.763890 ncdv-master-1 devstack@n-api.service[140524]: exception: Keypair data is invalid: failed to generate fingerprint Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1795256707', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:46.766041 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:46.768463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:51:46.768463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:51:46.768463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:51:46.768463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:51:46.768463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 17 20:51:46.768463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 17 20:51:46.768463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 17 20:51:46.768463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 17 20:51:46.768463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 17 20:51:46.768463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:46.768463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:46.768463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:46.768463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:46.768463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:46.768463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:46.768463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:46.768463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:46.768463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 17 20:51:46.768463 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:46.777107 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-52c68d9c-6a6e-412c-b56c-331e5f3457f5 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:46.780481 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-52c68d9c-6a6e-412c-b56c-331e5f3457f5 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.208462 Sep 17 20:51:46.784414 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 265/446] 10.222.0.26 () {60 vars in 1160 bytes} [Sat Sep 17 20:51:46 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 214 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 17 20:51:46.811721 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-38c1c16f-6982-48fc-aa37-4d986de0af63 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Action: 'create', calling method: .version_select at 0x7f25a5c38040>, body: {"keypair": {"name": "tempest-keypair-607202979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAg/wjX2N3Ibkf7JXFXISPDOWqNeTfLCtlsquT/B91ADybwFW9y1n3UCcuuK4WNx8on4RW1PZ5G/vtuFn6hSMm7r8w+9kdLuWAoHxjiwFFJBuDOyGdlE+xNliuVm8wTxBA=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:46.878221 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-38c1c16f-6982-48fc-aa37-4d986de0af63 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Getting quotas for project 0eaaf70380604bbd9496ca1f77b8e4b0. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:51:46.899975 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-38c1c16f-6982-48fc-aa37-4d986de0af63 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Getting quotas for user 13e22fbbe5164ea9995633bab30ad42e and project 0eaaf70380604bbd9496ca1f77b8e4b0. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:51:46.972759 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-38c1c16f-6982-48fc-aa37-4d986de0af63 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.178348 Sep 17 20:51:46.974000 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 266/447] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 20:51:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:46.980828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-867c5fbd-c429-444d-9691-fd4401607f61 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-32419201", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:47.062106 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-867c5fbd-c429-444d-9691-fd4401607f61 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] validate_networks() for None {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:51:47.978726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-867c5fbd-c429-444d-9691-fd4401607f61 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:51:47.979357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-867c5fbd-c429-444d-9691-fd4401607f61 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:51:47.979593 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-867c5fbd-c429-444d-9691-fd4401607f61 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:51:47.981216 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-867c5fbd-c429-444d-9691-fd4401607f61 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:51:47.981992 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-867c5fbd-c429-444d-9691-fd4401607f61 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:51:47.999590 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-867c5fbd-c429-444d-9691-fd4401607f61 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:48.001782 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-867c5fbd-c429-444d-9691-fd4401607f61 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:48.003496 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-867c5fbd-c429-444d-9691-fd4401607f61 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:48.013572 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-867c5fbd-c429-444d-9691-fd4401607f61 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:48.014390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-867c5fbd-c429-444d-9691-fd4401607f61 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:48.014985 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-867c5fbd-c429-444d-9691-fd4401607f61 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:48.044404 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dbcbb213-91e4-4790-976b-d3137ca64aeb tempest-FloatingIPsTestJSON-1970796804 tempest-FloatingIPsTestJSON-1970796804-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/57e52740-1465-4492-811b-0cdd595401a0" status: 202 len: 0 microversion: 2.1 time: 3.479486 Sep 17 20:51:48.047225 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 182/448] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Sep 17 20:51:44 2022] DELETE /compute/v2.1/os-floating-ips/57e52740-1465-4492-811b-0cdd595401a0 => generated 0 bytes in 3483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:51:48.052260 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ddac5ab5-160c-49ea-9e9d-a4540f1603a0 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Action: 'create', calling method: .version_select at 0x7f25a5bd2dc0>, body: {"keypair": {"name": "tempest-keypair-607202979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSImsZUV5yEaQXjEChmHp2g91+K049XJb0Dw9twoXI+hXm8mSjaJ2RZm8+Hu/22UyhLNzyF5XJDwoci0X7p4FjwVkNjIEscxzgSSzvAFoj6WwY3+k1MDmwF+3+zJ2v5yw=="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:48.076590 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-867c5fbd-c429-444d-9691-fd4401607f61 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Getting quotas for project 07ce9fd746374b478a743261eb014e5c. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:51:48.086946 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-867c5fbd-c429-444d-9691-fd4401607f61 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Getting quotas for user 226a87a1f393420b8d19ec2390e9d063 and project 07ce9fd746374b478a743261eb014e5c. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:51:48.109842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-ddac5ab5-160c-49ea-9e9d-a4540f1603a0 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Getting quotas for project 0eaaf70380604bbd9496ca1f77b8e4b0. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:51:48.129123 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-ddac5ab5-160c-49ea-9e9d-a4540f1603a0 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Getting quotas for user 13e22fbbe5164ea9995633bab30ad42e and project 0eaaf70380604bbd9496ca1f77b8e4b0. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:51:48.138767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-867c5fbd-c429-444d-9691-fd4401607f61 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:51:48.146835 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-867c5fbd-c429-444d-9691-fd4401607f61 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:51:48.226866 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-ddac5ab5-160c-49ea-9e9d-a4540f1603a0 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] HTTP exception thrown: Key pair 'tempest-keypair-607202979' already exists. Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ddac5ab5-160c-49ea-9e9d-a4540f1603a0 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Request method failure captured: Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 272 Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjNhqWDadAYj7tkrsQxP81sLyIMF4uAk706a1wX3aNAvx3asZ5GL4xgZbrPkuvT3mdkifAosg0TVNNKoCtbXAG1JvkAuv8oWUzBiB26FxduhLq6-GvqheVh_Sb4nQcWjgvJScn4BhwrN7WWNUkkjNDgi7Zgwt38U74jE96ooqg1Wg44 Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 0eaaf70380604bbd9496ca1f77b8e4b0 Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1985576567 Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0eaaf70380604bbd9496ca1f77b8e4b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0eaaf70380604bbd9496ca1f77b8e4b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0eaaf70380604bbd9496ca1f77b8e4b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0eaaf70380604bbd9496ca1f77b8e4b0", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1985576567 Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 0eaaf70380604bbd9496ca1f77b8e4b0 Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1985576567 Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-KeyPairsNegativeTestJSON-1985576567-project Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 13e22fbbe5164ea9995633bab30ad42e Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1985576567-project Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: {"keypair": {"name": "tempest-keypair-607202979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSImsZUV5yEaQXjEChmHp2g91+K049XJb0Dw9twoXI+hXm8mSjaJ2RZm8+Hu/22UyhLNzyF5XJDwoci0X7p4FjwVkNjIEscxzgSSzvAFoj6WwY3+k1MDmwF+3+zJ2v5yw=="}} Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: exception: Key pair 'tempest-keypair-607202979' already exists. Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-607202979', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSImsZUV5yEaQXjEChmHp2g91+K049XJb0Dw9twoXI+hXm8mSjaJ2RZm8+Hu/22UyhLNzyF5XJDwoci0X7p4FjwVkNjIEscxzgSSzvAFoj6WwY3+k1MDmwF+3+zJ2v5yw=='}}} Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result.read() Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '13e22fbbe5164ea9995633bab30ad42e-tempest-keypair-607202979' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 17 20:51:48.231084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi kp.save(context.session) Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi session.flush() Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result.read() Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 17 20:51:48.235763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '13e22fbbe5164ea9995633bab30ad42e-tempest-keypair-607202979' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 17, 20, 51, 48, 213979), 'updated_at': None, 'name': 'tempest-keypair-607202979', 'user_id': '13e22fbbe5164ea9995633bab30ad42e', 'fingerprint': '23:7d:db:24:cf:be:f7:c5:49:18:2d:8f:99:14:2b:f9', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSImsZUV5yEaQXjEChmHp2g91+K049XJb0Dw9twoXI+hXm8mSjaJ2RZm8+Hu/22UyhLNzyF5XJDwoci0X7p4FjwVkNjIEscxzgSSzvAFoj6WwY3+k1MDmwF+3+zJ2v5yw==', 'type': 'ssh'}] Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi keypair.create() Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._create() Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-607202979' already exists. Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Sep 17 20:51:48.245632 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-607202979' already exists. Sep 17 20:51:48.252208 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.252208 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:48.252208 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.252208 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:48.252208 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:48.252208 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:48.252208 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:48.252208 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:48.252208 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-607202979' already exists. Sep 17 20:51:48.252208 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.254549 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ddac5ab5-160c-49ea-9e9d-a4540f1603a0 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Returning 409 to user: Key pair 'tempest-keypair-607202979' already exists. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:48.255643 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ddac5ab5-160c-49ea-9e9d-a4540f1603a0 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.207179 Sep 17 20:51:48.261400 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 183/449] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 20:51:48 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 213 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 17 20:51:48.291683 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-230ca9c9-b0e4-4cff-bb31-d0b7a9aff368 tempest-FloatingIPsTestJSON-1970796804 tempest-FloatingIPsTestJSON-1970796804-project] Calling method '.version_select at 0x7f25a5bcdb80>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:48.318090 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-867c5fbd-c429-444d-9691-fd4401607f61 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.341431 Sep 17 20:51:48.328395 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 267/450] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:51:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:51:48.343800 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-dba1305c-1cd2-4de9-a823-b721f1434d7a tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Calling method '.version_select at 0x7f25a5b64310>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:48.440490 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-dba1305c-1cd2-4de9-a823-b721f1434d7a tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-607202979" status: 202 len: 0 microversion: 2.1 time: 0.109840 Sep 17 20:51:48.453428 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 268/451] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Sep 17 20:51:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-607202979 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:51:48.475555 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1f7b2371-ce41-4a08-b416-08f7c9cf503a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:48.476371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1f7b2371-ce41-4a08-b416-08f7c9cf503a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:48.630788 ncdv-master-1 devstack@n-api.service[140523]: DEBUG neutronclient.v2_0.client [None req-230ca9c9-b0e4-4cff-bb31-d0b7a9aff368 tempest-FloatingIPsTestJSON-1970796804 tempest-FloatingIPsTestJSON-1970796804-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 57e52740-1465-4492-811b-0cdd595401a0 could not be found", "detail": ""}} {{(pid=140523) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 17 20:51:48.631656 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-230ca9c9-b0e4-4cff-bb31-d0b7a9aff368 tempest-FloatingIPsTestJSON-1970796804 tempest-FloatingIPsTestJSON-1970796804-project] HTTP exception thrown: Floating IP not found for ID 57e52740-1465-4492-811b-0cdd595401a0 Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-230ca9c9-b0e4-4cff-bb31-d0b7a9aff368 tempest-FloatingIPsTestJSON-1970796804 tempest-FloatingIPsTestJSON-1970796804-project] Request method failure captured: Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/os-floating-ips/57e52740-1465-4492-811b-0cdd595401a0 HTTP/1.1 Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjNR6NQZrFLYiMIxRM5iP_XiDmi6J8w6MS8TTNcDiEhD2y_QwyWrye-6yjjkUp8V4Wao_T-00zp_oPmeku8zsZCx0PY0ZmYZ9awQRVyE9qHBcHsnN_OdKDfXr6VQIlU24ZDrbEM3IsA79uR8QcfI0Ur_bvGjX_EM9-mPQy9tO97vULc Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 06f2b7e4e205458b8cf6f19a43b77296 Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-FloatingIPsTestJSON-1970796804 Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/06f2b7e4e205458b8cf6f19a43b77296"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/06f2b7e4e205458b8cf6f19a43b77296"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/06f2b7e4e205458b8cf6f19a43b77296"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_06f2b7e4e205458b8cf6f19a43b77296", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-FloatingIPsTestJSON-1970796804 Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 06f2b7e4e205458b8cf6f19a43b77296 Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1970796804 Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-FloatingIPsTestJSON-1970796804-project Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 5aae6d573509428db8d4d5db9d7b005c Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-FloatingIPsTestJSON-1970796804-project Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: exception: Floating IP not found for ID 57e52740-1465-4492-811b-0cdd595401a0 Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '57e52740-1465-4492-811b-0cdd595401a0'} Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 57e52740-1465-4492-811b-0cdd595401a0 could not be found Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-72446e1e-a677-48ce-a448-b77c03ac8856'] Sep 17 20:51:48.658233 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.663318 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:48.663318 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.663318 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:48.663318 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 17 20:51:48.663318 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 17 20:51:48.663318 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 17 20:51:48.663318 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 17 20:51:48.663318 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 57e52740-1465-4492-811b-0cdd595401a0. Sep 17 20:51:48.663318 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.663318 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:48.663318 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.663318 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:48.663318 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:48.663318 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:48.663318 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:48.663318 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:48.663318 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:51:48.663318 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:51:48.663318 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:48.663318 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:48.663318 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 17 20:51:48.663318 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 17 20:51:48.663318 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 57e52740-1465-4492-811b-0cdd595401a0 Sep 17 20:51:48.663318 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.663318 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:48.663318 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.663318 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:48.663318 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:48.663318 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:48.663318 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:48.663318 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:48.663318 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 57e52740-1465-4492-811b-0cdd595401a0 Sep 17 20:51:48.663318 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.668036 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-230ca9c9-b0e4-4cff-bb31-d0b7a9aff368 tempest-FloatingIPsTestJSON-1970796804 tempest-FloatingIPsTestJSON-1970796804-project] Returning 404 to user: Floating IP not found for ID 57e52740-1465-4492-811b-0cdd595401a0 {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:48.670286 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-230ca9c9-b0e4-4cff-bb31-d0b7a9aff368 tempest-FloatingIPsTestJSON-1970796804 tempest-FloatingIPsTestJSON-1970796804-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips/57e52740-1465-4492-811b-0cdd595401a0" status: 404 len: 111 microversion: 2.1 time: 0.405321 Sep 17 20:51:48.671610 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 184/452] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Sep 17 20:51:48 2022] GET /compute/v2.1/os-floating-ips/57e52740-1465-4492-811b-0cdd595401a0 => generated 111 bytes in 409 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:48.725870 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0fe672ce-e209-4fc0-b376-93e6258eaadb tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Action: 'create', calling method: .version_select at 0x7f25a5b2c670>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxoY/nuppyUeGViWd53/Rv05/+u3h3g9E9IHnGvDe47EgWiFbWysCkHibdnTBOiKVmxdjPVOsZD8EdsCLpZBzrEBX4Xrly/1ODGKsdx+Yem2jbih8e4709EMbGUrK+0Pw=="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0fe672ce-e209-4fc0-b376-93e6258eaadb tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Request method failure captured: Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 247 Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjNhqWDadAYj7tkrsQxP81sLyIMF4uAk706a1wX3aNAvx3asZ5GL4xgZbrPkuvT3mdkifAosg0TVNNKoCtbXAG1JvkAuv8oWUzBiB26FxduhLq6-GvqheVh_Sb4nQcWjgvJScn4BhwrN7WWNUkkjNDgi7Zgwt38U74jE96ooqg1Wg44 Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 0eaaf70380604bbd9496ca1f77b8e4b0 Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1985576567 Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0eaaf70380604bbd9496ca1f77b8e4b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0eaaf70380604bbd9496ca1f77b8e4b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0eaaf70380604bbd9496ca1f77b8e4b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0eaaf70380604bbd9496ca1f77b8e4b0", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1985576567 Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 0eaaf70380604bbd9496ca1f77b8e4b0 Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1985576567 Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-KeyPairsNegativeTestJSON-1985576567-project Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 13e22fbbe5164ea9995633bab30ad42e Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1985576567-project Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxoY/nuppyUeGViWd53/Rv05/+u3h3g9E9IHnGvDe47EgWiFbWysCkHibdnTBOiKVmxdjPVOsZD8EdsCLpZBzrEBX4Xrly/1ODGKsdx+Yem2jbih8e4709EMbGUrK+0Pw=="}} Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxoY/nuppyUeGViWd53/Rv05/+u3h3g9E9IHnGvDe47EgWiFbWysCkHibdnTBOiKVmxdjPVOsZD8EdsCLpZBzrEBX4Xrly/1ODGKsdx+Yem2jbih8e4709EMbGUrK+0Pw=='}}} Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise error Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi '' Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 20:51:48.755681 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 20:51:48.759527 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 20:51:48.759527 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 20:51:48.759527 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 20:51:48.759527 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 20:51:48.759527 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 17 20:51:48.759527 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.759527 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:48.759527 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.759527 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:48.759527 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:48.759527 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:48.759527 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 20:51:48.759527 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 20:51:48.759527 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 17 20:51:48.759527 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.762751 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0fe672ce-e209-4fc0-b376-93e6258eaadb tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:48.765257 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0fe672ce-e209-4fc0-b376-93e6258eaadb tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.091872 Sep 17 20:51:48.766083 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 185/453] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 20:51:48 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 20:51:48.783667 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4d4cd564-3df4-4dcc-aeb9-f187070a72ad tempest-FloatingIPsTestJSON-1970796804 tempest-FloatingIPsTestJSON-1970796804-project] Calling method '.version_select at 0x7f25a5b2c550>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:48.787212 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1f7b2371-ce41-4a08-b416-08f7c9cf503a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:48.797401 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1f7b2371-ce41-4a08-b416-08f7c9cf503a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1211 microversion: 2.1 time: 0.341400 Sep 17 20:51:48.803094 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 269/454] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:48 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1211 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:48.829858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-26d2272d-ae99-4a30-86f2-d92a972745a9 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Action: 'create', calling method: .version_select at 0x7f25a5b645e0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-629168200", "public_key": " "}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:48.877113 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-26d2272d-ae99-4a30-86f2-d92a972745a9 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Getting quotas for project 0eaaf70380604bbd9496ca1f77b8e4b0. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:51:48.893011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-26d2272d-ae99-4a30-86f2-d92a972745a9 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Getting quotas for user 13e22fbbe5164ea9995633bab30ad42e and project 0eaaf70380604bbd9496ca1f77b8e4b0. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:51:48.930568 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-26d2272d-ae99-4a30-86f2-d92a972745a9 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-26d2272d-ae99-4a30-86f2-d92a972745a9 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Request method failure captured: Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 94 Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjNhqWDadAYj7tkrsQxP81sLyIMF4uAk706a1wX3aNAvx3asZ5GL4xgZbrPkuvT3mdkifAosg0TVNNKoCtbXAG1JvkAuv8oWUzBiB26FxduhLq6-GvqheVh_Sb4nQcWjgvJScn4BhwrN7WWNUkkjNDgi7Zgwt38U74jE96ooqg1Wg44 Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 0eaaf70380604bbd9496ca1f77b8e4b0 Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1985576567 Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0eaaf70380604bbd9496ca1f77b8e4b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0eaaf70380604bbd9496ca1f77b8e4b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0eaaf70380604bbd9496ca1f77b8e4b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0eaaf70380604bbd9496ca1f77b8e4b0", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1985576567 Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 0eaaf70380604bbd9496ca1f77b8e4b0 Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1985576567 Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-KeyPairsNegativeTestJSON-1985576567-project Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 13e22fbbe5164ea9995633bab30ad42e Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1985576567-project Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-629168200", "public_key": " "}} Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: exception: Keypair data is invalid: failed to generate fingerprint Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-629168200', 'public_key': ' '}}} Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:48.933062 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.939307 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:48.939307 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:48.939307 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:48.939307 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:48.939307 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:48.939307 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:51:48.939307 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:51:48.939307 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:48.939307 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:48.939307 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:51:48.939307 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:51:48.939307 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:51:48.939307 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:51:48.939307 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 17 20:51:48.939307 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 17 20:51:48.939307 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 17 20:51:48.939307 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 17 20:51:48.939307 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 17 20:51:48.939307 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.939307 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:48.939307 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.939307 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:48.939307 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:48.939307 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:48.939307 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:48.939307 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:48.939307 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 17 20:51:48.939307 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.946521 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-26d2272d-ae99-4a30-86f2-d92a972745a9 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:48.956026 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-26d2272d-ae99-4a30-86f2-d92a972745a9 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.151696 Sep 17 20:51:48.957634 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 270/455] 10.222.0.26 () {60 vars in 1158 bytes} [Sat Sep 17 20:51:48 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 17 20:51:48.972828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9f647cf0-5e82-4a5d-839c-d4dbeaed5db4 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Action: 'create', calling method: .version_select at 0x7f25a5de5280>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5v0HJX8iMloTsvIk3bqQYl1YXT01Pw3gDhhAhMF9U/osDnx8Jjlc1qhw8uBcbIkBfKVvj021E313SfTEGTu24FJaCDi8nwp0Bhcmrd0VQQ52FRum+UUoMmVOSCGrjrmQ=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9f647cf0-5e82-4a5d-839c-d4dbeaed5db4 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Request method failure captured: Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 507 Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjNhqWDadAYj7tkrsQxP81sLyIMF4uAk706a1wX3aNAvx3asZ5GL4xgZbrPkuvT3mdkifAosg0TVNNKoCtbXAG1JvkAuv8oWUzBiB26FxduhLq6-GvqheVh_Sb4nQcWjgvJScn4BhwrN7WWNUkkjNDgi7Zgwt38U74jE96ooqg1Wg44 Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 0eaaf70380604bbd9496ca1f77b8e4b0 Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1985576567 Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0eaaf70380604bbd9496ca1f77b8e4b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0eaaf70380604bbd9496ca1f77b8e4b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0eaaf70380604bbd9496ca1f77b8e4b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0eaaf70380604bbd9496ca1f77b8e4b0", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1985576567 Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 0eaaf70380604bbd9496ca1f77b8e4b0 Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1985576567 Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-KeyPairsNegativeTestJSON-1985576567-project Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 13e22fbbe5164ea9995633bab30ad42e Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1985576567-project Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5v0HJX8iMloTsvIk3bqQYl1YXT01Pw3gDhhAhMF9U/osDnx8Jjlc1qhw8uBcbIkBfKVvj021E313SfTEGTu24FJaCDi8nwp0Bhcmrd0VQQ52FRum+UUoMmVOSCGrjrmQ=="}} Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5v0HJX8iMloTsvIk3bqQYl1YXT01Pw3gDhhAhMF9U/osDnx8Jjlc1qhw8uBcbIkBfKVvj021E313SfTEGTu24FJaCDi8nwp0Bhcmrd0VQQ52FRum+UUoMmVOSCGrjrmQ=='}}} Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise error Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 17 20:51:48.981742 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Sep 17 20:51:48.985080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.985080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:48.985080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.985080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:48.985080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:48.985080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:48.985080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:48.985080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:48.985080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:51:48.985080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:51:48.985080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:48.985080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:48.985080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:51:48.985080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:51:48.985080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 20:51:48.985080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 20:51:48.985080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 20:51:48.985080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 20:51:48.985080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 20:51:48.985080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 20:51:48.985080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 17 20:51:48.985080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.985080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:48.985080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.985080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:48.985080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:48.985080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:48.985080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 20:51:48.985080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 20:51:48.985080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 17 20:51:48.985080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:48.989998 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9f647cf0-5e82-4a5d-839c-d4dbeaed5db4 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:48.991258 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9f647cf0-5e82-4a5d-839c-d4dbeaed5db4 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.024048 Sep 17 20:51:48.992584 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 271/456] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 20:51:48 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 17 20:51:49.017442 ncdv-master-1 devstack@n-api.service[140523]: DEBUG neutronclient.v2_0.client [None req-4d4cd564-3df4-4dcc-aeb9-f187070a72ad tempest-FloatingIPsTestJSON-1970796804 tempest-FloatingIPsTestJSON-1970796804-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 57e52740-1465-4492-811b-0cdd595401a0 could not be found", "detail": ""}} {{(pid=140523) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 17 20:51:49.018326 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-4d4cd564-3df4-4dcc-aeb9-f187070a72ad tempest-FloatingIPsTestJSON-1970796804 tempest-FloatingIPsTestJSON-1970796804-project] HTTP exception thrown: Floating IP not found for ID 57e52740-1465-4492-811b-0cdd595401a0 Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4d4cd564-3df4-4dcc-aeb9-f187070a72ad tempest-FloatingIPsTestJSON-1970796804 tempest-FloatingIPsTestJSON-1970796804-project] Request method failure captured: Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/os-floating-ips/57e52740-1465-4492-811b-0cdd595401a0 HTTP/1.1 Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjNR6NQZrFLYiMIxRM5iP_XiDmi6J8w6MS8TTNcDiEhD2y_QwyWrye-6yjjkUp8V4Wao_T-00zp_oPmeku8zsZCx0PY0ZmYZ9awQRVyE9qHBcHsnN_OdKDfXr6VQIlU24ZDrbEM3IsA79uR8QcfI0Ur_bvGjX_EM9-mPQy9tO97vULc Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 06f2b7e4e205458b8cf6f19a43b77296 Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-FloatingIPsTestJSON-1970796804 Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/06f2b7e4e205458b8cf6f19a43b77296"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/06f2b7e4e205458b8cf6f19a43b77296"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/06f2b7e4e205458b8cf6f19a43b77296"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_06f2b7e4e205458b8cf6f19a43b77296", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-FloatingIPsTestJSON-1970796804 Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 06f2b7e4e205458b8cf6f19a43b77296 Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1970796804 Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-FloatingIPsTestJSON-1970796804-project Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 5aae6d573509428db8d4d5db9d7b005c Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-FloatingIPsTestJSON-1970796804-project Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: exception: Floating IP not found for ID 57e52740-1465-4492-811b-0cdd595401a0 Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '57e52740-1465-4492-811b-0cdd595401a0'} Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 57e52740-1465-4492-811b-0cdd595401a0 could not be found Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4208d1e4-91e9-439d-9880-e12a75109621'] Sep 17 20:51:49.020711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 57e52740-1465-4492-811b-0cdd595401a0. Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 57e52740-1465-4492-811b-0cdd595401a0 Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 57e52740-1465-4492-811b-0cdd595401a0 Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4d4cd564-3df4-4dcc-aeb9-f187070a72ad tempest-FloatingIPsTestJSON-1970796804 tempest-FloatingIPsTestJSON-1970796804-project] Returning 404 to user: Floating IP not found for ID 57e52740-1465-4492-811b-0cdd595401a0 {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4d4cd564-3df4-4dcc-aeb9-f187070a72ad tempest-FloatingIPsTestJSON-1970796804 tempest-FloatingIPsTestJSON-1970796804-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/57e52740-1465-4492-811b-0cdd595401a0" status: 404 len: 111 microversion: 2.1 time: 0.253645 Sep 17 20:51:49.024329 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 186/457] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Sep 17 20:51:48 2022] DELETE /compute/v2.1/os-floating-ips/57e52740-1465-4492-811b-0cdd595401a0 => generated 111 bytes in 255 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:51:49.030363 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bbb704e7-1e04-4a9b-ad32-cd08a2046e46 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Action: 'create', calling method: .version_select at 0x7f25a5bd4dc0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-648051114", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:49.063091 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-bbb704e7-1e04-4a9b-ad32-cd08a2046e46 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Getting quotas for project 0eaaf70380604bbd9496ca1f77b8e4b0. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:51:49.082417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-bbb704e7-1e04-4a9b-ad32-cd08a2046e46 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Getting quotas for user 13e22fbbe5164ea9995633bab30ad42e and project 0eaaf70380604bbd9496ca1f77b8e4b0. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:51:49.128661 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-bbb704e7-1e04-4a9b-ad32-cd08a2046e46 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bbb704e7-1e04-4a9b-ad32-cd08a2046e46 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Request method failure captured: Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 117 Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjNhqWDadAYj7tkrsQxP81sLyIMF4uAk706a1wX3aNAvx3asZ5GL4xgZbrPkuvT3mdkifAosg0TVNNKoCtbXAG1JvkAuv8oWUzBiB26FxduhLq6-GvqheVh_Sb4nQcWjgvJScn4BhwrN7WWNUkkjNDgi7Zgwt38U74jE96ooqg1Wg44 Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 0eaaf70380604bbd9496ca1f77b8e4b0 Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1985576567 Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0eaaf70380604bbd9496ca1f77b8e4b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0eaaf70380604bbd9496ca1f77b8e4b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0eaaf70380604bbd9496ca1f77b8e4b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0eaaf70380604bbd9496ca1f77b8e4b0", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1985576567 Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 0eaaf70380604bbd9496ca1f77b8e4b0 Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1985576567 Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-KeyPairsNegativeTestJSON-1985576567-project Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 13e22fbbe5164ea9995633bab30ad42e Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1985576567-project Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-648051114", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: exception: Keypair data is invalid: failed to generate fingerprint Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-648051114', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 17 20:51:49.132576 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:51:49.136917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bbb704e7-1e04-4a9b-ad32-cd08a2046e46 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:49.138898 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bbb704e7-1e04-4a9b-ad32-cd08a2046e46 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.137321 Sep 17 20:51:49.146310 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 272/458] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 20:51:48 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 147 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Sep 17 20:51:49.148010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c2526b49-a5f6-4844-8a5d-0d02c0142116 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Calling method '.version_select at 0x7f25a5b2e820>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:49.186825 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-c2526b49-a5f6-4844-8a5d-0d02c0142116 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-279179531 not found for user 13e22fbbe5164ea9995633bab30ad42e Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c2526b49-a5f6-4844-8a5d-0d02c0142116 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Request method failure captured: Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-279179531 HTTP/1.1 Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjNhqWDadAYj7tkrsQxP81sLyIMF4uAk706a1wX3aNAvx3asZ5GL4xgZbrPkuvT3mdkifAosg0TVNNKoCtbXAG1JvkAuv8oWUzBiB26FxduhLq6-GvqheVh_Sb4nQcWjgvJScn4BhwrN7WWNUkkjNDgi7Zgwt38U74jE96ooqg1Wg44 Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 0eaaf70380604bbd9496ca1f77b8e4b0 Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1985576567 Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0eaaf70380604bbd9496ca1f77b8e4b0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0eaaf70380604bbd9496ca1f77b8e4b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0eaaf70380604bbd9496ca1f77b8e4b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0eaaf70380604bbd9496ca1f77b8e4b0", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1985576567 Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 0eaaf70380604bbd9496ca1f77b8e4b0 Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1985576567 Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-KeyPairsNegativeTestJSON-1985576567-project Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 13e22fbbe5164ea9995633bab30ad42e Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1985576567-project Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: exception: Keypair tempest-keypair-non-existent-279179531 not found for user 13e22fbbe5164ea9995633bab30ad42e Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'tempest-keypair-non-existent-279179531'} Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-279179531 not found for user 13e22fbbe5164ea9995633bab30ad42e Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:49.193133 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:49.196934 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:49.196934 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:49.196934 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:49.196934 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:49.196934 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:51:49.196934 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:51:49.196934 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:51:49.196934 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:51:49.196934 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 17 20:51:49.196934 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:51:49.196934 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:51:49.196934 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:51:49.196934 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Sep 17 20:51:49.196934 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req, id) Sep 17 20:51:49.196934 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Sep 17 20:51:49.196934 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Sep 17 20:51:49.196934 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-279179531 not found for user 13e22fbbe5164ea9995633bab30ad42e Sep 17 20:51:49.196934 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:49.196934 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:51:49.196934 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:49.196934 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:51:49.196934 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:51:49.196934 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:51:49.196934 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:51:49.196934 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:51:49.196934 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-279179531 not found for user 13e22fbbe5164ea9995633bab30ad42e Sep 17 20:51:49.196934 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:51:49.196934 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c2526b49-a5f6-4844-8a5d-0d02c0142116 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Returning 404 to user: Keypair tempest-keypair-non-existent-279179531 not found for user 13e22fbbe5164ea9995633bab30ad42e {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:51:49.201725 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c2526b49-a5f6-4844-8a5d-0d02c0142116 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-279179531" status: 404 len: 144 microversion: 2.1 time: 0.053771 Sep 17 20:51:49.201725 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 187/459] 10.222.0.26 () {58 vars in 1257 bytes} [Sat Sep 17 20:51:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-279179531 => generated 144 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 20:51:49.835014 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ff597da9-c1b2-46ef-b15a-cef8ae7c037e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:49.835529 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c2526b49-a5f6-4844-8a5d-0d02c0142116 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:49.836378 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ff597da9-c1b2-46ef-b15a-cef8ae7c037e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:49.836911 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c2526b49-a5f6-4844-8a5d-0d02c0142116 tempest-KeyPairsNegativeTestJSON-1985576567 tempest-KeyPairsNegativeTestJSON-1985576567-project] 10.222.0.26 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001405 Sep 17 20:51:49.843313 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 188/460] 10.222.0.26 () {56 vars in 886 bytes} [Sat Sep 17 20:51:49 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 17 20:51:49.859671 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff597da9-c1b2-46ef-b15a-cef8ae7c037e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:49.860514 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff597da9-c1b2-46ef-b15a-cef8ae7c037e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:49.861550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff597da9-c1b2-46ef-b15a-cef8ae7c037e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:49.862762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff597da9-c1b2-46ef-b15a-cef8ae7c037e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:49.863696 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff597da9-c1b2-46ef-b15a-cef8ae7c037e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:49.871860 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff597da9-c1b2-46ef-b15a-cef8ae7c037e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:51.135533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ff597da9-c1b2-46ef-b15a-cef8ae7c037e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:51.150849 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ff597da9-c1b2-46ef-b15a-cef8ae7c037e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1263 microversion: 2.1 time: 1.323674 Sep 17 20:51:51.152049 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 273/461] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:49 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1263 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:51.226588 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5b0ff2f5-31c0-4276-ada3-66dba550338b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1948716053", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "291f6f93-7c31-4c8d-9946-eca7fb2662ee"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:51.309058 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-5b0ff2f5-31c0-4276-ada3-66dba550338b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] validate_networks() for [('291f6f93-7c31-4c8d-9946-eca7fb2662ee', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:51:52.176947 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f9350191-0118-4d31-99ff-628e8cbddb17 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:52.178300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f9350191-0118-4d31-99ff-628e8cbddb17 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:52.190120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f9350191-0118-4d31-99ff-628e8cbddb17 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:52.190635 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f9350191-0118-4d31-99ff-628e8cbddb17 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:52.191195 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f9350191-0118-4d31-99ff-628e8cbddb17 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:52.191773 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f9350191-0118-4d31-99ff-628e8cbddb17 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:52.203566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f9350191-0118-4d31-99ff-628e8cbddb17 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:52.203857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f9350191-0118-4d31-99ff-628e8cbddb17 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:52.666097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f9350191-0118-4d31-99ff-628e8cbddb17 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:52.682929 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f9350191-0118-4d31-99ff-628e8cbddb17 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1269 microversion: 2.1 time: 0.510389 Sep 17 20:51:52.684532 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 274/462] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:52 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1269 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:53.314262 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-5b0ff2f5-31c0-4276-ada3-66dba550338b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:51:53.315550 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-5b0ff2f5-31c0-4276-ada3-66dba550338b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:51:53.316243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-5b0ff2f5-31c0-4276-ada3-66dba550338b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:51:53.316861 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-5b0ff2f5-31c0-4276-ada3-66dba550338b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:51:53.317549 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-5b0ff2f5-31c0-4276-ada3-66dba550338b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:51:53.342880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b0ff2f5-31c0-4276-ada3-66dba550338b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:53.344178 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b0ff2f5-31c0-4276-ada3-66dba550338b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:53.345975 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b0ff2f5-31c0-4276-ada3-66dba550338b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:53.351994 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b0ff2f5-31c0-4276-ada3-66dba550338b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:53.352599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b0ff2f5-31c0-4276-ada3-66dba550338b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:53.354222 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b0ff2f5-31c0-4276-ada3-66dba550338b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:53.437226 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-5b0ff2f5-31c0-4276-ada3-66dba550338b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Getting quotas for project 7dc8bc81c2d74bae9612f7c9807350a7. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:51:53.467048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-5b0ff2f5-31c0-4276-ada3-66dba550338b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Getting quotas for user f1134231b4a545fdb136a5204cb4f289 and project 7dc8bc81c2d74bae9612f7c9807350a7. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:51:53.491471 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5b0ff2f5-31c0-4276-ada3-66dba550338b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:51:53.498494 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5b0ff2f5-31c0-4276-ada3-66dba550338b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:51:53.708246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c58aaaaf-f09e-4bf4-a1d9-421f23ee4f0f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:53.709044 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c58aaaaf-f09e-4bf4-a1d9-421f23ee4f0f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:53.713011 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5b0ff2f5-31c0-4276-ada3-66dba550338b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.755608 Sep 17 20:51:53.715585 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c58aaaaf-f09e-4bf4-a1d9-421f23ee4f0f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:53.716075 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c58aaaaf-f09e-4bf4-a1d9-421f23ee4f0f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:53.725890 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 189/463] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Sep 17 20:51:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2761 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 17 20:51:53.735115 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c58aaaaf-f09e-4bf4-a1d9-421f23ee4f0f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:53.739775 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9b7ce7aa-52c1-41b4-a141-da7bb13333be tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:53.742225 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c58aaaaf-f09e-4bf4-a1d9-421f23ee4f0f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:53.742888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c58aaaaf-f09e-4bf4-a1d9-421f23ee4f0f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:53.744718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c58aaaaf-f09e-4bf4-a1d9-421f23ee4f0f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:53.745260 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9b7ce7aa-52c1-41b4-a141-da7bb13333be tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:54.201416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9b7ce7aa-52c1-41b4-a141-da7bb13333be tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:54.211370 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9b7ce7aa-52c1-41b4-a141-da7bb13333be tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:54.217443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9b7ce7aa-52c1-41b4-a141-da7bb13333be tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:54.229908 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9b7ce7aa-52c1-41b4-a141-da7bb13333be tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9" status: 200 len: 1262 microversion: 2.25 time: 0.495182 Sep 17 20:51:54.231156 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 190/464] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:51:53 2022] GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9 => generated 1262 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:51:55.257019 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-66ac79f1-6a23-4545-bd47-1517d4d8f6fc tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:55.259008 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-66ac79f1-6a23-4545-bd47-1517d4d8f6fc tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:55.277336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-66ac79f1-6a23-4545-bd47-1517d4d8f6fc tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:55.279381 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-66ac79f1-6a23-4545-bd47-1517d4d8f6fc tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:55.280006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-66ac79f1-6a23-4545-bd47-1517d4d8f6fc tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:55.280983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-66ac79f1-6a23-4545-bd47-1517d4d8f6fc tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:55.281770 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-66ac79f1-6a23-4545-bd47-1517d4d8f6fc tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:55.282416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-66ac79f1-6a23-4545-bd47-1517d4d8f6fc tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:55.577706 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c58aaaaf-f09e-4bf4-a1d9-421f23ee4f0f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:55.587195 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c58aaaaf-f09e-4bf4-a1d9-421f23ee4f0f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1311 microversion: 2.1 time: 1.882702 Sep 17 20:51:55.597429 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 275/465] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:53 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1311 bytes in 1894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:55.624280 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-66ac79f1-6a23-4545-bd47-1517d4d8f6fc tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:55.635541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-66ac79f1-6a23-4545-bd47-1517d4d8f6fc tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:55.637047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-66ac79f1-6a23-4545-bd47-1517d4d8f6fc tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:55.651730 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-66ac79f1-6a23-4545-bd47-1517d4d8f6fc tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9" status: 200 len: 1314 microversion: 2.25 time: 0.398077 Sep 17 20:51:55.673859 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 191/466] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:51:55 2022] GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9 => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 20:51:56.624331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d3bcf698-e484-4426-b413-7f889c50cc4b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:56.629822 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d3bcf698-e484-4426-b413-7f889c50cc4b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:56.643085 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3bcf698-e484-4426-b413-7f889c50cc4b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:56.645082 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3bcf698-e484-4426-b413-7f889c50cc4b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:56.645825 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3bcf698-e484-4426-b413-7f889c50cc4b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:56.651260 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3bcf698-e484-4426-b413-7f889c50cc4b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:56.654811 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3bcf698-e484-4426-b413-7f889c50cc4b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:56.655386 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3bcf698-e484-4426-b413-7f889c50cc4b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:56.684523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-00477827-324a-4c86-aa90-220827e9513b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:56.694351 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-00477827-324a-4c86-aa90-220827e9513b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:56.706011 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00477827-324a-4c86-aa90-220827e9513b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:56.710155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00477827-324a-4c86-aa90-220827e9513b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:56.710820 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00477827-324a-4c86-aa90-220827e9513b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:56.711721 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00477827-324a-4c86-aa90-220827e9513b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:56.712340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00477827-324a-4c86-aa90-220827e9513b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:56.712942 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00477827-324a-4c86-aa90-220827e9513b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:57.104444 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-00477827-324a-4c86-aa90-220827e9513b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:57.114392 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-00477827-324a-4c86-aa90-220827e9513b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:57.115867 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-00477827-324a-4c86-aa90-220827e9513b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:57.116999 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-00477827-324a-4c86-aa90-220827e9513b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9" status: 200 len: 1320 microversion: 2.25 time: 0.436592 Sep 17 20:51:57.141954 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 192/467] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:51:56 2022] GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9 => generated 1320 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:51:57.539522 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-c1253d54-bee6-41fc-95d5-2a77b2b4359f req-075a73fd-42c5-4f33-81aa-dbfb929924f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700", "tag": "3b2dfcf9-36b6-4299-8814-a29f994bcc2f"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:51:57.557232 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-c1253d54-bee6-41fc-95d5-2a77b2b4359f req-075a73fd-42c5-4f33-81aa-dbfb929924f8 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:57.577877 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-c1253d54-bee6-41fc-95d5-2a77b2b4359f req-075a73fd-42c5-4f33-81aa-dbfb929924f8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:57.578444 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-c1253d54-bee6-41fc-95d5-2a77b2b4359f req-075a73fd-42c5-4f33-81aa-dbfb929924f8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:57.613881 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-c1253d54-bee6-41fc-95d5-2a77b2b4359f req-075a73fd-42c5-4f33-81aa-dbfb929924f8 service nova] Creating event network-changed:3b2dfcf9-36b6-4299-8814-a29f994bcc2f for instance e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 on nch2-master-1 Sep 17 20:51:57.640517 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-c1253d54-bee6-41fc-95d5-2a77b2b4359f req-075a73fd-42c5-4f33-81aa-dbfb929924f8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104581 Sep 17 20:51:57.648275 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 193/468] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:51:57.926822 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d3bcf698-e484-4426-b413-7f889c50cc4b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:51:57.940867 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d3bcf698-e484-4426-b413-7f889c50cc4b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1311 microversion: 2.1 time: 1.320388 Sep 17 20:51:57.952804 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 276/469] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:56 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1311 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:51:58.150086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dd06473f-d79c-4374-96e1-d0ea5a5962db tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:58.151690 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dd06473f-d79c-4374-96e1-d0ea5a5962db tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:58.177785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd06473f-d79c-4374-96e1-d0ea5a5962db tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:58.178582 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd06473f-d79c-4374-96e1-d0ea5a5962db tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:58.179292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd06473f-d79c-4374-96e1-d0ea5a5962db tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:58.181133 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd06473f-d79c-4374-96e1-d0ea5a5962db tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:58.184566 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd06473f-d79c-4374-96e1-d0ea5a5962db tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:58.185304 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd06473f-d79c-4374-96e1-d0ea5a5962db tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:58.983261 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-58dbbac1-eb28-45a5-9c35-4722902750d5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:51:58.983984 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-58dbbac1-eb28-45a5-9c35-4722902750d5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:51:58.995081 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:51:59.000423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58dbbac1-eb28-45a5-9c35-4722902750d5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:59.006049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58dbbac1-eb28-45a5-9c35-4722902750d5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:59.007407 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58dbbac1-eb28-45a5-9c35-4722902750d5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:59.008220 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58dbbac1-eb28-45a5-9c35-4722902750d5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:51:59.010688 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58dbbac1-eb28-45a5-9c35-4722902750d5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:51:59.012931 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58dbbac1-eb28-45a5-9c35-4722902750d5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:51:59.103105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=24 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:52:00.104336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dd06473f-d79c-4374-96e1-d0ea5a5962db tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:00.117578 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dd06473f-d79c-4374-96e1-d0ea5a5962db tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:00.127271 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dd06473f-d79c-4374-96e1-d0ea5a5962db tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:00.130868 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dd06473f-d79c-4374-96e1-d0ea5a5962db tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9" status: 200 len: 1362 microversion: 2.25 time: 1.986737 Sep 17 20:52:00.133847 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 194/470] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:51:58 2022] GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9 => generated 1362 bytes in 1991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:00.327814 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-58dbbac1-eb28-45a5-9c35-4722902750d5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:00.340333 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-58dbbac1-eb28-45a5-9c35-4722902750d5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1311 microversion: 2.1 time: 1.362009 Sep 17 20:52:00.340990 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 277/471] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:51:58 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1311 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:00.757020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d0ceeeea-adb1-49b1-965b-b227d4cced84 tempest-QuotasAdminTestV257-775824531 tempest-QuotasAdminTestV257-775824531-project-admin] Action: 'update', calling method: .version_select at 0x7f25a5ad08b0>, body: {"quota_set": {"ram": "5120"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:01.165035 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-18be82c8-11b6-4647-9f78-525fb03db194 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:01.165711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-18be82c8-11b6-4647-9f78-525fb03db194 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:01.210376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d0ceeeea-adb1-49b1-965b-b227d4cced84 tempest-QuotasAdminTestV257-775824531 tempest-QuotasAdminTestV257-775824531-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:01.213116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d0ceeeea-adb1-49b1-965b-b227d4cced84 tempest-QuotasAdminTestV257-775824531 tempest-QuotasAdminTestV257-775824531-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:01.214136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18be82c8-11b6-4647-9f78-525fb03db194 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:01.214665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18be82c8-11b6-4647-9f78-525fb03db194 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:01.215220 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18be82c8-11b6-4647-9f78-525fb03db194 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:01.215869 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d0ceeeea-adb1-49b1-965b-b227d4cced84 tempest-QuotasAdminTestV257-775824531 tempest-QuotasAdminTestV257-775824531-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:01.216900 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18be82c8-11b6-4647-9f78-525fb03db194 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:01.218212 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18be82c8-11b6-4647-9f78-525fb03db194 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:01.219796 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18be82c8-11b6-4647-9f78-525fb03db194 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:01.232946 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d0ceeeea-adb1-49b1-965b-b227d4cced84 tempest-QuotasAdminTestV257-775824531 tempest-QuotasAdminTestV257-775824531-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:01.234654 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d0ceeeea-adb1-49b1-965b-b227d4cced84 tempest-QuotasAdminTestV257-775824531 tempest-QuotasAdminTestV257-775824531-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:01.238417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d0ceeeea-adb1-49b1-965b-b227d4cced84 tempest-QuotasAdminTestV257-775824531 tempest-QuotasAdminTestV257-775824531-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:01.350811 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d0ceeeea-adb1-49b1-965b-b227d4cced84 tempest-QuotasAdminTestV257-775824531 tempest-QuotasAdminTestV257-775824531-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/66ad9f5ab0304cd8bbd551accb4212b8" status: 200 len: 148 microversion: 2.57 time: 0.807686 Sep 17 20:52:01.352001 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 195/472] 10.222.0.26 () {62 vars in 1303 bytes} [Sat Sep 17 20:52:00 2022] PUT /compute/v2.1/os-quota-sets/66ad9f5ab0304cd8bbd551accb4212b8 => generated 148 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 17 20:52:01.370284 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c557b041-be18-46b3-a420-69a64f04a226 tempest-QuotasAdminTestV257-775824531 tempest-QuotasAdminTestV257-775824531-project-admin] Calling method '.version_select at 0x7f25a5da5c10>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:01.680698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c557b041-be18-46b3-a420-69a64f04a226 tempest-QuotasAdminTestV257-775824531 tempest-QuotasAdminTestV257-775824531-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:01.681227 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c557b041-be18-46b3-a420-69a64f04a226 tempest-QuotasAdminTestV257-775824531 tempest-QuotasAdminTestV257-775824531-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:01.681956 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c557b041-be18-46b3-a420-69a64f04a226 tempest-QuotasAdminTestV257-775824531 tempest-QuotasAdminTestV257-775824531-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:01.683076 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c557b041-be18-46b3-a420-69a64f04a226 tempest-QuotasAdminTestV257-775824531 tempest-QuotasAdminTestV257-775824531-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:01.683755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c557b041-be18-46b3-a420-69a64f04a226 tempest-QuotasAdminTestV257-775824531 tempest-QuotasAdminTestV257-775824531-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:01.684385 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c557b041-be18-46b3-a420-69a64f04a226 tempest-QuotasAdminTestV257-775824531 tempest-QuotasAdminTestV257-775824531-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:01.713345 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c557b041-be18-46b3-a420-69a64f04a226 tempest-QuotasAdminTestV257-775824531 tempest-QuotasAdminTestV257-775824531-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/66ad9f5ab0304cd8bbd551accb4212b8/detail" status: 200 len: 463 microversion: 2.57 time: 0.351713 Sep 17 20:52:01.722995 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 196/473] 10.222.0.26 () {60 vars in 1304 bytes} [Sat Sep 17 20:52:01 2022] GET /compute/v2.1/os-quota-sets/66ad9f5ab0304cd8bbd551accb4212b8/detail => generated 463 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:52:01.722995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4df70511-d379-4c80-8ad7-4fa8f7a6c381 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:01.722995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4df70511-d379-4c80-8ad7-4fa8f7a6c381 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:01.728568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4df70511-d379-4c80-8ad7-4fa8f7a6c381 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:01.729065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4df70511-d379-4c80-8ad7-4fa8f7a6c381 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:01.729767 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4df70511-d379-4c80-8ad7-4fa8f7a6c381 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:01.730754 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4df70511-d379-4c80-8ad7-4fa8f7a6c381 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:01.731441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4df70511-d379-4c80-8ad7-4fa8f7a6c381 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:01.732091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4df70511-d379-4c80-8ad7-4fa8f7a6c381 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:02.209723 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-18be82c8-11b6-4647-9f78-525fb03db194 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:02.237416 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-18be82c8-11b6-4647-9f78-525fb03db194 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:02.240659 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-18be82c8-11b6-4647-9f78-525fb03db194 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:02.244616 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-18be82c8-11b6-4647-9f78-525fb03db194 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9" status: 200 len: 1362 microversion: 2.25 time: 1.088654 Sep 17 20:52:02.245937 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 278/474] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:01 2022] GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9 => generated 1362 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:02.256116 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fc1b3041-f1c8-4da4-8f7d-2ed0245b3f50 tempest-QuotasAdminTestV257-775824531 tempest-QuotasAdminTestV257-775824531-project-admin] Action: 'update', calling method: .version_select at 0x7f25a5c381f0>, body: {"quota_set": {"ram": "2048"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:02.339395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4df70511-d379-4c80-8ad7-4fa8f7a6c381 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:02.352387 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4df70511-d379-4c80-8ad7-4fa8f7a6c381 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1311 microversion: 2.1 time: 0.634553 Sep 17 20:52:02.353252 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 197/475] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:01 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1311 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:02.364246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-279a41c8-ff7e-40d7-8c23-74db5fe19e46 req-570f97d2-2399-4135-953c-1bcd252eb295 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7289e6c1-bbfd-4239-8a82-43ffe2335ec9", "tag": "d7427540-da45-49cd-8b9c-b7aa57d8fc78"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:02.393147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-279a41c8-ff7e-40d7-8c23-74db5fe19e46 req-570f97d2-2399-4135-953c-1bcd252eb295 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:02.394179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-279a41c8-ff7e-40d7-8c23-74db5fe19e46 req-570f97d2-2399-4135-953c-1bcd252eb295 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:02.394864 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-279a41c8-ff7e-40d7-8c23-74db5fe19e46 req-570f97d2-2399-4135-953c-1bcd252eb295 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:02.428478 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-279a41c8-ff7e-40d7-8c23-74db5fe19e46 req-570f97d2-2399-4135-953c-1bcd252eb295 service nova] Creating event network-changed:d7427540-da45-49cd-8b9c-b7aa57d8fc78 for instance 7289e6c1-bbfd-4239-8a82-43ffe2335ec9 on nch1-master-1 Sep 17 20:52:02.441965 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-279a41c8-ff7e-40d7-8c23-74db5fe19e46 req-570f97d2-2399-4135-953c-1bcd252eb295 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085442 Sep 17 20:52:02.443520 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 198/476] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:52:02.532274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc1b3041-f1c8-4da4-8f7d-2ed0245b3f50 tempest-QuotasAdminTestV257-775824531 tempest-QuotasAdminTestV257-775824531-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:02.533676 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc1b3041-f1c8-4da4-8f7d-2ed0245b3f50 tempest-QuotasAdminTestV257-775824531 tempest-QuotasAdminTestV257-775824531-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:02.534575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc1b3041-f1c8-4da4-8f7d-2ed0245b3f50 tempest-QuotasAdminTestV257-775824531 tempest-QuotasAdminTestV257-775824531-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:02.535583 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc1b3041-f1c8-4da4-8f7d-2ed0245b3f50 tempest-QuotasAdminTestV257-775824531 tempest-QuotasAdminTestV257-775824531-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:02.537129 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc1b3041-f1c8-4da4-8f7d-2ed0245b3f50 tempest-QuotasAdminTestV257-775824531 tempest-QuotasAdminTestV257-775824531-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:02.541002 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc1b3041-f1c8-4da4-8f7d-2ed0245b3f50 tempest-QuotasAdminTestV257-775824531 tempest-QuotasAdminTestV257-775824531-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:02.631898 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:DELETE=3,nova_api:SELECT=93,nova_api:INSERT=4 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:52:02.674515 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc1b3041-f1c8-4da4-8f7d-2ed0245b3f50 tempest-QuotasAdminTestV257-775824531 tempest-QuotasAdminTestV257-775824531-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:02.675380 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc1b3041-f1c8-4da4-8f7d-2ed0245b3f50 tempest-QuotasAdminTestV257-775824531 tempest-QuotasAdminTestV257-775824531-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:02.676011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc1b3041-f1c8-4da4-8f7d-2ed0245b3f50 tempest-QuotasAdminTestV257-775824531 tempest-QuotasAdminTestV257-775824531-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:02.677011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc1b3041-f1c8-4da4-8f7d-2ed0245b3f50 tempest-QuotasAdminTestV257-775824531 tempest-QuotasAdminTestV257-775824531-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:02.677690 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc1b3041-f1c8-4da4-8f7d-2ed0245b3f50 tempest-QuotasAdminTestV257-775824531 tempest-QuotasAdminTestV257-775824531-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:02.678296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc1b3041-f1c8-4da4-8f7d-2ed0245b3f50 tempest-QuotasAdminTestV257-775824531 tempest-QuotasAdminTestV257-775824531-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:02.751726 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fc1b3041-f1c8-4da4-8f7d-2ed0245b3f50 tempest-QuotasAdminTestV257-775824531 tempest-QuotasAdminTestV257-775824531-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/66ad9f5ab0304cd8bbd551accb4212b8?user_id=4066cd60f9df4c21887969d380704e48" status: 200 len: 148 microversion: 2.57 time: 0.504646 Sep 17 20:52:02.753047 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 279/477] 10.222.0.26 () {62 vars in 1384 bytes} [Sat Sep 17 20:52:02 2022] PUT /compute/v2.1/os-quota-sets/66ad9f5ab0304cd8bbd551accb4212b8?user_id=4066cd60f9df4c21887969d380704e48 => generated 148 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:52:02.766579 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8665b9af-54af-4660-a244-9396a7c734c4 tempest-QuotasAdminTestV257-775824531 tempest-QuotasAdminTestV257-775824531-project-admin] Calling method '.version_select at 0x7f25a5bcdca0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:02.848789 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8665b9af-54af-4660-a244-9396a7c734c4 tempest-QuotasAdminTestV257-775824531 tempest-QuotasAdminTestV257-775824531-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/66ad9f5ab0304cd8bbd551accb4212b8?user_id=4066cd60f9df4c21887969d380704e48" status: 200 len: 190 microversion: 2.57 time: 0.088038 Sep 17 20:52:02.850081 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 199/478] 10.222.0.26 () {60 vars in 1364 bytes} [Sat Sep 17 20:52:02 2022] GET /compute/v2.1/os-quota-sets/66ad9f5ab0304cd8bbd551accb4212b8?user_id=4066cd60f9df4c21887969d380704e48 => generated 190 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:52:03.276959 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7e4cd566-d69d-45d1-92dc-16f135bba46e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:03.277745 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7e4cd566-d69d-45d1-92dc-16f135bba46e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:03.290793 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e4cd566-d69d-45d1-92dc-16f135bba46e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:03.291727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e4cd566-d69d-45d1-92dc-16f135bba46e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:03.294044 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e4cd566-d69d-45d1-92dc-16f135bba46e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:03.295985 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e4cd566-d69d-45d1-92dc-16f135bba46e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:03.298062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e4cd566-d69d-45d1-92dc-16f135bba46e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:03.299780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e4cd566-d69d-45d1-92dc-16f135bba46e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:03.377407 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-312255c8-ce66-4813-b277-a6f93c47b0ef tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:03.379223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-312255c8-ce66-4813-b277-a6f93c47b0ef tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:03.415773 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-312255c8-ce66-4813-b277-a6f93c47b0ef tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:03.420064 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-312255c8-ce66-4813-b277-a6f93c47b0ef tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:03.423491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-312255c8-ce66-4813-b277-a6f93c47b0ef tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:03.431152 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-312255c8-ce66-4813-b277-a6f93c47b0ef tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:03.434612 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-312255c8-ce66-4813-b277-a6f93c47b0ef tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:03.438759 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-312255c8-ce66-4813-b277-a6f93c47b0ef tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:04.078581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7e4cd566-d69d-45d1-92dc-16f135bba46e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:04.091608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7e4cd566-d69d-45d1-92dc-16f135bba46e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:04.093051 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7e4cd566-d69d-45d1-92dc-16f135bba46e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:04.094223 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7e4cd566-d69d-45d1-92dc-16f135bba46e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9" status: 200 len: 1362 microversion: 2.25 time: 0.821585 Sep 17 20:52:04.098791 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 280/479] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:03 2022] GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9 => generated 1362 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:04.112821 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-312255c8-ce66-4813-b277-a6f93c47b0ef tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:04.124575 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-312255c8-ce66-4813-b277-a6f93c47b0ef tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1311 microversion: 2.1 time: 0.751653 Sep 17 20:52:04.129439 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 200/480] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:03 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1311 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:04.996652 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-45ed6a61-c00a-4bfa-ae36-b2c982db6a1b tempest-FloatingIPsNegativeTestJSON-988493244 tempest-FloatingIPsNegativeTestJSON-988493244-project] Calling method '.version_select at 0x7f25a5c385e0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:05.130541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9435db58-e591-4f42-a0ce-dfcbf398c21d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:05.132458 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9435db58-e591-4f42-a0ce-dfcbf398c21d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:05.148511 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9435db58-e591-4f42-a0ce-dfcbf398c21d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:05.150205 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9435db58-e591-4f42-a0ce-dfcbf398c21d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:05.151343 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9435db58-e591-4f42-a0ce-dfcbf398c21d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:05.153441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9435db58-e591-4f42-a0ce-dfcbf398c21d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:05.154185 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9435db58-e591-4f42-a0ce-dfcbf398c21d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:05.155003 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9435db58-e591-4f42-a0ce-dfcbf398c21d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:05.634638 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-45ed6a61-c00a-4bfa-ae36-b2c982db6a1b tempest-FloatingIPsNegativeTestJSON-988493244 tempest-FloatingIPsNegativeTestJSON-988493244-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.792395 Sep 17 20:52:05.647362 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 281/481] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Sep 17 20:52:04 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:52:05.653213 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-114e3b70-7596-4d87-aada-4dc5fdfc941b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:05.655011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-114e3b70-7596-4d87-aada-4dc5fdfc941b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:05.676055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-114e3b70-7596-4d87-aada-4dc5fdfc941b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:05.678185 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-114e3b70-7596-4d87-aada-4dc5fdfc941b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:05.679608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-114e3b70-7596-4d87-aada-4dc5fdfc941b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:05.681620 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-114e3b70-7596-4d87-aada-4dc5fdfc941b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:05.682196 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-114e3b70-7596-4d87-aada-4dc5fdfc941b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:05.684562 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-114e3b70-7596-4d87-aada-4dc5fdfc941b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:06.212947 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-114e3b70-7596-4d87-aada-4dc5fdfc941b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:06.230283 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-114e3b70-7596-4d87-aada-4dc5fdfc941b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1311 microversion: 2.1 time: 0.578052 Sep 17 20:52:06.232726 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 282/482] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:05 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1311 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:06.255118 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e33763dc-1d28-44f2-a284-2bcdc86f1d9c tempest-FloatingIPsNegativeTestJSON-988493244 tempest-FloatingIPsNegativeTestJSON-988493244-project] Action: 'create', calling method: .version_select at 0x7f25a5c38f70>, body: {"pool": "non_exist_pool"} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:06.256464 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9435db58-e591-4f42-a0ce-dfcbf398c21d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:06.284594 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9435db58-e591-4f42-a0ce-dfcbf398c21d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:06.292009 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9435db58-e591-4f42-a0ce-dfcbf398c21d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:06.295754 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9435db58-e591-4f42-a0ce-dfcbf398c21d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9" status: 200 len: 1362 microversion: 2.25 time: 1.175138 Sep 17 20:52:06.298166 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 201/483] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:05 2022] GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9 => generated 1362 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:06.395266 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-e33763dc-1d28-44f2-a284-2bcdc86f1d9c tempest-FloatingIPsNegativeTestJSON-988493244 tempest-FloatingIPsNegativeTestJSON-988493244-project] HTTP exception thrown: Floating IP pool not found. Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e33763dc-1d28-44f2-a284-2bcdc86f1d9c tempest-FloatingIPsNegativeTestJSON-988493244 tempest-FloatingIPsNegativeTestJSON-988493244-project] Request method failure captured: Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 26 Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjN0F0m7YFKKbStgXL6U9ZLb9tfssCTKjAnNx4e16tDUbKF4OarQM20rdONdHGdpJyrV58ZKhVpNnzIYBvXjqH7zRzr-In-PXbNK5caNkoowXyPGjpFMeokfgqv068cBwWRsNSIIxrjMKZIKenmBg3CKeo8jYI28GFwXEPk9DLkPg_I Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 4a80cf8bf5be4795a0be8a65a5b389e5 Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-988493244 Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4a80cf8bf5be4795a0be8a65a5b389e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4a80cf8bf5be4795a0be8a65a5b389e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4a80cf8bf5be4795a0be8a65a5b389e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4a80cf8bf5be4795a0be8a65a5b389e5", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-988493244 Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 4a80cf8bf5be4795a0be8a65a5b389e5 Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-988493244 Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-FloatingIPsNegativeTestJSON-988493244-project Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 2fc322d5713f443d8351f65b132e703a Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-988493244-project Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: {"pool": "non_exist_pool"} Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: exception: Floating IP pool not found. Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'body': {'pool': 'non_exist_pool'}} Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:52:06.399075 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:52:06.404843 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Sep 17 20:52:06.404843 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:52:06.404843 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e33763dc-1d28-44f2-a284-2bcdc86f1d9c tempest-FloatingIPsNegativeTestJSON-988493244 tempest-FloatingIPsNegativeTestJSON-988493244-project] Returning 404 to user: Floating IP pool not found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:52:06.404843 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e33763dc-1d28-44f2-a284-2bcdc86f1d9c tempest-FloatingIPsNegativeTestJSON-988493244 tempest-FloatingIPsNegativeTestJSON-988493244-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.166106 Sep 17 20:52:06.404843 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 283/484] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Sep 17 20:52:06 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 20:52:06.411694 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c3fcbbf8-4942-48fe-b717-7841d19dc203 tempest-FloatingIPsNegativeTestJSON-988493244 tempest-FloatingIPsNegativeTestJSON-988493244-project] Calling method '.version_select at 0x7f25a5bcd4c0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:06.482662 ncdv-master-1 devstack@n-api.service[140523]: DEBUG neutronclient.v2_0.client [None req-c3fcbbf8-4942-48fe-b717-7841d19dc203 tempest-FloatingIPsNegativeTestJSON-988493244 tempest-FloatingIPsNegativeTestJSON-988493244-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 22540699-5a09-4134-a0f6-b3121ec91094 could not be found", "detail": ""}} {{(pid=140523) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 17 20:52:06.483371 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-c3fcbbf8-4942-48fe-b717-7841d19dc203 tempest-FloatingIPsNegativeTestJSON-988493244 tempest-FloatingIPsNegativeTestJSON-988493244-project] HTTP exception thrown: Floating IP not found for ID 22540699-5a09-4134-a0f6-b3121ec91094 Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c3fcbbf8-4942-48fe-b717-7841d19dc203 tempest-FloatingIPsNegativeTestJSON-988493244 tempest-FloatingIPsNegativeTestJSON-988493244-project] Request method failure captured: Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/os-floating-ips/22540699-5a09-4134-a0f6-b3121ec91094 HTTP/1.1 Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjN0F0m7YFKKbStgXL6U9ZLb9tfssCTKjAnNx4e16tDUbKF4OarQM20rdONdHGdpJyrV58ZKhVpNnzIYBvXjqH7zRzr-In-PXbNK5caNkoowXyPGjpFMeokfgqv068cBwWRsNSIIxrjMKZIKenmBg3CKeo8jYI28GFwXEPk9DLkPg_I Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 4a80cf8bf5be4795a0be8a65a5b389e5 Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-988493244 Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4a80cf8bf5be4795a0be8a65a5b389e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4a80cf8bf5be4795a0be8a65a5b389e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4a80cf8bf5be4795a0be8a65a5b389e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4a80cf8bf5be4795a0be8a65a5b389e5", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-988493244 Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 4a80cf8bf5be4795a0be8a65a5b389e5 Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-988493244 Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-FloatingIPsNegativeTestJSON-988493244-project Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 2fc322d5713f443d8351f65b132e703a Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-988493244-project Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: exception: Floating IP not found for ID 22540699-5a09-4134-a0f6-b3121ec91094 Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '22540699-5a09-4134-a0f6-b3121ec91094'} Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 22540699-5a09-4134-a0f6-b3121ec91094 could not be found Sep 17 20:52:06.485979 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-63161515-7e68-458a-bd2b-0410cb952cc2'] Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 22540699-5a09-4134-a0f6-b3121ec91094. Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 22540699-5a09-4134-a0f6-b3121ec91094 Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 22540699-5a09-4134-a0f6-b3121ec91094 Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c3fcbbf8-4942-48fe-b717-7841d19dc203 tempest-FloatingIPsNegativeTestJSON-988493244 tempest-FloatingIPsNegativeTestJSON-988493244-project] Returning 404 to user: Floating IP not found for ID 22540699-5a09-4134-a0f6-b3121ec91094 {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c3fcbbf8-4942-48fe-b717-7841d19dc203 tempest-FloatingIPsNegativeTestJSON-988493244 tempest-FloatingIPsNegativeTestJSON-988493244-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/22540699-5a09-4134-a0f6-b3121ec91094" status: 404 len: 111 microversion: 2.1 time: 0.080279 Sep 17 20:52:06.490822 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 202/485] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Sep 17 20:52:06 2022] DELETE /compute/v2.1/os-floating-ips/22540699-5a09-4134-a0f6-b3121ec91094 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:52:07.262470 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-560861f1-c1ad-4722-a909-4da7ccbc1ef2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:07.264679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-560861f1-c1ad-4722-a909-4da7ccbc1ef2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:07.287280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-560861f1-c1ad-4722-a909-4da7ccbc1ef2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:07.287863 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-560861f1-c1ad-4722-a909-4da7ccbc1ef2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:07.288313 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-560861f1-c1ad-4722-a909-4da7ccbc1ef2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:07.292026 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-560861f1-c1ad-4722-a909-4da7ccbc1ef2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:07.292672 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-560861f1-c1ad-4722-a909-4da7ccbc1ef2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:07.293116 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-560861f1-c1ad-4722-a909-4da7ccbc1ef2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:07.326639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3781f542-85e5-4351-8987-6ecce78daa58 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:07.327252 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3781f542-85e5-4351-8987-6ecce78daa58 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:07.348875 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3781f542-85e5-4351-8987-6ecce78daa58 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:07.360595 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3781f542-85e5-4351-8987-6ecce78daa58 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:07.361539 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3781f542-85e5-4351-8987-6ecce78daa58 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:07.362504 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3781f542-85e5-4351-8987-6ecce78daa58 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:07.363704 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3781f542-85e5-4351-8987-6ecce78daa58 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:07.364319 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3781f542-85e5-4351-8987-6ecce78daa58 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:07.802091 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-560861f1-c1ad-4722-a909-4da7ccbc1ef2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:07.810229 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-560861f1-c1ad-4722-a909-4da7ccbc1ef2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1311 microversion: 2.1 time: 0.554018 Sep 17 20:52:07.812875 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 284/486] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:07 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1311 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:08.178616 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3781f542-85e5-4351-8987-6ecce78daa58 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:08.199863 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3781f542-85e5-4351-8987-6ecce78daa58 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:08.212831 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3781f542-85e5-4351-8987-6ecce78daa58 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:08.218052 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3781f542-85e5-4351-8987-6ecce78daa58 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9" status: 200 len: 1362 microversion: 2.25 time: 0.897240 Sep 17 20:52:08.246249 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 203/487] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:07 2022] GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9 => generated 1362 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:08.838918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c3405bc1-7298-4426-97ef-69980f99eefb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:08.841566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c3405bc1-7298-4426-97ef-69980f99eefb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:08.854786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3405bc1-7298-4426-97ef-69980f99eefb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:08.855539 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3405bc1-7298-4426-97ef-69980f99eefb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:08.856186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3405bc1-7298-4426-97ef-69980f99eefb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:08.857133 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3405bc1-7298-4426-97ef-69980f99eefb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:08.857913 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3405bc1-7298-4426-97ef-69980f99eefb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:08.861948 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3405bc1-7298-4426-97ef-69980f99eefb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:08.983917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-035b7f06-7090-4328-8ccc-074f852f74a6 req-e85496cb-3119-43c2-aeec-a67d9015a08a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700", "name": "network-vif-plugged", "status": "completed", "tag": "3b2dfcf9-36b6-4299-8814-a29f994bcc2f"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:09.008454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-035b7f06-7090-4328-8ccc-074f852f74a6 req-e85496cb-3119-43c2-aeec-a67d9015a08a service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:09.010303 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-035b7f06-7090-4328-8ccc-074f852f74a6 req-e85496cb-3119-43c2-aeec-a67d9015a08a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:09.010952 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-035b7f06-7090-4328-8ccc-074f852f74a6 req-e85496cb-3119-43c2-aeec-a67d9015a08a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:09.051827 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-035b7f06-7090-4328-8ccc-074f852f74a6 req-e85496cb-3119-43c2-aeec-a67d9015a08a service nova] Creating event network-vif-plugged:3b2dfcf9-36b6-4299-8814-a29f994bcc2f for instance e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 on nch2-master-1 Sep 17 20:52:09.061047 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-035b7f06-7090-4328-8ccc-074f852f74a6 req-e85496cb-3119-43c2-aeec-a67d9015a08a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078066 Sep 17 20:52:09.063227 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 204/488] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:52:09.256651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-37f47b19-dc94-42a5-9e08-0b30ad4d84c6 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:09.257873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-37f47b19-dc94-42a5-9e08-0b30ad4d84c6 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:09.284166 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-37f47b19-dc94-42a5-9e08-0b30ad4d84c6 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:09.293232 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-37f47b19-dc94-42a5-9e08-0b30ad4d84c6 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:09.293888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-37f47b19-dc94-42a5-9e08-0b30ad4d84c6 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:09.294780 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-37f47b19-dc94-42a5-9e08-0b30ad4d84c6 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:09.295362 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-37f47b19-dc94-42a5-9e08-0b30ad4d84c6 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:09.299644 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-37f47b19-dc94-42a5-9e08-0b30ad4d84c6 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:10.161853 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c3405bc1-7298-4426-97ef-69980f99eefb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:10.177679 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c3405bc1-7298-4426-97ef-69980f99eefb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1311 microversion: 2.1 time: 1.340031 Sep 17 20:52:10.178859 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 285/489] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:08 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1311 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:10.385415 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-37f47b19-dc94-42a5-9e08-0b30ad4d84c6 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:10.415559 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-37f47b19-dc94-42a5-9e08-0b30ad4d84c6 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:10.432658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-37f47b19-dc94-42a5-9e08-0b30ad4d84c6 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:10.439360 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-37f47b19-dc94-42a5-9e08-0b30ad4d84c6 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9" status: 200 len: 1362 microversion: 2.25 time: 1.189842 Sep 17 20:52:10.442835 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 205/490] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:09 2022] GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9 => generated 1362 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:11.208279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-38251f28-eea4-4466-ada1-6abe98ae7f54 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:11.208913 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-38251f28-eea4-4466-ada1-6abe98ae7f54 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:11.219176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-38251f28-eea4-4466-ada1-6abe98ae7f54 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:11.219692 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-38251f28-eea4-4466-ada1-6abe98ae7f54 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:11.220130 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-38251f28-eea4-4466-ada1-6abe98ae7f54 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:11.220860 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-38251f28-eea4-4466-ada1-6abe98ae7f54 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:11.227362 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-38251f28-eea4-4466-ada1-6abe98ae7f54 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:11.228540 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-38251f28-eea4-4466-ada1-6abe98ae7f54 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:11.319218 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=95 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:52:11.474689 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d7e44a5e-a8ca-4b57-a9b8-589f4909e54c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:11.475888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d7e44a5e-a8ca-4b57-a9b8-589f4909e54c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:11.485829 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d7e44a5e-a8ca-4b57-a9b8-589f4909e54c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:11.488521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d7e44a5e-a8ca-4b57-a9b8-589f4909e54c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:11.492019 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d7e44a5e-a8ca-4b57-a9b8-589f4909e54c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:11.498513 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d7e44a5e-a8ca-4b57-a9b8-589f4909e54c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:11.499213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d7e44a5e-a8ca-4b57-a9b8-589f4909e54c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:11.502080 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d7e44a5e-a8ca-4b57-a9b8-589f4909e54c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:11.705524 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:52:12.694700 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d7e44a5e-a8ca-4b57-a9b8-589f4909e54c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:12.699441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=5 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:52:12.704023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d7e44a5e-a8ca-4b57-a9b8-589f4909e54c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:12.714887 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d7e44a5e-a8ca-4b57-a9b8-589f4909e54c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:12.716076 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d7e44a5e-a8ca-4b57-a9b8-589f4909e54c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9" status: 200 len: 1362 microversion: 2.25 time: 1.248250 Sep 17 20:52:12.716653 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 206/491] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:11 2022] GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9 => generated 1362 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:12.747032 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=12 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:52:12.772676 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-38251f28-eea4-4466-ada1-6abe98ae7f54 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:12.786489 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-38251f28-eea4-4466-ada1-6abe98ae7f54 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1461 microversion: 2.1 time: 1.578948 Sep 17 20:52:12.811543 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 286/492] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:11 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1461 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:12.820675 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-814faa20-59b9-4918-92f7-5830dff19568 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:12.824738 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-814faa20-59b9-4918-92f7-5830dff19568 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:12.854380 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=26 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:52:12.861856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-814faa20-59b9-4918-92f7-5830dff19568 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:12.867093 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-814faa20-59b9-4918-92f7-5830dff19568 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:12.867735 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-814faa20-59b9-4918-92f7-5830dff19568 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:12.868734 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-814faa20-59b9-4918-92f7-5830dff19568 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:12.872017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-814faa20-59b9-4918-92f7-5830dff19568 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:12.873095 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-814faa20-59b9-4918-92f7-5830dff19568 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:13.255693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-814faa20-59b9-4918-92f7-5830dff19568 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:13.264242 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-814faa20-59b9-4918-92f7-5830dff19568 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Old instance type m1.heat2, new instance type m1.heat {{(pid=140523) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 17 20:52:13.299766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-814faa20-59b9-4918-92f7-5830dff19568 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:52:13.301405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-814faa20-59b9-4918-92f7-5830dff19568 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:52:13.303399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-814faa20-59b9-4918-92f7-5830dff19568 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:52:13.304087 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-814faa20-59b9-4918-92f7-5830dff19568 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:52:13.305424 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-814faa20-59b9-4918-92f7-5830dff19568 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:52:13.633956 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-814faa20-59b9-4918-92f7-5830dff19568 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "POST /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700/action" status: 202 len: 0 microversion: 2.1 time: 0.816345 Sep 17 20:52:13.638196 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 207/493] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:52:12 2022] POST /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700/action => generated 0 bytes in 822 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:52:13.650599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-da1969c7-70e0-4af3-978f-b39b806168a2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:13.651238 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-da1969c7-70e0-4af3-978f-b39b806168a2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:13.677240 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da1969c7-70e0-4af3-978f-b39b806168a2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:13.677965 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da1969c7-70e0-4af3-978f-b39b806168a2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:13.680054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da1969c7-70e0-4af3-978f-b39b806168a2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:13.682123 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da1969c7-70e0-4af3-978f-b39b806168a2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:13.683218 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da1969c7-70e0-4af3-978f-b39b806168a2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:13.685269 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da1969c7-70e0-4af3-978f-b39b806168a2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:13.852444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-15c99537-b5f6-4193-b900-1d490be65346 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1078097381", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": "none"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:13.945395 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-15c99537-b5f6-4193-b900-1d490be65346 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:52:13.950455 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-15c99537-b5f6-4193-b900-1d490be65346 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:52:13.951257 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-15c99537-b5f6-4193-b900-1d490be65346 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:52:13.951896 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-15c99537-b5f6-4193-b900-1d490be65346 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:52:13.952535 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-15c99537-b5f6-4193-b900-1d490be65346 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:52:13.969003 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-15c99537-b5f6-4193-b900-1d490be65346 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:13.971586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-15c99537-b5f6-4193-b900-1d490be65346 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:13.977764 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-15c99537-b5f6-4193-b900-1d490be65346 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:13.978874 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-15c99537-b5f6-4193-b900-1d490be65346 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:13.981035 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-15c99537-b5f6-4193-b900-1d490be65346 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:13.982081 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-15c99537-b5f6-4193-b900-1d490be65346 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:14.034064 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-15c99537-b5f6-4193-b900-1d490be65346 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Getting quotas for project d53ead9bed9640a88ca01af3a10626c5. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:52:14.045936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-15c99537-b5f6-4193-b900-1d490be65346 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Getting quotas for user a38f77df31e648f99763a2f785b6fb4a and project d53ead9bed9640a88ca01af3a10626c5. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:52:14.061370 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-15c99537-b5f6-4193-b900-1d490be65346 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:52:14.065612 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-15c99537-b5f6-4193-b900-1d490be65346 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:52:14.165054 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-15c99537-b5f6-4193-b900-1d490be65346 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.560552 Sep 17 20:52:14.174942 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 287/494] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Sep 17 20:52:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 17 20:52:14.192999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-49eef18b-292b-4707-ab2d-3dae9d029f44 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:14.194898 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-49eef18b-292b-4707-ab2d-3dae9d029f44 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:14.205943 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49eef18b-292b-4707-ab2d-3dae9d029f44 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:14.207468 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49eef18b-292b-4707-ab2d-3dae9d029f44 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:14.215175 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49eef18b-292b-4707-ab2d-3dae9d029f44 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:14.216884 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49eef18b-292b-4707-ab2d-3dae9d029f44 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:14.217965 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49eef18b-292b-4707-ab2d-3dae9d029f44 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:14.218759 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49eef18b-292b-4707-ab2d-3dae9d029f44 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:14.739967 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-49eef18b-292b-4707-ab2d-3dae9d029f44 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:14.756686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-49eef18b-292b-4707-ab2d-3dae9d029f44 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:14.761145 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-49eef18b-292b-4707-ab2d-3dae9d029f44 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:14.763662 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-49eef18b-292b-4707-ab2d-3dae9d029f44 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9" status: 200 len: 1362 microversion: 2.25 time: 0.586286 Sep 17 20:52:14.765838 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 288/495] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:14 2022] GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9 => generated 1362 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:14.780142 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ff7da69e-ee6b-4add-bc3c-cb600f5f07d0 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:14.786179 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ff7da69e-ee6b-4add-bc3c-cb600f5f07d0 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:14.867844 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-da1969c7-70e0-4af3-978f-b39b806168a2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:14.888074 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-da1969c7-70e0-4af3-978f-b39b806168a2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1470 microversion: 2.1 time: 1.244590 Sep 17 20:52:14.889005 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 208/496] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:13 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1470 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:15.068423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ff7da69e-ee6b-4add-bc3c-cb600f5f07d0 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:15.093186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ff7da69e-ee6b-4add-bc3c-cb600f5f07d0 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:15.100167 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ff7da69e-ee6b-4add-bc3c-cb600f5f07d0 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:15.134709 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ff7da69e-ee6b-4add-bc3c-cb600f5f07d0 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] 10.222.0.26 "PUT /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1359 microversion: 2.75 time: 0.366736 Sep 17 20:52:15.142876 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 289/497] 10.222.0.26 () {62 vars in 1297 bytes} [Sat Sep 17 20:52:14 2022] PUT /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1359 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:15.176969 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0c50f4ef-caaa-43a9-a7f6-e28c66744fbb tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:15.178353 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0c50f4ef-caaa-43a9-a7f6-e28c66744fbb tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:15.185088 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:52:15.192736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c50f4ef-caaa-43a9-a7f6-e28c66744fbb tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:15.193781 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c50f4ef-caaa-43a9-a7f6-e28c66744fbb tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:15.194578 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c50f4ef-caaa-43a9-a7f6-e28c66744fbb tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:15.195553 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c50f4ef-caaa-43a9-a7f6-e28c66744fbb tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:15.196564 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c50f4ef-caaa-43a9-a7f6-e28c66744fbb tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:15.197209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c50f4ef-caaa-43a9-a7f6-e28c66744fbb tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:15.635885 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0c50f4ef-caaa-43a9-a7f6-e28c66744fbb tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:15.653415 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0c50f4ef-caaa-43a9-a7f6-e28c66744fbb tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:15.656695 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0c50f4ef-caaa-43a9-a7f6-e28c66744fbb tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:15.674855 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0c50f4ef-caaa-43a9-a7f6-e28c66744fbb tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1363 microversion: 2.75 time: 0.501475 Sep 17 20:52:15.676851 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 209/498] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:15 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1363 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:15.795128 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e2cc9182-2387-44d4-9fe4-35a5e7b2d603 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:15.795924 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e2cc9182-2387-44d4-9fe4-35a5e7b2d603 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:15.822759 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2cc9182-2387-44d4-9fe4-35a5e7b2d603 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:15.825042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2cc9182-2387-44d4-9fe4-35a5e7b2d603 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:15.826125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2cc9182-2387-44d4-9fe4-35a5e7b2d603 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:15.830830 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2cc9182-2387-44d4-9fe4-35a5e7b2d603 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:15.835937 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2cc9182-2387-44d4-9fe4-35a5e7b2d603 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:15.836611 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2cc9182-2387-44d4-9fe4-35a5e7b2d603 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:15.923377 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-41692ec2-4d94-4e30-8fdc-fea771e2566b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:15.931548 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-41692ec2-4d94-4e30-8fdc-fea771e2566b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:15.953635 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-41692ec2-4d94-4e30-8fdc-fea771e2566b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:15.954525 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-41692ec2-4d94-4e30-8fdc-fea771e2566b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:15.956263 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-41692ec2-4d94-4e30-8fdc-fea771e2566b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:15.959419 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-41692ec2-4d94-4e30-8fdc-fea771e2566b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:15.960946 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-41692ec2-4d94-4e30-8fdc-fea771e2566b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:15.963360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-41692ec2-4d94-4e30-8fdc-fea771e2566b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:15.980006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:52:16.914334 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-41692ec2-4d94-4e30-8fdc-fea771e2566b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:16.934808 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-41692ec2-4d94-4e30-8fdc-fea771e2566b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1470 microversion: 2.1 time: 1.022580 Sep 17 20:52:16.944147 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 210/499] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:15 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1470 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:52:16.950952 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9462602f-4dc4-4db4-aff6-6126c3b35724 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:16.951915 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9462602f-4dc4-4db4-aff6-6126c3b35724 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:16.960028 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e2cc9182-2387-44d4-9fe4-35a5e7b2d603 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:16.971800 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e2cc9182-2387-44d4-9fe4-35a5e7b2d603 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:16.976119 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e2cc9182-2387-44d4-9fe4-35a5e7b2d603 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:16.983274 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e2cc9182-2387-44d4-9fe4-35a5e7b2d603 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9" status: 200 len: 1362 microversion: 2.25 time: 1.194784 Sep 17 20:52:16.983893 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 290/500] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:15 2022] GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9 => generated 1362 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:16.985390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9462602f-4dc4-4db4-aff6-6126c3b35724 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:16.986103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9462602f-4dc4-4db4-aff6-6126c3b35724 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:16.986636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9462602f-4dc4-4db4-aff6-6126c3b35724 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:16.987450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9462602f-4dc4-4db4-aff6-6126c3b35724 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:16.988000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9462602f-4dc4-4db4-aff6-6126c3b35724 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:16.988515 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9462602f-4dc4-4db4-aff6-6126c3b35724 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:17.069701 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-4a178992-24ff-4a93-a81c-e479602e6dce req-fb6f3fdf-994e-4136-90ee-8e5805e7c908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7289e6c1-bbfd-4239-8a82-43ffe2335ec9", "name": "network-vif-plugged", "status": "completed", "tag": "d7427540-da45-49cd-8b9c-b7aa57d8fc78"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:17.079911 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4a178992-24ff-4a93-a81c-e479602e6dce req-fb6f3fdf-994e-4136-90ee-8e5805e7c908 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:17.080786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4a178992-24ff-4a93-a81c-e479602e6dce req-fb6f3fdf-994e-4136-90ee-8e5805e7c908 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:17.081446 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4a178992-24ff-4a93-a81c-e479602e6dce req-fb6f3fdf-994e-4136-90ee-8e5805e7c908 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:17.095711 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-4a178992-24ff-4a93-a81c-e479602e6dce req-fb6f3fdf-994e-4136-90ee-8e5805e7c908 service nova] Creating event network-vif-plugged:d7427540-da45-49cd-8b9c-b7aa57d8fc78 for instance 7289e6c1-bbfd-4239-8a82-43ffe2335ec9 on nch1-master-1 Sep 17 20:52:17.103923 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-4a178992-24ff-4a93-a81c-e479602e6dce req-fb6f3fdf-994e-4136-90ee-8e5805e7c908 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039592 Sep 17 20:52:17.105106 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 291/501] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:52:17.133833 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9462602f-4dc4-4db4-aff6-6126c3b35724 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:17.146479 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9462602f-4dc4-4db4-aff6-6126c3b35724 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:17.150232 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9462602f-4dc4-4db4-aff6-6126c3b35724 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:17.157856 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9462602f-4dc4-4db4-aff6-6126c3b35724 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1417 microversion: 2.75 time: 0.212270 Sep 17 20:52:17.158682 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 211/502] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:16 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1417 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:17.968422 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-24694588-f5d0-4091-b1fe-ad3733d5a698 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:17.971182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-24694588-f5d0-4091-b1fe-ad3733d5a698 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:17.980508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-24694588-f5d0-4091-b1fe-ad3733d5a698 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:17.981768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-24694588-f5d0-4091-b1fe-ad3733d5a698 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:17.982445 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-24694588-f5d0-4091-b1fe-ad3733d5a698 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:17.983422 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-24694588-f5d0-4091-b1fe-ad3733d5a698 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:17.984107 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-24694588-f5d0-4091-b1fe-ad3733d5a698 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:17.984741 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-24694588-f5d0-4091-b1fe-ad3733d5a698 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:18.016891 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f9270945-8682-46b1-b88a-a59ace406266 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:18.018841 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f9270945-8682-46b1-b88a-a59ace406266 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:18.032269 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f9270945-8682-46b1-b88a-a59ace406266 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:18.033187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f9270945-8682-46b1-b88a-a59ace406266 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:18.038205 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f9270945-8682-46b1-b88a-a59ace406266 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:18.039365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f9270945-8682-46b1-b88a-a59ace406266 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:18.041025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f9270945-8682-46b1-b88a-a59ace406266 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:18.044516 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f9270945-8682-46b1-b88a-a59ace406266 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:19.217374 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f9270945-8682-46b1-b88a-a59ace406266 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:19.237564 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f9270945-8682-46b1-b88a-a59ace406266 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:19.241963 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f9270945-8682-46b1-b88a-a59ace406266 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:19.245223 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f9270945-8682-46b1-b88a-a59ace406266 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9" status: 200 len: 1362 microversion: 2.25 time: 1.232837 Sep 17 20:52:19.267613 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 212/503] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:18 2022] GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9 => generated 1362 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:19.273876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5d026e62-8c2c-46bc-9c5d-ba674345e967 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:19.274667 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5d026e62-8c2c-46bc-9c5d-ba674345e967 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:19.281870 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d026e62-8c2c-46bc-9c5d-ba674345e967 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:19.282595 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d026e62-8c2c-46bc-9c5d-ba674345e967 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:19.283445 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d026e62-8c2c-46bc-9c5d-ba674345e967 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:19.284314 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d026e62-8c2c-46bc-9c5d-ba674345e967 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:19.284924 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d026e62-8c2c-46bc-9c5d-ba674345e967 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:19.285521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d026e62-8c2c-46bc-9c5d-ba674345e967 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:19.328697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-24694588-f5d0-4091-b1fe-ad3733d5a698 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:19.338910 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-24694588-f5d0-4091-b1fe-ad3733d5a698 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1470 microversion: 2.1 time: 1.374858 Sep 17 20:52:19.355486 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 292/504] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:17 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1470 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:19.567323 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cc7abffa-cf5f-4134-b849-1e6915d085f7 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:19.576547 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cc7abffa-cf5f-4134-b849-1e6915d085f7 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.215749 Sep 17 20:52:19.578286 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 293/505] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Sep 17 20:52:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:52:19.646054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5d026e62-8c2c-46bc-9c5d-ba674345e967 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:19.659133 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5d026e62-8c2c-46bc-9c5d-ba674345e967 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:19.667540 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5d026e62-8c2c-46bc-9c5d-ba674345e967 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:19.679499 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5d026e62-8c2c-46bc-9c5d-ba674345e967 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1438 microversion: 2.75 time: 0.410123 Sep 17 20:52:19.684925 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 213/506] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:19 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1438 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:19.721764 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-95785a42-efba-4d10-8091-b8aafe497d7a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:19.724711 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-95785a42-efba-4d10-8091-b8aafe497d7a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:19.742580 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95785a42-efba-4d10-8091-b8aafe497d7a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:19.743088 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95785a42-efba-4d10-8091-b8aafe497d7a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:19.743527 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95785a42-efba-4d10-8091-b8aafe497d7a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:19.744270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95785a42-efba-4d10-8091-b8aafe497d7a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:19.744744 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95785a42-efba-4d10-8091-b8aafe497d7a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:19.745170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95785a42-efba-4d10-8091-b8aafe497d7a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:19.770638 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-eab1a84f-1aa1-4a8e-b130-17001ac0bab4 tempest-ServersWithSpecificFlavorTestJSON-1158539409 tempest-ServersWithSpecificFlavorTestJSON-1158539409-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1287773277", "id": 1073285898, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:19.824057 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-eab1a84f-1aa1-4a8e-b130-17001ac0bab4 tempest-ServersWithSpecificFlavorTestJSON-1158539409 tempest-ServersWithSpecificFlavorTestJSON-1158539409-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.237729 Sep 17 20:52:19.836465 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 294/507] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:52:19 2022] POST /compute/v2.1/flavors => generated 425 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:52:19.848047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ae196481-f18c-4da5-9db8-55f505fa49e8 tempest-ServersWithSpecificFlavorTestJSON-1158539409 tempest-ServersWithSpecificFlavorTestJSON-1158539409-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:19.871939 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ae196481-f18c-4da5-9db8-55f505fa49e8 tempest-ServersWithSpecificFlavorTestJSON-1158539409 tempest-ServersWithSpecificFlavorTestJSON-1158539409-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.033940 Sep 17 20:52:19.872830 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 295/508] 10.222.0.26 () {58 vars in 1182 bytes} [Sat Sep 17 20:52:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:52:19.887603 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2e0ede79-5528-42c0-bede-ebe538a77f1d tempest-ServersWithSpecificFlavorTestJSON-1158539409 tempest-ServersWithSpecificFlavorTestJSON-1158539409-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-625791384", "id": 689354539, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:19.939267 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2e0ede79-5528-42c0-bede-ebe538a77f1d tempest-ServersWithSpecificFlavorTestJSON-1158539409 tempest-ServersWithSpecificFlavorTestJSON-1158539409-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.059237 Sep 17 20:52:19.953548 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 296/509] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:52:19 2022] POST /compute/v2.1/flavors => generated 421 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:52:19.957447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-95785a42-efba-4d10-8091-b8aafe497d7a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:52:19.960393 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-61661dfa-e3af-4676-b72a-05f6c854d76c tempest-ServersWithSpecificFlavorTestJSON-1158539409 tempest-ServersWithSpecificFlavorTestJSON-1158539409-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:19.962176 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-95785a42-efba-4d10-8091-b8aafe497d7a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:52:19.963476 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-95785a42-efba-4d10-8091-b8aafe497d7a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:52:19.964433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-95785a42-efba-4d10-8091-b8aafe497d7a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:52:19.965116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-95785a42-efba-4d10-8091-b8aafe497d7a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:52:19.980643 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-61661dfa-e3af-4676-b72a-05f6c854d76c tempest-ServersWithSpecificFlavorTestJSON-1158539409 tempest-ServersWithSpecificFlavorTestJSON-1158539409-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.025833 Sep 17 20:52:19.984169 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 297/510] 10.222.0.26 () {58 vars in 1182 bytes} [Sat Sep 17 20:52:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:52:20.024187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0480b564-2a3f-4857-ad98-0e1d73086433 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Action: 'create', calling method: .version_select at 0x7f25a5afddc0>, body: {"keypair": {"name": "tempest-keypair-714475675", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCVuBbLqmqmZ61elNQqpuzwTLNxDFUaZKmGTEjvGsKmfMT1Fi/0z2PNkSK2RT+0uA60x17AgbC4i5zSLv5+Ejc4DddNt5mfNL55gIz+DBJmByDsHu21E03RWY6tszsNCgQ=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:20.106925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-0480b564-2a3f-4857-ad98-0e1d73086433 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Getting quotas for project 1f305d163acf499c9808c5f11150a7cf. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:52:20.114328 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-0480b564-2a3f-4857-ad98-0e1d73086433 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Getting quotas for user 42f7c0fdad9346c58949928300021b07 and project 1f305d163acf499c9808c5f11150a7cf. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:52:20.133197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-95785a42-efba-4d10-8091-b8aafe497d7a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:20.140967 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95785a42-efba-4d10-8091-b8aafe497d7a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:20.142036 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95785a42-efba-4d10-8091-b8aafe497d7a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:20.143225 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95785a42-efba-4d10-8091-b8aafe497d7a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:20.145116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95785a42-efba-4d10-8091-b8aafe497d7a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:20.145901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95785a42-efba-4d10-8091-b8aafe497d7a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:20.146504 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95785a42-efba-4d10-8091-b8aafe497d7a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:20.193875 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0480b564-2a3f-4857-ad98-0e1d73086433 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.183082 Sep 17 20:52:20.194498 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 298/511] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 20:52:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:52:20.275522 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3f929152-5bb0-4677-a0f0-ec4fa84d2dd2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:20.276148 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3f929152-5bb0-4677-a0f0-ec4fa84d2dd2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:20.292497 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f929152-5bb0-4677-a0f0-ec4fa84d2dd2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:20.293009 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f929152-5bb0-4677-a0f0-ec4fa84d2dd2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:20.293676 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f929152-5bb0-4677-a0f0-ec4fa84d2dd2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:20.294580 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f929152-5bb0-4677-a0f0-ec4fa84d2dd2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:20.297151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f929152-5bb0-4677-a0f0-ec4fa84d2dd2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:20.297779 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f929152-5bb0-4677-a0f0-ec4fa84d2dd2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:20.363699 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-95785a42-efba-4d10-8091-b8aafe497d7a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:20.406484 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-95785a42-efba-4d10-8091-b8aafe497d7a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:20.412344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-95785a42-efba-4d10-8091-b8aafe497d7a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:20.428299 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-95785a42-efba-4d10-8091-b8aafe497d7a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] 10.222.0.26 "POST /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91/action" status: 202 len: 1495 microversion: 2.75 time: 0.713506 Sep 17 20:52:20.451893 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 214/512] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Sep 17 20:52:19 2022] POST /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91/action => generated 1495 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 17 20:52:20.464190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e217b480-66fe-42b4-b197-f0fd8470b49e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:20.465296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e217b480-66fe-42b4-b197-f0fd8470b49e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:20.473000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e217b480-66fe-42b4-b197-f0fd8470b49e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:20.473867 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e217b480-66fe-42b4-b197-f0fd8470b49e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:20.474493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e217b480-66fe-42b4-b197-f0fd8470b49e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:20.475921 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e217b480-66fe-42b4-b197-f0fd8470b49e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:20.476635 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e217b480-66fe-42b4-b197-f0fd8470b49e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:20.477373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e217b480-66fe-42b4-b197-f0fd8470b49e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:20.946126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e217b480-66fe-42b4-b197-f0fd8470b49e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:20.959528 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e217b480-66fe-42b4-b197-f0fd8470b49e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1470 microversion: 2.1 time: 0.499956 Sep 17 20:52:20.960242 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 215/513] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:20 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1470 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:20.979292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3ee34681-1a52-4fa5-9170-e7e6304b77a0 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:20.980207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3ee34681-1a52-4fa5-9170-e7e6304b77a0 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:20.990036 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3ee34681-1a52-4fa5-9170-e7e6304b77a0 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:20.998305 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3ee34681-1a52-4fa5-9170-e7e6304b77a0 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:20.999049 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3ee34681-1a52-4fa5-9170-e7e6304b77a0 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:21.000026 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3ee34681-1a52-4fa5-9170-e7e6304b77a0 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:21.000669 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3ee34681-1a52-4fa5-9170-e7e6304b77a0 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:21.001285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3ee34681-1a52-4fa5-9170-e7e6304b77a0 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:21.080296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3f929152-5bb0-4677-a0f0-ec4fa84d2dd2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:21.105917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3f929152-5bb0-4677-a0f0-ec4fa84d2dd2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:21.111846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3f929152-5bb0-4677-a0f0-ec4fa84d2dd2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:21.114815 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3f929152-5bb0-4677-a0f0-ec4fa84d2dd2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9" status: 200 len: 1559 microversion: 2.25 time: 0.843367 Sep 17 20:52:21.117480 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 299/514] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:20 2022] GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9 => generated 1559 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:21.247065 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b7669699-0389-40b0-be4e-f9ee89903de2 tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Action: 'create', calling method: .version_select at 0x7f25a5adee50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2134319019", "description": "tempest-description-1914615609"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:21.283880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3ee34681-1a52-4fa5-9170-e7e6304b77a0 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:21.292489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3ee34681-1a52-4fa5-9170-e7e6304b77a0 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:21.293961 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3ee34681-1a52-4fa5-9170-e7e6304b77a0 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:21.314452 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3ee34681-1a52-4fa5-9170-e7e6304b77a0 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1447 microversion: 2.75 time: 0.353032 Sep 17 20:52:21.330714 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 216/515] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:20 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1447 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:21.613980 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a6ac17bd-083b-471c-8928-02cc75e8d351 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:21.614601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a6ac17bd-083b-471c-8928-02cc75e8d351 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:21.620752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6ac17bd-083b-471c-8928-02cc75e8d351 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:21.621241 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6ac17bd-083b-471c-8928-02cc75e8d351 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:21.621696 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6ac17bd-083b-471c-8928-02cc75e8d351 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:21.633374 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6ac17bd-083b-471c-8928-02cc75e8d351 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:21.634144 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6ac17bd-083b-471c-8928-02cc75e8d351 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:21.634491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6ac17bd-083b-471c-8928-02cc75e8d351 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:22.202925 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-a6ac17bd-083b-471c-8928-02cc75e8d351 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lazy-loading 'services' on Instance uuid 7289e6c1-bbfd-4239-8a82-43ffe2335ec9 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:52:22.355513 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a6ac17bd-083b-471c-8928-02cc75e8d351 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9" status: 200 len: 2052 microversion: 2.25 time: 1.005191 Sep 17 20:52:22.356764 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 217/516] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:21 2022] GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9 => generated 2052 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:22.369453 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-16d25184-d340-46ce-9d3d-27c182f6ff4c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:22.374708 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-16d25184-d340-46ce-9d3d-27c182f6ff4c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:22.397410 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-16d25184-d340-46ce-9d3d-27c182f6ff4c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:22.397985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-16d25184-d340-46ce-9d3d-27c182f6ff4c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:22.398428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-16d25184-d340-46ce-9d3d-27c182f6ff4c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:22.399174 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-16d25184-d340-46ce-9d3d-27c182f6ff4c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:22.399628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-16d25184-d340-46ce-9d3d-27c182f6ff4c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:22.400053 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-16d25184-d340-46ce-9d3d-27c182f6ff4c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:22.851507 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b7669699-0389-40b0-be4e-f9ee89903de2 tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.732162 Sep 17 20:52:22.852121 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 300/517] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Sep 17 20:52:21 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:52:22.856823 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c985c916-bf81-425d-b82f-b1db8c3c7236 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:22.857425 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c985c916-bf81-425d-b82f-b1db8c3c7236 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:22.877164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c985c916-bf81-425d-b82f-b1db8c3c7236 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:22.877913 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c985c916-bf81-425d-b82f-b1db8c3c7236 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:22.878489 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c985c916-bf81-425d-b82f-b1db8c3c7236 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:22.879352 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c985c916-bf81-425d-b82f-b1db8c3c7236 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:22.879943 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c985c916-bf81-425d-b82f-b1db8c3c7236 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:22.880549 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c985c916-bf81-425d-b82f-b1db8c3c7236 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:23.083163 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c985c916-bf81-425d-b82f-b1db8c3c7236 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:23.096024 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c985c916-bf81-425d-b82f-b1db8c3c7236 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:23.098166 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c985c916-bf81-425d-b82f-b1db8c3c7236 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:23.119320 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c985c916-bf81-425d-b82f-b1db8c3c7236 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1447 microversion: 2.75 time: 0.252804 Sep 17 20:52:23.136949 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 301/518] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:22 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1447 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:23.150563 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a8acde14-1bec-4954-8bd3-4f9658793fe4 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:23.151913 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a8acde14-1bec-4954-8bd3-4f9658793fe4 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:23.169704 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8acde14-1bec-4954-8bd3-4f9658793fe4 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:23.170516 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8acde14-1bec-4954-8bd3-4f9658793fe4 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:23.175085 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8acde14-1bec-4954-8bd3-4f9658793fe4 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:23.176254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8acde14-1bec-4954-8bd3-4f9658793fe4 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:23.177254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8acde14-1bec-4954-8bd3-4f9658793fe4 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:23.177895 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8acde14-1bec-4954-8bd3-4f9658793fe4 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:23.342983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-16d25184-d340-46ce-9d3d-27c182f6ff4c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:23.360464 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-16d25184-d340-46ce-9d3d-27c182f6ff4c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1475 microversion: 2.1 time: 1.001823 Sep 17 20:52:23.366567 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 218/519] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:22 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1475 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:23.376465 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-22e22666-ec7c-4aaa-8b70-b84da9eefe5c tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1613190882", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "689354539", "adminPass": "***", "networks": [{"uuid": "0282db1b-1740-4d35-9ade-d2fa2c594978"}], "security_groups": [{"name": "tempest-securitygroup--1064954919"}], "key_name": "tempest-keypair-714475675", "user_data": "}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:23.816763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-22e22666-ec7c-4aaa-8b70-b84da9eefe5c tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] validate_networks() for [('0282db1b-1740-4d35-9ade-d2fa2c594978', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:52:23.835750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-a8acde14-1bec-4954-8bd3-4f9658793fe4 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lazy-loading 'services' on Instance uuid 7289e6c1-bbfd-4239-8a82-43ffe2335ec9 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:52:23.981640 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a8acde14-1bec-4954-8bd3-4f9658793fe4 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9" status: 200 len: 2052 microversion: 2.25 time: 0.835876 Sep 17 20:52:23.982603 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 302/520] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:23 2022] GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9 => generated 2052 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:23.987784 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-14a56903-2cc4-4800-b26b-fdfe4c533181 tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Action: 'create', calling method: .version_select at 0x7f25a5e5a8b0>, body: {"security_group_rule": {"parent_group_id": "80c0e0b9-fbed-4af0-9187-16ea2894cfe5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:24.015811 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:52:25.421274 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-22e22666-ec7c-4aaa-8b70-b84da9eefe5c tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:52:25.421881 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-22e22666-ec7c-4aaa-8b70-b84da9eefe5c tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:52:25.422728 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-22e22666-ec7c-4aaa-8b70-b84da9eefe5c tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:52:25.423133 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-22e22666-ec7c-4aaa-8b70-b84da9eefe5c tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:52:25.423539 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-22e22666-ec7c-4aaa-8b70-b84da9eefe5c tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:52:25.448807 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-22e22666-ec7c-4aaa-8b70-b84da9eefe5c tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:25.449336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-22e22666-ec7c-4aaa-8b70-b84da9eefe5c tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:25.449800 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-22e22666-ec7c-4aaa-8b70-b84da9eefe5c tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:25.454893 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-22e22666-ec7c-4aaa-8b70-b84da9eefe5c tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:25.456923 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-22e22666-ec7c-4aaa-8b70-b84da9eefe5c tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:25.457490 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-22e22666-ec7c-4aaa-8b70-b84da9eefe5c tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:25.488187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-22e22666-ec7c-4aaa-8b70-b84da9eefe5c tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Getting quotas for project 1f305d163acf499c9808c5f11150a7cf. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:52:25.494701 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-14a56903-2cc4-4800-b26b-fdfe4c533181 tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.510512 Sep 17 20:52:25.495207 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 303/521] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Sep 17 20:52:23 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:52:25.502260 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8bbe91ec-c964-4e8a-9fe5-69c06c341c4e tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:25.506224 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-22e22666-ec7c-4aaa-8b70-b84da9eefe5c tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Getting quotas for user 42f7c0fdad9346c58949928300021b07 and project 1f305d163acf499c9808c5f11150a7cf. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:52:25.509613 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bbe91ec-c964-4e8a-9fe5-69c06c341c4e tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:25.510095 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bbe91ec-c964-4e8a-9fe5-69c06c341c4e tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:25.513332 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bbe91ec-c964-4e8a-9fe5-69c06c341c4e tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:25.514451 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bbe91ec-c964-4e8a-9fe5-69c06c341c4e tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:25.514918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bbe91ec-c964-4e8a-9fe5-69c06c341c4e tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:25.517325 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bbe91ec-c964-4e8a-9fe5-69c06c341c4e tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:25.535987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-22e22666-ec7c-4aaa-8b70-b84da9eefe5c tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:52:25.541948 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-22e22666-ec7c-4aaa-8b70-b84da9eefe5c tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:52:25.581329 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8bbe91ec-c964-4e8a-9fe5-69c06c341c4e tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.085014 Sep 17 20:52:25.582668 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 304/522] 10.222.0.26 () {60 vars in 1217 bytes} [Sat Sep 17 20:52:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:52:25.596184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-37bb3f84-2267-41b9-b00e-8d088feb244c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:25.598300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-37bb3f84-2267-41b9-b00e-8d088feb244c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:25.605917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:52:25.612027 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-37bb3f84-2267-41b9-b00e-8d088feb244c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:25.612900 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-37bb3f84-2267-41b9-b00e-8d088feb244c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:25.613595 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-37bb3f84-2267-41b9-b00e-8d088feb244c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:25.614555 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-37bb3f84-2267-41b9-b00e-8d088feb244c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:25.615107 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-37bb3f84-2267-41b9-b00e-8d088feb244c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:25.615591 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-37bb3f84-2267-41b9-b00e-8d088feb244c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:25.667783 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-22e22666-ec7c-4aaa-8b70-b84da9eefe5c tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.299455 Sep 17 20:52:25.668970 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 219/523] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:52:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 2302 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:52:25.683277 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5ba5c767-7176-41f8-b2f1-f5421d61ae43 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:25.684394 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5ba5c767-7176-41f8-b2f1-f5421d61ae43 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:25.700886 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ba5c767-7176-41f8-b2f1-f5421d61ae43 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:25.701669 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ba5c767-7176-41f8-b2f1-f5421d61ae43 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:25.702262 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ba5c767-7176-41f8-b2f1-f5421d61ae43 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:25.704589 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ba5c767-7176-41f8-b2f1-f5421d61ae43 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:25.705267 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ba5c767-7176-41f8-b2f1-f5421d61ae43 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:25.705912 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ba5c767-7176-41f8-b2f1-f5421d61ae43 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:25.777287 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-37bb3f84-2267-41b9-b00e-8d088feb244c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:25.791543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-37bb3f84-2267-41b9-b00e-8d088feb244c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:25.793514 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-37bb3f84-2267-41b9-b00e-8d088feb244c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:25.801902 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-37bb3f84-2267-41b9-b00e-8d088feb244c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1447 microversion: 2.75 time: 0.217706 Sep 17 20:52:25.815488 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 305/524] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:25 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1447 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:25.827692 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c4d3a9ba-d381-4db3-9d50-673792c345a7 tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Action: 'create', calling method: .version_select at 0x7f25a5afd8b0>, body: {"security_group_rule": {"parent_group_id": "80c0e0b9-fbed-4af0-9187-16ea2894cfe5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:26.216437 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-c4d3a9ba-d381-4db3-9d50-673792c345a7 tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] HTTP exception thrown: This rule already exists in group 80c0e0b9-fbed-4af0-9187-16ea2894cfe5 Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c4d3a9ba-d381-4db3-9d50-673792c345a7 tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Request method failure captured: Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 138 Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjOE_XhRYJy_YLIkTxEg9iYWCOySS05m8GhtFSZH2g4mVhgm8kcxHfeDXuz5zK_y7xyakIoROrAQjNsLTi9WqKEfpzJYreOjtJQ6I5RVKtFyqx8nT6lkIEC5qHtWzNF7SQ6gUfOmz1-d7NfQU8cAeQYwr_34XSNjhI-aoc4BZA30Ucw Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 6589c8be0f944eb7bb726df3d468d2f8 Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-910357177 Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6589c8be0f944eb7bb726df3d468d2f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6589c8be0f944eb7bb726df3d468d2f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6589c8be0f944eb7bb726df3d468d2f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6589c8be0f944eb7bb726df3d468d2f8", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-910357177 Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 6589c8be0f944eb7bb726df3d468d2f8 Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-910357177 Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-910357177-project Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 5b6c0aef786d4fd7ba8c5bd00a097fe6 Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-910357177-project Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: {"security_group_rule": {"parent_group_id": "80c0e0b9-fbed-4af0-9187-16ea2894cfe5", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: exception: This rule already exists in group 80c0e0b9-fbed-4af0-9187-16ea2894cfe5 Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'body': {'security_group_rule': {'parent_group_id': '80c0e0b9-fbed-4af0-9187-16ea2894cfe5', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 80c0e0b9-fbed-4af0-9187-16ea2894cfe5 Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 80c0e0b9-fbed-4af0-9187-16ea2894cfe5 Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:52:26.218717 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:52:26.222691 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:52:26.222691 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:52:26.222691 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 80c0e0b9-fbed-4af0-9187-16ea2894cfe5 Sep 17 20:52:26.222691 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:52:26.222691 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c4d3a9ba-d381-4db3-9d50-673792c345a7 tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Returning 400 to user: This rule already exists in group 80c0e0b9-fbed-4af0-9187-16ea2894cfe5 {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:52:26.224036 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c4d3a9ba-d381-4db3-9d50-673792c345a7 tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.400062 Sep 17 20:52:26.224807 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 306/525] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Sep 17 20:52:25 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 402 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 20:52:26.248047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b2a78524-d8d6-4282-88ae-67c6b8d07667 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:26.252148 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b2a78524-d8d6-4282-88ae-67c6b8d07667 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:26.260265 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b2a78524-d8d6-4282-88ae-67c6b8d07667 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:26.261075 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b2a78524-d8d6-4282-88ae-67c6b8d07667 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:26.261792 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b2a78524-d8d6-4282-88ae-67c6b8d07667 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:26.262893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b2a78524-d8d6-4282-88ae-67c6b8d07667 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:26.263577 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b2a78524-d8d6-4282-88ae-67c6b8d07667 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:26.264503 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b2a78524-d8d6-4282-88ae-67c6b8d07667 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:26.347532 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5ba5c767-7176-41f8-b2f1-f5421d61ae43 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:26.356154 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5ba5c767-7176-41f8-b2f1-f5421d61ae43 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1475 microversion: 2.1 time: 0.678772 Sep 17 20:52:26.374284 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 220/526] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:25 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1475 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:26.401686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fd2d93a5-3e5b-45d7-805a-ecfbd7c95c7c tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:26.402463 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fd2d93a5-3e5b-45d7-805a-ecfbd7c95c7c tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:26.602215 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fd2d93a5-3e5b-45d7-805a-ecfbd7c95c7c tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f7c0fdad9346c58949928300021b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f305d163acf499c9808c5f11150a7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:26.615747 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fd2d93a5-3e5b-45d7-805a-ecfbd7c95c7c tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7" status: 200 len: 1262 microversion: 2.1 time: 0.239137 Sep 17 20:52:26.629780 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 221/527] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:26 2022] GET /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 => generated 1262 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:26.669968 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f6dd49cc-ebaa-4b81-bfdf-311dd363f998 tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Calling method '.version_select at 0x7f25a5d42040>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:26.983218 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-b2a78524-d8d6-4282-88ae-67c6b8d07667 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lazy-loading 'flavor' on Instance uuid 7289e6c1-bbfd-4239-8a82-43ffe2335ec9 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:52:27.039858 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f6dd49cc-ebaa-4b81-bfdf-311dd363f998 tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-group-rules/ce466d02-363a-43a7-95fd-adce8de771e4" status: 202 len: 0 microversion: 2.1 time: 0.390998 Sep 17 20:52:27.041056 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 222/528] 10.222.0.26 () {58 vars in 1287 bytes} [Sat Sep 17 20:52:26 2022] DELETE /compute/v2.1/os-security-group-rules/ce466d02-363a-43a7-95fd-adce8de771e4 => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:52:27.046755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7484d857-afdd-4ad0-9ea5-7a552affba72 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:27.047637 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7484d857-afdd-4ad0-9ea5-7a552affba72 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:27.079243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7484d857-afdd-4ad0-9ea5-7a552affba72 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:27.079795 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7484d857-afdd-4ad0-9ea5-7a552affba72 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:27.082390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7484d857-afdd-4ad0-9ea5-7a552affba72 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:27.083204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7484d857-afdd-4ad0-9ea5-7a552affba72 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:27.083747 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7484d857-afdd-4ad0-9ea5-7a552affba72 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:27.084200 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7484d857-afdd-4ad0-9ea5-7a552affba72 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:27.092635 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b2a78524-d8d6-4282-88ae-67c6b8d07667 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Going to try to live migrate instance to nch2-master-1 {{(pid=140524) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 17 20:52:27.219671 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7484d857-afdd-4ad0-9ea5-7a552affba72 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:27.232984 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7484d857-afdd-4ad0-9ea5-7a552affba72 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:27.238621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7484d857-afdd-4ad0-9ea5-7a552affba72 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:27.262501 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7484d857-afdd-4ad0-9ea5-7a552affba72 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1447 microversion: 2.75 time: 0.220088 Sep 17 20:52:27.269706 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 223/529] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:27 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1447 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:27.589085 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f3ffbb8a-c491-4983-8e1f-6fb1e9729532 tempest-AZV2TestJSON-1285185595 tempest-AZV2TestJSON-1285185595-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:27.590862 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f3ffbb8a-c491-4983-8e1f-6fb1e9729532 tempest-AZV2TestJSON-1285185595 tempest-AZV2TestJSON-1285185595-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:27.591528 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f3ffbb8a-c491-4983-8e1f-6fb1e9729532 tempest-AZV2TestJSON-1285185595 tempest-AZV2TestJSON-1285185595-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:27.592134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f3ffbb8a-c491-4983-8e1f-6fb1e9729532 tempest-AZV2TestJSON-1285185595 tempest-AZV2TestJSON-1285185595-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:27.593033 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f3ffbb8a-c491-4983-8e1f-6fb1e9729532 tempest-AZV2TestJSON-1285185595 tempest-AZV2TestJSON-1285185595-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:27.596673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f3ffbb8a-c491-4983-8e1f-6fb1e9729532 tempest-AZV2TestJSON-1285185595 tempest-AZV2TestJSON-1285185595-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:27.597156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f3ffbb8a-c491-4983-8e1f-6fb1e9729532 tempest-AZV2TestJSON-1285185595 tempest-AZV2TestJSON-1285185595-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:27.681736 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f3ffbb8a-c491-4983-8e1f-6fb1e9729532 tempest-AZV2TestJSON-1285185595 tempest-AZV2TestJSON-1285185595-project] 10.222.0.26 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.409716 Sep 17 20:52:27.682326 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 224/530] 10.222.0.26 () {58 vars in 1164 bytes} [Sat Sep 17 20:52:27 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:52:27.695762 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-95b2ce8d-b97f-479f-a149-db92a2684843 tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Action: 'create', calling method: .version_select at 0x7f25a5a06af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2040198571", "description": "tempest-description-321564366"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:28.115707 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-95b2ce8d-b97f-479f-a149-db92a2684843 tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.428496 Sep 17 20:52:28.116418 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 225/531] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Sep 17 20:52:27 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:52:28.122165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-96afc53a-9545-418e-a427-5ca3a1a73d2d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:28.123080 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-96afc53a-9545-418e-a427-5ca3a1a73d2d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:28.135978 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-96afc53a-9545-418e-a427-5ca3a1a73d2d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:28.144087 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-96afc53a-9545-418e-a427-5ca3a1a73d2d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:28.144743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-96afc53a-9545-418e-a427-5ca3a1a73d2d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:28.145661 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-96afc53a-9545-418e-a427-5ca3a1a73d2d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:28.146311 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-96afc53a-9545-418e-a427-5ca3a1a73d2d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:28.146981 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-96afc53a-9545-418e-a427-5ca3a1a73d2d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:28.407286 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-96afc53a-9545-418e-a427-5ca3a1a73d2d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:28.419989 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-96afc53a-9545-418e-a427-5ca3a1a73d2d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1475 microversion: 2.1 time: 0.301880 Sep 17 20:52:28.421845 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 226/532] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:28 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1475 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:28.426982 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-157cdde6-185a-4a0a-8819-729849fb9ca5 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:28.431246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-157cdde6-185a-4a0a-8819-729849fb9ca5 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:28.448728 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-157cdde6-185a-4a0a-8819-729849fb9ca5 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:28.449961 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-157cdde6-185a-4a0a-8819-729849fb9ca5 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:28.450631 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-157cdde6-185a-4a0a-8819-729849fb9ca5 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:28.451556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-157cdde6-185a-4a0a-8819-729849fb9ca5 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:28.452202 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-157cdde6-185a-4a0a-8819-729849fb9ca5 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:28.456091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-157cdde6-185a-4a0a-8819-729849fb9ca5 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:28.639873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-157cdde6-185a-4a0a-8819-729849fb9ca5 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f7c0fdad9346c58949928300021b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f305d163acf499c9808c5f11150a7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:28.655896 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-157cdde6-185a-4a0a-8819-729849fb9ca5 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7" status: 200 len: 1320 microversion: 2.1 time: 0.232378 Sep 17 20:52:28.670003 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 227/533] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:28 2022] GET /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 => generated 1320 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:28.680504 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ac89ea82-313e-4a2a-ab07-f5ef27f02e4c tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Action: 'create', calling method: .version_select at 0x7f25a5a06a60>, body: {"security_group_rule": {"parent_group_id": "bc24665a-002d-4bd4-8534-cdfa399159f3", "ip_protocol": "tcp", "from_port": 1603356022, "to_port": 22}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:28.778732 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-ac89ea82-313e-4a2a-ab07-f5ef27f02e4c tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] HTTP exception thrown: Invalid port range 1603356022:22. Former value cannot be greater than the later Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ac89ea82-313e-4a2a-ab07-f5ef27f02e4c tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Request method failure captured: Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 146 Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjOE_XhRYJy_YLIkTxEg9iYWCOySS05m8GhtFSZH2g4mVhgm8kcxHfeDXuz5zK_y7xyakIoROrAQjNsLTi9WqKEfpzJYreOjtJQ6I5RVKtFyqx8nT6lkIEC5qHtWzNF7SQ6gUfOmz1-d7NfQU8cAeQYwr_34XSNjhI-aoc4BZA30Ucw Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 6589c8be0f944eb7bb726df3d468d2f8 Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-910357177 Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6589c8be0f944eb7bb726df3d468d2f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6589c8be0f944eb7bb726df3d468d2f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6589c8be0f944eb7bb726df3d468d2f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6589c8be0f944eb7bb726df3d468d2f8", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-910357177 Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 6589c8be0f944eb7bb726df3d468d2f8 Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-910357177 Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-910357177-project Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 5b6c0aef786d4fd7ba8c5bd00a097fe6 Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-910357177-project Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: {"security_group_rule": {"parent_group_id": "bc24665a-002d-4bd4-8534-cdfa399159f3", "ip_protocol": "tcp", "from_port": 1603356022, "to_port": 22}} Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: exception: Invalid port range 1603356022:22. Former value cannot be greater than the later Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'bc24665a-002d-4bd4-8534-cdfa399159f3', 'ip_protocol': 'tcp', 'from_port': 1603356022, 'to_port': 22}}} Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1603356022:22. Former value cannot be greater than the later Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1603356022:22. Former value cannot be greater than the later Sep 17 20:52:28.781916 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:28.786541 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:52:28.786541 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:28.786541 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:52:28.786541 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:52:28.786541 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:52:28.786541 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:52:28.786541 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:52:28.786541 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1603356022:22. Former value cannot be greater than the later Sep 17 20:52:28.786541 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:28.788001 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ac89ea82-313e-4a2a-ab07-f5ef27f02e4c tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Returning 400 to user: Invalid port range 1603356022:22. Former value cannot be greater than the later {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:52:28.789008 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ac89ea82-313e-4a2a-ab07-f5ef27f02e4c tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.117665 Sep 17 20:52:28.789796 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 228/534] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Sep 17 20:52:28 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 20:52:28.799785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8e01291f-822e-47c7-97d0-af8fb6463977 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:28.800634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8e01291f-822e-47c7-97d0-af8fb6463977 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:28.811650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8e01291f-822e-47c7-97d0-af8fb6463977 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:28.816859 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8e01291f-822e-47c7-97d0-af8fb6463977 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:28.819689 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8e01291f-822e-47c7-97d0-af8fb6463977 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:28.820728 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8e01291f-822e-47c7-97d0-af8fb6463977 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:28.821538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8e01291f-822e-47c7-97d0-af8fb6463977 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:28.821943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8e01291f-822e-47c7-97d0-af8fb6463977 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:28.860482 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:52:28.947801 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8e01291f-822e-47c7-97d0-af8fb6463977 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:28.974285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8e01291f-822e-47c7-97d0-af8fb6463977 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:28.978522 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8e01291f-822e-47c7-97d0-af8fb6463977 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:29.015479 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8e01291f-822e-47c7-97d0-af8fb6463977 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1447 microversion: 2.75 time: 0.224227 Sep 17 20:52:29.053450 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 229/535] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:28 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1447 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:29.059504 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1049adb4-c100-4536-a8b9-733691b4083d tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Action: 'create', calling method: .version_select at 0x7f25a5a068b0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-980039932", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:29.065102 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-1049adb4-c100-4536-a8b9-733691b4083d tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] HTTP exception thrown: Security group id should be uuid Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1049adb4-c100-4536-a8b9-733691b4083d tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Request method failure captured: Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 130 Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjOE_XhRYJy_YLIkTxEg9iYWCOySS05m8GhtFSZH2g4mVhgm8kcxHfeDXuz5zK_y7xyakIoROrAQjNsLTi9WqKEfpzJYreOjtJQ6I5RVKtFyqx8nT6lkIEC5qHtWzNF7SQ6gUfOmz1-d7NfQU8cAeQYwr_34XSNjhI-aoc4BZA30Ucw Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 6589c8be0f944eb7bb726df3d468d2f8 Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-910357177 Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6589c8be0f944eb7bb726df3d468d2f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6589c8be0f944eb7bb726df3d468d2f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6589c8be0f944eb7bb726df3d468d2f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6589c8be0f944eb7bb726df3d468d2f8", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-910357177 Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 6589c8be0f944eb7bb726df3d468d2f8 Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-910357177 Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-910357177-project Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 5b6c0aef786d4fd7ba8c5bd00a097fe6 Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-910357177-project Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-980039932", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: exception: Security group id should be uuid Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-980039932', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:52:29.066865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:52:29.073428 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Sep 17 20:52:29.073428 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:29.076949 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1049adb4-c100-4536-a8b9-733691b4083d tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Returning 400 to user: Security group id should be uuid {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:52:29.085083 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1049adb4-c100-4536-a8b9-733691b4083d tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.027802 Sep 17 20:52:29.086419 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 230/536] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Sep 17 20:52:29 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 17 20:52:29.095753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3b9ffec5-4f1e-4ad2-a840-9197d5ff90f8 tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Action: 'create', calling method: .version_select at 0x7f25a5a0c310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-297963572", "description": "tempest-description-1309340309"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:29.803278 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3b9ffec5-4f1e-4ad2-a840-9197d5ff90f8 tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.711401 Sep 17 20:52:29.804609 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 231/537] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Sep 17 20:52:29 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:52:29.820745 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1b11ec05-7ce2-4ded-b0e2-0ed184829c43 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:29.821692 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1b11ec05-7ce2-4ded-b0e2-0ed184829c43 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:29.842872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b11ec05-7ce2-4ded-b0e2-0ed184829c43 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:29.843597 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b11ec05-7ce2-4ded-b0e2-0ed184829c43 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:29.844269 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b11ec05-7ce2-4ded-b0e2-0ed184829c43 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:29.845263 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b11ec05-7ce2-4ded-b0e2-0ed184829c43 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:29.845962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b11ec05-7ce2-4ded-b0e2-0ed184829c43 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:29.847057 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b11ec05-7ce2-4ded-b0e2-0ed184829c43 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:30.132274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=12 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:52:30.191338 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b2a78524-d8d6-4282-88ae-67c6b8d07667 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9/action" status: 202 len: 0 microversion: 2.25 time: 3.963443 Sep 17 20:52:30.191960 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 307/538] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Sep 17 20:52:26 2022] POST /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9/action => generated 0 bytes in 3965 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:52:30.201392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3ab66d40-eaad-4287-9857-94d31c0cfed0 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:30.202939 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3ab66d40-eaad-4287-9857-94d31c0cfed0 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:30.205518 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1b11ec05-7ce2-4ded-b0e2-0ed184829c43 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:30.220283 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1b11ec05-7ce2-4ded-b0e2-0ed184829c43 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1475 microversion: 2.1 time: 0.414360 Sep 17 20:52:30.220927 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ab66d40-eaad-4287-9857-94d31c0cfed0 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:30.221429 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ab66d40-eaad-4287-9857-94d31c0cfed0 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:30.222032 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 232/539] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:29 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1475 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:30.229506 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dfc91e0e-46d3-44c6-af7c-5f204c3fbbba tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Action: 'create', calling method: .version_select at 0x7f25a5bcd4c0>, body: {"security_group_rule": {"parent_group_id": "6ca88cbe-8974-4525-b24f-51a20be52e47", "ip_protocol": "tempest-999-130851227", "from_port": 22, "to_port": 22}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:30.237096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ab66d40-eaad-4287-9857-94d31c0cfed0 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:30.238170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ab66d40-eaad-4287-9857-94d31c0cfed0 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:30.239970 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ab66d40-eaad-4287-9857-94d31c0cfed0 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:30.240587 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ab66d40-eaad-4287-9857-94d31c0cfed0 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:30.308846 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-dfc91e0e-46d3-44c6-af7c-5f204c3fbbba tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] HTTP exception thrown: Invalid IP protocol tempest-999-130851227. Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dfc91e0e-46d3-44c6-af7c-5f204c3fbbba tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Request method failure captured: Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 156 Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjOE_XhRYJy_YLIkTxEg9iYWCOySS05m8GhtFSZH2g4mVhgm8kcxHfeDXuz5zK_y7xyakIoROrAQjNsLTi9WqKEfpzJYreOjtJQ6I5RVKtFyqx8nT6lkIEC5qHtWzNF7SQ6gUfOmz1-d7NfQU8cAeQYwr_34XSNjhI-aoc4BZA30Ucw Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 6589c8be0f944eb7bb726df3d468d2f8 Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-910357177 Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6589c8be0f944eb7bb726df3d468d2f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6589c8be0f944eb7bb726df3d468d2f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6589c8be0f944eb7bb726df3d468d2f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6589c8be0f944eb7bb726df3d468d2f8", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-910357177 Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 6589c8be0f944eb7bb726df3d468d2f8 Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-910357177 Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-910357177-project Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 5b6c0aef786d4fd7ba8c5bd00a097fe6 Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-910357177-project Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: {"security_group_rule": {"parent_group_id": "6ca88cbe-8974-4525-b24f-51a20be52e47", "ip_protocol": "tempest-999-130851227", "from_port": 22, "to_port": 22}} Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: exception: Invalid IP protocol tempest-999-130851227. Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6ca88cbe-8974-4525-b24f-51a20be52e47', 'ip_protocol': 'tempest-999-130851227', 'from_port': 22, 'to_port': 22}}} Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-130851227. Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-130851227. Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:30.322057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:52:30.327440 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:30.327440 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:52:30.327440 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:52:30.327440 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:52:30.327440 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:52:30.327440 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:52:30.327440 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-130851227. Sep 17 20:52:30.327440 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:30.339992 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dfc91e0e-46d3-44c6-af7c-5f204c3fbbba tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Returning 400 to user: Invalid IP protocol tempest-999-130851227. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:52:30.341151 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dfc91e0e-46d3-44c6-af7c-5f204c3fbbba tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.117752 Sep 17 20:52:30.343158 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 233/540] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Sep 17 20:52:30 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 120 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 17 20:52:30.361214 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7805df1f-3efd-4d91-b56a-574628bdd481 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:30.370606 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7805df1f-3efd-4d91-b56a-574628bdd481 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:30.389518 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7805df1f-3efd-4d91-b56a-574628bdd481 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:30.390240 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7805df1f-3efd-4d91-b56a-574628bdd481 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:30.390875 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7805df1f-3efd-4d91-b56a-574628bdd481 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:30.392294 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7805df1f-3efd-4d91-b56a-574628bdd481 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:30.392944 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7805df1f-3efd-4d91-b56a-574628bdd481 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:30.393711 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7805df1f-3efd-4d91-b56a-574628bdd481 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:30.397178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3ab66d40-eaad-4287-9857-94d31c0cfed0 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f7c0fdad9346c58949928300021b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f305d163acf499c9808c5f11150a7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:30.417162 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3ab66d40-eaad-4287-9857-94d31c0cfed0 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7" status: 200 len: 1320 microversion: 2.1 time: 0.220040 Sep 17 20:52:30.420907 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 308/541] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:30 2022] GET /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 => generated 1320 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:30.432855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-099402ce-6c50-42f4-9d60-36be1f611ace tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:30.433387 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-099402ce-6c50-42f4-9d60-36be1f611ace tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:30.443636 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-099402ce-6c50-42f4-9d60-36be1f611ace tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:30.444414 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-099402ce-6c50-42f4-9d60-36be1f611ace tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:30.445071 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-099402ce-6c50-42f4-9d60-36be1f611ace tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:30.445982 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-099402ce-6c50-42f4-9d60-36be1f611ace tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:30.446614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-099402ce-6c50-42f4-9d60-36be1f611ace tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:30.447201 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-099402ce-6c50-42f4-9d60-36be1f611ace tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:30.601069 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7805df1f-3efd-4d91-b56a-574628bdd481 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:30.613705 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7805df1f-3efd-4d91-b56a-574628bdd481 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:30.622630 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7805df1f-3efd-4d91-b56a-574628bdd481 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:30.634570 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7805df1f-3efd-4d91-b56a-574628bdd481 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1447 microversion: 2.75 time: 0.287199 Sep 17 20:52:30.640667 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 234/542] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:30 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1447 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:30.653810 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cff5fe83-bc36-4ded-854c-5b4eb72d6296 tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Action: 'create', calling method: .version_select at 0x7f25a59ddca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1952488648", "description": "tempest-description-573996733"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:31.386568 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-099402ce-6c50-42f4-9d60-36be1f611ace tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:31.401608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-099402ce-6c50-42f4-9d60-36be1f611ace tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:31.404684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-099402ce-6c50-42f4-9d60-36be1f611ace tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:31.409298 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-099402ce-6c50-42f4-9d60-36be1f611ace tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9" status: 200 len: 1569 microversion: 2.25 time: 0.986919 Sep 17 20:52:31.423659 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 309/543] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:30 2022] GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9 => generated 1569 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:31.430626 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ef27e915-7aec-40fc-a454-ced1a4ba437c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:31.431879 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ef27e915-7aec-40fc-a454-ced1a4ba437c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:31.442388 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef27e915-7aec-40fc-a454-ced1a4ba437c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:31.443265 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef27e915-7aec-40fc-a454-ced1a4ba437c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:31.444005 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef27e915-7aec-40fc-a454-ced1a4ba437c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:31.446094 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef27e915-7aec-40fc-a454-ced1a4ba437c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:31.446726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef27e915-7aec-40fc-a454-ced1a4ba437c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:31.447315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef27e915-7aec-40fc-a454-ced1a4ba437c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:31.608741 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cff5fe83-bc36-4ded-854c-5b4eb72d6296 tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.965416 Sep 17 20:52:31.609933 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 235/544] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Sep 17 20:52:30 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:52:31.615990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-11d11b41-7afa-4ec6-89c3-eee2dd2c1ad3 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:31.618079 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-11d11b41-7afa-4ec6-89c3-eee2dd2c1ad3 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:31.627075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11d11b41-7afa-4ec6-89c3-eee2dd2c1ad3 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:31.628028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11d11b41-7afa-4ec6-89c3-eee2dd2c1ad3 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:31.628628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11d11b41-7afa-4ec6-89c3-eee2dd2c1ad3 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:31.629551 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11d11b41-7afa-4ec6-89c3-eee2dd2c1ad3 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:31.630154 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11d11b41-7afa-4ec6-89c3-eee2dd2c1ad3 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:31.630747 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11d11b41-7afa-4ec6-89c3-eee2dd2c1ad3 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:31.919329 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ef27e915-7aec-40fc-a454-ced1a4ba437c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:31.936646 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ef27e915-7aec-40fc-a454-ced1a4ba437c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1475 microversion: 2.1 time: 0.511215 Sep 17 20:52:31.959443 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 310/545] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:31 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1475 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:31.967265 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0a95c9dd-5b04-445a-82fe-5433778399cf tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Action: 'create', calling method: .version_select at 0x7f25a5948d30>, body: {"security_group_rule": {"parent_group_id": "398ca3bb-2456-4980-8751-d428e717946d", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:32.092618 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-11d11b41-7afa-4ec6-89c3-eee2dd2c1ad3 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f7c0fdad9346c58949928300021b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f305d163acf499c9808c5f11150a7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:32.104702 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-11d11b41-7afa-4ec6-89c3-eee2dd2c1ad3 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7" status: 200 len: 1388 microversion: 2.1 time: 0.493356 Sep 17 20:52:32.105302 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 236/546] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:31 2022] GET /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 => generated 1388 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:32.112173 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9d044f7c-a4ba-41fd-983c-33628bf3a08c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:32.113026 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9d044f7c-a4ba-41fd-983c-33628bf3a08c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:32.140284 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d044f7c-a4ba-41fd-983c-33628bf3a08c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:32.141259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d044f7c-a4ba-41fd-983c-33628bf3a08c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:32.144155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d044f7c-a4ba-41fd-983c-33628bf3a08c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:32.144751 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d044f7c-a4ba-41fd-983c-33628bf3a08c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:32.146657 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d044f7c-a4ba-41fd-983c-33628bf3a08c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:32.147211 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d044f7c-a4ba-41fd-983c-33628bf3a08c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:32.206012 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-0a95c9dd-5b04-445a-82fe-5433778399cf tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0a95c9dd-5b04-445a-82fe-5433778399cf tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Request method failure captured: Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 138 Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjOE_XhRYJy_YLIkTxEg9iYWCOySS05m8GhtFSZH2g4mVhgm8kcxHfeDXuz5zK_y7xyakIoROrAQjNsLTi9WqKEfpzJYreOjtJQ6I5RVKtFyqx8nT6lkIEC5qHtWzNF7SQ6gUfOmz1-d7NfQU8cAeQYwr_34XSNjhI-aoc4BZA30Ucw Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 6589c8be0f944eb7bb726df3d468d2f8 Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-910357177 Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6589c8be0f944eb7bb726df3d468d2f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6589c8be0f944eb7bb726df3d468d2f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6589c8be0f944eb7bb726df3d468d2f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6589c8be0f944eb7bb726df3d468d2f8", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-910357177 Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 6589c8be0f944eb7bb726df3d468d2f8 Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-910357177 Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-910357177-project Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 5b6c0aef786d4fd7ba8c5bd00a097fe6 Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-910357177-project Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: {"security_group_rule": {"parent_group_id": "398ca3bb-2456-4980-8751-d428e717946d", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: exception: Invalid port range 22:21. Former value cannot be greater than the later Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'body': {'security_group_rule': {'parent_group_id': '398ca3bb-2456-4980-8751-d428e717946d', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Sep 17 20:52:32.208703 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:52:32.213422 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:52:32.213422 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:52:32.213422 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:52:32.213422 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:52:32.213422 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:52:32.213422 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:52:32.213422 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:52:32.213422 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Sep 17 20:52:32.213422 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:52:32.213422 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0a95c9dd-5b04-445a-82fe-5433778399cf tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:52:32.213422 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0a95c9dd-5b04-445a-82fe-5433778399cf tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.249314 Sep 17 20:52:32.213422 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 311/547] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Sep 17 20:52:31 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 251 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 20:52:32.285288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9d044f7c-a4ba-41fd-983c-33628bf3a08c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:32.299905 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9d044f7c-a4ba-41fd-983c-33628bf3a08c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:32.302777 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9d044f7c-a4ba-41fd-983c-33628bf3a08c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:32.319100 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9d044f7c-a4ba-41fd-983c-33628bf3a08c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1447 microversion: 2.75 time: 0.208611 Sep 17 20:52:32.321038 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 237/548] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:32 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1447 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:32.326240 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f8767f4f-1d13-426b-9467-a48f4e9e3ccf tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Action: 'create', calling method: .version_select at 0x7f25a5bcd670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1759345356", "description": "tempest-description-1214815911"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:32.394838 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-52414733-fce8-4e9f-8bd1-2d6a9ba2b6e3 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-512465653", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "9972ca70-5471-447a-8a92-6cfeb739a36b"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:32.467906 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-52414733-fce8-4e9f-8bd1-2d6a9ba2b6e3 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] validate_networks() for [('9972ca70-5471-447a-8a92-6cfeb739a36b', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:52:32.657968 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f8767f4f-1d13-426b-9467-a48f4e9e3ccf tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.335388 Sep 17 20:52:32.669490 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 238/549] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Sep 17 20:52:32 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:52:32.676382 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3053cef2-672c-48bc-85ce-7968fc0bb960 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:32.678356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3053cef2-672c-48bc-85ce-7968fc0bb960 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:32.686769 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3053cef2-672c-48bc-85ce-7968fc0bb960 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:32.687645 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3053cef2-672c-48bc-85ce-7968fc0bb960 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:32.688232 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3053cef2-672c-48bc-85ce-7968fc0bb960 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:32.689200 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3053cef2-672c-48bc-85ce-7968fc0bb960 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:32.690090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3053cef2-672c-48bc-85ce-7968fc0bb960 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:32.690686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3053cef2-672c-48bc-85ce-7968fc0bb960 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:33.276211 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3053cef2-672c-48bc-85ce-7968fc0bb960 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:33.285997 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3053cef2-672c-48bc-85ce-7968fc0bb960 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:33.287907 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3053cef2-672c-48bc-85ce-7968fc0bb960 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:33.289759 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3053cef2-672c-48bc-85ce-7968fc0bb960 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9" status: 200 len: 1569 microversion: 2.25 time: 0.618348 Sep 17 20:52:33.302797 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 239/550] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:32 2022] GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9 => generated 1569 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:33.315551 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e4b3c877-c6e8-46db-93dc-dabd1cbae2af tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Action: 'create', calling method: .version_select at 0x7f25a59ddca0>, body: {"security_group_rule": {"parent_group_id": "41828f8f-3bdc-4626-b17d-dce539b9d2db", "ip_protocol": "tcp", "from_port": 22, "to_port": 851222895}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:33.817375 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-e4b3c877-c6e8-46db-93dc-dabd1cbae2af tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] HTTP exception thrown: Invalid port range 22:851222895. Valid TCP ports should be between 1-65535 Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e4b3c877-c6e8-46db-93dc-dabd1cbae2af tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Request method failure captured: Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 145 Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjOE_XhRYJy_YLIkTxEg9iYWCOySS05m8GhtFSZH2g4mVhgm8kcxHfeDXuz5zK_y7xyakIoROrAQjNsLTi9WqKEfpzJYreOjtJQ6I5RVKtFyqx8nT6lkIEC5qHtWzNF7SQ6gUfOmz1-d7NfQU8cAeQYwr_34XSNjhI-aoc4BZA30Ucw Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 6589c8be0f944eb7bb726df3d468d2f8 Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-910357177 Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6589c8be0f944eb7bb726df3d468d2f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6589c8be0f944eb7bb726df3d468d2f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6589c8be0f944eb7bb726df3d468d2f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6589c8be0f944eb7bb726df3d468d2f8", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-910357177 Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 6589c8be0f944eb7bb726df3d468d2f8 Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-910357177 Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-910357177-project Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 5b6c0aef786d4fd7ba8c5bd00a097fe6 Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-910357177-project Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: {"security_group_rule": {"parent_group_id": "41828f8f-3bdc-4626-b17d-dce539b9d2db", "ip_protocol": "tcp", "from_port": 22, "to_port": 851222895}} Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: exception: Invalid port range 22:851222895. Valid TCP ports should be between 1-65535 Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'body': {'security_group_rule': {'parent_group_id': '41828f8f-3bdc-4626-b17d-dce539b9d2db', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 851222895}}} Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:851222895. Valid TCP ports should be between 1-65535 Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:851222895. Valid TCP ports should be between 1-65535 Sep 17 20:52:33.820946 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:33.825420 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:52:33.825420 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:33.825420 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:52:33.825420 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:52:33.825420 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:52:33.825420 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:52:33.825420 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:52:33.825420 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:851222895. Valid TCP ports should be between 1-65535 Sep 17 20:52:33.825420 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:33.825420 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e4b3c877-c6e8-46db-93dc-dabd1cbae2af tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Returning 400 to user: Invalid port range 22:851222895. Valid TCP ports should be between 1-65535 {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:52:33.826478 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e4b3c877-c6e8-46db-93dc-dabd1cbae2af tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.521889 Sep 17 20:52:33.827119 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 240/551] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Sep 17 20:52:33 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 524 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 20:52:33.834731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2b7abed1-7697-40c7-91ab-f69020f8c854 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:33.835677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2b7abed1-7697-40c7-91ab-f69020f8c854 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:33.844209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b7abed1-7697-40c7-91ab-f69020f8c854 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:33.844785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b7abed1-7697-40c7-91ab-f69020f8c854 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:33.845576 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b7abed1-7697-40c7-91ab-f69020f8c854 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:33.846371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b7abed1-7697-40c7-91ab-f69020f8c854 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:33.846896 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b7abed1-7697-40c7-91ab-f69020f8c854 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:33.847461 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b7abed1-7697-40c7-91ab-f69020f8c854 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:34.180932 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-52414733-fce8-4e9f-8bd1-2d6a9ba2b6e3 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:52:34.181402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-52414733-fce8-4e9f-8bd1-2d6a9ba2b6e3 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:52:34.182024 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-52414733-fce8-4e9f-8bd1-2d6a9ba2b6e3 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:52:34.182492 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-52414733-fce8-4e9f-8bd1-2d6a9ba2b6e3 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:52:34.183007 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-52414733-fce8-4e9f-8bd1-2d6a9ba2b6e3 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:52:34.192071 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-52414733-fce8-4e9f-8bd1-2d6a9ba2b6e3 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:34.192628 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-52414733-fce8-4e9f-8bd1-2d6a9ba2b6e3 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:34.193067 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-52414733-fce8-4e9f-8bd1-2d6a9ba2b6e3 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:34.193833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-52414733-fce8-4e9f-8bd1-2d6a9ba2b6e3 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:34.194283 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-52414733-fce8-4e9f-8bd1-2d6a9ba2b6e3 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:34.194701 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-52414733-fce8-4e9f-8bd1-2d6a9ba2b6e3 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:34.215750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-52414733-fce8-4e9f-8bd1-2d6a9ba2b6e3 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Getting quotas for project e566b2c69fec4ec784a13e4034eaef72. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:52:34.220259 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-52414733-fce8-4e9f-8bd1-2d6a9ba2b6e3 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Getting quotas for user feb0a86572434db48c987279d67cd4e0 and project e566b2c69fec4ec784a13e4034eaef72. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:52:34.232771 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-52414733-fce8-4e9f-8bd1-2d6a9ba2b6e3 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:52:34.235155 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-52414733-fce8-4e9f-8bd1-2d6a9ba2b6e3 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] [instance: 9d268239-a1b7-433b-a3f1-52e84ad59682] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:52:34.287598 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-52414733-fce8-4e9f-8bd1-2d6a9ba2b6e3 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.075501 Sep 17 20:52:34.294715 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 312/552] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:52:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:52:34.294715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-16bfe745-e8d6-467e-889e-e3e7db3dad33 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:34.294715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-16bfe745-e8d6-467e-889e-e3e7db3dad33 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:34.300761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-16bfe745-e8d6-467e-889e-e3e7db3dad33 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:34.301613 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-16bfe745-e8d6-467e-889e-e3e7db3dad33 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:34.302182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-16bfe745-e8d6-467e-889e-e3e7db3dad33 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:34.305930 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-16bfe745-e8d6-467e-889e-e3e7db3dad33 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:34.307527 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-16bfe745-e8d6-467e-889e-e3e7db3dad33 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:34.308259 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-16bfe745-e8d6-467e-889e-e3e7db3dad33 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:34.346549 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2b7abed1-7697-40c7-91ab-f69020f8c854 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:34.356607 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2b7abed1-7697-40c7-91ab-f69020f8c854 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1475 microversion: 2.1 time: 0.528358 Sep 17 20:52:34.357684 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 241/553] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:33 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1475 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:34.363543 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f0a92cdb-bea2-460b-9b17-b982f9a51ba3 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:34.364722 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f0a92cdb-bea2-460b-9b17-b982f9a51ba3 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:34.373921 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0a92cdb-bea2-460b-9b17-b982f9a51ba3 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:34.374875 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0a92cdb-bea2-460b-9b17-b982f9a51ba3 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:34.375799 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0a92cdb-bea2-460b-9b17-b982f9a51ba3 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:34.377916 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0a92cdb-bea2-460b-9b17-b982f9a51ba3 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:34.379055 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0a92cdb-bea2-460b-9b17-b982f9a51ba3 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:34.379948 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0a92cdb-bea2-460b-9b17-b982f9a51ba3 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:34.556660 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f0a92cdb-bea2-460b-9b17-b982f9a51ba3 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:34.566391 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f0a92cdb-bea2-460b-9b17-b982f9a51ba3 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:34.571103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f0a92cdb-bea2-460b-9b17-b982f9a51ba3 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:34.579224 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f0a92cdb-bea2-460b-9b17-b982f9a51ba3 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1447 microversion: 2.75 time: 0.220252 Sep 17 20:52:34.581126 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 242/554] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:34 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1447 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:34.586741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-e71c03db-1507-4c61-89fc-8810817a00be req-79071ee0-2847-4677-b184-8bcb70fbdc5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7", "tag": "69898655-651f-4c1b-afd3-8dc1cb5c1d0e"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:34.600445 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-e71c03db-1507-4c61-89fc-8810817a00be req-79071ee0-2847-4677-b184-8bcb70fbdc5b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:34.601424 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-e71c03db-1507-4c61-89fc-8810817a00be req-79071ee0-2847-4677-b184-8bcb70fbdc5b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:34.602094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-e71c03db-1507-4c61-89fc-8810817a00be req-79071ee0-2847-4677-b184-8bcb70fbdc5b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:34.643184 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-e71c03db-1507-4c61-89fc-8810817a00be req-79071ee0-2847-4677-b184-8bcb70fbdc5b service nova] Creating event network-changed:69898655-651f-4c1b-afd3-8dc1cb5c1d0e for instance 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 on nch2-master-1 Sep 17 20:52:34.652548 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-e71c03db-1507-4c61-89fc-8810817a00be req-79071ee0-2847-4677-b184-8bcb70fbdc5b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068808 Sep 17 20:52:34.654518 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 243/555] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:52:34.665090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-14cd9241-fe1c-4e0f-8642-00181701a8fd tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Action: 'create', calling method: .version_select at 0x7f25a5b2c3a0>, body: {"security_group_rule": {"parent_group_id": "750bfeca-e681-4270-9858-17e2fa4c245b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:34.727282 ncdv-master-1 devstack@n-api.service[140523]: DEBUG neutronclient.v2_0.client [None req-14cd9241-fe1c-4e0f-8642-00181701a8fd tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 750bfeca-e681-4270-9858-17e2fa4c245b does not exist", "detail": ""}} {{(pid=140523) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 17 20:52:34.728495 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.security_group_api [None req-14cd9241-fe1c-4e0f-8642-00181701a8fd tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Neutron security group 750bfeca-e681-4270-9858-17e2fa4c245b not found {{(pid=140523) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 17 20:52:34.729319 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-14cd9241-fe1c-4e0f-8642-00181701a8fd tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] HTTP exception thrown: Security group 750bfeca-e681-4270-9858-17e2fa4c245b does not exist Sep 17 20:52:34.729319 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-f78ea4f1-dd16-4f12-923d-77931e8de85e'] Sep 17 20:52:34.731948 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-16bfe745-e8d6-467e-889e-e3e7db3dad33 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f7c0fdad9346c58949928300021b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f305d163acf499c9808c5f11150a7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-14cd9241-fe1c-4e0f-8642-00181701a8fd tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Request method failure captured: Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 138 Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjOE_XhRYJy_YLIkTxEg9iYWCOySS05m8GhtFSZH2g4mVhgm8kcxHfeDXuz5zK_y7xyakIoROrAQjNsLTi9WqKEfpzJYreOjtJQ6I5RVKtFyqx8nT6lkIEC5qHtWzNF7SQ6gUfOmz1-d7NfQU8cAeQYwr_34XSNjhI-aoc4BZA30Ucw Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 6589c8be0f944eb7bb726df3d468d2f8 Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-910357177 Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6589c8be0f944eb7bb726df3d468d2f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6589c8be0f944eb7bb726df3d468d2f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6589c8be0f944eb7bb726df3d468d2f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6589c8be0f944eb7bb726df3d468d2f8", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-910357177 Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 6589c8be0f944eb7bb726df3d468d2f8 Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-910357177 Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-910357177-project Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 5b6c0aef786d4fd7ba8c5bd00a097fe6 Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-910357177-project Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: {"security_group_rule": {"parent_group_id": "750bfeca-e681-4270-9858-17e2fa4c245b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: exception: Security group 750bfeca-e681-4270-9858-17e2fa4c245b does not exist Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-f78ea4f1-dd16-4f12-923d-77931e8de85e'] Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'body': {'security_group_rule': {'parent_group_id': '750bfeca-e681-4270-9858-17e2fa4c245b', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 17 20:52:34.734688 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 750bfeca-e681-4270-9858-17e2fa4c245b does not exist Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f78ea4f1-dd16-4f12-923d-77931e8de85e'] Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 750bfeca-e681-4270-9858-17e2fa4c245b does not exist Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f78ea4f1-dd16-4f12-923d-77931e8de85e'] Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 750bfeca-e681-4270-9858-17e2fa4c245b does not exist Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f78ea4f1-dd16-4f12-923d-77931e8de85e'] Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 750bfeca-e681-4270-9858-17e2fa4c245b does not exist Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f78ea4f1-dd16-4f12-923d-77931e8de85e'] Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-14cd9241-fe1c-4e0f-8642-00181701a8fd tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Returning 404 to user: Security group 750bfeca-e681-4270-9858-17e2fa4c245b does not exist Sep 17 20:52:34.738899 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-f78ea4f1-dd16-4f12-923d-77931e8de85e'] {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:52:34.741614 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-14cd9241-fe1c-4e0f-8642-00181701a8fd tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.081818 Sep 17 20:52:34.741614 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 244/556] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Sep 17 20:52:34 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:52:34.760030 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-16bfe745-e8d6-467e-889e-e3e7db3dad33 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7" status: 200 len: 1388 microversion: 2.1 time: 0.470471 Sep 17 20:52:34.761117 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 313/557] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:34 2022] GET /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 => generated 1388 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:34.779855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-238f90eb-afc5-477c-81fe-3e7df3df4200 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:34.780886 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-238f90eb-afc5-477c-81fe-3e7df3df4200 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] [instance: 9d268239-a1b7-433b-a3f1-52e84ad59682] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:34.897691 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-238f90eb-afc5-477c-81fe-3e7df3df4200 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb0a86572434db48c987279d67cd4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e566b2c69fec4ec784a13e4034eaef72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:34.907402 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-238f90eb-afc5-477c-81fe-3e7df3df4200 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] 10.222.0.26 "GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682" status: 200 len: 1231 microversion: 2.1 time: 0.144916 Sep 17 20:52:34.910361 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 314/558] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:34 2022] GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682 => generated 1231 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:34.928827 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f311e1a1-d38d-4e1e-8d7b-7ff740b47c5d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:34.929773 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f311e1a1-d38d-4e1e-8d7b-7ff740b47c5d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:34.936822 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-78a280f1-8835-4eca-8ea2-943f92fbbae7 req-90db57c3-e7c0-40cd-886e-b41d4078887b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7289e6c1-bbfd-4239-8a82-43ffe2335ec9", "name": "network-vif-unplugged", "status": "completed", "tag": "d7427540-da45-49cd-8b9c-b7aa57d8fc78"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:34.941150 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f311e1a1-d38d-4e1e-8d7b-7ff740b47c5d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:34.941967 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f311e1a1-d38d-4e1e-8d7b-7ff740b47c5d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:34.944285 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f311e1a1-d38d-4e1e-8d7b-7ff740b47c5d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:34.945217 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f311e1a1-d38d-4e1e-8d7b-7ff740b47c5d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:34.945786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f311e1a1-d38d-4e1e-8d7b-7ff740b47c5d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:34.947608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f311e1a1-d38d-4e1e-8d7b-7ff740b47c5d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:34.961666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:52:34.981854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-78a280f1-8835-4eca-8ea2-943f92fbbae7 req-90db57c3-e7c0-40cd-886e-b41d4078887b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:34.982406 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-78a280f1-8835-4eca-8ea2-943f92fbbae7 req-90db57c3-e7c0-40cd-886e-b41d4078887b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:34.986147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-78a280f1-8835-4eca-8ea2-943f92fbbae7 req-90db57c3-e7c0-40cd-886e-b41d4078887b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:35.022755 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-78a280f1-8835-4eca-8ea2-943f92fbbae7 req-90db57c3-e7c0-40cd-886e-b41d4078887b service nova] Creating event network-vif-unplugged:d7427540-da45-49cd-8b9c-b7aa57d8fc78 for instance 7289e6c1-bbfd-4239-8a82-43ffe2335ec9 on nch1-master-1 Sep 17 20:52:35.042973 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-78a280f1-8835-4eca-8ea2-943f92fbbae7 req-90db57c3-e7c0-40cd-886e-b41d4078887b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.296250 Sep 17 20:52:35.046028 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 245/559] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:52:35.089726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b1bbbc1f-94b9-4905-bc72-5d28d2af0bd2 tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Calling method '.version_select at 0x7f25a59678b0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:35.292140 ncdv-master-1 devstack@n-api.service[140523]: DEBUG neutronclient.v2_0.client [None req-b1bbbc1f-94b9-4905-bc72-5d28d2af0bd2 tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 98c36d43-d233-47c3-99b7-0b75b75a4387 does not exist", "detail": ""}} {{(pid=140523) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 17 20:52:35.293090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.security_group_api [None req-b1bbbc1f-94b9-4905-bc72-5d28d2af0bd2 tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Neutron security group rule 98c36d43-d233-47c3-99b7-0b75b75a4387 not found {{(pid=140523) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Sep 17 20:52:35.294729 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-b1bbbc1f-94b9-4905-bc72-5d28d2af0bd2 tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] HTTP exception thrown: Security group rule 98c36d43-d233-47c3-99b7-0b75b75a4387 does not exist Sep 17 20:52:35.294729 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-d2ce6fa0-c263-42fa-ba33-33754ebf89c1'] Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b1bbbc1f-94b9-4905-bc72-5d28d2af0bd2 tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Request method failure captured: Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/os-security-group-rules/98c36d43-d233-47c3-99b7-0b75b75a4387 HTTP/1.1 Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjOE_XhRYJy_YLIkTxEg9iYWCOySS05m8GhtFSZH2g4mVhgm8kcxHfeDXuz5zK_y7xyakIoROrAQjNsLTi9WqKEfpzJYreOjtJQ6I5RVKtFyqx8nT6lkIEC5qHtWzNF7SQ6gUfOmz1-d7NfQU8cAeQYwr_34XSNjhI-aoc4BZA30Ucw Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 6589c8be0f944eb7bb726df3d468d2f8 Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-910357177 Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6589c8be0f944eb7bb726df3d468d2f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6589c8be0f944eb7bb726df3d468d2f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6589c8be0f944eb7bb726df3d468d2f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6589c8be0f944eb7bb726df3d468d2f8", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-910357177 Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 6589c8be0f944eb7bb726df3d468d2f8 Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-910357177 Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-910357177-project Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 5b6c0aef786d4fd7ba8c5bd00a097fe6 Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-910357177-project Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: exception: Security group rule 98c36d43-d233-47c3-99b7-0b75b75a4387 does not exist Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-d2ce6fa0-c263-42fa-ba33-33754ebf89c1'] Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '98c36d43-d233-47c3-99b7-0b75b75a4387'} Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 17 20:52:35.298219 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 98c36d43-d233-47c3-99b7-0b75b75a4387 does not exist Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2ce6fa0-c263-42fa-ba33-33754ebf89c1'] Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 98c36d43-d233-47c3-99b7-0b75b75a4387 does not exist Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2ce6fa0-c263-42fa-ba33-33754ebf89c1'] Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 98c36d43-d233-47c3-99b7-0b75b75a4387 does not exist Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2ce6fa0-c263-42fa-ba33-33754ebf89c1'] Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 98c36d43-d233-47c3-99b7-0b75b75a4387 does not exist Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2ce6fa0-c263-42fa-ba33-33754ebf89c1'] Sep 17 20:52:35.306473 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:52:35.316434 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b1bbbc1f-94b9-4905-bc72-5d28d2af0bd2 tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Returning 404 to user: Security group rule 98c36d43-d233-47c3-99b7-0b75b75a4387 does not exist Sep 17 20:52:35.316434 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-d2ce6fa0-c263-42fa-ba33-33754ebf89c1'] {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:52:35.318314 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b1bbbc1f-94b9-4905-bc72-5d28d2af0bd2 tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-group-rules/98c36d43-d233-47c3-99b7-0b75b75a4387" status: 404 len: 199 microversion: 2.1 time: 0.255576 Sep 17 20:52:35.320256 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 246/560] 10.222.0.26 () {58 vars in 1287 bytes} [Sat Sep 17 20:52:35 2022] DELETE /compute/v2.1/os-security-group-rules/98c36d43-d233-47c3-99b7-0b75b75a4387 => generated 199 bytes in 274 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:52:35.341978 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-793069aa-a8bd-4553-9a15-da665236076d tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Calling method '.version_select at 0x7f25a5b2cdc0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:35.623930 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f311e1a1-d38d-4e1e-8d7b-7ff740b47c5d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:35.640759 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f311e1a1-d38d-4e1e-8d7b-7ff740b47c5d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:35.642221 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f311e1a1-d38d-4e1e-8d7b-7ff740b47c5d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:35.643423 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f311e1a1-d38d-4e1e-8d7b-7ff740b47c5d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9" status: 200 len: 1569 microversion: 2.25 time: 0.730679 Sep 17 20:52:35.643991 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 315/561] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:34 2022] GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9 => generated 1569 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:35.676470 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-832cb87f-4fbf-45d8-a4ff-2e169ae1cd56 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:35.680437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-832cb87f-4fbf-45d8-a4ff-2e169ae1cd56 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:35.694896 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-832cb87f-4fbf-45d8-a4ff-2e169ae1cd56 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:35.695399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-832cb87f-4fbf-45d8-a4ff-2e169ae1cd56 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:35.695834 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-832cb87f-4fbf-45d8-a4ff-2e169ae1cd56 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:35.699613 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-832cb87f-4fbf-45d8-a4ff-2e169ae1cd56 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:35.700108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-832cb87f-4fbf-45d8-a4ff-2e169ae1cd56 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:35.700549 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-832cb87f-4fbf-45d8-a4ff-2e169ae1cd56 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:36.066544 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-793069aa-a8bd-4553-9a15-da665236076d tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/41828f8f-3bdc-4626-b17d-dce539b9d2db" status: 202 len: 0 microversion: 2.1 time: 0.740814 Sep 17 20:52:36.070070 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 247/562] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 20:52:35 2022] DELETE /compute/v2.1/os-security-groups/41828f8f-3bdc-4626-b17d-dce539b9d2db => generated 0 bytes in 743 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:52:36.073426 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ee8724a4-28d5-4358-a68c-a8338e83fdc4 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:36.074488 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ee8724a4-28d5-4358-a68c-a8338e83fdc4 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:36.092909 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee8724a4-28d5-4358-a68c-a8338e83fdc4 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:36.096382 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee8724a4-28d5-4358-a68c-a8338e83fdc4 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:36.097090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee8724a4-28d5-4358-a68c-a8338e83fdc4 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:36.109429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee8724a4-28d5-4358-a68c-a8338e83fdc4 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:36.110270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee8724a4-28d5-4358-a68c-a8338e83fdc4 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:36.116167 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee8724a4-28d5-4358-a68c-a8338e83fdc4 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:36.333670 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ee8724a4-28d5-4358-a68c-a8338e83fdc4 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:36.347954 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ee8724a4-28d5-4358-a68c-a8338e83fdc4 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:36.349886 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ee8724a4-28d5-4358-a68c-a8338e83fdc4 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:36.355930 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:52:36.358533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-832cb87f-4fbf-45d8-a4ff-2e169ae1cd56 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:36.366525 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ee8724a4-28d5-4358-a68c-a8338e83fdc4 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1447 microversion: 2.75 time: 0.295426 Sep 17 20:52:36.368407 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 248/563] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:36 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1447 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:36.387357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-000d5ea9-2dd8-4ece-bcce-659068761b91 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:36.389322 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-000d5ea9-2dd8-4ece-bcce-659068761b91 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:36.402095 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-832cb87f-4fbf-45d8-a4ff-2e169ae1cd56 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1475 microversion: 2.1 time: 0.752119 Sep 17 20:52:36.405302 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 316/564] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:35 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1475 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:36.406136 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-000d5ea9-2dd8-4ece-bcce-659068761b91 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:36.408296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-000d5ea9-2dd8-4ece-bcce-659068761b91 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:36.408974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-000d5ea9-2dd8-4ece-bcce-659068761b91 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:36.412171 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-000d5ea9-2dd8-4ece-bcce-659068761b91 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:36.412925 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-000d5ea9-2dd8-4ece-bcce-659068761b91 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:36.414807 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-000d5ea9-2dd8-4ece-bcce-659068761b91 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:36.424336 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e7231bd0-1dd6-4da1-85e1-a08294b3822e tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:36.425256 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e7231bd0-1dd6-4da1-85e1-a08294b3822e tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] [instance: 9d268239-a1b7-433b-a3f1-52e84ad59682] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:36.434299 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7231bd0-1dd6-4da1-85e1-a08294b3822e tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:36.435049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7231bd0-1dd6-4da1-85e1-a08294b3822e tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:36.435681 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7231bd0-1dd6-4da1-85e1-a08294b3822e tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:36.436560 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7231bd0-1dd6-4da1-85e1-a08294b3822e tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:36.437171 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7231bd0-1dd6-4da1-85e1-a08294b3822e tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:36.437845 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7231bd0-1dd6-4da1-85e1-a08294b3822e tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:36.615658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=8 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:52:36.660834 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e7231bd0-1dd6-4da1-85e1-a08294b3822e tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb0a86572434db48c987279d67cd4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e566b2c69fec4ec784a13e4034eaef72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:36.676010 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e7231bd0-1dd6-4da1-85e1-a08294b3822e tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] 10.222.0.26 "GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682" status: 200 len: 1283 microversion: 2.1 time: 0.267088 Sep 17 20:52:36.677128 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 317/565] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:36 2022] GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682 => generated 1283 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:36.697419 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-109a5517-3082-4787-a4b0-b9ff226a189f tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Calling method '.version_select at 0x7f25a5c380d0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:37.488758 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-000d5ea9-2dd8-4ece-bcce-659068761b91 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f7c0fdad9346c58949928300021b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f305d163acf499c9808c5f11150a7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:37.497124 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-000d5ea9-2dd8-4ece-bcce-659068761b91 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7" status: 200 len: 1388 microversion: 2.1 time: 1.127415 Sep 17 20:52:37.501360 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 249/566] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:36 2022] GET /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 => generated 1388 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:37.518031 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-adcfa3df-1d6e-4ccb-9950-9bdb55c71d7c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:37.518665 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-adcfa3df-1d6e-4ccb-9950-9bdb55c71d7c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:37.531589 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-adcfa3df-1d6e-4ccb-9950-9bdb55c71d7c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:37.532091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-adcfa3df-1d6e-4ccb-9950-9bdb55c71d7c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:37.532558 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-adcfa3df-1d6e-4ccb-9950-9bdb55c71d7c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:37.533345 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-adcfa3df-1d6e-4ccb-9950-9bdb55c71d7c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:37.533722 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-adcfa3df-1d6e-4ccb-9950-9bdb55c71d7c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:37.534153 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-adcfa3df-1d6e-4ccb-9950-9bdb55c71d7c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:37.623498 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=4 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:52:37.799279 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-109a5517-3082-4787-a4b0-b9ff226a189f tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/398ca3bb-2456-4980-8751-d428e717946d" status: 202 len: 0 microversion: 2.1 time: 1.120747 Sep 17 20:52:37.800504 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 318/567] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 20:52:36 2022] DELETE /compute/v2.1/os-security-groups/398ca3bb-2456-4980-8751-d428e717946d => generated 0 bytes in 1123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:52:37.816656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c3977d29-aaf6-463c-a182-5e1d57040440 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:37.817382 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c3977d29-aaf6-463c-a182-5e1d57040440 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:37.832058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3977d29-aaf6-463c-a182-5e1d57040440 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:37.836940 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3977d29-aaf6-463c-a182-5e1d57040440 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:37.843264 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3977d29-aaf6-463c-a182-5e1d57040440 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:37.844055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3977d29-aaf6-463c-a182-5e1d57040440 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:37.844535 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3977d29-aaf6-463c-a182-5e1d57040440 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:37.844996 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3977d29-aaf6-463c-a182-5e1d57040440 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:37.983343 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-adcfa3df-1d6e-4ccb-9950-9bdb55c71d7c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:37.997643 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-adcfa3df-1d6e-4ccb-9950-9bdb55c71d7c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:37.999112 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-adcfa3df-1d6e-4ccb-9950-9bdb55c71d7c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:38.000324 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-adcfa3df-1d6e-4ccb-9950-9bdb55c71d7c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9" status: 200 len: 1569 microversion: 2.25 time: 0.497930 Sep 17 20:52:38.002436 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 250/568] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:37 2022] GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9 => generated 1569 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:38.009892 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-a4faa2b2-5a7b-4ffe-ad43-89495bc76e99 req-34fbddf2-e9b4-4685-b645-1761eee9e52a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7289e6c1-bbfd-4239-8a82-43ffe2335ec9", "tag": "d7427540-da45-49cd-8b9c-b7aa57d8fc78"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:38.026640 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-a4faa2b2-5a7b-4ffe-ad43-89495bc76e99 req-34fbddf2-e9b4-4685-b645-1761eee9e52a service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:38.027403 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-a4faa2b2-5a7b-4ffe-ad43-89495bc76e99 req-34fbddf2-e9b4-4685-b645-1761eee9e52a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:38.028872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-a4faa2b2-5a7b-4ffe-ad43-89495bc76e99 req-34fbddf2-e9b4-4685-b645-1761eee9e52a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:38.030206 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c3977d29-aaf6-463c-a182-5e1d57040440 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:38.040862 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c3977d29-aaf6-463c-a182-5e1d57040440 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:38.052050 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c3977d29-aaf6-463c-a182-5e1d57040440 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:38.061682 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-a4faa2b2-5a7b-4ffe-ad43-89495bc76e99 req-34fbddf2-e9b4-4685-b645-1761eee9e52a service nova] Creating event network-changed:d7427540-da45-49cd-8b9c-b7aa57d8fc78 for instance 7289e6c1-bbfd-4239-8a82-43ffe2335ec9 on nch1-master-1 Sep 17 20:52:38.066249 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c3977d29-aaf6-463c-a182-5e1d57040440 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1447 microversion: 2.75 time: 0.262804 Sep 17 20:52:38.069652 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 319/569] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:37 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1447 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:38.071794 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-a4faa2b2-5a7b-4ffe-ad43-89495bc76e99 req-34fbddf2-e9b4-4685-b645-1761eee9e52a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067757 Sep 17 20:52:38.073752 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 251/570] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:52:38.087704 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-901f4707-5721-4755-a3e9-4f1da877be5b tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:38.091155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-901f4707-5721-4755-a3e9-4f1da877be5b tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] [instance: 9d268239-a1b7-433b-a3f1-52e84ad59682] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:38.096455 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-67246624-da81-415c-b7c4-7a28e2c4315d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:38.097082 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-67246624-da81-415c-b7c4-7a28e2c4315d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:38.107286 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-901f4707-5721-4755-a3e9-4f1da877be5b tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:38.110082 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-901f4707-5721-4755-a3e9-4f1da877be5b tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:38.110803 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-901f4707-5721-4755-a3e9-4f1da877be5b tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:38.112525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-67246624-da81-415c-b7c4-7a28e2c4315d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:38.113028 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-67246624-da81-415c-b7c4-7a28e2c4315d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:38.113647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-901f4707-5721-4755-a3e9-4f1da877be5b tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:38.114352 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-901f4707-5721-4755-a3e9-4f1da877be5b tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:38.116374 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-901f4707-5721-4755-a3e9-4f1da877be5b tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:38.118845 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-67246624-da81-415c-b7c4-7a28e2c4315d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:38.119643 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-67246624-da81-415c-b7c4-7a28e2c4315d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:38.120168 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-67246624-da81-415c-b7c4-7a28e2c4315d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:38.121301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-67246624-da81-415c-b7c4-7a28e2c4315d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:38.325415 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-901f4707-5721-4755-a3e9-4f1da877be5b tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb0a86572434db48c987279d67cd4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e566b2c69fec4ec784a13e4034eaef72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:38.333611 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-901f4707-5721-4755-a3e9-4f1da877be5b tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] 10.222.0.26 "GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682" status: 200 len: 1289 microversion: 2.1 time: 0.257217 Sep 17 20:52:38.340519 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 252/571] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:38 2022] GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682 => generated 1289 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:38.360326 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6680c589-ea92-4e29-83ca-1d9a77243dfd tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Calling method '.version_select at 0x7f25a59ddf70>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:38.517237 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-67246624-da81-415c-b7c4-7a28e2c4315d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:38.529951 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-67246624-da81-415c-b7c4-7a28e2c4315d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1475 microversion: 2.1 time: 0.458935 Sep 17 20:52:38.530549 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 320/572] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:38 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1475 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:38.541092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ca962329-3f5d-478b-85ac-57a383fab84d tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:38.548715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ca962329-3f5d-478b-85ac-57a383fab84d tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:38.566441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca962329-3f5d-478b-85ac-57a383fab84d tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:38.567175 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca962329-3f5d-478b-85ac-57a383fab84d tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:38.570301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca962329-3f5d-478b-85ac-57a383fab84d tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:38.571380 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca962329-3f5d-478b-85ac-57a383fab84d tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:38.572064 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca962329-3f5d-478b-85ac-57a383fab84d tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:38.572690 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca962329-3f5d-478b-85ac-57a383fab84d tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:39.004050 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ca962329-3f5d-478b-85ac-57a383fab84d tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f7c0fdad9346c58949928300021b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f305d163acf499c9808c5f11150a7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:39.019169 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ca962329-3f5d-478b-85ac-57a383fab84d tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7" status: 200 len: 1388 microversion: 2.1 time: 0.487517 Sep 17 20:52:39.022191 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 321/573] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:38 2022] GET /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 => generated 1388 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:39.042588 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1d18fc0c-400a-4db8-9579-21ae927c3dc5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:39.043285 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1d18fc0c-400a-4db8-9579-21ae927c3dc5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:39.051194 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d18fc0c-400a-4db8-9579-21ae927c3dc5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:39.054243 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d18fc0c-400a-4db8-9579-21ae927c3dc5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:39.055024 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d18fc0c-400a-4db8-9579-21ae927c3dc5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:39.056189 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d18fc0c-400a-4db8-9579-21ae927c3dc5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:39.056883 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d18fc0c-400a-4db8-9579-21ae927c3dc5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:39.057588 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d18fc0c-400a-4db8-9579-21ae927c3dc5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:39.438622 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6680c589-ea92-4e29-83ca-1d9a77243dfd tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/6ca88cbe-8974-4525-b24f-51a20be52e47" status: 202 len: 0 microversion: 2.1 time: 1.086764 Sep 17 20:52:39.440403 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 253/574] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 20:52:38 2022] DELETE /compute/v2.1/os-security-groups/6ca88cbe-8974-4525-b24f-51a20be52e47 => generated 0 bytes in 1099 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:52:39.448684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-89cad777-e74b-4a54-84e8-19aeb66a5b7d tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:39.449851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-89cad777-e74b-4a54-84e8-19aeb66a5b7d tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:39.464806 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89cad777-e74b-4a54-84e8-19aeb66a5b7d tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:39.465768 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89cad777-e74b-4a54-84e8-19aeb66a5b7d tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:39.466777 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89cad777-e74b-4a54-84e8-19aeb66a5b7d tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:39.467829 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89cad777-e74b-4a54-84e8-19aeb66a5b7d tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:39.468599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89cad777-e74b-4a54-84e8-19aeb66a5b7d tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:39.469278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89cad777-e74b-4a54-84e8-19aeb66a5b7d tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:39.557496 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1d18fc0c-400a-4db8-9579-21ae927c3dc5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:39.591592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1d18fc0c-400a-4db8-9579-21ae927c3dc5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:39.593627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1d18fc0c-400a-4db8-9579-21ae927c3dc5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:39.595331 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1d18fc0c-400a-4db8-9579-21ae927c3dc5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9" status: 200 len: 1569 microversion: 2.25 time: 0.566284 Sep 17 20:52:39.602645 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 322/575] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:39 2022] GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9 => generated 1569 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:39.623277 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e9fe222e-ea99-4acf-a661-8779d381e699 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:39.624163 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e9fe222e-ea99-4acf-a661-8779d381e699 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] [instance: 9d268239-a1b7-433b-a3f1-52e84ad59682] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:39.633370 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9fe222e-ea99-4acf-a661-8779d381e699 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:39.634176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9fe222e-ea99-4acf-a661-8779d381e699 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:39.634918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9fe222e-ea99-4acf-a661-8779d381e699 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:39.635871 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9fe222e-ea99-4acf-a661-8779d381e699 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:39.636641 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9fe222e-ea99-4acf-a661-8779d381e699 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:39.637228 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9fe222e-ea99-4acf-a661-8779d381e699 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:39.738024 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-89cad777-e74b-4a54-84e8-19aeb66a5b7d tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:39.755782 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-89cad777-e74b-4a54-84e8-19aeb66a5b7d tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:39.757582 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-89cad777-e74b-4a54-84e8-19aeb66a5b7d tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:39.763716 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-89cad777-e74b-4a54-84e8-19aeb66a5b7d tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1447 microversion: 2.75 time: 0.320030 Sep 17 20:52:39.765328 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 254/576] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:39 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1447 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:39.770369 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-461be360-45c2-4656-96ed-a408a14fe74b tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Calling method '.version_select at 0x7f25a5967dc0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:39.909127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e9fe222e-ea99-4acf-a661-8779d381e699 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb0a86572434db48c987279d67cd4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e566b2c69fec4ec784a13e4034eaef72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:39.924104 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e9fe222e-ea99-4acf-a661-8779d381e699 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] 10.222.0.26 "GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682" status: 200 len: 1331 microversion: 2.1 time: 0.319613 Sep 17 20:52:39.925069 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 323/577] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:39 2022] GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682 => generated 1331 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:39.930787 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5a018339-d951-4c76-8daa-0bf75592bec4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:39.931822 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5a018339-d951-4c76-8daa-0bf75592bec4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:39.940385 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a018339-d951-4c76-8daa-0bf75592bec4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:39.941184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a018339-d951-4c76-8daa-0bf75592bec4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:39.941994 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a018339-d951-4c76-8daa-0bf75592bec4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:39.943898 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a018339-d951-4c76-8daa-0bf75592bec4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:39.944589 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a018339-d951-4c76-8daa-0bf75592bec4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:39.945166 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a018339-d951-4c76-8daa-0bf75592bec4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:40.119753 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-461be360-45c2-4656-96ed-a408a14fe74b tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/bc24665a-002d-4bd4-8534-cdfa399159f3" status: 202 len: 0 microversion: 2.1 time: 0.352993 Sep 17 20:52:40.120440 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 255/578] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 20:52:39 2022] DELETE /compute/v2.1/os-security-groups/bc24665a-002d-4bd4-8534-cdfa399159f3 => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:52:40.126098 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a01da87e-2bce-4cdb-a48f-fdf88b31bd93 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:40.127224 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a01da87e-2bce-4cdb-a48f-fdf88b31bd93 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:40.148596 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a01da87e-2bce-4cdb-a48f-fdf88b31bd93 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:40.149252 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a01da87e-2bce-4cdb-a48f-fdf88b31bd93 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:40.150821 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a01da87e-2bce-4cdb-a48f-fdf88b31bd93 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:40.152282 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a01da87e-2bce-4cdb-a48f-fdf88b31bd93 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:40.153148 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a01da87e-2bce-4cdb-a48f-fdf88b31bd93 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:40.153623 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a01da87e-2bce-4cdb-a48f-fdf88b31bd93 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:40.217184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5a018339-d951-4c76-8daa-0bf75592bec4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:40.226901 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5a018339-d951-4c76-8daa-0bf75592bec4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1475 microversion: 2.1 time: 0.300532 Sep 17 20:52:40.231683 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 324/579] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:39 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1475 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:40.258160 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7b324822-ca5a-4a45-9729-4d378b2d4f55 tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] Calling method '.version_select at 0x7f25a58f0430>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:40.454580 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a01da87e-2bce-4cdb-a48f-fdf88b31bd93 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f7c0fdad9346c58949928300021b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f305d163acf499c9808c5f11150a7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:40.469196 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a01da87e-2bce-4cdb-a48f-fdf88b31bd93 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7" status: 200 len: 1388 microversion: 2.1 time: 0.346754 Sep 17 20:52:40.469931 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 256/580] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:40 2022] GET /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 => generated 1388 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:40.558070 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7b324822-ca5a-4a45-9729-4d378b2d4f55 tempest-SecurityGroupRulesNegativeTestJSON-910357177 tempest-SecurityGroupRulesNegativeTestJSON-910357177-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/80c0e0b9-fbed-4af0-9187-16ea2894cfe5" status: 202 len: 0 microversion: 2.1 time: 0.315143 Sep 17 20:52:40.563209 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 325/581] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 20:52:40 2022] DELETE /compute/v2.1/os-security-groups/80c0e0b9-fbed-4af0-9187-16ea2894cfe5 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:52:40.626271 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2d8b4169-58b2-4a09-a7e4-ff4e467a8448 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:40.627241 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2d8b4169-58b2-4a09-a7e4-ff4e467a8448 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:40.637046 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d8b4169-58b2-4a09-a7e4-ff4e467a8448 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:40.639206 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d8b4169-58b2-4a09-a7e4-ff4e467a8448 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:40.639974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d8b4169-58b2-4a09-a7e4-ff4e467a8448 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:40.640895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d8b4169-58b2-4a09-a7e4-ff4e467a8448 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:40.641687 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d8b4169-58b2-4a09-a7e4-ff4e467a8448 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:40.642293 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d8b4169-58b2-4a09-a7e4-ff4e467a8448 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:40.797740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-35a2f589-d457-4537-8efe-b43610f9bb9e tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:40.798330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-35a2f589-d457-4537-8efe-b43610f9bb9e tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:40.807050 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-35a2f589-d457-4537-8efe-b43610f9bb9e tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:40.807523 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-35a2f589-d457-4537-8efe-b43610f9bb9e tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:40.808021 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-35a2f589-d457-4537-8efe-b43610f9bb9e tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:40.808731 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-35a2f589-d457-4537-8efe-b43610f9bb9e tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:40.809180 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-35a2f589-d457-4537-8efe-b43610f9bb9e tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:40.809632 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-35a2f589-d457-4537-8efe-b43610f9bb9e tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:40.956369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-35a2f589-d457-4537-8efe-b43610f9bb9e tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:40.967606 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-35a2f589-d457-4537-8efe-b43610f9bb9e tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:40.969552 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-35a2f589-d457-4537-8efe-b43610f9bb9e tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:40.976073 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-35a2f589-d457-4537-8efe-b43610f9bb9e tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1447 microversion: 2.75 time: 0.183271 Sep 17 20:52:40.977245 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 326/582] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:40 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1447 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:40.982976 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cef4fdea-4862-4ffc-bcc0-4bd5ca536353 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:40.983791 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cef4fdea-4862-4ffc-bcc0-4bd5ca536353 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] [instance: 9d268239-a1b7-433b-a3f1-52e84ad59682] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:40.991237 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cef4fdea-4862-4ffc-bcc0-4bd5ca536353 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:40.992077 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cef4fdea-4862-4ffc-bcc0-4bd5ca536353 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:40.992810 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cef4fdea-4862-4ffc-bcc0-4bd5ca536353 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:40.993873 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cef4fdea-4862-4ffc-bcc0-4bd5ca536353 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:40.994667 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cef4fdea-4862-4ffc-bcc0-4bd5ca536353 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:40.995888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cef4fdea-4862-4ffc-bcc0-4bd5ca536353 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:41.081817 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2d8b4169-58b2-4a09-a7e4-ff4e467a8448 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:41.097074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2d8b4169-58b2-4a09-a7e4-ff4e467a8448 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:41.099390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2d8b4169-58b2-4a09-a7e4-ff4e467a8448 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:41.100672 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2d8b4169-58b2-4a09-a7e4-ff4e467a8448 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9" status: 200 len: 1569 microversion: 2.25 time: 0.481028 Sep 17 20:52:41.101282 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 257/583] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:40 2022] GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9 => generated 1569 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:41.254337 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4be864f5-acc7-4e5d-a838-8d0368144fa9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:41.256057 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4be864f5-acc7-4e5d-a838-8d0368144fa9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:41.262646 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4be864f5-acc7-4e5d-a838-8d0368144fa9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:41.263491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4be864f5-acc7-4e5d-a838-8d0368144fa9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:41.264147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4be864f5-acc7-4e5d-a838-8d0368144fa9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:41.265094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4be864f5-acc7-4e5d-a838-8d0368144fa9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:41.265812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4be864f5-acc7-4e5d-a838-8d0368144fa9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:41.266455 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4be864f5-acc7-4e5d-a838-8d0368144fa9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:41.295092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cef4fdea-4862-4ffc-bcc0-4bd5ca536353 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb0a86572434db48c987279d67cd4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e566b2c69fec4ec784a13e4034eaef72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:41.310305 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cef4fdea-4862-4ffc-bcc0-4bd5ca536353 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] 10.222.0.26 "GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682" status: 200 len: 1331 microversion: 2.1 time: 0.330923 Sep 17 20:52:41.311062 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 327/584] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:40 2022] GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682 => generated 1331 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:41.315883 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-e71414f8-3355-4498-a24d-cd2dd27b135f req-0ff766bd-bd4e-4cfc-a003-63366b59187f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7", "name": "network-vif-plugged", "status": "completed", "tag": "69898655-651f-4c1b-afd3-8dc1cb5c1d0e"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:41.338222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e71414f8-3355-4498-a24d-cd2dd27b135f req-0ff766bd-bd4e-4cfc-a003-63366b59187f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:41.339093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e71414f8-3355-4498-a24d-cd2dd27b135f req-0ff766bd-bd4e-4cfc-a003-63366b59187f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:41.339729 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e71414f8-3355-4498-a24d-cd2dd27b135f req-0ff766bd-bd4e-4cfc-a003-63366b59187f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:41.361590 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-e71414f8-3355-4498-a24d-cd2dd27b135f req-0ff766bd-bd4e-4cfc-a003-63366b59187f service nova] Creating event network-vif-plugged:69898655-651f-4c1b-afd3-8dc1cb5c1d0e for instance 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 on nch2-master-1 Sep 17 20:52:41.369882 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-e71414f8-3355-4498-a24d-cd2dd27b135f req-0ff766bd-bd4e-4cfc-a003-63366b59187f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056762 Sep 17 20:52:41.371316 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 328/585] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:52:41.495036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9f9303f6-007f-42a7-8505-a76508eb38c4 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:41.496366 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9f9303f6-007f-42a7-8505-a76508eb38c4 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:41.505613 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9f9303f6-007f-42a7-8505-a76508eb38c4 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:41.506470 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9f9303f6-007f-42a7-8505-a76508eb38c4 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:41.507316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9f9303f6-007f-42a7-8505-a76508eb38c4 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:41.508409 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9f9303f6-007f-42a7-8505-a76508eb38c4 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:41.509071 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9f9303f6-007f-42a7-8505-a76508eb38c4 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:41.509754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9f9303f6-007f-42a7-8505-a76508eb38c4 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:41.630034 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4be864f5-acc7-4e5d-a838-8d0368144fa9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:41.646846 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4be864f5-acc7-4e5d-a838-8d0368144fa9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1475 microversion: 2.1 time: 0.396371 Sep 17 20:52:41.663738 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 258/586] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:41 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1475 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:52:41.773161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9f9303f6-007f-42a7-8505-a76508eb38c4 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f7c0fdad9346c58949928300021b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f305d163acf499c9808c5f11150a7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:41.787301 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9f9303f6-007f-42a7-8505-a76508eb38c4 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7" status: 200 len: 1388 microversion: 2.1 time: 0.298266 Sep 17 20:52:41.788291 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 329/587] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:41 2022] GET /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 => generated 1388 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:42.009168 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3b86ab45-ea75-4084-99d9-0a25fcff5e1a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:42.009797 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3b86ab45-ea75-4084-99d9-0a25fcff5e1a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:42.016166 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3b86ab45-ea75-4084-99d9-0a25fcff5e1a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:42.016874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3b86ab45-ea75-4084-99d9-0a25fcff5e1a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:42.017452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3b86ab45-ea75-4084-99d9-0a25fcff5e1a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:42.018360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3b86ab45-ea75-4084-99d9-0a25fcff5e1a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:42.018977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3b86ab45-ea75-4084-99d9-0a25fcff5e1a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:42.019394 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3b86ab45-ea75-4084-99d9-0a25fcff5e1a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:42.024649 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:52:42.125967 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3b86ab45-ea75-4084-99d9-0a25fcff5e1a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:42.131185 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-39e37947-ec52-4300-8a71-f51c74014179 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:42.131818 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-39e37947-ec52-4300-8a71-f51c74014179 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:42.136873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3b86ab45-ea75-4084-99d9-0a25fcff5e1a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:42.141400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3b86ab45-ea75-4084-99d9-0a25fcff5e1a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:42.145095 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39e37947-ec52-4300-8a71-f51c74014179 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:42.145620 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39e37947-ec52-4300-8a71-f51c74014179 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:42.146064 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39e37947-ec52-4300-8a71-f51c74014179 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:42.146794 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39e37947-ec52-4300-8a71-f51c74014179 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:42.147249 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39e37947-ec52-4300-8a71-f51c74014179 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:42.150157 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39e37947-ec52-4300-8a71-f51c74014179 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:42.158022 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3b86ab45-ea75-4084-99d9-0a25fcff5e1a tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1447 microversion: 2.75 time: 0.152928 Sep 17 20:52:42.160844 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 259/588] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:42 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1447 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:42.339471 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7a0a956c-60ea-4945-8aee-d259dc4e7d4d tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:42.341295 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7a0a956c-60ea-4945-8aee-d259dc4e7d4d tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] [instance: 9d268239-a1b7-433b-a3f1-52e84ad59682] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:42.355704 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a0a956c-60ea-4945-8aee-d259dc4e7d4d tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:42.356197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a0a956c-60ea-4945-8aee-d259dc4e7d4d tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:42.356633 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a0a956c-60ea-4945-8aee-d259dc4e7d4d tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:42.357347 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a0a956c-60ea-4945-8aee-d259dc4e7d4d tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:42.363053 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a0a956c-60ea-4945-8aee-d259dc4e7d4d tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:42.363535 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a0a956c-60ea-4945-8aee-d259dc4e7d4d tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:42.503590 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-39e37947-ec52-4300-8a71-f51c74014179 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:42.514222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-39e37947-ec52-4300-8a71-f51c74014179 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:42.515665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-39e37947-ec52-4300-8a71-f51c74014179 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:42.516859 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-39e37947-ec52-4300-8a71-f51c74014179 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9" status: 200 len: 1569 microversion: 2.25 time: 0.390533 Sep 17 20:52:42.518242 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 330/589] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:42 2022] GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9 => generated 1569 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 20:52:42.627880 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-0194d6ec-2fa6-4bd6-91b4-635dae400f5c req-a4ce8724-0adc-4022-a704-7e5b243baeab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d268239-a1b7-433b-a3f1-52e84ad59682", "tag": "a1936332-9c49-496c-a1d8-d378ab79c8ff"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:42.639525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-0194d6ec-2fa6-4bd6-91b4-635dae400f5c req-a4ce8724-0adc-4022-a704-7e5b243baeab service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:42.640233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-0194d6ec-2fa6-4bd6-91b4-635dae400f5c req-a4ce8724-0adc-4022-a704-7e5b243baeab service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:42.640874 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-0194d6ec-2fa6-4bd6-91b4-635dae400f5c req-a4ce8724-0adc-4022-a704-7e5b243baeab service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:42.657152 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-0194d6ec-2fa6-4bd6-91b4-635dae400f5c req-a4ce8724-0adc-4022-a704-7e5b243baeab service nova] Creating event network-changed:a1936332-9c49-496c-a1d8-d378ab79c8ff for instance 9d268239-a1b7-433b-a3f1-52e84ad59682 on nch1-master-1 Sep 17 20:52:42.663497 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-0194d6ec-2fa6-4bd6-91b4-635dae400f5c req-a4ce8724-0adc-4022-a704-7e5b243baeab service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044958 Sep 17 20:52:42.664813 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 331/590] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:52:42.673182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-94142a9d-1cda-4605-86a0-74d893957e74 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:42.673911 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-94142a9d-1cda-4605-86a0-74d893957e74 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:42.699980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94142a9d-1cda-4605-86a0-74d893957e74 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:42.700484 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94142a9d-1cda-4605-86a0-74d893957e74 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:42.700958 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94142a9d-1cda-4605-86a0-74d893957e74 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:42.701711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94142a9d-1cda-4605-86a0-74d893957e74 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:42.702166 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94142a9d-1cda-4605-86a0-74d893957e74 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:42.702589 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94142a9d-1cda-4605-86a0-74d893957e74 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:43.115674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7a0a956c-60ea-4945-8aee-d259dc4e7d4d tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb0a86572434db48c987279d67cd4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e566b2c69fec4ec784a13e4034eaef72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:43.139889 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7a0a956c-60ea-4945-8aee-d259dc4e7d4d tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] 10.222.0.26 "GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682" status: 200 len: 1331 microversion: 2.1 time: 0.811357 Sep 17 20:52:43.145755 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 260/591] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:42 2022] GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682 => generated 1331 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:43.154773 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-94142a9d-1cda-4605-86a0-74d893957e74 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:43.166650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-63978e38-abea-4384-8a33-ccb2bd63c041 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:43.169492 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-94142a9d-1cda-4605-86a0-74d893957e74 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1475 microversion: 2.1 time: 0.501216 Sep 17 20:52:43.170837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-63978e38-abea-4384-8a33-ccb2bd63c041 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:43.170962 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 332/592] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:42 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1475 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:43.189314 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-63978e38-abea-4384-8a33-ccb2bd63c041 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:43.190042 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-63978e38-abea-4384-8a33-ccb2bd63c041 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:43.190772 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-63978e38-abea-4384-8a33-ccb2bd63c041 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:43.191666 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-63978e38-abea-4384-8a33-ccb2bd63c041 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:43.191835 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-68a98daf-fb05-4efa-a9fc-3aa6e1c00010 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:43.192544 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-68a98daf-fb05-4efa-a9fc-3aa6e1c00010 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:43.194917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-63978e38-abea-4384-8a33-ccb2bd63c041 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:43.195543 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-63978e38-abea-4384-8a33-ccb2bd63c041 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:43.203808 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68a98daf-fb05-4efa-a9fc-3aa6e1c00010 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:43.206007 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68a98daf-fb05-4efa-a9fc-3aa6e1c00010 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:43.206704 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68a98daf-fb05-4efa-a9fc-3aa6e1c00010 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:43.211873 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68a98daf-fb05-4efa-a9fc-3aa6e1c00010 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:43.212709 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68a98daf-fb05-4efa-a9fc-3aa6e1c00010 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:43.214785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68a98daf-fb05-4efa-a9fc-3aa6e1c00010 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:43.431267 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-68a98daf-fb05-4efa-a9fc-3aa6e1c00010 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:43.446595 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-68a98daf-fb05-4efa-a9fc-3aa6e1c00010 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:43.448034 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-68a98daf-fb05-4efa-a9fc-3aa6e1c00010 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:43.459246 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-68a98daf-fb05-4efa-a9fc-3aa6e1c00010 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1447 microversion: 2.75 time: 0.272541 Sep 17 20:52:43.462040 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 333/593] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:43 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1447 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 20:52:43.542416 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b451e6f3-8baf-4853-a7fe-1beb58498b7d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:43.543101 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b451e6f3-8baf-4853-a7fe-1beb58498b7d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:43.549884 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b451e6f3-8baf-4853-a7fe-1beb58498b7d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:43.550592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b451e6f3-8baf-4853-a7fe-1beb58498b7d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:43.551028 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b451e6f3-8baf-4853-a7fe-1beb58498b7d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:43.551702 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b451e6f3-8baf-4853-a7fe-1beb58498b7d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:43.552396 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b451e6f3-8baf-4853-a7fe-1beb58498b7d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:43.552886 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b451e6f3-8baf-4853-a7fe-1beb58498b7d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:43.663345 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-63978e38-abea-4384-8a33-ccb2bd63c041 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f7c0fdad9346c58949928300021b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f305d163acf499c9808c5f11150a7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:43.672327 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-63978e38-abea-4384-8a33-ccb2bd63c041 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7" status: 200 len: 1388 microversion: 2.1 time: 0.525218 Sep 17 20:52:43.673947 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 261/594] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:43 2022] GET /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 => generated 1388 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:43.825645 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b451e6f3-8baf-4853-a7fe-1beb58498b7d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:43.835361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b451e6f3-8baf-4853-a7fe-1beb58498b7d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:43.837243 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b451e6f3-8baf-4853-a7fe-1beb58498b7d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:43.839417 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b451e6f3-8baf-4853-a7fe-1beb58498b7d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9" status: 200 len: 1569 microversion: 2.25 time: 0.300931 Sep 17 20:52:43.839988 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 334/595] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:43 2022] GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9 => generated 1569 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:44.170700 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7eeecd6b-b8ca-456a-a722-13c5f9b57922 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:44.172382 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7eeecd6b-b8ca-456a-a722-13c5f9b57922 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] [instance: 9d268239-a1b7-433b-a3f1-52e84ad59682] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:44.190007 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7eeecd6b-b8ca-456a-a722-13c5f9b57922 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:44.194103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7eeecd6b-b8ca-456a-a722-13c5f9b57922 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:44.195878 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7eeecd6b-b8ca-456a-a722-13c5f9b57922 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:44.196875 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7eeecd6b-b8ca-456a-a722-13c5f9b57922 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:44.197972 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7eeecd6b-b8ca-456a-a722-13c5f9b57922 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:44.199983 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-14c39440-e46e-4482-9e33-88b0093083e0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:44.200649 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7eeecd6b-b8ca-456a-a722-13c5f9b57922 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:44.200781 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-14c39440-e46e-4482-9e33-88b0093083e0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:44.216397 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=4 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:52:44.219644 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14c39440-e46e-4482-9e33-88b0093083e0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:44.221933 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14c39440-e46e-4482-9e33-88b0093083e0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:44.222757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14c39440-e46e-4482-9e33-88b0093083e0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:44.224025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14c39440-e46e-4482-9e33-88b0093083e0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:44.225368 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14c39440-e46e-4482-9e33-88b0093083e0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:44.225867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14c39440-e46e-4482-9e33-88b0093083e0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:44.236153 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:52:44.659446 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-14c39440-e46e-4482-9e33-88b0093083e0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:44.671056 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-14c39440-e46e-4482-9e33-88b0093083e0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1474 microversion: 2.1 time: 0.473392 Sep 17 20:52:44.678692 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 335/596] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:44 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1474 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:44.699769 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2cc1e671-99d8-4053-96c6-e34f387aaead tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:44.700890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2cc1e671-99d8-4053-96c6-e34f387aaead tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:44.708357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2cc1e671-99d8-4053-96c6-e34f387aaead tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:44.709308 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2cc1e671-99d8-4053-96c6-e34f387aaead tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:44.709926 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2cc1e671-99d8-4053-96c6-e34f387aaead tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:44.710962 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2cc1e671-99d8-4053-96c6-e34f387aaead tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:44.711673 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2cc1e671-99d8-4053-96c6-e34f387aaead tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:44.712207 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2cc1e671-99d8-4053-96c6-e34f387aaead tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:44.736767 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7eeecd6b-b8ca-456a-a722-13c5f9b57922 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb0a86572434db48c987279d67cd4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e566b2c69fec4ec784a13e4034eaef72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:44.745486 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7eeecd6b-b8ca-456a-a722-13c5f9b57922 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] 10.222.0.26 "GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682" status: 200 len: 1331 microversion: 2.1 time: 0.579005 Sep 17 20:52:44.746786 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 262/597] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:44 2022] GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682 => generated 1331 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:44.754077 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ba4f0295-8171-492e-a41c-604d0031e3c1 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:44.754948 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ba4f0295-8171-492e-a41c-604d0031e3c1 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:44.761596 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ba4f0295-8171-492e-a41c-604d0031e3c1 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:44.762341 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ba4f0295-8171-492e-a41c-604d0031e3c1 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:44.762972 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ba4f0295-8171-492e-a41c-604d0031e3c1 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:44.763904 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ba4f0295-8171-492e-a41c-604d0031e3c1 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:44.764541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ba4f0295-8171-492e-a41c-604d0031e3c1 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:44.765155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ba4f0295-8171-492e-a41c-604d0031e3c1 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:44.824829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2cc1e671-99d8-4053-96c6-e34f387aaead tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:44.838417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2cc1e671-99d8-4053-96c6-e34f387aaead tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:44.840061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2cc1e671-99d8-4053-96c6-e34f387aaead tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:44.845610 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2cc1e671-99d8-4053-96c6-e34f387aaead tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1447 microversion: 2.75 time: 0.153744 Sep 17 20:52:44.846320 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 336/598] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:44 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1447 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:44.871626 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1538ddd6-399d-474a-ab4b-91b038b18a9e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:44.872805 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1538ddd6-399d-474a-ab4b-91b038b18a9e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:44.879950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1538ddd6-399d-474a-ab4b-91b038b18a9e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:44.880552 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1538ddd6-399d-474a-ab4b-91b038b18a9e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:44.881062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1538ddd6-399d-474a-ab4b-91b038b18a9e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:44.881868 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1538ddd6-399d-474a-ab4b-91b038b18a9e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:44.883013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1538ddd6-399d-474a-ab4b-91b038b18a9e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:44.883483 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1538ddd6-399d-474a-ab4b-91b038b18a9e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:44.910170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=8 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:52:45.006807 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ba4f0295-8171-492e-a41c-604d0031e3c1 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f7c0fdad9346c58949928300021b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f305d163acf499c9808c5f11150a7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:45.024398 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ba4f0295-8171-492e-a41c-604d0031e3c1 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7" status: 200 len: 1587 microversion: 2.1 time: 0.276484 Sep 17 20:52:45.025768 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 263/599] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:44 2022] GET /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 => generated 1587 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:45.064827 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0d82f59a-96b4-4c3a-98bd-cb55e3881069 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:45.067596 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1538ddd6-399d-474a-ab4b-91b038b18a9e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:45.068332 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0d82f59a-96b4-4c3a-98bd-cb55e3881069 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:45.075192 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d82f59a-96b4-4c3a-98bd-cb55e3881069 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:45.075925 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d82f59a-96b4-4c3a-98bd-cb55e3881069 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:45.076566 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d82f59a-96b4-4c3a-98bd-cb55e3881069 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:45.077497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d82f59a-96b4-4c3a-98bd-cb55e3881069 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:45.078141 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d82f59a-96b4-4c3a-98bd-cb55e3881069 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:45.078757 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d82f59a-96b4-4c3a-98bd-cb55e3881069 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:45.090670 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1538ddd6-399d-474a-ab4b-91b038b18a9e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:45.092108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1538ddd6-399d-474a-ab4b-91b038b18a9e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:45.093273 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1538ddd6-399d-474a-ab4b-91b038b18a9e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9" status: 200 len: 1569 microversion: 2.25 time: 0.226674 Sep 17 20:52:45.094188 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 337/600] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:44 2022] GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9 => generated 1569 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:45.185719 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0d82f59a-96b4-4c3a-98bd-cb55e3881069 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.138871 Sep 17 20:52:45.193784 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 264/601] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Sep 17 20:52:45 2022] GET /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7/os-interface => generated 285 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:52:45.692477 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-afb4b655-682f-4a09-8a1c-be51c62bd64b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:45.693867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-afb4b655-682f-4a09-8a1c-be51c62bd64b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:45.701374 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-afb4b655-682f-4a09-8a1c-be51c62bd64b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:45.702079 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-afb4b655-682f-4a09-8a1c-be51c62bd64b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:45.702581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-afb4b655-682f-4a09-8a1c-be51c62bd64b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:45.703400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-afb4b655-682f-4a09-8a1c-be51c62bd64b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:45.703912 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-afb4b655-682f-4a09-8a1c-be51c62bd64b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:45.704402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-afb4b655-682f-4a09-8a1c-be51c62bd64b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:45.773091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6d84787b-b6f9-44fa-a147-8c249d4e9a0d tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:45.774196 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6d84787b-b6f9-44fa-a147-8c249d4e9a0d tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] [instance: 9d268239-a1b7-433b-a3f1-52e84ad59682] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:45.781271 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d84787b-b6f9-44fa-a147-8c249d4e9a0d tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:45.782178 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d84787b-b6f9-44fa-a147-8c249d4e9a0d tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:45.782711 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d84787b-b6f9-44fa-a147-8c249d4e9a0d tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:45.783523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d84787b-b6f9-44fa-a147-8c249d4e9a0d tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:45.784364 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d84787b-b6f9-44fa-a147-8c249d4e9a0d tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:45.785122 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d84787b-b6f9-44fa-a147-8c249d4e9a0d tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:46.178062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-afb4b655-682f-4a09-8a1c-be51c62bd64b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:46.187106 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-afb4b655-682f-4a09-8a1c-be51c62bd64b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1474 microversion: 2.1 time: 0.498611 Sep 17 20:52:46.188335 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 338/602] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:45 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1474 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:46.193252 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d5075756-ee8f-4db4-921c-4f3fa0124fa6 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:46.194286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d5075756-ee8f-4db4-921c-4f3fa0124fa6 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:46.200190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5075756-ee8f-4db4-921c-4f3fa0124fa6 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:46.200743 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5075756-ee8f-4db4-921c-4f3fa0124fa6 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:46.201224 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5075756-ee8f-4db4-921c-4f3fa0124fa6 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:46.202298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5075756-ee8f-4db4-921c-4f3fa0124fa6 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:46.202876 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5075756-ee8f-4db4-921c-4f3fa0124fa6 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:46.203522 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5075756-ee8f-4db4-921c-4f3fa0124fa6 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:46.272218 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6d84787b-b6f9-44fa-a147-8c249d4e9a0d tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb0a86572434db48c987279d67cd4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e566b2c69fec4ec784a13e4034eaef72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:46.282492 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6d84787b-b6f9-44fa-a147-8c249d4e9a0d tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] 10.222.0.26 "GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682" status: 200 len: 1331 microversion: 2.1 time: 0.513198 Sep 17 20:52:46.283996 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 265/603] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:45 2022] GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682 => generated 1331 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:52:46.289544 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-13f46683-1b8b-4b85-b21e-101a03906dad tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:46.290397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-13f46683-1b8b-4b85-b21e-101a03906dad tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:46.296866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-13f46683-1b8b-4b85-b21e-101a03906dad tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:46.299201 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-13f46683-1b8b-4b85-b21e-101a03906dad tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:46.299919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-13f46683-1b8b-4b85-b21e-101a03906dad tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:46.300879 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-13f46683-1b8b-4b85-b21e-101a03906dad tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:46.301394 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-13f46683-1b8b-4b85-b21e-101a03906dad tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:46.301953 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-13f46683-1b8b-4b85-b21e-101a03906dad tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:46.331001 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d5075756-ee8f-4db4-921c-4f3fa0124fa6 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:46.344636 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d5075756-ee8f-4db4-921c-4f3fa0124fa6 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:46.347120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d5075756-ee8f-4db4-921c-4f3fa0124fa6 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:46.355245 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d5075756-ee8f-4db4-921c-4f3fa0124fa6 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1447 microversion: 2.75 time: 0.165491 Sep 17 20:52:46.376937 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 339/604] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:46 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1447 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:46.835490 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-13f46683-1b8b-4b85-b21e-101a03906dad tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:46.867672 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-13f46683-1b8b-4b85-b21e-101a03906dad tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:46.885000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-13f46683-1b8b-4b85-b21e-101a03906dad tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:46.886540 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-13f46683-1b8b-4b85-b21e-101a03906dad tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9" status: 200 len: 1559 microversion: 2.25 time: 0.601226 Sep 17 20:52:46.895902 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 266/605] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:46 2022] GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9 => generated 1559 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:46.920114 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f00b86ba-df09-4170-aebe-adedaf669171 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Calling method '.version_select at 0x7f25a599cdc0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:46.924168 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f00b86ba-df09-4170-aebe-adedaf669171 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:46.924911 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f00b86ba-df09-4170-aebe-adedaf669171 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:46.925361 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f00b86ba-df09-4170-aebe-adedaf669171 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:46.959476 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f00b86ba-df09-4170-aebe-adedaf669171 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 1530 microversion: 2.25 time: 0.043802 Sep 17 20:52:46.962400 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 267/606] 10.222.0.26 () {60 vars in 1184 bytes} [Sat Sep 17 20:52:46 2022] GET /compute/v2.1/os-migrations => generated 1530 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 20:52:46.987145 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-84c107ac-6d4e-434c-a44f-c43aea970ff1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Action: 'create', calling method: .version_select at 0x7f25a5c383a0>, body: {"keypair": {"name": "tempest-keypair-1568539338", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4Ay1dhBjnE9sgtXQJTFy2ND4HtH/+mto0uwgXhn/QXpmPybp4TCE5TxFGFDgo0zDACUzVc61yrHsFF9tCNhofu3SxAbvSeY2ZR6Lno9Qn6THcx7FlGGsZGlCs2QC9Xxg=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:46.993912 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ac520666-849d-4e83-8fe6-1664458691c8 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:46.994946 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ac520666-849d-4e83-8fe6-1664458691c8 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:47.020417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac520666-849d-4e83-8fe6-1664458691c8 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:47.024651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac520666-849d-4e83-8fe6-1664458691c8 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:47.025414 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac520666-849d-4e83-8fe6-1664458691c8 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:47.026505 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac520666-849d-4e83-8fe6-1664458691c8 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:47.027198 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac520666-849d-4e83-8fe6-1664458691c8 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:47.029659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac520666-849d-4e83-8fe6-1664458691c8 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:47.034897 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-84c107ac-6d4e-434c-a44f-c43aea970ff1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Getting quotas for project 26d60144477f4a5192d581350d678979. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:52:47.050483 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-84c107ac-6d4e-434c-a44f-c43aea970ff1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Getting quotas for user 6f7681de64c248268da4d78124f59b54 and project 26d60144477f4a5192d581350d678979. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:52:47.086131 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:52:47.132154 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-84c107ac-6d4e-434c-a44f-c43aea970ff1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.284758 Sep 17 20:52:47.133229 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 340/607] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 20:52:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:52:47.215235 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-13ef3357-9cfc-4964-88f0-19389a308831 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:47.215899 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-13ef3357-9cfc-4964-88f0-19389a308831 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:47.239313 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-13ef3357-9cfc-4964-88f0-19389a308831 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:47.239825 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-13ef3357-9cfc-4964-88f0-19389a308831 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:47.240270 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-13ef3357-9cfc-4964-88f0-19389a308831 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:47.241078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-13ef3357-9cfc-4964-88f0-19389a308831 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:47.241438 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-13ef3357-9cfc-4964-88f0-19389a308831 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:47.244976 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-13ef3357-9cfc-4964-88f0-19389a308831 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:47.656881 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-ac520666-849d-4e83-8fe6-1664458691c8 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lazy-loading 'services' on Instance uuid 7289e6c1-bbfd-4239-8a82-43ffe2335ec9 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:52:47.684562 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ac520666-849d-4e83-8fe6-1664458691c8 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9" status: 200 len: 2052 microversion: 2.25 time: 0.710303 Sep 17 20:52:47.697485 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 268/608] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:46 2022] GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9 => generated 2052 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 20:52:47.697485 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c6c054f4-11d9-411e-836a-eeb26de48c0e tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:47.697485 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c6c054f4-11d9-411e-836a-eeb26de48c0e tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] [instance: 9d268239-a1b7-433b-a3f1-52e84ad59682] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:47.721320 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c6c054f4-11d9-411e-836a-eeb26de48c0e tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:47.722071 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c6c054f4-11d9-411e-836a-eeb26de48c0e tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:47.722807 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c6c054f4-11d9-411e-836a-eeb26de48c0e tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:47.723787 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c6c054f4-11d9-411e-836a-eeb26de48c0e tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:47.724486 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c6c054f4-11d9-411e-836a-eeb26de48c0e tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:47.725149 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c6c054f4-11d9-411e-836a-eeb26de48c0e tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:48.058167 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-13ef3357-9cfc-4964-88f0-19389a308831 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:48.077113 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-13ef3357-9cfc-4964-88f0-19389a308831 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1472 microversion: 2.1 time: 0.869774 Sep 17 20:52:48.079638 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 341/609] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:47 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1472 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:48.098599 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-7b3f2f8e-8f2f-43c9-996f-9b952960cbc0 req-85156b6c-a579-40fd-a992-dadfa2dcb6dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700", "name": "network-vif-unplugged", "status": "completed", "tag": "3b2dfcf9-36b6-4299-8814-a29f994bcc2f"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:48.122919 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7b3f2f8e-8f2f-43c9-996f-9b952960cbc0 req-85156b6c-a579-40fd-a992-dadfa2dcb6dc service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:48.126565 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7b3f2f8e-8f2f-43c9-996f-9b952960cbc0 req-85156b6c-a579-40fd-a992-dadfa2dcb6dc service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:48.127236 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7b3f2f8e-8f2f-43c9-996f-9b952960cbc0 req-85156b6c-a579-40fd-a992-dadfa2dcb6dc service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:48.171269 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-7b3f2f8e-8f2f-43c9-996f-9b952960cbc0 req-85156b6c-a579-40fd-a992-dadfa2dcb6dc service nova] Creating event network-vif-unplugged:3b2dfcf9-36b6-4299-8814-a29f994bcc2f for instance e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 on nch2-master-1 Sep 17 20:52:48.182744 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [req-7b3f2f8e-8f2f-43c9-996f-9b952960cbc0 req-85156b6c-a579-40fd-a992-dadfa2dcb6dc service nova] Instance e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=140524) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 20:52:48.190977 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-7b3f2f8e-8f2f-43c9-996f-9b952960cbc0 req-85156b6c-a579-40fd-a992-dadfa2dcb6dc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110055 Sep 17 20:52:48.192505 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 342/610] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:52:48.198865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c5e3986f-78bd-4b50-8bc7-e612db5f5642 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:48.199917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c5e3986f-78bd-4b50-8bc7-e612db5f5642 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:48.207390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c5e3986f-78bd-4b50-8bc7-e612db5f5642 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:48.208196 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c5e3986f-78bd-4b50-8bc7-e612db5f5642 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:48.208941 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c5e3986f-78bd-4b50-8bc7-e612db5f5642 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:48.210084 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c5e3986f-78bd-4b50-8bc7-e612db5f5642 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:48.210775 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c5e3986f-78bd-4b50-8bc7-e612db5f5642 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:48.211444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c5e3986f-78bd-4b50-8bc7-e612db5f5642 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:48.503033 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c5e3986f-78bd-4b50-8bc7-e612db5f5642 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:48.537092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c5e3986f-78bd-4b50-8bc7-e612db5f5642 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:48.541056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c5e3986f-78bd-4b50-8bc7-e612db5f5642 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:48.558700 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c5e3986f-78bd-4b50-8bc7-e612db5f5642 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1453 microversion: 2.75 time: 0.363081 Sep 17 20:52:48.561703 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 343/611] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:48 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1453 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:48.577349 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2ce9d768-d772-42f3-9198-460dc20fa7fd tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-486887338", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "291f6f93-7c31-4c8d-9946-eca7fb2662ee"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:48.712144 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-2ce9d768-d772-42f3-9198-460dc20fa7fd tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] validate_networks() for [('291f6f93-7c31-4c8d-9946-eca7fb2662ee', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:52:49.255885 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c6c054f4-11d9-411e-836a-eeb26de48c0e tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb0a86572434db48c987279d67cd4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e566b2c69fec4ec784a13e4034eaef72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:49.269654 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c6c054f4-11d9-411e-836a-eeb26de48c0e tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] 10.222.0.26 "GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682" status: 200 len: 1331 microversion: 2.1 time: 1.581411 Sep 17 20:52:49.270276 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 269/612] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:47 2022] GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682 => generated 1331 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:49.293011 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-90264a03-8d58-4f0b-a54b-700db2ceffc8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:49.293933 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-90264a03-8d58-4f0b-a54b-700db2ceffc8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:49.300843 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90264a03-8d58-4f0b-a54b-700db2ceffc8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:49.301650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90264a03-8d58-4f0b-a54b-700db2ceffc8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:49.302695 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90264a03-8d58-4f0b-a54b-700db2ceffc8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:49.306888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90264a03-8d58-4f0b-a54b-700db2ceffc8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:49.307701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90264a03-8d58-4f0b-a54b-700db2ceffc8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:49.308379 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90264a03-8d58-4f0b-a54b-700db2ceffc8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:49.955057 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-90264a03-8d58-4f0b-a54b-700db2ceffc8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:49.981978 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-90264a03-8d58-4f0b-a54b-700db2ceffc8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1469 microversion: 2.1 time: 0.697973 Sep 17 20:52:49.986960 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 270/613] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:49 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1469 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:50.016297 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-227de392-2d48-4a27-8782-aa334c3aa14c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:50.018064 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-227de392-2d48-4a27-8782-aa334c3aa14c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:50.027425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-227de392-2d48-4a27-8782-aa334c3aa14c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:50.028846 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-227de392-2d48-4a27-8782-aa334c3aa14c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:50.029443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-227de392-2d48-4a27-8782-aa334c3aa14c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:50.032655 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-227de392-2d48-4a27-8782-aa334c3aa14c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:50.033378 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-227de392-2d48-4a27-8782-aa334c3aa14c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:50.034188 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-227de392-2d48-4a27-8782-aa334c3aa14c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:50.133790 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-2ce9d768-d772-42f3-9198-460dc20fa7fd tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:52:50.134315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-2ce9d768-d772-42f3-9198-460dc20fa7fd tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:52:50.134671 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-2ce9d768-d772-42f3-9198-460dc20fa7fd tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:52:50.135384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-2ce9d768-d772-42f3-9198-460dc20fa7fd tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:52:50.135885 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-2ce9d768-d772-42f3-9198-460dc20fa7fd tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:52:50.148191 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ce9d768-d772-42f3-9198-460dc20fa7fd tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:50.148695 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ce9d768-d772-42f3-9198-460dc20fa7fd tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:50.149185 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ce9d768-d772-42f3-9198-460dc20fa7fd tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:50.149892 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ce9d768-d772-42f3-9198-460dc20fa7fd tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:50.150347 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ce9d768-d772-42f3-9198-460dc20fa7fd tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:50.162293 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ce9d768-d772-42f3-9198-460dc20fa7fd tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:50.198032 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-2ce9d768-d772-42f3-9198-460dc20fa7fd tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Getting quotas for project 7dc8bc81c2d74bae9612f7c9807350a7. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:52:50.217348 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-2ce9d768-d772-42f3-9198-460dc20fa7fd tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Getting quotas for user f1134231b4a545fdb136a5204cb4f289 and project 7dc8bc81c2d74bae9612f7c9807350a7. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:52:50.249901 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2ce9d768-d772-42f3-9198-460dc20fa7fd tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:52:50.256174 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2ce9d768-d772-42f3-9198-460dc20fa7fd tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:52:50.343298 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-227de392-2d48-4a27-8782-aa334c3aa14c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:50.349291 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2ce9d768-d772-42f3-9198-460dc20fa7fd tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.784828 Sep 17 20:52:50.349981 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 344/614] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Sep 17 20:52:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1788 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 17 20:52:50.356725 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-227de392-2d48-4a27-8782-aa334c3aa14c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:50.358381 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-227de392-2d48-4a27-8782-aa334c3aa14c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:50.358571 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e7a226fa-1d2a-4b97-b1fb-14f7dd01319a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:50.359120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e7a226fa-1d2a-4b97-b1fb-14f7dd01319a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:50.366448 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-227de392-2d48-4a27-8782-aa334c3aa14c tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1453 microversion: 2.75 time: 0.366338 Sep 17 20:52:50.367424 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 271/615] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:49 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1453 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:50.378678 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7a226fa-1d2a-4b97-b1fb-14f7dd01319a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:50.379445 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7a226fa-1d2a-4b97-b1fb-14f7dd01319a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:50.380071 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7a226fa-1d2a-4b97-b1fb-14f7dd01319a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:50.380974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7a226fa-1d2a-4b97-b1fb-14f7dd01319a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:50.381620 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7a226fa-1d2a-4b97-b1fb-14f7dd01319a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:50.382199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7a226fa-1d2a-4b97-b1fb-14f7dd01319a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:50.421713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2b70892e-09b5-4c4d-a73f-5332e92b9ab2 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:50.422506 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2b70892e-09b5-4c4d-a73f-5332e92b9ab2 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] [instance: 9d268239-a1b7-433b-a3f1-52e84ad59682] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:50.452972 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b70892e-09b5-4c4d-a73f-5332e92b9ab2 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:50.453494 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b70892e-09b5-4c4d-a73f-5332e92b9ab2 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:50.454001 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b70892e-09b5-4c4d-a73f-5332e92b9ab2 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:50.454735 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b70892e-09b5-4c4d-a73f-5332e92b9ab2 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:50.455200 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b70892e-09b5-4c4d-a73f-5332e92b9ab2 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:50.455631 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b70892e-09b5-4c4d-a73f-5332e92b9ab2 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:50.523395 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e7a226fa-1d2a-4b97-b1fb-14f7dd01319a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "POST /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700/action" status: 204 len: 0 microversion: 2.1 time: 0.168808 Sep 17 20:52:50.524068 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 345/616] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:52:50 2022] POST /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700/action => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:52:50.535514 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cb15daa8-4a14-43b1-a7b4-bead5f9b6031 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:50.536233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cb15daa8-4a14-43b1-a7b4-bead5f9b6031 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:50.820342 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cb15daa8-4a14-43b1-a7b4-bead5f9b6031 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:50.833955 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cb15daa8-4a14-43b1-a7b4-bead5f9b6031 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:50.835412 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cb15daa8-4a14-43b1-a7b4-bead5f9b6031 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:50.836560 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cb15daa8-4a14-43b1-a7b4-bead5f9b6031 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2" status: 200 len: 1261 microversion: 2.25 time: 0.311395 Sep 17 20:52:50.837123 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 346/617] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:50 2022] GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2 => generated 1261 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:50.859267 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f209a180-ec27-4f8e-9ca1-b38b2afcf525 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:50.860262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f209a180-ec27-4f8e-9ca1-b38b2afcf525 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:50.867840 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f209a180-ec27-4f8e-9ca1-b38b2afcf525 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:50.878279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f209a180-ec27-4f8e-9ca1-b38b2afcf525 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:50.879096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f209a180-ec27-4f8e-9ca1-b38b2afcf525 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:50.880065 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f209a180-ec27-4f8e-9ca1-b38b2afcf525 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:50.885017 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f209a180-ec27-4f8e-9ca1-b38b2afcf525 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:50.885782 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f209a180-ec27-4f8e-9ca1-b38b2afcf525 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:50.925120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2b70892e-09b5-4c4d-a73f-5332e92b9ab2 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb0a86572434db48c987279d67cd4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e566b2c69fec4ec784a13e4034eaef72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:50.936261 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2b70892e-09b5-4c4d-a73f-5332e92b9ab2 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] 10.222.0.26 "GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682" status: 200 len: 1331 microversion: 2.1 time: 0.531790 Sep 17 20:52:50.937596 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 272/618] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:50 2022] GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682 => generated 1331 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:50.942644 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fc6b14cd-d01a-40ec-82c5-67f4e84939d2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:50.944261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fc6b14cd-d01a-40ec-82c5-67f4e84939d2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:50.981151 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc6b14cd-d01a-40ec-82c5-67f4e84939d2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:50.987973 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc6b14cd-d01a-40ec-82c5-67f4e84939d2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:50.989306 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc6b14cd-d01a-40ec-82c5-67f4e84939d2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:50.990299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc6b14cd-d01a-40ec-82c5-67f4e84939d2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:50.991112 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc6b14cd-d01a-40ec-82c5-67f4e84939d2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:50.992087 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc6b14cd-d01a-40ec-82c5-67f4e84939d2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:51.285504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f209a180-ec27-4f8e-9ca1-b38b2afcf525 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f7c0fdad9346c58949928300021b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f305d163acf499c9808c5f11150a7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:51.293795 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f209a180-ec27-4f8e-9ca1-b38b2afcf525 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7" status: 200 len: 1587 microversion: 2.1 time: 0.447006 Sep 17 20:52:51.294393 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 347/619] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:50 2022] GET /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 => generated 1587 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:51.332638 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-63ab4ad0-2818-4c9a-b4b0-91c85c856cfb req-d78d8805-161d-433d-8a1f-67d3ccab9421 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7", "tag": "69898655-651f-4c1b-afd3-8dc1cb5c1d0e"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:51.351836 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-63ab4ad0-2818-4c9a-b4b0-91c85c856cfb req-d78d8805-161d-433d-8a1f-67d3ccab9421 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:51.356399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-63ab4ad0-2818-4c9a-b4b0-91c85c856cfb req-d78d8805-161d-433d-8a1f-67d3ccab9421 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:51.357051 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-63ab4ad0-2818-4c9a-b4b0-91c85c856cfb req-d78d8805-161d-433d-8a1f-67d3ccab9421 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:51.646860 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fc6b14cd-d01a-40ec-82c5-67f4e84939d2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:51.714753 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fc6b14cd-d01a-40ec-82c5-67f4e84939d2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1469 microversion: 2.1 time: 0.775613 Sep 17 20:52:51.731578 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 273/620] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:50 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1469 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:51.753916 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a8c5eb5e-439f-46b4-b5ba-d8b648687250 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:51.762633 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a8c5eb5e-439f-46b4-b5ba-d8b648687250 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:51.773755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a8c5eb5e-439f-46b4-b5ba-d8b648687250 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:51.774253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a8c5eb5e-439f-46b4-b5ba-d8b648687250 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:51.777197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a8c5eb5e-439f-46b4-b5ba-d8b648687250 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:51.778783 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-63ab4ad0-2818-4c9a-b4b0-91c85c856cfb req-d78d8805-161d-433d-8a1f-67d3ccab9421 service nova] Creating event network-changed:69898655-651f-4c1b-afd3-8dc1cb5c1d0e for instance 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 on nch2-master-1 Sep 17 20:52:51.780407 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a8c5eb5e-439f-46b4-b5ba-d8b648687250 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:51.781811 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a8c5eb5e-439f-46b4-b5ba-d8b648687250 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:51.782431 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a8c5eb5e-439f-46b4-b5ba-d8b648687250 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:51.785350 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-63ab4ad0-2818-4c9a-b4b0-91c85c856cfb req-d78d8805-161d-433d-8a1f-67d3ccab9421 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.463630 Sep 17 20:52:51.786728 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 348/621] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:52:51.811871 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-c6399a0e-da52-47bf-b9fa-57d0833cc32b req-4a4dcdc9-4e2b-4d59-8fae-81d503a2ac6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d268239-a1b7-433b-a3f1-52e84ad59682", "name": "network-vif-plugged", "status": "completed", "tag": "a1936332-9c49-496c-a1d8-d378ab79c8ff"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:51.848270 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c6399a0e-da52-47bf-b9fa-57d0833cc32b req-4a4dcdc9-4e2b-4d59-8fae-81d503a2ac6b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:51.848816 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c6399a0e-da52-47bf-b9fa-57d0833cc32b req-4a4dcdc9-4e2b-4d59-8fae-81d503a2ac6b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:51.850919 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c6399a0e-da52-47bf-b9fa-57d0833cc32b req-4a4dcdc9-4e2b-4d59-8fae-81d503a2ac6b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:51.873941 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-c6399a0e-da52-47bf-b9fa-57d0833cc32b req-4a4dcdc9-4e2b-4d59-8fae-81d503a2ac6b service nova] Creating event network-vif-plugged:a1936332-9c49-496c-a1d8-d378ab79c8ff for instance 9d268239-a1b7-433b-a3f1-52e84ad59682 on nch1-master-1 Sep 17 20:52:51.894601 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-c6399a0e-da52-47bf-b9fa-57d0833cc32b req-4a4dcdc9-4e2b-4d59-8fae-81d503a2ac6b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086195 Sep 17 20:52:51.896076 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 349/622] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:52:51.904589 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2de53a6e-c343-49d3-b001-d706ccd2deb2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:51.931488 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2de53a6e-c343-49d3-b001-d706ccd2deb2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:51.951711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2de53a6e-c343-49d3-b001-d706ccd2deb2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:51.954587 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2de53a6e-c343-49d3-b001-d706ccd2deb2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:51.960683 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2de53a6e-c343-49d3-b001-d706ccd2deb2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:51.961093 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a8c5eb5e-439f-46b4-b5ba-d8b648687250 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:51.965098 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2de53a6e-c343-49d3-b001-d706ccd2deb2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:51.966690 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2de53a6e-c343-49d3-b001-d706ccd2deb2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:51.971352 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2de53a6e-c343-49d3-b001-d706ccd2deb2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:51.973179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a8c5eb5e-439f-46b4-b5ba-d8b648687250 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:51.976858 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a8c5eb5e-439f-46b4-b5ba-d8b648687250 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:51.984413 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a8c5eb5e-439f-46b4-b5ba-d8b648687250 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1438 microversion: 2.75 time: 0.242379 Sep 17 20:52:51.992081 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 274/623] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:51 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1438 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:51.999672 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a6c31e25-214e-47b9-b032-5a393ac04eb4 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:52.002445 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a6c31e25-214e-47b9-b032-5a393ac04eb4 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] [instance: 9d268239-a1b7-433b-a3f1-52e84ad59682] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:52.020149 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6c31e25-214e-47b9-b032-5a393ac04eb4 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:52.022989 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6c31e25-214e-47b9-b032-5a393ac04eb4 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:52.024272 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6c31e25-214e-47b9-b032-5a393ac04eb4 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:52.025111 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6c31e25-214e-47b9-b032-5a393ac04eb4 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:52.025693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6c31e25-214e-47b9-b032-5a393ac04eb4 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:52.026642 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6c31e25-214e-47b9-b032-5a393ac04eb4 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:52.191833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2de53a6e-c343-49d3-b001-d706ccd2deb2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:52.206421 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2de53a6e-c343-49d3-b001-d706ccd2deb2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:52.208444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2de53a6e-c343-49d3-b001-d706ccd2deb2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:52.216873 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2de53a6e-c343-49d3-b001-d706ccd2deb2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2" status: 200 len: 1313 microversion: 2.25 time: 0.319003 Sep 17 20:52:52.217890 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 350/624] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:51 2022] GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2 => generated 1313 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:52.587487 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-77ead8f7-ca09-43c2-80bd-e30d17038ea8 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:52.593080 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-77ead8f7-ca09-43c2-80bd-e30d17038ea8 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:52.607061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-77ead8f7-ca09-43c2-80bd-e30d17038ea8 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:52.612567 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-77ead8f7-ca09-43c2-80bd-e30d17038ea8 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:52.613384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-77ead8f7-ca09-43c2-80bd-e30d17038ea8 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:52.614386 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-77ead8f7-ca09-43c2-80bd-e30d17038ea8 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:52.615011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-77ead8f7-ca09-43c2-80bd-e30d17038ea8 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:52.616504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-77ead8f7-ca09-43c2-80bd-e30d17038ea8 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:52.828946 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-77ead8f7-ca09-43c2-80bd-e30d17038ea8 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:52:52.830520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-77ead8f7-ca09-43c2-80bd-e30d17038ea8 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:52:52.832721 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-77ead8f7-ca09-43c2-80bd-e30d17038ea8 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:52:52.837333 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-77ead8f7-ca09-43c2-80bd-e30d17038ea8 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:52:52.838648 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-77ead8f7-ca09-43c2-80bd-e30d17038ea8 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:52:52.978215 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a6c31e25-214e-47b9-b032-5a393ac04eb4 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb0a86572434db48c987279d67cd4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e566b2c69fec4ec784a13e4034eaef72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:52.989246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-77ead8f7-ca09-43c2-80bd-e30d17038ea8 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:53.003749 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a6c31e25-214e-47b9-b032-5a393ac04eb4 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] 10.222.0.26 "GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682" status: 200 len: 1331 microversion: 2.1 time: 1.006467 Sep 17 20:52:53.011476 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-77ead8f7-ca09-43c2-80bd-e30d17038ea8 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:53.011985 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-77ead8f7-ca09-43c2-80bd-e30d17038ea8 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:53.012443 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-77ead8f7-ca09-43c2-80bd-e30d17038ea8 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:53.013162 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-77ead8f7-ca09-43c2-80bd-e30d17038ea8 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:53.013658 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-77ead8f7-ca09-43c2-80bd-e30d17038ea8 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:53.014097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-77ead8f7-ca09-43c2-80bd-e30d17038ea8 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:53.018220 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 275/625] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:51 2022] GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682 => generated 1331 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:53.026618 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a63b1126-26bd-4d17-a802-16abc7e37179 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:53.027939 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a63b1126-26bd-4d17-a802-16abc7e37179 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:53.036693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a63b1126-26bd-4d17-a802-16abc7e37179 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:53.037564 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a63b1126-26bd-4d17-a802-16abc7e37179 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:53.038171 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a63b1126-26bd-4d17-a802-16abc7e37179 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:53.039085 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a63b1126-26bd-4d17-a802-16abc7e37179 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:53.039698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a63b1126-26bd-4d17-a802-16abc7e37179 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:53.040274 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a63b1126-26bd-4d17-a802-16abc7e37179 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:53.078331 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:52:53.269145 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-77ead8f7-ca09-43c2-80bd-e30d17038ea8 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lazy-loading 'services' on Instance uuid 8ec574a4-de66-49f0-84bf-b7a1bc07eb91 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:52:53.307433 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-77ead8f7-ca09-43c2-80bd-e30d17038ea8 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91/action" status: 202 len: 1942 microversion: 2.75 time: 1.088154 Sep 17 20:52:53.308736 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 351/626] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Sep 17 20:52:52 2022] POST /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91/action => generated 1942 bytes in 1090 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 17 20:52:53.332838 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b46fd6a6-b678-446b-b92a-86825b9886f1 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:53.333489 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b46fd6a6-b678-446b-b92a-86825b9886f1 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:53.343509 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b46fd6a6-b678-446b-b92a-86825b9886f1 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:53.344373 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b46fd6a6-b678-446b-b92a-86825b9886f1 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:53.345125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b46fd6a6-b678-446b-b92a-86825b9886f1 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:53.346167 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b46fd6a6-b678-446b-b92a-86825b9886f1 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:53.348451 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b46fd6a6-b678-446b-b92a-86825b9886f1 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:53.349150 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b46fd6a6-b678-446b-b92a-86825b9886f1 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:53.356096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:52:53.467360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b46fd6a6-b678-446b-b92a-86825b9886f1 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:53.481591 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b46fd6a6-b678-446b-b92a-86825b9886f1 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:53.483566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b46fd6a6-b678-446b-b92a-86825b9886f1 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:53.484981 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b46fd6a6-b678-446b-b92a-86825b9886f1 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2" status: 200 len: 1319 microversion: 2.25 time: 0.174787 Sep 17 20:52:53.497503 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 352/627] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:53 2022] GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:53.497830 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a63b1126-26bd-4d17-a802-16abc7e37179 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:53.508693 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a63b1126-26bd-4d17-a802-16abc7e37179 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1469 microversion: 2.1 time: 0.485591 Sep 17 20:52:53.512665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-aa354db8-3139-4918-a80e-cbae8f5a7c6f tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:53.513679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-aa354db8-3139-4918-a80e-cbae8f5a7c6f tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:53.526241 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 276/628] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:53 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1469 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:53.538027 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa354db8-3139-4918-a80e-cbae8f5a7c6f tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:53.538621 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa354db8-3139-4918-a80e-cbae8f5a7c6f tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:53.539066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa354db8-3139-4918-a80e-cbae8f5a7c6f tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:53.539783 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa354db8-3139-4918-a80e-cbae8f5a7c6f tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:53.543375 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa354db8-3139-4918-a80e-cbae8f5a7c6f tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:53.546135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa354db8-3139-4918-a80e-cbae8f5a7c6f tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:53.709645 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-aa354db8-3139-4918-a80e-cbae8f5a7c6f tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lazy-loading 'services' on Instance uuid 8ec574a4-de66-49f0-84bf-b7a1bc07eb91 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:52:53.740713 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-aa354db8-3139-4918-a80e-cbae8f5a7c6f tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1929 microversion: 2.75 time: 0.240197 Sep 17 20:52:53.742369 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 353/629] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:53 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1929 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:53.934174 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-093e80ef-8a4a-4deb-ac82-346d91d341c1 req-fe08add2-d565-412f-bc18-2864150c04ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700", "name": "network-vif-plugged", "status": "completed", "tag": "3b2dfcf9-36b6-4299-8814-a29f994bcc2f"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:53.948041 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-093e80ef-8a4a-4deb-ac82-346d91d341c1 req-fe08add2-d565-412f-bc18-2864150c04ac service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:53.948842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-093e80ef-8a4a-4deb-ac82-346d91d341c1 req-fe08add2-d565-412f-bc18-2864150c04ac service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:53.949375 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-093e80ef-8a4a-4deb-ac82-346d91d341c1 req-fe08add2-d565-412f-bc18-2864150c04ac service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:53.962191 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-093e80ef-8a4a-4deb-ac82-346d91d341c1 req-fe08add2-d565-412f-bc18-2864150c04ac service nova] Creating event network-vif-plugged:3b2dfcf9-36b6-4299-8814-a29f994bcc2f for instance e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 on nch2-master-1 Sep 17 20:52:53.968222 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-093e80ef-8a4a-4deb-ac82-346d91d341c1 req-fe08add2-d565-412f-bc18-2864150c04ac service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040661 Sep 17 20:52:53.968848 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 277/630] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:52:54.029159 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-af47c009-1202-4d60-8965-d17a6528522b tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:54.029828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-af47c009-1202-4d60-8965-d17a6528522b tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] [instance: 9d268239-a1b7-433b-a3f1-52e84ad59682] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:54.037782 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af47c009-1202-4d60-8965-d17a6528522b tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:54.038921 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af47c009-1202-4d60-8965-d17a6528522b tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:54.040089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af47c009-1202-4d60-8965-d17a6528522b tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:54.044019 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af47c009-1202-4d60-8965-d17a6528522b tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:54.044552 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af47c009-1202-4d60-8965-d17a6528522b tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:54.045172 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af47c009-1202-4d60-8965-d17a6528522b tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:54.229021 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-af47c009-1202-4d60-8965-d17a6528522b tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb0a86572434db48c987279d67cd4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e566b2c69fec4ec784a13e4034eaef72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:54.241898 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-af47c009-1202-4d60-8965-d17a6528522b tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] 10.222.0.26 "GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682" status: 200 len: 1535 microversion: 2.1 time: 0.217637 Sep 17 20:52:54.244600 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 354/631] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:54 2022] GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682 => generated 1535 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:54.267932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-01cb4faf-903d-40ba-936f-01d42e77f722 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Action: 'create', calling method: .version_select at 0x7f25a59674c0>, body: {"pool": "65a1299f-7295-4ddf-9578-cb304a29a96a"} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:54.515782 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f5e4e463-5cc1-4cbb-97aa-537d60cbee5e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:54.516403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f5e4e463-5cc1-4cbb-97aa-537d60cbee5e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:54.525211 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f5e4e463-5cc1-4cbb-97aa-537d60cbee5e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:54.525651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f5e4e463-5cc1-4cbb-97aa-537d60cbee5e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:54.527330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f5e4e463-5cc1-4cbb-97aa-537d60cbee5e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:54.527330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f5e4e463-5cc1-4cbb-97aa-537d60cbee5e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:54.527330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f5e4e463-5cc1-4cbb-97aa-537d60cbee5e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:54.529713 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f5e4e463-5cc1-4cbb-97aa-537d60cbee5e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:54.640825 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f5e4e463-5cc1-4cbb-97aa-537d60cbee5e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:54.653708 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f5e4e463-5cc1-4cbb-97aa-537d60cbee5e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:54.655543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f5e4e463-5cc1-4cbb-97aa-537d60cbee5e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:54.656819 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f5e4e463-5cc1-4cbb-97aa-537d60cbee5e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2" status: 200 len: 1319 microversion: 2.25 time: 0.145711 Sep 17 20:52:54.657429 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 355/632] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:54 2022] GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:54.678017 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bdf85d3b-e7a3-4a48-a8a4-947f9a2126ce tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:54.678917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bdf85d3b-e7a3-4a48-a8a4-947f9a2126ce tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:54.685749 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bdf85d3b-e7a3-4a48-a8a4-947f9a2126ce tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:54.686376 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bdf85d3b-e7a3-4a48-a8a4-947f9a2126ce tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:54.687014 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bdf85d3b-e7a3-4a48-a8a4-947f9a2126ce tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:54.687748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bdf85d3b-e7a3-4a48-a8a4-947f9a2126ce tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:54.688214 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bdf85d3b-e7a3-4a48-a8a4-947f9a2126ce tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:54.688648 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bdf85d3b-e7a3-4a48-a8a4-947f9a2126ce tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:55.006669 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bdf85d3b-e7a3-4a48-a8a4-947f9a2126ce tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:55.040151 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bdf85d3b-e7a3-4a48-a8a4-947f9a2126ce tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1461 microversion: 2.1 time: 0.381164 Sep 17 20:52:55.040890 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 356/633] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:54 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1461 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:55.052463 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8906126e-d4fe-4436-9c78-dccc1f3bc0c0 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:55.053402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8906126e-d4fe-4436-9c78-dccc1f3bc0c0 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:55.073542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8906126e-d4fe-4436-9c78-dccc1f3bc0c0 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:55.074238 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8906126e-d4fe-4436-9c78-dccc1f3bc0c0 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:55.074840 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8906126e-d4fe-4436-9c78-dccc1f3bc0c0 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:55.076148 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8906126e-d4fe-4436-9c78-dccc1f3bc0c0 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:55.076697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8906126e-d4fe-4436-9c78-dccc1f3bc0c0 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:55.077213 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8906126e-d4fe-4436-9c78-dccc1f3bc0c0 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:55.198958 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-8906126e-d4fe-4436-9c78-dccc1f3bc0c0 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lazy-loading 'services' on Instance uuid 8ec574a4-de66-49f0-84bf-b7a1bc07eb91 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:52:55.257122 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8906126e-d4fe-4436-9c78-dccc1f3bc0c0 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1929 microversion: 2.75 time: 0.214166 Sep 17 20:52:55.274255 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 357/634] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:55 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1929 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:55.286146 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0b0656ec-f87f-4e4c-bc91-288c23556c5c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:55.286146 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0b0656ec-f87f-4e4c-bc91-288c23556c5c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:55.315176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b0656ec-f87f-4e4c-bc91-288c23556c5c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:55.317023 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b0656ec-f87f-4e4c-bc91-288c23556c5c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:55.320637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b0656ec-f87f-4e4c-bc91-288c23556c5c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:55.321889 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b0656ec-f87f-4e4c-bc91-288c23556c5c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:55.322549 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b0656ec-f87f-4e4c-bc91-288c23556c5c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:55.323084 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b0656ec-f87f-4e4c-bc91-288c23556c5c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:55.741539 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0b0656ec-f87f-4e4c-bc91-288c23556c5c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:55.754429 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0b0656ec-f87f-4e4c-bc91-288c23556c5c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1461 microversion: 2.1 time: 0.474948 Sep 17 20:52:55.755436 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 358/635] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:52:55 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1461 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:55.768009 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-672b1c1d-72b8-4024-af00-7753f54eb71b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:55.768622 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-672b1c1d-72b8-4024-af00-7753f54eb71b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:55.779242 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-672b1c1d-72b8-4024-af00-7753f54eb71b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:55.779772 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-672b1c1d-72b8-4024-af00-7753f54eb71b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:55.780266 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-672b1c1d-72b8-4024-af00-7753f54eb71b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:55.781004 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-672b1c1d-72b8-4024-af00-7753f54eb71b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:55.781530 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-672b1c1d-72b8-4024-af00-7753f54eb71b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:55.782015 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-672b1c1d-72b8-4024-af00-7753f54eb71b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:56.088107 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-672b1c1d-72b8-4024-af00-7753f54eb71b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:56.099751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-672b1c1d-72b8-4024-af00-7753f54eb71b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:56.112273 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-672b1c1d-72b8-4024-af00-7753f54eb71b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:56.113920 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-672b1c1d-72b8-4024-af00-7753f54eb71b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2" status: 200 len: 1361 microversion: 2.25 time: 0.357395 Sep 17 20:52:56.115022 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 359/636] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:55 2022] GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2 => generated 1361 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:56.120177 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-26cfb799-6b4e-44aa-b19c-e2cf066f42a9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Action: 'create', calling method: .version_select at 0x7f25a5912430>, body: {"keypair": {"name": "tempest-keypair-661048962", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLla2ev+wAU8tlnJGfmI5BdesyxgZGAWNN391QcF7ZnWh3snGjuVUmtKlvzgEPJj4r8UlzFXNQTRHdUKJYSQhKY2EwELz5SxTWInOq/ie0K4fn0epCq5unGYc9XORFIdJQ=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:56.173180 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-26cfb799-6b4e-44aa-b19c-e2cf066f42a9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Getting quotas for project 07ce9fd746374b478a743261eb014e5c. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:52:56.186582 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-26cfb799-6b4e-44aa-b19c-e2cf066f42a9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Getting quotas for user 226a87a1f393420b8d19ec2390e9d063 and project 07ce9fd746374b478a743261eb014e5c. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:52:56.240351 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-26cfb799-6b4e-44aa-b19c-e2cf066f42a9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.123857 Sep 17 20:52:56.241295 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 360/637] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 20:52:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:52:56.310075 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9d2d1d58-aec4-4e8e-adad-9f2de0104724 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:56.325258 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9d2d1d58-aec4-4e8e-adad-9f2de0104724 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:56.330839 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d2d1d58-aec4-4e8e-adad-9f2de0104724 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:56.331402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d2d1d58-aec4-4e8e-adad-9f2de0104724 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:56.331857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d2d1d58-aec4-4e8e-adad-9f2de0104724 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:56.335701 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d2d1d58-aec4-4e8e-adad-9f2de0104724 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:56.336379 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d2d1d58-aec4-4e8e-adad-9f2de0104724 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:56.336725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d2d1d58-aec4-4e8e-adad-9f2de0104724 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:56.523106 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-9d2d1d58-aec4-4e8e-adad-9f2de0104724 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lazy-loading 'services' on Instance uuid 8ec574a4-de66-49f0-84bf-b7a1bc07eb91 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:52:56.555162 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9d2d1d58-aec4-4e8e-adad-9f2de0104724 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1929 microversion: 2.75 time: 0.252410 Sep 17 20:52:56.556321 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 361/638] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:56 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1929 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:56.797158 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-c43d52d9-4f65-49fc-9656-4d7a4eead5d7 req-3b4a969e-e88e-461d-bcd9-90774e7c2f73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58d4b11c-eac7-4725-be0b-d10e4cf15bc2", "tag": "fb8fa2f7-3a6c-4af8-bb7a-8e20186076a7"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:56.821432 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c43d52d9-4f65-49fc-9656-4d7a4eead5d7 req-3b4a969e-e88e-461d-bcd9-90774e7c2f73 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:56.824076 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c43d52d9-4f65-49fc-9656-4d7a4eead5d7 req-3b4a969e-e88e-461d-bcd9-90774e7c2f73 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:56.824904 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c43d52d9-4f65-49fc-9656-4d7a4eead5d7 req-3b4a969e-e88e-461d-bcd9-90774e7c2f73 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:56.840335 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-c43d52d9-4f65-49fc-9656-4d7a4eead5d7 req-3b4a969e-e88e-461d-bcd9-90774e7c2f73 service nova] Creating event network-changed:fb8fa2f7-3a6c-4af8-bb7a-8e20186076a7 for instance 58d4b11c-eac7-4725-be0b-d10e4cf15bc2 on nch1-master-1 Sep 17 20:52:56.846202 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-c43d52d9-4f65-49fc-9656-4d7a4eead5d7 req-3b4a969e-e88e-461d-bcd9-90774e7c2f73 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052795 Sep 17 20:52:56.847608 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 362/639] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:52:57.142733 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2804b38b-1ddd-4f87-a183-f3f5c16bf503 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:57.144196 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2804b38b-1ddd-4f87-a183-f3f5c16bf503 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:57.168751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2804b38b-1ddd-4f87-a183-f3f5c16bf503 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:57.169589 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2804b38b-1ddd-4f87-a183-f3f5c16bf503 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:57.171173 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2804b38b-1ddd-4f87-a183-f3f5c16bf503 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:57.173952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2804b38b-1ddd-4f87-a183-f3f5c16bf503 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:57.178364 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2804b38b-1ddd-4f87-a183-f3f5c16bf503 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:57.181127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2804b38b-1ddd-4f87-a183-f3f5c16bf503 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:57.715738 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-01cb4faf-903d-40ba-936f-01d42e77f722 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.452734 Sep 17 20:52:57.716331 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 278/640] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Sep 17 20:52:54 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:52:57.722875 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9cbd0284-8832-42fc-89b2-0632c0eb46f3 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:57.724524 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9cbd0284-8832-42fc-89b2-0632c0eb46f3 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:57.747198 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9cbd0284-8832-42fc-89b2-0632c0eb46f3 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:57.749971 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9cbd0284-8832-42fc-89b2-0632c0eb46f3 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:57.750684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9cbd0284-8832-42fc-89b2-0632c0eb46f3 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:57.751814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9cbd0284-8832-42fc-89b2-0632c0eb46f3 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:57.752478 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9cbd0284-8832-42fc-89b2-0632c0eb46f3 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:57.753250 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9cbd0284-8832-42fc-89b2-0632c0eb46f3 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:58.000064 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-9cbd0284-8832-42fc-89b2-0632c0eb46f3 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lazy-loading 'services' on Instance uuid 8ec574a4-de66-49f0-84bf-b7a1bc07eb91 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:52:58.006836 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2804b38b-1ddd-4f87-a183-f3f5c16bf503 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:58.021347 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2804b38b-1ddd-4f87-a183-f3f5c16bf503 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:58.026316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2804b38b-1ddd-4f87-a183-f3f5c16bf503 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:58.029150 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2804b38b-1ddd-4f87-a183-f3f5c16bf503 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2" status: 200 len: 1361 microversion: 2.25 time: 0.892030 Sep 17 20:52:58.033843 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 363/641] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:57 2022] GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2 => generated 1361 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:58.038858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-52caf4d8-0e31-4fe2-859f-4132c626cd63 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Action: 'action', calling method: .version_select at 0x7f25a7232ca0>, body: {"addFloatingIp": {"address": "172.35.7.208"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:52:58.043314 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9cbd0284-8832-42fc-89b2-0632c0eb46f3 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1929 microversion: 2.75 time: 0.323778 Sep 17 20:52:58.044904 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 279/642] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:57 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1929 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:58.052711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-52caf4d8-0e31-4fe2-859f-4132c626cd63 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] [instance: 9d268239-a1b7-433b-a3f1-52e84ad59682] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:58.069082 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-52caf4d8-0e31-4fe2-859f-4132c626cd63 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:58.069886 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-52caf4d8-0e31-4fe2-859f-4132c626cd63 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:58.070790 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-52caf4d8-0e31-4fe2-859f-4132c626cd63 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:58.071872 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-52caf4d8-0e31-4fe2-859f-4132c626cd63 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:58.073417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-52caf4d8-0e31-4fe2-859f-4132c626cd63 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:58.074709 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-52caf4d8-0e31-4fe2-859f-4132c626cd63 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:58.249659 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-52caf4d8-0e31-4fe2-859f-4132c626cd63 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "refresh_cache-9d268239-a1b7-433b-a3f1-52e84ad59682" {{(pid=140524) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 17 20:52:58.250842 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-52caf4d8-0e31-4fe2-859f-4132c626cd63 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquired lock "refresh_cache-9d268239-a1b7-433b-a3f1-52e84ad59682" {{(pid=140524) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 17 20:52:59.060766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ad9010f8-41f0-45f4-80eb-0a2dff37f5a2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:59.061583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ad9010f8-41f0-45f4-80eb-0a2dff37f5a2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:59.068867 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad9010f8-41f0-45f4-80eb-0a2dff37f5a2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:59.078042 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad9010f8-41f0-45f4-80eb-0a2dff37f5a2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:59.078641 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad9010f8-41f0-45f4-80eb-0a2dff37f5a2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:59.081177 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad9010f8-41f0-45f4-80eb-0a2dff37f5a2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:59.081977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad9010f8-41f0-45f4-80eb-0a2dff37f5a2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:59.086277 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad9010f8-41f0-45f4-80eb-0a2dff37f5a2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:59.702459 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ad9010f8-41f0-45f4-80eb-0a2dff37f5a2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:59.708558 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ad9010f8-41f0-45f4-80eb-0a2dff37f5a2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:59.711086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ad9010f8-41f0-45f4-80eb-0a2dff37f5a2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:52:59.719897 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ad9010f8-41f0-45f4-80eb-0a2dff37f5a2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2" status: 200 len: 1361 microversion: 2.25 time: 0.655856 Sep 17 20:52:59.722935 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 280/643] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:59 2022] GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2 => generated 1361 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 20:52:59.741100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-07b709d1-06a7-4c3d-88d1-9fe1ff1fdcbd tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:59.744289 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-07b709d1-06a7-4c3d-88d1-9fe1ff1fdcbd tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:52:59.768799 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-07b709d1-06a7-4c3d-88d1-9fe1ff1fdcbd tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:59.769678 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-07b709d1-06a7-4c3d-88d1-9fe1ff1fdcbd tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:59.770909 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-07b709d1-06a7-4c3d-88d1-9fe1ff1fdcbd tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:59.771879 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-07b709d1-06a7-4c3d-88d1-9fe1ff1fdcbd tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:59.772760 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-07b709d1-06a7-4c3d-88d1-9fe1ff1fdcbd tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:59.773413 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-07b709d1-06a7-4c3d-88d1-9fe1ff1fdcbd tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:59.887291 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-07b709d1-06a7-4c3d-88d1-9fe1ff1fdcbd tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lazy-loading 'services' on Instance uuid 8ec574a4-de66-49f0-84bf-b7a1bc07eb91 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:52:59.918677 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-07b709d1-06a7-4c3d-88d1-9fe1ff1fdcbd tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1929 microversion: 2.75 time: 0.191428 Sep 17 20:52:59.919693 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 281/644] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:52:59 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1929 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:52:59.924983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f644054f-12a2-4031-938c-4bdb17321a9d tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Calling method '.version_select at 0x7f25a5d8fe50>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:59.929884 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f644054f-12a2-4031-938c-4bdb17321a9d tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:52:59.930605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f644054f-12a2-4031-938c-4bdb17321a9d tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:52:59.931250 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f644054f-12a2-4031-938c-4bdb17321a9d tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:52:59.942445 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f644054f-12a2-4031-938c-4bdb17321a9d tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 1186 microversion: 2.1 time: 0.021399 Sep 17 20:52:59.943396 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 282/645] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Sep 17 20:52:59 2022] GET /compute/v2.1/os-migrations => generated 1186 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:52:59.961566 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-576a71e9-8bcb-4150-98dc-fa08cee793ae tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:52:59.969843 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-576a71e9-8bcb-4150-98dc-fa08cee793ae tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012125 Sep 17 20:52:59.980738 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 283/646] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Sep 17 20:52:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:52:59.990297 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e50cc12f-b8ae-479a-b259-0fcab9a3abbb tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-643263057", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:00.032724 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e50cc12f-b8ae-479a-b259-0fcab9a3abbb tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.038211 Sep 17 20:53:00.032724 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 284/647] 10.222.0.26 () {60 vars in 1146 bytes} [Sat Sep 17 20:52:59 2022] POST /compute/v2.1/flavors => generated 498 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:53:00.039488 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e230a547-a055-4a01-8514-bbdf83857fdf tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:00.052514 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e230a547-a055-4a01-8514-bbdf83857fdf tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.018252 Sep 17 20:53:00.054346 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 285/648] 10.222.0.26 () {58 vars in 1182 bytes} [Sat Sep 17 20:53:00 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 17 20:53:00.178209 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:53:00.212951 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-10269900-603d-40bc-92f8-eb0625280795 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-356616174", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "e11eb69d-0e08-4e83-bc39-5671aae60bd2"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:00.320164 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-10269900-603d-40bc-92f8-eb0625280795 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] validate_networks() for None {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:53:01.461852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-52caf4d8-0e31-4fe2-859f-4132c626cd63 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] [instance: 9d268239-a1b7-433b-a3f1-52e84ad59682] Building network info cache for instance {{(pid=140524) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 17 20:53:01.494807 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-10269900-603d-40bc-92f8-eb0625280795 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:53:01.495490 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-10269900-603d-40bc-92f8-eb0625280795 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:53:01.496154 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-10269900-603d-40bc-92f8-eb0625280795 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:53:01.496729 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-10269900-603d-40bc-92f8-eb0625280795 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:53:01.497432 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-10269900-603d-40bc-92f8-eb0625280795 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:53:01.520779 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10269900-603d-40bc-92f8-eb0625280795 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:01.522204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10269900-603d-40bc-92f8-eb0625280795 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:01.523850 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10269900-603d-40bc-92f8-eb0625280795 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:01.528088 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10269900-603d-40bc-92f8-eb0625280795 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:01.528714 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10269900-603d-40bc-92f8-eb0625280795 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:01.529046 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10269900-603d-40bc-92f8-eb0625280795 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:01.623076 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-10269900-603d-40bc-92f8-eb0625280795 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Getting quotas for project 07ce9fd746374b478a743261eb014e5c. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:53:01.649753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-10269900-603d-40bc-92f8-eb0625280795 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Getting quotas for user 226a87a1f393420b8d19ec2390e9d063 and project 07ce9fd746374b478a743261eb014e5c. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:53:01.697452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-10269900-603d-40bc-92f8-eb0625280795 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:53:01.700483 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-10269900-603d-40bc-92f8-eb0625280795 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:53:01.827185 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-10269900-603d-40bc-92f8-eb0625280795 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.619627 Sep 17 20:53:01.835947 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 286/649] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:53:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:53:01.872703 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ad7e8361-df96-4593-8315-3f7f71b80eea tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:01.873777 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ad7e8361-df96-4593-8315-3f7f71b80eea tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:01.906201 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad7e8361-df96-4593-8315-3f7f71b80eea tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:01.908159 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad7e8361-df96-4593-8315-3f7f71b80eea tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:01.911688 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad7e8361-df96-4593-8315-3f7f71b80eea tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:01.915129 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad7e8361-df96-4593-8315-3f7f71b80eea tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:01.917336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad7e8361-df96-4593-8315-3f7f71b80eea tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:01.920486 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad7e8361-df96-4593-8315-3f7f71b80eea tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:02.510384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ad7e8361-df96-4593-8315-3f7f71b80eea tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:02.533775 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ad7e8361-df96-4593-8315-3f7f71b80eea tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:02.542704 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ad7e8361-df96-4593-8315-3f7f71b80eea tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:02.546783 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ad7e8361-df96-4593-8315-3f7f71b80eea tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2" status: 200 len: 1361 microversion: 2.25 time: 0.709524 Sep 17 20:53:02.547386 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 287/650] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:01 2022] GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2 => generated 1361 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:53:02.568730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-05752e44-0491-4101-9755-9abb8317a890 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:02.569367 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-05752e44-0491-4101-9755-9abb8317a890 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:02.601107 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-05752e44-0491-4101-9755-9abb8317a890 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:02.611401 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-05752e44-0491-4101-9755-9abb8317a890 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:02.612206 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-05752e44-0491-4101-9755-9abb8317a890 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:02.612987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-05752e44-0491-4101-9755-9abb8317a890 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:02.613483 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-05752e44-0491-4101-9755-9abb8317a890 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:02.613914 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-05752e44-0491-4101-9755-9abb8317a890 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:02.871596 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-05752e44-0491-4101-9755-9abb8317a890 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lazy-loading 'services' on Instance uuid 8ec574a4-de66-49f0-84bf-b7a1bc07eb91 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:53:02.924053 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:53:02.945609 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-05752e44-0491-4101-9755-9abb8317a890 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1929 microversion: 2.75 time: 0.396751 Sep 17 20:53:02.962358 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 288/651] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:02 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1929 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:53:02.981165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-f03f86f6-8ff4-4ae4-91d2-a903eaf58d68 req-fd71a8ff-b1ab-466d-b97d-a521071889b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d268239-a1b7-433b-a3f1-52e84ad59682", "tag": "a1936332-9c49-496c-a1d8-d378ab79c8ff"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:03.039786 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f03f86f6-8ff4-4ae4-91d2-a903eaf58d68 req-fd71a8ff-b1ab-466d-b97d-a521071889b8 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:03.040295 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f03f86f6-8ff4-4ae4-91d2-a903eaf58d68 req-fd71a8ff-b1ab-466d-b97d-a521071889b8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:03.040739 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f03f86f6-8ff4-4ae4-91d2-a903eaf58d68 req-fd71a8ff-b1ab-466d-b97d-a521071889b8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:03.099116 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-f03f86f6-8ff4-4ae4-91d2-a903eaf58d68 req-fd71a8ff-b1ab-466d-b97d-a521071889b8 service nova] Creating event network-changed:a1936332-9c49-496c-a1d8-d378ab79c8ff for instance 9d268239-a1b7-433b-a3f1-52e84ad59682 on nch1-master-1 Sep 17 20:53:03.119939 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-f03f86f6-8ff4-4ae4-91d2-a903eaf58d68 req-fd71a8ff-b1ab-466d-b97d-a521071889b8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156123 Sep 17 20:53:03.126805 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 289/652] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:53:03.144069 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-60cc03e0-2c65-4483-ae24-5319d5220263 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:03.144862 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-60cc03e0-2c65-4483-ae24-5319d5220263 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:03.159557 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60cc03e0-2c65-4483-ae24-5319d5220263 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:03.160066 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60cc03e0-2c65-4483-ae24-5319d5220263 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:03.165184 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60cc03e0-2c65-4483-ae24-5319d5220263 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:03.166190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60cc03e0-2c65-4483-ae24-5319d5220263 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:03.166884 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60cc03e0-2c65-4483-ae24-5319d5220263 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:03.169302 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60cc03e0-2c65-4483-ae24-5319d5220263 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:03.385965 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-60cc03e0-2c65-4483-ae24-5319d5220263 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:03.400575 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-60cc03e0-2c65-4483-ae24-5319d5220263 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1274 microversion: 2.1 time: 0.267309 Sep 17 20:53:03.401437 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 290/653] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:03 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1274 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:03.578656 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-59fbc97f-01be-43d9-9f0c-cad09684b5df tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:03.579438 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-59fbc97f-01be-43d9-9f0c-cad09684b5df tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:03.593342 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59fbc97f-01be-43d9-9f0c-cad09684b5df tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:03.599071 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-52caf4d8-0e31-4fe2-859f-4132c626cd63 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] [instance: 9d268239-a1b7-433b-a3f1-52e84ad59682] Updating instance_info_cache with network_info: [{"id": "a1936332-9c49-496c-a1d8-d378ab79c8ff", "address": "fa:16:3e:f1:18:18", "network": {"id": "9972ca70-5471-447a-8a92-6cfeb739a36b", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1790851012-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.7.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e566b2c69fec4ec784a13e4034eaef72", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa1936332-9c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140524) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 17 20:53:03.604073 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59fbc97f-01be-43d9-9f0c-cad09684b5df tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:03.605333 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59fbc97f-01be-43d9-9f0c-cad09684b5df tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:03.608209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59fbc97f-01be-43d9-9f0c-cad09684b5df tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:03.608695 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59fbc97f-01be-43d9-9f0c-cad09684b5df tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:03.609129 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59fbc97f-01be-43d9-9f0c-cad09684b5df tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:03.634642 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-52caf4d8-0e31-4fe2-859f-4132c626cd63 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Releasing lock "refresh_cache-9d268239-a1b7-433b-a3f1-52e84ad59682" {{(pid=140524) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 17 20:53:03.636932 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-52caf4d8-0e31-4fe2-859f-4132c626cd63 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] 10.222.0.26 "POST /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682/action" status: 202 len: 0 microversion: 2.1 time: 5.601877 Sep 17 20:53:03.648869 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 364/654] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:52:58 2022] POST /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682/action => generated 0 bytes in 5614 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 17 20:53:03.663256 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-05a7fbe6-736c-4374-95ef-060294b99aba tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Action: 'create', calling method: .version_select at 0x7f25a5948940>, body: {"pool": "65a1299f-7295-4ddf-9578-cb304a29a96a"} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:04.960686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-59fbc97f-01be-43d9-9f0c-cad09684b5df tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:04.978457 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-59fbc97f-01be-43d9-9f0c-cad09684b5df tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:04.980019 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-59fbc97f-01be-43d9-9f0c-cad09684b5df tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:04.988272 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-59fbc97f-01be-43d9-9f0c-cad09684b5df tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2" status: 200 len: 1361 microversion: 2.25 time: 1.408673 Sep 17 20:53:04.988947 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 291/655] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:03 2022] GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2 => generated 1361 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 20:53:04.997061 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2f1ac839-6fa6-478f-925b-c032cfcbfc54 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:05.002383 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2f1ac839-6fa6-478f-925b-c032cfcbfc54 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:05.015578 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f1ac839-6fa6-478f-925b-c032cfcbfc54 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:05.016650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f1ac839-6fa6-478f-925b-c032cfcbfc54 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:05.017246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f1ac839-6fa6-478f-925b-c032cfcbfc54 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:05.019052 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f1ac839-6fa6-478f-925b-c032cfcbfc54 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:05.022723 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f1ac839-6fa6-478f-925b-c032cfcbfc54 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:05.023516 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f1ac839-6fa6-478f-925b-c032cfcbfc54 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:05.269952 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-2f1ac839-6fa6-478f-925b-c032cfcbfc54 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lazy-loading 'services' on Instance uuid 8ec574a4-de66-49f0-84bf-b7a1bc07eb91 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:53:05.328623 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2f1ac839-6fa6-478f-925b-c032cfcbfc54 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1929 microversion: 2.75 time: 0.337048 Sep 17 20:53:05.332605 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 292/656] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:04 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1929 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:53:05.351616 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-93fe0ae7-14cf-4f5e-8dcf-5e3ecf8d3796 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:05.352605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-93fe0ae7-14cf-4f5e-8dcf-5e3ecf8d3796 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:05.359408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-93fe0ae7-14cf-4f5e-8dcf-5e3ecf8d3796 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:05.363552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-93fe0ae7-14cf-4f5e-8dcf-5e3ecf8d3796 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:05.366988 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-93fe0ae7-14cf-4f5e-8dcf-5e3ecf8d3796 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:05.368692 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-93fe0ae7-14cf-4f5e-8dcf-5e3ecf8d3796 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:05.370804 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-93fe0ae7-14cf-4f5e-8dcf-5e3ecf8d3796 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:05.371517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-93fe0ae7-14cf-4f5e-8dcf-5e3ecf8d3796 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:05.539567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-93fe0ae7-14cf-4f5e-8dcf-5e3ecf8d3796 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:05.578159 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-93fe0ae7-14cf-4f5e-8dcf-5e3ecf8d3796 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1336 microversion: 2.1 time: 0.244177 Sep 17 20:53:05.579888 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 293/657] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:05 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1336 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:06.022523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3f708d66-4b54-4463-8c6b-ab7da6d567c8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:06.023099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3f708d66-4b54-4463-8c6b-ab7da6d567c8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:06.033119 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f708d66-4b54-4463-8c6b-ab7da6d567c8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:06.040794 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f708d66-4b54-4463-8c6b-ab7da6d567c8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:06.041370 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f708d66-4b54-4463-8c6b-ab7da6d567c8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:06.042249 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f708d66-4b54-4463-8c6b-ab7da6d567c8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:06.042732 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f708d66-4b54-4463-8c6b-ab7da6d567c8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:06.043169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f708d66-4b54-4463-8c6b-ab7da6d567c8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:06.204669 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=16 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:53:06.662719 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3f708d66-4b54-4463-8c6b-ab7da6d567c8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:06.688748 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3f708d66-4b54-4463-8c6b-ab7da6d567c8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:06.692651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3f708d66-4b54-4463-8c6b-ab7da6d567c8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:06.698650 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3f708d66-4b54-4463-8c6b-ab7da6d567c8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2" status: 200 len: 1361 microversion: 2.25 time: 0.676891 Sep 17 20:53:06.701772 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 294/658] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:06 2022] GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2 => generated 1361 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:53:06.720141 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-deb02e48-5118-4fad-b5f5-d23813023dd9 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:06.728038 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-deb02e48-5118-4fad-b5f5-d23813023dd9 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:06.751187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-deb02e48-5118-4fad-b5f5-d23813023dd9 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:06.751926 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-deb02e48-5118-4fad-b5f5-d23813023dd9 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:06.753813 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-deb02e48-5118-4fad-b5f5-d23813023dd9 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:06.756318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-deb02e48-5118-4fad-b5f5-d23813023dd9 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:06.756983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-deb02e48-5118-4fad-b5f5-d23813023dd9 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:06.760181 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-deb02e48-5118-4fad-b5f5-d23813023dd9 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:06.981069 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-deb02e48-5118-4fad-b5f5-d23813023dd9 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lazy-loading 'services' on Instance uuid 8ec574a4-de66-49f0-84bf-b7a1bc07eb91 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:53:07.036383 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-deb02e48-5118-4fad-b5f5-d23813023dd9 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1929 microversion: 2.75 time: 0.327837 Sep 17 20:53:07.037899 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 295/659] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:06 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1929 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:53:07.050373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-43cfea6a-02f8-4001-94bf-f836a747e90d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:07.055368 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-43cfea6a-02f8-4001-94bf-f836a747e90d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:07.071625 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-43cfea6a-02f8-4001-94bf-f836a747e90d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:07.072409 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-43cfea6a-02f8-4001-94bf-f836a747e90d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:07.075083 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-43cfea6a-02f8-4001-94bf-f836a747e90d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:07.078929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-43cfea6a-02f8-4001-94bf-f836a747e90d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:07.080341 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-43cfea6a-02f8-4001-94bf-f836a747e90d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:07.082370 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-43cfea6a-02f8-4001-94bf-f836a747e90d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:07.633233 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-43cfea6a-02f8-4001-94bf-f836a747e90d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:07.644311 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-43cfea6a-02f8-4001-94bf-f836a747e90d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1378 microversion: 2.1 time: 0.605033 Sep 17 20:53:07.646766 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 296/660] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:07 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1378 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:07.657206 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-3305f0bd-5841-4d75-90eb-38d819a16a92 req-e6233d96-509b-452a-b6d1-e90a3d1b9398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58d4b11c-eac7-4725-be0b-d10e4cf15bc2", "name": "network-vif-plugged", "status": "completed", "tag": "fb8fa2f7-3a6c-4af8-bb7a-8e20186076a7"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:07.680686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-3305f0bd-5841-4d75-90eb-38d819a16a92 req-e6233d96-509b-452a-b6d1-e90a3d1b9398 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:07.682156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-3305f0bd-5841-4d75-90eb-38d819a16a92 req-e6233d96-509b-452a-b6d1-e90a3d1b9398 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:07.682899 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-3305f0bd-5841-4d75-90eb-38d819a16a92 req-e6233d96-509b-452a-b6d1-e90a3d1b9398 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:07.709439 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-3305f0bd-5841-4d75-90eb-38d819a16a92 req-e6233d96-509b-452a-b6d1-e90a3d1b9398 service nova] Creating event network-vif-plugged:fb8fa2f7-3a6c-4af8-bb7a-8e20186076a7 for instance 58d4b11c-eac7-4725-be0b-d10e4cf15bc2 on nch1-master-1 Sep 17 20:53:07.719726 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-3305f0bd-5841-4d75-90eb-38d819a16a92 req-e6233d96-509b-452a-b6d1-e90a3d1b9398 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071455 Sep 17 20:53:07.720653 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 297/661] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:53:08.008579 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-197898a4-35e1-4ea2-b68f-55d290f074b4 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Action: 'create', calling method: .version_select at 0x7f25a5bef1f0>, body: {"keypair": {"name": "tempest-keypair-393711399", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBUc2mIw+9YpbnK46MeYIwpJijRUIl6YwAB1sOGpHGnUhy6vmq8Ub7M8xSLR681ob4Ch7tT1ZQjOFedJC+iVyJmaJ4tZF1M2c1XzYKiX8a8JgqoxhwBGuBe0+Vn/BTJkA=="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:08.040866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-197898a4-35e1-4ea2-b68f-55d290f074b4 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Getting quotas for project 5d29b99a6bd9481f9042d9c7a9451c49. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:53:08.047886 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-197898a4-35e1-4ea2-b68f-55d290f074b4 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Getting quotas for user 495973792ca942bca2c6f65d545346e9 and project 5d29b99a6bd9481f9042d9c7a9451c49. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:53:08.064470 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=5 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:53:08.113538 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-197898a4-35e1-4ea2-b68f-55d290f074b4 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.390433 Sep 17 20:53:08.124080 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 298/662] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 20:53:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:53:08.136723 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-98a8b038-294c-4d47-90c8-9b7a3ca5700e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:08.138265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-98a8b038-294c-4d47-90c8-9b7a3ca5700e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:08.151146 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98a8b038-294c-4d47-90c8-9b7a3ca5700e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:08.154607 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98a8b038-294c-4d47-90c8-9b7a3ca5700e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:08.155802 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98a8b038-294c-4d47-90c8-9b7a3ca5700e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:08.157350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98a8b038-294c-4d47-90c8-9b7a3ca5700e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:08.158599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98a8b038-294c-4d47-90c8-9b7a3ca5700e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:08.160585 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98a8b038-294c-4d47-90c8-9b7a3ca5700e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:08.758307 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-98a8b038-294c-4d47-90c8-9b7a3ca5700e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:08.761999 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:53:08.795644 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-98a8b038-294c-4d47-90c8-9b7a3ca5700e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:08.799388 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-98a8b038-294c-4d47-90c8-9b7a3ca5700e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:08.804091 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-98a8b038-294c-4d47-90c8-9b7a3ca5700e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2" status: 200 len: 1361 microversion: 2.25 time: 0.676884 Sep 17 20:53:08.805568 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 299/663] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:08 2022] GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2 => generated 1361 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:53:08.813864 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7e5a27ae-b547-475d-a47f-3f48761d45af tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:08.815378 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7e5a27ae-b547-475d-a47f-3f48761d45af tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:08.840873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7e5a27ae-b547-475d-a47f-3f48761d45af tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:08.841451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7e5a27ae-b547-475d-a47f-3f48761d45af tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:08.841943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7e5a27ae-b547-475d-a47f-3f48761d45af tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:08.843056 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7e5a27ae-b547-475d-a47f-3f48761d45af tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:08.843691 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7e5a27ae-b547-475d-a47f-3f48761d45af tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:08.844115 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7e5a27ae-b547-475d-a47f-3f48761d45af tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:09.058563 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-7e5a27ae-b547-475d-a47f-3f48761d45af tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lazy-loading 'services' on Instance uuid 8ec574a4-de66-49f0-84bf-b7a1bc07eb91 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:53:09.112741 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7e5a27ae-b547-475d-a47f-3f48761d45af tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1929 microversion: 2.75 time: 0.303828 Sep 17 20:53:09.131334 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 300/664] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:08 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1929 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:53:09.154357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b00e38f2-718c-4c4a-8b02-da50ed950f3b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:09.155508 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b00e38f2-718c-4c4a-8b02-da50ed950f3b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:09.177236 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b00e38f2-718c-4c4a-8b02-da50ed950f3b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:09.178227 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b00e38f2-718c-4c4a-8b02-da50ed950f3b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:09.178899 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b00e38f2-718c-4c4a-8b02-da50ed950f3b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:09.179817 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b00e38f2-718c-4c4a-8b02-da50ed950f3b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:09.180456 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b00e38f2-718c-4c4a-8b02-da50ed950f3b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:09.181154 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b00e38f2-718c-4c4a-8b02-da50ed950f3b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:10.104647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b00e38f2-718c-4c4a-8b02-da50ed950f3b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:10.116088 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b00e38f2-718c-4c4a-8b02-da50ed950f3b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1378 microversion: 2.1 time: 0.983152 Sep 17 20:53:10.120585 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 301/665] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:09 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1378 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:10.127424 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-84a3bc53-eb12-486e-99cc-5663cfdc2bd5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:10.131271 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-84a3bc53-eb12-486e-99cc-5663cfdc2bd5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:10.147507 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84a3bc53-eb12-486e-99cc-5663cfdc2bd5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:10.148434 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84a3bc53-eb12-486e-99cc-5663cfdc2bd5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:10.149089 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84a3bc53-eb12-486e-99cc-5663cfdc2bd5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:10.150533 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84a3bc53-eb12-486e-99cc-5663cfdc2bd5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:10.151284 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84a3bc53-eb12-486e-99cc-5663cfdc2bd5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:10.151952 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84a3bc53-eb12-486e-99cc-5663cfdc2bd5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:10.547529 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-05a7fbe6-736c-4374-95ef-060294b99aba tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.896448 Sep 17 20:53:10.548634 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 365/666] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Sep 17 20:53:03 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6899 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:53:10.555673 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a5260314-bfd2-44b9-a8f2-151f1fcf7896 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:10.556649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a5260314-bfd2-44b9-a8f2-151f1fcf7896 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:10.583095 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5260314-bfd2-44b9-a8f2-151f1fcf7896 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:10.583802 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5260314-bfd2-44b9-a8f2-151f1fcf7896 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:10.584592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5260314-bfd2-44b9-a8f2-151f1fcf7896 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:10.585787 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5260314-bfd2-44b9-a8f2-151f1fcf7896 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:10.586767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5260314-bfd2-44b9-a8f2-151f1fcf7896 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:10.587286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5260314-bfd2-44b9-a8f2-151f1fcf7896 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:10.766054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-84a3bc53-eb12-486e-99cc-5663cfdc2bd5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:10.775477 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-84a3bc53-eb12-486e-99cc-5663cfdc2bd5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:10.782927 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-84a3bc53-eb12-486e-99cc-5663cfdc2bd5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:10.785029 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-84a3bc53-eb12-486e-99cc-5663cfdc2bd5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2" status: 200 len: 1557 microversion: 2.25 time: 0.663036 Sep 17 20:53:10.785737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-a5260314-bfd2-44b9-a8f2-151f1fcf7896 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lazy-loading 'services' on Instance uuid 8ec574a4-de66-49f0-84bf-b7a1bc07eb91 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:53:10.788289 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 302/667] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:10 2022] GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2 => generated 1557 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:53:10.797816 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b159e17a-33a1-4986-b718-b7016954a864 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Action: 'action', calling method: .version_select at 0x7f25a726fd30>, body: {"addFloatingIp": {"address": "172.35.7.214"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:10.812952 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b159e17a-33a1-4986-b718-b7016954a864 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] [instance: 9d268239-a1b7-433b-a3f1-52e84ad59682] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:10.833831 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a5260314-bfd2-44b9-a8f2-151f1fcf7896 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1929 microversion: 2.75 time: 0.280326 Sep 17 20:53:10.834569 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b159e17a-33a1-4986-b718-b7016954a864 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:10.834731 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 366/668] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:10 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1929 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:53:10.842926 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b159e17a-33a1-4986-b718-b7016954a864 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:10.845209 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-60a9a0ae-2bf2-410c-8167-7bceed00483e tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:10.845741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b159e17a-33a1-4986-b718-b7016954a864 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:10.847349 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b159e17a-33a1-4986-b718-b7016954a864 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:10.848269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-60a9a0ae-2bf2-410c-8167-7bceed00483e tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:10.851109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b159e17a-33a1-4986-b718-b7016954a864 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:10.854597 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b159e17a-33a1-4986-b718-b7016954a864 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:10.872247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-60a9a0ae-2bf2-410c-8167-7bceed00483e tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:10.873051 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-60a9a0ae-2bf2-410c-8167-7bceed00483e tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:10.873712 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-60a9a0ae-2bf2-410c-8167-7bceed00483e tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:10.877247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-60a9a0ae-2bf2-410c-8167-7bceed00483e tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:10.878051 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-60a9a0ae-2bf2-410c-8167-7bceed00483e tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:10.880133 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-60a9a0ae-2bf2-410c-8167-7bceed00483e tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:11.053865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b159e17a-33a1-4986-b718-b7016954a864 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "refresh_cache-9d268239-a1b7-433b-a3f1-52e84ad59682" {{(pid=140523) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 17 20:53:11.054331 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b159e17a-33a1-4986-b718-b7016954a864 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquired lock "refresh_cache-9d268239-a1b7-433b-a3f1-52e84ad59682" {{(pid=140523) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 17 20:53:11.586368 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:53:11.899122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-60a9a0ae-2bf2-410c-8167-7bceed00483e tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lazy-loading 'services' on Instance uuid 58d4b11c-eac7-4725-be0b-d10e4cf15bc2 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:53:11.934495 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-60a9a0ae-2bf2-410c-8167-7bceed00483e tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2" status: 200 len: 2049 microversion: 2.25 time: 1.098614 Sep 17 20:53:11.935845 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 367/669] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:10 2022] GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2 => generated 2049 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:53:11.946052 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-28ac855b-f470-46b4-9ebb-4bd998ec9011 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:11.946864 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-28ac855b-f470-46b4-9ebb-4bd998ec9011 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:11.969831 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28ac855b-f470-46b4-9ebb-4bd998ec9011 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:11.971222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28ac855b-f470-46b4-9ebb-4bd998ec9011 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:11.973408 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28ac855b-f470-46b4-9ebb-4bd998ec9011 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:11.975630 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28ac855b-f470-46b4-9ebb-4bd998ec9011 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:11.977618 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28ac855b-f470-46b4-9ebb-4bd998ec9011 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:11.982294 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28ac855b-f470-46b4-9ebb-4bd998ec9011 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:12.492904 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-28ac855b-f470-46b4-9ebb-4bd998ec9011 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:12.505032 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-28ac855b-f470-46b4-9ebb-4bd998ec9011 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1378 microversion: 2.1 time: 0.563084 Sep 17 20:53:12.505941 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 368/670] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:11 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1378 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:12.513710 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-023e9ef8-1014-46fb-81a9-d6c402e13003 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-20956631", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "09c9b3c9-a210-43fd-befa-fb6539e0170c"}], "security_groups": [{"name": "tempest-securitygroup--1351977190"}], "key_name": "tempest-keypair-393711399", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:12.595073 ncdv-master-1 devstack@n-api.service[140523]: DEBUG neutronclient.v2_0.client [None req-b159e17a-33a1-4986-b718-b7016954a864 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.7.214 (e1a94874-ae07-420d-86f2-8eb8625db7d6) with port a1936332-9c49-496c-a1d8-d378ab79c8ff using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 65a1299f-7295-4ddf-9578-cb304a29a96a.", "detail": ""}} {{(pid=140523) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 17 20:53:12.595958 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b159e17a-33a1-4986-b718-b7016954a864 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Releasing lock "refresh_cache-9d268239-a1b7-433b-a3f1-52e84ad59682" {{(pid=140523) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 17 20:53:12.596625 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-b159e17a-33a1-4986-b718-b7016954a864 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] HTTP exception thrown: Cannot associate floating IP 172.35.7.214 (e1a94874-ae07-420d-86f2-8eb8625db7d6) with port a1936332-9c49-496c-a1d8-d378ab79c8ff using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 65a1299f-7295-4ddf-9578-cb304a29a96a. Sep 17 20:53:12.596625 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-0956fe9d-aa73-49d2-b487-548cf202356e'] Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b159e17a-33a1-4986-b718-b7016954a864 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Request method failure captured: Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682/action HTTP/1.1 Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 46 Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjOPTD5bVc5vw9S8U7S39ahSkUdLqYrEohQkTER8XyECLPOX8-Wzl3iM3e2fdoLvu2gM1MBw_jDVBCemrcXZjMYyfCtmYMgnqW4J2izXawiy9GAW8TRFepKi0Y7eI1o8mHaGZHoKccTsemQx4JJOQzVrtnY-yAMe0XWWBK3NkT6ELJk Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: e566b2c69fec4ec784a13e4034eaef72 Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-291838535 Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e566b2c69fec4ec784a13e4034eaef72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e566b2c69fec4ec784a13e4034eaef72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e566b2c69fec4ec784a13e4034eaef72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e566b2c69fec4ec784a13e4034eaef72", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-291838535 Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: e566b2c69fec4ec784a13e4034eaef72 Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-291838535 Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: feb0a86572434db48c987279d67cd4e0 Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: {"addFloatingIp": {"address": "172.35.7.214"}} Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: exception: Cannot associate floating IP 172.35.7.214 (e1a94874-ae07-420d-86f2-8eb8625db7d6) with port a1936332-9c49-496c-a1d8-d378ab79c8ff using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 65a1299f-7295-4ddf-9578-cb304a29a96a. Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-0956fe9d-aa73-49d2-b487-548cf202356e'] Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '9d268239-a1b7-433b-a3f1-52e84ad59682', 'body': {'addFloatingIp': {'address': '172.35.7.214'}}} Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 17 20:53:12.599285 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.7.214 (e1a94874-ae07-420d-86f2-8eb8625db7d6) with port a1936332-9c49-496c-a1d8-d378ab79c8ff using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 65a1299f-7295-4ddf-9578-cb304a29a96a. Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0956fe9d-aa73-49d2-b487-548cf202356e'] Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.7.214 (e1a94874-ae07-420d-86f2-8eb8625db7d6) with port a1936332-9c49-496c-a1d8-d378ab79c8ff using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 65a1299f-7295-4ddf-9578-cb304a29a96a. Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0956fe9d-aa73-49d2-b487-548cf202356e'] Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.7.214 (e1a94874-ae07-420d-86f2-8eb8625db7d6) with port a1936332-9c49-496c-a1d8-d378ab79c8ff using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 65a1299f-7295-4ddf-9578-cb304a29a96a. Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0956fe9d-aa73-49d2-b487-548cf202356e'] Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.7.214 (e1a94874-ae07-420d-86f2-8eb8625db7d6) with port a1936332-9c49-496c-a1d8-d378ab79c8ff using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 65a1299f-7295-4ddf-9578-cb304a29a96a. Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0956fe9d-aa73-49d2-b487-548cf202356e'] Sep 17 20:53:12.603974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:53:12.608421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b159e17a-33a1-4986-b718-b7016954a864 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Returning 400 to user: Cannot associate floating IP 172.35.7.214 (e1a94874-ae07-420d-86f2-8eb8625db7d6) with port a1936332-9c49-496c-a1d8-d378ab79c8ff using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network 65a1299f-7295-4ddf-9578-cb304a29a96a. Sep 17 20:53:12.608421 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-0956fe9d-aa73-49d2-b487-548cf202356e'] {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:53:12.608421 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b159e17a-33a1-4986-b718-b7016954a864 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] 10.222.0.26 "POST /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682/action" status: 400 len: 381 microversion: 2.1 time: 1.817261 Sep 17 20:53:12.608704 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 303/671] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:53:10 2022] POST /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682/action => generated 381 bytes in 1820 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 20:53:12.614532 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-fef9d240-46c0-4347-8197-74fe15c89ad8 req-25059987-7ba3-42fd-b092-f9951eb7a03a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89b39b18-ff49-4810-9701-3084736ff2d0", "tag": "67dfcd54-a56f-4269-9ed0-edf035c918b0"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:12.642207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-fef9d240-46c0-4347-8197-74fe15c89ad8 req-25059987-7ba3-42fd-b092-f9951eb7a03a service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:12.642794 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-fef9d240-46c0-4347-8197-74fe15c89ad8 req-25059987-7ba3-42fd-b092-f9951eb7a03a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:12.644083 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-fef9d240-46c0-4347-8197-74fe15c89ad8 req-25059987-7ba3-42fd-b092-f9951eb7a03a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:12.673750 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-fef9d240-46c0-4347-8197-74fe15c89ad8 req-25059987-7ba3-42fd-b092-f9951eb7a03a service nova] Creating event network-changed:67dfcd54-a56f-4269-9ed0-edf035c918b0 for instance 89b39b18-ff49-4810-9701-3084736ff2d0 on nch2-master-1 Sep 17 20:53:12.684508 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-fef9d240-46c0-4347-8197-74fe15c89ad8 req-25059987-7ba3-42fd-b092-f9951eb7a03a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073882 Sep 17 20:53:12.694810 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 304/672] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:53:12.708607 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7937b860-4a6d-4cb6-9bd7-08bc8f01df61 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:12.711724 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7937b860-4a6d-4cb6-9bd7-08bc8f01df61 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:12.719466 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7937b860-4a6d-4cb6-9bd7-08bc8f01df61 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:12.720075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7937b860-4a6d-4cb6-9bd7-08bc8f01df61 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:12.720590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7937b860-4a6d-4cb6-9bd7-08bc8f01df61 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:12.721390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7937b860-4a6d-4cb6-9bd7-08bc8f01df61 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:12.722188 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7937b860-4a6d-4cb6-9bd7-08bc8f01df61 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:12.722691 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7937b860-4a6d-4cb6-9bd7-08bc8f01df61 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:12.748455 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-023e9ef8-1014-46fb-81a9-d6c402e13003 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] validate_networks() for [('09c9b3c9-a210-43fd-befa-fb6539e0170c', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:53:12.842100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-7937b860-4a6d-4cb6-9bd7-08bc8f01df61 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lazy-loading 'services' on Instance uuid 8ec574a4-de66-49f0-84bf-b7a1bc07eb91 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:53:12.863018 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7937b860-4a6d-4cb6-9bd7-08bc8f01df61 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1929 microversion: 2.75 time: 0.165370 Sep 17 20:53:12.863908 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 305/673] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:12 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1929 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:53:12.869871 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cef1b0d6-6ef3-4d4a-9adb-fe2643ca57e9 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:12.870936 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cef1b0d6-6ef3-4d4a-9adb-fe2643ca57e9 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:12.877576 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cef1b0d6-6ef3-4d4a-9adb-fe2643ca57e9 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:12.878488 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cef1b0d6-6ef3-4d4a-9adb-fe2643ca57e9 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:12.879112 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cef1b0d6-6ef3-4d4a-9adb-fe2643ca57e9 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:12.880017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cef1b0d6-6ef3-4d4a-9adb-fe2643ca57e9 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:12.880472 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cef1b0d6-6ef3-4d4a-9adb-fe2643ca57e9 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:12.881060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cef1b0d6-6ef3-4d4a-9adb-fe2643ca57e9 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:13.142176 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-cef1b0d6-6ef3-4d4a-9adb-fe2643ca57e9 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lazy-loading 'services' on Instance uuid 58d4b11c-eac7-4725-be0b-d10e4cf15bc2 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:53:13.160224 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cef1b0d6-6ef3-4d4a-9adb-fe2643ca57e9 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2" status: 200 len: 2049 microversion: 2.25 time: 0.294961 Sep 17 20:53:13.160826 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 306/674] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:12 2022] GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2 => generated 2049 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:53:13.188187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f452b61c-1d46-42f8-9a86-9a78f3b88ee6 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Calling method '.version_select at 0x7f25a5967790>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:14.298186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-023e9ef8-1014-46fb-81a9-d6c402e13003 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Getting quotas for project 5d29b99a6bd9481f9042d9c7a9451c49. Resources: dict_keys(['metadata_items']) {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:53:14.305827 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-023e9ef8-1014-46fb-81a9-d6c402e13003 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Getting quotas for user 495973792ca942bca2c6f65d545346e9 and project 5d29b99a6bd9481f9042d9c7a9451c49. Resources: dict_keys(['metadata_items']) {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:53:14.324257 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-023e9ef8-1014-46fb-81a9-d6c402e13003 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:53:14.325119 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-023e9ef8-1014-46fb-81a9-d6c402e13003 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:53:14.325669 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-023e9ef8-1014-46fb-81a9-d6c402e13003 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:53:14.326094 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-023e9ef8-1014-46fb-81a9-d6c402e13003 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:53:14.326508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-023e9ef8-1014-46fb-81a9-d6c402e13003 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:53:14.338461 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-023e9ef8-1014-46fb-81a9-d6c402e13003 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:14.339047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-023e9ef8-1014-46fb-81a9-d6c402e13003 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:14.339473 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-023e9ef8-1014-46fb-81a9-d6c402e13003 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:14.340221 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-023e9ef8-1014-46fb-81a9-d6c402e13003 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:14.340747 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-023e9ef8-1014-46fb-81a9-d6c402e13003 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:14.341397 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-023e9ef8-1014-46fb-81a9-d6c402e13003 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:14.355233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:53:14.374376 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-023e9ef8-1014-46fb-81a9-d6c402e13003 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Getting quotas for project 5d29b99a6bd9481f9042d9c7a9451c49. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:53:14.381727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-023e9ef8-1014-46fb-81a9-d6c402e13003 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Getting quotas for user 495973792ca942bca2c6f65d545346e9 and project 5d29b99a6bd9481f9042d9c7a9451c49. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:53:14.404833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-023e9ef8-1014-46fb-81a9-d6c402e13003 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:53:14.407955 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-023e9ef8-1014-46fb-81a9-d6c402e13003 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] [instance: b2b0fad5-5be4-433b-bd8e-f51c4c8de010] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:53:14.515577 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-023e9ef8-1014-46fb-81a9-d6c402e13003 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.008364 Sep 17 20:53:14.518141 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 369/675] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:53:12 2022] POST /compute/v2.1/servers => generated 407 bytes in 2011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:53:14.532063 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fbb576c7-def1-470a-8bd1-763449d2e9e7 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:14.536244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbb576c7-def1-470a-8bd1-763449d2e9e7 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:14.540611 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbb576c7-def1-470a-8bd1-763449d2e9e7 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:14.541764 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbb576c7-def1-470a-8bd1-763449d2e9e7 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:14.543442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbb576c7-def1-470a-8bd1-763449d2e9e7 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:14.544129 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbb576c7-def1-470a-8bd1-763449d2e9e7 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:14.546820 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbb576c7-def1-470a-8bd1-763449d2e9e7 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:14.631203 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fbb576c7-def1-470a-8bd1-763449d2e9e7 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.103422 Sep 17 20:53:14.636746 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 370/676] 10.222.0.26 () {60 vars in 1217 bytes} [Sat Sep 17 20:53:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:53:14.645877 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6d994edf-7e67-4120-9162-99a7899ee7ca tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:14.649285 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6d994edf-7e67-4120-9162-99a7899ee7ca tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:14.658506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6d994edf-7e67-4120-9162-99a7899ee7ca tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:14.661148 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6d994edf-7e67-4120-9162-99a7899ee7ca tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:14.665112 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6d994edf-7e67-4120-9162-99a7899ee7ca tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:14.668208 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6d994edf-7e67-4120-9162-99a7899ee7ca tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:14.668948 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6d994edf-7e67-4120-9162-99a7899ee7ca tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:14.672799 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6d994edf-7e67-4120-9162-99a7899ee7ca tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:15.185697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6d994edf-7e67-4120-9162-99a7899ee7ca tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:15.212407 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6d994edf-7e67-4120-9162-99a7899ee7ca tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1378 microversion: 2.1 time: 0.569001 Sep 17 20:53:15.213615 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 371/677] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:14 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1378 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:15.222399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-97af820c-92dd-42fc-b033-a0875036c93d tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:15.223025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-97af820c-92dd-42fc-b033-a0875036c93d tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:15.236798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97af820c-92dd-42fc-b033-a0875036c93d tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:15.239797 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97af820c-92dd-42fc-b033-a0875036c93d tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:15.240495 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97af820c-92dd-42fc-b033-a0875036c93d tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:15.242096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97af820c-92dd-42fc-b033-a0875036c93d tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:15.245257 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97af820c-92dd-42fc-b033-a0875036c93d tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:15.247865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97af820c-92dd-42fc-b033-a0875036c93d tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:15.528392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-97af820c-92dd-42fc-b033-a0875036c93d tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lazy-loading 'services' on Instance uuid 8ec574a4-de66-49f0-84bf-b7a1bc07eb91 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:53:15.590161 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-97af820c-92dd-42fc-b033-a0875036c93d tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1929 microversion: 2.75 time: 0.365304 Sep 17 20:53:15.590988 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 372/678] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:15 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1929 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:53:15.613382 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6958a688-5249-4e01-9bfd-4f194ad18109 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:15.614303 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6958a688-5249-4e01-9bfd-4f194ad18109 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] [instance: b2b0fad5-5be4-433b-bd8e-f51c4c8de010] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:15.627571 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6958a688-5249-4e01-9bfd-4f194ad18109 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:15.631217 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6958a688-5249-4e01-9bfd-4f194ad18109 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:15.631861 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6958a688-5249-4e01-9bfd-4f194ad18109 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:15.635798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6958a688-5249-4e01-9bfd-4f194ad18109 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:15.636445 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6958a688-5249-4e01-9bfd-4f194ad18109 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:15.637037 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6958a688-5249-4e01-9bfd-4f194ad18109 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:15.954595 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6958a688-5249-4e01-9bfd-4f194ad18109 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495973792ca942bca2c6f65d545346e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d29b99a6bd9481f9042d9c7a9451c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:15.962904 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6958a688-5249-4e01-9bfd-4f194ad18109 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] 10.222.0.26 "GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010" status: 200 len: 1271 microversion: 2.1 time: 0.370844 Sep 17 20:53:15.963483 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 373/679] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:15 2022] GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010 => generated 1271 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:16.002555 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f000184d-7db5-41ba-9db1-13c503bb2538 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:16.004222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f000184d-7db5-41ba-9db1-13c503bb2538 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:16.011147 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f000184d-7db5-41ba-9db1-13c503bb2538 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:16.011641 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f000184d-7db5-41ba-9db1-13c503bb2538 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:16.021237 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f000184d-7db5-41ba-9db1-13c503bb2538 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:16.022278 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f000184d-7db5-41ba-9db1-13c503bb2538 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:16.022935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f000184d-7db5-41ba-9db1-13c503bb2538 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:16.024094 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f000184d-7db5-41ba-9db1-13c503bb2538 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:16.167290 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f000184d-7db5-41ba-9db1-13c503bb2538 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2/action" status: 202 len: 0 microversion: 2.25 time: 0.180800 Sep 17 20:53:16.172212 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 374/680] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Sep 17 20:53:15 2022] POST /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:53:16.184071 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c898ae99-cf08-41b9-8e6c-3c0823c989b1 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:16.187306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c898ae99-cf08-41b9-8e6c-3c0823c989b1 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:16.204623 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c898ae99-cf08-41b9-8e6c-3c0823c989b1 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:16.205981 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c898ae99-cf08-41b9-8e6c-3c0823c989b1 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:16.223619 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c898ae99-cf08-41b9-8e6c-3c0823c989b1 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:16.228520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c898ae99-cf08-41b9-8e6c-3c0823c989b1 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:16.229241 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c898ae99-cf08-41b9-8e6c-3c0823c989b1 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:16.230069 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c898ae99-cf08-41b9-8e6c-3c0823c989b1 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:16.373482 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f452b61c-1d46-42f8-9a86-9a78f3b88ee6 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/e1a94874-ae07-420d-86f2-8eb8625db7d6" status: 202 len: 0 microversion: 2.1 time: 3.194548 Sep 17 20:53:16.374149 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 307/681] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Sep 17 20:53:13 2022] DELETE /compute/v2.1/os-floating-ips/e1a94874-ae07-420d-86f2-8eb8625db7d6 => generated 0 bytes in 3213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:53:16.382287 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-de5d1350-6d4c-4984-873e-d7bdbbf94d04 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:16.383012 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-de5d1350-6d4c-4984-873e-d7bdbbf94d04 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:16.396050 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de5d1350-6d4c-4984-873e-d7bdbbf94d04 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:16.396781 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de5d1350-6d4c-4984-873e-d7bdbbf94d04 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:16.397405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de5d1350-6d4c-4984-873e-d7bdbbf94d04 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:16.399396 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de5d1350-6d4c-4984-873e-d7bdbbf94d04 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:16.401053 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de5d1350-6d4c-4984-873e-d7bdbbf94d04 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:16.402282 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de5d1350-6d4c-4984-873e-d7bdbbf94d04 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:16.825716 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-de5d1350-6d4c-4984-873e-d7bdbbf94d04 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:16.842620 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-de5d1350-6d4c-4984-873e-d7bdbbf94d04 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1378 microversion: 2.1 time: 0.464016 Sep 17 20:53:16.851570 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 308/682] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:16 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1378 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:16.856881 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e860e48a-cb9f-4326-af35-3564669f96da tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Action: 'action', calling method: .version_select at 0x7f25a726fee0>, body: {"removeFloatingIp": {"address": "172.35.7.208"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:17.156517 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-c898ae99-cf08-41b9-8e6c-3c0823c989b1 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lazy-loading 'services' on Instance uuid 58d4b11c-eac7-4725-be0b-d10e4cf15bc2 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:53:17.185153 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c898ae99-cf08-41b9-8e6c-3c0823c989b1 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2" status: 200 len: 2054 microversion: 2.25 time: 1.011371 Sep 17 20:53:17.186689 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 375/683] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:16 2022] GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2 => generated 2054 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:53:17.191857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d6166901-8fe3-4dfc-a2a7-a67074449eb0 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:17.193140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d6166901-8fe3-4dfc-a2a7-a67074449eb0 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:17.201655 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d6166901-8fe3-4dfc-a2a7-a67074449eb0 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:17.202458 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d6166901-8fe3-4dfc-a2a7-a67074449eb0 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:17.203400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d6166901-8fe3-4dfc-a2a7-a67074449eb0 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:17.204425 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d6166901-8fe3-4dfc-a2a7-a67074449eb0 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:17.205097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d6166901-8fe3-4dfc-a2a7-a67074449eb0 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:17.205979 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d6166901-8fe3-4dfc-a2a7-a67074449eb0 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:17.220700 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e860e48a-cb9f-4326-af35-3564669f96da tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] [instance: 9d268239-a1b7-433b-a3f1-52e84ad59682] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:17.227465 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e860e48a-cb9f-4326-af35-3564669f96da tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:17.228223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e860e48a-cb9f-4326-af35-3564669f96da tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:17.229335 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e860e48a-cb9f-4326-af35-3564669f96da tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:17.231970 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e860e48a-cb9f-4326-af35-3564669f96da tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:17.232839 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e860e48a-cb9f-4326-af35-3564669f96da tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:17.235215 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e860e48a-cb9f-4326-af35-3564669f96da tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:17.432674 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-d6166901-8fe3-4dfc-a2a7-a67074449eb0 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lazy-loading 'services' on Instance uuid 8ec574a4-de66-49f0-84bf-b7a1bc07eb91 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:53:17.476496 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d6166901-8fe3-4dfc-a2a7-a67074449eb0 tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1929 microversion: 2.75 time: 0.288399 Sep 17 20:53:17.480132 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 376/684] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:17 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1929 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:53:17.493929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c920629f-cb67-41ea-abfe-cf4b23d29f50 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:17.494842 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c920629f-cb67-41ea-abfe-cf4b23d29f50 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] [instance: b2b0fad5-5be4-433b-bd8e-f51c4c8de010] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:17.510897 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c920629f-cb67-41ea-abfe-cf4b23d29f50 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:17.511673 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c920629f-cb67-41ea-abfe-cf4b23d29f50 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:17.513017 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c920629f-cb67-41ea-abfe-cf4b23d29f50 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:17.515373 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c920629f-cb67-41ea-abfe-cf4b23d29f50 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:17.516164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c920629f-cb67-41ea-abfe-cf4b23d29f50 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:17.516760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c920629f-cb67-41ea-abfe-cf4b23d29f50 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:18.034396 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c920629f-cb67-41ea-abfe-cf4b23d29f50 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495973792ca942bca2c6f65d545346e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d29b99a6bd9481f9042d9c7a9451c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:18.048707 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c920629f-cb67-41ea-abfe-cf4b23d29f50 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] 10.222.0.26 "GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010" status: 200 len: 1319 microversion: 2.1 time: 0.567176 Sep 17 20:53:18.052692 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 377/685] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:17 2022] GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010 => generated 1319 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:18.060979 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=10 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:53:18.073816 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cd284486-567f-4400-a4c2-f19475fcc320 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:18.074702 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cd284486-567f-4400-a4c2-f19475fcc320 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:18.098882 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd284486-567f-4400-a4c2-f19475fcc320 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:18.099390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd284486-567f-4400-a4c2-f19475fcc320 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:18.099820 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd284486-567f-4400-a4c2-f19475fcc320 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:18.100543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd284486-567f-4400-a4c2-f19475fcc320 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:18.100997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd284486-567f-4400-a4c2-f19475fcc320 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:18.101415 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd284486-567f-4400-a4c2-f19475fcc320 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:18.323970 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e860e48a-cb9f-4326-af35-3564669f96da tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "refresh_cache-9d268239-a1b7-433b-a3f1-52e84ad59682" {{(pid=140523) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 17 20:53:18.324597 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e860e48a-cb9f-4326-af35-3564669f96da tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquired lock "refresh_cache-9d268239-a1b7-433b-a3f1-52e84ad59682" {{(pid=140523) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 17 20:53:18.533812 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cd284486-567f-4400-a4c2-f19475fcc320 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:18.542974 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cd284486-567f-4400-a4c2-f19475fcc320 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1378 microversion: 2.1 time: 0.489191 Sep 17 20:53:18.547559 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 378/686] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:18 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1378 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:18.552294 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-b253493a-dd12-48cc-9eda-030a1ba1e0bc req-d14002a3-6c7b-454a-92e1-b5c9e4a3ba43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89b39b18-ff49-4810-9701-3084736ff2d0", "name": "network-vif-plugged", "status": "completed", "tag": "67dfcd54-a56f-4269-9ed0-edf035c918b0"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:18.585791 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b253493a-dd12-48cc-9eda-030a1ba1e0bc req-d14002a3-6c7b-454a-92e1-b5c9e4a3ba43 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:18.586283 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b253493a-dd12-48cc-9eda-030a1ba1e0bc req-d14002a3-6c7b-454a-92e1-b5c9e4a3ba43 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:18.586712 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b253493a-dd12-48cc-9eda-030a1ba1e0bc req-d14002a3-6c7b-454a-92e1-b5c9e4a3ba43 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:18.603848 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-b253493a-dd12-48cc-9eda-030a1ba1e0bc req-d14002a3-6c7b-454a-92e1-b5c9e4a3ba43 service nova] Creating event network-vif-plugged:67dfcd54-a56f-4269-9ed0-edf035c918b0 for instance 89b39b18-ff49-4810-9701-3084736ff2d0 on nch2-master-1 Sep 17 20:53:18.619426 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-b253493a-dd12-48cc-9eda-030a1ba1e0bc req-d14002a3-6c7b-454a-92e1-b5c9e4a3ba43 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070497 Sep 17 20:53:18.620454 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 379/687] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:53:18.625811 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8bfc2927-5c44-4508-8cf0-b840aac3d6be tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:18.628391 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8bfc2927-5c44-4508-8cf0-b840aac3d6be tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:18.646789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bfc2927-5c44-4508-8cf0-b840aac3d6be tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:18.646789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bfc2927-5c44-4508-8cf0-b840aac3d6be tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:18.647234 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bfc2927-5c44-4508-8cf0-b840aac3d6be tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:18.648323 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bfc2927-5c44-4508-8cf0-b840aac3d6be tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:18.648928 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bfc2927-5c44-4508-8cf0-b840aac3d6be tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:18.649524 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bfc2927-5c44-4508-8cf0-b840aac3d6be tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:19.570401 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-8bfc2927-5c44-4508-8cf0-b840aac3d6be tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lazy-loading 'services' on Instance uuid 58d4b11c-eac7-4725-be0b-d10e4cf15bc2 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:53:19.620697 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8bfc2927-5c44-4508-8cf0-b840aac3d6be tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2" status: 200 len: 2034 microversion: 2.25 time: 0.987201 Sep 17 20:53:19.621400 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 380/688] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:18 2022] GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2 => generated 2034 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:53:19.648322 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6f39d6e8-a06d-4a38-a0ef-ee0387e0f78f tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:19.648971 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6f39d6e8-a06d-4a38-a0ef-ee0387e0f78f tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:19.660589 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f39d6e8-a06d-4a38-a0ef-ee0387e0f78f tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:19.661105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f39d6e8-a06d-4a38-a0ef-ee0387e0f78f tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:19.670218 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f39d6e8-a06d-4a38-a0ef-ee0387e0f78f tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:19.671191 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f39d6e8-a06d-4a38-a0ef-ee0387e0f78f tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:19.671690 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f39d6e8-a06d-4a38-a0ef-ee0387e0f78f tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:19.672138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f39d6e8-a06d-4a38-a0ef-ee0387e0f78f tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:19.815657 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-6f39d6e8-a06d-4a38-a0ef-ee0387e0f78f tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lazy-loading 'services' on Instance uuid 8ec574a4-de66-49f0-84bf-b7a1bc07eb91 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:53:19.844366 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6f39d6e8-a06d-4a38-a0ef-ee0387e0f78f tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1929 microversion: 2.75 time: 0.221821 Sep 17 20:53:19.845280 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 381/689] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:19 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1929 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:53:19.851353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-458be6ad-9d8f-4cd0-9488-818a635fb74c tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:19.851974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-458be6ad-9d8f-4cd0-9488-818a635fb74c tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] [instance: b2b0fad5-5be4-433b-bd8e-f51c4c8de010] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:19.858135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-458be6ad-9d8f-4cd0-9488-818a635fb74c tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:19.858633 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-458be6ad-9d8f-4cd0-9488-818a635fb74c tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:19.859093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-458be6ad-9d8f-4cd0-9488-818a635fb74c tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:19.860109 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-458be6ad-9d8f-4cd0-9488-818a635fb74c tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:19.860851 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-458be6ad-9d8f-4cd0-9488-818a635fb74c tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:19.861289 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-458be6ad-9d8f-4cd0-9488-818a635fb74c tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:20.247689 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-458be6ad-9d8f-4cd0-9488-818a635fb74c tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495973792ca942bca2c6f65d545346e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d29b99a6bd9481f9042d9c7a9451c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:20.263701 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-458be6ad-9d8f-4cd0-9488-818a635fb74c tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] 10.222.0.26 "GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010" status: 200 len: 1393 microversion: 2.1 time: 0.417295 Sep 17 20:53:20.282853 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 382/690] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:19 2022] GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010 => generated 1393 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:20.289299 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-337e903c-6635-4aa1-af17-b5075ddfd9df tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:20.290837 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-337e903c-6635-4aa1-af17-b5075ddfd9df tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:20.300570 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-337e903c-6635-4aa1-af17-b5075ddfd9df tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:20.301508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-337e903c-6635-4aa1-af17-b5075ddfd9df tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:20.302210 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-337e903c-6635-4aa1-af17-b5075ddfd9df tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:20.307957 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-337e903c-6635-4aa1-af17-b5075ddfd9df tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:20.309523 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-337e903c-6635-4aa1-af17-b5075ddfd9df tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:20.312829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-337e903c-6635-4aa1-af17-b5075ddfd9df tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:20.603248 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-337e903c-6635-4aa1-af17-b5075ddfd9df tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:20.673970 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-337e903c-6635-4aa1-af17-b5075ddfd9df tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1378 microversion: 2.1 time: 0.389589 Sep 17 20:53:20.686265 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 383/691] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:20 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1378 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:20.700529 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3b30bbc2-14c8-4466-87bc-fa5b66e51752 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:20.704436 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3b30bbc2-14c8-4466-87bc-fa5b66e51752 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:20.711125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b30bbc2-14c8-4466-87bc-fa5b66e51752 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:20.711962 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b30bbc2-14c8-4466-87bc-fa5b66e51752 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:20.712668 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b30bbc2-14c8-4466-87bc-fa5b66e51752 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:20.713857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b30bbc2-14c8-4466-87bc-fa5b66e51752 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:20.714542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b30bbc2-14c8-4466-87bc-fa5b66e51752 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:20.715222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b30bbc2-14c8-4466-87bc-fa5b66e51752 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:20.741670 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-e860e48a-cb9f-4326-af35-3564669f96da tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] [instance: 9d268239-a1b7-433b-a3f1-52e84ad59682] Building network info cache for instance {{(pid=140523) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 17 20:53:20.833730 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-3b30bbc2-14c8-4466-87bc-fa5b66e51752 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lazy-loading 'flavor' on Instance uuid 58d4b11c-eac7-4725-be0b-d10e4cf15bc2 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:53:20.870240 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3b30bbc2-14c8-4466-87bc-fa5b66e51752 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] Going to try to live migrate instance to nch2-master-1 {{(pid=140524) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 17 20:53:20.874631 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:53:22.487383 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-e860e48a-cb9f-4326-af35-3564669f96da tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] [instance: 9d268239-a1b7-433b-a3f1-52e84ad59682] Updating instance_info_cache with network_info: [{"id": "a1936332-9c49-496c-a1d8-d378ab79c8ff", "address": "fa:16:3e:f1:18:18", "network": {"id": "9972ca70-5471-447a-8a92-6cfeb739a36b", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1790851012-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e566b2c69fec4ec784a13e4034eaef72", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapa1936332-9c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140523) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 17 20:53:22.531126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e860e48a-cb9f-4326-af35-3564669f96da tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Releasing lock "refresh_cache-9d268239-a1b7-433b-a3f1-52e84ad59682" {{(pid=140523) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 17 20:53:22.532066 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e860e48a-cb9f-4326-af35-3564669f96da tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] 10.222.0.26 "POST /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682/action" status: 202 len: 0 microversion: 2.1 time: 5.679158 Sep 17 20:53:22.532732 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 309/692] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:53:16 2022] POST /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682/action => generated 0 bytes in 5680 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 17 20:53:22.570204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-54125d22-4162-4033-a048-58a904ae1545 req-93fba885-8aa2-4bf7-a6ed-2f2b8c6f75a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d268239-a1b7-433b-a3f1-52e84ad59682", "tag": "a1936332-9c49-496c-a1d8-d378ab79c8ff"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:22.609126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-54125d22-4162-4033-a048-58a904ae1545 req-93fba885-8aa2-4bf7-a6ed-2f2b8c6f75a9 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:22.617970 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-54125d22-4162-4033-a048-58a904ae1545 req-93fba885-8aa2-4bf7-a6ed-2f2b8c6f75a9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:22.618567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-54125d22-4162-4033-a048-58a904ae1545 req-93fba885-8aa2-4bf7-a6ed-2f2b8c6f75a9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:22.648403 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-54125d22-4162-4033-a048-58a904ae1545 req-93fba885-8aa2-4bf7-a6ed-2f2b8c6f75a9 service nova] Creating event network-changed:a1936332-9c49-496c-a1d8-d378ab79c8ff for instance 9d268239-a1b7-433b-a3f1-52e84ad59682 on nch1-master-1 Sep 17 20:53:22.682070 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-54125d22-4162-4033-a048-58a904ae1545 req-93fba885-8aa2-4bf7-a6ed-2f2b8c6f75a9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121018 Sep 17 20:53:22.683166 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 310/693] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:53:22.697305 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9b4dbffd-aade-4ed6-a566-0fda964c8baa tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:22.698342 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9b4dbffd-aade-4ed6-a566-0fda964c8baa tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:22.713829 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b4dbffd-aade-4ed6-a566-0fda964c8baa tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:22.714335 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b4dbffd-aade-4ed6-a566-0fda964c8baa tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:22.714915 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b4dbffd-aade-4ed6-a566-0fda964c8baa tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:22.715833 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b4dbffd-aade-4ed6-a566-0fda964c8baa tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:22.716303 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b4dbffd-aade-4ed6-a566-0fda964c8baa tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:22.716732 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b4dbffd-aade-4ed6-a566-0fda964c8baa tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:22.882625 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-9b4dbffd-aade-4ed6-a566-0fda964c8baa tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] Lazy-loading 'services' on Instance uuid 8ec574a4-de66-49f0-84bf-b7a1bc07eb91 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:53:22.918850 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9b4dbffd-aade-4ed6-a566-0fda964c8baa tempest-ServersAdmin275Test-27308624 tempest-ServersAdmin275Test-27308624-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1920 microversion: 2.75 time: 0.234179 Sep 17 20:53:22.930666 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 311/694] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:22 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1920 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:53:22.935854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-d6373fdb-b899-4fdd-b11b-063318cf34c7 req-d7310cec-343a-4d99-ae3b-0ddfdcd2c45f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2b0fad5-5be4-433b-bd8e-f51c4c8de010", "tag": "d84a1ac3-3c9c-4bd7-8638-7d28ec39e2b8"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:22.957774 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d6373fdb-b899-4fdd-b11b-063318cf34c7 req-d7310cec-343a-4d99-ae3b-0ddfdcd2c45f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:22.958513 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d6373fdb-b899-4fdd-b11b-063318cf34c7 req-d7310cec-343a-4d99-ae3b-0ddfdcd2c45f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:22.958948 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d6373fdb-b899-4fdd-b11b-063318cf34c7 req-d7310cec-343a-4d99-ae3b-0ddfdcd2c45f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:22.978859 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-d6373fdb-b899-4fdd-b11b-063318cf34c7 req-d7310cec-343a-4d99-ae3b-0ddfdcd2c45f service nova] Creating event network-changed:d84a1ac3-3c9c-4bd7-8638-7d28ec39e2b8 for instance b2b0fad5-5be4-433b-bd8e-f51c4c8de010 on nch1-master-1 Sep 17 20:53:22.990454 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-d6373fdb-b899-4fdd-b11b-063318cf34c7 req-d7310cec-343a-4d99-ae3b-0ddfdcd2c45f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058167 Sep 17 20:53:22.995638 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 312/695] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:53:23.005328 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f8bfe4f5-75ea-4e49-bfd4-9265ce04d53b tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:23.013271 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f8bfe4f5-75ea-4e49-bfd4-9265ce04d53b tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] [instance: b2b0fad5-5be4-433b-bd8e-f51c4c8de010] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:23.019976 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8bfe4f5-75ea-4e49-bfd4-9265ce04d53b tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:23.029270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8bfe4f5-75ea-4e49-bfd4-9265ce04d53b tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:23.029763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8bfe4f5-75ea-4e49-bfd4-9265ce04d53b tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:23.030536 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8bfe4f5-75ea-4e49-bfd4-9265ce04d53b tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:23.030999 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8bfe4f5-75ea-4e49-bfd4-9265ce04d53b tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:23.031428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8bfe4f5-75ea-4e49-bfd4-9265ce04d53b tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:23.301174 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f8bfe4f5-75ea-4e49-bfd4-9265ce04d53b tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495973792ca942bca2c6f65d545346e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d29b99a6bd9481f9042d9c7a9451c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:23.310935 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f8bfe4f5-75ea-4e49-bfd4-9265ce04d53b tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] 10.222.0.26 "GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010" status: 200 len: 1393 microversion: 2.1 time: 0.313838 Sep 17 20:53:23.330056 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 313/696] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:22 2022] GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010 => generated 1393 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:23.342319 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4c968e8d-7e8b-46e9-b1ff-8df413faaec0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:23.344318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4c968e8d-7e8b-46e9-b1ff-8df413faaec0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:23.357777 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c968e8d-7e8b-46e9-b1ff-8df413faaec0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:23.358623 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c968e8d-7e8b-46e9-b1ff-8df413faaec0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:23.359387 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c968e8d-7e8b-46e9-b1ff-8df413faaec0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:23.360308 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c968e8d-7e8b-46e9-b1ff-8df413faaec0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:23.360936 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c968e8d-7e8b-46e9-b1ff-8df413faaec0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:23.361554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c968e8d-7e8b-46e9-b1ff-8df413faaec0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:23.395793 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3b30bbc2-14c8-4466-87bc-fa5b66e51752 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2/action" status: 202 len: 0 microversion: 2.25 time: 2.704858 Sep 17 20:53:23.399724 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 384/697] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Sep 17 20:53:20 2022] POST /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2/action => generated 0 bytes in 2709 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:53:23.405239 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-159caa5e-cc95-43e3-a4a5-2b4a735b4d5f tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Calling method '.version_select at 0x7f25a5838f70>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:23.801528 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4c968e8d-7e8b-46e9-b1ff-8df413faaec0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:23.810737 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4c968e8d-7e8b-46e9-b1ff-8df413faaec0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1528 microversion: 2.1 time: 0.479117 Sep 17 20:53:23.836488 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 314/698] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:23 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1528 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:23.841699 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7fb65345-7e82-49c5-9067-a3e3b9ccde37 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:23.846895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7fb65345-7e82-49c5-9067-a3e3b9ccde37 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:23.865437 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7fb65345-7e82-49c5-9067-a3e3b9ccde37 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:23.866464 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7fb65345-7e82-49c5-9067-a3e3b9ccde37 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:23.866981 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7fb65345-7e82-49c5-9067-a3e3b9ccde37 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:23.867769 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7fb65345-7e82-49c5-9067-a3e3b9ccde37 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:23.871295 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7fb65345-7e82-49c5-9067-a3e3b9ccde37 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:23.871755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7fb65345-7e82-49c5-9067-a3e3b9ccde37 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:23.926216 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7fb65345-7e82-49c5-9067-a3e3b9ccde37 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:53:24.034157 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:53:24.089689 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7fb65345-7e82-49c5-9067-a3e3b9ccde37 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 204 len: 0 microversion: 2.75 time: 0.251267 Sep 17 20:53:24.091241 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 315/699] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 17 20:53:23 2022] DELETE /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 20:53:24.098973 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-be64165a-191d-4e95-9fd6-f754fc03e5d4 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:24.101320 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-be64165a-191d-4e95-9fd6-f754fc03e5d4 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:24.126413 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be64165a-191d-4e95-9fd6-f754fc03e5d4 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:24.127298 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be64165a-191d-4e95-9fd6-f754fc03e5d4 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:24.127949 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be64165a-191d-4e95-9fd6-f754fc03e5d4 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:24.128920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be64165a-191d-4e95-9fd6-f754fc03e5d4 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:24.129609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be64165a-191d-4e95-9fd6-f754fc03e5d4 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:24.130859 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be64165a-191d-4e95-9fd6-f754fc03e5d4 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:24.395645 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=10 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:53:24.508012 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-be64165a-191d-4e95-9fd6-f754fc03e5d4 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:24.523929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-be64165a-191d-4e95-9fd6-f754fc03e5d4 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:24.531568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-be64165a-191d-4e95-9fd6-f754fc03e5d4 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:24.533312 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-be64165a-191d-4e95-9fd6-f754fc03e5d4 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2" status: 200 len: 1567 microversion: 2.25 time: 0.440037 Sep 17 20:53:24.550094 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 316/700] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:24 2022] GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2 => generated 1567 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:53:24.564313 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f8200a47-808f-4424-b773-fd6c7e39682c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:24.565426 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f8200a47-808f-4424-b773-fd6c7e39682c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:24.574070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=4 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:53:24.577446 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8200a47-808f-4424-b773-fd6c7e39682c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:24.579577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8200a47-808f-4424-b773-fd6c7e39682c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:24.579577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8200a47-808f-4424-b773-fd6c7e39682c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:24.581137 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8200a47-808f-4424-b773-fd6c7e39682c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:24.581925 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8200a47-808f-4424-b773-fd6c7e39682c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:24.583230 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8200a47-808f-4424-b773-fd6c7e39682c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:24.965347 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f8200a47-808f-4424-b773-fd6c7e39682c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:24.978235 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f8200a47-808f-4424-b773-fd6c7e39682c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1528 microversion: 2.1 time: 0.423603 Sep 17 20:53:24.979401 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 317/701] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:24 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1528 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:24.989276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e9871227-a4c5-4821-a8a2-86e32bd7641b tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:24.990233 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e9871227-a4c5-4821-a8a2-86e32bd7641b tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:24.999325 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9871227-a4c5-4821-a8a2-86e32bd7641b tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:25.000090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9871227-a4c5-4821-a8a2-86e32bd7641b tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:25.000681 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9871227-a4c5-4821-a8a2-86e32bd7641b tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:25.001629 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9871227-a4c5-4821-a8a2-86e32bd7641b tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:25.002267 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9871227-a4c5-4821-a8a2-86e32bd7641b tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:25.002697 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9871227-a4c5-4821-a8a2-86e32bd7641b tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:25.162234 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e9871227-a4c5-4821-a8a2-86e32bd7641b tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:25.176269 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e9871227-a4c5-4821-a8a2-86e32bd7641b tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:25.179263 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e9871227-a4c5-4821-a8a2-86e32bd7641b tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:25.195686 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e9871227-a4c5-4821-a8a2-86e32bd7641b tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1444 microversion: 2.75 time: 0.210454 Sep 17 20:53:25.196275 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 318/702] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:24 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1444 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:53:25.205044 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-322b54a4-eadc-4f46-8179-8dcd649771d0 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:25.205845 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-322b54a4-eadc-4f46-8179-8dcd649771d0 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] [instance: b2b0fad5-5be4-433b-bd8e-f51c4c8de010] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:25.220217 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-322b54a4-eadc-4f46-8179-8dcd649771d0 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:25.221032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-322b54a4-eadc-4f46-8179-8dcd649771d0 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:25.225165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-322b54a4-eadc-4f46-8179-8dcd649771d0 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:25.225615 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-322b54a4-eadc-4f46-8179-8dcd649771d0 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:25.226284 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-322b54a4-eadc-4f46-8179-8dcd649771d0 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:25.226881 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-322b54a4-eadc-4f46-8179-8dcd649771d0 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:25.703100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-322b54a4-eadc-4f46-8179-8dcd649771d0 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495973792ca942bca2c6f65d545346e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d29b99a6bd9481f9042d9c7a9451c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:25.713244 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-322b54a4-eadc-4f46-8179-8dcd649771d0 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] 10.222.0.26 "GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010" status: 200 len: 1393 microversion: 2.1 time: 0.515665 Sep 17 20:53:25.713989 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 319/703] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:25 2022] GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010 => generated 1393 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:25.727978 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5ba53343-8d93-4089-ad55-b9f9fa0aa725 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:25.728797 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5ba53343-8d93-4089-ad55-b9f9fa0aa725 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:25.737810 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ba53343-8d93-4089-ad55-b9f9fa0aa725 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:25.740849 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ba53343-8d93-4089-ad55-b9f9fa0aa725 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:25.746678 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ba53343-8d93-4089-ad55-b9f9fa0aa725 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:25.747651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ba53343-8d93-4089-ad55-b9f9fa0aa725 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:25.748140 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ba53343-8d93-4089-ad55-b9f9fa0aa725 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:25.748634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ba53343-8d93-4089-ad55-b9f9fa0aa725 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:25.755277 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-159caa5e-cc95-43e3-a4a5-2b4a735b4d5f tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/39bfc8bd-953c-4166-a9f4-cd9b5b106cd4" status: 202 len: 0 microversion: 2.1 time: 2.354268 Sep 17 20:53:25.756869 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 385/704] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Sep 17 20:53:23 2022] DELETE /compute/v2.1/os-floating-ips/39bfc8bd-953c-4166-a9f4-cd9b5b106cd4 => generated 0 bytes in 2356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:53:25.765138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3294e16d-73ef-4499-8c06-9b8413b2f8fc tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:25.823924 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3294e16d-73ef-4499-8c06-9b8413b2f8fc tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/e11eb69d-0e08-4e83-bc39-5671aae60bd2" status: 202 len: 0 microversion: 2.1 time: 0.065650 Sep 17 20:53:25.824529 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 386/705] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:53:25 2022] DELETE /compute/v2.1/flavors/e11eb69d-0e08-4e83-bc39-5671aae60bd2 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:53:25.838314 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b99fbcec-2520-4f9e-9999-8e3a0ae56c7f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:25.855072 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5ba53343-8d93-4089-ad55-b9f9fa0aa725 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:53:25.855335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b99fbcec-2520-4f9e-9999-8e3a0ae56c7f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:25.883862 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b99fbcec-2520-4f9e-9999-8e3a0ae56c7f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:25.884372 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b99fbcec-2520-4f9e-9999-8e3a0ae56c7f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:25.885206 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b99fbcec-2520-4f9e-9999-8e3a0ae56c7f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:25.893268 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b99fbcec-2520-4f9e-9999-8e3a0ae56c7f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:25.893985 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b99fbcec-2520-4f9e-9999-8e3a0ae56c7f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:25.894440 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b99fbcec-2520-4f9e-9999-8e3a0ae56c7f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:26.076266 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5ba53343-8d93-4089-ad55-b9f9fa0aa725 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7" status: 204 len: 0 microversion: 2.1 time: 0.351887 Sep 17 20:53:26.086054 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 320/706] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:53:25 2022] DELETE /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:53:26.091819 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d8be6578-9e24-4965-9840-73f504ad4aa5 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d8be6578-9e24-4965-9840-73f504ad4aa5 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Request method failure captured: Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682/action HTTP/1.1 Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 34 Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjOPTD5bVc5vw9S8U7S39ahSkUdLqYrEohQkTER8XyECLPOX8-Wzl3iM3e2fdoLvu2gM1MBw_jDVBCemrcXZjMYyfCtmYMgnqW4J2izXawiy9GAW8TRFepKi0Y7eI1o8mHaGZHoKccTsemQx4JJOQzVrtnY-yAMe0XWWBK3NkT6ELJk Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: e566b2c69fec4ec784a13e4034eaef72 Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-291838535 Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e566b2c69fec4ec784a13e4034eaef72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e566b2c69fec4ec784a13e4034eaef72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e566b2c69fec4ec784a13e4034eaef72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e566b2c69fec4ec784a13e4034eaef72", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-291838535 Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: e566b2c69fec4ec784a13e4034eaef72 Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-291838535 Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: feb0a86572434db48c987279d67cd4e0 Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: {"addFloatingIp": {"address": ""}} Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '9d268239-a1b7-433b-a3f1-52e84ad59682', 'body': {'addFloatingIp': {'address': ''}}} Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise error Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi '' Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 20:53:26.114629 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 20:53:26.122647 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 20:53:26.122647 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 17 20:53:26.122647 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:53:26.122647 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:53:26.122647 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:53:26.122647 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:53:26.122647 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:53:26.122647 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:53:26.122647 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 20:53:26.122647 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 20:53:26.122647 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 17 20:53:26.122647 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:53:26.130864 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d8be6578-9e24-4965-9840-73f504ad4aa5 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:53:26.132048 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d8be6578-9e24-4965-9840-73f504ad4aa5 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] 10.222.0.26 "POST /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682/action" status: 400 len: 142 microversion: 2.1 time: 0.044685 Sep 17 20:53:26.132841 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 321/707] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:53:26 2022] POST /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682/action => generated 142 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 20:53:26.152135 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5e8efc23-836e-4b25-a88f-fce176def06c tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:26.211590 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5e8efc23-836e-4b25-a88f-fce176def06c tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5817 microversion: 2.1 time: 0.057457 Sep 17 20:53:26.227438 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 322/708] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:53:26 2022] GET /compute/v2.1/flavors/detail => generated 5817 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:26.227438 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7bb4ae85-46ab-41e7-af63-26f370b65be6 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:26.227438 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7bb4ae85-46ab-41e7-af63-26f370b65be6 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] [instance: 9d268239-a1b7-433b-a3f1-52e84ad59682] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:26.272755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:53:26.292271 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7bb4ae85-46ab-41e7-af63-26f370b65be6 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:26.293174 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7bb4ae85-46ab-41e7-af63-26f370b65be6 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:26.293941 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7bb4ae85-46ab-41e7-af63-26f370b65be6 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:26.296762 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7bb4ae85-46ab-41e7-af63-26f370b65be6 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:26.297721 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7bb4ae85-46ab-41e7-af63-26f370b65be6 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:26.299298 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7bb4ae85-46ab-41e7-af63-26f370b65be6 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:26.377939 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7bb4ae85-46ab-41e7-af63-26f370b65be6 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "refresh_cache-9d268239-a1b7-433b-a3f1-52e84ad59682" {{(pid=140523) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 17 20:53:26.378624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7bb4ae85-46ab-41e7-af63-26f370b65be6 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquired lock "refresh_cache-9d268239-a1b7-433b-a3f1-52e84ad59682" {{(pid=140523) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 17 20:53:26.639699 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b99fbcec-2520-4f9e-9999-8e3a0ae56c7f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:26.653300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b99fbcec-2520-4f9e-9999-8e3a0ae56c7f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:26.656030 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b99fbcec-2520-4f9e-9999-8e3a0ae56c7f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:26.663009 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b99fbcec-2520-4f9e-9999-8e3a0ae56c7f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2" status: 200 len: 1567 microversion: 2.25 time: 0.837434 Sep 17 20:53:26.663911 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 387/709] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:25 2022] GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2 => generated 1567 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:53:26.758001 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7bb4ae85-46ab-41e7-af63-26f370b65be6 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Releasing lock "refresh_cache-9d268239-a1b7-433b-a3f1-52e84ad59682" {{(pid=140523) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 17 20:53:26.758933 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-7bb4ae85-46ab-41e7-af63-26f370b65be6 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] HTTP exception thrown: floating IP not found Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7bb4ae85-46ab-41e7-af63-26f370b65be6 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Request method failure captured: Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682/action HTTP/1.1 Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 41 Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjOPTD5bVc5vw9S8U7S39ahSkUdLqYrEohQkTER8XyECLPOX8-Wzl3iM3e2fdoLvu2gM1MBw_jDVBCemrcXZjMYyfCtmYMgnqW4J2izXawiy9GAW8TRFepKi0Y7eI1o8mHaGZHoKccTsemQx4JJOQzVrtnY-yAMe0XWWBK3NkT6ELJk Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: e566b2c69fec4ec784a13e4034eaef72 Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-291838535 Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e566b2c69fec4ec784a13e4034eaef72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e566b2c69fec4ec784a13e4034eaef72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e566b2c69fec4ec784a13e4034eaef72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e566b2c69fec4ec784a13e4034eaef72", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-291838535 Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: e566b2c69fec4ec784a13e4034eaef72 Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-291838535 Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: feb0a86572434db48c987279d67cd4e0 Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: {"addFloatingIp": {"address": "0.0.0.0"}} Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: exception: floating IP not found Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '9d268239-a1b7-433b-a3f1-52e84ad59682', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Sep 17 20:53:26.760807 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:53:26.765847 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:53:26.765847 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:53:26.765847 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:53:26.765847 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:53:26.765847 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:53:26.765847 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:53:26.765847 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:53:26.765847 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Sep 17 20:53:26.765847 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:53:26.767436 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7bb4ae85-46ab-41e7-af63-26f370b65be6 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Returning 404 to user: floating IP not found {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:53:26.768505 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7bb4ae85-46ab-41e7-af63-26f370b65be6 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] 10.222.0.26 "POST /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682/action" status: 404 len: 67 microversion: 2.1 time: 0.552702 Sep 17 20:53:26.775745 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 323/710] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:53:26 2022] POST /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682/action => generated 67 bytes in 560 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 20:53:26.785683 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-da941566-571b-4c0f-87ae-6f4aa8401b96 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:26.786954 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-da941566-571b-4c0f-87ae-6f4aa8401b96 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:26.800441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da941566-571b-4c0f-87ae-6f4aa8401b96 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:26.803943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da941566-571b-4c0f-87ae-6f4aa8401b96 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:26.804680 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da941566-571b-4c0f-87ae-6f4aa8401b96 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:26.805679 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da941566-571b-4c0f-87ae-6f4aa8401b96 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:26.810637 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da941566-571b-4c0f-87ae-6f4aa8401b96 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:26.811657 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da941566-571b-4c0f-87ae-6f4aa8401b96 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:26.880972 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da941566-571b-4c0f-87ae-6f4aa8401b96 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:26.885094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da941566-571b-4c0f-87ae-6f4aa8401b96 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:26.885722 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da941566-571b-4c0f-87ae-6f4aa8401b96 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:26.887524 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-da941566-571b-4c0f-87ae-6f4aa8401b96 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lazy-loading 'fault' on Instance uuid 8ec574a4-de66-49f0-84bf-b7a1bc07eb91 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:53:26.929070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-701193ae-0437-4034-a027-f293d1a83858 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1082453554", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "eb85edb1-9d13-4b48-a02b-116c5b437767"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:26.978229 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-da941566-571b-4c0f-87ae-6f4aa8401b96 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:26.992692 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-da941566-571b-4c0f-87ae-6f4aa8401b96 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:26.995084 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-da941566-571b-4c0f-87ae-6f4aa8401b96 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a38f77df31e648f99763a2f785b6fb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ead9bed9640a88ca01af3a10626c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:27.007737 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-da941566-571b-4c0f-87ae-6f4aa8401b96 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 200 len: 1449 microversion: 2.75 time: 0.230062 Sep 17 20:53:27.023233 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 324/711] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:26 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 1449 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:53:27.035740 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bc2cd5cc-61a6-4707-a7ba-30227a44fe1d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:27.042054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bc2cd5cc-61a6-4707-a7ba-30227a44fe1d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:27.053415 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-701193ae-0437-4034-a027-f293d1a83858 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] validate_networks() for [('eb85edb1-9d13-4b48-a02b-116c5b437767', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:53:27.058426 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bc2cd5cc-61a6-4707-a7ba-30227a44fe1d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:27.059680 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bc2cd5cc-61a6-4707-a7ba-30227a44fe1d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:27.060420 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bc2cd5cc-61a6-4707-a7ba-30227a44fe1d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:27.061513 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bc2cd5cc-61a6-4707-a7ba-30227a44fe1d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:27.062365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bc2cd5cc-61a6-4707-a7ba-30227a44fe1d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:27.063022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bc2cd5cc-61a6-4707-a7ba-30227a44fe1d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:27.102479 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bc2cd5cc-61a6-4707-a7ba-30227a44fe1d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:27.112351 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bc2cd5cc-61a6-4707-a7ba-30227a44fe1d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Old instance type tempest-test_resize_flavor_-643263057, new instance type m1.heat {{(pid=140523) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 17 20:53:27.124076 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-bc2cd5cc-61a6-4707-a7ba-30227a44fe1d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:53:27.125035 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-bc2cd5cc-61a6-4707-a7ba-30227a44fe1d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:53:27.126301 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-bc2cd5cc-61a6-4707-a7ba-30227a44fe1d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:53:27.128055 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-bc2cd5cc-61a6-4707-a7ba-30227a44fe1d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:53:27.128730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-bc2cd5cc-61a6-4707-a7ba-30227a44fe1d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:53:27.228825 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bc2cd5cc-61a6-4707-a7ba-30227a44fe1d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "POST /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0/action" status: 202 len: 0 microversion: 2.1 time: 0.201763 Sep 17 20:53:27.232717 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 325/712] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:53:27 2022] POST /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:53:27.235628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dd49cc60-0c13-4e6a-a0e0-56671c079fdf tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1728956635", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "1073285898", "adminPass": "***", "networks": [{"uuid": "0282db1b-1740-4d35-9ade-d2fa2c594978"}], "security_groups": [{"name": "tempest-securitygroup--1064954919"}], "key_name": "tempest-keypair-714475675", "user_data": "}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:27.443772 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-dd49cc60-0c13-4e6a-a0e0-56671c079fdf tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] validate_networks() for [('0282db1b-1740-4d35-9ade-d2fa2c594978', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:53:29.638613 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-dd49cc60-0c13-4e6a-a0e0-56671c079fdf tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:53:29.640198 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-dd49cc60-0c13-4e6a-a0e0-56671c079fdf tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:53:29.640895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-dd49cc60-0c13-4e6a-a0e0-56671c079fdf tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:53:29.641533 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-dd49cc60-0c13-4e6a-a0e0-56671c079fdf tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:53:29.642232 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-dd49cc60-0c13-4e6a-a0e0-56671c079fdf tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:53:29.697397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd49cc60-0c13-4e6a-a0e0-56671c079fdf tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:29.699541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd49cc60-0c13-4e6a-a0e0-56671c079fdf tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:29.703249 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd49cc60-0c13-4e6a-a0e0-56671c079fdf tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:29.708028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd49cc60-0c13-4e6a-a0e0-56671c079fdf tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:29.709026 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd49cc60-0c13-4e6a-a0e0-56671c079fdf tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:29.713872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd49cc60-0c13-4e6a-a0e0-56671c079fdf tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:29.793006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-dd49cc60-0c13-4e6a-a0e0-56671c079fdf tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Getting quotas for project 1f305d163acf499c9808c5f11150a7cf. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:53:29.800186 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-dd49cc60-0c13-4e6a-a0e0-56671c079fdf tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Getting quotas for user 42f7c0fdad9346c58949928300021b07 and project 1f305d163acf499c9808c5f11150a7cf. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:53:29.822827 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dd49cc60-0c13-4e6a-a0e0-56671c079fdf tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:53:29.822827 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dd49cc60-0c13-4e6a-a0e0-56671c079fdf tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: a9ab9592-fc9c-4ec4-bf25-6ffb49440f25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:53:29.844507 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-701193ae-0437-4034-a027-f293d1a83858 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:53:29.846499 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-701193ae-0437-4034-a027-f293d1a83858 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:53:29.847199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-701193ae-0437-4034-a027-f293d1a83858 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:53:29.847886 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-701193ae-0437-4034-a027-f293d1a83858 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:53:29.848531 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-701193ae-0437-4034-a027-f293d1a83858 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:53:29.863897 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-701193ae-0437-4034-a027-f293d1a83858 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:29.864758 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-701193ae-0437-4034-a027-f293d1a83858 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:29.865365 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-701193ae-0437-4034-a027-f293d1a83858 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:29.868933 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-701193ae-0437-4034-a027-f293d1a83858 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:29.869894 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-701193ae-0437-4034-a027-f293d1a83858 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:29.870908 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-701193ae-0437-4034-a027-f293d1a83858 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:29.910618 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-701193ae-0437-4034-a027-f293d1a83858 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Getting quotas for project f6b44bc44e7c4a998bfd99e7d11e99fc. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:53:29.916471 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-701193ae-0437-4034-a027-f293d1a83858 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Getting quotas for user 9c2b746b7c194596808a7b0c736f3b53 and project f6b44bc44e7c4a998bfd99e7d11e99fc. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:53:29.962445 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-701193ae-0437-4034-a027-f293d1a83858 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:53:29.984256 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-701193ae-0437-4034-a027-f293d1a83858 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:53:29.994549 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dd49cc60-0c13-4e6a-a0e0-56671c079fdf tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.763130 Sep 17 20:53:29.996551 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 326/713] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:53:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 2766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:53:30.011278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8972e926-bd1a-4842-b9a3-e37ad2fc5a37 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:30.012154 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8972e926-bd1a-4842-b9a3-e37ad2fc5a37 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] [instance: b2b0fad5-5be4-433b-bd8e-f51c4c8de010] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:30.032246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8972e926-bd1a-4842-b9a3-e37ad2fc5a37 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:30.032781 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8972e926-bd1a-4842-b9a3-e37ad2fc5a37 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:30.034398 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8972e926-bd1a-4842-b9a3-e37ad2fc5a37 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:30.037024 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8972e926-bd1a-4842-b9a3-e37ad2fc5a37 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:30.037535 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8972e926-bd1a-4842-b9a3-e37ad2fc5a37 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:30.039283 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8972e926-bd1a-4842-b9a3-e37ad2fc5a37 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:30.223249 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-701193ae-0437-4034-a027-f293d1a83858 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.558117 Sep 17 20:53:30.231975 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 388/714] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:53:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 3567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:53:30.246266 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-707f3cdc-5107-429f-99a0-3377e2c120c9 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Action: 'action', calling method: .version_select at 0x7f25a7232d30>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:30.463942 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-707f3cdc-5107-429f-99a0-3377e2c120c9 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-707f3cdc-5107-429f-99a0-3377e2c120c9 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Request method failure captured: Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682/action HTTP/1.1 Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 44 Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjOPTD5bVc5vw9S8U7S39ahSkUdLqYrEohQkTER8XyECLPOX8-Wzl3iM3e2fdoLvu2gM1MBw_jDVBCemrcXZjMYyfCtmYMgnqW4J2izXawiy9GAW8TRFepKi0Y7eI1o8mHaGZHoKccTsemQx4JJOQzVrtnY-yAMe0XWWBK3NkT6ELJk Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: e566b2c69fec4ec784a13e4034eaef72 Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-291838535 Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e566b2c69fec4ec784a13e4034eaef72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e566b2c69fec4ec784a13e4034eaef72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e566b2c69fec4ec784a13e4034eaef72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e566b2c69fec4ec784a13e4034eaef72", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-291838535 Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: e566b2c69fec4ec784a13e4034eaef72 Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-291838535 Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: feb0a86572434db48c987279d67cd4e0 Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: {"removeFloatingIp": {"address": "0.0.0.0"}} Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: exception: Floating IP not found for address 0.0.0.0. Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '9d268239-a1b7-433b-a3f1-52e84ad59682', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Sep 17 20:53:30.467357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Sep 17 20:53:30.472009 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Sep 17 20:53:30.472009 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:53:30.472009 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:53:30.472009 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:53:30.472009 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:53:30.472009 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:53:30.472009 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:53:30.472009 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:53:30.472009 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:53:30.472009 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Sep 17 20:53:30.472009 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:53:30.476971 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-707f3cdc-5107-429f-99a0-3377e2c120c9 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:53:30.478523 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-707f3cdc-5107-429f-99a0-3377e2c120c9 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] 10.222.0.26 "POST /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682/action" status: 404 len: 88 microversion: 2.1 time: 0.244790 Sep 17 20:53:30.479482 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 389/715] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:53:30 2022] POST /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682/action => generated 88 bytes in 246 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 20:53:30.496903 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-304dd570-2009-4bf6-8b04-efc244a61316 req-d3691003-cb00-4241-aab0-54e4cf38d050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58d4b11c-eac7-4725-be0b-d10e4cf15bc2", "name": "network-vif-unplugged", "status": "completed", "tag": "fb8fa2f7-3a6c-4af8-bb7a-8e20186076a7"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:30.517858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:53:30.523085 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-304dd570-2009-4bf6-8b04-efc244a61316 req-d3691003-cb00-4241-aab0-54e4cf38d050 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:30.526735 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-304dd570-2009-4bf6-8b04-efc244a61316 req-d3691003-cb00-4241-aab0-54e4cf38d050 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:30.527375 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-304dd570-2009-4bf6-8b04-efc244a61316 req-d3691003-cb00-4241-aab0-54e4cf38d050 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:30.570089 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-304dd570-2009-4bf6-8b04-efc244a61316 req-d3691003-cb00-4241-aab0-54e4cf38d050 service nova] Creating event network-vif-unplugged:fb8fa2f7-3a6c-4af8-bb7a-8e20186076a7 for instance 58d4b11c-eac7-4725-be0b-d10e4cf15bc2 on nch1-master-1 Sep 17 20:53:30.600455 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-304dd570-2009-4bf6-8b04-efc244a61316 req-d3691003-cb00-4241-aab0-54e4cf38d050 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118147 Sep 17 20:53:30.603940 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 390/716] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:53:30.630099 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-47d3636e-6303-432e-9c14-a7f000ca1db9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:30.634705 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-47d3636e-6303-432e-9c14-a7f000ca1db9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:30.636563 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8972e926-bd1a-4842-b9a3-e37ad2fc5a37 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495973792ca942bca2c6f65d545346e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d29b99a6bd9481f9042d9c7a9451c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:30.648259 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8972e926-bd1a-4842-b9a3-e37ad2fc5a37 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] 10.222.0.26 "GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010" status: 200 len: 1393 microversion: 2.1 time: 0.650572 Sep 17 20:53:30.674987 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 327/717] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:29 2022] GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010 => generated 1393 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:30.681198 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6a7c7518-e13b-4570-8042-9a53657cd9df tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:30.683188 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6a7c7518-e13b-4570-8042-9a53657cd9df tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:30.696978 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a7c7518-e13b-4570-8042-9a53657cd9df tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:30.699267 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a7c7518-e13b-4570-8042-9a53657cd9df tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:30.700424 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a7c7518-e13b-4570-8042-9a53657cd9df tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:30.701125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-47d3636e-6303-432e-9c14-a7f000ca1db9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:30.701824 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-47d3636e-6303-432e-9c14-a7f000ca1db9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:30.702830 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-47d3636e-6303-432e-9c14-a7f000ca1db9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:30.703387 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a7c7518-e13b-4570-8042-9a53657cd9df tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:30.704263 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-47d3636e-6303-432e-9c14-a7f000ca1db9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:30.705271 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a7c7518-e13b-4570-8042-9a53657cd9df tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:30.705906 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a7c7518-e13b-4570-8042-9a53657cd9df tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:30.706742 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-47d3636e-6303-432e-9c14-a7f000ca1db9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:30.707906 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-47d3636e-6303-432e-9c14-a7f000ca1db9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:31.381685 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-47d3636e-6303-432e-9c14-a7f000ca1db9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:31.399947 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-47d3636e-6303-432e-9c14-a7f000ca1db9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1537 microversion: 2.1 time: 0.793847 Sep 17 20:53:31.403797 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 391/718] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:30 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1537 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:31.427430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1f5ee93e-6dd0-4033-8a32-6f264bd6cea9 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:31.428612 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1f5ee93e-6dd0-4033-8a32-6f264bd6cea9 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] [instance: 8ec574a4-de66-49f0-84bf-b7a1bc07eb91] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:31.468615 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f5ee93e-6dd0-4033-8a32-6f264bd6cea9 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:31.472282 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f5ee93e-6dd0-4033-8a32-6f264bd6cea9 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:31.475132 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f5ee93e-6dd0-4033-8a32-6f264bd6cea9 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:31.489047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f5ee93e-6dd0-4033-8a32-6f264bd6cea9 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:31.490779 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f5ee93e-6dd0-4033-8a32-6f264bd6cea9 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:31.491868 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f5ee93e-6dd0-4033-8a32-6f264bd6cea9 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:31.558866 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-1f5ee93e-6dd0-4033-8a32-6f264bd6cea9 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] HTTP exception thrown: Instance 8ec574a4-de66-49f0-84bf-b7a1bc07eb91 could not be found. Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1f5ee93e-6dd0-4033-8a32-6f264bd6cea9 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Request method failure captured: Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 HTTP/1.1 Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjN7CXAW4gQtBmw_xQzpRoi78dmgH9n2xwrxx04PIw09-XbDILNDOcoTawMmeF79FkmZVKxCzJgM_YLoAFV1GE_79VxaOlij2t99VdG01Xa-E04lSaKB3z5YEzhbyD2_LXoBaRQxy2eShvKILOB8pDChi0lz3VA9su1xBf_lLRS6zGg Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: X-Openstack-Nova-Api-Version: 2.75 Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: d53ead9bed9640a88ca01af3a10626c5 Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersAdmin275Test-595579225 Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d53ead9bed9640a88ca01af3a10626c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d53ead9bed9640a88ca01af3a10626c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d53ead9bed9640a88ca01af3a10626c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d53ead9bed9640a88ca01af3a10626c5", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersAdmin275Test-595579225 Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: d53ead9bed9640a88ca01af3a10626c5 Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersAdmin275Test-595579225 Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersAdmin275Test-595579225-project Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: a38f77df31e648f99763a2f785b6fb4a Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersAdmin275Test-595579225-project Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 8ec574a4-de66-49f0-84bf-b7a1bc07eb91 could not be found. Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '8ec574a4-de66-49f0-84bf-b7a1bc07eb91'} Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ec574a4-de66-49f0-84bf-b7a1bc07eb91 could not be found. Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ec574a4-de66-49f0-84bf-b7a1bc07eb91 could not be found. Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:53:31.574870 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:53:31.581883 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:53:31.581883 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:53:31.581883 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:53:31.581883 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:53:31.581883 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:53:31.581883 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ec574a4-de66-49f0-84bf-b7a1bc07eb91 could not be found. Sep 17 20:53:31.581883 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:53:31.591707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1f5ee93e-6dd0-4033-8a32-6f264bd6cea9 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] Returning 404 to user: Instance 8ec574a4-de66-49f0-84bf-b7a1bc07eb91 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:53:31.593318 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1f5ee93e-6dd0-4033-8a32-6f264bd6cea9 tempest-ServersAdmin275Test-595579225 tempest-ServersAdmin275Test-595579225-project] 10.222.0.26 "GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91" status: 404 len: 111 microversion: 2.75 time: 0.187868 Sep 17 20:53:31.598296 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 392/719] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:31 2022] GET /compute/v2.1/servers/8ec574a4-de66-49f0-84bf-b7a1bc07eb91 => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 17 20:53:31.598407 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6a7c7518-e13b-4570-8042-9a53657cd9df tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:31.601661 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-e0cd532f-2d9b-4bc2-ba26-4d2fa0abb7b7 req-abb7b161-c829-440b-8ede-1622d381f773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2b0fad5-5be4-433b-bd8e-f51c4c8de010", "name": "network-vif-plugged", "status": "completed", "tag": "d84a1ac3-3c9c-4bd7-8638-7d28ec39e2b8"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:31.624875 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6a7c7518-e13b-4570-8042-9a53657cd9df tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:31.627611 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e0cd532f-2d9b-4bc2-ba26-4d2fa0abb7b7 req-abb7b161-c829-440b-8ede-1622d381f773 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:31.628548 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e0cd532f-2d9b-4bc2-ba26-4d2fa0abb7b7 req-abb7b161-c829-440b-8ede-1622d381f773 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:31.630378 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e0cd532f-2d9b-4bc2-ba26-4d2fa0abb7b7 req-abb7b161-c829-440b-8ede-1622d381f773 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:31.642006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6a7c7518-e13b-4570-8042-9a53657cd9df tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:31.645323 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6a7c7518-e13b-4570-8042-9a53657cd9df tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2" status: 200 len: 1567 microversion: 2.25 time: 0.968827 Sep 17 20:53:31.650526 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-e0cd532f-2d9b-4bc2-ba26-4d2fa0abb7b7 req-abb7b161-c829-440b-8ede-1622d381f773 service nova] Creating event network-vif-plugged:d84a1ac3-3c9c-4bd7-8638-7d28ec39e2b8 for instance b2b0fad5-5be4-433b-bd8e-f51c4c8de010 on nch1-master-1 Sep 17 20:53:31.670023 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 328/720] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:30 2022] GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2 => generated 1567 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:53:31.678994 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-e18d9de4-0b2c-4f63-a631-d2d52f8bf2eb req-86bca928-b237-4b17-88f9-1c0fb100478b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7", "name": "network-vif-deleted", "tag": "69898655-651f-4c1b-afd3-8dc1cb5c1d0e"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:31.696895 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-e0cd532f-2d9b-4bc2-ba26-4d2fa0abb7b7 req-abb7b161-c829-440b-8ede-1622d381f773 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101016 Sep 17 20:53:31.704091 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 393/721] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:53:31.712625 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-e18d9de4-0b2c-4f63-a631-d2d52f8bf2eb req-86bca928-b237-4b17-88f9-1c0fb100478b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:31.715302 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-e18d9de4-0b2c-4f63-a631-d2d52f8bf2eb req-86bca928-b237-4b17-88f9-1c0fb100478b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:31.716652 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-e18d9de4-0b2c-4f63-a631-d2d52f8bf2eb req-86bca928-b237-4b17-88f9-1c0fb100478b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:31.743703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7d53fba9-ba23-4ac9-8bfe-d4db903e081f tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:31.748548 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7d53fba9-ba23-4ac9-8bfe-d4db903e081f tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: a9ab9592-fc9c-4ec4-bf25-6ffb49440f25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:31.752315 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-e18d9de4-0b2c-4f63-a631-d2d52f8bf2eb req-86bca928-b237-4b17-88f9-1c0fb100478b service nova] Creating event network-vif-deleted:69898655-651f-4c1b-afd3-8dc1cb5c1d0e for instance 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 on nch2-master-1 Sep 17 20:53:31.763537 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-e18d9de4-0b2c-4f63-a631-d2d52f8bf2eb req-86bca928-b237-4b17-88f9-1c0fb100478b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087521 Sep 17 20:53:31.764997 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 329/722] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:53:31.782713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-30bd5751-2914-473f-85b0-ffbfa41f39c9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:31.783896 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-30bd5751-2914-473f-85b0-ffbfa41f39c9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:31.796424 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d53fba9-ba23-4ac9-8bfe-d4db903e081f tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:31.797494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d53fba9-ba23-4ac9-8bfe-d4db903e081f tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:31.798395 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d53fba9-ba23-4ac9-8bfe-d4db903e081f tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:31.802003 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d53fba9-ba23-4ac9-8bfe-d4db903e081f tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:31.802983 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d53fba9-ba23-4ac9-8bfe-d4db903e081f tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:31.803602 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d53fba9-ba23-4ac9-8bfe-d4db903e081f tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:31.807935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30bd5751-2914-473f-85b0-ffbfa41f39c9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:31.808798 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30bd5751-2914-473f-85b0-ffbfa41f39c9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:31.809436 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30bd5751-2914-473f-85b0-ffbfa41f39c9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:31.810670 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30bd5751-2914-473f-85b0-ffbfa41f39c9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:31.811319 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30bd5751-2914-473f-85b0-ffbfa41f39c9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:31.811964 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30bd5751-2914-473f-85b0-ffbfa41f39c9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:32.241274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7d53fba9-ba23-4ac9-8bfe-d4db903e081f tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f7c0fdad9346c58949928300021b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f305d163acf499c9808c5f11150a7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:32.255336 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7d53fba9-ba23-4ac9-8bfe-d4db903e081f tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25" status: 200 len: 1268 microversion: 2.1 time: 0.548469 Sep 17 20:53:32.258595 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 394/723] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:31 2022] GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 => generated 1268 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:32.267815 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d9476969-04e6-40bf-8394-ba82a23ae5e5 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:32.268627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d9476969-04e6-40bf-8394-ba82a23ae5e5 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] [instance: 9d268239-a1b7-433b-a3f1-52e84ad59682] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:32.283782 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d9476969-04e6-40bf-8394-ba82a23ae5e5 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:32.284303 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d9476969-04e6-40bf-8394-ba82a23ae5e5 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:32.288202 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d9476969-04e6-40bf-8394-ba82a23ae5e5 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:32.289599 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d9476969-04e6-40bf-8394-ba82a23ae5e5 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:32.292579 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d9476969-04e6-40bf-8394-ba82a23ae5e5 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:32.293286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d9476969-04e6-40bf-8394-ba82a23ae5e5 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:32.324126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-30bd5751-2914-473f-85b0-ffbfa41f39c9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:32.337616 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d9476969-04e6-40bf-8394-ba82a23ae5e5 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] [instance: 9d268239-a1b7-433b-a3f1-52e84ad59682] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:53:32.339719 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-30bd5751-2914-473f-85b0-ffbfa41f39c9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1" status: 200 len: 1215 microversion: 2.1 time: 0.560370 Sep 17 20:53:32.350022 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 330/724] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:31 2022] GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 => generated 1215 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:32.370541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-af39aac7-d7fe-4bae-8767-fba1a0a450b1 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:32.373375 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-af39aac7-d7fe-4bae-8767-fba1a0a450b1 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] [instance: b2b0fad5-5be4-433b-bd8e-f51c4c8de010] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:32.408732 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af39aac7-d7fe-4bae-8767-fba1a0a450b1 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:32.409244 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af39aac7-d7fe-4bae-8767-fba1a0a450b1 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:32.420627 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af39aac7-d7fe-4bae-8767-fba1a0a450b1 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:32.428836 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af39aac7-d7fe-4bae-8767-fba1a0a450b1 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:32.430282 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af39aac7-d7fe-4bae-8767-fba1a0a450b1 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:32.434971 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af39aac7-d7fe-4bae-8767-fba1a0a450b1 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:32.626231 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d9476969-04e6-40bf-8394-ba82a23ae5e5 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682" status: 204 len: 0 microversion: 2.1 time: 0.365706 Sep 17 20:53:32.627157 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 395/725] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:53:32 2022] DELETE /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:53:32.633304 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a612f0f0-6390-4e82-9ce7-0e2129b38b1b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:32.634613 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a612f0f0-6390-4e82-9ce7-0e2129b38b1b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:32.643042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a612f0f0-6390-4e82-9ce7-0e2129b38b1b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:32.643961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a612f0f0-6390-4e82-9ce7-0e2129b38b1b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:32.644705 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a612f0f0-6390-4e82-9ce7-0e2129b38b1b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:32.645666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a612f0f0-6390-4e82-9ce7-0e2129b38b1b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:32.647116 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a612f0f0-6390-4e82-9ce7-0e2129b38b1b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:32.647914 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a612f0f0-6390-4e82-9ce7-0e2129b38b1b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:32.952103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-af39aac7-d7fe-4bae-8767-fba1a0a450b1 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495973792ca942bca2c6f65d545346e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d29b99a6bd9481f9042d9c7a9451c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:32.984741 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-af39aac7-d7fe-4bae-8767-fba1a0a450b1 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] 10.222.0.26 "GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010" status: 200 len: 1393 microversion: 2.1 time: 0.629424 Sep 17 20:53:32.991570 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a612f0f0-6390-4e82-9ce7-0e2129b38b1b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:32.998549 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 331/726] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:32 2022] GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010 => generated 1393 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:33.015072 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-56ec0d90-e0c7-4bea-8aed-39e0cefe1584 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:33.015842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-56ec0d90-e0c7-4bea-8aed-39e0cefe1584 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] [instance: 9d268239-a1b7-433b-a3f1-52e84ad59682] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:33.025443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56ec0d90-e0c7-4bea-8aed-39e0cefe1584 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:33.026203 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56ec0d90-e0c7-4bea-8aed-39e0cefe1584 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:33.026692 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56ec0d90-e0c7-4bea-8aed-39e0cefe1584 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:33.028372 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56ec0d90-e0c7-4bea-8aed-39e0cefe1584 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:33.029125 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56ec0d90-e0c7-4bea-8aed-39e0cefe1584 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:33.030517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56ec0d90-e0c7-4bea-8aed-39e0cefe1584 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:33.065005 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a612f0f0-6390-4e82-9ce7-0e2129b38b1b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1537 microversion: 2.1 time: 0.383336 Sep 17 20:53:33.066927 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 396/727] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:32 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1537 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:33.080218 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-b6245409-91fe-4cf8-9ce2-177fcbfc8437 req-95cf2afa-08f2-4e45-a6f9-cc215dcf41df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58d4b11c-eac7-4725-be0b-d10e4cf15bc2", "tag": "fb8fa2f7-3a6c-4af8-bb7a-8e20186076a7"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:33.107143 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b6245409-91fe-4cf8-9ce2-177fcbfc8437 req-95cf2afa-08f2-4e45-a6f9-cc215dcf41df service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:33.107891 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b6245409-91fe-4cf8-9ce2-177fcbfc8437 req-95cf2afa-08f2-4e45-a6f9-cc215dcf41df service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:33.109369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b6245409-91fe-4cf8-9ce2-177fcbfc8437 req-95cf2afa-08f2-4e45-a6f9-cc215dcf41df service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:33.179325 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-b6245409-91fe-4cf8-9ce2-177fcbfc8437 req-95cf2afa-08f2-4e45-a6f9-cc215dcf41df service nova] Creating event network-changed:fb8fa2f7-3a6c-4af8-bb7a-8e20186076a7 for instance 58d4b11c-eac7-4725-be0b-d10e4cf15bc2 on nch1-master-1 Sep 17 20:53:33.192751 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-b6245409-91fe-4cf8-9ce2-177fcbfc8437 req-95cf2afa-08f2-4e45-a6f9-cc215dcf41df service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124499 Sep 17 20:53:33.193791 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 397/728] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:53:33.234261 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-269cd2e2-1277-4c3b-98b5-46570e4441fb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:33.236507 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-269cd2e2-1277-4c3b-98b5-46570e4441fb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:33.259309 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-269cd2e2-1277-4c3b-98b5-46570e4441fb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:33.260518 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-269cd2e2-1277-4c3b-98b5-46570e4441fb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:33.261317 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-269cd2e2-1277-4c3b-98b5-46570e4441fb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:33.285684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-269cd2e2-1277-4c3b-98b5-46570e4441fb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:33.286400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-269cd2e2-1277-4c3b-98b5-46570e4441fb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:33.286866 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-269cd2e2-1277-4c3b-98b5-46570e4441fb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:33.485413 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-56ec0d90-e0c7-4bea-8aed-39e0cefe1584 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb0a86572434db48c987279d67cd4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e566b2c69fec4ec784a13e4034eaef72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:33.492509 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:53:33.501377 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-56ec0d90-e0c7-4bea-8aed-39e0cefe1584 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] 10.222.0.26 "GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682" status: 200 len: 1541 microversion: 2.1 time: 0.493798 Sep 17 20:53:33.502614 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 332/729] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:32 2022] GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682 => generated 1541 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:33.517225 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d5b496a2-5022-43cf-a643-4740860c3090 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:33.518133 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d5b496a2-5022-43cf-a643-4740860c3090 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: a9ab9592-fc9c-4ec4-bf25-6ffb49440f25] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:33.525401 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5b496a2-5022-43cf-a643-4740860c3090 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:33.525961 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5b496a2-5022-43cf-a643-4740860c3090 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:33.526395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5b496a2-5022-43cf-a643-4740860c3090 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:33.531253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5b496a2-5022-43cf-a643-4740860c3090 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:33.531744 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5b496a2-5022-43cf-a643-4740860c3090 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:33.532187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5b496a2-5022-43cf-a643-4740860c3090 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:33.660590 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-269cd2e2-1277-4c3b-98b5-46570e4441fb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:33.669087 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d5b496a2-5022-43cf-a643-4740860c3090 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f7c0fdad9346c58949928300021b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f305d163acf499c9808c5f11150a7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:33.678504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-269cd2e2-1277-4c3b-98b5-46570e4441fb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:33.679738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-269cd2e2-1277-4c3b-98b5-46570e4441fb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:33.680918 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-269cd2e2-1277-4c3b-98b5-46570e4441fb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2" status: 200 len: 1567 microversion: 2.25 time: 0.486038 Sep 17 20:53:33.695557 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 398/730] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:33 2022] GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2 => generated 1567 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:53:33.702142 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a8bf33ed-3532-4869-a28a-e314c0a92cfb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:33.702933 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a8bf33ed-3532-4869-a28a-e314c0a92cfb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:33.709145 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d5b496a2-5022-43cf-a643-4740860c3090 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25" status: 200 len: 1316 microversion: 2.1 time: 0.204963 Sep 17 20:53:33.710227 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 333/731] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:33 2022] GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 => generated 1316 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:33.729365 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8bf33ed-3532-4869-a28a-e314c0a92cfb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:33.735851 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8bf33ed-3532-4869-a28a-e314c0a92cfb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:33.736794 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8bf33ed-3532-4869-a28a-e314c0a92cfb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:33.737869 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8bf33ed-3532-4869-a28a-e314c0a92cfb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:33.738501 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8bf33ed-3532-4869-a28a-e314c0a92cfb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:33.739082 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8bf33ed-3532-4869-a28a-e314c0a92cfb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:33.826717 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a8bf33ed-3532-4869-a28a-e314c0a92cfb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:33.836317 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a8bf33ed-3532-4869-a28a-e314c0a92cfb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1" status: 200 len: 1207 microversion: 2.1 time: 0.139149 Sep 17 20:53:33.837303 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 399/732] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:33 2022] GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 => generated 1207 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:34.018742 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a7ad1c10-7156-4ee9-889f-a02eb8ff81d5 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:34.019452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a7ad1c10-7156-4ee9-889f-a02eb8ff81d5 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] [instance: b2b0fad5-5be4-433b-bd8e-f51c4c8de010] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:34.027872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a7ad1c10-7156-4ee9-889f-a02eb8ff81d5 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:34.028379 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a7ad1c10-7156-4ee9-889f-a02eb8ff81d5 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:34.028833 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a7ad1c10-7156-4ee9-889f-a02eb8ff81d5 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:34.029756 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a7ad1c10-7156-4ee9-889f-a02eb8ff81d5 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:34.030315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a7ad1c10-7156-4ee9-889f-a02eb8ff81d5 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:34.030958 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a7ad1c10-7156-4ee9-889f-a02eb8ff81d5 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:34.095504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-873b10de-50ac-49d0-9353-fba20c97177e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:34.096292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-873b10de-50ac-49d0-9353-fba20c97177e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:34.103585 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-873b10de-50ac-49d0-9353-fba20c97177e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:34.104367 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-873b10de-50ac-49d0-9353-fba20c97177e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:34.104958 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-873b10de-50ac-49d0-9353-fba20c97177e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:34.106209 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-873b10de-50ac-49d0-9353-fba20c97177e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:34.119381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-873b10de-50ac-49d0-9353-fba20c97177e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:34.121009 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-873b10de-50ac-49d0-9353-fba20c97177e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:34.281369 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a7ad1c10-7156-4ee9-889f-a02eb8ff81d5 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495973792ca942bca2c6f65d545346e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d29b99a6bd9481f9042d9c7a9451c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:34.344706 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a7ad1c10-7156-4ee9-889f-a02eb8ff81d5 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] 10.222.0.26 "GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010" status: 200 len: 1393 microversion: 2.1 time: 0.328658 Sep 17 20:53:34.344706 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 334/733] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:34 2022] GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010 => generated 1393 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:34.483795 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-873b10de-50ac-49d0-9353-fba20c97177e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:34.500925 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-873b10de-50ac-49d0-9353-fba20c97177e tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1542 microversion: 2.1 time: 0.412660 Sep 17 20:53:34.501540 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 400/734] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:34 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1542 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:34.528500 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-eaef67d9-fec1-4fb0-add3-15ef4dc2dcf7 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:34.529160 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-eaef67d9-fec1-4fb0-add3-15ef4dc2dcf7 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] [instance: 9d268239-a1b7-433b-a3f1-52e84ad59682] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:34.536598 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eaef67d9-fec1-4fb0-add3-15ef4dc2dcf7 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:34.537500 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eaef67d9-fec1-4fb0-add3-15ef4dc2dcf7 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:34.538096 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eaef67d9-fec1-4fb0-add3-15ef4dc2dcf7 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:34.539210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eaef67d9-fec1-4fb0-add3-15ef4dc2dcf7 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:34.539851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eaef67d9-fec1-4fb0-add3-15ef4dc2dcf7 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:34.540571 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eaef67d9-fec1-4fb0-add3-15ef4dc2dcf7 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:34.716853 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-139945eb-21ad-4930-ac0b-e26aef437053 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:34.718201 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-139945eb-21ad-4930-ac0b-e26aef437053 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:34.731130 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-139945eb-21ad-4930-ac0b-e26aef437053 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:34.738368 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-139945eb-21ad-4930-ac0b-e26aef437053 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:34.739203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-139945eb-21ad-4930-ac0b-e26aef437053 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:34.740160 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-139945eb-21ad-4930-ac0b-e26aef437053 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:34.740773 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-139945eb-21ad-4930-ac0b-e26aef437053 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:34.741366 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-139945eb-21ad-4930-ac0b-e26aef437053 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:34.773026 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-eaef67d9-fec1-4fb0-add3-15ef4dc2dcf7 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb0a86572434db48c987279d67cd4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e566b2c69fec4ec784a13e4034eaef72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:34.786157 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-eaef67d9-fec1-4fb0-add3-15ef4dc2dcf7 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] 10.222.0.26 "GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682" status: 200 len: 1541 microversion: 2.1 time: 0.262602 Sep 17 20:53:34.786782 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 335/735] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:34 2022] GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682 => generated 1541 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:34.808732 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-12ac8189-71a4-4f23-b1b2-ddae46ec7c6f tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:34.812807 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-12ac8189-71a4-4f23-b1b2-ddae46ec7c6f tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: a9ab9592-fc9c-4ec4-bf25-6ffb49440f25] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:34.843605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12ac8189-71a4-4f23-b1b2-ddae46ec7c6f tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:34.844023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12ac8189-71a4-4f23-b1b2-ddae46ec7c6f tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:34.844543 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12ac8189-71a4-4f23-b1b2-ddae46ec7c6f tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:34.846020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12ac8189-71a4-4f23-b1b2-ddae46ec7c6f tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:34.846020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12ac8189-71a4-4f23-b1b2-ddae46ec7c6f tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:34.846241 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12ac8189-71a4-4f23-b1b2-ddae46ec7c6f tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:35.026402 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-12ac8189-71a4-4f23-b1b2-ddae46ec7c6f tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f7c0fdad9346c58949928300021b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f305d163acf499c9808c5f11150a7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:35.049573 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-12ac8189-71a4-4f23-b1b2-ddae46ec7c6f tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25" status: 200 len: 1316 microversion: 2.1 time: 0.261426 Sep 17 20:53:35.051508 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 336/736] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:34 2022] GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 => generated 1316 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:35.068071 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d2b7bcb4-0e97-45dc-bad2-b6bb14946f7e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:35.068739 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d2b7bcb4-0e97-45dc-bad2-b6bb14946f7e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:35.092045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2b7bcb4-0e97-45dc-bad2-b6bb14946f7e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:35.093506 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2b7bcb4-0e97-45dc-bad2-b6bb14946f7e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:35.094017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2b7bcb4-0e97-45dc-bad2-b6bb14946f7e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:35.094812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2b7bcb4-0e97-45dc-bad2-b6bb14946f7e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:35.095367 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2b7bcb4-0e97-45dc-bad2-b6bb14946f7e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:35.098922 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2b7bcb4-0e97-45dc-bad2-b6bb14946f7e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:35.275541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d2b7bcb4-0e97-45dc-bad2-b6bb14946f7e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:35.283496 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-139945eb-21ad-4930-ac0b-e26aef437053 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:35.288252 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d2b7bcb4-0e97-45dc-bad2-b6bb14946f7e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1" status: 200 len: 1263 microversion: 2.1 time: 0.235036 Sep 17 20:53:35.289340 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 337/737] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:35 2022] GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 => generated 1263 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:35.296947 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-139945eb-21ad-4930-ac0b-e26aef437053 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:35.299795 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-139945eb-21ad-4930-ac0b-e26aef437053 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:35.328562 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-139945eb-21ad-4930-ac0b-e26aef437053 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2" status: 200 len: 1567 microversion: 2.25 time: 0.589102 Sep 17 20:53:35.330176 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 401/738] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:34 2022] GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2 => generated 1567 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 20:53:35.365654 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1d9a7b18-7348-451c-8b9e-181c7b3b87f2 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:35.366376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1d9a7b18-7348-451c-8b9e-181c7b3b87f2 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] [instance: b2b0fad5-5be4-433b-bd8e-f51c4c8de010] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:35.375731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1d9a7b18-7348-451c-8b9e-181c7b3b87f2 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:35.376395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1d9a7b18-7348-451c-8b9e-181c7b3b87f2 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:35.376850 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1d9a7b18-7348-451c-8b9e-181c7b3b87f2 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:35.378496 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1d9a7b18-7348-451c-8b9e-181c7b3b87f2 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:35.379166 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1d9a7b18-7348-451c-8b9e-181c7b3b87f2 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:35.379931 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1d9a7b18-7348-451c-8b9e-181c7b3b87f2 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:35.540915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5f1fba2a-bc67-4829-afd6-4970ba01490c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:35.542927 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5f1fba2a-bc67-4829-afd6-4970ba01490c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:35.569838 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5f1fba2a-bc67-4829-afd6-4970ba01490c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:35.572198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5f1fba2a-bc67-4829-afd6-4970ba01490c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:35.573801 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5f1fba2a-bc67-4829-afd6-4970ba01490c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:35.576317 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5f1fba2a-bc67-4829-afd6-4970ba01490c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:35.579409 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5f1fba2a-bc67-4829-afd6-4970ba01490c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:35.580803 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5f1fba2a-bc67-4829-afd6-4970ba01490c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:35.760405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1d9a7b18-7348-451c-8b9e-181c7b3b87f2 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495973792ca942bca2c6f65d545346e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d29b99a6bd9481f9042d9c7a9451c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:35.774509 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1d9a7b18-7348-451c-8b9e-181c7b3b87f2 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] 10.222.0.26 "GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010" status: 200 len: 1575 microversion: 2.1 time: 0.417933 Sep 17 20:53:35.782054 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 338/739] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:35 2022] GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010 => generated 1575 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:35.807682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a1fb1524-6186-43f4-a143-5c5c4468ebc0 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:35.808330 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a1fb1524-6186-43f4-a143-5c5c4468ebc0 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] [instance: b2b0fad5-5be4-433b-bd8e-f51c4c8de010] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:35.821162 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1fb1524-6186-43f4-a143-5c5c4468ebc0 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:35.826516 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1fb1524-6186-43f4-a143-5c5c4468ebc0 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:35.827854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1fb1524-6186-43f4-a143-5c5c4468ebc0 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:35.828671 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1fb1524-6186-43f4-a143-5c5c4468ebc0 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:35.829195 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1fb1524-6186-43f4-a143-5c5c4468ebc0 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:35.829669 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1fb1524-6186-43f4-a143-5c5c4468ebc0 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:35.975836 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5f1fba2a-bc67-4829-afd6-4970ba01490c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:35.987977 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5f1fba2a-bc67-4829-afd6-4970ba01490c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1542 microversion: 2.1 time: 0.462624 Sep 17 20:53:35.989182 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 402/740] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:35 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1542 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:36.002530 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fd435c70-1d00-469e-8dc2-950a16c9920a tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:36.005527 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fd435c70-1d00-469e-8dc2-950a16c9920a tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] [instance: 9d268239-a1b7-433b-a3f1-52e84ad59682] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:36.010473 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a1fb1524-6186-43f4-a143-5c5c4468ebc0 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] 10.222.0.26 "GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.207249 Sep 17 20:53:36.011112 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 339/741] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Sep 17 20:53:35 2022] GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010/os-interface => generated 285 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:53:36.014334 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fd435c70-1d00-469e-8dc2-950a16c9920a tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:36.014934 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fd435c70-1d00-469e-8dc2-950a16c9920a tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:36.015467 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fd435c70-1d00-469e-8dc2-950a16c9920a tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:36.016571 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fd435c70-1d00-469e-8dc2-950a16c9920a tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:36.017216 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fd435c70-1d00-469e-8dc2-950a16c9920a tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:36.017896 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fd435c70-1d00-469e-8dc2-950a16c9920a tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:36.077942 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-06bbd273-5412-4aa1-bad3-c58f6540e572 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:36.079246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-06bbd273-5412-4aa1-bad3-c58f6540e572 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: a9ab9592-fc9c-4ec4-bf25-6ffb49440f25] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:36.092577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06bbd273-5412-4aa1-bad3-c58f6540e572 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:36.093670 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06bbd273-5412-4aa1-bad3-c58f6540e572 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:36.096421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06bbd273-5412-4aa1-bad3-c58f6540e572 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:36.097985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06bbd273-5412-4aa1-bad3-c58f6540e572 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:36.105646 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06bbd273-5412-4aa1-bad3-c58f6540e572 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:36.106525 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06bbd273-5412-4aa1-bad3-c58f6540e572 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:36.257175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-06bbd273-5412-4aa1-bad3-c58f6540e572 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f7c0fdad9346c58949928300021b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f305d163acf499c9808c5f11150a7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:36.278052 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-06bbd273-5412-4aa1-bad3-c58f6540e572 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25" status: 200 len: 1322 microversion: 2.1 time: 0.203650 Sep 17 20:53:36.292920 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 340/742] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:36 2022] GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:53:36.313512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-879fed80-9558-4437-8155-c1c1bd5ef9dc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:36.313512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-879fed80-9558-4437-8155-c1c1bd5ef9dc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:36.324324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-879fed80-9558-4437-8155-c1c1bd5ef9dc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:36.324843 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-879fed80-9558-4437-8155-c1c1bd5ef9dc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:36.325280 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-879fed80-9558-4437-8155-c1c1bd5ef9dc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:36.327950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-879fed80-9558-4437-8155-c1c1bd5ef9dc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:36.327950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-879fed80-9558-4437-8155-c1c1bd5ef9dc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:36.327950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-879fed80-9558-4437-8155-c1c1bd5ef9dc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:36.473097 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-879fed80-9558-4437-8155-c1c1bd5ef9dc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:36.477232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fd435c70-1d00-469e-8dc2-950a16c9920a tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb0a86572434db48c987279d67cd4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e566b2c69fec4ec784a13e4034eaef72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:36.495606 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fd435c70-1d00-469e-8dc2-950a16c9920a tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] 10.222.0.26 "GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682" status: 200 len: 1541 microversion: 2.1 time: 0.501399 Sep 17 20:53:36.501630 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 403/743] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:35 2022] GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682 => generated 1541 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:36.525424 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-879fed80-9558-4437-8155-c1c1bd5ef9dc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1" status: 200 len: 1269 microversion: 2.1 time: 0.215333 Sep 17 20:53:36.526477 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-43d55ff0-7a0d-4135-b5a7-c37f6992efd9 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:36.528445 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 341/744] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:36 2022] GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 => generated 1269 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:36.537916 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-43d55ff0-7a0d-4135-b5a7-c37f6992efd9 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:36.544624 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43d55ff0-7a0d-4135-b5a7-c37f6992efd9 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:36.545157 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43d55ff0-7a0d-4135-b5a7-c37f6992efd9 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:36.546870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43d55ff0-7a0d-4135-b5a7-c37f6992efd9 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:36.551366 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43d55ff0-7a0d-4135-b5a7-c37f6992efd9 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:36.553379 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43d55ff0-7a0d-4135-b5a7-c37f6992efd9 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:36.554025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43d55ff0-7a0d-4135-b5a7-c37f6992efd9 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:36.601609 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:53:36.980085 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-43d55ff0-7a0d-4135-b5a7-c37f6992efd9 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:36.995243 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-43d55ff0-7a0d-4135-b5a7-c37f6992efd9 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:36.996754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-43d55ff0-7a0d-4135-b5a7-c37f6992efd9 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:36.998305 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-43d55ff0-7a0d-4135-b5a7-c37f6992efd9 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2" status: 200 len: 1567 microversion: 2.25 time: 0.495162 Sep 17 20:53:37.006468 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 404/745] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:36 2022] GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2 => generated 1567 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:53:37.023372 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c0a7e290-9334-43d6-8c0e-dab48d9f6028 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:37.023996 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c0a7e290-9334-43d6-8c0e-dab48d9f6028 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:37.035723 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0a7e290-9334-43d6-8c0e-dab48d9f6028 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:37.036221 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0a7e290-9334-43d6-8c0e-dab48d9f6028 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:37.036839 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0a7e290-9334-43d6-8c0e-dab48d9f6028 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:37.037780 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0a7e290-9334-43d6-8c0e-dab48d9f6028 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:37.048924 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0a7e290-9334-43d6-8c0e-dab48d9f6028 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:37.049679 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0a7e290-9334-43d6-8c0e-dab48d9f6028 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:37.302605 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-43715e71-0f81-45f0-a6e0-e04ffb2a8470 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:37.303596 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-43715e71-0f81-45f0-a6e0-e04ffb2a8470 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: a9ab9592-fc9c-4ec4-bf25-6ffb49440f25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:37.313276 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43715e71-0f81-45f0-a6e0-e04ffb2a8470 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:37.314416 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43715e71-0f81-45f0-a6e0-e04ffb2a8470 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:37.316245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43715e71-0f81-45f0-a6e0-e04ffb2a8470 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:37.317444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43715e71-0f81-45f0-a6e0-e04ffb2a8470 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:37.318165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43715e71-0f81-45f0-a6e0-e04ffb2a8470 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:37.319196 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43715e71-0f81-45f0-a6e0-e04ffb2a8470 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:37.325209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c0a7e290-9334-43d6-8c0e-dab48d9f6028 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:37.339053 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c0a7e290-9334-43d6-8c0e-dab48d9f6028 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1542 microversion: 2.1 time: 0.319806 Sep 17 20:53:37.364431 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 342/746] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:37 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1542 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:37.371840 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-023f44b7-0f5d-4acf-ae7d-a293dbebcd94 req-6a47175e-4901-4ec7-99d8-caf65b36e37c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d268239-a1b7-433b-a3f1-52e84ad59682", "name": "network-vif-deleted", "tag": "a1936332-9c49-496c-a1d8-d378ab79c8ff"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:37.405803 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-023f44b7-0f5d-4acf-ae7d-a293dbebcd94 req-6a47175e-4901-4ec7-99d8-caf65b36e37c service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:37.407267 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-023f44b7-0f5d-4acf-ae7d-a293dbebcd94 req-6a47175e-4901-4ec7-99d8-caf65b36e37c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:37.409309 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-023f44b7-0f5d-4acf-ae7d-a293dbebcd94 req-6a47175e-4901-4ec7-99d8-caf65b36e37c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:37.435952 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-023f44b7-0f5d-4acf-ae7d-a293dbebcd94 req-6a47175e-4901-4ec7-99d8-caf65b36e37c service nova] Creating event network-vif-deleted:a1936332-9c49-496c-a1d8-d378ab79c8ff for instance 9d268239-a1b7-433b-a3f1-52e84ad59682 on nch1-master-1 Sep 17 20:53:37.445287 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-023f44b7-0f5d-4acf-ae7d-a293dbebcd94 req-6a47175e-4901-4ec7-99d8-caf65b36e37c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079273 Sep 17 20:53:37.446173 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 343/747] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:53:37.517938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-43715e71-0f81-45f0-a6e0-e04ffb2a8470 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f7c0fdad9346c58949928300021b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f305d163acf499c9808c5f11150a7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:37.531451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-eb9937b4-6cca-41d9-aee8-adaf85f14d84 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:37.536633 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-eb9937b4-6cca-41d9-aee8-adaf85f14d84 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] [instance: 9d268239-a1b7-433b-a3f1-52e84ad59682] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:37.552542 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-43715e71-0f81-45f0-a6e0-e04ffb2a8470 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25" status: 200 len: 1322 microversion: 2.1 time: 0.254778 Sep 17 20:53:37.553475 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 405/748] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:37 2022] GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:53:37.558509 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-471eb668-7a4f-46c6-b10e-e5a3eb6b3f55 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:37.559637 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eb9937b4-6cca-41d9-aee8-adaf85f14d84 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:37.560396 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eb9937b4-6cca-41d9-aee8-adaf85f14d84 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:37.560946 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eb9937b4-6cca-41d9-aee8-adaf85f14d84 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:37.570431 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eb9937b4-6cca-41d9-aee8-adaf85f14d84 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:37.571038 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eb9937b4-6cca-41d9-aee8-adaf85f14d84 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:37.571489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eb9937b4-6cca-41d9-aee8-adaf85f14d84 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:37.575920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-471eb668-7a4f-46c6-b10e-e5a3eb6b3f55 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:37.602844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-471eb668-7a4f-46c6-b10e-e5a3eb6b3f55 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:37.603349 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-471eb668-7a4f-46c6-b10e-e5a3eb6b3f55 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:37.603782 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-471eb668-7a4f-46c6-b10e-e5a3eb6b3f55 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:37.604536 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-471eb668-7a4f-46c6-b10e-e5a3eb6b3f55 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:37.604981 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-471eb668-7a4f-46c6-b10e-e5a3eb6b3f55 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:37.610065 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-471eb668-7a4f-46c6-b10e-e5a3eb6b3f55 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:37.659495 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eb9937b4-6cca-41d9-aee8-adaf85f14d84 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:37.659982 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eb9937b4-6cca-41d9-aee8-adaf85f14d84 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:37.660416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eb9937b4-6cca-41d9-aee8-adaf85f14d84 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:37.660865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-eb9937b4-6cca-41d9-aee8-adaf85f14d84 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lazy-loading 'fault' on Instance uuid 9d268239-a1b7-433b-a3f1-52e84ad59682 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:53:37.789083 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-471eb668-7a4f-46c6-b10e-e5a3eb6b3f55 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:37.801408 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-471eb668-7a4f-46c6-b10e-e5a3eb6b3f55 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1" status: 200 len: 1269 microversion: 2.1 time: 0.245500 Sep 17 20:53:37.816741 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 406/749] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:37 2022] GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 => generated 1269 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:37.831909 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-eb9937b4-6cca-41d9-aee8-adaf85f14d84 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb0a86572434db48c987279d67cd4e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e566b2c69fec4ec784a13e4034eaef72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:37.843854 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-eb9937b4-6cca-41d9-aee8-adaf85f14d84 tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] 10.222.0.26 "GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682" status: 200 len: 1321 microversion: 2.1 time: 0.320452 Sep 17 20:53:37.859423 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 344/750] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:37 2022] GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682 => generated 1321 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:53:38.027584 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7e1065bd-30f1-4813-a6ba-cf3d5d34b47d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:38.029280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7e1065bd-30f1-4813-a6ba-cf3d5d34b47d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:38.037887 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e1065bd-30f1-4813-a6ba-cf3d5d34b47d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:38.039365 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e1065bd-30f1-4813-a6ba-cf3d5d34b47d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:38.040066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e1065bd-30f1-4813-a6ba-cf3d5d34b47d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:38.051264 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e1065bd-30f1-4813-a6ba-cf3d5d34b47d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:38.051826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e1065bd-30f1-4813-a6ba-cf3d5d34b47d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:38.052290 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e1065bd-30f1-4813-a6ba-cf3d5d34b47d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:38.368542 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ee11d1f9-212a-4011-adae-81ee77c820e0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:38.369163 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ee11d1f9-212a-4011-adae-81ee77c820e0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:38.381551 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee11d1f9-212a-4011-adae-81ee77c820e0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:38.382075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee11d1f9-212a-4011-adae-81ee77c820e0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:38.382836 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee11d1f9-212a-4011-adae-81ee77c820e0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:38.385753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee11d1f9-212a-4011-adae-81ee77c820e0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:38.386383 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee11d1f9-212a-4011-adae-81ee77c820e0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:38.392725 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee11d1f9-212a-4011-adae-81ee77c820e0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:38.972531 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7e1065bd-30f1-4813-a6ba-cf3d5d34b47d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:38.983108 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ee11d1f9-212a-4011-adae-81ee77c820e0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:38.995927 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7e1065bd-30f1-4813-a6ba-cf3d5d34b47d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:38.998698 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ee11d1f9-212a-4011-adae-81ee77c820e0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1542 microversion: 2.1 time: 0.634025 Sep 17 20:53:38.998997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7e1065bd-30f1-4813-a6ba-cf3d5d34b47d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:39.000919 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 345/751] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:38 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1542 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:39.005690 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7e1065bd-30f1-4813-a6ba-cf3d5d34b47d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2" status: 200 len: 1567 microversion: 2.25 time: 0.980440 Sep 17 20:53:39.006494 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 407/752] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:38 2022] GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2 => generated 1567 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:53:39.020183 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b42aaa12-2775-4e43-a1a3-a7adfd54c14f tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:39.021918 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b42aaa12-2775-4e43-a1a3-a7adfd54c14f tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: a9ab9592-fc9c-4ec4-bf25-6ffb49440f25] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:39.029713 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d0066e2e-cb7e-4ed6-b9eb-658073d026c7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:39.030938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d0066e2e-cb7e-4ed6-b9eb-658073d026c7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:39.038201 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d0066e2e-cb7e-4ed6-b9eb-658073d026c7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:39.039157 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d0066e2e-cb7e-4ed6-b9eb-658073d026c7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:39.039755 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d0066e2e-cb7e-4ed6-b9eb-658073d026c7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:39.040637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d0066e2e-cb7e-4ed6-b9eb-658073d026c7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:39.041415 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d0066e2e-cb7e-4ed6-b9eb-658073d026c7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:39.041637 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b42aaa12-2775-4e43-a1a3-a7adfd54c14f tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:39.042341 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d0066e2e-cb7e-4ed6-b9eb-658073d026c7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:39.043786 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b42aaa12-2775-4e43-a1a3-a7adfd54c14f tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:39.046583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b42aaa12-2775-4e43-a1a3-a7adfd54c14f tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:39.047374 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b42aaa12-2775-4e43-a1a3-a7adfd54c14f tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:39.047845 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b42aaa12-2775-4e43-a1a3-a7adfd54c14f tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:39.048278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b42aaa12-2775-4e43-a1a3-a7adfd54c14f tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:39.405163 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d0066e2e-cb7e-4ed6-b9eb-658073d026c7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:39.419244 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d0066e2e-cb7e-4ed6-b9eb-658073d026c7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1" status: 200 len: 1311 microversion: 2.1 time: 0.396178 Sep 17 20:53:39.420963 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 408/753] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:39 2022] GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 => generated 1311 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:39.436897 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b42aaa12-2775-4e43-a1a3-a7adfd54c14f tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f7c0fdad9346c58949928300021b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f305d163acf499c9808c5f11150a7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:39.453420 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6bcfa418-21f2-4fef-9638-47900be31fd1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-985324309", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "400b7e30-05bb-4dbc-bf0f-d22eb683913b"}], "security_groups": [{"name": "tempest-securitygroup--856235866"}], "key_name": "tempest-keypair-1568539338", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "d32359bf-ad08-4517-9759-3f42907f23c0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:39.458906 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b42aaa12-2775-4e43-a1a3-a7adfd54c14f tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25" status: 200 len: 1390 microversion: 2.1 time: 0.455260 Sep 17 20:53:39.461010 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 346/754] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:39 2022] GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 => generated 1390 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:39.470025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2c81369e-4bab-45a4-979e-02059470db7f tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:39.473339 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2c81369e-4bab-45a4-979e-02059470db7f tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] [instance: 9d268239-a1b7-433b-a3f1-52e84ad59682] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:39.485185 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2c81369e-4bab-45a4-979e-02059470db7f tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:39.486306 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2c81369e-4bab-45a4-979e-02059470db7f tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:39.486989 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2c81369e-4bab-45a4-979e-02059470db7f tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:39.487958 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2c81369e-4bab-45a4-979e-02059470db7f tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:39.488797 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2c81369e-4bab-45a4-979e-02059470db7f tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:39.489567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2c81369e-4bab-45a4-979e-02059470db7f tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:39.521145 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-2c81369e-4bab-45a4-979e-02059470db7f tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] HTTP exception thrown: Instance 9d268239-a1b7-433b-a3f1-52e84ad59682 could not be found. Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2c81369e-4bab-45a4-979e-02059470db7f tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Request method failure captured: Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682 HTTP/1.1 Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjOPTD5bVc5vw9S8U7S39ahSkUdLqYrEohQkTER8XyECLPOX8-Wzl3iM3e2fdoLvu2gM1MBw_jDVBCemrcXZjMYyfCtmYMgnqW4J2izXawiy9GAW8TRFepKi0Y7eI1o8mHaGZHoKccTsemQx4JJOQzVrtnY-yAMe0XWWBK3NkT6ELJk Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: e566b2c69fec4ec784a13e4034eaef72 Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-291838535 Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e566b2c69fec4ec784a13e4034eaef72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e566b2c69fec4ec784a13e4034eaef72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e566b2c69fec4ec784a13e4034eaef72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e566b2c69fec4ec784a13e4034eaef72", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-291838535 Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: e566b2c69fec4ec784a13e4034eaef72 Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-291838535 Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: feb0a86572434db48c987279d67cd4e0 Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 9d268239-a1b7-433b-a3f1-52e84ad59682 could not be found. Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '9d268239-a1b7-433b-a3f1-52e84ad59682'} Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d268239-a1b7-433b-a3f1-52e84ad59682 could not be found. Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d268239-a1b7-433b-a3f1-52e84ad59682 could not be found. Sep 17 20:53:39.525512 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:53:39.531206 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:53:39.531206 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:53:39.531206 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:53:39.531206 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:53:39.531206 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:53:39.531206 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:53:39.531206 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:53:39.531206 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d268239-a1b7-433b-a3f1-52e84ad59682 could not be found. Sep 17 20:53:39.531206 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:53:39.531206 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2c81369e-4bab-45a4-979e-02059470db7f tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] Returning 404 to user: Instance 9d268239-a1b7-433b-a3f1-52e84ad59682 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:53:39.531206 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2c81369e-4bab-45a4-979e-02059470db7f tempest-FloatingIPsAssociationNegativeTestJSON-291838535 tempest-FloatingIPsAssociationNegativeTestJSON-291838535-project] 10.222.0.26 "GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682" status: 404 len: 111 microversion: 2.1 time: 0.065883 Sep 17 20:53:39.533396 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 347/755] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:39 2022] GET /compute/v2.1/servers/9d268239-a1b7-433b-a3f1-52e84ad59682 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:53:39.543199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-eecaf518-de87-4c66-8c48-ea1d4430277d tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:39.545010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-eecaf518-de87-4c66-8c48-ea1d4430277d tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] [instance: b2b0fad5-5be4-433b-bd8e-f51c4c8de010] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:39.555235 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eecaf518-de87-4c66-8c48-ea1d4430277d tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:39.555963 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eecaf518-de87-4c66-8c48-ea1d4430277d tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:39.557563 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eecaf518-de87-4c66-8c48-ea1d4430277d tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:39.558474 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eecaf518-de87-4c66-8c48-ea1d4430277d tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:39.559296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eecaf518-de87-4c66-8c48-ea1d4430277d tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:39.560204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eecaf518-de87-4c66-8c48-ea1d4430277d tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:39.760184 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:53:39.814752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:53:39.896824 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:53:39.922588 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-eecaf518-de87-4c66-8c48-ea1d4430277d tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495973792ca942bca2c6f65d545346e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d29b99a6bd9481f9042d9c7a9451c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:39.925656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=6 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:53:39.938944 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-6bcfa418-21f2-4fef-9638-47900be31fd1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] validate_networks() for [('400b7e30-05bb-4dbc-bf0f-d22eb683913b', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:53:39.944314 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-eecaf518-de87-4c66-8c48-ea1d4430277d tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] 10.222.0.26 "GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010" status: 200 len: 1575 microversion: 2.1 time: 0.408676 Sep 17 20:53:39.945992 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 348/756] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:39 2022] GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010 => generated 1575 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:39.952171 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-a0567012-dab1-4c51-b727-a2c168bc313b req-48813892-93d9-45bf-907d-50eed97e6d90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2b0fad5-5be4-433b-bd8e-f51c4c8de010", "tag": "d84a1ac3-3c9c-4bd7-8638-7d28ec39e2b8"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:39.967875 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-a0567012-dab1-4c51-b727-a2c168bc313b req-48813892-93d9-45bf-907d-50eed97e6d90 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:39.968364 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-a0567012-dab1-4c51-b727-a2c168bc313b req-48813892-93d9-45bf-907d-50eed97e6d90 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:39.969010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-a0567012-dab1-4c51-b727-a2c168bc313b req-48813892-93d9-45bf-907d-50eed97e6d90 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:39.997374 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-a0567012-dab1-4c51-b727-a2c168bc313b req-48813892-93d9-45bf-907d-50eed97e6d90 service nova] Creating event network-changed:d84a1ac3-3c9c-4bd7-8638-7d28ec39e2b8 for instance b2b0fad5-5be4-433b-bd8e-f51c4c8de010 on nch1-master-1 Sep 17 20:53:40.006010 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-a0567012-dab1-4c51-b727-a2c168bc313b req-48813892-93d9-45bf-907d-50eed97e6d90 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057032 Sep 17 20:53:40.008213 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 349/757] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:53:40.033591 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1900ff39-e838-4618-8122-40a5dee2bbea tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:40.035949 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1900ff39-e838-4618-8122-40a5dee2bbea tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:40.048784 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1900ff39-e838-4618-8122-40a5dee2bbea tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:40.051471 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1900ff39-e838-4618-8122-40a5dee2bbea tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:40.054219 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1900ff39-e838-4618-8122-40a5dee2bbea tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:40.055564 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1900ff39-e838-4618-8122-40a5dee2bbea tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:40.056761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1900ff39-e838-4618-8122-40a5dee2bbea tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:40.058153 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1900ff39-e838-4618-8122-40a5dee2bbea tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:40.601190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1900ff39-e838-4618-8122-40a5dee2bbea tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:40.613923 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1900ff39-e838-4618-8122-40a5dee2bbea tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1542 microversion: 2.1 time: 0.591349 Sep 17 20:53:40.623709 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 350/758] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:40 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1542 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:40.654338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5953cf06-c7ea-498c-b248-d00d570df39a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:40.655222 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5953cf06-c7ea-498c-b248-d00d570df39a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:40.662765 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5953cf06-c7ea-498c-b248-d00d570df39a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:40.663438 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5953cf06-c7ea-498c-b248-d00d570df39a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:40.664068 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5953cf06-c7ea-498c-b248-d00d570df39a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:40.664948 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5953cf06-c7ea-498c-b248-d00d570df39a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:40.665698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5953cf06-c7ea-498c-b248-d00d570df39a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:40.666556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5953cf06-c7ea-498c-b248-d00d570df39a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:40.701343 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:53:41.653315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5953cf06-c7ea-498c-b248-d00d570df39a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:41.663353 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5953cf06-c7ea-498c-b248-d00d570df39a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:41.664993 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5953cf06-c7ea-498c-b248-d00d570df39a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:41.667141 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5953cf06-c7ea-498c-b248-d00d570df39a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2" status: 200 len: 1542 microversion: 2.25 time: 1.041918 Sep 17 20:53:41.668388 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 351/759] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:40 2022] GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2 => generated 1542 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:53:41.674449 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-2922eddc-9f59-43c1-99de-fe1bbf2a0ba6 req-0e91e8ea-47b4-48d1-b7d6-e586b04d5da1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9ab9592-fc9c-4ec4-bf25-6ffb49440f25", "tag": "23b1a85d-8b5b-4c32-8ff8-5e4c1672d0d4"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:41.691689 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2922eddc-9f59-43c1-99de-fe1bbf2a0ba6 req-0e91e8ea-47b4-48d1-b7d6-e586b04d5da1 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:41.692470 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2922eddc-9f59-43c1-99de-fe1bbf2a0ba6 req-0e91e8ea-47b4-48d1-b7d6-e586b04d5da1 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:41.693069 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2922eddc-9f59-43c1-99de-fe1bbf2a0ba6 req-0e91e8ea-47b4-48d1-b7d6-e586b04d5da1 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:41.708028 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-2922eddc-9f59-43c1-99de-fe1bbf2a0ba6 req-0e91e8ea-47b4-48d1-b7d6-e586b04d5da1 service nova] Creating event network-changed:23b1a85d-8b5b-4c32-8ff8-5e4c1672d0d4 for instance a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 on nch1-master-1 Sep 17 20:53:41.714103 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-2922eddc-9f59-43c1-99de-fe1bbf2a0ba6 req-0e91e8ea-47b4-48d1-b7d6-e586b04d5da1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044142 Sep 17 20:53:41.714752 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 352/760] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:53:41.722001 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-76f682af-8e9e-4ac9-9dd2-1a6d0bcdfc74 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:41.722917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-76f682af-8e9e-4ac9-9dd2-1a6d0bcdfc74 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:41.729714 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-76f682af-8e9e-4ac9-9dd2-1a6d0bcdfc74 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:41.730318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-76f682af-8e9e-4ac9-9dd2-1a6d0bcdfc74 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:41.730765 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-76f682af-8e9e-4ac9-9dd2-1a6d0bcdfc74 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:41.731492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-76f682af-8e9e-4ac9-9dd2-1a6d0bcdfc74 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:41.731952 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-76f682af-8e9e-4ac9-9dd2-1a6d0bcdfc74 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:41.732384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-76f682af-8e9e-4ac9-9dd2-1a6d0bcdfc74 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:41.924043 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-6bcfa418-21f2-4fef-9638-47900be31fd1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Getting quotas for project 26d60144477f4a5192d581350d678979. Resources: dict_keys(['metadata_items']) {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:53:41.928579 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-6bcfa418-21f2-4fef-9638-47900be31fd1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Getting quotas for user 6f7681de64c248268da4d78124f59b54 and project 26d60144477f4a5192d581350d678979. Resources: dict_keys(['metadata_items']) {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:53:41.940980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-6bcfa418-21f2-4fef-9638-47900be31fd1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:53:41.941405 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-6bcfa418-21f2-4fef-9638-47900be31fd1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:53:41.941917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-6bcfa418-21f2-4fef-9638-47900be31fd1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:53:41.942508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-6bcfa418-21f2-4fef-9638-47900be31fd1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:53:41.943081 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-6bcfa418-21f2-4fef-9638-47900be31fd1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:53:41.953506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6bcfa418-21f2-4fef-9638-47900be31fd1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:41.954228 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6bcfa418-21f2-4fef-9638-47900be31fd1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:41.954886 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6bcfa418-21f2-4fef-9638-47900be31fd1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:41.956096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6bcfa418-21f2-4fef-9638-47900be31fd1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:41.956711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6bcfa418-21f2-4fef-9638-47900be31fd1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:41.957283 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6bcfa418-21f2-4fef-9638-47900be31fd1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:41.976915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-6bcfa418-21f2-4fef-9638-47900be31fd1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Getting quotas for project 26d60144477f4a5192d581350d678979. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:53:41.981930 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-6bcfa418-21f2-4fef-9638-47900be31fd1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Getting quotas for user 6f7681de64c248268da4d78124f59b54 and project 26d60144477f4a5192d581350d678979. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:53:42.044224 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6bcfa418-21f2-4fef-9638-47900be31fd1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:53:42.046686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6bcfa418-21f2-4fef-9638-47900be31fd1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] [instance: 44fa7976-1412-4c83-ae29-b02e16186990] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d32359bf-ad08-4517-9759-3f42907f23c0',volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:53:42.088458 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-76f682af-8e9e-4ac9-9dd2-1a6d0bcdfc74 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:42.098730 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-76f682af-8e9e-4ac9-9dd2-1a6d0bcdfc74 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1" status: 200 len: 1311 microversion: 2.1 time: 0.382120 Sep 17 20:53:42.099662 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 353/761] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:41 2022] GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 => generated 1311 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:42.107516 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d5bdd14a-acd9-4cba-91fd-f52d259a19e0 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:42.108593 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d5bdd14a-acd9-4cba-91fd-f52d259a19e0 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: a9ab9592-fc9c-4ec4-bf25-6ffb49440f25] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:42.117643 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5bdd14a-acd9-4cba-91fd-f52d259a19e0 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:42.118494 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5bdd14a-acd9-4cba-91fd-f52d259a19e0 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:42.119159 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5bdd14a-acd9-4cba-91fd-f52d259a19e0 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:42.120291 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5bdd14a-acd9-4cba-91fd-f52d259a19e0 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:42.120993 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5bdd14a-acd9-4cba-91fd-f52d259a19e0 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:42.121692 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5bdd14a-acd9-4cba-91fd-f52d259a19e0 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:42.272718 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6bcfa418-21f2-4fef-9638-47900be31fd1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.849547 Sep 17 20:53:42.274635 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 409/762] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:53:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 2853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:53:42.280614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-43b7c57e-d0d0-418c-9702-e5857c122f22 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:42.282143 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-43b7c57e-d0d0-418c-9702-e5857c122f22 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:42.289666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43b7c57e-d0d0-418c-9702-e5857c122f22 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:42.290729 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43b7c57e-d0d0-418c-9702-e5857c122f22 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:42.291518 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43b7c57e-d0d0-418c-9702-e5857c122f22 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:42.292853 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43b7c57e-d0d0-418c-9702-e5857c122f22 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:42.293872 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43b7c57e-d0d0-418c-9702-e5857c122f22 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:42.294599 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43b7c57e-d0d0-418c-9702-e5857c122f22 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:42.632414 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d5bdd14a-acd9-4cba-91fd-f52d259a19e0 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f7c0fdad9346c58949928300021b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f305d163acf499c9808c5f11150a7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:42.642484 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d5bdd14a-acd9-4cba-91fd-f52d259a19e0 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25" status: 200 len: 1390 microversion: 2.1 time: 0.541481 Sep 17 20:53:42.647828 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 354/763] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:42 2022] GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 => generated 1390 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:42.659429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c69b8e7c-3f13-4ecb-ba5d-4d53a660276f tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Calling method '.version_select at 0x7f25a5842b80>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:42.664951 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c69b8e7c-3f13-4ecb-ba5d-4d53a660276f tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:42.665450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c69b8e7c-3f13-4ecb-ba5d-4d53a660276f tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:42.675985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c69b8e7c-3f13-4ecb-ba5d-4d53a660276f tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:42.703142 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c69b8e7c-3f13-4ecb-ba5d-4d53a660276f tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 2366 microversion: 2.25 time: 0.053910 Sep 17 20:53:42.714966 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 355/764] 10.222.0.26 () {60 vars in 1184 bytes} [Sat Sep 17 20:53:42 2022] GET /compute/v2.1/os-migrations => generated 2366 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:53:42.721002 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e34b8b00-2f60-4f9e-a064-9baab635069c tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:42.721762 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e34b8b00-2f60-4f9e-a064-9baab635069c tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] [instance: 44fa7976-1412-4c83-ae29-b02e16186990] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:42.773242 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-43b7c57e-d0d0-418c-9702-e5857c122f22 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:42.790743 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-43b7c57e-d0d0-418c-9702-e5857c122f22 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1542 microversion: 2.1 time: 0.514253 Sep 17 20:53:42.805125 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 410/765] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:42 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1542 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:42.805125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-eab61d47-74ad-4a73-a8ab-d7ba8e44fbb8 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:42.805125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-eab61d47-74ad-4a73-a8ab-d7ba8e44fbb8 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:42.820826 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e34b8b00-2f60-4f9e-a064-9baab635069c tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7681de64c248268da4d78124f59b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d60144477f4a5192d581350d678979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:42.824774 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eab61d47-74ad-4a73-a8ab-d7ba8e44fbb8 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:42.830205 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eab61d47-74ad-4a73-a8ab-d7ba8e44fbb8 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:42.832507 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e34b8b00-2f60-4f9e-a064-9baab635069c tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] 10.222.0.26 "GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990" status: 200 len: 1121 microversion: 2.1 time: 0.126161 Sep 17 20:53:42.832900 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eab61d47-74ad-4a73-a8ab-d7ba8e44fbb8 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:42.833874 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eab61d47-74ad-4a73-a8ab-d7ba8e44fbb8 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:42.835754 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 356/766] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:42 2022] GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990 => generated 1121 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:42.836241 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eab61d47-74ad-4a73-a8ab-d7ba8e44fbb8 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:42.837661 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eab61d47-74ad-4a73-a8ab-d7ba8e44fbb8 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:43.123110 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-28648c11-f6fd-4b52-a6d0-25c9f47079d5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:43.123784 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-28648c11-f6fd-4b52-a6d0-25c9f47079d5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:43.134009 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-28648c11-f6fd-4b52-a6d0-25c9f47079d5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:43.137630 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-28648c11-f6fd-4b52-a6d0-25c9f47079d5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:43.139712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-28648c11-f6fd-4b52-a6d0-25c9f47079d5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:43.140788 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-28648c11-f6fd-4b52-a6d0-25c9f47079d5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:43.141962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-28648c11-f6fd-4b52-a6d0-25c9f47079d5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:43.143904 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-28648c11-f6fd-4b52-a6d0-25c9f47079d5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:43.341082 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-eab61d47-74ad-4a73-a8ab-d7ba8e44fbb8 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lazy-loading 'services' on Instance uuid 58d4b11c-eac7-4725-be0b-d10e4cf15bc2 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:53:43.360678 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-eab61d47-74ad-4a73-a8ab-d7ba8e44fbb8 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2" status: 200 len: 2034 microversion: 2.25 time: 0.564201 Sep 17 20:53:43.362255 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 411/767] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:42 2022] GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2 => generated 2034 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:53:43.392888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-93d8bbbc-a680-433e-8fcc-75a4d83c3453 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Action: 'create', calling method: .version_select at 0x7f25a57a2b80>, body: {"keypair": {"name": "tempest-keypair-1928430300", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPmzyk/POq/q591W8t2zz9M84TDoWn7Ylzds0wowODVrUjmbg3xmV1sYxg+T5Pjwi+oAMCw/D8DVpeztI4x9rjTk/o3q4ilAwSk3LxH2WjS4sxmSxgRm1H5XmE9QbdT2g=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:43.428132 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-93d8bbbc-a680-433e-8fcc-75a4d83c3453 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Getting quotas for project 7dc8bc81c2d74bae9612f7c9807350a7. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:53:43.443518 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-93d8bbbc-a680-433e-8fcc-75a4d83c3453 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Getting quotas for user f1134231b4a545fdb136a5204cb4f289 and project 7dc8bc81c2d74bae9612f7c9807350a7. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:53:43.516740 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-93d8bbbc-a680-433e-8fcc-75a4d83c3453 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.127780 Sep 17 20:53:43.519465 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 412/768] 10.222.0.26 () {62 vars in 1200 bytes} [Sat Sep 17 20:53:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 131 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 17 20:53:43.669522 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-343b4042-accb-4f75-addf-9a0f21e754b5 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:43.670358 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-343b4042-accb-4f75-addf-9a0f21e754b5 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: a9ab9592-fc9c-4ec4-bf25-6ffb49440f25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:43.676744 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-343b4042-accb-4f75-addf-9a0f21e754b5 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:43.677356 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-343b4042-accb-4f75-addf-9a0f21e754b5 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:43.677694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-343b4042-accb-4f75-addf-9a0f21e754b5 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:43.678705 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-343b4042-accb-4f75-addf-9a0f21e754b5 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:43.679168 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-343b4042-accb-4f75-addf-9a0f21e754b5 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:43.679601 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-343b4042-accb-4f75-addf-9a0f21e754b5 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:43.680435 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-28648c11-f6fd-4b52-a6d0-25c9f47079d5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:43.698494 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-28648c11-f6fd-4b52-a6d0-25c9f47079d5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1" status: 200 len: 1311 microversion: 2.1 time: 0.580451 Sep 17 20:53:43.699667 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 357/769] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:43 2022] GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 => generated 1311 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:43.731160 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-25b6e919-c7e0-4850-b101-32a08d25a055 req-c6d22ef7-0269-4474-8e39-55ab80353dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f598b03-b7f1-42ce-a5b0-2c140bde7ba1", "tag": "a8ad5af8-55a2-4214-b840-cef45bde3c20"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:43.741412 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-25b6e919-c7e0-4850-b101-32a08d25a055 req-c6d22ef7-0269-4474-8e39-55ab80353dc6 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:43.742141 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-25b6e919-c7e0-4850-b101-32a08d25a055 req-c6d22ef7-0269-4474-8e39-55ab80353dc6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:43.742644 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-25b6e919-c7e0-4850-b101-32a08d25a055 req-c6d22ef7-0269-4474-8e39-55ab80353dc6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:43.754913 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-25b6e919-c7e0-4850-b101-32a08d25a055 req-c6d22ef7-0269-4474-8e39-55ab80353dc6 service nova] Creating event network-changed:a8ad5af8-55a2-4214-b840-cef45bde3c20 for instance 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 on nch1-master-1 Sep 17 20:53:43.759981 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-25b6e919-c7e0-4850-b101-32a08d25a055 req-c6d22ef7-0269-4474-8e39-55ab80353dc6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032798 Sep 17 20:53:43.760912 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 358/770] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:53:43.817170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-aa666201-3051-4425-98fe-0dd0d5323ec3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:43.817914 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-aa666201-3051-4425-98fe-0dd0d5323ec3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:43.824673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa666201-3051-4425-98fe-0dd0d5323ec3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:43.825190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa666201-3051-4425-98fe-0dd0d5323ec3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:43.825658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa666201-3051-4425-98fe-0dd0d5323ec3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:43.826384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa666201-3051-4425-98fe-0dd0d5323ec3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:43.826844 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa666201-3051-4425-98fe-0dd0d5323ec3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:43.827281 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa666201-3051-4425-98fe-0dd0d5323ec3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:44.580062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-343b4042-accb-4f75-addf-9a0f21e754b5 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f7c0fdad9346c58949928300021b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f305d163acf499c9808c5f11150a7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:44.591148 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-343b4042-accb-4f75-addf-9a0f21e754b5 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25" status: 200 len: 1390 microversion: 2.1 time: 0.925815 Sep 17 20:53:44.591771 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 413/771] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:43 2022] GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 => generated 1390 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:53:44.597084 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4cfd77ec-a430-4ae0-a461-58b79f1a533c tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:44.598163 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4cfd77ec-a430-4ae0-a461-58b79f1a533c tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] [instance: 44fa7976-1412-4c83-ae29-b02e16186990] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:44.606156 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4cfd77ec-a430-4ae0-a461-58b79f1a533c tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:44.606920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4cfd77ec-a430-4ae0-a461-58b79f1a533c tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:44.608029 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4cfd77ec-a430-4ae0-a461-58b79f1a533c tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:44.609271 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4cfd77ec-a430-4ae0-a461-58b79f1a533c tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:44.609852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4cfd77ec-a430-4ae0-a461-58b79f1a533c tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:44.611850 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4cfd77ec-a430-4ae0-a461-58b79f1a533c tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:44.617313 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-aa666201-3051-4425-98fe-0dd0d5323ec3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:44.628802 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-aa666201-3051-4425-98fe-0dd0d5323ec3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1542 microversion: 2.1 time: 0.815954 Sep 17 20:53:44.629757 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 359/772] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:43 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1542 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:44.722992 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bd523850-c2be-46d6-9037-55ab7f95c182 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:44.724303 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bd523850-c2be-46d6-9037-55ab7f95c182 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:44.727609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:53:44.737417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd523850-c2be-46d6-9037-55ab7f95c182 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:44.745770 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd523850-c2be-46d6-9037-55ab7f95c182 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:44.747254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd523850-c2be-46d6-9037-55ab7f95c182 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:44.748052 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd523850-c2be-46d6-9037-55ab7f95c182 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:44.748539 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd523850-c2be-46d6-9037-55ab7f95c182 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:44.748987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd523850-c2be-46d6-9037-55ab7f95c182 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:44.766366 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4cfd77ec-a430-4ae0-a461-58b79f1a533c tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7681de64c248268da4d78124f59b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d60144477f4a5192d581350d678979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:44.779647 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4cfd77ec-a430-4ae0-a461-58b79f1a533c tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] 10.222.0.26 "GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990" status: 200 len: 1237 microversion: 2.1 time: 0.185074 Sep 17 20:53:44.789852 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 414/773] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:44 2022] GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990 => generated 1237 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:45.227589 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bd523850-c2be-46d6-9037-55ab7f95c182 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:45.240525 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bd523850-c2be-46d6-9037-55ab7f95c182 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1" status: 200 len: 1311 microversion: 2.1 time: 0.521998 Sep 17 20:53:45.242674 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 360/774] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:44 2022] GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 => generated 1311 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:53:45.615169 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a7569cb7-3358-467a-a8ae-e4133e532d5a tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:45.615784 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a7569cb7-3358-467a-a8ae-e4133e532d5a tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: a9ab9592-fc9c-4ec4-bf25-6ffb49440f25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:45.629625 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7569cb7-3358-467a-a8ae-e4133e532d5a tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:45.630413 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7569cb7-3358-467a-a8ae-e4133e532d5a tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:45.631050 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7569cb7-3358-467a-a8ae-e4133e532d5a tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:45.631976 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7569cb7-3358-467a-a8ae-e4133e532d5a tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:45.632647 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7569cb7-3358-467a-a8ae-e4133e532d5a tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:45.633729 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7569cb7-3358-467a-a8ae-e4133e532d5a tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:45.652107 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e5019db9-b376-4e7e-accb-a6ad190aaca1 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:45.652977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e5019db9-b376-4e7e-accb-a6ad190aaca1 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:45.665265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5019db9-b376-4e7e-accb-a6ad190aaca1 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:45.665793 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5019db9-b376-4e7e-accb-a6ad190aaca1 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:45.670294 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5019db9-b376-4e7e-accb-a6ad190aaca1 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:45.671328 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5019db9-b376-4e7e-accb-a6ad190aaca1 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:45.678962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5019db9-b376-4e7e-accb-a6ad190aaca1 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:45.680222 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5019db9-b376-4e7e-accb-a6ad190aaca1 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:46.483334 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a7569cb7-3358-467a-a8ae-e4133e532d5a tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f7c0fdad9346c58949928300021b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f305d163acf499c9808c5f11150a7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:46.494052 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a7569cb7-3358-467a-a8ae-e4133e532d5a tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25" status: 200 len: 1390 microversion: 2.1 time: 0.882765 Sep 17 20:53:46.495623 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 415/775] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:45 2022] GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 => generated 1390 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:53:46.501340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a0e887eb-269f-46e8-b54a-0f11ea24783d tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:46.502638 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a0e887eb-269f-46e8-b54a-0f11ea24783d tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] [instance: 44fa7976-1412-4c83-ae29-b02e16186990] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:46.511438 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0e887eb-269f-46e8-b54a-0f11ea24783d tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:46.511934 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0e887eb-269f-46e8-b54a-0f11ea24783d tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:46.512365 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0e887eb-269f-46e8-b54a-0f11ea24783d tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:46.513064 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0e887eb-269f-46e8-b54a-0f11ea24783d tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:46.513600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0e887eb-269f-46e8-b54a-0f11ea24783d tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:46.514025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0e887eb-269f-46e8-b54a-0f11ea24783d tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:46.565146 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e5019db9-b376-4e7e-accb-a6ad190aaca1 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:46.574320 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e5019db9-b376-4e7e-accb-a6ad190aaca1 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1542 microversion: 2.1 time: 0.926464 Sep 17 20:53:46.578250 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 361/776] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:45 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1542 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:46.583270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f3dd92de-f249-49c9-9d9e-757af926172a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:46.584088 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f3dd92de-f249-49c9-9d9e-757af926172a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:46.590735 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f3dd92de-f249-49c9-9d9e-757af926172a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:46.591490 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f3dd92de-f249-49c9-9d9e-757af926172a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:46.592293 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f3dd92de-f249-49c9-9d9e-757af926172a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:46.593249 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f3dd92de-f249-49c9-9d9e-757af926172a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:46.593948 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f3dd92de-f249-49c9-9d9e-757af926172a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:46.594609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f3dd92de-f249-49c9-9d9e-757af926172a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:46.704308 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a0e887eb-269f-46e8-b54a-0f11ea24783d tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7681de64c248268da4d78124f59b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d60144477f4a5192d581350d678979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:46.717582 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a0e887eb-269f-46e8-b54a-0f11ea24783d tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] 10.222.0.26 "GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990" status: 200 len: 1225 microversion: 2.1 time: 0.220674 Sep 17 20:53:46.719412 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 416/777] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:46 2022] GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990 => generated 1225 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:47.121306 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f3dd92de-f249-49c9-9d9e-757af926172a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:47.136381 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f3dd92de-f249-49c9-9d9e-757af926172a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1" status: 200 len: 1311 microversion: 2.1 time: 0.556776 Sep 17 20:53:47.157323 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 362/778] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:46 2022] GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 => generated 1311 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:47.320979 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-782e1736-37a8-460b-86dd-49c6c68b00b9 req-b321d838-3899-4768-9304-3bebbff53d8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9ab9592-fc9c-4ec4-bf25-6ffb49440f25", "name": "network-vif-plugged", "status": "completed", "tag": "23b1a85d-8b5b-4c32-8ff8-5e4c1672d0d4"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:47.332285 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-782e1736-37a8-460b-86dd-49c6c68b00b9 req-b321d838-3899-4768-9304-3bebbff53d8a service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:47.332775 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-782e1736-37a8-460b-86dd-49c6c68b00b9 req-b321d838-3899-4768-9304-3bebbff53d8a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:47.333238 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-782e1736-37a8-460b-86dd-49c6c68b00b9 req-b321d838-3899-4768-9304-3bebbff53d8a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:47.384317 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-782e1736-37a8-460b-86dd-49c6c68b00b9 req-b321d838-3899-4768-9304-3bebbff53d8a service nova] Creating event network-vif-plugged:23b1a85d-8b5b-4c32-8ff8-5e4c1672d0d4 for instance a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 on nch1-master-1 Sep 17 20:53:47.394922 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-782e1736-37a8-460b-86dd-49c6c68b00b9 req-b321d838-3899-4768-9304-3bebbff53d8a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077861 Sep 17 20:53:47.397698 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 417/779] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:53:47.516686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b8410c1f-882c-40fc-be11-ca77bd60fdb7 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:47.517724 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b8410c1f-882c-40fc-be11-ca77bd60fdb7 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: a9ab9592-fc9c-4ec4-bf25-6ffb49440f25] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:47.527497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b8410c1f-882c-40fc-be11-ca77bd60fdb7 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:47.528134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b8410c1f-882c-40fc-be11-ca77bd60fdb7 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:47.528586 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b8410c1f-882c-40fc-be11-ca77bd60fdb7 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:47.529305 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b8410c1f-882c-40fc-be11-ca77bd60fdb7 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:47.529806 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b8410c1f-882c-40fc-be11-ca77bd60fdb7 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:47.531662 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b8410c1f-882c-40fc-be11-ca77bd60fdb7 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:47.605951 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-45a72be4-77f4-41c0-bcd2-5fe42efe76b2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:47.606764 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-45a72be4-77f4-41c0-bcd2-5fe42efe76b2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:47.614960 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45a72be4-77f4-41c0-bcd2-5fe42efe76b2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:47.615820 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45a72be4-77f4-41c0-bcd2-5fe42efe76b2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:47.616615 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45a72be4-77f4-41c0-bcd2-5fe42efe76b2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:47.617580 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45a72be4-77f4-41c0-bcd2-5fe42efe76b2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:47.618533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45a72be4-77f4-41c0-bcd2-5fe42efe76b2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:47.619242 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45a72be4-77f4-41c0-bcd2-5fe42efe76b2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:47.843493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b8410c1f-882c-40fc-be11-ca77bd60fdb7 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f7c0fdad9346c58949928300021b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f305d163acf499c9808c5f11150a7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:47.861978 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b8410c1f-882c-40fc-be11-ca77bd60fdb7 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25" status: 200 len: 1390 microversion: 2.1 time: 0.341177 Sep 17 20:53:47.863241 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 363/780] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:47 2022] GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 => generated 1390 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:47.868118 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-87dedbbb-8beb-424d-8559-79abfceb7867 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:47.869074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-87dedbbb-8beb-424d-8559-79abfceb7867 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] [instance: 44fa7976-1412-4c83-ae29-b02e16186990] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:47.883108 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87dedbbb-8beb-424d-8559-79abfceb7867 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:47.883614 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87dedbbb-8beb-424d-8559-79abfceb7867 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:47.884064 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87dedbbb-8beb-424d-8559-79abfceb7867 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:47.885200 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87dedbbb-8beb-424d-8559-79abfceb7867 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:47.885729 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87dedbbb-8beb-424d-8559-79abfceb7867 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:47.886167 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87dedbbb-8beb-424d-8559-79abfceb7867 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:48.372629 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-45a72be4-77f4-41c0-bcd2-5fe42efe76b2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:48.385369 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-45a72be4-77f4-41c0-bcd2-5fe42efe76b2 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1542 microversion: 2.1 time: 0.784544 Sep 17 20:53:48.387752 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 418/781] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:47 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1542 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:48.400692 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3b0806df-f5db-479d-b00f-c9e4963ea298 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:48.405824 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3b0806df-f5db-479d-b00f-c9e4963ea298 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:48.420937 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b0806df-f5db-479d-b00f-c9e4963ea298 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:48.423065 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b0806df-f5db-479d-b00f-c9e4963ea298 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:48.424770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b0806df-f5db-479d-b00f-c9e4963ea298 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:48.426431 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b0806df-f5db-479d-b00f-c9e4963ea298 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:48.428308 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b0806df-f5db-479d-b00f-c9e4963ea298 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:48.430343 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b0806df-f5db-479d-b00f-c9e4963ea298 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:48.484178 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-87dedbbb-8beb-424d-8559-79abfceb7867 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7681de64c248268da4d78124f59b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d60144477f4a5192d581350d678979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:48.497364 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-87dedbbb-8beb-424d-8559-79abfceb7867 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] 10.222.0.26 "GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990" status: 200 len: 1292 microversion: 2.1 time: 0.631912 Sep 17 20:53:48.504976 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 364/782] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:47 2022] GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990 => generated 1292 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:48.878078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3b0806df-f5db-479d-b00f-c9e4963ea298 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:48.885258 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e34a38b6-09da-438e-b19b-1dde5f0985ac tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:48.885909 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e34a38b6-09da-438e-b19b-1dde5f0985ac tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: a9ab9592-fc9c-4ec4-bf25-6ffb49440f25] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:48.900848 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3b0806df-f5db-479d-b00f-c9e4963ea298 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1" status: 200 len: 1311 microversion: 2.1 time: 0.510660 Sep 17 20:53:48.903690 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e34a38b6-09da-438e-b19b-1dde5f0985ac tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:48.904083 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 419/783] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:48 2022] GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 => generated 1311 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:48.915216 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e34a38b6-09da-438e-b19b-1dde5f0985ac tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:48.921317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e34a38b6-09da-438e-b19b-1dde5f0985ac tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:48.922450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e34a38b6-09da-438e-b19b-1dde5f0985ac tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:48.923082 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e34a38b6-09da-438e-b19b-1dde5f0985ac tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:48.923680 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e34a38b6-09da-438e-b19b-1dde5f0985ac tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:49.485404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-638275c4-76de-4c9a-ab5e-5da33294a1ca tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1057917823", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "3c590c43-fcd5-41d9-9c4b-71b8980abfc0"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:49.495856 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:53:49.552321 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-638275c4-76de-4c9a-ab5e-5da33294a1ca tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] validate_networks() for [('3c590c43-fcd5-41d9-9c4b-71b8980abfc0', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:53:49.857434 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e34a38b6-09da-438e-b19b-1dde5f0985ac tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f7c0fdad9346c58949928300021b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f305d163acf499c9808c5f11150a7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:49.866185 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e34a38b6-09da-438e-b19b-1dde5f0985ac tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25" status: 200 len: 1390 microversion: 2.1 time: 0.984973 Sep 17 20:53:49.866780 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 365/784] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:48 2022] GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 => generated 1390 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:53:49.882558 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e1ba7856-6dd9-42d2-be63-ee1f0e255999 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:49.883425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e1ba7856-6dd9-42d2-be63-ee1f0e255999 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:49.890000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e1ba7856-6dd9-42d2-be63-ee1f0e255999 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:49.890624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e1ba7856-6dd9-42d2-be63-ee1f0e255999 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:49.891067 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e1ba7856-6dd9-42d2-be63-ee1f0e255999 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:49.891789 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e1ba7856-6dd9-42d2-be63-ee1f0e255999 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:49.892246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e1ba7856-6dd9-42d2-be63-ee1f0e255999 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:49.892670 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e1ba7856-6dd9-42d2-be63-ee1f0e255999 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:50.314897 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e1ba7856-6dd9-42d2-be63-ee1f0e255999 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:50.323405 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e1ba7856-6dd9-42d2-be63-ee1f0e255999 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1542 microversion: 2.1 time: 0.455337 Sep 17 20:53:50.327866 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 366/785] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:49 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1542 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:50.335926 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-062fd0e6-3762-41b7-a72e-f0b1c17d4152 req-349b792b-2df9-4989-b618-b5ca750a5307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f598b03-b7f1-42ce-a5b0-2c140bde7ba1", "name": "network-vif-plugged", "status": "completed", "tag": "a8ad5af8-55a2-4214-b840-cef45bde3c20"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:50.368654 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-062fd0e6-3762-41b7-a72e-f0b1c17d4152 req-349b792b-2df9-4989-b618-b5ca750a5307 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:50.368969 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-062fd0e6-3762-41b7-a72e-f0b1c17d4152 req-349b792b-2df9-4989-b618-b5ca750a5307 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:50.370354 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-062fd0e6-3762-41b7-a72e-f0b1c17d4152 req-349b792b-2df9-4989-b618-b5ca750a5307 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:50.401269 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-062fd0e6-3762-41b7-a72e-f0b1c17d4152 req-349b792b-2df9-4989-b618-b5ca750a5307 service nova] Creating event network-vif-plugged:a8ad5af8-55a2-4214-b840-cef45bde3c20 for instance 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 on nch1-master-1 Sep 17 20:53:50.411640 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-062fd0e6-3762-41b7-a72e-f0b1c17d4152 req-349b792b-2df9-4989-b618-b5ca750a5307 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082189 Sep 17 20:53:50.416155 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 367/786] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:53:50.442094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-10ecf11a-5da9-4016-92a1-5e0958057d65 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:50.445976 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-10ecf11a-5da9-4016-92a1-5e0958057d65 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] [instance: 44fa7976-1412-4c83-ae29-b02e16186990] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:50.456477 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10ecf11a-5da9-4016-92a1-5e0958057d65 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:50.457019 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10ecf11a-5da9-4016-92a1-5e0958057d65 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:50.464864 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10ecf11a-5da9-4016-92a1-5e0958057d65 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:50.466622 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10ecf11a-5da9-4016-92a1-5e0958057d65 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:50.467134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10ecf11a-5da9-4016-92a1-5e0958057d65 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:50.467590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10ecf11a-5da9-4016-92a1-5e0958057d65 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:51.018149 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-638275c4-76de-4c9a-ab5e-5da33294a1ca tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:53:51.018658 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-638275c4-76de-4c9a-ab5e-5da33294a1ca tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:53:51.019511 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-638275c4-76de-4c9a-ab5e-5da33294a1ca tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:53:51.020328 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-638275c4-76de-4c9a-ab5e-5da33294a1ca tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:53:51.020937 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-638275c4-76de-4c9a-ab5e-5da33294a1ca tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:53:51.039857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-638275c4-76de-4c9a-ab5e-5da33294a1ca tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:51.040783 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-638275c4-76de-4c9a-ab5e-5da33294a1ca tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:51.041520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-638275c4-76de-4c9a-ab5e-5da33294a1ca tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:51.044339 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-638275c4-76de-4c9a-ab5e-5da33294a1ca tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:51.045170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-638275c4-76de-4c9a-ab5e-5da33294a1ca tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:51.045857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-638275c4-76de-4c9a-ab5e-5da33294a1ca tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:51.079125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-638275c4-76de-4c9a-ab5e-5da33294a1ca tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Getting quotas for project 6b843f5d09c94cf3916f65e815d6d7a1. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:53:51.088879 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-638275c4-76de-4c9a-ab5e-5da33294a1ca tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Getting quotas for user aaa9e5c7b7dd4a74935de34327145697 and project 6b843f5d09c94cf3916f65e815d6d7a1. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:53:51.111049 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-10ecf11a-5da9-4016-92a1-5e0958057d65 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7681de64c248268da4d78124f59b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d60144477f4a5192d581350d678979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:51.130229 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-10ecf11a-5da9-4016-92a1-5e0958057d65 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] 10.222.0.26 "GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990" status: 200 len: 1292 microversion: 2.1 time: 0.707187 Sep 17 20:53:51.132354 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-638275c4-76de-4c9a-ab5e-5da33294a1ca tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:53:51.132700 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 368/787] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:50 2022] GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990 => generated 1292 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:51.137017 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-638275c4-76de-4c9a-ab5e-5da33294a1ca tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 59beeb15-b8ee-49e8-b739-f38a755dc102] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:53:51.148658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a50959a6-5fd0-4ab7-b971-9394b0f7dbeb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:51.149299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a50959a6-5fd0-4ab7-b971-9394b0f7dbeb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:51.160674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a50959a6-5fd0-4ab7-b971-9394b0f7dbeb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:51.165371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a50959a6-5fd0-4ab7-b971-9394b0f7dbeb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:51.165919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a50959a6-5fd0-4ab7-b971-9394b0f7dbeb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:51.166671 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a50959a6-5fd0-4ab7-b971-9394b0f7dbeb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:51.167127 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a50959a6-5fd0-4ab7-b971-9394b0f7dbeb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:51.167748 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a50959a6-5fd0-4ab7-b971-9394b0f7dbeb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:51.232742 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-638275c4-76de-4c9a-ab5e-5da33294a1ca tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.912437 Sep 17 20:53:51.234038 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 420/788] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:53:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1914 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 17 20:53:51.242837 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8323643d-7053-4c3f-9f53-96067a13f733 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-922997508", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "291f6f93-7c31-4c8d-9946-eca7fb2662ee"}], "security_groups": [{"name": "tempest-securitygroup--1043227719"}], "key_name": "tempest-keypair-1928430300", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:51.468697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-8323643d-7053-4c3f-9f53-96067a13f733 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] validate_networks() for [('291f6f93-7c31-4c8d-9946-eca7fb2662ee', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:53:51.831732 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a50959a6-5fd0-4ab7-b971-9394b0f7dbeb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:51.843649 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a50959a6-5fd0-4ab7-b971-9394b0f7dbeb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1" status: 200 len: 1311 microversion: 2.1 time: 0.709660 Sep 17 20:53:51.844465 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 369/789] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:51 2022] GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 => generated 1311 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:51.870446 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-2d1bf2f4-b789-4ede-b3fa-0c85f5b7295f req-4cf95fdc-4f30-40f1-bd03-beecac23fbbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44fa7976-1412-4c83-ae29-b02e16186990", "tag": "7125d3dc-3622-46b0-a3c6-b60d56b537b5"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:51.891206 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2d1bf2f4-b789-4ede-b3fa-0c85f5b7295f req-4cf95fdc-4f30-40f1-bd03-beecac23fbbb service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:51.895711 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2d1bf2f4-b789-4ede-b3fa-0c85f5b7295f req-4cf95fdc-4f30-40f1-bd03-beecac23fbbb service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:51.896617 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2d1bf2f4-b789-4ede-b3fa-0c85f5b7295f req-4cf95fdc-4f30-40f1-bd03-beecac23fbbb service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:51.932956 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-2d1bf2f4-b789-4ede-b3fa-0c85f5b7295f req-4cf95fdc-4f30-40f1-bd03-beecac23fbbb service nova] Creating event network-changed:7125d3dc-3622-46b0-a3c6-b60d56b537b5 for instance 44fa7976-1412-4c83-ae29-b02e16186990 on nch2-master-1 Sep 17 20:53:51.938496 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-2d1bf2f4-b789-4ede-b3fa-0c85f5b7295f req-4cf95fdc-4f30-40f1-bd03-beecac23fbbb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092064 Sep 17 20:53:51.939499 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 370/790] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:53:51.946791 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7e49062a-4ca3-472f-80f5-392a631a4eff tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:51.947560 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7e49062a-4ca3-472f-80f5-392a631a4eff tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: a9ab9592-fc9c-4ec4-bf25-6ffb49440f25] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:51.954911 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7e49062a-4ca3-472f-80f5-392a631a4eff tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:51.955404 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7e49062a-4ca3-472f-80f5-392a631a4eff tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:51.955850 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7e49062a-4ca3-472f-80f5-392a631a4eff tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:51.956580 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7e49062a-4ca3-472f-80f5-392a631a4eff tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:51.957045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7e49062a-4ca3-472f-80f5-392a631a4eff tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:51.957510 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7e49062a-4ca3-472f-80f5-392a631a4eff tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:52.411449 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7e49062a-4ca3-472f-80f5-392a631a4eff tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f7c0fdad9346c58949928300021b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f305d163acf499c9808c5f11150a7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:52.424738 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7e49062a-4ca3-472f-80f5-392a631a4eff tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25" status: 200 len: 1588 microversion: 2.1 time: 0.483430 Sep 17 20:53:52.426203 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 371/791] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:51 2022] GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 => generated 1588 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:52.433888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-fd45542a-f96a-4720-a148-33b6d474576e req-0054927e-8495-4eef-b255-4bbe3de21e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89b39b18-ff49-4810-9701-3084736ff2d0", "name": "network-vif-unplugged", "status": "completed", "tag": "67dfcd54-a56f-4269-9ed0-edf035c918b0"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:52.459637 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-fd45542a-f96a-4720-a148-33b6d474576e req-0054927e-8495-4eef-b255-4bbe3de21e3e service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:52.462041 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-fd45542a-f96a-4720-a148-33b6d474576e req-0054927e-8495-4eef-b255-4bbe3de21e3e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:52.463402 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-fd45542a-f96a-4720-a148-33b6d474576e req-0054927e-8495-4eef-b255-4bbe3de21e3e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:52.492838 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-fd45542a-f96a-4720-a148-33b6d474576e req-0054927e-8495-4eef-b255-4bbe3de21e3e service nova] Creating event network-vif-unplugged:67dfcd54-a56f-4269-9ed0-edf035c918b0 for instance 89b39b18-ff49-4810-9701-3084736ff2d0 on nch1-master-1 Sep 17 20:53:52.504403 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:53:52.506769 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [req-fd45542a-f96a-4720-a148-33b6d474576e req-0054927e-8495-4eef-b255-4bbe3de21e3e service nova] Instance 89b39b18-ff49-4810-9701-3084736ff2d0 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140523) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 20:53:52.542655 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-fd45542a-f96a-4720-a148-33b6d474576e req-0054927e-8495-4eef-b255-4bbe3de21e3e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113364 Sep 17 20:53:52.544618 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 372/792] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:53:52.571235 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b3252fd9-0692-4172-bcf2-3c0df861fd6f tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:52.572408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b3252fd9-0692-4172-bcf2-3c0df861fd6f tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 59beeb15-b8ee-49e8-b739-f38a755dc102] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:52.583780 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3252fd9-0692-4172-bcf2-3c0df861fd6f tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:52.584742 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3252fd9-0692-4172-bcf2-3c0df861fd6f tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:52.585346 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3252fd9-0692-4172-bcf2-3c0df861fd6f tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:52.585943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3252fd9-0692-4172-bcf2-3c0df861fd6f tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:52.586396 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3252fd9-0692-4172-bcf2-3c0df861fd6f tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:52.586901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3252fd9-0692-4172-bcf2-3c0df861fd6f tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:52.638665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-8323643d-7053-4c3f-9f53-96067a13f733 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:53:52.639685 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-8323643d-7053-4c3f-9f53-96067a13f733 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:53:52.640163 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-8323643d-7053-4c3f-9f53-96067a13f733 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:53:52.640576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-8323643d-7053-4c3f-9f53-96067a13f733 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:53:52.640982 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-8323643d-7053-4c3f-9f53-96067a13f733 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:53:52.651789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8323643d-7053-4c3f-9f53-96067a13f733 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:52.655170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8323643d-7053-4c3f-9f53-96067a13f733 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:52.655932 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8323643d-7053-4c3f-9f53-96067a13f733 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:52.656857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8323643d-7053-4c3f-9f53-96067a13f733 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:52.657310 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8323643d-7053-4c3f-9f53-96067a13f733 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:52.657757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8323643d-7053-4c3f-9f53-96067a13f733 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:52.676352 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-8323643d-7053-4c3f-9f53-96067a13f733 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Getting quotas for project 7dc8bc81c2d74bae9612f7c9807350a7. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:53:52.680941 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-8323643d-7053-4c3f-9f53-96067a13f733 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Getting quotas for user f1134231b4a545fdb136a5204cb4f289 and project 7dc8bc81c2d74bae9612f7c9807350a7. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:53:52.696445 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8323643d-7053-4c3f-9f53-96067a13f733 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:53:52.699799 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8323643d-7053-4c3f-9f53-96067a13f733 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:53:52.753012 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8323643d-7053-4c3f-9f53-96067a13f733 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.516970 Sep 17 20:53:52.754502 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 421/793] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Sep 17 20:53:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 1520 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 17 20:53:52.763078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-89e564e0-3886-42e6-9ccb-d43aa3389656 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:52.764345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-89e564e0-3886-42e6-9ccb-d43aa3389656 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:52.772324 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-89e564e0-3886-42e6-9ccb-d43aa3389656 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:52.773148 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-89e564e0-3886-42e6-9ccb-d43aa3389656 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:52.773961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-89e564e0-3886-42e6-9ccb-d43aa3389656 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:52.774880 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-89e564e0-3886-42e6-9ccb-d43aa3389656 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:52.775635 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-89e564e0-3886-42e6-9ccb-d43aa3389656 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:52.776666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-89e564e0-3886-42e6-9ccb-d43aa3389656 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:52.828408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:53:53.087338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b3252fd9-0692-4172-bcf2-3c0df861fd6f tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa9e5c7b7dd4a74935de34327145697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b843f5d09c94cf3916f65e815d6d7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:53.096680 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b3252fd9-0692-4172-bcf2-3c0df861fd6f tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102" status: 200 len: 1276 microversion: 2.1 time: 0.549640 Sep 17 20:53:53.097988 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 373/794] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:52 2022] GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102 => generated 1276 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:53.116601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6cdc7a47-4d86-4ac2-968d-6d5a47f6f9ca tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:53.117648 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6cdc7a47-4d86-4ac2-968d-6d5a47f6f9ca tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] [instance: 44fa7976-1412-4c83-ae29-b02e16186990] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:53.124409 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6cdc7a47-4d86-4ac2-968d-6d5a47f6f9ca tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:53.124900 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6cdc7a47-4d86-4ac2-968d-6d5a47f6f9ca tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:53.125679 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6cdc7a47-4d86-4ac2-968d-6d5a47f6f9ca tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:53.126400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6cdc7a47-4d86-4ac2-968d-6d5a47f6f9ca tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:53.126870 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6cdc7a47-4d86-4ac2-968d-6d5a47f6f9ca tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:53.127292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6cdc7a47-4d86-4ac2-968d-6d5a47f6f9ca tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:53.347927 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-89e564e0-3886-42e6-9ccb-d43aa3389656 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:53.366717 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-89e564e0-3886-42e6-9ccb-d43aa3389656 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1473 microversion: 2.1 time: 0.610516 Sep 17 20:53:53.387170 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 422/795] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:52 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1473 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:53.394705 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f2de45d9-dc3c-4754-9f3d-ea983d12be2c tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:53.395333 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f2de45d9-dc3c-4754-9f3d-ea983d12be2c tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: a9ab9592-fc9c-4ec4-bf25-6ffb49440f25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:53.402395 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f2de45d9-dc3c-4754-9f3d-ea983d12be2c tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:53.403164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f2de45d9-dc3c-4754-9f3d-ea983d12be2c tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:53.403834 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f2de45d9-dc3c-4754-9f3d-ea983d12be2c tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:53.405255 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f2de45d9-dc3c-4754-9f3d-ea983d12be2c tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:53.406023 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f2de45d9-dc3c-4754-9f3d-ea983d12be2c tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:53.406683 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f2de45d9-dc3c-4754-9f3d-ea983d12be2c tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:53.436365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6cdc7a47-4d86-4ac2-968d-6d5a47f6f9ca tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7681de64c248268da4d78124f59b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d60144477f4a5192d581350d678979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:53.450926 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6cdc7a47-4d86-4ac2-968d-6d5a47f6f9ca tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] 10.222.0.26 "GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990" status: 200 len: 1292 microversion: 2.1 time: 0.351596 Sep 17 20:53:53.452178 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 374/796] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:53 2022] GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990 => generated 1292 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:53.457062 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-46ee1987-7012-49d2-8023-7a0d48536ed8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:53.457641 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-46ee1987-7012-49d2-8023-7a0d48536ed8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:53.481164 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46ee1987-7012-49d2-8023-7a0d48536ed8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:53.481721 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46ee1987-7012-49d2-8023-7a0d48536ed8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:53.482161 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46ee1987-7012-49d2-8023-7a0d48536ed8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:53.482878 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46ee1987-7012-49d2-8023-7a0d48536ed8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:53.483356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46ee1987-7012-49d2-8023-7a0d48536ed8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:53.484017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46ee1987-7012-49d2-8023-7a0d48536ed8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:53.563277 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f2de45d9-dc3c-4754-9f3d-ea983d12be2c tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.174153 Sep 17 20:53:53.563968 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 423/797] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Sep 17 20:53:53 2022] GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25/os-interface => generated 284 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:53:53.585398 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a0106d16-09fd-42bc-8050-58abcac4e6c5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:53.597135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a0106d16-09fd-42bc-8050-58abcac4e6c5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:53.598966 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-46ee1987-7012-49d2-8023-7a0d48536ed8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:53.615372 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-46ee1987-7012-49d2-8023-7a0d48536ed8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:53.615951 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0106d16-09fd-42bc-8050-58abcac4e6c5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:53.617977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-46ee1987-7012-49d2-8023-7a0d48536ed8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:53.618113 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0106d16-09fd-42bc-8050-58abcac4e6c5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:53.618558 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0106d16-09fd-42bc-8050-58abcac4e6c5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:53.621063 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-46ee1987-7012-49d2-8023-7a0d48536ed8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 1281 microversion: 2.25 time: 0.167717 Sep 17 20:53:53.621626 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0106d16-09fd-42bc-8050-58abcac4e6c5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:53.622838 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 375/798] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:53 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 1281 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:53:53.624121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0106d16-09fd-42bc-8050-58abcac4e6c5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:53.625772 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0106d16-09fd-42bc-8050-58abcac4e6c5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:54.052440 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a0106d16-09fd-42bc-8050-58abcac4e6c5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:54.060140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:53:54.066070 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a0106d16-09fd-42bc-8050-58abcac4e6c5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1" status: 200 len: 1495 microversion: 2.1 time: 0.500110 Sep 17 20:53:54.067825 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 424/799] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:53 2022] GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 => generated 1495 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:54.133408 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e5a299cb-e0c5-4d2c-b757-50ca13f7b2ce tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:54.138224 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e5a299cb-e0c5-4d2c-b757-50ca13f7b2ce tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 59beeb15-b8ee-49e8-b739-f38a755dc102] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:54.173339 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5a299cb-e0c5-4d2c-b757-50ca13f7b2ce tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:54.188111 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5a299cb-e0c5-4d2c-b757-50ca13f7b2ce tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:54.188867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5a299cb-e0c5-4d2c-b757-50ca13f7b2ce tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:54.189838 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5a299cb-e0c5-4d2c-b757-50ca13f7b2ce tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:54.193885 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5a299cb-e0c5-4d2c-b757-50ca13f7b2ce tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:54.195344 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5a299cb-e0c5-4d2c-b757-50ca13f7b2ce tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:54.370045 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e5a299cb-e0c5-4d2c-b757-50ca13f7b2ce tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa9e5c7b7dd4a74935de34327145697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b843f5d09c94cf3916f65e815d6d7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:54.386579 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e5a299cb-e0c5-4d2c-b757-50ca13f7b2ce tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102" status: 200 len: 1276 microversion: 2.1 time: 0.268822 Sep 17 20:53:54.387739 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 425/800] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:54 2022] GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102 => generated 1276 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:54.406974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ad714018-7a75-4d5b-a113-48f927f1aa70 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:54.407608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ad714018-7a75-4d5b-a113-48f927f1aa70 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:54.433394 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad714018-7a75-4d5b-a113-48f927f1aa70 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:54.434103 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad714018-7a75-4d5b-a113-48f927f1aa70 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:54.434585 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad714018-7a75-4d5b-a113-48f927f1aa70 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:54.441893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad714018-7a75-4d5b-a113-48f927f1aa70 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:54.442610 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad714018-7a75-4d5b-a113-48f927f1aa70 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:54.443238 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad714018-7a75-4d5b-a113-48f927f1aa70 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:54.784501 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-83f68dba-f0df-4c81-8417-d9455a7ce537 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:54.789814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-83f68dba-f0df-4c81-8417-d9455a7ce537 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:54.800453 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-83f68dba-f0df-4c81-8417-d9455a7ce537 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:54.800955 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-83f68dba-f0df-4c81-8417-d9455a7ce537 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:54.801655 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-83f68dba-f0df-4c81-8417-d9455a7ce537 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:54.802811 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-83f68dba-f0df-4c81-8417-d9455a7ce537 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:54.803626 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-83f68dba-f0df-4c81-8417-d9455a7ce537 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:54.804425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-83f68dba-f0df-4c81-8417-d9455a7ce537 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:54.942937 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ad714018-7a75-4d5b-a113-48f927f1aa70 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:54.951461 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ad714018-7a75-4d5b-a113-48f927f1aa70 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1473 microversion: 2.1 time: 0.562395 Sep 17 20:53:54.962302 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 426/801] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:54 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1473 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:54.972814 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-322f015a-8b1e-450c-a5b8-c68a4fc23db9 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:54.973753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-322f015a-8b1e-450c-a5b8-c68a4fc23db9 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] [instance: 44fa7976-1412-4c83-ae29-b02e16186990] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:54.989239 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-322f015a-8b1e-450c-a5b8-c68a4fc23db9 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:54.990178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-322f015a-8b1e-450c-a5b8-c68a4fc23db9 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:54.990815 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-322f015a-8b1e-450c-a5b8-c68a4fc23db9 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:54.991554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-322f015a-8b1e-450c-a5b8-c68a4fc23db9 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:54.992014 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-322f015a-8b1e-450c-a5b8-c68a4fc23db9 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:54.994537 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-322f015a-8b1e-450c-a5b8-c68a4fc23db9 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:55.039499 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-83f68dba-f0df-4c81-8417-d9455a7ce537 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1" status: 200 len: 1646 microversion: 2.1 time: 0.949938 Sep 17 20:53:55.040906 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 376/802] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:54 2022] GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 => generated 1646 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:55.045898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-58172247-b919-414c-bc3e-433538db0b1e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:55.046728 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-58172247-b919-414c-bc3e-433538db0b1e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:55.053327 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58172247-b919-414c-bc3e-433538db0b1e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:55.054187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58172247-b919-414c-bc3e-433538db0b1e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:55.054793 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58172247-b919-414c-bc3e-433538db0b1e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:55.055674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58172247-b919-414c-bc3e-433538db0b1e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:55.056400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58172247-b919-414c-bc3e-433538db0b1e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:55.056984 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58172247-b919-414c-bc3e-433538db0b1e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:55.153839 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-58172247-b919-414c-bc3e-433538db0b1e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:55.167369 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-58172247-b919-414c-bc3e-433538db0b1e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:55.168841 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-58172247-b919-414c-bc3e-433538db0b1e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:55.170028 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-58172247-b919-414c-bc3e-433538db0b1e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 1337 microversion: 2.25 time: 0.127986 Sep 17 20:53:55.170640 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 377/803] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:55 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 1337 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:53:55.193362 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-4e3e2dfc-e76c-4648-9bc6-60591ac21991 req-b5d129bb-f85b-4261-b034-8b96e4b97ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89b39b18-ff49-4810-9701-3084736ff2d0", "tag": "67dfcd54-a56f-4269-9ed0-edf035c918b0"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:55.221041 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-4e3e2dfc-e76c-4648-9bc6-60591ac21991 req-b5d129bb-f85b-4261-b034-8b96e4b97ed9 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:55.221559 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-4e3e2dfc-e76c-4648-9bc6-60591ac21991 req-b5d129bb-f85b-4261-b034-8b96e4b97ed9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:55.222006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-4e3e2dfc-e76c-4648-9bc6-60591ac21991 req-b5d129bb-f85b-4261-b034-8b96e4b97ed9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:55.233802 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-322f015a-8b1e-450c-a5b8-c68a4fc23db9 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7681de64c248268da4d78124f59b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d60144477f4a5192d581350d678979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:55.242652 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-322f015a-8b1e-450c-a5b8-c68a4fc23db9 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] 10.222.0.26 "GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990" status: 200 len: 1292 microversion: 2.1 time: 0.278770 Sep 17 20:53:55.243503 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 427/804] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:54 2022] GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990 => generated 1292 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:55.246019 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-4e3e2dfc-e76c-4648-9bc6-60591ac21991 req-b5d129bb-f85b-4261-b034-8b96e4b97ed9 service nova] Creating event network-changed:67dfcd54-a56f-4269-9ed0-edf035c918b0 for instance 89b39b18-ff49-4810-9701-3084736ff2d0 on nch1-master-1 Sep 17 20:53:55.248480 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-16925925-637a-4e3a-b077-c6e308e08289 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:55.249313 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-16925925-637a-4e3a-b077-c6e308e08289 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:55.262030 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-16925925-637a-4e3a-b077-c6e308e08289 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:55.262740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-16925925-637a-4e3a-b077-c6e308e08289 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:55.263241 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-16925925-637a-4e3a-b077-c6e308e08289 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:55.264452 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-16925925-637a-4e3a-b077-c6e308e08289 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:55.265121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-16925925-637a-4e3a-b077-c6e308e08289 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:55.265777 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-16925925-637a-4e3a-b077-c6e308e08289 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:55.270236 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [req-4e3e2dfc-e76c-4648-9bc6-60591ac21991 req-b5d129bb-f85b-4261-b034-8b96e4b97ed9 service nova] Instance 89b39b18-ff49-4810-9701-3084736ff2d0 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140523) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 20:53:55.283873 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-4e3e2dfc-e76c-4648-9bc6-60591ac21991 req-b5d129bb-f85b-4261-b034-8b96e4b97ed9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094918 Sep 17 20:53:55.284792 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 378/805] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:53:55.411145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2e4879cd-71e8-4927-b82e-70ebf428a70d tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:55.412067 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2e4879cd-71e8-4927-b82e-70ebf428a70d tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 59beeb15-b8ee-49e8-b739-f38a755dc102] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:55.419759 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e4879cd-71e8-4927-b82e-70ebf428a70d tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:55.420513 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e4879cd-71e8-4927-b82e-70ebf428a70d tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:55.421185 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e4879cd-71e8-4927-b82e-70ebf428a70d tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:55.422887 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e4879cd-71e8-4927-b82e-70ebf428a70d tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:55.423522 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e4879cd-71e8-4927-b82e-70ebf428a70d tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:55.424458 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e4879cd-71e8-4927-b82e-70ebf428a70d tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:55.460283 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-16925925-637a-4e3a-b077-c6e308e08289 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1" status: 200 len: 1646 microversion: 2.1 time: 0.215116 Sep 17 20:53:55.474539 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 428/806] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:55 2022] GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 => generated 1646 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:55.483521 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e334628f-1e14-4a12-9e8f-738cb4370380 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:55.487571 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e334628f-1e14-4a12-9e8f-738cb4370380 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:55.488237 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e334628f-1e14-4a12-9e8f-738cb4370380 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:55.488845 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e334628f-1e14-4a12-9e8f-738cb4370380 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:55.489768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e334628f-1e14-4a12-9e8f-738cb4370380 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:55.490457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e334628f-1e14-4a12-9e8f-738cb4370380 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:55.491034 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e334628f-1e14-4a12-9e8f-738cb4370380 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:55.515172 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2e4879cd-71e8-4927-b82e-70ebf428a70d tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa9e5c7b7dd4a74935de34327145697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b843f5d09c94cf3916f65e815d6d7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:55.518744 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e334628f-1e14-4a12-9e8f-738cb4370380 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.038508 Sep 17 20:53:55.520265 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 429/807] 10.222.0.26 () {58 vars in 1176 bytes} [Sat Sep 17 20:53:55 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:53:55.532350 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2e4879cd-71e8-4927-b82e-70ebf428a70d tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102" status: 200 len: 1282 microversion: 2.1 time: 0.125355 Sep 17 20:53:55.532921 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7f51e525-2114-49be-974d-afe13509bf8c tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:55.533117 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 379/808] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:55 2022] GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102 => generated 1282 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:53:55.536460 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7f51e525-2114-49be-974d-afe13509bf8c tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:55.542804 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7f51e525-2114-49be-974d-afe13509bf8c tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:55.543292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7f51e525-2114-49be-974d-afe13509bf8c tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:55.543776 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7f51e525-2114-49be-974d-afe13509bf8c tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:55.544483 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7f51e525-2114-49be-974d-afe13509bf8c tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:55.544935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7f51e525-2114-49be-974d-afe13509bf8c tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:55.545369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7f51e525-2114-49be-974d-afe13509bf8c tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:55.574753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-7f51e525-2114-49be-974d-afe13509bf8c tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lazy-loading 'flavor' on Instance uuid 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:53:55.589288 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7f51e525-2114-49be-974d-afe13509bf8c tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Going to try to live migrate instance to nch2-master-1 {{(pid=140524) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 17 20:53:55.988163 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3d5b53c1-6b0e-45d4-91f0-a942d84d88af tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:55.988851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3d5b53c1-6b0e-45d4-91f0-a942d84d88af tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:55.996861 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3d5b53c1-6b0e-45d4-91f0-a942d84d88af tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:55.997612 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3d5b53c1-6b0e-45d4-91f0-a942d84d88af tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:55.998384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3d5b53c1-6b0e-45d4-91f0-a942d84d88af tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:55.999481 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3d5b53c1-6b0e-45d4-91f0-a942d84d88af tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:56.000458 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3d5b53c1-6b0e-45d4-91f0-a942d84d88af tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:56.001037 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3d5b53c1-6b0e-45d4-91f0-a942d84d88af tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:56.304030 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3d5b53c1-6b0e-45d4-91f0-a942d84d88af tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:56.313119 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3d5b53c1-6b0e-45d4-91f0-a942d84d88af tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1470 microversion: 2.1 time: 0.331064 Sep 17 20:53:56.317998 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 380/809] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:55 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1470 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:56.332744 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6b6fafb9-1727-4424-aae2-8d4a41442954 tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Calling method '.version_select at 0x7f25a59679d0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:56.431576 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6b6fafb9-1727-4424-aae2-8d4a41442954 tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] 10.222.0.26 "GET /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f" status: 200 len: 636 microversion: 2.1 time: 0.108625 Sep 17 20:53:56.433407 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 381/810] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:53:56 2022] GET /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f => generated 636 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:53:56.450668 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-300bcf48-6fe6-4f1b-a3aa-f8a78ff1f0c5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:56.453741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-300bcf48-6fe6-4f1b-a3aa-f8a78ff1f0c5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:56.482027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-300bcf48-6fe6-4f1b-a3aa-f8a78ff1f0c5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:56.482625 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-300bcf48-6fe6-4f1b-a3aa-f8a78ff1f0c5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:56.483136 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-300bcf48-6fe6-4f1b-a3aa-f8a78ff1f0c5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:56.483950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-300bcf48-6fe6-4f1b-a3aa-f8a78ff1f0c5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:56.484552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-300bcf48-6fe6-4f1b-a3aa-f8a78ff1f0c5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:56.485302 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-300bcf48-6fe6-4f1b-a3aa-f8a78ff1f0c5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:56.581130 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-300bcf48-6fe6-4f1b-a3aa-f8a78ff1f0c5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:56.592323 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-300bcf48-6fe6-4f1b-a3aa-f8a78ff1f0c5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:56.594073 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-300bcf48-6fe6-4f1b-a3aa-f8a78ff1f0c5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:56.595673 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-300bcf48-6fe6-4f1b-a3aa-f8a78ff1f0c5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 1343 microversion: 2.25 time: 0.159028 Sep 17 20:53:56.610003 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 382/811] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:56 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 1343 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:53:56.620379 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0d82a6cd-02a2-458c-b597-5a53cfb74a02 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:56.621311 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0d82a6cd-02a2-458c-b597-5a53cfb74a02 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] [instance: 44fa7976-1412-4c83-ae29-b02e16186990] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:56.628674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d82a6cd-02a2-458c-b597-5a53cfb74a02 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:56.629280 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d82a6cd-02a2-458c-b597-5a53cfb74a02 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:56.629785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d82a6cd-02a2-458c-b597-5a53cfb74a02 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:56.630687 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d82a6cd-02a2-458c-b597-5a53cfb74a02 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:56.632238 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d82a6cd-02a2-458c-b597-5a53cfb74a02 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:56.633173 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d82a6cd-02a2-458c-b597-5a53cfb74a02 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:56.860235 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0d82a6cd-02a2-458c-b597-5a53cfb74a02 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7681de64c248268da4d78124f59b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d60144477f4a5192d581350d678979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:56.875781 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0d82a6cd-02a2-458c-b597-5a53cfb74a02 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] 10.222.0.26 "GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990" status: 200 len: 1292 microversion: 2.1 time: 0.263146 Sep 17 20:53:56.877942 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 383/812] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:56 2022] GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990 => generated 1292 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:56.884893 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1a5de460-ea4d-4c74-82fd-d8ba43d1df30 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:56.885712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1a5de460-ea4d-4c74-82fd-d8ba43d1df30 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:56.893125 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a5de460-ea4d-4c74-82fd-d8ba43d1df30 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:56.894803 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a5de460-ea4d-4c74-82fd-d8ba43d1df30 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:56.896283 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a5de460-ea4d-4c74-82fd-d8ba43d1df30 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:56.897248 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a5de460-ea4d-4c74-82fd-d8ba43d1df30 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:56.897980 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a5de460-ea4d-4c74-82fd-d8ba43d1df30 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:56.898696 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a5de460-ea4d-4c74-82fd-d8ba43d1df30 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:56.968905 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a5de460-ea4d-4c74-82fd-d8ba43d1df30 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:56.969923 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a5de460-ea4d-4c74-82fd-d8ba43d1df30 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:56.985900 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a5de460-ea4d-4c74-82fd-d8ba43d1df30 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:56.988670 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a5de460-ea4d-4c74-82fd-d8ba43d1df30 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:56.989239 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a5de460-ea4d-4c74-82fd-d8ba43d1df30 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:57.002776 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a5de460-ea4d-4c74-82fd-d8ba43d1df30 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:57.062061 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-1a5de460-ea4d-4c74-82fd-d8ba43d1df30 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Getting quotas for project 07ce9fd746374b478a743261eb014e5c. Resources: {'cores', 'ram'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:53:57.070353 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-1a5de460-ea4d-4c74-82fd-d8ba43d1df30 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Getting quotas for user 226a87a1f393420b8d19ec2390e9d063 and project 07ce9fd746374b478a743261eb014e5c. Resources: {'cores', 'ram'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:53:57.275962 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1a5de460-ea4d-4c74-82fd-d8ba43d1df30 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "POST /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0/action" status: 202 len: 0 microversion: 2.1 time: 0.396335 Sep 17 20:53:57.277233 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 384/813] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:53:56 2022] POST /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:53:57.292332 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9aa38385-50e3-4ef8-a083-1b14a237a807 tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Action: 'update_all', calling method: .version_select at 0x7f25a583f160>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:57.412715 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-9aa38385-50e3-4ef8-a083-1b14a237a807 tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Getting quotas for project db3f74611f1840c282454eb53c4063d5. Resources: dict_keys(['metadata_items']) {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:53:57.418013 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-9aa38385-50e3-4ef8-a083-1b14a237a807 tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Getting quotas for user 79370e0ba5674f9ea8c09ad7aa1828fe and project db3f74611f1840c282454eb53c4063d5. Resources: dict_keys(['metadata_items']) {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:53:57.686496 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7f51e525-2114-49be-974d-afe13509bf8c tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1/action" status: 202 len: 0 microversion: 2.1 time: 2.157290 Sep 17 20:53:57.698739 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 430/814] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:53:55 2022] POST /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1/action => generated 0 bytes in 2170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 17 20:53:57.703958 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c9b0c6a2-e435-41f1-943e-10795cdb9dc5 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:57.704836 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c9b0c6a2-e435-41f1-943e-10795cdb9dc5 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 59beeb15-b8ee-49e8-b739-f38a755dc102] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:57.727028 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9b0c6a2-e435-41f1-943e-10795cdb9dc5 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:57.731849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9b0c6a2-e435-41f1-943e-10795cdb9dc5 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:57.732542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9b0c6a2-e435-41f1-943e-10795cdb9dc5 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:57.733526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9b0c6a2-e435-41f1-943e-10795cdb9dc5 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:57.734217 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9b0c6a2-e435-41f1-943e-10795cdb9dc5 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:57.735534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9b0c6a2-e435-41f1-943e-10795cdb9dc5 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:57.877401 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9aa38385-50e3-4ef8-a083-1b14a237a807 tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] 10.222.0.26 "PUT /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.598837 Sep 17 20:53:57.878345 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 385/815] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 17 20:53:57 2022] PUT /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f/metadata => generated 61 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:53:57.886133 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c8073a91-7eb1-4139-9d9c-d52b1695b03f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:57.887348 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c8073a91-7eb1-4139-9d9c-d52b1695b03f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:57.896890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8073a91-7eb1-4139-9d9c-d52b1695b03f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:57.897602 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8073a91-7eb1-4139-9d9c-d52b1695b03f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:57.898473 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8073a91-7eb1-4139-9d9c-d52b1695b03f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:57.899465 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8073a91-7eb1-4139-9d9c-d52b1695b03f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:57.901849 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8073a91-7eb1-4139-9d9c-d52b1695b03f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:57.902847 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8073a91-7eb1-4139-9d9c-d52b1695b03f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:58.081653 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c9b0c6a2-e435-41f1-943e-10795cdb9dc5 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa9e5c7b7dd4a74935de34327145697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b843f5d09c94cf3916f65e815d6d7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:58.093446 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c9b0c6a2-e435-41f1-943e-10795cdb9dc5 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102" status: 200 len: 1324 microversion: 2.1 time: 0.393360 Sep 17 20:53:58.097429 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 431/816] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:57 2022] GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102 => generated 1324 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:58.103546 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e2572d32-9f5a-4c72-96cf-b1332a0284bb tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:58.109675 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e2572d32-9f5a-4c72-96cf-b1332a0284bb tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: a9ab9592-fc9c-4ec4-bf25-6ffb49440f25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:58.119972 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2572d32-9f5a-4c72-96cf-b1332a0284bb tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:58.123549 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2572d32-9f5a-4c72-96cf-b1332a0284bb tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:58.124172 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2572d32-9f5a-4c72-96cf-b1332a0284bb tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:58.125857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2572d32-9f5a-4c72-96cf-b1332a0284bb tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:58.128176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2572d32-9f5a-4c72-96cf-b1332a0284bb tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:58.128802 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2572d32-9f5a-4c72-96cf-b1332a0284bb tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:58.331799 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c8073a91-7eb1-4139-9d9c-d52b1695b03f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:58.346024 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c8073a91-7eb1-4139-9d9c-d52b1695b03f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1469 microversion: 2.1 time: 0.466436 Sep 17 20:53:58.347114 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 386/817] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:57 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1469 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:58.366239 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-aaac5944-3130-49de-991c-17e8b22d79f2 req-8b584062-e696-4a1b-b786-f8f8a53211ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9ab9592-fc9c-4ec4-bf25-6ffb49440f25", "tag": "23b1a85d-8b5b-4c32-8ff8-5e4c1672d0d4"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:58.378014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-aaac5944-3130-49de-991c-17e8b22d79f2 req-8b584062-e696-4a1b-b786-f8f8a53211ae service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:58.378497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-aaac5944-3130-49de-991c-17e8b22d79f2 req-8b584062-e696-4a1b-b786-f8f8a53211ae service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:58.378929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-aaac5944-3130-49de-991c-17e8b22d79f2 req-8b584062-e696-4a1b-b786-f8f8a53211ae service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:58.394311 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-aaac5944-3130-49de-991c-17e8b22d79f2 req-8b584062-e696-4a1b-b786-f8f8a53211ae service nova] Creating event network-changed:23b1a85d-8b5b-4c32-8ff8-5e4c1672d0d4 for instance a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 on nch1-master-1 Sep 17 20:53:58.407278 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-aaac5944-3130-49de-991c-17e8b22d79f2 req-8b584062-e696-4a1b-b786-f8f8a53211ae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058731 Sep 17 20:53:58.408213 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 387/818] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:53:58.421732 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f69991aa-0b8d-4023-bcf9-e00dae5eba4c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:58.428003 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f69991aa-0b8d-4023-bcf9-e00dae5eba4c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:58.444301 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f69991aa-0b8d-4023-bcf9-e00dae5eba4c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:58.444813 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f69991aa-0b8d-4023-bcf9-e00dae5eba4c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:58.445285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f69991aa-0b8d-4023-bcf9-e00dae5eba4c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:58.453728 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f69991aa-0b8d-4023-bcf9-e00dae5eba4c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:58.454467 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f69991aa-0b8d-4023-bcf9-e00dae5eba4c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:58.454931 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f69991aa-0b8d-4023-bcf9-e00dae5eba4c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:58.473813 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e2572d32-9f5a-4c72-96cf-b1332a0284bb tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f7c0fdad9346c58949928300021b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f305d163acf499c9808c5f11150a7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:58.483753 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e2572d32-9f5a-4c72-96cf-b1332a0284bb tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25" status: 200 len: 1588 microversion: 2.1 time: 0.385019 Sep 17 20:53:58.491509 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 432/819] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:58 2022] GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 => generated 1588 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:58.497231 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-187783cb-6bf6-4c36-9c04-77570c53a99f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:58.498201 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-187783cb-6bf6-4c36-9c04-77570c53a99f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:58.510895 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-187783cb-6bf6-4c36-9c04-77570c53a99f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:58.515386 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-187783cb-6bf6-4c36-9c04-77570c53a99f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:58.515844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-187783cb-6bf6-4c36-9c04-77570c53a99f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:58.516612 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-187783cb-6bf6-4c36-9c04-77570c53a99f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:58.517060 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-187783cb-6bf6-4c36-9c04-77570c53a99f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:58.517525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-187783cb-6bf6-4c36-9c04-77570c53a99f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:58.560459 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f69991aa-0b8d-4023-bcf9-e00dae5eba4c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:58.577714 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f69991aa-0b8d-4023-bcf9-e00dae5eba4c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:58.580197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f69991aa-0b8d-4023-bcf9-e00dae5eba4c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:58.581386 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f69991aa-0b8d-4023-bcf9-e00dae5eba4c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 1343 microversion: 2.25 time: 0.171964 Sep 17 20:53:58.582025 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 388/820] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:58 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 1343 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:53:58.608265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-df1122f3-fadc-4e9b-8d00-6ea10f13724d tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Calling method '.version_select at 0x7f25a5801790>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:58.854815 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-187783cb-6bf6-4c36-9c04-77570c53a99f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:58.863982 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-187783cb-6bf6-4c36-9c04-77570c53a99f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1" status: 200 len: 1505 microversion: 2.1 time: 0.371200 Sep 17 20:53:58.864896 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 433/821] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:58 2022] GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 => generated 1505 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:58.884753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-764099b5-add1-4afa-8861-68c2381b3ac1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:58.886139 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-764099b5-add1-4afa-8861-68c2381b3ac1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] [instance: 44fa7976-1412-4c83-ae29-b02e16186990] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:58.895341 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-764099b5-add1-4afa-8861-68c2381b3ac1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:58.897067 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-764099b5-add1-4afa-8861-68c2381b3ac1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:58.897977 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-764099b5-add1-4afa-8861-68c2381b3ac1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:58.899510 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-764099b5-add1-4afa-8861-68c2381b3ac1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:58.904394 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-764099b5-add1-4afa-8861-68c2381b3ac1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:58.905078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-764099b5-add1-4afa-8861-68c2381b3ac1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:58.935286 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-df1122f3-fadc-4e9b-8d00-6ea10f13724d tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] 10.222.0.26 "DELETE /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.330382 Sep 17 20:53:58.941136 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 389/822] 10.222.0.26 () {58 vars in 1296 bytes} [Sat Sep 17 20:53:58 2022] DELETE /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f/metadata/os_version => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:53:58.946923 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b765a75a-40e1-44e2-81a7-c61cdaa3a62d tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Calling method '.version_select at 0x7f25a66b3700>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:58.994748 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b765a75a-40e1-44e2-81a7-c61cdaa3a62d tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] 10.222.0.26 "GET /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f/metadata" status: 200 len: 37 microversion: 2.1 time: 0.052318 Sep 17 20:53:58.995642 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 390/823] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Sep 17 20:53:58 2022] GET /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f/metadata => generated 37 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:53:59.006720 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-49887d1f-b438-4afd-a82f-acf0e48097e3 tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Action: 'update_all', calling method: .version_select at 0x7f25a58019d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:59.064436 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-49887d1f-b438-4afd-a82f-acf0e48097e3 tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Getting quotas for project db3f74611f1840c282454eb53c4063d5. Resources: dict_keys(['metadata_items']) {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:53:59.070266 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-49887d1f-b438-4afd-a82f-acf0e48097e3 tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Getting quotas for user 79370e0ba5674f9ea8c09ad7aa1828fe and project db3f74611f1840c282454eb53c4063d5. Resources: dict_keys(['metadata_items']) {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:53:59.218385 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-764099b5-add1-4afa-8861-68c2381b3ac1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7681de64c248268da4d78124f59b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d60144477f4a5192d581350d678979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:59.227186 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-764099b5-add1-4afa-8861-68c2381b3ac1 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] 10.222.0.26 "GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990" status: 200 len: 1292 microversion: 2.1 time: 0.360698 Sep 17 20:53:59.228254 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 434/824] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:58 2022] GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990 => generated 1292 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:59.233639 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-19863078-fb87-4f9b-9be5-633d4cdc7baa tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:59.234675 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-19863078-fb87-4f9b-9be5-633d4cdc7baa tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 59beeb15-b8ee-49e8-b739-f38a755dc102] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:59.241579 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-19863078-fb87-4f9b-9be5-633d4cdc7baa tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:59.242437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-19863078-fb87-4f9b-9be5-633d4cdc7baa tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:59.243100 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-19863078-fb87-4f9b-9be5-633d4cdc7baa tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:59.244154 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-19863078-fb87-4f9b-9be5-633d4cdc7baa tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:59.245030 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-19863078-fb87-4f9b-9be5-633d4cdc7baa tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:59.245733 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-19863078-fb87-4f9b-9be5-633d4cdc7baa tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:59.365955 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-49887d1f-b438-4afd-a82f-acf0e48097e3 tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] 10.222.0.26 "PUT /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.363183 Sep 17 20:53:59.366591 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 391/825] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 17 20:53:59 2022] PUT /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f/metadata => generated 61 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:53:59.376397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-e841ea5c-7252-4437-a763-a68073aa3bcb req-f390d233-916e-48d6-975d-7bebe3d2fd39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89b39b18-ff49-4810-9701-3084736ff2d0", "name": "network-vif-plugged", "status": "completed", "tag": "67dfcd54-a56f-4269-9ed0-edf035c918b0"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:59.386505 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-e841ea5c-7252-4437-a763-a68073aa3bcb req-f390d233-916e-48d6-975d-7bebe3d2fd39 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:59.386990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-e841ea5c-7252-4437-a763-a68073aa3bcb req-f390d233-916e-48d6-975d-7bebe3d2fd39 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:59.387428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-e841ea5c-7252-4437-a763-a68073aa3bcb req-f390d233-916e-48d6-975d-7bebe3d2fd39 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:59.408449 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-e841ea5c-7252-4437-a763-a68073aa3bcb req-f390d233-916e-48d6-975d-7bebe3d2fd39 service nova] Creating event network-vif-plugged:67dfcd54-a56f-4269-9ed0-edf035c918b0 for instance 89b39b18-ff49-4810-9701-3084736ff2d0 on nch1-master-1 Sep 17 20:53:59.412152 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:53:59.416312 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [req-e841ea5c-7252-4437-a763-a68073aa3bcb req-f390d233-916e-48d6-975d-7bebe3d2fd39 service nova] Instance 89b39b18-ff49-4810-9701-3084736ff2d0 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140523) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 20:53:59.450680 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-e841ea5c-7252-4437-a763-a68073aa3bcb req-f390d233-916e-48d6-975d-7bebe3d2fd39 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077189 Sep 17 20:53:59.452939 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 392/826] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:53:59.460181 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-50613918-c97c-4b6a-b477-6927e8c1cc58 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:59.461020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-50613918-c97c-4b6a-b477-6927e8c1cc58 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:59.469147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-50613918-c97c-4b6a-b477-6927e8c1cc58 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:59.469712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-50613918-c97c-4b6a-b477-6927e8c1cc58 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:59.470384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-50613918-c97c-4b6a-b477-6927e8c1cc58 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:59.472569 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-50613918-c97c-4b6a-b477-6927e8c1cc58 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:59.473165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-50613918-c97c-4b6a-b477-6927e8c1cc58 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:59.473851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-50613918-c97c-4b6a-b477-6927e8c1cc58 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:59.499990 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-19863078-fb87-4f9b-9be5-633d4cdc7baa tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa9e5c7b7dd4a74935de34327145697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b843f5d09c94cf3916f65e815d6d7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:59.510742 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-19863078-fb87-4f9b-9be5-633d4cdc7baa tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102" status: 200 len: 1324 microversion: 2.1 time: 0.281028 Sep 17 20:53:59.529975 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 435/827] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:59 2022] GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102 => generated 1324 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:59.537250 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5fa47483-ee64-4f1b-bb0c-11b97e7f8c99 tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Calling method '.version_select at 0x7f25a5715790>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:59.583010 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5fa47483-ee64-4f1b-bb0c-11b97e7f8c99 tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] 10.222.0.26 "GET /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.051494 Sep 17 20:53:59.589713 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 436/828] 10.222.0.26 () {58 vars in 1290 bytes} [Sat Sep 17 20:53:59 2022] GET /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f/metadata/os_distro => generated 33 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:53:59.595888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-49bbda58-c7ad-43c6-806f-8b6c39e99184 tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Action: 'update_all', calling method: .version_select at 0x7f25a5716040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:53:59.662469 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-49bbda58-c7ad-43c6-806f-8b6c39e99184 tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Getting quotas for project db3f74611f1840c282454eb53c4063d5. Resources: dict_keys(['metadata_items']) {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:53:59.667982 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-49bbda58-c7ad-43c6-806f-8b6c39e99184 tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Getting quotas for user 79370e0ba5674f9ea8c09ad7aa1828fe and project db3f74611f1840c282454eb53c4063d5. Resources: dict_keys(['metadata_items']) {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:53:59.889872 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-49bbda58-c7ad-43c6-806f-8b6c39e99184 tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] 10.222.0.26 "PUT /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.298631 Sep 17 20:53:59.891191 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 437/829] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 17 20:53:59 2022] PUT /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f/metadata => generated 61 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:53:59.896377 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bc008753-1928-4653-ac0a-eebce569e61a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:59.897007 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bc008753-1928-4653-ac0a-eebce569e61a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:59.903457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc008753-1928-4653-ac0a-eebce569e61a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:59.903943 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc008753-1928-4653-ac0a-eebce569e61a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:59.904380 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc008753-1928-4653-ac0a-eebce569e61a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:59.905080 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc008753-1928-4653-ac0a-eebce569e61a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:59.905554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc008753-1928-4653-ac0a-eebce569e61a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:59.905975 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc008753-1928-4653-ac0a-eebce569e61a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:59.952494 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-50613918-c97c-4b6a-b477-6927e8c1cc58 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:53:59.960796 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-50613918-c97c-4b6a-b477-6927e8c1cc58 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1469 microversion: 2.1 time: 0.506059 Sep 17 20:53:59.961385 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 393/830] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:59 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1469 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:53:59.966601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4204bba9-aabd-4972-9f5a-959adf89a5fe tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:53:59.967382 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4204bba9-aabd-4972-9f5a-959adf89a5fe tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:53:59.975554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4204bba9-aabd-4972-9f5a-959adf89a5fe tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:59.976264 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4204bba9-aabd-4972-9f5a-959adf89a5fe tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:59.976935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4204bba9-aabd-4972-9f5a-959adf89a5fe tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:53:59.978014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4204bba9-aabd-4972-9f5a-959adf89a5fe tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:53:59.978502 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4204bba9-aabd-4972-9f5a-959adf89a5fe tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:53:59.978923 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4204bba9-aabd-4972-9f5a-959adf89a5fe tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:00.186120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bc008753-1928-4653-ac0a-eebce569e61a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:00.196445 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bc008753-1928-4653-ac0a-eebce569e61a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:00.197998 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bc008753-1928-4653-ac0a-eebce569e61a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:00.199402 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bc008753-1928-4653-ac0a-eebce569e61a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 1411 microversion: 2.25 time: 0.307120 Sep 17 20:54:00.200232 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 438/831] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:53:59 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 1411 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:54:00.239308 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-95f13d82-83ac-4749-8145-ab047dff33e9 tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Calling method '.version_select at 0x7f25a5716310>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:00.284965 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4204bba9-aabd-4972-9f5a-959adf89a5fe tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:00.294496 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4204bba9-aabd-4972-9f5a-959adf89a5fe tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1" status: 200 len: 1505 microversion: 2.1 time: 0.331763 Sep 17 20:54:00.295654 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 394/832] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:53:59 2022] GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 => generated 1505 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:00.305352 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-49fcfc59-5dad-4398-af29-78db4b1eae31 req-3fdac631-cae5-4d43-93db-5ad721ff7f1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f598b03-b7f1-42ce-a5b0-2c140bde7ba1", "name": "network-vif-unplugged", "status": "completed", "tag": "a8ad5af8-55a2-4214-b840-cef45bde3c20"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:00.314549 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-95f13d82-83ac-4749-8145-ab047dff33e9 tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] 10.222.0.26 "GET /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.096948 Sep 17 20:54:00.315292 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 439/833] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Sep 17 20:54:00 2022] GET /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f/metadata => generated 61 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:54:00.324437 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-49fcfc59-5dad-4398-af29-78db4b1eae31 req-3fdac631-cae5-4d43-93db-5ad721ff7f1e service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:00.324928 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-49fcfc59-5dad-4398-af29-78db4b1eae31 req-3fdac631-cae5-4d43-93db-5ad721ff7f1e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:00.325365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-49fcfc59-5dad-4398-af29-78db4b1eae31 req-3fdac631-cae5-4d43-93db-5ad721ff7f1e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:00.327139 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c0f7e6d3-5aa4-4b3b-8d9b-03fbeaa9fcc0 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:00.328036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c0f7e6d3-5aa4-4b3b-8d9b-03fbeaa9fcc0 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] [instance: 44fa7976-1412-4c83-ae29-b02e16186990] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:00.334654 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0f7e6d3-5aa4-4b3b-8d9b-03fbeaa9fcc0 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:00.335138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0f7e6d3-5aa4-4b3b-8d9b-03fbeaa9fcc0 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:00.335762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0f7e6d3-5aa4-4b3b-8d9b-03fbeaa9fcc0 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:00.336648 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0f7e6d3-5aa4-4b3b-8d9b-03fbeaa9fcc0 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:00.338030 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0f7e6d3-5aa4-4b3b-8d9b-03fbeaa9fcc0 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:00.338659 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0f7e6d3-5aa4-4b3b-8d9b-03fbeaa9fcc0 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:00.340319 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-49fcfc59-5dad-4398-af29-78db4b1eae31 req-3fdac631-cae5-4d43-93db-5ad721ff7f1e service nova] Creating event network-vif-unplugged:a8ad5af8-55a2-4214-b840-cef45bde3c20 for instance 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 on nch1-master-1 Sep 17 20:54:00.347879 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-49fcfc59-5dad-4398-af29-78db4b1eae31 req-3fdac631-cae5-4d43-93db-5ad721ff7f1e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050540 Sep 17 20:54:00.348922 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 395/834] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:54:00.355697 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-18dcc9fd-c879-46d6-9b3e-00dc5084f1d0 tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Action: 'update_all', calling method: .version_select at 0x7f25a5773c10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:00.419926 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-18dcc9fd-c879-46d6-9b3e-00dc5084f1d0 tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Getting quotas for project db3f74611f1840c282454eb53c4063d5. Resources: dict_keys(['metadata_items']) {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:54:00.426726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-18dcc9fd-c879-46d6-9b3e-00dc5084f1d0 tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Getting quotas for user 79370e0ba5674f9ea8c09ad7aa1828fe and project db3f74611f1840c282454eb53c4063d5. Resources: dict_keys(['metadata_items']) {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:54:00.442053 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:54:00.618865 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-18dcc9fd-c879-46d6-9b3e-00dc5084f1d0 tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] 10.222.0.26 "PUT /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.268480 Sep 17 20:54:00.624091 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 396/835] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 17 20:54:00 2022] PUT /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f/metadata => generated 61 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:54:00.625215 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-3828e3c9-2ca5-4374-a378-f75a48e86722 req-089a591a-44a6-48d0-92ad-9ff3e4504a92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59beeb15-b8ee-49e8-b739-f38a755dc102", "tag": "eadc612b-7bf9-4d2b-b813-686741311705"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:00.636437 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-3828e3c9-2ca5-4374-a378-f75a48e86722 req-089a591a-44a6-48d0-92ad-9ff3e4504a92 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:00.637237 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-3828e3c9-2ca5-4374-a378-f75a48e86722 req-089a591a-44a6-48d0-92ad-9ff3e4504a92 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:00.637882 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-3828e3c9-2ca5-4374-a378-f75a48e86722 req-089a591a-44a6-48d0-92ad-9ff3e4504a92 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:00.649912 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-3828e3c9-2ca5-4374-a378-f75a48e86722 req-089a591a-44a6-48d0-92ad-9ff3e4504a92 service nova] Creating event network-changed:eadc612b-7bf9-4d2b-b813-686741311705 for instance 59beeb15-b8ee-49e8-b739-f38a755dc102 on nch1-master-1 Sep 17 20:54:00.655498 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-3828e3c9-2ca5-4374-a378-f75a48e86722 req-089a591a-44a6-48d0-92ad-9ff3e4504a92 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034240 Sep 17 20:54:00.656500 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 397/836] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:54:00.662129 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-10c328b0-09f4-4d8a-8893-9ae803100b03 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:00.662908 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-10c328b0-09f4-4d8a-8893-9ae803100b03 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 59beeb15-b8ee-49e8-b739-f38a755dc102] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:00.675636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10c328b0-09f4-4d8a-8893-9ae803100b03 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:00.676565 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10c328b0-09f4-4d8a-8893-9ae803100b03 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:00.677289 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10c328b0-09f4-4d8a-8893-9ae803100b03 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:00.678940 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10c328b0-09f4-4d8a-8893-9ae803100b03 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:00.679629 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10c328b0-09f4-4d8a-8893-9ae803100b03 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:00.697935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10c328b0-09f4-4d8a-8893-9ae803100b03 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:00.898318 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c0f7e6d3-5aa4-4b3b-8d9b-03fbeaa9fcc0 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7681de64c248268da4d78124f59b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d60144477f4a5192d581350d678979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:00.909245 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c0f7e6d3-5aa4-4b3b-8d9b-03fbeaa9fcc0 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] 10.222.0.26 "GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990" status: 200 len: 1292 microversion: 2.1 time: 0.585828 Sep 17 20:54:00.921605 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 440/837] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:00 2022] GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990 => generated 1292 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:00.928339 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4edefe79-77c1-4ca1-9033-6e9fae02212a tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Action: 'update_all', calling method: .version_select at 0x7f25a5725310>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:00.993245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-4edefe79-77c1-4ca1-9033-6e9fae02212a tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Getting quotas for project db3f74611f1840c282454eb53c4063d5. Resources: dict_keys(['metadata_items']) {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:54:00.998052 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-4edefe79-77c1-4ca1-9033-6e9fae02212a tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Getting quotas for user 79370e0ba5674f9ea8c09ad7aa1828fe and project db3f74611f1840c282454eb53c4063d5. Resources: dict_keys(['metadata_items']) {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:54:01.021414 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-10c328b0-09f4-4d8a-8893-9ae803100b03 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa9e5c7b7dd4a74935de34327145697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b843f5d09c94cf3916f65e815d6d7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:01.030759 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-10c328b0-09f4-4d8a-8893-9ae803100b03 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102" status: 200 len: 1324 microversion: 2.1 time: 0.372889 Sep 17 20:54:01.031684 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 398/838] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:00 2022] GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102 => generated 1324 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:01.037293 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-573871cf-cda2-4bf7-b661-83e199ed97bb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:01.038078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-573871cf-cda2-4bf7-b661-83e199ed97bb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:01.056293 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-573871cf-cda2-4bf7-b661-83e199ed97bb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:01.057030 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-573871cf-cda2-4bf7-b661-83e199ed97bb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:01.057687 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-573871cf-cda2-4bf7-b661-83e199ed97bb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:01.058926 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-573871cf-cda2-4bf7-b661-83e199ed97bb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:01.059877 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-573871cf-cda2-4bf7-b661-83e199ed97bb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:01.060709 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-573871cf-cda2-4bf7-b661-83e199ed97bb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:01.305837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-573871cf-cda2-4bf7-b661-83e199ed97bb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:01.315447 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-573871cf-cda2-4bf7-b661-83e199ed97bb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1469 microversion: 2.1 time: 0.282451 Sep 17 20:54:01.332524 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 399/839] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:01 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1469 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:01.340816 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-90087758-d932-4c38-89d9-6d2255c39481 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:01.342275 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-90087758-d932-4c38-89d9-6d2255c39481 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:01.349128 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90087758-d932-4c38-89d9-6d2255c39481 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:01.349867 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90087758-d932-4c38-89d9-6d2255c39481 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:01.350523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90087758-d932-4c38-89d9-6d2255c39481 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:01.351463 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90087758-d932-4c38-89d9-6d2255c39481 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:01.352155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90087758-d932-4c38-89d9-6d2255c39481 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:01.352834 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90087758-d932-4c38-89d9-6d2255c39481 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:01.511570 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4edefe79-77c1-4ca1-9033-6e9fae02212a tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] 10.222.0.26 "PUT /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f/metadata" status: 200 len: 64 microversion: 2.1 time: 0.598612 Sep 17 20:54:01.513125 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 441/840] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 17 20:54:00 2022] PUT /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f/metadata => generated 64 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:54:01.519008 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0947ea91-af87-436e-a7b0-94b77a1ad52e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:01.519484 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-90087758-d932-4c38-89d9-6d2255c39481 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:01.520498 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0947ea91-af87-436e-a7b0-94b77a1ad52e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:01.529854 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0947ea91-af87-436e-a7b0-94b77a1ad52e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:01.531020 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0947ea91-af87-436e-a7b0-94b77a1ad52e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:01.531700 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0947ea91-af87-436e-a7b0-94b77a1ad52e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:01.533025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0947ea91-af87-436e-a7b0-94b77a1ad52e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:01.534754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0947ea91-af87-436e-a7b0-94b77a1ad52e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:01.535252 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0947ea91-af87-436e-a7b0-94b77a1ad52e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:01.535685 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-90087758-d932-4c38-89d9-6d2255c39481 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:01.537393 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-90087758-d932-4c38-89d9-6d2255c39481 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:01.538587 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-90087758-d932-4c38-89d9-6d2255c39481 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 1411 microversion: 2.25 time: 0.208607 Sep 17 20:54:01.539205 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 400/841] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:54:01 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 1411 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:54:01.553326 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-7194eefd-ff10-475b-9bd2-75e260ea7691 req-495afc88-61ac-424b-b30c-30284a9164bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44fa7976-1412-4c83-ae29-b02e16186990", "name": "network-vif-plugged", "status": "completed", "tag": "7125d3dc-3622-46b0-a3c6-b60d56b537b5"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:01.569859 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-7194eefd-ff10-475b-9bd2-75e260ea7691 req-495afc88-61ac-424b-b30c-30284a9164bf service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:01.570677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-7194eefd-ff10-475b-9bd2-75e260ea7691 req-495afc88-61ac-424b-b30c-30284a9164bf service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:01.571346 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-7194eefd-ff10-475b-9bd2-75e260ea7691 req-495afc88-61ac-424b-b30c-30284a9164bf service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:01.587256 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-7194eefd-ff10-475b-9bd2-75e260ea7691 req-495afc88-61ac-424b-b30c-30284a9164bf service nova] Creating event network-vif-plugged:7125d3dc-3622-46b0-a3c6-b60d56b537b5 for instance 44fa7976-1412-4c83-ae29-b02e16186990 on nch2-master-1 Sep 17 20:54:01.595386 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-7194eefd-ff10-475b-9bd2-75e260ea7691 req-495afc88-61ac-424b-b30c-30284a9164bf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053978 Sep 17 20:54:01.596180 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 401/842] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:54:01.601648 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-836a4b9e-84d0-41d1-b943-135c0e77458e tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Calling method '.version_select at 0x7f25a5e41d30>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:01.649758 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-836a4b9e-84d0-41d1-b943-135c0e77458e tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] 10.222.0.26 "GET /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f/metadata" status: 200 len: 64 microversion: 2.1 time: 0.051896 Sep 17 20:54:01.650345 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 402/843] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Sep 17 20:54:01 2022] GET /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f/metadata => generated 64 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:54:01.661446 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e2ed1732-ae15-409e-aacf-70a75f7d91f6 tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Action: 'update_all', calling method: .version_select at 0x7f25a5b2cdc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:01.706352 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0947ea91-af87-436e-a7b0-94b77a1ad52e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:01.714299 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0947ea91-af87-436e-a7b0-94b77a1ad52e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1" status: 200 len: 1505 microversion: 2.1 time: 0.199904 Sep 17 20:54:01.722968 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-e2ed1732-ae15-409e-aacf-70a75f7d91f6 tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Getting quotas for project db3f74611f1840c282454eb53c4063d5. Resources: dict_keys(['metadata_items']) {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:54:01.727173 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-e2ed1732-ae15-409e-aacf-70a75f7d91f6 tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Getting quotas for user 79370e0ba5674f9ea8c09ad7aa1828fe and project db3f74611f1840c282454eb53c4063d5. Resources: dict_keys(['metadata_items']) {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:54:01.730140 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 442/844] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:01 2022] GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 => generated 1505 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:01.934678 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f270c39f-b118-448e-8502-dd26d865f175 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:01.935286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f270c39f-b118-448e-8502-dd26d865f175 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] [instance: 44fa7976-1412-4c83-ae29-b02e16186990] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:01.942238 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f270c39f-b118-448e-8502-dd26d865f175 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:01.942727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f270c39f-b118-448e-8502-dd26d865f175 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:01.943161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f270c39f-b118-448e-8502-dd26d865f175 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:01.943884 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f270c39f-b118-448e-8502-dd26d865f175 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:01.944333 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f270c39f-b118-448e-8502-dd26d865f175 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:01.944753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f270c39f-b118-448e-8502-dd26d865f175 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:02.050998 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e2ed1732-ae15-409e-aacf-70a75f7d91f6 tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] 10.222.0.26 "PUT /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.393107 Sep 17 20:54:02.063053 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 403/845] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 17 20:54:01 2022] PUT /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f/metadata => generated 61 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:54:02.071306 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ba127c58-2d06-4a6f-be65-a8231b0584bd tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:02.072647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ba127c58-2d06-4a6f-be65-a8231b0584bd tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 59beeb15-b8ee-49e8-b739-f38a755dc102] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:02.083841 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ba127c58-2d06-4a6f-be65-a8231b0584bd tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:02.084814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ba127c58-2d06-4a6f-be65-a8231b0584bd tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:02.085717 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ba127c58-2d06-4a6f-be65-a8231b0584bd tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:02.087083 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ba127c58-2d06-4a6f-be65-a8231b0584bd tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:02.087904 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ba127c58-2d06-4a6f-be65-a8231b0584bd tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:02.088671 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ba127c58-2d06-4a6f-be65-a8231b0584bd tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:02.142126 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f270c39f-b118-448e-8502-dd26d865f175 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7681de64c248268da4d78124f59b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d60144477f4a5192d581350d678979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:02.151432 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f270c39f-b118-448e-8502-dd26d865f175 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] 10.222.0.26 "GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990" status: 200 len: 1292 microversion: 2.1 time: 0.220468 Sep 17 20:54:02.152239 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 443/846] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:01 2022] GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990 => generated 1292 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:54:02.156960 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-53c23fd0-3cec-4e33-b896-96b5ba6c1cef tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Action: 'update', calling method: .version_select at 0x7f25a5716d30>, body: {"meta": {"os_version": "alt"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:02.210720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-53c23fd0-3cec-4e33-b896-96b5ba6c1cef tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Getting quotas for project db3f74611f1840c282454eb53c4063d5. Resources: dict_keys(['metadata_items']) {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:54:02.217761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-53c23fd0-3cec-4e33-b896-96b5ba6c1cef tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Getting quotas for user 79370e0ba5674f9ea8c09ad7aa1828fe and project db3f74611f1840c282454eb53c4063d5. Resources: dict_keys(['metadata_items']) {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:54:02.248292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ba127c58-2d06-4a6f-be65-a8231b0584bd tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa9e5c7b7dd4a74935de34327145697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b843f5d09c94cf3916f65e815d6d7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:02.256305 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ba127c58-2d06-4a6f-be65-a8231b0584bd tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102" status: 200 len: 1324 microversion: 2.1 time: 0.191396 Sep 17 20:54:02.257008 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 404/847] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:02 2022] GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102 => generated 1324 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:02.342245 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-63366b56-4d12-4b72-a7d3-45e426bbaa11 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:02.343084 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-63366b56-4d12-4b72-a7d3-45e426bbaa11 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:02.349390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-63366b56-4d12-4b72-a7d3-45e426bbaa11 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:02.350157 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-63366b56-4d12-4b72-a7d3-45e426bbaa11 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:02.350810 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-63366b56-4d12-4b72-a7d3-45e426bbaa11 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:02.351580 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-63366b56-4d12-4b72-a7d3-45e426bbaa11 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:02.352100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-63366b56-4d12-4b72-a7d3-45e426bbaa11 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:02.352640 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-63366b56-4d12-4b72-a7d3-45e426bbaa11 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:02.490876 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-53c23fd0-3cec-4e33-b896-96b5ba6c1cef tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] 10.222.0.26 "PUT /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.337554 Sep 17 20:54:02.491505 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 444/848] 10.222.0.26 () {60 vars in 1313 bytes} [Sat Sep 17 20:54:02 2022] PUT /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f/metadata/os_version => generated 31 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:54:02.496452 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-036ae4cf-521c-41ad-8761-2a985bcf330a req-4cc46e50-33c9-49fc-a0f5-ad54dbdaf99a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f598b03-b7f1-42ce-a5b0-2c140bde7ba1", "tag": "a8ad5af8-55a2-4214-b840-cef45bde3c20"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:02.498872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-63366b56-4d12-4b72-a7d3-45e426bbaa11 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:02.506001 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-036ae4cf-521c-41ad-8761-2a985bcf330a req-4cc46e50-33c9-49fc-a0f5-ad54dbdaf99a service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:02.506482 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-036ae4cf-521c-41ad-8761-2a985bcf330a req-4cc46e50-33c9-49fc-a0f5-ad54dbdaf99a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:02.506915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-036ae4cf-521c-41ad-8761-2a985bcf330a req-4cc46e50-33c9-49fc-a0f5-ad54dbdaf99a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:02.507245 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-63366b56-4d12-4b72-a7d3-45e426bbaa11 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1469 microversion: 2.1 time: 0.169161 Sep 17 20:54:02.507829 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 405/849] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:02 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1469 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:54:02.510820 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:54:02.512435 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1ae4bf2d-79e5-4e72-9349-b7ce7dcf6651 tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Calling method '.version_select at 0x7f25a66b3820>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:02.519231 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-036ae4cf-521c-41ad-8761-2a985bcf330a req-4cc46e50-33c9-49fc-a0f5-ad54dbdaf99a service nova] Creating event network-changed:a8ad5af8-55a2-4214-b840-cef45bde3c20 for instance 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 on nch1-master-1 Sep 17 20:54:02.524761 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-036ae4cf-521c-41ad-8761-2a985bcf330a req-4cc46e50-33c9-49fc-a0f5-ad54dbdaf99a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032033 Sep 17 20:54:02.525729 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 445/850] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:54:02.556861 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1ae4bf2d-79e5-4e72-9349-b7ce7dcf6651 tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] 10.222.0.26 "GET /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f/metadata" status: 200 len: 58 microversion: 2.1 time: 0.047983 Sep 17 20:54:02.557430 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 406/851] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Sep 17 20:54:02 2022] GET /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f/metadata => generated 58 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:54:02.567698 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a5e21cf9-4a8b-475d-9f31-cdb26b0acde3 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:02.568592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a5e21cf9-4a8b-475d-9f31-cdb26b0acde3 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:02.569421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8b489d56-49ed-40e4-8ca7-3383b403cfee tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Action: 'update_all', calling method: .version_select at 0x7f25a5773ca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:02.576161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:54:02.577892 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5e21cf9-4a8b-475d-9f31-cdb26b0acde3 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:02.578390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5e21cf9-4a8b-475d-9f31-cdb26b0acde3 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:02.578833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5e21cf9-4a8b-475d-9f31-cdb26b0acde3 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:02.579574 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5e21cf9-4a8b-475d-9f31-cdb26b0acde3 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:02.580150 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5e21cf9-4a8b-475d-9f31-cdb26b0acde3 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:02.580810 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5e21cf9-4a8b-475d-9f31-cdb26b0acde3 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:02.628765 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-8b489d56-49ed-40e4-8ca7-3383b403cfee tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Getting quotas for project db3f74611f1840c282454eb53c4063d5. Resources: dict_keys(['metadata_items']) {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:54:02.633089 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-8b489d56-49ed-40e4-8ca7-3383b403cfee tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Getting quotas for user 79370e0ba5674f9ea8c09ad7aa1828fe and project db3f74611f1840c282454eb53c4063d5. Resources: dict_keys(['metadata_items']) {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:54:02.751703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a5e21cf9-4a8b-475d-9f31-cdb26b0acde3 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:02.764491 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a5e21cf9-4a8b-475d-9f31-cdb26b0acde3 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:02.765985 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a5e21cf9-4a8b-475d-9f31-cdb26b0acde3 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:02.767352 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a5e21cf9-4a8b-475d-9f31-cdb26b0acde3 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 1411 microversion: 2.25 time: 0.204457 Sep 17 20:54:02.774607 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 446/852] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:54:02 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 1411 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:54:02.780640 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-d056aabd-466e-45df-aab3-76d57d34a5b6 req-ec780409-920a-4911-b23d-ebf1b6155f24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "796a6ed8-e44a-4e34-849d-1daeb1f363dd", "tag": "3825b5cf-93a8-4a37-b807-cab157be9707"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:02.791330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d056aabd-466e-45df-aab3-76d57d34a5b6 req-ec780409-920a-4911-b23d-ebf1b6155f24 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:02.791836 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d056aabd-466e-45df-aab3-76d57d34a5b6 req-ec780409-920a-4911-b23d-ebf1b6155f24 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:02.792266 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d056aabd-466e-45df-aab3-76d57d34a5b6 req-ec780409-920a-4911-b23d-ebf1b6155f24 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:02.803606 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-d056aabd-466e-45df-aab3-76d57d34a5b6 req-ec780409-920a-4911-b23d-ebf1b6155f24 service nova] Creating event network-changed:3825b5cf-93a8-4a37-b807-cab157be9707 for instance 796a6ed8-e44a-4e34-849d-1daeb1f363dd on nch2-master-1 Sep 17 20:54:02.808567 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-d056aabd-466e-45df-aab3-76d57d34a5b6 req-ec780409-920a-4911-b23d-ebf1b6155f24 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032449 Sep 17 20:54:02.809162 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 447/853] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:54:02.814441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5c4d9692-cb6d-4700-894b-2597e35581f1 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:02.815128 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5c4d9692-cb6d-4700-894b-2597e35581f1 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:02.821134 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c4d9692-cb6d-4700-894b-2597e35581f1 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:02.821771 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c4d9692-cb6d-4700-894b-2597e35581f1 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:02.822208 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c4d9692-cb6d-4700-894b-2597e35581f1 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:02.822905 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c4d9692-cb6d-4700-894b-2597e35581f1 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:02.823360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c4d9692-cb6d-4700-894b-2597e35581f1 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:02.823787 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c4d9692-cb6d-4700-894b-2597e35581f1 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:02.936005 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8b489d56-49ed-40e4-8ca7-3383b403cfee tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] 10.222.0.26 "PUT /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f/metadata" status: 200 len: 61 microversion: 2.1 time: 0.371136 Sep 17 20:54:02.936699 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 407/854] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 17 20:54:02 2022] PUT /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f/metadata => generated 61 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:54:02.946103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-43ca92fb-c05b-448b-be8c-0da9454c3b08 tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Action: 'create', calling method: .version_select at 0x7f25a5773a60>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:02.958612 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5c4d9692-cb6d-4700-894b-2597e35581f1 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:02.967349 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5c4d9692-cb6d-4700-894b-2597e35581f1 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1" status: 200 len: 1505 microversion: 2.1 time: 0.156810 Sep 17 20:54:02.968021 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 448/855] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:02 2022] GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:02.995254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-43ca92fb-c05b-448b-be8c-0da9454c3b08 tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Getting quotas for project db3f74611f1840c282454eb53c4063d5. Resources: dict_keys(['metadata_items']) {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:54:02.998984 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-43ca92fb-c05b-448b-be8c-0da9454c3b08 tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Getting quotas for user 79370e0ba5674f9ea8c09ad7aa1828fe and project db3f74611f1840c282454eb53c4063d5. Resources: dict_keys(['metadata_items']) {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:54:03.175053 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-809e1001-7469-436c-b72b-91c14b5f3953 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:03.176088 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-809e1001-7469-436c-b72b-91c14b5f3953 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] [instance: 44fa7976-1412-4c83-ae29-b02e16186990] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:03.184512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-809e1001-7469-436c-b72b-91c14b5f3953 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:03.185177 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-809e1001-7469-436c-b72b-91c14b5f3953 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:03.185816 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-809e1001-7469-436c-b72b-91c14b5f3953 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:03.186740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-809e1001-7469-436c-b72b-91c14b5f3953 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:03.187302 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-809e1001-7469-436c-b72b-91c14b5f3953 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:03.187820 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-809e1001-7469-436c-b72b-91c14b5f3953 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:03.307645 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-43ca92fb-c05b-448b-be8c-0da9454c3b08 tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] 10.222.0.26 "POST /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f/metadata" status: 200 len: 85 microversion: 2.1 time: 0.364962 Sep 17 20:54:03.307975 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 408/856] 10.222.0.26 () {60 vars in 1281 bytes} [Sat Sep 17 20:54:02 2022] POST /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f/metadata => generated 85 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 17 20:54:03.313365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0d03e14c-a8e8-4d74-a0bb-57e7e1d1371b tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:03.313981 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0d03e14c-a8e8-4d74-a0bb-57e7e1d1371b tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 59beeb15-b8ee-49e8-b739-f38a755dc102] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:03.320300 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d03e14c-a8e8-4d74-a0bb-57e7e1d1371b tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:03.320842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d03e14c-a8e8-4d74-a0bb-57e7e1d1371b tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:03.321232 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d03e14c-a8e8-4d74-a0bb-57e7e1d1371b tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:03.322018 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d03e14c-a8e8-4d74-a0bb-57e7e1d1371b tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:03.322488 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d03e14c-a8e8-4d74-a0bb-57e7e1d1371b tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:03.322915 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d03e14c-a8e8-4d74-a0bb-57e7e1d1371b tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:03.445396 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-809e1001-7469-436c-b72b-91c14b5f3953 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7681de64c248268da4d78124f59b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d60144477f4a5192d581350d678979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:03.455301 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-809e1001-7469-436c-b72b-91c14b5f3953 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] 10.222.0.26 "GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990" status: 200 len: 1292 microversion: 2.1 time: 0.284121 Sep 17 20:54:03.455826 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 449/857] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:03 2022] GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990 => generated 1292 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:54:03.460706 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9bff3976-f9fa-4c6e-9b4c-09e6ec72c49f tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] Calling method '.version_select at 0x7f25a5716d30>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:03.533051 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9bff3976-f9fa-4c6e-9b4c-09e6ec72c49f tempest-ImagesMetadataTestJSON-263099944 tempest-ImagesMetadataTestJSON-263099944-project] 10.222.0.26 "GET /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f/metadata" status: 200 len: 85 microversion: 2.1 time: 0.075703 Sep 17 20:54:03.533939 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 450/858] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Sep 17 20:54:03 2022] GET /compute/v2.1/images/fc69318e-6d74-41f2-9500-252cd9eae66f/metadata => generated 85 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:54:03.539340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c273e560-ff9e-4a8f-91a6-f448d5311ce7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:03.540124 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c273e560-ff9e-4a8f-91a6-f448d5311ce7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:03.547986 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c273e560-ff9e-4a8f-91a6-f448d5311ce7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:03.548774 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c273e560-ff9e-4a8f-91a6-f448d5311ce7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:03.549991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c273e560-ff9e-4a8f-91a6-f448d5311ce7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:03.551563 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c273e560-ff9e-4a8f-91a6-f448d5311ce7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:03.552244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c273e560-ff9e-4a8f-91a6-f448d5311ce7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:03.552885 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c273e560-ff9e-4a8f-91a6-f448d5311ce7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:03.602124 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0d03e14c-a8e8-4d74-a0bb-57e7e1d1371b tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa9e5c7b7dd4a74935de34327145697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b843f5d09c94cf3916f65e815d6d7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:03.611450 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0d03e14c-a8e8-4d74-a0bb-57e7e1d1371b tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102" status: 200 len: 1324 microversion: 2.1 time: 0.301826 Sep 17 20:54:03.612391 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 409/859] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:03 2022] GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102 => generated 1324 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:03.794593 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-070e58c7-64e1-48ec-9ea9-46c377f6705f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:03.795240 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-070e58c7-64e1-48ec-9ea9-46c377f6705f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:03.807062 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-070e58c7-64e1-48ec-9ea9-46c377f6705f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:03.807602 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-070e58c7-64e1-48ec-9ea9-46c377f6705f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:03.808181 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-070e58c7-64e1-48ec-9ea9-46c377f6705f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:03.811492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-070e58c7-64e1-48ec-9ea9-46c377f6705f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:03.812064 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-070e58c7-64e1-48ec-9ea9-46c377f6705f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:03.812583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-070e58c7-64e1-48ec-9ea9-46c377f6705f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:03.851941 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c273e560-ff9e-4a8f-91a6-f448d5311ce7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:03.870561 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c273e560-ff9e-4a8f-91a6-f448d5311ce7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1535 microversion: 2.1 time: 0.328212 Sep 17 20:54:03.871627 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 451/860] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:03 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1535 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:03.990786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7d1c0bab-12de-4a27-8d04-17f586f3ca02 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:03.991516 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7d1c0bab-12de-4a27-8d04-17f586f3ca02 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:04.001788 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d1c0bab-12de-4a27-8d04-17f586f3ca02 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:04.006364 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d1c0bab-12de-4a27-8d04-17f586f3ca02 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:04.006954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d1c0bab-12de-4a27-8d04-17f586f3ca02 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:04.007805 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d1c0bab-12de-4a27-8d04-17f586f3ca02 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:04.008368 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d1c0bab-12de-4a27-8d04-17f586f3ca02 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:04.009049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d1c0bab-12de-4a27-8d04-17f586f3ca02 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:04.029694 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-070e58c7-64e1-48ec-9ea9-46c377f6705f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:04.041720 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-070e58c7-64e1-48ec-9ea9-46c377f6705f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:04.046154 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-070e58c7-64e1-48ec-9ea9-46c377f6705f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:04.049236 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-070e58c7-64e1-48ec-9ea9-46c377f6705f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 1411 microversion: 2.25 time: 0.258518 Sep 17 20:54:04.050780 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 410/861] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:54:03 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 1411 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:54:04.355878 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7d1c0bab-12de-4a27-8d04-17f586f3ca02 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:04.373097 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7d1c0bab-12de-4a27-8d04-17f586f3ca02 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1" status: 200 len: 1505 microversion: 2.1 time: 0.386284 Sep 17 20:54:04.376256 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 452/862] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:03 2022] GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 => generated 1505 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:04.480443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a7ea9821-5ff6-47d2-bdcf-cabaf9b3bb43 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:04.481059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a7ea9821-5ff6-47d2-bdcf-cabaf9b3bb43 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] [instance: 44fa7976-1412-4c83-ae29-b02e16186990] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:04.487334 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a7ea9821-5ff6-47d2-bdcf-cabaf9b3bb43 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:04.487835 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a7ea9821-5ff6-47d2-bdcf-cabaf9b3bb43 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:04.488261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a7ea9821-5ff6-47d2-bdcf-cabaf9b3bb43 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:04.488975 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a7ea9821-5ff6-47d2-bdcf-cabaf9b3bb43 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:04.489429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a7ea9821-5ff6-47d2-bdcf-cabaf9b3bb43 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:04.489879 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a7ea9821-5ff6-47d2-bdcf-cabaf9b3bb43 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:04.550126 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-aa9eec7a-cf66-4759-be3e-523eb3af3307 req-f596a01b-078d-45be-83d5-7f59bacc2314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89b39b18-ff49-4810-9701-3084736ff2d0", "name": "network-vif-unplugged", "status": "completed", "tag": "67dfcd54-a56f-4269-9ed0-edf035c918b0"}, {"name": "network-changed", "server_uuid": "89b39b18-ff49-4810-9701-3084736ff2d0", "tag": "67dfcd54-a56f-4269-9ed0-edf035c918b0"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:04.570083 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-aa9eec7a-cf66-4759-be3e-523eb3af3307 req-f596a01b-078d-45be-83d5-7f59bacc2314 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:04.570660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-aa9eec7a-cf66-4759-be3e-523eb3af3307 req-f596a01b-078d-45be-83d5-7f59bacc2314 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:04.571386 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-aa9eec7a-cf66-4759-be3e-523eb3af3307 req-f596a01b-078d-45be-83d5-7f59bacc2314 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:04.585144 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-aa9eec7a-cf66-4759-be3e-523eb3af3307 req-f596a01b-078d-45be-83d5-7f59bacc2314 service nova] Creating event network-vif-unplugged:67dfcd54-a56f-4269-9ed0-edf035c918b0 for instance 89b39b18-ff49-4810-9701-3084736ff2d0 on nch2-master-1 Sep 17 20:54:04.585781 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-aa9eec7a-cf66-4759-be3e-523eb3af3307 req-f596a01b-078d-45be-83d5-7f59bacc2314 service nova] Creating event network-changed:67dfcd54-a56f-4269-9ed0-edf035c918b0 for instance 89b39b18-ff49-4810-9701-3084736ff2d0 on nch2-master-1 Sep 17 20:54:04.591754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [req-aa9eec7a-cf66-4759-be3e-523eb3af3307 req-f596a01b-078d-45be-83d5-7f59bacc2314 service nova] Instance 89b39b18-ff49-4810-9701-3084736ff2d0 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140524) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 20:54:04.602771 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-aa9eec7a-cf66-4759-be3e-523eb3af3307 req-f596a01b-078d-45be-83d5-7f59bacc2314 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.060331 Sep 17 20:54:04.603431 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 453/863] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:54:04.637293 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-257189bd-5698-4a00-8072-fdfc4b825a13 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:04.638181 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-257189bd-5698-4a00-8072-fdfc4b825a13 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 59beeb15-b8ee-49e8-b739-f38a755dc102] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:04.645697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-257189bd-5698-4a00-8072-fdfc4b825a13 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:04.646476 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-257189bd-5698-4a00-8072-fdfc4b825a13 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:04.647083 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-257189bd-5698-4a00-8072-fdfc4b825a13 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:04.647967 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-257189bd-5698-4a00-8072-fdfc4b825a13 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:04.648580 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-257189bd-5698-4a00-8072-fdfc4b825a13 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:04.649011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-257189bd-5698-4a00-8072-fdfc4b825a13 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:04.905206 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a7ea9821-5ff6-47d2-bdcf-cabaf9b3bb43 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7681de64c248268da4d78124f59b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d60144477f4a5192d581350d678979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:04.915500 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a7ea9821-5ff6-47d2-bdcf-cabaf9b3bb43 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] 10.222.0.26 "GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990" status: 200 len: 1483 microversion: 2.1 time: 0.438899 Sep 17 20:54:04.916509 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 411/864] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:04 2022] GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990 => generated 1483 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:04.923699 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4ced2d78-ce30-4bf0-9fc0-8ae5884cc794 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:04.923699 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4ced2d78-ce30-4bf0-9fc0-8ae5884cc794 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:04.931232 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4ced2d78-ce30-4bf0-9fc0-8ae5884cc794 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:04.931722 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4ced2d78-ce30-4bf0-9fc0-8ae5884cc794 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:04.932161 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4ced2d78-ce30-4bf0-9fc0-8ae5884cc794 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:04.932869 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4ced2d78-ce30-4bf0-9fc0-8ae5884cc794 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:04.933326 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4ced2d78-ce30-4bf0-9fc0-8ae5884cc794 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:04.933798 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4ced2d78-ce30-4bf0-9fc0-8ae5884cc794 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:04.955059 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-257189bd-5698-4a00-8072-fdfc4b825a13 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa9e5c7b7dd4a74935de34327145697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b843f5d09c94cf3916f65e815d6d7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:04.964832 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-257189bd-5698-4a00-8072-fdfc4b825a13 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102" status: 200 len: 1324 microversion: 2.1 time: 0.331853 Sep 17 20:54:04.965429 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 454/865] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:04 2022] GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102 => generated 1324 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:54:04.978538 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4d23e4fb-6551-4ea5-8a9b-0004f3d5fada tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:04.979036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4d23e4fb-6551-4ea5-8a9b-0004f3d5fada tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] [instance: 44fa7976-1412-4c83-ae29-b02e16186990] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:04.998046 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d23e4fb-6551-4ea5-8a9b-0004f3d5fada tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:04.999285 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d23e4fb-6551-4ea5-8a9b-0004f3d5fada tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:04.999911 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d23e4fb-6551-4ea5-8a9b-0004f3d5fada tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:05.000624 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d23e4fb-6551-4ea5-8a9b-0004f3d5fada tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:05.001078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d23e4fb-6551-4ea5-8a9b-0004f3d5fada tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:05.001520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d23e4fb-6551-4ea5-8a9b-0004f3d5fada tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:05.199765 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4d23e4fb-6551-4ea5-8a9b-0004f3d5fada tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] 10.222.0.26 "GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.225038 Sep 17 20:54:05.200871 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 455/866] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Sep 17 20:54:04 2022] GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990/os-interface => generated 285 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:54:05.207073 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2f83d36b-4212-45d1-8e1b-a603496c570a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:05.207932 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2f83d36b-4212-45d1-8e1b-a603496c570a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:05.217355 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f83d36b-4212-45d1-8e1b-a603496c570a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:05.218288 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f83d36b-4212-45d1-8e1b-a603496c570a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:05.218801 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f83d36b-4212-45d1-8e1b-a603496c570a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:05.219733 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f83d36b-4212-45d1-8e1b-a603496c570a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:05.220753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f83d36b-4212-45d1-8e1b-a603496c570a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:05.221405 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f83d36b-4212-45d1-8e1b-a603496c570a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:05.481908 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4ced2d78-ce30-4bf0-9fc0-8ae5884cc794 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:05.492825 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4ced2d78-ce30-4bf0-9fc0-8ae5884cc794 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1535 microversion: 2.1 time: 0.575079 Sep 17 20:54:05.503589 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 412/867] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:04 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1535 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:05.503816 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=8 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:54:05.509518 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bdf4911a-9dc9-4e6f-808d-07ea86e5faba tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:05.510161 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bdf4911a-9dc9-4e6f-808d-07ea86e5faba tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:05.516405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bdf4911a-9dc9-4e6f-808d-07ea86e5faba tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:05.517172 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bdf4911a-9dc9-4e6f-808d-07ea86e5faba tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:05.518162 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bdf4911a-9dc9-4e6f-808d-07ea86e5faba tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:05.519265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bdf4911a-9dc9-4e6f-808d-07ea86e5faba tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:05.519734 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bdf4911a-9dc9-4e6f-808d-07ea86e5faba tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:05.520169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bdf4911a-9dc9-4e6f-808d-07ea86e5faba tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:05.757254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2f83d36b-4212-45d1-8e1b-a603496c570a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:05.767833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2f83d36b-4212-45d1-8e1b-a603496c570a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:05.770065 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2f83d36b-4212-45d1-8e1b-a603496c570a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:05.771538 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2f83d36b-4212-45d1-8e1b-a603496c570a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 1411 microversion: 2.25 time: 0.569264 Sep 17 20:54:05.772098 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 456/868] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:54:05 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 1411 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:54:05.797438 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-9200e62d-7079-4dc0-b424-2de0267b359d req-2781a71b-8d8e-41a8-9067-a5dbb55b3b5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "796a6ed8-e44a-4e34-849d-1daeb1f363dd", "name": "network-vif-plugged", "status": "completed", "tag": "3825b5cf-93a8-4a37-b807-cab157be9707"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:05.807671 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-9200e62d-7079-4dc0-b424-2de0267b359d req-2781a71b-8d8e-41a8-9067-a5dbb55b3b5e service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:05.808274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-9200e62d-7079-4dc0-b424-2de0267b359d req-2781a71b-8d8e-41a8-9067-a5dbb55b3b5e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:05.808807 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-9200e62d-7079-4dc0-b424-2de0267b359d req-2781a71b-8d8e-41a8-9067-a5dbb55b3b5e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:05.825963 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-9200e62d-7079-4dc0-b424-2de0267b359d req-2781a71b-8d8e-41a8-9067-a5dbb55b3b5e service nova] Creating event network-vif-plugged:3825b5cf-93a8-4a37-b807-cab157be9707 for instance 796a6ed8-e44a-4e34-849d-1daeb1f363dd on nch2-master-1 Sep 17 20:54:05.832020 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-9200e62d-7079-4dc0-b424-2de0267b359d req-2781a71b-8d8e-41a8-9067-a5dbb55b3b5e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038176 Sep 17 20:54:05.833265 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 457/869] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:54:05.959904 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bdf4911a-9dc9-4e6f-808d-07ea86e5faba tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:05.978141 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bdf4911a-9dc9-4e6f-808d-07ea86e5faba tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1" status: 200 len: 1505 microversion: 2.1 time: 0.483139 Sep 17 20:54:05.979134 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 413/870] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:05 2022] GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 => generated 1505 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:05.996197 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6786594d-556d-43b0-beb8-85de6ee5bae8 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:05.996910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6786594d-556d-43b0-beb8-85de6ee5bae8 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 59beeb15-b8ee-49e8-b739-f38a755dc102] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:06.007809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6786594d-556d-43b0-beb8-85de6ee5bae8 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:06.008377 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6786594d-556d-43b0-beb8-85de6ee5bae8 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:06.008735 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6786594d-556d-43b0-beb8-85de6ee5bae8 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:06.020940 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6786594d-556d-43b0-beb8-85de6ee5bae8 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:06.021511 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6786594d-556d-43b0-beb8-85de6ee5bae8 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:06.022244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6786594d-556d-43b0-beb8-85de6ee5bae8 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:06.316667 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6786594d-556d-43b0-beb8-85de6ee5bae8 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa9e5c7b7dd4a74935de34327145697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b843f5d09c94cf3916f65e815d6d7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:06.331576 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6786594d-556d-43b0-beb8-85de6ee5bae8 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102" status: 200 len: 1324 microversion: 2.1 time: 0.340315 Sep 17 20:54:06.332986 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 458/871] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:05 2022] GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102 => generated 1324 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:54:06.516139 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b224870a-2e06-4a33-8758-82986c4183b5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:06.517107 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b224870a-2e06-4a33-8758-82986c4183b5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:06.531502 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b224870a-2e06-4a33-8758-82986c4183b5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:06.532103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b224870a-2e06-4a33-8758-82986c4183b5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:06.533805 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b224870a-2e06-4a33-8758-82986c4183b5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:06.534806 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b224870a-2e06-4a33-8758-82986c4183b5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:06.535573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b224870a-2e06-4a33-8758-82986c4183b5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:06.538845 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b224870a-2e06-4a33-8758-82986c4183b5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:06.865382 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-73845bb7-6e96-4ece-9e7a-a6bb99990b45 tempest-ImagesMetadataNegativeTestJSON-1189081274 tempest-ImagesMetadataNegativeTestJSON-1189081274-project] Calling method '.version_select at 0x7f25a5715c10>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:06.887722 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-73845bb7-6e96-4ece-9e7a-a6bb99990b45 tempest-ImagesMetadataNegativeTestJSON-1189081274 tempest-ImagesMetadataNegativeTestJSON-1189081274-project] HTTP exception thrown: Image not found. Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-73845bb7-6e96-4ece-9e7a-a6bb99990b45 tempest-ImagesMetadataNegativeTestJSON-1189081274 tempest-ImagesMetadataNegativeTestJSON-1189081274-project] Request method failure captured: Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/images/23cda9a5-849a-4d9d-b043-317bcd2e5070/metadata/os_distro HTTP/1.1 Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjPubUKFgIRlAWido0t_BP2cjqlJUp3r6duElQvL-gxh6u1ofF_G_AMeGDgrqZJ_3IE8kidBY5RJpIMDVyD7KP0MRkAs5lX8GhMzAI1AXWyLt1XGtu412_WLSelrE_MJmBUwhero8TdFlm9gmfDZuziWwKElVEogr-fV4hOyUf-Uvi0 Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 343bbd535db44f4a97ea0db400d0b30e Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1189081274 Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/343bbd535db44f4a97ea0db400d0b30e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/343bbd535db44f4a97ea0db400d0b30e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/343bbd535db44f4a97ea0db400d0b30e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_343bbd535db44f4a97ea0db400d0b30e", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1189081274 Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 343bbd535db44f4a97ea0db400d0b30e Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1189081274 Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ImagesMetadataNegativeTestJSON-1189081274-project Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 4b89ffdc23fa44baa5bdae8f98751f4c Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1189081274-project Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: exception: Image not found. Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'image_id': '23cda9a5-849a-4d9d-b043-317bcd2e5070', 'id': 'os_distro'} Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 23cda9a5-849a-4d9d-b043-317bcd2e5070 Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 17 20:54:06.916640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 23cda9a5-849a-4d9d-b043-317bcd2e5070 could not be found. Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-73845bb7-6e96-4ece-9e7a-a6bb99990b45 tempest-ImagesMetadataNegativeTestJSON-1189081274 tempest-ImagesMetadataNegativeTestJSON-1189081274-project] Returning 404 to user: Image not found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-73845bb7-6e96-4ece-9e7a-a6bb99990b45 tempest-ImagesMetadataNegativeTestJSON-1189081274 tempest-ImagesMetadataNegativeTestJSON-1189081274-project] 10.222.0.26 "DELETE /compute/v2.1/images/23cda9a5-849a-4d9d-b043-317bcd2e5070/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.181366 Sep 17 20:54:06.923140 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 459/872] 10.222.0.26 () {58 vars in 1293 bytes} [Sat Sep 17 20:54:06 2022] DELETE /compute/v2.1/images/23cda9a5-849a-4d9d-b043-317bcd2e5070/metadata/os_distro => generated 62 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 17 20:54:06.927813 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-af8c2d61-989c-4141-bec5-19c4fbacc347 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:06.928436 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-af8c2d61-989c-4141-bec5-19c4fbacc347 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:06.935586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af8c2d61-989c-4141-bec5-19c4fbacc347 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:06.936190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af8c2d61-989c-4141-bec5-19c4fbacc347 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:06.936753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af8c2d61-989c-4141-bec5-19c4fbacc347 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:06.937451 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af8c2d61-989c-4141-bec5-19c4fbacc347 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:06.938326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af8c2d61-989c-4141-bec5-19c4fbacc347 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:06.939067 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af8c2d61-989c-4141-bec5-19c4fbacc347 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:06.994452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b224870a-2e06-4a33-8758-82986c4183b5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:07.004965 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b224870a-2e06-4a33-8758-82986c4183b5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1535 microversion: 2.1 time: 0.492752 Sep 17 20:54:07.005989 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 414/873] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:06 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1535 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:07.011101 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fb9c3344-efbb-4e34-a877-4481debacb98 tempest-ImagesMetadataNegativeTestJSON-1189081274 tempest-ImagesMetadataNegativeTestJSON-1189081274-project] Calling method '.version_select at 0x7f25a5773790>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:07.037098 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-fb9c3344-efbb-4e34-a877-4481debacb98 tempest-ImagesMetadataNegativeTestJSON-1189081274 tempest-ImagesMetadataNegativeTestJSON-1189081274-project] HTTP exception thrown: Image not found. Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fb9c3344-efbb-4e34-a877-4481debacb98 tempest-ImagesMetadataNegativeTestJSON-1189081274 tempest-ImagesMetadataNegativeTestJSON-1189081274-project] Request method failure captured: Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/images/7a52fe22-59a2-47bb-9e79-1a48e91c33a0/metadata/os_version HTTP/1.1 Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjPubUKFgIRlAWido0t_BP2cjqlJUp3r6duElQvL-gxh6u1ofF_G_AMeGDgrqZJ_3IE8kidBY5RJpIMDVyD7KP0MRkAs5lX8GhMzAI1AXWyLt1XGtu412_WLSelrE_MJmBUwhero8TdFlm9gmfDZuziWwKElVEogr-fV4hOyUf-Uvi0 Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 343bbd535db44f4a97ea0db400d0b30e Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1189081274 Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/343bbd535db44f4a97ea0db400d0b30e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/343bbd535db44f4a97ea0db400d0b30e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/343bbd535db44f4a97ea0db400d0b30e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_343bbd535db44f4a97ea0db400d0b30e", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1189081274 Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 343bbd535db44f4a97ea0db400d0b30e Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1189081274 Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ImagesMetadataNegativeTestJSON-1189081274-project Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 4b89ffdc23fa44baa5bdae8f98751f4c Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1189081274-project Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: exception: Image not found. Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'image_id': '7a52fe22-59a2-47bb-9e79-1a48e91c33a0', 'id': 'os_version'} Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 7a52fe22-59a2-47bb-9e79-1a48e91c33a0 Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 17 20:54:07.041294 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7a52fe22-59a2-47bb-9e79-1a48e91c33a0 could not be found. Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fb9c3344-efbb-4e34-a877-4481debacb98 tempest-ImagesMetadataNegativeTestJSON-1189081274 tempest-ImagesMetadataNegativeTestJSON-1189081274-project] Returning 404 to user: Image not found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fb9c3344-efbb-4e34-a877-4481debacb98 tempest-ImagesMetadataNegativeTestJSON-1189081274 tempest-ImagesMetadataNegativeTestJSON-1189081274-project] 10.222.0.26 "GET /compute/v2.1/images/7a52fe22-59a2-47bb-9e79-1a48e91c33a0/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.035604 Sep 17 20:54:07.045342 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 415/874] 10.222.0.26 () {58 vars in 1293 bytes} [Sat Sep 17 20:54:07 2022] GET /compute/v2.1/images/7a52fe22-59a2-47bb-9e79-1a48e91c33a0/metadata/os_version => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 20:54:07.055463 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-71825523-757b-497f-bc89-b01d812c7b12 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:07.055463 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-71825523-757b-497f-bc89-b01d812c7b12 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:07.057015 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:54:07.058602 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-71825523-757b-497f-bc89-b01d812c7b12 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:07.059161 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-71825523-757b-497f-bc89-b01d812c7b12 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:07.059664 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-71825523-757b-497f-bc89-b01d812c7b12 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:07.060566 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-71825523-757b-497f-bc89-b01d812c7b12 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:07.061233 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-71825523-757b-497f-bc89-b01d812c7b12 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:07.061693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-71825523-757b-497f-bc89-b01d812c7b12 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:07.169074 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-af8c2d61-989c-4141-bec5-19c4fbacc347 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:07.181928 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-af8c2d61-989c-4141-bec5-19c4fbacc347 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:07.183403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-af8c2d61-989c-4141-bec5-19c4fbacc347 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:07.184547 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-af8c2d61-989c-4141-bec5-19c4fbacc347 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 1411 microversion: 2.25 time: 0.264318 Sep 17 20:54:07.202492 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 460/875] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:54:06 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 1411 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:54:07.207617 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4a14e014-3b23-485a-9115-ac56665e0c47 tempest-ImagesMetadataNegativeTestJSON-1189081274 tempest-ImagesMetadataNegativeTestJSON-1189081274-project] Calling method '.version_select at 0x7f25a57561f0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:07.235994 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-4a14e014-3b23-485a-9115-ac56665e0c47 tempest-ImagesMetadataNegativeTestJSON-1189081274 tempest-ImagesMetadataNegativeTestJSON-1189081274-project] HTTP exception thrown: Image not found. Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4a14e014-3b23-485a-9115-ac56665e0c47 tempest-ImagesMetadataNegativeTestJSON-1189081274 tempest-ImagesMetadataNegativeTestJSON-1189081274-project] Request method failure captured: Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/images/82dce35a-caae-49b4-bebb-bf86e7a290ad/metadata HTTP/1.1 Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjPubUKFgIRlAWido0t_BP2cjqlJUp3r6duElQvL-gxh6u1ofF_G_AMeGDgrqZJ_3IE8kidBY5RJpIMDVyD7KP0MRkAs5lX8GhMzAI1AXWyLt1XGtu412_WLSelrE_MJmBUwhero8TdFlm9gmfDZuziWwKElVEogr-fV4hOyUf-Uvi0 Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 343bbd535db44f4a97ea0db400d0b30e Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1189081274 Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/343bbd535db44f4a97ea0db400d0b30e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/343bbd535db44f4a97ea0db400d0b30e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/343bbd535db44f4a97ea0db400d0b30e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_343bbd535db44f4a97ea0db400d0b30e", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1189081274 Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 343bbd535db44f4a97ea0db400d0b30e Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1189081274 Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ImagesMetadataNegativeTestJSON-1189081274-project Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 4b89ffdc23fa44baa5bdae8f98751f4c Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1189081274-project Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: exception: Image not found. Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'image_id': '82dce35a-caae-49b4-bebb-bf86e7a290ad'} Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 82dce35a-caae-49b4-bebb-bf86e7a290ad Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 17 20:54:07.238896 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 82dce35a-caae-49b4-bebb-bf86e7a290ad could not be found. Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4a14e014-3b23-485a-9115-ac56665e0c47 tempest-ImagesMetadataNegativeTestJSON-1189081274 tempest-ImagesMetadataNegativeTestJSON-1189081274-project] Returning 404 to user: Image not found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4a14e014-3b23-485a-9115-ac56665e0c47 tempest-ImagesMetadataNegativeTestJSON-1189081274 tempest-ImagesMetadataNegativeTestJSON-1189081274-project] 10.222.0.26 "GET /compute/v2.1/images/82dce35a-caae-49b4-bebb-bf86e7a290ad/metadata" status: 404 len: 62 microversion: 2.1 time: 0.036554 Sep 17 20:54:07.246186 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 461/876] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Sep 17 20:54:07 2022] GET /compute/v2.1/images/82dce35a-caae-49b4-bebb-bf86e7a290ad/metadata => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 20:54:07.251845 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1dc46b97-69b0-4cb2-b2bb-fa886f13acb2 tempest-ImagesMetadataNegativeTestJSON-1189081274 tempest-ImagesMetadataNegativeTestJSON-1189081274-project] Action: 'update_all', calling method: .version_select at 0x7f25a57b4ca0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:07.274998 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-1dc46b97-69b0-4cb2-b2bb-fa886f13acb2 tempest-ImagesMetadataNegativeTestJSON-1189081274 tempest-ImagesMetadataNegativeTestJSON-1189081274-project] HTTP exception thrown: Image not found. Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1dc46b97-69b0-4cb2-b2bb-fa886f13acb2 tempest-ImagesMetadataNegativeTestJSON-1189081274 tempest-ImagesMetadataNegativeTestJSON-1189081274-project] Request method failure captured: Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: request: PUT /compute/v2.1/images/1afd9e10-aeec-4ff9-bf66-8f7f13d71d8c/metadata HTTP/1.1 Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 57 Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjPubUKFgIRlAWido0t_BP2cjqlJUp3r6duElQvL-gxh6u1ofF_G_AMeGDgrqZJ_3IE8kidBY5RJpIMDVyD7KP0MRkAs5lX8GhMzAI1AXWyLt1XGtu412_WLSelrE_MJmBUwhero8TdFlm9gmfDZuziWwKElVEogr-fV4hOyUf-Uvi0 Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 343bbd535db44f4a97ea0db400d0b30e Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1189081274 Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/343bbd535db44f4a97ea0db400d0b30e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/343bbd535db44f4a97ea0db400d0b30e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/343bbd535db44f4a97ea0db400d0b30e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_343bbd535db44f4a97ea0db400d0b30e", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1189081274 Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 343bbd535db44f4a97ea0db400d0b30e Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1189081274 Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ImagesMetadataNegativeTestJSON-1189081274-project Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 4b89ffdc23fa44baa5bdae8f98751f4c Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1189081274-project Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: exception: Image not found. Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'image_id': '1afd9e10-aeec-4ff9-bf66-8f7f13d71d8c', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1afd9e10-aeec-4ff9-bf66-8f7f13d71d8c Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 17 20:54:07.277438 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1afd9e10-aeec-4ff9-bf66-8f7f13d71d8c could not be found. Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1dc46b97-69b0-4cb2-b2bb-fa886f13acb2 tempest-ImagesMetadataNegativeTestJSON-1189081274 tempest-ImagesMetadataNegativeTestJSON-1189081274-project] Returning 404 to user: Image not found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:54:07.282686 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1dc46b97-69b0-4cb2-b2bb-fa886f13acb2 tempest-ImagesMetadataNegativeTestJSON-1189081274 tempest-ImagesMetadataNegativeTestJSON-1189081274-project] 10.222.0.26 "PUT /compute/v2.1/images/1afd9e10-aeec-4ff9-bf66-8f7f13d71d8c/metadata" status: 404 len: 62 microversion: 2.1 time: 0.032386 Sep 17 20:54:07.287434 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 462/877] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 17 20:54:07 2022] PUT /compute/v2.1/images/1afd9e10-aeec-4ff9-bf66-8f7f13d71d8c/metadata => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 17 20:54:07.289894 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-35b34e8f-631d-43cd-9436-e5c9c9df1629 tempest-ImagesMetadataNegativeTestJSON-1189081274 tempest-ImagesMetadataNegativeTestJSON-1189081274-project] Action: 'update', calling method: .version_select at 0x7f25a57a2ee0>, body: {"meta": {"os_distro": "alt"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:07.306619 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-71825523-757b-497f-bc89-b01d812c7b12 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:07.311356 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-35b34e8f-631d-43cd-9436-e5c9c9df1629 tempest-ImagesMetadataNegativeTestJSON-1189081274 tempest-ImagesMetadataNegativeTestJSON-1189081274-project] HTTP exception thrown: Image not found. Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-35b34e8f-631d-43cd-9436-e5c9c9df1629 tempest-ImagesMetadataNegativeTestJSON-1189081274 tempest-ImagesMetadataNegativeTestJSON-1189081274-project] Request method failure captured: Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: request: PUT /compute/v2.1/images/34485377-77f3-4ea1-9193-932cf14d06ca/metadata/os_distro HTTP/1.1 Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 30 Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjPubUKFgIRlAWido0t_BP2cjqlJUp3r6duElQvL-gxh6u1ofF_G_AMeGDgrqZJ_3IE8kidBY5RJpIMDVyD7KP0MRkAs5lX8GhMzAI1AXWyLt1XGtu412_WLSelrE_MJmBUwhero8TdFlm9gmfDZuziWwKElVEogr-fV4hOyUf-Uvi0 Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 343bbd535db44f4a97ea0db400d0b30e Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1189081274 Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/343bbd535db44f4a97ea0db400d0b30e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/343bbd535db44f4a97ea0db400d0b30e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/343bbd535db44f4a97ea0db400d0b30e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_343bbd535db44f4a97ea0db400d0b30e", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1189081274 Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 343bbd535db44f4a97ea0db400d0b30e Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1189081274 Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ImagesMetadataNegativeTestJSON-1189081274-project Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 4b89ffdc23fa44baa5bdae8f98751f4c Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1189081274-project Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: {"meta": {"os_distro": "alt"}} Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: exception: Image not found. Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'image_id': '34485377-77f3-4ea1-9193-932cf14d06ca', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 34485377-77f3-4ea1-9193-932cf14d06ca Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 17 20:54:07.313587 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 34485377-77f3-4ea1-9193-932cf14d06ca could not be found. Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-35b34e8f-631d-43cd-9436-e5c9c9df1629 tempest-ImagesMetadataNegativeTestJSON-1189081274 tempest-ImagesMetadataNegativeTestJSON-1189081274-project] Returning 404 to user: Image not found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-35b34e8f-631d-43cd-9436-e5c9c9df1629 tempest-ImagesMetadataNegativeTestJSON-1189081274 tempest-ImagesMetadataNegativeTestJSON-1189081274-project] 10.222.0.26 "PUT /compute/v2.1/images/34485377-77f3-4ea1-9193-932cf14d06ca/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.028800 Sep 17 20:54:07.325187 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 463/878] 10.222.0.26 () {60 vars in 1310 bytes} [Sat Sep 17 20:54:07 2022] PUT /compute/v2.1/images/34485377-77f3-4ea1-9193-932cf14d06ca/metadata/os_distro => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 20:54:07.332454 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8a376be6-3ab8-488f-94bb-cdb56799a1b7 tempest-ImagesMetadataNegativeTestJSON-1189081274 tempest-ImagesMetadataNegativeTestJSON-1189081274-project] Action: 'create', calling method: .version_select at 0x7f25a5715c10>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:07.350351 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-71825523-757b-497f-bc89-b01d812c7b12 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1" status: 200 len: 1505 microversion: 2.1 time: 0.302748 Sep 17 20:54:07.350351 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 416/879] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:07 2022] GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 => generated 1505 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:07.360032 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-8a376be6-3ab8-488f-94bb-cdb56799a1b7 tempest-ImagesMetadataNegativeTestJSON-1189081274 tempest-ImagesMetadataNegativeTestJSON-1189081274-project] HTTP exception thrown: Image not found. Sep 17 20:54:07.362660 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-96945ef9-faa3-4a04-a457-2a33103ca1af tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8a376be6-3ab8-488f-94bb-cdb56799a1b7 tempest-ImagesMetadataNegativeTestJSON-1189081274 tempest-ImagesMetadataNegativeTestJSON-1189081274-project] Request method failure captured: Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/images/266d0fc2-a198-4f5a-bf2e-1fbbb4b2343b/metadata HTTP/1.1 Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 57 Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjPubUKFgIRlAWido0t_BP2cjqlJUp3r6duElQvL-gxh6u1ofF_G_AMeGDgrqZJ_3IE8kidBY5RJpIMDVyD7KP0MRkAs5lX8GhMzAI1AXWyLt1XGtu412_WLSelrE_MJmBUwhero8TdFlm9gmfDZuziWwKElVEogr-fV4hOyUf-Uvi0 Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 343bbd535db44f4a97ea0db400d0b30e Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1189081274 Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/343bbd535db44f4a97ea0db400d0b30e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/343bbd535db44f4a97ea0db400d0b30e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/343bbd535db44f4a97ea0db400d0b30e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_343bbd535db44f4a97ea0db400d0b30e", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1189081274 Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 343bbd535db44f4a97ea0db400d0b30e Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1189081274 Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ImagesMetadataNegativeTestJSON-1189081274-project Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 4b89ffdc23fa44baa5bdae8f98751f4c Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1189081274-project Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: exception: Image not found. Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'image_id': '266d0fc2-a198-4f5a-bf2e-1fbbb4b2343b', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 266d0fc2-a198-4f5a-bf2e-1fbbb4b2343b Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 17 20:54:07.363397 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 266d0fc2-a198-4f5a-bf2e-1fbbb4b2343b could not be found. Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 17 20:54:07.367559 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:07.371075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-96945ef9-faa3-4a04-a457-2a33103ca1af tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] [instance: 44fa7976-1412-4c83-ae29-b02e16186990] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:07.371176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8a376be6-3ab8-488f-94bb-cdb56799a1b7 tempest-ImagesMetadataNegativeTestJSON-1189081274 tempest-ImagesMetadataNegativeTestJSON-1189081274-project] Returning 404 to user: Image not found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:54:07.371176 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8a376be6-3ab8-488f-94bb-cdb56799a1b7 tempest-ImagesMetadataNegativeTestJSON-1189081274 tempest-ImagesMetadataNegativeTestJSON-1189081274-project] 10.222.0.26 "POST /compute/v2.1/images/266d0fc2-a198-4f5a-bf2e-1fbbb4b2343b/metadata" status: 404 len: 62 microversion: 2.1 time: 0.048468 Sep 17 20:54:07.376461 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 464/880] 10.222.0.26 () {60 vars in 1281 bytes} [Sat Sep 17 20:54:07 2022] POST /compute/v2.1/images/266d0fc2-a198-4f5a-bf2e-1fbbb4b2343b/metadata => generated 62 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 20:54:07.376628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-96945ef9-faa3-4a04-a457-2a33103ca1af tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:07.376628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-96945ef9-faa3-4a04-a457-2a33103ca1af tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:07.376628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-96945ef9-faa3-4a04-a457-2a33103ca1af tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:07.377042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-dcbbb31c-aeab-4838-b2cf-aa6ed523fa94 req-e9ab1338-6f25-494c-ab71-94eedbacedbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44fa7976-1412-4c83-ae29-b02e16186990", "tag": "7125d3dc-3622-46b0-a3c6-b60d56b537b5"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:07.379412 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-96945ef9-faa3-4a04-a457-2a33103ca1af tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:07.379412 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-96945ef9-faa3-4a04-a457-2a33103ca1af tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:07.379412 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-96945ef9-faa3-4a04-a457-2a33103ca1af tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:07.390151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-dcbbb31c-aeab-4838-b2cf-aa6ed523fa94 req-e9ab1338-6f25-494c-ab71-94eedbacedbf service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:07.390504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-dcbbb31c-aeab-4838-b2cf-aa6ed523fa94 req-e9ab1338-6f25-494c-ab71-94eedbacedbf service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:07.391013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-dcbbb31c-aeab-4838-b2cf-aa6ed523fa94 req-e9ab1338-6f25-494c-ab71-94eedbacedbf service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:07.405707 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-dcbbb31c-aeab-4838-b2cf-aa6ed523fa94 req-e9ab1338-6f25-494c-ab71-94eedbacedbf service nova] Creating event network-changed:7125d3dc-3622-46b0-a3c6-b60d56b537b5 for instance 44fa7976-1412-4c83-ae29-b02e16186990 on nch2-master-1 Sep 17 20:54:07.413213 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-dcbbb31c-aeab-4838-b2cf-aa6ed523fa94 req-e9ab1338-6f25-494c-ab71-94eedbacedbf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040105 Sep 17 20:54:07.414383 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 465/881] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:54:07.421580 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-33f0b457-8f10-46a2-a7eb-a413f2a951b1 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:07.422562 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-33f0b457-8f10-46a2-a7eb-a413f2a951b1 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 59beeb15-b8ee-49e8-b739-f38a755dc102] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:07.430068 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-33f0b457-8f10-46a2-a7eb-a413f2a951b1 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:07.430849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-33f0b457-8f10-46a2-a7eb-a413f2a951b1 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:07.431442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-33f0b457-8f10-46a2-a7eb-a413f2a951b1 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:07.432362 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-33f0b457-8f10-46a2-a7eb-a413f2a951b1 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:07.432995 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-33f0b457-8f10-46a2-a7eb-a413f2a951b1 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:07.433603 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-33f0b457-8f10-46a2-a7eb-a413f2a951b1 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:07.603453 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-96945ef9-faa3-4a04-a457-2a33103ca1af tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7681de64c248268da4d78124f59b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d60144477f4a5192d581350d678979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:07.617543 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-96945ef9-faa3-4a04-a457-2a33103ca1af tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] 10.222.0.26 "GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990" status: 200 len: 1483 microversion: 2.1 time: 0.258637 Sep 17 20:54:07.618888 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 417/882] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:07 2022] GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990 => generated 1483 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:54:07.646629 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-33f0b457-8f10-46a2-a7eb-a413f2a951b1 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa9e5c7b7dd4a74935de34327145697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b843f5d09c94cf3916f65e815d6d7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:07.657201 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-33f0b457-8f10-46a2-a7eb-a413f2a951b1 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102" status: 200 len: 1324 microversion: 2.1 time: 0.241036 Sep 17 20:54:07.657814 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 466/883] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:07 2022] GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102 => generated 1324 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:07.847223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-dbcb5ac0-a4cc-4467-b8de-cac4a28eb995 req-1a7d1d4c-7118-4fb8-903a-98daaaab7497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59beeb15-b8ee-49e8-b739-f38a755dc102", "name": "network-vif-plugged", "status": "completed", "tag": "eadc612b-7bf9-4d2b-b813-686741311705"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:07.857233 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-dbcb5ac0-a4cc-4467-b8de-cac4a28eb995 req-1a7d1d4c-7118-4fb8-903a-98daaaab7497 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:07.858056 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-dbcb5ac0-a4cc-4467-b8de-cac4a28eb995 req-1a7d1d4c-7118-4fb8-903a-98daaaab7497 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:07.858584 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-dbcb5ac0-a4cc-4467-b8de-cac4a28eb995 req-1a7d1d4c-7118-4fb8-903a-98daaaab7497 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:07.872852 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-dbcb5ac0-a4cc-4467-b8de-cac4a28eb995 req-1a7d1d4c-7118-4fb8-903a-98daaaab7497 service nova] Creating event network-vif-plugged:eadc612b-7bf9-4d2b-b813-686741311705 for instance 59beeb15-b8ee-49e8-b739-f38a755dc102 on nch1-master-1 Sep 17 20:54:07.884557 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-dbcb5ac0-a4cc-4467-b8de-cac4a28eb995 req-1a7d1d4c-7118-4fb8-903a-98daaaab7497 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040672 Sep 17 20:54:07.885587 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 418/884] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:54:08.031531 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-20da526d-9719-4662-9375-7682cde0d361 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:08.032821 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-20da526d-9719-4662-9375-7682cde0d361 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:08.044879 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-20da526d-9719-4662-9375-7682cde0d361 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:08.046248 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-20da526d-9719-4662-9375-7682cde0d361 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:08.049778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-20da526d-9719-4662-9375-7682cde0d361 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:08.051001 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-20da526d-9719-4662-9375-7682cde0d361 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:08.051687 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-20da526d-9719-4662-9375-7682cde0d361 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:08.052546 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-20da526d-9719-4662-9375-7682cde0d361 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:08.215078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f383d6cd-83d4-4e3a-a6ad-a1f521d2e4c6 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:08.215891 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f383d6cd-83d4-4e3a-a6ad-a1f521d2e4c6 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:08.218684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-20da526d-9719-4662-9375-7682cde0d361 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:08.225596 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f383d6cd-83d4-4e3a-a6ad-a1f521d2e4c6 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:08.226416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f383d6cd-83d4-4e3a-a6ad-a1f521d2e4c6 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:08.227239 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f383d6cd-83d4-4e3a-a6ad-a1f521d2e4c6 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:08.228579 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-20da526d-9719-4662-9375-7682cde0d361 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1535 microversion: 2.1 time: 0.203576 Sep 17 20:54:08.229236 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 467/885] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:08 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1535 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:08.229356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f383d6cd-83d4-4e3a-a6ad-a1f521d2e4c6 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:08.229826 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f383d6cd-83d4-4e3a-a6ad-a1f521d2e4c6 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:08.230426 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f383d6cd-83d4-4e3a-a6ad-a1f521d2e4c6 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:08.236778 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:54:08.371760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-00bb102d-5a3f-447b-b783-be86be0e7648 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:08.372367 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-00bb102d-5a3f-447b-b783-be86be0e7648 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:08.381186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00bb102d-5a3f-447b-b783-be86be0e7648 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:08.381903 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00bb102d-5a3f-447b-b783-be86be0e7648 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:08.382492 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00bb102d-5a3f-447b-b783-be86be0e7648 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:08.383365 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00bb102d-5a3f-447b-b783-be86be0e7648 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:08.383872 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00bb102d-5a3f-447b-b783-be86be0e7648 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:08.384444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00bb102d-5a3f-447b-b783-be86be0e7648 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:08.390565 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f383d6cd-83d4-4e3a-a6ad-a1f521d2e4c6 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:08.402114 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f383d6cd-83d4-4e3a-a6ad-a1f521d2e4c6 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:08.404981 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f383d6cd-83d4-4e3a-a6ad-a1f521d2e4c6 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:08.417557 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f383d6cd-83d4-4e3a-a6ad-a1f521d2e4c6 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 1411 microversion: 2.25 time: 0.210967 Sep 17 20:54:08.418345 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 419/886] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:54:08 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 1411 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 20:54:08.574846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-00bb102d-5a3f-447b-b783-be86be0e7648 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:08.583700 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-00bb102d-5a3f-447b-b783-be86be0e7648 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1" status: 200 len: 1505 microversion: 2.1 time: 0.215831 Sep 17 20:54:08.598175 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 468/887] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:08 2022] GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 => generated 1505 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:08.682409 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5db0e51c-d5ec-4850-bfa2-97277d06c124 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:08.683061 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5db0e51c-d5ec-4850-bfa2-97277d06c124 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 59beeb15-b8ee-49e8-b739-f38a755dc102] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:08.701647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5db0e51c-d5ec-4850-bfa2-97277d06c124 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:08.702155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5db0e51c-d5ec-4850-bfa2-97277d06c124 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:08.703444 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5db0e51c-d5ec-4850-bfa2-97277d06c124 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:08.704194 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5db0e51c-d5ec-4850-bfa2-97277d06c124 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:08.704679 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5db0e51c-d5ec-4850-bfa2-97277d06c124 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:08.705097 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5db0e51c-d5ec-4850-bfa2-97277d06c124 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:09.047471 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5db0e51c-d5ec-4850-bfa2-97277d06c124 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa9e5c7b7dd4a74935de34327145697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b843f5d09c94cf3916f65e815d6d7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:09.064345 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5db0e51c-d5ec-4850-bfa2-97277d06c124 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102" status: 200 len: 1324 microversion: 2.1 time: 0.386333 Sep 17 20:54:09.065847 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 420/888] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:08 2022] GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102 => generated 1324 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:09.253271 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cca1aa55-9c30-4a74-abef-d42fe59ec28c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:09.253987 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cca1aa55-9c30-4a74-abef-d42fe59ec28c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:09.260735 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cca1aa55-9c30-4a74-abef-d42fe59ec28c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:09.261217 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cca1aa55-9c30-4a74-abef-d42fe59ec28c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:09.261889 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cca1aa55-9c30-4a74-abef-d42fe59ec28c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:09.262738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cca1aa55-9c30-4a74-abef-d42fe59ec28c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:09.263193 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cca1aa55-9c30-4a74-abef-d42fe59ec28c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:09.263612 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cca1aa55-9c30-4a74-abef-d42fe59ec28c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:09.448580 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9d7c0601-6c84-4696-8675-870034425a07 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:09.449210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9d7c0601-6c84-4696-8675-870034425a07 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:09.458098 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d7c0601-6c84-4696-8675-870034425a07 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:09.458771 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d7c0601-6c84-4696-8675-870034425a07 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:09.459488 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d7c0601-6c84-4696-8675-870034425a07 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:09.460443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d7c0601-6c84-4696-8675-870034425a07 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:09.461004 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d7c0601-6c84-4696-8675-870034425a07 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:09.461570 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d7c0601-6c84-4696-8675-870034425a07 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:09.479718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cca1aa55-9c30-4a74-abef-d42fe59ec28c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:09.494578 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cca1aa55-9c30-4a74-abef-d42fe59ec28c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1528 microversion: 2.1 time: 0.245736 Sep 17 20:54:09.496621 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 469/889] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:09 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1528 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:09.521452 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-40de03d8-4dba-444a-a437-389a3bf63a8b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:09.522704 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-40de03d8-4dba-444a-a437-389a3bf63a8b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:09.532144 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-40de03d8-4dba-444a-a437-389a3bf63a8b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:09.533593 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-40de03d8-4dba-444a-a437-389a3bf63a8b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:09.534196 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-40de03d8-4dba-444a-a437-389a3bf63a8b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:09.535727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-40de03d8-4dba-444a-a437-389a3bf63a8b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:09.536344 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-40de03d8-4dba-444a-a437-389a3bf63a8b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:09.536922 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-40de03d8-4dba-444a-a437-389a3bf63a8b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:09.796992 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9d7c0601-6c84-4696-8675-870034425a07 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:09.810576 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9d7c0601-6c84-4696-8675-870034425a07 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:09.812489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9d7c0601-6c84-4696-8675-870034425a07 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:09.814554 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9d7c0601-6c84-4696-8675-870034425a07 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 1607 microversion: 2.25 time: 0.373440 Sep 17 20:54:09.815489 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 421/890] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:54:09 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 1607 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:54:09.822178 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0e512709-3462-42c0-b80c-61d80b2f7cdb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:09.839177 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0e512709-3462-42c0-b80c-61d80b2f7cdb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:09.848131 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e512709-3462-42c0-b80c-61d80b2f7cdb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:09.848657 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e512709-3462-42c0-b80c-61d80b2f7cdb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:09.849320 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e512709-3462-42c0-b80c-61d80b2f7cdb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:09.851336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e512709-3462-42c0-b80c-61d80b2f7cdb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:09.852204 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-40de03d8-4dba-444a-a437-389a3bf63a8b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:09.852700 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e512709-3462-42c0-b80c-61d80b2f7cdb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:09.853434 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e512709-3462-42c0-b80c-61d80b2f7cdb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:09.861014 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-40de03d8-4dba-444a-a437-389a3bf63a8b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1528 microversion: 2.1 time: 0.344827 Sep 17 20:54:09.861931 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 470/891] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:09 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1528 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:09.882950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-79026004-1878-4ae1-9fb2-48924d9b620b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:09.883808 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-79026004-1878-4ae1-9fb2-48924d9b620b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:09.896554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79026004-1878-4ae1-9fb2-48924d9b620b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:09.897304 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79026004-1878-4ae1-9fb2-48924d9b620b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:09.897872 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79026004-1878-4ae1-9fb2-48924d9b620b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:09.898676 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79026004-1878-4ae1-9fb2-48924d9b620b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:09.899314 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79026004-1878-4ae1-9fb2-48924d9b620b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:09.899830 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79026004-1878-4ae1-9fb2-48924d9b620b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:09.905120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:54:10.062380 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-79026004-1878-4ae1-9fb2-48924d9b620b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.190801 Sep 17 20:54:10.070561 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 471/892] 10.222.0.26 () {60 vars in 1316 bytes} [Sat Sep 17 20:54:09 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd/os-interface => generated 284 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:54:10.070561 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1c746b98-6995-429f-8734-f9865101e926 tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:10.073910 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-1c746b98-6995-429f-8734-f9865101e926 tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] HTTP exception thrown: Flavor e11eb69d-0e08-4e83-bc39-5671aae60bd2 could not be found. Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1c746b98-6995-429f-8734-f9865101e926 tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Request method failure captured: Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/flavors/e11eb69d-0e08-4e83-bc39-5671aae60bd2 HTTP/1.1 Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjMZYn9NKEdbwzjRLn_XoGAiN3SubaNN8xgRV6FyCHMRyBJQpE5SnULrqZ3BxRyYSkuZT6gMB5kyeVPxfiPc4dlNWyg0DMZixJEYdAtQwJ0WCx19DhxUw_SE6qTOmSs1yJOIbO7aMRKxm1BkXI2GmF8atlxf6LwpHJeRkeW-Ez2pRZA Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: cbe06cc27b4f403faac35ee3521893ea Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-MigrationsAdminTest-1954676359 Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: X-Role: admin,member,reader Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: admin,member,reader Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cbe06cc27b4f403faac35ee3521893ea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cbe06cc27b4f403faac35ee3521893ea"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cbe06cc27b4f403faac35ee3521893ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cbe06cc27b4f403faac35ee3521893ea", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-MigrationsAdminTest-1954676359 Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: cbe06cc27b4f403faac35ee3521893ea Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-MigrationsAdminTest-1954676359 Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-MigrationsAdminTest-1954676359-project-admin Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 27c681039283443c8dd284f22277bc8f Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-MigrationsAdminTest-1954676359-project-admin Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: exception: Flavor e11eb69d-0e08-4e83-bc39-5671aae60bd2 could not be found. Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'e11eb69d-0e08-4e83-bc39-5671aae60bd2'} Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi flavor.destroy() Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor e11eb69d-0e08-4e83-bc39-5671aae60bd2 could not be found. Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor e11eb69d-0e08-4e83-bc39-5671aae60bd2 could not be found. Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:10.075894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:10.080815 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:10.080815 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:10.080815 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:54:10.080815 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:54:10.080815 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:54:10.080815 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:54:10.080815 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor e11eb69d-0e08-4e83-bc39-5671aae60bd2 could not be found. Sep 17 20:54:10.080815 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:10.080815 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1c746b98-6995-429f-8734-f9865101e926 tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Returning 404 to user: Flavor e11eb69d-0e08-4e83-bc39-5671aae60bd2 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:54:10.080815 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1c746b98-6995-429f-8734-f9865101e926 tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/e11eb69d-0e08-4e83-bc39-5671aae60bd2" status: 404 len: 109 microversion: 2.1 time: 0.013340 Sep 17 20:54:10.081834 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 472/893] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:54:10 2022] DELETE /compute/v2.1/flavors/e11eb69d-0e08-4e83-bc39-5671aae60bd2 => generated 109 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:54:10.105337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-eeb39662-6bfa-4104-a9d9-7ca14247f0a5 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:10.106040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-eeb39662-6bfa-4104-a9d9-7ca14247f0a5 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 59beeb15-b8ee-49e8-b739-f38a755dc102] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:10.113452 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eeb39662-6bfa-4104-a9d9-7ca14247f0a5 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:10.113984 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eeb39662-6bfa-4104-a9d9-7ca14247f0a5 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:10.114619 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eeb39662-6bfa-4104-a9d9-7ca14247f0a5 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:10.115521 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eeb39662-6bfa-4104-a9d9-7ca14247f0a5 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:10.116141 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eeb39662-6bfa-4104-a9d9-7ca14247f0a5 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:10.116755 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eeb39662-6bfa-4104-a9d9-7ca14247f0a5 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:10.182849 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0e512709-3462-42c0-b80c-61d80b2f7cdb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:10.192284 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0e512709-3462-42c0-b80c-61d80b2f7cdb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1" status: 200 len: 1505 microversion: 2.1 time: 0.375750 Sep 17 20:54:10.196410 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 422/894] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:09 2022] GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 => generated 1505 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:10.261188 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-be95b4de-9a15-4454-8e1b-70eab39756dd tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-938103956", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:10.323144 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-eeb39662-6bfa-4104-a9d9-7ca14247f0a5 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa9e5c7b7dd4a74935de34327145697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b843f5d09c94cf3916f65e815d6d7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:10.332973 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-be95b4de-9a15-4454-8e1b-70eab39756dd tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] validate_networks() for None {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:54:10.334034 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-eeb39662-6bfa-4104-a9d9-7ca14247f0a5 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102" status: 200 len: 1520 microversion: 2.1 time: 0.235274 Sep 17 20:54:10.337528 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 473/895] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:10 2022] GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102 => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:10.359495 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a69d2c22-6177-4d64-bff6-9889d978f216 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Action: 'create', calling method: .version_select at 0x7f25a57568b0>, body: {"pool": null} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:10.688009 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-be95b4de-9a15-4454-8e1b-70eab39756dd tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:54:10.689252 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-be95b4de-9a15-4454-8e1b-70eab39756dd tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:54:10.690049 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-be95b4de-9a15-4454-8e1b-70eab39756dd tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:54:10.697766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-be95b4de-9a15-4454-8e1b-70eab39756dd tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:54:10.698683 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-be95b4de-9a15-4454-8e1b-70eab39756dd tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:54:10.729730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be95b4de-9a15-4454-8e1b-70eab39756dd tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:10.730608 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be95b4de-9a15-4454-8e1b-70eab39756dd tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:10.731313 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be95b4de-9a15-4454-8e1b-70eab39756dd tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:10.732265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be95b4de-9a15-4454-8e1b-70eab39756dd tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:10.732926 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be95b4de-9a15-4454-8e1b-70eab39756dd tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:10.737505 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be95b4de-9a15-4454-8e1b-70eab39756dd tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:10.763422 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-be95b4de-9a15-4454-8e1b-70eab39756dd tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Getting quotas for project 07ce9fd746374b478a743261eb014e5c. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:54:10.770399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-be95b4de-9a15-4454-8e1b-70eab39756dd tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Getting quotas for user 226a87a1f393420b8d19ec2390e9d063 and project 07ce9fd746374b478a743261eb014e5c. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:54:10.789601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-be95b4de-9a15-4454-8e1b-70eab39756dd tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:54:10.792748 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-be95b4de-9a15-4454-8e1b-70eab39756dd tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:54:10.857098 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-be95b4de-9a15-4454-8e1b-70eab39756dd tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.600522 Sep 17 20:54:10.858594 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 423/896] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:54:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 17 20:54:10.872294 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-32f0140d-7ebf-4848-8c7c-5987e8753591 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:10.873195 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-32f0140d-7ebf-4848-8c7c-5987e8753591 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:10.957310 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-32f0140d-7ebf-4848-8c7c-5987e8753591 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:10.979918 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-32f0140d-7ebf-4848-8c7c-5987e8753591 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1212 microversion: 2.1 time: 0.113926 Sep 17 20:54:10.980700 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 424/897] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:10 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1212 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:11.220063 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4836644a-f9f4-4866-b593-9456c87f5a62 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:11.220684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4836644a-f9f4-4866-b593-9456c87f5a62 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:11.231923 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4836644a-f9f4-4866-b593-9456c87f5a62 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:11.232433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4836644a-f9f4-4866-b593-9456c87f5a62 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:11.238643 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4836644a-f9f4-4866-b593-9456c87f5a62 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:11.239671 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4836644a-f9f4-4866-b593-9456c87f5a62 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:11.240450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4836644a-f9f4-4866-b593-9456c87f5a62 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:11.241101 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4836644a-f9f4-4866-b593-9456c87f5a62 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:12.225576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=38 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:54:12.278062 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4836644a-f9f4-4866-b593-9456c87f5a62 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:12.287197 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4836644a-f9f4-4866-b593-9456c87f5a62 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1" status: 200 len: 1495 microversion: 2.1 time: 1.070870 Sep 17 20:54:12.288258 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 425/898] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:11 2022] GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 => generated 1495 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:54:12.293114 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4836f145-aed8-417c-840d-e256f1816a5b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:12.294120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4836f145-aed8-417c-840d-e256f1816a5b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:12.315541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4836f145-aed8-417c-840d-e256f1816a5b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:12.317669 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4836f145-aed8-417c-840d-e256f1816a5b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:12.318573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4836f145-aed8-417c-840d-e256f1816a5b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:12.321334 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4836f145-aed8-417c-840d-e256f1816a5b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:12.324842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4836f145-aed8-417c-840d-e256f1816a5b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:12.325712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4836f145-aed8-417c-840d-e256f1816a5b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:12.535874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4836f145-aed8-417c-840d-e256f1816a5b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:12.546303 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4836f145-aed8-417c-840d-e256f1816a5b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1264 microversion: 2.1 time: 0.256734 Sep 17 20:54:12.550678 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 426/899] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:12 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1264 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:12.562987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-13440b0b-9853-482a-adbf-3d5c1e9eb02d req-46019d80-609f-431b-b3e2-72d74d0650b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "796a6ed8-e44a-4e34-849d-1daeb1f363dd", "tag": "3825b5cf-93a8-4a37-b807-cab157be9707"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:12.591579 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-13440b0b-9853-482a-adbf-3d5c1e9eb02d req-46019d80-609f-431b-b3e2-72d74d0650b4 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:12.593738 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-13440b0b-9853-482a-adbf-3d5c1e9eb02d req-46019d80-609f-431b-b3e2-72d74d0650b4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:12.594676 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-13440b0b-9853-482a-adbf-3d5c1e9eb02d req-46019d80-609f-431b-b3e2-72d74d0650b4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:12.625800 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-13440b0b-9853-482a-adbf-3d5c1e9eb02d req-46019d80-609f-431b-b3e2-72d74d0650b4 service nova] Creating event network-changed:3825b5cf-93a8-4a37-b807-cab157be9707 for instance 796a6ed8-e44a-4e34-849d-1daeb1f363dd on nch2-master-1 Sep 17 20:54:12.634001 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-13440b0b-9853-482a-adbf-3d5c1e9eb02d req-46019d80-609f-431b-b3e2-72d74d0650b4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079402 Sep 17 20:54:12.634996 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 427/900] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:54:12.648438 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-679b5ca8-a02b-4469-b56f-27e7c4ec17a7 req-ca2288bb-9017-479e-ad66-341baca6e3cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89b39b18-ff49-4810-9701-3084736ff2d0", "name": "network-vif-plugged", "status": "completed", "tag": "67dfcd54-a56f-4269-9ed0-edf035c918b0"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:12.676140 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-679b5ca8-a02b-4469-b56f-27e7c4ec17a7 req-ca2288bb-9017-479e-ad66-341baca6e3cd service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:12.676819 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-679b5ca8-a02b-4469-b56f-27e7c4ec17a7 req-ca2288bb-9017-479e-ad66-341baca6e3cd service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:12.677270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-679b5ca8-a02b-4469-b56f-27e7c4ec17a7 req-ca2288bb-9017-479e-ad66-341baca6e3cd service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:12.728681 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-679b5ca8-a02b-4469-b56f-27e7c4ec17a7 req-ca2288bb-9017-479e-ad66-341baca6e3cd service nova] Creating event network-vif-plugged:67dfcd54-a56f-4269-9ed0-edf035c918b0 for instance 89b39b18-ff49-4810-9701-3084736ff2d0 on nch2-master-1 Sep 17 20:54:12.757741 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-679b5ca8-a02b-4469-b56f-27e7c4ec17a7 req-ca2288bb-9017-479e-ad66-341baca6e3cd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121241 Sep 17 20:54:12.758408 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 428/901] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:54:12.763517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0072e253-32b3-4355-bbc3-826378ca6e44 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Calling method '.version_select at 0x7f25a583f280>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:12.767087 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0072e253-32b3-4355-bbc3-826378ca6e44 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:12.767573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0072e253-32b3-4355-bbc3-826378ca6e44 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:12.768209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0072e253-32b3-4355-bbc3-826378ca6e44 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:12.782233 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0072e253-32b3-4355-bbc3-826378ca6e44 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 2346 microversion: 2.1 time: 0.022051 Sep 17 20:54:12.794458 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 429/902] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Sep 17 20:54:12 2022] GET /compute/v2.1/os-migrations => generated 2346 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:12.801260 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-51ff883b-7334-4c69-a52d-46e08549852a tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:12.802485 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-51ff883b-7334-4c69-a52d-46e08549852a tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:12.813017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-51ff883b-7334-4c69-a52d-46e08549852a tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:12.814603 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-51ff883b-7334-4c69-a52d-46e08549852a tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:12.815247 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-51ff883b-7334-4c69-a52d-46e08549852a tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:12.816199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-51ff883b-7334-4c69-a52d-46e08549852a tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:12.817028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-51ff883b-7334-4c69-a52d-46e08549852a tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:12.817711 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-51ff883b-7334-4c69-a52d-46e08549852a tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:13.200295 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-51ff883b-7334-4c69-a52d-46e08549852a tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1" status: 200 len: 1646 microversion: 2.1 time: 0.403900 Sep 17 20:54:13.217762 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 430/903] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:12 2022] GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 => generated 1646 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:13.349495 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-226b7e4d-c582-4ecd-81a9-00c14d720be5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1490638889", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "eb85edb1-9d13-4b48-a02b-116c5b437767"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:13.399858 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a69d2c22-6177-4d64-bff6-9889d978f216 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.044830 Sep 17 20:54:13.400840 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 474/904] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Sep 17 20:54:10 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3047 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:54:13.426393 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-226b7e4d-c582-4ecd-81a9-00c14d720be5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] validate_networks() for [('eb85edb1-9d13-4b48-a02b-116c5b437767', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:54:13.572918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8b3da63b-0792-4e50-b8ed-76d7c5c5bc81 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:13.573662 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8b3da63b-0792-4e50-b8ed-76d7c5c5bc81 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:13.595130 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8b3da63b-0792-4e50-b8ed-76d7c5c5bc81 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:13.596649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8b3da63b-0792-4e50-b8ed-76d7c5c5bc81 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:13.599434 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8b3da63b-0792-4e50-b8ed-76d7c5c5bc81 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:13.600481 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8b3da63b-0792-4e50-b8ed-76d7c5c5bc81 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:13.602610 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8b3da63b-0792-4e50-b8ed-76d7c5c5bc81 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:13.603264 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8b3da63b-0792-4e50-b8ed-76d7c5c5bc81 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:13.747443 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8b3da63b-0792-4e50-b8ed-76d7c5c5bc81 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:13.756046 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8b3da63b-0792-4e50-b8ed-76d7c5c5bc81 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1270 microversion: 2.1 time: 0.187448 Sep 17 20:54:13.761756 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 475/905] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:13 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1270 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:54:13.771471 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3b0dc342-f12d-4f34-8a6d-3318bb81bdf8 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:13.786313 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3b0dc342-f12d-4f34-8a6d-3318bb81bdf8 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '495973792ca942bca2c6f65d545346e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d29b99a6bd9481f9042d9c7a9451c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:13.787373 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3b0dc342-f12d-4f34-8a6d-3318bb81bdf8 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Searching by: {'deleted': False, 'project_id': '5d29b99a6bd9481f9042d9c7a9451c49'} {{(pid=140524) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 20:54:13.800134 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b0dc342-f12d-4f34-8a6d-3318bb81bdf8 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:13.802499 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b0dc342-f12d-4f34-8a6d-3318bb81bdf8 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:13.803277 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b0dc342-f12d-4f34-8a6d-3318bb81bdf8 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:13.806445 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b0dc342-f12d-4f34-8a6d-3318bb81bdf8 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:13.808342 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b0dc342-f12d-4f34-8a6d-3318bb81bdf8 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:13.808952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b0dc342-f12d-4f34-8a6d-3318bb81bdf8 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:13.957629 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.multi_cell_list [None req-3b0dc342-f12d-4f34-8a6d-3318bb81bdf8 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140524) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 20:54:14.074810 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3b0dc342-f12d-4f34-8a6d-3318bb81bdf8 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 332 microversion: 2.1 time: 0.311568 Sep 17 20:54:14.076269 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 476/906] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Sep 17 20:54:13 2022] GET /compute/v2.1/servers => generated 332 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:54:14.082193 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-325a9134-8562-4448-bf06-9ea9afa55e56 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-387740481", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "3c590c43-fcd5-41d9-9c4b-71b8980abfc0"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:14.153167 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-325a9134-8562-4448-bf06-9ea9afa55e56 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] validate_networks() for [('3c590c43-fcd5-41d9-9c4b-71b8980abfc0', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:54:14.698605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-226b7e4d-c582-4ecd-81a9-00c14d720be5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:54:14.699535 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-226b7e4d-c582-4ecd-81a9-00c14d720be5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:54:14.700200 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-226b7e4d-c582-4ecd-81a9-00c14d720be5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:54:14.700768 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-226b7e4d-c582-4ecd-81a9-00c14d720be5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:54:14.701864 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-226b7e4d-c582-4ecd-81a9-00c14d720be5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:54:14.727724 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-226b7e4d-c582-4ecd-81a9-00c14d720be5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:14.728249 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-226b7e4d-c582-4ecd-81a9-00c14d720be5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:14.728694 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-226b7e4d-c582-4ecd-81a9-00c14d720be5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:14.729438 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-226b7e4d-c582-4ecd-81a9-00c14d720be5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:14.729940 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-226b7e4d-c582-4ecd-81a9-00c14d720be5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:14.730373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-226b7e4d-c582-4ecd-81a9-00c14d720be5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:14.764269 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:54:14.780544 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-226b7e4d-c582-4ecd-81a9-00c14d720be5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Getting quotas for project f6b44bc44e7c4a998bfd99e7d11e99fc. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:54:14.785554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-226b7e4d-c582-4ecd-81a9-00c14d720be5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Getting quotas for user 9c2b746b7c194596808a7b0c736f3b53 and project f6b44bc44e7c4a998bfd99e7d11e99fc. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:54:14.807943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-226b7e4d-c582-4ecd-81a9-00c14d720be5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:54:14.812354 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-226b7e4d-c582-4ecd-81a9-00c14d720be5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:54:14.875773 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-226b7e4d-c582-4ecd-81a9-00c14d720be5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.530809 Sep 17 20:54:14.877207 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 431/907] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:54:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 17 20:54:14.883151 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-21b1269f-078e-4760-a956-f5c458791052 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:14.889186 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-21b1269f-078e-4760-a956-f5c458791052 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '495973792ca942bca2c6f65d545346e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d29b99a6bd9481f9042d9c7a9451c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:14.890433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-21b1269f-078e-4760-a956-f5c458791052 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Searching by: {'deleted': False, 'project_id': '5d29b99a6bd9481f9042d9c7a9451c49'} {{(pid=140523) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 20:54:14.902407 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21b1269f-078e-4760-a956-f5c458791052 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:14.903742 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21b1269f-078e-4760-a956-f5c458791052 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:14.904656 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21b1269f-078e-4760-a956-f5c458791052 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:14.906222 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21b1269f-078e-4760-a956-f5c458791052 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:14.906946 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21b1269f-078e-4760-a956-f5c458791052 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:14.907617 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21b1269f-078e-4760-a956-f5c458791052 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:15.099786 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.multi_cell_list [None req-21b1269f-078e-4760-a956-f5c458791052 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140523) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 20:54:15.236308 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-21b1269f-078e-4760-a956-f5c458791052 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495973792ca942bca2c6f65d545346e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d29b99a6bd9481f9042d9c7a9451c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:15.243270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21b1269f-078e-4760-a956-f5c458791052 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:15.243767 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21b1269f-078e-4760-a956-f5c458791052 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:15.244210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21b1269f-078e-4760-a956-f5c458791052 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:15.639737 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-21b1269f-078e-4760-a956-f5c458791052 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.760910 Sep 17 20:54:15.640381 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 432/908] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:54:14 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:15.653133 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-325a9134-8562-4448-bf06-9ea9afa55e56 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:54:15.653756 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-325a9134-8562-4448-bf06-9ea9afa55e56 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:54:15.654399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-325a9134-8562-4448-bf06-9ea9afa55e56 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:54:15.654938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-325a9134-8562-4448-bf06-9ea9afa55e56 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:54:15.656482 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e534d882-ef95-404a-a6b5-e874b40e66fb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:15.656601 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-325a9134-8562-4448-bf06-9ea9afa55e56 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:54:15.660779 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e534d882-ef95-404a-a6b5-e874b40e66fb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:15.677242 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e534d882-ef95-404a-a6b5-e874b40e66fb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:15.678010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e534d882-ef95-404a-a6b5-e874b40e66fb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:15.679134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e534d882-ef95-404a-a6b5-e874b40e66fb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:15.680686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-325a9134-8562-4448-bf06-9ea9afa55e56 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:15.681450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e534d882-ef95-404a-a6b5-e874b40e66fb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:15.682076 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e534d882-ef95-404a-a6b5-e874b40e66fb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:15.682221 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-325a9134-8562-4448-bf06-9ea9afa55e56 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:15.682684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e534d882-ef95-404a-a6b5-e874b40e66fb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:15.684133 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-325a9134-8562-4448-bf06-9ea9afa55e56 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:15.687406 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-325a9134-8562-4448-bf06-9ea9afa55e56 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:15.687955 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-325a9134-8562-4448-bf06-9ea9afa55e56 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:15.688407 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-325a9134-8562-4448-bf06-9ea9afa55e56 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:15.753970 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-325a9134-8562-4448-bf06-9ea9afa55e56 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Getting quotas for project 6b843f5d09c94cf3916f65e815d6d7a1. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:54:15.762268 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-325a9134-8562-4448-bf06-9ea9afa55e56 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Getting quotas for user aaa9e5c7b7dd4a74935de34327145697 and project 6b843f5d09c94cf3916f65e815d6d7a1. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:54:15.789319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-325a9134-8562-4448-bf06-9ea9afa55e56 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:54:15.792807 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-325a9134-8562-4448-bf06-9ea9afa55e56 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 143322a7-9d8b-43c3-b3a5-4000c26b6cc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:54:15.876582 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-325a9134-8562-4448-bf06-9ea9afa55e56 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.797615 Sep 17 20:54:15.880079 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 477/909] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:54:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:54:15.890380 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9d1bd3d7-4453-4063-ae79-d9fed91e3e31 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:15.897097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9d1bd3d7-4453-4063-ae79-d9fed91e3e31 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:15.911195 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d1bd3d7-4453-4063-ae79-d9fed91e3e31 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:15.911973 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d1bd3d7-4453-4063-ae79-d9fed91e3e31 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:15.912718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d1bd3d7-4453-4063-ae79-d9fed91e3e31 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:15.914214 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d1bd3d7-4453-4063-ae79-d9fed91e3e31 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:15.915072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d1bd3d7-4453-4063-ae79-d9fed91e3e31 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:15.916470 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d1bd3d7-4453-4063-ae79-d9fed91e3e31 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:16.043423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9d1bd3d7-4453-4063-ae79-d9fed91e3e31 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:16.087982 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9d1bd3d7-4453-4063-ae79-d9fed91e3e31 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9" status: 200 len: 1263 microversion: 2.1 time: 0.189714 Sep 17 20:54:16.088884 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 478/910] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:15 2022] GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 => generated 1263 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:16.104967 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e534d882-ef95-404a-a6b5-e874b40e66fb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:16.111133 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-014921fd-9786-48ff-86ec-d5c997eb080c tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:16.127250 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e534d882-ef95-404a-a6b5-e874b40e66fb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1312 microversion: 2.1 time: 0.485518 Sep 17 20:54:16.128559 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 433/911] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:15 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1312 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:16.133571 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-014921fd-9786-48ff-86ec-d5c997eb080c tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.040238 Sep 17 20:54:16.135261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-609cd4d0-eaa7-455c-93ba-53f5ada9ea99 req-f7967662-102a-4217-8bd8-56fa4a19572f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "560c9626-f97e-4bc8-a2a9-942ddb969ccc", "tag": "41a6b4dc-39d8-4713-bf4d-91efa6a5c055"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:16.137364 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 479/912] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Sep 17 20:54:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:54:16.144707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ce4f97cb-4bab-4e2e-89c0-2c83ca7db34f tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:16.145419 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ce4f97cb-4bab-4e2e-89c0-2c83ca7db34f tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 143322a7-9d8b-43c3-b3a5-4000c26b6cc7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:16.160624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-609cd4d0-eaa7-455c-93ba-53f5ada9ea99 req-f7967662-102a-4217-8bd8-56fa4a19572f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:16.162806 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-609cd4d0-eaa7-455c-93ba-53f5ada9ea99 req-f7967662-102a-4217-8bd8-56fa4a19572f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:16.165237 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-609cd4d0-eaa7-455c-93ba-53f5ada9ea99 req-f7967662-102a-4217-8bd8-56fa4a19572f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:16.197584 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-609cd4d0-eaa7-455c-93ba-53f5ada9ea99 req-f7967662-102a-4217-8bd8-56fa4a19572f service nova] Creating event network-changed:41a6b4dc-39d8-4713-bf4d-91efa6a5c055 for instance 560c9626-f97e-4bc8-a2a9-942ddb969ccc on nch1-master-1 Sep 17 20:54:16.219436 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-609cd4d0-eaa7-455c-93ba-53f5ada9ea99 req-f7967662-102a-4217-8bd8-56fa4a19572f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084015 Sep 17 20:54:16.223519 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 434/913] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:54:16.277216 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ce4f97cb-4bab-4e2e-89c0-2c83ca7db34f tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa9e5c7b7dd4a74935de34327145697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b843f5d09c94cf3916f65e815d6d7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:16.288631 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ce4f97cb-4bab-4e2e-89c0-2c83ca7db34f tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "GET /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7" status: 200 len: 1223 microversion: 2.1 time: 0.147943 Sep 17 20:54:16.289224 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 480/914] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:16 2022] GET /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7 => generated 1223 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:16.472013 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-43fd1964-4cc0-49b9-a82c-f8ceef45c3f4 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:16.472747 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-43fd1964-4cc0-49b9-a82c-f8ceef45c3f4 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] [instance: b2b0fad5-5be4-433b-bd8e-f51c4c8de010] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:16.483690 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-43fd1964-4cc0-49b9-a82c-f8ceef45c3f4 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:16.484305 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-43fd1964-4cc0-49b9-a82c-f8ceef45c3f4 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:16.486753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-43fd1964-4cc0-49b9-a82c-f8ceef45c3f4 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:16.487509 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-43fd1964-4cc0-49b9-a82c-f8ceef45c3f4 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:16.487976 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-43fd1964-4cc0-49b9-a82c-f8ceef45c3f4 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:16.488410 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-43fd1964-4cc0-49b9-a82c-f8ceef45c3f4 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:16.526512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-43fd1964-4cc0-49b9-a82c-f8ceef45c3f4 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] [instance: b2b0fad5-5be4-433b-bd8e-f51c4c8de010] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:54:16.644264 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-43fd1964-4cc0-49b9-a82c-f8ceef45c3f4 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010" status: 204 len: 0 microversion: 2.1 time: 0.176186 Sep 17 20:54:16.655433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9b3cc0f0-cf3d-4e32-b635-ea017ef91e4e tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:16.656030 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9b3cc0f0-cf3d-4e32-b635-ea017ef91e4e tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] [instance: b2b0fad5-5be4-433b-bd8e-f51c4c8de010] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:16.660227 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 435/915] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:54:16 2022] DELETE /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:54:16.665809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b3cc0f0-cf3d-4e32-b635-ea017ef91e4e tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:16.666828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b3cc0f0-cf3d-4e32-b635-ea017ef91e4e tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:16.667511 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b3cc0f0-cf3d-4e32-b635-ea017ef91e4e tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:16.668486 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b3cc0f0-cf3d-4e32-b635-ea017ef91e4e tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:16.670575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b3cc0f0-cf3d-4e32-b635-ea017ef91e4e tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:16.671349 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b3cc0f0-cf3d-4e32-b635-ea017ef91e4e tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:16.870219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9b3cc0f0-cf3d-4e32-b635-ea017ef91e4e tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495973792ca942bca2c6f65d545346e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d29b99a6bd9481f9042d9c7a9451c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:16.881878 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9b3cc0f0-cf3d-4e32-b635-ea017ef91e4e tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] 10.222.0.26 "GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010" status: 200 len: 1699 microversion: 2.1 time: 0.231610 Sep 17 20:54:16.882555 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 481/916] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:16 2022] GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010 => generated 1699 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:17.116650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-435355d1-6d4c-4cf3-9ead-1c8c6699c526 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:17.118103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-435355d1-6d4c-4cf3-9ead-1c8c6699c526 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:17.133113 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-435355d1-6d4c-4cf3-9ead-1c8c6699c526 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:17.134143 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-435355d1-6d4c-4cf3-9ead-1c8c6699c526 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:17.134829 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-435355d1-6d4c-4cf3-9ead-1c8c6699c526 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:17.135753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-435355d1-6d4c-4cf3-9ead-1c8c6699c526 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:17.136560 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-435355d1-6d4c-4cf3-9ead-1c8c6699c526 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:17.137231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-435355d1-6d4c-4cf3-9ead-1c8c6699c526 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:17.165650 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-02eaa570-2865-4eb9-b579-fe571de8d976 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:17.167482 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-02eaa570-2865-4eb9-b579-fe571de8d976 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:17.192185 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02eaa570-2865-4eb9-b579-fe571de8d976 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:17.195826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02eaa570-2865-4eb9-b579-fe571de8d976 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:17.196393 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02eaa570-2865-4eb9-b579-fe571de8d976 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:17.199772 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02eaa570-2865-4eb9-b579-fe571de8d976 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:17.200472 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02eaa570-2865-4eb9-b579-fe571de8d976 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:17.201746 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02eaa570-2865-4eb9-b579-fe571de8d976 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:17.204566 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-435355d1-6d4c-4cf3-9ead-1c8c6699c526 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:17.213915 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-435355d1-6d4c-4cf3-9ead-1c8c6699c526 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9" status: 200 len: 1271 microversion: 2.1 time: 0.101929 Sep 17 20:54:17.215129 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 436/917] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:17 2022] GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 => generated 1271 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:17.311438 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-04a2562c-178c-44a8-a2c8-ca1a7d0f86ac tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:17.312254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-04a2562c-178c-44a8-a2c8-ca1a7d0f86ac tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 143322a7-9d8b-43c3-b3a5-4000c26b6cc7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:17.320843 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04a2562c-178c-44a8-a2c8-ca1a7d0f86ac tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:17.322658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04a2562c-178c-44a8-a2c8-ca1a7d0f86ac tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:17.325394 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04a2562c-178c-44a8-a2c8-ca1a7d0f86ac tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:17.326457 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04a2562c-178c-44a8-a2c8-ca1a7d0f86ac tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:17.327274 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04a2562c-178c-44a8-a2c8-ca1a7d0f86ac tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:17.329730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04a2562c-178c-44a8-a2c8-ca1a7d0f86ac tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:17.458343 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-04a2562c-178c-44a8-a2c8-ca1a7d0f86ac tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa9e5c7b7dd4a74935de34327145697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b843f5d09c94cf3916f65e815d6d7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:17.468119 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-04a2562c-178c-44a8-a2c8-ca1a7d0f86ac tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "GET /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7" status: 200 len: 1275 microversion: 2.1 time: 0.160570 Sep 17 20:54:17.471721 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 437/918] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:17 2022] GET /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7 => generated 1275 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:17.490007 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-02eaa570-2865-4eb9-b579-fe571de8d976 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:17.499585 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-02eaa570-2865-4eb9-b579-fe571de8d976 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1312 microversion: 2.1 time: 0.339225 Sep 17 20:54:17.513487 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 482/919] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:17 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1312 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:54:17.911071 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-413ec846-7226-4f74-b822-48cb419ee9ec tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:17.912098 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-413ec846-7226-4f74-b822-48cb419ee9ec tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] [instance: b2b0fad5-5be4-433b-bd8e-f51c4c8de010] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:17.919982 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-413ec846-7226-4f74-b822-48cb419ee9ec tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:17.920825 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-413ec846-7226-4f74-b822-48cb419ee9ec tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:17.921739 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-413ec846-7226-4f74-b822-48cb419ee9ec tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:17.922753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-413ec846-7226-4f74-b822-48cb419ee9ec tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:17.923409 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-413ec846-7226-4f74-b822-48cb419ee9ec tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:17.924190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-413ec846-7226-4f74-b822-48cb419ee9ec tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:17.953766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:54:18.106627 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-413ec846-7226-4f74-b822-48cb419ee9ec tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495973792ca942bca2c6f65d545346e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d29b99a6bd9481f9042d9c7a9451c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:18.117079 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-413ec846-7226-4f74-b822-48cb419ee9ec tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] 10.222.0.26 "GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010" status: 200 len: 1699 microversion: 2.1 time: 0.213921 Sep 17 20:54:18.122301 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 438/920] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:17 2022] GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010 => generated 1699 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:18.240290 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b9e2da9e-a675-4ceb-a462-af95d19f2950 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:18.241026 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b9e2da9e-a675-4ceb-a462-af95d19f2950 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:18.248921 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9e2da9e-a675-4ceb-a462-af95d19f2950 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:18.249596 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9e2da9e-a675-4ceb-a462-af95d19f2950 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:18.251307 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9e2da9e-a675-4ceb-a462-af95d19f2950 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:18.252414 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9e2da9e-a675-4ceb-a462-af95d19f2950 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:18.252972 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9e2da9e-a675-4ceb-a462-af95d19f2950 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:18.253677 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9e2da9e-a675-4ceb-a462-af95d19f2950 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:18.377275 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b9e2da9e-a675-4ceb-a462-af95d19f2950 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:18.397098 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b9e2da9e-a675-4ceb-a462-af95d19f2950 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9" status: 200 len: 1269 microversion: 2.1 time: 0.159568 Sep 17 20:54:18.397945 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 483/921] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:18 2022] GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:18.502104 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-33079151-cf0a-463e-9df5-ae3012875959 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:18.509567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-33079151-cf0a-463e-9df5-ae3012875959 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 143322a7-9d8b-43c3-b3a5-4000c26b6cc7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:18.528269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-089847ee-df18-49f7-993c-66e84a8ab6c7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:18.529202 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-089847ee-df18-49f7-993c-66e84a8ab6c7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:18.536642 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-33079151-cf0a-463e-9df5-ae3012875959 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:18.539453 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-33079151-cf0a-463e-9df5-ae3012875959 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:18.542372 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-33079151-cf0a-463e-9df5-ae3012875959 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:18.545953 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-089847ee-df18-49f7-993c-66e84a8ab6c7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:18.546508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-089847ee-df18-49f7-993c-66e84a8ab6c7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:18.546964 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-089847ee-df18-49f7-993c-66e84a8ab6c7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:18.547475 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-33079151-cf0a-463e-9df5-ae3012875959 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:18.547975 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-33079151-cf0a-463e-9df5-ae3012875959 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:18.548613 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-33079151-cf0a-463e-9df5-ae3012875959 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:18.550870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-089847ee-df18-49f7-993c-66e84a8ab6c7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:18.552488 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-089847ee-df18-49f7-993c-66e84a8ab6c7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:18.556478 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-089847ee-df18-49f7-993c-66e84a8ab6c7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:18.662862 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-33079151-cf0a-463e-9df5-ae3012875959 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa9e5c7b7dd4a74935de34327145697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b843f5d09c94cf3916f65e815d6d7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:18.678009 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-33079151-cf0a-463e-9df5-ae3012875959 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "GET /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7" status: 200 len: 1281 microversion: 2.1 time: 0.183561 Sep 17 20:54:18.683127 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 439/922] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:18 2022] GET /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7 => generated 1281 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:18.800981 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-089847ee-df18-49f7-993c-66e84a8ab6c7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:18.810852 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-089847ee-df18-49f7-993c-66e84a8ab6c7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1312 microversion: 2.1 time: 0.288275 Sep 17 20:54:18.811577 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 484/923] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:18 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1312 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:19.142183 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bf01b080-ac69-4e49-8ef3-3529585afc84 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:19.142803 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bf01b080-ac69-4e49-8ef3-3529585afc84 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] [instance: b2b0fad5-5be4-433b-bd8e-f51c4c8de010] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:19.150953 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf01b080-ac69-4e49-8ef3-3529585afc84 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:19.151900 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf01b080-ac69-4e49-8ef3-3529585afc84 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:19.152556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf01b080-ac69-4e49-8ef3-3529585afc84 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:19.153311 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf01b080-ac69-4e49-8ef3-3529585afc84 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:19.153799 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf01b080-ac69-4e49-8ef3-3529585afc84 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:19.154202 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf01b080-ac69-4e49-8ef3-3529585afc84 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:19.322910 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bf01b080-ac69-4e49-8ef3-3529585afc84 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495973792ca942bca2c6f65d545346e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d29b99a6bd9481f9042d9c7a9451c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:19.338156 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bf01b080-ac69-4e49-8ef3-3529585afc84 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] 10.222.0.26 "GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010" status: 200 len: 1699 microversion: 2.1 time: 0.199861 Sep 17 20:54:19.353054 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 440/924] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:19 2022] GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010 => generated 1699 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:19.422871 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-aad96c75-2ee2-440c-8713-698e312e9b3a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:19.423494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-aad96c75-2ee2-440c-8713-698e312e9b3a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:19.431583 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aad96c75-2ee2-440c-8713-698e312e9b3a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:19.432087 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aad96c75-2ee2-440c-8713-698e312e9b3a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:19.432529 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aad96c75-2ee2-440c-8713-698e312e9b3a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:19.433242 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aad96c75-2ee2-440c-8713-698e312e9b3a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:19.433817 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aad96c75-2ee2-440c-8713-698e312e9b3a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:19.434247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aad96c75-2ee2-440c-8713-698e312e9b3a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:19.503425 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-aad96c75-2ee2-440c-8713-698e312e9b3a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:19.513201 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-aad96c75-2ee2-440c-8713-698e312e9b3a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9" status: 200 len: 1269 microversion: 2.1 time: 0.094944 Sep 17 20:54:19.514082 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 485/925] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:19 2022] GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 => generated 1269 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:19.711017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-18e0099b-1669-4a50-9684-4368f084bdf1 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:19.711917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-18e0099b-1669-4a50-9684-4368f084bdf1 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 143322a7-9d8b-43c3-b3a5-4000c26b6cc7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:19.720435 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-18e0099b-1669-4a50-9684-4368f084bdf1 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:19.721103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-18e0099b-1669-4a50-9684-4368f084bdf1 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:19.721814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-18e0099b-1669-4a50-9684-4368f084bdf1 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:19.722670 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-18e0099b-1669-4a50-9684-4368f084bdf1 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:19.723508 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-18e0099b-1669-4a50-9684-4368f084bdf1 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:19.724441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-18e0099b-1669-4a50-9684-4368f084bdf1 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:19.797955 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-18e0099b-1669-4a50-9684-4368f084bdf1 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa9e5c7b7dd4a74935de34327145697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b843f5d09c94cf3916f65e815d6d7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:19.806268 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-18e0099b-1669-4a50-9684-4368f084bdf1 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "GET /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7" status: 200 len: 1281 microversion: 2.1 time: 0.099455 Sep 17 20:54:19.806845 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 441/926] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:19 2022] GET /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7 => generated 1281 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:19.835232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9cfa1923-0f22-4250-b549-3d59ddb8337c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:19.835753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9cfa1923-0f22-4250-b549-3d59ddb8337c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:19.842358 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9cfa1923-0f22-4250-b549-3d59ddb8337c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:19.842943 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9cfa1923-0f22-4250-b549-3d59ddb8337c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:19.843556 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9cfa1923-0f22-4250-b549-3d59ddb8337c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:19.844419 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9cfa1923-0f22-4250-b549-3d59ddb8337c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:19.845056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9cfa1923-0f22-4250-b549-3d59ddb8337c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:19.845745 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9cfa1923-0f22-4250-b549-3d59ddb8337c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:19.999512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9cfa1923-0f22-4250-b549-3d59ddb8337c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:20.009790 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9cfa1923-0f22-4250-b549-3d59ddb8337c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1312 microversion: 2.1 time: 0.178390 Sep 17 20:54:20.010656 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 486/927] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:19 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1312 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:20.364646 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b9cfb08b-0670-47ff-b23b-b708b9b88851 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:20.365366 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b9cfb08b-0670-47ff-b23b-b708b9b88851 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] [instance: b2b0fad5-5be4-433b-bd8e-f51c4c8de010] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:20.375026 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9cfb08b-0670-47ff-b23b-b708b9b88851 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:20.375746 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9cfb08b-0670-47ff-b23b-b708b9b88851 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:20.376412 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9cfb08b-0670-47ff-b23b-b708b9b88851 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:20.377693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9cfb08b-0670-47ff-b23b-b708b9b88851 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:20.378345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9cfb08b-0670-47ff-b23b-b708b9b88851 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:20.378977 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9cfb08b-0670-47ff-b23b-b708b9b88851 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:20.425154 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a759a092-1c58-40c3-bfd9-273814b8b369 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-378469671", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "c1a7aff7-16bc-489c-b88f-724a10b4c0a6"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:20.458951 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b9cfb08b-0670-47ff-b23b-b708b9b88851 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495973792ca942bca2c6f65d545346e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d29b99a6bd9481f9042d9c7a9451c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:20.467958 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b9cfb08b-0670-47ff-b23b-b708b9b88851 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] 10.222.0.26 "GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010" status: 200 len: 1631 microversion: 2.1 time: 0.107527 Sep 17 20:54:20.472096 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 487/928] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:20 2022] GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010 => generated 1631 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:54:20.502032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-a759a092-1c58-40c3-bfd9-273814b8b369 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] validate_networks() for [('c1a7aff7-16bc-489c-b88f-724a10b4c0a6', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:54:20.536697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4f868fe2-1384-4a68-9ee6-8b914db4ab4d tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:20.537312 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4f868fe2-1384-4a68-9ee6-8b914db4ab4d tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:20.543710 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f868fe2-1384-4a68-9ee6-8b914db4ab4d tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:20.544431 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f868fe2-1384-4a68-9ee6-8b914db4ab4d tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:20.544881 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f868fe2-1384-4a68-9ee6-8b914db4ab4d tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:20.545627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f868fe2-1384-4a68-9ee6-8b914db4ab4d tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:20.546241 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f868fe2-1384-4a68-9ee6-8b914db4ab4d tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:20.546825 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f868fe2-1384-4a68-9ee6-8b914db4ab4d tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:20.675771 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4f868fe2-1384-4a68-9ee6-8b914db4ab4d tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:20.726722 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4f868fe2-1384-4a68-9ee6-8b914db4ab4d tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9" status: 200 len: 1269 microversion: 2.1 time: 0.193866 Sep 17 20:54:20.727639 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 488/929] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:20 2022] GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 => generated 1269 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:54:20.829353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-54284600-07fd-49ef-8a72-60ce7ec749a7 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:20.830167 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-54284600-07fd-49ef-8a72-60ce7ec749a7 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 143322a7-9d8b-43c3-b3a5-4000c26b6cc7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:20.845400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-54284600-07fd-49ef-8a72-60ce7ec749a7 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:20.846007 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-54284600-07fd-49ef-8a72-60ce7ec749a7 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:20.846506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-54284600-07fd-49ef-8a72-60ce7ec749a7 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:20.847314 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-54284600-07fd-49ef-8a72-60ce7ec749a7 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:20.847782 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-54284600-07fd-49ef-8a72-60ce7ec749a7 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:20.848213 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-54284600-07fd-49ef-8a72-60ce7ec749a7 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:21.125179 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-54284600-07fd-49ef-8a72-60ce7ec749a7 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa9e5c7b7dd4a74935de34327145697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b843f5d09c94cf3916f65e815d6d7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:21.134020 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-54284600-07fd-49ef-8a72-60ce7ec749a7 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "GET /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7" status: 200 len: 1323 microversion: 2.1 time: 0.309458 Sep 17 20:54:21.145285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a759a092-1c58-40c3-bfd9-273814b8b369 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:54:21.146016 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a759a092-1c58-40c3-bfd9-273814b8b369 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:54:21.146210 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 489/930] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:20 2022] GET /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7 => generated 1323 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:54:21.146983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a759a092-1c58-40c3-bfd9-273814b8b369 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:54:21.147682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a759a092-1c58-40c3-bfd9-273814b8b369 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:54:21.148254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a759a092-1c58-40c3-bfd9-273814b8b369 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:54:21.159680 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-36ff2254-c6c4-4b6a-9675-6507e8e17991 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:21.160654 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-36ff2254-c6c4-4b6a-9675-6507e8e17991 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:21.163912 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a759a092-1c58-40c3-bfd9-273814b8b369 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:21.164478 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a759a092-1c58-40c3-bfd9-273814b8b369 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:21.164912 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a759a092-1c58-40c3-bfd9-273814b8b369 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:21.165741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a759a092-1c58-40c3-bfd9-273814b8b369 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:21.166259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a759a092-1c58-40c3-bfd9-273814b8b369 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:21.166868 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a759a092-1c58-40c3-bfd9-273814b8b369 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:21.168733 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-36ff2254-c6c4-4b6a-9675-6507e8e17991 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:21.169428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-36ff2254-c6c4-4b6a-9675-6507e8e17991 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:21.170040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-36ff2254-c6c4-4b6a-9675-6507e8e17991 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:21.170925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-36ff2254-c6c4-4b6a-9675-6507e8e17991 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:21.171535 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-36ff2254-c6c4-4b6a-9675-6507e8e17991 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:21.172109 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-36ff2254-c6c4-4b6a-9675-6507e8e17991 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:21.193517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-a759a092-1c58-40c3-bfd9-273814b8b369 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Getting quotas for project 52c89ce6659b4b4b9d6a53c9a8d33b41. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:54:21.199054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-a759a092-1c58-40c3-bfd9-273814b8b369 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Getting quotas for user d461326fa46149f5a49b278b32d9c9fb and project 52c89ce6659b4b4b9d6a53c9a8d33b41. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:54:21.220791 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a759a092-1c58-40c3-bfd9-273814b8b369 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:54:21.223823 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a759a092-1c58-40c3-bfd9-273814b8b369 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:54:21.289569 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a759a092-1c58-40c3-bfd9-273814b8b369 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.060616 Sep 17 20:54:21.293389 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 442/931] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:54:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:54:21.304895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-86511233-49d9-445b-a6d0-dd61f150ad56 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:21.305862 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-86511233-49d9-445b-a6d0-dd61f150ad56 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:21.376493 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-36ff2254-c6c4-4b6a-9675-6507e8e17991 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:21.387387 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-36ff2254-c6c4-4b6a-9675-6507e8e17991 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1312 microversion: 2.1 time: 0.238025 Sep 17 20:54:21.388211 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 490/932] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:21 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1312 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:21.409295 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-86511233-49d9-445b-a6d0-dd61f150ad56 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:21.417551 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-86511233-49d9-445b-a6d0-dd61f150ad56 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1217 microversion: 2.1 time: 0.116875 Sep 17 20:54:21.418133 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 443/933] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:21 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1217 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:54:21.492859 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c2c643c7-bfd8-416a-b590-365b2c67cb22 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:21.493666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c2c643c7-bfd8-416a-b590-365b2c67cb22 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] [instance: b2b0fad5-5be4-433b-bd8e-f51c4c8de010] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:21.503524 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c2c643c7-bfd8-416a-b590-365b2c67cb22 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:21.505774 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c2c643c7-bfd8-416a-b590-365b2c67cb22 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:21.506187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c2c643c7-bfd8-416a-b590-365b2c67cb22 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:21.508390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c2c643c7-bfd8-416a-b590-365b2c67cb22 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:21.509327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c2c643c7-bfd8-416a-b590-365b2c67cb22 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:21.512299 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c2c643c7-bfd8-416a-b590-365b2c67cb22 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:21.628475 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c2c643c7-bfd8-416a-b590-365b2c67cb22 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495973792ca942bca2c6f65d545346e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d29b99a6bd9481f9042d9c7a9451c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:21.647046 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c2c643c7-bfd8-416a-b590-365b2c67cb22 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] 10.222.0.26 "GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010" status: 200 len: 1631 microversion: 2.1 time: 0.156278 Sep 17 20:54:21.661394 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 491/934] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:21 2022] GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010 => generated 1631 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:21.752817 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cf70e8f4-9984-4c5c-86e1-ecc9f67c7263 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:21.754244 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cf70e8f4-9984-4c5c-86e1-ecc9f67c7263 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:21.765561 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf70e8f4-9984-4c5c-86e1-ecc9f67c7263 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:21.766083 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf70e8f4-9984-4c5c-86e1-ecc9f67c7263 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:21.766528 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf70e8f4-9984-4c5c-86e1-ecc9f67c7263 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:21.769785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf70e8f4-9984-4c5c-86e1-ecc9f67c7263 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:21.770463 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf70e8f4-9984-4c5c-86e1-ecc9f67c7263 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:21.775724 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf70e8f4-9984-4c5c-86e1-ecc9f67c7263 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:21.846631 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-8638423f-e89c-4f1c-952c-746ac9307c74 req-8bc7dc87-f82e-4664-83b9-05fe38f94202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2b0fad5-5be4-433b-bd8e-f51c4c8de010", "name": "network-vif-deleted", "tag": "d84a1ac3-3c9c-4bd7-8638-7d28ec39e2b8"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:21.883550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8638423f-e89c-4f1c-952c-746ac9307c74 req-8bc7dc87-f82e-4664-83b9-05fe38f94202 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:21.885323 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8638423f-e89c-4f1c-952c-746ac9307c74 req-8bc7dc87-f82e-4664-83b9-05fe38f94202 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:21.886046 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8638423f-e89c-4f1c-952c-746ac9307c74 req-8bc7dc87-f82e-4664-83b9-05fe38f94202 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:21.916950 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-8638423f-e89c-4f1c-952c-746ac9307c74 req-8bc7dc87-f82e-4664-83b9-05fe38f94202 service nova] Creating event network-vif-deleted:d84a1ac3-3c9c-4bd7-8638-7d28ec39e2b8 for instance b2b0fad5-5be4-433b-bd8e-f51c4c8de010 on nch1-master-1 Sep 17 20:54:21.943418 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-8638423f-e89c-4f1c-952c-746ac9307c74 req-8bc7dc87-f82e-4664-83b9-05fe38f94202 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101878 Sep 17 20:54:21.947499 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 492/935] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:54:22.166664 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5fb05b6d-6038-495b-a4e5-277e0ee3462e tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:22.168413 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5fb05b6d-6038-495b-a4e5-277e0ee3462e tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 143322a7-9d8b-43c3-b3a5-4000c26b6cc7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:22.183997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5fb05b6d-6038-495b-a4e5-277e0ee3462e tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:22.184865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5fb05b6d-6038-495b-a4e5-277e0ee3462e tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:22.185387 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5fb05b6d-6038-495b-a4e5-277e0ee3462e tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:22.187598 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5fb05b6d-6038-495b-a4e5-277e0ee3462e tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:22.188139 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5fb05b6d-6038-495b-a4e5-277e0ee3462e tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:22.192305 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5fb05b6d-6038-495b-a4e5-277e0ee3462e tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:22.225136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:54:22.279006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cf70e8f4-9984-4c5c-86e1-ecc9f67c7263 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:22.290607 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cf70e8f4-9984-4c5c-86e1-ecc9f67c7263 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9" status: 200 len: 1311 microversion: 2.1 time: 0.542414 Sep 17 20:54:22.293770 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 444/936] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:21 2022] GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 => generated 1311 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:22.413376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-05a1e8df-aa62-4bb1-8e77-4aec4863456d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:22.414109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-05a1e8df-aa62-4bb1-8e77-4aec4863456d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:22.430632 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-05a1e8df-aa62-4bb1-8e77-4aec4863456d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:22.431445 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-05a1e8df-aa62-4bb1-8e77-4aec4863456d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:22.431977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-05a1e8df-aa62-4bb1-8e77-4aec4863456d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:22.432799 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-05a1e8df-aa62-4bb1-8e77-4aec4863456d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:22.435429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-05a1e8df-aa62-4bb1-8e77-4aec4863456d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:22.436002 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-05a1e8df-aa62-4bb1-8e77-4aec4863456d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:22.515719 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5fb05b6d-6038-495b-a4e5-277e0ee3462e tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa9e5c7b7dd4a74935de34327145697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b843f5d09c94cf3916f65e815d6d7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:22.529225 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5fb05b6d-6038-495b-a4e5-277e0ee3462e tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "GET /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7" status: 200 len: 1323 microversion: 2.1 time: 0.370134 Sep 17 20:54:22.531995 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 493/937] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:22 2022] GET /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7 => generated 1323 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:22.542660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-da7b8896-5ad2-4eaa-b028-4c1d9e7ad385 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:22.545890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-da7b8896-5ad2-4eaa-b028-4c1d9e7ad385 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:22.560585 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-da7b8896-5ad2-4eaa-b028-4c1d9e7ad385 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:22.561516 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-da7b8896-5ad2-4eaa-b028-4c1d9e7ad385 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:22.564979 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-da7b8896-5ad2-4eaa-b028-4c1d9e7ad385 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:22.566089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-da7b8896-5ad2-4eaa-b028-4c1d9e7ad385 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:22.567905 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-da7b8896-5ad2-4eaa-b028-4c1d9e7ad385 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:22.569874 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-da7b8896-5ad2-4eaa-b028-4c1d9e7ad385 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:22.742233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-da7b8896-5ad2-4eaa-b028-4c1d9e7ad385 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:22.752862 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-da7b8896-5ad2-4eaa-b028-4c1d9e7ad385 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1269 microversion: 2.1 time: 0.219449 Sep 17 20:54:22.757245 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 494/938] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:22 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1269 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:22.762362 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-99c5eea0-2aec-4402-9a53-9054ae1e1565 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:22.765593 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-99c5eea0-2aec-4402-9a53-9054ae1e1565 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] [instance: b2b0fad5-5be4-433b-bd8e-f51c4c8de010] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:22.773720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:54:22.776038 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-99c5eea0-2aec-4402-9a53-9054ae1e1565 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:22.776903 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-99c5eea0-2aec-4402-9a53-9054ae1e1565 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:22.785986 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-99c5eea0-2aec-4402-9a53-9054ae1e1565 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:22.788533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-99c5eea0-2aec-4402-9a53-9054ae1e1565 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:22.789359 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-99c5eea0-2aec-4402-9a53-9054ae1e1565 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:22.791859 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-99c5eea0-2aec-4402-9a53-9054ae1e1565 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:22.834979 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-99c5eea0-2aec-4402-9a53-9054ae1e1565 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:22.835981 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-99c5eea0-2aec-4402-9a53-9054ae1e1565 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:22.836801 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-99c5eea0-2aec-4402-9a53-9054ae1e1565 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:22.837486 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-99c5eea0-2aec-4402-9a53-9054ae1e1565 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lazy-loading 'fault' on Instance uuid b2b0fad5-5be4-433b-bd8e-f51c4c8de010 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:54:22.864022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-05a1e8df-aa62-4bb1-8e77-4aec4863456d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:22.880824 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-05a1e8df-aa62-4bb1-8e77-4aec4863456d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1312 microversion: 2.1 time: 0.467567 Sep 17 20:54:22.881530 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 445/939] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:22 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1312 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:22.972081 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-99c5eea0-2aec-4402-9a53-9054ae1e1565 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '495973792ca942bca2c6f65d545346e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d29b99a6bd9481f9042d9c7a9451c49', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:23.007075 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-99c5eea0-2aec-4402-9a53-9054ae1e1565 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] 10.222.0.26 "GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010" status: 200 len: 1357 microversion: 2.1 time: 0.245799 Sep 17 20:54:23.009114 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 495/940] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:22 2022] GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010 => generated 1357 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:23.328977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c227027c-86d0-4e31-9b8b-492ceb3fbd27 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:23.329979 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c227027c-86d0-4e31-9b8b-492ceb3fbd27 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:23.337909 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c227027c-86d0-4e31-9b8b-492ceb3fbd27 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:23.338630 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c227027c-86d0-4e31-9b8b-492ceb3fbd27 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:23.339234 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c227027c-86d0-4e31-9b8b-492ceb3fbd27 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:23.340145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c227027c-86d0-4e31-9b8b-492ceb3fbd27 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:23.340962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c227027c-86d0-4e31-9b8b-492ceb3fbd27 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:23.341590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c227027c-86d0-4e31-9b8b-492ceb3fbd27 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:23.537006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c227027c-86d0-4e31-9b8b-492ceb3fbd27 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:23.545765 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c227027c-86d0-4e31-9b8b-492ceb3fbd27 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9" status: 200 len: 1311 microversion: 2.1 time: 0.228937 Sep 17 20:54:23.546668 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 446/941] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:23 2022] GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 => generated 1311 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:23.554728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6dbae943-c6c7-45e4-9416-9502c81fa340 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:23.556135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6dbae943-c6c7-45e4-9416-9502c81fa340 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 143322a7-9d8b-43c3-b3a5-4000c26b6cc7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:23.563411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6dbae943-c6c7-45e4-9416-9502c81fa340 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:23.564290 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6dbae943-c6c7-45e4-9416-9502c81fa340 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:23.564728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6dbae943-c6c7-45e4-9416-9502c81fa340 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:23.565719 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6dbae943-c6c7-45e4-9416-9502c81fa340 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:23.566334 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6dbae943-c6c7-45e4-9416-9502c81fa340 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:23.566903 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6dbae943-c6c7-45e4-9416-9502c81fa340 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:23.649283 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-b0a7a311-df20-4439-b356-0cecd5a31021 req-ecba6eda-32b5-4c28-8f93-b3164d181a32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "560c9626-f97e-4bc8-a2a9-942ddb969ccc", "name": "network-vif-plugged", "status": "completed", "tag": "41a6b4dc-39d8-4713-bf4d-91efa6a5c055"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:23.714643 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b0a7a311-df20-4439-b356-0cecd5a31021 req-ecba6eda-32b5-4c28-8f93-b3164d181a32 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:23.722161 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b0a7a311-df20-4439-b356-0cecd5a31021 req-ecba6eda-32b5-4c28-8f93-b3164d181a32 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:23.730546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b0a7a311-df20-4439-b356-0cecd5a31021 req-ecba6eda-32b5-4c28-8f93-b3164d181a32 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:23.798634 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-b0a7a311-df20-4439-b356-0cecd5a31021 req-ecba6eda-32b5-4c28-8f93-b3164d181a32 service nova] Creating event network-vif-plugged:41a6b4dc-39d8-4713-bf4d-91efa6a5c055 for instance 560c9626-f97e-4bc8-a2a9-942ddb969ccc on nch1-master-1 Sep 17 20:54:23.805743 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6dbae943-c6c7-45e4-9416-9502c81fa340 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa9e5c7b7dd4a74935de34327145697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b843f5d09c94cf3916f65e815d6d7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:23.808040 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-b0a7a311-df20-4439-b356-0cecd5a31021 req-ecba6eda-32b5-4c28-8f93-b3164d181a32 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162609 Sep 17 20:54:23.816104 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 447/942] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:54:23.823686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-22674704-4cd7-43de-9ca6-e4eaf936a176 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:23.823944 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6dbae943-c6c7-45e4-9416-9502c81fa340 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "GET /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7" status: 200 len: 1323 microversion: 2.1 time: 0.272994 Sep 17 20:54:23.824950 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 496/943] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:23 2022] GET /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7 => generated 1323 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:23.830824 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-22674704-4cd7-43de-9ca6-e4eaf936a176 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:23.838784 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-22674704-4cd7-43de-9ca6-e4eaf936a176 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:23.840317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-22674704-4cd7-43de-9ca6-e4eaf936a176 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:23.841150 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-22674704-4cd7-43de-9ca6-e4eaf936a176 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:23.842984 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-22674704-4cd7-43de-9ca6-e4eaf936a176 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:23.844502 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-22674704-4cd7-43de-9ca6-e4eaf936a176 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:23.845241 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-22674704-4cd7-43de-9ca6-e4eaf936a176 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:23.914307 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-09e987b7-11f8-4f89-8330-39a0fdf3fe93 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:23.915354 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-09e987b7-11f8-4f89-8330-39a0fdf3fe93 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:23.971686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09e987b7-11f8-4f89-8330-39a0fdf3fe93 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:23.974342 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09e987b7-11f8-4f89-8330-39a0fdf3fe93 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:23.977069 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09e987b7-11f8-4f89-8330-39a0fdf3fe93 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:23.978119 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09e987b7-11f8-4f89-8330-39a0fdf3fe93 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:23.981049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09e987b7-11f8-4f89-8330-39a0fdf3fe93 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:23.981754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09e987b7-11f8-4f89-8330-39a0fdf3fe93 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:24.015750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-22674704-4cd7-43de-9ca6-e4eaf936a176 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:24.029981 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-22674704-4cd7-43de-9ca6-e4eaf936a176 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1287 microversion: 2.1 time: 0.211997 Sep 17 20:54:24.030855 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 448/944] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:23 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1287 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:24.044853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-f9cd8ed3-5c49-4ef5-ad55-5c3333208e95 req-a5c7547b-15b6-4e62-80ee-dd5ebc49775f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "143322a7-9d8b-43c3-b3a5-4000c26b6cc7", "tag": "6f8f4ce9-626f-432d-8d38-108942adfb39"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:24.068359 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f9cd8ed3-5c49-4ef5-ad55-5c3333208e95 req-a5c7547b-15b6-4e62-80ee-dd5ebc49775f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:24.068848 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f9cd8ed3-5c49-4ef5-ad55-5c3333208e95 req-a5c7547b-15b6-4e62-80ee-dd5ebc49775f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:24.069287 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f9cd8ed3-5c49-4ef5-ad55-5c3333208e95 req-a5c7547b-15b6-4e62-80ee-dd5ebc49775f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:24.095316 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-f9cd8ed3-5c49-4ef5-ad55-5c3333208e95 req-a5c7547b-15b6-4e62-80ee-dd5ebc49775f service nova] Creating event network-changed:6f8f4ce9-626f-432d-8d38-108942adfb39 for instance 143322a7-9d8b-43c3-b3a5-4000c26b6cc7 on nch2-master-1 Sep 17 20:54:24.104757 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-f9cd8ed3-5c49-4ef5-ad55-5c3333208e95 req-a5c7547b-15b6-4e62-80ee-dd5ebc49775f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070924 Sep 17 20:54:24.105675 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 449/945] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:54:24.113035 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d28881c6-d136-4b0f-81ba-855d367d6a98 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:24.114172 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d28881c6-d136-4b0f-81ba-855d367d6a98 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] [instance: b2b0fad5-5be4-433b-bd8e-f51c4c8de010] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:24.122156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d28881c6-d136-4b0f-81ba-855d367d6a98 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:24.122841 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d28881c6-d136-4b0f-81ba-855d367d6a98 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:24.123283 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d28881c6-d136-4b0f-81ba-855d367d6a98 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:24.124020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d28881c6-d136-4b0f-81ba-855d367d6a98 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:24.124479 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d28881c6-d136-4b0f-81ba-855d367d6a98 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:24.124909 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d28881c6-d136-4b0f-81ba-855d367d6a98 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:24.142839 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-d28881c6-d136-4b0f-81ba-855d367d6a98 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] HTTP exception thrown: Instance b2b0fad5-5be4-433b-bd8e-f51c4c8de010 could not be found. Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d28881c6-d136-4b0f-81ba-855d367d6a98 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Request method failure captured: Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010 HTTP/1.1 Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjOzyuz98cPos_fz1Gh2bFcjpei424POP8C4BbGWjBArokp-irpsk12ikI49_fyAZelnFnDBZFwUlp2R27mfygzmsyYKPZDZCYED8yJrb9zZg0oUsmAagn3qiEkF42xU_fjxX2hqI0UxwtdH3RjzQCPKtOM_4VzeDp7lqzJh7l02rWg Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 5d29b99a6bd9481f9042d9c7a9451c49 Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersTestJSON-1209640467 Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5d29b99a6bd9481f9042d9c7a9451c49"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5d29b99a6bd9481f9042d9c7a9451c49"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5d29b99a6bd9481f9042d9c7a9451c49"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5d29b99a6bd9481f9042d9c7a9451c49", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersTestJSON-1209640467 Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 5d29b99a6bd9481f9042d9c7a9451c49 Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersTestJSON-1209640467 Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersTestJSON-1209640467-project Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 495973792ca942bca2c6f65d545346e9 Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersTestJSON-1209640467-project Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance b2b0fad5-5be4-433b-bd8e-f51c4c8de010 could not be found. Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'b2b0fad5-5be4-433b-bd8e-f51c4c8de010'} Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2b0fad5-5be4-433b-bd8e-f51c4c8de010 could not be found. Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2b0fad5-5be4-433b-bd8e-f51c4c8de010 could not be found. Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:24.144755 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:24.154180 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:24.154180 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:54:24.154180 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:54:24.154180 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:54:24.154180 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:54:24.154180 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2b0fad5-5be4-433b-bd8e-f51c4c8de010 could not be found. Sep 17 20:54:24.154180 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:24.154180 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d28881c6-d136-4b0f-81ba-855d367d6a98 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Returning 404 to user: Instance b2b0fad5-5be4-433b-bd8e-f51c4c8de010 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:54:24.154180 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d28881c6-d136-4b0f-81ba-855d367d6a98 tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] 10.222.0.26 "GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010" status: 404 len: 111 microversion: 2.1 time: 0.040113 Sep 17 20:54:24.154180 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 450/946] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:24 2022] GET /compute/v2.1/servers/b2b0fad5-5be4-433b-bd8e-f51c4c8de010 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:54:24.169089 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ddb95308-d9fc-4b3b-a5e6-e206f841641f tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] Calling method '.version_select at 0x7f25aa085a60>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:24.204390 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ddb95308-d9fc-4b3b-a5e6-e206f841641f tempest-ServersTestJSON-1209640467 tempest-ServersTestJSON-1209640467-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-393711399" status: 202 len: 0 microversion: 2.1 time: 0.048629 Sep 17 20:54:24.209724 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 451/947] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Sep 17 20:54:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-393711399 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:54:24.260800 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-09e987b7-11f8-4f89-8330-39a0fdf3fe93 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:24.275700 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-09e987b7-11f8-4f89-8330-39a0fdf3fe93 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1312 microversion: 2.1 time: 0.367197 Sep 17 20:54:24.285794 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 497/948] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:23 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1312 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:54:24.572970 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-58db87d3-75c6-4881-8ca7-a20cdcaf1292 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:24.573627 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-58db87d3-75c6-4881-8ca7-a20cdcaf1292 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:24.586609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58db87d3-75c6-4881-8ca7-a20cdcaf1292 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:24.587345 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58db87d3-75c6-4881-8ca7-a20cdcaf1292 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:24.587547 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58db87d3-75c6-4881-8ca7-a20cdcaf1292 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:24.592372 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58db87d3-75c6-4881-8ca7-a20cdcaf1292 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:24.592924 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58db87d3-75c6-4881-8ca7-a20cdcaf1292 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:24.593380 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58db87d3-75c6-4881-8ca7-a20cdcaf1292 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:24.818186 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-58db87d3-75c6-4881-8ca7-a20cdcaf1292 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:24.827600 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-58db87d3-75c6-4881-8ca7-a20cdcaf1292 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9" status: 200 len: 1311 microversion: 2.1 time: 0.260432 Sep 17 20:54:24.828906 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 452/949] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:24 2022] GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 => generated 1311 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:24.848325 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4e09f0f9-bf3e-4fbb-bcbd-06eb5b1af035 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:24.849588 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4e09f0f9-bf3e-4fbb-bcbd-06eb5b1af035 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 143322a7-9d8b-43c3-b3a5-4000c26b6cc7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:24.856602 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e09f0f9-bf3e-4fbb-bcbd-06eb5b1af035 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:24.857434 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e09f0f9-bf3e-4fbb-bcbd-06eb5b1af035 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:24.858096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e09f0f9-bf3e-4fbb-bcbd-06eb5b1af035 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:24.859018 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e09f0f9-bf3e-4fbb-bcbd-06eb5b1af035 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:24.859669 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e09f0f9-bf3e-4fbb-bcbd-06eb5b1af035 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:24.860317 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e09f0f9-bf3e-4fbb-bcbd-06eb5b1af035 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:25.057382 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1f3862ee-9f2e-4b6a-95ce-11796c73e791 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:25.058720 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1f3862ee-9f2e-4b6a-95ce-11796c73e791 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:25.061747 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4e09f0f9-bf3e-4fbb-bcbd-06eb5b1af035 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa9e5c7b7dd4a74935de34327145697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b843f5d09c94cf3916f65e815d6d7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:25.069935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1f3862ee-9f2e-4b6a-95ce-11796c73e791 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:25.070539 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4e09f0f9-bf3e-4fbb-bcbd-06eb5b1af035 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "GET /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7" status: 200 len: 1323 microversion: 2.1 time: 0.226023 Sep 17 20:54:25.071392 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1f3862ee-9f2e-4b6a-95ce-11796c73e791 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:25.071519 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 498/950] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:24 2022] GET /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7 => generated 1323 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:25.072237 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1f3862ee-9f2e-4b6a-95ce-11796c73e791 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:25.073178 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1f3862ee-9f2e-4b6a-95ce-11796c73e791 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:25.073888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1f3862ee-9f2e-4b6a-95ce-11796c73e791 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:25.074724 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1f3862ee-9f2e-4b6a-95ce-11796c73e791 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:25.200182 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1f3862ee-9f2e-4b6a-95ce-11796c73e791 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:25.213989 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1f3862ee-9f2e-4b6a-95ce-11796c73e791 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1275 microversion: 2.1 time: 0.165207 Sep 17 20:54:25.215962 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 453/951] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:25 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1275 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:25.304928 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-da8113ec-822f-4ba2-8d3b-7ce0bb081b44 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:25.320787 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-da8113ec-822f-4ba2-8d3b-7ce0bb081b44 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:25.339277 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-da8113ec-822f-4ba2-8d3b-7ce0bb081b44 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:25.339898 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-da8113ec-822f-4ba2-8d3b-7ce0bb081b44 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:25.340356 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-da8113ec-822f-4ba2-8d3b-7ce0bb081b44 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:25.341124 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-da8113ec-822f-4ba2-8d3b-7ce0bb081b44 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:25.346866 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-da8113ec-822f-4ba2-8d3b-7ce0bb081b44 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:25.348174 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-da8113ec-822f-4ba2-8d3b-7ce0bb081b44 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:25.631132 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-da8113ec-822f-4ba2-8d3b-7ce0bb081b44 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:25.640831 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-da8113ec-822f-4ba2-8d3b-7ce0bb081b44 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1312 microversion: 2.1 time: 0.339874 Sep 17 20:54:25.641526 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 499/952] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:25 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1312 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:25.850953 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fdb61fee-4e55-4ddb-b9b5-ce86eb953cdd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:25.851571 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fdb61fee-4e55-4ddb-b9b5-ce86eb953cdd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:25.858233 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fdb61fee-4e55-4ddb-b9b5-ce86eb953cdd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:25.858726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fdb61fee-4e55-4ddb-b9b5-ce86eb953cdd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:25.859165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fdb61fee-4e55-4ddb-b9b5-ce86eb953cdd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:25.859874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fdb61fee-4e55-4ddb-b9b5-ce86eb953cdd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:25.860331 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fdb61fee-4e55-4ddb-b9b5-ce86eb953cdd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:25.860731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fdb61fee-4e55-4ddb-b9b5-ce86eb953cdd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:26.096453 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a54b5ae0-d05a-4b7f-b898-014ea5b36d02 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:26.097255 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a54b5ae0-d05a-4b7f-b898-014ea5b36d02 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 143322a7-9d8b-43c3-b3a5-4000c26b6cc7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:26.099309 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=4 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:54:26.105760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a54b5ae0-d05a-4b7f-b898-014ea5b36d02 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:26.106262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a54b5ae0-d05a-4b7f-b898-014ea5b36d02 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:26.106707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a54b5ae0-d05a-4b7f-b898-014ea5b36d02 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:26.107457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a54b5ae0-d05a-4b7f-b898-014ea5b36d02 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:26.107916 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a54b5ae0-d05a-4b7f-b898-014ea5b36d02 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:26.108340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a54b5ae0-d05a-4b7f-b898-014ea5b36d02 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:26.288602 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=8 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:54:26.393598 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fdb61fee-4e55-4ddb-b9b5-ce86eb953cdd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:26.412250 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fdb61fee-4e55-4ddb-b9b5-ce86eb953cdd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9" status: 200 len: 1311 microversion: 2.1 time: 0.557266 Sep 17 20:54:26.413288 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 454/953] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:25 2022] GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 => generated 1311 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:26.421696 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-15d80c4b-f5fc-44d4-b30e-292ae84862d9 req-d848b110-4fdb-434b-83f5-5aa3fbdec67d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b3f5764-d941-4ddb-80fc-3e7b6409f7d9", "tag": "da68fd65-992d-49fa-b979-c348cd631ce3"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:26.434748 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-15d80c4b-f5fc-44d4-b30e-292ae84862d9 req-d848b110-4fdb-434b-83f5-5aa3fbdec67d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:26.435920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-15d80c4b-f5fc-44d4-b30e-292ae84862d9 req-d848b110-4fdb-434b-83f5-5aa3fbdec67d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:26.436577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-15d80c4b-f5fc-44d4-b30e-292ae84862d9 req-d848b110-4fdb-434b-83f5-5aa3fbdec67d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:26.454249 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-15d80c4b-f5fc-44d4-b30e-292ae84862d9 req-d848b110-4fdb-434b-83f5-5aa3fbdec67d service nova] Creating event network-changed:da68fd65-992d-49fa-b979-c348cd631ce3 for instance 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 on nch1-master-1 Sep 17 20:54:26.460319 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-15d80c4b-f5fc-44d4-b30e-292ae84862d9 req-d848b110-4fdb-434b-83f5-5aa3fbdec67d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045528 Sep 17 20:54:26.461961 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 455/954] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:54:26.467951 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c4ef1bdc-0c3d-4db7-9a49-4d2b3d911ace tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:26.469758 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c4ef1bdc-0c3d-4db7-9a49-4d2b3d911ace tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:26.475933 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c4ef1bdc-0c3d-4db7-9a49-4d2b3d911ace tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:26.476650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c4ef1bdc-0c3d-4db7-9a49-4d2b3d911ace tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:26.477302 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c4ef1bdc-0c3d-4db7-9a49-4d2b3d911ace tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:26.478837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c4ef1bdc-0c3d-4db7-9a49-4d2b3d911ace tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:26.479519 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c4ef1bdc-0c3d-4db7-9a49-4d2b3d911ace tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:26.480356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c4ef1bdc-0c3d-4db7-9a49-4d2b3d911ace tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:26.613674 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a54b5ae0-d05a-4b7f-b898-014ea5b36d02 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa9e5c7b7dd4a74935de34327145697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b843f5d09c94cf3916f65e815d6d7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:26.640949 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a54b5ae0-d05a-4b7f-b898-014ea5b36d02 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "GET /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7" status: 200 len: 1323 microversion: 2.1 time: 0.548327 Sep 17 20:54:26.641906 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 500/955] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:26 2022] GET /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7 => generated 1323 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:26.668756 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-031b53cc-1101-4762-b02c-01ebb82f4d61 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:26.669570 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-031b53cc-1101-4762-b02c-01ebb82f4d61 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:26.680939 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-031b53cc-1101-4762-b02c-01ebb82f4d61 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:26.682202 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-031b53cc-1101-4762-b02c-01ebb82f4d61 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:26.683535 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-031b53cc-1101-4762-b02c-01ebb82f4d61 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:26.685553 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-031b53cc-1101-4762-b02c-01ebb82f4d61 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:26.686414 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-031b53cc-1101-4762-b02c-01ebb82f4d61 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:26.687984 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-031b53cc-1101-4762-b02c-01ebb82f4d61 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:26.774424 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c4ef1bdc-0c3d-4db7-9a49-4d2b3d911ace tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:26.791663 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c4ef1bdc-0c3d-4db7-9a49-4d2b3d911ace tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1317 microversion: 2.1 time: 0.324040 Sep 17 20:54:26.793149 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 456/956] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:26 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1317 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:27.009157 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-031b53cc-1101-4762-b02c-01ebb82f4d61 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:27.020591 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-031b53cc-1101-4762-b02c-01ebb82f4d61 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1462 microversion: 2.1 time: 0.357127 Sep 17 20:54:27.022703 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 501/957] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:26 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1462 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:27.053833 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-063a769c-f35b-4bbc-9a90-b0c57b8b0c01 tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:27.055837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-063a769c-f35b-4bbc-9a90-b0c57b8b0c01 tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:27.064033 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-063a769c-f35b-4bbc-9a90-b0c57b8b0c01 tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:27.064833 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-063a769c-f35b-4bbc-9a90-b0c57b8b0c01 tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:27.065966 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-063a769c-f35b-4bbc-9a90-b0c57b8b0c01 tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:27.067093 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-063a769c-f35b-4bbc-9a90-b0c57b8b0c01 tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:27.068085 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-063a769c-f35b-4bbc-9a90-b0c57b8b0c01 tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:27.068608 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-063a769c-f35b-4bbc-9a90-b0c57b8b0c01 tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:27.317278 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-063a769c-f35b-4bbc-9a90-b0c57b8b0c01 tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1613 microversion: 2.1 time: 0.267292 Sep 17 20:54:27.320127 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 457/958] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:27 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1613 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:27.352713 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c020ae1c-0c13-4572-bd70-eb22e888bd5c tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:27.358338 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c020ae1c-0c13-4572-bd70-eb22e888bd5c tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:27.361069 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c020ae1c-0c13-4572-bd70-eb22e888bd5c tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:27.361887 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c020ae1c-0c13-4572-bd70-eb22e888bd5c tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:27.362418 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c020ae1c-0c13-4572-bd70-eb22e888bd5c tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:27.363882 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c020ae1c-0c13-4572-bd70-eb22e888bd5c tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:27.364019 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c020ae1c-0c13-4572-bd70-eb22e888bd5c tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:27.364433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c020ae1c-0c13-4572-bd70-eb22e888bd5c tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:27.436024 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c9d41658-ee8e-4771-8178-b087f60439fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:27.436827 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c9d41658-ee8e-4771-8178-b087f60439fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:27.442890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c9d41658-ee8e-4771-8178-b087f60439fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:27.443379 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c9d41658-ee8e-4771-8178-b087f60439fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:27.444052 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c9d41658-ee8e-4771-8178-b087f60439fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:27.444947 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c9d41658-ee8e-4771-8178-b087f60439fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:27.445695 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c9d41658-ee8e-4771-8178-b087f60439fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:27.446338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c9d41658-ee8e-4771-8178-b087f60439fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:27.452049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c020ae1c-0c13-4572-bd70-eb22e888bd5c tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '27c681039283443c8dd284f22277bc8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbe06cc27b4f403faac35ee3521893ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:27.452999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c020ae1c-0c13-4572-bd70-eb22e888bd5c tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] flavor_id is None. Assuming migration. {{(pid=140524) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 17 20:54:27.455112 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c020ae1c-0c13-4572-bd70-eb22e888bd5c tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140524) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 17 20:54:27.646475 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c020ae1c-0c13-4572-bd70-eb22e888bd5c tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc/action" status: 202 len: 0 microversion: 2.1 time: 0.297511 Sep 17 20:54:27.647415 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 502/959] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:54:27 2022] POST /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:54:27.656690 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e07e0bcb-e251-4814-9268-b8db58a20de0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:27.657601 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e07e0bcb-e251-4814-9268-b8db58a20de0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:27.666775 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e07e0bcb-e251-4814-9268-b8db58a20de0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:27.667450 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e07e0bcb-e251-4814-9268-b8db58a20de0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:27.674223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e07e0bcb-e251-4814-9268-b8db58a20de0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:27.675326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e07e0bcb-e251-4814-9268-b8db58a20de0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:27.676098 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e07e0bcb-e251-4814-9268-b8db58a20de0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:27.676692 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e07e0bcb-e251-4814-9268-b8db58a20de0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:27.678970 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c9d41658-ee8e-4771-8178-b087f60439fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:27.691415 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c9d41658-ee8e-4771-8178-b087f60439fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9" status: 200 len: 1311 microversion: 2.1 time: 0.259200 Sep 17 20:54:27.692056 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 458/960] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:27 2022] GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 => generated 1311 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:54:27.710096 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5228f401-b55c-4198-9892-5a80b53f9ee3 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:27.710833 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5228f401-b55c-4198-9892-5a80b53f9ee3 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 143322a7-9d8b-43c3-b3a5-4000c26b6cc7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:27.718175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5228f401-b55c-4198-9892-5a80b53f9ee3 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:27.718175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5228f401-b55c-4198-9892-5a80b53f9ee3 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:27.718484 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5228f401-b55c-4198-9892-5a80b53f9ee3 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:27.719182 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5228f401-b55c-4198-9892-5a80b53f9ee3 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:27.719630 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5228f401-b55c-4198-9892-5a80b53f9ee3 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:27.720175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5228f401-b55c-4198-9892-5a80b53f9ee3 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:28.109660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e07e0bcb-e251-4814-9268-b8db58a20de0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:28.119153 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e07e0bcb-e251-4814-9268-b8db58a20de0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1471 microversion: 2.1 time: 0.467037 Sep 17 20:54:28.129987 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 503/961] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:27 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1471 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:28.135941 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4f78b00b-e878-4ea5-9547-ddf0e1e81b0a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:28.137647 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4f78b00b-e878-4ea5-9547-ddf0e1e81b0a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:28.159229 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5228f401-b55c-4198-9892-5a80b53f9ee3 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa9e5c7b7dd4a74935de34327145697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b843f5d09c94cf3916f65e815d6d7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:28.161597 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f78b00b-e878-4ea5-9547-ddf0e1e81b0a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:28.178582 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f78b00b-e878-4ea5-9547-ddf0e1e81b0a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:28.179168 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f78b00b-e878-4ea5-9547-ddf0e1e81b0a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:28.179972 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f78b00b-e878-4ea5-9547-ddf0e1e81b0a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:28.180452 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f78b00b-e878-4ea5-9547-ddf0e1e81b0a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:28.180878 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f78b00b-e878-4ea5-9547-ddf0e1e81b0a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:28.183792 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5228f401-b55c-4198-9892-5a80b53f9ee3 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "GET /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7" status: 200 len: 1323 microversion: 2.1 time: 0.487389 Sep 17 20:54:28.188296 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 459/962] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:27 2022] GET /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7 => generated 1323 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:28.447423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4f78b00b-e878-4ea5-9547-ddf0e1e81b0a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:28.460392 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4f78b00b-e878-4ea5-9547-ddf0e1e81b0a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1317 microversion: 2.1 time: 0.328938 Sep 17 20:54:28.470814 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 504/963] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:28 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1317 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:28.718832 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6a3dd0c7-e8b7-4145-b2b3-a3a2c21706aa tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:28.720477 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6a3dd0c7-e8b7-4145-b2b3-a3a2c21706aa tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:28.732592 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a3dd0c7-e8b7-4145-b2b3-a3a2c21706aa tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:28.733888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a3dd0c7-e8b7-4145-b2b3-a3a2c21706aa tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:28.734922 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a3dd0c7-e8b7-4145-b2b3-a3a2c21706aa tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:28.737574 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a3dd0c7-e8b7-4145-b2b3-a3a2c21706aa tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:28.738267 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a3dd0c7-e8b7-4145-b2b3-a3a2c21706aa tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:28.738880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a3dd0c7-e8b7-4145-b2b3-a3a2c21706aa tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:28.774344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:54:28.830657 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-d99e5c6f-6b58-4a3b-9ea7-a2ccc39b9b02 req-1c9cddf4-2f92-4b86-9170-1966ed20634d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdc5c241-5abc-4fde-b458-961a9cd5eb4c", "tag": "f6aa453c-b788-41f9-8c99-9269c4f81d7b"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:28.858280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d99e5c6f-6b58-4a3b-9ea7-a2ccc39b9b02 req-1c9cddf4-2f92-4b86-9170-1966ed20634d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:28.859421 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d99e5c6f-6b58-4a3b-9ea7-a2ccc39b9b02 req-1c9cddf4-2f92-4b86-9170-1966ed20634d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:28.860048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d99e5c6f-6b58-4a3b-9ea7-a2ccc39b9b02 req-1c9cddf4-2f92-4b86-9170-1966ed20634d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:28.873341 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-d99e5c6f-6b58-4a3b-9ea7-a2ccc39b9b02 req-1c9cddf4-2f92-4b86-9170-1966ed20634d service nova] Creating event network-changed:f6aa453c-b788-41f9-8c99-9269c4f81d7b for instance fdc5c241-5abc-4fde-b458-961a9cd5eb4c on nch2-master-1 Sep 17 20:54:28.878367 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-d99e5c6f-6b58-4a3b-9ea7-a2ccc39b9b02 req-1c9cddf4-2f92-4b86-9170-1966ed20634d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051701 Sep 17 20:54:28.879442 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 505/964] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:54:29.023873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6a3dd0c7-e8b7-4145-b2b3-a3a2c21706aa tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:29.040649 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6a3dd0c7-e8b7-4145-b2b3-a3a2c21706aa tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9" status: 200 len: 1311 microversion: 2.1 time: 0.328531 Sep 17 20:54:29.041821 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 460/965] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:28 2022] GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 => generated 1311 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:29.149270 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-146dc75d-5191-41f1-a0e5-5256e51d4450 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:29.150404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-146dc75d-5191-41f1-a0e5-5256e51d4450 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:29.156870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-146dc75d-5191-41f1-a0e5-5256e51d4450 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:29.157813 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-146dc75d-5191-41f1-a0e5-5256e51d4450 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:29.158421 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-146dc75d-5191-41f1-a0e5-5256e51d4450 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:29.159390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-146dc75d-5191-41f1-a0e5-5256e51d4450 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:29.159996 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-146dc75d-5191-41f1-a0e5-5256e51d4450 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:29.160597 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-146dc75d-5191-41f1-a0e5-5256e51d4450 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:29.211063 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e363ea79-224a-439e-9a7a-680c01c8810a tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:29.211771 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e363ea79-224a-439e-9a7a-680c01c8810a tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 143322a7-9d8b-43c3-b3a5-4000c26b6cc7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:29.223740 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e363ea79-224a-439e-9a7a-680c01c8810a tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:29.224474 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e363ea79-224a-439e-9a7a-680c01c8810a tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:29.225093 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e363ea79-224a-439e-9a7a-680c01c8810a tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:29.226175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e363ea79-224a-439e-9a7a-680c01c8810a tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:29.226871 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e363ea79-224a-439e-9a7a-680c01c8810a tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:29.228186 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e363ea79-224a-439e-9a7a-680c01c8810a tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:29.494594 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-146dc75d-5191-41f1-a0e5-5256e51d4450 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:29.500229 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e363ea79-224a-439e-9a7a-680c01c8810a tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa9e5c7b7dd4a74935de34327145697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b843f5d09c94cf3916f65e815d6d7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:29.503190 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-146dc75d-5191-41f1-a0e5-5256e51d4450 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1471 microversion: 2.1 time: 0.358781 Sep 17 20:54:29.504688 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 506/966] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:29 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1471 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:29.510113 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-caa4c6c7-4b45-4277-8e3f-cbc995804f43 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:29.510943 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-caa4c6c7-4b45-4277-8e3f-cbc995804f43 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:29.518132 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-caa4c6c7-4b45-4277-8e3f-cbc995804f43 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:29.518826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-caa4c6c7-4b45-4277-8e3f-cbc995804f43 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:29.519529 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-caa4c6c7-4b45-4277-8e3f-cbc995804f43 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:29.520424 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-caa4c6c7-4b45-4277-8e3f-cbc995804f43 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:29.521096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-caa4c6c7-4b45-4277-8e3f-cbc995804f43 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:29.521715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-caa4c6c7-4b45-4277-8e3f-cbc995804f43 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:29.524008 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e363ea79-224a-439e-9a7a-680c01c8810a tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "GET /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7" status: 200 len: 1323 microversion: 2.1 time: 0.316895 Sep 17 20:54:29.525400 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 461/967] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:29 2022] GET /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7 => generated 1323 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:54:29.730885 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-caa4c6c7-4b45-4277-8e3f-cbc995804f43 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:29.740937 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-caa4c6c7-4b45-4277-8e3f-cbc995804f43 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1317 microversion: 2.1 time: 0.234869 Sep 17 20:54:29.747527 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 507/968] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:29 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:30.064642 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3d9217c3-6579-478e-a7aa-a57d7be10a62 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:30.065390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3d9217c3-6579-478e-a7aa-a57d7be10a62 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:30.076450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3d9217c3-6579-478e-a7aa-a57d7be10a62 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:30.076450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3d9217c3-6579-478e-a7aa-a57d7be10a62 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:30.076450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3d9217c3-6579-478e-a7aa-a57d7be10a62 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:30.076450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3d9217c3-6579-478e-a7aa-a57d7be10a62 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:30.076450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3d9217c3-6579-478e-a7aa-a57d7be10a62 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:30.077366 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3d9217c3-6579-478e-a7aa-a57d7be10a62 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:30.316533 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3d9217c3-6579-478e-a7aa-a57d7be10a62 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:30.325714 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3d9217c3-6579-478e-a7aa-a57d7be10a62 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9" status: 200 len: 1311 microversion: 2.1 time: 0.265066 Sep 17 20:54:30.337987 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 462/969] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:30 2022] GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 => generated 1311 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:30.452540 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-880a1451-bb6f-4c3c-a5ad-6369d89c6212 req-573cdcc9-625d-4256-bf53-e7343dffff0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "143322a7-9d8b-43c3-b3a5-4000c26b6cc7", "name": "network-vif-plugged", "status": "completed", "tag": "6f8f4ce9-626f-432d-8d38-108942adfb39"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:30.468981 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-880a1451-bb6f-4c3c-a5ad-6369d89c6212 req-573cdcc9-625d-4256-bf53-e7343dffff0d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:30.469744 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-880a1451-bb6f-4c3c-a5ad-6369d89c6212 req-573cdcc9-625d-4256-bf53-e7343dffff0d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:30.470404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-880a1451-bb6f-4c3c-a5ad-6369d89c6212 req-573cdcc9-625d-4256-bf53-e7343dffff0d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:30.491765 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-880a1451-bb6f-4c3c-a5ad-6369d89c6212 req-573cdcc9-625d-4256-bf53-e7343dffff0d service nova] Creating event network-vif-plugged:6f8f4ce9-626f-432d-8d38-108942adfb39 for instance 143322a7-9d8b-43c3-b3a5-4000c26b6cc7 on nch2-master-1 Sep 17 20:54:30.500394 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-880a1451-bb6f-4c3c-a5ad-6369d89c6212 req-573cdcc9-625d-4256-bf53-e7343dffff0d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059638 Sep 17 20:54:30.503593 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 508/970] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:54:30.529942 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-202006d6-8a7a-439d-af63-43ac17229d9f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:30.530640 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-202006d6-8a7a-439d-af63-43ac17229d9f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:30.543858 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:54:30.551077 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-202006d6-8a7a-439d-af63-43ac17229d9f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:30.555963 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-202006d6-8a7a-439d-af63-43ac17229d9f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:30.556140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e013a281-af6c-4d8a-931d-3ee5078fa8ba tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:30.556792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-202006d6-8a7a-439d-af63-43ac17229d9f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:30.557718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e013a281-af6c-4d8a-931d-3ee5078fa8ba tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 143322a7-9d8b-43c3-b3a5-4000c26b6cc7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:30.558259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-202006d6-8a7a-439d-af63-43ac17229d9f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:30.558259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-202006d6-8a7a-439d-af63-43ac17229d9f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:30.558735 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-202006d6-8a7a-439d-af63-43ac17229d9f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:30.575862 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e013a281-af6c-4d8a-931d-3ee5078fa8ba tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:30.578118 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e013a281-af6c-4d8a-931d-3ee5078fa8ba tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:30.578890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e013a281-af6c-4d8a-931d-3ee5078fa8ba tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:30.583225 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e013a281-af6c-4d8a-931d-3ee5078fa8ba tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:30.584860 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e013a281-af6c-4d8a-931d-3ee5078fa8ba tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:30.586361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e013a281-af6c-4d8a-931d-3ee5078fa8ba tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:30.592960 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:54:30.882703 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-202006d6-8a7a-439d-af63-43ac17229d9f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:30.890839 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-202006d6-8a7a-439d-af63-43ac17229d9f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1471 microversion: 2.1 time: 0.365865 Sep 17 20:54:30.891656 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 463/971] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:30 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1471 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:54:30.909649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e013a281-af6c-4d8a-931d-3ee5078fa8ba tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa9e5c7b7dd4a74935de34327145697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b843f5d09c94cf3916f65e815d6d7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:30.911019 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-da4a096c-96b9-4c96-b831-04d1a743117d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:30.912066 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-da4a096c-96b9-4c96-b831-04d1a743117d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:30.918446 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e013a281-af6c-4d8a-931d-3ee5078fa8ba tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "GET /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7" status: 200 len: 1323 microversion: 2.1 time: 0.367620 Sep 17 20:54:30.919345 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 509/972] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:30 2022] GET /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7 => generated 1323 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:30.920644 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da4a096c-96b9-4c96-b831-04d1a743117d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:30.921255 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da4a096c-96b9-4c96-b831-04d1a743117d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:30.922257 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da4a096c-96b9-4c96-b831-04d1a743117d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:30.923468 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da4a096c-96b9-4c96-b831-04d1a743117d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:30.924033 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da4a096c-96b9-4c96-b831-04d1a743117d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:30.924949 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da4a096c-96b9-4c96-b831-04d1a743117d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:30.925804 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cd947000-ee30-4b37-9567-d88b236a67ba tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:30.926470 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cd947000-ee30-4b37-9567-d88b236a67ba tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: a9ab9592-fc9c-4ec4-bf25-6ffb49440f25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:30.935020 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd947000-ee30-4b37-9567-d88b236a67ba tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:30.935517 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd947000-ee30-4b37-9567-d88b236a67ba tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:30.935952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd947000-ee30-4b37-9567-d88b236a67ba tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:30.936651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd947000-ee30-4b37-9567-d88b236a67ba tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:30.937096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd947000-ee30-4b37-9567-d88b236a67ba tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:30.937543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd947000-ee30-4b37-9567-d88b236a67ba tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:30.965064 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cd947000-ee30-4b37-9567-d88b236a67ba tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: a9ab9592-fc9c-4ec4-bf25-6ffb49440f25] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:54:31.058790 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cd947000-ee30-4b37-9567-d88b236a67ba tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25" status: 204 len: 0 microversion: 2.1 time: 0.137773 Sep 17 20:54:31.059506 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 510/973] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:54:30 2022] DELETE /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:54:31.069740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fad716d7-61ae-4052-82d0-60d72836d61d tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:31.069740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fad716d7-61ae-4052-82d0-60d72836d61d tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: a9ab9592-fc9c-4ec4-bf25-6ffb49440f25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:31.076495 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fad716d7-61ae-4052-82d0-60d72836d61d tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:31.077114 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fad716d7-61ae-4052-82d0-60d72836d61d tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:31.078323 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fad716d7-61ae-4052-82d0-60d72836d61d tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:31.079061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fad716d7-61ae-4052-82d0-60d72836d61d tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:31.079704 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fad716d7-61ae-4052-82d0-60d72836d61d tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:31.080195 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fad716d7-61ae-4052-82d0-60d72836d61d tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:31.115121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-da4a096c-96b9-4c96-b831-04d1a743117d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:31.127510 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-da4a096c-96b9-4c96-b831-04d1a743117d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1317 microversion: 2.1 time: 0.221922 Sep 17 20:54:31.130176 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 464/974] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:30 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:31.317019 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fad716d7-61ae-4052-82d0-60d72836d61d tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f7c0fdad9346c58949928300021b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f305d163acf499c9808c5f11150a7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:31.340255 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fad716d7-61ae-4052-82d0-60d72836d61d tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25" status: 200 len: 1712 microversion: 2.1 time: 0.275947 Sep 17 20:54:31.341217 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 511/975] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:31 2022] GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 => generated 1712 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:31.356408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2836f6ba-12a0-417c-b25c-7baa751020a7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:31.357197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2836f6ba-12a0-417c-b25c-7baa751020a7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:31.359431 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=8 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:54:31.370126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2836f6ba-12a0-417c-b25c-7baa751020a7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:31.370971 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2836f6ba-12a0-417c-b25c-7baa751020a7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:31.371595 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2836f6ba-12a0-417c-b25c-7baa751020a7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:31.372632 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2836f6ba-12a0-417c-b25c-7baa751020a7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:31.373113 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2836f6ba-12a0-417c-b25c-7baa751020a7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:31.373635 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2836f6ba-12a0-417c-b25c-7baa751020a7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:31.417084 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=48 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:54:31.522737 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2836f6ba-12a0-417c-b25c-7baa751020a7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:31.536822 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2836f6ba-12a0-417c-b25c-7baa751020a7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9" status: 200 len: 1311 microversion: 2.1 time: 0.184416 Sep 17 20:54:31.537402 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 465/976] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:31 2022] GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 => generated 1311 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:31.916840 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2a4701ef-7798-4c82-a6a3-434baceb5009 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:31.917306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2a4701ef-7798-4c82-a6a3-434baceb5009 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:31.926659 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a4701ef-7798-4c82-a6a3-434baceb5009 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:31.927603 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a4701ef-7798-4c82-a6a3-434baceb5009 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:31.929385 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a4701ef-7798-4c82-a6a3-434baceb5009 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:31.931047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a4701ef-7798-4c82-a6a3-434baceb5009 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:31.931604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a4701ef-7798-4c82-a6a3-434baceb5009 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:31.932044 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a4701ef-7798-4c82-a6a3-434baceb5009 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:31.943880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-43e32d69-7f12-45cd-9e35-86ce3ba039d0 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:31.944617 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-43e32d69-7f12-45cd-9e35-86ce3ba039d0 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 143322a7-9d8b-43c3-b3a5-4000c26b6cc7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:31.950829 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-43e32d69-7f12-45cd-9e35-86ce3ba039d0 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:31.951531 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-43e32d69-7f12-45cd-9e35-86ce3ba039d0 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:31.952263 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-43e32d69-7f12-45cd-9e35-86ce3ba039d0 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:31.953141 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-43e32d69-7f12-45cd-9e35-86ce3ba039d0 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:31.953787 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-43e32d69-7f12-45cd-9e35-86ce3ba039d0 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:31.954383 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-43e32d69-7f12-45cd-9e35-86ce3ba039d0 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:32.191513 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2a4701ef-7798-4c82-a6a3-434baceb5009 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:32.198223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-43e32d69-7f12-45cd-9e35-86ce3ba039d0 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa9e5c7b7dd4a74935de34327145697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b843f5d09c94cf3916f65e815d6d7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:32.200815 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2a4701ef-7798-4c82-a6a3-434baceb5009 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1471 microversion: 2.1 time: 0.288476 Sep 17 20:54:32.212560 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 512/977] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:31 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1471 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:32.224850 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0576f0d6-0b7c-48c0-8259-a2acdb2042db tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:32.226013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0576f0d6-0b7c-48c0-8259-a2acdb2042db tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:32.228458 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-43e32d69-7f12-45cd-9e35-86ce3ba039d0 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "GET /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7" status: 200 len: 1323 microversion: 2.1 time: 0.289690 Sep 17 20:54:32.230633 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 466/978] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:31 2022] GET /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7 => generated 1323 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:54:32.233715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0576f0d6-0b7c-48c0-8259-a2acdb2042db tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:32.234228 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0576f0d6-0b7c-48c0-8259-a2acdb2042db tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:32.234623 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0576f0d6-0b7c-48c0-8259-a2acdb2042db tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:32.235525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0576f0d6-0b7c-48c0-8259-a2acdb2042db tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:32.235980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0576f0d6-0b7c-48c0-8259-a2acdb2042db tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:32.236399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0576f0d6-0b7c-48c0-8259-a2acdb2042db tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:32.368685 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ab1ae01d-d89a-4f35-a3ec-6fc1c0de7aeb tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:32.369377 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ab1ae01d-d89a-4f35-a3ec-6fc1c0de7aeb tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: a9ab9592-fc9c-4ec4-bf25-6ffb49440f25] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:32.378257 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab1ae01d-d89a-4f35-a3ec-6fc1c0de7aeb tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:32.379859 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab1ae01d-d89a-4f35-a3ec-6fc1c0de7aeb tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:32.381184 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab1ae01d-d89a-4f35-a3ec-6fc1c0de7aeb tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:32.382694 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab1ae01d-d89a-4f35-a3ec-6fc1c0de7aeb tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:32.385771 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab1ae01d-d89a-4f35-a3ec-6fc1c0de7aeb tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:32.386292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab1ae01d-d89a-4f35-a3ec-6fc1c0de7aeb tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:32.511394 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0576f0d6-0b7c-48c0-8259-a2acdb2042db tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:32.521024 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0576f0d6-0b7c-48c0-8259-a2acdb2042db tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1317 microversion: 2.1 time: 0.306954 Sep 17 20:54:32.521759 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 513/979] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:32 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1317 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:32.533102 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-60e1b59d-5a24-4cdc-9c03-74e28367df46 req-b65efd2b-8a8a-4ec7-b2a2-a31e6d4bbe5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b3f5764-d941-4ddb-80fc-3e7b6409f7d9", "name": "network-vif-plugged", "status": "completed", "tag": "da68fd65-992d-49fa-b979-c348cd631ce3"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:32.544371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-60e1b59d-5a24-4cdc-9c03-74e28367df46 req-b65efd2b-8a8a-4ec7-b2a2-a31e6d4bbe5c service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:32.545839 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-60e1b59d-5a24-4cdc-9c03-74e28367df46 req-b65efd2b-8a8a-4ec7-b2a2-a31e6d4bbe5c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:32.546774 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-60e1b59d-5a24-4cdc-9c03-74e28367df46 req-b65efd2b-8a8a-4ec7-b2a2-a31e6d4bbe5c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:32.563263 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-60e1b59d-5a24-4cdc-9c03-74e28367df46 req-b65efd2b-8a8a-4ec7-b2a2-a31e6d4bbe5c service nova] Creating event network-vif-plugged:da68fd65-992d-49fa-b979-c348cd631ce3 for instance 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 on nch1-master-1 Sep 17 20:54:32.568626 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-60e1b59d-5a24-4cdc-9c03-74e28367df46 req-b65efd2b-8a8a-4ec7-b2a2-a31e6d4bbe5c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039764 Sep 17 20:54:32.569573 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 514/980] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:54:32.575855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-615f0e6f-b630-4a2f-a4b1-b1d09afb387e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:32.576632 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-615f0e6f-b630-4a2f-a4b1-b1d09afb387e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:32.583464 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-615f0e6f-b630-4a2f-a4b1-b1d09afb387e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:32.584327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-615f0e6f-b630-4a2f-a4b1-b1d09afb387e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:32.584834 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-615f0e6f-b630-4a2f-a4b1-b1d09afb387e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:32.585726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-615f0e6f-b630-4a2f-a4b1-b1d09afb387e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:32.586307 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-615f0e6f-b630-4a2f-a4b1-b1d09afb387e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:32.587294 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-615f0e6f-b630-4a2f-a4b1-b1d09afb387e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:33.004164 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ab1ae01d-d89a-4f35-a3ec-6fc1c0de7aeb tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f7c0fdad9346c58949928300021b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f305d163acf499c9808c5f11150a7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:33.050943 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ab1ae01d-d89a-4f35-a3ec-6fc1c0de7aeb tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25" status: 200 len: 1712 microversion: 2.1 time: 0.685703 Sep 17 20:54:33.055251 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 467/981] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:32 2022] GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 => generated 1712 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:54:33.089873 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-615f0e6f-b630-4a2f-a4b1-b1d09afb387e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:33.099444 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-615f0e6f-b630-4a2f-a4b1-b1d09afb387e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9" status: 200 len: 1311 microversion: 2.1 time: 0.528386 Sep 17 20:54:33.113202 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 515/982] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:32 2022] GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 => generated 1311 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:33.228750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cda7c208-5c8a-4d62-8fdb-e47219047d40 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:33.229337 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cda7c208-5c8a-4d62-8fdb-e47219047d40 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:33.240058 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cda7c208-5c8a-4d62-8fdb-e47219047d40 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:33.241385 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cda7c208-5c8a-4d62-8fdb-e47219047d40 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:33.242045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cda7c208-5c8a-4d62-8fdb-e47219047d40 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:33.243458 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cda7c208-5c8a-4d62-8fdb-e47219047d40 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:33.244210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cda7c208-5c8a-4d62-8fdb-e47219047d40 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:33.244849 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cda7c208-5c8a-4d62-8fdb-e47219047d40 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:33.257583 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5c23e2d7-94c2-4499-8bab-e6263297ed9b tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:33.259083 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5c23e2d7-94c2-4499-8bab-e6263297ed9b tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 143322a7-9d8b-43c3-b3a5-4000c26b6cc7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:33.267867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c23e2d7-94c2-4499-8bab-e6263297ed9b tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:33.269023 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c23e2d7-94c2-4499-8bab-e6263297ed9b tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:33.269773 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c23e2d7-94c2-4499-8bab-e6263297ed9b tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:33.270498 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c23e2d7-94c2-4499-8bab-e6263297ed9b tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:33.271241 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c23e2d7-94c2-4499-8bab-e6263297ed9b tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:33.272023 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c23e2d7-94c2-4499-8bab-e6263297ed9b tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:33.534433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cda7c208-5c8a-4d62-8fdb-e47219047d40 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:33.543467 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cda7c208-5c8a-4d62-8fdb-e47219047d40 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1471 microversion: 2.1 time: 0.320251 Sep 17 20:54:33.544159 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 468/983] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:33 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1471 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:33.549239 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0c94e4a9-695f-4e94-9d24-708e7fca890e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:33.549941 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0c94e4a9-695f-4e94-9d24-708e7fca890e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:33.556190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c94e4a9-695f-4e94-9d24-708e7fca890e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:33.556746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c94e4a9-695f-4e94-9d24-708e7fca890e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:33.557491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c94e4a9-695f-4e94-9d24-708e7fca890e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:33.558637 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c94e4a9-695f-4e94-9d24-708e7fca890e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:33.559306 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c94e4a9-695f-4e94-9d24-708e7fca890e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:33.559958 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c94e4a9-695f-4e94-9d24-708e7fca890e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:33.568125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5c23e2d7-94c2-4499-8bab-e6263297ed9b tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa9e5c7b7dd4a74935de34327145697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b843f5d09c94cf3916f65e815d6d7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:33.584488 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5c23e2d7-94c2-4499-8bab-e6263297ed9b tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "GET /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7" status: 200 len: 1518 microversion: 2.1 time: 0.335475 Sep 17 20:54:33.598109 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 516/984] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:33 2022] GET /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7 => generated 1518 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:33.612984 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-06c1055b-212a-4045-b2d8-06dcffb364c0 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.7.99"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:33.616812 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-06c1055b-212a-4045-b2d8-06dcffb364c0 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 59beeb15-b8ee-49e8-b739-f38a755dc102] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:33.630817 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06c1055b-212a-4045-b2d8-06dcffb364c0 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:33.631377 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06c1055b-212a-4045-b2d8-06dcffb364c0 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:33.631820 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06c1055b-212a-4045-b2d8-06dcffb364c0 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:33.632743 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06c1055b-212a-4045-b2d8-06dcffb364c0 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:33.638189 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06c1055b-212a-4045-b2d8-06dcffb364c0 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:33.638998 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06c1055b-212a-4045-b2d8-06dcffb364c0 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:33.677074 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06c1055b-212a-4045-b2d8-06dcffb364c0 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "refresh_cache-59beeb15-b8ee-49e8-b739-f38a755dc102" {{(pid=140524) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 17 20:54:33.677843 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06c1055b-212a-4045-b2d8-06dcffb364c0 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquired lock "refresh_cache-59beeb15-b8ee-49e8-b739-f38a755dc102" {{(pid=140524) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 17 20:54:34.313743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0c94e4a9-695f-4e94-9d24-708e7fca890e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:34.326238 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0c94e4a9-695f-4e94-9d24-708e7fca890e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1317 microversion: 2.1 time: 0.780484 Sep 17 20:54:34.327199 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 469/985] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:33 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1317 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:34.334783 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b75cedcc-057c-4a59-9cf2-8824f5653373 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:34.335782 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b75cedcc-057c-4a59-9cf2-8824f5653373 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: a9ab9592-fc9c-4ec4-bf25-6ffb49440f25] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:34.355170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b75cedcc-057c-4a59-9cf2-8824f5653373 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:34.357489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b75cedcc-057c-4a59-9cf2-8824f5653373 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:34.357957 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b75cedcc-057c-4a59-9cf2-8824f5653373 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:34.363227 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b75cedcc-057c-4a59-9cf2-8824f5653373 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:34.363795 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b75cedcc-057c-4a59-9cf2-8824f5653373 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:34.369077 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b75cedcc-057c-4a59-9cf2-8824f5653373 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:34.437537 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b75cedcc-057c-4a59-9cf2-8824f5653373 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:34.438353 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b75cedcc-057c-4a59-9cf2-8824f5653373 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:34.439523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b75cedcc-057c-4a59-9cf2-8824f5653373 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:34.440032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-b75cedcc-057c-4a59-9cf2-8824f5653373 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lazy-loading 'fault' on Instance uuid a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:54:34.550078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b75cedcc-057c-4a59-9cf2-8824f5653373 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42f7c0fdad9346c58949928300021b07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f305d163acf499c9808c5f11150a7cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:34.575340 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b75cedcc-057c-4a59-9cf2-8824f5653373 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25" status: 200 len: 1354 microversion: 2.1 time: 0.245184 Sep 17 20:54:34.591227 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 470/986] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:34 2022] GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 => generated 1354 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:34.599524 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-e0e1f14e-b62c-4210-8138-04595d4c8087 req-6ea8c6a7-0a2d-4291-beb3-fd41fc8aa8fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9ab9592-fc9c-4ec4-bf25-6ffb49440f25", "name": "network-vif-deleted", "tag": "23b1a85d-8b5b-4c32-8ff8-5e4c1672d0d4"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:34.615314 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-e0e1f14e-b62c-4210-8138-04595d4c8087 req-6ea8c6a7-0a2d-4291-beb3-fd41fc8aa8fc service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:34.616453 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-e0e1f14e-b62c-4210-8138-04595d4c8087 req-6ea8c6a7-0a2d-4291-beb3-fd41fc8aa8fc service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:34.618056 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-e0e1f14e-b62c-4210-8138-04595d4c8087 req-6ea8c6a7-0a2d-4291-beb3-fd41fc8aa8fc service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:34.636756 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-e0e1f14e-b62c-4210-8138-04595d4c8087 req-6ea8c6a7-0a2d-4291-beb3-fd41fc8aa8fc service nova] Creating event network-vif-deleted:23b1a85d-8b5b-4c32-8ff8-5e4c1672d0d4 for instance a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 on nch1-master-1 Sep 17 20:54:34.642153 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-e0e1f14e-b62c-4210-8138-04595d4c8087 req-6ea8c6a7-0a2d-4291-beb3-fd41fc8aa8fc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049135 Sep 17 20:54:34.643327 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 471/987] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:54:34.650902 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2b95c047-ab15-4019-ab94-43df91b0370a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:34.653760 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2b95c047-ab15-4019-ab94-43df91b0370a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:34.661559 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b95c047-ab15-4019-ab94-43df91b0370a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:34.662356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b95c047-ab15-4019-ab94-43df91b0370a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:34.663396 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b95c047-ab15-4019-ab94-43df91b0370a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:34.664319 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b95c047-ab15-4019-ab94-43df91b0370a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:34.664930 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b95c047-ab15-4019-ab94-43df91b0370a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:34.665520 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b95c047-ab15-4019-ab94-43df91b0370a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:35.052458 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2b95c047-ab15-4019-ab94-43df91b0370a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:35.094080 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2b95c047-ab15-4019-ab94-43df91b0370a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9" status: 200 len: 1494 microversion: 2.1 time: 0.449089 Sep 17 20:54:35.096024 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 472/988] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:34 2022] GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 => generated 1494 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:35.103376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-facb9bf0-71f1-4342-b94e-60d2a15cd904 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:35.104278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-facb9bf0-71f1-4342-b94e-60d2a15cd904 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:35.118261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-facb9bf0-71f1-4342-b94e-60d2a15cd904 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:35.118815 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-facb9bf0-71f1-4342-b94e-60d2a15cd904 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:35.119253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-facb9bf0-71f1-4342-b94e-60d2a15cd904 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:35.124141 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-facb9bf0-71f1-4342-b94e-60d2a15cd904 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:35.124647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-facb9bf0-71f1-4342-b94e-60d2a15cd904 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:35.125156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-facb9bf0-71f1-4342-b94e-60d2a15cd904 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:35.792486 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-facb9bf0-71f1-4342-b94e-60d2a15cd904 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:35.801669 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-facb9bf0-71f1-4342-b94e-60d2a15cd904 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1476 microversion: 2.1 time: 0.704231 Sep 17 20:54:35.802728 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 473/989] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:35 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1476 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:35.809792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-904d5b57-36e7-4783-ba0a-d01b6ecfe7a5 req-64bc7019-bf89-40b9-973d-769dd0b1a169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdc5c241-5abc-4fde-b458-961a9cd5eb4c", "name": "network-vif-plugged", "status": "completed", "tag": "f6aa453c-b788-41f9-8c99-9269c4f81d7b"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:35.821134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-904d5b57-36e7-4783-ba0a-d01b6ecfe7a5 req-64bc7019-bf89-40b9-973d-769dd0b1a169 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:35.821647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-904d5b57-36e7-4783-ba0a-d01b6ecfe7a5 req-64bc7019-bf89-40b9-973d-769dd0b1a169 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:35.822398 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-904d5b57-36e7-4783-ba0a-d01b6ecfe7a5 req-64bc7019-bf89-40b9-973d-769dd0b1a169 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:35.835241 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-904d5b57-36e7-4783-ba0a-d01b6ecfe7a5 req-64bc7019-bf89-40b9-973d-769dd0b1a169 service nova] Creating event network-vif-plugged:f6aa453c-b788-41f9-8c99-9269c4f81d7b for instance fdc5c241-5abc-4fde-b458-961a9cd5eb4c on nch2-master-1 Sep 17 20:54:35.840830 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-904d5b57-36e7-4783-ba0a-d01b6ecfe7a5 req-64bc7019-bf89-40b9-973d-769dd0b1a169 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036675 Sep 17 20:54:35.841702 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 474/990] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:54:35.850983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a75b3601-eb77-441c-bab2-ecb81676ed08 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:35.851980 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a75b3601-eb77-441c-bab2-ecb81676ed08 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:35.858417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a75b3601-eb77-441c-bab2-ecb81676ed08 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:35.858873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a75b3601-eb77-441c-bab2-ecb81676ed08 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:35.860669 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a75b3601-eb77-441c-bab2-ecb81676ed08 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:35.862326 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a75b3601-eb77-441c-bab2-ecb81676ed08 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:35.862991 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a75b3601-eb77-441c-bab2-ecb81676ed08 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:35.863682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a75b3601-eb77-441c-bab2-ecb81676ed08 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:36.369032 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a75b3601-eb77-441c-bab2-ecb81676ed08 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9" status: 200 len: 1645 microversion: 2.1 time: 0.522000 Sep 17 20:54:36.370272 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 475/991] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:35 2022] GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 => generated 1645 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:36.378946 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-35e617ac-6e97-48a2-9fc9-319b8edf046c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:36.379743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-35e617ac-6e97-48a2-9fc9-319b8edf046c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:36.393105 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35e617ac-6e97-48a2-9fc9-319b8edf046c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:36.393817 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35e617ac-6e97-48a2-9fc9-319b8edf046c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:36.394433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35e617ac-6e97-48a2-9fc9-319b8edf046c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:36.395331 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35e617ac-6e97-48a2-9fc9-319b8edf046c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:36.395961 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35e617ac-6e97-48a2-9fc9-319b8edf046c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:36.396949 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35e617ac-6e97-48a2-9fc9-319b8edf046c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:36.796010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-35e617ac-6e97-48a2-9fc9-319b8edf046c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:36.826059 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-35e617ac-6e97-48a2-9fc9-319b8edf046c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1317 microversion: 2.1 time: 0.453465 Sep 17 20:54:36.827291 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 476/992] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:36 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1317 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:36.836672 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-74570ddf-9053-4546-8202-8d143734f377 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:36.838460 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-74570ddf-9053-4546-8202-8d143734f377 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: a9ab9592-fc9c-4ec4-bf25-6ffb49440f25] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:36.850910 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74570ddf-9053-4546-8202-8d143734f377 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:36.852121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74570ddf-9053-4546-8202-8d143734f377 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:36.852736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74570ddf-9053-4546-8202-8d143734f377 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:36.853621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74570ddf-9053-4546-8202-8d143734f377 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:36.855559 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74570ddf-9053-4546-8202-8d143734f377 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:36.856038 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74570ddf-9053-4546-8202-8d143734f377 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:36.872733 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-74570ddf-9053-4546-8202-8d143734f377 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] HTTP exception thrown: Instance a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 could not be found. Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-74570ddf-9053-4546-8202-8d143734f377 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Request method failure captured: Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 HTTP/1.1 Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjNtTfMY0G5lQs_dyrUUd3uhf4fkQ3zAp8Me0jeaAiBro3HrrjlPk268iZKuzOLTN5xAJijPUZAtWoKLG1JownXbmLXTWOo2qR82Cu6KknLHG1OzyZsrBhYeLNP8tdMuR4onga0PVA4wmKh8cK4cEHnZBxYpO6qDZRvyIkkGiNViI6A Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 1f305d163acf499c9808c5f11150a7cf Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-387909269 Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1f305d163acf499c9808c5f11150a7cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1f305d163acf499c9808c5f11150a7cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1f305d163acf499c9808c5f11150a7cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1f305d163acf499c9808c5f11150a7cf", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-387909269 Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 1f305d163acf499c9808c5f11150a7cf Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-387909269 Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersWithSpecificFlavorTestJSON-387909269-project Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 42f7c0fdad9346c58949928300021b07 Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-387909269-project Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 could not be found. Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'a9ab9592-fc9c-4ec4-bf25-6ffb49440f25'} Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 could not be found. Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 could not be found. Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:36.874986 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:36.880243 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:36.880243 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:36.880243 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:54:36.880243 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:54:36.880243 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:54:36.880243 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:54:36.880243 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 could not be found. Sep 17 20:54:36.880243 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:36.881040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-06c1055b-212a-4045-b2d8-06dcffb364c0 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 59beeb15-b8ee-49e8-b739-f38a755dc102] Building network info cache for instance {{(pid=140524) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 17 20:54:36.887577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-74570ddf-9053-4546-8202-8d143734f377 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Returning 404 to user: Instance a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:54:36.888769 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-74570ddf-9053-4546-8202-8d143734f377 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25" status: 404 len: 111 microversion: 2.1 time: 0.060277 Sep 17 20:54:36.889584 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 477/993] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:36 2022] GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:54:36.895221 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-01e74d02-b267-4e78-9512-25f1dc99a9b8 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:36.895852 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-01e74d02-b267-4e78-9512-25f1dc99a9b8 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:36.903935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01e74d02-b267-4e78-9512-25f1dc99a9b8 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:36.904193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01e74d02-b267-4e78-9512-25f1dc99a9b8 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:36.904471 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01e74d02-b267-4e78-9512-25f1dc99a9b8 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:36.905375 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01e74d02-b267-4e78-9512-25f1dc99a9b8 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:36.906060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01e74d02-b267-4e78-9512-25f1dc99a9b8 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:36.906658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01e74d02-b267-4e78-9512-25f1dc99a9b8 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:37.300132 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:54:37.305409 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-01e74d02-b267-4e78-9512-25f1dc99a9b8 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9" status: 200 len: 1645 microversion: 2.1 time: 0.414613 Sep 17 20:54:37.306326 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 478/994] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:36 2022] GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 => generated 1645 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:37.323714 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1ca0e267-9dd4-4318-bc73-8699f3bbf5d3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:37.324418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1ca0e267-9dd4-4318-bc73-8699f3bbf5d3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:37.332306 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ca0e267-9dd4-4318-bc73-8699f3bbf5d3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:37.333056 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ca0e267-9dd4-4318-bc73-8699f3bbf5d3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:37.333788 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ca0e267-9dd4-4318-bc73-8699f3bbf5d3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:37.334752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ca0e267-9dd4-4318-bc73-8699f3bbf5d3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:37.335470 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ca0e267-9dd4-4318-bc73-8699f3bbf5d3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:37.336104 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ca0e267-9dd4-4318-bc73-8699f3bbf5d3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:37.655205 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1ca0e267-9dd4-4318-bc73-8699f3bbf5d3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:37.665806 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1ca0e267-9dd4-4318-bc73-8699f3bbf5d3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1476 microversion: 2.1 time: 0.346348 Sep 17 20:54:37.682027 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 479/995] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:37 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1476 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:37.688132 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-9b23d9cf-9990-4c6e-9f46-76d12425cafd req-03974cb8-1e55-4d94-9ca2-3d7eff708631 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59beeb15-b8ee-49e8-b739-f38a755dc102", "tag": "eadc612b-7bf9-4d2b-b813-686741311705"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:37.702441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-9b23d9cf-9990-4c6e-9f46-76d12425cafd req-03974cb8-1e55-4d94-9ca2-3d7eff708631 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:37.703303 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-9b23d9cf-9990-4c6e-9f46-76d12425cafd req-03974cb8-1e55-4d94-9ca2-3d7eff708631 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:37.703761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-9b23d9cf-9990-4c6e-9f46-76d12425cafd req-03974cb8-1e55-4d94-9ca2-3d7eff708631 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:37.717338 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-9b23d9cf-9990-4c6e-9f46-76d12425cafd req-03974cb8-1e55-4d94-9ca2-3d7eff708631 service nova] Creating event network-changed:eadc612b-7bf9-4d2b-b813-686741311705 for instance 59beeb15-b8ee-49e8-b739-f38a755dc102 on nch1-master-1 Sep 17 20:54:37.723506 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-9b23d9cf-9990-4c6e-9f46-76d12425cafd req-03974cb8-1e55-4d94-9ca2-3d7eff708631 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040022 Sep 17 20:54:37.724800 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 480/996] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:54:37.731946 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bacd00ba-eb0c-42f2-8072-3a048f322f78 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:37.732357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bacd00ba-eb0c-42f2-8072-3a048f322f78 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:37.743346 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bacd00ba-eb0c-42f2-8072-3a048f322f78 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:37.744716 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bacd00ba-eb0c-42f2-8072-3a048f322f78 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:37.746104 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bacd00ba-eb0c-42f2-8072-3a048f322f78 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:37.747554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bacd00ba-eb0c-42f2-8072-3a048f322f78 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:37.748546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bacd00ba-eb0c-42f2-8072-3a048f322f78 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:37.749312 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bacd00ba-eb0c-42f2-8072-3a048f322f78 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:37.766183 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-bacd00ba-eb0c-42f2-8072-3a048f322f78 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] HTTP exception thrown: Instance 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 could not be found. Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bacd00ba-eb0c-42f2-8072-3a048f322f78 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Request method failure captured: Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 HTTP/1.1 Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjNtTfMY0G5lQs_dyrUUd3uhf4fkQ3zAp8Me0jeaAiBro3HrrjlPk268iZKuzOLTN5xAJijPUZAtWoKLG1JownXbmLXTWOo2qR82Cu6KknLHG1OzyZsrBhYeLNP8tdMuR4onga0PVA4wmKh8cK4cEHnZBxYpO6qDZRvyIkkGiNViI6A Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 1f305d163acf499c9808c5f11150a7cf Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-387909269 Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1f305d163acf499c9808c5f11150a7cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1f305d163acf499c9808c5f11150a7cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1f305d163acf499c9808c5f11150a7cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1f305d163acf499c9808c5f11150a7cf", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-387909269 Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 1f305d163acf499c9808c5f11150a7cf Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-387909269 Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersWithSpecificFlavorTestJSON-387909269-project Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 42f7c0fdad9346c58949928300021b07 Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-387909269-project Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 could not be found. Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7'} Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 could not be found. Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:54:37.768309 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:54:37.774070 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 could not be found. Sep 17 20:54:37.774070 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:37.774070 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:37.774070 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:37.774070 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:37.774070 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:54:37.774070 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:54:37.774070 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:54:37.774070 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:54:37.774070 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 could not be found. Sep 17 20:54:37.774070 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:37.776348 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bacd00ba-eb0c-42f2-8072-3a048f322f78 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Returning 404 to user: Instance 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:54:37.777421 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bacd00ba-eb0c-42f2-8072-3a048f322f78 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7" status: 404 len: 111 microversion: 2.1 time: 0.050734 Sep 17 20:54:37.781802 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 481/997] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:54:37 2022] DELETE /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:54:37.787113 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-10c427db-c681-4d41-88ce-df0d953b9ff7 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:37.792025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10c427db-c681-4d41-88ce-df0d953b9ff7 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:37.792596 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10c427db-c681-4d41-88ce-df0d953b9ff7 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:37.793047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10c427db-c681-4d41-88ce-df0d953b9ff7 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:37.793895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10c427db-c681-4d41-88ce-df0d953b9ff7 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:37.794480 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10c427db-c681-4d41-88ce-df0d953b9ff7 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:37.795043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10c427db-c681-4d41-88ce-df0d953b9ff7 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:37.830422 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-10c427db-c681-4d41-88ce-df0d953b9ff7 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.046836 Sep 17 20:54:37.831521 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 482/998] 10.222.0.26 () {58 vars in 1176 bytes} [Sat Sep 17 20:54:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:54:37.838478 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cc8ca0f4-e82a-41f6-9d1a-fc8ecef90b4b tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:37.839270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cc8ca0f4-e82a-41f6-9d1a-fc8ecef90b4b tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:37.850124 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc8ca0f4-e82a-41f6-9d1a-fc8ecef90b4b tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:37.851055 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc8ca0f4-e82a-41f6-9d1a-fc8ecef90b4b tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:37.853365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc8ca0f4-e82a-41f6-9d1a-fc8ecef90b4b tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:37.856313 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc8ca0f4-e82a-41f6-9d1a-fc8ecef90b4b tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:37.858844 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc8ca0f4-e82a-41f6-9d1a-fc8ecef90b4b tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:37.862138 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc8ca0f4-e82a-41f6-9d1a-fc8ecef90b4b tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:37.903919 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-cc8ca0f4-e82a-41f6-9d1a-fc8ecef90b4b tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] HTTP exception thrown: Instance 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 could not be found. Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cc8ca0f4-e82a-41f6-9d1a-fc8ecef90b4b tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Request method failure captured: Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 HTTP/1.1 Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjNtTfMY0G5lQs_dyrUUd3uhf4fkQ3zAp8Me0jeaAiBro3HrrjlPk268iZKuzOLTN5xAJijPUZAtWoKLG1JownXbmLXTWOo2qR82Cu6KknLHG1OzyZsrBhYeLNP8tdMuR4onga0PVA4wmKh8cK4cEHnZBxYpO6qDZRvyIkkGiNViI6A Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 1f305d163acf499c9808c5f11150a7cf Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-387909269 Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1f305d163acf499c9808c5f11150a7cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1f305d163acf499c9808c5f11150a7cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1f305d163acf499c9808c5f11150a7cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1f305d163acf499c9808c5f11150a7cf", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-387909269 Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 1f305d163acf499c9808c5f11150a7cf Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-387909269 Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersWithSpecificFlavorTestJSON-387909269-project Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 42f7c0fdad9346c58949928300021b07 Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-387909269-project Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 could not be found. Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7'} Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 could not be found. Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 could not be found. Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:37.908097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:37.913218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:37.913218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:37.913218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:54:37.913218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:54:37.913218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:54:37.913218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:54:37.913218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 could not be found. Sep 17 20:54:37.913218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:37.915792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cc8ca0f4-e82a-41f6-9d1a-fc8ecef90b4b tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Returning 404 to user: Instance 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:54:37.917050 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cc8ca0f4-e82a-41f6-9d1a-fc8ecef90b4b tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7" status: 404 len: 111 microversion: 2.1 time: 0.084495 Sep 17 20:54:37.922787 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 483/999] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:37 2022] GET /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:54:37.930358 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b2d1b7fa-0b2b-4965-9628-906aed7510a5 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:37.932443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b2d1b7fa-0b2b-4965-9628-906aed7510a5 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:37.950294 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b2d1b7fa-0b2b-4965-9628-906aed7510a5 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:37.950294 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b2d1b7fa-0b2b-4965-9628-906aed7510a5 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:37.950294 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b2d1b7fa-0b2b-4965-9628-906aed7510a5 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:37.950294 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b2d1b7fa-0b2b-4965-9628-906aed7510a5 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:37.953985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b2d1b7fa-0b2b-4965-9628-906aed7510a5 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:37.954716 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b2d1b7fa-0b2b-4965-9628-906aed7510a5 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:38.119506 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b2d1b7fa-0b2b-4965-9628-906aed7510a5 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9/action" status: 202 len: 0 microversion: 2.1 time: 0.198362 Sep 17 20:54:38.124236 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 484/1000] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:54:37 2022] POST /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:54:38.145182 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-def5d0b6-3e0b-42b6-8411-16808046ca4d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:38.145986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-def5d0b6-3e0b-42b6-8411-16808046ca4d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:38.156771 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-def5d0b6-3e0b-42b6-8411-16808046ca4d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:38.157269 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-def5d0b6-3e0b-42b6-8411-16808046ca4d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:38.157746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-def5d0b6-3e0b-42b6-8411-16808046ca4d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:38.158650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-def5d0b6-3e0b-42b6-8411-16808046ca4d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:38.159033 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-def5d0b6-3e0b-42b6-8411-16808046ca4d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:38.159441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-def5d0b6-3e0b-42b6-8411-16808046ca4d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:38.438424 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-06c1055b-212a-4045-b2d8-06dcffb364c0 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 59beeb15-b8ee-49e8-b739-f38a755dc102] Updating instance_info_cache with network_info: [{"id": "eadc612b-7bf9-4d2b-b813-686741311705", "address": "fa:16:3e:ae:bb:2c", "network": {"id": "3c590c43-fcd5-41d9-9c4b-71b8980abfc0", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-261373508-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.7.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6b843f5d09c94cf3916f65e815d6d7a1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapeadc612b-7b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140524) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 17 20:54:38.457814 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06c1055b-212a-4045-b2d8-06dcffb364c0 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Releasing lock "refresh_cache-59beeb15-b8ee-49e8-b739-f38a755dc102" {{(pid=140524) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 17 20:54:38.458877 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-06c1055b-212a-4045-b2d8-06dcffb364c0 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "POST /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102/action" status: 202 len: 0 microversion: 2.1 time: 4.850466 Sep 17 20:54:38.463788 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 517/1001] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:54:33 2022] POST /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102/action => generated 0 bytes in 4856 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Sep 17 20:54:38.476090 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-84ae5efb-ea30-4a9c-be54-3bd4d8adf8dd tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '.version_select at 0x7f25a54b8b80>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:38.509438 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-84ae5efb-ea30-4a9c-be54-3bd4d8adf8dd tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-714475675" status: 202 len: 0 microversion: 2.1 time: 0.043251 Sep 17 20:54:38.511207 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 518/1002] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Sep 17 20:54:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-714475675 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:54:38.518518 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a4cf5e75-d871-468a-8635-b4f4516c8460 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:38.519849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a4cf5e75-d871-468a-8635-b4f4516c8460 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:38.531424 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a4cf5e75-d871-468a-8635-b4f4516c8460 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:38.532245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a4cf5e75-d871-468a-8635-b4f4516c8460 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:38.532959 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a4cf5e75-d871-468a-8635-b4f4516c8460 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:38.534967 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a4cf5e75-d871-468a-8635-b4f4516c8460 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:38.535711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a4cf5e75-d871-468a-8635-b4f4516c8460 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:38.536659 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a4cf5e75-d871-468a-8635-b4f4516c8460 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:38.631522 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-def5d0b6-3e0b-42b6-8411-16808046ca4d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:38.650017 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-def5d0b6-3e0b-42b6-8411-16808046ca4d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1506 microversion: 2.1 time: 0.527172 Sep 17 20:54:38.651055 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 485/1003] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:38 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1506 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:38.674351 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0ab0d173-9728-46cd-9fe2-4db6d4a10b18 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.7.99"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:38.685075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0ab0d173-9728-46cd-9fe2-4db6d4a10b18 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 143322a7-9d8b-43c3-b3a5-4000c26b6cc7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:38.700487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ab0d173-9728-46cd-9fe2-4db6d4a10b18 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:38.708997 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ab0d173-9728-46cd-9fe2-4db6d4a10b18 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:38.709755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ab0d173-9728-46cd-9fe2-4db6d4a10b18 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:38.710765 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ab0d173-9728-46cd-9fe2-4db6d4a10b18 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:38.711385 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ab0d173-9728-46cd-9fe2-4db6d4a10b18 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:38.711978 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ab0d173-9728-46cd-9fe2-4db6d4a10b18 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:38.769841 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ab0d173-9728-46cd-9fe2-4db6d4a10b18 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "refresh_cache-143322a7-9d8b-43c3-b3a5-4000c26b6cc7" {{(pid=140523) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 17 20:54:38.770512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ab0d173-9728-46cd-9fe2-4db6d4a10b18 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquired lock "refresh_cache-143322a7-9d8b-43c3-b3a5-4000c26b6cc7" {{(pid=140523) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 17 20:54:39.153029 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a4cf5e75-d871-468a-8635-b4f4516c8460 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9" status: 200 len: 1630 microversion: 2.1 time: 0.640451 Sep 17 20:54:39.153855 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 519/1004] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:38 2022] GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 => generated 1630 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:39.176614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8eb4f593-4232-488d-88c0-6d65ec1a3337 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:39.177795 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8eb4f593-4232-488d-88c0-6d65ec1a3337 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:39.184885 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8eb4f593-4232-488d-88c0-6d65ec1a3337 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:39.185693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8eb4f593-4232-488d-88c0-6d65ec1a3337 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:39.186305 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8eb4f593-4232-488d-88c0-6d65ec1a3337 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:39.187378 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8eb4f593-4232-488d-88c0-6d65ec1a3337 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:39.188143 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8eb4f593-4232-488d-88c0-6d65ec1a3337 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:39.188716 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8eb4f593-4232-488d-88c0-6d65ec1a3337 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:39.594973 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8eb4f593-4232-488d-88c0-6d65ec1a3337 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:39.612448 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8eb4f593-4232-488d-88c0-6d65ec1a3337 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1506 microversion: 2.1 time: 0.441298 Sep 17 20:54:39.614953 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 520/1005] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:39 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1506 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:39.622210 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-415d93fa-847f-4180-9ce6-b642ce3d185a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:39.623244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-415d93fa-847f-4180-9ce6-b642ce3d185a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:39.633839 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-415d93fa-847f-4180-9ce6-b642ce3d185a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:39.635059 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-415d93fa-847f-4180-9ce6-b642ce3d185a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:39.636750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-415d93fa-847f-4180-9ce6-b642ce3d185a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:39.640395 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-415d93fa-847f-4180-9ce6-b642ce3d185a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:39.641748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-415d93fa-847f-4180-9ce6-b642ce3d185a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:39.641748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-415d93fa-847f-4180-9ce6-b642ce3d185a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:40.126891 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-415d93fa-847f-4180-9ce6-b642ce3d185a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:40.136833 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-415d93fa-847f-4180-9ce6-b642ce3d185a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1476 microversion: 2.1 time: 0.519484 Sep 17 20:54:40.137454 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 521/1006] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:39 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1476 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:40.143735 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-17c1e7c9-2d71-4dc3-874e-1f4f1feaadee tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:40.146852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-17c1e7c9-2d71-4dc3-874e-1f4f1feaadee tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:40.154612 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17c1e7c9-2d71-4dc3-874e-1f4f1feaadee tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:40.155069 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17c1e7c9-2d71-4dc3-874e-1f4f1feaadee tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:40.155556 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17c1e7c9-2d71-4dc3-874e-1f4f1feaadee tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:40.156342 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17c1e7c9-2d71-4dc3-874e-1f4f1feaadee tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:40.156839 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17c1e7c9-2d71-4dc3-874e-1f4f1feaadee tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:40.157611 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17c1e7c9-2d71-4dc3-874e-1f4f1feaadee tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:40.186969 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-17c1e7c9-2d71-4dc3-874e-1f4f1feaadee tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lazy-loading 'flavor' on Instance uuid 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:54:40.205178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-17c1e7c9-2d71-4dc3-874e-1f4f1feaadee tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Going to try to live migrate instance to nch2-master-1 {{(pid=140524) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 17 20:54:40.315905 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:54:42.125060 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-17c1e7c9-2d71-4dc3-874e-1f4f1feaadee tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9/action" status: 202 len: 0 microversion: 2.1 time: 1.986225 Sep 17 20:54:42.133021 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 522/1007] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:54:40 2022] POST /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9/action => generated 0 bytes in 1995 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:54:42.139966 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c04d1b0d-f935-4374-bda9-137ed51f09fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "OS-DCF:diskConfig": "AUTO"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:42.144830 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c04d1b0d-f935-4374-bda9-137ed51f09fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:42.171357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c04d1b0d-f935-4374-bda9-137ed51f09fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:42.172280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c04d1b0d-f935-4374-bda9-137ed51f09fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:42.172953 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c04d1b0d-f935-4374-bda9-137ed51f09fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:42.174051 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c04d1b0d-f935-4374-bda9-137ed51f09fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:42.174689 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c04d1b0d-f935-4374-bda9-137ed51f09fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:42.175475 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c04d1b0d-f935-4374-bda9-137ed51f09fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:42.367596 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-c04d1b0d-f935-4374-bda9-137ed51f09fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:54:42.369772 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-c04d1b0d-f935-4374-bda9-137ed51f09fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:54:42.371213 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-c04d1b0d-f935-4374-bda9-137ed51f09fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:54:42.371842 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-c04d1b0d-f935-4374-bda9-137ed51f09fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:54:42.372517 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-c04d1b0d-f935-4374-bda9-137ed51f09fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:54:42.517259 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c04d1b0d-f935-4374-bda9-137ed51f09fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:42.556903 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c04d1b0d-f935-4374-bda9-137ed51f09fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:42.561118 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c04d1b0d-f935-4374-bda9-137ed51f09fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:42.562861 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c04d1b0d-f935-4374-bda9-137ed51f09fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:42.565732 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c04d1b0d-f935-4374-bda9-137ed51f09fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:42.566490 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c04d1b0d-f935-4374-bda9-137ed51f09fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:42.569360 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.network.neutron [None req-0ab0d173-9728-46cd-9fe2-4db6d4a10b18 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 143322a7-9d8b-43c3-b3a5-4000c26b6cc7] re-assign floating IP 172.35.7.99 from instance 59beeb15-b8ee-49e8-b739-f38a755dc102 Sep 17 20:54:42.570785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c04d1b0d-f935-4374-bda9-137ed51f09fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:42.637231 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c04d1b0d-f935-4374-bda9-137ed51f09fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "POST /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c/action" status: 202 len: 1108 microversion: 2.1 time: 0.502240 Sep 17 20:54:42.643698 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 523/1008] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:54:42 2022] POST /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c/action => generated 1108 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 17 20:54:42.656032 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b086a169-5de5-4629-aa30-84645b776f6b tempest-ServersWithSpecificFlavorTestJSON-1158539409 tempest-ServersWithSpecificFlavorTestJSON-1158539409-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:42.713640 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-0ab0d173-9728-46cd-9fe2-4db6d4a10b18 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 59beeb15-b8ee-49e8-b739-f38a755dc102] Building network info cache for instance {{(pid=140523) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 17 20:54:42.738119 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b086a169-5de5-4629-aa30-84645b776f6b tempest-ServersWithSpecificFlavorTestJSON-1158539409 tempest-ServersWithSpecificFlavorTestJSON-1158539409-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/689354539" status: 202 len: 0 microversion: 2.1 time: 0.092972 Sep 17 20:54:42.739163 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 524/1009] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Sep 17 20:54:42 2022] DELETE /compute/v2.1/flavors/689354539 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:54:42.750669 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fbeb7bf1-ab7a-4d08-b5a7-f78cbb59e91c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:42.754684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fbeb7bf1-ab7a-4d08-b5a7-f78cbb59e91c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:42.775010 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbeb7bf1-ab7a-4d08-b5a7-f78cbb59e91c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:42.777760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbeb7bf1-ab7a-4d08-b5a7-f78cbb59e91c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:42.778331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbeb7bf1-ab7a-4d08-b5a7-f78cbb59e91c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:42.779555 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbeb7bf1-ab7a-4d08-b5a7-f78cbb59e91c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:42.780223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbeb7bf1-ab7a-4d08-b5a7-f78cbb59e91c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:42.781343 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbeb7bf1-ab7a-4d08-b5a7-f78cbb59e91c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:43.609771 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fbeb7bf1-ab7a-4d08-b5a7-f78cbb59e91c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:43.621843 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fbeb7bf1-ab7a-4d08-b5a7-f78cbb59e91c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1476 microversion: 2.1 time: 0.881305 Sep 17 20:54:43.625835 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 525/1010] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:42 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1476 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:43.632588 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a0cf2609-17d2-44da-bdf2-345e3a51a49f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:43.633633 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a0cf2609-17d2-44da-bdf2-345e3a51a49f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:43.643561 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0cf2609-17d2-44da-bdf2-345e3a51a49f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:43.644646 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0cf2609-17d2-44da-bdf2-345e3a51a49f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:43.645494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0cf2609-17d2-44da-bdf2-345e3a51a49f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:43.656074 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0cf2609-17d2-44da-bdf2-345e3a51a49f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:43.659802 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0cf2609-17d2-44da-bdf2-345e3a51a49f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:43.661473 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0cf2609-17d2-44da-bdf2-345e3a51a49f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:43.938905 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a0cf2609-17d2-44da-bdf2-345e3a51a49f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:43.956499 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a0cf2609-17d2-44da-bdf2-345e3a51a49f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9" status: 200 len: 1504 microversion: 2.1 time: 0.325452 Sep 17 20:54:43.956499 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 526/1011] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:43 2022] GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 => generated 1504 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:43.981559 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-849dc621-ae12-4756-ab93-91ff152ec2c5 req-6b49f5a2-eab9-409a-9a19-a2ddd3f42335 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59beeb15-b8ee-49e8-b739-f38a755dc102", "tag": "eadc612b-7bf9-4d2b-b813-686741311705"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:44.014600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-849dc621-ae12-4756-ab93-91ff152ec2c5 req-6b49f5a2-eab9-409a-9a19-a2ddd3f42335 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:44.015104 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-849dc621-ae12-4756-ab93-91ff152ec2c5 req-6b49f5a2-eab9-409a-9a19-a2ddd3f42335 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:44.015540 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-849dc621-ae12-4756-ab93-91ff152ec2c5 req-6b49f5a2-eab9-409a-9a19-a2ddd3f42335 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:44.048520 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-849dc621-ae12-4756-ab93-91ff152ec2c5 req-6b49f5a2-eab9-409a-9a19-a2ddd3f42335 service nova] Creating event network-changed:eadc612b-7bf9-4d2b-b813-686741311705 for instance 59beeb15-b8ee-49e8-b739-f38a755dc102 on nch1-master-1 Sep 17 20:54:44.065370 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-849dc621-ae12-4756-ab93-91ff152ec2c5 req-6b49f5a2-eab9-409a-9a19-a2ddd3f42335 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109079 Sep 17 20:54:44.066170 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 527/1012] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:54:44.078291 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0b3af3b8-fcb5-4e6f-96e5-df4354a70546 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:44.080943 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0b3af3b8-fcb5-4e6f-96e5-df4354a70546 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:44.097332 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b3af3b8-fcb5-4e6f-96e5-df4354a70546 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:44.097956 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b3af3b8-fcb5-4e6f-96e5-df4354a70546 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:44.098383 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b3af3b8-fcb5-4e6f-96e5-df4354a70546 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:44.099305 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b3af3b8-fcb5-4e6f-96e5-df4354a70546 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:44.099776 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b3af3b8-fcb5-4e6f-96e5-df4354a70546 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:44.100794 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b3af3b8-fcb5-4e6f-96e5-df4354a70546 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:44.120232 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-0ab0d173-9728-46cd-9fe2-4db6d4a10b18 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 59beeb15-b8ee-49e8-b739-f38a755dc102] Updating instance_info_cache with network_info: [{"id": "eadc612b-7bf9-4d2b-b813-686741311705", "address": "fa:16:3e:ae:bb:2c", "network": {"id": "3c590c43-fcd5-41d9-9c4b-71b8980abfc0", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-261373508-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6b843f5d09c94cf3916f65e815d6d7a1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapeadc612b-7b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140523) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 17 20:54:44.140135 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-0ab0d173-9728-46cd-9fe2-4db6d4a10b18 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 143322a7-9d8b-43c3-b3a5-4000c26b6cc7] Building network info cache for instance {{(pid=140523) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 17 20:54:44.437352 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0b3af3b8-fcb5-4e6f-96e5-df4354a70546 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:44.448088 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0b3af3b8-fcb5-4e6f-96e5-df4354a70546 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1513 microversion: 2.1 time: 0.380314 Sep 17 20:54:44.451560 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 528/1013] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:44 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1513 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:44.466085 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a6818b57-af27-4111-8338-edff5966ebfb tempest-ServersWithSpecificFlavorTestJSON-1158539409 tempest-ServersWithSpecificFlavorTestJSON-1158539409-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:44.509494 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a6818b57-af27-4111-8338-edff5966ebfb tempest-ServersWithSpecificFlavorTestJSON-1158539409 tempest-ServersWithSpecificFlavorTestJSON-1158539409-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.056170 Sep 17 20:54:44.510054 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 529/1014] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:54:44 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:44.525896 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-b03d08cc-c535-4566-aeb6-8f4011de2068 req-eda970a4-1590-4710-96b8-804907c5b9e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b3f5764-d941-4ddb-80fc-3e7b6409f7d9", "name": "network-vif-unplugged", "status": "completed", "tag": "da68fd65-992d-49fa-b979-c348cd631ce3"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:44.554185 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b03d08cc-c535-4566-aeb6-8f4011de2068 req-eda970a4-1590-4710-96b8-804907c5b9e9 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:44.554675 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b03d08cc-c535-4566-aeb6-8f4011de2068 req-eda970a4-1590-4710-96b8-804907c5b9e9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:44.555122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b03d08cc-c535-4566-aeb6-8f4011de2068 req-eda970a4-1590-4710-96b8-804907c5b9e9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:44.585762 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-b03d08cc-c535-4566-aeb6-8f4011de2068 req-eda970a4-1590-4710-96b8-804907c5b9e9 service nova] Creating event network-vif-unplugged:da68fd65-992d-49fa-b979-c348cd631ce3 for instance 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 on nch1-master-1 Sep 17 20:54:44.596971 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-b03d08cc-c535-4566-aeb6-8f4011de2068 req-eda970a4-1590-4710-96b8-804907c5b9e9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080988 Sep 17 20:54:44.598785 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 530/1015] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:54:44.604314 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-29596ad1-7321-4cc9-bf73-ec687ea5d525 tempest-ServersWithSpecificFlavorTestJSON-1158539409 tempest-ServersWithSpecificFlavorTestJSON-1158539409-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:44.618640 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=6 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:54:44.627775 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-29596ad1-7321-4cc9-bf73-ec687ea5d525 tempest-ServersWithSpecificFlavorTestJSON-1158539409 tempest-ServersWithSpecificFlavorTestJSON-1158539409-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1073285898" status: 202 len: 0 microversion: 2.1 time: 0.027468 Sep 17 20:54:44.631695 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 531/1016] 10.222.0.26 () {58 vars in 1161 bytes} [Sat Sep 17 20:54:44 2022] DELETE /compute/v2.1/flavors/1073285898 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:54:44.641570 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-eb331f0d-c2f7-4a65-82d5-1b79a422e6b2 tempest-ServersWithSpecificFlavorTestJSON-1158539409 tempest-ServersWithSpecificFlavorTestJSON-1158539409-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:44.683838 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-eb331f0d-c2f7-4a65-82d5-1b79a422e6b2 tempest-ServersWithSpecificFlavorTestJSON-1158539409 tempest-ServersWithSpecificFlavorTestJSON-1158539409-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.050320 Sep 17 20:54:44.700325 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 532/1017] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:54:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:44.700325 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5a86bbf6-7290-4297-a7b7-432bc2cf7467 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:44.700325 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5a86bbf6-7290-4297-a7b7-432bc2cf7467 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:44.706982 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a86bbf6-7290-4297-a7b7-432bc2cf7467 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:44.707561 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a86bbf6-7290-4297-a7b7-432bc2cf7467 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:44.708015 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a86bbf6-7290-4297-a7b7-432bc2cf7467 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:44.713169 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a86bbf6-7290-4297-a7b7-432bc2cf7467 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:44.714068 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a86bbf6-7290-4297-a7b7-432bc2cf7467 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:44.714526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a86bbf6-7290-4297-a7b7-432bc2cf7467 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:45.006436 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5a86bbf6-7290-4297-a7b7-432bc2cf7467 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:45.023685 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5a86bbf6-7290-4297-a7b7-432bc2cf7467 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1476 microversion: 2.1 time: 0.337766 Sep 17 20:54:45.025901 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 533/1018] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:44 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1476 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:45.033003 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fd5b255c-8002-4ded-982d-37abdff65666 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:45.033713 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fd5b255c-8002-4ded-982d-37abdff65666 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: a9ab9592-fc9c-4ec4-bf25-6ffb49440f25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:45.051891 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fd5b255c-8002-4ded-982d-37abdff65666 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:45.052915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fd5b255c-8002-4ded-982d-37abdff65666 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:45.053940 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fd5b255c-8002-4ded-982d-37abdff65666 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:45.055396 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fd5b255c-8002-4ded-982d-37abdff65666 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:45.056144 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fd5b255c-8002-4ded-982d-37abdff65666 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:45.056792 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fd5b255c-8002-4ded-982d-37abdff65666 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:45.080000 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-fd5b255c-8002-4ded-982d-37abdff65666 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] HTTP exception thrown: Instance a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 could not be found. Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fd5b255c-8002-4ded-982d-37abdff65666 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Request method failure captured: Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 HTTP/1.1 Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjNtTfMY0G5lQs_dyrUUd3uhf4fkQ3zAp8Me0jeaAiBro3HrrjlPk268iZKuzOLTN5xAJijPUZAtWoKLG1JownXbmLXTWOo2qR82Cu6KknLHG1OzyZsrBhYeLNP8tdMuR4onga0PVA4wmKh8cK4cEHnZBxYpO6qDZRvyIkkGiNViI6A Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 1f305d163acf499c9808c5f11150a7cf Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-387909269 Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1f305d163acf499c9808c5f11150a7cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1f305d163acf499c9808c5f11150a7cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1f305d163acf499c9808c5f11150a7cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1f305d163acf499c9808c5f11150a7cf", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-387909269 Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 1f305d163acf499c9808c5f11150a7cf Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-387909269 Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersWithSpecificFlavorTestJSON-387909269-project Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 42f7c0fdad9346c58949928300021b07 Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-387909269-project Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 could not be found. Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'a9ab9592-fc9c-4ec4-bf25-6ffb49440f25'} Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 could not be found. Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:54:45.083761 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:54:45.093064 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 could not be found. Sep 17 20:54:45.093064 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:45.093064 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:45.093064 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:45.093064 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:45.093064 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:54:45.093064 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:54:45.093064 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:54:45.093064 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:54:45.093064 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 could not be found. Sep 17 20:54:45.093064 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:45.097085 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fd5b255c-8002-4ded-982d-37abdff65666 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Returning 404 to user: Instance a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:54:45.100646 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fd5b255c-8002-4ded-982d-37abdff65666 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25" status: 404 len: 111 microversion: 2.1 time: 0.072991 Sep 17 20:54:45.106173 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 534/1019] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:54:45 2022] DELETE /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:54:45.123374 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bccbba27-591b-4db7-a371-0be1f5932b06 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:45.124414 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bccbba27-591b-4db7-a371-0be1f5932b06 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:45.134239 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bccbba27-591b-4db7-a371-0be1f5932b06 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:45.135068 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bccbba27-591b-4db7-a371-0be1f5932b06 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:45.136046 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bccbba27-591b-4db7-a371-0be1f5932b06 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:45.137444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bccbba27-591b-4db7-a371-0be1f5932b06 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:45.138633 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bccbba27-591b-4db7-a371-0be1f5932b06 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:45.171771 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bccbba27-591b-4db7-a371-0be1f5932b06 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:45.348449 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-0ab0d173-9728-46cd-9fe2-4db6d4a10b18 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 143322a7-9d8b-43c3-b3a5-4000c26b6cc7] Updating instance_info_cache with network_info: [{"id": "6f8f4ce9-626f-432d-8d38-108942adfb39", "address": "fa:16:3e:81:bd:b4", "network": {"id": "3c590c43-fcd5-41d9-9c4b-71b8980abfc0", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-261373508-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.7.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6b843f5d09c94cf3916f65e815d6d7a1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6f8f4ce9-62", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140523) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 17 20:54:45.386714 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ab0d173-9728-46cd-9fe2-4db6d4a10b18 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Releasing lock "refresh_cache-143322a7-9d8b-43c3-b3a5-4000c26b6cc7" {{(pid=140523) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 17 20:54:45.388031 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0ab0d173-9728-46cd-9fe2-4db6d4a10b18 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "POST /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7/action" status: 202 len: 0 microversion: 2.1 time: 6.724789 Sep 17 20:54:45.389398 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 486/1020] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:54:38 2022] POST /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7/action => generated 0 bytes in 6727 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 17 20:54:45.398593 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-26dcee46-cb21-4317-9da6-bf4c43aaa4e2 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:45.400286 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-26dcee46-cb21-4317-9da6-bf4c43aaa4e2 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: a9ab9592-fc9c-4ec4-bf25-6ffb49440f25] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:45.418502 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26dcee46-cb21-4317-9da6-bf4c43aaa4e2 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:45.421390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26dcee46-cb21-4317-9da6-bf4c43aaa4e2 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:45.423028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26dcee46-cb21-4317-9da6-bf4c43aaa4e2 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:45.426317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26dcee46-cb21-4317-9da6-bf4c43aaa4e2 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:45.427618 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26dcee46-cb21-4317-9da6-bf4c43aaa4e2 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:45.428640 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26dcee46-cb21-4317-9da6-bf4c43aaa4e2 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:45.466420 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-26dcee46-cb21-4317-9da6-bf4c43aaa4e2 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] HTTP exception thrown: Instance a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 could not be found. Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-26dcee46-cb21-4317-9da6-bf4c43aaa4e2 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Request method failure captured: Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 HTTP/1.1 Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjNtTfMY0G5lQs_dyrUUd3uhf4fkQ3zAp8Me0jeaAiBro3HrrjlPk268iZKuzOLTN5xAJijPUZAtWoKLG1JownXbmLXTWOo2qR82Cu6KknLHG1OzyZsrBhYeLNP8tdMuR4onga0PVA4wmKh8cK4cEHnZBxYpO6qDZRvyIkkGiNViI6A Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 1f305d163acf499c9808c5f11150a7cf Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-387909269 Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1f305d163acf499c9808c5f11150a7cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1f305d163acf499c9808c5f11150a7cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1f305d163acf499c9808c5f11150a7cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1f305d163acf499c9808c5f11150a7cf", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-387909269 Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 1f305d163acf499c9808c5f11150a7cf Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-387909269 Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersWithSpecificFlavorTestJSON-387909269-project Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 42f7c0fdad9346c58949928300021b07 Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-387909269-project Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 could not be found. Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'a9ab9592-fc9c-4ec4-bf25-6ffb49440f25'} Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 could not be found. Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 could not be found. Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:45.473291 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:45.480519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:45.480519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:45.480519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:54:45.480519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:54:45.480519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:54:45.480519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:54:45.480519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 could not be found. Sep 17 20:54:45.480519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:45.483111 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-26dcee46-cb21-4317-9da6-bf4c43aaa4e2 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Returning 404 to user: Instance a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:54:45.484531 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-26dcee46-cb21-4317-9da6-bf4c43aaa4e2 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25" status: 404 len: 111 microversion: 2.1 time: 0.093864 Sep 17 20:54:45.486154 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 487/1021] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:45 2022] GET /compute/v2.1/servers/a9ab9592-fc9c-4ec4-bf25-6ffb49440f25 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:54:45.498607 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-86a729aa-9650-46c5-9b70-f6b7c0742865 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.7.99"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:45.634751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bccbba27-591b-4db7-a371-0be1f5932b06 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:45.644015 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bccbba27-591b-4db7-a371-0be1f5932b06 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9" status: 200 len: 1504 microversion: 2.1 time: 0.535385 Sep 17 20:54:45.646954 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 535/1022] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:45 2022] GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 => generated 1504 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:45.659812 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ae8cce2c-6caf-4648-b259-931f4ea3215e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:45.661292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ae8cce2c-6caf-4648-b259-931f4ea3215e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:45.671978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae8cce2c-6caf-4648-b259-931f4ea3215e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:45.673152 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae8cce2c-6caf-4648-b259-931f4ea3215e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:45.673712 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae8cce2c-6caf-4648-b259-931f4ea3215e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:45.674707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae8cce2c-6caf-4648-b259-931f4ea3215e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:45.675274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae8cce2c-6caf-4648-b259-931f4ea3215e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:45.675791 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae8cce2c-6caf-4648-b259-931f4ea3215e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:45.818369 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-86a729aa-9650-46c5-9b70-f6b7c0742865 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 143322a7-9d8b-43c3-b3a5-4000c26b6cc7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:45.825013 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-86a729aa-9650-46c5-9b70-f6b7c0742865 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:45.826103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-86a729aa-9650-46c5-9b70-f6b7c0742865 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:45.826801 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-86a729aa-9650-46c5-9b70-f6b7c0742865 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:45.828401 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-86a729aa-9650-46c5-9b70-f6b7c0742865 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:45.829602 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-86a729aa-9650-46c5-9b70-f6b7c0742865 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:45.830109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-86a729aa-9650-46c5-9b70-f6b7c0742865 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:46.030166 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ae8cce2c-6caf-4648-b259-931f4ea3215e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:46.039144 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ae8cce2c-6caf-4648-b259-931f4ea3215e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1513 microversion: 2.1 time: 0.390467 Sep 17 20:54:46.040105 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 536/1023] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:45 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1513 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:46.044512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fbbccfe1-1986-4570-81c1-945f9a2906ef tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:46.046065 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fbbccfe1-1986-4570-81c1-945f9a2906ef tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:46.054147 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbbccfe1-1986-4570-81c1-945f9a2906ef tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:46.054630 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbbccfe1-1986-4570-81c1-945f9a2906ef tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:46.055244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbbccfe1-1986-4570-81c1-945f9a2906ef tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:46.056207 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbbccfe1-1986-4570-81c1-945f9a2906ef tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:46.056824 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbbccfe1-1986-4570-81c1-945f9a2906ef tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:46.057702 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbbccfe1-1986-4570-81c1-945f9a2906ef tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:46.076243 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-fbbccfe1-1986-4570-81c1-945f9a2906ef tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] HTTP exception thrown: Instance 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 could not be found. Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fbbccfe1-1986-4570-81c1-945f9a2906ef tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Request method failure captured: Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 HTTP/1.1 Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjNtTfMY0G5lQs_dyrUUd3uhf4fkQ3zAp8Me0jeaAiBro3HrrjlPk268iZKuzOLTN5xAJijPUZAtWoKLG1JownXbmLXTWOo2qR82Cu6KknLHG1OzyZsrBhYeLNP8tdMuR4onga0PVA4wmKh8cK4cEHnZBxYpO6qDZRvyIkkGiNViI6A Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 1f305d163acf499c9808c5f11150a7cf Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-387909269 Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1f305d163acf499c9808c5f11150a7cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1f305d163acf499c9808c5f11150a7cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1f305d163acf499c9808c5f11150a7cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1f305d163acf499c9808c5f11150a7cf", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-387909269 Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 1f305d163acf499c9808c5f11150a7cf Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-387909269 Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersWithSpecificFlavorTestJSON-387909269-project Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 42f7c0fdad9346c58949928300021b07 Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-387909269-project Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 could not be found. Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7'} Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 could not be found. Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:54:46.078070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:54:46.083300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 could not be found. Sep 17 20:54:46.083300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:46.083300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:46.083300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:46.083300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:46.083300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:54:46.083300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:54:46.083300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:54:46.083300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:54:46.083300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 could not be found. Sep 17 20:54:46.083300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:54:46.083300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fbbccfe1-1986-4570-81c1-945f9a2906ef tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Returning 404 to user: Instance 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:54:46.083300 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fbbccfe1-1986-4570-81c1-945f9a2906ef tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7" status: 404 len: 111 microversion: 2.1 time: 0.038817 Sep 17 20:54:46.083300 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 537/1024] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:54:46 2022] DELETE /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:54:46.088603 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-53180819-dffc-4ba0-a370-5eff8acec6a3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:46.089203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-53180819-dffc-4ba0-a370-5eff8acec6a3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:46.095983 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53180819-dffc-4ba0-a370-5eff8acec6a3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:46.096439 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53180819-dffc-4ba0-a370-5eff8acec6a3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:46.096996 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53180819-dffc-4ba0-a370-5eff8acec6a3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:46.097942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53180819-dffc-4ba0-a370-5eff8acec6a3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:46.098614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53180819-dffc-4ba0-a370-5eff8acec6a3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:46.099044 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53180819-dffc-4ba0-a370-5eff8acec6a3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:46.206835 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-86a729aa-9650-46c5-9b70-f6b7c0742865 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] HTTP exception thrown: Floating IP 172.35.7.99 is not associated with instance 59beeb15-b8ee-49e8-b739-f38a755dc102. Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-86a729aa-9650-46c5-9b70-f6b7c0742865 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Request method failure captured: Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102/action HTTP/1.1 Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 48 Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjPdtRu2iYptkTPd_MttBInDvZ232C4UYTgRRk7p73wF24SJC9a_uyjbBDxC8PGK6VtaICTpDWpKUHaBQrqeF21sLQpSabwTsxZi5tuSn0UYbf1WXUZP94metBT0x0P8-itukHhcfK1Pe9eM_o7WuV-s29r_1ZxnCxDB3hpogM1wsbA Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 6b843f5d09c94cf3916f65e815d6d7a1 Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1435988706 Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6b843f5d09c94cf3916f65e815d6d7a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6b843f5d09c94cf3916f65e815d6d7a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6b843f5d09c94cf3916f65e815d6d7a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6b843f5d09c94cf3916f65e815d6d7a1", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1435988706 Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 6b843f5d09c94cf3916f65e815d6d7a1 Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1435988706 Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-FloatingIPsAssociationTestJSON-1435988706-project Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: aaa9e5c7b7dd4a74935de34327145697 Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1435988706-project Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: {"removeFloatingIp": {"address": "172.35.7.99"}} Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: exception: Floating IP 172.35.7.99 is not associated with instance 59beeb15-b8ee-49e8-b739-f38a755dc102. Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '59beeb15-b8ee-49e8-b739-f38a755dc102', 'body': {'removeFloatingIp': {'address': '172.35.7.99'}}} Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.7.99 is not associated with instance 59beeb15-b8ee-49e8-b739-f38a755dc102. Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.7.99 is not associated with instance 59beeb15-b8ee-49e8-b739-f38a755dc102. Sep 17 20:54:46.208238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:46.229410 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-86a729aa-9650-46c5-9b70-f6b7c0742865 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Returning 409 to user: Floating IP 172.35.7.99 is not associated with instance 59beeb15-b8ee-49e8-b739-f38a755dc102. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:54:46.236315 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-86a729aa-9650-46c5-9b70-f6b7c0742865 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "POST /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102/action" status: 409 len: 145 microversion: 2.1 time: 0.745447 Sep 17 20:54:46.253031 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 488/1025] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:54:45 2022] POST /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102/action => generated 145 bytes in 760 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 17 20:54:46.258028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-44019273-9ef5-4600-9af6-3bb514c11bc1 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:46.258652 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-44019273-9ef5-4600-9af6-3bb514c11bc1 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] [instance: 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:46.266095 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44019273-9ef5-4600-9af6-3bb514c11bc1 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:46.268246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44019273-9ef5-4600-9af6-3bb514c11bc1 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:46.268246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44019273-9ef5-4600-9af6-3bb514c11bc1 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:46.268246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44019273-9ef5-4600-9af6-3bb514c11bc1 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:46.268582 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44019273-9ef5-4600-9af6-3bb514c11bc1 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:46.268769 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44019273-9ef5-4600-9af6-3bb514c11bc1 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:46.313206 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-44019273-9ef5-4600-9af6-3bb514c11bc1 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] HTTP exception thrown: Instance 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 could not be found. Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-44019273-9ef5-4600-9af6-3bb514c11bc1 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Request method failure captured: Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 HTTP/1.1 Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjNtTfMY0G5lQs_dyrUUd3uhf4fkQ3zAp8Me0jeaAiBro3HrrjlPk268iZKuzOLTN5xAJijPUZAtWoKLG1JownXbmLXTWOo2qR82Cu6KknLHG1OzyZsrBhYeLNP8tdMuR4onga0PVA4wmKh8cK4cEHnZBxYpO6qDZRvyIkkGiNViI6A Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 1f305d163acf499c9808c5f11150a7cf Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-387909269 Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1f305d163acf499c9808c5f11150a7cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1f305d163acf499c9808c5f11150a7cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1f305d163acf499c9808c5f11150a7cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1f305d163acf499c9808c5f11150a7cf", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-387909269 Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 1f305d163acf499c9808c5f11150a7cf Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-387909269 Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersWithSpecificFlavorTestJSON-387909269-project Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 42f7c0fdad9346c58949928300021b07 Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-387909269-project Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 could not be found. Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7'} Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 could not be found. Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 could not be found. Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:46.314817 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:54:46.320325 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:46.320325 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:54:46.320325 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:54:46.320325 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:54:46.320325 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:54:46.320325 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:54:46.320325 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 could not be found. Sep 17 20:54:46.320325 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:54:46.322301 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-44019273-9ef5-4600-9af6-3bb514c11bc1 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] Returning 404 to user: Instance 4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:54:46.323203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-53180819-dffc-4ba0-a370-5eff8acec6a3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:46.323775 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-44019273-9ef5-4600-9af6-3bb514c11bc1 tempest-ServersWithSpecificFlavorTestJSON-387909269 tempest-ServersWithSpecificFlavorTestJSON-387909269-project] 10.222.0.26 "GET /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7" status: 404 len: 111 microversion: 2.1 time: 0.070918 Sep 17 20:54:46.324829 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 489/1026] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:46 2022] GET /compute/v2.1/servers/4b8a6b1e-41ba-4de4-bbc5-f044ccd923f7 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:54:46.331840 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-33b76d5f-16c6-4c59-ba77-18f5f759eec8 req-bb097fd4-c83e-4cc0-a453-41d84c6d9d14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "143322a7-9d8b-43c3-b3a5-4000c26b6cc7", "tag": "6f8f4ce9-626f-432d-8d38-108942adfb39"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:46.338116 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-53180819-dffc-4ba0-a370-5eff8acec6a3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1476 microversion: 2.1 time: 0.253595 Sep 17 20:54:46.338897 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 538/1027] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:46 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1476 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:46.345700 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-06473f8b-eedd-4e07-81c0-158ac04632dd tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.7.99"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:46.345857 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-33b76d5f-16c6-4c59-ba77-18f5f759eec8 req-bb097fd4-c83e-4cc0-a453-41d84c6d9d14 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:46.346413 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-33b76d5f-16c6-4c59-ba77-18f5f759eec8 req-bb097fd4-c83e-4cc0-a453-41d84c6d9d14 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:46.346841 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-33b76d5f-16c6-4c59-ba77-18f5f759eec8 req-bb097fd4-c83e-4cc0-a453-41d84c6d9d14 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:46.359621 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-33b76d5f-16c6-4c59-ba77-18f5f759eec8 req-bb097fd4-c83e-4cc0-a453-41d84c6d9d14 service nova] Creating event network-changed:6f8f4ce9-626f-432d-8d38-108942adfb39 for instance 143322a7-9d8b-43c3-b3a5-4000c26b6cc7 on nch2-master-1 Sep 17 20:54:46.371052 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-33b76d5f-16c6-4c59-ba77-18f5f759eec8 req-bb097fd4-c83e-4cc0-a453-41d84c6d9d14 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044756 Sep 17 20:54:46.372629 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 490/1028] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:54:46.600310 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-06473f8b-eedd-4e07-81c0-158ac04632dd tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 143322a7-9d8b-43c3-b3a5-4000c26b6cc7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:46.608430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06473f8b-eedd-4e07-81c0-158ac04632dd tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:46.609275 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06473f8b-eedd-4e07-81c0-158ac04632dd tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:46.610004 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06473f8b-eedd-4e07-81c0-158ac04632dd tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:46.610912 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06473f8b-eedd-4e07-81c0-158ac04632dd tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:46.611476 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06473f8b-eedd-4e07-81c0-158ac04632dd tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:46.612126 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06473f8b-eedd-4e07-81c0-158ac04632dd tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:46.657502 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-620cbbe0-28c6-4fd5-af79-2dd8bcb8a070 req-ef0e22b5-d89f-41ab-99cd-7a1ca6d0610f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b3f5764-d941-4ddb-80fc-3e7b6409f7d9", "tag": "da68fd65-992d-49fa-b979-c348cd631ce3"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:46.684999 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-620cbbe0-28c6-4fd5-af79-2dd8bcb8a070 req-ef0e22b5-d89f-41ab-99cd-7a1ca6d0610f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:46.685825 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-620cbbe0-28c6-4fd5-af79-2dd8bcb8a070 req-ef0e22b5-d89f-41ab-99cd-7a1ca6d0610f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:46.686420 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-620cbbe0-28c6-4fd5-af79-2dd8bcb8a070 req-ef0e22b5-d89f-41ab-99cd-7a1ca6d0610f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:46.705012 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-620cbbe0-28c6-4fd5-af79-2dd8bcb8a070 req-ef0e22b5-d89f-41ab-99cd-7a1ca6d0610f service nova] Creating event network-changed:da68fd65-992d-49fa-b979-c348cd631ce3 for instance 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 on nch1-master-1 Sep 17 20:54:46.719539 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-620cbbe0-28c6-4fd5-af79-2dd8bcb8a070 req-ef0e22b5-d89f-41ab-99cd-7a1ca6d0610f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068137 Sep 17 20:54:46.729895 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 491/1029] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:54:46.736170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b484f1f4-83e0-4e22-a4d1-6a3c38fa1c3a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:46.736811 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b484f1f4-83e0-4e22-a4d1-6a3c38fa1c3a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:46.749104 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b484f1f4-83e0-4e22-a4d1-6a3c38fa1c3a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:46.752022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b484f1f4-83e0-4e22-a4d1-6a3c38fa1c3a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:46.754641 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b484f1f4-83e0-4e22-a4d1-6a3c38fa1c3a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:46.755627 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b484f1f4-83e0-4e22-a4d1-6a3c38fa1c3a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:46.756263 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b484f1f4-83e0-4e22-a4d1-6a3c38fa1c3a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:46.758165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b484f1f4-83e0-4e22-a4d1-6a3c38fa1c3a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:47.035868 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06473f8b-eedd-4e07-81c0-158ac04632dd tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "refresh_cache-143322a7-9d8b-43c3-b3a5-4000c26b6cc7" {{(pid=140524) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 17 20:54:47.036444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06473f8b-eedd-4e07-81c0-158ac04632dd tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquired lock "refresh_cache-143322a7-9d8b-43c3-b3a5-4000c26b6cc7" {{(pid=140524) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 17 20:54:47.138623 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b484f1f4-83e0-4e22-a4d1-6a3c38fa1c3a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:47.147852 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b484f1f4-83e0-4e22-a4d1-6a3c38fa1c3a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9" status: 200 len: 1504 microversion: 2.1 time: 0.416454 Sep 17 20:54:47.159136 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 492/1030] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:46 2022] GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 => generated 1504 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:47.169505 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-75a7185e-b57f-4a4c-9cda-40a038db8464 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:47.170107 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-75a7185e-b57f-4a4c-9cda-40a038db8464 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:47.181141 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75a7185e-b57f-4a4c-9cda-40a038db8464 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:47.181744 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75a7185e-b57f-4a4c-9cda-40a038db8464 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:47.182102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75a7185e-b57f-4a4c-9cda-40a038db8464 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:47.183020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75a7185e-b57f-4a4c-9cda-40a038db8464 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:47.183642 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75a7185e-b57f-4a4c-9cda-40a038db8464 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:47.184229 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75a7185e-b57f-4a4c-9cda-40a038db8464 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:47.457956 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-75a7185e-b57f-4a4c-9cda-40a038db8464 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:47.474256 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-75a7185e-b57f-4a4c-9cda-40a038db8464 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1513 microversion: 2.1 time: 0.312472 Sep 17 20:54:47.476798 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 493/1031] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:47 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1513 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:47.488964 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c637e3ea-959a-4675-ad7a-fd4024e607d0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:47.489637 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c637e3ea-959a-4675-ad7a-fd4024e607d0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:47.503428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c637e3ea-959a-4675-ad7a-fd4024e607d0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:47.503935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c637e3ea-959a-4675-ad7a-fd4024e607d0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:47.504391 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c637e3ea-959a-4675-ad7a-fd4024e607d0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:47.510017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c637e3ea-959a-4675-ad7a-fd4024e607d0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:47.513027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c637e3ea-959a-4675-ad7a-fd4024e607d0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:47.513557 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c637e3ea-959a-4675-ad7a-fd4024e607d0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:47.807145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:54:47.819475 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c637e3ea-959a-4675-ad7a-fd4024e607d0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:47.877030 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c637e3ea-959a-4675-ad7a-fd4024e607d0 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1476 microversion: 2.1 time: 0.398668 Sep 17 20:54:47.878163 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 494/1032] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:47 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1476 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:48.113914 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-06473f8b-eedd-4e07-81c0-158ac04632dd tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 143322a7-9d8b-43c3-b3a5-4000c26b6cc7] Building network info cache for instance {{(pid=140524) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 17 20:54:48.181774 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-37e2439c-34b6-4768-bcee-af3c71ddf56b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:48.182753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-37e2439c-34b6-4768-bcee-af3c71ddf56b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:48.193731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-37e2439c-34b6-4768-bcee-af3c71ddf56b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:48.194625 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-37e2439c-34b6-4768-bcee-af3c71ddf56b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:48.195276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-37e2439c-34b6-4768-bcee-af3c71ddf56b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:48.196180 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-37e2439c-34b6-4768-bcee-af3c71ddf56b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:48.196820 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-37e2439c-34b6-4768-bcee-af3c71ddf56b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:48.197451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-37e2439c-34b6-4768-bcee-af3c71ddf56b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:48.962619 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-37e2439c-34b6-4768-bcee-af3c71ddf56b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:48.974366 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-37e2439c-34b6-4768-bcee-af3c71ddf56b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9" status: 200 len: 1504 microversion: 2.1 time: 0.796693 Sep 17 20:54:48.991703 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 495/1033] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:48 2022] GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 => generated 1504 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:54:48.997084 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-df3dcc89-458a-4759-9022-5942b0f53d0b req-10d2b748-fa99-4146-a157-2e65fae47ede service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "143322a7-9d8b-43c3-b3a5-4000c26b6cc7", "tag": "6f8f4ce9-626f-432d-8d38-108942adfb39"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:49.022705 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-df3dcc89-458a-4759-9022-5942b0f53d0b req-10d2b748-fa99-4146-a157-2e65fae47ede service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:49.023315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-df3dcc89-458a-4759-9022-5942b0f53d0b req-10d2b748-fa99-4146-a157-2e65fae47ede service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:49.024186 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-df3dcc89-458a-4759-9022-5942b0f53d0b req-10d2b748-fa99-4146-a157-2e65fae47ede service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:49.047138 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-df3dcc89-458a-4759-9022-5942b0f53d0b req-10d2b748-fa99-4146-a157-2e65fae47ede service nova] Creating event network-changed:6f8f4ce9-626f-432d-8d38-108942adfb39 for instance 143322a7-9d8b-43c3-b3a5-4000c26b6cc7 on nch2-master-1 Sep 17 20:54:49.054324 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-df3dcc89-458a-4759-9022-5942b0f53d0b req-10d2b748-fa99-4146-a157-2e65fae47ede service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060914 Sep 17 20:54:49.058301 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 496/1034] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:54:49.064405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-09beca0c-8a96-47d3-b0b6-7c155f8b1725 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:49.065198 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-09beca0c-8a96-47d3-b0b6-7c155f8b1725 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:49.072013 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09beca0c-8a96-47d3-b0b6-7c155f8b1725 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:49.072727 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09beca0c-8a96-47d3-b0b6-7c155f8b1725 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:49.073766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09beca0c-8a96-47d3-b0b6-7c155f8b1725 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:49.074230 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09beca0c-8a96-47d3-b0b6-7c155f8b1725 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:49.074782 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09beca0c-8a96-47d3-b0b6-7c155f8b1725 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:49.075891 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09beca0c-8a96-47d3-b0b6-7c155f8b1725 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:49.325604 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-09beca0c-8a96-47d3-b0b6-7c155f8b1725 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:49.339203 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-09beca0c-8a96-47d3-b0b6-7c155f8b1725 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1513 microversion: 2.1 time: 0.279473 Sep 17 20:54:49.340009 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 497/1035] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:49 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1513 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:49.364845 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-06473f8b-eedd-4e07-81c0-158ac04632dd tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 143322a7-9d8b-43c3-b3a5-4000c26b6cc7] Updating instance_info_cache with network_info: [{"id": "6f8f4ce9-626f-432d-8d38-108942adfb39", "address": "fa:16:3e:81:bd:b4", "network": {"id": "3c590c43-fcd5-41d9-9c4b-71b8980abfc0", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-261373508-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6b843f5d09c94cf3916f65e815d6d7a1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6f8f4ce9-62", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140524) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 17 20:54:49.377109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8d4f2cd6-cb1b-4e6c-86dc-d00da5815b67 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:49.378233 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8d4f2cd6-cb1b-4e6c-86dc-d00da5815b67 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:49.388477 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06473f8b-eedd-4e07-81c0-158ac04632dd tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Releasing lock "refresh_cache-143322a7-9d8b-43c3-b3a5-4000c26b6cc7" {{(pid=140524) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 17 20:54:49.389804 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-06473f8b-eedd-4e07-81c0-158ac04632dd tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "POST /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7/action" status: 202 len: 0 microversion: 2.1 time: 3.049372 Sep 17 20:54:49.390631 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 539/1036] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:54:46 2022] POST /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7/action => generated 0 bytes in 3051 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 17 20:54:49.391898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8d4f2cd6-cb1b-4e6c-86dc-d00da5815b67 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:49.392499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8d4f2cd6-cb1b-4e6c-86dc-d00da5815b67 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:49.393009 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8d4f2cd6-cb1b-4e6c-86dc-d00da5815b67 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:49.398758 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-02bacc06-df25-423e-955b-2524f827d2bf tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:49.399712 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-02bacc06-df25-423e-955b-2524f827d2bf tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 143322a7-9d8b-43c3-b3a5-4000c26b6cc7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:49.403114 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8d4f2cd6-cb1b-4e6c-86dc-d00da5815b67 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:49.403730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8d4f2cd6-cb1b-4e6c-86dc-d00da5815b67 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:49.404431 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8d4f2cd6-cb1b-4e6c-86dc-d00da5815b67 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:49.412118 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02bacc06-df25-423e-955b-2524f827d2bf tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:49.412600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02bacc06-df25-423e-955b-2524f827d2bf tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:49.413152 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02bacc06-df25-423e-955b-2524f827d2bf tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:49.413866 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02bacc06-df25-423e-955b-2524f827d2bf tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:49.414312 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02bacc06-df25-423e-955b-2524f827d2bf tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:49.414963 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02bacc06-df25-423e-955b-2524f827d2bf tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:49.436798 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:54:49.450317 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-02bacc06-df25-423e-955b-2524f827d2bf tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 143322a7-9d8b-43c3-b3a5-4000c26b6cc7] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:54:49.583345 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-02bacc06-df25-423e-955b-2524f827d2bf tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "DELETE /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7" status: 204 len: 0 microversion: 2.1 time: 0.187589 Sep 17 20:54:49.592003 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 540/1037] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:54:49 2022] DELETE /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:54:49.599804 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8013ea02-0bea-4a2b-98dd-bbdeb9425d28 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.7.99"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:49.604111 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8013ea02-0bea-4a2b-98dd-bbdeb9425d28 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 59beeb15-b8ee-49e8-b739-f38a755dc102] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:49.613687 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8013ea02-0bea-4a2b-98dd-bbdeb9425d28 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:49.614896 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8013ea02-0bea-4a2b-98dd-bbdeb9425d28 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:49.615636 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8013ea02-0bea-4a2b-98dd-bbdeb9425d28 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:49.616711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8013ea02-0bea-4a2b-98dd-bbdeb9425d28 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:49.617404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8013ea02-0bea-4a2b-98dd-bbdeb9425d28 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:49.618142 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8013ea02-0bea-4a2b-98dd-bbdeb9425d28 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:49.646942 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8d4f2cd6-cb1b-4e6c-86dc-d00da5815b67 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:49.664263 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8013ea02-0bea-4a2b-98dd-bbdeb9425d28 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "refresh_cache-59beeb15-b8ee-49e8-b739-f38a755dc102" {{(pid=140524) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 17 20:54:49.664770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8013ea02-0bea-4a2b-98dd-bbdeb9425d28 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquired lock "refresh_cache-59beeb15-b8ee-49e8-b739-f38a755dc102" {{(pid=140524) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 17 20:54:49.667626 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8d4f2cd6-cb1b-4e6c-86dc-d00da5815b67 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1476 microversion: 2.1 time: 0.306955 Sep 17 20:54:49.669925 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 498/1038] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:49 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1476 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:50.004695 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-39b8b1eb-c124-48d9-9f0c-f7618024d59c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:50.007391 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-39b8b1eb-c124-48d9-9f0c-f7618024d59c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:50.018954 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-39b8b1eb-c124-48d9-9f0c-f7618024d59c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:50.019522 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-39b8b1eb-c124-48d9-9f0c-f7618024d59c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:50.020172 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-39b8b1eb-c124-48d9-9f0c-f7618024d59c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:50.020932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-39b8b1eb-c124-48d9-9f0c-f7618024d59c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:50.021390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-39b8b1eb-c124-48d9-9f0c-f7618024d59c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:50.021984 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-39b8b1eb-c124-48d9-9f0c-f7618024d59c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:50.348127 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-39b8b1eb-c124-48d9-9f0c-f7618024d59c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:50.375832 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-39b8b1eb-c124-48d9-9f0c-f7618024d59c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9" status: 200 len: 1504 microversion: 2.1 time: 0.367889 Sep 17 20:54:50.382878 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 499/1039] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:49 2022] GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 => generated 1504 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:50.389338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-82a8a91b-557f-484f-8711-ff7a812c497c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:50.390619 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-82a8a91b-557f-484f-8711-ff7a812c497c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:50.397545 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82a8a91b-557f-484f-8711-ff7a812c497c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:50.398441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82a8a91b-557f-484f-8711-ff7a812c497c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:50.399445 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82a8a91b-557f-484f-8711-ff7a812c497c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:50.400322 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82a8a91b-557f-484f-8711-ff7a812c497c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:50.401026 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82a8a91b-557f-484f-8711-ff7a812c497c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:50.401730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82a8a91b-557f-484f-8711-ff7a812c497c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:50.609568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-82a8a91b-557f-484f-8711-ff7a812c497c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:50.619799 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-82a8a91b-557f-484f-8711-ff7a812c497c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1513 microversion: 2.1 time: 0.235651 Sep 17 20:54:50.621151 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 500/1040] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:50 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1513 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:50.701812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c72a7eb8-a5da-4bf6-9a97-98dba6255ac8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:50.702878 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c72a7eb8-a5da-4bf6-9a97-98dba6255ac8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:50.712735 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c72a7eb8-a5da-4bf6-9a97-98dba6255ac8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:50.713248 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c72a7eb8-a5da-4bf6-9a97-98dba6255ac8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:50.713811 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c72a7eb8-a5da-4bf6-9a97-98dba6255ac8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:50.714576 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c72a7eb8-a5da-4bf6-9a97-98dba6255ac8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:50.715037 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c72a7eb8-a5da-4bf6-9a97-98dba6255ac8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:50.715466 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c72a7eb8-a5da-4bf6-9a97-98dba6255ac8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:50.891214 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c72a7eb8-a5da-4bf6-9a97-98dba6255ac8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:50.903929 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c72a7eb8-a5da-4bf6-9a97-98dba6255ac8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1476 microversion: 2.1 time: 0.206874 Sep 17 20:54:50.904807 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 501/1041] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:50 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1476 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:51.394436 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-35debc7c-d0ec-417d-a45e-98ec9bef0d4d tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:51.395147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-35debc7c-d0ec-417d-a45e-98ec9bef0d4d tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:51.407291 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35debc7c-d0ec-417d-a45e-98ec9bef0d4d tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:51.408219 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35debc7c-d0ec-417d-a45e-98ec9bef0d4d tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:51.408929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35debc7c-d0ec-417d-a45e-98ec9bef0d4d tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:51.410307 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35debc7c-d0ec-417d-a45e-98ec9bef0d4d tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:51.410928 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35debc7c-d0ec-417d-a45e-98ec9bef0d4d tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:51.411608 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35debc7c-d0ec-417d-a45e-98ec9bef0d4d tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:51.826719 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-35debc7c-d0ec-417d-a45e-98ec9bef0d4d tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:51.843993 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-35debc7c-d0ec-417d-a45e-98ec9bef0d4d tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9" status: 200 len: 1504 microversion: 2.1 time: 0.456668 Sep 17 20:54:51.845950 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 502/1042] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:51 2022] GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 => generated 1504 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:51.853248 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9ae57ef6-d9f8-41d3-8dbb-01ec27ae3818 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:51.854171 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9ae57ef6-d9f8-41d3-8dbb-01ec27ae3818 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:51.887662 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9ae57ef6-d9f8-41d3-8dbb-01ec27ae3818 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:51.888879 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9ae57ef6-d9f8-41d3-8dbb-01ec27ae3818 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:51.891421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9ae57ef6-d9f8-41d3-8dbb-01ec27ae3818 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:51.893210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9ae57ef6-d9f8-41d3-8dbb-01ec27ae3818 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:51.894550 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9ae57ef6-d9f8-41d3-8dbb-01ec27ae3818 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:51.895241 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9ae57ef6-d9f8-41d3-8dbb-01ec27ae3818 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:52.228548 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9ae57ef6-d9f8-41d3-8dbb-01ec27ae3818 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:52.242988 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9ae57ef6-d9f8-41d3-8dbb-01ec27ae3818 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1513 microversion: 2.1 time: 0.394316 Sep 17 20:54:52.254924 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 503/1043] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:51 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1513 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:52.254924 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-379bc770-0116-4a02-9649-84d23423018b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:52.262213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-379bc770-0116-4a02-9649-84d23423018b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:52.290802 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-379bc770-0116-4a02-9649-84d23423018b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:52.292638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-379bc770-0116-4a02-9649-84d23423018b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:52.293415 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-379bc770-0116-4a02-9649-84d23423018b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:52.294520 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-379bc770-0116-4a02-9649-84d23423018b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:52.295275 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-379bc770-0116-4a02-9649-84d23423018b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:52.296144 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-379bc770-0116-4a02-9649-84d23423018b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:53.132374 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-379bc770-0116-4a02-9649-84d23423018b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:53.184683 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-379bc770-0116-4a02-9649-84d23423018b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1476 microversion: 2.1 time: 0.934307 Sep 17 20:54:53.190147 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 504/1044] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:52 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1476 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:53.203894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bbb268a4-d54f-4efa-a4b9-ee84f7cda921 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:53.206384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bbb268a4-d54f-4efa-a4b9-ee84f7cda921 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:53.227068 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bbb268a4-d54f-4efa-a4b9-ee84f7cda921 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:53.230213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bbb268a4-d54f-4efa-a4b9-ee84f7cda921 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:53.231670 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bbb268a4-d54f-4efa-a4b9-ee84f7cda921 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:53.233742 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bbb268a4-d54f-4efa-a4b9-ee84f7cda921 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:53.235229 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bbb268a4-d54f-4efa-a4b9-ee84f7cda921 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:53.237746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bbb268a4-d54f-4efa-a4b9-ee84f7cda921 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:53.319321 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-8013ea02-0bea-4a2b-98dd-bbdeb9425d28 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 59beeb15-b8ee-49e8-b739-f38a755dc102] Building network info cache for instance {{(pid=140524) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 17 20:54:53.322976 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:54:53.939319 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bbb268a4-d54f-4efa-a4b9-ee84f7cda921 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:53.951179 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bbb268a4-d54f-4efa-a4b9-ee84f7cda921 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9" status: 200 len: 1504 microversion: 2.1 time: 0.758831 Sep 17 20:54:53.958987 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 505/1045] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:53 2022] GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 => generated 1504 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:53.976296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-1bc893ce-fb59-4654-af1f-1feeadfa9032 req-88948051-e84c-43c3-86c1-2d8a72728204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "143322a7-9d8b-43c3-b3a5-4000c26b6cc7", "name": "network-vif-deleted", "tag": "6f8f4ce9-626f-432d-8d38-108942adfb39"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:54.010645 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-1bc893ce-fb59-4654-af1f-1feeadfa9032 req-88948051-e84c-43c3-86c1-2d8a72728204 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:54.013985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-1bc893ce-fb59-4654-af1f-1feeadfa9032 req-88948051-e84c-43c3-86c1-2d8a72728204 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:54.014622 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-1bc893ce-fb59-4654-af1f-1feeadfa9032 req-88948051-e84c-43c3-86c1-2d8a72728204 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:54.052777 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-1bc893ce-fb59-4654-af1f-1feeadfa9032 req-88948051-e84c-43c3-86c1-2d8a72728204 service nova] Creating event network-vif-deleted:6f8f4ce9-626f-432d-8d38-108942adfb39 for instance 143322a7-9d8b-43c3-b3a5-4000c26b6cc7 on nch2-master-1 Sep 17 20:54:54.068668 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-1bc893ce-fb59-4654-af1f-1feeadfa9032 req-88948051-e84c-43c3-86c1-2d8a72728204 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105761 Sep 17 20:54:54.070145 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 506/1046] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:54:54.085792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e652a04b-2cf5-4696-b8bc-6b14ceb80bd1 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:54.086673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e652a04b-2cf5-4696-b8bc-6b14ceb80bd1 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:54.101044 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e652a04b-2cf5-4696-b8bc-6b14ceb80bd1 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:54.101962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e652a04b-2cf5-4696-b8bc-6b14ceb80bd1 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:54.103129 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e652a04b-2cf5-4696-b8bc-6b14ceb80bd1 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:54.106198 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e652a04b-2cf5-4696-b8bc-6b14ceb80bd1 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:54.107526 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e652a04b-2cf5-4696-b8bc-6b14ceb80bd1 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:54.109387 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e652a04b-2cf5-4696-b8bc-6b14ceb80bd1 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:54.773085 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e652a04b-2cf5-4696-b8bc-6b14ceb80bd1 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:54.796600 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e652a04b-2cf5-4696-b8bc-6b14ceb80bd1 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1513 microversion: 2.1 time: 0.723195 Sep 17 20:54:54.797609 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 507/1047] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:54 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1513 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:54.807262 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e7518f3d-3155-4b2f-bb09-56fc9d4e9ac5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:54.822361 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e7518f3d-3155-4b2f-bb09-56fc9d4e9ac5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:54.846494 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7518f3d-3155-4b2f-bb09-56fc9d4e9ac5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:54.847004 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7518f3d-3155-4b2f-bb09-56fc9d4e9ac5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:54.847643 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7518f3d-3155-4b2f-bb09-56fc9d4e9ac5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:54.849294 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7518f3d-3155-4b2f-bb09-56fc9d4e9ac5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:54.849800 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7518f3d-3155-4b2f-bb09-56fc9d4e9ac5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:54.850275 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7518f3d-3155-4b2f-bb09-56fc9d4e9ac5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:55.326193 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-8013ea02-0bea-4a2b-98dd-bbdeb9425d28 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 59beeb15-b8ee-49e8-b739-f38a755dc102] Updating instance_info_cache with network_info: [{"id": "eadc612b-7bf9-4d2b-b813-686741311705", "address": "fa:16:3e:ae:bb:2c", "network": {"id": "3c590c43-fcd5-41d9-9c4b-71b8980abfc0", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-261373508-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.7.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6b843f5d09c94cf3916f65e815d6d7a1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapeadc612b-7b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140524) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 17 20:54:55.343252 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8013ea02-0bea-4a2b-98dd-bbdeb9425d28 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Releasing lock "refresh_cache-59beeb15-b8ee-49e8-b739-f38a755dc102" {{(pid=140524) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 17 20:54:55.344830 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8013ea02-0bea-4a2b-98dd-bbdeb9425d28 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "POST /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102/action" status: 202 len: 0 microversion: 2.1 time: 5.750289 Sep 17 20:54:55.349146 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 541/1048] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:54:49 2022] POST /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102/action => generated 0 bytes in 5756 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 17 20:54:55.355258 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b3a5dc7c-c0da-4654-8683-d13e07c3cd5f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:55.356148 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b3a5dc7c-c0da-4654-8683-d13e07c3cd5f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:55.363613 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3a5dc7c-c0da-4654-8683-d13e07c3cd5f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:55.365743 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3a5dc7c-c0da-4654-8683-d13e07c3cd5f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:55.366529 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3a5dc7c-c0da-4654-8683-d13e07c3cd5f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:55.367639 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3a5dc7c-c0da-4654-8683-d13e07c3cd5f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:55.368341 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3a5dc7c-c0da-4654-8683-d13e07c3cd5f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:55.368989 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3a5dc7c-c0da-4654-8683-d13e07c3cd5f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:55.388423 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e7518f3d-3155-4b2f-bb09-56fc9d4e9ac5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:55.404850 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e7518f3d-3155-4b2f-bb09-56fc9d4e9ac5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1476 microversion: 2.1 time: 0.602921 Sep 17 20:54:55.407997 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 508/1049] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:54 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1476 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:55.432165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5e471c6a-25c7-4f73-8728-39445d49e6a4 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '.version_select at 0x7f25a9ff90d0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:55.781563 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b3a5dc7c-c0da-4654-8683-d13e07c3cd5f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:55.793574 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b3a5dc7c-c0da-4654-8683-d13e07c3cd5f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9" status: 200 len: 1479 microversion: 2.1 time: 0.442768 Sep 17 20:54:55.795075 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 542/1050] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:55 2022] GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 => generated 1479 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:55.822452 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b72e41e2-43f8-49c4-9131-69741b084eab tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Calling method '.version_select at 0x7f25a5590ca0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:55.831689 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b72e41e2-43f8-49c4-9131-69741b084eab tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:55.832768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b72e41e2-43f8-49c4-9131-69741b084eab tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:55.836493 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b72e41e2-43f8-49c4-9131-69741b084eab tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:55.860384 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b72e41e2-43f8-49c4-9131-69741b084eab tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 3121 microversion: 2.1 time: 0.044451 Sep 17 20:54:55.861705 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 543/1051] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Sep 17 20:54:55 2022] GET /compute/v2.1/os-migrations => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:55.868254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-50d5594b-f324-4862-874e-922d7b9bd42d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:55.869392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-50d5594b-f324-4862-874e-922d7b9bd42d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:55.879853 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50d5594b-f324-4862-874e-922d7b9bd42d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:55.882719 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50d5594b-f324-4862-874e-922d7b9bd42d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:55.883211 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50d5594b-f324-4862-874e-922d7b9bd42d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:55.884293 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50d5594b-f324-4862-874e-922d7b9bd42d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:55.885080 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50d5594b-f324-4862-874e-922d7b9bd42d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:55.898066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50d5594b-f324-4862-874e-922d7b9bd42d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:56.090218 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5e471c6a-25c7-4f73-8728-39445d49e6a4 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips/fc407ad3-6297-4610-9586-83ccada8858e" status: 200 len: 184 microversion: 2.1 time: 0.663625 Sep 17 20:54:56.091439 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 509/1052] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Sep 17 20:54:55 2022] GET /compute/v2.1/os-floating-ips/fc407ad3-6297-4610-9586-83ccada8858e => generated 184 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:54:56.096504 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-228619cf-ccf9-4022-ad18-88149ba209d8 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:56.097174 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-228619cf-ccf9-4022-ad18-88149ba209d8 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:56.113234 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-228619cf-ccf9-4022-ad18-88149ba209d8 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:56.113696 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-228619cf-ccf9-4022-ad18-88149ba209d8 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:56.114344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-228619cf-ccf9-4022-ad18-88149ba209d8 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:56.115327 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-228619cf-ccf9-4022-ad18-88149ba209d8 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:56.116322 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-228619cf-ccf9-4022-ad18-88149ba209d8 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:56.117097 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-228619cf-ccf9-4022-ad18-88149ba209d8 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:56.926085 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-50d5594b-f324-4862-874e-922d7b9bd42d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:56.939823 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-50d5594b-f324-4862-874e-922d7b9bd42d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1513 microversion: 2.1 time: 1.076742 Sep 17 20:54:56.940424 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 544/1053] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:55 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1513 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:56.957909 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-02845c6b-8dfd-4b54-9fd8-76c6294cf0ec tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.7.99"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:57.255007 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-228619cf-ccf9-4022-ad18-88149ba209d8 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9" status: 200 len: 1630 microversion: 2.1 time: 1.161858 Sep 17 20:54:57.256033 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 510/1054] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:56 2022] GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 => generated 1630 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:57.266536 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-33645a18-bd8a-4e12-af73-ad77e672cbfc req-2d2abcac-7c49-4623-8e93-55b16ed8e2c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59beeb15-b8ee-49e8-b739-f38a755dc102", "tag": "eadc612b-7bf9-4d2b-b813-686741311705"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:57.277618 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-33645a18-bd8a-4e12-af73-ad77e672cbfc req-2d2abcac-7c49-4623-8e93-55b16ed8e2c1 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:57.278461 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-33645a18-bd8a-4e12-af73-ad77e672cbfc req-2d2abcac-7c49-4623-8e93-55b16ed8e2c1 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:57.279145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-33645a18-bd8a-4e12-af73-ad77e672cbfc req-2d2abcac-7c49-4623-8e93-55b16ed8e2c1 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:57.299458 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-33645a18-bd8a-4e12-af73-ad77e672cbfc req-2d2abcac-7c49-4623-8e93-55b16ed8e2c1 service nova] Creating event network-changed:eadc612b-7bf9-4d2b-b813-686741311705 for instance 59beeb15-b8ee-49e8-b739-f38a755dc102 on nch1-master-1 Sep 17 20:54:57.306227 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-33645a18-bd8a-4e12-af73-ad77e672cbfc req-2d2abcac-7c49-4623-8e93-55b16ed8e2c1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048249 Sep 17 20:54:57.307528 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 511/1055] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:54:57.322663 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5e092083-ae99-411a-b2ea-bcc50ab7d58a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:57.328969 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5e092083-ae99-411a-b2ea-bcc50ab7d58a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:57.337492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:54:57.340991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-02845c6b-8dfd-4b54-9fd8-76c6294cf0ec tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 59beeb15-b8ee-49e8-b739-f38a755dc102] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:57.343080 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e092083-ae99-411a-b2ea-bcc50ab7d58a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:57.343615 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e092083-ae99-411a-b2ea-bcc50ab7d58a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:57.344595 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e092083-ae99-411a-b2ea-bcc50ab7d58a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:57.345343 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e092083-ae99-411a-b2ea-bcc50ab7d58a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:57.346935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e092083-ae99-411a-b2ea-bcc50ab7d58a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:57.347486 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e092083-ae99-411a-b2ea-bcc50ab7d58a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:57.351098 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02845c6b-8dfd-4b54-9fd8-76c6294cf0ec tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:57.351891 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02845c6b-8dfd-4b54-9fd8-76c6294cf0ec tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:57.352510 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02845c6b-8dfd-4b54-9fd8-76c6294cf0ec tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:57.353338 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02845c6b-8dfd-4b54-9fd8-76c6294cf0ec tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:57.354020 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02845c6b-8dfd-4b54-9fd8-76c6294cf0ec tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:57.354719 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02845c6b-8dfd-4b54-9fd8-76c6294cf0ec tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:57.931292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5e092083-ae99-411a-b2ea-bcc50ab7d58a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:57.940293 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5e092083-ae99-411a-b2ea-bcc50ab7d58a tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1475 microversion: 2.1 time: 0.630550 Sep 17 20:54:57.941022 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 512/1056] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:57 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1475 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:57.949180 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-c4e42d73-3093-4f00-abc0-10a8c03a4cb9 req-94c28924-f215-442e-8d1c-91fa42e4ca6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "560c9626-f97e-4bc8-a2a9-942ddb969ccc", "name": "network-vif-unplugged", "status": "completed", "tag": "41a6b4dc-39d8-4713-bf4d-91efa6a5c055"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:57.966661 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-c4e42d73-3093-4f00-abc0-10a8c03a4cb9 req-94c28924-f215-442e-8d1c-91fa42e4ca6f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:57.967151 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-c4e42d73-3093-4f00-abc0-10a8c03a4cb9 req-94c28924-f215-442e-8d1c-91fa42e4ca6f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:57.967625 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-c4e42d73-3093-4f00-abc0-10a8c03a4cb9 req-94c28924-f215-442e-8d1c-91fa42e4ca6f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:57.970844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02845c6b-8dfd-4b54-9fd8-76c6294cf0ec tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "refresh_cache-59beeb15-b8ee-49e8-b739-f38a755dc102" {{(pid=140524) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 17 20:54:57.971334 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02845c6b-8dfd-4b54-9fd8-76c6294cf0ec tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquired lock "refresh_cache-59beeb15-b8ee-49e8-b739-f38a755dc102" {{(pid=140524) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 17 20:54:57.996871 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-c4e42d73-3093-4f00-abc0-10a8c03a4cb9 req-94c28924-f215-442e-8d1c-91fa42e4ca6f service nova] Creating event network-vif-unplugged:41a6b4dc-39d8-4713-bf4d-91efa6a5c055 for instance 560c9626-f97e-4bc8-a2a9-942ddb969ccc on nch2-master-1 Sep 17 20:54:58.006038 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [req-c4e42d73-3093-4f00-abc0-10a8c03a4cb9 req-94c28924-f215-442e-8d1c-91fa42e4ca6f service nova] Instance 560c9626-f97e-4bc8-a2a9-942ddb969ccc is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140523) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 20:54:58.025729 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-c4e42d73-3093-4f00-abc0-10a8c03a4cb9 req-94c28924-f215-442e-8d1c-91fa42e4ca6f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082199 Sep 17 20:54:58.026776 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 513/1057] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:54:58.036006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b832a335-9452-43a6-84a3-a31f5c56309e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Action: 'create', calling method: .version_select at 0x7f25a9fc1ee0>, body: {"keypair": {"name": "tempest-keypair-1548807653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpTOfar/3Tkcmjy0JsNoa9y2ufqS3VtnWlVXEeWo8+O72E8zC8fvFmmKwpqXsie4CzIUs1hR6X8mkU6AiN+Xwz9ztCdiFYLRv9rw1AFxOgGcjBRVAt53j69kYCVUaDcOw=="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:54:58.054994 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-b832a335-9452-43a6-84a3-a31f5c56309e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Getting quotas for project f6b44bc44e7c4a998bfd99e7d11e99fc. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:54:58.060083 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-b832a335-9452-43a6-84a3-a31f5c56309e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Getting quotas for user 9c2b746b7c194596808a7b0c736f3b53 and project f6b44bc44e7c4a998bfd99e7d11e99fc. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:54:58.100300 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b832a335-9452-43a6-84a3-a31f5c56309e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.071788 Sep 17 20:54:58.101122 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 514/1058] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 20:54:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:54:58.106562 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-571bbd92-e01d-4df4-a473-6fece1d01d53 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:58.107562 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-571bbd92-e01d-4df4-a473-6fece1d01d53 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:58.116922 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-571bbd92-e01d-4df4-a473-6fece1d01d53 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:58.117750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-571bbd92-e01d-4df4-a473-6fece1d01d53 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:58.118382 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-571bbd92-e01d-4df4-a473-6fece1d01d53 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:58.119628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-571bbd92-e01d-4df4-a473-6fece1d01d53 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:58.120384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-571bbd92-e01d-4df4-a473-6fece1d01d53 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:58.122043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-571bbd92-e01d-4df4-a473-6fece1d01d53 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:58.586564 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-571bbd92-e01d-4df4-a473-6fece1d01d53 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lazy-loading 'services' on Instance uuid 796a6ed8-e44a-4e34-849d-1daeb1f363dd {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:54:58.616164 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-571bbd92-e01d-4df4-a473-6fece1d01d53 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 2344 microversion: 2.25 time: 0.513248 Sep 17 20:54:58.618360 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 515/1059] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:54:58 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 2344 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:54:58.624394 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5f829dbe-eb93-4f86-a43e-904a0d2ef8e7 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:58.625145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5f829dbe-eb93-4f86-a43e-904a0d2ef8e7 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:58.634316 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5f829dbe-eb93-4f86-a43e-904a0d2ef8e7 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:58.636927 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5f829dbe-eb93-4f86-a43e-904a0d2ef8e7 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:58.637940 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5f829dbe-eb93-4f86-a43e-904a0d2ef8e7 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:58.640339 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5f829dbe-eb93-4f86-a43e-904a0d2ef8e7 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:58.641763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5f829dbe-eb93-4f86-a43e-904a0d2ef8e7 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:58.643014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5f829dbe-eb93-4f86-a43e-904a0d2ef8e7 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:59.515184 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5f829dbe-eb93-4f86-a43e-904a0d2ef8e7 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:59.526912 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5f829dbe-eb93-4f86-a43e-904a0d2ef8e7 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1513 microversion: 2.1 time: 0.906944 Sep 17 20:54:59.527677 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 516/1060] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:58 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1513 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:54:59.533454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-82aaddaa-086c-4484-8544-0e23559837f9 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:59.537919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82aaddaa-086c-4484-8544-0e23559837f9 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:59.538547 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82aaddaa-086c-4484-8544-0e23559837f9 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:59.539020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82aaddaa-086c-4484-8544-0e23559837f9 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:59.539851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82aaddaa-086c-4484-8544-0e23559837f9 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:59.540505 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82aaddaa-086c-4484-8544-0e23559837f9 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:59.541007 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82aaddaa-086c-4484-8544-0e23559837f9 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:59.568684 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-82aaddaa-086c-4484-8544-0e23559837f9 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.039168 Sep 17 20:54:59.569723 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 517/1061] 10.222.0.26 () {60 vars in 1217 bytes} [Sat Sep 17 20:54:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:54:59.576891 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-044a9012-697e-4607-915c-d63ab76c9db8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:54:59.577878 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-044a9012-697e-4607-915c-d63ab76c9db8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:54:59.587042 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-044a9012-697e-4607-915c-d63ab76c9db8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:59.588317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-044a9012-697e-4607-915c-d63ab76c9db8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:59.588912 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-044a9012-697e-4607-915c-d63ab76c9db8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:59.590074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-044a9012-697e-4607-915c-d63ab76c9db8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:54:59.590698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-044a9012-697e-4607-915c-d63ab76c9db8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:54:59.591283 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-044a9012-697e-4607-915c-d63ab76c9db8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:54:59.974044 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-044a9012-697e-4607-915c-d63ab76c9db8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:54:59.986788 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-044a9012-697e-4607-915c-d63ab76c9db8 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1473 microversion: 2.1 time: 0.414800 Sep 17 20:55:00.000871 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 518/1062] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:54:59 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1473 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:00.045508 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-24db92cb-b1f9-4d7c-b136-57f1ea6fedec req-9d7a1e67-2332-4f71-ba29-73287e200b51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "560c9626-f97e-4bc8-a2a9-942ddb969ccc", "tag": "41a6b4dc-39d8-4713-bf4d-91efa6a5c055"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:00.071954 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-24db92cb-b1f9-4d7c-b136-57f1ea6fedec req-9d7a1e67-2332-4f71-ba29-73287e200b51 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:00.072841 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-24db92cb-b1f9-4d7c-b136-57f1ea6fedec req-9d7a1e67-2332-4f71-ba29-73287e200b51 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:00.073676 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-24db92cb-b1f9-4d7c-b136-57f1ea6fedec req-9d7a1e67-2332-4f71-ba29-73287e200b51 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:00.079182 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:00.093126 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-24db92cb-b1f9-4d7c-b136-57f1ea6fedec req-9d7a1e67-2332-4f71-ba29-73287e200b51 service nova] Creating event network-changed:41a6b4dc-39d8-4713-bf4d-91efa6a5c055 for instance 560c9626-f97e-4bc8-a2a9-942ddb969ccc on nch2-master-1 Sep 17 20:55:00.100999 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [req-24db92cb-b1f9-4d7c-b136-57f1ea6fedec req-9d7a1e67-2332-4f71-ba29-73287e200b51 service nova] Instance 560c9626-f97e-4bc8-a2a9-942ddb969ccc is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140523) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 20:55:00.119693 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-24db92cb-b1f9-4d7c-b136-57f1ea6fedec req-9d7a1e67-2332-4f71-ba29-73287e200b51 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079523 Sep 17 20:55:00.122745 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 519/1063] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:00.219866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-196f8d16-0212-4601-a5a2-c55e88fa24fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1265706240", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "eb85edb1-9d13-4b48-a02b-116c5b437767"}], "security_groups": [{"name": "tempest-securitygroup--1340254688"}], "key_name": "tempest-keypair-1548807653", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:00.418166 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-02845c6b-8dfd-4b54-9fd8-76c6294cf0ec tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 59beeb15-b8ee-49e8-b739-f38a755dc102] Building network info cache for instance {{(pid=140524) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 17 20:55:00.534981 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-196f8d16-0212-4601-a5a2-c55e88fa24fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] validate_networks() for [('eb85edb1-9d13-4b48-a02b-116c5b437767', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:55:02.152348 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-02845c6b-8dfd-4b54-9fd8-76c6294cf0ec tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 59beeb15-b8ee-49e8-b739-f38a755dc102] Updating instance_info_cache with network_info: [{"id": "eadc612b-7bf9-4d2b-b813-686741311705", "address": "fa:16:3e:ae:bb:2c", "network": {"id": "3c590c43-fcd5-41d9-9c4b-71b8980abfc0", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-261373508-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "6b843f5d09c94cf3916f65e815d6d7a1", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapeadc612b-7b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140524) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 17 20:55:02.181777 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02845c6b-8dfd-4b54-9fd8-76c6294cf0ec tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Releasing lock "refresh_cache-59beeb15-b8ee-49e8-b739-f38a755dc102" {{(pid=140524) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 17 20:55:02.183805 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-02845c6b-8dfd-4b54-9fd8-76c6294cf0ec tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "POST /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102/action" status: 202 len: 0 microversion: 2.1 time: 5.239247 Sep 17 20:55:02.184993 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 545/1064] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:54:56 2022] POST /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102/action => generated 0 bytes in 5244 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 17 20:55:02.193263 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-fa2d2907-b8b9-4d57-ad5a-6fa52ab2333f req-729fc512-b7ef-41b0-bb56-8b7a79e7760b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59beeb15-b8ee-49e8-b739-f38a755dc102", "tag": "eadc612b-7bf9-4d2b-b813-686741311705"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:02.213188 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-fa2d2907-b8b9-4d57-ad5a-6fa52ab2333f req-729fc512-b7ef-41b0-bb56-8b7a79e7760b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:02.214235 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-fa2d2907-b8b9-4d57-ad5a-6fa52ab2333f req-729fc512-b7ef-41b0-bb56-8b7a79e7760b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:02.216115 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-fa2d2907-b8b9-4d57-ad5a-6fa52ab2333f req-729fc512-b7ef-41b0-bb56-8b7a79e7760b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:02.245922 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-fa2d2907-b8b9-4d57-ad5a-6fa52ab2333f req-729fc512-b7ef-41b0-bb56-8b7a79e7760b service nova] Creating event network-changed:eadc612b-7bf9-4d2b-b813-686741311705 for instance 59beeb15-b8ee-49e8-b739-f38a755dc102 on nch1-master-1 Sep 17 20:55:02.252196 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-fa2d2907-b8b9-4d57-ad5a-6fa52ab2333f req-729fc512-b7ef-41b0-bb56-8b7a79e7760b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065719 Sep 17 20:55:02.253717 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 546/1065] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:02.265068 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b4018e0b-bb11-4ddc-9cf9-f3fe8eec8e55 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:02.266544 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b4018e0b-bb11-4ddc-9cf9-f3fe8eec8e55 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:02.274062 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-196f8d16-0212-4601-a5a2-c55e88fa24fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:55:02.274669 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-196f8d16-0212-4601-a5a2-c55e88fa24fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:55:02.274950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-196f8d16-0212-4601-a5a2-c55e88fa24fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:55:02.275390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-196f8d16-0212-4601-a5a2-c55e88fa24fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:55:02.275822 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-196f8d16-0212-4601-a5a2-c55e88fa24fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:55:02.280756 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b4018e0b-bb11-4ddc-9cf9-f3fe8eec8e55 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:02.294525 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-196f8d16-0212-4601-a5a2-c55e88fa24fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:02.295023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-196f8d16-0212-4601-a5a2-c55e88fa24fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:02.296551 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b4018e0b-bb11-4ddc-9cf9-f3fe8eec8e55 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:02.304551 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b4018e0b-bb11-4ddc-9cf9-f3fe8eec8e55 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:02.307362 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b4018e0b-bb11-4ddc-9cf9-f3fe8eec8e55 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:02.310630 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b4018e0b-bb11-4ddc-9cf9-f3fe8eec8e55 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:02.312826 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-196f8d16-0212-4601-a5a2-c55e88fa24fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:02.313007 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b4018e0b-bb11-4ddc-9cf9-f3fe8eec8e55 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:02.322062 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-196f8d16-0212-4601-a5a2-c55e88fa24fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:02.323931 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-196f8d16-0212-4601-a5a2-c55e88fa24fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:02.324673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-196f8d16-0212-4601-a5a2-c55e88fa24fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:02.400469 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-196f8d16-0212-4601-a5a2-c55e88fa24fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Getting quotas for project f6b44bc44e7c4a998bfd99e7d11e99fc. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:55:02.410907 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-196f8d16-0212-4601-a5a2-c55e88fa24fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Getting quotas for user 9c2b746b7c194596808a7b0c736f3b53 and project f6b44bc44e7c4a998bfd99e7d11e99fc. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:55:02.441310 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-196f8d16-0212-4601-a5a2-c55e88fa24fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:55:02.453313 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-196f8d16-0212-4601-a5a2-c55e88fa24fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:55:02.582721 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-196f8d16-0212-4601-a5a2-c55e88fa24fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.370071 Sep 17 20:55:02.587829 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 520/1066] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:55:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 2376 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:55:02.600920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-349042fc-31ae-4f77-a267-2cb5d1fbf53f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:02.601584 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-349042fc-31ae-4f77-a267-2cb5d1fbf53f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:02.621261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-349042fc-31ae-4f77-a267-2cb5d1fbf53f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:02.631643 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-349042fc-31ae-4f77-a267-2cb5d1fbf53f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:02.632130 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-349042fc-31ae-4f77-a267-2cb5d1fbf53f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:02.632907 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-349042fc-31ae-4f77-a267-2cb5d1fbf53f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:02.633449 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-349042fc-31ae-4f77-a267-2cb5d1fbf53f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:02.634204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-349042fc-31ae-4f77-a267-2cb5d1fbf53f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:02.958894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-349042fc-31ae-4f77-a267-2cb5d1fbf53f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:02.967381 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-349042fc-31ae-4f77-a267-2cb5d1fbf53f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1470 microversion: 2.1 time: 0.378285 Sep 17 20:55:02.979060 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 521/1067] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:02 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1470 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:02.979374 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b4018e0b-bb11-4ddc-9cf9-f3fe8eec8e55 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:02.979996 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-019c656a-b681-4c17-85b5-7d75aeb9e0d9 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2a1c319-7ed9-4fb7-af62-52e9373195bf", "device": "/dev/xvdb"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:02.987933 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b4018e0b-bb11-4ddc-9cf9-f3fe8eec8e55 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1513 microversion: 2.1 time: 0.732456 Sep 17 20:55:02.990070 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-019c656a-b681-4c17-85b5-7d75aeb9e0d9 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:02.993300 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 547/1068] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:02 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1513 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:03.006866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-019c656a-b681-4c17-85b5-7d75aeb9e0d9 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:03.007554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-019c656a-b681-4c17-85b5-7d75aeb9e0d9 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:03.008162 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-019c656a-b681-4c17-85b5-7d75aeb9e0d9 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:03.009063 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-019c656a-b681-4c17-85b5-7d75aeb9e0d9 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:03.009724 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-019c656a-b681-4c17-85b5-7d75aeb9e0d9 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:03.013870 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-019c656a-b681-4c17-85b5-7d75aeb9e0d9 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:03.020290 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1d1e20e8-e290-4308-84f8-1c8f62290080 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:03.022296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1d1e20e8-e290-4308-84f8-1c8f62290080 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 143322a7-9d8b-43c3-b3a5-4000c26b6cc7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:03.061571 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d1e20e8-e290-4308-84f8-1c8f62290080 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:03.068715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d1e20e8-e290-4308-84f8-1c8f62290080 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:03.069235 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d1e20e8-e290-4308-84f8-1c8f62290080 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:03.075781 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d1e20e8-e290-4308-84f8-1c8f62290080 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:03.076307 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d1e20e8-e290-4308-84f8-1c8f62290080 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:03.082920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d1e20e8-e290-4308-84f8-1c8f62290080 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:03.117447 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-1d1e20e8-e290-4308-84f8-1c8f62290080 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] HTTP exception thrown: Instance 143322a7-9d8b-43c3-b3a5-4000c26b6cc7 could not be found. Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1d1e20e8-e290-4308-84f8-1c8f62290080 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Request method failure captured: Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7 HTTP/1.1 Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjPdtRu2iYptkTPd_MttBInDvZ232C4UYTgRRk7p73wF24SJC9a_uyjbBDxC8PGK6VtaICTpDWpKUHaBQrqeF21sLQpSabwTsxZi5tuSn0UYbf1WXUZP94metBT0x0P8-itukHhcfK1Pe9eM_o7WuV-s29r_1ZxnCxDB3hpogM1wsbA Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 6b843f5d09c94cf3916f65e815d6d7a1 Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1435988706 Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6b843f5d09c94cf3916f65e815d6d7a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6b843f5d09c94cf3916f65e815d6d7a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6b843f5d09c94cf3916f65e815d6d7a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6b843f5d09c94cf3916f65e815d6d7a1", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1435988706 Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 6b843f5d09c94cf3916f65e815d6d7a1 Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1435988706 Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-FloatingIPsAssociationTestJSON-1435988706-project Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: aaa9e5c7b7dd4a74935de34327145697 Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1435988706-project Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 143322a7-9d8b-43c3-b3a5-4000c26b6cc7 could not be found. Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '143322a7-9d8b-43c3-b3a5-4000c26b6cc7'} Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 143322a7-9d8b-43c3-b3a5-4000c26b6cc7 could not be found. Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:55:03.120071 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:55:03.126090 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 143322a7-9d8b-43c3-b3a5-4000c26b6cc7 could not be found. Sep 17 20:55:03.126090 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:55:03.126090 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:55:03.126090 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:55:03.126090 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:55:03.126090 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:55:03.126090 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:55:03.126090 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:55:03.126090 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:55:03.126090 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 143322a7-9d8b-43c3-b3a5-4000c26b6cc7 could not be found. Sep 17 20:55:03.126090 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:55:03.126090 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1d1e20e8-e290-4308-84f8-1c8f62290080 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Returning 404 to user: Instance 143322a7-9d8b-43c3-b3a5-4000c26b6cc7 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:55:03.126090 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1d1e20e8-e290-4308-84f8-1c8f62290080 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "DELETE /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7" status: 404 len: 111 microversion: 2.1 time: 0.108035 Sep 17 20:55:03.126090 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 548/1069] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:55:02 2022] DELETE /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:55:03.139608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1f14378b-a8ba-4b97-b64c-e03ef7f035bc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:03.141877 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1f14378b-a8ba-4b97-b64c-e03ef7f035bc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:03.623867 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-019c656a-b681-4c17-85b5-7d75aeb9e0d9 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "POST /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.647474 Sep 17 20:55:03.624514 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 522/1070] 10.222.0.26 () {62 vars in 1364 bytes} [Sat Sep 17 20:55:02 2022] POST /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd/os-volume_attachments => generated 194 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:55:03.677561 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9745f838-da82-44b8-8ba4-908f6e3913dd tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:03.686670 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9745f838-da82-44b8-8ba4-908f6e3913dd tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:03.718942 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9745f838-da82-44b8-8ba4-908f6e3913dd tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:03.719391 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9745f838-da82-44b8-8ba4-908f6e3913dd tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:03.719897 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9745f838-da82-44b8-8ba4-908f6e3913dd tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:03.726482 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9745f838-da82-44b8-8ba4-908f6e3913dd tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:03.730118 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9745f838-da82-44b8-8ba4-908f6e3913dd tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:03.733784 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9745f838-da82-44b8-8ba4-908f6e3913dd tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:03.891532 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1f14378b-a8ba-4b97-b64c-e03ef7f035bc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:03.921056 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1f14378b-a8ba-4b97-b64c-e03ef7f035bc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1235 microversion: 2.1 time: 0.793535 Sep 17 20:55:03.931811 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 549/1071] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:03 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1235 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:03.946497 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ac8d2229-be40-4443-af83-da3f8114a564 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:03.954070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ac8d2229-be40-4443-af83-da3f8114a564 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 143322a7-9d8b-43c3-b3a5-4000c26b6cc7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:04.003740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac8d2229-be40-4443-af83-da3f8114a564 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:04.004262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac8d2229-be40-4443-af83-da3f8114a564 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:04.009092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac8d2229-be40-4443-af83-da3f8114a564 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:04.010117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac8d2229-be40-4443-af83-da3f8114a564 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:04.010606 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac8d2229-be40-4443-af83-da3f8114a564 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:04.014483 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac8d2229-be40-4443-af83-da3f8114a564 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:04.047509 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-ac8d2229-be40-4443-af83-da3f8114a564 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] HTTP exception thrown: Instance 143322a7-9d8b-43c3-b3a5-4000c26b6cc7 could not be found. Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ac8d2229-be40-4443-af83-da3f8114a564 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Request method failure captured: Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7 HTTP/1.1 Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjPdtRu2iYptkTPd_MttBInDvZ232C4UYTgRRk7p73wF24SJC9a_uyjbBDxC8PGK6VtaICTpDWpKUHaBQrqeF21sLQpSabwTsxZi5tuSn0UYbf1WXUZP94metBT0x0P8-itukHhcfK1Pe9eM_o7WuV-s29r_1ZxnCxDB3hpogM1wsbA Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 6b843f5d09c94cf3916f65e815d6d7a1 Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1435988706 Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6b843f5d09c94cf3916f65e815d6d7a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6b843f5d09c94cf3916f65e815d6d7a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6b843f5d09c94cf3916f65e815d6d7a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6b843f5d09c94cf3916f65e815d6d7a1", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1435988706 Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 6b843f5d09c94cf3916f65e815d6d7a1 Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1435988706 Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-FloatingIPsAssociationTestJSON-1435988706-project Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: aaa9e5c7b7dd4a74935de34327145697 Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1435988706-project Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 143322a7-9d8b-43c3-b3a5-4000c26b6cc7 could not be found. Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '143322a7-9d8b-43c3-b3a5-4000c26b6cc7'} Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 143322a7-9d8b-43c3-b3a5-4000c26b6cc7 could not be found. Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 143322a7-9d8b-43c3-b3a5-4000c26b6cc7 could not be found. Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:55:04.049753 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:55:04.053864 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:55:04.053864 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:55:04.053864 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:55:04.053864 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:55:04.053864 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:55:04.053864 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:55:04.053864 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 143322a7-9d8b-43c3-b3a5-4000c26b6cc7 could not be found. Sep 17 20:55:04.053864 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:55:04.057715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ac8d2229-be40-4443-af83-da3f8114a564 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Returning 404 to user: Instance 143322a7-9d8b-43c3-b3a5-4000c26b6cc7 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:55:04.059866 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ac8d2229-be40-4443-af83-da3f8114a564 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "GET /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7" status: 404 len: 111 microversion: 2.1 time: 0.125777 Sep 17 20:55:04.063873 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 550/1072] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:03 2022] GET /compute/v2.1/servers/143322a7-9d8b-43c3-b3a5-4000c26b6cc7 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:55:04.078796 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c4c91eab-8e73-469b-9b89-4ea89647e574 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:04.083385 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c4c91eab-8e73-469b-9b89-4ea89647e574 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:04.106728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4c91eab-8e73-469b-9b89-4ea89647e574 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:04.107599 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4c91eab-8e73-469b-9b89-4ea89647e574 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:04.108291 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4c91eab-8e73-469b-9b89-4ea89647e574 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:04.110685 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4c91eab-8e73-469b-9b89-4ea89647e574 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:04.112078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4c91eab-8e73-469b-9b89-4ea89647e574 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:04.112766 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4c91eab-8e73-469b-9b89-4ea89647e574 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:04.206696 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9745f838-da82-44b8-8ba4-908f6e3913dd tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "POST /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc/action" status: 202 len: 0 microversion: 2.1 time: 0.576444 Sep 17 20:55:04.207639 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 523/1073] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:55:03 2022] POST /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc/action => generated 0 bytes in 583 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:55:04.218892 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-804ebc9b-3435-4695-8a9c-58e3e4996a58 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '.version_select at 0x7f25a5207ee0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:04.834672 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c4c91eab-8e73-469b-9b89-4ea89647e574 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:04.871783 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c4c91eab-8e73-469b-9b89-4ea89647e574 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1513 microversion: 2.1 time: 0.806439 Sep 17 20:55:04.883699 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 551/1074] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:04 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1513 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:04.897143 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5128eafd-1919-41db-aba7-ea221d30b0f9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:04.899097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5128eafd-1919-41db-aba7-ea221d30b0f9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:04.910792 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5128eafd-1919-41db-aba7-ea221d30b0f9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:04.911721 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5128eafd-1919-41db-aba7-ea221d30b0f9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:04.912957 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5128eafd-1919-41db-aba7-ea221d30b0f9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:04.914314 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5128eafd-1919-41db-aba7-ea221d30b0f9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:04.915335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5128eafd-1919-41db-aba7-ea221d30b0f9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:04.915975 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5128eafd-1919-41db-aba7-ea221d30b0f9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:05.608894 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5128eafd-1919-41db-aba7-ea221d30b0f9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:05.624609 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5128eafd-1919-41db-aba7-ea221d30b0f9 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1469 microversion: 2.1 time: 0.738149 Sep 17 20:55:05.642435 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 552/1075] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:04 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1469 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:05.676830 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-42b9cddd-0ed9-436c-a7e5-eb89b310e7bc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:05.677958 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-42b9cddd-0ed9-436c-a7e5-eb89b310e7bc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:05.685210 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42b9cddd-0ed9-436c-a7e5-eb89b310e7bc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:05.695157 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42b9cddd-0ed9-436c-a7e5-eb89b310e7bc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:05.695858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42b9cddd-0ed9-436c-a7e5-eb89b310e7bc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:05.696898 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42b9cddd-0ed9-436c-a7e5-eb89b310e7bc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:05.697541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42b9cddd-0ed9-436c-a7e5-eb89b310e7bc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:05.698402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42b9cddd-0ed9-436c-a7e5-eb89b310e7bc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:05.946717 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-42b9cddd-0ed9-436c-a7e5-eb89b310e7bc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:05.960866 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-42b9cddd-0ed9-436c-a7e5-eb89b310e7bc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1293 microversion: 2.1 time: 0.312268 Sep 17 20:55:05.964467 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 553/1076] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:05 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1293 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:05.986326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-171328cd-97eb-4a4c-bf80-44609764080e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:05.987763 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-171328cd-97eb-4a4c-bf80-44609764080e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:06.005181 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-171328cd-97eb-4a4c-bf80-44609764080e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:06.006224 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-171328cd-97eb-4a4c-bf80-44609764080e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:06.007802 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-171328cd-97eb-4a4c-bf80-44609764080e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:06.009890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-171328cd-97eb-4a4c-bf80-44609764080e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:06.011036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-171328cd-97eb-4a4c-bf80-44609764080e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:06.012031 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-171328cd-97eb-4a4c-bf80-44609764080e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:06.806524 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-171328cd-97eb-4a4c-bf80-44609764080e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:06.817747 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-171328cd-97eb-4a4c-bf80-44609764080e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1513 microversion: 2.1 time: 0.848166 Sep 17 20:55:06.827817 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 554/1077] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:05 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1513 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:06.833186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-485beb11-fddb-4c00-88bf-faed42205985 req-05e4ba86-a5e1-463c-9714-53fe33562df6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "560c9626-f97e-4bc8-a2a9-942ddb969ccc", "name": "network-vif-plugged", "status": "completed", "tag": "41a6b4dc-39d8-4713-bf4d-91efa6a5c055"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:06.854242 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-804ebc9b-3435-4695-8a9c-58e3e4996a58 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/fc407ad3-6297-4610-9586-83ccada8858e" status: 202 len: 0 microversion: 2.1 time: 2.645146 Sep 17 20:55:06.855455 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 524/1078] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Sep 17 20:55:04 2022] DELETE /compute/v2.1/os-floating-ips/fc407ad3-6297-4610-9586-83ccada8858e => generated 0 bytes in 2647 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:55:06.861810 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-90f94ad6-1d6f-4817-a7b2-a2e847011303 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:06.862659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-90f94ad6-1d6f-4817-a7b2-a2e847011303 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:06.875713 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-485beb11-fddb-4c00-88bf-faed42205985 req-05e4ba86-a5e1-463c-9714-53fe33562df6 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:06.881552 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-485beb11-fddb-4c00-88bf-faed42205985 req-05e4ba86-a5e1-463c-9714-53fe33562df6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:06.882357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-485beb11-fddb-4c00-88bf-faed42205985 req-05e4ba86-a5e1-463c-9714-53fe33562df6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:06.884841 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90f94ad6-1d6f-4817-a7b2-a2e847011303 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:06.896403 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90f94ad6-1d6f-4817-a7b2-a2e847011303 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:06.897518 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90f94ad6-1d6f-4817-a7b2-a2e847011303 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:06.902116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90f94ad6-1d6f-4817-a7b2-a2e847011303 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:06.906662 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90f94ad6-1d6f-4817-a7b2-a2e847011303 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:06.908634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90f94ad6-1d6f-4817-a7b2-a2e847011303 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:06.942279 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-485beb11-fddb-4c00-88bf-faed42205985 req-05e4ba86-a5e1-463c-9714-53fe33562df6 service nova] Creating event network-vif-plugged:41a6b4dc-39d8-4713-bf4d-91efa6a5c055 for instance 560c9626-f97e-4bc8-a2a9-942ddb969ccc on nch2-master-1 Sep 17 20:55:06.960250 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [req-485beb11-fddb-4c00-88bf-faed42205985 req-05e4ba86-a5e1-463c-9714-53fe33562df6 service nova] Instance 560c9626-f97e-4bc8-a2a9-942ddb969ccc is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140524) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 20:55:06.993315 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-485beb11-fddb-4c00-88bf-faed42205985 req-05e4ba86-a5e1-463c-9714-53fe33562df6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162684 Sep 17 20:55:06.997134 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 555/1079] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:07.006660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-886bd588-5dcb-4bee-9edb-deeaa4db09c9 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:07.007912 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-886bd588-5dcb-4bee-9edb-deeaa4db09c9 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 59beeb15-b8ee-49e8-b739-f38a755dc102] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:07.019829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-886bd588-5dcb-4bee-9edb-deeaa4db09c9 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:07.020782 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-886bd588-5dcb-4bee-9edb-deeaa4db09c9 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:07.021626 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-886bd588-5dcb-4bee-9edb-deeaa4db09c9 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:07.022980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-886bd588-5dcb-4bee-9edb-deeaa4db09c9 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:07.024601 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-886bd588-5dcb-4bee-9edb-deeaa4db09c9 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:07.025684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-886bd588-5dcb-4bee-9edb-deeaa4db09c9 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:07.071719 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-886bd588-5dcb-4bee-9edb-deeaa4db09c9 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 59beeb15-b8ee-49e8-b739-f38a755dc102] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:55:07.235375 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-886bd588-5dcb-4bee-9edb-deeaa4db09c9 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "DELETE /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102" status: 204 len: 0 microversion: 2.1 time: 0.234833 Sep 17 20:55:07.236395 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 556/1080] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:55:06 2022] DELETE /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:55:07.247284 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-58940945-1480-418a-882f-54aa873fc367 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:07.248009 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-58940945-1480-418a-882f-54aa873fc367 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:07.254814 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58940945-1480-418a-882f-54aa873fc367 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:07.255880 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58940945-1480-418a-882f-54aa873fc367 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:07.258302 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58940945-1480-418a-882f-54aa873fc367 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:07.259105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58940945-1480-418a-882f-54aa873fc367 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:07.259645 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58940945-1480-418a-882f-54aa873fc367 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:07.260228 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58940945-1480-418a-882f-54aa873fc367 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:07.274046 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-90f94ad6-1d6f-4817-a7b2-a2e847011303 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:07.285611 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-90f94ad6-1d6f-4817-a7b2-a2e847011303 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1469 microversion: 2.1 time: 0.427641 Sep 17 20:55:07.287153 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 525/1081] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:06 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1469 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:07.294718 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-224d4640-a2cc-4628-b677-8000b501a572 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:07.295560 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-224d4640-a2cc-4628-b677-8000b501a572 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 59beeb15-b8ee-49e8-b739-f38a755dc102] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:07.314542 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-224d4640-a2cc-4628-b677-8000b501a572 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:07.315243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-224d4640-a2cc-4628-b677-8000b501a572 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:07.315613 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-224d4640-a2cc-4628-b677-8000b501a572 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:07.316405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-224d4640-a2cc-4628-b677-8000b501a572 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:07.316875 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-224d4640-a2cc-4628-b677-8000b501a572 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:07.317364 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-224d4640-a2cc-4628-b677-8000b501a572 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:07.748527 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-58940945-1480-418a-882f-54aa873fc367 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:07.760498 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-58940945-1480-418a-882f-54aa873fc367 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1361 microversion: 2.1 time: 0.519656 Sep 17 20:55:07.761790 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 557/1082] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:07 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1361 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:07.774435 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-224d4640-a2cc-4628-b677-8000b501a572 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa9e5c7b7dd4a74935de34327145697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b843f5d09c94cf3916f65e815d6d7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:07.786405 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-224d4640-a2cc-4628-b677-8000b501a572 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102" status: 200 len: 1526 microversion: 2.1 time: 0.495626 Sep 17 20:55:07.787600 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 526/1083] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:07 2022] GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102 => generated 1526 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:07.846057 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-79356409-9098-4452-8967-fe6dbff03e4a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:07.846807 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-79356409-9098-4452-8967-fe6dbff03e4a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:07.853762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79356409-9098-4452-8967-fe6dbff03e4a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:07.854607 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79356409-9098-4452-8967-fe6dbff03e4a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:07.855246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79356409-9098-4452-8967-fe6dbff03e4a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:07.856381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79356409-9098-4452-8967-fe6dbff03e4a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:07.856898 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79356409-9098-4452-8967-fe6dbff03e4a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:07.857317 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79356409-9098-4452-8967-fe6dbff03e4a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:08.146354 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-79356409-9098-4452-8967-fe6dbff03e4a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:08.161914 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-79356409-9098-4452-8967-fe6dbff03e4a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1513 microversion: 2.1 time: 0.319767 Sep 17 20:55:08.172722 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 558/1084] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:07 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1513 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:08.290675 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-8e20e9de-6978-457f-908f-9a3401e07714 req-af05a98d-c96b-4a05-bd61-e6eb5ddaf333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46d60c84-b2e2-4376-a0ca-f0bee938fd9a", "tag": "94958f55-6b3e-41f2-a7f1-6dd835192bd3"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:08.312850 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8e20e9de-6978-457f-908f-9a3401e07714 req-af05a98d-c96b-4a05-bd61-e6eb5ddaf333 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:08.313393 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8e20e9de-6978-457f-908f-9a3401e07714 req-af05a98d-c96b-4a05-bd61-e6eb5ddaf333 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:08.313867 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8e20e9de-6978-457f-908f-9a3401e07714 req-af05a98d-c96b-4a05-bd61-e6eb5ddaf333 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:08.323294 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-71e46f3c-a994-4336-a991-d6f3068b28e3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:08.324225 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-71e46f3c-a994-4336-a991-d6f3068b28e3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:08.338647 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71e46f3c-a994-4336-a991-d6f3068b28e3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:08.341017 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71e46f3c-a994-4336-a991-d6f3068b28e3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:08.341866 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71e46f3c-a994-4336-a991-d6f3068b28e3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:08.343383 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71e46f3c-a994-4336-a991-d6f3068b28e3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:08.344796 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71e46f3c-a994-4336-a991-d6f3068b28e3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:08.345496 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71e46f3c-a994-4336-a991-d6f3068b28e3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:08.351403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:08.380971 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-8e20e9de-6978-457f-908f-9a3401e07714 req-af05a98d-c96b-4a05-bd61-e6eb5ddaf333 service nova] Creating event network-changed:94958f55-6b3e-41f2-a7f1-6dd835192bd3 for instance 46d60c84-b2e2-4376-a0ca-f0bee938fd9a on nch1-master-1 Sep 17 20:55:08.393358 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-8e20e9de-6978-457f-908f-9a3401e07714 req-af05a98d-c96b-4a05-bd61-e6eb5ddaf333 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109773 Sep 17 20:55:08.397963 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 527/1085] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:08.699064 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-71e46f3c-a994-4336-a991-d6f3068b28e3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:08.714308 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-71e46f3c-a994-4336-a991-d6f3068b28e3 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1469 microversion: 2.1 time: 0.397050 Sep 17 20:55:08.731359 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 559/1086] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:08 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1469 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:08.800327 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b8213870-b383-4373-8a52-5768033d53a4 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:08.802179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b8213870-b383-4373-8a52-5768033d53a4 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:08.818898 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1c7900bc-2036-45d6-b98a-cb6832d1035d tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:08.819674 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1c7900bc-2036-45d6-b98a-cb6832d1035d tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 59beeb15-b8ee-49e8-b739-f38a755dc102] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:08.845125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c7900bc-2036-45d6-b98a-cb6832d1035d tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:08.848299 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c7900bc-2036-45d6-b98a-cb6832d1035d tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:08.849021 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c7900bc-2036-45d6-b98a-cb6832d1035d tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:08.850321 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b8213870-b383-4373-8a52-5768033d53a4 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:08.867187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c7900bc-2036-45d6-b98a-cb6832d1035d tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:08.872447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b8213870-b383-4373-8a52-5768033d53a4 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:08.873267 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b8213870-b383-4373-8a52-5768033d53a4 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:08.875682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b8213870-b383-4373-8a52-5768033d53a4 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:08.876514 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c7900bc-2036-45d6-b98a-cb6832d1035d tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:08.876989 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c7900bc-2036-45d6-b98a-cb6832d1035d tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:08.877753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b8213870-b383-4373-8a52-5768033d53a4 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:08.880100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b8213870-b383-4373-8a52-5768033d53a4 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:09.367378 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b8213870-b383-4373-8a52-5768033d53a4 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:09.378165 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b8213870-b383-4373-8a52-5768033d53a4 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1361 microversion: 2.1 time: 0.588319 Sep 17 20:55:09.378758 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 528/1087] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:08 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1361 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:09.388108 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ceb86e10-d805-4ab1-82ae-07c44781ab2c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:09.394342 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ceb86e10-d805-4ab1-82ae-07c44781ab2c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:09.401853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ceb86e10-d805-4ab1-82ae-07c44781ab2c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:09.402447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ceb86e10-d805-4ab1-82ae-07c44781ab2c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:09.403111 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ceb86e10-d805-4ab1-82ae-07c44781ab2c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:09.404065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ceb86e10-d805-4ab1-82ae-07c44781ab2c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:09.404591 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ceb86e10-d805-4ab1-82ae-07c44781ab2c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:09.405249 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ceb86e10-d805-4ab1-82ae-07c44781ab2c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:09.442677 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1c7900bc-2036-45d6-b98a-cb6832d1035d tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa9e5c7b7dd4a74935de34327145697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b843f5d09c94cf3916f65e815d6d7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:09.457640 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1c7900bc-2036-45d6-b98a-cb6832d1035d tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102" status: 200 len: 1526 microversion: 2.1 time: 0.646993 Sep 17 20:55:09.475714 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 560/1088] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:08 2022] GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102 => generated 1526 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:09.591156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ceb86e10-d805-4ab1-82ae-07c44781ab2c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:09.600366 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ceb86e10-d805-4ab1-82ae-07c44781ab2c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1513 microversion: 2.1 time: 0.216003 Sep 17 20:55:09.614545 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 529/1089] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:09 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1513 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:09.741957 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ad3e9867-f93e-4f55-9089-7e73eef66fa4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:09.742930 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ad3e9867-f93e-4f55-9089-7e73eef66fa4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:09.752768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad3e9867-f93e-4f55-9089-7e73eef66fa4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:09.753275 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad3e9867-f93e-4f55-9089-7e73eef66fa4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:09.753738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad3e9867-f93e-4f55-9089-7e73eef66fa4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:09.754450 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad3e9867-f93e-4f55-9089-7e73eef66fa4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:09.760934 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad3e9867-f93e-4f55-9089-7e73eef66fa4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:09.761307 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad3e9867-f93e-4f55-9089-7e73eef66fa4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:09.929226 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ad3e9867-f93e-4f55-9089-7e73eef66fa4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:09.940622 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ad3e9867-f93e-4f55-9089-7e73eef66fa4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1469 microversion: 2.1 time: 0.203755 Sep 17 20:55:09.942002 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 561/1090] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:09 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1469 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:10.122683 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cc723802-5300-4d7a-818d-c0e68830142a tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:10.124805 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cc723802-5300-4d7a-818d-c0e68830142a tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:10.133982 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc723802-5300-4d7a-818d-c0e68830142a tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:10.134560 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc723802-5300-4d7a-818d-c0e68830142a tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:10.135006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc723802-5300-4d7a-818d-c0e68830142a tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:10.135946 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc723802-5300-4d7a-818d-c0e68830142a tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:10.136387 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc723802-5300-4d7a-818d-c0e68830142a tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:10.137048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc723802-5300-4d7a-818d-c0e68830142a tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:10.283959 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-cc723802-5300-4d7a-818d-c0e68830142a tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lazy-loading 'services' on Instance uuid 796a6ed8-e44a-4e34-849d-1daeb1f363dd {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:55:10.298419 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cc723802-5300-4d7a-818d-c0e68830142a tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 2422 microversion: 2.25 time: 0.184304 Sep 17 20:55:10.299501 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 530/1091] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:10 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 2422 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 20:55:10.324078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-79ebc3af-8b5f-4a0b-a77d-3fe526c9ee78 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:10.327305 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-79ebc3af-8b5f-4a0b-a77d-3fe526c9ee78 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:10.334013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79ebc3af-8b5f-4a0b-a77d-3fe526c9ee78 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:10.334675 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79ebc3af-8b5f-4a0b-a77d-3fe526c9ee78 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:10.335316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79ebc3af-8b5f-4a0b-a77d-3fe526c9ee78 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:10.336219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79ebc3af-8b5f-4a0b-a77d-3fe526c9ee78 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:10.336825 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79ebc3af-8b5f-4a0b-a77d-3fe526c9ee78 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:10.337412 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79ebc3af-8b5f-4a0b-a77d-3fe526c9ee78 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:10.365713 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-79ebc3af-8b5f-4a0b-a77d-3fe526c9ee78 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lazy-loading 'flavor' on Instance uuid 796a6ed8-e44a-4e34-849d-1daeb1f363dd {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:55:10.382259 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-79ebc3af-8b5f-4a0b-a77d-3fe526c9ee78 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Going to try to live migrate instance to nch1-master-1 {{(pid=140524) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 17 20:55:10.421234 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f2f1a89d-31e2-451a-bebb-c999efd2dcd3 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:10.422649 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f2f1a89d-31e2-451a-bebb-c999efd2dcd3 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:10.430007 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2f1a89d-31e2-451a-bebb-c999efd2dcd3 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:10.430875 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2f1a89d-31e2-451a-bebb-c999efd2dcd3 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:10.431565 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2f1a89d-31e2-451a-bebb-c999efd2dcd3 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:10.432991 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2f1a89d-31e2-451a-bebb-c999efd2dcd3 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:10.433347 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2f1a89d-31e2-451a-bebb-c999efd2dcd3 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:10.434581 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2f1a89d-31e2-451a-bebb-c999efd2dcd3 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:10.764360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f2f1a89d-31e2-451a-bebb-c999efd2dcd3 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:10.776051 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f2f1a89d-31e2-451a-bebb-c999efd2dcd3 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1361 microversion: 2.1 time: 0.375099 Sep 17 20:55:10.776873 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 531/1092] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:10 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1361 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:10.781666 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1426732c-001f-4397-9e68-cd6657552682 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:10.784293 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1426732c-001f-4397-9e68-cd6657552682 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 59beeb15-b8ee-49e8-b739-f38a755dc102] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:10.799921 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1426732c-001f-4397-9e68-cd6657552682 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:10.800360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1426732c-001f-4397-9e68-cd6657552682 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:10.800803 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1426732c-001f-4397-9e68-cd6657552682 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:10.802976 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1426732c-001f-4397-9e68-cd6657552682 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:10.803753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1426732c-001f-4397-9e68-cd6657552682 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:10.804619 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1426732c-001f-4397-9e68-cd6657552682 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:10.892345 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1426732c-001f-4397-9e68-cd6657552682 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaa9e5c7b7dd4a74935de34327145697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b843f5d09c94cf3916f65e815d6d7a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:10.906730 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1426732c-001f-4397-9e68-cd6657552682 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102" status: 200 len: 1484 microversion: 2.1 time: 0.128600 Sep 17 20:55:10.910155 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 532/1093] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:10 2022] GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102 => generated 1484 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:10.923687 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-d0ff94e0-49e9-45e4-9bc7-31b667a30b59 req-0d634481-32f7-4017-b7d3-e6edacf7f6ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59beeb15-b8ee-49e8-b739-f38a755dc102", "name": "network-vif-deleted", "tag": "eadc612b-7bf9-4d2b-b813-686741311705"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:10.943496 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d0ff94e0-49e9-45e4-9bc7-31b667a30b59 req-0d634481-32f7-4017-b7d3-e6edacf7f6ab service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:10.944269 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d0ff94e0-49e9-45e4-9bc7-31b667a30b59 req-0d634481-32f7-4017-b7d3-e6edacf7f6ab service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:10.945283 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d0ff94e0-49e9-45e4-9bc7-31b667a30b59 req-0d634481-32f7-4017-b7d3-e6edacf7f6ab service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:10.966374 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-d0ff94e0-49e9-45e4-9bc7-31b667a30b59 req-0d634481-32f7-4017-b7d3-e6edacf7f6ab service nova] Creating event network-vif-deleted:eadc612b-7bf9-4d2b-b813-686741311705 for instance 59beeb15-b8ee-49e8-b739-f38a755dc102 on nch1-master-1 Sep 17 20:55:10.989350 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-d0ff94e0-49e9-45e4-9bc7-31b667a30b59 req-0d634481-32f7-4017-b7d3-e6edacf7f6ab service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059505 Sep 17 20:55:10.990582 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 533/1094] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:11.007061 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e6188633-cf69-41c4-b8b3-bef2adf2675d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:11.018696 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e6188633-cf69-41c4-b8b3-bef2adf2675d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:11.028992 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6188633-cf69-41c4-b8b3-bef2adf2675d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:11.029442 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6188633-cf69-41c4-b8b3-bef2adf2675d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:11.029924 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6188633-cf69-41c4-b8b3-bef2adf2675d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:11.030652 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6188633-cf69-41c4-b8b3-bef2adf2675d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:11.031114 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6188633-cf69-41c4-b8b3-bef2adf2675d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:11.031562 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6188633-cf69-41c4-b8b3-bef2adf2675d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:11.702417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e6188633-cf69-41c4-b8b3-bef2adf2675d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:11.716352 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e6188633-cf69-41c4-b8b3-bef2adf2675d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1513 microversion: 2.1 time: 0.723430 Sep 17 20:55:11.717448 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 534/1095] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:10 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1513 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:11.726492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e15562af-4398-4595-b76e-d12053d1278f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:11.728411 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e15562af-4398-4595-b76e-d12053d1278f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:11.739418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e15562af-4398-4595-b76e-d12053d1278f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:11.740406 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e15562af-4398-4595-b76e-d12053d1278f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:11.741187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e15562af-4398-4595-b76e-d12053d1278f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:11.742275 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e15562af-4398-4595-b76e-d12053d1278f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:11.745127 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e15562af-4398-4595-b76e-d12053d1278f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:11.746283 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e15562af-4398-4595-b76e-d12053d1278f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:11.983683 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e15562af-4398-4595-b76e-d12053d1278f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:11.986407 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:11.996678 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e15562af-4398-4595-b76e-d12053d1278f tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1469 microversion: 2.1 time: 0.277561 Sep 17 20:55:12.009743 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 535/1096] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:11 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1469 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:12.020977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c456567b-16bd-4e67-bcfe-3c134a7ea24c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:12.021955 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c456567b-16bd-4e67-bcfe-3c134a7ea24c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:12.030944 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c456567b-16bd-4e67-bcfe-3c134a7ea24c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:12.032206 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c456567b-16bd-4e67-bcfe-3c134a7ea24c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:12.032805 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c456567b-16bd-4e67-bcfe-3c134a7ea24c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:12.033760 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c456567b-16bd-4e67-bcfe-3c134a7ea24c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:12.034729 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c456567b-16bd-4e67-bcfe-3c134a7ea24c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:12.035387 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c456567b-16bd-4e67-bcfe-3c134a7ea24c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:12.365274 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=4 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:12.410881 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c456567b-16bd-4e67-bcfe-3c134a7ea24c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:12.421942 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c456567b-16bd-4e67-bcfe-3c134a7ea24c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1361 microversion: 2.1 time: 0.411043 Sep 17 20:55:12.437559 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 536/1097] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:12 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1361 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:12.437559 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e3a6d51c-ba81-442b-b9a8-3b95ce820ad6 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:12.446422 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e3a6d51c-ba81-442b-b9a8-3b95ce820ad6 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] [instance: 59beeb15-b8ee-49e8-b739-f38a755dc102] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:12.461695 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=10 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:12.463736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e3a6d51c-ba81-442b-b9a8-3b95ce820ad6 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:12.464408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e3a6d51c-ba81-442b-b9a8-3b95ce820ad6 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:12.464986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e3a6d51c-ba81-442b-b9a8-3b95ce820ad6 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:12.465773 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e3a6d51c-ba81-442b-b9a8-3b95ce820ad6 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:12.469958 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e3a6d51c-ba81-442b-b9a8-3b95ce820ad6 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:12.470452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e3a6d51c-ba81-442b-b9a8-3b95ce820ad6 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:12.497823 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-e3a6d51c-ba81-442b-b9a8-3b95ce820ad6 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] HTTP exception thrown: Instance 59beeb15-b8ee-49e8-b739-f38a755dc102 could not be found. Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e3a6d51c-ba81-442b-b9a8-3b95ce820ad6 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Request method failure captured: Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102 HTTP/1.1 Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjPdtRu2iYptkTPd_MttBInDvZ232C4UYTgRRk7p73wF24SJC9a_uyjbBDxC8PGK6VtaICTpDWpKUHaBQrqeF21sLQpSabwTsxZi5tuSn0UYbf1WXUZP94metBT0x0P8-itukHhcfK1Pe9eM_o7WuV-s29r_1ZxnCxDB3hpogM1wsbA Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 6b843f5d09c94cf3916f65e815d6d7a1 Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1435988706 Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6b843f5d09c94cf3916f65e815d6d7a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6b843f5d09c94cf3916f65e815d6d7a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6b843f5d09c94cf3916f65e815d6d7a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6b843f5d09c94cf3916f65e815d6d7a1", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1435988706 Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 6b843f5d09c94cf3916f65e815d6d7a1 Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1435988706 Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-FloatingIPsAssociationTestJSON-1435988706-project Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: aaa9e5c7b7dd4a74935de34327145697 Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1435988706-project Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 59beeb15-b8ee-49e8-b739-f38a755dc102 could not be found. Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '59beeb15-b8ee-49e8-b739-f38a755dc102'} Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59beeb15-b8ee-49e8-b739-f38a755dc102 could not be found. Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59beeb15-b8ee-49e8-b739-f38a755dc102 could not be found. Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:55:12.499693 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:55:12.509216 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:55:12.509216 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:55:12.509216 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:55:12.509216 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:55:12.509216 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:55:12.509216 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:55:12.509216 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59beeb15-b8ee-49e8-b739-f38a755dc102 could not be found. Sep 17 20:55:12.509216 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:55:12.509216 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e3a6d51c-ba81-442b-b9a8-3b95ce820ad6 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] Returning 404 to user: Instance 59beeb15-b8ee-49e8-b739-f38a755dc102 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:55:12.509216 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e3a6d51c-ba81-442b-b9a8-3b95ce820ad6 tempest-FloatingIPsAssociationTestJSON-1435988706 tempest-FloatingIPsAssociationTestJSON-1435988706-project] 10.222.0.26 "GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102" status: 404 len: 111 microversion: 2.1 time: 0.071054 Sep 17 20:55:12.509216 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 537/1098] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:12 2022] GET /compute/v2.1/servers/59beeb15-b8ee-49e8-b739-f38a755dc102 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:55:12.599165 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-79ebc3af-8b5f-4a0b-a77d-3fe526c9ee78 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd/action" status: 202 len: 0 microversion: 2.25 time: 2.277666 Sep 17 20:55:12.602918 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 562/1099] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Sep 17 20:55:10 2022] POST /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd/action => generated 0 bytes in 2284 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:55:12.617870 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-64148c4d-8169-4b75-a84a-8d931f9b41f7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:12.619065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-64148c4d-8169-4b75-a84a-8d931f9b41f7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:12.636162 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-64148c4d-8169-4b75-a84a-8d931f9b41f7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:12.639225 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-64148c4d-8169-4b75-a84a-8d931f9b41f7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:12.641421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-64148c4d-8169-4b75-a84a-8d931f9b41f7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:12.645923 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-64148c4d-8169-4b75-a84a-8d931f9b41f7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:12.646725 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-64148c4d-8169-4b75-a84a-8d931f9b41f7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:12.649439 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-64148c4d-8169-4b75-a84a-8d931f9b41f7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:12.742568 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ccfa1e72-2bc7-4909-aece-78550c20c29d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:12.743671 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ccfa1e72-2bc7-4909-aece-78550c20c29d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:12.759136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ccfa1e72-2bc7-4909-aece-78550c20c29d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:12.760143 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ccfa1e72-2bc7-4909-aece-78550c20c29d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:12.761752 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ccfa1e72-2bc7-4909-aece-78550c20c29d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:12.762697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ccfa1e72-2bc7-4909-aece-78550c20c29d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:12.769582 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ccfa1e72-2bc7-4909-aece-78550c20c29d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:12.770543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ccfa1e72-2bc7-4909-aece-78550c20c29d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:13.218805 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-64148c4d-8169-4b75-a84a-8d931f9b41f7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:13.229053 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-64148c4d-8169-4b75-a84a-8d931f9b41f7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:13.230733 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-64148c4d-8169-4b75-a84a-8d931f9b41f7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:13.231938 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-64148c4d-8169-4b75-a84a-8d931f9b41f7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 1814 microversion: 2.25 time: 0.622920 Sep 17 20:55:13.232648 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 538/1100] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:12 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 1814 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:13.239617 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8795de1a-87fd-4a1a-9d69-dab22ad5017d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:13.242789 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8795de1a-87fd-4a1a-9d69-dab22ad5017d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:13.250282 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8795de1a-87fd-4a1a-9d69-dab22ad5017d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:13.251103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8795de1a-87fd-4a1a-9d69-dab22ad5017d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:13.251685 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8795de1a-87fd-4a1a-9d69-dab22ad5017d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:13.252548 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8795de1a-87fd-4a1a-9d69-dab22ad5017d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:13.253146 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8795de1a-87fd-4a1a-9d69-dab22ad5017d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:13.253888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8795de1a-87fd-4a1a-9d69-dab22ad5017d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:13.294693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ccfa1e72-2bc7-4909-aece-78550c20c29d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:13.306221 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ccfa1e72-2bc7-4909-aece-78550c20c29d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1513 microversion: 2.1 time: 0.569001 Sep 17 20:55:13.308890 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 563/1101] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:12 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1513 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:13.325899 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-29212d0e-7bdb-4e2c-9741-5f331915dbb1 req-bfda726c-8fc1-4c37-a4e7-d2985c0fcd48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "560c9626-f97e-4bc8-a2a9-942ddb969ccc", "name": "network-vif-unplugged", "status": "completed", "tag": "41a6b4dc-39d8-4713-bf4d-91efa6a5c055"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:13.338021 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-29212d0e-7bdb-4e2c-9741-5f331915dbb1 req-bfda726c-8fc1-4c37-a4e7-d2985c0fcd48 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:13.338773 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-29212d0e-7bdb-4e2c-9741-5f331915dbb1 req-bfda726c-8fc1-4c37-a4e7-d2985c0fcd48 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:13.339606 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-29212d0e-7bdb-4e2c-9741-5f331915dbb1 req-bfda726c-8fc1-4c37-a4e7-d2985c0fcd48 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:13.367899 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-29212d0e-7bdb-4e2c-9741-5f331915dbb1 req-bfda726c-8fc1-4c37-a4e7-d2985c0fcd48 service nova] Creating event network-vif-unplugged:41a6b4dc-39d8-4713-bf4d-91efa6a5c055 for instance 560c9626-f97e-4bc8-a2a9-942ddb969ccc on nch1-master-1 Sep 17 20:55:13.380278 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [req-29212d0e-7bdb-4e2c-9741-5f331915dbb1 req-bfda726c-8fc1-4c37-a4e7-d2985c0fcd48 service nova] Instance 560c9626-f97e-4bc8-a2a9-942ddb969ccc is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140524) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 20:55:13.395504 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-29212d0e-7bdb-4e2c-9741-5f331915dbb1 req-bfda726c-8fc1-4c37-a4e7-d2985c0fcd48 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085008 Sep 17 20:55:13.396768 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 564/1102] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:13.464503 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-29ebe452-8789-4bce-a29d-e8afd221d074 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:13.465404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-29ebe452-8789-4bce-a29d-e8afd221d074 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:13.477894 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-29ebe452-8789-4bce-a29d-e8afd221d074 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:13.482971 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-29ebe452-8789-4bce-a29d-e8afd221d074 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:13.486133 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-29ebe452-8789-4bce-a29d-e8afd221d074 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:13.487165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-29ebe452-8789-4bce-a29d-e8afd221d074 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:13.487803 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-29ebe452-8789-4bce-a29d-e8afd221d074 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:13.488388 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-29ebe452-8789-4bce-a29d-e8afd221d074 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:13.789188 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8795de1a-87fd-4a1a-9d69-dab22ad5017d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:13.800022 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8795de1a-87fd-4a1a-9d69-dab22ad5017d tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1469 microversion: 2.1 time: 0.565725 Sep 17 20:55:13.801569 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 539/1103] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:13 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1469 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:13.829356 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-29ebe452-8789-4bce-a29d-e8afd221d074 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:13.846163 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-29ebe452-8789-4bce-a29d-e8afd221d074 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1361 microversion: 2.1 time: 0.389035 Sep 17 20:55:13.847093 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 565/1104] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:13 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1361 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:14.262503 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c7529d33-4e4e-48cd-8e93-3694ff61f74a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:14.263130 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c7529d33-4e4e-48cd-8e93-3694ff61f74a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:14.281120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c7529d33-4e4e-48cd-8e93-3694ff61f74a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:14.283459 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c7529d33-4e4e-48cd-8e93-3694ff61f74a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:14.284078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c7529d33-4e4e-48cd-8e93-3694ff61f74a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:14.284972 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c7529d33-4e4e-48cd-8e93-3694ff61f74a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:14.287653 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c7529d33-4e4e-48cd-8e93-3694ff61f74a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:14.288406 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c7529d33-4e4e-48cd-8e93-3694ff61f74a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:14.334274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-123cadda-75d7-4fbd-8a8f-77103cac38c3 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:14.335351 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-123cadda-75d7-4fbd-8a8f-77103cac38c3 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:14.348318 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:14.355616 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-123cadda-75d7-4fbd-8a8f-77103cac38c3 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:14.356612 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-123cadda-75d7-4fbd-8a8f-77103cac38c3 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:14.359164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-123cadda-75d7-4fbd-8a8f-77103cac38c3 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:14.361956 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-123cadda-75d7-4fbd-8a8f-77103cac38c3 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:14.365712 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-123cadda-75d7-4fbd-8a8f-77103cac38c3 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:14.367861 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-123cadda-75d7-4fbd-8a8f-77103cac38c3 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:14.856222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-123cadda-75d7-4fbd-8a8f-77103cac38c3 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:14.873874 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-123cadda-75d7-4fbd-8a8f-77103cac38c3 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1513 microversion: 2.1 time: 0.544704 Sep 17 20:55:14.877599 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 566/1105] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:14 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1513 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:55:14.899211 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4d5526f6-a55a-4c1d-8d23-cdc25d39297c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:14.900195 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4d5526f6-a55a-4c1d-8d23-cdc25d39297c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:14.903034 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=83,nova_api:UPDATE=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:14.910402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d5526f6-a55a-4c1d-8d23-cdc25d39297c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:14.911155 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d5526f6-a55a-4c1d-8d23-cdc25d39297c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:14.911795 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d5526f6-a55a-4c1d-8d23-cdc25d39297c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:14.912901 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d5526f6-a55a-4c1d-8d23-cdc25d39297c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:14.913634 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d5526f6-a55a-4c1d-8d23-cdc25d39297c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:14.914833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d5526f6-a55a-4c1d-8d23-cdc25d39297c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:15.125374 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c7529d33-4e4e-48cd-8e93-3694ff61f74a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:15.144112 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c7529d33-4e4e-48cd-8e93-3694ff61f74a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:15.149350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c7529d33-4e4e-48cd-8e93-3694ff61f74a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:15.152975 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c7529d33-4e4e-48cd-8e93-3694ff61f74a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 1814 microversion: 2.25 time: 0.893267 Sep 17 20:55:15.154093 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 540/1106] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:14 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 1814 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:15.164848 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e0286811-5fcd-40e0-9a88-25464dbff4a5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:15.165762 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e0286811-5fcd-40e0-9a88-25464dbff4a5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:15.175596 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0286811-5fcd-40e0-9a88-25464dbff4a5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:15.176441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0286811-5fcd-40e0-9a88-25464dbff4a5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:15.177370 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0286811-5fcd-40e0-9a88-25464dbff4a5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:15.180372 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0286811-5fcd-40e0-9a88-25464dbff4a5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:15.181081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0286811-5fcd-40e0-9a88-25464dbff4a5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:15.181995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0286811-5fcd-40e0-9a88-25464dbff4a5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:15.311725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4d5526f6-a55a-4c1d-8d23-cdc25d39297c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:15.327323 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4d5526f6-a55a-4c1d-8d23-cdc25d39297c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1469 microversion: 2.1 time: 0.448086 Sep 17 20:55:15.341491 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 567/1107] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:14 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1469 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:15.494251 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-4a8a7578-00a9-44fd-9b5c-e77d6a73481e req-06c1e458-9d56-483e-98f2-30040aed9ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "560c9626-f97e-4bc8-a2a9-942ddb969ccc", "tag": "41a6b4dc-39d8-4713-bf4d-91efa6a5c055"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:15.513505 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4a8a7578-00a9-44fd-9b5c-e77d6a73481e req-06c1e458-9d56-483e-98f2-30040aed9ea3 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:15.513986 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4a8a7578-00a9-44fd-9b5c-e77d6a73481e req-06c1e458-9d56-483e-98f2-30040aed9ea3 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:15.524830 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4a8a7578-00a9-44fd-9b5c-e77d6a73481e req-06c1e458-9d56-483e-98f2-30040aed9ea3 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:15.577362 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-4a8a7578-00a9-44fd-9b5c-e77d6a73481e req-06c1e458-9d56-483e-98f2-30040aed9ea3 service nova] Creating event network-changed:41a6b4dc-39d8-4713-bf4d-91efa6a5c055 for instance 560c9626-f97e-4bc8-a2a9-942ddb969ccc on nch1-master-1 Sep 17 20:55:15.593786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [req-4a8a7578-00a9-44fd-9b5c-e77d6a73481e req-06c1e458-9d56-483e-98f2-30040aed9ea3 service nova] Instance 560c9626-f97e-4bc8-a2a9-942ddb969ccc is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140524) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 20:55:15.631339 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-4a8a7578-00a9-44fd-9b5c-e77d6a73481e req-06c1e458-9d56-483e-98f2-30040aed9ea3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140732 Sep 17 20:55:15.633202 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 568/1108] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:55:15.788887 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e0286811-5fcd-40e0-9a88-25464dbff4a5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:15.799861 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e0286811-5fcd-40e0-9a88-25464dbff4a5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1361 microversion: 2.1 time: 0.643178 Sep 17 20:55:15.804638 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 541/1109] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:15 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1361 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:15.902155 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fa9848f1-73f9-403d-b128-b159acc1b25a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:15.903333 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fa9848f1-73f9-403d-b128-b159acc1b25a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:15.913021 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa9848f1-73f9-403d-b128-b159acc1b25a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:15.923054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa9848f1-73f9-403d-b128-b159acc1b25a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:15.923520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa9848f1-73f9-403d-b128-b159acc1b25a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:15.924288 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa9848f1-73f9-403d-b128-b159acc1b25a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:15.925189 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa9848f1-73f9-403d-b128-b159acc1b25a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:15.925807 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa9848f1-73f9-403d-b128-b159acc1b25a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:16.183133 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0c5af0ef-a989-4af4-b3db-0d2ac64e26ef tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:16.184799 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0c5af0ef-a989-4af4-b3db-0d2ac64e26ef tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:16.197197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c5af0ef-a989-4af4-b3db-0d2ac64e26ef tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:16.198103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c5af0ef-a989-4af4-b3db-0d2ac64e26ef tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:16.198640 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c5af0ef-a989-4af4-b3db-0d2ac64e26ef tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:16.201056 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c5af0ef-a989-4af4-b3db-0d2ac64e26ef tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:16.201674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c5af0ef-a989-4af4-b3db-0d2ac64e26ef tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:16.202186 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c5af0ef-a989-4af4-b3db-0d2ac64e26ef tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:16.663881 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fa9848f1-73f9-403d-b128-b159acc1b25a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:16.680262 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fa9848f1-73f9-403d-b128-b159acc1b25a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1519 microversion: 2.1 time: 0.782594 Sep 17 20:55:16.682060 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 569/1110] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:15 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1519 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:16.682179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0c5af0ef-a989-4af4-b3db-0d2ac64e26ef tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:16.694946 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0c5af0ef-a989-4af4-b3db-0d2ac64e26ef tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:16.700669 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0c5af0ef-a989-4af4-b3db-0d2ac64e26ef tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:16.703188 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0c5af0ef-a989-4af4-b3db-0d2ac64e26ef tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 1814 microversion: 2.25 time: 0.524493 Sep 17 20:55:16.708591 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 542/1111] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:16 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 1814 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:16.721904 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-68108d0a-0431-4e2d-97a0-19d4befb25e7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:16.722530 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-68108d0a-0431-4e2d-97a0-19d4befb25e7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:16.783372 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68108d0a-0431-4e2d-97a0-19d4befb25e7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:16.783920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68108d0a-0431-4e2d-97a0-19d4befb25e7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:16.793165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68108d0a-0431-4e2d-97a0-19d4befb25e7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:16.800662 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68108d0a-0431-4e2d-97a0-19d4befb25e7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:16.801441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68108d0a-0431-4e2d-97a0-19d4befb25e7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:16.810212 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68108d0a-0431-4e2d-97a0-19d4befb25e7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:17.080333 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-895ab25a-5e96-4079-a393-9829d7e08c1b tempest-FlavorsAccessTestJSON-969148146 tempest-FlavorsAccessTestJSON-969148146-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1491350379", "id": 224722963, "os-flavor-access:is_public": "False"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:17.119906 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-895ab25a-5e96-4079-a393-9829d7e08c1b tempest-FlavorsAccessTestJSON-969148146 tempest-FlavorsAccessTestJSON-969148146-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.436656 Sep 17 20:55:17.129906 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 570/1112] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:55:16 2022] POST /compute/v2.1/flavors => generated 428 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:17.147573 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-829fbbf2-8132-4dda-ab82-cee14959ca7d tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:17.149497 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-829fbbf2-8132-4dda-ab82-cee14959ca7d tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:17.157319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-829fbbf2-8132-4dda-ab82-cee14959ca7d tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:17.158119 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-829fbbf2-8132-4dda-ab82-cee14959ca7d tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:17.158555 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-829fbbf2-8132-4dda-ab82-cee14959ca7d tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:17.160055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-829fbbf2-8132-4dda-ab82-cee14959ca7d tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:17.160933 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-829fbbf2-8132-4dda-ab82-cee14959ca7d tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:17.161560 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-829fbbf2-8132-4dda-ab82-cee14959ca7d tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:17.892322 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-829fbbf2-8132-4dda-ab82-cee14959ca7d tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:17.914113 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-829fbbf2-8132-4dda-ab82-cee14959ca7d tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1361 microversion: 2.1 time: 0.778640 Sep 17 20:55:17.926000 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 571/1113] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:17 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1361 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:17.954425 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-49fdcc7e-7d05-4043-8c22-284b745ef1a3 tempest-FlavorsAccessTestJSON-969148146 tempest-FlavorsAccessTestJSON-969148146-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "7e713977cb174684af5ef6158b6ed24f"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:18.090105 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-49fdcc7e-7d05-4043-8c22-284b745ef1a3 tempest-FlavorsAccessTestJSON-969148146 tempest-FlavorsAccessTestJSON-969148146-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/224722963/action" status: 200 len: 96 microversion: 2.1 time: 0.162534 Sep 17 20:55:18.092565 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 572/1114] 10.222.0.26 () {60 vars in 1197 bytes} [Sat Sep 17 20:55:17 2022] POST /compute/v2.1/flavors/224722963/action => generated 96 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:55:18.104553 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9941496b-9e78-408e-ab58-75dbbcb834b6 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:18.106702 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9941496b-9e78-408e-ab58-75dbbcb834b6 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:18.125005 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9941496b-9e78-408e-ab58-75dbbcb834b6 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:18.128066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9941496b-9e78-408e-ab58-75dbbcb834b6 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:18.129917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9941496b-9e78-408e-ab58-75dbbcb834b6 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:18.130880 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9941496b-9e78-408e-ab58-75dbbcb834b6 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:18.132856 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9941496b-9e78-408e-ab58-75dbbcb834b6 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:18.134267 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9941496b-9e78-408e-ab58-75dbbcb834b6 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:18.545762 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-68108d0a-0431-4e2d-97a0-19d4befb25e7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:18.557867 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-68108d0a-0431-4e2d-97a0-19d4befb25e7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1469 microversion: 2.1 time: 1.848099 Sep 17 20:55:18.574915 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 543/1115] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:16 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1469 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:18.580925 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5c614060-0b02-40cb-9766-89d31f6b2496 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:18.581709 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5c614060-0b02-40cb-9766-89d31f6b2496 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:18.599536 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c614060-0b02-40cb-9766-89d31f6b2496 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:18.600033 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c614060-0b02-40cb-9766-89d31f6b2496 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:18.603057 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c614060-0b02-40cb-9766-89d31f6b2496 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:18.604017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c614060-0b02-40cb-9766-89d31f6b2496 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:18.604644 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c614060-0b02-40cb-9766-89d31f6b2496 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:18.605236 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c614060-0b02-40cb-9766-89d31f6b2496 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:18.942403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9941496b-9e78-408e-ab58-75dbbcb834b6 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:18.962696 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9941496b-9e78-408e-ab58-75dbbcb834b6 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1519 microversion: 2.1 time: 0.870247 Sep 17 20:55:18.964116 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 573/1116] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:18 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1519 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:18.973364 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-7cfce9a3-83fb-44e1-8141-d735e2d3028c req-529c123e-150e-45d9-8184-5d1c7eb2e860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d60c84-b2e2-4376-a0ca-f0bee938fd9a", "name": "network-vif-plugged", "status": "completed", "tag": "94958f55-6b3e-41f2-a7f1-6dd835192bd3"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:18.986119 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7cfce9a3-83fb-44e1-8141-d735e2d3028c req-529c123e-150e-45d9-8184-5d1c7eb2e860 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:18.986717 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7cfce9a3-83fb-44e1-8141-d735e2d3028c req-529c123e-150e-45d9-8184-5d1c7eb2e860 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:18.987215 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7cfce9a3-83fb-44e1-8141-d735e2d3028c req-529c123e-150e-45d9-8184-5d1c7eb2e860 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:19.000526 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-7cfce9a3-83fb-44e1-8141-d735e2d3028c req-529c123e-150e-45d9-8184-5d1c7eb2e860 service nova] Creating event network-vif-plugged:94958f55-6b3e-41f2-a7f1-6dd835192bd3 for instance 46d60c84-b2e2-4376-a0ca-f0bee938fd9a on nch1-master-1 Sep 17 20:55:19.006495 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-7cfce9a3-83fb-44e1-8141-d735e2d3028c req-529c123e-150e-45d9-8184-5d1c7eb2e860 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040909 Sep 17 20:55:19.007630 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 574/1117] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:19.177101 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c5a1aaa0-19e2-46b9-a5b2-edd36b76068e tempest-FlavorsAccessTestJSON-1445356605 tempest-FlavorsAccessTestJSON-1445356605-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:19.209405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5c614060-0b02-40cb-9766-89d31f6b2496 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:19.220881 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c5a1aaa0-19e2-46b9-a5b2-edd36b76068e tempest-FlavorsAccessTestJSON-1445356605 tempest-FlavorsAccessTestJSON-1445356605-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.211655 Sep 17 20:55:19.223507 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 575/1118] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:55:19 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:19.224414 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5c614060-0b02-40cb-9766-89d31f6b2496 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:19.228490 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5c614060-0b02-40cb-9766-89d31f6b2496 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:19.230934 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b7ede218-1ef8-427f-8143-918accbd2811 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:19.231859 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5c614060-0b02-40cb-9766-89d31f6b2496 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 1814 microversion: 2.25 time: 0.659222 Sep 17 20:55:19.232454 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 544/1119] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:18 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 1814 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:19.233251 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b7ede218-1ef8-427f-8143-918accbd2811 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:19.245474 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b7ede218-1ef8-427f-8143-918accbd2811 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:19.246352 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b7ede218-1ef8-427f-8143-918accbd2811 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:19.247031 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b7ede218-1ef8-427f-8143-918accbd2811 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:19.247427 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ceeba930-cf03-43c6-a227-eedecd2f465b tempest-FlavorsAccessTestJSON-969148146 tempest-FlavorsAccessTestJSON-969148146-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "7e713977cb174684af5ef6158b6ed24f"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:19.248312 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b7ede218-1ef8-427f-8143-918accbd2811 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:19.248985 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b7ede218-1ef8-427f-8143-918accbd2811 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:19.249861 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b7ede218-1ef8-427f-8143-918accbd2811 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:19.376273 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:19.382079 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ceeba930-cf03-43c6-a227-eedecd2f465b tempest-FlavorsAccessTestJSON-969148146 tempest-FlavorsAccessTestJSON-969148146-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/224722963/action" status: 200 len: 21 microversion: 2.1 time: 0.138447 Sep 17 20:55:19.383817 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 545/1120] 10.222.0.26 () {60 vars in 1197 bytes} [Sat Sep 17 20:55:19 2022] POST /compute/v2.1/flavors/224722963/action => generated 21 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:55:19.399001 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cfbbf11e-85e5-4962-a9da-77469c84612a tempest-FlavorsAccessTestJSON-1445356605 tempest-FlavorsAccessTestJSON-1445356605-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:19.434625 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cfbbf11e-85e5-4962-a9da-77469c84612a tempest-FlavorsAccessTestJSON-1445356605 tempest-FlavorsAccessTestJSON-1445356605-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041634 Sep 17 20:55:19.455518 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 546/1121] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:55:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:19.461663 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2d5a8722-31e2-484e-ad0b-943e2224285e tempest-FlavorsAccessTestJSON-969148146 tempest-FlavorsAccessTestJSON-969148146-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:19.494648 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2d5a8722-31e2-484e-ad0b-943e2224285e tempest-FlavorsAccessTestJSON-969148146 tempest-FlavorsAccessTestJSON-969148146-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/224722963" status: 202 len: 0 microversion: 2.1 time: 0.037410 Sep 17 20:55:19.498090 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 547/1122] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Sep 17 20:55:19 2022] DELETE /compute/v2.1/flavors/224722963 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:55:19.504722 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f83f88e2-139a-459a-b4c3-da3f3665bfbf tempest-FlavorsAccessTestJSON-969148146 tempest-FlavorsAccessTestJSON-969148146-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:19.532311 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f83f88e2-139a-459a-b4c3-da3f3665bfbf tempest-FlavorsAccessTestJSON-969148146 tempest-FlavorsAccessTestJSON-969148146-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031603 Sep 17 20:55:19.533281 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 548/1123] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:55:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:19.554808 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b7839fbf-0984-4be9-9e46-ef76a9f533a6 tempest-FlavorsAccessTestJSON-969148146 tempest-FlavorsAccessTestJSON-969148146-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-626620475", "id": 1540667765, "os-flavor-access:is_public": "False"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:19.578642 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b7839fbf-0984-4be9-9e46-ef76a9f533a6 tempest-FlavorsAccessTestJSON-969148146 tempest-FlavorsAccessTestJSON-969148146-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.027746 Sep 17 20:55:19.586728 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 549/1124] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:55:19 2022] POST /compute/v2.1/flavors => generated 430 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:55:19.594950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b77956fa-e2a8-4d9f-842d-01f5609a8676 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:19.595639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b77956fa-e2a8-4d9f-842d-01f5609a8676 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:19.603310 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b77956fa-e2a8-4d9f-842d-01f5609a8676 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:19.603851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b77956fa-e2a8-4d9f-842d-01f5609a8676 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:19.604431 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b77956fa-e2a8-4d9f-842d-01f5609a8676 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:19.605829 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b77956fa-e2a8-4d9f-842d-01f5609a8676 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:19.606290 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b77956fa-e2a8-4d9f-842d-01f5609a8676 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:19.606753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b77956fa-e2a8-4d9f-842d-01f5609a8676 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:19.801995 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b7ede218-1ef8-427f-8143-918accbd2811 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:19.814380 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b7ede218-1ef8-427f-8143-918accbd2811 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1361 microversion: 2.1 time: 0.588853 Sep 17 20:55:19.830525 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 576/1125] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:19 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1361 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:19.840349 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4334f8b2-5901-43c2-980d-e7cc97628730 tempest-FlavorsAccessTestJSON-969148146 tempest-FlavorsAccessTestJSON-969148146-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:19.863124 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4334f8b2-5901-43c2-980d-e7cc97628730 tempest-FlavorsAccessTestJSON-969148146 tempest-FlavorsAccessTestJSON-969148146-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/1540667765/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.032926 Sep 17 20:55:19.864106 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 577/1126] 10.222.0.26 () {58 vars in 1209 bytes} [Sat Sep 17 20:55:19 2022] GET /compute/v2.1/flavors/1540667765/os-flavor-access => generated 21 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:55:19.874495 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-103edfdd-f825-439b-9af2-25b35e0ec4f0 tempest-FlavorsAccessTestJSON-969148146 tempest-FlavorsAccessTestJSON-969148146-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:19.898394 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-103edfdd-f825-439b-9af2-25b35e0ec4f0 tempest-FlavorsAccessTestJSON-969148146 tempest-FlavorsAccessTestJSON-969148146-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1540667765" status: 202 len: 0 microversion: 2.1 time: 0.026860 Sep 17 20:55:19.899087 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 578/1127] 10.222.0.26 () {58 vars in 1161 bytes} [Sat Sep 17 20:55:19 2022] DELETE /compute/v2.1/flavors/1540667765 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:55:19.909041 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7f430624-3f5f-431f-b09a-2610392db6db tempest-FlavorsAccessTestJSON-969148146 tempest-FlavorsAccessTestJSON-969148146-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:19.932646 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7f430624-3f5f-431f-b09a-2610392db6db tempest-FlavorsAccessTestJSON-969148146 tempest-FlavorsAccessTestJSON-969148146-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028420 Sep 17 20:55:19.933306 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 579/1128] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:55:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:19.986572 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-983daa86-6387-4684-b4b5-7cb4b52cabcd tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:19.987331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-983daa86-6387-4684-b4b5-7cb4b52cabcd tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:19.994897 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-983daa86-6387-4684-b4b5-7cb4b52cabcd tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:19.996238 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-983daa86-6387-4684-b4b5-7cb4b52cabcd tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:19.996932 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-983daa86-6387-4684-b4b5-7cb4b52cabcd tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:19.997895 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-983daa86-6387-4684-b4b5-7cb4b52cabcd tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:19.998562 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-983daa86-6387-4684-b4b5-7cb4b52cabcd tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:19.999193 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-983daa86-6387-4684-b4b5-7cb4b52cabcd tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:20.079707 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b77956fa-e2a8-4d9f-842d-01f5609a8676 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:20.109959 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b77956fa-e2a8-4d9f-842d-01f5609a8676 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1462 microversion: 2.1 time: 0.522314 Sep 17 20:55:20.117050 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 550/1129] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:19 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1462 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:20.146679 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ff6bbd3f-09a9-4f55-be94-55e32fef5b5b tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:20.148167 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ff6bbd3f-09a9-4f55-be94-55e32fef5b5b tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:20.158685 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff6bbd3f-09a9-4f55-be94-55e32fef5b5b tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:20.159453 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff6bbd3f-09a9-4f55-be94-55e32fef5b5b tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:20.160051 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff6bbd3f-09a9-4f55-be94-55e32fef5b5b tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:20.161036 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff6bbd3f-09a9-4f55-be94-55e32fef5b5b tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:20.161949 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff6bbd3f-09a9-4f55-be94-55e32fef5b5b tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:20.162612 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff6bbd3f-09a9-4f55-be94-55e32fef5b5b tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:20.531564 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-983daa86-6387-4684-b4b5-7cb4b52cabcd tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:20.542860 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-983daa86-6387-4684-b4b5-7cb4b52cabcd tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1519 microversion: 2.1 time: 0.560360 Sep 17 20:55:20.546364 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 580/1130] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:19 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1519 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:55:20.561158 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5666a9d3-7648-4209-8dfc-011165947c03 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:20.562361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5666a9d3-7648-4209-8dfc-011165947c03 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:20.577543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5666a9d3-7648-4209-8dfc-011165947c03 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:20.581435 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5666a9d3-7648-4209-8dfc-011165947c03 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:20.582754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5666a9d3-7648-4209-8dfc-011165947c03 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:20.589735 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5666a9d3-7648-4209-8dfc-011165947c03 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:20.591021 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5666a9d3-7648-4209-8dfc-011165947c03 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:20.591779 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5666a9d3-7648-4209-8dfc-011165947c03 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:20.678820 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:20.810065 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ff6bbd3f-09a9-4f55-be94-55e32fef5b5b tempest-MigrationsAdminTest-1954676359 tempest-MigrationsAdminTest-1954676359-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1613 microversion: 2.1 time: 0.670751 Sep 17 20:55:20.814757 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 551/1131] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:20 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1613 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:20.841797 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9238459d-b0ae-4c73-b264-670d207a0c05 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:20.843368 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9238459d-b0ae-4c73-b264-670d207a0c05 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:20.854096 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9238459d-b0ae-4c73-b264-670d207a0c05 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:20.854611 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9238459d-b0ae-4c73-b264-670d207a0c05 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:20.855068 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9238459d-b0ae-4c73-b264-670d207a0c05 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:20.855799 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9238459d-b0ae-4c73-b264-670d207a0c05 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:20.858822 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9238459d-b0ae-4c73-b264-670d207a0c05 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:20.859282 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9238459d-b0ae-4c73-b264-670d207a0c05 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:20.896890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9238459d-b0ae-4c73-b264-670d207a0c05 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:55:21.017583 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9238459d-b0ae-4c73-b264-670d207a0c05 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "DELETE /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 204 len: 0 microversion: 2.1 time: 0.180045 Sep 17 20:55:21.021411 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 552/1132] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:55:20 2022] DELETE /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 17 20:55:21.027495 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6d91b169-1ed8-4567-94ce-9daadba236d5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:21.028601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6d91b169-1ed8-4567-94ce-9daadba236d5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:21.037749 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d91b169-1ed8-4567-94ce-9daadba236d5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:21.038512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d91b169-1ed8-4567-94ce-9daadba236d5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:21.040004 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d91b169-1ed8-4567-94ce-9daadba236d5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:21.040964 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d91b169-1ed8-4567-94ce-9daadba236d5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:21.041624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d91b169-1ed8-4567-94ce-9daadba236d5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:21.042210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d91b169-1ed8-4567-94ce-9daadba236d5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:21.073605 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5666a9d3-7648-4209-8dfc-011165947c03 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:21.086258 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5666a9d3-7648-4209-8dfc-011165947c03 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:21.093055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5666a9d3-7648-4209-8dfc-011165947c03 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:21.094852 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5666a9d3-7648-4209-8dfc-011165947c03 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 1814 microversion: 2.25 time: 0.547269 Sep 17 20:55:21.095448 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 581/1133] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:20 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 1814 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:21.114351 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9b265f3c-95a3-4315-bb77-ff4aff1a5fc7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:21.126901 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9b265f3c-95a3-4315-bb77-ff4aff1a5fc7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:21.138914 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b265f3c-95a3-4315-bb77-ff4aff1a5fc7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:21.139949 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b265f3c-95a3-4315-bb77-ff4aff1a5fc7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:21.140632 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b265f3c-95a3-4315-bb77-ff4aff1a5fc7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:21.141863 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b265f3c-95a3-4315-bb77-ff4aff1a5fc7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:21.142705 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b265f3c-95a3-4315-bb77-ff4aff1a5fc7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:21.143573 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b265f3c-95a3-4315-bb77-ff4aff1a5fc7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:21.414889 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6d91b169-1ed8-4567-94ce-9daadba236d5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:21.424108 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6d91b169-1ed8-4567-94ce-9daadba236d5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1361 microversion: 2.1 time: 0.403088 Sep 17 20:55:21.428856 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 553/1134] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:21 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1361 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:21.437576 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-9b1ac2bb-1935-4039-a910-c64669add351 req-029b85e2-57e3-43dd-8cca-887c694d555f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdc5c241-5abc-4fde-b458-961a9cd5eb4c", "name": "network-vif-unplugged", "status": "completed", "tag": "f6aa453c-b788-41f9-8c99-9269c4f81d7b"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:21.458051 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-9b1ac2bb-1935-4039-a910-c64669add351 req-029b85e2-57e3-43dd-8cca-887c694d555f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:21.462639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-9b1ac2bb-1935-4039-a910-c64669add351 req-029b85e2-57e3-43dd-8cca-887c694d555f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:21.463693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-9b1ac2bb-1935-4039-a910-c64669add351 req-029b85e2-57e3-43dd-8cca-887c694d555f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:21.520752 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9b265f3c-95a3-4315-bb77-ff4aff1a5fc7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:21.538524 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9b265f3c-95a3-4315-bb77-ff4aff1a5fc7 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1468 microversion: 2.1 time: 0.441116 Sep 17 20:55:21.540665 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 582/1135] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:21 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1468 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:21.551587 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bcaf47bf-a6f1-4528-b89b-17ed61a16233 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Action: 'create', calling method: .version_select at 0x7f25a5715ca0>, body: {"keypair": {"name": "tempest-keypair-1111928329", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjZ5RIZF43EsQElPotb8C+zydYzseocPipeRTrSrOsgeL3mHcvp5C94Xz1X7DpthM5ptS7sB7K5M6kAVTTdPLS3kqLshmvTuItdkdLSphdb/irViwlkZySbZF8UYBeEyg=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:21.570861 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-9b1ac2bb-1935-4039-a910-c64669add351 req-029b85e2-57e3-43dd-8cca-887c694d555f service nova] Creating event network-vif-unplugged:f6aa453c-b788-41f9-8c99-9269c4f81d7b for instance fdc5c241-5abc-4fde-b458-961a9cd5eb4c on nch2-master-1 Sep 17 20:55:21.592341 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-bcaf47bf-a6f1-4528-b89b-17ed61a16233 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Getting quotas for project 822801d3963d45c1b4176259fb5c5b19. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:55:21.594976 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-9b1ac2bb-1935-4039-a910-c64669add351 req-029b85e2-57e3-43dd-8cca-887c694d555f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.163226 Sep 17 20:55:21.598071 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 554/1136] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:21.603150 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-bcaf47bf-a6f1-4528-b89b-17ed61a16233 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Getting quotas for user 55e8e491f8844f7696f93d8ec5a7171b and project 822801d3963d45c1b4176259fb5c5b19. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:55:21.613437 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e23b5e84-b3a7-45d9-ab98-aa90c22d80fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:21.617588 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e23b5e84-b3a7-45d9-ab98-aa90c22d80fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:21.637638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e23b5e84-b3a7-45d9-ab98-aa90c22d80fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:21.641197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e23b5e84-b3a7-45d9-ab98-aa90c22d80fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:21.643408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e23b5e84-b3a7-45d9-ab98-aa90c22d80fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:21.644727 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e23b5e84-b3a7-45d9-ab98-aa90c22d80fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:21.648524 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e23b5e84-b3a7-45d9-ab98-aa90c22d80fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:21.650183 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e23b5e84-b3a7-45d9-ab98-aa90c22d80fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:21.678031 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bcaf47bf-a6f1-4528-b89b-17ed61a16233 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.135613 Sep 17 20:55:21.678808 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 583/1137] 10.222.0.26 () {62 vars in 1200 bytes} [Sat Sep 17 20:55:21 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 137 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 17 20:55:22.038644 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e23b5e84-b3a7-45d9-ab98-aa90c22d80fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:22.056216 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e23b5e84-b3a7-45d9-ab98-aa90c22d80fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1519 microversion: 2.1 time: 0.456573 Sep 17 20:55:22.058926 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 555/1138] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:21 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1519 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:22.124784 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-533d6bc3-c542-4455-bed7-c2aaaf4103af tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:22.125885 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-533d6bc3-c542-4455-bed7-c2aaaf4103af tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:22.143700 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-533d6bc3-c542-4455-bed7-c2aaaf4103af tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:22.144345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-533d6bc3-c542-4455-bed7-c2aaaf4103af tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:22.144845 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-533d6bc3-c542-4455-bed7-c2aaaf4103af tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:22.145824 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-533d6bc3-c542-4455-bed7-c2aaaf4103af tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:22.146392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-533d6bc3-c542-4455-bed7-c2aaaf4103af tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:22.146978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-533d6bc3-c542-4455-bed7-c2aaaf4103af tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:22.454564 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2b719851-1c14-4167-997d-43a535e21c29 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:22.455240 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2b719851-1c14-4167-997d-43a535e21c29 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:22.467122 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b719851-1c14-4167-997d-43a535e21c29 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:22.468034 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b719851-1c14-4167-997d-43a535e21c29 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:22.469733 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b719851-1c14-4167-997d-43a535e21c29 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:22.470773 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b719851-1c14-4167-997d-43a535e21c29 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:22.472316 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b719851-1c14-4167-997d-43a535e21c29 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:22.472896 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b719851-1c14-4167-997d-43a535e21c29 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:22.966594 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-533d6bc3-c542-4455-bed7-c2aaaf4103af tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:22.979514 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-533d6bc3-c542-4455-bed7-c2aaaf4103af tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:22.981173 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-533d6bc3-c542-4455-bed7-c2aaaf4103af tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:22.982893 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-533d6bc3-c542-4455-bed7-c2aaaf4103af tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 1814 microversion: 2.25 time: 0.863802 Sep 17 20:55:22.983940 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 584/1139] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:22 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 1814 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:22.990124 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-963f42eb-c176-464e-a4b3-e3db80051323 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:22.991119 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-963f42eb-c176-464e-a4b3-e3db80051323 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:23.000202 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-963f42eb-c176-464e-a4b3-e3db80051323 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:23.001175 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-963f42eb-c176-464e-a4b3-e3db80051323 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:23.001866 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-963f42eb-c176-464e-a4b3-e3db80051323 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:23.003466 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-963f42eb-c176-464e-a4b3-e3db80051323 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:23.004185 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-963f42eb-c176-464e-a4b3-e3db80051323 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:23.004828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-963f42eb-c176-464e-a4b3-e3db80051323 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:23.164725 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2b719851-1c14-4167-997d-43a535e21c29 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:23.176499 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2b719851-1c14-4167-997d-43a535e21c29 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1544 microversion: 2.1 time: 0.726471 Sep 17 20:55:23.179106 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 556/1140] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:22 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1544 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:23.195260 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-87e41461-8628-4e8b-9520-410d7c726926 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:23.196267 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-87e41461-8628-4e8b-9520-410d7c726926 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:23.212088 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87e41461-8628-4e8b-9520-410d7c726926 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:23.212711 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87e41461-8628-4e8b-9520-410d7c726926 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:23.213252 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87e41461-8628-4e8b-9520-410d7c726926 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:23.214049 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87e41461-8628-4e8b-9520-410d7c726926 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:23.216787 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87e41461-8628-4e8b-9520-410d7c726926 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:23.217224 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87e41461-8628-4e8b-9520-410d7c726926 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:23.223968 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:23.365920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-963f42eb-c176-464e-a4b3-e3db80051323 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:23.374868 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-963f42eb-c176-464e-a4b3-e3db80051323 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1468 microversion: 2.1 time: 0.389446 Sep 17 20:55:23.375709 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 585/1141] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:22 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1468 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:23.399262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5613fdba-40bd-4950-99db-7039aa426072 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:23.400046 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5613fdba-40bd-4950-99db-7039aa426072 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:23.406739 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5613fdba-40bd-4950-99db-7039aa426072 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:23.407889 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5613fdba-40bd-4950-99db-7039aa426072 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:23.408497 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5613fdba-40bd-4950-99db-7039aa426072 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:23.409398 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5613fdba-40bd-4950-99db-7039aa426072 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:23.410066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5613fdba-40bd-4950-99db-7039aa426072 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:23.410658 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5613fdba-40bd-4950-99db-7039aa426072 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:23.460254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-87e41461-8628-4e8b-9520-410d7c726926 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:23.474382 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-87e41461-8628-4e8b-9520-410d7c726926 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1519 microversion: 2.1 time: 0.293988 Sep 17 20:55:23.475219 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 557/1142] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:23 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1519 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:23.534826 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5613fdba-40bd-4950-99db-7039aa426072 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.146386 Sep 17 20:55:23.535573 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 586/1143] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Sep 17 20:55:23 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:23.650344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-ca147489-e29f-4ab8-9a01-d35676cdddda req-c9f7f6ad-c492-4cca-80a8-896c6314b09f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdc5c241-5abc-4fde-b458-961a9cd5eb4c", "name": "network-vif-plugged", "status": "completed", "tag": "f6aa453c-b788-41f9-8c99-9269c4f81d7b"}, {"server_uuid": "560c9626-f97e-4bc8-a2a9-942ddb969ccc", "name": "network-vif-plugged", "status": "completed", "tag": "41a6b4dc-39d8-4713-bf4d-91efa6a5c055"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:23.674640 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-ca147489-e29f-4ab8-9a01-d35676cdddda req-c9f7f6ad-c492-4cca-80a8-896c6314b09f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:23.675175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-ca147489-e29f-4ab8-9a01-d35676cdddda req-c9f7f6ad-c492-4cca-80a8-896c6314b09f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:23.675829 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-ca147489-e29f-4ab8-9a01-d35676cdddda req-c9f7f6ad-c492-4cca-80a8-896c6314b09f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:23.698004 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-ca147489-e29f-4ab8-9a01-d35676cdddda req-c9f7f6ad-c492-4cca-80a8-896c6314b09f service nova] Creating event network-vif-plugged:f6aa453c-b788-41f9-8c99-9269c4f81d7b for instance fdc5c241-5abc-4fde-b458-961a9cd5eb4c on nch2-master-1 Sep 17 20:55:23.698859 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-ca147489-e29f-4ab8-9a01-d35676cdddda req-c9f7f6ad-c492-4cca-80a8-896c6314b09f service nova] Creating event network-vif-plugged:41a6b4dc-39d8-4713-bf4d-91efa6a5c055 for instance 560c9626-f97e-4bc8-a2a9-942ddb969ccc on nch1-master-1 Sep 17 20:55:23.709748 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-ca147489-e29f-4ab8-9a01-d35676cdddda req-c9f7f6ad-c492-4cca-80a8-896c6314b09f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.064242 Sep 17 20:55:23.710882 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 558/1144] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:24.009069 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5c7f6abc-fb54-4ef8-936c-e8b1ee628fd5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:24.010375 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5c7f6abc-fb54-4ef8-936c-e8b1ee628fd5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:24.021559 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c7f6abc-fb54-4ef8-936c-e8b1ee628fd5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:24.022736 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c7f6abc-fb54-4ef8-936c-e8b1ee628fd5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:24.023351 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c7f6abc-fb54-4ef8-936c-e8b1ee628fd5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:24.024300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c7f6abc-fb54-4ef8-936c-e8b1ee628fd5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:24.024953 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c7f6abc-fb54-4ef8-936c-e8b1ee628fd5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:24.025658 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c7f6abc-fb54-4ef8-936c-e8b1ee628fd5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:24.267742 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dfb835c2-314b-41c9-b67c-faba76296ae9 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1902241339", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "e22b772d-b0c9-4969-ab28-d49290c4dbc1"}, {"port": "6825902e-5439-42f2-847a-d4c7f3aaf775", "tag": "port-1"}, {"port": "650223c4-4cf1-497c-9804-f7fb7d683a92", "tag": "port-2"}, {"uuid": "f901b57d-2954-4749-a524-c53cc09e37d9", "tag": "net-1"}, {"uuid": "f901b57d-2954-4749-a524-c53cc09e37d9"}, {"uuid": "0cde24a5-a5b5-4af1-ad86-7dd9429ac6ff", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "0cde24a5-a5b5-4af1-ad86-7dd9429ac6ff", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "99848cf4-d1b1-4750-bd2d-84def7a9a754", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "39a25695-6a20-4519-b4cc-233d172fde0a", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "1a721e0a-0c66-4cab-9a36-ed78def77377", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1944461545"}], "key_name": "tempest-keypair-1111928329", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:24.538399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-dfb835c2-314b-41c9-b67c-faba76296ae9 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] validate_networks() for [('e22b772d-b0c9-4969-ab28-d49290c4dbc1', None, None, None, None, None), (None, None, '6825902e-5439-42f2-847a-d4c7f3aaf775', None, None, None), (None, None, '650223c4-4cf1-497c-9804-f7fb7d683a92', None, None, None), ('f901b57d-2954-4749-a524-c53cc09e37d9', None, None, None, None, None), ('f901b57d-2954-4749-a524-c53cc09e37d9', None, None, None, None, None), ('0cde24a5-a5b5-4af1-ad86-7dd9429ac6ff', '10.2.2.100', None, None, None, None), ('0cde24a5-a5b5-4af1-ad86-7dd9429ac6ff', '10.2.2.200', None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:55:24.539484 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5c7f6abc-fb54-4ef8-936c-e8b1ee628fd5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:24.549828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5c7f6abc-fb54-4ef8-936c-e8b1ee628fd5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:24.551348 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5c7f6abc-fb54-4ef8-936c-e8b1ee628fd5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:24.558543 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5c7f6abc-fb54-4ef8-936c-e8b1ee628fd5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 1814 microversion: 2.25 time: 0.554046 Sep 17 20:55:24.563885 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 587/1145] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:24 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 1814 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:24.586310 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a7e1a467-6a8f-4a81-8161-9ee72d20a09c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:24.586974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a7e1a467-6a8f-4a81-8161-9ee72d20a09c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:24.606960 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7e1a467-6a8f-4a81-8161-9ee72d20a09c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:24.607686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7e1a467-6a8f-4a81-8161-9ee72d20a09c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:24.608917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7e1a467-6a8f-4a81-8161-9ee72d20a09c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:24.609980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7e1a467-6a8f-4a81-8161-9ee72d20a09c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:24.610603 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7e1a467-6a8f-4a81-8161-9ee72d20a09c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:24.611222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7e1a467-6a8f-4a81-8161-9ee72d20a09c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:25.077687 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a7e1a467-6a8f-4a81-8161-9ee72d20a09c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:25.094011 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a7e1a467-6a8f-4a81-8161-9ee72d20a09c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 200 len: 1468 microversion: 2.1 time: 0.528569 Sep 17 20:55:25.095418 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 588/1146] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:24 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 1468 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:25.111804 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f87f69fa-287c-4ac3-b393-ad24363cd9fa tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:25.115970 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f87f69fa-287c-4ac3-b393-ad24363cd9fa tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:25.134349 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f87f69fa-287c-4ac3-b393-ad24363cd9fa tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:25.135129 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f87f69fa-287c-4ac3-b393-ad24363cd9fa tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:25.135750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f87f69fa-287c-4ac3-b393-ad24363cd9fa tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:25.137325 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f87f69fa-287c-4ac3-b393-ad24363cd9fa tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:25.138097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f87f69fa-287c-4ac3-b393-ad24363cd9fa tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:25.139607 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f87f69fa-287c-4ac3-b393-ad24363cd9fa tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:25.775408 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f87f69fa-287c-4ac3-b393-ad24363cd9fa tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:25.799616 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f87f69fa-287c-4ac3-b393-ad24363cd9fa tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1519 microversion: 2.1 time: 0.702851 Sep 17 20:55:25.803692 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 589/1147] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:25 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1519 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:25.819457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-c605fe70-370f-43ee-a5cd-701b98e185f9 req-87ba4cc8-c083-4666-ae03-4fab80324e55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "796a6ed8-e44a-4e34-849d-1daeb1f363dd", "name": "network-vif-unplugged", "status": "completed", "tag": "3825b5cf-93a8-4a37-b807-cab157be9707"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:25.891645 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c605fe70-370f-43ee-a5cd-701b98e185f9 req-87ba4cc8-c083-4666-ae03-4fab80324e55 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:25.892615 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c605fe70-370f-43ee-a5cd-701b98e185f9 req-87ba4cc8-c083-4666-ae03-4fab80324e55 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:25.893235 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c605fe70-370f-43ee-a5cd-701b98e185f9 req-87ba4cc8-c083-4666-ae03-4fab80324e55 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:25.941523 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-c605fe70-370f-43ee-a5cd-701b98e185f9 req-87ba4cc8-c083-4666-ae03-4fab80324e55 service nova] Creating event network-vif-unplugged:3825b5cf-93a8-4a37-b807-cab157be9707 for instance 796a6ed8-e44a-4e34-849d-1daeb1f363dd on nch2-master-1 Sep 17 20:55:25.964701 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-c605fe70-370f-43ee-a5cd-701b98e185f9 req-87ba4cc8-c083-4666-ae03-4fab80324e55 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.152662 Sep 17 20:55:25.972011 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 590/1148] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:25.978881 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5ca7a953-c1d3-4ab2-a782-0c9fc1dfe3bb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:25.979609 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5ca7a953-c1d3-4ab2-a782-0c9fc1dfe3bb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:26.008504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5ca7a953-c1d3-4ab2-a782-0c9fc1dfe3bb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:26.009014 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5ca7a953-c1d3-4ab2-a782-0c9fc1dfe3bb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:26.009536 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5ca7a953-c1d3-4ab2-a782-0c9fc1dfe3bb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:26.010451 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5ca7a953-c1d3-4ab2-a782-0c9fc1dfe3bb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:26.011074 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5ca7a953-c1d3-4ab2-a782-0c9fc1dfe3bb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:26.011666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5ca7a953-c1d3-4ab2-a782-0c9fc1dfe3bb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:26.563078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5ca7a953-c1d3-4ab2-a782-0c9fc1dfe3bb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:26.588642 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5ca7a953-c1d3-4ab2-a782-0c9fc1dfe3bb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:26.590194 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5ca7a953-c1d3-4ab2-a782-0c9fc1dfe3bb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:26.591955 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5ca7a953-c1d3-4ab2-a782-0c9fc1dfe3bb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 1814 microversion: 2.25 time: 0.618484 Sep 17 20:55:26.592888 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 591/1149] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:25 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 1814 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:26.603221 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-578b5de5-f265-4ca5-99cc-b253fb1a73e4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:26.605990 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-578b5de5-f265-4ca5-99cc-b253fb1a73e4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 560c9626-f97e-4bc8-a2a9-942ddb969ccc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:26.622212 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-578b5de5-f265-4ca5-99cc-b253fb1a73e4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:26.624952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-578b5de5-f265-4ca5-99cc-b253fb1a73e4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:26.627229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-578b5de5-f265-4ca5-99cc-b253fb1a73e4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:26.631078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-578b5de5-f265-4ca5-99cc-b253fb1a73e4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:26.632204 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-578b5de5-f265-4ca5-99cc-b253fb1a73e4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:26.633960 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-578b5de5-f265-4ca5-99cc-b253fb1a73e4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:26.685248 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-578b5de5-f265-4ca5-99cc-b253fb1a73e4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] HTTP exception thrown: Instance 560c9626-f97e-4bc8-a2a9-942ddb969ccc could not be found. Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-578b5de5-f265-4ca5-99cc-b253fb1a73e4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Request method failure captured: Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc HTTP/1.1 Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjMW4WTMrHVxT_blH9OktIdsLxdSc4WUWVP8xumJavGA2GiRpiJlQJhI5X_he7_TVPivWgrAsf02nd8RHzhJ31a5Qgvl4lZ2TEO5bOf-4RaZy91bp9Tmv8DbTpLGvhmreUrma1J_K-T2_-ItJNWXrzg7NdUY0DyjuqhtzF_M_k9ZhT0 Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 07ce9fd746374b478a743261eb014e5c Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-MigrationsAdminTest-1514848596 Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/07ce9fd746374b478a743261eb014e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/07ce9fd746374b478a743261eb014e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/07ce9fd746374b478a743261eb014e5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_07ce9fd746374b478a743261eb014e5c", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-MigrationsAdminTest-1514848596 Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 07ce9fd746374b478a743261eb014e5c Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-MigrationsAdminTest-1514848596 Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-MigrationsAdminTest-1514848596-project Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 226a87a1f393420b8d19ec2390e9d063 Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-MigrationsAdminTest-1514848596-project Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 560c9626-f97e-4bc8-a2a9-942ddb969ccc could not be found. Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '560c9626-f97e-4bc8-a2a9-942ddb969ccc'} Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 560c9626-f97e-4bc8-a2a9-942ddb969ccc could not be found. Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 560c9626-f97e-4bc8-a2a9-942ddb969ccc could not be found. Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:55:26.697718 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:55:26.705292 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:55:26.705292 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:55:26.705292 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:55:26.705292 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:55:26.705292 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:55:26.705292 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 560c9626-f97e-4bc8-a2a9-942ddb969ccc could not be found. Sep 17 20:55:26.705292 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:55:26.705292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-578b5de5-f265-4ca5-99cc-b253fb1a73e4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Returning 404 to user: Instance 560c9626-f97e-4bc8-a2a9-942ddb969ccc could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:55:26.715675 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-578b5de5-f265-4ca5-99cc-b253fb1a73e4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc" status: 404 len: 111 microversion: 2.1 time: 0.121376 Sep 17 20:55:26.718116 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 592/1150] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:26 2022] GET /compute/v2.1/servers/560c9626-f97e-4bc8-a2a9-942ddb969ccc => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:55:26.728313 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-a3c9d25f-4e7a-47e8-9109-0b7efa874307 req-5c4c4831-8d5e-49da-aa42-097b0122aef2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46d60c84-b2e2-4376-a0ca-f0bee938fd9a", "tag": "94958f55-6b3e-41f2-a7f1-6dd835192bd3"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:26.741653 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a3c9d25f-4e7a-47e8-9109-0b7efa874307 req-5c4c4831-8d5e-49da-aa42-097b0122aef2 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:26.742359 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a3c9d25f-4e7a-47e8-9109-0b7efa874307 req-5c4c4831-8d5e-49da-aa42-097b0122aef2 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:26.747123 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a3c9d25f-4e7a-47e8-9109-0b7efa874307 req-5c4c4831-8d5e-49da-aa42-097b0122aef2 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:26.767152 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-a3c9d25f-4e7a-47e8-9109-0b7efa874307 req-5c4c4831-8d5e-49da-aa42-097b0122aef2 service nova] Creating event network-changed:94958f55-6b3e-41f2-a7f1-6dd835192bd3 for instance 46d60c84-b2e2-4376-a0ca-f0bee938fd9a on nch1-master-1 Sep 17 20:55:26.776057 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-a3c9d25f-4e7a-47e8-9109-0b7efa874307 req-5c4c4831-8d5e-49da-aa42-097b0122aef2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055613 Sep 17 20:55:26.777337 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 593/1151] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:26.791340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ab4bc974-8165-49bb-a738-bd8e1f4c5610 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:26.791340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ab4bc974-8165-49bb-a738-bd8e1f4c5610 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:26.797663 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ab4bc974-8165-49bb-a738-bd8e1f4c5610 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:26.798317 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ab4bc974-8165-49bb-a738-bd8e1f4c5610 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:26.798828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ab4bc974-8165-49bb-a738-bd8e1f4c5610 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:26.799641 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ab4bc974-8165-49bb-a738-bd8e1f4c5610 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:26.800282 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ab4bc974-8165-49bb-a738-bd8e1f4c5610 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:26.803630 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ab4bc974-8165-49bb-a738-bd8e1f4c5610 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:26.844655 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ab4bc974-8165-49bb-a738-bd8e1f4c5610 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:55:27.006453 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ab4bc974-8165-49bb-a738-bd8e1f4c5610 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "DELETE /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 204 len: 0 microversion: 2.1 time: 0.224056 Sep 17 20:55:27.007171 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 594/1152] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:55:26 2022] DELETE /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:55:27.015876 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7e104bb8-ac5f-4f16-8017-3ee0149371f0 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:27.022120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7e104bb8-ac5f-4f16-8017-3ee0149371f0 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f7681de64c248268da4d78124f59b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d60144477f4a5192d581350d678979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:27.024666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7e104bb8-ac5f-4f16-8017-3ee0149371f0 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Searching by: {'deleted': False, 'project_id': '26d60144477f4a5192d581350d678979'} {{(pid=140524) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 20:55:27.048491 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e104bb8-ac5f-4f16-8017-3ee0149371f0 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:27.050910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e104bb8-ac5f-4f16-8017-3ee0149371f0 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:27.053503 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e104bb8-ac5f-4f16-8017-3ee0149371f0 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:27.055245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e104bb8-ac5f-4f16-8017-3ee0149371f0 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:27.064611 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e104bb8-ac5f-4f16-8017-3ee0149371f0 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:27.066573 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e104bb8-ac5f-4f16-8017-3ee0149371f0 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:27.114837 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.multi_cell_list [None req-7e104bb8-ac5f-4f16-8017-3ee0149371f0 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140524) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 20:55:27.168747 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7e104bb8-ac5f-4f16-8017-3ee0149371f0 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.159521 Sep 17 20:55:27.170111 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 595/1153] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Sep 17 20:55:27 2022] GET /compute/v2.1/servers => generated 343 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:27.178037 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-70cb6e84-2e56-436a-b51b-6924c7115d05 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:27.179112 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-70cb6e84-2e56-436a-b51b-6924c7115d05 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:27.187535 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-70cb6e84-2e56-436a-b51b-6924c7115d05 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:27.188155 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-70cb6e84-2e56-436a-b51b-6924c7115d05 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:27.189181 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-70cb6e84-2e56-436a-b51b-6924c7115d05 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:27.191115 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-70cb6e84-2e56-436a-b51b-6924c7115d05 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:27.191610 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-70cb6e84-2e56-436a-b51b-6924c7115d05 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:27.192054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-70cb6e84-2e56-436a-b51b-6924c7115d05 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:27.840056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-70cb6e84-2e56-436a-b51b-6924c7115d05 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:27.853504 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-70cb6e84-2e56-436a-b51b-6924c7115d05 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1504 microversion: 2.1 time: 0.682048 Sep 17 20:55:27.854557 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 596/1154] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:27 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1504 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:27.867531 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8cff4d99-a24f-4217-aae0-b42b0ef843de tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:27.868518 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8cff4d99-a24f-4217-aae0-b42b0ef843de tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:27.880426 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8cff4d99-a24f-4217-aae0-b42b0ef843de tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:27.881644 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8cff4d99-a24f-4217-aae0-b42b0ef843de tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:27.889701 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8cff4d99-a24f-4217-aae0-b42b0ef843de tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:27.890878 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8cff4d99-a24f-4217-aae0-b42b0ef843de tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:27.891707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8cff4d99-a24f-4217-aae0-b42b0ef843de tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:27.892296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8cff4d99-a24f-4217-aae0-b42b0ef843de tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:28.080706 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8cff4d99-a24f-4217-aae0-b42b0ef843de tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:28.091502 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8cff4d99-a24f-4217-aae0-b42b0ef843de tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1534 microversion: 2.1 time: 0.235099 Sep 17 20:55:28.092747 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 597/1155] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:27 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1534 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:28.294628 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-75a4bd3f-3326-45c0-920c-5f5478e89a11 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Calling method '.version_select at 0x7f25a545bc10>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:28.301340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75a4bd3f-3326-45c0-920c-5f5478e89a11 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:28.306911 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75a4bd3f-3326-45c0-920c-5f5478e89a11 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:28.307555 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75a4bd3f-3326-45c0-920c-5f5478e89a11 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:28.310575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75a4bd3f-3326-45c0-920c-5f5478e89a11 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:28.312457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75a4bd3f-3326-45c0-920c-5f5478e89a11 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:28.313867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75a4bd3f-3326-45c0-920c-5f5478e89a11 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:28.400508 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-75a4bd3f-3326-45c0-920c-5f5478e89a11 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.305035 Sep 17 20:55:28.402104 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 598/1156] 10.222.0.26 () {58 vars in 1128 bytes} [Sat Sep 17 20:55:28 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:28.407112 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9c02c33a-2614-4bfa-8299-229425207719 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:28.415362 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9c02c33a-2614-4bfa-8299-229425207719 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6f7681de64c248268da4d78124f59b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d60144477f4a5192d581350d678979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:28.416536 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9c02c33a-2614-4bfa-8299-229425207719 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Searching by: {'deleted': False, 'project_id': '26d60144477f4a5192d581350d678979'} {{(pid=140524) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 20:55:28.429915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9c02c33a-2614-4bfa-8299-229425207719 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:28.430603 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9c02c33a-2614-4bfa-8299-229425207719 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:28.431320 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9c02c33a-2614-4bfa-8299-229425207719 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:28.432484 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9c02c33a-2614-4bfa-8299-229425207719 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:28.433214 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9c02c33a-2614-4bfa-8299-229425207719 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:28.433833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9c02c33a-2614-4bfa-8299-229425207719 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:28.608012 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.multi_cell_list [None req-9c02c33a-2614-4bfa-8299-229425207719 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140524) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 20:55:28.615432 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:28.753370 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9c02c33a-2614-4bfa-8299-229425207719 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7681de64c248268da4d78124f59b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d60144477f4a5192d581350d678979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:28.763259 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9c02c33a-2614-4bfa-8299-229425207719 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:28.765372 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9c02c33a-2614-4bfa-8299-229425207719 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:28.766560 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9c02c33a-2614-4bfa-8299-229425207719 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:29.151970 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9c02c33a-2614-4bfa-8299-229425207719 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 0.748254 Sep 17 20:55:29.153256 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 599/1157] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:55:28 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:29.158252 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bc3aeff3-3ac8-456e-8dc1-a00437b4d697 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:29.158937 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bc3aeff3-3ac8-456e-8dc1-a00437b4d697 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:29.171219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:29.176832 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc3aeff3-3ac8-456e-8dc1-a00437b4d697 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:29.177400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc3aeff3-3ac8-456e-8dc1-a00437b4d697 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:29.182618 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc3aeff3-3ac8-456e-8dc1-a00437b4d697 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:29.183549 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc3aeff3-3ac8-456e-8dc1-a00437b4d697 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:29.184055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc3aeff3-3ac8-456e-8dc1-a00437b4d697 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:29.184543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc3aeff3-3ac8-456e-8dc1-a00437b4d697 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:29.581153 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bc3aeff3-3ac8-456e-8dc1-a00437b4d697 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:29.591024 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bc3aeff3-3ac8-456e-8dc1-a00437b4d697 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:29.592459 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bc3aeff3-3ac8-456e-8dc1-a00437b4d697 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:29.593711 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bc3aeff3-3ac8-456e-8dc1-a00437b4d697 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 1814 microversion: 2.25 time: 0.439561 Sep 17 20:55:29.601525 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 600/1158] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:29 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 1814 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:29.601525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-359fe993-1e85-46d7-8647-b5d8e0ecbe98 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:29.601525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-359fe993-1e85-46d7-8647-b5d8e0ecbe98 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:29.607788 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-359fe993-1e85-46d7-8647-b5d8e0ecbe98 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:29.608477 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-359fe993-1e85-46d7-8647-b5d8e0ecbe98 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:29.609122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-359fe993-1e85-46d7-8647-b5d8e0ecbe98 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:29.610161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-359fe993-1e85-46d7-8647-b5d8e0ecbe98 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:29.610780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-359fe993-1e85-46d7-8647-b5d8e0ecbe98 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:29.615170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-359fe993-1e85-46d7-8647-b5d8e0ecbe98 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:29.921837 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-359fe993-1e85-46d7-8647-b5d8e0ecbe98 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:29.932020 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-359fe993-1e85-46d7-8647-b5d8e0ecbe98 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 200 len: 1504 microversion: 2.1 time: 0.336150 Sep 17 20:55:29.932816 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 601/1159] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:29 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 1504 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:29.938403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-b59bfbed-47ac-4082-8b5e-07ef7bdabd99 req-811863e9-a2dd-474d-99de-1003b2b016f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "560c9626-f97e-4bc8-a2a9-942ddb969ccc", "name": "network-vif-deleted", "tag": "41a6b4dc-39d8-4713-bf4d-91efa6a5c055"}, {"name": "network-changed", "server_uuid": "796a6ed8-e44a-4e34-849d-1daeb1f363dd", "tag": "3825b5cf-93a8-4a37-b807-cab157be9707"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:29.949840 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b59bfbed-47ac-4082-8b5e-07ef7bdabd99 req-811863e9-a2dd-474d-99de-1003b2b016f5 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:29.950598 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b59bfbed-47ac-4082-8b5e-07ef7bdabd99 req-811863e9-a2dd-474d-99de-1003b2b016f5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:29.951193 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b59bfbed-47ac-4082-8b5e-07ef7bdabd99 req-811863e9-a2dd-474d-99de-1003b2b016f5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:29.965809 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-b59bfbed-47ac-4082-8b5e-07ef7bdabd99 req-811863e9-a2dd-474d-99de-1003b2b016f5 service nova] Creating event network-vif-deleted:41a6b4dc-39d8-4713-bf4d-91efa6a5c055 for instance 560c9626-f97e-4bc8-a2a9-942ddb969ccc on nch1-master-1 Sep 17 20:55:29.966585 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-b59bfbed-47ac-4082-8b5e-07ef7bdabd99 req-811863e9-a2dd-474d-99de-1003b2b016f5 service nova] Creating event network-changed:3825b5cf-93a8-4a37-b807-cab157be9707 for instance 796a6ed8-e44a-4e34-849d-1daeb1f363dd on nch2-master-1 Sep 17 20:55:29.976766 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-b59bfbed-47ac-4082-8b5e-07ef7bdabd99 req-811863e9-a2dd-474d-99de-1003b2b016f5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.042511 Sep 17 20:55:29.978208 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 602/1160] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:29.983542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-162209e5-1f17-413c-b6a6-1d6409610970 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Calling method '.version_select at 0x7f25a54941f0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:29.987893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-162209e5-1f17-413c-b6a6-1d6409610970 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:29.988748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-162209e5-1f17-413c-b6a6-1d6409610970 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:29.989424 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-162209e5-1f17-413c-b6a6-1d6409610970 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:29.990412 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-162209e5-1f17-413c-b6a6-1d6409610970 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:29.991032 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-162209e5-1f17-413c-b6a6-1d6409610970 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:29.991617 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-162209e5-1f17-413c-b6a6-1d6409610970 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:30.019248 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-162209e5-1f17-413c-b6a6-1d6409610970 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 379 microversion: 2.1 time: 0.039423 Sep 17 20:55:30.027293 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 603/1161] 10.222.0.26 () {58 vars in 1139 bytes} [Sat Sep 17 20:55:29 2022] GET /compute/v2.1/os-hosts?zone= => generated 379 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:30.035613 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4e41ceae-6272-4e97-b842-f66c09045778 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:30.036597 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4e41ceae-6272-4e97-b842-f66c09045778 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:30.048239 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e41ceae-6272-4e97-b842-f66c09045778 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:30.049961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e41ceae-6272-4e97-b842-f66c09045778 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:30.050610 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e41ceae-6272-4e97-b842-f66c09045778 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:30.052290 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e41ceae-6272-4e97-b842-f66c09045778 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:30.054287 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e41ceae-6272-4e97-b842-f66c09045778 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:30.056041 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e41ceae-6272-4e97-b842-f66c09045778 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:30.165361 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-dfb835c2-314b-41c9-b67c-faba76296ae9 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:55:30.166536 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-dfb835c2-314b-41c9-b67c-faba76296ae9 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:55:30.168455 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-dfb835c2-314b-41c9-b67c-faba76296ae9 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:55:30.169091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-dfb835c2-314b-41c9-b67c-faba76296ae9 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:55:30.169724 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-dfb835c2-314b-41c9-b67c-faba76296ae9 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:55:30.187686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfb835c2-314b-41c9-b67c-faba76296ae9 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:30.188452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfb835c2-314b-41c9-b67c-faba76296ae9 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:30.189077 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfb835c2-314b-41c9-b67c-faba76296ae9 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:30.190028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfb835c2-314b-41c9-b67c-faba76296ae9 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:30.190938 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfb835c2-314b-41c9-b67c-faba76296ae9 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:30.191546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfb835c2-314b-41c9-b67c-faba76296ae9 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:30.227042 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-dfb835c2-314b-41c9-b67c-faba76296ae9 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Getting quotas for project 822801d3963d45c1b4176259fb5c5b19. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:55:30.234696 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-dfb835c2-314b-41c9-b67c-faba76296ae9 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Getting quotas for user 55e8e491f8844f7696f93d8ec5a7171b and project 822801d3963d45c1b4176259fb5c5b19. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:55:30.491222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4e41ceae-6272-4e97-b842-f66c09045778 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:30.503039 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4e41ceae-6272-4e97-b842-f66c09045778 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1492 microversion: 2.1 time: 0.474255 Sep 17 20:55:30.518398 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 604/1162] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:30 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1492 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:30.518398 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9a7d5227-6315-4dc7-a815-fbfec30271db tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:30.529651 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9a7d5227-6315-4dc7-a815-fbfec30271db tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023416 Sep 17 20:55:30.530256 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 605/1163] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Sep 17 20:55:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:30.544011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a92a0bbc-95d6-45e0-ae0d-946ca21a1ea8 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:30.544683 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a92a0bbc-95d6-45e0-ae0d-946ca21a1ea8 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:30.560958 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a92a0bbc-95d6-45e0-ae0d-946ca21a1ea8 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:30.565541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a92a0bbc-95d6-45e0-ae0d-946ca21a1ea8 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:30.566287 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a92a0bbc-95d6-45e0-ae0d-946ca21a1ea8 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:30.567034 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a92a0bbc-95d6-45e0-ae0d-946ca21a1ea8 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:30.567588 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a92a0bbc-95d6-45e0-ae0d-946ca21a1ea8 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:30.568027 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a92a0bbc-95d6-45e0-ae0d-946ca21a1ea8 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:30.572271 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dfb835c2-314b-41c9-b67c-faba76296ae9 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:55:30.577033 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dfb835c2-314b-41c9-b67c-faba76296ae9 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='99848cf4-d1b1-4750-bd2d-84def7a9a754',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='39a25695-6a20-4519-b4cc-233d172fde0a',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1a721e0a-0c66-4cab-9a36-ed78def77377',volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:55:30.656870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a92a0bbc-95d6-45e0-ae0d-946ca21a1ea8 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:55:30.878334 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a92a0bbc-95d6-45e0-ae0d-946ca21a1ea8 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 204 len: 0 microversion: 2.1 time: 0.343939 Sep 17 20:55:30.886796 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 606/1164] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:55:30 2022] DELETE /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:55:30.914857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2ed984b9-3582-43d8-9358-bc4a388932ed tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Calling method '.version_select at 0x7f25a63563a0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:30.923993 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ed984b9-3582-43d8-9358-bc4a388932ed tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:30.929708 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ed984b9-3582-43d8-9358-bc4a388932ed tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:30.931151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ed984b9-3582-43d8-9358-bc4a388932ed tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:30.931997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ed984b9-3582-43d8-9358-bc4a388932ed tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:30.935253 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ed984b9-3582-43d8-9358-bc4a388932ed tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:30.936213 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ed984b9-3582-43d8-9358-bc4a388932ed tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:31.024208 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2ed984b9-3582-43d8-9358-bc4a388932ed tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.135453 Sep 17 20:55:31.025378 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 607/1165] 10.222.0.26 () {58 vars in 1145 bytes} [Sat Sep 17 20:55:30 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:55:31.037706 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-381e5859-b4ba-425b-a7aa-6e870e2a2b9e req-e5ab8047-f500-48b8-82d6-a2a85c50a17b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89b39b18-ff49-4810-9701-3084736ff2d0", "name": "network-vif-deleted", "tag": "67dfcd54-a56f-4269-9ed0-edf035c918b0"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:31.051751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-381e5859-b4ba-425b-a7aa-6e870e2a2b9e req-e5ab8047-f500-48b8-82d6-a2a85c50a17b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:31.053544 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-381e5859-b4ba-425b-a7aa-6e870e2a2b9e req-e5ab8047-f500-48b8-82d6-a2a85c50a17b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:31.054271 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-381e5859-b4ba-425b-a7aa-6e870e2a2b9e req-e5ab8047-f500-48b8-82d6-a2a85c50a17b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:31.070429 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-381e5859-b4ba-425b-a7aa-6e870e2a2b9e req-e5ab8047-f500-48b8-82d6-a2a85c50a17b service nova] Creating event network-vif-deleted:67dfcd54-a56f-4269-9ed0-edf035c918b0 for instance 89b39b18-ff49-4810-9701-3084736ff2d0 on nch2-master-1 Sep 17 20:55:31.079641 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-381e5859-b4ba-425b-a7aa-6e870e2a2b9e req-e5ab8047-f500-48b8-82d6-a2a85c50a17b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051239 Sep 17 20:55:31.080493 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 608/1166] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:31.088100 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fe984da4-69d6-46c6-a47d-eef219cd098a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:31.088836 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fe984da4-69d6-46c6-a47d-eef219cd098a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:31.096959 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe984da4-69d6-46c6-a47d-eef219cd098a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:31.097767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe984da4-69d6-46c6-a47d-eef219cd098a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:31.098462 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe984da4-69d6-46c6-a47d-eef219cd098a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:31.099673 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe984da4-69d6-46c6-a47d-eef219cd098a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:31.100390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe984da4-69d6-46c6-a47d-eef219cd098a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:31.101054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe984da4-69d6-46c6-a47d-eef219cd098a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:31.258653 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dfb835c2-314b-41c9-b67c-faba76296ae9 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 6.995269 Sep 17 20:55:31.264805 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 559/1167] 10.222.0.26 () {62 vars in 1189 bytes} [Sat Sep 17 20:55:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 7002 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 17 20:55:31.281624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f46b18a5-31e1-41f7-af8a-85042e0bc7bf tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:31.285347 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f46b18a5-31e1-41f7-af8a-85042e0bc7bf tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] [instance: 44fa7976-1412-4c83-ae29-b02e16186990] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:31.300497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f46b18a5-31e1-41f7-af8a-85042e0bc7bf tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:31.301363 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f46b18a5-31e1-41f7-af8a-85042e0bc7bf tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:31.302731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f46b18a5-31e1-41f7-af8a-85042e0bc7bf tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:31.305317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f46b18a5-31e1-41f7-af8a-85042e0bc7bf tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:31.306379 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f46b18a5-31e1-41f7-af8a-85042e0bc7bf tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:31.307008 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f46b18a5-31e1-41f7-af8a-85042e0bc7bf tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:31.318899 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fe984da4-69d6-46c6-a47d-eef219cd098a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:31.330874 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fe984da4-69d6-46c6-a47d-eef219cd098a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:31.333848 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fe984da4-69d6-46c6-a47d-eef219cd098a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:31.335420 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fe984da4-69d6-46c6-a47d-eef219cd098a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 1814 microversion: 2.25 time: 0.253539 Sep 17 20:55:31.336389 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 609/1168] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:31 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 1814 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:31.346666 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f46b18a5-31e1-41f7-af8a-85042e0bc7bf tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] [instance: 44fa7976-1412-4c83-ae29-b02e16186990] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:55:31.354388 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-85e0cd3f-fe18-4272-b07a-b53bfdceb975 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Calling method '.version_select at 0x7f25a545da60>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:31.362201 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85e0cd3f-fe18-4272-b07a-b53bfdceb975 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:31.364760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85e0cd3f-fe18-4272-b07a-b53bfdceb975 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:31.364999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85e0cd3f-fe18-4272-b07a-b53bfdceb975 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:31.365964 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85e0cd3f-fe18-4272-b07a-b53bfdceb975 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:31.366443 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85e0cd3f-fe18-4272-b07a-b53bfdceb975 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:31.368029 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85e0cd3f-fe18-4272-b07a-b53bfdceb975 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:31.393237 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-85e0cd3f-fe18-4272-b07a-b53bfdceb975 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.055664 Sep 17 20:55:31.394972 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 610/1169] 10.222.0.26 () {58 vars in 1128 bytes} [Sat Sep 17 20:55:31 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:31.400168 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-192cd7b1-27cb-46b1-9a58-e80ddc418c94 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-505099110", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "c1a7aff7-16bc-489c-b88f-724a10b4c0a6"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:31.459436 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f46b18a5-31e1-41f7-af8a-85042e0bc7bf tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] 10.222.0.26 "DELETE /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990" status: 204 len: 0 microversion: 2.1 time: 0.190555 Sep 17 20:55:31.461726 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 560/1170] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:55:31 2022] DELETE /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:55:31.470598 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-448fe7a4-5b43-47a8-b418-19f82623fc85 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:31.472517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-448fe7a4-5b43-47a8-b418-19f82623fc85 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:31.474340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-192cd7b1-27cb-46b1-9a58-e80ddc418c94 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] validate_networks() for [('c1a7aff7-16bc-489c-b88f-724a10b4c0a6', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:55:31.634848 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-448fe7a4-5b43-47a8-b418-19f82623fc85 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:31.648840 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-448fe7a4-5b43-47a8-b418-19f82623fc85 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:31.654754 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-448fe7a4-5b43-47a8-b418-19f82623fc85 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:31.658733 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-448fe7a4-5b43-47a8-b418-19f82623fc85 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1286 microversion: 2.32 time: 0.191804 Sep 17 20:55:31.659355 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 561/1171] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:31 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1286 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:31.670557 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-471a9913-c857-4d26-8bdc-da161b10f8b6 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Calling method '.version_select at 0x7f25a51e11f0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:31.691656 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-471a9913-c857-4d26-8bdc-da161b10f8b6 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:31.694085 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-471a9913-c857-4d26-8bdc-da161b10f8b6 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:31.694199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-471a9913-c857-4d26-8bdc-da161b10f8b6 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:31.696904 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-471a9913-c857-4d26-8bdc-da161b10f8b6 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:31.697395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-471a9913-c857-4d26-8bdc-da161b10f8b6 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:31.700013 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-471a9913-c857-4d26-8bdc-da161b10f8b6 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:31.737592 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-471a9913-c857-4d26-8bdc-da161b10f8b6 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.076499 Sep 17 20:55:31.737963 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 562/1172] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Sep 17 20:55:31 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:31.763770 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-11329e9b-9c9a-45c0-a7b7-a998b88fa9de tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:31.764851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-11329e9b-9c9a-45c0-a7b7-a998b88fa9de tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] [instance: 44fa7976-1412-4c83-ae29-b02e16186990] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:31.773533 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11329e9b-9c9a-45c0-a7b7-a998b88fa9de tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:31.774599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11329e9b-9c9a-45c0-a7b7-a998b88fa9de tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:31.776383 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11329e9b-9c9a-45c0-a7b7-a998b88fa9de tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:31.778001 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11329e9b-9c9a-45c0-a7b7-a998b88fa9de tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:31.778709 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11329e9b-9c9a-45c0-a7b7-a998b88fa9de tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:31.779337 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11329e9b-9c9a-45c0-a7b7-a998b88fa9de tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:32.103261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-11329e9b-9c9a-45c0-a7b7-a998b88fa9de tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7681de64c248268da4d78124f59b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d60144477f4a5192d581350d678979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:32.117058 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-11329e9b-9c9a-45c0-a7b7-a998b88fa9de tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] 10.222.0.26 "GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990" status: 200 len: 1607 microversion: 2.1 time: 0.377896 Sep 17 20:55:32.131992 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 563/1173] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:31 2022] GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990 => generated 1607 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:32.143318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f4d0f2bf-58fa-4e09-a578-e44cfb916f80 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:32.143923 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f4d0f2bf-58fa-4e09-a578-e44cfb916f80 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:32.165566 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f4d0f2bf-58fa-4e09-a578-e44cfb916f80 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:32.166296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f4d0f2bf-58fa-4e09-a578-e44cfb916f80 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:32.166999 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f4d0f2bf-58fa-4e09-a578-e44cfb916f80 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:32.167625 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f4d0f2bf-58fa-4e09-a578-e44cfb916f80 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:32.168332 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f4d0f2bf-58fa-4e09-a578-e44cfb916f80 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:32.169100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f4d0f2bf-58fa-4e09-a578-e44cfb916f80 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:32.247188 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f4d0f2bf-58fa-4e09-a578-e44cfb916f80 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:32.247730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f4d0f2bf-58fa-4e09-a578-e44cfb916f80 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:32.248189 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f4d0f2bf-58fa-4e09-a578-e44cfb916f80 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:32.248663 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-f4d0f2bf-58fa-4e09-a578-e44cfb916f80 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lazy-loading 'fault' on Instance uuid 89b39b18-ff49-4810-9701-3084736ff2d0 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:55:32.287646 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-192cd7b1-27cb-46b1-9a58-e80ddc418c94 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:55:32.288839 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-192cd7b1-27cb-46b1-9a58-e80ddc418c94 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:55:32.288839 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-192cd7b1-27cb-46b1-9a58-e80ddc418c94 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:55:32.289376 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-192cd7b1-27cb-46b1-9a58-e80ddc418c94 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:55:32.290061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-192cd7b1-27cb-46b1-9a58-e80ddc418c94 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:55:32.308108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-192cd7b1-27cb-46b1-9a58-e80ddc418c94 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:32.310400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-192cd7b1-27cb-46b1-9a58-e80ddc418c94 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:32.310937 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-192cd7b1-27cb-46b1-9a58-e80ddc418c94 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:32.311816 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-192cd7b1-27cb-46b1-9a58-e80ddc418c94 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:32.313720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-192cd7b1-27cb-46b1-9a58-e80ddc418c94 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:32.315727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-192cd7b1-27cb-46b1-9a58-e80ddc418c94 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:32.329512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f4d0f2bf-58fa-4e09-a578-e44cfb916f80 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:32.337721 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f4d0f2bf-58fa-4e09-a578-e44cfb916f80 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1368 microversion: 2.1 time: 0.204283 Sep 17 20:55:32.356277 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-192cd7b1-27cb-46b1-9a58-e80ddc418c94 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Getting quotas for project 52c89ce6659b4b4b9d6a53c9a8d33b41. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:55:32.357626 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 564/1174] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:32 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1368 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:32.365159 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-589ec624-bda1-42cb-95a2-acb3a94072c5 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Calling method '.version_select at 0x7f25a5207700>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:32.365945 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-192cd7b1-27cb-46b1-9a58-e80ddc418c94 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Getting quotas for user d461326fa46149f5a49b278b32d9c9fb and project 52c89ce6659b4b4b9d6a53c9a8d33b41. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:55:32.370119 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-589ec624-bda1-42cb-95a2-acb3a94072c5 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:32.370631 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-589ec624-bda1-42cb-95a2-acb3a94072c5 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:32.372186 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-589ec624-bda1-42cb-95a2-acb3a94072c5 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:32.372927 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-589ec624-bda1-42cb-95a2-acb3a94072c5 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:32.374318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-589ec624-bda1-42cb-95a2-acb3a94072c5 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:32.374770 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-589ec624-bda1-42cb-95a2-acb3a94072c5 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:32.398708 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-192cd7b1-27cb-46b1-9a58-e80ddc418c94 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:55:32.402648 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-192cd7b1-27cb-46b1-9a58-e80ddc418c94 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:55:32.409980 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-589ec624-bda1-42cb-95a2-acb3a94072c5 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.050986 Sep 17 20:55:32.410910 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 565/1175] 10.222.0.26 () {58 vars in 1128 bytes} [Sat Sep 17 20:55:32 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:32.416478 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-123112d7-b543-44f7-ab4c-22a132d3a18f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:32.417098 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-123112d7-b543-44f7-ab4c-22a132d3a18f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:32.424181 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-123112d7-b543-44f7-ab4c-22a132d3a18f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:32.424775 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-123112d7-b543-44f7-ab4c-22a132d3a18f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:32.425120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-123112d7-b543-44f7-ab4c-22a132d3a18f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:32.426067 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-123112d7-b543-44f7-ab4c-22a132d3a18f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:32.426534 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-123112d7-b543-44f7-ab4c-22a132d3a18f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:32.427085 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-123112d7-b543-44f7-ab4c-22a132d3a18f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:32.511367 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-192cd7b1-27cb-46b1-9a58-e80ddc418c94 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.115376 Sep 17 20:55:32.514095 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 611/1176] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:55:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:55:32.525181 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7cddc037-644c-4a40-8739-9615a16dd468 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Calling method '.version_select at 0x7f25a545d160>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:32.541621 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7cddc037-644c-4a40-8739-9615a16dd468 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:32.542649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7cddc037-644c-4a40-8739-9615a16dd468 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:32.543288 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7cddc037-644c-4a40-8739-9615a16dd468 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:32.561984 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7cddc037-644c-4a40-8739-9615a16dd468 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:32.562865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7cddc037-644c-4a40-8739-9615a16dd468 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:32.563571 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7cddc037-644c-4a40-8739-9615a16dd468 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:32.613243 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7cddc037-644c-4a40-8739-9615a16dd468 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 993 microversion: 2.1 time: 0.098005 Sep 17 20:55:32.619036 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 612/1177] 10.222.0.26 () {58 vars in 1170 bytes} [Sat Sep 17 20:55:32 2022] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 993 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:32.624341 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-123112d7-b543-44f7-ab4c-22a132d3a18f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:32.633816 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-aff7ba8f-f6d4-40f8-8267-ac2ad2ecd2b0 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:32.637515 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-aff7ba8f-f6d4-40f8-8267-ac2ad2ecd2b0 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:32.641075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-123112d7-b543-44f7-ab4c-22a132d3a18f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:32.642711 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-123112d7-b543-44f7-ab4c-22a132d3a18f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:32.643912 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-123112d7-b543-44f7-ab4c-22a132d3a18f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 1814 microversion: 2.25 time: 0.231879 Sep 17 20:55:32.644713 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 566/1178] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:32 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 1814 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:32.651337 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dfb972b3-4dc5-47c9-bf69-e27d60c80046 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Calling method '.version_select at 0x7f25a510b4c0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:32.672494 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfb972b3-4dc5-47c9-bf69-e27d60c80046 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:32.673078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfb972b3-4dc5-47c9-bf69-e27d60c80046 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:32.673583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfb972b3-4dc5-47c9-bf69-e27d60c80046 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:32.705853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfb972b3-4dc5-47c9-bf69-e27d60c80046 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:32.706373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfb972b3-4dc5-47c9-bf69-e27d60c80046 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:32.710129 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfb972b3-4dc5-47c9-bf69-e27d60c80046 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:32.729656 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dfb972b3-4dc5-47c9-bf69-e27d60c80046 tempest-HostsAdminTestJSON-1581251273 tempest-HostsAdminTestJSON-1581251273-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 467 microversion: 2.1 time: 0.083998 Sep 17 20:55:32.739253 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 567/1179] 10.222.0.26 () {58 vars in 1170 bytes} [Sat Sep 17 20:55:32 2022] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 467 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:32.743485 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-aff7ba8f-f6d4-40f8-8267-ac2ad2ecd2b0 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:32.752940 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-27a5c427-e82f-42a1-b3d2-63d89596d415 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:32.756176 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-27a5c427-e82f-42a1-b3d2-63d89596d415 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:32.768779 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-aff7ba8f-f6d4-40f8-8267-ac2ad2ecd2b0 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1217 microversion: 2.1 time: 0.142274 Sep 17 20:55:32.771119 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-27a5c427-e82f-42a1-b3d2-63d89596d415 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:32.773856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-27a5c427-e82f-42a1-b3d2-63d89596d415 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:32.774369 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-27a5c427-e82f-42a1-b3d2-63d89596d415 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:32.776857 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-27a5c427-e82f-42a1-b3d2-63d89596d415 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:32.777483 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-27a5c427-e82f-42a1-b3d2-63d89596d415 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:32.778451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-27a5c427-e82f-42a1-b3d2-63d89596d415 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:32.783706 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 613/1180] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:32 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1217 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:32.966270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-27a5c427-e82f-42a1-b3d2-63d89596d415 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:32.987276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-27a5c427-e82f-42a1-b3d2-63d89596d415 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:32.989689 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-27a5c427-e82f-42a1-b3d2-63d89596d415 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:32.994573 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-27a5c427-e82f-42a1-b3d2-63d89596d415 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1528 microversion: 2.32 time: 0.247516 Sep 17 20:55:32.997364 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 568/1181] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:32 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1528 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:33.144937 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-99dd4f84-a2e4-4454-90ad-c7badf5d1ca0 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:33.145761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-99dd4f84-a2e4-4454-90ad-c7badf5d1ca0 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] [instance: 44fa7976-1412-4c83-ae29-b02e16186990] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:33.158233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-99dd4f84-a2e4-4454-90ad-c7badf5d1ca0 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:33.162437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-99dd4f84-a2e4-4454-90ad-c7badf5d1ca0 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:33.165694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-99dd4f84-a2e4-4454-90ad-c7badf5d1ca0 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:33.167637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-99dd4f84-a2e4-4454-90ad-c7badf5d1ca0 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:33.171360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-99dd4f84-a2e4-4454-90ad-c7badf5d1ca0 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:33.172170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-99dd4f84-a2e4-4454-90ad-c7badf5d1ca0 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:33.480691 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-99dd4f84-a2e4-4454-90ad-c7badf5d1ca0 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7681de64c248268da4d78124f59b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d60144477f4a5192d581350d678979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:33.492858 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-99dd4f84-a2e4-4454-90ad-c7badf5d1ca0 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] 10.222.0.26 "GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990" status: 200 len: 1607 microversion: 2.1 time: 0.351729 Sep 17 20:55:33.500676 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 614/1182] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:33 2022] GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990 => generated 1607 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:33.665877 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4dd84bd8-d541-478a-ab43-d05c2f6221cb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:33.666577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4dd84bd8-d541-478a-ab43-d05c2f6221cb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:33.675085 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cc56970a-e2a4-4715-bfab-0246d001d769 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:33.675738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cc56970a-e2a4-4715-bfab-0246d001d769 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:33.687336 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc56970a-e2a4-4715-bfab-0246d001d769 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:33.688225 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc56970a-e2a4-4715-bfab-0246d001d769 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:33.690048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc56970a-e2a4-4715-bfab-0246d001d769 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:33.691711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc56970a-e2a4-4715-bfab-0246d001d769 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:33.692337 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4dd84bd8-d541-478a-ab43-d05c2f6221cb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:33.693933 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc56970a-e2a4-4715-bfab-0246d001d769 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:33.694531 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc56970a-e2a4-4715-bfab-0246d001d769 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:33.695213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4dd84bd8-d541-478a-ab43-d05c2f6221cb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:33.695420 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4dd84bd8-d541-478a-ab43-d05c2f6221cb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:33.698698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4dd84bd8-d541-478a-ab43-d05c2f6221cb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:33.699244 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4dd84bd8-d541-478a-ab43-d05c2f6221cb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:33.699918 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4dd84bd8-d541-478a-ab43-d05c2f6221cb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:33.785652 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4dd84bd8-d541-478a-ab43-d05c2f6221cb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:33.786494 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4dd84bd8-d541-478a-ab43-d05c2f6221cb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:33.787091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4dd84bd8-d541-478a-ab43-d05c2f6221cb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:33.787698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-4dd84bd8-d541-478a-ab43-d05c2f6221cb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lazy-loading 'fault' on Instance uuid 89b39b18-ff49-4810-9701-3084736ff2d0 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:55:34.151003 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4dd84bd8-d541-478a-ab43-d05c2f6221cb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:34.160074 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4dd84bd8-d541-478a-ab43-d05c2f6221cb tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 200 len: 1368 microversion: 2.1 time: 0.798767 Sep 17 20:55:34.180368 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 569/1183] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:33 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 1368 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:55:34.199937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-04fd2f19-5b3a-4948-9399-a8b48b8cfe32 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:34.200569 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-04fd2f19-5b3a-4948-9399-a8b48b8cfe32 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:34.209743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04fd2f19-5b3a-4948-9399-a8b48b8cfe32 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:34.210320 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04fd2f19-5b3a-4948-9399-a8b48b8cfe32 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:34.210919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04fd2f19-5b3a-4948-9399-a8b48b8cfe32 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:34.211744 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04fd2f19-5b3a-4948-9399-a8b48b8cfe32 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:34.212941 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04fd2f19-5b3a-4948-9399-a8b48b8cfe32 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:34.213559 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04fd2f19-5b3a-4948-9399-a8b48b8cfe32 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:34.371618 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cc56970a-e2a4-4715-bfab-0246d001d769 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:34.385398 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cc56970a-e2a4-4715-bfab-0246d001d769 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:34.386876 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cc56970a-e2a4-4715-bfab-0246d001d769 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:34.388078 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cc56970a-e2a4-4715-bfab-0246d001d769 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 1814 microversion: 2.25 time: 0.718160 Sep 17 20:55:34.401834 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 615/1184] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:33 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 1814 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 20:55:34.438164 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-04fd2f19-5b3a-4948-9399-a8b48b8cfe32 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:34.468852 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-04fd2f19-5b3a-4948-9399-a8b48b8cfe32 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1213 microversion: 2.1 time: 0.281874 Sep 17 20:55:34.470878 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 570/1185] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:34 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1213 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:34.483336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-93423f0a-fb00-42ee-a69c-6d57e2f04774 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:34.488961 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-93423f0a-fb00-42ee-a69c-6d57e2f04774 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:34.502402 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-93423f0a-fb00-42ee-a69c-6d57e2f04774 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:34.504278 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d2b1d605-fe68-4f56-98bd-9d525b565115 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-997704176", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "abd24085-3207-4975-a2e8-9c99f58fa2c7"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:34.505333 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-93423f0a-fb00-42ee-a69c-6d57e2f04774 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:34.505930 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-93423f0a-fb00-42ee-a69c-6d57e2f04774 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:34.507449 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-93423f0a-fb00-42ee-a69c-6d57e2f04774 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:34.509239 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-93423f0a-fb00-42ee-a69c-6d57e2f04774 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:34.511934 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-93423f0a-fb00-42ee-a69c-6d57e2f04774 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:34.585380 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-d2b1d605-fe68-4f56-98bd-9d525b565115 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] validate_networks() for [('abd24085-3207-4975-a2e8-9c99f58fa2c7', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:55:34.696392 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-93423f0a-fb00-42ee-a69c-6d57e2f04774 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:34.744505 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-93423f0a-fb00-42ee-a69c-6d57e2f04774 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:34.751668 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-93423f0a-fb00-42ee-a69c-6d57e2f04774 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:34.753080 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-93423f0a-fb00-42ee-a69c-6d57e2f04774 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1576 microversion: 2.32 time: 0.280966 Sep 17 20:55:34.773212 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 571/1186] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:34 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1576 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:34.781920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-65f78d08-ee82-424e-82e0-6bde5a79edc4 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:34.795419 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-65f78d08-ee82-424e-82e0-6bde5a79edc4 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] [instance: 44fa7976-1412-4c83-ae29-b02e16186990] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:34.804109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:34.823947 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-65f78d08-ee82-424e-82e0-6bde5a79edc4 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:34.841549 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-65f78d08-ee82-424e-82e0-6bde5a79edc4 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:34.842298 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-65f78d08-ee82-424e-82e0-6bde5a79edc4 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:34.843237 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-65f78d08-ee82-424e-82e0-6bde5a79edc4 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:34.843895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-65f78d08-ee82-424e-82e0-6bde5a79edc4 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:34.844474 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-65f78d08-ee82-424e-82e0-6bde5a79edc4 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:35.985685 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-65f78d08-ee82-424e-82e0-6bde5a79edc4 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7681de64c248268da4d78124f59b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d60144477f4a5192d581350d678979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:35.997732 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-65f78d08-ee82-424e-82e0-6bde5a79edc4 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] 10.222.0.26 "GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990" status: 200 len: 1607 microversion: 2.1 time: 1.222875 Sep 17 20:55:35.998336 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 572/1187] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:34 2022] GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990 => generated 1607 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:36.004092 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-02b65a46-52de-4aa5-a581-63a554eb73a4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:36.005555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-02b65a46-52de-4aa5-a581-63a554eb73a4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 89b39b18-ff49-4810-9701-3084736ff2d0] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:36.022796 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02b65a46-52de-4aa5-a581-63a554eb73a4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:36.023606 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02b65a46-52de-4aa5-a581-63a554eb73a4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:36.024207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02b65a46-52de-4aa5-a581-63a554eb73a4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:36.026773 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02b65a46-52de-4aa5-a581-63a554eb73a4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:36.028095 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02b65a46-52de-4aa5-a581-63a554eb73a4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:36.030820 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02b65a46-52de-4aa5-a581-63a554eb73a4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:36.050541 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-02b65a46-52de-4aa5-a581-63a554eb73a4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] HTTP exception thrown: Instance 89b39b18-ff49-4810-9701-3084736ff2d0 could not be found. Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-02b65a46-52de-4aa5-a581-63a554eb73a4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Request method failure captured: Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 HTTP/1.1 Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjMW4WTMrHVxT_blH9OktIdsLxdSc4WUWVP8xumJavGA2GiRpiJlQJhI5X_he7_TVPivWgrAsf02nd8RHzhJ31a5Qgvl4lZ2TEO5bOf-4RaZy91bp9Tmv8DbTpLGvhmreUrma1J_K-T2_-ItJNWXrzg7NdUY0DyjuqhtzF_M_k9ZhT0 Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 07ce9fd746374b478a743261eb014e5c Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-MigrationsAdminTest-1514848596 Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/07ce9fd746374b478a743261eb014e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/07ce9fd746374b478a743261eb014e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/07ce9fd746374b478a743261eb014e5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_07ce9fd746374b478a743261eb014e5c", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-MigrationsAdminTest-1514848596 Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 07ce9fd746374b478a743261eb014e5c Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-MigrationsAdminTest-1514848596 Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-MigrationsAdminTest-1514848596-project Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 226a87a1f393420b8d19ec2390e9d063 Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-MigrationsAdminTest-1514848596-project Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 89b39b18-ff49-4810-9701-3084736ff2d0 could not be found. Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '89b39b18-ff49-4810-9701-3084736ff2d0'} Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89b39b18-ff49-4810-9701-3084736ff2d0 could not be found. Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89b39b18-ff49-4810-9701-3084736ff2d0 could not be found. Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:55:36.052549 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:55:36.059361 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:55:36.059361 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:55:36.059361 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:55:36.059361 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:55:36.059361 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:55:36.059361 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89b39b18-ff49-4810-9701-3084736ff2d0 could not be found. Sep 17 20:55:36.059361 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:55:36.059361 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-02b65a46-52de-4aa5-a581-63a554eb73a4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Returning 404 to user: Instance 89b39b18-ff49-4810-9701-3084736ff2d0 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:55:36.064253 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-02b65a46-52de-4aa5-a581-63a554eb73a4 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0" status: 404 len: 111 microversion: 2.1 time: 0.062950 Sep 17 20:55:36.065415 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 573/1188] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:35 2022] GET /compute/v2.1/servers/89b39b18-ff49-4810-9701-3084736ff2d0 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:55:36.070577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1585a42f-d0c2-4787-9f1f-ca07a6837ed8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:36.071535 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1585a42f-d0c2-4787-9f1f-ca07a6837ed8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:36.081752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1585a42f-d0c2-4787-9f1f-ca07a6837ed8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:36.086195 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1585a42f-d0c2-4787-9f1f-ca07a6837ed8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:36.086933 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1585a42f-d0c2-4787-9f1f-ca07a6837ed8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:36.087902 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1585a42f-d0c2-4787-9f1f-ca07a6837ed8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:36.089058 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1585a42f-d0c2-4787-9f1f-ca07a6837ed8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:36.090134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1585a42f-d0c2-4787-9f1f-ca07a6837ed8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:36.852621 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-d2b1d605-fe68-4f56-98bd-9d525b565115 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:55:36.853690 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-d2b1d605-fe68-4f56-98bd-9d525b565115 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:55:36.855892 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-d2b1d605-fe68-4f56-98bd-9d525b565115 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:55:36.856345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-d2b1d605-fe68-4f56-98bd-9d525b565115 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:55:36.860089 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1585a42f-d0c2-4787-9f1f-ca07a6837ed8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:36.860827 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-d2b1d605-fe68-4f56-98bd-9d525b565115 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:55:36.878997 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1585a42f-d0c2-4787-9f1f-ca07a6837ed8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:36.881109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1585a42f-d0c2-4787-9f1f-ca07a6837ed8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:36.886914 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1585a42f-d0c2-4787-9f1f-ca07a6837ed8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 1814 microversion: 2.25 time: 0.817128 Sep 17 20:55:36.889653 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 574/1189] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:36 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 1814 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:36.903180 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c26af140-4138-4d21-81d3-4d08d67fc6de tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:36.904941 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c26af140-4138-4d21-81d3-4d08d67fc6de tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:36.932020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c26af140-4138-4d21-81d3-4d08d67fc6de tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:36.932301 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c26af140-4138-4d21-81d3-4d08d67fc6de tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:36.935238 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c26af140-4138-4d21-81d3-4d08d67fc6de tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:36.936880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c26af140-4138-4d21-81d3-4d08d67fc6de tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:36.942837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c26af140-4138-4d21-81d3-4d08d67fc6de tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:36.944058 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c26af140-4138-4d21-81d3-4d08d67fc6de tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:36.945985 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d2b1d605-fe68-4f56-98bd-9d525b565115 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:36.950258 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d2b1d605-fe68-4f56-98bd-9d525b565115 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:36.951476 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d2b1d605-fe68-4f56-98bd-9d525b565115 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:36.958237 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d2b1d605-fe68-4f56-98bd-9d525b565115 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:36.961043 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d2b1d605-fe68-4f56-98bd-9d525b565115 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:36.964588 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d2b1d605-fe68-4f56-98bd-9d525b565115 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:37.076010 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-d2b1d605-fe68-4f56-98bd-9d525b565115 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Getting quotas for project 2a4117ca05454573bbd93fbca50431d2. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:55:37.090844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-d2b1d605-fe68-4f56-98bd-9d525b565115 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Getting quotas for user 6e33e0b756e14af28a90cc5c76d346e6 and project 2a4117ca05454573bbd93fbca50431d2. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:55:37.158672 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d2b1d605-fe68-4f56-98bd-9d525b565115 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:55:37.172761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d2b1d605-fe68-4f56-98bd-9d525b565115 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: d99ba94b-addd-4964-8d95-91de304a4988] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:55:37.296532 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c26af140-4138-4d21-81d3-4d08d67fc6de tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:37.300071 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:37.317447 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c26af140-4138-4d21-81d3-4d08d67fc6de tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1275 microversion: 2.1 time: 0.424413 Sep 17 20:55:37.324999 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 575/1190] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:36 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1275 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:37.361698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2633f437-e986-4569-8fcf-31b7b5be9a49 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:37.366319 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2633f437-e986-4569-8fcf-31b7b5be9a49 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:37.412032 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d2b1d605-fe68-4f56-98bd-9d525b565115 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.008980 Sep 17 20:55:37.412729 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2633f437-e986-4569-8fcf-31b7b5be9a49 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:37.413234 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2633f437-e986-4569-8fcf-31b7b5be9a49 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:37.413748 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2633f437-e986-4569-8fcf-31b7b5be9a49 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:37.417803 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2633f437-e986-4569-8fcf-31b7b5be9a49 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:37.417998 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 616/1191] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:55:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 3014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:55:37.418301 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2633f437-e986-4569-8fcf-31b7b5be9a49 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:37.430054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2633f437-e986-4569-8fcf-31b7b5be9a49 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:37.431708 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-36e967c6-ddb6-4223-88ff-b9eae9055628 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '.version_select at 0x7f25a55fb5e0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:37.501897 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-36e967c6-ddb6-4223-88ff-b9eae9055628 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-661048962" status: 202 len: 0 microversion: 2.1 time: 0.081960 Sep 17 20:55:37.502874 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 617/1192] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Sep 17 20:55:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-661048962 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:55:37.518813 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-dc9574f5-39bf-4788-b39a-11a7b74bbc89 req-264fa39f-58f4-4217-a98d-b9d17ffb8d0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44fa7976-1412-4c83-ae29-b02e16186990", "name": "network-vif-deleted", "tag": "7125d3dc-3622-46b0-a3c6-b60d56b537b5"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:37.562177 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-dc9574f5-39bf-4788-b39a-11a7b74bbc89 req-264fa39f-58f4-4217-a98d-b9d17ffb8d0c service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:37.563068 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-dc9574f5-39bf-4788-b39a-11a7b74bbc89 req-264fa39f-58f4-4217-a98d-b9d17ffb8d0c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:37.563823 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-dc9574f5-39bf-4788-b39a-11a7b74bbc89 req-264fa39f-58f4-4217-a98d-b9d17ffb8d0c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:37.602889 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-dc9574f5-39bf-4788-b39a-11a7b74bbc89 req-264fa39f-58f4-4217-a98d-b9d17ffb8d0c service nova] Creating event network-vif-deleted:7125d3dc-3622-46b0-a3c6-b60d56b537b5 for instance 44fa7976-1412-4c83-ae29-b02e16186990 on nch2-master-1 Sep 17 20:55:37.629491 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-dc9574f5-39bf-4788-b39a-11a7b74bbc89 req-264fa39f-58f4-4217-a98d-b9d17ffb8d0c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124075 Sep 17 20:55:37.637593 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 618/1193] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:37.650224 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3132531c-0948-4518-b688-5963b0213578 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:37.658102 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3132531c-0948-4518-b688-5963b0213578 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] [instance: 44fa7976-1412-4c83-ae29-b02e16186990] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:37.673399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3132531c-0948-4518-b688-5963b0213578 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:37.674115 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3132531c-0948-4518-b688-5963b0213578 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:37.677454 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3132531c-0948-4518-b688-5963b0213578 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:37.678436 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3132531c-0948-4518-b688-5963b0213578 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:37.679062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3132531c-0948-4518-b688-5963b0213578 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:37.680704 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3132531c-0948-4518-b688-5963b0213578 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:38.167160 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2633f437-e986-4569-8fcf-31b7b5be9a49 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:38.179891 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2633f437-e986-4569-8fcf-31b7b5be9a49 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:38.192131 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2633f437-e986-4569-8fcf-31b7b5be9a49 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:38.201182 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2633f437-e986-4569-8fcf-31b7b5be9a49 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1594 microversion: 2.32 time: 0.870801 Sep 17 20:55:38.205938 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 576/1194] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:37 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1594 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:38.211492 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3132531c-0948-4518-b688-5963b0213578 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7681de64c248268da4d78124f59b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d60144477f4a5192d581350d678979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:38.221716 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-db14b747-7cb0-4202-a167-6da9d038827d req-f217d737-526f-43a4-a5db-2080a8acb38f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdc5c241-5abc-4fde-b458-961a9cd5eb4c", "name": "network-vif-deleted", "tag": "f6aa453c-b788-41f9-8c99-9269c4f81d7b"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:38.231269 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3132531c-0948-4518-b688-5963b0213578 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] 10.222.0.26 "GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990" status: 200 len: 1252 microversion: 2.1 time: 0.592678 Sep 17 20:55:38.235903 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 619/1195] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:37 2022] GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990 => generated 1252 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:38.257358 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-db14b747-7cb0-4202-a167-6da9d038827d req-f217d737-526f-43a4-a5db-2080a8acb38f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:38.262440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-db14b747-7cb0-4202-a167-6da9d038827d req-f217d737-526f-43a4-a5db-2080a8acb38f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:38.265310 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-db14b747-7cb0-4202-a167-6da9d038827d req-f217d737-526f-43a4-a5db-2080a8acb38f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:38.300292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cebc6810-74f5-4b53-8245-2cd41970871d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:38.301133 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cebc6810-74f5-4b53-8245-2cd41970871d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: d99ba94b-addd-4964-8d95-91de304a4988] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:38.318386 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-db14b747-7cb0-4202-a167-6da9d038827d req-f217d737-526f-43a4-a5db-2080a8acb38f service nova] Creating event network-vif-deleted:f6aa453c-b788-41f9-8c99-9269c4f81d7b for instance fdc5c241-5abc-4fde-b458-961a9cd5eb4c on nch2-master-1 Sep 17 20:55:38.359379 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-db14b747-7cb0-4202-a167-6da9d038827d req-f217d737-526f-43a4-a5db-2080a8acb38f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146219 Sep 17 20:55:38.364526 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 577/1196] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:38.384398 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d2613186-3773-4d06-b125-da121f459a45 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:38.394571 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d2613186-3773-4d06-b125-da121f459a45 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:38.424851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2613186-3773-4d06-b125-da121f459a45 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:38.437138 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2613186-3773-4d06-b125-da121f459a45 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:38.443649 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2613186-3773-4d06-b125-da121f459a45 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:38.445237 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2613186-3773-4d06-b125-da121f459a45 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:38.445880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2613186-3773-4d06-b125-da121f459a45 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:38.448909 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2613186-3773-4d06-b125-da121f459a45 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:38.857860 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cebc6810-74f5-4b53-8245-2cd41970871d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:38.869390 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cebc6810-74f5-4b53-8245-2cd41970871d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988" status: 200 len: 1207 microversion: 2.1 time: 0.630931 Sep 17 20:55:38.878246 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 620/1197] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:38 2022] GET /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988 => generated 1207 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:38.911157 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0c13c401-6d99-4407-8e20-d3d818f17857 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:38.911789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0c13c401-6d99-4407-8e20-d3d818f17857 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:38.937581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c13c401-6d99-4407-8e20-d3d818f17857 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:38.942131 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c13c401-6d99-4407-8e20-d3d818f17857 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:38.942718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c13c401-6d99-4407-8e20-d3d818f17857 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:38.947213 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c13c401-6d99-4407-8e20-d3d818f17857 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:38.948015 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c13c401-6d99-4407-8e20-d3d818f17857 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:38.954018 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c13c401-6d99-4407-8e20-d3d818f17857 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:39.367178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0c13c401-6d99-4407-8e20-d3d818f17857 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:39.381336 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0c13c401-6d99-4407-8e20-d3d818f17857 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1275 microversion: 2.1 time: 0.491672 Sep 17 20:55:39.382429 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 621/1198] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:38 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1275 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:39.386947 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d2613186-3773-4d06-b125-da121f459a45 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:39.403506 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d2613186-3773-4d06-b125-da121f459a45 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:39.411572 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d2613186-3773-4d06-b125-da121f459a45 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:39.416254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-15bc532f-1897-4585-a556-93a416bfd2c0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:39.416473 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d2613186-3773-4d06-b125-da121f459a45 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 1814 microversion: 2.25 time: 1.040535 Sep 17 20:55:39.418522 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 578/1199] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:38 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 1814 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:39.419418 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-15bc532f-1897-4585-a556-93a416bfd2c0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:39.450579 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-513b49ee-dd05-4b96-a108-a986e35b3685 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:39.451234 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-15bc532f-1897-4585-a556-93a416bfd2c0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:39.452765 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-513b49ee-dd05-4b96-a108-a986e35b3685 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] [instance: 44fa7976-1412-4c83-ae29-b02e16186990] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:39.466881 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-15bc532f-1897-4585-a556-93a416bfd2c0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:39.470533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-15bc532f-1897-4585-a556-93a416bfd2c0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:39.479082 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-513b49ee-dd05-4b96-a108-a986e35b3685 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:39.479640 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-15bc532f-1897-4585-a556-93a416bfd2c0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:39.480147 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-15bc532f-1897-4585-a556-93a416bfd2c0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:39.481683 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-15bc532f-1897-4585-a556-93a416bfd2c0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:39.481815 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-513b49ee-dd05-4b96-a108-a986e35b3685 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:39.482213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-513b49ee-dd05-4b96-a108-a986e35b3685 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:39.486010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-513b49ee-dd05-4b96-a108-a986e35b3685 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:39.486657 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-513b49ee-dd05-4b96-a108-a986e35b3685 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:39.487266 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-513b49ee-dd05-4b96-a108-a986e35b3685 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:39.671745 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-513b49ee-dd05-4b96-a108-a986e35b3685 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:39.680389 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-513b49ee-dd05-4b96-a108-a986e35b3685 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:39.681288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-513b49ee-dd05-4b96-a108-a986e35b3685 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:39.682846 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-513b49ee-dd05-4b96-a108-a986e35b3685 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lazy-loading 'fault' on Instance uuid 44fa7976-1412-4c83-ae29-b02e16186990 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:55:39.973196 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-513b49ee-dd05-4b96-a108-a986e35b3685 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f7681de64c248268da4d78124f59b54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d60144477f4a5192d581350d678979', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:39.987143 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-513b49ee-dd05-4b96-a108-a986e35b3685 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] 10.222.0.26 "GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990" status: 200 len: 1211 microversion: 2.1 time: 0.567228 Sep 17 20:55:39.992230 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 579/1200] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:39 2022] GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990 => generated 1211 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:40.009154 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-833f97f3-4b50-4207-92d6-2b4c872c7570 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:40.010777 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-833f97f3-4b50-4207-92d6-2b4c872c7570 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: d99ba94b-addd-4964-8d95-91de304a4988] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:40.030659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-833f97f3-4b50-4207-92d6-2b4c872c7570 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:40.033873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-833f97f3-4b50-4207-92d6-2b4c872c7570 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:40.040747 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-833f97f3-4b50-4207-92d6-2b4c872c7570 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:40.046435 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-833f97f3-4b50-4207-92d6-2b4c872c7570 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:40.047258 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-833f97f3-4b50-4207-92d6-2b4c872c7570 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:40.047906 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-833f97f3-4b50-4207-92d6-2b4c872c7570 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:40.306679 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-833f97f3-4b50-4207-92d6-2b4c872c7570 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:40.316269 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-833f97f3-4b50-4207-92d6-2b4c872c7570 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988" status: 200 len: 1259 microversion: 2.1 time: 0.320691 Sep 17 20:55:40.320398 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 580/1201] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:39 2022] GET /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988 => generated 1259 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:40.424505 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-15bc532f-1897-4585-a556-93a416bfd2c0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:40.459909 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-15bc532f-1897-4585-a556-93a416bfd2c0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:40.467392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-15bc532f-1897-4585-a556-93a416bfd2c0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:40.474700 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-15bc532f-1897-4585-a556-93a416bfd2c0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1662 microversion: 2.32 time: 1.080922 Sep 17 20:55:40.478937 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 622/1202] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:39 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1662 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:40.491181 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ebde5028-0e55-429c-baaa-d2a8bbe029e2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:40.496398 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ebde5028-0e55-429c-baaa-d2a8bbe029e2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:40.513838 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ebde5028-0e55-429c-baaa-d2a8bbe029e2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:40.515618 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ebde5028-0e55-429c-baaa-d2a8bbe029e2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:40.516359 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ebde5028-0e55-429c-baaa-d2a8bbe029e2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:40.523038 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ebde5028-0e55-429c-baaa-d2a8bbe029e2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:40.523662 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ebde5028-0e55-429c-baaa-d2a8bbe029e2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:40.524197 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ebde5028-0e55-429c-baaa-d2a8bbe029e2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:40.554406 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:40.561417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-02772b7d-fa6f-4a9d-9214-ca5f3e0b75eb tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Calling method '.version_select at 0x7f25a5100ca0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:40.563212 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02772b7d-fa6f-4a9d-9214-ca5f3e0b75eb tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:40.563698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02772b7d-fa6f-4a9d-9214-ca5f3e0b75eb tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:40.564176 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02772b7d-fa6f-4a9d-9214-ca5f3e0b75eb tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:40.590254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02772b7d-fa6f-4a9d-9214-ca5f3e0b75eb tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:40.590759 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02772b7d-fa6f-4a9d-9214-ca5f3e0b75eb tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:40.591194 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02772b7d-fa6f-4a9d-9214-ca5f3e0b75eb tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:40.627801 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02772b7d-fa6f-4a9d-9214-ca5f3e0b75eb tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:40.632086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02772b7d-fa6f-4a9d-9214-ca5f3e0b75eb tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:40.632713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02772b7d-fa6f-4a9d-9214-ca5f3e0b75eb tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:40.648989 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-02772b7d-fa6f-4a9d-9214-ca5f3e0b75eb tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.327142 Sep 17 20:55:40.649887 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 581/1203] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:55:40 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:40.662539 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-09d92aa7-6706-44b8-82ef-4d0ab2dc3c4a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:40.664916 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-09d92aa7-6706-44b8-82ef-4d0ab2dc3c4a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:40.672670 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ebde5028-0e55-429c-baaa-d2a8bbe029e2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:40.679207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09d92aa7-6706-44b8-82ef-4d0ab2dc3c4a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:40.680042 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09d92aa7-6706-44b8-82ef-4d0ab2dc3c4a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:40.680681 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09d92aa7-6706-44b8-82ef-4d0ab2dc3c4a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:40.681911 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09d92aa7-6706-44b8-82ef-4d0ab2dc3c4a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:40.682591 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09d92aa7-6706-44b8-82ef-4d0ab2dc3c4a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:40.684288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09d92aa7-6706-44b8-82ef-4d0ab2dc3c4a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:40.685445 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ebde5028-0e55-429c-baaa-d2a8bbe029e2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1275 microversion: 2.1 time: 0.204925 Sep 17 20:55:40.693350 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 623/1204] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:40 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1275 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:40.698498 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7371cef3-0e3f-4abe-9836-ca198d8fd73d tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Calling method '.version_select at 0x7f25a545d4c0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:40.700519 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7371cef3-0e3f-4abe-9836-ca198d8fd73d tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:40.704349 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7371cef3-0e3f-4abe-9836-ca198d8fd73d tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:40.705762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7371cef3-0e3f-4abe-9836-ca198d8fd73d tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:40.722523 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7371cef3-0e3f-4abe-9836-ca198d8fd73d tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:40.723371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7371cef3-0e3f-4abe-9836-ca198d8fd73d tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:40.724655 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7371cef3-0e3f-4abe-9836-ca198d8fd73d tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:40.738487 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7371cef3-0e3f-4abe-9836-ca198d8fd73d tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:40.739752 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7371cef3-0e3f-4abe-9836-ca198d8fd73d tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:40.740406 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7371cef3-0e3f-4abe-9836-ca198d8fd73d tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:40.747743 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7371cef3-0e3f-4abe-9836-ca198d8fd73d tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.052950 Sep 17 20:55:40.749101 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 624/1205] 10.222.0.26 () {58 vars in 1167 bytes} [Sat Sep 17 20:55:40 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:40.765087 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-15aad8e0-5b4a-413c-8f1c-3f971f6c495c tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Calling method '.version_select at 0x7f25a541e790>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:40.767368 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-15aad8e0-5b4a-413c-8f1c-3f971f6c495c tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:40.768020 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-15aad8e0-5b4a-413c-8f1c-3f971f6c495c tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:40.768756 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-15aad8e0-5b4a-413c-8f1c-3f971f6c495c tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:40.780754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:40.809768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-15aad8e0-5b4a-413c-8f1c-3f971f6c495c tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:40.810917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-15aad8e0-5b4a-413c-8f1c-3f971f6c495c tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:40.811370 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-15aad8e0-5b4a-413c-8f1c-3f971f6c495c tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:40.827840 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-15aad8e0-5b4a-413c-8f1c-3f971f6c495c tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:40.840952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-15aad8e0-5b4a-413c-8f1c-3f971f6c495c tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:40.841740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-15aad8e0-5b4a-413c-8f1c-3f971f6c495c tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:40.850192 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-15aad8e0-5b4a-413c-8f1c-3f971f6c495c tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.088866 Sep 17 20:55:40.851430 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 625/1206] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:55:40 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:55:40.861633 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2e75972e-55d8-4aad-ab96-c990880bd3aa tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Calling method '.version_select at 0x7f25a54941f0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:40.869153 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e75972e-55d8-4aad-ab96-c990880bd3aa tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:40.869990 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e75972e-55d8-4aad-ab96-c990880bd3aa tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:40.870703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e75972e-55d8-4aad-ab96-c990880bd3aa tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:40.908636 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e75972e-55d8-4aad-ab96-c990880bd3aa tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:40.909395 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e75972e-55d8-4aad-ab96-c990880bd3aa tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:40.910019 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e75972e-55d8-4aad-ab96-c990880bd3aa tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:40.920454 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2e75972e-55d8-4aad-ab96-c990880bd3aa tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.062457 Sep 17 20:55:40.921312 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 626/1207] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Sep 17 20:55:40 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:55:40.937826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-220a4dfb-4e5e-47c4-b009-dec0793f7a40 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Calling method '.version_select at 0x7f25a541e670>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:40.946812 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-220a4dfb-4e5e-47c4-b009-dec0793f7a40 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:40.947499 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-220a4dfb-4e5e-47c4-b009-dec0793f7a40 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:40.948107 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-220a4dfb-4e5e-47c4-b009-dec0793f7a40 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:40.994672 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-220a4dfb-4e5e-47c4-b009-dec0793f7a40 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 267 microversion: 2.1 time: 0.060745 Sep 17 20:55:40.996070 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 627/1208] 10.222.0.26 () {58 vars in 1179 bytes} [Sat Sep 17 20:55:40 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 267 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:55:41.005086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-09d92aa7-6706-44b8-82ef-4d0ab2dc3c4a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:41.009266 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4158a33f-3530-49bd-9470-ed7f996df4e0 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Calling method '.version_select at 0x7f25a54949d0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:41.014852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4158a33f-3530-49bd-9470-ed7f996df4e0 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:41.018144 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-09d92aa7-6706-44b8-82ef-4d0ab2dc3c4a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:41.018994 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4158a33f-3530-49bd-9470-ed7f996df4e0 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:41.020217 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4158a33f-3530-49bd-9470-ed7f996df4e0 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:41.025348 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-09d92aa7-6706-44b8-82ef-4d0ab2dc3c4a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:41.027014 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-09d92aa7-6706-44b8-82ef-4d0ab2dc3c4a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 1814 microversion: 2.25 time: 0.375986 Sep 17 20:55:41.027838 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 582/1209] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:40 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 1814 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:41.035994 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a2672544-0924-41fe-b042-31e337b4b26a tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:41.039423 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a2672544-0924-41fe-b042-31e337b4b26a tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] [instance: 44fa7976-1412-4c83-ae29-b02e16186990] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:41.054721 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2672544-0924-41fe-b042-31e337b4b26a tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:41.055585 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2672544-0924-41fe-b042-31e337b4b26a tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:41.057385 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2672544-0924-41fe-b042-31e337b4b26a tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:41.059478 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2672544-0924-41fe-b042-31e337b4b26a tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:41.062060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2672544-0924-41fe-b042-31e337b4b26a tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:41.062759 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2672544-0924-41fe-b042-31e337b4b26a tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:41.074092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4158a33f-3530-49bd-9470-ed7f996df4e0 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:41.077441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4158a33f-3530-49bd-9470-ed7f996df4e0 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:41.078387 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4158a33f-3530-49bd-9470-ed7f996df4e0 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:41.081977 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-a2672544-0924-41fe-b042-31e337b4b26a tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] HTTP exception thrown: Instance 44fa7976-1412-4c83-ae29-b02e16186990 could not be found. Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a2672544-0924-41fe-b042-31e337b4b26a tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Request method failure captured: Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990 HTTP/1.1 Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjOeAw-E4Cq5VwGTJ399Xs-3mMSPQCAeeFrP-KUVidiDFVFMVuoZ9pdaeiDwnn6n3gK8vrwn55fkReXDo9TNy9mi_DkaXIEjkdO7SpffACHeTBtq4pZFEGSJpR9abaNIg4Jkr6BgfAhDNR3qgfDk0CdD9Eji6edqfHZlZ6FTbDri5j0 Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 26d60144477f4a5192d581350d678979 Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersTestBootFromVolume-594505527 Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/26d60144477f4a5192d581350d678979"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/26d60144477f4a5192d581350d678979"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/26d60144477f4a5192d581350d678979"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_26d60144477f4a5192d581350d678979", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersTestBootFromVolume-594505527 Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 26d60144477f4a5192d581350d678979 Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersTestBootFromVolume-594505527 Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersTestBootFromVolume-594505527-project Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 6f7681de64c248268da4d78124f59b54 Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersTestBootFromVolume-594505527-project Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 44fa7976-1412-4c83-ae29-b02e16186990 could not be found. Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '44fa7976-1412-4c83-ae29-b02e16186990'} Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44fa7976-1412-4c83-ae29-b02e16186990 could not be found. Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44fa7976-1412-4c83-ae29-b02e16186990 could not be found. Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:55:41.084065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:55:41.088417 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:55:41.088417 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:55:41.088417 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:55:41.088417 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:55:41.088417 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:55:41.088417 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44fa7976-1412-4c83-ae29-b02e16186990 could not be found. Sep 17 20:55:41.088417 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:55:41.090240 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a2672544-0924-41fe-b042-31e337b4b26a tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Returning 404 to user: Instance 44fa7976-1412-4c83-ae29-b02e16186990 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:55:41.091337 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a2672544-0924-41fe-b042-31e337b4b26a tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] 10.222.0.26 "GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990" status: 404 len: 111 microversion: 2.1 time: 0.062321 Sep 17 20:55:41.092448 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 583/1210] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:41 2022] GET /compute/v2.1/servers/44fa7976-1412-4c83-ae29-b02e16186990 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:55:41.097743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6fa81343-3066-4872-983f-40792b32e110 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:41.108165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6fa81343-3066-4872-983f-40792b32e110 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:41.108978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4158a33f-3530-49bd-9470-ed7f996df4e0 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:41.109577 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4158a33f-3530-49bd-9470-ed7f996df4e0 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:41.110225 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4158a33f-3530-49bd-9470-ed7f996df4e0 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:41.117727 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fa81343-3066-4872-983f-40792b32e110 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:41.118244 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fa81343-3066-4872-983f-40792b32e110 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:41.118980 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fa81343-3066-4872-983f-40792b32e110 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:41.119603 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4158a33f-3530-49bd-9470-ed7f996df4e0 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.114038 Sep 17 20:55:41.119757 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fa81343-3066-4872-983f-40792b32e110 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:41.120225 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fa81343-3066-4872-983f-40792b32e110 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:41.120750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fa81343-3066-4872-983f-40792b32e110 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:41.121177 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 628/1211] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:55:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:55:41.126632 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e71fcab8-fd0a-4ad4-9b2e-bbb41480e394 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] Calling method '.version_select at 0x7f25a5590ee0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:41.157006 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e71fcab8-fd0a-4ad4-9b2e-bbb41480e394 tempest-ServersTestBootFromVolume-594505527 tempest-ServersTestBootFromVolume-594505527-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1568539338" status: 202 len: 0 microversion: 2.1 time: 0.032370 Sep 17 20:55:41.157751 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 629/1212] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Sep 17 20:55:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1568539338 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:55:41.170957 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5c4b3b9d-19d5-43f9-841e-352ba8ceedc3 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Calling method '.version_select at 0x7f25a53b8040>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:41.179003 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c4b3b9d-19d5-43f9-841e-352ba8ceedc3 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:41.179505 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c4b3b9d-19d5-43f9-841e-352ba8ceedc3 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:41.179837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6fa81343-3066-4872-983f-40792b32e110 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:55:41.180986 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c4b3b9d-19d5-43f9-841e-352ba8ceedc3 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:41.212840 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c4b3b9d-19d5-43f9-841e-352ba8ceedc3 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:41.215470 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c4b3b9d-19d5-43f9-841e-352ba8ceedc3 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:41.215938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c4b3b9d-19d5-43f9-841e-352ba8ceedc3 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:41.231761 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5c4b3b9d-19d5-43f9-841e-352ba8ceedc3 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 757 microversion: 2.1 time: 0.064973 Sep 17 20:55:41.234100 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 630/1213] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Sep 17 20:55:41 2022] GET /compute/v2.1/os-hypervisors/1 => generated 757 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:41.251916 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2b86df57-5781-4448-ba86-d994722bb310 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Calling method '.version_select at 0x7f25a5691280>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:41.255992 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b86df57-5781-4448-ba86-d994722bb310 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:41.257160 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b86df57-5781-4448-ba86-d994722bb310 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:41.259190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b86df57-5781-4448-ba86-d994722bb310 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:41.296640 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b86df57-5781-4448-ba86-d994722bb310 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:41.298186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b86df57-5781-4448-ba86-d994722bb310 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:41.298643 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b86df57-5781-4448-ba86-d994722bb310 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:41.319184 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2b86df57-5781-4448-ba86-d994722bb310 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.075265 Sep 17 20:55:41.320397 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 631/1214] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Sep 17 20:55:41 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:41.335529 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-760f58a1-6234-4d3b-ae24-8a6933887988 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Calling method '.version_select at 0x7f25a53b89d0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:41.337678 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-760f58a1-6234-4d3b-ae24-8a6933887988 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:41.338351 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-760f58a1-6234-4d3b-ae24-8a6933887988 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:41.339171 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-760f58a1-6234-4d3b-ae24-8a6933887988 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:41.379491 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-760f58a1-6234-4d3b-ae24-8a6933887988 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:41.380075 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-760f58a1-6234-4d3b-ae24-8a6933887988 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:41.380591 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-760f58a1-6234-4d3b-ae24-8a6933887988 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:41.404366 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-760f58a1-6234-4d3b-ae24-8a6933887988 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:41.406320 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-760f58a1-6234-4d3b-ae24-8a6933887988 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:41.409227 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-760f58a1-6234-4d3b-ae24-8a6933887988 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:41.442009 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6fa81343-3066-4872-983f-40792b32e110 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 204 len: 0 microversion: 2.1 time: 0.335980 Sep 17 20:55:41.443626 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 584/1215] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:55:41 2022] DELETE /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:55:41.461166 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a502e7f8-b26f-40d9-83de-c96b9c86f964 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:41.472871 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a502e7f8-b26f-40d9-83de-c96b9c86f964 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: d99ba94b-addd-4964-8d95-91de304a4988] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:41.492337 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a502e7f8-b26f-40d9-83de-c96b9c86f964 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:41.493137 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a502e7f8-b26f-40d9-83de-c96b9c86f964 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:41.493770 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a502e7f8-b26f-40d9-83de-c96b9c86f964 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:41.494637 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a502e7f8-b26f-40d9-83de-c96b9c86f964 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:41.495251 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a502e7f8-b26f-40d9-83de-c96b9c86f964 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:41.495892 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a502e7f8-b26f-40d9-83de-c96b9c86f964 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:41.639887 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=8 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:41.686244 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a502e7f8-b26f-40d9-83de-c96b9c86f964 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:41.709190 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a502e7f8-b26f-40d9-83de-c96b9c86f964 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988" status: 200 len: 1265 microversion: 2.1 time: 0.263636 Sep 17 20:55:41.711249 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 585/1216] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:41 2022] GET /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988 => generated 1265 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:41.720387 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-827114a5-c717-49ce-bff7-d97d1e647b60 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:41.723359 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-827114a5-c717-49ce-bff7-d97d1e647b60 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:41.743199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-827114a5-c717-49ce-bff7-d97d1e647b60 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:41.743753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-827114a5-c717-49ce-bff7-d97d1e647b60 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:41.758556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-827114a5-c717-49ce-bff7-d97d1e647b60 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:41.760117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-827114a5-c717-49ce-bff7-d97d1e647b60 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:41.761924 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-827114a5-c717-49ce-bff7-d97d1e647b60 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:41.764064 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-827114a5-c717-49ce-bff7-d97d1e647b60 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:42.201733 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-827114a5-c717-49ce-bff7-d97d1e647b60 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:42.211628 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-827114a5-c717-49ce-bff7-d97d1e647b60 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1467 microversion: 2.1 time: 0.499242 Sep 17 20:55:42.234338 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 586/1217] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:41 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1467 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:42.244466 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-59699b39-6c89-481b-b53f-bc6f6dd256b1 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:42.245315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-59699b39-6c89-481b-b53f-bc6f6dd256b1 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:42.256739 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59699b39-6c89-481b-b53f-bc6f6dd256b1 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:42.257616 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59699b39-6c89-481b-b53f-bc6f6dd256b1 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:42.258367 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59699b39-6c89-481b-b53f-bc6f6dd256b1 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:42.259378 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59699b39-6c89-481b-b53f-bc6f6dd256b1 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:42.260140 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59699b39-6c89-481b-b53f-bc6f6dd256b1 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:42.261478 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59699b39-6c89-481b-b53f-bc6f6dd256b1 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:42.391943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:42.446354 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-760f58a1-6234-4d3b-ae24-8a6933887988 tempest-HypervisorAdminTestJSON-257328725 tempest-HypervisorAdminTestJSON-257328725-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 1.112532 Sep 17 20:55:42.449369 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 632/1218] 10.222.0.26 () {58 vars in 1173 bytes} [Sat Sep 17 20:55:41 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:42.477122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8af48484-38be-4c71-bc87-f586f447f61f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:42.487423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8af48484-38be-4c71-bc87-f586f447f61f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:42.503636 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8af48484-38be-4c71-bc87-f586f447f61f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:42.505138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8af48484-38be-4c71-bc87-f586f447f61f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:42.508362 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8af48484-38be-4c71-bc87-f586f447f61f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:42.521979 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8af48484-38be-4c71-bc87-f586f447f61f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:42.523939 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8af48484-38be-4c71-bc87-f586f447f61f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:42.524404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8af48484-38be-4c71-bc87-f586f447f61f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:42.880361 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-59699b39-6c89-481b-b53f-bc6f6dd256b1 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:42.896418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-59699b39-6c89-481b-b53f-bc6f6dd256b1 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:42.898655 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-59699b39-6c89-481b-b53f-bc6f6dd256b1 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:42.906040 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-59699b39-6c89-481b-b53f-bc6f6dd256b1 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1709 microversion: 2.32 time: 0.670365 Sep 17 20:55:42.907223 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 587/1219] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:42 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1709 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:42.912081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c2da8a65-a6e4-4224-8529-51cd2897c49d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:42.916662 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c2da8a65-a6e4-4224-8529-51cd2897c49d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:42.935216 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c2da8a65-a6e4-4224-8529-51cd2897c49d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:42.936116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c2da8a65-a6e4-4224-8529-51cd2897c49d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:42.936770 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c2da8a65-a6e4-4224-8529-51cd2897c49d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:42.937747 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c2da8a65-a6e4-4224-8529-51cd2897c49d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:42.938375 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c2da8a65-a6e4-4224-8529-51cd2897c49d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:42.938990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c2da8a65-a6e4-4224-8529-51cd2897c49d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:43.347101 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8af48484-38be-4c71-bc87-f586f447f61f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:43.359177 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8af48484-38be-4c71-bc87-f586f447f61f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1317 microversion: 2.1 time: 0.905286 Sep 17 20:55:43.361330 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 633/1220] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:42 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1317 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:43.367469 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3db008f2-b1cd-404a-a6a1-10f866df7fb4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:43.368651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3db008f2-b1cd-404a-a6a1-10f866df7fb4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: d99ba94b-addd-4964-8d95-91de304a4988] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:43.384280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3db008f2-b1cd-404a-a6a1-10f866df7fb4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:43.385021 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3db008f2-b1cd-404a-a6a1-10f866df7fb4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:43.385912 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3db008f2-b1cd-404a-a6a1-10f866df7fb4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:43.386784 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3db008f2-b1cd-404a-a6a1-10f866df7fb4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:43.394247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3db008f2-b1cd-404a-a6a1-10f866df7fb4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:43.395158 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3db008f2-b1cd-404a-a6a1-10f866df7fb4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:43.764402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3db008f2-b1cd-404a-a6a1-10f866df7fb4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:43.779288 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3db008f2-b1cd-404a-a6a1-10f866df7fb4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988" status: 200 len: 1265 microversion: 2.1 time: 0.416053 Sep 17 20:55:43.780139 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 634/1221] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:43 2022] GET /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988 => generated 1265 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:43.802592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fd970e84-581a-47a1-837e-e12e04cb11c5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:43.803973 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fd970e84-581a-47a1-837e-e12e04cb11c5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:43.812046 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fd970e84-581a-47a1-837e-e12e04cb11c5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:43.813183 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fd970e84-581a-47a1-837e-e12e04cb11c5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:43.813760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fd970e84-581a-47a1-837e-e12e04cb11c5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:43.814581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fd970e84-581a-47a1-837e-e12e04cb11c5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:43.816012 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fd970e84-581a-47a1-837e-e12e04cb11c5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:43.817015 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fd970e84-581a-47a1-837e-e12e04cb11c5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:43.826983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c2da8a65-a6e4-4224-8529-51cd2897c49d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:43.839202 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c2da8a65-a6e4-4224-8529-51cd2897c49d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:43.840727 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c2da8a65-a6e4-4224-8529-51cd2897c49d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:43.842107 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c2da8a65-a6e4-4224-8529-51cd2897c49d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 1814 microversion: 2.25 time: 0.933671 Sep 17 20:55:43.843656 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 588/1222] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:42 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 1814 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:43.936323 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-56c07e8a-04d1-4dd9-a0b3-10ddfb1cb2b9 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:43.937144 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-56c07e8a-04d1-4dd9-a0b3-10ddfb1cb2b9 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:43.944082 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56c07e8a-04d1-4dd9-a0b3-10ddfb1cb2b9 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:43.944837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56c07e8a-04d1-4dd9-a0b3-10ddfb1cb2b9 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:43.945277 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56c07e8a-04d1-4dd9-a0b3-10ddfb1cb2b9 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:43.946019 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56c07e8a-04d1-4dd9-a0b3-10ddfb1cb2b9 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:43.946638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56c07e8a-04d1-4dd9-a0b3-10ddfb1cb2b9 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:43.947238 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56c07e8a-04d1-4dd9-a0b3-10ddfb1cb2b9 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:44.295112 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fd970e84-581a-47a1-837e-e12e04cb11c5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:44.309640 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fd970e84-581a-47a1-837e-e12e04cb11c5 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1467 microversion: 2.1 time: 0.508079 Sep 17 20:55:44.311826 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 635/1223] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:43 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1467 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:44.384355 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f589b1c6-6581-4fbd-8a30-9af41f9e0f91 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:44.385094 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f589b1c6-6581-4fbd-8a30-9af41f9e0f91 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:44.395683 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f589b1c6-6581-4fbd-8a30-9af41f9e0f91 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:44.402756 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f589b1c6-6581-4fbd-8a30-9af41f9e0f91 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:44.405015 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f589b1c6-6581-4fbd-8a30-9af41f9e0f91 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:44.406330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f589b1c6-6581-4fbd-8a30-9af41f9e0f91 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:44.413105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f589b1c6-6581-4fbd-8a30-9af41f9e0f91 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:44.414287 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f589b1c6-6581-4fbd-8a30-9af41f9e0f91 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:44.443913 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-56c07e8a-04d1-4dd9-a0b3-10ddfb1cb2b9 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:44.464016 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-56c07e8a-04d1-4dd9-a0b3-10ddfb1cb2b9 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:44.471194 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-56c07e8a-04d1-4dd9-a0b3-10ddfb1cb2b9 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:44.473841 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-56c07e8a-04d1-4dd9-a0b3-10ddfb1cb2b9 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1697 microversion: 2.32 time: 0.540605 Sep 17 20:55:44.486181 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 589/1224] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:43 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1697 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 20:55:44.804461 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ff950d3d-0075-432b-a7d9-725d3be8c1f1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:44.805087 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ff950d3d-0075-432b-a7d9-725d3be8c1f1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: d99ba94b-addd-4964-8d95-91de304a4988] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:44.825417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff950d3d-0075-432b-a7d9-725d3be8c1f1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:44.830547 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff950d3d-0075-432b-a7d9-725d3be8c1f1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:44.831086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff950d3d-0075-432b-a7d9-725d3be8c1f1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:44.837377 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff950d3d-0075-432b-a7d9-725d3be8c1f1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:44.837906 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff950d3d-0075-432b-a7d9-725d3be8c1f1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:44.838350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff950d3d-0075-432b-a7d9-725d3be8c1f1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:45.174929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f589b1c6-6581-4fbd-8a30-9af41f9e0f91 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:45.189053 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f589b1c6-6581-4fbd-8a30-9af41f9e0f91 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1317 microversion: 2.1 time: 0.809090 Sep 17 20:55:45.207853 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 636/1225] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:44 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1317 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:55:45.214921 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f0703290-f3ff-46dd-afe8-0e33c1a0a6a0 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:45.215868 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f0703290-f3ff-46dd-afe8-0e33c1a0a6a0 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:45.229332 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f0703290-f3ff-46dd-afe8-0e33c1a0a6a0 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:45.231138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f0703290-f3ff-46dd-afe8-0e33c1a0a6a0 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:45.232504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f0703290-f3ff-46dd-afe8-0e33c1a0a6a0 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:45.234054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f0703290-f3ff-46dd-afe8-0e33c1a0a6a0 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:45.234720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f0703290-f3ff-46dd-afe8-0e33c1a0a6a0 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:45.235319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f0703290-f3ff-46dd-afe8-0e33c1a0a6a0 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:45.328482 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ff950d3d-0075-432b-a7d9-725d3be8c1f1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:45.339537 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ff950d3d-0075-432b-a7d9-725d3be8c1f1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988" status: 200 len: 1307 microversion: 2.1 time: 0.538143 Sep 17 20:55:45.340487 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 590/1226] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:44 2022] GET /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988 => generated 1307 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:45.340487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-25ff8f12-4cc1-45a9-a47a-e73c72a3c905 req-6cf9a7f8-5e34-4ed2-ad45-7515f972fa54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700", "name": "network-vif-deleted", "tag": "3b2dfcf9-36b6-4299-8814-a29f994bcc2f"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:45.416760 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-25ff8f12-4cc1-45a9-a47a-e73c72a3c905 req-6cf9a7f8-5e34-4ed2-ad45-7515f972fa54 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:45.420761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-25ff8f12-4cc1-45a9-a47a-e73c72a3c905 req-6cf9a7f8-5e34-4ed2-ad45-7515f972fa54 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:45.420761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-25ff8f12-4cc1-45a9-a47a-e73c72a3c905 req-6cf9a7f8-5e34-4ed2-ad45-7515f972fa54 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:45.444292 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-25ff8f12-4cc1-45a9-a47a-e73c72a3c905 req-6cf9a7f8-5e34-4ed2-ad45-7515f972fa54 service nova] Creating event network-vif-deleted:3b2dfcf9-36b6-4299-8814-a29f994bcc2f for instance e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 on nch2-master-1 Sep 17 20:55:45.463266 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-25ff8f12-4cc1-45a9-a47a-e73c72a3c905 req-6cf9a7f8-5e34-4ed2-ad45-7515f972fa54 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120825 Sep 17 20:55:45.464497 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 591/1227] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:45.476127 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f0d41698-c377-4ef4-b994-4edb901a298c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:45.479584 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f0d41698-c377-4ef4-b994-4edb901a298c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:45.496944 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0d41698-c377-4ef4-b994-4edb901a298c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:45.501068 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0d41698-c377-4ef4-b994-4edb901a298c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:45.501812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0d41698-c377-4ef4-b994-4edb901a298c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:45.502708 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0d41698-c377-4ef4-b994-4edb901a298c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:45.503331 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0d41698-c377-4ef4-b994-4edb901a298c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:45.503917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0d41698-c377-4ef4-b994-4edb901a298c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:45.546974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:45.595195 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0d41698-c377-4ef4-b994-4edb901a298c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:45.595706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0d41698-c377-4ef4-b994-4edb901a298c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:45.598623 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0d41698-c377-4ef4-b994-4edb901a298c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:45.599288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-f0d41698-c377-4ef4-b994-4edb901a298c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lazy-loading 'fault' on Instance uuid e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:55:45.663803 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f0703290-f3ff-46dd-afe8-0e33c1a0a6a0 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:45.675193 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f0703290-f3ff-46dd-afe8-0e33c1a0a6a0 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:45.676706 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f0703290-f3ff-46dd-afe8-0e33c1a0a6a0 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:45.683910 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f0703290-f3ff-46dd-afe8-0e33c1a0a6a0 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 1804 microversion: 2.25 time: 0.474314 Sep 17 20:55:45.697648 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 637/1228] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:45 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 1804 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:45.715596 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-06b5d394-ebc0-4f35-84da-c646121712cd tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:45.718493 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-06b5d394-ebc0-4f35-84da-c646121712cd tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:45.726614 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f0d41698-c377-4ef4-b994-4edb901a298c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:45.736103 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f0d41698-c377-4ef4-b994-4edb901a298c tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 200 len: 1301 microversion: 2.1 time: 0.269947 Sep 17 20:55:45.736704 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 592/1229] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:45 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 1301 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:45.742830 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06b5d394-ebc0-4f35-84da-c646121712cd tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:45.748132 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06b5d394-ebc0-4f35-84da-c646121712cd tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:45.748870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06b5d394-ebc0-4f35-84da-c646121712cd tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:45.749862 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06b5d394-ebc0-4f35-84da-c646121712cd tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:45.750482 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06b5d394-ebc0-4f35-84da-c646121712cd tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:45.751072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06b5d394-ebc0-4f35-84da-c646121712cd tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:46.029682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-2479972b-c7da-4359-8c59-ae4d2671ceaa req-89de4de8-64e1-4ee3-954d-9c5afeb6ce93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08", "tag": "55685621-d375-4d51-80b4-1c25904556be"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:46.041993 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2479972b-c7da-4359-8c59-ae4d2671ceaa req-89de4de8-64e1-4ee3-954d-9c5afeb6ce93 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:46.042484 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2479972b-c7da-4359-8c59-ae4d2671ceaa req-89de4de8-64e1-4ee3-954d-9c5afeb6ce93 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:46.042916 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2479972b-c7da-4359-8c59-ae4d2671ceaa req-89de4de8-64e1-4ee3-954d-9c5afeb6ce93 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:46.056203 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-2479972b-c7da-4359-8c59-ae4d2671ceaa req-89de4de8-64e1-4ee3-954d-9c5afeb6ce93 service nova] Creating event network-changed:55685621-d375-4d51-80b4-1c25904556be for instance b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 on nch2-master-1 Sep 17 20:55:46.062899 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-2479972b-c7da-4359-8c59-ae4d2671ceaa req-89de4de8-64e1-4ee3-954d-9c5afeb6ce93 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.321203 Sep 17 20:55:46.063513 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 593/1230] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:46.074073 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4327240e-f7fe-4135-b73c-2a2963cf1594 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Calling method '.version_select at 0x7f25a50e43a0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:46.079377 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4327240e-f7fe-4135-b73c-2a2963cf1594 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:46.079982 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4327240e-f7fe-4135-b73c-2a2963cf1594 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:46.080545 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4327240e-f7fe-4135-b73c-2a2963cf1594 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:46.093411 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4327240e-f7fe-4135-b73c-2a2963cf1594 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 2961 microversion: 2.25 time: 0.028257 Sep 17 20:55:46.094196 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 594/1231] 10.222.0.26 () {60 vars in 1184 bytes} [Sat Sep 17 20:55:46 2022] GET /compute/v2.1/os-migrations => generated 2961 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:46.110291 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-50ea3da9-0427-458c-a9a7-836f55c3c53d tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:46.111058 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-50ea3da9-0427-458c-a9a7-836f55c3c53d tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:46.119151 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-50ea3da9-0427-458c-a9a7-836f55c3c53d tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:46.120158 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-50ea3da9-0427-458c-a9a7-836f55c3c53d tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:46.120658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-50ea3da9-0427-458c-a9a7-836f55c3c53d tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:46.121378 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-50ea3da9-0427-458c-a9a7-836f55c3c53d tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:46.122010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-50ea3da9-0427-458c-a9a7-836f55c3c53d tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:46.122655 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-50ea3da9-0427-458c-a9a7-836f55c3c53d tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:46.257852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-06b5d394-ebc0-4f35-84da-c646121712cd tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:46.273576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-06b5d394-ebc0-4f35-84da-c646121712cd tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:46.275181 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-06b5d394-ebc0-4f35-84da-c646121712cd tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:46.276814 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-06b5d394-ebc0-4f35-84da-c646121712cd tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1744 microversion: 2.32 time: 0.575048 Sep 17 20:55:46.290287 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 638/1232] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:45 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1744 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:46.302340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4ea7f09a-bfb2-4cc5-a1d3-416b740b8823 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:46.303256 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4ea7f09a-bfb2-4cc5-a1d3-416b740b8823 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:46.311454 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ea7f09a-bfb2-4cc5-a1d3-416b740b8823 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:46.312320 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ea7f09a-bfb2-4cc5-a1d3-416b740b8823 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:46.313019 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ea7f09a-bfb2-4cc5-a1d3-416b740b8823 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:46.314005 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ea7f09a-bfb2-4cc5-a1d3-416b740b8823 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:46.314746 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ea7f09a-bfb2-4cc5-a1d3-416b740b8823 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:46.315412 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ea7f09a-bfb2-4cc5-a1d3-416b740b8823 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:46.468769 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-50ea3da9-0427-458c-a9a7-836f55c3c53d tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lazy-loading 'services' on Instance uuid 796a6ed8-e44a-4e34-849d-1daeb1f363dd {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:55:46.485039 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-50ea3da9-0427-458c-a9a7-836f55c3c53d tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 2422 microversion: 2.25 time: 0.378475 Sep 17 20:55:46.486082 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 595/1233] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:46 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 2422 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 20:55:46.491348 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9a125b4a-df17-4ad7-aad1-c547adc970c3 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:46.492222 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9a125b4a-df17-4ad7-aad1-c547adc970c3 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: d99ba94b-addd-4964-8d95-91de304a4988] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:46.498426 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9a125b4a-df17-4ad7-aad1-c547adc970c3 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:46.499205 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9a125b4a-df17-4ad7-aad1-c547adc970c3 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:46.499683 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9a125b4a-df17-4ad7-aad1-c547adc970c3 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:46.500583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9a125b4a-df17-4ad7-aad1-c547adc970c3 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:46.501261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9a125b4a-df17-4ad7-aad1-c547adc970c3 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:46.501898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9a125b4a-df17-4ad7-aad1-c547adc970c3 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:46.784197 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4ea7f09a-bfb2-4cc5-a1d3-416b740b8823 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:46.795285 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4ea7f09a-bfb2-4cc5-a1d3-416b740b8823 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1317 microversion: 2.1 time: 0.503479 Sep 17 20:55:46.810544 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 639/1234] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:46 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1317 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:46.817661 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f1edc28b-f421-429a-bb9d-ba85d5f68293 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:46.818519 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f1edc28b-f421-429a-bb9d-ba85d5f68293 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:46.825799 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f1edc28b-f421-429a-bb9d-ba85d5f68293 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:46.826632 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f1edc28b-f421-429a-bb9d-ba85d5f68293 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:46.827293 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f1edc28b-f421-429a-bb9d-ba85d5f68293 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:46.828380 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f1edc28b-f421-429a-bb9d-ba85d5f68293 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:46.829025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f1edc28b-f421-429a-bb9d-ba85d5f68293 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:46.829687 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f1edc28b-f421-429a-bb9d-ba85d5f68293 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:46.843136 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9a125b4a-df17-4ad7-aad1-c547adc970c3 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:46.855855 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9a125b4a-df17-4ad7-aad1-c547adc970c3 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988" status: 200 len: 1307 microversion: 2.1 time: 0.365287 Sep 17 20:55:46.857295 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 596/1235] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:46 2022] GET /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988 => generated 1307 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:46.867686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-aa7c144f-e7b8-473e-a000-ae4327e8fdb6 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:46.868521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-aa7c144f-e7b8-473e-a000-ae4327e8fdb6 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:46.881292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa7c144f-e7b8-473e-a000-ae4327e8fdb6 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:46.881827 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa7c144f-e7b8-473e-a000-ae4327e8fdb6 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:46.882252 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa7c144f-e7b8-473e-a000-ae4327e8fdb6 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:46.882968 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa7c144f-e7b8-473e-a000-ae4327e8fdb6 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:46.883426 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa7c144f-e7b8-473e-a000-ae4327e8fdb6 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:46.883851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa7c144f-e7b8-473e-a000-ae4327e8fdb6 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:46.899720 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-aa7c144f-e7b8-473e-a000-ae4327e8fdb6 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] HTTP exception thrown: Instance e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 could not be found. Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-aa7c144f-e7b8-473e-a000-ae4327e8fdb6 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Request method failure captured: Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 HTTP/1.1 Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjMW4WTMrHVxT_blH9OktIdsLxdSc4WUWVP8xumJavGA2GiRpiJlQJhI5X_he7_TVPivWgrAsf02nd8RHzhJ31a5Qgvl4lZ2TEO5bOf-4RaZy91bp9Tmv8DbTpLGvhmreUrma1J_K-T2_-ItJNWXrzg7NdUY0DyjuqhtzF_M_k9ZhT0 Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 07ce9fd746374b478a743261eb014e5c Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-MigrationsAdminTest-1514848596 Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/07ce9fd746374b478a743261eb014e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/07ce9fd746374b478a743261eb014e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/07ce9fd746374b478a743261eb014e5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_07ce9fd746374b478a743261eb014e5c", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-MigrationsAdminTest-1514848596 Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 07ce9fd746374b478a743261eb014e5c Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-MigrationsAdminTest-1514848596 Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-MigrationsAdminTest-1514848596-project Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 226a87a1f393420b8d19ec2390e9d063 Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-MigrationsAdminTest-1514848596-project Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 could not be found. Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700'} Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 could not be found. Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 could not be found. Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:55:46.901921 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:55:46.907327 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:55:46.907327 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:55:46.907327 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:55:46.907327 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:55:46.907327 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:55:46.907327 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 could not be found. Sep 17 20:55:46.907327 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:55:46.908968 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-aa7c144f-e7b8-473e-a000-ae4327e8fdb6 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Returning 404 to user: Instance e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:55:46.910152 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-aa7c144f-e7b8-473e-a000-ae4327e8fdb6 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700" status: 404 len: 111 microversion: 2.1 time: 0.051720 Sep 17 20:55:46.914918 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 597/1236] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:46 2022] GET /compute/v2.1/servers/e8607c0d-65a3-4c41-a7d5-bb4e9ce2d700 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:55:46.924031 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-aa92ac90-1a46-4ad2-8a45-f069f265889b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:46.924568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-aa92ac90-1a46-4ad2-8a45-f069f265889b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:46.931556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa92ac90-1a46-4ad2-8a45-f069f265889b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:46.932304 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa92ac90-1a46-4ad2-8a45-f069f265889b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:46.932751 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa92ac90-1a46-4ad2-8a45-f069f265889b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:46.933501 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa92ac90-1a46-4ad2-8a45-f069f265889b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:46.933950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa92ac90-1a46-4ad2-8a45-f069f265889b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:46.934379 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa92ac90-1a46-4ad2-8a45-f069f265889b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:46.973739 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-aa92ac90-1a46-4ad2-8a45-f069f265889b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:55:47.037010 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=16 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:47.103314 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-aa92ac90-1a46-4ad2-8a45-f069f265889b tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "DELETE /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 204 len: 0 microversion: 2.1 time: 0.186087 Sep 17 20:55:47.106644 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 598/1237] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:55:46 2022] DELETE /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:55:47.112320 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4077a482-a1a1-4613-b1c2-87e6ffb2d108 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:47.113209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4077a482-a1a1-4613-b1c2-87e6ffb2d108 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:47.120144 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4077a482-a1a1-4613-b1c2-87e6ffb2d108 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:47.120906 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4077a482-a1a1-4613-b1c2-87e6ffb2d108 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:47.121636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4077a482-a1a1-4613-b1c2-87e6ffb2d108 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:47.122601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4077a482-a1a1-4613-b1c2-87e6ffb2d108 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:47.123059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4077a482-a1a1-4613-b1c2-87e6ffb2d108 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:47.123491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4077a482-a1a1-4613-b1c2-87e6ffb2d108 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:47.160658 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-f1edc28b-f421-429a-bb9d-ba85d5f68293 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lazy-loading 'services' on Instance uuid 796a6ed8-e44a-4e34-849d-1daeb1f363dd {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:55:47.184103 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f1edc28b-f421-429a-bb9d-ba85d5f68293 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 2422 microversion: 2.25 time: 0.372161 Sep 17 20:55:47.185282 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 640/1238] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:46 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 2422 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:47.302345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-43c5365a-a21d-47af-9aa0-d45fa44aa3f7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:47.303728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-43c5365a-a21d-47af-9aa0-d45fa44aa3f7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:47.314943 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43c5365a-a21d-47af-9aa0-d45fa44aa3f7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:47.315817 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43c5365a-a21d-47af-9aa0-d45fa44aa3f7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:47.317473 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43c5365a-a21d-47af-9aa0-d45fa44aa3f7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:47.318458 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43c5365a-a21d-47af-9aa0-d45fa44aa3f7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:47.319107 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43c5365a-a21d-47af-9aa0-d45fa44aa3f7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:47.320376 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43c5365a-a21d-47af-9aa0-d45fa44aa3f7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:47.473389 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-43c5365a-a21d-47af-9aa0-d45fa44aa3f7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lazy-loading 'services' on Instance uuid 796a6ed8-e44a-4e34-849d-1daeb1f363dd {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:55:47.583239 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:47.596769 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-43c5365a-a21d-47af-9aa0-d45fa44aa3f7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "DELETE /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd/os-volume_attachments/d2a1c319-7ed9-4fb7-af62-52e9373195bf" status: 202 len: 0 microversion: 2.25 time: 0.306007 Sep 17 20:55:47.597851 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 641/1239] 10.222.0.26 () {60 vars in 1457 bytes} [Sat Sep 17 20:55:47 2022] DELETE /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd/os-volume_attachments/d2a1c319-7ed9-4fb7-af62-52e9373195bf => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 17 20:55:47.624635 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a0940509-9d01-40e2-a3dc-d0211251b261 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:47.625502 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a0940509-9d01-40e2-a3dc-d0211251b261 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:47.645755 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0940509-9d01-40e2-a3dc-d0211251b261 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:47.646319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0940509-9d01-40e2-a3dc-d0211251b261 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:47.647201 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0940509-9d01-40e2-a3dc-d0211251b261 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:47.648108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0940509-9d01-40e2-a3dc-d0211251b261 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:47.648902 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0940509-9d01-40e2-a3dc-d0211251b261 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:47.662335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0940509-9d01-40e2-a3dc-d0211251b261 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:47.728818 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4077a482-a1a1-4613-b1c2-87e6ffb2d108 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:47.743442 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4077a482-a1a1-4613-b1c2-87e6ffb2d108 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1467 microversion: 2.1 time: 0.635363 Sep 17 20:55:47.744378 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 599/1240] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:47 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1467 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:55:47.749196 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-57ecb5f7-cd21-4196-9017-e8cecf87d2c5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:47.751517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-57ecb5f7-cd21-4196-9017-e8cecf87d2c5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:47.773253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-57ecb5f7-cd21-4196-9017-e8cecf87d2c5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:47.773795 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-57ecb5f7-cd21-4196-9017-e8cecf87d2c5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:47.774243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-57ecb5f7-cd21-4196-9017-e8cecf87d2c5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:47.774976 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-57ecb5f7-cd21-4196-9017-e8cecf87d2c5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:47.775435 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-57ecb5f7-cd21-4196-9017-e8cecf87d2c5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:47.775868 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-57ecb5f7-cd21-4196-9017-e8cecf87d2c5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:47.812641 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-57ecb5f7-cd21-4196-9017-e8cecf87d2c5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.067181 Sep 17 20:55:47.813218 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 600/1241] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Sep 17 20:55:47 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:55:47.824074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a68df6c2-6420-47a3-a90b-474f61b083b6 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:47.824688 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a68df6c2-6420-47a3-a90b-474f61b083b6 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:47.831302 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a68df6c2-6420-47a3-a90b-474f61b083b6 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:47.831785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a68df6c2-6420-47a3-a90b-474f61b083b6 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:47.832221 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a68df6c2-6420-47a3-a90b-474f61b083b6 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:47.832962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a68df6c2-6420-47a3-a90b-474f61b083b6 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:47.833414 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a68df6c2-6420-47a3-a90b-474f61b083b6 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:47.833861 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a68df6c2-6420-47a3-a90b-474f61b083b6 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:48.038718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a0940509-9d01-40e2-a3dc-d0211251b261 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:48.056882 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a0940509-9d01-40e2-a3dc-d0211251b261 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:48.059119 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a0940509-9d01-40e2-a3dc-d0211251b261 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:48.060910 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a0940509-9d01-40e2-a3dc-d0211251b261 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1791 microversion: 2.32 time: 0.461779 Sep 17 20:55:48.061678 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 642/1242] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:47 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1791 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:48.082226 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a68df6c2-6420-47a3-a90b-474f61b083b6 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:48.091557 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a68df6c2-6420-47a3-a90b-474f61b083b6 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1317 microversion: 2.1 time: 0.271203 Sep 17 20:55:48.093032 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 601/1243] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:47 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:55:48.096695 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-08b71d18-b949-40c6-bbd2-6b01cb9abb7e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:48.097333 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-08b71d18-b949-40c6-bbd2-6b01cb9abb7e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: d99ba94b-addd-4964-8d95-91de304a4988] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:48.098776 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-77eb6246-f330-41bc-af66-581bf8479b02 req-06e38e3e-0415-46ee-aad2-8378e3d8527d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d99ba94b-addd-4964-8d95-91de304a4988", "tag": "01b9920f-d8f7-4dfb-b9df-b1746666a92f"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:48.113064 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-77eb6246-f330-41bc-af66-581bf8479b02 req-06e38e3e-0415-46ee-aad2-8378e3d8527d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:48.113745 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-77eb6246-f330-41bc-af66-581bf8479b02 req-06e38e3e-0415-46ee-aad2-8378e3d8527d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:48.114399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-77eb6246-f330-41bc-af66-581bf8479b02 req-06e38e3e-0415-46ee-aad2-8378e3d8527d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:48.119337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-08b71d18-b949-40c6-bbd2-6b01cb9abb7e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:48.120867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-08b71d18-b949-40c6-bbd2-6b01cb9abb7e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:48.121346 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-08b71d18-b949-40c6-bbd2-6b01cb9abb7e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:48.122123 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-08b71d18-b949-40c6-bbd2-6b01cb9abb7e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:48.122590 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-08b71d18-b949-40c6-bbd2-6b01cb9abb7e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:48.123023 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-08b71d18-b949-40c6-bbd2-6b01cb9abb7e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:48.134701 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-77eb6246-f330-41bc-af66-581bf8479b02 req-06e38e3e-0415-46ee-aad2-8378e3d8527d service nova] Creating event network-changed:01b9920f-d8f7-4dfb-b9df-b1746666a92f for instance d99ba94b-addd-4964-8d95-91de304a4988 on nch1-master-1 Sep 17 20:55:48.140603 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-77eb6246-f330-41bc-af66-581bf8479b02 req-06e38e3e-0415-46ee-aad2-8378e3d8527d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045971 Sep 17 20:55:48.142463 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 602/1244] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:48.309284 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-08b71d18-b949-40c6-bbd2-6b01cb9abb7e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:48.318308 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-08b71d18-b949-40c6-bbd2-6b01cb9abb7e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988" status: 200 len: 1307 microversion: 2.1 time: 0.255279 Sep 17 20:55:48.318910 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 643/1245] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:48 2022] GET /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988 => generated 1307 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:48.772148 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a4e87c9a-f400-4f54-b729-f5638fd9e437 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:48.773564 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a4e87c9a-f400-4f54-b729-f5638fd9e437 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:48.780477 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4e87c9a-f400-4f54-b729-f5638fd9e437 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:48.781223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4e87c9a-f400-4f54-b729-f5638fd9e437 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:48.781877 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4e87c9a-f400-4f54-b729-f5638fd9e437 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:48.782961 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4e87c9a-f400-4f54-b729-f5638fd9e437 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:48.783605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4e87c9a-f400-4f54-b729-f5638fd9e437 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:48.784286 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4e87c9a-f400-4f54-b729-f5638fd9e437 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:48.825888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0f7fdb8e-48f0-4bdc-895d-5bad99de902f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:48.828832 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0f7fdb8e-48f0-4bdc-895d-5bad99de902f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:48.853645 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f7fdb8e-48f0-4bdc-895d-5bad99de902f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:48.863982 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f7fdb8e-48f0-4bdc-895d-5bad99de902f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:48.864738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f7fdb8e-48f0-4bdc-895d-5bad99de902f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:48.865805 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f7fdb8e-48f0-4bdc-895d-5bad99de902f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:48.866525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f7fdb8e-48f0-4bdc-895d-5bad99de902f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:48.867200 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f7fdb8e-48f0-4bdc-895d-5bad99de902f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:48.868037 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=22 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:48.938399 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0f7fdb8e-48f0-4bdc-895d-5bad99de902f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.116702 Sep 17 20:55:48.939440 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 644/1246] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Sep 17 20:55:48 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:55:49.006099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a4e87c9a-f400-4f54-b729-f5638fd9e437 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:49.016265 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a4e87c9a-f400-4f54-b729-f5638fd9e437 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1467 microversion: 2.1 time: 0.249060 Sep 17 20:55:49.034513 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 603/1247] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:48 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1467 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:49.087554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3e2d964f-dbe5-4cdc-bc48-543e20993d1c tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:49.088209 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3e2d964f-dbe5-4cdc-bc48-543e20993d1c tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:49.097694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e2d964f-dbe5-4cdc-bc48-543e20993d1c tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:49.098549 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e2d964f-dbe5-4cdc-bc48-543e20993d1c tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:49.099003 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e2d964f-dbe5-4cdc-bc48-543e20993d1c tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:49.099739 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e2d964f-dbe5-4cdc-bc48-543e20993d1c tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:49.100443 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e2d964f-dbe5-4cdc-bc48-543e20993d1c tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:49.100952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e2d964f-dbe5-4cdc-bc48-543e20993d1c tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:49.114753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fe7c4368-c5d2-4436-8c5b-7d0da2b6ee68 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:49.115372 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fe7c4368-c5d2-4436-8c5b-7d0da2b6ee68 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:49.125212 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fe7c4368-c5d2-4436-8c5b-7d0da2b6ee68 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:49.129117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fe7c4368-c5d2-4436-8c5b-7d0da2b6ee68 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:49.129711 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fe7c4368-c5d2-4436-8c5b-7d0da2b6ee68 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:49.130476 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fe7c4368-c5d2-4436-8c5b-7d0da2b6ee68 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:49.130940 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fe7c4368-c5d2-4436-8c5b-7d0da2b6ee68 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:49.131376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fe7c4368-c5d2-4436-8c5b-7d0da2b6ee68 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:49.417869 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3e2d964f-dbe5-4cdc-bc48-543e20993d1c tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:49.435363 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3e2d964f-dbe5-4cdc-bc48-543e20993d1c tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:49.446587 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3e2d964f-dbe5-4cdc-bc48-543e20993d1c tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:49.450373 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3e2d964f-dbe5-4cdc-bc48-543e20993d1c tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1838 microversion: 2.32 time: 0.366768 Sep 17 20:55:49.453893 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 645/1248] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:49 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1838 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:49.471671 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ac332077-8262-48ef-964c-f57841dc9817 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:49.481717 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ac332077-8262-48ef-964c-f57841dc9817 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: d99ba94b-addd-4964-8d95-91de304a4988] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:49.509596 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac332077-8262-48ef-964c-f57841dc9817 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:49.510012 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac332077-8262-48ef-964c-f57841dc9817 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:49.510458 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac332077-8262-48ef-964c-f57841dc9817 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:49.511194 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac332077-8262-48ef-964c-f57841dc9817 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:49.511647 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac332077-8262-48ef-964c-f57841dc9817 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:49.512082 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac332077-8262-48ef-964c-f57841dc9817 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:49.719921 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fe7c4368-c5d2-4436-8c5b-7d0da2b6ee68 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:49.732177 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fe7c4368-c5d2-4436-8c5b-7d0da2b6ee68 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1317 microversion: 2.1 time: 0.621341 Sep 17 20:55:49.733351 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 604/1249] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:49 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1317 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:49.868086 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ac332077-8262-48ef-964c-f57841dc9817 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:49.891884 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ac332077-8262-48ef-964c-f57841dc9817 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988" status: 200 len: 1307 microversion: 2.1 time: 0.432786 Sep 17 20:55:49.893334 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 646/1250] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:49 2022] GET /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988 => generated 1307 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:49.952428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-26bda755-e1be-4405-b870-24cf12cbd793 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:49.955114 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-26bda755-e1be-4405-b870-24cf12cbd793 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:49.967837 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26bda755-e1be-4405-b870-24cf12cbd793 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:49.970893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26bda755-e1be-4405-b870-24cf12cbd793 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:49.972525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26bda755-e1be-4405-b870-24cf12cbd793 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:49.975562 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26bda755-e1be-4405-b870-24cf12cbd793 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:49.977400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26bda755-e1be-4405-b870-24cf12cbd793 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:49.980286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26bda755-e1be-4405-b870-24cf12cbd793 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:50.051687 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-26bda755-e1be-4405-b870-24cf12cbd793 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.104178 Sep 17 20:55:50.053436 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 647/1251] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Sep 17 20:55:49 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd/os-volume_attachments => generated 25 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:55:50.058886 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6dd54ba4-e200-4acd-9ec2-cb2e636ba516 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:50.059819 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6dd54ba4-e200-4acd-9ec2-cb2e636ba516 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:50.068864 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6dd54ba4-e200-4acd-9ec2-cb2e636ba516 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:50.070715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6dd54ba4-e200-4acd-9ec2-cb2e636ba516 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:50.072101 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6dd54ba4-e200-4acd-9ec2-cb2e636ba516 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:50.073396 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6dd54ba4-e200-4acd-9ec2-cb2e636ba516 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:50.074397 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6dd54ba4-e200-4acd-9ec2-cb2e636ba516 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:50.075609 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6dd54ba4-e200-4acd-9ec2-cb2e636ba516 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:50.103067 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4e56a635-85ec-4fcb-ae51-d47bce3ff362 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1743849770", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:50.226049 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-4e56a635-85ec-4fcb-ae51-d47bce3ff362 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] validate_networks() for None {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:55:50.509236 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6dd54ba4-e200-4acd-9ec2-cb2e636ba516 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:50.526338 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6dd54ba4-e200-4acd-9ec2-cb2e636ba516 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1467 microversion: 2.1 time: 0.469629 Sep 17 20:55:50.527201 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 648/1252] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:50 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1467 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:50.567441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1f6599d5-652e-472a-8ae9-e2b6e1f83de7 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:50.571936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1f6599d5-652e-472a-8ae9-e2b6e1f83de7 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:50.592363 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f6599d5-652e-472a-8ae9-e2b6e1f83de7 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:50.592939 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f6599d5-652e-472a-8ae9-e2b6e1f83de7 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:50.593337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f6599d5-652e-472a-8ae9-e2b6e1f83de7 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:50.594413 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f6599d5-652e-472a-8ae9-e2b6e1f83de7 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:50.597778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f6599d5-652e-472a-8ae9-e2b6e1f83de7 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:50.598518 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f6599d5-652e-472a-8ae9-e2b6e1f83de7 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:51.018886 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-4e56a635-85ec-4fcb-ae51-d47bce3ff362 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:55:51.020994 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-4e56a635-85ec-4fcb-ae51-d47bce3ff362 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:55:51.024068 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-4e56a635-85ec-4fcb-ae51-d47bce3ff362 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:55:51.024529 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-4e56a635-85ec-4fcb-ae51-d47bce3ff362 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:55:51.024965 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-4e56a635-85ec-4fcb-ae51-d47bce3ff362 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:55:51.043289 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1f6599d5-652e-472a-8ae9-e2b6e1f83de7 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:51.044609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e56a635-85ec-4fcb-ae51-d47bce3ff362 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:51.045540 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e56a635-85ec-4fcb-ae51-d47bce3ff362 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:51.047339 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e56a635-85ec-4fcb-ae51-d47bce3ff362 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:51.049177 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e56a635-85ec-4fcb-ae51-d47bce3ff362 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:51.049686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e56a635-85ec-4fcb-ae51-d47bce3ff362 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:51.052233 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e56a635-85ec-4fcb-ae51-d47bce3ff362 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:51.057153 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1f6599d5-652e-472a-8ae9-e2b6e1f83de7 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:51.059215 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1f6599d5-652e-472a-8ae9-e2b6e1f83de7 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:51.060599 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1f6599d5-652e-472a-8ae9-e2b6e1f83de7 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1838 microversion: 2.32 time: 0.530667 Sep 17 20:55:51.062392 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 649/1253] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:50 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1838 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:51.067438 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-f6b95de9-2bd8-450b-9fd2-3fbc99d1a5a9 req-ceb34d96-6b42-44db-9bc5-af762fdde3d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63955de3-b0fa-4f96-a2db-26ae995db228", "name": "network-vif-deleted", "tag": "17d8bcdf-2e72-4ea0-a129-6fda20d5053a"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:51.079604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f6b95de9-2bd8-450b-9fd2-3fbc99d1a5a9 req-ceb34d96-6b42-44db-9bc5-af762fdde3d3 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:51.080268 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f6b95de9-2bd8-450b-9fd2-3fbc99d1a5a9 req-ceb34d96-6b42-44db-9bc5-af762fdde3d3 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:51.081047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f6b95de9-2bd8-450b-9fd2-3fbc99d1a5a9 req-ceb34d96-6b42-44db-9bc5-af762fdde3d3 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:51.096568 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-f6b95de9-2bd8-450b-9fd2-3fbc99d1a5a9 req-ceb34d96-6b42-44db-9bc5-af762fdde3d3 service nova] Creating event network-vif-deleted:17d8bcdf-2e72-4ea0-a129-6fda20d5053a for instance 63955de3-b0fa-4f96-a2db-26ae995db228 on nch2-master-1 Sep 17 20:55:51.103418 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-f6b95de9-2bd8-450b-9fd2-3fbc99d1a5a9 req-ceb34d96-6b42-44db-9bc5-af762fdde3d3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038538 Sep 17 20:55:51.107901 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 650/1254] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:51.115106 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-cdbbe683-7ca9-49ae-a69d-33a0fbbb6d8d req-61946d84-73a1-4afd-83d1-1e0e282157a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08", "name": "network-vif-plugged", "status": "completed", "tag": "55685621-d375-4d51-80b4-1c25904556be"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:51.116841 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-4e56a635-85ec-4fcb-ae51-d47bce3ff362 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Getting quotas for project eee008b613cd468f9b996e915ced3074. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:55:51.126157 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-4e56a635-85ec-4fcb-ae51-d47bce3ff362 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Getting quotas for user 6fe33ab0e3394b7ea6b1b0b29f444e53 and project eee008b613cd468f9b996e915ced3074. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:55:51.141822 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4e56a635-85ec-4fcb-ae51-d47bce3ff362 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:55:51.141978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-cdbbe683-7ca9-49ae-a69d-33a0fbbb6d8d req-61946d84-73a1-4afd-83d1-1e0e282157a4 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:51.142610 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-cdbbe683-7ca9-49ae-a69d-33a0fbbb6d8d req-61946d84-73a1-4afd-83d1-1e0e282157a4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:51.143195 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-cdbbe683-7ca9-49ae-a69d-33a0fbbb6d8d req-61946d84-73a1-4afd-83d1-1e0e282157a4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:51.144354 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4e56a635-85ec-4fcb-ae51-d47bce3ff362 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: c8aaf21a-21d2-485f-8df0-2d2e43f00a57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:55:51.158144 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-cdbbe683-7ca9-49ae-a69d-33a0fbbb6d8d req-61946d84-73a1-4afd-83d1-1e0e282157a4 service nova] Creating event network-vif-plugged:55685621-d375-4d51-80b4-1c25904556be for instance b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 on nch2-master-1 Sep 17 20:55:51.164044 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-cdbbe683-7ca9-49ae-a69d-33a0fbbb6d8d req-61946d84-73a1-4afd-83d1-1e0e282157a4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054779 Sep 17 20:55:51.164844 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 651/1255] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:51.174397 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f20f1f84-23d7-48c5-bdac-ccad030ee4ef tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:51.175104 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f20f1f84-23d7-48c5-bdac-ccad030ee4ef tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:51.182480 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f20f1f84-23d7-48c5-bdac-ccad030ee4ef tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:51.183093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f20f1f84-23d7-48c5-bdac-ccad030ee4ef tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:51.183543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f20f1f84-23d7-48c5-bdac-ccad030ee4ef tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:51.184259 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f20f1f84-23d7-48c5-bdac-ccad030ee4ef tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:51.184861 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f20f1f84-23d7-48c5-bdac-ccad030ee4ef tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:51.185242 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f20f1f84-23d7-48c5-bdac-ccad030ee4ef tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:51.225782 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4e56a635-85ec-4fcb-ae51-d47bce3ff362 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.347121 Sep 17 20:55:51.233442 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 605/1256] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:55:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 17 20:55:51.239422 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9b4aa6ab-bcf7-49c2-9def-aeaa68b5a332 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:51.240372 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9b4aa6ab-bcf7-49c2-9def-aeaa68b5a332 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: d99ba94b-addd-4964-8d95-91de304a4988] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:51.249405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b4aa6ab-bcf7-49c2-9def-aeaa68b5a332 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:51.250061 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b4aa6ab-bcf7-49c2-9def-aeaa68b5a332 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:51.250577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b4aa6ab-bcf7-49c2-9def-aeaa68b5a332 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:51.251367 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b4aa6ab-bcf7-49c2-9def-aeaa68b5a332 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:51.251910 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b4aa6ab-bcf7-49c2-9def-aeaa68b5a332 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:51.252592 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b4aa6ab-bcf7-49c2-9def-aeaa68b5a332 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:51.390801 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f20f1f84-23d7-48c5-bdac-ccad030ee4ef tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:51.405740 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f20f1f84-23d7-48c5-bdac-ccad030ee4ef tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1317 microversion: 2.1 time: 0.231287 Sep 17 20:55:51.407095 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 652/1257] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:51 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:51.412609 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2cc1619e-0de7-44b9-802c-37021edd1230 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:51.414214 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2cc1619e-0de7-44b9-802c-37021edd1230 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: c8aaf21a-21d2-485f-8df0-2d2e43f00a57] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:51.513855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2cc1619e-0de7-44b9-802c-37021edd1230 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:51.516357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9b4aa6ab-bcf7-49c2-9def-aeaa68b5a332 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:51.529939 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9b4aa6ab-bcf7-49c2-9def-aeaa68b5a332 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988" status: 200 len: 1307 microversion: 2.1 time: 0.294283 Sep 17 20:55:51.533965 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 606/1258] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:51 2022] GET /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988 => generated 1307 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:51.554773 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2cc1619e-0de7-44b9-802c-37021edd1230 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57" status: 200 len: 1219 microversion: 2.1 time: 0.145949 Sep 17 20:55:51.559405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-92b64d3b-541a-4b76-be1d-40d19d9d7810 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:51.562083 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-92b64d3b-541a-4b76-be1d-40d19d9d7810 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:51.564363 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:51.569081 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 653/1259] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:51 2022] GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57 => generated 1219 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:51.570355 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92b64d3b-541a-4b76-be1d-40d19d9d7810 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:51.571074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92b64d3b-541a-4b76-be1d-40d19d9d7810 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:51.571478 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92b64d3b-541a-4b76-be1d-40d19d9d7810 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:51.572255 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92b64d3b-541a-4b76-be1d-40d19d9d7810 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:51.572930 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92b64d3b-541a-4b76-be1d-40d19d9d7810 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:51.573361 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92b64d3b-541a-4b76-be1d-40d19d9d7810 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:51.610276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92b64d3b-541a-4b76-be1d-40d19d9d7810 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:51.610771 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92b64d3b-541a-4b76-be1d-40d19d9d7810 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:51.611213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92b64d3b-541a-4b76-be1d-40d19d9d7810 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:51.611663 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-92b64d3b-541a-4b76-be1d-40d19d9d7810 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lazy-loading 'fault' on Instance uuid 63955de3-b0fa-4f96-a2db-26ae995db228 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:55:51.761563 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-92b64d3b-541a-4b76-be1d-40d19d9d7810 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '226a87a1f393420b8d19ec2390e9d063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07ce9fd746374b478a743261eb014e5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:51.772294 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-92b64d3b-541a-4b76-be1d-40d19d9d7810 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 200 len: 1302 microversion: 2.1 time: 0.223876 Sep 17 20:55:51.776962 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 607/1260] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:51 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 1302 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:52.089450 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9a4e3b1a-3342-4813-b93b-95eaca462eb3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:52.090281 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9a4e3b1a-3342-4813-b93b-95eaca462eb3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:52.101683 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9a4e3b1a-3342-4813-b93b-95eaca462eb3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:52.102480 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9a4e3b1a-3342-4813-b93b-95eaca462eb3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:52.103046 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9a4e3b1a-3342-4813-b93b-95eaca462eb3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:52.104260 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9a4e3b1a-3342-4813-b93b-95eaca462eb3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:52.104800 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9a4e3b1a-3342-4813-b93b-95eaca462eb3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:52.105302 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9a4e3b1a-3342-4813-b93b-95eaca462eb3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:52.332285 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9a4e3b1a-3342-4813-b93b-95eaca462eb3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:52.375526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9a4e3b1a-3342-4813-b93b-95eaca462eb3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:52.383554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9a4e3b1a-3342-4813-b93b-95eaca462eb3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:52.385890 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9a4e3b1a-3342-4813-b93b-95eaca462eb3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1838 microversion: 2.32 time: 0.300992 Sep 17 20:55:52.400986 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 654/1261] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:52 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1838 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:52.429646 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-593f2ca6-23fa-4542-bc50-2cf26b90a1c5 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:52.430275 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-593f2ca6-23fa-4542-bc50-2cf26b90a1c5 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:52.442301 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-593f2ca6-23fa-4542-bc50-2cf26b90a1c5 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:52.443342 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-593f2ca6-23fa-4542-bc50-2cf26b90a1c5 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:52.443998 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-593f2ca6-23fa-4542-bc50-2cf26b90a1c5 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:52.447805 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-593f2ca6-23fa-4542-bc50-2cf26b90a1c5 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:52.448664 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-593f2ca6-23fa-4542-bc50-2cf26b90a1c5 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:52.449357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-593f2ca6-23fa-4542-bc50-2cf26b90a1c5 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:52.565319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-69a1be20-e21f-4682-bfde-a2d9de79eb7d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:52.566848 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-69a1be20-e21f-4682-bfde-a2d9de79eb7d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: d99ba94b-addd-4964-8d95-91de304a4988] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:52.582236 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69a1be20-e21f-4682-bfde-a2d9de79eb7d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:52.589520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69a1be20-e21f-4682-bfde-a2d9de79eb7d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:52.593061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69a1be20-e21f-4682-bfde-a2d9de79eb7d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:52.596246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69a1be20-e21f-4682-bfde-a2d9de79eb7d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:52.598634 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69a1be20-e21f-4682-bfde-a2d9de79eb7d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:52.599432 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69a1be20-e21f-4682-bfde-a2d9de79eb7d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:52.797365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-593f2ca6-23fa-4542-bc50-2cf26b90a1c5 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:52.807537 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-593f2ca6-23fa-4542-bc50-2cf26b90a1c5 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1317 microversion: 2.1 time: 0.383176 Sep 17 20:55:52.829687 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 608/1262] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:52 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1317 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:52.843819 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2998abf1-15e3-461a-a02d-036abd14afd6 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:52.844447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2998abf1-15e3-461a-a02d-036abd14afd6 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: c8aaf21a-21d2-485f-8df0-2d2e43f00a57] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:52.853934 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2998abf1-15e3-461a-a02d-036abd14afd6 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:52.854722 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2998abf1-15e3-461a-a02d-036abd14afd6 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:52.855332 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2998abf1-15e3-461a-a02d-036abd14afd6 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:52.857224 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2998abf1-15e3-461a-a02d-036abd14afd6 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:52.858195 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2998abf1-15e3-461a-a02d-036abd14afd6 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:52.858786 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2998abf1-15e3-461a-a02d-036abd14afd6 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:52.901529 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-69a1be20-e21f-4682-bfde-a2d9de79eb7d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:52.912543 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-69a1be20-e21f-4682-bfde-a2d9de79eb7d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988" status: 200 len: 1307 microversion: 2.1 time: 0.352265 Sep 17 20:55:52.930367 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 655/1263] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:52 2022] GET /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988 => generated 1307 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:52.937006 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-a836004e-95cf-4220-ace8-4170ff118fc9 req-8759f314-4a21-4df2-96e8-d1b744430c4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22b13c98-aea4-497c-a213-142393b2758c", "tag": "7c3cbfdf-d88c-428e-969f-2451f881cc2b"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:52.958714 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a836004e-95cf-4220-ace8-4170ff118fc9 req-8759f314-4a21-4df2-96e8-d1b744430c4b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:52.959179 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a836004e-95cf-4220-ace8-4170ff118fc9 req-8759f314-4a21-4df2-96e8-d1b744430c4b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:52.959608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a836004e-95cf-4220-ace8-4170ff118fc9 req-8759f314-4a21-4df2-96e8-d1b744430c4b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:52.976782 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-a836004e-95cf-4220-ace8-4170ff118fc9 req-8759f314-4a21-4df2-96e8-d1b744430c4b service nova] Creating event network-changed:7c3cbfdf-d88c-428e-969f-2451f881cc2b for instance 22b13c98-aea4-497c-a213-142393b2758c on nch2-master-1 Sep 17 20:55:52.992790 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2998abf1-15e3-461a-a02d-036abd14afd6 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:52.993108 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-a836004e-95cf-4220-ace8-4170ff118fc9 req-8759f314-4a21-4df2-96e8-d1b744430c4b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066209 Sep 17 20:55:52.995690 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 656/1264] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:52.996609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:53.009950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f118c680-f40b-431d-a860-6db7ee5ffb35 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:53.010522 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2998abf1-15e3-461a-a02d-036abd14afd6 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57" status: 200 len: 1271 microversion: 2.1 time: 0.168232 Sep 17 20:55:53.011244 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 609/1265] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:52 2022] GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57 => generated 1271 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:53.014372 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f118c680-f40b-431d-a860-6db7ee5ffb35 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] [instance: 63955de3-b0fa-4f96-a2db-26ae995db228] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:53.027647 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f118c680-f40b-431d-a860-6db7ee5ffb35 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:53.028592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f118c680-f40b-431d-a860-6db7ee5ffb35 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:53.029283 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f118c680-f40b-431d-a860-6db7ee5ffb35 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:53.039893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f118c680-f40b-431d-a860-6db7ee5ffb35 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:53.040525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f118c680-f40b-431d-a860-6db7ee5ffb35 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:53.041040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f118c680-f40b-431d-a860-6db7ee5ffb35 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:53.072356 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-f118c680-f40b-431d-a860-6db7ee5ffb35 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] HTTP exception thrown: Instance 63955de3-b0fa-4f96-a2db-26ae995db228 could not be found. Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f118c680-f40b-431d-a860-6db7ee5ffb35 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Request method failure captured: Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 HTTP/1.1 Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjMW4WTMrHVxT_blH9OktIdsLxdSc4WUWVP8xumJavGA2GiRpiJlQJhI5X_he7_TVPivWgrAsf02nd8RHzhJ31a5Qgvl4lZ2TEO5bOf-4RaZy91bp9Tmv8DbTpLGvhmreUrma1J_K-T2_-ItJNWXrzg7NdUY0DyjuqhtzF_M_k9ZhT0 Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 07ce9fd746374b478a743261eb014e5c Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-MigrationsAdminTest-1514848596 Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/07ce9fd746374b478a743261eb014e5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/07ce9fd746374b478a743261eb014e5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/07ce9fd746374b478a743261eb014e5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_07ce9fd746374b478a743261eb014e5c", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-MigrationsAdminTest-1514848596 Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 07ce9fd746374b478a743261eb014e5c Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-MigrationsAdminTest-1514848596 Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-MigrationsAdminTest-1514848596-project Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 226a87a1f393420b8d19ec2390e9d063 Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-MigrationsAdminTest-1514848596-project Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 63955de3-b0fa-4f96-a2db-26ae995db228 could not be found. Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '63955de3-b0fa-4f96-a2db-26ae995db228'} Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63955de3-b0fa-4f96-a2db-26ae995db228 could not be found. Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63955de3-b0fa-4f96-a2db-26ae995db228 could not be found. Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:55:53.074135 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:55:53.080157 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:55:53.080157 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:55:53.080157 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:55:53.080157 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:55:53.080157 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:55:53.080157 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63955de3-b0fa-4f96-a2db-26ae995db228 could not be found. Sep 17 20:55:53.080157 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:55:53.080157 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f118c680-f40b-431d-a860-6db7ee5ffb35 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] Returning 404 to user: Instance 63955de3-b0fa-4f96-a2db-26ae995db228 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:55:53.080157 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f118c680-f40b-431d-a860-6db7ee5ffb35 tempest-MigrationsAdminTest-1514848596 tempest-MigrationsAdminTest-1514848596-project] 10.222.0.26 "GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228" status: 404 len: 111 microversion: 2.1 time: 0.078594 Sep 17 20:55:53.080157 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 657/1266] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:52 2022] GET /compute/v2.1/servers/63955de3-b0fa-4f96-a2db-26ae995db228 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:55:53.180851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8502c882-40b6-40cb-b768-322ff38ebe20 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1354706926", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "291f6f93-7c31-4c8d-9946-eca7fb2662ee"}], "block_device_mapping_v2": [{"uuid": "73bec761-6a0d-444f-9c7c-1504a4ca70c6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:53.274649 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-8502c882-40b6-40cb-b768-322ff38ebe20 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] validate_networks() for [('291f6f93-7c31-4c8d-9946-eca7fb2662ee', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:55:53.420279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-072cf947-45da-4eef-a3c5-54294e3180eb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:53.420961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-072cf947-45da-4eef-a3c5-54294e3180eb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:53.431898 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-072cf947-45da-4eef-a3c5-54294e3180eb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:53.433443 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-072cf947-45da-4eef-a3c5-54294e3180eb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:53.434100 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-072cf947-45da-4eef-a3c5-54294e3180eb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:53.435734 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-072cf947-45da-4eef-a3c5-54294e3180eb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:53.437550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-072cf947-45da-4eef-a3c5-54294e3180eb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:53.440526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-072cf947-45da-4eef-a3c5-54294e3180eb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:53.771818 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-072cf947-45da-4eef-a3c5-54294e3180eb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:53.782758 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-072cf947-45da-4eef-a3c5-54294e3180eb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:53.784341 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-072cf947-45da-4eef-a3c5-54294e3180eb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:53.788407 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-072cf947-45da-4eef-a3c5-54294e3180eb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1838 microversion: 2.32 time: 0.371311 Sep 17 20:55:53.789695 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 658/1267] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:53 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1838 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:53.835568 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b1c65878-5cdb-4997-b937-fe65f49c8303 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:53.836524 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b1c65878-5cdb-4997-b937-fe65f49c8303 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:53.844233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1c65878-5cdb-4997-b937-fe65f49c8303 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:53.845651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1c65878-5cdb-4997-b937-fe65f49c8303 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:53.846327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1c65878-5cdb-4997-b937-fe65f49c8303 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:53.847292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1c65878-5cdb-4997-b937-fe65f49c8303 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:53.848049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1c65878-5cdb-4997-b937-fe65f49c8303 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:53.850212 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1c65878-5cdb-4997-b937-fe65f49c8303 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:54.189174 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b1c65878-5cdb-4997-b937-fe65f49c8303 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:54.201619 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b1c65878-5cdb-4997-b937-fe65f49c8303 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1507 microversion: 2.1 time: 0.369806 Sep 17 20:55:54.213862 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 659/1268] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:53 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1507 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:54.228506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-ce62b036-5a9e-4737-b084-ab25b6e5274a req-6d44c978-9365-4aa9-85b7-51cadef0039a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d99ba94b-addd-4964-8d95-91de304a4988", "name": "network-vif-plugged", "status": "completed", "tag": "01b9920f-d8f7-4dfb-b9df-b1746666a92f"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:54.246729 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-ce62b036-5a9e-4737-b084-ab25b6e5274a req-6d44c978-9365-4aa9-85b7-51cadef0039a service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:54.247225 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-ce62b036-5a9e-4737-b084-ab25b6e5274a req-6d44c978-9365-4aa9-85b7-51cadef0039a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:54.247665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-ce62b036-5a9e-4737-b084-ab25b6e5274a req-6d44c978-9365-4aa9-85b7-51cadef0039a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:54.254548 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-8502c882-40b6-40cb-b768-322ff38ebe20 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:55:54.255086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-8502c882-40b6-40cb-b768-322ff38ebe20 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:55:54.255437 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-8502c882-40b6-40cb-b768-322ff38ebe20 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:55:54.256060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-8502c882-40b6-40cb-b768-322ff38ebe20 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:55:54.256636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-8502c882-40b6-40cb-b768-322ff38ebe20 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:55:54.261842 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-ce62b036-5a9e-4737-b084-ab25b6e5274a req-6d44c978-9365-4aa9-85b7-51cadef0039a service nova] Creating event network-vif-plugged:01b9920f-d8f7-4dfb-b9df-b1746666a92f for instance d99ba94b-addd-4964-8d95-91de304a4988 on nch1-master-1 Sep 17 20:55:54.265909 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8502c882-40b6-40cb-b768-322ff38ebe20 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:54.266725 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8502c882-40b6-40cb-b768-322ff38ebe20 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:54.267469 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8502c882-40b6-40cb-b768-322ff38ebe20 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:54.268509 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8502c882-40b6-40cb-b768-322ff38ebe20 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:54.269190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8502c882-40b6-40cb-b768-322ff38ebe20 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:54.269398 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-ce62b036-5a9e-4737-b084-ab25b6e5274a req-6d44c978-9365-4aa9-85b7-51cadef0039a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054122 Sep 17 20:55:54.270452 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 660/1269] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:54.270687 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8502c882-40b6-40cb-b768-322ff38ebe20 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:54.276702 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0850fcda-6c6a-4e7a-a0e4-237f1daa6b90 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:54.277681 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0850fcda-6c6a-4e7a-a0e4-237f1daa6b90 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: d99ba94b-addd-4964-8d95-91de304a4988] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:54.284304 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0850fcda-6c6a-4e7a-a0e4-237f1daa6b90 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:54.285416 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0850fcda-6c6a-4e7a-a0e4-237f1daa6b90 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:54.286053 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0850fcda-6c6a-4e7a-a0e4-237f1daa6b90 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:54.288163 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0850fcda-6c6a-4e7a-a0e4-237f1daa6b90 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:54.288804 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0850fcda-6c6a-4e7a-a0e4-237f1daa6b90 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:54.289399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0850fcda-6c6a-4e7a-a0e4-237f1daa6b90 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:54.302353 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-8502c882-40b6-40cb-b768-322ff38ebe20 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Getting quotas for project 7dc8bc81c2d74bae9612f7c9807350a7. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:55:54.307026 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-8502c882-40b6-40cb-b768-322ff38ebe20 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Getting quotas for user f1134231b4a545fdb136a5204cb4f289 and project 7dc8bc81c2d74bae9612f7c9807350a7. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:55:54.374936 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8502c882-40b6-40cb-b768-322ff38ebe20 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:55:54.377691 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8502c882-40b6-40cb-b768-322ff38ebe20 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='73bec761-6a0d-444f-9c7c-1504a4ca70c6',volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:55:54.556400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0850fcda-6c6a-4e7a-a0e4-237f1daa6b90 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:54.564924 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0850fcda-6c6a-4e7a-a0e4-237f1daa6b90 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988" status: 200 len: 1307 microversion: 2.1 time: 0.292545 Sep 17 20:55:54.582760 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 661/1270] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:54 2022] GET /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988 => generated 1307 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:54.595682 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-48626387-1f47-4da7-98b9-50f55e756e6e tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:54.596308 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-48626387-1f47-4da7-98b9-50f55e756e6e tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: c8aaf21a-21d2-485f-8df0-2d2e43f00a57] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:54.605534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-48626387-1f47-4da7-98b9-50f55e756e6e tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:54.606053 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-48626387-1f47-4da7-98b9-50f55e756e6e tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:54.607066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-48626387-1f47-4da7-98b9-50f55e756e6e tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:54.608945 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-48626387-1f47-4da7-98b9-50f55e756e6e tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:54.609961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-48626387-1f47-4da7-98b9-50f55e756e6e tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:54.610762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-48626387-1f47-4da7-98b9-50f55e756e6e tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:54.641501 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8502c882-40b6-40cb-b768-322ff38ebe20 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.467755 Sep 17 20:55:54.650117 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 610/1271] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Sep 17 20:55:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1472 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 17 20:55:54.663720 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-138eabfd-e78e-4b1a-abcb-c9b22de0da60 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:54.666695 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-138eabfd-e78e-4b1a-abcb-c9b22de0da60 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:54.711905 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-138eabfd-e78e-4b1a-abcb-c9b22de0da60 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:54.714094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-138eabfd-e78e-4b1a-abcb-c9b22de0da60 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:54.715257 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-138eabfd-e78e-4b1a-abcb-c9b22de0da60 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:54.717065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-138eabfd-e78e-4b1a-abcb-c9b22de0da60 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:54.718966 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-138eabfd-e78e-4b1a-abcb-c9b22de0da60 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:54.719504 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-138eabfd-e78e-4b1a-abcb-c9b22de0da60 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:54.731083 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-48626387-1f47-4da7-98b9-50f55e756e6e tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:54.734406 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:54.747057 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-48626387-1f47-4da7-98b9-50f55e756e6e tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57" status: 200 len: 1277 microversion: 2.1 time: 0.160710 Sep 17 20:55:54.755646 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 662/1272] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:54 2022] GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57 => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:54.761393 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1e2cb431-d577-4953-ba29-2bf5f1078185 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:54.762108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1e2cb431-d577-4953-ba29-2bf5f1078185 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:54.863003 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1e2cb431-d577-4953-ba29-2bf5f1078185 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:54.878290 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1e2cb431-d577-4953-ba29-2bf5f1078185 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:54.879796 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1e2cb431-d577-4953-ba29-2bf5f1078185 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:54.881372 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1e2cb431-d577-4953-ba29-2bf5f1078185 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1104 microversion: 2.25 time: 0.124146 Sep 17 20:55:54.882454 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 663/1273] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:54 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1104 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:54.907974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3e0df1fd-d5b6-4bd9-9182-4db2928e8677 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:54.910537 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3e0df1fd-d5b6-4bd9-9182-4db2928e8677 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:54.925753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e0df1fd-d5b6-4bd9-9182-4db2928e8677 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:54.926385 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e0df1fd-d5b6-4bd9-9182-4db2928e8677 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:54.927033 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e0df1fd-d5b6-4bd9-9182-4db2928e8677 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:54.928270 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e0df1fd-d5b6-4bd9-9182-4db2928e8677 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:54.928734 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e0df1fd-d5b6-4bd9-9182-4db2928e8677 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:54.929172 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e0df1fd-d5b6-4bd9-9182-4db2928e8677 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:54.979026 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-138eabfd-e78e-4b1a-abcb-c9b22de0da60 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:54.997410 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-138eabfd-e78e-4b1a-abcb-c9b22de0da60 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1507 microversion: 2.1 time: 0.351533 Sep 17 20:55:55.003034 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 611/1274] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:54 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1507 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:55.033047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-59dbbe6c-12a1-4f1f-8bdd-dc2dfd705cee tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:55.036175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-59dbbe6c-12a1-4f1f-8bdd-dc2dfd705cee tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:55.051480 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59dbbe6c-12a1-4f1f-8bdd-dc2dfd705cee tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:55.053748 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59dbbe6c-12a1-4f1f-8bdd-dc2dfd705cee tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:55.055788 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59dbbe6c-12a1-4f1f-8bdd-dc2dfd705cee tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:55.057921 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59dbbe6c-12a1-4f1f-8bdd-dc2dfd705cee tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:55.059263 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59dbbe6c-12a1-4f1f-8bdd-dc2dfd705cee tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:55.061797 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59dbbe6c-12a1-4f1f-8bdd-dc2dfd705cee tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:55.200405 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-59dbbe6c-12a1-4f1f-8bdd-dc2dfd705cee tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "PUT /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1079 microversion: 2.1 time: 0.171852 Sep 17 20:55:55.209557 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 612/1275] 10.222.0.26 () {60 vars in 1256 bytes} [Sat Sep 17 20:55:55 2022] PUT /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1079 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:55:55.221048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-b49e83fe-d26c-4c48-abce-6a82d376c20f req-dc7daae9-3c33-41b5-b0ea-e34535e51c5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22b13c98-aea4-497c-a213-142393b2758c", "tag": "6825902e-5439-42f2-847a-d4c7f3aaf775"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:55.243490 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b49e83fe-d26c-4c48-abce-6a82d376c20f req-dc7daae9-3c33-41b5-b0ea-e34535e51c5d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:55.244169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b49e83fe-d26c-4c48-abce-6a82d376c20f req-dc7daae9-3c33-41b5-b0ea-e34535e51c5d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:55.245574 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b49e83fe-d26c-4c48-abce-6a82d376c20f req-dc7daae9-3c33-41b5-b0ea-e34535e51c5d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:55.261399 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-b49e83fe-d26c-4c48-abce-6a82d376c20f req-dc7daae9-3c33-41b5-b0ea-e34535e51c5d service nova] Creating event network-changed:6825902e-5439-42f2-847a-d4c7f3aaf775 for instance 22b13c98-aea4-497c-a213-142393b2758c on nch2-master-1 Sep 17 20:55:55.268716 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-b49e83fe-d26c-4c48-abce-6a82d376c20f req-dc7daae9-3c33-41b5-b0ea-e34535e51c5d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055468 Sep 17 20:55:55.271674 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 613/1276] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:55.294448 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ed5ea0c8-069d-478f-973d-8dec41e0430a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:55.295369 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ed5ea0c8-069d-478f-973d-8dec41e0430a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:55.305639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ed5ea0c8-069d-478f-973d-8dec41e0430a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:55.306415 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ed5ea0c8-069d-478f-973d-8dec41e0430a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:55.306994 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ed5ea0c8-069d-478f-973d-8dec41e0430a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:55.308007 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ed5ea0c8-069d-478f-973d-8dec41e0430a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:55.308552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ed5ea0c8-069d-478f-973d-8dec41e0430a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:55.309015 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ed5ea0c8-069d-478f-973d-8dec41e0430a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:55.435717 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3e0df1fd-d5b6-4bd9-9182-4db2928e8677 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:55.453345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3e0df1fd-d5b6-4bd9-9182-4db2928e8677 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:55.455335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3e0df1fd-d5b6-4bd9-9182-4db2928e8677 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:55.456835 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3e0df1fd-d5b6-4bd9-9182-4db2928e8677 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1859 microversion: 2.32 time: 0.572324 Sep 17 20:55:55.461351 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 664/1277] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:54 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1859 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:55.532015 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ed5ea0c8-069d-478f-973d-8dec41e0430a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:55.542586 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ed5ea0c8-069d-478f-973d-8dec41e0430a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1505 microversion: 2.1 time: 0.268378 Sep 17 20:55:55.544919 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 614/1278] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:55 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1505 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:55.565867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1656c8ce-82a7-4f3b-8aa2-c637f32283cd tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:55.566856 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1656c8ce-82a7-4f3b-8aa2-c637f32283cd tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:55.575011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1656c8ce-82a7-4f3b-8aa2-c637f32283cd tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:55.575315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1656c8ce-82a7-4f3b-8aa2-c637f32283cd tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:55.575930 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1656c8ce-82a7-4f3b-8aa2-c637f32283cd tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:55.576840 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1656c8ce-82a7-4f3b-8aa2-c637f32283cd tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:55.577824 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1656c8ce-82a7-4f3b-8aa2-c637f32283cd tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:55.578421 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1656c8ce-82a7-4f3b-8aa2-c637f32283cd tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:55.598990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cbd78fdd-3cdf-464a-8e08-3ce88d05f921 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:55.599809 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cbd78fdd-3cdf-464a-8e08-3ce88d05f921 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: d99ba94b-addd-4964-8d95-91de304a4988] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:55.619387 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbd78fdd-3cdf-464a-8e08-3ce88d05f921 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:55.622223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbd78fdd-3cdf-464a-8e08-3ce88d05f921 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:55.627677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbd78fdd-3cdf-464a-8e08-3ce88d05f921 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:55.629898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbd78fdd-3cdf-464a-8e08-3ce88d05f921 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:55.632407 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbd78fdd-3cdf-464a-8e08-3ce88d05f921 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:55.633025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbd78fdd-3cdf-464a-8e08-3ce88d05f921 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:55.833513 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1656c8ce-82a7-4f3b-8aa2-c637f32283cd tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:55.844944 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1656c8ce-82a7-4f3b-8aa2-c637f32283cd tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1505 microversion: 2.1 time: 0.283358 Sep 17 20:55:55.847071 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 665/1279] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:55 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1505 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:55.875316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-eb26f65f-4a59-4e78-8ff9-b86656823cb8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:55.876743 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-eb26f65f-4a59-4e78-8ff9-b86656823cb8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: c8aaf21a-21d2-485f-8df0-2d2e43f00a57] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:55.883142 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eb26f65f-4a59-4e78-8ff9-b86656823cb8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:55.885183 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eb26f65f-4a59-4e78-8ff9-b86656823cb8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:55.888164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eb26f65f-4a59-4e78-8ff9-b86656823cb8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:55.889291 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eb26f65f-4a59-4e78-8ff9-b86656823cb8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:55.890028 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eb26f65f-4a59-4e78-8ff9-b86656823cb8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:55.892887 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eb26f65f-4a59-4e78-8ff9-b86656823cb8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:56.025766 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-eb26f65f-4a59-4e78-8ff9-b86656823cb8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:56.044414 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-eb26f65f-4a59-4e78-8ff9-b86656823cb8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57" status: 200 len: 1277 microversion: 2.1 time: 0.177230 Sep 17 20:55:56.060026 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cbd78fdd-3cdf-464a-8e08-3ce88d05f921 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:56.064906 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 666/1280] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:55 2022] GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57 => generated 1277 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:56.068940 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cbd78fdd-3cdf-464a-8e08-3ce88d05f921 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988" status: 200 len: 1307 microversion: 2.1 time: 0.476304 Sep 17 20:55:56.073764 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 615/1281] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:55 2022] GET /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988 => generated 1307 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:56.074199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-56831dae-d4f9-42ab-b39e-6631363cd9ed tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:56.078533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-56831dae-d4f9-42ab-b39e-6631363cd9ed tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:56.090945 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56831dae-d4f9-42ab-b39e-6631363cd9ed tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:56.091666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56831dae-d4f9-42ab-b39e-6631363cd9ed tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:56.094469 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-20c68bb7-a72f-4126-b663-e9a221a74f01 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:56.094933 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56831dae-d4f9-42ab-b39e-6631363cd9ed tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:56.096278 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56831dae-d4f9-42ab-b39e-6631363cd9ed tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:56.097669 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56831dae-d4f9-42ab-b39e-6631363cd9ed tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:56.098934 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56831dae-d4f9-42ab-b39e-6631363cd9ed tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:56.101050 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-20c68bb7-a72f-4126-b663-e9a221a74f01 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:56.113809 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20c68bb7-a72f-4126-b663-e9a221a74f01 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:56.115701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20c68bb7-a72f-4126-b663-e9a221a74f01 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:56.118066 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20c68bb7-a72f-4126-b663-e9a221a74f01 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:56.119199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20c68bb7-a72f-4126-b663-e9a221a74f01 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:56.120911 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20c68bb7-a72f-4126-b663-e9a221a74f01 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:56.121690 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20c68bb7-a72f-4126-b663-e9a221a74f01 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:56.260996 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-20c68bb7-a72f-4126-b663-e9a221a74f01 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:56.279207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-20c68bb7-a72f-4126-b663-e9a221a74f01 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:56.284350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-20c68bb7-a72f-4126-b663-e9a221a74f01 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:56.285761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-56831dae-d4f9-42ab-b39e-6631363cd9ed tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:55:56.286605 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-56831dae-d4f9-42ab-b39e-6631363cd9ed tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:55:56.287881 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-56831dae-d4f9-42ab-b39e-6631363cd9ed tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:55:56.290485 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-56831dae-d4f9-42ab-b39e-6631363cd9ed tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:55:56.290752 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-20c68bb7-a72f-4126-b663-e9a221a74f01 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1233 microversion: 2.25 time: 0.211567 Sep 17 20:55:56.291359 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 616/1282] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:56 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1233 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:56.291677 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-56831dae-d4f9-42ab-b39e-6631363cd9ed tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:55:56.448087 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-56831dae-d4f9-42ab-b39e-6631363cd9ed tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:56.456759 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56831dae-d4f9-42ab-b39e-6631363cd9ed tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:56.457437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56831dae-d4f9-42ab-b39e-6631363cd9ed tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:56.458050 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56831dae-d4f9-42ab-b39e-6631363cd9ed tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:56.459232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56831dae-d4f9-42ab-b39e-6631363cd9ed tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:56.459821 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56831dae-d4f9-42ab-b39e-6631363cd9ed tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:56.460254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56831dae-d4f9-42ab-b39e-6631363cd9ed tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:56.497857 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bddf8998-f2c9-4a68-95e6-49cdcd60a109 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:56.498755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bddf8998-f2c9-4a68-95e6-49cdcd60a109 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:56.500460 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-56831dae-d4f9-42ab-b39e-6631363cd9ed tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "POST /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08/action" status: 202 len: 1111 microversion: 2.1 time: 0.433626 Sep 17 20:55:56.505504 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 667/1283] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:55:56 2022] POST /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08/action => generated 1111 bytes in 436 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 17 20:55:56.527162 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bddf8998-f2c9-4a68-95e6-49cdcd60a109 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:56.527639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bddf8998-f2c9-4a68-95e6-49cdcd60a109 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:56.529574 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bddf8998-f2c9-4a68-95e6-49cdcd60a109 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:56.530365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bddf8998-f2c9-4a68-95e6-49cdcd60a109 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:56.531956 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a23e4223-a09c-4449-979b-ed367f69aae2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:56.532731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bddf8998-f2c9-4a68-95e6-49cdcd60a109 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:56.534543 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bddf8998-f2c9-4a68-95e6-49cdcd60a109 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:56.535293 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a23e4223-a09c-4449-979b-ed367f69aae2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:56.548810 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:55:56.550630 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a23e4223-a09c-4449-979b-ed367f69aae2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:56.555136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a23e4223-a09c-4449-979b-ed367f69aae2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:56.557803 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a23e4223-a09c-4449-979b-ed367f69aae2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:56.561397 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a23e4223-a09c-4449-979b-ed367f69aae2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:56.566456 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a23e4223-a09c-4449-979b-ed367f69aae2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:56.573646 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a23e4223-a09c-4449-979b-ed367f69aae2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:56.993321 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a23e4223-a09c-4449-979b-ed367f69aae2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:57.009140 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a23e4223-a09c-4449-979b-ed367f69aae2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1516 microversion: 2.1 time: 0.492970 Sep 17 20:55:57.015812 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 668/1284] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:56 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1516 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:57.064489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bddf8998-f2c9-4a68-95e6-49cdcd60a109 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:57.068477 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e3845186-ab7e-421d-991a-cf19efddc6ec tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:57.069353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e3845186-ab7e-421d-991a-cf19efddc6ec tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: c8aaf21a-21d2-485f-8df0-2d2e43f00a57] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:57.076690 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e3845186-ab7e-421d-991a-cf19efddc6ec tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:57.085006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bddf8998-f2c9-4a68-95e6-49cdcd60a109 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:57.087453 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e3845186-ab7e-421d-991a-cf19efddc6ec tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:57.088983 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e3845186-ab7e-421d-991a-cf19efddc6ec tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:57.089740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e3845186-ab7e-421d-991a-cf19efddc6ec tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:57.090212 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e3845186-ab7e-421d-991a-cf19efddc6ec tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:57.091934 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bddf8998-f2c9-4a68-95e6-49cdcd60a109 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:57.094283 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bddf8998-f2c9-4a68-95e6-49cdcd60a109 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1880 microversion: 2.32 time: 0.604602 Sep 17 20:55:57.094423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e3845186-ab7e-421d-991a-cf19efddc6ec tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:57.110829 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 617/1285] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:56 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1880 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:57.148575 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3a563ce3-402a-42ae-80dc-7351eb23130e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:57.152569 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3a563ce3-402a-42ae-80dc-7351eb23130e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: d99ba94b-addd-4964-8d95-91de304a4988] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:57.167867 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3a563ce3-402a-42ae-80dc-7351eb23130e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:57.168399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3a563ce3-402a-42ae-80dc-7351eb23130e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:57.168843 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3a563ce3-402a-42ae-80dc-7351eb23130e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:57.172312 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3a563ce3-402a-42ae-80dc-7351eb23130e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:57.172838 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3a563ce3-402a-42ae-80dc-7351eb23130e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:57.173293 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3a563ce3-402a-42ae-80dc-7351eb23130e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:57.828111 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e3845186-ab7e-421d-991a-cf19efddc6ec tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:57.836303 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e3845186-ab7e-421d-991a-cf19efddc6ec tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57" status: 200 len: 1319 microversion: 2.1 time: 0.772148 Sep 17 20:55:57.836763 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 669/1286] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:57 2022] GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57 => generated 1319 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:57.854499 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-626efb92-dd7d-4763-aae9-a82a4616187f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:57.855538 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-626efb92-dd7d-4763-aae9-a82a4616187f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:57.862000 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-626efb92-dd7d-4763-aae9-a82a4616187f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:57.862536 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-626efb92-dd7d-4763-aae9-a82a4616187f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:57.862870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-626efb92-dd7d-4763-aae9-a82a4616187f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:57.863629 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-626efb92-dd7d-4763-aae9-a82a4616187f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:57.878264 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-626efb92-dd7d-4763-aae9-a82a4616187f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:57.879015 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-626efb92-dd7d-4763-aae9-a82a4616187f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:57.916020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3a563ce3-402a-42ae-80dc-7351eb23130e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:57.928618 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3a563ce3-402a-42ae-80dc-7351eb23130e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988" status: 200 len: 1487 microversion: 2.1 time: 0.815870 Sep 17 20:55:57.931116 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 618/1287] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:57 2022] GET /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988 => generated 1487 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:57.943230 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-0bb4dbe4-bc58-464a-9b32-495e6090e2c4 req-070a2798-dbe5-4d3f-9337-18d6f4e1b8ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22b13c98-aea4-497c-a213-142393b2758c", "tag": "650223c4-4cf1-497c-9804-f7fb7d683a92"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:57.960875 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-0bb4dbe4-bc58-464a-9b32-495e6090e2c4 req-070a2798-dbe5-4d3f-9337-18d6f4e1b8ca service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:57.964396 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-0bb4dbe4-bc58-464a-9b32-495e6090e2c4 req-070a2798-dbe5-4d3f-9337-18d6f4e1b8ca service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:57.968501 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-0bb4dbe4-bc58-464a-9b32-495e6090e2c4 req-070a2798-dbe5-4d3f-9337-18d6f4e1b8ca service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:58.009848 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-0bb4dbe4-bc58-464a-9b32-495e6090e2c4 req-070a2798-dbe5-4d3f-9337-18d6f4e1b8ca service nova] Creating event network-changed:650223c4-4cf1-497c-9804-f7fb7d683a92 for instance 22b13c98-aea4-497c-a213-142393b2758c on nch2-master-1 Sep 17 20:55:58.023063 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-0bb4dbe4-bc58-464a-9b32-495e6090e2c4 req-070a2798-dbe5-4d3f-9337-18d6f4e1b8ca service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089587 Sep 17 20:55:58.024007 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 619/1288] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:55:58.029204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9d67278b-de82-4c09-8326-2ada586aa9c7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:55:58.029936 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9d67278b-de82-4c09-8326-2ada586aa9c7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: d99ba94b-addd-4964-8d95-91de304a4988] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:58.034455 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-626efb92-dd7d-4763-aae9-a82a4616187f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:58.036836 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d67278b-de82-4c09-8326-2ada586aa9c7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:58.037405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d67278b-de82-4c09-8326-2ada586aa9c7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:58.039435 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d67278b-de82-4c09-8326-2ada586aa9c7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:58.040391 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d67278b-de82-4c09-8326-2ada586aa9c7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:58.041072 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d67278b-de82-4c09-8326-2ada586aa9c7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:58.041740 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d67278b-de82-4c09-8326-2ada586aa9c7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:58.050951 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-626efb92-dd7d-4763-aae9-a82a4616187f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:58.052440 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-626efb92-dd7d-4763-aae9-a82a4616187f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:58.053629 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-626efb92-dd7d-4763-aae9-a82a4616187f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1251 microversion: 2.25 time: 0.203031 Sep 17 20:55:58.054399 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 670/1289] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:57 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1251 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:58.077784 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-287335b0-eb08-4ffe-9d95-1c8b73c405db tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:58.078557 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-287335b0-eb08-4ffe-9d95-1c8b73c405db tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:58.090962 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-287335b0-eb08-4ffe-9d95-1c8b73c405db tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:58.091464 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-287335b0-eb08-4ffe-9d95-1c8b73c405db tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:58.091907 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-287335b0-eb08-4ffe-9d95-1c8b73c405db tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:58.092630 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-287335b0-eb08-4ffe-9d95-1c8b73c405db tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:58.093091 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-287335b0-eb08-4ffe-9d95-1c8b73c405db tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:58.093550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-287335b0-eb08-4ffe-9d95-1c8b73c405db tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:58.157226 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9d67278b-de82-4c09-8326-2ada586aa9c7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "POST /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988/action" status: 202 len: 0 microversion: 2.1 time: 0.131459 Sep 17 20:55:58.161043 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 620/1290] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:55:58 2022] POST /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:55:58.168124 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a3514305-898b-4a02-a9a9-9a04d03add86 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:58.169335 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a3514305-898b-4a02-a9a9-9a04d03add86 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:58.177962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3514305-898b-4a02-a9a9-9a04d03add86 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:58.178991 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3514305-898b-4a02-a9a9-9a04d03add86 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:58.179752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3514305-898b-4a02-a9a9-9a04d03add86 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:58.180736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3514305-898b-4a02-a9a9-9a04d03add86 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:58.181680 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3514305-898b-4a02-a9a9-9a04d03add86 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:58.182320 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3514305-898b-4a02-a9a9-9a04d03add86 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:58.819656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-287335b0-eb08-4ffe-9d95-1c8b73c405db tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:58.828560 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-287335b0-eb08-4ffe-9d95-1c8b73c405db tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1516 microversion: 2.1 time: 0.773334 Sep 17 20:55:58.829405 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 671/1291] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:58 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1516 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:58.845024 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2cd82cc2-a70e-4afd-8545-7596b0b8a52a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:58.853365 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2cd82cc2-a70e-4afd-8545-7596b0b8a52a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: d99ba94b-addd-4964-8d95-91de304a4988] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:58.860832 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2cd82cc2-a70e-4afd-8545-7596b0b8a52a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:58.861626 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2cd82cc2-a70e-4afd-8545-7596b0b8a52a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:58.862214 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2cd82cc2-a70e-4afd-8545-7596b0b8a52a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:58.863200 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2cd82cc2-a70e-4afd-8545-7596b0b8a52a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:58.864074 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2cd82cc2-a70e-4afd-8545-7596b0b8a52a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:58.864863 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2cd82cc2-a70e-4afd-8545-7596b0b8a52a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:59.254889 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a3514305-898b-4a02-a9a9-9a04d03add86 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:59.266650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a3514305-898b-4a02-a9a9-9a04d03add86 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:59.268603 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a3514305-898b-4a02-a9a9-9a04d03add86 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:59.270150 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a3514305-898b-4a02-a9a9-9a04d03add86 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1880 microversion: 2.32 time: 1.109952 Sep 17 20:55:59.286754 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 621/1292] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:58 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1880 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:55:59.298760 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-16cd3aa8-0a21-4ec0-af5b-d1b920d698ee tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:59.299748 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-16cd3aa8-0a21-4ec0-af5b-d1b920d698ee tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:59.307273 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-16cd3aa8-0a21-4ec0-af5b-d1b920d698ee tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:59.308216 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-16cd3aa8-0a21-4ec0-af5b-d1b920d698ee tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:59.308951 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-16cd3aa8-0a21-4ec0-af5b-d1b920d698ee tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:59.310219 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-16cd3aa8-0a21-4ec0-af5b-d1b920d698ee tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:59.311139 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-16cd3aa8-0a21-4ec0-af5b-d1b920d698ee tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:59.311831 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-16cd3aa8-0a21-4ec0-af5b-d1b920d698ee tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:59.472164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2cd82cc2-a70e-4afd-8545-7596b0b8a52a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:55:59.481497 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2cd82cc2-a70e-4afd-8545-7596b0b8a52a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988" status: 200 len: 1472 microversion: 2.1 time: 0.650789 Sep 17 20:55:59.482343 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 672/1293] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:58 2022] GET /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988 => generated 1472 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:59.581321 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-16cd3aa8-0a21-4ec0-af5b-d1b920d698ee tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1814 microversion: 2.1 time: 0.293040 Sep 17 20:55:59.593484 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 622/1294] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:59 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1814 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:55:59.598879 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-eaf68549-2b3f-4a92-834f-9d315c5c8d3f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:59.598879 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-eaf68549-2b3f-4a92-834f-9d315c5c8d3f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: c8aaf21a-21d2-485f-8df0-2d2e43f00a57] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:59.606788 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eaf68549-2b3f-4a92-834f-9d315c5c8d3f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:59.607603 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eaf68549-2b3f-4a92-834f-9d315c5c8d3f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:59.608190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eaf68549-2b3f-4a92-834f-9d315c5c8d3f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:59.609032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eaf68549-2b3f-4a92-834f-9d315c5c8d3f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:59.609657 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eaf68549-2b3f-4a92-834f-9d315c5c8d3f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:59.610177 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eaf68549-2b3f-4a92-834f-9d315c5c8d3f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:59.695862 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3642b428-9853-4c50-9f45-5878897835d8 tempest-QuotaClassesAdmin257Test-1167187605 tempest-QuotaClassesAdmin257Test-1167187605-project-admin] Calling method '.version_select at 0x7f25a53b80d0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:59.725151 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3642b428-9853-4c50-9f45-5878897835d8 tempest-QuotaClassesAdmin257Test-1167187605 tempest-QuotaClassesAdmin257Test-1167187605-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.228059 Sep 17 20:55:59.729989 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 673/1295] 10.222.0.26 () {60 vars in 1226 bytes} [Sat Sep 17 20:55:59 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:55:59.741209 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a9f0e7fd-3151-413f-a1a1-97778415b9d1 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:55:59.745060 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a9f0e7fd-3151-413f-a1a1-97778415b9d1 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:55:59.754501 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a9f0e7fd-3151-413f-a1a1-97778415b9d1 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:59.755002 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a9f0e7fd-3151-413f-a1a1-97778415b9d1 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:59.755640 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a9f0e7fd-3151-413f-a1a1-97778415b9d1 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:55:59.756542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a9f0e7fd-3151-413f-a1a1-97778415b9d1 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:55:59.757166 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a9f0e7fd-3151-413f-a1a1-97778415b9d1 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:55:59.757842 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a9f0e7fd-3151-413f-a1a1-97778415b9d1 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:00.070767 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-eaf68549-2b3f-4a92-834f-9d315c5c8d3f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:00.084004 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-eaf68549-2b3f-4a92-834f-9d315c5c8d3f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57" status: 200 len: 1319 microversion: 2.1 time: 0.500468 Sep 17 20:56:00.095893 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 623/1296] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:55:59 2022] GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57 => generated 1319 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:00.108229 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-85dcf211-c6e9-4dbf-bdf6-160ac3465288 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-308763420"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:00.112780 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-85dcf211-c6e9-4dbf-bdf6-160ac3465288 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: d99ba94b-addd-4964-8d95-91de304a4988] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:00.126897 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-85dcf211-c6e9-4dbf-bdf6-160ac3465288 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:00.135215 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a9f0e7fd-3151-413f-a1a1-97778415b9d1 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:00.141548 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-85dcf211-c6e9-4dbf-bdf6-160ac3465288 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:00.144600 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-85dcf211-c6e9-4dbf-bdf6-160ac3465288 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:00.147845 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-85dcf211-c6e9-4dbf-bdf6-160ac3465288 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:00.148450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-85dcf211-c6e9-4dbf-bdf6-160ac3465288 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:00.152367 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-85dcf211-c6e9-4dbf-bdf6-160ac3465288 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:00.154068 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a9f0e7fd-3151-413f-a1a1-97778415b9d1 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:00.157334 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a9f0e7fd-3151-413f-a1a1-97778415b9d1 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:00.159899 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a9f0e7fd-3151-413f-a1a1-97778415b9d1 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1281 microversion: 2.25 time: 0.428229 Sep 17 20:56:00.180349 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 674/1297] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:55:59 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1281 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:00.195723 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-06be22fa-a60f-4665-9b05-2102d9c482ab tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:00.201093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06be22fa-a60f-4665-9b05-2102d9c482ab tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:00.202259 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06be22fa-a60f-4665-9b05-2102d9c482ab tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:00.222239 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06be22fa-a60f-4665-9b05-2102d9c482ab tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:00.223188 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06be22fa-a60f-4665-9b05-2102d9c482ab tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:00.223723 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06be22fa-a60f-4665-9b05-2102d9c482ab tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:00.224163 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06be22fa-a60f-4665-9b05-2102d9c482ab tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:00.281198 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-06be22fa-a60f-4665-9b05-2102d9c482ab tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.098463 Sep 17 20:56:00.288697 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 675/1298] 10.222.0.26 () {58 vars in 1176 bytes} [Sat Sep 17 20:56:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:56:00.292806 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-675eadfb-ff93-4810-938c-7f48a5b2fc37 tempest-QuotaClassesAdmin257Test-1167187605 tempest-QuotaClassesAdmin257Test-1167187605-project-admin] Action: 'update', calling method: .version_select at 0x7f25a545d670>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:00.502940 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-85dcf211-c6e9-4dbf-bdf6-160ac3465288 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "POST /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988/action" status: 202 len: 0 microversion: 2.1 time: 0.403327 Sep 17 20:56:00.504432 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 624/1299] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:56:00 2022] POST /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988/action => generated 0 bytes in 407 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 17 20:56:00.510827 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dccd0db5-72ed-434a-8433-f6bbba7e5429 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:00.511729 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dccd0db5-72ed-434a-8433-f6bbba7e5429 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:00.520417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dccd0db5-72ed-434a-8433-f6bbba7e5429 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:00.521487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dccd0db5-72ed-434a-8433-f6bbba7e5429 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:00.522273 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dccd0db5-72ed-434a-8433-f6bbba7e5429 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:00.523159 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dccd0db5-72ed-434a-8433-f6bbba7e5429 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:00.523726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dccd0db5-72ed-434a-8433-f6bbba7e5429 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:00.524261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dccd0db5-72ed-434a-8433-f6bbba7e5429 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:00.547259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:00.687303 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-675eadfb-ff93-4810-938c-7f48a5b2fc37 tempest-QuotaClassesAdmin257Test-1167187605 tempest-QuotaClassesAdmin257Test-1167187605-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.403942 Sep 17 20:56:00.695984 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 676/1300] 10.222.0.26 () {62 vars in 1247 bytes} [Sat Sep 17 20:56:00 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:56:00.703123 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-51774000-9127-49e8-94fb-65244ba887a4 req-423be705-76fe-4e14-8e7b-69d98f7bdf1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8aaf21a-21d2-485f-8df0-2d2e43f00a57", "tag": "d99d0073-b580-4c7a-b194-0bd762030194"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:00.715206 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-51774000-9127-49e8-94fb-65244ba887a4 req-423be705-76fe-4e14-8e7b-69d98f7bdf1b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:00.717262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-51774000-9127-49e8-94fb-65244ba887a4 req-423be705-76fe-4e14-8e7b-69d98f7bdf1b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:00.718056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-51774000-9127-49e8-94fb-65244ba887a4 req-423be705-76fe-4e14-8e7b-69d98f7bdf1b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:00.733791 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-51774000-9127-49e8-94fb-65244ba887a4 req-423be705-76fe-4e14-8e7b-69d98f7bdf1b service nova] Creating event network-changed:d99d0073-b580-4c7a-b194-0bd762030194 for instance c8aaf21a-21d2-485f-8df0-2d2e43f00a57 on nch1-master-1 Sep 17 20:56:00.741170 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-51774000-9127-49e8-94fb-65244ba887a4 req-423be705-76fe-4e14-8e7b-69d98f7bdf1b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042511 Sep 17 20:56:00.742666 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 677/1301] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:56:00.749482 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-45dccbed-365e-4e81-bdc2-601661e42232 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:00.750526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-45dccbed-365e-4e81-bdc2-601661e42232 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:00.758901 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45dccbed-365e-4e81-bdc2-601661e42232 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:00.759915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45dccbed-365e-4e81-bdc2-601661e42232 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:00.760669 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45dccbed-365e-4e81-bdc2-601661e42232 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:00.761703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45dccbed-365e-4e81-bdc2-601661e42232 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:00.762345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45dccbed-365e-4e81-bdc2-601661e42232 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:00.763145 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45dccbed-365e-4e81-bdc2-601661e42232 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:01.067745 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dccd0db5-72ed-434a-8433-f6bbba7e5429 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:01.078180 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dccd0db5-72ed-434a-8433-f6bbba7e5429 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1516 microversion: 2.1 time: 0.572460 Sep 17 20:56:01.085522 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 625/1302] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:00 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1516 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:01.099440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f0e12c1f-957d-4c87-84d3-9ad34bfc5701 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a5e301f0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:01.183946 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f0e12c1f-957d-4c87-84d3-9ad34bfc5701 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3" status: 200 len: 1413 microversion: 2.1 time: 0.103494 Sep 17 20:56:01.184922 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 626/1303] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:56:01 2022] GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3 => generated 1413 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:01.191135 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-721a9d06-07fe-4f65-8257-aa6442ef9769 tempest-QuotaClassesAdmin257Test-1167187605 tempest-QuotaClassesAdmin257Test-1167187605-project-admin] Calling method '.version_select at 0x7f25a5050b80>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:01.242400 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-721a9d06-07fe-4f65-8257-aa6442ef9769 tempest-QuotaClassesAdmin257Test-1167187605 tempest-QuotaClassesAdmin257Test-1167187605-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.055968 Sep 17 20:56:01.242910 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 627/1304] 10.222.0.26 () {60 vars in 1226 bytes} [Sat Sep 17 20:56:01 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:56:01.249515 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1afd268d-71b6-405e-b354-a845b64ac0b1 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:01.250993 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1afd268d-71b6-405e-b354-a845b64ac0b1 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: c8aaf21a-21d2-485f-8df0-2d2e43f00a57] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:01.257501 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1afd268d-71b6-405e-b354-a845b64ac0b1 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:01.258259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1afd268d-71b6-405e-b354-a845b64ac0b1 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:01.259147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1afd268d-71b6-405e-b354-a845b64ac0b1 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:01.260384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1afd268d-71b6-405e-b354-a845b64ac0b1 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:01.261048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1afd268d-71b6-405e-b354-a845b64ac0b1 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:01.261749 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1afd268d-71b6-405e-b354-a845b64ac0b1 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:01.376925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-45dccbed-365e-4e81-bdc2-601661e42232 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:01.388536 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-45dccbed-365e-4e81-bdc2-601661e42232 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:01.391958 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-45dccbed-365e-4e81-bdc2-601661e42232 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:01.393879 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-45dccbed-365e-4e81-bdc2-601661e42232 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1880 microversion: 2.32 time: 0.649842 Sep 17 20:56:01.394850 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 678/1305] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:00 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1880 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:01.401230 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8ca64bdd-fe04-4c1a-9bdb-f98fa5516cf4 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:01.402169 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8ca64bdd-fe04-4c1a-9bdb-f98fa5516cf4 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:01.425637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8ca64bdd-fe04-4c1a-9bdb-f98fa5516cf4 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:01.427579 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8ca64bdd-fe04-4c1a-9bdb-f98fa5516cf4 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:01.428811 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8ca64bdd-fe04-4c1a-9bdb-f98fa5516cf4 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:01.430401 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8ca64bdd-fe04-4c1a-9bdb-f98fa5516cf4 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:01.431148 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8ca64bdd-fe04-4c1a-9bdb-f98fa5516cf4 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:01.431844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8ca64bdd-fe04-4c1a-9bdb-f98fa5516cf4 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:01.507139 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1afd268d-71b6-405e-b354-a845b64ac0b1 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:01.520009 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1afd268d-71b6-405e-b354-a845b64ac0b1 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57" status: 200 len: 1319 microversion: 2.1 time: 0.273996 Sep 17 20:56:01.521922 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 628/1306] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:01 2022] GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57 => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:01.530333 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-59759ce2-72f1-49a9-a72f-374e7a4b31b9 tempest-QuotaClassesAdmin257Test-1167187605 tempest-QuotaClassesAdmin257Test-1167187605-project-admin] Action: 'update', calling method: .version_select at 0x7f25a5154310>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:01.659723 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-59759ce2-72f1-49a9-a72f-374e7a4b31b9 tempest-QuotaClassesAdmin257Test-1167187605 tempest-QuotaClassesAdmin257Test-1167187605-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.135256 Sep 17 20:56:01.661601 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 629/1307] 10.222.0.26 () {62 vars in 1247 bytes} [Sat Sep 17 20:56:01 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:56:01.750979 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8ca64bdd-fe04-4c1a-9bdb-f98fa5516cf4 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:01.762265 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8ca64bdd-fe04-4c1a-9bdb-f98fa5516cf4 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:01.763703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8ca64bdd-fe04-4c1a-9bdb-f98fa5516cf4 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:01.764829 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8ca64bdd-fe04-4c1a-9bdb-f98fa5516cf4 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1281 microversion: 2.25 time: 0.368697 Sep 17 20:56:01.765931 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 679/1308] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:01 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1281 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:02.105255 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-990e4296-c615-40e6-b633-d29cc26d80af tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:02.106103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-990e4296-c615-40e6-b633-d29cc26d80af tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:02.141421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-990e4296-c615-40e6-b633-d29cc26d80af tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:02.141943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-990e4296-c615-40e6-b633-d29cc26d80af tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:02.144908 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-990e4296-c615-40e6-b633-d29cc26d80af tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:02.146641 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-990e4296-c615-40e6-b633-d29cc26d80af tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:02.150755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-990e4296-c615-40e6-b633-d29cc26d80af tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:02.151753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-990e4296-c615-40e6-b633-d29cc26d80af tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:02.200158 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-82d376a0-589d-49e8-98f9-afb50ef70947 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a57a2700>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:02.286563 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-82d376a0-589d-49e8-98f9-afb50ef70947 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3" status: 200 len: 1413 microversion: 2.1 time: 0.090199 Sep 17 20:56:02.292331 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 680/1309] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:56:02 2022] GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3 => generated 1413 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:56:02.307302 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1161023c-d8bd-4255-823e-e9270b1eec97 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39a2a629-4cdb-497c-8f9e-729c11354b4b", "device": "/dev/xvdb"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:02.310435 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1161023c-d8bd-4255-823e-e9270b1eec97 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:02.318739 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1161023c-d8bd-4255-823e-e9270b1eec97 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:02.319424 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1161023c-d8bd-4255-823e-e9270b1eec97 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:02.320037 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1161023c-d8bd-4255-823e-e9270b1eec97 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:02.320925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1161023c-d8bd-4255-823e-e9270b1eec97 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:02.321593 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1161023c-d8bd-4255-823e-e9270b1eec97 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:02.322566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1161023c-d8bd-4255-823e-e9270b1eec97 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:02.704368 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:02.744629 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1161023c-d8bd-4255-823e-e9270b1eec97 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "POST /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.449797 Sep 17 20:56:02.745730 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 681/1310] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 17 20:56:02 2022] POST /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a/os-volume_attachments => generated 194 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:56:02.766626 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-990e4296-c615-40e6-b633-d29cc26d80af tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:02.767196 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-32840cd9-229e-48b2-96ec-4c1067773585 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:02.770233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-32840cd9-229e-48b2-96ec-4c1067773585 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:02.779933 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-990e4296-c615-40e6-b633-d29cc26d80af tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1516 microversion: 2.1 time: 0.680148 Sep 17 20:56:02.784053 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 630/1311] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:02 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1516 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:02.797756 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d8660af6-5d72-43d5-8ddd-b38add2c55d8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:02.800443 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32840cd9-229e-48b2-96ec-4c1067773585 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:02.801171 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32840cd9-229e-48b2-96ec-4c1067773585 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:02.802214 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d8660af6-5d72-43d5-8ddd-b38add2c55d8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: c8aaf21a-21d2-485f-8df0-2d2e43f00a57] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:02.802369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32840cd9-229e-48b2-96ec-4c1067773585 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:02.802997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32840cd9-229e-48b2-96ec-4c1067773585 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:02.803632 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32840cd9-229e-48b2-96ec-4c1067773585 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:02.804339 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32840cd9-229e-48b2-96ec-4c1067773585 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:02.826597 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8660af6-5d72-43d5-8ddd-b38add2c55d8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:02.829798 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8660af6-5d72-43d5-8ddd-b38add2c55d8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:02.832436 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8660af6-5d72-43d5-8ddd-b38add2c55d8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:02.836498 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8660af6-5d72-43d5-8ddd-b38add2c55d8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:02.837274 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8660af6-5d72-43d5-8ddd-b38add2c55d8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:02.840708 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8660af6-5d72-43d5-8ddd-b38add2c55d8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:03.270511 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-32840cd9-229e-48b2-96ec-4c1067773585 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:03.282864 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-32840cd9-229e-48b2-96ec-4c1067773585 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:03.284320 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-32840cd9-229e-48b2-96ec-4c1067773585 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:03.285423 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d8660af6-5d72-43d5-8ddd-b38add2c55d8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:03.286097 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-32840cd9-229e-48b2-96ec-4c1067773585 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1880 microversion: 2.32 time: 0.538737 Sep 17 20:56:03.286831 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 682/1312] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:02 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1880 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:03.296872 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d8660af6-5d72-43d5-8ddd-b38add2c55d8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57" status: 200 len: 1319 microversion: 2.1 time: 0.509997 Sep 17 20:56:03.297476 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 631/1313] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:02 2022] GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57 => generated 1319 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:03.299696 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b9a2e0fa-689e-4721-88fb-d83318c0a0d7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:03.302186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b9a2e0fa-689e-4721-88fb-d83318c0a0d7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:03.308904 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9a2e0fa-689e-4721-88fb-d83318c0a0d7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:03.309744 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9a2e0fa-689e-4721-88fb-d83318c0a0d7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:03.310576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9a2e0fa-689e-4721-88fb-d83318c0a0d7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:03.311380 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9a2e0fa-689e-4721-88fb-d83318c0a0d7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:03.311891 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9a2e0fa-689e-4721-88fb-d83318c0a0d7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:03.312375 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9a2e0fa-689e-4721-88fb-d83318c0a0d7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:03.319523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-66def58a-6bda-4d57-810b-f7c5e6187a10 req-04664793-adf9-4f8c-9731-c27bd5ba81b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22b13c98-aea4-497c-a213-142393b2758c", "tag": "fac0a530-6799-4e5d-bb72-c716e7db5b00"}, {"name": "network-changed", "server_uuid": "50a51f32-a366-4bd6-9de4-7652c6b2d29d", "tag": "8df31a1d-fc1e-494b-8747-1f3e6c1867ce"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:03.333606 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-66def58a-6bda-4d57-810b-f7c5e6187a10 req-04664793-adf9-4f8c-9731-c27bd5ba81b0 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:03.334154 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-66def58a-6bda-4d57-810b-f7c5e6187a10 req-04664793-adf9-4f8c-9731-c27bd5ba81b0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:03.334608 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-66def58a-6bda-4d57-810b-f7c5e6187a10 req-04664793-adf9-4f8c-9731-c27bd5ba81b0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:03.352246 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-66def58a-6bda-4d57-810b-f7c5e6187a10 req-04664793-adf9-4f8c-9731-c27bd5ba81b0 service nova] Creating event network-changed:fac0a530-6799-4e5d-bb72-c716e7db5b00 for instance 22b13c98-aea4-497c-a213-142393b2758c on nch2-master-1 Sep 17 20:56:03.353244 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-66def58a-6bda-4d57-810b-f7c5e6187a10 req-04664793-adf9-4f8c-9731-c27bd5ba81b0 service nova] Creating event network-changed:8df31a1d-fc1e-494b-8747-1f3e6c1867ce for instance 50a51f32-a366-4bd6-9de4-7652c6b2d29d on nch2-master-1 Sep 17 20:56:03.360592 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-66def58a-6bda-4d57-810b-f7c5e6187a10 req-04664793-adf9-4f8c-9731-c27bd5ba81b0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.061035 Sep 17 20:56:03.361584 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 632/1314] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:56:03.367763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6a513cc3-92d7-4dd0-b472-fc97b223b8ef tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a5100af0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:03.423800 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6a513cc3-92d7-4dd0-b472-fc97b223b8ef tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3" status: 200 len: 1413 microversion: 2.1 time: 0.060593 Sep 17 20:56:03.424966 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 633/1315] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:56:03 2022] GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3 => generated 1413 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:03.655178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b9a2e0fa-689e-4721-88fb-d83318c0a0d7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:03.665021 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b9a2e0fa-689e-4721-88fb-d83318c0a0d7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:03.666921 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b9a2e0fa-689e-4721-88fb-d83318c0a0d7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:03.668257 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b9a2e0fa-689e-4721-88fb-d83318c0a0d7 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1281 microversion: 2.25 time: 0.380262 Sep 17 20:56:03.668984 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 683/1316] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:03 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1281 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:03.812053 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-98a484db-8c5f-46c9-9aa6-25f742b4debd tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:03.812865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-98a484db-8c5f-46c9-9aa6-25f742b4debd tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:03.824163 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98a484db-8c5f-46c9-9aa6-25f742b4debd tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:03.830202 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98a484db-8c5f-46c9-9aa6-25f742b4debd tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:03.839058 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98a484db-8c5f-46c9-9aa6-25f742b4debd tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:03.840046 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98a484db-8c5f-46c9-9aa6-25f742b4debd tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:03.841127 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98a484db-8c5f-46c9-9aa6-25f742b4debd tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:03.844539 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98a484db-8c5f-46c9-9aa6-25f742b4debd tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:04.283544 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-98a484db-8c5f-46c9-9aa6-25f742b4debd tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:04.292143 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=4 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:04.299237 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-98a484db-8c5f-46c9-9aa6-25f742b4debd tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1516 microversion: 2.1 time: 0.493048 Sep 17 20:56:04.305145 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 634/1317] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:03 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1516 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:04.321684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-701500e5-bb2a-406d-bc29-61f91dd1063d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:04.323206 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-701500e5-bb2a-406d-bc29-61f91dd1063d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:04.354518 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-40d1bd90-0ded-4f86-a3f3-115484e0e14f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:04.355095 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-701500e5-bb2a-406d-bc29-61f91dd1063d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:04.356879 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-701500e5-bb2a-406d-bc29-61f91dd1063d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:04.357260 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-40d1bd90-0ded-4f86-a3f3-115484e0e14f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: c8aaf21a-21d2-485f-8df0-2d2e43f00a57] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:04.360042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-701500e5-bb2a-406d-bc29-61f91dd1063d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:04.366471 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-701500e5-bb2a-406d-bc29-61f91dd1063d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:04.367295 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-701500e5-bb2a-406d-bc29-61f91dd1063d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:04.367894 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-701500e5-bb2a-406d-bc29-61f91dd1063d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:04.397286 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-40d1bd90-0ded-4f86-a3f3-115484e0e14f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:04.397820 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-40d1bd90-0ded-4f86-a3f3-115484e0e14f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:04.398260 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-40d1bd90-0ded-4f86-a3f3-115484e0e14f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:04.411739 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-40d1bd90-0ded-4f86-a3f3-115484e0e14f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:04.413313 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-40d1bd90-0ded-4f86-a3f3-115484e0e14f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:04.417726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-40d1bd90-0ded-4f86-a3f3-115484e0e14f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:05.415080 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-40d1bd90-0ded-4f86-a3f3-115484e0e14f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:05.427903 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-40d1bd90-0ded-4f86-a3f3-115484e0e14f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57" status: 200 len: 1319 microversion: 2.1 time: 1.091920 Sep 17 20:56:05.428650 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 635/1318] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:04 2022] GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57 => generated 1319 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:05.454326 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-24b2b9aa-b5c8-470b-a693-f1deda9eb351 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a50b1ca0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:05.535683 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-24b2b9aa-b5c8-470b-a693-f1deda9eb351 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3" status: 200 len: 1413 microversion: 2.1 time: 0.092670 Sep 17 20:56:05.544560 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 636/1319] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:56:05 2022] GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3 => generated 1413 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:05.555763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e9d7eb84-3e54-4d19-9f5f-0bae9ed4a92a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:05.559714 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e9d7eb84-3e54-4d19-9f5f-0bae9ed4a92a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:05.571897 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9d7eb84-3e54-4d19-9f5f-0bae9ed4a92a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:05.577185 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9d7eb84-3e54-4d19-9f5f-0bae9ed4a92a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:05.577901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9d7eb84-3e54-4d19-9f5f-0bae9ed4a92a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:05.579007 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9d7eb84-3e54-4d19-9f5f-0bae9ed4a92a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:05.579639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9d7eb84-3e54-4d19-9f5f-0bae9ed4a92a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:05.586142 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9d7eb84-3e54-4d19-9f5f-0bae9ed4a92a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:05.716199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-701500e5-bb2a-406d-bc29-61f91dd1063d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:05.753258 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-701500e5-bb2a-406d-bc29-61f91dd1063d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:05.755386 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-701500e5-bb2a-406d-bc29-61f91dd1063d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:05.757965 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-701500e5-bb2a-406d-bc29-61f91dd1063d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1880 microversion: 2.32 time: 1.445148 Sep 17 20:56:05.762522 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 684/1320] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:04 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1880 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:05.778192 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-79bd7c77-5bc0-4eb2-bc3a-f8b9ea7630d3 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:05.779234 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-79bd7c77-5bc0-4eb2-bc3a-f8b9ea7630d3 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:05.791787 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79bd7c77-5bc0-4eb2-bc3a-f8b9ea7630d3 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:05.792020 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79bd7c77-5bc0-4eb2-bc3a-f8b9ea7630d3 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:05.792390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79bd7c77-5bc0-4eb2-bc3a-f8b9ea7630d3 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:05.793015 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79bd7c77-5bc0-4eb2-bc3a-f8b9ea7630d3 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:05.793515 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79bd7c77-5bc0-4eb2-bc3a-f8b9ea7630d3 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:05.794152 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79bd7c77-5bc0-4eb2-bc3a-f8b9ea7630d3 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:06.529189 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-79bd7c77-5bc0-4eb2-bc3a-f8b9ea7630d3 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:06.540404 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-79bd7c77-5bc0-4eb2-bc3a-f8b9ea7630d3 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1516 microversion: 2.1 time: 0.776399 Sep 17 20:56:06.546311 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 685/1321] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:05 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1516 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:06.554257 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e9d7eb84-3e54-4d19-9f5f-0bae9ed4a92a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:06.562027 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-a7bb6161-0d87-429a-ae29-559fe8a1d1cb req-3a3b8a1f-bf14-44a1-b0fe-8df90560735f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22b13c98-aea4-497c-a213-142393b2758c", "tag": "f1f9bbb6-1fce-45e9-b23b-60319ea313bb"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:06.578025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e9d7eb84-3e54-4d19-9f5f-0bae9ed4a92a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:06.587450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e9d7eb84-3e54-4d19-9f5f-0bae9ed4a92a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:06.588773 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e9d7eb84-3e54-4d19-9f5f-0bae9ed4a92a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1281 microversion: 2.25 time: 1.038220 Sep 17 20:56:06.589377 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 637/1322] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:05 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1281 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:06.616322 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a7bb6161-0d87-429a-ae29-559fe8a1d1cb req-3a3b8a1f-bf14-44a1-b0fe-8df90560735f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:06.616928 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a7bb6161-0d87-429a-ae29-559fe8a1d1cb req-3a3b8a1f-bf14-44a1-b0fe-8df90560735f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:06.620173 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a7bb6161-0d87-429a-ae29-559fe8a1d1cb req-3a3b8a1f-bf14-44a1-b0fe-8df90560735f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:06.627125 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a9c22590-7cc6-4e24-bed4-89d021e92a5d tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:06.628777 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a9c22590-7cc6-4e24-bed4-89d021e92a5d tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: c8aaf21a-21d2-485f-8df0-2d2e43f00a57] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:06.672204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a9c22590-7cc6-4e24-bed4-89d021e92a5d tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:06.682285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a9c22590-7cc6-4e24-bed4-89d021e92a5d tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:06.683132 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a9c22590-7cc6-4e24-bed4-89d021e92a5d tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:06.687931 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a9c22590-7cc6-4e24-bed4-89d021e92a5d tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:06.688838 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a9c22590-7cc6-4e24-bed4-89d021e92a5d tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:06.690033 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a9c22590-7cc6-4e24-bed4-89d021e92a5d tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:06.710103 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-a7bb6161-0d87-429a-ae29-559fe8a1d1cb req-3a3b8a1f-bf14-44a1-b0fe-8df90560735f service nova] Creating event network-changed:f1f9bbb6-1fce-45e9-b23b-60319ea313bb for instance 22b13c98-aea4-497c-a213-142393b2758c on nch2-master-1 Sep 17 20:56:06.716960 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-a7bb6161-0d87-429a-ae29-559fe8a1d1cb req-3a3b8a1f-bf14-44a1-b0fe-8df90560735f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169127 Sep 17 20:56:06.719123 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 686/1323] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:56:06.736532 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b99ebcce-7406-4e72-921d-dafb0be94629 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:06.739153 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b99ebcce-7406-4e72-921d-dafb0be94629 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:06.757390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b99ebcce-7406-4e72-921d-dafb0be94629 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:06.758380 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b99ebcce-7406-4e72-921d-dafb0be94629 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:06.759041 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b99ebcce-7406-4e72-921d-dafb0be94629 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:06.760010 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b99ebcce-7406-4e72-921d-dafb0be94629 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:06.762754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b99ebcce-7406-4e72-921d-dafb0be94629 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:06.765564 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b99ebcce-7406-4e72-921d-dafb0be94629 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:07.537682 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b99ebcce-7406-4e72-921d-dafb0be94629 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1860 microversion: 2.1 time: 0.817052 Sep 17 20:56:07.540287 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 687/1324] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:06 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1860 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:07.566594 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-081e745e-8e62-4c7a-acd1-3ce5eccc968e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a57d74c0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:07.683866 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-081e745e-8e62-4c7a-acd1-3ce5eccc968e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3" status: 200 len: 1413 microversion: 2.1 time: 0.137115 Sep 17 20:56:07.685097 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 688/1325] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:56:07 2022] GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3 => generated 1413 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:07.952986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a9c22590-7cc6-4e24-bed4-89d021e92a5d tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:07.969155 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a9c22590-7cc6-4e24-bed4-89d021e92a5d tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57" status: 200 len: 1319 microversion: 2.1 time: 1.359620 Sep 17 20:56:07.972959 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 638/1326] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:06 2022] GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57 => generated 1319 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:07.985403 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3a0666b8-b6f5-4f71-a7fb-89dfa6d4710c tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:07.989205 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3a0666b8-b6f5-4f71-a7fb-89dfa6d4710c tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:08.012375 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3a0666b8-b6f5-4f71-a7fb-89dfa6d4710c tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:08.013646 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3a0666b8-b6f5-4f71-a7fb-89dfa6d4710c tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:08.014882 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3a0666b8-b6f5-4f71-a7fb-89dfa6d4710c tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:08.017524 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3a0666b8-b6f5-4f71-a7fb-89dfa6d4710c tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:08.018102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3a0666b8-b6f5-4f71-a7fb-89dfa6d4710c tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:08.021486 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3a0666b8-b6f5-4f71-a7fb-89dfa6d4710c tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:08.080411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-00f6c726-d1b0-4481-9dad-7091c6123056 req-15e6febd-16d2-4744-9c1a-871c8de0940d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d99ba94b-addd-4964-8d95-91de304a4988", "name": "network-vif-plugged", "status": "completed", "tag": "01b9920f-d8f7-4dfb-b9df-b1746666a92f"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:08.106414 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-00f6c726-d1b0-4481-9dad-7091c6123056 req-15e6febd-16d2-4744-9c1a-871c8de0940d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:08.106897 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-00f6c726-d1b0-4481-9dad-7091c6123056 req-15e6febd-16d2-4744-9c1a-871c8de0940d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:08.114057 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-00f6c726-d1b0-4481-9dad-7091c6123056 req-15e6febd-16d2-4744-9c1a-871c8de0940d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:08.161234 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-00f6c726-d1b0-4481-9dad-7091c6123056 req-15e6febd-16d2-4744-9c1a-871c8de0940d service nova] Creating event network-vif-plugged:01b9920f-d8f7-4dfb-b9df-b1746666a92f for instance d99ba94b-addd-4964-8d95-91de304a4988 on nch1-master-1 Sep 17 20:56:08.186055 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-00f6c726-d1b0-4481-9dad-7091c6123056 req-15e6febd-16d2-4744-9c1a-871c8de0940d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.486131 Sep 17 20:56:08.188200 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 689/1327] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:56:08.206152 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3bb407aa-2d2c-424f-bbdb-d76a64f69a25 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:08.212237 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3bb407aa-2d2c-424f-bbdb-d76a64f69a25 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:08.223163 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3bb407aa-2d2c-424f-bbdb-d76a64f69a25 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:08.224126 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3bb407aa-2d2c-424f-bbdb-d76a64f69a25 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:08.224801 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3bb407aa-2d2c-424f-bbdb-d76a64f69a25 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:08.225794 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3bb407aa-2d2c-424f-bbdb-d76a64f69a25 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:08.226454 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3bb407aa-2d2c-424f-bbdb-d76a64f69a25 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:08.227102 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3bb407aa-2d2c-424f-bbdb-d76a64f69a25 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:08.294525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-3bb407aa-2d2c-424f-bbdb-d76a64f69a25 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lazy-loading 'flavor' on Instance uuid 46d60c84-b2e2-4376-a0ca-f0bee938fd9a {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:56:08.311259 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3bb407aa-2d2c-424f-bbdb-d76a64f69a25 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Going to try to live migrate instance to nch2-master-1 {{(pid=140524) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 17 20:56:09.367731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3a0666b8-b6f5-4f71-a7fb-89dfa6d4710c tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:09.377475 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3a0666b8-b6f5-4f71-a7fb-89dfa6d4710c tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:09.391358 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3a0666b8-b6f5-4f71-a7fb-89dfa6d4710c tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:09.400125 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3a0666b8-b6f5-4f71-a7fb-89dfa6d4710c tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1880 microversion: 2.32 time: 1.418306 Sep 17 20:56:09.409647 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 639/1328] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:07 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1880 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:09.426601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-75da118d-9dbf-4099-aebc-ef0a5f3b0845 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:09.430148 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-75da118d-9dbf-4099-aebc-ef0a5f3b0845 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:09.473762 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75da118d-9dbf-4099-aebc-ef0a5f3b0845 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:09.475746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75da118d-9dbf-4099-aebc-ef0a5f3b0845 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:09.477792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75da118d-9dbf-4099-aebc-ef0a5f3b0845 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:09.478896 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75da118d-9dbf-4099-aebc-ef0a5f3b0845 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:09.480068 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75da118d-9dbf-4099-aebc-ef0a5f3b0845 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:09.481367 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75da118d-9dbf-4099-aebc-ef0a5f3b0845 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:09.914829 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-75da118d-9dbf-4099-aebc-ef0a5f3b0845 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:09.930791 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-75da118d-9dbf-4099-aebc-ef0a5f3b0845 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1516 microversion: 2.1 time: 0.517080 Sep 17 20:56:09.935436 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 640/1329] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:09 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1516 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:09.941493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8e29f18b-f26a-4f32-b4dd-53bbc2313652 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:09.942391 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8e29f18b-f26a-4f32-b4dd-53bbc2313652 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:09.954415 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8e29f18b-f26a-4f32-b4dd-53bbc2313652 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:09.955293 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8e29f18b-f26a-4f32-b4dd-53bbc2313652 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:09.956081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8e29f18b-f26a-4f32-b4dd-53bbc2313652 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:09.957150 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8e29f18b-f26a-4f32-b4dd-53bbc2313652 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:09.958078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8e29f18b-f26a-4f32-b4dd-53bbc2313652 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:09.958582 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8e29f18b-f26a-4f32-b4dd-53bbc2313652 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:10.237406 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:10.401373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8e29f18b-f26a-4f32-b4dd-53bbc2313652 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:10.414064 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8e29f18b-f26a-4f32-b4dd-53bbc2313652 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:10.422684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8e29f18b-f26a-4f32-b4dd-53bbc2313652 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:10.424897 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8e29f18b-f26a-4f32-b4dd-53bbc2313652 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1281 microversion: 2.25 time: 0.488117 Sep 17 20:56:10.477391 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 641/1330] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:09 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1281 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:10.484519 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-57e96902-a279-4b0e-a4ab-312cf872c3ed tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a51e1b80>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:10.568047 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-57e96902-a279-4b0e-a4ab-312cf872c3ed tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3" status: 200 len: 1413 microversion: 2.1 time: 0.089381 Sep 17 20:56:10.568993 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 642/1331] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:56:10 2022] GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3 => generated 1413 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:10.576342 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-18641126-5d20-4559-a461-9c43f2821f78 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:10.577591 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-18641126-5d20-4559-a461-9c43f2821f78 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: c8aaf21a-21d2-485f-8df0-2d2e43f00a57] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:10.592645 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-18641126-5d20-4559-a461-9c43f2821f78 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:10.593589 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-18641126-5d20-4559-a461-9c43f2821f78 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:10.598010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-18641126-5d20-4559-a461-9c43f2821f78 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:10.598922 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-18641126-5d20-4559-a461-9c43f2821f78 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:10.599498 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-18641126-5d20-4559-a461-9c43f2821f78 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:10.600057 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-18641126-5d20-4559-a461-9c43f2821f78 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:10.682325 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=29,nova_cell0:UPDATE=7 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:10.938456 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-18641126-5d20-4559-a461-9c43f2821f78 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:10.951841 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-18641126-5d20-4559-a461-9c43f2821f78 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57" status: 200 len: 1319 microversion: 2.1 time: 0.381506 Sep 17 20:56:10.953356 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 643/1332] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:10 2022] GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57 => generated 1319 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:10.962964 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-edf87a9f-8967-43b3-9137-b583c7409340 req-edae5f4c-945a-4e0d-bd8d-54a6f12fcc18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22b13c98-aea4-497c-a213-142393b2758c", "tag": "2adbeae0-ecea-4ae6-bf73-c7bf555f5367"}, {"name": "network-changed", "server_uuid": "22b13c98-aea4-497c-a213-142393b2758c", "tag": "e15c3f2b-0cbb-44da-8610-207b8c1ec7bc"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:10.997446 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-edf87a9f-8967-43b3-9137-b583c7409340 req-edae5f4c-945a-4e0d-bd8d-54a6f12fcc18 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:10.997989 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-edf87a9f-8967-43b3-9137-b583c7409340 req-edae5f4c-945a-4e0d-bd8d-54a6f12fcc18 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:10.998445 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-edf87a9f-8967-43b3-9137-b583c7409340 req-edae5f4c-945a-4e0d-bd8d-54a6f12fcc18 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:11.024517 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-edf87a9f-8967-43b3-9137-b583c7409340 req-edae5f4c-945a-4e0d-bd8d-54a6f12fcc18 service nova] Creating event network-changed:2adbeae0-ecea-4ae6-bf73-c7bf555f5367 for instance 22b13c98-aea4-497c-a213-142393b2758c on nch2-master-1 Sep 17 20:56:11.025028 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-edf87a9f-8967-43b3-9137-b583c7409340 req-edae5f4c-945a-4e0d-bd8d-54a6f12fcc18 service nova] Creating event network-changed:e15c3f2b-0cbb-44da-8610-207b8c1ec7bc for instance 22b13c98-aea4-497c-a213-142393b2758c on nch2-master-1 Sep 17 20:56:11.034986 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-edf87a9f-8967-43b3-9137-b583c7409340 req-edae5f4c-945a-4e0d-bd8d-54a6f12fcc18 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.079935 Sep 17 20:56:11.035983 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 644/1333] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:56:11.157821 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3bb407aa-2d2c-424f-bbdb-d76a64f69a25 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a/action" status: 202 len: 0 microversion: 2.1 time: 2.966159 Sep 17 20:56:11.158585 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 690/1334] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:56:08 2022] POST /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a/action => generated 0 bytes in 2970 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:56:11.164085 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-acec9185-9e03-4409-b9a2-297f6a6b6bc9 req-3d796b80-a5e9-444a-9d23-34a4ac42840c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8aaf21a-21d2-485f-8df0-2d2e43f00a57", "name": "network-vif-plugged", "status": "completed", "tag": "d99d0073-b580-4c7a-b194-0bd762030194"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:11.193098 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-acec9185-9e03-4409-b9a2-297f6a6b6bc9 req-3d796b80-a5e9-444a-9d23-34a4ac42840c service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:11.197890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-acec9185-9e03-4409-b9a2-297f6a6b6bc9 req-3d796b80-a5e9-444a-9d23-34a4ac42840c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:11.199049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-acec9185-9e03-4409-b9a2-297f6a6b6bc9 req-3d796b80-a5e9-444a-9d23-34a4ac42840c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:11.226419 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-acec9185-9e03-4409-b9a2-297f6a6b6bc9 req-3d796b80-a5e9-444a-9d23-34a4ac42840c service nova] Creating event network-vif-plugged:d99d0073-b580-4c7a-b194-0bd762030194 for instance c8aaf21a-21d2-485f-8df0-2d2e43f00a57 on nch1-master-1 Sep 17 20:56:11.232981 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-acec9185-9e03-4409-b9a2-297f6a6b6bc9 req-3d796b80-a5e9-444a-9d23-34a4ac42840c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072693 Sep 17 20:56:11.234054 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 691/1335] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:56:11.241807 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8139a95a-0017-478b-8c68-bc79618dbe6b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:11.257291 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8139a95a-0017-478b-8c68-bc79618dbe6b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:11.279903 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8139a95a-0017-478b-8c68-bc79618dbe6b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:11.281738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8139a95a-0017-478b-8c68-bc79618dbe6b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:11.282638 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8139a95a-0017-478b-8c68-bc79618dbe6b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:11.283728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8139a95a-0017-478b-8c68-bc79618dbe6b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:11.284795 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8139a95a-0017-478b-8c68-bc79618dbe6b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:11.285449 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8139a95a-0017-478b-8c68-bc79618dbe6b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:11.502429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-57b8847d-bea2-49da-a9ea-488e9b50f452 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1183703395", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:11.571590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-57b8847d-bea2-49da-a9ea-488e9b50f452 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] validate_networks() for None {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:56:11.656661 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=16 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:11.733695 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8139a95a-0017-478b-8c68-bc79618dbe6b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:11.753795 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8139a95a-0017-478b-8c68-bc79618dbe6b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:11.757203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8139a95a-0017-478b-8c68-bc79618dbe6b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:11.760637 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8139a95a-0017-478b-8c68-bc79618dbe6b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1880 microversion: 2.32 time: 0.522490 Sep 17 20:56:11.761235 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 692/1336] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:11 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1880 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:11.773562 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-45f0397a-cdba-4509-b9a2-d60bda319223 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:11.774284 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-45f0397a-cdba-4509-b9a2-d60bda319223 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:11.795154 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45f0397a-cdba-4509-b9a2-d60bda319223 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:11.799581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45f0397a-cdba-4509-b9a2-d60bda319223 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:11.800075 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45f0397a-cdba-4509-b9a2-d60bda319223 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:11.801378 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45f0397a-cdba-4509-b9a2-d60bda319223 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:11.801880 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45f0397a-cdba-4509-b9a2-d60bda319223 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:11.802317 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45f0397a-cdba-4509-b9a2-d60bda319223 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:12.173986 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-45f0397a-cdba-4509-b9a2-d60bda319223 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:12.197529 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-45f0397a-cdba-4509-b9a2-d60bda319223 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1516 microversion: 2.1 time: 0.431214 Sep 17 20:56:12.199199 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 693/1337] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:11 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1516 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:12.213594 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ce00ff3a-b327-4243-850c-14b75f716bb6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:12.214537 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ce00ff3a-b327-4243-850c-14b75f716bb6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:12.229298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce00ff3a-b327-4243-850c-14b75f716bb6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:12.233437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce00ff3a-b327-4243-850c-14b75f716bb6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:12.234238 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce00ff3a-b327-4243-850c-14b75f716bb6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:12.235232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce00ff3a-b327-4243-850c-14b75f716bb6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:12.236022 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce00ff3a-b327-4243-850c-14b75f716bb6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:12.237477 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce00ff3a-b327-4243-850c-14b75f716bb6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:12.377983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-57b8847d-bea2-49da-a9ea-488e9b50f452 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:56:12.378705 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-57b8847d-bea2-49da-a9ea-488e9b50f452 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:56:12.379190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-57b8847d-bea2-49da-a9ea-488e9b50f452 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:56:12.379603 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-57b8847d-bea2-49da-a9ea-488e9b50f452 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:56:12.380017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-57b8847d-bea2-49da-a9ea-488e9b50f452 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:56:12.382093 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=7 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:12.398715 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-57b8847d-bea2-49da-a9ea-488e9b50f452 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:12.399211 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-57b8847d-bea2-49da-a9ea-488e9b50f452 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:12.399646 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-57b8847d-bea2-49da-a9ea-488e9b50f452 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:12.402320 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-57b8847d-bea2-49da-a9ea-488e9b50f452 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:12.408671 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-57b8847d-bea2-49da-a9ea-488e9b50f452 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:12.411598 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-57b8847d-bea2-49da-a9ea-488e9b50f452 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:12.457048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-57b8847d-bea2-49da-a9ea-488e9b50f452 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Getting quotas for project 84caeb4c4b2e4dbda9bf7def13420af1. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:56:12.472663 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-57b8847d-bea2-49da-a9ea-488e9b50f452 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Getting quotas for user 4d9c7f4729e04bf6b915246ca7b5a3cf and project 84caeb4c4b2e4dbda9bf7def13420af1. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:56:12.501855 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-57b8847d-bea2-49da-a9ea-488e9b50f452 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:56:12.504406 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-57b8847d-bea2-49da-a9ea-488e9b50f452 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: fe75e57c-282a-4bac-b0a2-1c52dd110c84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:56:12.626075 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-57b8847d-bea2-49da-a9ea-488e9b50f452 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.588660 Sep 17 20:56:12.634600 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 645/1338] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:56:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:56:12.643917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a79a8d46-1998-4309-a6a4-aea0562e4f94 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:12.648378 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a79a8d46-1998-4309-a6a4-aea0562e4f94 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:12.657022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a79a8d46-1998-4309-a6a4-aea0562e4f94 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:12.657895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a79a8d46-1998-4309-a6a4-aea0562e4f94 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:12.658524 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a79a8d46-1998-4309-a6a4-aea0562e4f94 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:12.659432 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a79a8d46-1998-4309-a6a4-aea0562e4f94 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:12.660235 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a79a8d46-1998-4309-a6a4-aea0562e4f94 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:12.660823 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a79a8d46-1998-4309-a6a4-aea0562e4f94 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:13.195039 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a79a8d46-1998-4309-a6a4-aea0562e4f94 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:13.205797 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ce00ff3a-b327-4243-850c-14b75f716bb6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:13.217433 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ce00ff3a-b327-4243-850c-14b75f716bb6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1719 microversion: 2.1 time: 1.016352 Sep 17 20:56:13.218522 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 694/1339] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:12 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1719 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:13.231521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a79a8d46-1998-4309-a6a4-aea0562e4f94 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:13.231521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a79a8d46-1998-4309-a6a4-aea0562e4f94 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:13.231521 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a79a8d46-1998-4309-a6a4-aea0562e4f94 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1281 microversion: 2.25 time: 0.593802 Sep 17 20:56:13.233085 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 646/1340] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:12 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1281 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:13.251328 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ce3d0d06-840c-405f-bc07-e0abd77ab4fc tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:13.260830 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ce3d0d06-840c-405f-bc07-e0abd77ab4fc tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: c8aaf21a-21d2-485f-8df0-2d2e43f00a57] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:13.261231 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a94a8327-8af1-45b5-b5e2-61062b736be8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a5900700>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:13.283166 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce3d0d06-840c-405f-bc07-e0abd77ab4fc tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:13.284152 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce3d0d06-840c-405f-bc07-e0abd77ab4fc tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:13.286215 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce3d0d06-840c-405f-bc07-e0abd77ab4fc tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:13.287846 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce3d0d06-840c-405f-bc07-e0abd77ab4fc tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:13.290082 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce3d0d06-840c-405f-bc07-e0abd77ab4fc tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:13.293197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce3d0d06-840c-405f-bc07-e0abd77ab4fc tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:13.348911 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a94a8327-8af1-45b5-b5e2-61062b736be8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3" status: 200 len: 1413 microversion: 2.1 time: 0.102242 Sep 17 20:56:13.350715 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 695/1341] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:56:13 2022] GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3 => generated 1413 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:13.368865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-78c91314-63fd-489b-9590-94f67106d743 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:13.369541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-78c91314-63fd-489b-9590-94f67106d743 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: fe75e57c-282a-4bac-b0a2-1c52dd110c84] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:13.537614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-78c91314-63fd-489b-9590-94f67106d743 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:13.550264 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-78c91314-63fd-489b-9590-94f67106d743 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84" status: 200 len: 1222 microversion: 2.1 time: 0.197139 Sep 17 20:56:13.553258 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 696/1342] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:13 2022] GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84 => generated 1222 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:13.563811 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5e950278-9a93-4316-8284-0e50ce4d4620 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:13.566146 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5e950278-9a93-4316-8284-0e50ce4d4620 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:13.597447 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e950278-9a93-4316-8284-0e50ce4d4620 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:13.598376 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e950278-9a93-4316-8284-0e50ce4d4620 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:13.600844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e950278-9a93-4316-8284-0e50ce4d4620 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:13.602157 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e950278-9a93-4316-8284-0e50ce4d4620 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:13.602852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e950278-9a93-4316-8284-0e50ce4d4620 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:13.604542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e950278-9a93-4316-8284-0e50ce4d4620 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:13.682960 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ce3d0d06-840c-405f-bc07-e0abd77ab4fc tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:13.702421 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ce3d0d06-840c-405f-bc07-e0abd77ab4fc tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57" status: 200 len: 1468 microversion: 2.1 time: 0.467547 Sep 17 20:56:13.720416 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 647/1343] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:13 2022] GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57 => generated 1468 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:13.733495 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cd77fed0-1300-4eeb-a56e-580396ab2e1c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:13.738748 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cd77fed0-1300-4eeb-a56e-580396ab2e1c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:13.751244 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd77fed0-1300-4eeb-a56e-580396ab2e1c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:13.752130 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd77fed0-1300-4eeb-a56e-580396ab2e1c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:13.753640 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd77fed0-1300-4eeb-a56e-580396ab2e1c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:13.757756 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd77fed0-1300-4eeb-a56e-580396ab2e1c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:13.758706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd77fed0-1300-4eeb-a56e-580396ab2e1c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:13.759480 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd77fed0-1300-4eeb-a56e-580396ab2e1c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:14.596722 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cd77fed0-1300-4eeb-a56e-580396ab2e1c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:14.608830 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cd77fed0-1300-4eeb-a56e-580396ab2e1c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1516 microversion: 2.1 time: 0.887121 Sep 17 20:56:14.617746 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 648/1344] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:13 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1516 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:14.629734 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5e950278-9a93-4316-8284-0e50ce4d4620 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:14.634710 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-600fa754-8990-495f-b2d3-fa9daf777bb3 req-bc996ab3-1b47-4ca2-bcb1-aa5706e8b995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a51f32-a366-4bd6-9de4-7652c6b2d29d", "name": "network-vif-plugged", "status": "completed", "tag": "8df31a1d-fc1e-494b-8747-1f3e6c1867ce"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:14.662974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5e950278-9a93-4316-8284-0e50ce4d4620 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:14.669940 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5e950278-9a93-4316-8284-0e50ce4d4620 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:14.682477 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5e950278-9a93-4316-8284-0e50ce4d4620 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1880 microversion: 2.32 time: 1.127940 Sep 17 20:56:14.692196 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-600fa754-8990-495f-b2d3-fa9daf777bb3 req-bc996ab3-1b47-4ca2-bcb1-aa5706e8b995 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:14.692793 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-600fa754-8990-495f-b2d3-fa9daf777bb3 req-bc996ab3-1b47-4ca2-bcb1-aa5706e8b995 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:14.693560 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-600fa754-8990-495f-b2d3-fa9daf777bb3 req-bc996ab3-1b47-4ca2-bcb1-aa5706e8b995 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:14.705596 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 697/1345] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:13 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1880 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:14.740972 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-600fa754-8990-495f-b2d3-fa9daf777bb3 req-bc996ab3-1b47-4ca2-bcb1-aa5706e8b995 service nova] Creating event network-vif-plugged:8df31a1d-fc1e-494b-8747-1f3e6c1867ce for instance 50a51f32-a366-4bd6-9de4-7652c6b2d29d on nch2-master-1 Sep 17 20:56:14.774654 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-600fa754-8990-495f-b2d3-fa9daf777bb3 req-bc996ab3-1b47-4ca2-bcb1-aa5706e8b995 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154524 Sep 17 20:56:14.776443 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 649/1346] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:56:14.785908 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2fe83272-430f-4651-a07d-c9c08569dd39 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:14.787135 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2fe83272-430f-4651-a07d-c9c08569dd39 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:14.803159 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2fe83272-430f-4651-a07d-c9c08569dd39 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:14.806516 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2fe83272-430f-4651-a07d-c9c08569dd39 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:14.808440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2fe83272-430f-4651-a07d-c9c08569dd39 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:14.821860 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2fe83272-430f-4651-a07d-c9c08569dd39 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:14.829929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2fe83272-430f-4651-a07d-c9c08569dd39 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:14.832842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2fe83272-430f-4651-a07d-c9c08569dd39 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:15.060711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e7923491-10e1-4365-86a6-462e3e4b4a2a tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-823668167", "block_migration": true, "disk_over_commit": false}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:15.063770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e7923491-10e1-4365-86a6-462e3e4b4a2a tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] [instance: c8aaf21a-21d2-485f-8df0-2d2e43f00a57] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:15.102619 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7923491-10e1-4365-86a6-462e3e4b4a2a tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:15.104589 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7923491-10e1-4365-86a6-462e3e4b4a2a tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:15.106481 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7923491-10e1-4365-86a6-462e3e4b4a2a tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:15.109312 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7923491-10e1-4365-86a6-462e3e4b4a2a tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:15.112881 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7923491-10e1-4365-86a6-462e3e4b4a2a tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:15.113760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7923491-10e1-4365-86a6-462e3e4b4a2a tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:15.190027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2fe83272-430f-4651-a07d-c9c08569dd39 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:15.193184 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:15.199646 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-e7923491-10e1-4365-86a6-462e3e4b4a2a tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Lazy-loading 'flavor' on Instance uuid c8aaf21a-21d2-485f-8df0-2d2e43f00a57 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:56:15.208599 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2fe83272-430f-4651-a07d-c9c08569dd39 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1719 microversion: 2.1 time: 0.429618 Sep 17 20:56:15.209171 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 650/1347] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:14 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1719 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:15.221051 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ff40d9be-d939-461e-8228-caa7caa10425 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:15.222031 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ff40d9be-d939-461e-8228-caa7caa10425 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:15.237155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff40d9be-d939-461e-8228-caa7caa10425 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:15.240152 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff40d9be-d939-461e-8228-caa7caa10425 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:15.240804 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff40d9be-d939-461e-8228-caa7caa10425 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:15.242307 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e7923491-10e1-4365-86a6-462e3e4b4a2a tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] [instance: c8aaf21a-21d2-485f-8df0-2d2e43f00a57] Going to try to live migrate instance to tempest-host-823668167 {{(pid=140524) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 17 20:56:15.242651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff40d9be-d939-461e-8228-caa7caa10425 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:15.243277 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff40d9be-d939-461e-8228-caa7caa10425 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:15.245342 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff40d9be-d939-461e-8228-caa7caa10425 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:15.258740 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-e7923491-10e1-4365-86a6-462e3e4b4a2a tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] HTTP exception thrown: Compute host tempest-host-823668167 could not be found. Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e7923491-10e1-4365-86a6-462e3e4b4a2a tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Request method failure captured: Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57/action HTTP/1.1 Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 106 Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjRV8lXApDawh87rP-7iSle3iKtFwaJ_a_EyyN3j7tinVzV3k7-EQiqORpaWu01ckf7CLlY1q6W-2QKteFbolWAacT0VM_aksQVmsYqdj3fI1-mM29yI3VbJkBXVAJoX4Wvc4v8s0VrkG6yLe9sM5C2iVeNJFZVwVa-8ZNZYwIzg9iQ Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: d937c43c346a4286ab80fda4c4601c89 Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-LiveMigrationNegativeTest-358699538 Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: X-Role: admin,member,reader Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: admin,member,reader Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d937c43c346a4286ab80fda4c4601c89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d937c43c346a4286ab80fda4c4601c89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d937c43c346a4286ab80fda4c4601c89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d937c43c346a4286ab80fda4c4601c89", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-LiveMigrationNegativeTest-358699538 Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: d937c43c346a4286ab80fda4c4601c89 Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-358699538 Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-LiveMigrationNegativeTest-358699538-project-admin Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 491d2b684eb94a33a4b7a2b4d1bcaf49 Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-LiveMigrationNegativeTest-358699538-project-admin Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: {"os-migrateLive": {"host": "tempest-host-823668167", "block_migration": true, "disk_over_commit": false}} Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: exception: Compute host tempest-host-823668167 could not be found. Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'c8aaf21a-21d2-485f-8df0-2d2e43f00a57', 'body': {'os-migrateLive': {'host': 'tempest-host-823668167', 'block_migration': True, 'disk_over_commit': False}}} Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Sep 17 20:56:15.264010 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-823668167 could not be found. Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-823668167 could not be found. Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-823668167 could not be found. Sep 17 20:56:15.268892 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:56:15.274132 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e7923491-10e1-4365-86a6-462e3e4b4a2a tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Returning 400 to user: Compute host tempest-host-823668167 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:56:15.275350 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e7923491-10e1-4365-86a6-462e3e4b4a2a tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57/action" status: 400 len: 99 microversion: 2.1 time: 0.563024 Sep 17 20:56:15.276213 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 698/1348] 10.222.0.26 () {60 vars in 1279 bytes} [Sat Sep 17 20:56:14 2022] POST /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57/action => generated 99 bytes in 564 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 17 20:56:15.285877 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b4c91897-78b3-40e7-b90d-71afcfe62ed9 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a57a20d0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:15.437833 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b4c91897-78b3-40e7-b90d-71afcfe62ed9 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3" status: 200 len: 1413 microversion: 2.1 time: 0.160362 Sep 17 20:56:15.439003 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 699/1349] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:56:15 2022] GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3 => generated 1413 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:15.448032 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-862f949b-28a4-4958-a8ab-cacf7834a2d6 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:15.448787 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-862f949b-28a4-4958-a8ab-cacf7834a2d6 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: fe75e57c-282a-4bac-b0a2-1c52dd110c84] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:15.466478 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-862f949b-28a4-4958-a8ab-cacf7834a2d6 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:15.472182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-862f949b-28a4-4958-a8ab-cacf7834a2d6 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:15.473003 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-862f949b-28a4-4958-a8ab-cacf7834a2d6 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:15.474044 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-862f949b-28a4-4958-a8ab-cacf7834a2d6 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:15.478368 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-862f949b-28a4-4958-a8ab-cacf7834a2d6 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:15.479209 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-862f949b-28a4-4958-a8ab-cacf7834a2d6 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:15.579841 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ff40d9be-d939-461e-8228-caa7caa10425 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:15.589364 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ff40d9be-d939-461e-8228-caa7caa10425 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:15.607094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ff40d9be-d939-461e-8228-caa7caa10425 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:15.608286 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ff40d9be-d939-461e-8228-caa7caa10425 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1281 microversion: 2.25 time: 0.396804 Sep 17 20:56:15.622591 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 651/1350] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:15 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1281 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:15.627289 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-79aebbb5-ca33-434f-af38-c7b0017d9eaf tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:15.630348 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-79aebbb5-ca33-434f-af38-c7b0017d9eaf tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: c8aaf21a-21d2-485f-8df0-2d2e43f00a57] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:15.651584 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79aebbb5-ca33-434f-af38-c7b0017d9eaf tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:15.652126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79aebbb5-ca33-434f-af38-c7b0017d9eaf tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:15.652518 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79aebbb5-ca33-434f-af38-c7b0017d9eaf tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:15.653236 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79aebbb5-ca33-434f-af38-c7b0017d9eaf tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:15.653783 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79aebbb5-ca33-434f-af38-c7b0017d9eaf tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:15.654151 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79aebbb5-ca33-434f-af38-c7b0017d9eaf tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:15.698426 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-862f949b-28a4-4958-a8ab-cacf7834a2d6 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:15.709698 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-862f949b-28a4-4958-a8ab-cacf7834a2d6 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84" status: 200 len: 1292 microversion: 2.1 time: 0.267273 Sep 17 20:56:15.713116 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 700/1351] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:15 2022] GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84 => generated 1292 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:15.725860 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-759d60fc-027d-48d1-be5c-6c3a3c2cef1f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:15.726483 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-759d60fc-027d-48d1-be5c-6c3a3c2cef1f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:15.739172 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-759d60fc-027d-48d1-be5c-6c3a3c2cef1f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:15.740855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-759d60fc-027d-48d1-be5c-6c3a3c2cef1f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:15.741306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-759d60fc-027d-48d1-be5c-6c3a3c2cef1f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:15.742120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-759d60fc-027d-48d1-be5c-6c3a3c2cef1f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:15.742576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-759d60fc-027d-48d1-be5c-6c3a3c2cef1f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:15.743006 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-759d60fc-027d-48d1-be5c-6c3a3c2cef1f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:16.120607 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-759d60fc-027d-48d1-be5c-6c3a3c2cef1f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:16.123577 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:16.148639 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-759d60fc-027d-48d1-be5c-6c3a3c2cef1f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1516 microversion: 2.1 time: 0.434277 Sep 17 20:56:16.155353 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-79aebbb5-ca33-434f-af38-c7b0017d9eaf tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:16.170596 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-79aebbb5-ca33-434f-af38-c7b0017d9eaf tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57" status: 200 len: 1468 microversion: 2.1 time: 0.550431 Sep 17 20:56:16.170860 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 701/1352] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:15 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1516 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:16.182042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0e252a58-bb66-457a-a157-fb6e7560a401 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:16.182663 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0e252a58-bb66-457a-a157-fb6e7560a401 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:16.183703 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 652/1353] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:15 2022] GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57 => generated 1468 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:16.185142 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=7,nova_api:INSERT=7 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:16.190604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0e252a58-bb66-457a-a157-fb6e7560a401 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:16.191178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0e252a58-bb66-457a-a157-fb6e7560a401 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:16.191737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0e252a58-bb66-457a-a157-fb6e7560a401 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:16.192510 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0e252a58-bb66-457a-a157-fb6e7560a401 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:16.192977 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0e252a58-bb66-457a-a157-fb6e7560a401 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:16.193404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0e252a58-bb66-457a-a157-fb6e7560a401 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:16.235623 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f48faf2e-85a9-425d-a069-d4d2ece0a73b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:16.236304 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f48faf2e-85a9-425d-a069-d4d2ece0a73b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:16.253842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f48faf2e-85a9-425d-a069-d4d2ece0a73b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:16.259099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f48faf2e-85a9-425d-a069-d4d2ece0a73b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:16.259944 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f48faf2e-85a9-425d-a069-d4d2ece0a73b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:16.263264 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f48faf2e-85a9-425d-a069-d4d2ece0a73b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:16.265628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f48faf2e-85a9-425d-a069-d4d2ece0a73b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:16.269665 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f48faf2e-85a9-425d-a069-d4d2ece0a73b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:16.936769 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f48faf2e-85a9-425d-a069-d4d2ece0a73b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:16.952954 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f48faf2e-85a9-425d-a069-d4d2ece0a73b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1719 microversion: 2.1 time: 0.720625 Sep 17 20:56:16.958825 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 653/1354] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:16 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1719 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:16.970316 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7cb502fa-03da-4823-9a2d-d52915f88d97 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-2110540725", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "b2b2109e-b56e-4581-8c8f-5d8717f6227b"}, {"uuid": "e9ebe330-9bf9-42e1-b666-caf8db5a1a1a"}, {"uuid": "b2b2109e-b56e-4581-8c8f-5d8717f6227b"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:17.009121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0e252a58-bb66-457a-a157-fb6e7560a401 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:17.059098 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0e252a58-bb66-457a-a157-fb6e7560a401 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:17.064575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0e252a58-bb66-457a-a157-fb6e7560a401 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:17.072456 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0e252a58-bb66-457a-a157-fb6e7560a401 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1880 microversion: 2.32 time: 0.900260 Sep 17 20:56:17.085494 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 702/1355] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:16 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1880 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:17.109400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ce5187f5-05fa-499c-985f-f5d191424619 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a5716790>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:17.127923 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-7cb502fa-03da-4823-9a2d-d52915f88d97 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] validate_networks() for [('b2b2109e-b56e-4581-8c8f-5d8717f6227b', None, None, None, None, None), ('e9ebe330-9bf9-42e1-b666-caf8db5a1a1a', None, None, None, None, None), ('b2b2109e-b56e-4581-8c8f-5d8717f6227b', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:56:17.203105 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ce5187f5-05fa-499c-985f-f5d191424619 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3" status: 200 len: 1413 microversion: 2.1 time: 0.126981 Sep 17 20:56:17.204406 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 703/1356] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:56:17 2022] GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3 => generated 1413 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:17.210957 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4023307b-3200-409a-ac40-bdd4fae8a3b3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1604965107", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:17.302879 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-4023307b-3200-409a-ac40-bdd4fae8a3b3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] validate_networks() for None {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:56:17.714057 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-4023307b-3200-409a-ac40-bdd4fae8a3b3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:56:17.714702 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-4023307b-3200-409a-ac40-bdd4fae8a3b3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:56:17.715352 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-4023307b-3200-409a-ac40-bdd4fae8a3b3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:56:17.715974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-4023307b-3200-409a-ac40-bdd4fae8a3b3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:56:17.716919 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-4023307b-3200-409a-ac40-bdd4fae8a3b3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:56:17.750468 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4023307b-3200-409a-ac40-bdd4fae8a3b3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:17.752920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4023307b-3200-409a-ac40-bdd4fae8a3b3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:17.754903 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4023307b-3200-409a-ac40-bdd4fae8a3b3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:17.762518 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4023307b-3200-409a-ac40-bdd4fae8a3b3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:17.763171 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4023307b-3200-409a-ac40-bdd4fae8a3b3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:17.766094 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4023307b-3200-409a-ac40-bdd4fae8a3b3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:17.873640 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-4023307b-3200-409a-ac40-bdd4fae8a3b3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Getting quotas for project eee008b613cd468f9b996e915ced3074. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:56:17.881565 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-4023307b-3200-409a-ac40-bdd4fae8a3b3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Getting quotas for user 6fe33ab0e3394b7ea6b1b0b29f444e53 and project eee008b613cd468f9b996e915ced3074. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:56:17.903341 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4023307b-3200-409a-ac40-bdd4fae8a3b3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:56:17.906344 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4023307b-3200-409a-ac40-bdd4fae8a3b3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:56:17.983785 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4023307b-3200-409a-ac40-bdd4fae8a3b3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.777951 Sep 17 20:56:17.985583 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 704/1357] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:56:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:56:18.006428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-abfdf44d-2f59-4a89-9a7e-18572cae6c88 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:18.009645 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-abfdf44d-2f59-4a89-9a7e-18572cae6c88 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:18.024543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abfdf44d-2f59-4a89-9a7e-18572cae6c88 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:18.025592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abfdf44d-2f59-4a89-9a7e-18572cae6c88 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:18.026370 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abfdf44d-2f59-4a89-9a7e-18572cae6c88 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:18.027361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abfdf44d-2f59-4a89-9a7e-18572cae6c88 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:18.028539 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abfdf44d-2f59-4a89-9a7e-18572cae6c88 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:18.029355 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abfdf44d-2f59-4a89-9a7e-18572cae6c88 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:18.613965 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-abfdf44d-2f59-4a89-9a7e-18572cae6c88 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:18.644218 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-abfdf44d-2f59-4a89-9a7e-18572cae6c88 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:18.649194 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-abfdf44d-2f59-4a89-9a7e-18572cae6c88 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:18.650630 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-abfdf44d-2f59-4a89-9a7e-18572cae6c88 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1477 microversion: 2.25 time: 0.663626 Sep 17 20:56:18.651205 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 705/1358] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:17 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1477 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:18.659748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ae5d703d-68f3-450b-84b4-5db364020067 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:18.661240 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ae5d703d-68f3-450b-84b4-5db364020067 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: fe75e57c-282a-4bac-b0a2-1c52dd110c84] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:18.673400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae5d703d-68f3-450b-84b4-5db364020067 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:18.674210 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae5d703d-68f3-450b-84b4-5db364020067 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:18.675020 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae5d703d-68f3-450b-84b4-5db364020067 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:18.676470 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae5d703d-68f3-450b-84b4-5db364020067 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:18.677122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae5d703d-68f3-450b-84b4-5db364020067 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:18.677756 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae5d703d-68f3-450b-84b4-5db364020067 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:19.168063 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ae5d703d-68f3-450b-84b4-5db364020067 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:19.185179 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ae5d703d-68f3-450b-84b4-5db364020067 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84" status: 200 len: 1322 microversion: 2.1 time: 0.532862 Sep 17 20:56:19.189424 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 706/1359] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:18 2022] GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84 => generated 1322 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:19.204421 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b60a8d2b-81b9-44ca-bd21-246b8c69a6fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:19.211629 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b60a8d2b-81b9-44ca-bd21-246b8c69a6fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:19.227175 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b60a8d2b-81b9-44ca-bd21-246b8c69a6fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:19.231661 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b60a8d2b-81b9-44ca-bd21-246b8c69a6fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:19.232695 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b60a8d2b-81b9-44ca-bd21-246b8c69a6fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:19.243103 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b60a8d2b-81b9-44ca-bd21-246b8c69a6fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:19.247635 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b60a8d2b-81b9-44ca-bd21-246b8c69a6fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:19.250476 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b60a8d2b-81b9-44ca-bd21-246b8c69a6fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:20.192161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b60a8d2b-81b9-44ca-bd21-246b8c69a6fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:20.202377 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b60a8d2b-81b9-44ca-bd21-246b8c69a6fe tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1516 microversion: 2.1 time: 1.004845 Sep 17 20:56:20.203691 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 707/1360] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:19 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1516 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:20.215239 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2e75896c-083f-45e5-bd9a-11986014c2c0 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:20.216188 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2e75896c-083f-45e5-bd9a-11986014c2c0 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:20.223878 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e75896c-083f-45e5-bd9a-11986014c2c0 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:20.224690 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e75896c-083f-45e5-bd9a-11986014c2c0 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:20.225345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e75896c-083f-45e5-bd9a-11986014c2c0 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:20.226320 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e75896c-083f-45e5-bd9a-11986014c2c0 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:20.227144 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e75896c-083f-45e5-bd9a-11986014c2c0 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:20.228097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e75896c-083f-45e5-bd9a-11986014c2c0 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:20.537566 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-7cb502fa-03da-4823-9a2d-d52915f88d97 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:56:20.538175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-7cb502fa-03da-4823-9a2d-d52915f88d97 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:56:20.538723 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-7cb502fa-03da-4823-9a2d-d52915f88d97 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:56:20.539236 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-7cb502fa-03da-4823-9a2d-d52915f88d97 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:56:20.539761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-7cb502fa-03da-4823-9a2d-d52915f88d97 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:56:20.561471 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cb502fa-03da-4823-9a2d-d52915f88d97 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:20.562835 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cb502fa-03da-4823-9a2d-d52915f88d97 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:20.564912 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cb502fa-03da-4823-9a2d-d52915f88d97 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:20.567391 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cb502fa-03da-4823-9a2d-d52915f88d97 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:20.569685 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cb502fa-03da-4823-9a2d-d52915f88d97 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:20.570296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cb502fa-03da-4823-9a2d-d52915f88d97 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:20.657257 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-7cb502fa-03da-4823-9a2d-d52915f88d97 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Getting quotas for project 400242d681ab472d9c90de4fc7da202b. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:56:20.676171 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2e75896c-083f-45e5-bd9a-11986014c2c0 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:20.696150 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2e75896c-083f-45e5-bd9a-11986014c2c0 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1719 microversion: 2.1 time: 0.488323 Sep 17 20:56:20.711731 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 708/1361] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:20 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1719 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:20.712530 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-7cb502fa-03da-4823-9a2d-d52915f88d97 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Getting quotas for user bc22daf24ce44eb28bb6e000316e4df4 and project 400242d681ab472d9c90de4fc7da202b. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:56:20.728177 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d7333a20-9353-4540-a61b-fb34b879bd73 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:20.744441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d7333a20-9353-4540-a61b-fb34b879bd73 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:20.754205 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d7333a20-9353-4540-a61b-fb34b879bd73 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:20.756687 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d7333a20-9353-4540-a61b-fb34b879bd73 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:20.757321 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d7333a20-9353-4540-a61b-fb34b879bd73 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:20.758921 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d7333a20-9353-4540-a61b-fb34b879bd73 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:20.759808 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d7333a20-9353-4540-a61b-fb34b879bd73 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:20.760600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d7333a20-9353-4540-a61b-fb34b879bd73 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:20.767624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7cb502fa-03da-4823-9a2d-d52915f88d97 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:56:20.772006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7cb502fa-03da-4823-9a2d-d52915f88d97 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:56:20.916429 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7cb502fa-03da-4823-9a2d-d52915f88d97 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.954074 Sep 17 20:56:20.922050 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 654/1362] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:56:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 3962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:56:20.934165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1469fb13-c224-46e4-8920-9a41b2da26cf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:20.934794 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1469fb13-c224-46e4-8920-9a41b2da26cf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:20.951329 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d7333a20-9353-4540-a61b-fb34b879bd73 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:20.986161 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d7333a20-9353-4540-a61b-fb34b879bd73 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518" status: 200 len: 1277 microversion: 2.1 time: 0.269835 Sep 17 20:56:20.991619 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 709/1363] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:20 2022] GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 => generated 1277 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:20.994018 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1469fb13-c224-46e4-8920-9a41b2da26cf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:20.995050 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1469fb13-c224-46e4-8920-9a41b2da26cf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:20.995658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1469fb13-c224-46e4-8920-9a41b2da26cf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:20.997221 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1469fb13-c224-46e4-8920-9a41b2da26cf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:20.998407 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1469fb13-c224-46e4-8920-9a41b2da26cf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:20.999017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1469fb13-c224-46e4-8920-9a41b2da26cf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:21.007248 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f0b2f663-4a34-4298-847a-52b817e5c513 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a54f0430>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:21.106693 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f0b2f663-4a34-4298-847a-52b817e5c513 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3" status: 200 len: 1413 microversion: 2.1 time: 0.106019 Sep 17 20:56:21.115701 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 710/1364] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:56:20 2022] GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3 => generated 1413 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:21.121169 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0d9a1486-377a-4c86-b99a-d2576046b2f5 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:21.122128 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0d9a1486-377a-4c86-b99a-d2576046b2f5 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:21.130087 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0d9a1486-377a-4c86-b99a-d2576046b2f5 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:21.130883 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0d9a1486-377a-4c86-b99a-d2576046b2f5 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:21.131565 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0d9a1486-377a-4c86-b99a-d2576046b2f5 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:21.132517 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0d9a1486-377a-4c86-b99a-d2576046b2f5 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:21.133197 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0d9a1486-377a-4c86-b99a-d2576046b2f5 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:21.133898 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0d9a1486-377a-4c86-b99a-d2576046b2f5 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:21.537956 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1469fb13-c224-46e4-8920-9a41b2da26cf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:21.553528 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1469fb13-c224-46e4-8920-9a41b2da26cf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:21.555577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1469fb13-c224-46e4-8920-9a41b2da26cf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:21.557044 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1469fb13-c224-46e4-8920-9a41b2da26cf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1880 microversion: 2.32 time: 0.633743 Sep 17 20:56:21.558211 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 655/1365] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:20 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1880 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:21.577600 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d2b9fa10-1409-4270-ace5-8058a1d46e5f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:21.578599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d2b9fa10-1409-4270-ace5-8058a1d46e5f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: fe75e57c-282a-4bac-b0a2-1c52dd110c84] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:21.585135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-0d9a1486-377a-4c86-b99a-d2576046b2f5 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lazy-loading 'services' on Instance uuid 50a51f32-a366-4bd6-9de4-7652c6b2d29d {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:56:21.592083 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2b9fa10-1409-4270-ace5-8058a1d46e5f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:21.592897 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2b9fa10-1409-4270-ace5-8058a1d46e5f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:21.593615 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2b9fa10-1409-4270-ace5-8058a1d46e5f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:21.594665 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2b9fa10-1409-4270-ace5-8058a1d46e5f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:21.595349 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2b9fa10-1409-4270-ace5-8058a1d46e5f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:21.596148 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2b9fa10-1409-4270-ace5-8058a1d46e5f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:21.648335 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0d9a1486-377a-4c86-b99a-d2576046b2f5 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1970 microversion: 2.25 time: 0.530027 Sep 17 20:56:21.656524 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 711/1366] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:21 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1970 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:21.666442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9cc42344-0cdf-44d2-b29c-2c768b064b17 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:21.677019 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9cc42344-0cdf-44d2-b29c-2c768b064b17 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:21.859274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9cc42344-0cdf-44d2-b29c-2c768b064b17 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:21.868760 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9cc42344-0cdf-44d2-b29c-2c768b064b17 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1213 microversion: 2.1 time: 0.209542 Sep 17 20:56:21.877624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d2b9fa10-1409-4270-ace5-8058a1d46e5f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:21.898802 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 712/1367] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:21 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1213 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:21.902959 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d2b9fa10-1409-4270-ace5-8058a1d46e5f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84" status: 200 len: 1322 microversion: 2.1 time: 0.343355 Sep 17 20:56:21.908303 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 656/1368] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:21 2022] GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84 => generated 1322 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:21.910833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-66eb2636-94a3-4e08-ac3c-019d0477f2a2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:21.914732 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-66eb2636-94a3-4e08-ac3c-019d0477f2a2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:21.919019 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-d7767dab-fa8d-499d-8378-51b1e97fe3c1 req-59eeec5b-8e9d-4a6c-8d5a-7d9a0e36dca8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe75e57c-282a-4bac-b0a2-1c52dd110c84", "tag": "006c319b-8066-40f4-b844-ba9882602395"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:21.929189 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66eb2636-94a3-4e08-ac3c-019d0477f2a2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:21.929929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66eb2636-94a3-4e08-ac3c-019d0477f2a2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:21.931445 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66eb2636-94a3-4e08-ac3c-019d0477f2a2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:21.934172 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66eb2636-94a3-4e08-ac3c-019d0477f2a2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:21.934924 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66eb2636-94a3-4e08-ac3c-019d0477f2a2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:21.943656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66eb2636-94a3-4e08-ac3c-019d0477f2a2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:21.951132 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d7767dab-fa8d-499d-8378-51b1e97fe3c1 req-59eeec5b-8e9d-4a6c-8d5a-7d9a0e36dca8 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:21.952759 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d7767dab-fa8d-499d-8378-51b1e97fe3c1 req-59eeec5b-8e9d-4a6c-8d5a-7d9a0e36dca8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:21.956503 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d7767dab-fa8d-499d-8378-51b1e97fe3c1 req-59eeec5b-8e9d-4a6c-8d5a-7d9a0e36dca8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:21.988173 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-d7767dab-fa8d-499d-8378-51b1e97fe3c1 req-59eeec5b-8e9d-4a6c-8d5a-7d9a0e36dca8 service nova] Creating event network-changed:006c319b-8066-40f4-b844-ba9882602395 for instance fe75e57c-282a-4bac-b0a2-1c52dd110c84 on nch1-master-1 Sep 17 20:56:21.995301 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-d7767dab-fa8d-499d-8378-51b1e97fe3c1 req-59eeec5b-8e9d-4a6c-8d5a-7d9a0e36dca8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085455 Sep 17 20:56:21.998755 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 657/1369] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:56:22.018095 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e5f12588-bce9-44ae-90c0-bd9389db8a85 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:22.019010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e5f12588-bce9-44ae-90c0-bd9389db8a85 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:22.051866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5f12588-bce9-44ae-90c0-bd9389db8a85 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:22.052774 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5f12588-bce9-44ae-90c0-bd9389db8a85 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:22.062109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5f12588-bce9-44ae-90c0-bd9389db8a85 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:22.063139 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5f12588-bce9-44ae-90c0-bd9389db8a85 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:22.064059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5f12588-bce9-44ae-90c0-bd9389db8a85 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:22.064654 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5f12588-bce9-44ae-90c0-bd9389db8a85 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:22.291869 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-66eb2636-94a3-4e08-ac3c-019d0477f2a2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:22.305709 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-66eb2636-94a3-4e08-ac3c-019d0477f2a2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1516 microversion: 2.1 time: 0.401453 Sep 17 20:56:22.307638 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 713/1370] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:21 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1516 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:22.313201 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3c75f4ad-3c73-4da3-9fa8-b1b4db50961c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:22.314196 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3c75f4ad-3c73-4da3-9fa8-b1b4db50961c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:22.324778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c75f4ad-3c73-4da3-9fa8-b1b4db50961c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:22.325893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c75f4ad-3c73-4da3-9fa8-b1b4db50961c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:22.338552 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c75f4ad-3c73-4da3-9fa8-b1b4db50961c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:22.339729 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c75f4ad-3c73-4da3-9fa8-b1b4db50961c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:22.342330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c75f4ad-3c73-4da3-9fa8-b1b4db50961c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:22.343117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c75f4ad-3c73-4da3-9fa8-b1b4db50961c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:22.411698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-e5f12588-bce9-44ae-90c0-bd9389db8a85 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lazy-loading 'services' on Instance uuid 50a51f32-a366-4bd6-9de4-7652c6b2d29d {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:56:22.447464 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e5f12588-bce9-44ae-90c0-bd9389db8a85 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1970 microversion: 2.25 time: 0.438415 Sep 17 20:56:22.448606 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 658/1371] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:21 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1970 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:22.458447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8bceeb50-83bd-401d-bbc8-bd82fae6b4ba tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:22.460347 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8bceeb50-83bd-401d-bbc8-bd82fae6b4ba tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:22.477226 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8bceeb50-83bd-401d-bbc8-bd82fae6b4ba tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:22.480122 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8bceeb50-83bd-401d-bbc8-bd82fae6b4ba tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:22.480964 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8bceeb50-83bd-401d-bbc8-bd82fae6b4ba tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:22.483588 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8bceeb50-83bd-401d-bbc8-bd82fae6b4ba tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:22.486371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8bceeb50-83bd-401d-bbc8-bd82fae6b4ba tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:22.487037 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8bceeb50-83bd-401d-bbc8-bd82fae6b4ba tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:22.642313 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8bceeb50-83bd-401d-bbc8-bd82fae6b4ba tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:22.655741 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8bceeb50-83bd-401d-bbc8-bd82fae6b4ba tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518" status: 200 len: 1277 microversion: 2.1 time: 0.205804 Sep 17 20:56:22.660662 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 659/1372] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:22 2022] GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 => generated 1277 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:22.680769 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-95accfc8-8a5d-43b3-b6f9-58f64e8e7f6f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a51e1430>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:22.724854 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3c75f4ad-3c73-4da3-9fa8-b1b4db50961c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:22.736752 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3c75f4ad-3c73-4da3-9fa8-b1b4db50961c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1719 microversion: 2.1 time: 0.427327 Sep 17 20:56:22.766253 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 714/1373] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:22 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1719 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:22.768754 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-95accfc8-8a5d-43b3-b6f9-58f64e8e7f6f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3" status: 200 len: 1413 microversion: 2.1 time: 0.106586 Sep 17 20:56:22.776893 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 660/1374] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:56:22 2022] GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3 => generated 1413 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:22.777101 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-32c713e4-f5a4-46fe-bbd6-98927b7c3958 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:22.777203 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4bd5307b-930a-499d-91c0-81ad752b3402 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:22.777203 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4bd5307b-930a-499d-91c0-81ad752b3402 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:22.786237 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32c713e4-f5a4-46fe-bbd6-98927b7c3958 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:22.786778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32c713e4-f5a4-46fe-bbd6-98927b7c3958 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:22.787230 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32c713e4-f5a4-46fe-bbd6-98927b7c3958 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:22.788701 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32c713e4-f5a4-46fe-bbd6-98927b7c3958 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:22.789653 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32c713e4-f5a4-46fe-bbd6-98927b7c3958 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:22.790208 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32c713e4-f5a4-46fe-bbd6-98927b7c3958 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:22.797549 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bd5307b-930a-499d-91c0-81ad752b3402 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:22.798228 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bd5307b-930a-499d-91c0-81ad752b3402 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:22.798678 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bd5307b-930a-499d-91c0-81ad752b3402 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:22.799396 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bd5307b-930a-499d-91c0-81ad752b3402 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:22.799984 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bd5307b-930a-499d-91c0-81ad752b3402 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:22.800418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bd5307b-930a-499d-91c0-81ad752b3402 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:22.867133 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-32c713e4-f5a4-46fe-bbd6-98927b7c3958 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.099583 Sep 17 20:56:22.868327 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 715/1375] 10.222.0.26 () {60 vars in 1217 bytes} [Sat Sep 17 20:56:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:56:22.884717 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bbffe54a-072a-47ce-a812-c412c282b7a9 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:22.892316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bbffe54a-072a-47ce-a812-c412c282b7a9 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:22.903875 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbffe54a-072a-47ce-a812-c412c282b7a9 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:22.904914 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbffe54a-072a-47ce-a812-c412c282b7a9 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:22.905661 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbffe54a-072a-47ce-a812-c412c282b7a9 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:22.919890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbffe54a-072a-47ce-a812-c412c282b7a9 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:22.920674 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbffe54a-072a-47ce-a812-c412c282b7a9 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:22.921137 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbffe54a-072a-47ce-a812-c412c282b7a9 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:22.980187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-bbffe54a-072a-47ce-a812-c412c282b7a9 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lazy-loading 'flavor' on Instance uuid 50a51f32-a366-4bd6-9de4-7652c6b2d29d {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:56:22.993429 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bbffe54a-072a-47ce-a812-c412c282b7a9 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Going to try to live migrate instance to nch1-master-1 {{(pid=140524) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 17 20:56:23.054919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4bd5307b-930a-499d-91c0-81ad752b3402 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:23.069449 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4bd5307b-930a-499d-91c0-81ad752b3402 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:23.072124 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4bd5307b-930a-499d-91c0-81ad752b3402 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:23.073774 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4bd5307b-930a-499d-91c0-81ad752b3402 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1880 microversion: 2.32 time: 0.302538 Sep 17 20:56:23.074856 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 661/1376] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:22 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1880 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:23.081601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-51a7d817-2180-4140-9009-c38d82de666c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:23.082971 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-51a7d817-2180-4140-9009-c38d82de666c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:23.096526 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-51a7d817-2180-4140-9009-c38d82de666c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:23.098029 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-51a7d817-2180-4140-9009-c38d82de666c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:23.099061 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-51a7d817-2180-4140-9009-c38d82de666c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:23.100018 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-51a7d817-2180-4140-9009-c38d82de666c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:23.100638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-51a7d817-2180-4140-9009-c38d82de666c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:23.101622 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-51a7d817-2180-4140-9009-c38d82de666c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:23.184757 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-51a7d817-2180-4140-9009-c38d82de666c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:23.195163 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-51a7d817-2180-4140-9009-c38d82de666c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1265 microversion: 2.1 time: 0.118767 Sep 17 20:56:23.196823 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 662/1377] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:23 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1265 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:23.202875 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ad8c98d4-f558-4412-bbbc-7e9aedb6bded tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:23.203829 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ad8c98d4-f558-4412-bbbc-7e9aedb6bded tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: fe75e57c-282a-4bac-b0a2-1c52dd110c84] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:23.211428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad8c98d4-f558-4412-bbbc-7e9aedb6bded tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:23.212372 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad8c98d4-f558-4412-bbbc-7e9aedb6bded tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:23.213218 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad8c98d4-f558-4412-bbbc-7e9aedb6bded tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:23.214268 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad8c98d4-f558-4412-bbbc-7e9aedb6bded tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:23.214973 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad8c98d4-f558-4412-bbbc-7e9aedb6bded tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:23.215649 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad8c98d4-f558-4412-bbbc-7e9aedb6bded tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:23.454406 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ad8c98d4-f558-4412-bbbc-7e9aedb6bded tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:23.467596 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ad8c98d4-f558-4412-bbbc-7e9aedb6bded tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84" status: 200 len: 1322 microversion: 2.1 time: 0.268527 Sep 17 20:56:23.470743 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 663/1378] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:23 2022] GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84 => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:23.494340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-69744167-3a23-4e03-863d-0a17a634324c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:23.495642 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-69744167-3a23-4e03-863d-0a17a634324c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:23.503183 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69744167-3a23-4e03-863d-0a17a634324c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:23.504440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69744167-3a23-4e03-863d-0a17a634324c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:23.505165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69744167-3a23-4e03-863d-0a17a634324c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:23.506342 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69744167-3a23-4e03-863d-0a17a634324c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:23.507085 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69744167-3a23-4e03-863d-0a17a634324c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:23.507771 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69744167-3a23-4e03-863d-0a17a634324c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:23.707660 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-69744167-3a23-4e03-863d-0a17a634324c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:23.719079 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-69744167-3a23-4e03-863d-0a17a634324c tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1516 microversion: 2.1 time: 0.230085 Sep 17 20:56:23.734045 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 664/1379] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:23 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1516 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:23.743213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-67f0b340-ddfc-49b3-8647-fe6cb3fe6326 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:23.744185 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-67f0b340-ddfc-49b3-8647-fe6cb3fe6326 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:23.750917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67f0b340-ddfc-49b3-8647-fe6cb3fe6326 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:23.751789 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67f0b340-ddfc-49b3-8647-fe6cb3fe6326 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:23.752588 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67f0b340-ddfc-49b3-8647-fe6cb3fe6326 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:23.753685 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67f0b340-ddfc-49b3-8647-fe6cb3fe6326 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:23.754375 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67f0b340-ddfc-49b3-8647-fe6cb3fe6326 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:23.755027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67f0b340-ddfc-49b3-8647-fe6cb3fe6326 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:23.846233 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-67f0b340-ddfc-49b3-8647-fe6cb3fe6326 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:23.858581 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-67f0b340-ddfc-49b3-8647-fe6cb3fe6326 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518" status: 200 len: 1277 microversion: 2.1 time: 0.122847 Sep 17 20:56:23.873523 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 665/1380] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:23 2022] GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 => generated 1277 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:23.875442 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1cb8dcd7-6da7-47a8-b2df-9d7eb8716cf9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:23.876061 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1cb8dcd7-6da7-47a8-b2df-9d7eb8716cf9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:23.910406 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1cb8dcd7-6da7-47a8-b2df-9d7eb8716cf9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:23.910979 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1cb8dcd7-6da7-47a8-b2df-9d7eb8716cf9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:23.911445 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1cb8dcd7-6da7-47a8-b2df-9d7eb8716cf9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:23.912204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1cb8dcd7-6da7-47a8-b2df-9d7eb8716cf9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:23.917385 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1cb8dcd7-6da7-47a8-b2df-9d7eb8716cf9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:23.917898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1cb8dcd7-6da7-47a8-b2df-9d7eb8716cf9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:24.256454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1cb8dcd7-6da7-47a8-b2df-9d7eb8716cf9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:24.268949 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1cb8dcd7-6da7-47a8-b2df-9d7eb8716cf9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1719 microversion: 2.1 time: 0.401180 Sep 17 20:56:24.270432 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 666/1381] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:23 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1719 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:24.275794 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7dca7084-8f86-4bd3-a76c-e96dee5c20b8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a51eed30>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:24.366034 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7dca7084-8f86-4bd3-a76c-e96dee5c20b8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3" status: 200 len: 1413 microversion: 2.1 time: 0.093716 Sep 17 20:56:24.374219 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 667/1382] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:56:24 2022] GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3 => generated 1413 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:24.374219 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e6cf8a1b-4951-47dd-84e9-c75b3732418d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:24.374219 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e6cf8a1b-4951-47dd-84e9-c75b3732418d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:24.381962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6cf8a1b-4951-47dd-84e9-c75b3732418d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:24.383176 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6cf8a1b-4951-47dd-84e9-c75b3732418d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:24.384663 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6cf8a1b-4951-47dd-84e9-c75b3732418d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:24.385571 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6cf8a1b-4951-47dd-84e9-c75b3732418d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:24.386120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6cf8a1b-4951-47dd-84e9-c75b3732418d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:24.386897 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6cf8a1b-4951-47dd-84e9-c75b3732418d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:24.618992 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e6cf8a1b-4951-47dd-84e9-c75b3732418d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:24.639806 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e6cf8a1b-4951-47dd-84e9-c75b3732418d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:24.642239 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e6cf8a1b-4951-47dd-84e9-c75b3732418d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:24.643859 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e6cf8a1b-4951-47dd-84e9-c75b3732418d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1880 microversion: 2.32 time: 0.275149 Sep 17 20:56:24.660350 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 668/1383] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:24 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1880 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:24.671976 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e0e5743c-cdde-41ce-b8c3-5db557782d8f tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:24.672836 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e0e5743c-cdde-41ce-b8c3-5db557782d8f tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:24.679772 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0e5743c-cdde-41ce-b8c3-5db557782d8f tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:24.681499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0e5743c-cdde-41ce-b8c3-5db557782d8f tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:24.682468 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0e5743c-cdde-41ce-b8c3-5db557782d8f tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:24.684029 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0e5743c-cdde-41ce-b8c3-5db557782d8f tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:24.685079 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0e5743c-cdde-41ce-b8c3-5db557782d8f tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:24.685760 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0e5743c-cdde-41ce-b8c3-5db557782d8f tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:24.765973 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e0e5743c-cdde-41ce-b8c3-5db557782d8f tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:24.777156 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e0e5743c-cdde-41ce-b8c3-5db557782d8f tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1271 microversion: 2.1 time: 0.114386 Sep 17 20:56:24.778069 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 669/1384] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:24 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1271 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:24.784335 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-294d9b29-43ed-45e2-abaf-b3a61bc4efcc tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:24.785359 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-294d9b29-43ed-45e2-abaf-b3a61bc4efcc tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: fe75e57c-282a-4bac-b0a2-1c52dd110c84] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:24.796608 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-294d9b29-43ed-45e2-abaf-b3a61bc4efcc tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:24.797539 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-294d9b29-43ed-45e2-abaf-b3a61bc4efcc tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:24.798237 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-294d9b29-43ed-45e2-abaf-b3a61bc4efcc tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:24.799195 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-294d9b29-43ed-45e2-abaf-b3a61bc4efcc tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:24.800136 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-294d9b29-43ed-45e2-abaf-b3a61bc4efcc tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:24.800800 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-294d9b29-43ed-45e2-abaf-b3a61bc4efcc tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:24.819713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:25.046102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-294d9b29-43ed-45e2-abaf-b3a61bc4efcc tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:25.060016 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-294d9b29-43ed-45e2-abaf-b3a61bc4efcc tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84" status: 200 len: 1322 microversion: 2.1 time: 0.275955 Sep 17 20:56:25.074843 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 670/1385] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:24 2022] GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84 => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:25.087500 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-0146f33b-fce8-4178-92aa-af950479c721 req-5d04994c-80d6-4fa0-85d5-0cc602028b32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d60c84-b2e2-4376-a0ca-f0bee938fd9a", "name": "network-vif-unplugged", "status": "completed", "tag": "94958f55-6b3e-41f2-a7f1-6dd835192bd3"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:25.102054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-0146f33b-fce8-4178-92aa-af950479c721 req-5d04994c-80d6-4fa0-85d5-0cc602028b32 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:25.104576 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-0146f33b-fce8-4178-92aa-af950479c721 req-5d04994c-80d6-4fa0-85d5-0cc602028b32 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:25.105376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-0146f33b-fce8-4178-92aa-af950479c721 req-5d04994c-80d6-4fa0-85d5-0cc602028b32 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:25.149168 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-0146f33b-fce8-4178-92aa-af950479c721 req-5d04994c-80d6-4fa0-85d5-0cc602028b32 service nova] Creating event network-vif-unplugged:94958f55-6b3e-41f2-a7f1-6dd835192bd3 for instance 46d60c84-b2e2-4376-a0ca-f0bee938fd9a on nch1-master-1 Sep 17 20:56:25.158346 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-0146f33b-fce8-4178-92aa-af950479c721 req-5d04994c-80d6-4fa0-85d5-0cc602028b32 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081472 Sep 17 20:56:25.159769 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 671/1386] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:56:25.168412 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b6630dca-fe67-4fe3-a72a-84ffe7485981 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:25.168985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b6630dca-fe67-4fe3-a72a-84ffe7485981 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:25.176371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6630dca-fe67-4fe3-a72a-84ffe7485981 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:25.177184 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6630dca-fe67-4fe3-a72a-84ffe7485981 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:25.177729 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6630dca-fe67-4fe3-a72a-84ffe7485981 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:25.178569 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6630dca-fe67-4fe3-a72a-84ffe7485981 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:25.179131 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6630dca-fe67-4fe3-a72a-84ffe7485981 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:25.179634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6630dca-fe67-4fe3-a72a-84ffe7485981 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:25.398746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b6630dca-fe67-4fe3-a72a-84ffe7485981 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:25.415846 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b6630dca-fe67-4fe3-a72a-84ffe7485981 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1522 microversion: 2.1 time: 0.253344 Sep 17 20:56:25.432848 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 672/1387] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:25 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:25.443383 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a178bf84-ce4d-4cde-a6cb-a1b0b9349444 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:25.444703 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a178bf84-ce4d-4cde-a6cb-a1b0b9349444 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:25.458940 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a178bf84-ce4d-4cde-a6cb-a1b0b9349444 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:25.459362 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a178bf84-ce4d-4cde-a6cb-a1b0b9349444 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:25.459824 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a178bf84-ce4d-4cde-a6cb-a1b0b9349444 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:25.463499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a178bf84-ce4d-4cde-a6cb-a1b0b9349444 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:25.467708 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a178bf84-ce4d-4cde-a6cb-a1b0b9349444 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:25.468572 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a178bf84-ce4d-4cde-a6cb-a1b0b9349444 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:25.913389 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a178bf84-ce4d-4cde-a6cb-a1b0b9349444 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:25.924601 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a178bf84-ce4d-4cde-a6cb-a1b0b9349444 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518" status: 200 len: 1319 microversion: 2.1 time: 0.490381 Sep 17 20:56:25.938243 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 673/1388] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:25 2022] GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 => generated 1319 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:25.938243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dfe187c4-76f5-4fd1-819b-1f9e519a0ebd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:25.938243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dfe187c4-76f5-4fd1-819b-1f9e519a0ebd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:25.947813 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfe187c4-76f5-4fd1-819b-1f9e519a0ebd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:25.948464 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfe187c4-76f5-4fd1-819b-1f9e519a0ebd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:25.949150 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfe187c4-76f5-4fd1-819b-1f9e519a0ebd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:25.950189 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfe187c4-76f5-4fd1-819b-1f9e519a0ebd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:25.951216 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfe187c4-76f5-4fd1-819b-1f9e519a0ebd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:25.952585 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfe187c4-76f5-4fd1-819b-1f9e519a0ebd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:26.222826 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dfe187c4-76f5-4fd1-819b-1f9e519a0ebd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:26.249278 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dfe187c4-76f5-4fd1-819b-1f9e519a0ebd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1719 microversion: 2.1 time: 0.320332 Sep 17 20:56:26.261905 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 674/1389] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:25 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1719 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:26.266904 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3d0afe2f-35e1-48de-965a-8f15e3df58e4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a51078b0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:26.347948 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3d0afe2f-35e1-48de-965a-8f15e3df58e4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3" status: 200 len: 1413 microversion: 2.1 time: 0.084674 Sep 17 20:56:26.356637 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 675/1390] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:56:26 2022] GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3 => generated 1413 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:26.364636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-34f657a4-bbbc-4a1e-9436-e60bc85b91e3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:26.368360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-34f657a4-bbbc-4a1e-9436-e60bc85b91e3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:26.375165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34f657a4-bbbc-4a1e-9436-e60bc85b91e3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:26.375930 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34f657a4-bbbc-4a1e-9436-e60bc85b91e3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:26.376718 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34f657a4-bbbc-4a1e-9436-e60bc85b91e3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:26.377655 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34f657a4-bbbc-4a1e-9436-e60bc85b91e3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:26.378371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34f657a4-bbbc-4a1e-9436-e60bc85b91e3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:26.390751 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34f657a4-bbbc-4a1e-9436-e60bc85b91e3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:26.463932 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bbffe54a-072a-47ce-a812-c412c282b7a9 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d/action" status: 202 len: 0 microversion: 2.25 time: 3.584288 Sep 17 20:56:26.464965 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 716/1391] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Sep 17 20:56:22 2022] POST /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d/action => generated 0 bytes in 3586 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:56:26.470113 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-557e1a9a-6252-45f1-b6aa-88db404210d4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:26.470744 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-557e1a9a-6252-45f1-b6aa-88db404210d4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:26.489343 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-557e1a9a-6252-45f1-b6aa-88db404210d4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:26.489872 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-557e1a9a-6252-45f1-b6aa-88db404210d4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:26.490312 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-557e1a9a-6252-45f1-b6aa-88db404210d4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:26.502518 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-557e1a9a-6252-45f1-b6aa-88db404210d4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:26.503647 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-557e1a9a-6252-45f1-b6aa-88db404210d4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:26.504337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-557e1a9a-6252-45f1-b6aa-88db404210d4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:26.830116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-34f657a4-bbbc-4a1e-9436-e60bc85b91e3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:26.844791 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-34f657a4-bbbc-4a1e-9436-e60bc85b91e3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:26.854928 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-34f657a4-bbbc-4a1e-9436-e60bc85b91e3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:26.856245 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-34f657a4-bbbc-4a1e-9436-e60bc85b91e3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1880 microversion: 2.32 time: 0.497809 Sep 17 20:56:26.857181 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 676/1392] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:26 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1880 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:26.861822 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cac039ab-353d-4070-9309-765f08a43829 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:26.862491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cac039ab-353d-4070-9309-765f08a43829 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: fe75e57c-282a-4bac-b0a2-1c52dd110c84] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:26.881087 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cac039ab-353d-4070-9309-765f08a43829 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:26.884964 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cac039ab-353d-4070-9309-765f08a43829 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:26.885497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cac039ab-353d-4070-9309-765f08a43829 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:26.886294 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cac039ab-353d-4070-9309-765f08a43829 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:26.886773 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cac039ab-353d-4070-9309-765f08a43829 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:26.887214 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cac039ab-353d-4070-9309-765f08a43829 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:26.900939 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-557e1a9a-6252-45f1-b6aa-88db404210d4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:26.913721 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-557e1a9a-6252-45f1-b6aa-88db404210d4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1313 microversion: 2.1 time: 0.444015 Sep 17 20:56:26.931816 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 717/1393] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:26 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1313 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:26.945600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ff43ec0d-a6ac-4a5f-967a-bdd74e4222ab tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:26.946479 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ff43ec0d-a6ac-4a5f-967a-bdd74e4222ab tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:26.955552 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff43ec0d-a6ac-4a5f-967a-bdd74e4222ab tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:26.956513 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff43ec0d-a6ac-4a5f-967a-bdd74e4222ab tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:26.957172 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff43ec0d-a6ac-4a5f-967a-bdd74e4222ab tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:26.958189 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff43ec0d-a6ac-4a5f-967a-bdd74e4222ab tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:26.959078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff43ec0d-a6ac-4a5f-967a-bdd74e4222ab tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:26.959589 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff43ec0d-a6ac-4a5f-967a-bdd74e4222ab tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:27.164568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cac039ab-353d-4070-9309-765f08a43829 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:27.178625 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cac039ab-353d-4070-9309-765f08a43829 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84" status: 200 len: 1322 microversion: 2.1 time: 0.317755 Sep 17 20:56:27.180579 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 677/1394] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:26 2022] GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84 => generated 1322 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:27.186012 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a1835fb0-cfc5-41e8-9f00-98681d7f8921 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:27.186995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a1835fb0-cfc5-41e8-9f00-98681d7f8921 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:27.195453 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1835fb0-cfc5-41e8-9f00-98681d7f8921 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:27.196452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1835fb0-cfc5-41e8-9f00-98681d7f8921 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:27.197232 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1835fb0-cfc5-41e8-9f00-98681d7f8921 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:27.198251 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1835fb0-cfc5-41e8-9f00-98681d7f8921 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:27.198906 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1835fb0-cfc5-41e8-9f00-98681d7f8921 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:27.199697 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1835fb0-cfc5-41e8-9f00-98681d7f8921 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:27.204107 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ff43ec0d-a6ac-4a5f-967a-bdd74e4222ab tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:27.212473 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ff43ec0d-a6ac-4a5f-967a-bdd74e4222ab tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1522 microversion: 2.1 time: 0.279065 Sep 17 20:56:27.233349 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 718/1395] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:26 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:27.239613 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-17717b03-caea-4812-9195-097697b0e002 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:27.240541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-17717b03-caea-4812-9195-097697b0e002 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:27.247291 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17717b03-caea-4812-9195-097697b0e002 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:27.248877 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17717b03-caea-4812-9195-097697b0e002 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:27.249541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17717b03-caea-4812-9195-097697b0e002 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:27.250436 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17717b03-caea-4812-9195-097697b0e002 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:27.265127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17717b03-caea-4812-9195-097697b0e002 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:27.265631 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17717b03-caea-4812-9195-097697b0e002 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:27.450206 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a1835fb0-cfc5-41e8-9f00-98681d7f8921 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:27.459208 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a1835fb0-cfc5-41e8-9f00-98681d7f8921 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:27.464145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a1835fb0-cfc5-41e8-9f00-98681d7f8921 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:27.471281 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a1835fb0-cfc5-41e8-9f00-98681d7f8921 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1487 microversion: 2.25 time: 0.289203 Sep 17 20:56:27.472197 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 678/1396] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:27 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1487 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:27.477220 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1c4ae8ef-88f8-4f98-afc5-c13fb4647bd7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:27.482384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1c4ae8ef-88f8-4f98-afc5-c13fb4647bd7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:27.491861 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c4ae8ef-88f8-4f98-afc5-c13fb4647bd7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:27.492609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c4ae8ef-88f8-4f98-afc5-c13fb4647bd7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:27.495809 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c4ae8ef-88f8-4f98-afc5-c13fb4647bd7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:27.499748 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c4ae8ef-88f8-4f98-afc5-c13fb4647bd7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:27.500684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c4ae8ef-88f8-4f98-afc5-c13fb4647bd7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:27.501380 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c4ae8ef-88f8-4f98-afc5-c13fb4647bd7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:27.519296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-17717b03-caea-4812-9195-097697b0e002 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:27.531643 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-17717b03-caea-4812-9195-097697b0e002 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518" status: 200 len: 1319 microversion: 2.1 time: 0.296778 Sep 17 20:56:27.546486 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 719/1397] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:27 2022] GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 => generated 1319 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:27.559561 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-43cd5b25-9e11-471d-b368-e84b0133ef05 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a5796ca0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:27.665117 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-43cd5b25-9e11-471d-b368-e84b0133ef05 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3" status: 200 len: 1413 microversion: 2.1 time: 0.116631 Sep 17 20:56:27.675228 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 720/1398] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:56:27 2022] GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3 => generated 1413 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:27.752845 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1c4ae8ef-88f8-4f98-afc5-c13fb4647bd7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:27.761601 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1c4ae8ef-88f8-4f98-afc5-c13fb4647bd7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1719 microversion: 2.1 time: 0.288170 Sep 17 20:56:27.762811 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 679/1399] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:27 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1719 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:27.859852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-b9fec67f-f702-4658-988a-6c41bfe1b6e4 req-785f5377-b893-485e-805c-88ecdf3543b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46d60c84-b2e2-4376-a0ca-f0bee938fd9a", "tag": "94958f55-6b3e-41f2-a7f1-6dd835192bd3"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:27.885723 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b9fec67f-f702-4658-988a-6c41bfe1b6e4 req-785f5377-b893-485e-805c-88ecdf3543b6 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:27.887661 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b9fec67f-f702-4658-988a-6c41bfe1b6e4 req-785f5377-b893-485e-805c-88ecdf3543b6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:27.888210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2ff1c3ba-e83e-4e8d-b443-0c120ddd5113 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:27.888894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2ff1c3ba-e83e-4e8d-b443-0c120ddd5113 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:27.889275 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b9fec67f-f702-4658-988a-6c41bfe1b6e4 req-785f5377-b893-485e-805c-88ecdf3543b6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:27.899294 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ff1c3ba-e83e-4e8d-b443-0c120ddd5113 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:27.899798 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ff1c3ba-e83e-4e8d-b443-0c120ddd5113 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:27.900249 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ff1c3ba-e83e-4e8d-b443-0c120ddd5113 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:27.900968 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ff1c3ba-e83e-4e8d-b443-0c120ddd5113 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:27.901426 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ff1c3ba-e83e-4e8d-b443-0c120ddd5113 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:27.901884 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ff1c3ba-e83e-4e8d-b443-0c120ddd5113 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:27.915826 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-b9fec67f-f702-4658-988a-6c41bfe1b6e4 req-785f5377-b893-485e-805c-88ecdf3543b6 service nova] Creating event network-changed:94958f55-6b3e-41f2-a7f1-6dd835192bd3 for instance 46d60c84-b2e2-4376-a0ca-f0bee938fd9a on nch1-master-1 Sep 17 20:56:27.928344 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-b9fec67f-f702-4658-988a-6c41bfe1b6e4 req-785f5377-b893-485e-805c-88ecdf3543b6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074774 Sep 17 20:56:27.933839 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 721/1400] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:56:27.946481 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-115043fd-6161-4ff1-b4e5-6ef09de7a6ef tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:27.947786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-115043fd-6161-4ff1-b4e5-6ef09de7a6ef tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:27.959252 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-115043fd-6161-4ff1-b4e5-6ef09de7a6ef tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:27.962325 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-115043fd-6161-4ff1-b4e5-6ef09de7a6ef tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:27.966253 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-115043fd-6161-4ff1-b4e5-6ef09de7a6ef tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:27.968114 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-115043fd-6161-4ff1-b4e5-6ef09de7a6ef tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:27.970661 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-115043fd-6161-4ff1-b4e5-6ef09de7a6ef tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:27.971439 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-115043fd-6161-4ff1-b4e5-6ef09de7a6ef tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:27.978708 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:28.258273 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-115043fd-6161-4ff1-b4e5-6ef09de7a6ef tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:28.272563 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-115043fd-6161-4ff1-b4e5-6ef09de7a6ef tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1313 microversion: 2.1 time: 0.326375 Sep 17 20:56:28.273890 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 722/1401] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:27 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:28.285240 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fef947bd-a2c5-4727-b96b-38ca426f42e7 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:28.286267 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fef947bd-a2c5-4727-b96b-38ca426f42e7 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: fe75e57c-282a-4bac-b0a2-1c52dd110c84] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:28.299396 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fef947bd-a2c5-4727-b96b-38ca426f42e7 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:28.300381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fef947bd-a2c5-4727-b96b-38ca426f42e7 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:28.301809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fef947bd-a2c5-4727-b96b-38ca426f42e7 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:28.305199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fef947bd-a2c5-4727-b96b-38ca426f42e7 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:28.305980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fef947bd-a2c5-4727-b96b-38ca426f42e7 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:28.307313 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fef947bd-a2c5-4727-b96b-38ca426f42e7 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:28.340680 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2ff1c3ba-e83e-4e8d-b443-0c120ddd5113 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:28.353159 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2ff1c3ba-e83e-4e8d-b443-0c120ddd5113 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:28.358491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2ff1c3ba-e83e-4e8d-b443-0c120ddd5113 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:28.365311 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2ff1c3ba-e83e-4e8d-b443-0c120ddd5113 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1880 microversion: 2.32 time: 0.480355 Sep 17 20:56:28.368242 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 680/1402] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:27 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1880 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 20:56:28.374089 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-265e5e83-32a3-4f84-82c4-b64c055ec6a5 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:28.390485 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-265e5e83-32a3-4f84-82c4-b64c055ec6a5 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:28.397446 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-265e5e83-32a3-4f84-82c4-b64c055ec6a5 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:28.398350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-265e5e83-32a3-4f84-82c4-b64c055ec6a5 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:28.398955 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-265e5e83-32a3-4f84-82c4-b64c055ec6a5 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:28.399881 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-265e5e83-32a3-4f84-82c4-b64c055ec6a5 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:28.400567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-265e5e83-32a3-4f84-82c4-b64c055ec6a5 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:28.401164 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-265e5e83-32a3-4f84-82c4-b64c055ec6a5 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:28.550770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fef947bd-a2c5-4727-b96b-38ca426f42e7 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:28.564311 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fef947bd-a2c5-4727-b96b-38ca426f42e7 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84" status: 200 len: 1322 microversion: 2.1 time: 0.288887 Sep 17 20:56:28.566617 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 723/1403] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:28 2022] GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84 => generated 1322 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:28.578396 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ecd5694f-2d2d-4405-9478-5f767425261d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:28.580269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ecd5694f-2d2d-4405-9478-5f767425261d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:28.595863 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ecd5694f-2d2d-4405-9478-5f767425261d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:28.597592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ecd5694f-2d2d-4405-9478-5f767425261d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:28.598917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ecd5694f-2d2d-4405-9478-5f767425261d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:28.601112 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ecd5694f-2d2d-4405-9478-5f767425261d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:28.602675 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ecd5694f-2d2d-4405-9478-5f767425261d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:28.604440 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ecd5694f-2d2d-4405-9478-5f767425261d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:28.684973 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-265e5e83-32a3-4f84-82c4-b64c055ec6a5 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:28.696171 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-265e5e83-32a3-4f84-82c4-b64c055ec6a5 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1522 microversion: 2.1 time: 0.324751 Sep 17 20:56:28.698954 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 681/1404] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:28 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:28.710909 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-02680854-45cd-4d74-b0b7-6ebdcef7cff3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:28.711781 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-02680854-45cd-4d74-b0b7-6ebdcef7cff3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:28.723686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02680854-45cd-4d74-b0b7-6ebdcef7cff3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:28.729575 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02680854-45cd-4d74-b0b7-6ebdcef7cff3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:28.730911 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02680854-45cd-4d74-b0b7-6ebdcef7cff3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:28.733357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02680854-45cd-4d74-b0b7-6ebdcef7cff3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:28.734070 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02680854-45cd-4d74-b0b7-6ebdcef7cff3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:28.735796 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02680854-45cd-4d74-b0b7-6ebdcef7cff3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:28.874047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ecd5694f-2d2d-4405-9478-5f767425261d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:28.890720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ecd5694f-2d2d-4405-9478-5f767425261d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:28.894767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ecd5694f-2d2d-4405-9478-5f767425261d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:28.898023 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ecd5694f-2d2d-4405-9478-5f767425261d tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1487 microversion: 2.25 time: 0.327369 Sep 17 20:56:28.902144 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 724/1405] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:28 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1487 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:28.912628 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c505df45-2a59-4b8d-9a9c-bbffdc1d5e84 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a9fa5ca0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:28.984545 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c505df45-2a59-4b8d-9a9c-bbffdc1d5e84 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3" status: 200 len: 1413 microversion: 2.1 time: 0.080742 Sep 17 20:56:28.992681 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-02680854-45cd-4d74-b0b7-6ebdcef7cff3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:28.999913 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 725/1406] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:56:28 2022] GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3 => generated 1413 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:29.003512 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-02680854-45cd-4d74-b0b7-6ebdcef7cff3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518" status: 200 len: 1319 microversion: 2.1 time: 0.302923 Sep 17 20:56:29.004595 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 682/1407] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:28 2022] GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:29.022131 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3e5aacb8-3125-4f99-a3e7-eb1ab45b47b8 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:29.026274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3e5aacb8-3125-4f99-a3e7-eb1ab45b47b8 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:29.034094 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e5aacb8-3125-4f99-a3e7-eb1ab45b47b8 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:29.034917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e5aacb8-3125-4f99-a3e7-eb1ab45b47b8 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:29.035607 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e5aacb8-3125-4f99-a3e7-eb1ab45b47b8 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:29.036543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e5aacb8-3125-4f99-a3e7-eb1ab45b47b8 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:29.037216 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e5aacb8-3125-4f99-a3e7-eb1ab45b47b8 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:29.038102 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e5aacb8-3125-4f99-a3e7-eb1ab45b47b8 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:29.214642 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3e5aacb8-3125-4f99-a3e7-eb1ab45b47b8 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:29.224775 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3e5aacb8-3125-4f99-a3e7-eb1ab45b47b8 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1719 microversion: 2.1 time: 0.222311 Sep 17 20:56:29.225933 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 726/1408] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:28 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1719 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:29.297081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bef1ed7f-e6f7-42ff-9ba4-12fa6ec9d35a tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:29.297994 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bef1ed7f-e6f7-42ff-9ba4-12fa6ec9d35a tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:29.308309 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bef1ed7f-e6f7-42ff-9ba4-12fa6ec9d35a tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:29.309615 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bef1ed7f-e6f7-42ff-9ba4-12fa6ec9d35a tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:29.311655 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bef1ed7f-e6f7-42ff-9ba4-12fa6ec9d35a tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:29.312855 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bef1ed7f-e6f7-42ff-9ba4-12fa6ec9d35a tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:29.314205 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bef1ed7f-e6f7-42ff-9ba4-12fa6ec9d35a tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:29.314886 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bef1ed7f-e6f7-42ff-9ba4-12fa6ec9d35a tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:29.400030 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ac9a29ca-1acd-4e64-86fc-a1cfa68c18cf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:29.401819 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ac9a29ca-1acd-4e64-86fc-a1cfa68c18cf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:29.418319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac9a29ca-1acd-4e64-86fc-a1cfa68c18cf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:29.427105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac9a29ca-1acd-4e64-86fc-a1cfa68c18cf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:29.429029 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac9a29ca-1acd-4e64-86fc-a1cfa68c18cf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:29.431513 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac9a29ca-1acd-4e64-86fc-a1cfa68c18cf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:29.437373 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac9a29ca-1acd-4e64-86fc-a1cfa68c18cf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:29.437373 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac9a29ca-1acd-4e64-86fc-a1cfa68c18cf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:29.557654 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bef1ed7f-e6f7-42ff-9ba4-12fa6ec9d35a tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:29.566933 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bef1ed7f-e6f7-42ff-9ba4-12fa6ec9d35a tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1313 microversion: 2.1 time: 0.274499 Sep 17 20:56:29.574174 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 683/1409] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:29 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:29.597324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a0447972-1b08-4afe-86f3-92b8ca5ed3e9 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:29.600295 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a0447972-1b08-4afe-86f3-92b8ca5ed3e9 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: fe75e57c-282a-4bac-b0a2-1c52dd110c84] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:29.615091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0447972-1b08-4afe-86f3-92b8ca5ed3e9 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:29.621112 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0447972-1b08-4afe-86f3-92b8ca5ed3e9 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:29.624324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0447972-1b08-4afe-86f3-92b8ca5ed3e9 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:29.625349 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0447972-1b08-4afe-86f3-92b8ca5ed3e9 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:29.630307 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0447972-1b08-4afe-86f3-92b8ca5ed3e9 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:29.632017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0447972-1b08-4afe-86f3-92b8ca5ed3e9 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:29.842757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ac9a29ca-1acd-4e64-86fc-a1cfa68c18cf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:29.859481 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ac9a29ca-1acd-4e64-86fc-a1cfa68c18cf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:29.861359 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ac9a29ca-1acd-4e64-86fc-a1cfa68c18cf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:29.866295 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ac9a29ca-1acd-4e64-86fc-a1cfa68c18cf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1880 microversion: 2.32 time: 0.470461 Sep 17 20:56:29.866885 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 727/1410] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:29 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1880 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 20:56:29.880092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-08b8a5e2-c89b-4905-9355-949be92f9766 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:29.880729 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-08b8a5e2-c89b-4905-9355-949be92f9766 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:29.897666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-08b8a5e2-c89b-4905-9355-949be92f9766 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:29.898284 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-08b8a5e2-c89b-4905-9355-949be92f9766 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:29.904198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-08b8a5e2-c89b-4905-9355-949be92f9766 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:29.909929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-08b8a5e2-c89b-4905-9355-949be92f9766 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:29.910577 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-08b8a5e2-c89b-4905-9355-949be92f9766 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:29.911470 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-08b8a5e2-c89b-4905-9355-949be92f9766 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:29.961452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a0447972-1b08-4afe-86f3-92b8ca5ed3e9 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:29.974847 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a0447972-1b08-4afe-86f3-92b8ca5ed3e9 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84" status: 200 len: 1322 microversion: 2.1 time: 0.389243 Sep 17 20:56:29.979445 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 684/1411] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:29 2022] GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84 => generated 1322 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:29.988110 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-428fe30b-5b25-498f-bd41-10b140f5bc9e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:29.992010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-428fe30b-5b25-498f-bd41-10b140f5bc9e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:30.006368 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:30.016051 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-428fe30b-5b25-498f-bd41-10b140f5bc9e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:30.016577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-428fe30b-5b25-498f-bd41-10b140f5bc9e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:30.017033 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-428fe30b-5b25-498f-bd41-10b140f5bc9e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:30.017846 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-428fe30b-5b25-498f-bd41-10b140f5bc9e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:30.022263 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-428fe30b-5b25-498f-bd41-10b140f5bc9e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:30.022721 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-428fe30b-5b25-498f-bd41-10b140f5bc9e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:30.274390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-08b8a5e2-c89b-4905-9355-949be92f9766 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:30.289096 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-08b8a5e2-c89b-4905-9355-949be92f9766 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1522 microversion: 2.1 time: 0.413908 Sep 17 20:56:30.298780 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 728/1412] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:29 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1522 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:30.307821 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f7702e83-f68b-4653-b848-8886be32a72d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a9fa5160>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:30.440307 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f7702e83-f68b-4653-b848-8886be32a72d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3" status: 200 len: 1413 microversion: 2.1 time: 0.142434 Sep 17 20:56:30.456181 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 729/1413] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:56:30 2022] GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3 => generated 1413 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:30.469235 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8826ea00-ae22-420e-91be-0e65ac2961c3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:30.469937 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8826ea00-ae22-420e-91be-0e65ac2961c3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:30.486586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8826ea00-ae22-420e-91be-0e65ac2961c3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:30.487155 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8826ea00-ae22-420e-91be-0e65ac2961c3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:30.487677 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8826ea00-ae22-420e-91be-0e65ac2961c3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:30.488490 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8826ea00-ae22-420e-91be-0e65ac2961c3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:30.488966 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8826ea00-ae22-420e-91be-0e65ac2961c3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:30.493172 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8826ea00-ae22-420e-91be-0e65ac2961c3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:30.619753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=4 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:30.690449 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-428fe30b-5b25-498f-bd41-10b140f5bc9e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:30.736561 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-428fe30b-5b25-498f-bd41-10b140f5bc9e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:30.743599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-428fe30b-5b25-498f-bd41-10b140f5bc9e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:30.747527 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-428fe30b-5b25-498f-bd41-10b140f5bc9e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1487 microversion: 2.25 time: 0.766734 Sep 17 20:56:30.752621 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 685/1414] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:29 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1487 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:30.764524 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c3bc0501-5717-40bf-943f-bf450a6c60c6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:30.766090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c3bc0501-5717-40bf-943f-bf450a6c60c6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:30.795112 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=12 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:30.809159 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3bc0501-5717-40bf-943f-bf450a6c60c6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:30.821140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8826ea00-ae22-420e-91be-0e65ac2961c3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:30.828653 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3bc0501-5717-40bf-943f-bf450a6c60c6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:30.831236 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3bc0501-5717-40bf-943f-bf450a6c60c6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:30.832126 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8826ea00-ae22-420e-91be-0e65ac2961c3 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518" status: 200 len: 1319 microversion: 2.1 time: 0.374014 Sep 17 20:56:30.832722 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 730/1415] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:30 2022] GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 => generated 1319 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:30.835218 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3bc0501-5717-40bf-943f-bf450a6c60c6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:30.838149 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7989ef3e-aa1d-4761-a749-01eab4c664d1 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:30.838672 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3bc0501-5717-40bf-943f-bf450a6c60c6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:30.838821 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7989ef3e-aa1d-4761-a749-01eab4c664d1 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:30.841132 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3bc0501-5717-40bf-943f-bf450a6c60c6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:30.845166 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7989ef3e-aa1d-4761-a749-01eab4c664d1 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:30.845859 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7989ef3e-aa1d-4761-a749-01eab4c664d1 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:30.846187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7989ef3e-aa1d-4761-a749-01eab4c664d1 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:30.847121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7989ef3e-aa1d-4761-a749-01eab4c664d1 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:30.847734 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7989ef3e-aa1d-4761-a749-01eab4c664d1 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:30.848513 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7989ef3e-aa1d-4761-a749-01eab4c664d1 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:31.217449 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7989ef3e-aa1d-4761-a749-01eab4c664d1 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:31.229741 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7989ef3e-aa1d-4761-a749-01eab4c664d1 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1334 microversion: 2.1 time: 0.393729 Sep 17 20:56:31.233006 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 731/1416] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:30 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1334 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:31.246190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e90c79ee-1252-4e20-9e58-1c6d681fb9c7 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:31.250238 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e90c79ee-1252-4e20-9e58-1c6d681fb9c7 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:31.267704 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e90c79ee-1252-4e20-9e58-1c6d681fb9c7 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:31.270685 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e90c79ee-1252-4e20-9e58-1c6d681fb9c7 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:31.271494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e90c79ee-1252-4e20-9e58-1c6d681fb9c7 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:31.272436 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e90c79ee-1252-4e20-9e58-1c6d681fb9c7 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:31.274537 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e90c79ee-1252-4e20-9e58-1c6d681fb9c7 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:31.277929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e90c79ee-1252-4e20-9e58-1c6d681fb9c7 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:31.479688 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c3bc0501-5717-40bf-943f-bf450a6c60c6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:31.497665 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c3bc0501-5717-40bf-943f-bf450a6c60c6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1719 microversion: 2.1 time: 0.742294 Sep 17 20:56:31.501764 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 686/1417] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:30 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1719 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:31.513384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-04bee70c-1b9c-447d-a1e0-7da415a1d892 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:31.517087 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-04bee70c-1b9c-447d-a1e0-7da415a1d892 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: fe75e57c-282a-4bac-b0a2-1c52dd110c84] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:31.533852 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04bee70c-1b9c-447d-a1e0-7da415a1d892 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:31.534673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04bee70c-1b9c-447d-a1e0-7da415a1d892 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:31.535321 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04bee70c-1b9c-447d-a1e0-7da415a1d892 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:31.536258 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04bee70c-1b9c-447d-a1e0-7da415a1d892 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:31.536717 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04bee70c-1b9c-447d-a1e0-7da415a1d892 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:31.545565 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04bee70c-1b9c-447d-a1e0-7da415a1d892 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:31.744819 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e90c79ee-1252-4e20-9e58-1c6d681fb9c7 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:31.760145 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e90c79ee-1252-4e20-9e58-1c6d681fb9c7 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:31.761636 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e90c79ee-1252-4e20-9e58-1c6d681fb9c7 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:31.771001 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e90c79ee-1252-4e20-9e58-1c6d681fb9c7 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1880 microversion: 2.32 time: 0.536162 Sep 17 20:56:31.771615 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 732/1418] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:31 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1880 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:31.786020 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-1d50dce7-d3b1-4826-b081-294be5a9d6a5 req-a8037cde-0339-431d-bf2b-e4c00fc10625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b13c98-aea4-497c-a213-142393b2758c", "name": "network-vif-plugged", "status": "completed", "tag": "7c3cbfdf-d88c-428e-969f-2451f881cc2b"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:31.790280 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-04bee70c-1b9c-447d-a1e0-7da415a1d892 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:31.800434 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-04bee70c-1b9c-447d-a1e0-7da415a1d892 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84" status: 200 len: 1322 microversion: 2.1 time: 0.297219 Sep 17 20:56:31.801696 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 687/1419] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:31 2022] GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84 => generated 1322 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:31.807313 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1ca761cf-8480-49a4-b6c3-f3ee1b4f8462 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:31.808251 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-1d50dce7-d3b1-4826-b081-294be5a9d6a5 req-a8037cde-0339-431d-bf2b-e4c00fc10625 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:31.808754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-1d50dce7-d3b1-4826-b081-294be5a9d6a5 req-a8037cde-0339-431d-bf2b-e4c00fc10625 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:31.809046 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1ca761cf-8480-49a4-b6c3-f3ee1b4f8462 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:31.809182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-1d50dce7-d3b1-4826-b081-294be5a9d6a5 req-a8037cde-0339-431d-bf2b-e4c00fc10625 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:31.815898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ca761cf-8480-49a4-b6c3-f3ee1b4f8462 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:31.816664 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ca761cf-8480-49a4-b6c3-f3ee1b4f8462 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:31.817607 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ca761cf-8480-49a4-b6c3-f3ee1b4f8462 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:31.818851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ca761cf-8480-49a4-b6c3-f3ee1b4f8462 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:31.820041 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ca761cf-8480-49a4-b6c3-f3ee1b4f8462 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:31.820709 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ca761cf-8480-49a4-b6c3-f3ee1b4f8462 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:31.844182 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-1d50dce7-d3b1-4826-b081-294be5a9d6a5 req-a8037cde-0339-431d-bf2b-e4c00fc10625 service nova] Creating event network-vif-plugged:7c3cbfdf-d88c-428e-969f-2451f881cc2b for instance 22b13c98-aea4-497c-a213-142393b2758c on nch2-master-1 Sep 17 20:56:31.852912 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-1d50dce7-d3b1-4826-b081-294be5a9d6a5 req-a8037cde-0339-431d-bf2b-e4c00fc10625 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079959 Sep 17 20:56:31.861099 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 733/1420] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:56:31.871254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-6d3e555f-c4ac-4bab-8cc1-e471b987a5d9 req-0c76ebe9-7de3-4762-b825-99759e88e6b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518", "tag": "49c488cd-8158-4484-962f-4bfa74f75c62"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:31.899194 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=10 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:31.916419 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6d3e555f-c4ac-4bab-8cc1-e471b987a5d9 req-0c76ebe9-7de3-4762-b825-99759e88e6b8 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:31.916997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6d3e555f-c4ac-4bab-8cc1-e471b987a5d9 req-0c76ebe9-7de3-4762-b825-99759e88e6b8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:31.917532 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6d3e555f-c4ac-4bab-8cc1-e471b987a5d9 req-0c76ebe9-7de3-4762-b825-99759e88e6b8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:31.951238 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-6d3e555f-c4ac-4bab-8cc1-e471b987a5d9 req-0c76ebe9-7de3-4762-b825-99759e88e6b8 service nova] Creating event network-changed:49c488cd-8158-4484-962f-4bfa74f75c62 for instance f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 on nch1-master-1 Sep 17 20:56:31.972406 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-6d3e555f-c4ac-4bab-8cc1-e471b987a5d9 req-0c76ebe9-7de3-4762-b825-99759e88e6b8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109388 Sep 17 20:56:31.975317 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 734/1421] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:56:31.988215 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-03b30676-e80b-4a95-a37a-a264e99179e3 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a53b80d0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:32.070244 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-03b30676-e80b-4a95-a37a-a264e99179e3 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3" status: 200 len: 1413 microversion: 2.1 time: 0.093308 Sep 17 20:56:32.072109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1ca761cf-8480-49a4-b6c3-f3ee1b4f8462 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:32.075555 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 735/1422] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:56:31 2022] GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3 => generated 1413 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:32.076350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:32.087248 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ea42eee4-d791-46b6-8780-cb24aa936884 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:32.088007 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ea42eee4-d791-46b6-8780-cb24aa936884 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:32.090625 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1ca761cf-8480-49a4-b6c3-f3ee1b4f8462 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1522 microversion: 2.1 time: 0.287212 Sep 17 20:56:32.100972 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea42eee4-d791-46b6-8780-cb24aa936884 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:32.101507 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea42eee4-d791-46b6-8780-cb24aa936884 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:32.105494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea42eee4-d791-46b6-8780-cb24aa936884 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:32.107037 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea42eee4-d791-46b6-8780-cb24aa936884 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:32.110968 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea42eee4-d791-46b6-8780-cb24aa936884 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:32.110968 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea42eee4-d791-46b6-8780-cb24aa936884 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:32.115574 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 688/1423] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:31 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:32.124661 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-24d19d80-232d-4060-a58c-e75e94c431a0 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:32.125538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-24d19d80-232d-4060-a58c-e75e94c431a0 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:32.135177 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-24d19d80-232d-4060-a58c-e75e94c431a0 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:32.136053 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-24d19d80-232d-4060-a58c-e75e94c431a0 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:32.141874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-24d19d80-232d-4060-a58c-e75e94c431a0 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:32.145117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-24d19d80-232d-4060-a58c-e75e94c431a0 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:32.147126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-24d19d80-232d-4060-a58c-e75e94c431a0 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:32.147865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-24d19d80-232d-4060-a58c-e75e94c431a0 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:32.394538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-24d19d80-232d-4060-a58c-e75e94c431a0 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:32.406341 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-24d19d80-232d-4060-a58c-e75e94c431a0 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518" status: 200 len: 1319 microversion: 2.1 time: 0.289249 Sep 17 20:56:32.421498 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 689/1424] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:32 2022] GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:32.425995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6a7f6214-a1f0-471e-89bd-365d5afd0d9f tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:32.425995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6a7f6214-a1f0-471e-89bd-365d5afd0d9f tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:32.427061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ea42eee4-d791-46b6-8780-cb24aa936884 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:32.433262 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a7f6214-a1f0-471e-89bd-365d5afd0d9f tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:32.434154 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a7f6214-a1f0-471e-89bd-365d5afd0d9f tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:32.434614 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a7f6214-a1f0-471e-89bd-365d5afd0d9f tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:32.435476 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a7f6214-a1f0-471e-89bd-365d5afd0d9f tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:32.435934 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a7f6214-a1f0-471e-89bd-365d5afd0d9f tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:32.436365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a7f6214-a1f0-471e-89bd-365d5afd0d9f tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:32.440919 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ea42eee4-d791-46b6-8780-cb24aa936884 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:32.445290 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ea42eee4-d791-46b6-8780-cb24aa936884 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:32.446729 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ea42eee4-d791-46b6-8780-cb24aa936884 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1487 microversion: 2.25 time: 0.370161 Sep 17 20:56:32.462424 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 736/1425] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:32 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1487 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:32.528011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fe2c1142-27a7-4d0e-b447-98414a682b91 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:32.528639 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fe2c1142-27a7-4d0e-b447-98414a682b91 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:32.535659 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe2c1142-27a7-4d0e-b447-98414a682b91 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:32.536160 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe2c1142-27a7-4d0e-b447-98414a682b91 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:32.536751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe2c1142-27a7-4d0e-b447-98414a682b91 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:32.537495 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe2c1142-27a7-4d0e-b447-98414a682b91 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:32.538250 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe2c1142-27a7-4d0e-b447-98414a682b91 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:32.538728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe2c1142-27a7-4d0e-b447-98414a682b91 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:32.668167 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6a7f6214-a1f0-471e-89bd-365d5afd0d9f tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:32.677751 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6a7f6214-a1f0-471e-89bd-365d5afd0d9f tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1334 microversion: 2.1 time: 0.265264 Sep 17 20:56:32.678787 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 690/1426] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:32 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1334 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:32.753596 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fe2c1142-27a7-4d0e-b447-98414a682b91 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:32.767169 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fe2c1142-27a7-4d0e-b447-98414a682b91 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1719 microversion: 2.1 time: 0.244045 Sep 17 20:56:32.767902 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 737/1427] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:32 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1719 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:32.796567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2d4e7694-7bfe-46f1-b2bc-c6b8ac086066 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:32.797184 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2d4e7694-7bfe-46f1-b2bc-c6b8ac086066 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:32.803688 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d4e7694-7bfe-46f1-b2bc-c6b8ac086066 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:32.804184 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d4e7694-7bfe-46f1-b2bc-c6b8ac086066 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:32.804624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d4e7694-7bfe-46f1-b2bc-c6b8ac086066 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:32.805338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d4e7694-7bfe-46f1-b2bc-c6b8ac086066 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:32.805828 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d4e7694-7bfe-46f1-b2bc-c6b8ac086066 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:32.806254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d4e7694-7bfe-46f1-b2bc-c6b8ac086066 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:32.826042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-68760832-22a1-4d92-9e5c-9b1d53e735cd tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:32.826959 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-68760832-22a1-4d92-9e5c-9b1d53e735cd tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: fe75e57c-282a-4bac-b0a2-1c52dd110c84] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:32.830239 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=4 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:32.835690 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68760832-22a1-4d92-9e5c-9b1d53e735cd tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:32.836401 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68760832-22a1-4d92-9e5c-9b1d53e735cd tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:32.836841 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68760832-22a1-4d92-9e5c-9b1d53e735cd tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:32.837587 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68760832-22a1-4d92-9e5c-9b1d53e735cd tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:32.838050 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68760832-22a1-4d92-9e5c-9b1d53e735cd tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:32.838698 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68760832-22a1-4d92-9e5c-9b1d53e735cd tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:33.061007 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-68760832-22a1-4d92-9e5c-9b1d53e735cd tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:33.066628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2d4e7694-7bfe-46f1-b2bc-c6b8ac086066 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:33.069192 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-68760832-22a1-4d92-9e5c-9b1d53e735cd tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84" status: 200 len: 1322 microversion: 2.1 time: 0.247151 Sep 17 20:56:33.070033 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 738/1428] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:32 2022] GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84 => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:33.076199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2d4e7694-7bfe-46f1-b2bc-c6b8ac086066 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:33.077672 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2d4e7694-7bfe-46f1-b2bc-c6b8ac086066 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:33.078843 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2d4e7694-7bfe-46f1-b2bc-c6b8ac086066 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1880 microversion: 2.32 time: 0.286337 Sep 17 20:56:33.081138 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 691/1429] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:32 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1880 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 20:56:33.086379 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-98cc89cb-4dc4-4937-87c2-48df640a3c4d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a5c38040>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:33.120798 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-228dfb2e-3850-411a-918d-359f9b3505a4 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:33.121352 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-228dfb2e-3850-411a-918d-359f9b3505a4 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:33.128262 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-228dfb2e-3850-411a-918d-359f9b3505a4 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:33.128916 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-228dfb2e-3850-411a-918d-359f9b3505a4 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:33.129276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-228dfb2e-3850-411a-918d-359f9b3505a4 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:33.130016 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-228dfb2e-3850-411a-918d-359f9b3505a4 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:33.130468 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-228dfb2e-3850-411a-918d-359f9b3505a4 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:33.131104 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-228dfb2e-3850-411a-918d-359f9b3505a4 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:33.135825 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-98cc89cb-4dc4-4937-87c2-48df640a3c4d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3" status: 200 len: 1422 microversion: 2.1 time: 0.053080 Sep 17 20:56:33.136599 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 739/1430] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:56:33 2022] GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3 => generated 1422 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:33.150801 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-844e3757-7be6-4e4b-9633-7dd27ebb6d57 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a9fa5ca0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:33.202024 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-844e3757-7be6-4e4b-9633-7dd27ebb6d57 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3" status: 200 len: 1422 microversion: 2.1 time: 0.054795 Sep 17 20:56:33.202615 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 740/1431] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:56:33 2022] GET /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3 => generated 1422 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:33.219521 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c5789a3f-c91e-4b4d-b31c-b98bf1698afa tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25aa012790>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:33.272552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-228dfb2e-3850-411a-918d-359f9b3505a4 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:33.280455 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-228dfb2e-3850-411a-918d-359f9b3505a4 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1522 microversion: 2.1 time: 0.163985 Sep 17 20:56:33.284720 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 692/1432] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:33 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:33.434011 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-056830db-fb57-4fcf-bf1a-d810373b4b0c tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:33.434903 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-056830db-fb57-4fcf-bf1a-d810373b4b0c tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:33.441748 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-056830db-fb57-4fcf-bf1a-d810373b4b0c tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:33.442248 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-056830db-fb57-4fcf-bf1a-d810373b4b0c tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:33.442799 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-056830db-fb57-4fcf-bf1a-d810373b4b0c tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:33.443649 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-056830db-fb57-4fcf-bf1a-d810373b4b0c tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:33.444123 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-056830db-fb57-4fcf-bf1a-d810373b4b0c tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:33.444555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-056830db-fb57-4fcf-bf1a-d810373b4b0c tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:33.584316 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-056830db-fb57-4fcf-bf1a-d810373b4b0c tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:33.593014 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-056830db-fb57-4fcf-bf1a-d810373b4b0c tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518" status: 200 len: 1319 microversion: 2.1 time: 0.162910 Sep 17 20:56:33.597611 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 693/1433] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:33 2022] GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:33.599025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3f448d87-0ff8-4aea-80ac-90e58d26db6c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:33.599893 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3f448d87-0ff8-4aea-80ac-90e58d26db6c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:33.607542 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f448d87-0ff8-4aea-80ac-90e58d26db6c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:33.608204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f448d87-0ff8-4aea-80ac-90e58d26db6c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:33.608537 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f448d87-0ff8-4aea-80ac-90e58d26db6c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:33.609251 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f448d87-0ff8-4aea-80ac-90e58d26db6c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:33.609840 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f448d87-0ff8-4aea-80ac-90e58d26db6c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:33.610266 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f448d87-0ff8-4aea-80ac-90e58d26db6c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:33.797318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3f448d87-0ff8-4aea-80ac-90e58d26db6c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:33.807264 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3f448d87-0ff8-4aea-80ac-90e58d26db6c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:33.809538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3f448d87-0ff8-4aea-80ac-90e58d26db6c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:33.810748 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3f448d87-0ff8-4aea-80ac-90e58d26db6c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1487 microversion: 2.25 time: 0.215841 Sep 17 20:56:33.811311 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 694/1434] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:33 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1487 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:33.828072 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c2df7bc8-1375-4475-bfde-c1d3b664afb1 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:33.829566 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c2df7bc8-1375-4475-bfde-c1d3b664afb1 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:33.837935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c2df7bc8-1375-4475-bfde-c1d3b664afb1 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:33.838405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c2df7bc8-1375-4475-bfde-c1d3b664afb1 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:33.838937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c2df7bc8-1375-4475-bfde-c1d3b664afb1 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:33.839642 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c2df7bc8-1375-4475-bfde-c1d3b664afb1 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:33.840166 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c2df7bc8-1375-4475-bfde-c1d3b664afb1 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:33.840603 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c2df7bc8-1375-4475-bfde-c1d3b664afb1 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:33.848542 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c5789a3f-c91e-4b4d-b31c-b98bf1698afa tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "DELETE /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3" status: 204 len: 0 microversion: 2.1 time: 0.634185 Sep 17 20:56:33.849177 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 741/1435] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:33 2022] DELETE /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 17 20:56:33.857667 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0a29f64c-a589-4c6f-80cc-3a2e808507fe tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:33.857667 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0a29f64c-a589-4c6f-80cc-3a2e808507fe tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:33.870685 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a29f64c-a589-4c6f-80cc-3a2e808507fe tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:33.871490 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a29f64c-a589-4c6f-80cc-3a2e808507fe tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:33.872050 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a29f64c-a589-4c6f-80cc-3a2e808507fe tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:33.873010 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a29f64c-a589-4c6f-80cc-3a2e808507fe tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:33.873704 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a29f64c-a589-4c6f-80cc-3a2e808507fe tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:33.874240 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a29f64c-a589-4c6f-80cc-3a2e808507fe tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:34.057074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c2df7bc8-1375-4475-bfde-c1d3b664afb1 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:34.066047 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c2df7bc8-1375-4475-bfde-c1d3b664afb1 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1355 microversion: 2.1 time: 0.242658 Sep 17 20:56:34.075898 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 695/1436] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:33 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1355 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:34.075898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2064709e-c380-4e1e-8f72-f2a874eb82e7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:34.075898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2064709e-c380-4e1e-8f72-f2a874eb82e7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: d99ba94b-addd-4964-8d95-91de304a4988] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:34.078635 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2064709e-c380-4e1e-8f72-f2a874eb82e7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:34.079372 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2064709e-c380-4e1e-8f72-f2a874eb82e7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:34.080173 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2064709e-c380-4e1e-8f72-f2a874eb82e7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:34.081367 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2064709e-c380-4e1e-8f72-f2a874eb82e7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:34.082061 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2064709e-c380-4e1e-8f72-f2a874eb82e7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:34.082566 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2064709e-c380-4e1e-8f72-f2a874eb82e7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:34.092550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0a29f64c-a589-4c6f-80cc-3a2e808507fe tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:34.101134 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0a29f64c-a589-4c6f-80cc-3a2e808507fe tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1719 microversion: 2.1 time: 0.250547 Sep 17 20:56:34.107585 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 742/1437] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:33 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1719 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:34.107585 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-4ff36dcb-ddd5-45e4-b584-b5bdbf5d4298 req-e4daf28f-1d78-423c-b0e6-d397f7331a99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe75e57c-282a-4bac-b0a2-1c52dd110c84", "name": "network-vif-plugged", "status": "completed", "tag": "006c319b-8066-40f4-b844-ba9882602395"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:34.117512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4ff36dcb-ddd5-45e4-b584-b5bdbf5d4298 req-e4daf28f-1d78-423c-b0e6-d397f7331a99 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:34.118308 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4ff36dcb-ddd5-45e4-b584-b5bdbf5d4298 req-e4daf28f-1d78-423c-b0e6-d397f7331a99 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:34.118935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4ff36dcb-ddd5-45e4-b584-b5bdbf5d4298 req-e4daf28f-1d78-423c-b0e6-d397f7331a99 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:34.121083 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2064709e-c380-4e1e-8f72-f2a874eb82e7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: d99ba94b-addd-4964-8d95-91de304a4988] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:56:34.130431 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-4ff36dcb-ddd5-45e4-b584-b5bdbf5d4298 req-e4daf28f-1d78-423c-b0e6-d397f7331a99 service nova] Creating event network-vif-plugged:006c319b-8066-40f4-b844-ba9882602395 for instance fe75e57c-282a-4bac-b0a2-1c52dd110c84 on nch1-master-1 Sep 17 20:56:34.135437 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-4ff36dcb-ddd5-45e4-b584-b5bdbf5d4298 req-e4daf28f-1d78-423c-b0e6-d397f7331a99 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032089 Sep 17 20:56:34.136352 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 743/1438] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:56:34.142919 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-40a852ea-c5d7-4c95-bc14-759493486855 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:34.143721 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-40a852ea-c5d7-4c95-bc14-759493486855 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: fe75e57c-282a-4bac-b0a2-1c52dd110c84] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:34.151305 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-40a852ea-c5d7-4c95-bc14-759493486855 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:34.151951 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-40a852ea-c5d7-4c95-bc14-759493486855 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:34.152480 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-40a852ea-c5d7-4c95-bc14-759493486855 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:34.153260 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-40a852ea-c5d7-4c95-bc14-759493486855 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:34.153796 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-40a852ea-c5d7-4c95-bc14-759493486855 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:34.154282 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-40a852ea-c5d7-4c95-bc14-759493486855 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:34.223858 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2064709e-c380-4e1e-8f72-f2a874eb82e7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988" status: 204 len: 0 microversion: 2.1 time: 0.155403 Sep 17 20:56:34.224851 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 696/1439] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:56:34 2022] DELETE /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:56:34.246758 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9703714f-872f-4d65-9eda-dabccce2b9fb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:34.248174 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9703714f-872f-4d65-9eda-dabccce2b9fb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:34.263454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9703714f-872f-4d65-9eda-dabccce2b9fb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:34.263944 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9703714f-872f-4d65-9eda-dabccce2b9fb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:34.264390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9703714f-872f-4d65-9eda-dabccce2b9fb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:34.265380 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9703714f-872f-4d65-9eda-dabccce2b9fb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:34.268197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9703714f-872f-4d65-9eda-dabccce2b9fb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:34.268415 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9703714f-872f-4d65-9eda-dabccce2b9fb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:34.490134 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-40a852ea-c5d7-4c95-bc14-759493486855 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:34.499908 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-40a852ea-c5d7-4c95-bc14-759493486855 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84" status: 200 len: 1322 microversion: 2.1 time: 0.362075 Sep 17 20:56:34.501594 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 744/1440] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:34 2022] GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84 => generated 1322 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:34.507912 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2a968cff-37b9-4b29-8193-36cc14db149b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:34.508865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2a968cff-37b9-4b29-8193-36cc14db149b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:34.516932 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a968cff-37b9-4b29-8193-36cc14db149b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:34.517443 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a968cff-37b9-4b29-8193-36cc14db149b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:34.518371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a968cff-37b9-4b29-8193-36cc14db149b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:34.519174 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a968cff-37b9-4b29-8193-36cc14db149b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:34.520061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a968cff-37b9-4b29-8193-36cc14db149b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:34.520655 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a968cff-37b9-4b29-8193-36cc14db149b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:34.530599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9703714f-872f-4d65-9eda-dabccce2b9fb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:34.540058 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9703714f-872f-4d65-9eda-dabccce2b9fb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:34.541522 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9703714f-872f-4d65-9eda-dabccce2b9fb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:34.542698 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9703714f-872f-4d65-9eda-dabccce2b9fb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1880 microversion: 2.32 time: 0.315532 Sep 17 20:56:34.543462 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 697/1441] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:34 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1880 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:34.559402 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-35734434-6db8-4bb1-9bd7-ef6f33ca0a00 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1647442074", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "abd24085-3207-4975-a2e8-9c99f58fa2c7"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:34.624005 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-35734434-6db8-4bb1-9bd7-ef6f33ca0a00 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] validate_networks() for [('abd24085-3207-4975-a2e8-9c99f58fa2c7', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:56:34.742205 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2a968cff-37b9-4b29-8193-36cc14db149b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:34.753186 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2a968cff-37b9-4b29-8193-36cc14db149b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1522 microversion: 2.1 time: 0.250563 Sep 17 20:56:34.754287 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 745/1442] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:34 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:34.761093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0a6a31c6-37b6-4758-a4da-2eff9890c3cc tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:34.761977 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0a6a31c6-37b6-4758-a4da-2eff9890c3cc tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:34.775104 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a6a31c6-37b6-4758-a4da-2eff9890c3cc tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:34.775845 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a6a31c6-37b6-4758-a4da-2eff9890c3cc tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:34.776295 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a6a31c6-37b6-4758-a4da-2eff9890c3cc tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:34.777050 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a6a31c6-37b6-4758-a4da-2eff9890c3cc tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:34.777537 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a6a31c6-37b6-4758-a4da-2eff9890c3cc tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:34.777974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a6a31c6-37b6-4758-a4da-2eff9890c3cc tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:35.002768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0a6a31c6-37b6-4758-a4da-2eff9890c3cc tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:35.005251 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:35.012903 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0a6a31c6-37b6-4758-a4da-2eff9890c3cc tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518" status: 200 len: 1319 microversion: 2.1 time: 0.256941 Sep 17 20:56:35.013626 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 746/1443] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:34 2022] GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:35.018690 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-47f13def-8359-4e7f-9d65-2359981515fb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:35.019379 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-47f13def-8359-4e7f-9d65-2359981515fb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:35.026023 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-47f13def-8359-4e7f-9d65-2359981515fb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:35.026790 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-47f13def-8359-4e7f-9d65-2359981515fb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:35.027371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-47f13def-8359-4e7f-9d65-2359981515fb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:35.028360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-47f13def-8359-4e7f-9d65-2359981515fb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:35.028918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-47f13def-8359-4e7f-9d65-2359981515fb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:35.029417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-47f13def-8359-4e7f-9d65-2359981515fb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:35.196353 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-35734434-6db8-4bb1-9bd7-ef6f33ca0a00 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:56:35.197649 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-35734434-6db8-4bb1-9bd7-ef6f33ca0a00 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:56:35.198323 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-35734434-6db8-4bb1-9bd7-ef6f33ca0a00 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:56:35.199099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-35734434-6db8-4bb1-9bd7-ef6f33ca0a00 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:56:35.199768 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-35734434-6db8-4bb1-9bd7-ef6f33ca0a00 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:56:35.209261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35734434-6db8-4bb1-9bd7-ef6f33ca0a00 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:35.209801 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35734434-6db8-4bb1-9bd7-ef6f33ca0a00 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:35.210249 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35734434-6db8-4bb1-9bd7-ef6f33ca0a00 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:35.211116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35734434-6db8-4bb1-9bd7-ef6f33ca0a00 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:35.211575 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35734434-6db8-4bb1-9bd7-ef6f33ca0a00 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:35.212014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35734434-6db8-4bb1-9bd7-ef6f33ca0a00 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:35.223710 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-47f13def-8359-4e7f-9d65-2359981515fb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:35.231987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-35734434-6db8-4bb1-9bd7-ef6f33ca0a00 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Getting quotas for project 2a4117ca05454573bbd93fbca50431d2. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:56:35.233728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-47f13def-8359-4e7f-9d65-2359981515fb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:35.235476 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-47f13def-8359-4e7f-9d65-2359981515fb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:35.237259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-35734434-6db8-4bb1-9bd7-ef6f33ca0a00 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Getting quotas for user 6e33e0b756e14af28a90cc5c76d346e6 and project 2a4117ca05454573bbd93fbca50431d2. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:56:35.244575 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-47f13def-8359-4e7f-9d65-2359981515fb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1487 microversion: 2.25 time: 0.229533 Sep 17 20:56:35.257563 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 747/1444] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:35 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1487 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:35.257843 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-35734434-6db8-4bb1-9bd7-ef6f33ca0a00 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:56:35.257950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-633b1227-c9e8-4dce-8c56-e5a23ebb26e4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:35.258046 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-35734434-6db8-4bb1-9bd7-ef6f33ca0a00 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:56:35.258174 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-633b1227-c9e8-4dce-8c56-e5a23ebb26e4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:35.266341 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-633b1227-c9e8-4dce-8c56-e5a23ebb26e4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:35.266341 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-633b1227-c9e8-4dce-8c56-e5a23ebb26e4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:35.266341 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-633b1227-c9e8-4dce-8c56-e5a23ebb26e4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:35.266341 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-633b1227-c9e8-4dce-8c56-e5a23ebb26e4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:35.266341 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-633b1227-c9e8-4dce-8c56-e5a23ebb26e4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:35.266341 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-633b1227-c9e8-4dce-8c56-e5a23ebb26e4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:35.322666 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-35734434-6db8-4bb1-9bd7-ef6f33ca0a00 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.766215 Sep 17 20:56:35.331641 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 698/1445] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:56:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:56:35.335424 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-fccb8065-223e-4c0c-9952-4b8f269c1a56 req-f9ba4888-94a4-4a0b-bf35-4211680d4bdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f0fd2e6-7a40-44f0-9ab7-71ff4489741a", "tag": "b3992f00-9706-4260-982f-77dfde504678"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:35.345626 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-fccb8065-223e-4c0c-9952-4b8f269c1a56 req-f9ba4888-94a4-4a0b-bf35-4211680d4bdf service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:35.346155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-fccb8065-223e-4c0c-9952-4b8f269c1a56 req-f9ba4888-94a4-4a0b-bf35-4211680d4bdf service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:35.346595 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-fccb8065-223e-4c0c-9952-4b8f269c1a56 req-f9ba4888-94a4-4a0b-bf35-4211680d4bdf service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:35.358914 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-fccb8065-223e-4c0c-9952-4b8f269c1a56 req-f9ba4888-94a4-4a0b-bf35-4211680d4bdf service nova] Creating event network-changed:b3992f00-9706-4260-982f-77dfde504678 for instance 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a on nch1-master-1 Sep 17 20:56:35.363738 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-fccb8065-223e-4c0c-9952-4b8f269c1a56 req-f9ba4888-94a4-4a0b-bf35-4211680d4bdf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036913 Sep 17 20:56:35.364485 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 699/1446] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:56:35.369517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-de016496-9df5-463e-a761-97a3f88d1ce7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:35.370223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-de016496-9df5-463e-a761-97a3f88d1ce7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:35.377688 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de016496-9df5-463e-a761-97a3f88d1ce7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:35.382045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de016496-9df5-463e-a761-97a3f88d1ce7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:35.382561 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de016496-9df5-463e-a761-97a3f88d1ce7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:35.383385 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de016496-9df5-463e-a761-97a3f88d1ce7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:35.383844 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de016496-9df5-463e-a761-97a3f88d1ce7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:35.384401 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de016496-9df5-463e-a761-97a3f88d1ce7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:35.475949 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-633b1227-c9e8-4dce-8c56-e5a23ebb26e4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:35.484598 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-633b1227-c9e8-4dce-8c56-e5a23ebb26e4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1355 microversion: 2.1 time: 0.236410 Sep 17 20:56:35.485056 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 748/1447] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:35 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1355 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:35.490565 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-dd61572f-fd91-4f67-bd4a-110a03784867 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:35.491176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-dd61572f-fd91-4f67-bd4a-110a03784867 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:35.571658 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-dd61572f-fd91-4f67-bd4a-110a03784867 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:35.580121 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-dd61572f-fd91-4f67-bd4a-110a03784867 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 200 len: 1208 microversion: 2.1 time: 0.093120 Sep 17 20:56:35.580913 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 749/1448] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:35 2022] GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 1208 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:35.586965 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-de016496-9df5-463e-a761-97a3f88d1ce7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:35.593270 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-76ad6be2-409e-42d0-a1ff-fa2f63e36ce2 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:35.594185 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-76ad6be2-409e-42d0-a1ff-fa2f63e36ce2 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: fe75e57c-282a-4bac-b0a2-1c52dd110c84] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:35.595682 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-de016496-9df5-463e-a761-97a3f88d1ce7 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1719 microversion: 2.1 time: 0.230068 Sep 17 20:56:35.596405 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 700/1449] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:35 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1719 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:35.596546 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:35.601673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-09294406-7cdb-4f48-80ff-a759ceade6a0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:35.602612 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-09294406-7cdb-4f48-80ff-a759ceade6a0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:35.604727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76ad6be2-409e-42d0-a1ff-fa2f63e36ce2 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:35.605375 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76ad6be2-409e-42d0-a1ff-fa2f63e36ce2 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:35.606045 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76ad6be2-409e-42d0-a1ff-fa2f63e36ce2 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:35.607093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76ad6be2-409e-42d0-a1ff-fa2f63e36ce2 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:35.607742 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76ad6be2-409e-42d0-a1ff-fa2f63e36ce2 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:35.608747 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76ad6be2-409e-42d0-a1ff-fa2f63e36ce2 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:35.611123 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09294406-7cdb-4f48-80ff-a759ceade6a0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:35.612187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09294406-7cdb-4f48-80ff-a759ceade6a0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:35.612868 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09294406-7cdb-4f48-80ff-a759ceade6a0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:35.613612 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09294406-7cdb-4f48-80ff-a759ceade6a0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:35.614116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09294406-7cdb-4f48-80ff-a759ceade6a0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:35.614557 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09294406-7cdb-4f48-80ff-a759ceade6a0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:35.876779 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-76ad6be2-409e-42d0-a1ff-fa2f63e36ce2 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:35.880852 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-09294406-7cdb-4f48-80ff-a759ceade6a0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:35.885709 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-76ad6be2-409e-42d0-a1ff-fa2f63e36ce2 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84" status: 200 len: 1322 microversion: 2.1 time: 0.303299 Sep 17 20:56:35.886550 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 750/1450] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:35 2022] GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84 => generated 1322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:35.898688 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-98ea51d3-5273-4db9-99f0-3aef88d0714f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:35.899315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-98ea51d3-5273-4db9-99f0-3aef88d0714f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:35.905301 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-09294406-7cdb-4f48-80ff-a759ceade6a0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:35.907767 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-09294406-7cdb-4f48-80ff-a759ceade6a0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:35.909151 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-09294406-7cdb-4f48-80ff-a759ceade6a0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1880 microversion: 2.32 time: 0.311324 Sep 17 20:56:35.910240 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 701/1451] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:35 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1880 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:35.911757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-98ea51d3-5273-4db9-99f0-3aef88d0714f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:35.912360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-98ea51d3-5273-4db9-99f0-3aef88d0714f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:35.912868 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-98ea51d3-5273-4db9-99f0-3aef88d0714f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:35.913813 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-98ea51d3-5273-4db9-99f0-3aef88d0714f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:35.914921 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-98ea51d3-5273-4db9-99f0-3aef88d0714f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:35.915774 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-98ea51d3-5273-4db9-99f0-3aef88d0714f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:36.042754 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7b24f733-1868-466d-8efb-f2199b8b436f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:36.043566 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7b24f733-1868-466d-8efb-f2199b8b436f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:36.053852 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7b24f733-1868-466d-8efb-f2199b8b436f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:36.054461 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7b24f733-1868-466d-8efb-f2199b8b436f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:36.058113 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7b24f733-1868-466d-8efb-f2199b8b436f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:36.058989 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7b24f733-1868-466d-8efb-f2199b8b436f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:36.059543 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7b24f733-1868-466d-8efb-f2199b8b436f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:36.060053 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7b24f733-1868-466d-8efb-f2199b8b436f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:36.088444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-98ea51d3-5273-4db9-99f0-3aef88d0714f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:36.100982 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-98ea51d3-5273-4db9-99f0-3aef88d0714f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1522 microversion: 2.1 time: 0.213600 Sep 17 20:56:36.102240 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 751/1452] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:35 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:36.259137 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7b24f733-1868-466d-8efb-f2199b8b436f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:36.270168 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7b24f733-1868-466d-8efb-f2199b8b436f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518" status: 200 len: 1319 microversion: 2.1 time: 0.233407 Sep 17 20:56:36.270946 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 702/1453] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:36 2022] GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:36.340637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7f162436-19a4-4630-a033-545f0a37cc14 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:36.341445 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7f162436-19a4-4630-a033-545f0a37cc14 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:36.347861 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7f162436-19a4-4630-a033-545f0a37cc14 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:36.348718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7f162436-19a4-4630-a033-545f0a37cc14 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:36.349336 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7f162436-19a4-4630-a033-545f0a37cc14 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:36.350478 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7f162436-19a4-4630-a033-545f0a37cc14 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:36.351316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7f162436-19a4-4630-a033-545f0a37cc14 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:36.351921 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7f162436-19a4-4630-a033-545f0a37cc14 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:36.508713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-30ae5681-e7be-46aa-bd90-45b637a7fcdb tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:36.509346 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-30ae5681-e7be-46aa-bd90-45b637a7fcdb tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:36.509532 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7f162436-19a4-4630-a033-545f0a37cc14 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:36.519092 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30ae5681-e7be-46aa-bd90-45b637a7fcdb tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:36.519522 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7f162436-19a4-4630-a033-545f0a37cc14 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:36.521122 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30ae5681-e7be-46aa-bd90-45b637a7fcdb tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:36.521604 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30ae5681-e7be-46aa-bd90-45b637a7fcdb tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:36.522354 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30ae5681-e7be-46aa-bd90-45b637a7fcdb tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:36.522654 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7f162436-19a4-4630-a033-545f0a37cc14 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:36.522798 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30ae5681-e7be-46aa-bd90-45b637a7fcdb tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:36.524450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30ae5681-e7be-46aa-bd90-45b637a7fcdb tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:36.524893 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7f162436-19a4-4630-a033-545f0a37cc14 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1487 microversion: 2.25 time: 0.187979 Sep 17 20:56:36.526079 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 752/1454] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:36 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1487 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 20:56:36.603353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-401bf7ed-353d-41a5-ab21-94ae1ef619c0 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:36.603973 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-401bf7ed-353d-41a5-ab21-94ae1ef619c0 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:36.620750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-401bf7ed-353d-41a5-ab21-94ae1ef619c0 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:36.621250 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-401bf7ed-353d-41a5-ab21-94ae1ef619c0 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:36.621933 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-401bf7ed-353d-41a5-ab21-94ae1ef619c0 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:36.622665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-401bf7ed-353d-41a5-ab21-94ae1ef619c0 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:36.623338 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-401bf7ed-353d-41a5-ab21-94ae1ef619c0 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:36.623773 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-401bf7ed-353d-41a5-ab21-94ae1ef619c0 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:37.026568 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-401bf7ed-353d-41a5-ab21-94ae1ef619c0 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:37.036764 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-401bf7ed-353d-41a5-ab21-94ae1ef619c0 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 200 len: 1260 microversion: 2.1 time: 0.437151 Sep 17 20:56:37.038595 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 753/1455] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:36 2022] GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 1260 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:56:37.044832 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e4db27b8-749a-4010-bff9-66f93d7375c9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:37.045701 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e4db27b8-749a-4010-bff9-66f93d7375c9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:37.056972 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e4db27b8-749a-4010-bff9-66f93d7375c9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:37.057885 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e4db27b8-749a-4010-bff9-66f93d7375c9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:37.058590 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e4db27b8-749a-4010-bff9-66f93d7375c9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:37.060108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e4db27b8-749a-4010-bff9-66f93d7375c9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:37.060888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e4db27b8-749a-4010-bff9-66f93d7375c9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:37.061647 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e4db27b8-749a-4010-bff9-66f93d7375c9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:37.077259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-30ae5681-e7be-46aa-bd90-45b637a7fcdb tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:37.086814 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-30ae5681-e7be-46aa-bd90-45b637a7fcdb tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1355 microversion: 2.1 time: 0.581973 Sep 17 20:56:37.102889 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 703/1456] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:36 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1355 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:56:37.110524 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d3920006-9c9d-4a11-af77-1762e1b35088 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:37.111541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d3920006-9c9d-4a11-af77-1762e1b35088 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: fe75e57c-282a-4bac-b0a2-1c52dd110c84] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:37.122955 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d3920006-9c9d-4a11-af77-1762e1b35088 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:37.124388 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d3920006-9c9d-4a11-af77-1762e1b35088 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:37.125079 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d3920006-9c9d-4a11-af77-1762e1b35088 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:37.125914 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d3920006-9c9d-4a11-af77-1762e1b35088 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:37.126917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d3920006-9c9d-4a11-af77-1762e1b35088 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:37.127534 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d3920006-9c9d-4a11-af77-1762e1b35088 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:37.258635 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e4db27b8-749a-4010-bff9-66f93d7375c9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:37.268988 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e4db27b8-749a-4010-bff9-66f93d7375c9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1719 microversion: 2.1 time: 0.228731 Sep 17 20:56:37.270984 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 754/1457] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:37 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1719 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:37.275869 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-87832a51-20ff-44e5-8aef-180edf1aa0a0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:37.276707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-87832a51-20ff-44e5-8aef-180edf1aa0a0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:37.301741 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87832a51-20ff-44e5-8aef-180edf1aa0a0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:37.302160 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87832a51-20ff-44e5-8aef-180edf1aa0a0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:37.302824 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87832a51-20ff-44e5-8aef-180edf1aa0a0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:37.303561 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87832a51-20ff-44e5-8aef-180edf1aa0a0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:37.304030 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87832a51-20ff-44e5-8aef-180edf1aa0a0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:37.304459 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87832a51-20ff-44e5-8aef-180edf1aa0a0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:37.306525 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d3920006-9c9d-4a11-af77-1762e1b35088 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:37.315051 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d3920006-9c9d-4a11-af77-1762e1b35088 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84" status: 200 len: 1322 microversion: 2.1 time: 0.210272 Sep 17 20:56:37.316322 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 704/1458] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:37 2022] GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:37.329289 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7ac1e995-5784-4076-a8d3-04511ce6724b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:37.333517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7ac1e995-5784-4076-a8d3-04511ce6724b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:37.344027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ac1e995-5784-4076-a8d3-04511ce6724b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:37.344925 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ac1e995-5784-4076-a8d3-04511ce6724b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:37.345657 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ac1e995-5784-4076-a8d3-04511ce6724b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:37.346746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ac1e995-5784-4076-a8d3-04511ce6724b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:37.347266 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ac1e995-5784-4076-a8d3-04511ce6724b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:37.347789 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ac1e995-5784-4076-a8d3-04511ce6724b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:37.351197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:37.590394 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-87832a51-20ff-44e5-8aef-180edf1aa0a0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:37.592253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7ac1e995-5784-4076-a8d3-04511ce6724b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:37.601572 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7ac1e995-5784-4076-a8d3-04511ce6724b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1522 microversion: 2.1 time: 0.283818 Sep 17 20:56:37.602651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-87832a51-20ff-44e5-8aef-180edf1aa0a0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:37.602997 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 705/1459] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:37 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:37.604294 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-87832a51-20ff-44e5-8aef-180edf1aa0a0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:37.605972 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-87832a51-20ff-44e5-8aef-180edf1aa0a0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1880 microversion: 2.32 time: 0.333670 Sep 17 20:56:37.607107 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 755/1460] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:37 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1880 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:37.608032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f552bbd4-c5df-4a8c-b2ce-59cfd0277f04 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:37.608789 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f552bbd4-c5df-4a8c-b2ce-59cfd0277f04 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:37.616321 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f552bbd4-c5df-4a8c-b2ce-59cfd0277f04 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:37.617069 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f552bbd4-c5df-4a8c-b2ce-59cfd0277f04 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:37.617815 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f552bbd4-c5df-4a8c-b2ce-59cfd0277f04 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:37.618953 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f552bbd4-c5df-4a8c-b2ce-59cfd0277f04 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:37.619606 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f552bbd4-c5df-4a8c-b2ce-59cfd0277f04 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:37.621499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f552bbd4-c5df-4a8c-b2ce-59cfd0277f04 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:37.625490 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a156fd7a-2145-4c2b-aa5d-43c314a78d0a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:37.632462 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a156fd7a-2145-4c2b-aa5d-43c314a78d0a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:37.645254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a156fd7a-2145-4c2b-aa5d-43c314a78d0a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:37.645858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a156fd7a-2145-4c2b-aa5d-43c314a78d0a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:37.650203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a156fd7a-2145-4c2b-aa5d-43c314a78d0a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:37.651254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a156fd7a-2145-4c2b-aa5d-43c314a78d0a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:37.652059 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a156fd7a-2145-4c2b-aa5d-43c314a78d0a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:37.652786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a156fd7a-2145-4c2b-aa5d-43c314a78d0a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:37.856344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f552bbd4-c5df-4a8c-b2ce-59cfd0277f04 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:37.860829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a156fd7a-2145-4c2b-aa5d-43c314a78d0a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:37.868904 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f552bbd4-c5df-4a8c-b2ce-59cfd0277f04 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518" status: 200 len: 1319 microversion: 2.1 time: 0.264797 Sep 17 20:56:37.872662 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 706/1461] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:37 2022] GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:37.874982 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a156fd7a-2145-4c2b-aa5d-43c314a78d0a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:37.876708 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a156fd7a-2145-4c2b-aa5d-43c314a78d0a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:37.878403 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a156fd7a-2145-4c2b-aa5d-43c314a78d0a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1487 microversion: 2.25 time: 0.270201 Sep 17 20:56:37.879449 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 756/1462] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:37 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1487 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:38.061242 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d5f9e4a5-84e8-44c9-a628-27bcf4f37c5c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:38.062125 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d5f9e4a5-84e8-44c9-a628-27bcf4f37c5c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:38.069382 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5f9e4a5-84e8-44c9-a628-27bcf4f37c5c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:38.070712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5f9e4a5-84e8-44c9-a628-27bcf4f37c5c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:38.071155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5f9e4a5-84e8-44c9-a628-27bcf4f37c5c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:38.071927 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5f9e4a5-84e8-44c9-a628-27bcf4f37c5c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:38.072580 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5f9e4a5-84e8-44c9-a628-27bcf4f37c5c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:38.072985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5f9e4a5-84e8-44c9-a628-27bcf4f37c5c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:38.118979 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bbc0e6f7-5bd7-4605-b257-8197fb340b41 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:38.119814 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bbc0e6f7-5bd7-4605-b257-8197fb340b41 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:38.131289 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbc0e6f7-5bd7-4605-b257-8197fb340b41 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:38.132522 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbc0e6f7-5bd7-4605-b257-8197fb340b41 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:38.133212 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbc0e6f7-5bd7-4605-b257-8197fb340b41 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:38.134398 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbc0e6f7-5bd7-4605-b257-8197fb340b41 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:38.135094 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbc0e6f7-5bd7-4605-b257-8197fb340b41 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:38.136089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbc0e6f7-5bd7-4605-b257-8197fb340b41 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:38.148186 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d5f9e4a5-84e8-44c9-a628-27bcf4f37c5c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:38.158829 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d5f9e4a5-84e8-44c9-a628-27bcf4f37c5c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 200 len: 1266 microversion: 2.1 time: 0.101040 Sep 17 20:56:38.160127 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 707/1463] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:38 2022] GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:56:38.169402 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-79da267e-6fb1-46a8-ba46-51f1232e9203 req-9771a633-a49e-4dd6-8cea-45d85508b0b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518", "name": "network-vif-plugged", "status": "completed", "tag": "49c488cd-8158-4484-962f-4bfa74f75c62"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:38.183714 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-79da267e-6fb1-46a8-ba46-51f1232e9203 req-9771a633-a49e-4dd6-8cea-45d85508b0b7 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:38.184424 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-79da267e-6fb1-46a8-ba46-51f1232e9203 req-9771a633-a49e-4dd6-8cea-45d85508b0b7 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:38.184857 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-79da267e-6fb1-46a8-ba46-51f1232e9203 req-9771a633-a49e-4dd6-8cea-45d85508b0b7 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:38.202285 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-79da267e-6fb1-46a8-ba46-51f1232e9203 req-9771a633-a49e-4dd6-8cea-45d85508b0b7 service nova] Creating event network-vif-plugged:49c488cd-8158-4484-962f-4bfa74f75c62 for instance f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 on nch1-master-1 Sep 17 20:56:38.207421 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-79da267e-6fb1-46a8-ba46-51f1232e9203 req-9771a633-a49e-4dd6-8cea-45d85508b0b7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041957 Sep 17 20:56:38.209031 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 708/1464] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:56:38.298563 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-11376f57-a4d3-465d-847a-66001ea7f2e9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:38.300329 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-11376f57-a4d3-465d-847a-66001ea7f2e9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:38.310082 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11376f57-a4d3-465d-847a-66001ea7f2e9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:38.311298 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11376f57-a4d3-465d-847a-66001ea7f2e9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:38.312191 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11376f57-a4d3-465d-847a-66001ea7f2e9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:38.313162 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11376f57-a4d3-465d-847a-66001ea7f2e9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:38.313691 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bbc0e6f7-5bd7-4605-b257-8197fb340b41 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:38.314142 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11376f57-a4d3-465d-847a-66001ea7f2e9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:38.314983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11376f57-a4d3-465d-847a-66001ea7f2e9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:38.322550 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bbc0e6f7-5bd7-4605-b257-8197fb340b41 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1355 microversion: 2.1 time: 0.211147 Sep 17 20:56:38.323481 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 757/1465] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:38 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1355 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:38.340746 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cac5a5a5-8634-43fe-bdf2-e2664f8414a9 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:38.341370 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cac5a5a5-8634-43fe-bdf2-e2664f8414a9 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: fe75e57c-282a-4bac-b0a2-1c52dd110c84] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:38.347689 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cac5a5a5-8634-43fe-bdf2-e2664f8414a9 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:38.348510 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cac5a5a5-8634-43fe-bdf2-e2664f8414a9 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:38.349191 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cac5a5a5-8634-43fe-bdf2-e2664f8414a9 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:38.350226 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cac5a5a5-8634-43fe-bdf2-e2664f8414a9 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:38.350903 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cac5a5a5-8634-43fe-bdf2-e2664f8414a9 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:38.351584 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cac5a5a5-8634-43fe-bdf2-e2664f8414a9 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:38.503752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-11376f57-a4d3-465d-847a-66001ea7f2e9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:38.514612 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-11376f57-a4d3-465d-847a-66001ea7f2e9 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1719 microversion: 2.1 time: 0.222189 Sep 17 20:56:38.516981 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 709/1466] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:38 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1719 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:38.582088 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cac5a5a5-8634-43fe-bdf2-e2664f8414a9 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:38.591044 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cac5a5a5-8634-43fe-bdf2-e2664f8414a9 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84" status: 200 len: 1471 microversion: 2.1 time: 0.254329 Sep 17 20:56:38.592340 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 758/1467] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:38 2022] GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84 => generated 1471 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:56:38.624942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-176c20d5-ec06-4c05-baab-3605abd39f20 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:38.627561 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-176c20d5-ec06-4c05-baab-3605abd39f20 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:38.634851 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-176c20d5-ec06-4c05-baab-3605abd39f20 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:38.635398 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-176c20d5-ec06-4c05-baab-3605abd39f20 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:38.635945 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-176c20d5-ec06-4c05-baab-3605abd39f20 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:38.636670 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-176c20d5-ec06-4c05-baab-3605abd39f20 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:38.637132 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-176c20d5-ec06-4c05-baab-3605abd39f20 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:38.637589 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-176c20d5-ec06-4c05-baab-3605abd39f20 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:38.677027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-142dbce2-3454-4eab-a074-9f673c835915 tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:38.678103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-142dbce2-3454-4eab-a074-9f673c835915 tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] [instance: 5239e395-c03b-4f09-999a-f34d3d6e3a72] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:38.685019 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-142dbce2-3454-4eab-a074-9f673c835915 tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] HTTP exception thrown: Instance 5239e395-c03b-4f09-999a-f34d3d6e3a72 could not be found. Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-142dbce2-3454-4eab-a074-9f673c835915 tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Request method failure captured: Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers/5239e395-c03b-4f09-999a-f34d3d6e3a72/action HTTP/1.1 Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 15 Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjRoZ-ObfzCUBfzJkN3mYg3NHzzon2Tw7JygK82iQWX6rEiMR4Xm40Yoj3hRNVX1b-fhemNCxdgXxvtLDt2olRQwGH3EvQZjEoz0_HZXEfSrhi-BHgI8uCJMVCYLSXUil-kE17N5rwDIBpYmwzq9I12UOvhqhZqlj5csiINuiIXbDUM Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: eddfa4151eed49beafb4a87d152dc8c4 Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-22223311 Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: X-Role: admin,member,reader Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: admin,member,reader Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eddfa4151eed49beafb4a87d152dc8c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/eddfa4151eed49beafb4a87d152dc8c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eddfa4151eed49beafb4a87d152dc8c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_eddfa4151eed49beafb4a87d152dc8c4", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersAdminNegativeTestJSON-22223311 Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: eddfa4151eed49beafb4a87d152dc8c4 Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-22223311 Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersAdminNegativeTestJSON-22223311-project-admin Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 1f386dc88f214f489cb4105c2f6c50b0 Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersAdminNegativeTestJSON-22223311-project-admin Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: {"migrate": {}} Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 5239e395-c03b-4f09-999a-f34d3d6e3a72 could not be found. Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '5239e395-c03b-4f09-999a-f34d3d6e3a72', 'body': {'migrate': {}}} Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5239e395-c03b-4f09-999a-f34d3d6e3a72 could not be found. Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5239e395-c03b-4f09-999a-f34d3d6e3a72 could not be found. Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:56:38.694156 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:56:38.699661 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:56:38.699661 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:56:38.699661 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:56:38.699661 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:56:38.699661 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5239e395-c03b-4f09-999a-f34d3d6e3a72 could not be found. Sep 17 20:56:38.699661 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:56:38.703076 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-142dbce2-3454-4eab-a074-9f673c835915 tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Returning 404 to user: Instance 5239e395-c03b-4f09-999a-f34d3d6e3a72 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:56:38.704117 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-142dbce2-3454-4eab-a074-9f673c835915 tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/5239e395-c03b-4f09-999a-f34d3d6e3a72/action" status: 404 len: 111 microversion: 2.1 time: 0.092724 Sep 17 20:56:38.704734 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 710/1468] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:56:38 2022] POST /compute/v2.1/servers/5239e395-c03b-4f09-999a-f34d3d6e3a72/action => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:56:38.709960 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2166ec22-94c7-4cd8-81f4-9c8c4751f077 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:38.710900 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2166ec22-94c7-4cd8-81f4-9c8c4751f077 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:38.725800 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2166ec22-94c7-4cd8-81f4-9c8c4751f077 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:38.726593 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2166ec22-94c7-4cd8-81f4-9c8c4751f077 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:38.727353 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2166ec22-94c7-4cd8-81f4-9c8c4751f077 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:38.728581 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2166ec22-94c7-4cd8-81f4-9c8c4751f077 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:38.729318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2166ec22-94c7-4cd8-81f4-9c8c4751f077 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:38.730500 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2166ec22-94c7-4cd8-81f4-9c8c4751f077 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:38.928108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-176c20d5-ec06-4c05-baab-3605abd39f20 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:38.943244 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-176c20d5-ec06-4c05-baab-3605abd39f20 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1522 microversion: 2.1 time: 0.321767 Sep 17 20:56:38.951843 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 759/1469] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:38 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:38.956227 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5e3521ff-05ee-4edb-8678-a5029e6cc0e4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-205434574", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:38.997720 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2166ec22-94c7-4cd8-81f4-9c8c4751f077 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:39.010465 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2166ec22-94c7-4cd8-81f4-9c8c4751f077 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:39.013421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2166ec22-94c7-4cd8-81f4-9c8c4751f077 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:39.015490 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2166ec22-94c7-4cd8-81f4-9c8c4751f077 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1880 microversion: 2.32 time: 0.308810 Sep 17 20:56:39.022228 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 711/1470] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:38 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1880 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:39.027672 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a44fc21b-d9cd-43bd-85ca-d12e0b48c58f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:39.028373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a44fc21b-d9cd-43bd-85ca-d12e0b48c58f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:39.037489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a44fc21b-d9cd-43bd-85ca-d12e0b48c58f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:39.038083 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a44fc21b-d9cd-43bd-85ca-d12e0b48c58f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:39.038656 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a44fc21b-d9cd-43bd-85ca-d12e0b48c58f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:39.039441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a44fc21b-d9cd-43bd-85ca-d12e0b48c58f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:39.045862 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-5e3521ff-05ee-4edb-8678-a5029e6cc0e4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] validate_networks() for None {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:56:39.057651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a44fc21b-d9cd-43bd-85ca-d12e0b48c58f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:39.059120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a44fc21b-d9cd-43bd-85ca-d12e0b48c58f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:39.307532 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a44fc21b-d9cd-43bd-85ca-d12e0b48c58f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:39.319282 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a44fc21b-d9cd-43bd-85ca-d12e0b48c58f tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518" status: 200 len: 1319 microversion: 2.1 time: 0.295367 Sep 17 20:56:39.321425 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 712/1471] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:39 2022] GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 => generated 1319 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:39.327982 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-229e6838-956b-45e0-87b0-18f00bd44080 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:39.328970 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-229e6838-956b-45e0-87b0-18f00bd44080 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:39.338841 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-229e6838-956b-45e0-87b0-18f00bd44080 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:39.339662 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-229e6838-956b-45e0-87b0-18f00bd44080 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:39.340609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-229e6838-956b-45e0-87b0-18f00bd44080 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:39.341578 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-229e6838-956b-45e0-87b0-18f00bd44080 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:39.342059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-229e6838-956b-45e0-87b0-18f00bd44080 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:39.342493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-229e6838-956b-45e0-87b0-18f00bd44080 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:39.434301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-5e3521ff-05ee-4edb-8678-a5029e6cc0e4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:56:39.434736 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-5e3521ff-05ee-4edb-8678-a5029e6cc0e4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:56:39.435418 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-5e3521ff-05ee-4edb-8678-a5029e6cc0e4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:56:39.435845 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-5e3521ff-05ee-4edb-8678-a5029e6cc0e4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:56:39.436233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-5e3521ff-05ee-4edb-8678-a5029e6cc0e4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:56:39.447036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e3521ff-05ee-4edb-8678-a5029e6cc0e4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:39.447538 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e3521ff-05ee-4edb-8678-a5029e6cc0e4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:39.447980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e3521ff-05ee-4edb-8678-a5029e6cc0e4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:39.448723 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e3521ff-05ee-4edb-8678-a5029e6cc0e4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:39.449368 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e3521ff-05ee-4edb-8678-a5029e6cc0e4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:39.449849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e3521ff-05ee-4edb-8678-a5029e6cc0e4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:39.470424 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-5e3521ff-05ee-4edb-8678-a5029e6cc0e4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Getting quotas for project 84caeb4c4b2e4dbda9bf7def13420af1. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:56:39.475612 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-5e3521ff-05ee-4edb-8678-a5029e6cc0e4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Getting quotas for user 4d9c7f4729e04bf6b915246ca7b5a3cf and project 84caeb4c4b2e4dbda9bf7def13420af1. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:56:39.489382 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5e3521ff-05ee-4edb-8678-a5029e6cc0e4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:56:39.492199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5e3521ff-05ee-4edb-8678-a5029e6cc0e4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: 15f3f131-e02d-46b1-ba15-509016665f36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:56:39.503785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-229e6838-956b-45e0-87b0-18f00bd44080 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:39.513286 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-229e6838-956b-45e0-87b0-18f00bd44080 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:39.515012 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-229e6838-956b-45e0-87b0-18f00bd44080 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:39.516327 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-229e6838-956b-45e0-87b0-18f00bd44080 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1487 microversion: 2.25 time: 0.192969 Sep 17 20:56:39.517000 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 713/1472] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:39 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1487 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:39.534222 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1c082133-adea-41fd-b998-5a324910dbec tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:39.535315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1c082133-adea-41fd-b998-5a324910dbec tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:39.542566 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c082133-adea-41fd-b998-5a324910dbec tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:39.543417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c082133-adea-41fd-b998-5a324910dbec tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:39.543970 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c082133-adea-41fd-b998-5a324910dbec tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:39.544896 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c082133-adea-41fd-b998-5a324910dbec tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:39.545592 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c082133-adea-41fd-b998-5a324910dbec tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:39.546147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c082133-adea-41fd-b998-5a324910dbec tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:39.556992 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5e3521ff-05ee-4edb-8678-a5029e6cc0e4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.611371 Sep 17 20:56:39.558288 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 760/1473] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:56:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:56:39.563209 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8ee8aa8c-3926-41d2-8e6c-4e4a320eca24 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:39.564016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8ee8aa8c-3926-41d2-8e6c-4e4a320eca24 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:39.571436 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8ee8aa8c-3926-41d2-8e6c-4e4a320eca24 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:39.571921 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8ee8aa8c-3926-41d2-8e6c-4e4a320eca24 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:39.572534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8ee8aa8c-3926-41d2-8e6c-4e4a320eca24 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:39.573404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8ee8aa8c-3926-41d2-8e6c-4e4a320eca24 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:39.574043 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8ee8aa8c-3926-41d2-8e6c-4e4a320eca24 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:39.574468 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8ee8aa8c-3926-41d2-8e6c-4e4a320eca24 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:39.640676 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1c082133-adea-41fd-b998-5a324910dbec tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:39.651970 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1c082133-adea-41fd-b998-5a324910dbec tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 200 len: 1266 microversion: 2.1 time: 0.130103 Sep 17 20:56:39.668206 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 714/1474] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:39 2022] GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:39.676407 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-11a7130a-1e90-4e3c-b275-be1fa23843fa tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:39.677400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-11a7130a-1e90-4e3c-b275-be1fa23843fa tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:39.692876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11a7130a-1e90-4e3c-b275-be1fa23843fa tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:39.692876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11a7130a-1e90-4e3c-b275-be1fa23843fa tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:39.692876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11a7130a-1e90-4e3c-b275-be1fa23843fa tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:39.692876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11a7130a-1e90-4e3c-b275-be1fa23843fa tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:39.692876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11a7130a-1e90-4e3c-b275-be1fa23843fa tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:39.693291 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11a7130a-1e90-4e3c-b275-be1fa23843fa tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:39.860454 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8ee8aa8c-3926-41d2-8e6c-4e4a320eca24 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:39.870314 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8ee8aa8c-3926-41d2-8e6c-4e4a320eca24 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1355 microversion: 2.1 time: 0.310767 Sep 17 20:56:39.871719 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 761/1475] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:39 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1355 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:39.876757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-40636580-95ad-4d9d-9f92-ab98b1ebb80b tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:39.889280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-40636580-95ad-4d9d-9f92-ab98b1ebb80b tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: 15f3f131-e02d-46b1-ba15-509016665f36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:39.925676 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-11a7130a-1e90-4e3c-b275-be1fa23843fa tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:39.935423 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-11a7130a-1e90-4e3c-b275-be1fa23843fa tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1709 microversion: 2.1 time: 0.265615 Sep 17 20:56:39.952999 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 715/1476] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:39 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1709 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:39.959924 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-9579a320-073a-4754-8724-842f629639f7 req-6ed54a45-9eae-4906-9ff1-5705dee76a7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d99ba94b-addd-4964-8d95-91de304a4988", "name": "network-vif-deleted", "tag": "01b9920f-d8f7-4dfb-b9df-b1746666a92f"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:39.971312 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-9579a320-073a-4754-8724-842f629639f7 req-6ed54a45-9eae-4906-9ff1-5705dee76a7a service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:39.971788 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-9579a320-073a-4754-8724-842f629639f7 req-6ed54a45-9eae-4906-9ff1-5705dee76a7a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:39.972219 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-9579a320-073a-4754-8724-842f629639f7 req-6ed54a45-9eae-4906-9ff1-5705dee76a7a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:39.984679 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-9579a320-073a-4754-8724-842f629639f7 req-6ed54a45-9eae-4906-9ff1-5705dee76a7a service nova] Creating event network-vif-deleted:01b9920f-d8f7-4dfb-b9df-b1746666a92f for instance d99ba94b-addd-4964-8d95-91de304a4988 on nch1-master-1 Sep 17 20:56:39.990499 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-9579a320-073a-4754-8724-842f629639f7 req-6ed54a45-9eae-4906-9ff1-5705dee76a7a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035955 Sep 17 20:56:39.991116 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 716/1477] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:56:39.995690 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-40636580-95ad-4d9d-9f92-ab98b1ebb80b tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:39.996279 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3302a6ab-ebc6-4241-86bc-b5487359b26c tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Calling method '.version_select at 0x7f25a9fe0280>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:40.000212 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3302a6ab-ebc6-4241-86bc-b5487359b26c tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:40.000513 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3302a6ab-ebc6-4241-86bc-b5487359b26c tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:40.001114 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3302a6ab-ebc6-4241-86bc-b5487359b26c tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:40.005660 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-40636580-95ad-4d9d-9f92-ab98b1ebb80b tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36" status: 200 len: 1221 microversion: 2.1 time: 0.132705 Sep 17 20:56:40.012267 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3302a6ab-ebc6-4241-86bc-b5487359b26c tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 2704 microversion: 2.1 time: 0.019748 Sep 17 20:56:40.025113 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 717/1478] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Sep 17 20:56:39 2022] GET /compute/v2.1/os-migrations => generated 2704 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:40.030495 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cd0a352d-e638-4ce4-b04a-baf88bebd2ce tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:40.031317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cd0a352d-e638-4ce4-b04a-baf88bebd2ce tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:40.039044 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd0a352d-e638-4ce4-b04a-baf88bebd2ce tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:40.039720 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd0a352d-e638-4ce4-b04a-baf88bebd2ce tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:40.040170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd0a352d-e638-4ce4-b04a-baf88bebd2ce tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:40.042113 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd0a352d-e638-4ce4-b04a-baf88bebd2ce tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:40.042113 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd0a352d-e638-4ce4-b04a-baf88bebd2ce tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:40.042340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd0a352d-e638-4ce4-b04a-baf88bebd2ce tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:40.046377 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 762/1479] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:39 2022] GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36 => generated 1221 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:40.052977 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6f5a1bc1-f5e1-4120-a1c3-7fa069ce9290 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:40.053961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6f5a1bc1-f5e1-4120-a1c3-7fa069ce9290 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:40.062668 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f5a1bc1-f5e1-4120-a1c3-7fa069ce9290 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:40.063520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f5a1bc1-f5e1-4120-a1c3-7fa069ce9290 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:40.064267 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f5a1bc1-f5e1-4120-a1c3-7fa069ce9290 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:40.065421 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f5a1bc1-f5e1-4120-a1c3-7fa069ce9290 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:40.066366 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f5a1bc1-f5e1-4120-a1c3-7fa069ce9290 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:40.067027 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f5a1bc1-f5e1-4120-a1c3-7fa069ce9290 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:40.370241 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6f5a1bc1-f5e1-4120-a1c3-7fa069ce9290 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1860 microversion: 2.1 time: 0.322329 Sep 17 20:56:40.371597 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 763/1480] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:40 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1860 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:40.390341 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-38ba0b2e-55b0-4322-9929-1adfd3452e96 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:40.391342 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-38ba0b2e-55b0-4322-9929-1adfd3452e96 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:40.406483 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-38ba0b2e-55b0-4322-9929-1adfd3452e96 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:40.407242 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-38ba0b2e-55b0-4322-9929-1adfd3452e96 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:40.407846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-38ba0b2e-55b0-4322-9929-1adfd3452e96 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:40.408889 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-38ba0b2e-55b0-4322-9929-1adfd3452e96 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:40.409444 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cd0a352d-e638-4ce4-b04a-baf88bebd2ce tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:40.410153 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-38ba0b2e-55b0-4322-9929-1adfd3452e96 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:40.410771 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-38ba0b2e-55b0-4322-9929-1adfd3452e96 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:40.419562 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cd0a352d-e638-4ce4-b04a-baf88bebd2ce tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1522 microversion: 2.1 time: 0.392783 Sep 17 20:56:40.420153 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 718/1481] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:40 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1522 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:40.425237 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-438bd819-de13-4bc2-8d08-4de02e33dfd2 req-6a9631f9-0253-4292-91fb-e06ec63e6476 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d99ba94b-addd-4964-8d95-91de304a4988", "name": "network-vif-unplugged", "status": "completed", "tag": "01b9920f-d8f7-4dfb-b9df-b1746666a92f"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:40.437248 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-438bd819-de13-4bc2-8d08-4de02e33dfd2 req-6a9631f9-0253-4292-91fb-e06ec63e6476 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:40.437769 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-438bd819-de13-4bc2-8d08-4de02e33dfd2 req-6a9631f9-0253-4292-91fb-e06ec63e6476 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:40.438204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-438bd819-de13-4bc2-8d08-4de02e33dfd2 req-6a9631f9-0253-4292-91fb-e06ec63e6476 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:40.450522 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-438bd819-de13-4bc2-8d08-4de02e33dfd2 req-6a9631f9-0253-4292-91fb-e06ec63e6476 service nova] Creating event network-vif-unplugged:01b9920f-d8f7-4dfb-b9df-b1746666a92f for instance d99ba94b-addd-4964-8d95-91de304a4988 on nch1-master-1 Sep 17 20:56:40.456395 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-438bd819-de13-4bc2-8d08-4de02e33dfd2 req-6a9631f9-0253-4292-91fb-e06ec63e6476 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034595 Sep 17 20:56:40.458023 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 719/1482] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:56:40.463538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b0ffb5ab-a790-486f-8d08-9ac102907bf1 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:40.464482 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b0ffb5ab-a790-486f-8d08-9ac102907bf1 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:40.471290 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0ffb5ab-a790-486f-8d08-9ac102907bf1 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:40.472022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0ffb5ab-a790-486f-8d08-9ac102907bf1 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:40.472629 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0ffb5ab-a790-486f-8d08-9ac102907bf1 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:40.473337 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0ffb5ab-a790-486f-8d08-9ac102907bf1 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:40.473985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0ffb5ab-a790-486f-8d08-9ac102907bf1 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:40.474416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0ffb5ab-a790-486f-8d08-9ac102907bf1 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:40.768359 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-38ba0b2e-55b0-4322-9929-1adfd3452e96 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:40.779005 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-38ba0b2e-55b0-4322-9929-1adfd3452e96 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:40.780678 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-38ba0b2e-55b0-4322-9929-1adfd3452e96 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:40.782069 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-38ba0b2e-55b0-4322-9929-1adfd3452e96 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1880 microversion: 2.32 time: 0.409263 Sep 17 20:56:40.783837 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 764/1483] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:40 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1880 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:40.808832 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a26f225a-d064-4ee5-8c45-85be40c387fc tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:40.809480 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a26f225a-d064-4ee5-8c45-85be40c387fc tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:40.815838 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a26f225a-d064-4ee5-8c45-85be40c387fc tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:40.816338 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a26f225a-d064-4ee5-8c45-85be40c387fc tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:40.816785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a26f225a-d064-4ee5-8c45-85be40c387fc tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:40.817507 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a26f225a-d064-4ee5-8c45-85be40c387fc tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:40.818175 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a26f225a-d064-4ee5-8c45-85be40c387fc tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:40.818603 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a26f225a-d064-4ee5-8c45-85be40c387fc tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:40.838556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b0ffb5ab-a790-486f-8d08-9ac102907bf1 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:40.859764 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b0ffb5ab-a790-486f-8d08-9ac102907bf1 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518" status: 200 len: 1468 microversion: 2.1 time: 0.400205 Sep 17 20:56:40.880064 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 720/1484] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:40 2022] GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 => generated 1468 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:40.885728 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7dd72043-8666-445e-a9c2-9a511d78ca2f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:40.886623 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7dd72043-8666-445e-a9c2-9a511d78ca2f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:40.897039 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7dd72043-8666-445e-a9c2-9a511d78ca2f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:40.898389 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7dd72043-8666-445e-a9c2-9a511d78ca2f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:40.899143 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7dd72043-8666-445e-a9c2-9a511d78ca2f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:40.900349 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7dd72043-8666-445e-a9c2-9a511d78ca2f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:40.901533 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7dd72043-8666-445e-a9c2-9a511d78ca2f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:40.902152 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7dd72043-8666-445e-a9c2-9a511d78ca2f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:41.072590 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a26f225a-d064-4ee5-8c45-85be40c387fc tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1860 microversion: 2.1 time: 0.287300 Sep 17 20:56:41.085802 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 765/1485] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:40 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1860 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:41.100950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8f5c5fd4-d51d-4158-a31e-474619f4682f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:41.101731 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8f5c5fd4-d51d-4158-a31e-474619f4682f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:41.118669 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f5c5fd4-d51d-4158-a31e-474619f4682f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:41.119173 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f5c5fd4-d51d-4158-a31e-474619f4682f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:41.119620 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f5c5fd4-d51d-4158-a31e-474619f4682f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:41.120344 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f5c5fd4-d51d-4158-a31e-474619f4682f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:41.120820 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f5c5fd4-d51d-4158-a31e-474619f4682f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:41.121234 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f5c5fd4-d51d-4158-a31e-474619f4682f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:41.141192 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:41.163223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7dd72043-8666-445e-a9c2-9a511d78ca2f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:41.177547 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7dd72043-8666-445e-a9c2-9a511d78ca2f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:41.180124 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7dd72043-8666-445e-a9c2-9a511d78ca2f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:41.188119 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7dd72043-8666-445e-a9c2-9a511d78ca2f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1487 microversion: 2.25 time: 0.305635 Sep 17 20:56:41.201977 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 721/1486] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:40 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1487 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:41.216813 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-413f2e90-f66b-4457-911b-abae7349a449 tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:41.217278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-413f2e90-f66b-4457-911b-abae7349a449 tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] [instance: f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:41.232821 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-413f2e90-f66b-4457-911b-abae7349a449 tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:41.236153 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-413f2e90-f66b-4457-911b-abae7349a449 tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:41.236894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-413f2e90-f66b-4457-911b-abae7349a449 tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:41.238126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-413f2e90-f66b-4457-911b-abae7349a449 tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:41.238765 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-413f2e90-f66b-4457-911b-abae7349a449 tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:41.241752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-413f2e90-f66b-4457-911b-abae7349a449 tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:41.316844 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-413f2e90-f66b-4457-911b-abae7349a449 tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Lazy-loading 'flavor' on Instance uuid f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:56:41.534552 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8f5c5fd4-d51d-4158-a31e-474619f4682f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:41.549884 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8f5c5fd4-d51d-4158-a31e-474619f4682f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 200 len: 1308 microversion: 2.1 time: 0.455015 Sep 17 20:56:41.552329 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 766/1487] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:41 2022] GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 1308 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:41.569918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-984cde2f-70ab-4819-b477-d1cab046b70a tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:41.570757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-984cde2f-70ab-4819-b477-d1cab046b70a tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:41.582370 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-984cde2f-70ab-4819-b477-d1cab046b70a tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:41.583448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-984cde2f-70ab-4819-b477-d1cab046b70a tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:41.584269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-984cde2f-70ab-4819-b477-d1cab046b70a tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:41.589620 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-984cde2f-70ab-4819-b477-d1cab046b70a tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:41.590580 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-984cde2f-70ab-4819-b477-d1cab046b70a tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:41.591224 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-984cde2f-70ab-4819-b477-d1cab046b70a tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:41.605419 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-413f2e90-f66b-4457-911b-abae7349a449 tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518/action" status: 202 len: 0 microversion: 2.1 time: 0.401362 Sep 17 20:56:41.623484 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 722/1488] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:56:41 2022] POST /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518/action => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:56:41.636980 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2e99d3e5-6b01-4fb0-9ae1-305053c783bb tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:41.638026 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2e99d3e5-6b01-4fb0-9ae1-305053c783bb tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: 15f3f131-e02d-46b1-ba15-509016665f36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:41.648163 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e99d3e5-6b01-4fb0-9ae1-305053c783bb tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:41.648670 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e99d3e5-6b01-4fb0-9ae1-305053c783bb tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:41.649095 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e99d3e5-6b01-4fb0-9ae1-305053c783bb tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:41.649892 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e99d3e5-6b01-4fb0-9ae1-305053c783bb tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:41.650342 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e99d3e5-6b01-4fb0-9ae1-305053c783bb tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:41.650974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e99d3e5-6b01-4fb0-9ae1-305053c783bb tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:41.786351 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2e99d3e5-6b01-4fb0-9ae1-305053c783bb tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:41.788966 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:41.796537 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2e99d3e5-6b01-4fb0-9ae1-305053c783bb tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36" status: 200 len: 1217 microversion: 2.1 time: 0.169014 Sep 17 20:56:41.812523 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 723/1489] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:41 2022] GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36 => generated 1217 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:41.812763 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-984cde2f-70ab-4819-b477-d1cab046b70a tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:41.812923 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-67678a09-9d6f-4a99-8ab1-2f1e453131cd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:41.812923 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-67678a09-9d6f-4a99-8ab1-2f1e453131cd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:41.820267 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67678a09-9d6f-4a99-8ab1-2f1e453131cd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:41.820789 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67678a09-9d6f-4a99-8ab1-2f1e453131cd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:41.821267 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67678a09-9d6f-4a99-8ab1-2f1e453131cd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:41.822086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67678a09-9d6f-4a99-8ab1-2f1e453131cd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:41.822542 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67678a09-9d6f-4a99-8ab1-2f1e453131cd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:41.822984 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67678a09-9d6f-4a99-8ab1-2f1e453131cd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:41.825022 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-984cde2f-70ab-4819-b477-d1cab046b70a tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1355 microversion: 2.1 time: 0.271158 Sep 17 20:56:41.825902 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 767/1490] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:41 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1355 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:41.833402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-99087a80-4642-491f-8359-e2d0d62e4681 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:41.834395 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-99087a80-4642-491f-8359-e2d0d62e4681 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:41.842613 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-99087a80-4642-491f-8359-e2d0d62e4681 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:41.843547 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-99087a80-4642-491f-8359-e2d0d62e4681 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:41.844227 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-99087a80-4642-491f-8359-e2d0d62e4681 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:41.845311 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-99087a80-4642-491f-8359-e2d0d62e4681 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:41.846242 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-99087a80-4642-491f-8359-e2d0d62e4681 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:41.850250 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-99087a80-4642-491f-8359-e2d0d62e4681 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:41.964932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-67678a09-9d6f-4a99-8ab1-2f1e453131cd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lazy-loading 'services' on Instance uuid 46d60c84-b2e2-4376-a0ca-f0bee938fd9a {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:56:42.030029 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-99087a80-4642-491f-8359-e2d0d62e4681 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:42.038798 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-99087a80-4642-491f-8359-e2d0d62e4681 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1522 microversion: 2.1 time: 0.210826 Sep 17 20:56:42.039392 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 768/1491] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:41 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:42.058421 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-46799df0-8609-4b7d-846c-27079c2b5cb9 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:42.059067 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-46799df0-8609-4b7d-846c-27079c2b5cb9 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:42.065892 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46799df0-8609-4b7d-846c-27079c2b5cb9 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:42.066381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46799df0-8609-4b7d-846c-27079c2b5cb9 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:42.066818 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46799df0-8609-4b7d-846c-27079c2b5cb9 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:42.068057 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46799df0-8609-4b7d-846c-27079c2b5cb9 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:42.068519 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46799df0-8609-4b7d-846c-27079c2b5cb9 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:42.069253 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46799df0-8609-4b7d-846c-27079c2b5cb9 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:42.134416 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-67678a09-9d6f-4a99-8ab1-2f1e453131cd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "DELETE /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a/os-volume_attachments/39a2a629-4cdb-497c-8f9e-729c11354b4b" status: 202 len: 0 microversion: 2.1 time: 0.331009 Sep 17 20:56:42.135622 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 724/1492] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Sep 17 20:56:41 2022] DELETE /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a/os-volume_attachments/39a2a629-4cdb-497c-8f9e-729c11354b4b => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:56:42.155525 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9ce2019c-8eec-48bc-96a5-b9fb2a9b550f tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:42.156408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9ce2019c-8eec-48bc-96a5-b9fb2a9b550f tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:42.166483 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9ce2019c-8eec-48bc-96a5-b9fb2a9b550f tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:42.167436 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9ce2019c-8eec-48bc-96a5-b9fb2a9b550f tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:42.167652 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9ce2019c-8eec-48bc-96a5-b9fb2a9b550f tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:42.177631 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9ce2019c-8eec-48bc-96a5-b9fb2a9b550f tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:42.178273 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9ce2019c-8eec-48bc-96a5-b9fb2a9b550f tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:42.179196 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9ce2019c-8eec-48bc-96a5-b9fb2a9b550f tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:42.243852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-46799df0-8609-4b7d-846c-27079c2b5cb9 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:42.259509 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-46799df0-8609-4b7d-846c-27079c2b5cb9 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518" status: 200 len: 1476 microversion: 2.1 time: 0.218554 Sep 17 20:56:42.260040 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 769/1493] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:42 2022] GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 => generated 1476 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:42.291990 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-3d66f6cd-3410-44bd-a980-adba18c816c8 req-234430ee-d2ca-4be8-819f-b722878f9737 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f0fd2e6-7a40-44f0-9ab7-71ff4489741a", "tag": "7fa83e5d-ec8d-48f1-b098-873e8265bb06"}, {"server_uuid": "50a51f32-a366-4bd6-9de4-7652c6b2d29d", "name": "network-vif-unplugged", "status": "completed", "tag": "8df31a1d-fc1e-494b-8747-1f3e6c1867ce"}, {"name": "network-changed", "server_uuid": "50a51f32-a366-4bd6-9de4-7652c6b2d29d", "tag": "8df31a1d-fc1e-494b-8747-1f3e6c1867ce"}, {"name": "network-changed", "server_uuid": "4f0fd2e6-7a40-44f0-9ab7-71ff4489741a", "tag": "41a63a9c-a45e-49f6-98c5-c6e0496500b0"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:42.314985 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-3d66f6cd-3410-44bd-a980-adba18c816c8 req-234430ee-d2ca-4be8-819f-b722878f9737 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:42.318420 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-3d66f6cd-3410-44bd-a980-adba18c816c8 req-234430ee-d2ca-4be8-819f-b722878f9737 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:42.318973 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-3d66f6cd-3410-44bd-a980-adba18c816c8 req-234430ee-d2ca-4be8-819f-b722878f9737 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:42.357546 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-3d66f6cd-3410-44bd-a980-adba18c816c8 req-234430ee-d2ca-4be8-819f-b722878f9737 service nova] Creating event network-changed:7fa83e5d-ec8d-48f1-b098-873e8265bb06 for instance 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a on nch1-master-1 Sep 17 20:56:42.358067 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-3d66f6cd-3410-44bd-a980-adba18c816c8 req-234430ee-d2ca-4be8-819f-b722878f9737 service nova] Creating event network-vif-unplugged:8df31a1d-fc1e-494b-8747-1f3e6c1867ce for instance 50a51f32-a366-4bd6-9de4-7652c6b2d29d on nch2-master-1 Sep 17 20:56:42.358608 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-3d66f6cd-3410-44bd-a980-adba18c816c8 req-234430ee-d2ca-4be8-819f-b722878f9737 service nova] Creating event network-changed:8df31a1d-fc1e-494b-8747-1f3e6c1867ce for instance 50a51f32-a366-4bd6-9de4-7652c6b2d29d on nch2-master-1 Sep 17 20:56:42.359105 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-3d66f6cd-3410-44bd-a980-adba18c816c8 req-234430ee-d2ca-4be8-819f-b722878f9737 service nova] Creating event network-changed:41a63a9c-a45e-49f6-98c5-c6e0496500b0 for instance 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a on nch1-master-1 Sep 17 20:56:42.370466 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-3d66f6cd-3410-44bd-a980-adba18c816c8 req-234430ee-d2ca-4be8-819f-b722878f9737 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 686 microversion: 2.1 time: 0.082775 Sep 17 20:56:42.371424 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 770/1494] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 686 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:56:42.376870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ee7e922a-78de-4617-bd94-01dae91d3a97 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:42.380435 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ee7e922a-78de-4617-bd94-01dae91d3a97 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:42.390889 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee7e922a-78de-4617-bd94-01dae91d3a97 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:42.391654 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee7e922a-78de-4617-bd94-01dae91d3a97 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:42.392267 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee7e922a-78de-4617-bd94-01dae91d3a97 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:42.393232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee7e922a-78de-4617-bd94-01dae91d3a97 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:42.393929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee7e922a-78de-4617-bd94-01dae91d3a97 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:42.395258 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee7e922a-78de-4617-bd94-01dae91d3a97 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:42.436255 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ee7e922a-78de-4617-bd94-01dae91d3a97 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063546 Sep 17 20:56:42.437692 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 771/1495] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 17 20:56:42 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:56:42.443469 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-27ce97cf-cc07-4b24-a989-f849c078d6de tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:42.444342 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-27ce97cf-cc07-4b24-a989-f849c078d6de tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:42.454315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27ce97cf-cc07-4b24-a989-f849c078d6de tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:42.456315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27ce97cf-cc07-4b24-a989-f849c078d6de tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:42.457199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27ce97cf-cc07-4b24-a989-f849c078d6de tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:42.458415 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27ce97cf-cc07-4b24-a989-f849c078d6de tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:42.460295 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27ce97cf-cc07-4b24-a989-f849c078d6de tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:42.461317 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27ce97cf-cc07-4b24-a989-f849c078d6de tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:42.516874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9ce2019c-8eec-48bc-96a5-b9fb2a9b550f tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:42.532003 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9ce2019c-8eec-48bc-96a5-b9fb2a9b550f tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:42.533767 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9ce2019c-8eec-48bc-96a5-b9fb2a9b550f tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:42.536542 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9ce2019c-8eec-48bc-96a5-b9fb2a9b550f tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1880 microversion: 2.32 time: 0.399558 Sep 17 20:56:42.550722 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 725/1496] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:42 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1880 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:42.580100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0bcc488b-bf87-4bd8-b5d0-39de582f616a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:42.582125 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0bcc488b-bf87-4bd8-b5d0-39de582f616a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:42.589057 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:42.590707 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0bcc488b-bf87-4bd8-b5d0-39de582f616a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:42.591253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0bcc488b-bf87-4bd8-b5d0-39de582f616a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:42.591858 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0bcc488b-bf87-4bd8-b5d0-39de582f616a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:42.592728 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0bcc488b-bf87-4bd8-b5d0-39de582f616a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:42.593383 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0bcc488b-bf87-4bd8-b5d0-39de582f616a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:42.594010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0bcc488b-bf87-4bd8-b5d0-39de582f616a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:42.773918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-27ce97cf-cc07-4b24-a989-f849c078d6de tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:42.788370 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-27ce97cf-cc07-4b24-a989-f849c078d6de tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:42.789852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-27ce97cf-cc07-4b24-a989-f849c078d6de tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:42.791328 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-27ce97cf-cc07-4b24-a989-f849c078d6de tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1487 microversion: 2.25 time: 0.351821 Sep 17 20:56:42.792090 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 772/1497] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:42 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1487 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:42.805076 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0bcc488b-bf87-4bd8-b5d0-39de582f616a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:42.814185 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0bcc488b-bf87-4bd8-b5d0-39de582f616a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 200 len: 1308 microversion: 2.1 time: 0.240015 Sep 17 20:56:42.814874 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 726/1498] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:42 2022] GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 1308 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:56:42.831401 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ddd43644-f716-49d4-94ea-f9974b64e7e4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:42.832016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ddd43644-f716-49d4-94ea-f9974b64e7e4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: 15f3f131-e02d-46b1-ba15-509016665f36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:42.838220 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ddd43644-f716-49d4-94ea-f9974b64e7e4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:42.838708 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ddd43644-f716-49d4-94ea-f9974b64e7e4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:42.839171 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ddd43644-f716-49d4-94ea-f9974b64e7e4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:42.839870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ddd43644-f716-49d4-94ea-f9974b64e7e4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:42.840323 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ddd43644-f716-49d4-94ea-f9974b64e7e4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:42.840747 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ddd43644-f716-49d4-94ea-f9974b64e7e4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:42.849735 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-78251eb4-e9f3-42d3-8cd2-de40a3e21d7e tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:42.850612 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-78251eb4-e9f3-42d3-8cd2-de40a3e21d7e tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:42.857193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-78251eb4-e9f3-42d3-8cd2-de40a3e21d7e tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:42.857948 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-78251eb4-e9f3-42d3-8cd2-de40a3e21d7e tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:42.858525 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-78251eb4-e9f3-42d3-8cd2-de40a3e21d7e tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:42.859355 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-78251eb4-e9f3-42d3-8cd2-de40a3e21d7e tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:42.859912 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-78251eb4-e9f3-42d3-8cd2-de40a3e21d7e tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:42.860462 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-78251eb4-e9f3-42d3-8cd2-de40a3e21d7e tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:42.915111 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ddd43644-f716-49d4-94ea-f9974b64e7e4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:42.925637 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ddd43644-f716-49d4-94ea-f9974b64e7e4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36" status: 200 len: 1273 microversion: 2.1 time: 0.098713 Sep 17 20:56:42.937010 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 773/1499] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:42 2022] GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36 => generated 1273 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:43.063743 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f15c58c7-7754-4249-aaf0-c1c8235c8f3b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:43.064449 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f15c58c7-7754-4249-aaf0-c1c8235c8f3b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:43.071623 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f15c58c7-7754-4249-aaf0-c1c8235c8f3b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:43.072604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f15c58c7-7754-4249-aaf0-c1c8235c8f3b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:43.072917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f15c58c7-7754-4249-aaf0-c1c8235c8f3b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:43.073270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-78251eb4-e9f3-42d3-8cd2-de40a3e21d7e tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:43.073788 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f15c58c7-7754-4249-aaf0-c1c8235c8f3b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:43.087649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f15c58c7-7754-4249-aaf0-c1c8235c8f3b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:43.089113 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f15c58c7-7754-4249-aaf0-c1c8235c8f3b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:43.095434 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-78251eb4-e9f3-42d3-8cd2-de40a3e21d7e tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1355 microversion: 2.1 time: 0.248202 Sep 17 20:56:43.095434 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 727/1500] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:42 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1355 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:43.290034 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8d3d3988-dcc3-4528-a483-03fd4a50a245 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:43.290832 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8d3d3988-dcc3-4528-a483-03fd4a50a245 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:43.303838 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8d3d3988-dcc3-4528-a483-03fd4a50a245 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:43.304489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8d3d3988-dcc3-4528-a483-03fd4a50a245 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:43.305913 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8d3d3988-dcc3-4528-a483-03fd4a50a245 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:43.307588 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8d3d3988-dcc3-4528-a483-03fd4a50a245 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:43.310164 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8d3d3988-dcc3-4528-a483-03fd4a50a245 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:43.312275 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8d3d3988-dcc3-4528-a483-03fd4a50a245 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:43.318054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f15c58c7-7754-4249-aaf0-c1c8235c8f3b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:43.329833 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f15c58c7-7754-4249-aaf0-c1c8235c8f3b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1522 microversion: 2.1 time: 0.270302 Sep 17 20:56:43.332374 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 774/1501] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:43 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:56:43.347626 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-7010b0e4-f751-4ab6-9900-3225f13c06cd req-217645ae-536d-423a-950d-fe47c6c795eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b13c98-aea4-497c-a213-142393b2758c", "name": "network-vif-plugged", "status": "completed", "tag": "f1f9bbb6-1fce-45e9-b23b-60319ea313bb"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:43.372444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7010b0e4-f751-4ab6-9900-3225f13c06cd req-217645ae-536d-423a-950d-fe47c6c795eb service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:43.373020 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7010b0e4-f751-4ab6-9900-3225f13c06cd req-217645ae-536d-423a-950d-fe47c6c795eb service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:43.375515 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7010b0e4-f751-4ab6-9900-3225f13c06cd req-217645ae-536d-423a-950d-fe47c6c795eb service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:43.409320 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-7010b0e4-f751-4ab6-9900-3225f13c06cd req-217645ae-536d-423a-950d-fe47c6c795eb service nova] Creating event network-vif-plugged:f1f9bbb6-1fce-45e9-b23b-60319ea313bb for instance 22b13c98-aea4-497c-a213-142393b2758c on nch2-master-1 Sep 17 20:56:43.421501 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-7010b0e4-f751-4ab6-9900-3225f13c06cd req-217645ae-536d-423a-950d-fe47c6c795eb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087400 Sep 17 20:56:43.424793 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 775/1502] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:56:43.450689 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1e171b03-5415-4cc9-a7ea-84ef4d08c558 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:43.453447 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1e171b03-5415-4cc9-a7ea-84ef4d08c558 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:43.462013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e171b03-5415-4cc9-a7ea-84ef4d08c558 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:43.462548 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e171b03-5415-4cc9-a7ea-84ef4d08c558 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:43.463316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e171b03-5415-4cc9-a7ea-84ef4d08c558 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:43.464136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e171b03-5415-4cc9-a7ea-84ef4d08c558 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:43.465096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e171b03-5415-4cc9-a7ea-84ef4d08c558 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:43.465762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e171b03-5415-4cc9-a7ea-84ef4d08c558 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:43.500603 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1e171b03-5415-4cc9-a7ea-84ef4d08c558 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054572 Sep 17 20:56:43.501763 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 776/1503] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 17 20:56:43 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:56:43.566094 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-86515931-2b5b-4a16-9350-b4ec4b67c57d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:43.567051 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-86515931-2b5b-4a16-9350-b4ec4b67c57d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:43.568254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8d3d3988-dcc3-4528-a483-03fd4a50a245 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:43.577078 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8d3d3988-dcc3-4528-a483-03fd4a50a245 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518" status: 200 len: 1459 microversion: 2.1 time: 0.293683 Sep 17 20:56:43.582457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-86515931-2b5b-4a16-9350-b4ec4b67c57d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:43.582969 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-86515931-2b5b-4a16-9350-b4ec4b67c57d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:43.583408 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-86515931-2b5b-4a16-9350-b4ec4b67c57d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:43.584206 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-86515931-2b5b-4a16-9350-b4ec4b67c57d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:43.584565 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-86515931-2b5b-4a16-9350-b4ec4b67c57d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:43.584995 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-86515931-2b5b-4a16-9350-b4ec4b67c57d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:43.594293 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 728/1504] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:43 2022] GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 => generated 1459 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:43.606432 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7665c2ca-5278-4f22-905f-f8683f59465d tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:43.608410 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7665c2ca-5278-4f22-905f-f8683f59465d tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] [instance: f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:43.618165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7665c2ca-5278-4f22-905f-f8683f59465d tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:43.618943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7665c2ca-5278-4f22-905f-f8683f59465d tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:43.619552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7665c2ca-5278-4f22-905f-f8683f59465d tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:43.620745 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7665c2ca-5278-4f22-905f-f8683f59465d tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:43.622303 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7665c2ca-5278-4f22-905f-f8683f59465d tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:43.622894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7665c2ca-5278-4f22-905f-f8683f59465d tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:43.891337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-86515931-2b5b-4a16-9350-b4ec4b67c57d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:43.906027 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-86515931-2b5b-4a16-9350-b4ec4b67c57d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:43.907637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-86515931-2b5b-4a16-9350-b4ec4b67c57d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:43.911354 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-86515931-2b5b-4a16-9350-b4ec4b67c57d tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1880 microversion: 2.32 time: 0.350639 Sep 17 20:56:43.915036 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 777/1505] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:43 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1880 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 20:56:43.923451 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a9e1c054-2e37-404d-a7c5-f13c8cbec80f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:43.925648 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a9e1c054-2e37-404d-a7c5-f13c8cbec80f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:43.937792 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a9e1c054-2e37-404d-a7c5-f13c8cbec80f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:43.938287 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a9e1c054-2e37-404d-a7c5-f13c8cbec80f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:43.938727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a9e1c054-2e37-404d-a7c5-f13c8cbec80f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:43.939449 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a9e1c054-2e37-404d-a7c5-f13c8cbec80f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:43.939970 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a9e1c054-2e37-404d-a7c5-f13c8cbec80f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:43.940394 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a9e1c054-2e37-404d-a7c5-f13c8cbec80f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:44.214108 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7665c2ca-5278-4f22-905f-f8683f59465d tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518" status: 200 len: 1610 microversion: 2.1 time: 0.612131 Sep 17 20:56:44.215254 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 729/1506] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:43 2022] GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 => generated 1610 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:44.224457 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-67bc20c5-6ccc-4af8-93ef-f8b8f4099827 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:44.230542 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-67bc20c5-6ccc-4af8-93ef-f8b8f4099827 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:44.243706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67bc20c5-6ccc-4af8-93ef-f8b8f4099827 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:44.244280 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67bc20c5-6ccc-4af8-93ef-f8b8f4099827 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:44.244792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67bc20c5-6ccc-4af8-93ef-f8b8f4099827 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:44.245675 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67bc20c5-6ccc-4af8-93ef-f8b8f4099827 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:44.247611 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67bc20c5-6ccc-4af8-93ef-f8b8f4099827 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:44.248546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67bc20c5-6ccc-4af8-93ef-f8b8f4099827 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:44.335512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a9e1c054-2e37-404d-a7c5-f13c8cbec80f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:44.351003 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a9e1c054-2e37-404d-a7c5-f13c8cbec80f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:44.359127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a9e1c054-2e37-404d-a7c5-f13c8cbec80f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:44.360880 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a9e1c054-2e37-404d-a7c5-f13c8cbec80f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1487 microversion: 2.25 time: 0.444631 Sep 17 20:56:44.362193 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 778/1507] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:43 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1487 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:44.367990 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-57aa7349-95a3-44a5-bcb7-bb72b354cb68 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:44.388187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-57aa7349-95a3-44a5-bcb7-bb72b354cb68 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: 15f3f131-e02d-46b1-ba15-509016665f36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:44.406981 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57aa7349-95a3-44a5-bcb7-bb72b354cb68 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:44.407656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57aa7349-95a3-44a5-bcb7-bb72b354cb68 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:44.408587 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57aa7349-95a3-44a5-bcb7-bb72b354cb68 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:44.410492 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57aa7349-95a3-44a5-bcb7-bb72b354cb68 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:44.411204 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57aa7349-95a3-44a5-bcb7-bb72b354cb68 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:44.412534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57aa7349-95a3-44a5-bcb7-bb72b354cb68 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:44.500863 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-57aa7349-95a3-44a5-bcb7-bb72b354cb68 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:44.512022 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-57aa7349-95a3-44a5-bcb7-bb72b354cb68 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36" status: 200 len: 1279 microversion: 2.1 time: 0.148392 Sep 17 20:56:44.513631 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 779/1508] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:44 2022] GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36 => generated 1279 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:44.530080 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9cd197d6-aa19-4b02-aecd-98033081bced tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:44.531123 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9cd197d6-aa19-4b02-aecd-98033081bced tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:44.547054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9cd197d6-aa19-4b02-aecd-98033081bced tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:44.547867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9cd197d6-aa19-4b02-aecd-98033081bced tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:44.550072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9cd197d6-aa19-4b02-aecd-98033081bced tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:44.550936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9cd197d6-aa19-4b02-aecd-98033081bced tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:44.551658 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9cd197d6-aa19-4b02-aecd-98033081bced tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:44.556814 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9cd197d6-aa19-4b02-aecd-98033081bced tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:44.590542 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-67bc20c5-6ccc-4af8-93ef-f8b8f4099827 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:44.599684 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-67bc20c5-6ccc-4af8-93ef-f8b8f4099827 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 200 len: 1308 microversion: 2.1 time: 0.382974 Sep 17 20:56:44.614648 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 730/1509] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:44 2022] GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 1308 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:44.624013 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-98930eb3-416c-4b6b-aeca-ab68e0f3c9f0 tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:44.642065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98930eb3-416c-4b6b-aeca-ab68e0f3c9f0 tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:44.642990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98930eb3-416c-4b6b-aeca-ab68e0f3c9f0 tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:44.643656 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98930eb3-416c-4b6b-aeca-ab68e0f3c9f0 tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:44.645002 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98930eb3-416c-4b6b-aeca-ab68e0f3c9f0 tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:44.648670 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98930eb3-416c-4b6b-aeca-ab68e0f3c9f0 tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:44.650233 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98930eb3-416c-4b6b-aeca-ab68e0f3c9f0 tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:44.703976 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-98930eb3-416c-4b6b-aeca-ab68e0f3c9f0 tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.088024 Sep 17 20:56:44.713541 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 731/1510] 10.222.0.26 () {58 vars in 1176 bytes} [Sat Sep 17 20:56:44 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:56:44.727286 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-69eeb19e-3c77-45c3-aaa6-2990749f0812 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:44.728844 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-69eeb19e-3c77-45c3-aaa6-2990749f0812 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:44.746549 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69eeb19e-3c77-45c3-aaa6-2990749f0812 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:44.750922 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69eeb19e-3c77-45c3-aaa6-2990749f0812 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:44.752160 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69eeb19e-3c77-45c3-aaa6-2990749f0812 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:44.753440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69eeb19e-3c77-45c3-aaa6-2990749f0812 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:44.755615 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69eeb19e-3c77-45c3-aaa6-2990749f0812 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:44.756201 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69eeb19e-3c77-45c3-aaa6-2990749f0812 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:44.799467 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9cd197d6-aa19-4b02-aecd-98033081bced tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:44.812836 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9cd197d6-aa19-4b02-aecd-98033081bced tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1355 microversion: 2.1 time: 0.297268 Sep 17 20:56:44.814556 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 780/1511] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:44 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1355 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:44.834129 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-9e4d6929-0905-4705-934b-50944f6a945f req-45e18576-6efb-4058-ad23-efa5b47a2a74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be2b42c6-7d99-48b0-b515-26a7139e11aa", "tag": "6eb514c0-157c-49ae-bba8-9c080043b38a"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:44.845929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-9e4d6929-0905-4705-934b-50944f6a945f req-45e18576-6efb-4058-ad23-efa5b47a2a74 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:44.846851 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-9e4d6929-0905-4705-934b-50944f6a945f req-45e18576-6efb-4058-ad23-efa5b47a2a74 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:44.847442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-9e4d6929-0905-4705-934b-50944f6a945f req-45e18576-6efb-4058-ad23-efa5b47a2a74 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:44.863577 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-9e4d6929-0905-4705-934b-50944f6a945f req-45e18576-6efb-4058-ad23-efa5b47a2a74 service nova] Creating event network-changed:6eb514c0-157c-49ae-bba8-9c080043b38a for instance be2b42c6-7d99-48b0-b515-26a7139e11aa on nch2-master-1 Sep 17 20:56:44.871273 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-9e4d6929-0905-4705-934b-50944f6a945f req-45e18576-6efb-4058-ad23-efa5b47a2a74 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044086 Sep 17 20:56:44.872709 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 781/1512] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:56:44.878558 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bbe3e630-dea6-4060-985f-cd2619e66a67 tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:44.881016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bbe3e630-dea6-4060-985f-cd2619e66a67 tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] [instance: f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:44.904014 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbe3e630-dea6-4060-985f-cd2619e66a67 tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:44.904941 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbe3e630-dea6-4060-985f-cd2619e66a67 tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:44.905618 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbe3e630-dea6-4060-985f-cd2619e66a67 tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:44.906899 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbe3e630-dea6-4060-985f-cd2619e66a67 tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:44.907611 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbe3e630-dea6-4060-985f-cd2619e66a67 tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:44.908244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbe3e630-dea6-4060-985f-cd2619e66a67 tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:44.956622 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-bbe3e630-dea6-4060-985f-cd2619e66a67 tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Lazy-loading 'flavor' on Instance uuid f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:56:44.974761 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-bbe3e630-dea6-4060-985f-cd2619e66a67 tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 while it is in vm_state suspended Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bbe3e630-dea6-4060-985f-cd2619e66a67 tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Request method failure captured: Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518/action HTTP/1.1 Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 97 Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjRV8lXApDawh87rP-7iSle3iKtFwaJ_a_EyyN3j7tinVzV3k7-EQiqORpaWu01ckf7CLlY1q6W-2QKteFbolWAacT0VM_aksQVmsYqdj3fI1-mM29yI3VbJkBXVAJoX4Wvc4v8s0VrkG6yLe9sM5C2iVeNJFZVwVa-8ZNZYwIzg9iQ Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: d937c43c346a4286ab80fda4c4601c89 Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-LiveMigrationNegativeTest-358699538 Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: X-Role: admin,member,reader Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: admin,member,reader Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d937c43c346a4286ab80fda4c4601c89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d937c43c346a4286ab80fda4c4601c89"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d937c43c346a4286ab80fda4c4601c89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d937c43c346a4286ab80fda4c4601c89", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-LiveMigrationNegativeTest-358699538 Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: d937c43c346a4286ab80fda4c4601c89 Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-358699538 Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-LiveMigrationNegativeTest-358699538-project-admin Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 491d2b684eb94a33a4b7a2b4d1bcaf49 Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-LiveMigrationNegativeTest-358699538-project-admin Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: exception: Cannot 'os-migrateLive' instance f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 while it is in vm_state suspended Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518', 'body': {'os-migrateLive': {'host': 'nch2-master-1', 'block_migration': True, 'disk_over_commit': False}}} Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 in vm_state suspended. Cannot live_migrate while the instance is in this state. Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:56:44.977501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:56:44.983070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:56:44.983070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:56:44.983070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:56:44.983070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:56:44.983070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:56:44.983070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:56:44.983070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:56:44.983070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:56:44.983070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:56:44.983070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:56:44.983070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:56:44.983070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 17 20:56:44.983070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Sep 17 20:56:44.983070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 17 20:56:44.983070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 17 20:56:44.983070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 17 20:56:44.983070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 while it is in vm_state suspended Sep 17 20:56:44.983070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:56:44.983070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:56:44.983070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:56:44.983070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:56:44.983070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:56:44.983070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:56:44.983070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:56:44.983070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:56:44.983070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 while it is in vm_state suspended Sep 17 20:56:44.983070 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:56:44.986888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bbe3e630-dea6-4060-985f-cd2619e66a67 tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 while it is in vm_state suspended {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:56:44.988277 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bbe3e630-dea6-4060-985f-cd2619e66a67 tempest-LiveMigrationNegativeTest-358699538 tempest-LiveMigrationNegativeTest-358699538-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518/action" status: 409 len: 155 microversion: 2.1 time: 0.114431 Sep 17 20:56:44.996367 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 782/1513] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:56:44 2022] POST /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518/action => generated 155 bytes in 123 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 17 20:56:45.002002 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-09673679-eaef-40bf-89bd-d8d58b9801cb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:45.003470 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-09673679-eaef-40bf-89bd-d8d58b9801cb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:45.008535 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-69eeb19e-3c77-45c3-aaa6-2990749f0812 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:45.011926 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09673679-eaef-40bf-89bd-d8d58b9801cb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:45.012585 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09673679-eaef-40bf-89bd-d8d58b9801cb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:45.013716 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09673679-eaef-40bf-89bd-d8d58b9801cb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:45.014425 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09673679-eaef-40bf-89bd-d8d58b9801cb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:45.015091 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09673679-eaef-40bf-89bd-d8d58b9801cb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:45.015780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09673679-eaef-40bf-89bd-d8d58b9801cb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:45.017556 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-69eeb19e-3c77-45c3-aaa6-2990749f0812 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1522 microversion: 2.1 time: 0.301560 Sep 17 20:56:45.018232 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 732/1514] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:44 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:45.042138 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d6965827-444c-4a81-b012-40837a4a8b34 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:45.042975 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d6965827-444c-4a81-b012-40837a4a8b34 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:45.050150 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d6965827-444c-4a81-b012-40837a4a8b34 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:45.050929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d6965827-444c-4a81-b012-40837a4a8b34 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:45.052409 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d6965827-444c-4a81-b012-40837a4a8b34 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:45.053335 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d6965827-444c-4a81-b012-40837a4a8b34 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:45.054011 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d6965827-444c-4a81-b012-40837a4a8b34 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:45.054636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d6965827-444c-4a81-b012-40837a4a8b34 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:45.092815 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d6965827-444c-4a81-b012-40837a4a8b34 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:56:45.211095 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d6965827-444c-4a81-b012-40837a4a8b34 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518" status: 204 len: 0 microversion: 2.1 time: 0.180187 Sep 17 20:56:45.212279 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 733/1515] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:56:45 2022] DELETE /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:56:45.231580 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5eb6c14c-f397-4b5c-ad41-ba6bd8955878 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:45.233215 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5eb6c14c-f397-4b5c-ad41-ba6bd8955878 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:45.242548 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5eb6c14c-f397-4b5c-ad41-ba6bd8955878 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:45.243409 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5eb6c14c-f397-4b5c-ad41-ba6bd8955878 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:45.244072 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5eb6c14c-f397-4b5c-ad41-ba6bd8955878 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:45.245056 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5eb6c14c-f397-4b5c-ad41-ba6bd8955878 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:45.245779 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5eb6c14c-f397-4b5c-ad41-ba6bd8955878 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:45.246451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5eb6c14c-f397-4b5c-ad41-ba6bd8955878 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:45.247246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:45.305764 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-09673679-eaef-40bf-89bd-d8d58b9801cb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:45.323655 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-09673679-eaef-40bf-89bd-d8d58b9801cb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:45.325517 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-09673679-eaef-40bf-89bd-d8d58b9801cb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:45.327202 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-09673679-eaef-40bf-89bd-d8d58b9801cb tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1880 microversion: 2.32 time: 0.329248 Sep 17 20:56:45.328810 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 783/1516] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:44 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1880 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:45.390253 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-da1fc6dc-fbfc-493d-8a91-66d5a9482dc5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:45.391116 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-da1fc6dc-fbfc-493d-8a91-66d5a9482dc5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:45.410544 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-da1fc6dc-fbfc-493d-8a91-66d5a9482dc5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:45.411425 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-da1fc6dc-fbfc-493d-8a91-66d5a9482dc5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:45.411957 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-da1fc6dc-fbfc-493d-8a91-66d5a9482dc5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:45.414271 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-da1fc6dc-fbfc-493d-8a91-66d5a9482dc5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:45.415554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-da1fc6dc-fbfc-493d-8a91-66d5a9482dc5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:45.416175 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-da1fc6dc-fbfc-493d-8a91-66d5a9482dc5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:45.537220 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5eb6c14c-f397-4b5c-ad41-ba6bd8955878 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:45.558233 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5eb6c14c-f397-4b5c-ad41-ba6bd8955878 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518" status: 200 len: 1465 microversion: 2.1 time: 0.340926 Sep 17 20:56:45.574875 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 734/1517] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:45 2022] GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 => generated 1465 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:45.580856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-46805f83-5276-4ec0-8ec7-7d04452ddd9e req-fdc0140a-b6f3-44c4-8f69-d29ff1ee22d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b13c98-aea4-497c-a213-142393b2758c", "name": "network-vif-plugged", "status": "completed", "tag": "2adbeae0-ecea-4ae6-bf73-c7bf555f5367"}, {"server_uuid": "22b13c98-aea4-497c-a213-142393b2758c", "name": "network-vif-plugged", "status": "completed", "tag": "fac0a530-6799-4e5d-bb72-c716e7db5b00"}, {"server_uuid": "22b13c98-aea4-497c-a213-142393b2758c", "name": "network-vif-plugged", "status": "completed", "tag": "650223c4-4cf1-497c-9804-f7fb7d683a92"}, {"server_uuid": "22b13c98-aea4-497c-a213-142393b2758c", "name": "network-vif-plugged", "status": "completed", "tag": "6825902e-5439-42f2-847a-d4c7f3aaf775"}, {"server_uuid": "22b13c98-aea4-497c-a213-142393b2758c", "name": "network-vif-plugged", "status": "completed", "tag": "e15c3f2b-0cbb-44da-8610-207b8c1ec7bc"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:45.611360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-46805f83-5276-4ec0-8ec7-7d04452ddd9e req-fdc0140a-b6f3-44c4-8f69-d29ff1ee22d5 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:45.612084 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-46805f83-5276-4ec0-8ec7-7d04452ddd9e req-fdc0140a-b6f3-44c4-8f69-d29ff1ee22d5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:45.613165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-46805f83-5276-4ec0-8ec7-7d04452ddd9e req-fdc0140a-b6f3-44c4-8f69-d29ff1ee22d5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:45.642441 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-46805f83-5276-4ec0-8ec7-7d04452ddd9e req-fdc0140a-b6f3-44c4-8f69-d29ff1ee22d5 service nova] Creating event network-vif-plugged:2adbeae0-ecea-4ae6-bf73-c7bf555f5367 for instance 22b13c98-aea4-497c-a213-142393b2758c on nch2-master-1 Sep 17 20:56:45.643353 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-46805f83-5276-4ec0-8ec7-7d04452ddd9e req-fdc0140a-b6f3-44c4-8f69-d29ff1ee22d5 service nova] Creating event network-vif-plugged:fac0a530-6799-4e5d-bb72-c716e7db5b00 for instance 22b13c98-aea4-497c-a213-142393b2758c on nch2-master-1 Sep 17 20:56:45.643974 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-46805f83-5276-4ec0-8ec7-7d04452ddd9e req-fdc0140a-b6f3-44c4-8f69-d29ff1ee22d5 service nova] Creating event network-vif-plugged:650223c4-4cf1-497c-9804-f7fb7d683a92 for instance 22b13c98-aea4-497c-a213-142393b2758c on nch2-master-1 Sep 17 20:56:45.646187 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-46805f83-5276-4ec0-8ec7-7d04452ddd9e req-fdc0140a-b6f3-44c4-8f69-d29ff1ee22d5 service nova] Creating event network-vif-plugged:6825902e-5439-42f2-847a-d4c7f3aaf775 for instance 22b13c98-aea4-497c-a213-142393b2758c on nch2-master-1 Sep 17 20:56:45.647198 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-46805f83-5276-4ec0-8ec7-7d04452ddd9e req-fdc0140a-b6f3-44c4-8f69-d29ff1ee22d5 service nova] Creating event network-vif-plugged:e15c3f2b-0cbb-44da-8610-207b8c1ec7bc for instance 22b13c98-aea4-497c-a213-142393b2758c on nch2-master-1 Sep 17 20:56:45.656129 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-46805f83-5276-4ec0-8ec7-7d04452ddd9e req-fdc0140a-b6f3-44c4-8f69-d29ff1ee22d5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.079512 Sep 17 20:56:45.658022 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 735/1518] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:56:45.683242 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-66c08712-4f0a-43e1-940d-746a73722f15 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:45.694702 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-66c08712-4f0a-43e1-940d-746a73722f15 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: 15f3f131-e02d-46b1-ba15-509016665f36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:45.710754 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-66c08712-4f0a-43e1-940d-746a73722f15 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:45.712021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-66c08712-4f0a-43e1-940d-746a73722f15 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:45.712739 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-66c08712-4f0a-43e1-940d-746a73722f15 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:45.714463 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-66c08712-4f0a-43e1-940d-746a73722f15 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:45.723961 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-66c08712-4f0a-43e1-940d-746a73722f15 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:45.728514 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-66c08712-4f0a-43e1-940d-746a73722f15 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:45.776334 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-da1fc6dc-fbfc-493d-8a91-66d5a9482dc5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:45.788666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:45.834574 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-da1fc6dc-fbfc-493d-8a91-66d5a9482dc5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:45.839357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-da1fc6dc-fbfc-493d-8a91-66d5a9482dc5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:45.848065 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-da1fc6dc-fbfc-493d-8a91-66d5a9482dc5 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1487 microversion: 2.25 time: 0.461147 Sep 17 20:56:45.849212 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 784/1519] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:45 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1487 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 20:56:45.874883 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e7ca8be5-5ea9-4793-a290-ddfb666b66e0 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:45.875840 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e7ca8be5-5ea9-4793-a290-ddfb666b66e0 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:45.904505 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7ca8be5-5ea9-4793-a290-ddfb666b66e0 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:45.905012 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7ca8be5-5ea9-4793-a290-ddfb666b66e0 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:45.906593 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-66c08712-4f0a-43e1-940d-746a73722f15 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:45.912231 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7ca8be5-5ea9-4793-a290-ddfb666b66e0 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:45.916142 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7ca8be5-5ea9-4793-a290-ddfb666b66e0 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:45.917789 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-66c08712-4f0a-43e1-940d-746a73722f15 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36" status: 200 len: 1279 microversion: 2.1 time: 0.257431 Sep 17 20:56:45.919554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7ca8be5-5ea9-4793-a290-ddfb666b66e0 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:45.920382 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7ca8be5-5ea9-4793-a290-ddfb666b66e0 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:45.925511 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 736/1520] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:45 2022] GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36 => generated 1279 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:45.935197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8e4eae1c-7037-4d83-b90a-e5247907a648 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:45.936090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8e4eae1c-7037-4d83-b90a-e5247907a648 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:45.953364 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8e4eae1c-7037-4d83-b90a-e5247907a648 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:45.954511 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8e4eae1c-7037-4d83-b90a-e5247907a648 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:45.955427 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8e4eae1c-7037-4d83-b90a-e5247907a648 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:45.956422 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8e4eae1c-7037-4d83-b90a-e5247907a648 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:45.957196 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8e4eae1c-7037-4d83-b90a-e5247907a648 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:45.957854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8e4eae1c-7037-4d83-b90a-e5247907a648 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:46.303223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e7ca8be5-5ea9-4793-a290-ddfb666b66e0 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:46.313270 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e7ca8be5-5ea9-4793-a290-ddfb666b66e0 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 200 len: 1308 microversion: 2.1 time: 0.461978 Sep 17 20:56:46.314316 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 785/1521] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:45 2022] GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 1308 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:46.319684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c8a2424a-7b30-4ab4-be4b-566bd0117172 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:46.320293 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c8a2424a-7b30-4ab4-be4b-566bd0117172 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:46.328376 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8a2424a-7b30-4ab4-be4b-566bd0117172 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:46.329021 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8a2424a-7b30-4ab4-be4b-566bd0117172 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:46.330000 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8a2424a-7b30-4ab4-be4b-566bd0117172 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:46.330494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8a2424a-7b30-4ab4-be4b-566bd0117172 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:46.330962 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8a2424a-7b30-4ab4-be4b-566bd0117172 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:46.331491 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8a2424a-7b30-4ab4-be4b-566bd0117172 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:46.353790 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8e4eae1c-7037-4d83-b90a-e5247907a648 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:46.363005 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8e4eae1c-7037-4d83-b90a-e5247907a648 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1355 microversion: 2.1 time: 0.435021 Sep 17 20:56:46.363943 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 737/1522] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:45 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1355 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:46.368901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b177f310-4b4a-43eb-b1be-2c282ddb89d3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:46.369822 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b177f310-4b4a-43eb-b1be-2c282ddb89d3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:46.376443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b177f310-4b4a-43eb-b1be-2c282ddb89d3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:46.377247 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b177f310-4b4a-43eb-b1be-2c282ddb89d3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:46.377960 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b177f310-4b4a-43eb-b1be-2c282ddb89d3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:46.378844 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b177f310-4b4a-43eb-b1be-2c282ddb89d3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:46.379476 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b177f310-4b4a-43eb-b1be-2c282ddb89d3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:46.379907 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b177f310-4b4a-43eb-b1be-2c282ddb89d3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:46.655707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c8a2424a-7b30-4ab4-be4b-566bd0117172 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:46.666690 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c8a2424a-7b30-4ab4-be4b-566bd0117172 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1522 microversion: 2.1 time: 0.350989 Sep 17 20:56:46.667751 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 786/1523] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:46 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:46.672750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8127a111-9d91-4a3f-a34d-e0ea27e626f0 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:46.673363 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8127a111-9d91-4a3f-a34d-e0ea27e626f0 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:46.682565 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8127a111-9d91-4a3f-a34d-e0ea27e626f0 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:46.683309 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8127a111-9d91-4a3f-a34d-e0ea27e626f0 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:46.683943 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8127a111-9d91-4a3f-a34d-e0ea27e626f0 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:46.684816 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8127a111-9d91-4a3f-a34d-e0ea27e626f0 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:46.685270 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8127a111-9d91-4a3f-a34d-e0ea27e626f0 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:46.685739 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8127a111-9d91-4a3f-a34d-e0ea27e626f0 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:46.685888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b177f310-4b4a-43eb-b1be-2c282ddb89d3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:46.696223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b177f310-4b4a-43eb-b1be-2c282ddb89d3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:46.697870 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b177f310-4b4a-43eb-b1be-2c282ddb89d3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:46.699087 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b177f310-4b4a-43eb-b1be-2c282ddb89d3 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1880 microversion: 2.32 time: 0.333824 Sep 17 20:56:46.700136 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 738/1524] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:46 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1880 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:46.704745 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-35b74a39-b982-47a5-be8e-b8142640150b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2145245216", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "eb85edb1-9d13-4b48-a02b-116c5b437767"}], "block_device_mapping_v2": [{"uuid": "67568702-e073-4ebf-aeae-310160ebcb1e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:46.779172 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-35b74a39-b982-47a5-be8e-b8142640150b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] validate_networks() for [('eb85edb1-9d13-4b48-a02b-116c5b437767', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:56:46.921945 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8127a111-9d91-4a3f-a34d-e0ea27e626f0 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:46.938528 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8127a111-9d91-4a3f-a34d-e0ea27e626f0 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518" status: 200 len: 1465 microversion: 2.1 time: 0.267813 Sep 17 20:56:46.939470 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 787/1525] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:46 2022] GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 => generated 1465 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:46.951867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-896f6bf0-e608-4c6a-b894-39e5737d1a83 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:46.953069 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-896f6bf0-e608-4c6a-b894-39e5737d1a83 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:46.967705 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-896f6bf0-e608-4c6a-b894-39e5737d1a83 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:46.968207 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-896f6bf0-e608-4c6a-b894-39e5737d1a83 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:46.968783 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-896f6bf0-e608-4c6a-b894-39e5737d1a83 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:46.969357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-896f6bf0-e608-4c6a-b894-39e5737d1a83 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:46.972369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-896f6bf0-e608-4c6a-b894-39e5737d1a83 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:46.972817 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-896f6bf0-e608-4c6a-b894-39e5737d1a83 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:47.243598 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-896f6bf0-e608-4c6a-b894-39e5737d1a83 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:47.253707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-896f6bf0-e608-4c6a-b894-39e5737d1a83 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:47.255387 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-896f6bf0-e608-4c6a-b894-39e5737d1a83 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:47.256791 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-896f6bf0-e608-4c6a-b894-39e5737d1a83 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1487 microversion: 2.25 time: 0.315362 Sep 17 20:56:47.257511 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 788/1526] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:46 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1487 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:47.262521 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-51574f61-fda8-4e91-a82a-4b9395d23b5f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:47.263210 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-51574f61-fda8-4e91-a82a-4b9395d23b5f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: 15f3f131-e02d-46b1-ba15-509016665f36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:47.269711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-51574f61-fda8-4e91-a82a-4b9395d23b5f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:47.270209 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-51574f61-fda8-4e91-a82a-4b9395d23b5f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:47.270652 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-51574f61-fda8-4e91-a82a-4b9395d23b5f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:47.271370 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-51574f61-fda8-4e91-a82a-4b9395d23b5f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:47.271829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-51574f61-fda8-4e91-a82a-4b9395d23b5f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:47.272274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-51574f61-fda8-4e91-a82a-4b9395d23b5f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:47.378189 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-35b74a39-b982-47a5-be8e-b8142640150b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:56:47.380127 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-35b74a39-b982-47a5-be8e-b8142640150b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:56:47.380940 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-35b74a39-b982-47a5-be8e-b8142640150b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:56:47.382557 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-35b74a39-b982-47a5-be8e-b8142640150b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:56:47.383336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-35b74a39-b982-47a5-be8e-b8142640150b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:56:47.398435 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35b74a39-b982-47a5-be8e-b8142640150b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:47.399313 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35b74a39-b982-47a5-be8e-b8142640150b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:47.399931 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35b74a39-b982-47a5-be8e-b8142640150b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:47.400861 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35b74a39-b982-47a5-be8e-b8142640150b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:47.401649 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35b74a39-b982-47a5-be8e-b8142640150b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:47.403213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35b74a39-b982-47a5-be8e-b8142640150b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:47.428048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-35b74a39-b982-47a5-be8e-b8142640150b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Getting quotas for project f6b44bc44e7c4a998bfd99e7d11e99fc. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:56:47.434197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-35b74a39-b982-47a5-be8e-b8142640150b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Getting quotas for user 9c2b746b7c194596808a7b0c736f3b53 and project f6b44bc44e7c4a998bfd99e7d11e99fc. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:56:47.469900 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-51574f61-fda8-4e91-a82a-4b9395d23b5f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:47.479963 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-51574f61-fda8-4e91-a82a-4b9395d23b5f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36" status: 200 len: 1321 microversion: 2.1 time: 0.221250 Sep 17 20:56:47.481282 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 789/1527] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:47 2022] GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36 => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:47.503303 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e35077bd-1f53-497c-94c0-411a912b77a1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:47.504765 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e35077bd-1f53-497c-94c0-411a912b77a1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:47.509148 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-35b74a39-b982-47a5-be8e-b8142640150b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:56:47.511952 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-35b74a39-b982-47a5-be8e-b8142640150b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='67568702-e073-4ebf-aeae-310160ebcb1e',volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:56:47.515006 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e35077bd-1f53-497c-94c0-411a912b77a1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:47.516502 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e35077bd-1f53-497c-94c0-411a912b77a1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:47.517406 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e35077bd-1f53-497c-94c0-411a912b77a1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:47.520007 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e35077bd-1f53-497c-94c0-411a912b77a1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:47.520831 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e35077bd-1f53-497c-94c0-411a912b77a1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:47.522255 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e35077bd-1f53-497c-94c0-411a912b77a1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:47.775680 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e35077bd-1f53-497c-94c0-411a912b77a1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:47.785667 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-35b74a39-b982-47a5-be8e-b8142640150b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.084222 Sep 17 20:56:47.786241 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e35077bd-1f53-497c-94c0-411a912b77a1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 200 len: 1308 microversion: 2.1 time: 0.302734 Sep 17 20:56:47.786530 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 739/1528] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:56:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:56:47.787298 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 790/1529] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:47 2022] GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 1308 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:47.792555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-23db1330-a193-40b0-ab5d-da2da65d8fe4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:47.792875 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-72b5a00d-2f2d-4cab-ab30-8c1381b80475 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:47.793858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-72b5a00d-2f2d-4cab-ab30-8c1381b80475 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:47.794237 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-23db1330-a193-40b0-ab5d-da2da65d8fe4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:47.801951 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-23db1330-a193-40b0-ab5d-da2da65d8fe4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:47.802436 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72b5a00d-2f2d-4cab-ab30-8c1381b80475 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:47.802940 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-23db1330-a193-40b0-ab5d-da2da65d8fe4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:47.803230 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72b5a00d-2f2d-4cab-ab30-8c1381b80475 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:47.803787 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-23db1330-a193-40b0-ab5d-da2da65d8fe4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:47.803937 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72b5a00d-2f2d-4cab-ab30-8c1381b80475 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:47.804846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72b5a00d-2f2d-4cab-ab30-8c1381b80475 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:47.805145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-23db1330-a193-40b0-ab5d-da2da65d8fe4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:47.805578 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72b5a00d-2f2d-4cab-ab30-8c1381b80475 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:47.805964 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-23db1330-a193-40b0-ab5d-da2da65d8fe4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:47.806314 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72b5a00d-2f2d-4cab-ab30-8c1381b80475 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:47.806717 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-23db1330-a193-40b0-ab5d-da2da65d8fe4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:47.826141 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:48.080383 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-72b5a00d-2f2d-4cab-ab30-8c1381b80475 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:48.092240 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-72b5a00d-2f2d-4cab-ab30-8c1381b80475 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1522 microversion: 2.1 time: 0.303598 Sep 17 20:56:48.096677 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 791/1530] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:47 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:48.134098 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-23db1330-a193-40b0-ab5d-da2da65d8fe4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:48.136105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-818f56e4-358a-4851-8476-3b6709ac3a3a tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:48.138619 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-818f56e4-358a-4851-8476-3b6709ac3a3a tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:48.144088 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-23db1330-a193-40b0-ab5d-da2da65d8fe4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1355 microversion: 2.1 time: 0.356230 Sep 17 20:56:48.145482 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 740/1531] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:47 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1355 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:48.150890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-1c8cd928-a08c-4850-9078-b72c816e9de8 req-5da6e146-4510-4f40-a143-b0a77dd8a4aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08", "name": "network-vif-plugged", "status": "completed", "tag": "55685621-d375-4d51-80b4-1c25904556be"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:48.151317 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:48.155538 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-818f56e4-358a-4851-8476-3b6709ac3a3a tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:48.156061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-818f56e4-358a-4851-8476-3b6709ac3a3a tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:48.158617 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-818f56e4-358a-4851-8476-3b6709ac3a3a tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:48.159642 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-818f56e4-358a-4851-8476-3b6709ac3a3a tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:48.160379 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-818f56e4-358a-4851-8476-3b6709ac3a3a tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:48.162001 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-818f56e4-358a-4851-8476-3b6709ac3a3a tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:48.164869 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-1c8cd928-a08c-4850-9078-b72c816e9de8 req-5da6e146-4510-4f40-a143-b0a77dd8a4aa service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:48.165718 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-1c8cd928-a08c-4850-9078-b72c816e9de8 req-5da6e146-4510-4f40-a143-b0a77dd8a4aa service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:48.166527 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-1c8cd928-a08c-4850-9078-b72c816e9de8 req-5da6e146-4510-4f40-a143-b0a77dd8a4aa service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:48.181427 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-1c8cd928-a08c-4850-9078-b72c816e9de8 req-5da6e146-4510-4f40-a143-b0a77dd8a4aa service nova] Creating event network-vif-plugged:55685621-d375-4d51-80b4-1c25904556be for instance b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 on nch2-master-1 Sep 17 20:56:48.186635 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-1c8cd928-a08c-4850-9078-b72c816e9de8 req-5da6e146-4510-4f40-a143-b0a77dd8a4aa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039480 Sep 17 20:56:48.187540 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 741/1532] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:56:48.192938 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-91515da4-fab3-4d61-9580-d91cc74001cd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:48.193671 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-91515da4-fab3-4d61-9580-d91cc74001cd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:48.400726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-91515da4-fab3-4d61-9580-d91cc74001cd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:48.409267 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-91515da4-fab3-4d61-9580-d91cc74001cd tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1053 microversion: 2.1 time: 0.220485 Sep 17 20:56:48.410515 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 742/1533] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:48 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1053 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:48.415652 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1d7a05f0-c730-429c-9292-252a6009a3c5 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:48.416671 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1d7a05f0-c730-429c-9292-252a6009a3c5 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:48.423265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1d7a05f0-c730-429c-9292-252a6009a3c5 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:48.423980 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1d7a05f0-c730-429c-9292-252a6009a3c5 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:48.424592 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1d7a05f0-c730-429c-9292-252a6009a3c5 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:48.425298 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1d7a05f0-c730-429c-9292-252a6009a3c5 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:48.426173 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1d7a05f0-c730-429c-9292-252a6009a3c5 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:48.426822 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1d7a05f0-c730-429c-9292-252a6009a3c5 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:48.490978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-818f56e4-358a-4851-8476-3b6709ac3a3a tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:48.501992 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-818f56e4-358a-4851-8476-3b6709ac3a3a tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:48.504113 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-818f56e4-358a-4851-8476-3b6709ac3a3a tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:48.505699 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-818f56e4-358a-4851-8476-3b6709ac3a3a tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 2832 microversion: 2.32 time: 0.407840 Sep 17 20:56:48.507246 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 792/1534] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:48 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 2832 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:48.512344 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-adc125ca-efa2-4c58-8f79-94c39936f133 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:48.513060 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-adc125ca-efa2-4c58-8f79-94c39936f133 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:48.520432 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-adc125ca-efa2-4c58-8f79-94c39936f133 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:48.521384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-adc125ca-efa2-4c58-8f79-94c39936f133 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:48.521596 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-adc125ca-efa2-4c58-8f79-94c39936f133 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:48.522395 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-adc125ca-efa2-4c58-8f79-94c39936f133 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:48.523255 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-adc125ca-efa2-4c58-8f79-94c39936f133 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:48.523933 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-adc125ca-efa2-4c58-8f79-94c39936f133 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:48.687476 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1d7a05f0-c730-429c-9292-252a6009a3c5 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:48.699562 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1d7a05f0-c730-429c-9292-252a6009a3c5 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518" status: 200 len: 1465 microversion: 2.1 time: 0.286336 Sep 17 20:56:48.700606 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 743/1535] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:48 2022] GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 => generated 1465 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:48.707780 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9bdf217c-60bc-4267-b920-809e92dad006 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:48.708795 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9bdf217c-60bc-4267-b920-809e92dad006 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: 15f3f131-e02d-46b1-ba15-509016665f36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:48.716033 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9bdf217c-60bc-4267-b920-809e92dad006 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:48.716736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9bdf217c-60bc-4267-b920-809e92dad006 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:48.717361 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9bdf217c-60bc-4267-b920-809e92dad006 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:48.718529 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9bdf217c-60bc-4267-b920-809e92dad006 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:48.719110 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9bdf217c-60bc-4267-b920-809e92dad006 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:48.719691 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9bdf217c-60bc-4267-b920-809e92dad006 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:48.735740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-adc125ca-efa2-4c58-8f79-94c39936f133 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:48.745534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-adc125ca-efa2-4c58-8f79-94c39936f133 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:48.747465 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-adc125ca-efa2-4c58-8f79-94c39936f133 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:48.748880 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-adc125ca-efa2-4c58-8f79-94c39936f133 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1487 microversion: 2.25 time: 0.240324 Sep 17 20:56:48.749881 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 793/1536] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:48 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1487 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:48.755196 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ebb20b8d-2fc1-47c4-bba5-150fa68cc1e4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:48.758060 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ebb20b8d-2fc1-47c4-bba5-150fa68cc1e4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:48.764265 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ebb20b8d-2fc1-47c4-bba5-150fa68cc1e4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:48.765112 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ebb20b8d-2fc1-47c4-bba5-150fa68cc1e4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:48.765857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ebb20b8d-2fc1-47c4-bba5-150fa68cc1e4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:48.766916 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ebb20b8d-2fc1-47c4-bba5-150fa68cc1e4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:48.767721 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ebb20b8d-2fc1-47c4-bba5-150fa68cc1e4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:48.769073 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ebb20b8d-2fc1-47c4-bba5-150fa68cc1e4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:48.931323 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ebb20b8d-2fc1-47c4-bba5-150fa68cc1e4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.177609 Sep 17 20:56:48.935456 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 794/1537] 10.222.0.26 () {60 vars in 1316 bytes} [Sat Sep 17 20:56:48 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c/os-interface => generated 1831 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:48.941581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1d772a6c-6c74-4066-bf17-36061622c730 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:48.942464 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1d772a6c-6c74-4066-bf17-36061622c730 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:48.952254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d772a6c-6c74-4066-bf17-36061622c730 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:48.953991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d772a6c-6c74-4066-bf17-36061622c730 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:48.954720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d772a6c-6c74-4066-bf17-36061622c730 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:48.956292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d772a6c-6c74-4066-bf17-36061622c730 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:48.956944 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d772a6c-6c74-4066-bf17-36061622c730 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:48.958319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d772a6c-6c74-4066-bf17-36061622c730 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:48.969752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9bdf217c-60bc-4267-b920-809e92dad006 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:48.996205 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9bdf217c-60bc-4267-b920-809e92dad006 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36" status: 200 len: 1321 microversion: 2.1 time: 0.294219 Sep 17 20:56:48.999383 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 744/1538] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:48 2022] GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36 => generated 1321 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:49.116019 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e50508b6-085b-409e-a839-16a0e2f552e2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:49.116636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e50508b6-085b-409e-a839-16a0e2f552e2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:49.130144 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e50508b6-085b-409e-a839-16a0e2f552e2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:49.131244 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e50508b6-085b-409e-a839-16a0e2f552e2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:49.131707 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e50508b6-085b-409e-a839-16a0e2f552e2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:49.132440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e50508b6-085b-409e-a839-16a0e2f552e2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:49.132960 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e50508b6-085b-409e-a839-16a0e2f552e2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:49.133396 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e50508b6-085b-409e-a839-16a0e2f552e2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:49.201316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1d772a6c-6c74-4066-bf17-36061622c730 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:49.215172 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1d772a6c-6c74-4066-bf17-36061622c730 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 200 len: 1308 microversion: 2.1 time: 0.278265 Sep 17 20:56:49.221017 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 795/1539] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:48 2022] GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 1308 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:49.226176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-489fa2fc-8047-4423-8d40-e0053def803b tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:49.226938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-489fa2fc-8047-4423-8d40-e0053def803b tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:49.245414 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-489fa2fc-8047-4423-8d40-e0053def803b tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:49.246008 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-489fa2fc-8047-4423-8d40-e0053def803b tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:49.246530 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-489fa2fc-8047-4423-8d40-e0053def803b tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:49.247184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-489fa2fc-8047-4423-8d40-e0053def803b tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:49.247665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-489fa2fc-8047-4423-8d40-e0053def803b tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:49.248101 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-489fa2fc-8047-4423-8d40-e0053def803b tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:49.381399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e50508b6-085b-409e-a839-16a0e2f552e2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:49.390175 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e50508b6-085b-409e-a839-16a0e2f552e2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1522 microversion: 2.1 time: 0.278008 Sep 17 20:56:49.390770 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 745/1540] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:49 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:56:49.401526 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-8a90028a-536b-42de-a75b-625a607d6543 req-0ad4378a-e516-4cfc-ba39-1e64ff359ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518", "name": "network-vif-deleted", "tag": "49c488cd-8158-4484-962f-4bfa74f75c62"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:49.425602 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8a90028a-536b-42de-a75b-625a607d6543 req-0ad4378a-e516-4cfc-ba39-1e64ff359ee5 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:49.428614 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8a90028a-536b-42de-a75b-625a607d6543 req-0ad4378a-e516-4cfc-ba39-1e64ff359ee5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:49.431038 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8a90028a-536b-42de-a75b-625a607d6543 req-0ad4378a-e516-4cfc-ba39-1e64ff359ee5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:49.455890 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-8a90028a-536b-42de-a75b-625a607d6543 req-0ad4378a-e516-4cfc-ba39-1e64ff359ee5 service nova] Creating event network-vif-deleted:49c488cd-8158-4484-962f-4bfa74f75c62 for instance f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 on nch1-master-1 Sep 17 20:56:49.461019 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:49.491091 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-8a90028a-536b-42de-a75b-625a607d6543 req-0ad4378a-e516-4cfc-ba39-1e64ff359ee5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079182 Sep 17 20:56:49.495408 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 746/1541] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:56:49.499134 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-489fa2fc-8047-4423-8d40-e0053def803b tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:49.509019 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-489fa2fc-8047-4423-8d40-e0053def803b tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1355 microversion: 2.1 time: 0.286845 Sep 17 20:56:49.510246 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 796/1542] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:49 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1355 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:49.513283 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f70332e1-7f06-4e08-8432-359fb9f46e07 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:49.522769 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f70332e1-7f06-4e08-8432-359fb9f46e07 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:49.541097 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f70332e1-7f06-4e08-8432-359fb9f46e07 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:49.541097 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f70332e1-7f06-4e08-8432-359fb9f46e07 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:49.541097 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f70332e1-7f06-4e08-8432-359fb9f46e07 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:49.542624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f70332e1-7f06-4e08-8432-359fb9f46e07 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:49.543104 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f70332e1-7f06-4e08-8432-359fb9f46e07 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:49.543551 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f70332e1-7f06-4e08-8432-359fb9f46e07 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:49.654521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f70332e1-7f06-4e08-8432-359fb9f46e07 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:49.665681 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f70332e1-7f06-4e08-8432-359fb9f46e07 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1103 microversion: 2.1 time: 0.168593 Sep 17 20:56:49.666320 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 747/1543] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:49 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1103 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:49.724135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0c06c2d7-124d-4f64-86d6-c57f19b968b8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:49.724755 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0c06c2d7-124d-4f64-86d6-c57f19b968b8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:49.734018 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c06c2d7-124d-4f64-86d6-c57f19b968b8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:49.734789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c06c2d7-124d-4f64-86d6-c57f19b968b8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:49.735229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c06c2d7-124d-4f64-86d6-c57f19b968b8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:49.736303 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c06c2d7-124d-4f64-86d6-c57f19b968b8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:49.736926 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c06c2d7-124d-4f64-86d6-c57f19b968b8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:49.737407 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c06c2d7-124d-4f64-86d6-c57f19b968b8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:49.774922 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c06c2d7-124d-4f64-86d6-c57f19b968b8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:49.775946 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c06c2d7-124d-4f64-86d6-c57f19b968b8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:49.776547 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c06c2d7-124d-4f64-86d6-c57f19b968b8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:49.777171 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-0c06c2d7-124d-4f64-86d6-c57f19b968b8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lazy-loading 'fault' on Instance uuid f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:56:49.779674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f58a0c04-3efe-4a9f-a2a8-f0932f0b49fa tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:49.780318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f58a0c04-3efe-4a9f-a2a8-f0932f0b49fa tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:49.796601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f58a0c04-3efe-4a9f-a2a8-f0932f0b49fa tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:49.798003 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f58a0c04-3efe-4a9f-a2a8-f0932f0b49fa tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:49.799583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f58a0c04-3efe-4a9f-a2a8-f0932f0b49fa tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:49.803044 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f58a0c04-3efe-4a9f-a2a8-f0932f0b49fa tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:49.803809 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f58a0c04-3efe-4a9f-a2a8-f0932f0b49fa tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:49.804318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f58a0c04-3efe-4a9f-a2a8-f0932f0b49fa tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:49.823751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0c06c2d7-124d-4f64-86d6-c57f19b968b8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:49.847292 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0c06c2d7-124d-4f64-86d6-c57f19b968b8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518" status: 200 len: 1309 microversion: 2.1 time: 0.127374 Sep 17 20:56:49.848168 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 797/1544] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:49 2022] GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 => generated 1309 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:50.003458 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f58a0c04-3efe-4a9f-a2a8-f0932f0b49fa tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:50.012999 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f58a0c04-3efe-4a9f-a2a8-f0932f0b49fa tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:50.014456 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f58a0c04-3efe-4a9f-a2a8-f0932f0b49fa tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:50.015728 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f58a0c04-3efe-4a9f-a2a8-f0932f0b49fa tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1487 microversion: 2.25 time: 0.241681 Sep 17 20:56:50.016310 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 748/1545] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:49 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1487 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:50.029681 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e6d4e9c7-dd94-48d2-aab8-814d0609806d tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:50.031667 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e6d4e9c7-dd94-48d2-aab8-814d0609806d tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: 15f3f131-e02d-46b1-ba15-509016665f36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:50.035701 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=10 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:50.040424 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6d4e9c7-dd94-48d2-aab8-814d0609806d tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:50.042317 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6d4e9c7-dd94-48d2-aab8-814d0609806d tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:50.043047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6d4e9c7-dd94-48d2-aab8-814d0609806d tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:50.044567 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6d4e9c7-dd94-48d2-aab8-814d0609806d tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:50.045052 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6d4e9c7-dd94-48d2-aab8-814d0609806d tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:50.045862 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6d4e9c7-dd94-48d2-aab8-814d0609806d tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:50.207626 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e6d4e9c7-dd94-48d2-aab8-814d0609806d tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:50.211430 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-21431009-c547-4670-a68c-25eb9c96a8fc req-84f0f68d-133d-44da-aad6-be1d75aff689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be2b42c6-7d99-48b0-b515-26a7139e11aa", "name": "network-vif-plugged", "status": "completed", "tag": "6eb514c0-157c-49ae-bba8-9c080043b38a"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:50.219132 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e6d4e9c7-dd94-48d2-aab8-814d0609806d tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36" status: 200 len: 1321 microversion: 2.1 time: 0.195230 Sep 17 20:56:50.220112 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 798/1546] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:50 2022] GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36 => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:50.230219 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-21431009-c547-4670-a68c-25eb9c96a8fc req-84f0f68d-133d-44da-aad6-be1d75aff689 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:50.230716 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-21431009-c547-4670-a68c-25eb9c96a8fc req-84f0f68d-133d-44da-aad6-be1d75aff689 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:50.234927 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-21431009-c547-4670-a68c-25eb9c96a8fc req-84f0f68d-133d-44da-aad6-be1d75aff689 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:50.243485 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-21f85283-8e21-4f03-be98-ef5c656c80a4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:50.244229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-21f85283-8e21-4f03-be98-ef5c656c80a4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:50.251251 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-21f85283-8e21-4f03-be98-ef5c656c80a4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:50.251931 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-21f85283-8e21-4f03-be98-ef5c656c80a4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:50.252644 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-21f85283-8e21-4f03-be98-ef5c656c80a4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:50.253812 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-21f85283-8e21-4f03-be98-ef5c656c80a4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:50.254206 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-21f85283-8e21-4f03-be98-ef5c656c80a4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:50.254705 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-21f85283-8e21-4f03-be98-ef5c656c80a4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:50.269587 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-21431009-c547-4670-a68c-25eb9c96a8fc req-84f0f68d-133d-44da-aad6-be1d75aff689 service nova] Creating event network-vif-plugged:6eb514c0-157c-49ae-bba8-9c080043b38a for instance be2b42c6-7d99-48b0-b515-26a7139e11aa on nch2-master-1 Sep 17 20:56:50.277618 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-21431009-c547-4670-a68c-25eb9c96a8fc req-84f0f68d-133d-44da-aad6-be1d75aff689 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072507 Sep 17 20:56:50.278804 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 749/1547] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:56:50.418402 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8de44bcb-8674-480e-ab0c-02abef6e3cb9 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:50.419810 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8de44bcb-8674-480e-ab0c-02abef6e3cb9 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:50.433143 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8de44bcb-8674-480e-ab0c-02abef6e3cb9 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:50.436010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8de44bcb-8674-480e-ab0c-02abef6e3cb9 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:50.436936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-21f85283-8e21-4f03-be98-ef5c656c80a4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:50.438945 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8de44bcb-8674-480e-ab0c-02abef6e3cb9 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:50.442427 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8de44bcb-8674-480e-ab0c-02abef6e3cb9 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:50.443875 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8de44bcb-8674-480e-ab0c-02abef6e3cb9 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:50.446489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8de44bcb-8674-480e-ab0c-02abef6e3cb9 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:50.451256 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-21f85283-8e21-4f03-be98-ef5c656c80a4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 200 len: 1308 microversion: 2.1 time: 0.213087 Sep 17 20:56:50.480274 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 799/1548] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:50 2022] GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 1308 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:56:50.532689 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-16def74d-bc21-4281-a542-3b12bde2aab6 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:50.533813 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-16def74d-bc21-4281-a542-3b12bde2aab6 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:50.543137 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-16def74d-bc21-4281-a542-3b12bde2aab6 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:50.543906 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-16def74d-bc21-4281-a542-3b12bde2aab6 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:50.544510 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-16def74d-bc21-4281-a542-3b12bde2aab6 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:50.545569 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-16def74d-bc21-4281-a542-3b12bde2aab6 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:50.546534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-16def74d-bc21-4281-a542-3b12bde2aab6 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:50.546997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-16def74d-bc21-4281-a542-3b12bde2aab6 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:50.755164 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8de44bcb-8674-480e-ab0c-02abef6e3cb9 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:50.772074 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8de44bcb-8674-480e-ab0c-02abef6e3cb9 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1507 microversion: 2.1 time: 0.359214 Sep 17 20:56:50.773299 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 750/1549] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:50 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1507 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:50.776672 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-16def74d-bc21-4281-a542-3b12bde2aab6 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:50.779465 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-44363de8-03a7-4b40-8f36-692e7dac84e6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:50.783471 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-44363de8-03a7-4b40-8f36-692e7dac84e6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:50.786645 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-16def74d-bc21-4281-a542-3b12bde2aab6 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1355 microversion: 2.1 time: 0.258119 Sep 17 20:56:50.787885 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 800/1550] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:50 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1355 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:50.793653 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44363de8-03a7-4b40-8f36-692e7dac84e6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:50.794484 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44363de8-03a7-4b40-8f36-692e7dac84e6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:50.795094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44363de8-03a7-4b40-8f36-692e7dac84e6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:50.795872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44363de8-03a7-4b40-8f36-692e7dac84e6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:50.796402 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44363de8-03a7-4b40-8f36-692e7dac84e6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:50.797029 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44363de8-03a7-4b40-8f36-692e7dac84e6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:50.808118 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-22c81972-7206-4b40-84ed-f8809dbc6b7b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:50.809084 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-22c81972-7206-4b40-84ed-f8809dbc6b7b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:50.817441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-22c81972-7206-4b40-84ed-f8809dbc6b7b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:50.818244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-22c81972-7206-4b40-84ed-f8809dbc6b7b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:50.818953 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-22c81972-7206-4b40-84ed-f8809dbc6b7b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:50.819842 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-22c81972-7206-4b40-84ed-f8809dbc6b7b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:50.820547 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-22c81972-7206-4b40-84ed-f8809dbc6b7b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:50.821302 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-22c81972-7206-4b40-84ed-f8809dbc6b7b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:50.839286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:50.912184 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-44363de8-03a7-4b40-8f36-692e7dac84e6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:50.922190 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-44363de8-03a7-4b40-8f36-692e7dac84e6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1151 microversion: 2.1 time: 0.147206 Sep 17 20:56:50.922780 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 751/1551] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:50 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1151 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:50.946044 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bd569509-70dc-4435-8316-b0df9c728aaf tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:50.947562 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bd569509-70dc-4435-8316-b0df9c728aaf tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:50.955009 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd569509-70dc-4435-8316-b0df9c728aaf tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:50.955668 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd569509-70dc-4435-8316-b0df9c728aaf tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:50.956174 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd569509-70dc-4435-8316-b0df9c728aaf tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:50.957257 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd569509-70dc-4435-8316-b0df9c728aaf tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:50.957836 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd569509-70dc-4435-8316-b0df9c728aaf tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:50.958479 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd569509-70dc-4435-8316-b0df9c728aaf tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:50.978756 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-bd569509-70dc-4435-8316-b0df9c728aaf tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] HTTP exception thrown: Instance f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 could not be found. Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bd569509-70dc-4435-8316-b0df9c728aaf tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Request method failure captured: Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 HTTP/1.1 Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjRUIdrzVty6bDGHEFjhlfeM4IUSfmP_SxoJ_sIO5eoq6kJW5qj0YPRC8-APFRI9z9F4XJFBpEfbo_QDdiHykbDwonnrbYvoCcZswDcHdt2wiCm4_R22G5mMZozMh2i5T0eb2K8KAq7QOkEhpNoeZg8r3JAzq65IbB0eEHWoiu0KrAs Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: eee008b613cd468f9b996e915ced3074 Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-LiveMigrationNegativeTest-1292703711 Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eee008b613cd468f9b996e915ced3074"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/eee008b613cd468f9b996e915ced3074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eee008b613cd468f9b996e915ced3074"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_eee008b613cd468f9b996e915ced3074", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-LiveMigrationNegativeTest-1292703711 Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: eee008b613cd468f9b996e915ced3074 Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1292703711 Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-LiveMigrationNegativeTest-1292703711-project Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 6fe33ab0e3394b7ea6b1b0b29f444e53 Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-LiveMigrationNegativeTest-1292703711-project Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 could not be found. Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518'} Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 could not be found. Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 could not be found. Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:56:50.980874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:56:50.986404 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:56:50.986404 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:56:50.986404 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:56:50.986404 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:56:50.986404 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:56:50.986404 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 could not be found. Sep 17 20:56:50.986404 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:56:50.987933 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bd569509-70dc-4435-8316-b0df9c728aaf tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Returning 404 to user: Instance f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:56:50.988062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-22c81972-7206-4b40-84ed-f8809dbc6b7b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:50.989193 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bd569509-70dc-4435-8316-b0df9c728aaf tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518" status: 404 len: 111 microversion: 2.1 time: 0.048196 Sep 17 20:56:50.990007 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 752/1552] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:50 2022] GET /compute/v2.1/servers/f0ff08b7-4fa5-42ed-ad6d-9d2fe4ef9518 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:56:50.999589 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9ef04f04-171d-4dc3-b67c-308dcc74006b tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:51.000292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9ef04f04-171d-4dc3-b67c-308dcc74006b tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: c8aaf21a-21d2-485f-8df0-2d2e43f00a57] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:51.000901 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-22c81972-7206-4b40-84ed-f8809dbc6b7b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 200 len: 1507 microversion: 2.1 time: 0.209986 Sep 17 20:56:51.001608 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 801/1553] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:50 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 1507 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:51.007431 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9ef04f04-171d-4dc3-b67c-308dcc74006b tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:51.008052 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9ef04f04-171d-4dc3-b67c-308dcc74006b tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:51.008499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9ef04f04-171d-4dc3-b67c-308dcc74006b tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:51.009215 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9ef04f04-171d-4dc3-b67c-308dcc74006b tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:51.009709 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9ef04f04-171d-4dc3-b67c-308dcc74006b tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:51.010140 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9ef04f04-171d-4dc3-b67c-308dcc74006b tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:51.025615 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8bd6fc17-f718-4649-98ed-7284f1e28fa2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:51.026229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8bd6fc17-f718-4649-98ed-7284f1e28fa2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:51.033675 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bd6fc17-f718-4649-98ed-7284f1e28fa2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:51.035014 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bd6fc17-f718-4649-98ed-7284f1e28fa2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:51.038092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bd6fc17-f718-4649-98ed-7284f1e28fa2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:51.039151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bd6fc17-f718-4649-98ed-7284f1e28fa2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:51.039717 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bd6fc17-f718-4649-98ed-7284f1e28fa2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:51.040919 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bd6fc17-f718-4649-98ed-7284f1e28fa2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:51.042642 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9ef04f04-171d-4dc3-b67c-308dcc74006b tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: c8aaf21a-21d2-485f-8df0-2d2e43f00a57] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:56:51.089036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8bd6fc17-f718-4649-98ed-7284f1e28fa2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:56:51.190970 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9ef04f04-171d-4dc3-b67c-308dcc74006b tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57" status: 204 len: 0 microversion: 2.1 time: 0.195483 Sep 17 20:56:51.193790 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 753/1554] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:56:50 2022] DELETE /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:56:51.203953 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8bd6fc17-f718-4649-98ed-7284f1e28fa2 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 204 len: 0 microversion: 2.1 time: 0.182462 Sep 17 20:56:51.204627 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 802/1555] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:56:51 2022] DELETE /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 17 20:56:51.205752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0d9e2863-ca89-447f-8a1d-aeae9876c1ab tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:51.208074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0d9e2863-ca89-447f-8a1d-aeae9876c1ab tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:51.217917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d9e2863-ca89-447f-8a1d-aeae9876c1ab tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:51.218420 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d9e2863-ca89-447f-8a1d-aeae9876c1ab tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:51.219674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d9e2863-ca89-447f-8a1d-aeae9876c1ab tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:51.220459 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d9e2863-ca89-447f-8a1d-aeae9876c1ab tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:51.221085 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d9e2863-ca89-447f-8a1d-aeae9876c1ab tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:51.221590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d9e2863-ca89-447f-8a1d-aeae9876c1ab tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:51.225593 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-727dec60-0fd7-4206-8f73-9388b1bb64b8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:51.226290 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-727dec60-0fd7-4206-8f73-9388b1bb64b8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: c8aaf21a-21d2-485f-8df0-2d2e43f00a57] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:51.234541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-727dec60-0fd7-4206-8f73-9388b1bb64b8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:51.235750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-727dec60-0fd7-4206-8f73-9388b1bb64b8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:51.236229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-727dec60-0fd7-4206-8f73-9388b1bb64b8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:51.237042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-727dec60-0fd7-4206-8f73-9388b1bb64b8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:51.239111 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-727dec60-0fd7-4206-8f73-9388b1bb64b8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:51.239111 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-727dec60-0fd7-4206-8f73-9388b1bb64b8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:51.446865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-727dec60-0fd7-4206-8f73-9388b1bb64b8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:51.456961 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-727dec60-0fd7-4206-8f73-9388b1bb64b8 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57" status: 200 len: 1474 microversion: 2.1 time: 0.245962 Sep 17 20:56:51.459355 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 803/1556] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:51 2022] GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57 => generated 1474 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:51.468924 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-56aec965-3d9a-41ff-89af-bb8036e840bc tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:51.470063 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-56aec965-3d9a-41ff-89af-bb8036e840bc tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: 15f3f131-e02d-46b1-ba15-509016665f36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:51.481060 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56aec965-3d9a-41ff-89af-bb8036e840bc tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:51.482074 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56aec965-3d9a-41ff-89af-bb8036e840bc tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:51.482785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56aec965-3d9a-41ff-89af-bb8036e840bc tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:51.483875 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56aec965-3d9a-41ff-89af-bb8036e840bc tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:51.484568 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56aec965-3d9a-41ff-89af-bb8036e840bc tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:51.485209 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56aec965-3d9a-41ff-89af-bb8036e840bc tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:51.602325 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0d9e2863-ca89-447f-8a1d-aeae9876c1ab tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:51.612818 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0d9e2863-ca89-447f-8a1d-aeae9876c1ab tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:51.614634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0d9e2863-ca89-447f-8a1d-aeae9876c1ab tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:51.617055 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0d9e2863-ca89-447f-8a1d-aeae9876c1ab tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1487 microversion: 2.25 time: 0.421913 Sep 17 20:56:51.618620 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 754/1557] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:51 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1487 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:51.624549 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a9c7191b-1216-40a6-92e5-1a4a5c6c4b91 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-205840722", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "c1a7aff7-16bc-489c-b88f-724a10b4c0a6"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:51.709199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-a9c7191b-1216-40a6-92e5-1a4a5c6c4b91 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] validate_networks() for [('c1a7aff7-16bc-489c-b88f-724a10b4c0a6', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:56:51.722432 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-56aec965-3d9a-41ff-89af-bb8036e840bc tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:51.733181 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-56aec965-3d9a-41ff-89af-bb8036e840bc tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36" status: 200 len: 1321 microversion: 2.1 time: 0.271475 Sep 17 20:56:51.738738 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 804/1558] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:51 2022] GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36 => generated 1321 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:51.746340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-406b8335-0838-4fad-a257-b6c3aec8bcb2 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:51.747548 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-406b8335-0838-4fad-a257-b6c3aec8bcb2 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:51.756146 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-406b8335-0838-4fad-a257-b6c3aec8bcb2 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:51.756952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-406b8335-0838-4fad-a257-b6c3aec8bcb2 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:51.757639 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-406b8335-0838-4fad-a257-b6c3aec8bcb2 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:51.758514 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-406b8335-0838-4fad-a257-b6c3aec8bcb2 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:51.758991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-406b8335-0838-4fad-a257-b6c3aec8bcb2 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:51.759548 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-406b8335-0838-4fad-a257-b6c3aec8bcb2 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:51.973080 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-406b8335-0838-4fad-a257-b6c3aec8bcb2 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:51.981243 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-406b8335-0838-4fad-a257-b6c3aec8bcb2 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 200 len: 1308 microversion: 2.1 time: 0.241020 Sep 17 20:56:51.981864 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 805/1559] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:51 2022] GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 1308 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:51.986726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-281704a6-d335-48da-a5c0-1ab7190326aa req-4b221585-759d-4f7a-88e0-ddb0b6042c42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15f3f131-e02d-46b1-ba15-509016665f36", "tag": "9b9fb41b-b40c-44a0-bc52-610120eb986a"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:51.999695 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-281704a6-d335-48da-a5c0-1ab7190326aa req-4b221585-759d-4f7a-88e0-ddb0b6042c42 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:52.000182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-281704a6-d335-48da-a5c0-1ab7190326aa req-4b221585-759d-4f7a-88e0-ddb0b6042c42 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:52.000612 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-281704a6-d335-48da-a5c0-1ab7190326aa req-4b221585-759d-4f7a-88e0-ddb0b6042c42 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:52.012934 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-281704a6-d335-48da-a5c0-1ab7190326aa req-4b221585-759d-4f7a-88e0-ddb0b6042c42 service nova] Creating event network-changed:9b9fb41b-b40c-44a0-bc52-610120eb986a for instance 15f3f131-e02d-46b1-ba15-509016665f36 on nch1-master-1 Sep 17 20:56:52.018307 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-281704a6-d335-48da-a5c0-1ab7190326aa req-4b221585-759d-4f7a-88e0-ddb0b6042c42 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035033 Sep 17 20:56:52.019407 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 806/1560] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:56:52.027874 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5b585abb-7437-47fa-acc9-f71014482c40 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:52.028591 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5b585abb-7437-47fa-acc9-f71014482c40 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:52.036040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b585abb-7437-47fa-acc9-f71014482c40 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:52.036710 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b585abb-7437-47fa-acc9-f71014482c40 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:52.036980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b585abb-7437-47fa-acc9-f71014482c40 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:52.037730 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b585abb-7437-47fa-acc9-f71014482c40 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:52.038189 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b585abb-7437-47fa-acc9-f71014482c40 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:52.038622 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b585abb-7437-47fa-acc9-f71014482c40 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:52.286337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5b585abb-7437-47fa-acc9-f71014482c40 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:52.298938 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5b585abb-7437-47fa-acc9-f71014482c40 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1355 microversion: 2.1 time: 0.277262 Sep 17 20:56:52.313930 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 807/1561] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:52 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1355 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:52.319932 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fef20161-876d-40ad-b84f-cb068583fe54 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:52.320313 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fef20161-876d-40ad-b84f-cb068583fe54 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:52.326800 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fef20161-876d-40ad-b84f-cb068583fe54 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:52.327470 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fef20161-876d-40ad-b84f-cb068583fe54 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:52.327597 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fef20161-876d-40ad-b84f-cb068583fe54 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:52.328229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fef20161-876d-40ad-b84f-cb068583fe54 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:52.328690 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fef20161-876d-40ad-b84f-cb068583fe54 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:52.329127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fef20161-876d-40ad-b84f-cb068583fe54 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:52.389533 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a9c7191b-1216-40a6-92e5-1a4a5c6c4b91 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:56:52.390536 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a9c7191b-1216-40a6-92e5-1a4a5c6c4b91 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:56:52.393341 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a9c7191b-1216-40a6-92e5-1a4a5c6c4b91 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:56:52.394595 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a9c7191b-1216-40a6-92e5-1a4a5c6c4b91 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:56:52.395833 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a9c7191b-1216-40a6-92e5-1a4a5c6c4b91 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:56:52.419438 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a9c7191b-1216-40a6-92e5-1a4a5c6c4b91 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:52.421043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a9c7191b-1216-40a6-92e5-1a4a5c6c4b91 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:52.422115 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a9c7191b-1216-40a6-92e5-1a4a5c6c4b91 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:52.424618 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a9c7191b-1216-40a6-92e5-1a4a5c6c4b91 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:52.425498 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a9c7191b-1216-40a6-92e5-1a4a5c6c4b91 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:52.426162 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a9c7191b-1216-40a6-92e5-1a4a5c6c4b91 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:52.461827 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-a9c7191b-1216-40a6-92e5-1a4a5c6c4b91 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Getting quotas for project 52c89ce6659b4b4b9d6a53c9a8d33b41. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:56:52.473243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-a9c7191b-1216-40a6-92e5-1a4a5c6c4b91 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Getting quotas for user d461326fa46149f5a49b278b32d9c9fb and project 52c89ce6659b4b4b9d6a53c9a8d33b41. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:56:52.488013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fef20161-876d-40ad-b84f-cb068583fe54 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:52.495815 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a9c7191b-1216-40a6-92e5-1a4a5c6c4b91 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:56:52.499001 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a9c7191b-1216-40a6-92e5-1a4a5c6c4b91 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: 15402a7f-bb11-44a8-b440-0511829670be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:56:52.506068 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fef20161-876d-40ad-b84f-cb068583fe54 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1159 microversion: 2.1 time: 0.190604 Sep 17 20:56:52.506907 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 808/1562] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:52 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1159 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:52.513168 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:52.529283 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cab1a19a-87f3-4943-90e3-00f08c6447c7 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:52.530416 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cab1a19a-87f3-4943-90e3-00f08c6447c7 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: c8aaf21a-21d2-485f-8df0-2d2e43f00a57] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:52.544381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cab1a19a-87f3-4943-90e3-00f08c6447c7 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:52.546886 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cab1a19a-87f3-4943-90e3-00f08c6447c7 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:52.547697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cab1a19a-87f3-4943-90e3-00f08c6447c7 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:52.549347 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cab1a19a-87f3-4943-90e3-00f08c6447c7 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:52.550420 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cab1a19a-87f3-4943-90e3-00f08c6447c7 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:52.551139 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cab1a19a-87f3-4943-90e3-00f08c6447c7 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:52.600609 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a9c7191b-1216-40a6-92e5-1a4a5c6c4b91 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.980841 Sep 17 20:56:52.608192 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 755/1563] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:56:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:56:52.614862 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b3e7df1a-8f47-45ac-8f1d-97a74ff55105 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:52.615573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b3e7df1a-8f47-45ac-8f1d-97a74ff55105 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: 15402a7f-bb11-44a8-b440-0511829670be] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:53.220710 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b3e7df1a-8f47-45ac-8f1d-97a74ff55105 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:53.232415 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b3e7df1a-8f47-45ac-8f1d-97a74ff55105 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be" status: 200 len: 1217 microversion: 2.1 time: 0.621633 Sep 17 20:56:53.234833 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 756/1564] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:52 2022] GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be => generated 1217 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:53.240413 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7764dd09-cfeb-41dc-9585-04dd2456e56c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:53.241257 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7764dd09-cfeb-41dc-9585-04dd2456e56c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:53.261911 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7764dd09-cfeb-41dc-9585-04dd2456e56c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:53.262417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7764dd09-cfeb-41dc-9585-04dd2456e56c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:53.262962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7764dd09-cfeb-41dc-9585-04dd2456e56c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:53.269668 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7764dd09-cfeb-41dc-9585-04dd2456e56c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:53.271240 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7764dd09-cfeb-41dc-9585-04dd2456e56c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:53.272513 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7764dd09-cfeb-41dc-9585-04dd2456e56c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:53.346571 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cab1a19a-87f3-4943-90e3-00f08c6447c7 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:53.359171 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cab1a19a-87f3-4943-90e3-00f08c6447c7 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57" status: 200 len: 1474 microversion: 2.1 time: 0.850909 Sep 17 20:56:53.365052 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 809/1565] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:52 2022] GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57 => generated 1474 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:53.370586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-501a249d-9924-496c-903c-240b49e88861 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:53.371227 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-501a249d-9924-496c-903c-240b49e88861 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: 15f3f131-e02d-46b1-ba15-509016665f36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:53.397011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-501a249d-9924-496c-903c-240b49e88861 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:53.398446 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-501a249d-9924-496c-903c-240b49e88861 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:53.402265 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-501a249d-9924-496c-903c-240b49e88861 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:53.403573 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-501a249d-9924-496c-903c-240b49e88861 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:53.404239 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-501a249d-9924-496c-903c-240b49e88861 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:53.404788 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-501a249d-9924-496c-903c-240b49e88861 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:53.577255 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7764dd09-cfeb-41dc-9585-04dd2456e56c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:53.592341 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7764dd09-cfeb-41dc-9585-04dd2456e56c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:53.594212 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7764dd09-cfeb-41dc-9585-04dd2456e56c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:53.596055 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7764dd09-cfeb-41dc-9585-04dd2456e56c tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1487 microversion: 2.25 time: 0.359722 Sep 17 20:56:53.611398 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 757/1566] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:53 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1487 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:53.635077 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-04e7c73d-3fac-4ed0-9087-a8227a91df6d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:53.636746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-04e7c73d-3fac-4ed0-9087-a8227a91df6d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:53.645623 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04e7c73d-3fac-4ed0-9087-a8227a91df6d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:53.660295 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04e7c73d-3fac-4ed0-9087-a8227a91df6d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:53.660938 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04e7c73d-3fac-4ed0-9087-a8227a91df6d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:53.663296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04e7c73d-3fac-4ed0-9087-a8227a91df6d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:53.664461 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04e7c73d-3fac-4ed0-9087-a8227a91df6d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:53.665967 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04e7c73d-3fac-4ed0-9087-a8227a91df6d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:53.674803 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-501a249d-9924-496c-903c-240b49e88861 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:53.686505 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-501a249d-9924-496c-903c-240b49e88861 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36" status: 200 len: 1321 microversion: 2.1 time: 0.319365 Sep 17 20:56:53.687218 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 810/1567] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:53 2022] GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36 => generated 1321 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:53.709840 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-988b1d6e-0761-4d91-8e89-334e9c43dc9b tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:53.710623 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-988b1d6e-0761-4d91-8e89-334e9c43dc9b tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:53.718894 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-988b1d6e-0761-4d91-8e89-334e9c43dc9b tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:53.719548 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-988b1d6e-0761-4d91-8e89-334e9c43dc9b tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:53.720073 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-988b1d6e-0761-4d91-8e89-334e9c43dc9b tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:53.721156 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-988b1d6e-0761-4d91-8e89-334e9c43dc9b tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:53.721914 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-988b1d6e-0761-4d91-8e89-334e9c43dc9b tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:53.722556 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-988b1d6e-0761-4d91-8e89-334e9c43dc9b tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:54.053736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-04e7c73d-3fac-4ed0-9087-a8227a91df6d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:54.063308 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-04e7c73d-3fac-4ed0-9087-a8227a91df6d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 200 len: 1487 microversion: 2.1 time: 0.450839 Sep 17 20:56:54.080107 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 758/1568] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:53 2022] GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 1487 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:54.083723 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7dbb4917-208d-4bef-87fd-f29f140c2b5b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:54.086025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7dbb4917-208d-4bef-87fd-f29f140c2b5b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:54.100713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7dbb4917-208d-4bef-87fd-f29f140c2b5b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:54.105033 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7dbb4917-208d-4bef-87fd-f29f140c2b5b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:54.106753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-988b1d6e-0761-4d91-8e89-334e9c43dc9b tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:54.107510 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7dbb4917-208d-4bef-87fd-f29f140c2b5b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:54.108891 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7dbb4917-208d-4bef-87fd-f29f140c2b5b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:54.109619 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7dbb4917-208d-4bef-87fd-f29f140c2b5b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:54.118006 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-988b1d6e-0761-4d91-8e89-334e9c43dc9b tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1355 microversion: 2.1 time: 0.412764 Sep 17 20:56:54.134193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7dbb4917-208d-4bef-87fd-f29f140c2b5b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:54.138484 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 811/1569] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:53 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1355 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:54.145684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-aed78c38-8303-4548-a51d-f31a21840e7d req-984f985d-aea2-41bb-a44e-25cd552b7e20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22b13c98-aea4-497c-a213-142393b2758c", "tag": "7c3cbfdf-d88c-428e-969f-2451f881cc2b"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:54.184987 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-aed78c38-8303-4548-a51d-f31a21840e7d req-984f985d-aea2-41bb-a44e-25cd552b7e20 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:54.185564 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-aed78c38-8303-4548-a51d-f31a21840e7d req-984f985d-aea2-41bb-a44e-25cd552b7e20 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:54.189974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-aed78c38-8303-4548-a51d-f31a21840e7d req-984f985d-aea2-41bb-a44e-25cd552b7e20 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:54.212105 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-aed78c38-8303-4548-a51d-f31a21840e7d req-984f985d-aea2-41bb-a44e-25cd552b7e20 service nova] Creating event network-changed:7c3cbfdf-d88c-428e-969f-2451f881cc2b for instance 22b13c98-aea4-497c-a213-142393b2758c on nch2-master-1 Sep 17 20:56:54.241359 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-aed78c38-8303-4548-a51d-f31a21840e7d req-984f985d-aea2-41bb-a44e-25cd552b7e20 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101293 Sep 17 20:56:54.242113 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 812/1570] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:56:54.258128 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-64a5fa03-0d06-4bfc-bd4c-4897147ee0db tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:54.276542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64a5fa03-0d06-4bfc-bd4c-4897147ee0db tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:54.279563 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64a5fa03-0d06-4bfc-bd4c-4897147ee0db tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:54.280470 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64a5fa03-0d06-4bfc-bd4c-4897147ee0db tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:54.282873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7dbb4917-208d-4bef-87fd-f29f140c2b5b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:54.295464 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7dbb4917-208d-4bef-87fd-f29f140c2b5b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1169 microversion: 2.1 time: 0.230000 Sep 17 20:56:54.299030 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 759/1571] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:54 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1169 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:54.312589 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7105a7c3-377d-4e2b-8888-e108802c25af tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:54.318016 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7105a7c3-377d-4e2b-8888-e108802c25af tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: 15402a7f-bb11-44a8-b440-0511829670be] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:54.329357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7105a7c3-377d-4e2b-8888-e108802c25af tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:54.332752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7105a7c3-377d-4e2b-8888-e108802c25af tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:54.333203 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7105a7c3-377d-4e2b-8888-e108802c25af tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:54.341652 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7105a7c3-377d-4e2b-8888-e108802c25af tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:54.342224 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7105a7c3-377d-4e2b-8888-e108802c25af tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:54.342667 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7105a7c3-377d-4e2b-8888-e108802c25af tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:54.366284 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-64a5fa03-0d06-4bfc-bd4c-4897147ee0db tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Going to try to stop instance {{(pid=140524) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 17 20:56:54.375942 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:54.484069 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-64a5fa03-0d06-4bfc-bd4c-4897147ee0db tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "POST /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa/action" status: 202 len: 0 microversion: 2.1 time: 0.236067 Sep 17 20:56:54.484684 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 813/1572] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:56:54 2022] POST /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:56:54.496786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9efbd7ae-86cf-45ea-a85a-f11629cfe7b9 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:54.497425 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9efbd7ae-86cf-45ea-a85a-f11629cfe7b9 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: c8aaf21a-21d2-485f-8df0-2d2e43f00a57] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:54.506910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9efbd7ae-86cf-45ea-a85a-f11629cfe7b9 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:54.508545 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9efbd7ae-86cf-45ea-a85a-f11629cfe7b9 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:54.508914 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9efbd7ae-86cf-45ea-a85a-f11629cfe7b9 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:54.509856 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9efbd7ae-86cf-45ea-a85a-f11629cfe7b9 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:54.510338 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9efbd7ae-86cf-45ea-a85a-f11629cfe7b9 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:54.511018 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9efbd7ae-86cf-45ea-a85a-f11629cfe7b9 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:54.520986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7105a7c3-377d-4e2b-8888-e108802c25af tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:54.538952 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7105a7c3-377d-4e2b-8888-e108802c25af tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be" status: 200 len: 1269 microversion: 2.1 time: 0.237792 Sep 17 20:56:54.539820 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 760/1573] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:54 2022] GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be => generated 1269 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:54.544602 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cf063655-bdfd-4771-9b5d-9e89567c345e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:54.545224 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cf063655-bdfd-4771-9b5d-9e89567c345e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:54.565590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf063655-bdfd-4771-9b5d-9e89567c345e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:54.566406 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf063655-bdfd-4771-9b5d-9e89567c345e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:54.567117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf063655-bdfd-4771-9b5d-9e89567c345e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:54.567878 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf063655-bdfd-4771-9b5d-9e89567c345e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:54.568344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf063655-bdfd-4771-9b5d-9e89567c345e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:54.568781 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf063655-bdfd-4771-9b5d-9e89567c345e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:55.059642 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cf063655-bdfd-4771-9b5d-9e89567c345e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:55.074561 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cf063655-bdfd-4771-9b5d-9e89567c345e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 200 len: 1497 microversion: 2.1 time: 0.533442 Sep 17 20:56:55.075891 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 761/1574] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:54 2022] GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 1497 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:55.082382 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9efbd7ae-86cf-45ea-a85a-f11629cfe7b9 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:55.109992 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9efbd7ae-86cf-45ea-a85a-f11629cfe7b9 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57" status: 200 len: 1474 microversion: 2.1 time: 0.619373 Sep 17 20:56:55.111524 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 814/1575] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:54 2022] GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57 => generated 1474 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:55.118374 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-942eeb2e-856e-405a-9008-c1a2dde6f8ef tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:55.120081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-942eeb2e-856e-405a-9008-c1a2dde6f8ef tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:55.129575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e7508af3-26b8-403f-b1ae-51f9e833dd1a tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:55.132558 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e7508af3-26b8-403f-b1ae-51f9e833dd1a tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: 15f3f131-e02d-46b1-ba15-509016665f36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:55.144884 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-942eeb2e-856e-405a-9008-c1a2dde6f8ef tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:55.145810 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-942eeb2e-856e-405a-9008-c1a2dde6f8ef tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:55.148014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-942eeb2e-856e-405a-9008-c1a2dde6f8ef tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:55.150945 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-942eeb2e-856e-405a-9008-c1a2dde6f8ef tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:55.151373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-942eeb2e-856e-405a-9008-c1a2dde6f8ef tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:55.153973 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7508af3-26b8-403f-b1ae-51f9e833dd1a tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:55.155048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-942eeb2e-856e-405a-9008-c1a2dde6f8ef tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:55.156099 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7508af3-26b8-403f-b1ae-51f9e833dd1a tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:55.158798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7508af3-26b8-403f-b1ae-51f9e833dd1a tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:55.159986 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7508af3-26b8-403f-b1ae-51f9e833dd1a tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:55.162389 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7508af3-26b8-403f-b1ae-51f9e833dd1a tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:55.164835 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7508af3-26b8-403f-b1ae-51f9e833dd1a tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:55.641776 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e7508af3-26b8-403f-b1ae-51f9e833dd1a tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:55.647753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-942eeb2e-856e-405a-9008-c1a2dde6f8ef tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:55.659137 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e7508af3-26b8-403f-b1ae-51f9e833dd1a tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36" status: 200 len: 1321 microversion: 2.1 time: 0.545909 Sep 17 20:56:55.661245 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 815/1576] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:55 2022] GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36 => generated 1321 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:55.666090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-942eeb2e-856e-405a-9008-c1a2dde6f8ef tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:55.669596 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9324e4d2-cda6-4c2e-8048-5bfd44a5e522 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:55.670628 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9324e4d2-cda6-4c2e-8048-5bfd44a5e522 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:55.679789 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-942eeb2e-856e-405a-9008-c1a2dde6f8ef tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:55.680510 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9324e4d2-cda6-4c2e-8048-5bfd44a5e522 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:55.681256 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9324e4d2-cda6-4c2e-8048-5bfd44a5e522 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:55.681995 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9324e4d2-cda6-4c2e-8048-5bfd44a5e522 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:55.683769 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-942eeb2e-856e-405a-9008-c1a2dde6f8ef tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1487 microversion: 2.25 time: 0.587508 Sep 17 20:56:55.684185 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9324e4d2-cda6-4c2e-8048-5bfd44a5e522 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:55.684545 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 762/1577] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:55 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1487 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:55.685041 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9324e4d2-cda6-4c2e-8048-5bfd44a5e522 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:55.686930 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9324e4d2-cda6-4c2e-8048-5bfd44a5e522 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:55.693031 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-db493a01-0bb5-4ceb-a22b-61121cbdeedc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:55.693997 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-db493a01-0bb5-4ceb-a22b-61121cbdeedc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:55.708139 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db493a01-0bb5-4ceb-a22b-61121cbdeedc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:55.710113 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db493a01-0bb5-4ceb-a22b-61121cbdeedc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:55.710768 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db493a01-0bb5-4ceb-a22b-61121cbdeedc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:55.712890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db493a01-0bb5-4ceb-a22b-61121cbdeedc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:55.714647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db493a01-0bb5-4ceb-a22b-61121cbdeedc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:55.715611 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db493a01-0bb5-4ceb-a22b-61121cbdeedc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:55.856523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-db493a01-0bb5-4ceb-a22b-61121cbdeedc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:55.873671 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-db493a01-0bb5-4ceb-a22b-61121cbdeedc tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1157 microversion: 2.1 time: 0.186583 Sep 17 20:56:55.893603 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 763/1578] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:55 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1157 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:55.904757 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a53a8595-fb6d-4d2b-8a65-90660e939914 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:55.905845 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a53a8595-fb6d-4d2b-8a65-90660e939914 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: 15402a7f-bb11-44a8-b440-0511829670be] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:55.914454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a53a8595-fb6d-4d2b-8a65-90660e939914 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:55.915225 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a53a8595-fb6d-4d2b-8a65-90660e939914 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:55.915837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a53a8595-fb6d-4d2b-8a65-90660e939914 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:55.916835 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a53a8595-fb6d-4d2b-8a65-90660e939914 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:55.917782 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a53a8595-fb6d-4d2b-8a65-90660e939914 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:55.918341 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a53a8595-fb6d-4d2b-8a65-90660e939914 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:56.010597 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9324e4d2-cda6-4c2e-8048-5bfd44a5e522 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:56.013566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:56:56.023290 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9324e4d2-cda6-4c2e-8048-5bfd44a5e522 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1355 microversion: 2.1 time: 0.359651 Sep 17 20:56:56.024099 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 816/1579] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:55 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1355 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:56.033530 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a53a8595-fb6d-4d2b-8a65-90660e939914 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:56.050598 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a53a8595-fb6d-4d2b-8a65-90660e939914 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be" status: 200 len: 1275 microversion: 2.1 time: 0.151547 Sep 17 20:56:56.052048 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 764/1580] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:55 2022] GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be => generated 1275 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:56.109841 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ff229c6d-2dab-46d8-a2d7-e02c0b78e3c7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:56.111061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ff229c6d-2dab-46d8-a2d7-e02c0b78e3c7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:56.134235 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff229c6d-2dab-46d8-a2d7-e02c0b78e3c7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:56.136237 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff229c6d-2dab-46d8-a2d7-e02c0b78e3c7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:56.136842 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff229c6d-2dab-46d8-a2d7-e02c0b78e3c7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:56.138808 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff229c6d-2dab-46d8-a2d7-e02c0b78e3c7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:56.139587 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1d58cfe7-a78c-4a5e-8416-6ddd201d6d52 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:56.140216 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1d58cfe7-a78c-4a5e-8416-6ddd201d6d52 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: c8aaf21a-21d2-485f-8df0-2d2e43f00a57] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:56.140679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff229c6d-2dab-46d8-a2d7-e02c0b78e3c7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:56.144858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff229c6d-2dab-46d8-a2d7-e02c0b78e3c7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:56.148153 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1d58cfe7-a78c-4a5e-8416-6ddd201d6d52 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:56.148653 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1d58cfe7-a78c-4a5e-8416-6ddd201d6d52 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:56.149088 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1d58cfe7-a78c-4a5e-8416-6ddd201d6d52 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:56.149914 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1d58cfe7-a78c-4a5e-8416-6ddd201d6d52 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:56.150366 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1d58cfe7-a78c-4a5e-8416-6ddd201d6d52 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:56.150788 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1d58cfe7-a78c-4a5e-8416-6ddd201d6d52 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:56.439244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ff229c6d-2dab-46d8-a2d7-e02c0b78e3c7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:56.454259 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ff229c6d-2dab-46d8-a2d7-e02c0b78e3c7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 200 len: 1497 microversion: 2.1 time: 0.352699 Sep 17 20:56:56.454549 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1d58cfe7-a78c-4a5e-8416-6ddd201d6d52 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:56.456599 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 817/1581] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:56 2022] GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 1497 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:56.473069 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1d58cfe7-a78c-4a5e-8416-6ddd201d6d52 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57" status: 200 len: 1474 microversion: 2.1 time: 0.337752 Sep 17 20:56:56.477295 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 765/1582] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:56 2022] GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57 => generated 1474 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:56:56.487580 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-96ec6f0d-a078-4750-8383-9884e4a61283 req-7ea515fa-87c7-4201-839b-c44fe1ece911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08", "name": "network-vif-deleted", "tag": "55685621-d375-4d51-80b4-1c25904556be"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:56.504298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-96ec6f0d-a078-4750-8383-9884e4a61283 req-7ea515fa-87c7-4201-839b-c44fe1ece911 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:56.505275 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-96ec6f0d-a078-4750-8383-9884e4a61283 req-7ea515fa-87c7-4201-839b-c44fe1ece911 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:56.506053 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-96ec6f0d-a078-4750-8383-9884e4a61283 req-7ea515fa-87c7-4201-839b-c44fe1ece911 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:56.522442 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-96ec6f0d-a078-4750-8383-9884e4a61283 req-7ea515fa-87c7-4201-839b-c44fe1ece911 service nova] Creating event network-vif-deleted:55685621-d375-4d51-80b4-1c25904556be for instance b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 on nch2-master-1 Sep 17 20:56:56.529002 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-96ec6f0d-a078-4750-8383-9884e4a61283 req-7ea515fa-87c7-4201-839b-c44fe1ece911 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069180 Sep 17 20:56:56.530469 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 818/1583] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:56:56.699375 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f2673933-f7d4-4a95-a550-5eb3dda1cd3b tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:56.700520 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f2673933-f7d4-4a95-a550-5eb3dda1cd3b tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: 15f3f131-e02d-46b1-ba15-509016665f36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:56.709059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2673933-f7d4-4a95-a550-5eb3dda1cd3b tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:56.710487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2673933-f7d4-4a95-a550-5eb3dda1cd3b tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:56.713179 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2b523e95-b3fe-47dd-b965-0ca5011aa8b2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:56.714000 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2b523e95-b3fe-47dd-b965-0ca5011aa8b2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:56.715623 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2673933-f7d4-4a95-a550-5eb3dda1cd3b tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:56.716683 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2673933-f7d4-4a95-a550-5eb3dda1cd3b tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:56.717389 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2673933-f7d4-4a95-a550-5eb3dda1cd3b tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:56.720901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2673933-f7d4-4a95-a550-5eb3dda1cd3b tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:56.728014 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b523e95-b3fe-47dd-b965-0ca5011aa8b2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:56.728568 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b523e95-b3fe-47dd-b965-0ca5011aa8b2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:56.729247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b523e95-b3fe-47dd-b965-0ca5011aa8b2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:56.730274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b523e95-b3fe-47dd-b965-0ca5011aa8b2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:56.735979 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b523e95-b3fe-47dd-b965-0ca5011aa8b2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:56.736689 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b523e95-b3fe-47dd-b965-0ca5011aa8b2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:57.194778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2b523e95-b3fe-47dd-b965-0ca5011aa8b2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:57.217919 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2b523e95-b3fe-47dd-b965-0ca5011aa8b2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:57.240923 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2b523e95-b3fe-47dd-b965-0ca5011aa8b2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:57.242698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f2673933-f7d4-4a95-a550-5eb3dda1cd3b tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:57.249238 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2b523e95-b3fe-47dd-b965-0ca5011aa8b2 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1477 microversion: 2.25 time: 0.539874 Sep 17 20:56:57.253250 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 819/1584] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:56 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1477 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:57.258209 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f2673933-f7d4-4a95-a550-5eb3dda1cd3b tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36" status: 200 len: 1321 microversion: 2.1 time: 0.569345 Sep 17 20:56:57.259328 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 766/1585] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:56 2022] GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36 => generated 1321 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:57.262803 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c3d5b6d8-52a2-4235-8237-48fc052daa81 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:57.263436 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c3d5b6d8-52a2-4235-8237-48fc052daa81 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:57.267732 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b676c374-cf8c-49c3-a690-ae90a93723c0 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:57.268575 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b676c374-cf8c-49c3-a690-ae90a93723c0 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:57.279086 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3d5b6d8-52a2-4235-8237-48fc052daa81 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:57.279639 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3d5b6d8-52a2-4235-8237-48fc052daa81 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:57.281784 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b676c374-cf8c-49c3-a690-ae90a93723c0 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:57.282483 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3d5b6d8-52a2-4235-8237-48fc052daa81 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:57.282857 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b676c374-cf8c-49c3-a690-ae90a93723c0 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:57.283410 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3d5b6d8-52a2-4235-8237-48fc052daa81 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:57.284711 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b676c374-cf8c-49c3-a690-ae90a93723c0 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:57.287136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3d5b6d8-52a2-4235-8237-48fc052daa81 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:57.287315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b676c374-cf8c-49c3-a690-ae90a93723c0 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:57.287736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b676c374-cf8c-49c3-a690-ae90a93723c0 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:57.288016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3d5b6d8-52a2-4235-8237-48fc052daa81 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:57.288593 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b676c374-cf8c-49c3-a690-ae90a93723c0 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:57.820852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c3d5b6d8-52a2-4235-8237-48fc052daa81 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:57.823770 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b676c374-cf8c-49c3-a690-ae90a93723c0 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:57.832965 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c3d5b6d8-52a2-4235-8237-48fc052daa81 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1199 microversion: 2.1 time: 0.577244 Sep 17 20:56:57.834303 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b676c374-cf8c-49c3-a690-ae90a93723c0 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1355 microversion: 2.1 time: 0.573644 Sep 17 20:56:57.837313 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 767/1586] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:57 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1355 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:57.846021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-22b6e04c-f007-464a-ae31-4e5363ffba84 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:57.847188 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-22b6e04c-f007-464a-ae31-4e5363ffba84 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: 15402a7f-bb11-44a8-b440-0511829670be] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:57.852797 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 820/1587] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:57 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1199 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:57.854447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-22b6e04c-f007-464a-ae31-4e5363ffba84 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:57.855107 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-22b6e04c-f007-464a-ae31-4e5363ffba84 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:57.855836 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-22b6e04c-f007-464a-ae31-4e5363ffba84 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:57.856787 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-22b6e04c-f007-464a-ae31-4e5363ffba84 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:57.857399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-22b6e04c-f007-464a-ae31-4e5363ffba84 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:57.858108 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-22b6e04c-f007-464a-ae31-4e5363ffba84 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:57.861407 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e94e9b4a-3b5f-4859-b759-4b2877a02122 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Calling method '.version_select at 0x7f25a9ef8280>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:57.865960 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e94e9b4a-3b5f-4859-b759-4b2877a02122 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:57.866674 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e94e9b4a-3b5f-4859-b759-4b2877a02122 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:57.867381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e94e9b4a-3b5f-4859-b759-4b2877a02122 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:57.881271 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e94e9b4a-3b5f-4859-b759-4b2877a02122 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 3204 microversion: 2.25 time: 0.026365 Sep 17 20:56:57.889547 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 821/1588] 10.222.0.26 () {60 vars in 1184 bytes} [Sat Sep 17 20:56:57 2022] GET /compute/v2.1/os-migrations => generated 3204 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:57.901209 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-11d2670c-ba86-4bfe-9898-409e81042695 req-ad8a4d5f-f24e-41c1-b72a-d94889c01948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f0fd2e6-7a40-44f0-9ab7-71ff4489741a", "name": "network-vif-plugged", "status": "completed", "tag": "7fa83e5d-ec8d-48f1-b098-873e8265bb06"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:57.930189 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-11d2670c-ba86-4bfe-9898-409e81042695 req-ad8a4d5f-f24e-41c1-b72a-d94889c01948 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:57.930678 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-11d2670c-ba86-4bfe-9898-409e81042695 req-ad8a4d5f-f24e-41c1-b72a-d94889c01948 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:57.931111 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-11d2670c-ba86-4bfe-9898-409e81042695 req-ad8a4d5f-f24e-41c1-b72a-d94889c01948 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:57.966206 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-11d2670c-ba86-4bfe-9898-409e81042695 req-ad8a4d5f-f24e-41c1-b72a-d94889c01948 service nova] Creating event network-vif-plugged:7fa83e5d-ec8d-48f1-b098-873e8265bb06 for instance 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a on nch1-master-1 Sep 17 20:56:57.984572 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-11d2670c-ba86-4bfe-9898-409e81042695 req-ad8a4d5f-f24e-41c1-b72a-d94889c01948 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092383 Sep 17 20:56:57.987979 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 822/1589] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:56:57.997370 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-eba369ff-eac0-4344-a8c3-98fb1f2ab67b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:57.998339 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-eba369ff-eac0-4344-a8c3-98fb1f2ab67b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:58.014277 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eba369ff-eac0-4344-a8c3-98fb1f2ab67b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:58.015048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eba369ff-eac0-4344-a8c3-98fb1f2ab67b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:58.018439 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eba369ff-eac0-4344-a8c3-98fb1f2ab67b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:58.019739 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eba369ff-eac0-4344-a8c3-98fb1f2ab67b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:58.020208 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eba369ff-eac0-4344-a8c3-98fb1f2ab67b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:58.021944 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eba369ff-eac0-4344-a8c3-98fb1f2ab67b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:58.216450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-22b6e04c-f007-464a-ae31-4e5363ffba84 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:58.226167 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-22b6e04c-f007-464a-ae31-4e5363ffba84 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be" status: 200 len: 1317 microversion: 2.1 time: 0.387516 Sep 17 20:56:58.231819 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 768/1590] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:57 2022] GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be => generated 1317 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:58.238654 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-362ab7a0-852b-49bb-9064-144a759062b2 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:58.244381 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-362ab7a0-852b-49bb-9064-144a759062b2 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: c8aaf21a-21d2-485f-8df0-2d2e43f00a57] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:58.263779 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-362ab7a0-852b-49bb-9064-144a759062b2 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:58.264515 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-362ab7a0-852b-49bb-9064-144a759062b2 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:58.264750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-362ab7a0-852b-49bb-9064-144a759062b2 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:58.265554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-362ab7a0-852b-49bb-9064-144a759062b2 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:58.266015 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-362ab7a0-852b-49bb-9064-144a759062b2 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:58.266483 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-362ab7a0-852b-49bb-9064-144a759062b2 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:58.353654 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-eba369ff-eac0-4344-a8c3-98fb1f2ab67b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:58.363282 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-eba369ff-eac0-4344-a8c3-98fb1f2ab67b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 200 len: 1497 microversion: 2.1 time: 0.373687 Sep 17 20:56:58.363945 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 823/1591] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:57 2022] GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 1497 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:58.368557 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b83da556-fd46-451b-894c-181df22c0a56 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:58.369175 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b83da556-fd46-451b-894c-181df22c0a56 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:58.391809 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-362ab7a0-852b-49bb-9064-144a759062b2 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:58.392249 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-362ab7a0-852b-49bb-9064-144a759062b2 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:58.397606 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-362ab7a0-852b-49bb-9064-144a759062b2 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:58.398188 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-362ab7a0-852b-49bb-9064-144a759062b2 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lazy-loading 'fault' on Instance uuid c8aaf21a-21d2-485f-8df0-2d2e43f00a57 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:56:58.400560 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b83da556-fd46-451b-894c-181df22c0a56 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:58.401071 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b83da556-fd46-451b-894c-181df22c0a56 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:58.401542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b83da556-fd46-451b-894c-181df22c0a56 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:58.403036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b83da556-fd46-451b-894c-181df22c0a56 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:58.403543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b83da556-fd46-451b-894c-181df22c0a56 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:58.403982 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b83da556-fd46-451b-894c-181df22c0a56 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:58.545682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-362ab7a0-852b-49bb-9064-144a759062b2 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fe33ab0e3394b7ea6b1b0b29f444e53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eee008b613cd468f9b996e915ced3074', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:58.569895 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-362ab7a0-852b-49bb-9064-144a759062b2 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57" status: 200 len: 1309 microversion: 2.1 time: 0.335747 Sep 17 20:56:58.581165 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 769/1592] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:58 2022] GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57 => generated 1309 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:58.598286 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f51e45ff-2765-44a1-92a5-13932c48189f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:58.600135 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f51e45ff-2765-44a1-92a5-13932c48189f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: 15f3f131-e02d-46b1-ba15-509016665f36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:58.610781 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f51e45ff-2765-44a1-92a5-13932c48189f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:58.611772 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f51e45ff-2765-44a1-92a5-13932c48189f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:58.612330 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f51e45ff-2765-44a1-92a5-13932c48189f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:58.614195 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f51e45ff-2765-44a1-92a5-13932c48189f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:58.615039 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f51e45ff-2765-44a1-92a5-13932c48189f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:58.616028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f51e45ff-2765-44a1-92a5-13932c48189f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:58.707502 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-b83da556-fd46-451b-894c-181df22c0a56 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] Lazy-loading 'services' on Instance uuid 50a51f32-a366-4bd6-9de4-7652c6b2d29d {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:56:58.724126 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b83da556-fd46-451b-894c-181df22c0a56 tempest-LiveAutoBlockMigrationV225Test-832919131 tempest-LiveAutoBlockMigrationV225Test-832919131-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1970 microversion: 2.25 time: 0.358994 Sep 17 20:56:58.725660 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 824/1593] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:58 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1970 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:58.740756 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-8aa8b730-629f-4330-a5c3-7a0a64de0ac8 req-b843b743-9649-4214-ae91-107132a1c068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8aaf21a-21d2-485f-8df0-2d2e43f00a57", "name": "network-vif-deleted", "tag": "d99d0073-b580-4c7a-b194-0bd762030194"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:58.778405 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8aa8b730-629f-4330-a5c3-7a0a64de0ac8 req-b843b743-9649-4214-ae91-107132a1c068 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:58.778798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8aa8b730-629f-4330-a5c3-7a0a64de0ac8 req-b843b743-9649-4214-ae91-107132a1c068 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:58.779239 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8aa8b730-629f-4330-a5c3-7a0a64de0ac8 req-b843b743-9649-4214-ae91-107132a1c068 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:58.802577 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-8aa8b730-629f-4330-a5c3-7a0a64de0ac8 req-b843b743-9649-4214-ae91-107132a1c068 service nova] Creating event network-vif-deleted:d99d0073-b580-4c7a-b194-0bd762030194 for instance c8aaf21a-21d2-485f-8df0-2d2e43f00a57 on nch1-master-1 Sep 17 20:56:58.808423 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-8aa8b730-629f-4330-a5c3-7a0a64de0ac8 req-b843b743-9649-4214-ae91-107132a1c068 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079942 Sep 17 20:56:58.809755 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 825/1594] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:56:58.816374 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-8bf1c9c2-7653-49bb-a5e5-0c28289e6060 req-211d1208-16fe-43be-a8f7-2e47f3e27265 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15402a7f-bb11-44a8-b440-0511829670be", "tag": "c2a55f8c-cf56-49c7-a27d-c270da5cb58a"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:56:58.828883 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8bf1c9c2-7653-49bb-a5e5-0c28289e6060 req-211d1208-16fe-43be-a8f7-2e47f3e27265 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:58.830214 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8bf1c9c2-7653-49bb-a5e5-0c28289e6060 req-211d1208-16fe-43be-a8f7-2e47f3e27265 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:58.830978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8bf1c9c2-7653-49bb-a5e5-0c28289e6060 req-211d1208-16fe-43be-a8f7-2e47f3e27265 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:58.844187 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-8bf1c9c2-7653-49bb-a5e5-0c28289e6060 req-211d1208-16fe-43be-a8f7-2e47f3e27265 service nova] Creating event network-changed:c2a55f8c-cf56-49c7-a27d-c270da5cb58a for instance 15402a7f-bb11-44a8-b440-0511829670be on nch1-master-1 Sep 17 20:56:58.851603 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-8bf1c9c2-7653-49bb-a5e5-0c28289e6060 req-211d1208-16fe-43be-a8f7-2e47f3e27265 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038252 Sep 17 20:56:58.852246 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 826/1595] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:56:58.857957 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ff96786e-cf6b-40e0-99d7-b7169cf7a8b8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:58.859464 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ff96786e-cf6b-40e0-99d7-b7169cf7a8b8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:58.865832 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff96786e-cf6b-40e0-99d7-b7169cf7a8b8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:58.866533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff96786e-cf6b-40e0-99d7-b7169cf7a8b8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:58.866980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff96786e-cf6b-40e0-99d7-b7169cf7a8b8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:58.867693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff96786e-cf6b-40e0-99d7-b7169cf7a8b8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:58.868151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff96786e-cf6b-40e0-99d7-b7169cf7a8b8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:58.869249 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff96786e-cf6b-40e0-99d7-b7169cf7a8b8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:58.896974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ff96786e-cf6b-40e0-99d7-b7169cf7a8b8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:56:58.900177 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f51e45ff-2765-44a1-92a5-13932c48189f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:58.913520 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f51e45ff-2765-44a1-92a5-13932c48189f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36" status: 200 len: 1321 microversion: 2.1 time: 0.329456 Sep 17 20:56:58.929538 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 770/1596] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:58 2022] GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36 => generated 1321 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:58.929538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b259eeda-f62a-4a9f-ac39-c4b54f8a2db3 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:58.929538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b259eeda-f62a-4a9f-ac39-c4b54f8a2db3 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:58.938345 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b259eeda-f62a-4a9f-ac39-c4b54f8a2db3 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:58.938850 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b259eeda-f62a-4a9f-ac39-c4b54f8a2db3 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:58.939344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b259eeda-f62a-4a9f-ac39-c4b54f8a2db3 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:58.940098 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b259eeda-f62a-4a9f-ac39-c4b54f8a2db3 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:58.940555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b259eeda-f62a-4a9f-ac39-c4b54f8a2db3 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:58.940984 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b259eeda-f62a-4a9f-ac39-c4b54f8a2db3 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:59.025429 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ff96786e-cf6b-40e0-99d7-b7169cf7a8b8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "DELETE /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 204 len: 0 microversion: 2.25 time: 0.171442 Sep 17 20:56:59.026458 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 827/1597] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 17 20:56:58 2022] DELETE /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 20:56:59.032587 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f656c04a-5ead-4821-9695-1eb39cfb4148 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:59.033835 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f656c04a-5ead-4821-9695-1eb39cfb4148 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:59.041123 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f656c04a-5ead-4821-9695-1eb39cfb4148 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:59.042059 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f656c04a-5ead-4821-9695-1eb39cfb4148 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:59.042753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f656c04a-5ead-4821-9695-1eb39cfb4148 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:59.043737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f656c04a-5ead-4821-9695-1eb39cfb4148 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:59.044476 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f656c04a-5ead-4821-9695-1eb39cfb4148 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:59.045298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f656c04a-5ead-4821-9695-1eb39cfb4148 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:59.231720 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b259eeda-f62a-4a9f-ac39-c4b54f8a2db3 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:59.239437 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b259eeda-f62a-4a9f-ac39-c4b54f8a2db3 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1355 microversion: 2.1 time: 0.315806 Sep 17 20:56:59.254060 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 771/1598] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:58 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1355 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:59.262241 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-974e59d1-b8ef-4e3e-85b6-7d0be8af44fa tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:59.262901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-974e59d1-b8ef-4e3e-85b6-7d0be8af44fa tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:59.270355 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-974e59d1-b8ef-4e3e-85b6-7d0be8af44fa tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:59.270977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-974e59d1-b8ef-4e3e-85b6-7d0be8af44fa tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:59.271434 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-974e59d1-b8ef-4e3e-85b6-7d0be8af44fa tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:59.272222 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-974e59d1-b8ef-4e3e-85b6-7d0be8af44fa tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:59.273169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-974e59d1-b8ef-4e3e-85b6-7d0be8af44fa tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:59.273169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-974e59d1-b8ef-4e3e-85b6-7d0be8af44fa tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:59.391761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f656c04a-5ead-4821-9695-1eb39cfb4148 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:59.404250 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f656c04a-5ead-4821-9695-1eb39cfb4148 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1199 microversion: 2.1 time: 0.376065 Sep 17 20:56:59.405433 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 828/1599] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:59 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1199 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:59.410165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7a547a87-9ccc-4665-9c37-bd0360287a03 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:59.410785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7a547a87-9ccc-4665-9c37-bd0360287a03 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: 15402a7f-bb11-44a8-b440-0511829670be] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:59.416951 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a547a87-9ccc-4665-9c37-bd0360287a03 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:59.417857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a547a87-9ccc-4665-9c37-bd0360287a03 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:59.418041 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a547a87-9ccc-4665-9c37-bd0360287a03 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:59.418749 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a547a87-9ccc-4665-9c37-bd0360287a03 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:59.419202 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a547a87-9ccc-4665-9c37-bd0360287a03 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:59.419796 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a547a87-9ccc-4665-9c37-bd0360287a03 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:59.510438 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-974e59d1-b8ef-4e3e-85b6-7d0be8af44fa tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:59.519758 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-974e59d1-b8ef-4e3e-85b6-7d0be8af44fa tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:59.521239 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-974e59d1-b8ef-4e3e-85b6-7d0be8af44fa tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:59.522441 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-974e59d1-b8ef-4e3e-85b6-7d0be8af44fa tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1483 microversion: 2.25 time: 0.267278 Sep 17 20:56:59.523087 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 772/1600] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:56:59 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1483 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:56:59.527869 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-798c5cfe-1f5e-47be-b0b9-cd352dec6b05 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:59.528482 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-798c5cfe-1f5e-47be-b0b9-cd352dec6b05 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:59.534951 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-798c5cfe-1f5e-47be-b0b9-cd352dec6b05 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:59.535340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-798c5cfe-1f5e-47be-b0b9-cd352dec6b05 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:59.535812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-798c5cfe-1f5e-47be-b0b9-cd352dec6b05 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:59.536541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-798c5cfe-1f5e-47be-b0b9-cd352dec6b05 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:59.537012 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-798c5cfe-1f5e-47be-b0b9-cd352dec6b05 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:59.537450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-798c5cfe-1f5e-47be-b0b9-cd352dec6b05 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:59.594918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7a547a87-9ccc-4665-9c37-bd0360287a03 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:59.602818 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7a547a87-9ccc-4665-9c37-bd0360287a03 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be" status: 200 len: 1317 microversion: 2.1 time: 0.196357 Sep 17 20:56:59.613589 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 829/1601] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:59 2022] GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:59.617413 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5aa78cf4-195d-48c3-a76b-ee8d648ad204 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:59.618099 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5aa78cf4-195d-48c3-a76b-ee8d648ad204 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] [instance: c8aaf21a-21d2-485f-8df0-2d2e43f00a57] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:59.624679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5aa78cf4-195d-48c3-a76b-ee8d648ad204 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:59.625176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5aa78cf4-195d-48c3-a76b-ee8d648ad204 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:59.625655 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5aa78cf4-195d-48c3-a76b-ee8d648ad204 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:59.626379 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5aa78cf4-195d-48c3-a76b-ee8d648ad204 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:59.626916 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5aa78cf4-195d-48c3-a76b-ee8d648ad204 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:59.627345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5aa78cf4-195d-48c3-a76b-ee8d648ad204 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:59.641652 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-5aa78cf4-195d-48c3-a76b-ee8d648ad204 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] HTTP exception thrown: Instance c8aaf21a-21d2-485f-8df0-2d2e43f00a57 could not be found. Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5aa78cf4-195d-48c3-a76b-ee8d648ad204 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Request method failure captured: Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57 HTTP/1.1 Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjRUIdrzVty6bDGHEFjhlfeM4IUSfmP_SxoJ_sIO5eoq6kJW5qj0YPRC8-APFRI9z9F4XJFBpEfbo_QDdiHykbDwonnrbYvoCcZswDcHdt2wiCm4_R22G5mMZozMh2i5T0eb2K8KAq7QOkEhpNoeZg8r3JAzq65IbB0eEHWoiu0KrAs Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: eee008b613cd468f9b996e915ced3074 Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-LiveMigrationNegativeTest-1292703711 Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eee008b613cd468f9b996e915ced3074"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/eee008b613cd468f9b996e915ced3074"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eee008b613cd468f9b996e915ced3074"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_eee008b613cd468f9b996e915ced3074", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-LiveMigrationNegativeTest-1292703711 Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: eee008b613cd468f9b996e915ced3074 Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1292703711 Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-LiveMigrationNegativeTest-1292703711-project Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 6fe33ab0e3394b7ea6b1b0b29f444e53 Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-LiveMigrationNegativeTest-1292703711-project Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance c8aaf21a-21d2-485f-8df0-2d2e43f00a57 could not be found. Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'c8aaf21a-21d2-485f-8df0-2d2e43f00a57'} Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8aaf21a-21d2-485f-8df0-2d2e43f00a57 could not be found. Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8aaf21a-21d2-485f-8df0-2d2e43f00a57 could not be found. Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:56:59.643449 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:56:59.648357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:56:59.648357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:56:59.648357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:56:59.648357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:56:59.648357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:56:59.648357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8aaf21a-21d2-485f-8df0-2d2e43f00a57 could not be found. Sep 17 20:56:59.648357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:56:59.648357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5aa78cf4-195d-48c3-a76b-ee8d648ad204 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] Returning 404 to user: Instance c8aaf21a-21d2-485f-8df0-2d2e43f00a57 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:56:59.648357 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5aa78cf4-195d-48c3-a76b-ee8d648ad204 tempest-LiveMigrationNegativeTest-1292703711 tempest-LiveMigrationNegativeTest-1292703711-project] 10.222.0.26 "GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57" status: 404 len: 111 microversion: 2.1 time: 0.040843 Sep 17 20:56:59.648357 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 830/1602] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:59 2022] GET /compute/v2.1/servers/c8aaf21a-21d2-485f-8df0-2d2e43f00a57 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:56:59.685524 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-798c5cfe-1f5e-47be-b0b9-cd352dec6b05 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:56:59.695763 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-798c5cfe-1f5e-47be-b0b9-cd352dec6b05 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 200 len: 1497 microversion: 2.1 time: 0.171019 Sep 17 20:56:59.696076 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 773/1603] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:59 2022] GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:56:59.941151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-337a3a0e-e027-4bae-8a45-fa08166cbf4a tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:56:59.941808 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-337a3a0e-e027-4bae-8a45-fa08166cbf4a tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: 15f3f131-e02d-46b1-ba15-509016665f36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:56:59.948637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-337a3a0e-e027-4bae-8a45-fa08166cbf4a tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:59.949139 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-337a3a0e-e027-4bae-8a45-fa08166cbf4a tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:59.949612 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-337a3a0e-e027-4bae-8a45-fa08166cbf4a tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:56:59.950349 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-337a3a0e-e027-4bae-8a45-fa08166cbf4a tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:56:59.950934 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-337a3a0e-e027-4bae-8a45-fa08166cbf4a tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:56:59.951242 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-337a3a0e-e027-4bae-8a45-fa08166cbf4a tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:00.008706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-bfe3eeb9-7fb8-4407-b93b-79971957b54d req-7e51121c-7c0a-4927-9a24-00d2248b8969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f0fd2e6-7a40-44f0-9ab7-71ff4489741a", "name": "network-vif-plugged", "status": "completed", "tag": "41a63a9c-a45e-49f6-98c5-c6e0496500b0"}, {"server_uuid": "4f0fd2e6-7a40-44f0-9ab7-71ff4489741a", "name": "network-vif-plugged", "status": "completed", "tag": "b3992f00-9706-4260-982f-77dfde504678"}, {"server_uuid": "15f3f131-e02d-46b1-ba15-509016665f36", "name": "network-vif-plugged", "status": "completed", "tag": "9b9fb41b-b40c-44a0-bc52-610120eb986a"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:00.021823 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-bfe3eeb9-7fb8-4407-b93b-79971957b54d req-7e51121c-7c0a-4927-9a24-00d2248b8969 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:00.022732 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-bfe3eeb9-7fb8-4407-b93b-79971957b54d req-7e51121c-7c0a-4927-9a24-00d2248b8969 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:00.022988 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-bfe3eeb9-7fb8-4407-b93b-79971957b54d req-7e51121c-7c0a-4927-9a24-00d2248b8969 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:00.036970 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-bfe3eeb9-7fb8-4407-b93b-79971957b54d req-7e51121c-7c0a-4927-9a24-00d2248b8969 service nova] Creating event network-vif-plugged:41a63a9c-a45e-49f6-98c5-c6e0496500b0 for instance 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a on nch1-master-1 Sep 17 20:57:00.037618 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-bfe3eeb9-7fb8-4407-b93b-79971957b54d req-7e51121c-7c0a-4927-9a24-00d2248b8969 service nova] Creating event network-vif-plugged:b3992f00-9706-4260-982f-77dfde504678 for instance 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a on nch1-master-1 Sep 17 20:57:00.038309 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-bfe3eeb9-7fb8-4407-b93b-79971957b54d req-7e51121c-7c0a-4927-9a24-00d2248b8969 service nova] Creating event network-vif-plugged:9b9fb41b-b40c-44a0-bc52-610120eb986a for instance 15f3f131-e02d-46b1-ba15-509016665f36 on nch1-master-1 Sep 17 20:57:00.045205 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-bfe3eeb9-7fb8-4407-b93b-79971957b54d req-7e51121c-7c0a-4927-9a24-00d2248b8969 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.041104 Sep 17 20:57:00.051047 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 774/1604] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:00.086441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-337a3a0e-e027-4bae-8a45-fa08166cbf4a tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:00.094763 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-337a3a0e-e027-4bae-8a45-fa08166cbf4a tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36" status: 200 len: 1321 microversion: 2.1 time: 0.157638 Sep 17 20:57:00.095430 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 831/1605] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:56:59 2022] GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:00.276617 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-81c43f18-3434-45b8-81dd-d35309792529 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:00.277301 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-81c43f18-3434-45b8-81dd-d35309792529 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:00.284451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81c43f18-3434-45b8-81dd-d35309792529 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:00.284942 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81c43f18-3434-45b8-81dd-d35309792529 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:00.285384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81c43f18-3434-45b8-81dd-d35309792529 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:00.286127 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81c43f18-3434-45b8-81dd-d35309792529 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:00.286635 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81c43f18-3434-45b8-81dd-d35309792529 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:00.287186 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81c43f18-3434-45b8-81dd-d35309792529 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:00.432056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ed72a59d-e846-45d7-8ccd-6a0e9e8661e0 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:00.432895 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ed72a59d-e846-45d7-8ccd-6a0e9e8661e0 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:00.450326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed72a59d-e846-45d7-8ccd-6a0e9e8661e0 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:00.453441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed72a59d-e846-45d7-8ccd-6a0e9e8661e0 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:00.454166 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed72a59d-e846-45d7-8ccd-6a0e9e8661e0 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:00.455848 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed72a59d-e846-45d7-8ccd-6a0e9e8661e0 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:00.456594 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed72a59d-e846-45d7-8ccd-6a0e9e8661e0 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:00.457522 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed72a59d-e846-45d7-8ccd-6a0e9e8661e0 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:00.573642 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-81c43f18-3434-45b8-81dd-d35309792529 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:00.598896 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-81c43f18-3434-45b8-81dd-d35309792529 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1355 microversion: 2.1 time: 0.336685 Sep 17 20:57:00.600632 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 775/1606] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:00 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1355 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:00.614058 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-afe6ab87-81c0-4006-afb1-d65856277d5a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:00.614912 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-afe6ab87-81c0-4006-afb1-d65856277d5a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:00.622665 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afe6ab87-81c0-4006-afb1-d65856277d5a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:00.623996 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afe6ab87-81c0-4006-afb1-d65856277d5a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:00.624693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afe6ab87-81c0-4006-afb1-d65856277d5a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:00.625672 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afe6ab87-81c0-4006-afb1-d65856277d5a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:00.626326 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afe6ab87-81c0-4006-afb1-d65856277d5a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:00.627238 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afe6ab87-81c0-4006-afb1-d65856277d5a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:00.731429 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ed72a59d-e846-45d7-8ccd-6a0e9e8661e0 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:00.746108 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ed72a59d-e846-45d7-8ccd-6a0e9e8661e0 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1199 microversion: 2.1 time: 0.314784 Sep 17 20:57:00.746729 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 832/1607] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:00 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1199 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:00.752043 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8c4e69e6-ae42-4302-8de3-45a7cd4a580e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:00.752959 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8c4e69e6-ae42-4302-8de3-45a7cd4a580e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: 15402a7f-bb11-44a8-b440-0511829670be] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:00.759989 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c4e69e6-ae42-4302-8de3-45a7cd4a580e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:00.761124 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c4e69e6-ae42-4302-8de3-45a7cd4a580e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:00.761899 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c4e69e6-ae42-4302-8de3-45a7cd4a580e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:00.762863 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c4e69e6-ae42-4302-8de3-45a7cd4a580e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:00.763331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c4e69e6-ae42-4302-8de3-45a7cd4a580e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:00.763763 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c4e69e6-ae42-4302-8de3-45a7cd4a580e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:00.843400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-afe6ab87-81c0-4006-afb1-d65856277d5a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:00.854482 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-afe6ab87-81c0-4006-afb1-d65856277d5a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:00.856285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-afe6ab87-81c0-4006-afb1-d65856277d5a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:00.857789 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-afe6ab87-81c0-4006-afb1-d65856277d5a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1483 microversion: 2.25 time: 0.255941 Sep 17 20:57:00.859381 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 776/1608] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:57:00 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1483 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:57:00.864614 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a039868e-f591-4b6a-a3bf-df22a57a2ff4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:00.865731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a039868e-f591-4b6a-a3bf-df22a57a2ff4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:00.872726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a039868e-f591-4b6a-a3bf-df22a57a2ff4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:00.873583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a039868e-f591-4b6a-a3bf-df22a57a2ff4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:00.874109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a039868e-f591-4b6a-a3bf-df22a57a2ff4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:00.875112 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a039868e-f591-4b6a-a3bf-df22a57a2ff4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:00.876169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a039868e-f591-4b6a-a3bf-df22a57a2ff4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:00.876840 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a039868e-f591-4b6a-a3bf-df22a57a2ff4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:00.899273 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:00.966547 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8c4e69e6-ae42-4302-8de3-45a7cd4a580e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:00.976324 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8c4e69e6-ae42-4302-8de3-45a7cd4a580e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be" status: 200 len: 1317 microversion: 2.1 time: 0.228214 Sep 17 20:57:00.992233 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 833/1609] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:00 2022] GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:00.992233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-4d482e0a-69ae-4372-91f3-734b6044d70c req-80029746-2674-4da1-b6fd-38e2157f0d67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ca7424d-e666-4a33-9cc7-c56de359e512", "tag": "7e2345f8-01ba-4dab-8432-e34b1aefa6e8"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:00.998440 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4d482e0a-69ae-4372-91f3-734b6044d70c req-80029746-2674-4da1-b6fd-38e2157f0d67 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:00.999240 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4d482e0a-69ae-4372-91f3-734b6044d70c req-80029746-2674-4da1-b6fd-38e2157f0d67 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:01.000299 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4d482e0a-69ae-4372-91f3-734b6044d70c req-80029746-2674-4da1-b6fd-38e2157f0d67 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:01.012421 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-4d482e0a-69ae-4372-91f3-734b6044d70c req-80029746-2674-4da1-b6fd-38e2157f0d67 service nova] Creating event network-changed:7e2345f8-01ba-4dab-8432-e34b1aefa6e8 for instance 4ca7424d-e666-4a33-9cc7-c56de359e512 on nch1-master-1 Sep 17 20:57:01.018054 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-4d482e0a-69ae-4372-91f3-734b6044d70c req-80029746-2674-4da1-b6fd-38e2157f0d67 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039467 Sep 17 20:57:01.019103 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 834/1610] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:01.038956 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a039868e-f591-4b6a-a3bf-df22a57a2ff4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:01.047773 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a039868e-f591-4b6a-a3bf-df22a57a2ff4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 200 len: 1497 microversion: 2.1 time: 0.186961 Sep 17 20:57:01.048396 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 777/1611] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:00 2022] GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:01.153748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6dae5722-f604-427e-8f16-d5fd7aa4fd61 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:01.158191 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6dae5722-f604-427e-8f16-d5fd7aa4fd61 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: 15f3f131-e02d-46b1-ba15-509016665f36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:01.173009 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6dae5722-f604-427e-8f16-d5fd7aa4fd61 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:01.173600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6dae5722-f604-427e-8f16-d5fd7aa4fd61 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:01.178824 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6dae5722-f604-427e-8f16-d5fd7aa4fd61 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:01.179660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6dae5722-f604-427e-8f16-d5fd7aa4fd61 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:01.180403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6dae5722-f604-427e-8f16-d5fd7aa4fd61 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:01.180911 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6dae5722-f604-427e-8f16-d5fd7aa4fd61 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:01.508065 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6dae5722-f604-427e-8f16-d5fd7aa4fd61 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:01.519420 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6dae5722-f604-427e-8f16-d5fd7aa4fd61 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36" status: 200 len: 1321 microversion: 2.1 time: 0.404584 Sep 17 20:57:01.521259 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 835/1612] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:01 2022] GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36 => generated 1321 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:01.625788 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5c3d73fe-754b-4c00-abd6-31bcdf5a3390 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:01.627724 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5c3d73fe-754b-4c00-abd6-31bcdf5a3390 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:01.637871 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c3d73fe-754b-4c00-abd6-31bcdf5a3390 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:01.638747 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c3d73fe-754b-4c00-abd6-31bcdf5a3390 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:01.639276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c3d73fe-754b-4c00-abd6-31bcdf5a3390 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:01.640276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c3d73fe-754b-4c00-abd6-31bcdf5a3390 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:01.640955 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c3d73fe-754b-4c00-abd6-31bcdf5a3390 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:01.641393 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c3d73fe-754b-4c00-abd6-31bcdf5a3390 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:01.773578 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9d1ffff3-dd32-4b91-afd4-4e2a305a6a17 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:01.774509 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9d1ffff3-dd32-4b91-afd4-4e2a305a6a17 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:01.782551 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:01.784187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d1ffff3-dd32-4b91-afd4-4e2a305a6a17 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:01.784751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d1ffff3-dd32-4b91-afd4-4e2a305a6a17 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:01.785598 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d1ffff3-dd32-4b91-afd4-4e2a305a6a17 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:01.786667 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d1ffff3-dd32-4b91-afd4-4e2a305a6a17 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:01.787158 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d1ffff3-dd32-4b91-afd4-4e2a305a6a17 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:01.788080 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d1ffff3-dd32-4b91-afd4-4e2a305a6a17 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:01.830304 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:01.984674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5c3d73fe-754b-4c00-abd6-31bcdf5a3390 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:01.992820 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5c3d73fe-754b-4c00-abd6-31bcdf5a3390 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1355 microversion: 2.1 time: 0.372404 Sep 17 20:57:01.993509 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 778/1613] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:01 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1355 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:01.998444 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8215a168-ec78-4094-88c0-cd22edf88319 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:01.999066 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8215a168-ec78-4094-88c0-cd22edf88319 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:02.005075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8215a168-ec78-4094-88c0-cd22edf88319 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:02.005830 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8215a168-ec78-4094-88c0-cd22edf88319 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:02.006509 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8215a168-ec78-4094-88c0-cd22edf88319 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:02.007239 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8215a168-ec78-4094-88c0-cd22edf88319 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:02.007895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8215a168-ec78-4094-88c0-cd22edf88319 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:02.008327 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8215a168-ec78-4094-88c0-cd22edf88319 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:02.020336 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9d1ffff3-dd32-4b91-afd4-4e2a305a6a17 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:02.028405 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9d1ffff3-dd32-4b91-afd4-4e2a305a6a17 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1199 microversion: 2.1 time: 0.262513 Sep 17 20:57:02.028989 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 836/1614] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:01 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1199 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:02.033541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-4569640f-c48a-4a39-aea9-de21ad7a0eb3 req-3d4f3c75-6725-4232-8773-65d1d91d134f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a51f32-a366-4bd6-9de4-7652c6b2d29d", "name": "network-vif-deleted", "tag": "8df31a1d-fc1e-494b-8747-1f3e6c1867ce"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:02.043175 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4569640f-c48a-4a39-aea9-de21ad7a0eb3 req-3d4f3c75-6725-4232-8773-65d1d91d134f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:02.043656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4569640f-c48a-4a39-aea9-de21ad7a0eb3 req-3d4f3c75-6725-4232-8773-65d1d91d134f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:02.044093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4569640f-c48a-4a39-aea9-de21ad7a0eb3 req-3d4f3c75-6725-4232-8773-65d1d91d134f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:02.055263 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-4569640f-c48a-4a39-aea9-de21ad7a0eb3 req-3d4f3c75-6725-4232-8773-65d1d91d134f service nova] Creating event network-vif-deleted:8df31a1d-fc1e-494b-8747-1f3e6c1867ce for instance 50a51f32-a366-4bd6-9de4-7652c6b2d29d on nch1-master-1 Sep 17 20:57:02.060192 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-4569640f-c48a-4a39-aea9-de21ad7a0eb3 req-3d4f3c75-6725-4232-8773-65d1d91d134f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030071 Sep 17 20:57:02.060800 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 837/1615] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:02.077216 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8215a168-ec78-4094-88c0-cd22edf88319 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:02.086282 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8215a168-ec78-4094-88c0-cd22edf88319 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:02.087763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8215a168-ec78-4094-88c0-cd22edf88319 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:02.088931 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8215a168-ec78-4094-88c0-cd22edf88319 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1441 microversion: 2.25 time: 0.094229 Sep 17 20:57:02.089520 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 779/1616] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:57:01 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1441 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:57:02.094010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e6b0c2ef-2b34-4a16-8976-80b02be5772d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:02.094623 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e6b0c2ef-2b34-4a16-8976-80b02be5772d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: 15402a7f-bb11-44a8-b440-0511829670be] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:02.107509 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6b0c2ef-2b34-4a16-8976-80b02be5772d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:02.107950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6b0c2ef-2b34-4a16-8976-80b02be5772d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:02.108395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6b0c2ef-2b34-4a16-8976-80b02be5772d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:02.109102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6b0c2ef-2b34-4a16-8976-80b02be5772d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:02.109597 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6b0c2ef-2b34-4a16-8976-80b02be5772d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:02.110049 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6b0c2ef-2b34-4a16-8976-80b02be5772d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:02.192953 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0e7fb6aa-58a9-4775-a3dc-f1c92c519755 tempest-FlavorsV2NegativeTest-762334036 tempest-FlavorsV2NegativeTest-762334036-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:02.201386 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0e7fb6aa-58a9-4775-a3dc-f1c92c519755 tempest-FlavorsV2NegativeTest-762334036 tempest-FlavorsV2NegativeTest-762334036-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.139288 Sep 17 20:57:02.202271 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 838/1617] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Sep 17 20:57:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:02.207423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ba71b731-2c38-45db-a414-3f409dd2e880 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:02.208217 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ba71b731-2c38-45db-a414-3f409dd2e880 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:02.219211 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ba71b731-2c38-45db-a414-3f409dd2e880 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:02.219716 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ba71b731-2c38-45db-a414-3f409dd2e880 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:02.220245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ba71b731-2c38-45db-a414-3f409dd2e880 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:02.220965 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ba71b731-2c38-45db-a414-3f409dd2e880 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:02.221428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ba71b731-2c38-45db-a414-3f409dd2e880 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:02.222155 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ba71b731-2c38-45db-a414-3f409dd2e880 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:02.264570 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e6b0c2ef-2b34-4a16-8976-80b02be5772d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:02.275556 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e6b0c2ef-2b34-4a16-8976-80b02be5772d tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be" status: 200 len: 1317 microversion: 2.1 time: 0.184923 Sep 17 20:57:02.294482 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 780/1618] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:02 2022] GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be => generated 1317 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:02.394386 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ba71b731-2c38-45db-a414-3f409dd2e880 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:02.402923 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ba71b731-2c38-45db-a414-3f409dd2e880 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 200 len: 1497 microversion: 2.1 time: 0.199129 Sep 17 20:57:02.403433 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 839/1619] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:02 2022] GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 1497 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:02.543341 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dcb522e8-dc93-4559-99f7-ba0df36923df tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:02.544048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dcb522e8-dc93-4559-99f7-ba0df36923df tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: 15f3f131-e02d-46b1-ba15-509016665f36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:02.549242 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=8 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:02.551028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dcb522e8-dc93-4559-99f7-ba0df36923df tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:02.551530 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dcb522e8-dc93-4559-99f7-ba0df36923df tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:02.552219 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dcb522e8-dc93-4559-99f7-ba0df36923df tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:02.552926 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dcb522e8-dc93-4559-99f7-ba0df36923df tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:02.553388 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dcb522e8-dc93-4559-99f7-ba0df36923df tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:02.553851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dcb522e8-dc93-4559-99f7-ba0df36923df tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:02.718363 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dcb522e8-dc93-4559-99f7-ba0df36923df tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:02.727081 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dcb522e8-dc93-4559-99f7-ba0df36923df tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36" status: 200 len: 1321 microversion: 2.1 time: 0.187731 Sep 17 20:57:02.727703 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 781/1620] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:02 2022] GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36 => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:02.757546 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c5ee3c6f-3583-47b1-807d-f39e7a2c0062 tempest-FlavorsV2NegativeTest-762334036 tempest-FlavorsV2NegativeTest-762334036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-223529687", "imageRef": "ef131d5f-e59c-42c7-a197-06be721de784", "flavorRef": "452"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:02.810145 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-c5ee3c6f-3583-47b1-807d-f39e7a2c0062 tempest-FlavorsV2NegativeTest-762334036 tempest-FlavorsV2NegativeTest-762334036-project] validate_networks() for None {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:57:03.021542 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6d754ed5-e2ca-4cfc-83b9-3b824a1484ed tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:03.021702 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6d754ed5-e2ca-4cfc-83b9-3b824a1484ed tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:03.038317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d754ed5-e2ca-4cfc-83b9-3b824a1484ed tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:03.038984 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d754ed5-e2ca-4cfc-83b9-3b824a1484ed tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:03.039481 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d754ed5-e2ca-4cfc-83b9-3b824a1484ed tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:03.043836 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d754ed5-e2ca-4cfc-83b9-3b824a1484ed tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:03.044517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d754ed5-e2ca-4cfc-83b9-3b824a1484ed tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:03.045064 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d754ed5-e2ca-4cfc-83b9-3b824a1484ed tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:03.228136 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=16 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:03.332595 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-c5ee3c6f-3583-47b1-807d-f39e7a2c0062 tempest-FlavorsV2NegativeTest-762334036 tempest-FlavorsV2NegativeTest-762334036-project] HTTP exception thrown: Flavor's memory is too small for requested image. Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c5ee3c6f-3583-47b1-807d-f39e7a2c0062 tempest-FlavorsV2NegativeTest-762334036 tempest-FlavorsV2NegativeTest-762334036-project] Request method failure captured: Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 142 Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjSdmVoBTBzhWWhSh9EpVQ22Y1fXRy-u8ys6NGxeptTyJXWyWxsW-P6Qvqbr5-juZ_688oA0fCT3O90URwuRVzg9sezc4GsVpLGmu8AKxE-eGhLnmbkxd3XyGExnBQ9ZLjJM9inD3_Wf078oAATctsF8ES_buY6MjmDyqAb3SSG2HO0 Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 20bd9597d34a43d08a9609dc4dba4958 Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-FlavorsV2NegativeTest-762334036 Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/20bd9597d34a43d08a9609dc4dba4958"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/20bd9597d34a43d08a9609dc4dba4958"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/20bd9597d34a43d08a9609dc4dba4958"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_20bd9597d34a43d08a9609dc4dba4958", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-FlavorsV2NegativeTest-762334036 Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 20bd9597d34a43d08a9609dc4dba4958 Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-762334036 Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-FlavorsV2NegativeTest-762334036-project Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 52132aa6175c41a3b2bc16c427da72b0 Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-FlavorsV2NegativeTest-762334036-project Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-223529687", "imageRef": "ef131d5f-e59c-42c7-a197-06be721de784", "flavorRef": "452"}} Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: exception: Flavor's memory is too small for requested image. Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-223529687', 'imageRef': 'ef131d5f-e59c-42c7-a197-06be721de784', 'flavorRef': '452'}}} Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:57:03.334557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:57:03.342072 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:57:03.342072 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:57:03.342072 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 17 20:57:03.342072 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Sep 17 20:57:03.342072 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 17 20:57:03.342072 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Sep 17 20:57:03.342072 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:03.342072 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:03.342072 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:03.342072 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:03.342072 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:03.342072 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:03.342072 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:57:03.342072 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:57:03.342072 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Sep 17 20:57:03.342072 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:03.342072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c5ee3c6f-3583-47b1-807d-f39e7a2c0062 tempest-FlavorsV2NegativeTest-762334036 tempest-FlavorsV2NegativeTest-762334036-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:57:03.342072 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c5ee3c6f-3583-47b1-807d-f39e7a2c0062 tempest-FlavorsV2NegativeTest-762334036 tempest-FlavorsV2NegativeTest-762334036-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.583037 Sep 17 20:57:03.342072 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 840/1621] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:57:02 2022] POST /compute/v2.1/servers => generated 93 bytes in 584 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 17 20:57:03.345633 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7987f86c-7e7a-4c0f-be1c-7fa523d4fdff tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:03.345633 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7987f86c-7e7a-4c0f-be1c-7fa523d4fdff tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:03.349494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7987f86c-7e7a-4c0f-be1c-7fa523d4fdff tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:03.350017 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7987f86c-7e7a-4c0f-be1c-7fa523d4fdff tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:03.350460 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7987f86c-7e7a-4c0f-be1c-7fa523d4fdff tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:03.351173 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7987f86c-7e7a-4c0f-be1c-7fa523d4fdff tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:03.351613 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7987f86c-7e7a-4c0f-be1c-7fa523d4fdff tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:03.352305 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7987f86c-7e7a-4c0f-be1c-7fa523d4fdff tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:03.499874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6d754ed5-e2ca-4cfc-83b9-3b824a1484ed tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:03.509648 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6d754ed5-e2ca-4cfc-83b9-3b824a1484ed tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1355 microversion: 2.1 time: 0.497655 Sep 17 20:57:03.510404 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 782/1622] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:03 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1355 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:03.525828 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-968e252c-b623-4693-8510-f36b13d5a433 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:03.528399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-968e252c-b623-4693-8510-f36b13d5a433 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:03.529030 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7987f86c-7e7a-4c0f-be1c-7fa523d4fdff tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:03.534881 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-968e252c-b623-4693-8510-f36b13d5a433 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:03.535366 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-968e252c-b623-4693-8510-f36b13d5a433 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:03.535812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-968e252c-b623-4693-8510-f36b13d5a433 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:03.536505 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-968e252c-b623-4693-8510-f36b13d5a433 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:03.537020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-968e252c-b623-4693-8510-f36b13d5a433 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:03.537288 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7987f86c-7e7a-4c0f-be1c-7fa523d4fdff tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1199 microversion: 2.1 time: 0.199228 Sep 17 20:57:03.537414 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-968e252c-b623-4693-8510-f36b13d5a433 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:03.537909 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 841/1623] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:03 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1199 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:03.558198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-5f437ee2-c099-433f-a327-022bd0fdebf6 req-8fdda229-2a20-4116-a77f-f947a45a7dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15402a7f-bb11-44a8-b440-0511829670be", "name": "network-vif-plugged", "status": "completed", "tag": "c2a55f8c-cf56-49c7-a27d-c270da5cb58a"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:03.568698 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-5f437ee2-c099-433f-a327-022bd0fdebf6 req-8fdda229-2a20-4116-a77f-f947a45a7dd4 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:03.569188 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-5f437ee2-c099-433f-a327-022bd0fdebf6 req-8fdda229-2a20-4116-a77f-f947a45a7dd4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:03.569657 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-5f437ee2-c099-433f-a327-022bd0fdebf6 req-8fdda229-2a20-4116-a77f-f947a45a7dd4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:03.582101 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-5f437ee2-c099-433f-a327-022bd0fdebf6 req-8fdda229-2a20-4116-a77f-f947a45a7dd4 service nova] Creating event network-vif-plugged:c2a55f8c-cf56-49c7-a27d-c270da5cb58a for instance 15402a7f-bb11-44a8-b440-0511829670be on nch1-master-1 Sep 17 20:57:03.591168 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-5f437ee2-c099-433f-a327-022bd0fdebf6 req-8fdda229-2a20-4116-a77f-f947a45a7dd4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044006 Sep 17 20:57:03.591993 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 842/1624] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:03.597163 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2dd82c09-3c14-4870-87a7-ac9d6e69a34f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:03.597912 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2dd82c09-3c14-4870-87a7-ac9d6e69a34f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: 15402a7f-bb11-44a8-b440-0511829670be] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:03.604125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2dd82c09-3c14-4870-87a7-ac9d6e69a34f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:03.604619 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2dd82c09-3c14-4870-87a7-ac9d6e69a34f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:03.605056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2dd82c09-3c14-4870-87a7-ac9d6e69a34f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:03.605968 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2dd82c09-3c14-4870-87a7-ac9d6e69a34f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:03.606433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2dd82c09-3c14-4870-87a7-ac9d6e69a34f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:03.606856 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2dd82c09-3c14-4870-87a7-ac9d6e69a34f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:03.607021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-968e252c-b623-4693-8510-f36b13d5a433 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:03.615639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-968e252c-b623-4693-8510-f36b13d5a433 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:03.617069 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-968e252c-b623-4693-8510-f36b13d5a433 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:03.618293 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-968e252c-b623-4693-8510-f36b13d5a433 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 200 len: 1266 microversion: 2.25 time: 0.105960 Sep 17 20:57:03.618863 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 783/1625] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:57:03 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 1266 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:57:03.623363 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-25bcff8c-def5-4a3a-a1ab-4b2116b55f64 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:03.623970 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-25bcff8c-def5-4a3a-a1ab-4b2116b55f64 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:03.630400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25bcff8c-def5-4a3a-a1ab-4b2116b55f64 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:03.630892 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25bcff8c-def5-4a3a-a1ab-4b2116b55f64 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:03.631323 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25bcff8c-def5-4a3a-a1ab-4b2116b55f64 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:03.632210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25bcff8c-def5-4a3a-a1ab-4b2116b55f64 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:03.632867 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25bcff8c-def5-4a3a-a1ab-4b2116b55f64 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:03.633514 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25bcff8c-def5-4a3a-a1ab-4b2116b55f64 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:03.837104 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2dd82c09-3c14-4870-87a7-ac9d6e69a34f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:03.845025 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2dd82c09-3c14-4870-87a7-ac9d6e69a34f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be" status: 200 len: 1317 microversion: 2.1 time: 0.251782 Sep 17 20:57:03.845697 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 843/1626] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:03 2022] GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:03.859002 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-db8a08e1-271c-44a4-9794-6d1bc0937e7b tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:03.861852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-db8a08e1-271c-44a4-9794-6d1bc0937e7b tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: 15f3f131-e02d-46b1-ba15-509016665f36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:03.865988 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-25bcff8c-def5-4a3a-a1ab-4b2116b55f64 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:03.878542 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-25bcff8c-def5-4a3a-a1ab-4b2116b55f64 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 200 len: 1497 microversion: 2.1 time: 0.258569 Sep 17 20:57:03.881805 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 784/1627] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:03 2022] GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 1497 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:03.885309 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-db8a08e1-271c-44a4-9794-6d1bc0937e7b tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:03.886033 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-db8a08e1-271c-44a4-9794-6d1bc0937e7b tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:03.886686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-db8a08e1-271c-44a4-9794-6d1bc0937e7b tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:03.887642 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-db8a08e1-271c-44a4-9794-6d1bc0937e7b tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:03.888328 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-db8a08e1-271c-44a4-9794-6d1bc0937e7b tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:03.888955 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-db8a08e1-271c-44a4-9794-6d1bc0937e7b tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:04.083798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-db8a08e1-271c-44a4-9794-6d1bc0937e7b tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:04.096680 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-db8a08e1-271c-44a4-9794-6d1bc0937e7b tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36" status: 200 len: 1470 microversion: 2.1 time: 0.244911 Sep 17 20:57:04.119110 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 844/1628] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:03 2022] GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36 => generated 1470 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:04.123200 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e94cef46-7737-47c4-bcfc-87c472d4dde9 tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:04.124474 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e94cef46-7737-47c4-bcfc-87c472d4dde9 tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] [instance: 15f3f131-e02d-46b1-ba15-509016665f36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:04.132206 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e94cef46-7737-47c4-bcfc-87c472d4dde9 tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:04.133127 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e94cef46-7737-47c4-bcfc-87c472d4dde9 tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:04.134481 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e94cef46-7737-47c4-bcfc-87c472d4dde9 tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:04.135700 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e94cef46-7737-47c4-bcfc-87c472d4dde9 tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:04.136507 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e94cef46-7737-47c4-bcfc-87c472d4dde9 tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:04.137107 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e94cef46-7737-47c4-bcfc-87c472d4dde9 tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:04.165658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-e94cef46-7737-47c4-bcfc-87c472d4dde9 tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Lazy-loading 'flavor' on Instance uuid 15f3f131-e02d-46b1-ba15-509016665f36 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:57:04.254632 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e94cef46-7737-47c4-bcfc-87c472d4dde9 tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36/action" status: 202 len: 0 microversion: 2.1 time: 0.134858 Sep 17 20:57:04.255260 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 785/1629] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:57:04 2022] POST /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:57:04.265016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-59213b98-bf8b-4b59-9dbd-61ab1cd80acf tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:04.266318 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-59213b98-bf8b-4b59-9dbd-61ab1cd80acf tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] [instance: 15f3f131-e02d-46b1-ba15-509016665f36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:04.275618 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59213b98-bf8b-4b59-9dbd-61ab1cd80acf tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:04.276512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59213b98-bf8b-4b59-9dbd-61ab1cd80acf tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:04.278650 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59213b98-bf8b-4b59-9dbd-61ab1cd80acf tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:04.280368 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59213b98-bf8b-4b59-9dbd-61ab1cd80acf tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:04.280844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59213b98-bf8b-4b59-9dbd-61ab1cd80acf tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:04.282047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59213b98-bf8b-4b59-9dbd-61ab1cd80acf tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:04.535517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ec49419a-1f52-4fea-ab85-0c30a5f30291 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:04.536511 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ec49419a-1f52-4fea-ab85-0c30a5f30291 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:04.543373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec49419a-1f52-4fea-ab85-0c30a5f30291 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:04.544141 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec49419a-1f52-4fea-ab85-0c30a5f30291 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:04.544583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec49419a-1f52-4fea-ab85-0c30a5f30291 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:04.545366 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec49419a-1f52-4fea-ab85-0c30a5f30291 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:04.546028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec49419a-1f52-4fea-ab85-0c30a5f30291 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:04.546449 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec49419a-1f52-4fea-ab85-0c30a5f30291 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:04.565063 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-59213b98-bf8b-4b59-9dbd-61ab1cd80acf tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36" status: 200 len: 1629 microversion: 2.1 time: 0.304079 Sep 17 20:57:04.566154 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 845/1630] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:04 2022] GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36 => generated 1629 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:04.570386 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8c8ec568-a701-41f7-bde1-10c09c0b00db tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:04.571148 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8c8ec568-a701-41f7-bde1-10c09c0b00db tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:04.577864 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c8ec568-a701-41f7-bde1-10c09c0b00db tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:04.578375 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c8ec568-a701-41f7-bde1-10c09c0b00db tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:04.578796 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c8ec568-a701-41f7-bde1-10c09c0b00db tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:04.579524 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c8ec568-a701-41f7-bde1-10c09c0b00db tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:04.580001 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c8ec568-a701-41f7-bde1-10c09c0b00db tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:04.580833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c8ec568-a701-41f7-bde1-10c09c0b00db tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:04.809967 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ec49419a-1f52-4fea-ab85-0c30a5f30291 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:04.814708 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8c8ec568-a701-41f7-bde1-10c09c0b00db tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:04.819615 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ec49419a-1f52-4fea-ab85-0c30a5f30291 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1801 microversion: 2.1 time: 0.288785 Sep 17 20:57:04.820210 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 786/1631] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:04 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1801 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:57:04.827822 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8c8ec568-a701-41f7-bde1-10c09c0b00db tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1199 microversion: 2.1 time: 0.260676 Sep 17 20:57:04.828800 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 846/1632] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:04 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1199 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:04.830529 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-13d7daac-58e6-4a0c-b4c1-08e83eaf3517 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:04.831638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-13d7daac-58e6-4a0c-b4c1-08e83eaf3517 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 50a51f32-a366-4bd6-9de4-7652c6b2d29d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:04.840606 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-13d7daac-58e6-4a0c-b4c1-08e83eaf3517 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:04.841412 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-13d7daac-58e6-4a0c-b4c1-08e83eaf3517 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:04.842300 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-13d7daac-58e6-4a0c-b4c1-08e83eaf3517 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:04.842696 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c1f69ef5-268a-4deb-87ed-2b392e29e093 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:04.843206 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c1f69ef5-268a-4deb-87ed-2b392e29e093 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:04.843853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-13d7daac-58e6-4a0c-b4c1-08e83eaf3517 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:04.844413 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-13d7daac-58e6-4a0c-b4c1-08e83eaf3517 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:04.844934 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-13d7daac-58e6-4a0c-b4c1-08e83eaf3517 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:04.849610 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1f69ef5-268a-4deb-87ed-2b392e29e093 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:04.850122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1f69ef5-268a-4deb-87ed-2b392e29e093 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:04.850601 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1f69ef5-268a-4deb-87ed-2b392e29e093 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:04.851296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1f69ef5-268a-4deb-87ed-2b392e29e093 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:04.851764 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1f69ef5-268a-4deb-87ed-2b392e29e093 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:04.852181 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1f69ef5-268a-4deb-87ed-2b392e29e093 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:04.862620 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-13d7daac-58e6-4a0c-b4c1-08e83eaf3517 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] HTTP exception thrown: Instance 50a51f32-a366-4bd6-9de4-7652c6b2d29d could not be found. Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-13d7daac-58e6-4a0c-b4c1-08e83eaf3517 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Request method failure captured: Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d HTTP/1.1 Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjNRMAPX_oTsPhy9TfA5vu2vyNW5I1IgC_1G9MjGTLqycu01SdxDB1FQYnE4eP90RiN0J5FJdUywXLYCcYRiKroAyLyOhXaJdhri5JVTmmNDHZZ22UM3Q0dE9BqBpbNF6NGgyn9xK5g6Eb8IAu6FGQEDpUrY4GSRsSTNP6PFmk30ZJY Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: X-Openstack-Nova-Api-Version: 2.25 Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 7dc8bc81c2d74bae9612f7c9807350a7 Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1505099207 Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7dc8bc81c2d74bae9612f7c9807350a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7dc8bc81c2d74bae9612f7c9807350a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7dc8bc81c2d74bae9612f7c9807350a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7dc8bc81c2d74bae9612f7c9807350a7", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1505099207 Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 7dc8bc81c2d74bae9612f7c9807350a7 Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1505099207 Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-LiveAutoBlockMigrationV225Test-1505099207-project Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: f1134231b4a545fdb136a5204cb4f289 Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1505099207-project Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 50a51f32-a366-4bd6-9de4-7652c6b2d29d could not be found. Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '50a51f32-a366-4bd6-9de4-7652c6b2d29d'} Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a51f32-a366-4bd6-9de4-7652c6b2d29d could not be found. Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a51f32-a366-4bd6-9de4-7652c6b2d29d could not be found. Sep 17 20:57:04.864722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:57:04.870014 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:04.870014 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:57:04.870014 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:04.870014 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:04.870014 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:04.870014 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:57:04.870014 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:57:04.870014 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a51f32-a366-4bd6-9de4-7652c6b2d29d could not be found. Sep 17 20:57:04.870014 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:57:04.870014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-13d7daac-58e6-4a0c-b4c1-08e83eaf3517 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Returning 404 to user: Instance 50a51f32-a366-4bd6-9de4-7652c6b2d29d could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:57:04.870014 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-13d7daac-58e6-4a0c-b4c1-08e83eaf3517 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d" status: 404 len: 111 microversion: 2.25 time: 0.044722 Sep 17 20:57:04.870014 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 787/1633] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:57:04 2022] GET /compute/v2.1/servers/50a51f32-a366-4bd6-9de4-7652c6b2d29d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 17 20:57:04.873749 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-491da58f-6ded-47da-9f5f-c2ca3bac386b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:04.874362 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-491da58f-6ded-47da-9f5f-c2ca3bac386b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: 15402a7f-bb11-44a8-b440-0511829670be] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:04.881254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-491da58f-6ded-47da-9f5f-c2ca3bac386b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:04.882108 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-491da58f-6ded-47da-9f5f-c2ca3bac386b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:04.882934 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-491da58f-6ded-47da-9f5f-c2ca3bac386b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:04.883827 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-491da58f-6ded-47da-9f5f-c2ca3bac386b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:04.884445 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-491da58f-6ded-47da-9f5f-c2ca3bac386b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:04.885029 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-491da58f-6ded-47da-9f5f-c2ca3bac386b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:04.886657 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c1f69ef5-268a-4deb-87ed-2b392e29e093 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a/ips" status: 200 len: 214 microversion: 2.1 time: 0.047719 Sep 17 20:57:04.887642 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 847/1634] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Sep 17 20:57:04 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a/ips => generated 214 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:04.903079 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b064384f-fd0b-47be-b80d-1fe4a9a249e9 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:04.905540 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b064384f-fd0b-47be-b80d-1fe4a9a249e9 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:04.920013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b064384f-fd0b-47be-b80d-1fe4a9a249e9 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:04.921673 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b064384f-fd0b-47be-b80d-1fe4a9a249e9 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:04.922144 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b064384f-fd0b-47be-b80d-1fe4a9a249e9 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:04.923155 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b064384f-fd0b-47be-b80d-1fe4a9a249e9 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:04.923673 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b064384f-fd0b-47be-b80d-1fe4a9a249e9 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:04.924048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b064384f-fd0b-47be-b80d-1fe4a9a249e9 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:04.967156 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b064384f-fd0b-47be-b80d-1fe4a9a249e9 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:57:05.082439 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-491da58f-6ded-47da-9f5f-c2ca3bac386b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:05.084388 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b064384f-fd0b-47be-b80d-1fe4a9a249e9 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 204 len: 0 microversion: 2.1 time: 0.187981 Sep 17 20:57:05.085144 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 848/1635] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:57:04 2022] DELETE /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 17 20:57:05.091052 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9cb327b6-b617-47a9-9430-510c048d922d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:05.093949 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9cb327b6-b617-47a9-9430-510c048d922d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:05.097041 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-491da58f-6ded-47da-9f5f-c2ca3bac386b tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be" status: 200 len: 1317 microversion: 2.1 time: 0.228301 Sep 17 20:57:05.097673 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 788/1636] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:04 2022] GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:05.103338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9070d728-a4bc-428f-9b66-b8a84f5d886f tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:05.103951 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9070d728-a4bc-428f-9b66-b8a84f5d886f tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:05.110469 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9070d728-a4bc-428f-9b66-b8a84f5d886f tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:05.111195 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9070d728-a4bc-428f-9b66-b8a84f5d886f tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:05.111836 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9070d728-a4bc-428f-9b66-b8a84f5d886f tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:05.113211 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9070d728-a4bc-428f-9b66-b8a84f5d886f tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:05.114219 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9070d728-a4bc-428f-9b66-b8a84f5d886f tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:05.114821 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9070d728-a4bc-428f-9b66-b8a84f5d886f tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:05.118152 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9cb327b6-b617-47a9-9430-510c048d922d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:05.118648 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9cb327b6-b617-47a9-9430-510c048d922d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:05.119084 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9cb327b6-b617-47a9-9430-510c048d922d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:05.119972 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9cb327b6-b617-47a9-9430-510c048d922d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:05.120713 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9cb327b6-b617-47a9-9430-510c048d922d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:05.121335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9cb327b6-b617-47a9-9430-510c048d922d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:05.375531 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9070d728-a4bc-428f-9b66-b8a84f5d886f tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:05.386173 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9070d728-a4bc-428f-9b66-b8a84f5d886f tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1807 microversion: 2.1 time: 0.287430 Sep 17 20:57:05.396593 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9cb327b6-b617-47a9-9430-510c048d922d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:05.396956 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 789/1637] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:05 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1807 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:05.409422 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9cb327b6-b617-47a9-9430-510c048d922d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 200 len: 1497 microversion: 2.1 time: 0.322633 Sep 17 20:57:05.410909 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 849/1638] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:05 2022] GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 1497 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:05.590247 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-08688d22-f496-43ce-b335-ec98cf5a7f4d tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:05.591778 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-08688d22-f496-43ce-b335-ec98cf5a7f4d tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] [instance: 15f3f131-e02d-46b1-ba15-509016665f36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:05.602555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08688d22-f496-43ce-b335-ec98cf5a7f4d tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:05.603979 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08688d22-f496-43ce-b335-ec98cf5a7f4d tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:05.604982 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08688d22-f496-43ce-b335-ec98cf5a7f4d tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:05.607048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08688d22-f496-43ce-b335-ec98cf5a7f4d tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:05.607772 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08688d22-f496-43ce-b335-ec98cf5a7f4d tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:05.608763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08688d22-f496-43ce-b335-ec98cf5a7f4d tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:05.785895 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-08688d22-f496-43ce-b335-ec98cf5a7f4d tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36" status: 200 len: 1612 microversion: 2.1 time: 0.201297 Sep 17 20:57:05.786490 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 790/1639] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:05 2022] GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36 => generated 1612 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:05.809731 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-aba7f30f-1876-48b4-a2b5-b18c49b465a7 tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:05.810306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-aba7f30f-1876-48b4-a2b5-b18c49b465a7 tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] [instance: 15f3f131-e02d-46b1-ba15-509016665f36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:05.817021 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aba7f30f-1876-48b4-a2b5-b18c49b465a7 tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:05.817551 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aba7f30f-1876-48b4-a2b5-b18c49b465a7 tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:05.817997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aba7f30f-1876-48b4-a2b5-b18c49b465a7 tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:05.818715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aba7f30f-1876-48b4-a2b5-b18c49b465a7 tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:05.819184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aba7f30f-1876-48b4-a2b5-b18c49b465a7 tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:05.819610 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aba7f30f-1876-48b4-a2b5-b18c49b465a7 tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:05.851043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d67eb417-760c-45a2-a314-83e9270f0695 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:05.851247 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-aba7f30f-1876-48b4-a2b5-b18c49b465a7 tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] HTTP exception thrown: Cannot 'migrate' instance 15f3f131-e02d-46b1-ba15-509016665f36 while it is in vm_state suspended Sep 17 20:57:05.851820 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d67eb417-760c-45a2-a314-83e9270f0695 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-aba7f30f-1876-48b4-a2b5-b18c49b465a7 tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Request method failure captured: Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36/action HTTP/1.1 Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 15 Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjRoZ-ObfzCUBfzJkN3mYg3NHzzon2Tw7JygK82iQWX6rEiMR4Xm40Yoj3hRNVX1b-fhemNCxdgXxvtLDt2olRQwGH3EvQZjEoz0_HZXEfSrhi-BHgI8uCJMVCYLSXUil-kE17N5rwDIBpYmwzq9I12UOvhqhZqlj5csiINuiIXbDUM Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: eddfa4151eed49beafb4a87d152dc8c4 Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-22223311 Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: X-Role: admin,member,reader Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: admin,member,reader Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eddfa4151eed49beafb4a87d152dc8c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/eddfa4151eed49beafb4a87d152dc8c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eddfa4151eed49beafb4a87d152dc8c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_eddfa4151eed49beafb4a87d152dc8c4", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersAdminNegativeTestJSON-22223311 Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: eddfa4151eed49beafb4a87d152dc8c4 Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-22223311 Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersAdminNegativeTestJSON-22223311-project-admin Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 1f386dc88f214f489cb4105c2f6c50b0 Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersAdminNegativeTestJSON-22223311-project-admin Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: {"migrate": {}} Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: exception: Cannot 'migrate' instance 15f3f131-e02d-46b1-ba15-509016665f36 while it is in vm_state suspended Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '15f3f131-e02d-46b1-ba15-509016665f36', 'body': {'migrate': {}}} Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 15f3f131-e02d-46b1-ba15-509016665f36 in vm_state suspended. Cannot resize while the instance is in this state. Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:57:05.852905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Sep 17 20:57:05.857437 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 17 20:57:05.857437 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 17 20:57:05.857437 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 17 20:57:05.857437 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 15f3f131-e02d-46b1-ba15-509016665f36 while it is in vm_state suspended Sep 17 20:57:05.857437 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:05.857437 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:05.857437 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:05.857437 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:05.857437 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:05.857437 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:05.857437 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:57:05.857437 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:57:05.857437 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 15f3f131-e02d-46b1-ba15-509016665f36 while it is in vm_state suspended Sep 17 20:57:05.857437 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:05.857437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-aba7f30f-1876-48b4-a2b5-b18c49b465a7 tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Returning 409 to user: Cannot 'migrate' instance 15f3f131-e02d-46b1-ba15-509016665f36 while it is in vm_state suspended {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:57:05.857437 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-aba7f30f-1876-48b4-a2b5-b18c49b465a7 tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36/action" status: 409 len: 148 microversion: 2.1 time: 0.048789 Sep 17 20:57:05.858657 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d67eb417-760c-45a2-a314-83e9270f0695 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:05.862324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d67eb417-760c-45a2-a314-83e9270f0695 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:05.862981 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d67eb417-760c-45a2-a314-83e9270f0695 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:05.863928 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d67eb417-760c-45a2-a314-83e9270f0695 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:05.864564 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d67eb417-760c-45a2-a314-83e9270f0695 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:05.865866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d67eb417-760c-45a2-a314-83e9270f0695 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:05.867926 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 850/1640] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:57:05 2022] POST /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36/action => generated 148 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 17 20:57:05.875235 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9e31f91b-929f-47b6-a884-d427eecac3ac tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9e31f91b-929f-47b6-a884-d427eecac3ac tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Request method failure captured: Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84/action HTTP/1.1 Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 39 Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjRoZ-ObfzCUBfzJkN3mYg3NHzzon2Tw7JygK82iQWX6rEiMR4Xm40Yoj3hRNVX1b-fhemNCxdgXxvtLDt2olRQwGH3EvQZjEoz0_HZXEfSrhi-BHgI8uCJMVCYLSXUil-kE17N5rwDIBpYmwzq9I12UOvhqhZqlj5csiINuiIXbDUM Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: eddfa4151eed49beafb4a87d152dc8c4 Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-22223311 Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: X-Role: admin,member,reader Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: admin,member,reader Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eddfa4151eed49beafb4a87d152dc8c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/eddfa4151eed49beafb4a87d152dc8c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eddfa4151eed49beafb4a87d152dc8c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_eddfa4151eed49beafb4a87d152dc8c4", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersAdminNegativeTestJSON-22223311 Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: eddfa4151eed49beafb4a87d152dc8c4 Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-22223311 Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersAdminNegativeTestJSON-22223311-project-admin Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 1f386dc88f214f489cb4105c2f6c50b0 Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersAdminNegativeTestJSON-22223311-project-admin Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: {"os-resetState": {"state": "invalid"}} Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'fe75e57c-282a-4bac-b0a2-1c52dd110c84', 'body': {'os-resetState': {'state': 'invalid'}}} Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise error Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'invalid' Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 20:57:05.883563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 20:57:05.889350 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 17 20:57:05.889350 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:05.889350 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:05.889350 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:05.889350 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:05.889350 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:05.889350 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:05.889350 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 20:57:05.889350 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 20:57:05.889350 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 17 20:57:05.889350 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:05.892622 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9e31f91b-929f-47b6-a884-d427eecac3ac tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:57:05.896077 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9e31f91b-929f-47b6-a884-d427eecac3ac tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84/action" status: 400 len: 144 microversion: 2.1 time: 0.026859 Sep 17 20:57:05.905919 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 851/1641] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:57:05 2022] POST /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84/action => generated 144 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 20:57:05.928456 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-09947107-db42-4f94-9caa-b0a9bfb8a95c tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-09947107-db42-4f94-9caa-b0a9bfb8a95c tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Request method failure captured: Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84/action HTTP/1.1 Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 31 Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjRoZ-ObfzCUBfzJkN3mYg3NHzzon2Tw7JygK82iQWX6rEiMR4Xm40Yoj3hRNVX1b-fhemNCxdgXxvtLDt2olRQwGH3EvQZjEoz0_HZXEfSrhi-BHgI8uCJMVCYLSXUil-kE17N5rwDIBpYmwzq9I12UOvhqhZqlj5csiINuiIXbDUM Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: eddfa4151eed49beafb4a87d152dc8c4 Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-22223311 Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: X-Role: admin,member,reader Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: admin,member,reader Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eddfa4151eed49beafb4a87d152dc8c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/eddfa4151eed49beafb4a87d152dc8c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eddfa4151eed49beafb4a87d152dc8c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_eddfa4151eed49beafb4a87d152dc8c4", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersAdminNegativeTestJSON-22223311 Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: eddfa4151eed49beafb4a87d152dc8c4 Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-22223311 Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersAdminNegativeTestJSON-22223311-project-admin Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 1f386dc88f214f489cb4105c2f6c50b0 Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersAdminNegativeTestJSON-22223311-project-admin Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: {"os-resetState": {"state": 1}} Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'fe75e57c-282a-4bac-b0a2-1c52dd110c84', 'body': {'os-resetState': {'state': 1}}} Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise error Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 1 Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 17 20:57:05.936732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:05.942088 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:05.942088 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:05.942088 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:05.942088 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:05.942088 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:05.942088 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 20:57:05.942088 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 20:57:05.942088 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 17 20:57:05.942088 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:05.942088 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-09947107-db42-4f94-9caa-b0a9bfb8a95c tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:57:05.942088 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-09947107-db42-4f94-9caa-b0a9bfb8a95c tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84/action" status: 400 len: 120 microversion: 2.1 time: 0.015861 Sep 17 20:57:05.942088 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 852/1642] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:57:05 2022] POST /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84/action => generated 120 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 20:57:05.951047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2fd53fd1-743a-4cee-8668-fd2bd58905cd tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:05.953523 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2fd53fd1-743a-4cee-8668-fd2bd58905cd tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Failed to fetch instance by id 999 {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 17 20:57:05.954058 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-2fd53fd1-743a-4cee-8668-fd2bd58905cd tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] HTTP exception thrown: Instance 999 could not be found. Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2fd53fd1-743a-4cee-8668-fd2bd58905cd tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Request method failure captured: Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 37 Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjRoZ-ObfzCUBfzJkN3mYg3NHzzon2Tw7JygK82iQWX6rEiMR4Xm40Yoj3hRNVX1b-fhemNCxdgXxvtLDt2olRQwGH3EvQZjEoz0_HZXEfSrhi-BHgI8uCJMVCYLSXUil-kE17N5rwDIBpYmwzq9I12UOvhqhZqlj5csiINuiIXbDUM Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: eddfa4151eed49beafb4a87d152dc8c4 Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-22223311 Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: X-Role: admin,member,reader Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: admin,member,reader Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eddfa4151eed49beafb4a87d152dc8c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/eddfa4151eed49beafb4a87d152dc8c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eddfa4151eed49beafb4a87d152dc8c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_eddfa4151eed49beafb4a87d152dc8c4", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersAdminNegativeTestJSON-22223311 Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: eddfa4151eed49beafb4a87d152dc8c4 Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-22223311 Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersAdminNegativeTestJSON-22223311-project-admin Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 1f386dc88f214f489cb4105c2f6c50b0 Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersAdminNegativeTestJSON-22223311-project-admin Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: {"os-resetState": {"state": "error"}} Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 999 could not be found. Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:05.956175 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:57:05.962217 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:57:05.962217 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 17 20:57:05.962217 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:05.962217 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2fd53fd1-743a-4cee-8668-fd2bd58905cd tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:57:05.962217 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2fd53fd1-743a-4cee-8668-fd2bd58905cd tempest-ServersAdminNegativeTestJSON-22223311 tempest-ServersAdminNegativeTestJSON-22223311-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.011611 Sep 17 20:57:05.962217 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 853/1643] 10.222.0.26 () {60 vars in 1179 bytes} [Sat Sep 17 20:57:05 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 20:57:05.970809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a36ecd5b-8a71-4fa6-b747-1c405f16458f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:05.971676 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a36ecd5b-8a71-4fa6-b747-1c405f16458f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: 15f3f131-e02d-46b1-ba15-509016665f36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:05.980131 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a36ecd5b-8a71-4fa6-b747-1c405f16458f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:05.980841 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a36ecd5b-8a71-4fa6-b747-1c405f16458f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:05.981350 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a36ecd5b-8a71-4fa6-b747-1c405f16458f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:05.982270 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a36ecd5b-8a71-4fa6-b747-1c405f16458f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:05.982789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a36ecd5b-8a71-4fa6-b747-1c405f16458f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:05.983289 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a36ecd5b-8a71-4fa6-b747-1c405f16458f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:06.014060 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a36ecd5b-8a71-4fa6-b747-1c405f16458f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: 15f3f131-e02d-46b1-ba15-509016665f36] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:57:06.044296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d67eb417-760c-45a2-a314-83e9270f0695 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:06.058000 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d67eb417-760c-45a2-a314-83e9270f0695 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1199 microversion: 2.1 time: 0.210879 Sep 17 20:57:06.058682 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 791/1644] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:05 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1199 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:57:06.097160 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-45e25634-0618-4e2d-ab5a-d1df17892059 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:06.098170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-45e25634-0618-4e2d-ab5a-d1df17892059 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:06.105088 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45e25634-0618-4e2d-ab5a-d1df17892059 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:06.105850 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45e25634-0618-4e2d-ab5a-d1df17892059 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:06.106592 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45e25634-0618-4e2d-ab5a-d1df17892059 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:06.107933 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45e25634-0618-4e2d-ab5a-d1df17892059 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:06.108722 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45e25634-0618-4e2d-ab5a-d1df17892059 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:06.109490 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45e25634-0618-4e2d-ab5a-d1df17892059 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:06.113405 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a36ecd5b-8a71-4fa6-b747-1c405f16458f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "DELETE /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36" status: 204 len: 0 microversion: 2.1 time: 0.148805 Sep 17 20:57:06.117600 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 854/1645] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:57:05 2022] DELETE /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 17 20:57:06.124724 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9ef22259-896a-44cc-b230-f109c7eb0332 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:06.125436 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9ef22259-896a-44cc-b230-f109c7eb0332 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: 15402a7f-bb11-44a8-b440-0511829670be] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:06.132597 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ef22259-896a-44cc-b230-f109c7eb0332 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:06.133089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ef22259-896a-44cc-b230-f109c7eb0332 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:06.133599 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ef22259-896a-44cc-b230-f109c7eb0332 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:06.134999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ef22259-896a-44cc-b230-f109c7eb0332 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:06.135458 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ef22259-896a-44cc-b230-f109c7eb0332 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:06.136088 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ef22259-896a-44cc-b230-f109c7eb0332 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:06.141601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-45e25634-0618-4e2d-ab5a-d1df17892059 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:57:06.158648 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:06.232803 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-45e25634-0618-4e2d-ab5a-d1df17892059 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "DELETE /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 204 len: 0 microversion: 2.25 time: 0.140486 Sep 17 20:57:06.238441 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 792/1646] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 17 20:57:06 2022] DELETE /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 20:57:06.246504 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e3e1d99c-65de-4c1c-9cb8-c43c9fec7fe3 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:06.247242 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e3e1d99c-65de-4c1c-9cb8-c43c9fec7fe3 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: 15f3f131-e02d-46b1-ba15-509016665f36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:06.258964 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e3e1d99c-65de-4c1c-9cb8-c43c9fec7fe3 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:06.259596 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e3e1d99c-65de-4c1c-9cb8-c43c9fec7fe3 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:06.260401 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e3e1d99c-65de-4c1c-9cb8-c43c9fec7fe3 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:06.261295 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e3e1d99c-65de-4c1c-9cb8-c43c9fec7fe3 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:06.261792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e3e1d99c-65de-4c1c-9cb8-c43c9fec7fe3 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:06.262446 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e3e1d99c-65de-4c1c-9cb8-c43c9fec7fe3 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:06.296711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9ef22259-896a-44cc-b230-f109c7eb0332 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:06.305776 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9ef22259-896a-44cc-b230-f109c7eb0332 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be" status: 200 len: 1317 microversion: 2.1 time: 0.186027 Sep 17 20:57:06.310144 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 855/1647] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:06 2022] GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:06.323109 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ad30192d-1e25-4662-8196-ad131c07aac8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:06.324100 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ad30192d-1e25-4662-8196-ad131c07aac8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:06.331351 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad30192d-1e25-4662-8196-ad131c07aac8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:06.331953 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad30192d-1e25-4662-8196-ad131c07aac8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:06.332443 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad30192d-1e25-4662-8196-ad131c07aac8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:06.333733 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad30192d-1e25-4662-8196-ad131c07aac8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:06.334362 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad30192d-1e25-4662-8196-ad131c07aac8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:06.334849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad30192d-1e25-4662-8196-ad131c07aac8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:06.367529 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:06.499012 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e3e1d99c-65de-4c1c-9cb8-c43c9fec7fe3 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:06.507470 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e3e1d99c-65de-4c1c-9cb8-c43c9fec7fe3 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36" status: 200 len: 1467 microversion: 2.1 time: 0.271276 Sep 17 20:57:06.508046 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 793/1648] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:06 2022] GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36 => generated 1467 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:06.512740 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c8732d21-5b32-44ee-9612-51b7b7c99f5a tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:06.513346 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c8732d21-5b32-44ee-9612-51b7b7c99f5a tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:06.519861 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8732d21-5b32-44ee-9612-51b7b7c99f5a tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:06.520360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8732d21-5b32-44ee-9612-51b7b7c99f5a tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:06.520782 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8732d21-5b32-44ee-9612-51b7b7c99f5a tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:06.521489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8732d21-5b32-44ee-9612-51b7b7c99f5a tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:06.522113 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8732d21-5b32-44ee-9612-51b7b7c99f5a tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:06.522544 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8732d21-5b32-44ee-9612-51b7b7c99f5a tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:06.631390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ad30192d-1e25-4662-8196-ad131c07aac8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:06.639718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ad30192d-1e25-4662-8196-ad131c07aac8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:06.641193 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ad30192d-1e25-4662-8196-ad131c07aac8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:06.642376 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ad30192d-1e25-4662-8196-ad131c07aac8 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 1732 microversion: 2.25 time: 0.323740 Sep 17 20:57:06.642947 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 856/1649] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:57:06 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 1732 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:57:06.647629 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c40d6eba-5019-4ab1-a65c-a0e57ac34687 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:06.648422 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c40d6eba-5019-4ab1-a65c-a0e57ac34687 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:06.655502 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c40d6eba-5019-4ab1-a65c-a0e57ac34687 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:06.656240 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c40d6eba-5019-4ab1-a65c-a0e57ac34687 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:06.656910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c40d6eba-5019-4ab1-a65c-a0e57ac34687 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:06.658228 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c40d6eba-5019-4ab1-a65c-a0e57ac34687 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:06.658736 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c40d6eba-5019-4ab1-a65c-a0e57ac34687 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:06.659415 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c40d6eba-5019-4ab1-a65c-a0e57ac34687 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:06.826039 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c8732d21-5b32-44ee-9612-51b7b7c99f5a tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:06.834413 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c8732d21-5b32-44ee-9612-51b7b7c99f5a tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1807 microversion: 2.1 time: 0.325264 Sep 17 20:57:06.834863 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 794/1650] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:06 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1807 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:06.912635 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c40d6eba-5019-4ab1-a65c-a0e57ac34687 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:06.920490 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c40d6eba-5019-4ab1-a65c-a0e57ac34687 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 200 len: 1497 microversion: 2.1 time: 0.276576 Sep 17 20:57:06.922013 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 857/1651] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:06 2022] GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 1497 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:07.083069 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-63c5399b-11f9-40f4-bcda-8638aec70e3e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:07.084375 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-63c5399b-11f9-40f4-bcda-8638aec70e3e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:07.091636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-63c5399b-11f9-40f4-bcda-8638aec70e3e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:07.092145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-63c5399b-11f9-40f4-bcda-8638aec70e3e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:07.092580 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-63c5399b-11f9-40f4-bcda-8638aec70e3e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:07.093645 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-63c5399b-11f9-40f4-bcda-8638aec70e3e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:07.094344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-63c5399b-11f9-40f4-bcda-8638aec70e3e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:07.094846 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-63c5399b-11f9-40f4-bcda-8638aec70e3e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:07.252211 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-63c5399b-11f9-40f4-bcda-8638aec70e3e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:07.260449 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-63c5399b-11f9-40f4-bcda-8638aec70e3e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1199 microversion: 2.1 time: 0.181737 Sep 17 20:57:07.276447 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 795/1652] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:07 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1199 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:07.329633 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-317f74aa-e805-4997-9d99-09035627624a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:07.330378 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-317f74aa-e805-4997-9d99-09035627624a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: 15402a7f-bb11-44a8-b440-0511829670be] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:07.336837 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-317f74aa-e805-4997-9d99-09035627624a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:07.337411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-317f74aa-e805-4997-9d99-09035627624a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:07.337967 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-317f74aa-e805-4997-9d99-09035627624a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:07.338750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-317f74aa-e805-4997-9d99-09035627624a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:07.339288 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-317f74aa-e805-4997-9d99-09035627624a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:07.339728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-317f74aa-e805-4997-9d99-09035627624a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:07.497732 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-317f74aa-e805-4997-9d99-09035627624a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:07.506977 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-317f74aa-e805-4997-9d99-09035627624a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be" status: 200 len: 1506 microversion: 2.1 time: 0.181691 Sep 17 20:57:07.507556 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 858/1653] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:07 2022] GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:07.516704 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-aa8d2998-4109-4b57-aa4a-c18b0b0e4119 req-79bd00a4-75e7-4920-863b-7e0d65016067 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ca7424d-e666-4a33-9cc7-c56de359e512", "name": "network-vif-plugged", "status": "completed", "tag": "7e2345f8-01ba-4dab-8432-e34b1aefa6e8"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:07.529094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-aa8d2998-4109-4b57-aa4a-c18b0b0e4119 req-79bd00a4-75e7-4920-863b-7e0d65016067 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:07.529783 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-aa8d2998-4109-4b57-aa4a-c18b0b0e4119 req-79bd00a4-75e7-4920-863b-7e0d65016067 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:07.531071 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-aa8d2998-4109-4b57-aa4a-c18b0b0e4119 req-79bd00a4-75e7-4920-863b-7e0d65016067 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:07.533283 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4bf34e4a-81aa-4c33-a2a3-d9b89600e9f5 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:07.534428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4bf34e4a-81aa-4c33-a2a3-d9b89600e9f5 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: 15402a7f-bb11-44a8-b440-0511829670be] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:07.540828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4bf34e4a-81aa-4c33-a2a3-d9b89600e9f5 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:07.541581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4bf34e4a-81aa-4c33-a2a3-d9b89600e9f5 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:07.542035 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4bf34e4a-81aa-4c33-a2a3-d9b89600e9f5 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:07.542738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4bf34e4a-81aa-4c33-a2a3-d9b89600e9f5 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:07.543201 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4bf34e4a-81aa-4c33-a2a3-d9b89600e9f5 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:07.543626 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4bf34e4a-81aa-4c33-a2a3-d9b89600e9f5 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:07.543740 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-aa8d2998-4109-4b57-aa4a-c18b0b0e4119 req-79bd00a4-75e7-4920-863b-7e0d65016067 service nova] Creating event network-vif-plugged:7e2345f8-01ba-4dab-8432-e34b1aefa6e8 for instance 4ca7424d-e666-4a33-9cc7-c56de359e512 on nch1-master-1 Sep 17 20:57:07.549377 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-aa8d2998-4109-4b57-aa4a-c18b0b0e4119 req-79bd00a4-75e7-4920-863b-7e0d65016067 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035703 Sep 17 20:57:07.549377 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 796/1654] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:57:07.554599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2bfa41d5-76af-48df-9696-767a53703f5c tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:07.555288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2bfa41d5-76af-48df-9696-767a53703f5c tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: 15f3f131-e02d-46b1-ba15-509016665f36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:07.561986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2bfa41d5-76af-48df-9696-767a53703f5c tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:07.562731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2bfa41d5-76af-48df-9696-767a53703f5c tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:07.563432 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2bfa41d5-76af-48df-9696-767a53703f5c tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:07.564492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2bfa41d5-76af-48df-9696-767a53703f5c tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:07.565178 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2bfa41d5-76af-48df-9696-767a53703f5c tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:07.565873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2bfa41d5-76af-48df-9696-767a53703f5c tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:07.750869 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4bf34e4a-81aa-4c33-a2a3-d9b89600e9f5 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:07.767925 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4bf34e4a-81aa-4c33-a2a3-d9b89600e9f5 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be" status: 200 len: 1506 microversion: 2.1 time: 0.240902 Sep 17 20:57:07.770453 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 859/1655] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:07 2022] GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be => generated 1506 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:57:07.770933 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2bfa41d5-76af-48df-9696-767a53703f5c tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:07.788392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-efbf775d-e103-4934-a28c-586a90061d83 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:07.789356 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-efbf775d-e103-4934-a28c-586a90061d83 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:07.792009 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2bfa41d5-76af-48df-9696-767a53703f5c tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36" status: 200 len: 1467 microversion: 2.1 time: 0.237856 Sep 17 20:57:07.793242 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 797/1656] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:07 2022] GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36 => generated 1467 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:07.798174 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-efbf775d-e103-4934-a28c-586a90061d83 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:07.799105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-efbf775d-e103-4934-a28c-586a90061d83 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:07.799777 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-40c180fd-2722-477f-a246-72dd04ce4d94 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:07.800315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-efbf775d-e103-4934-a28c-586a90061d83 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:07.801359 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-efbf775d-e103-4934-a28c-586a90061d83 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:07.802165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-efbf775d-e103-4934-a28c-586a90061d83 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:07.802701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-40c180fd-2722-477f-a246-72dd04ce4d94 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: 15402a7f-bb11-44a8-b440-0511829670be] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:07.803306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-efbf775d-e103-4934-a28c-586a90061d83 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:07.813059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-40c180fd-2722-477f-a246-72dd04ce4d94 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:07.813903 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-40c180fd-2722-477f-a246-72dd04ce4d94 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:07.814560 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-40c180fd-2722-477f-a246-72dd04ce4d94 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:07.815534 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-40c180fd-2722-477f-a246-72dd04ce4d94 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:07.816439 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-40c180fd-2722-477f-a246-72dd04ce4d94 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:07.817125 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-40c180fd-2722-477f-a246-72dd04ce4d94 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:07.917185 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-40c180fd-2722-477f-a246-72dd04ce4d94 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "PUT /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be" status: 200 len: 1078 microversion: 2.1 time: 0.121225 Sep 17 20:57:07.918950 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 798/1657] 10.222.0.26 () {60 vars in 1256 bytes} [Sat Sep 17 20:57:07 2022] PUT /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be => generated 1078 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:07.936590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-245ad30a-142a-4790-a150-736d47dabc13 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:07.938621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-245ad30a-142a-4790-a150-736d47dabc13 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:07.941171 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:07.960904 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-245ad30a-142a-4790-a150-736d47dabc13 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:07.961411 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-245ad30a-142a-4790-a150-736d47dabc13 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:07.963187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-245ad30a-142a-4790-a150-736d47dabc13 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:07.964175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-245ad30a-142a-4790-a150-736d47dabc13 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:07.966126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-245ad30a-142a-4790-a150-736d47dabc13 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:07.966820 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-245ad30a-142a-4790-a150-736d47dabc13 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:07.967520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-efbf775d-e103-4934-a28c-586a90061d83 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:07.978542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-efbf775d-e103-4934-a28c-586a90061d83 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:07.980341 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-efbf775d-e103-4934-a28c-586a90061d83 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:07.981838 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-efbf775d-e103-4934-a28c-586a90061d83 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 1732 microversion: 2.25 time: 0.209359 Sep 17 20:57:07.982952 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 860/1658] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:57:07 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 1732 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:57:07.988577 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-43ed0a2b-7f53-4fb2-b358-2612d8915d7a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:07.989297 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-43ed0a2b-7f53-4fb2-b358-2612d8915d7a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: 15402a7f-bb11-44a8-b440-0511829670be] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:07.995999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43ed0a2b-7f53-4fb2-b358-2612d8915d7a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:07.996785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43ed0a2b-7f53-4fb2-b358-2612d8915d7a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:07.997437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43ed0a2b-7f53-4fb2-b358-2612d8915d7a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:07.998404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43ed0a2b-7f53-4fb2-b358-2612d8915d7a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:07.999255 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43ed0a2b-7f53-4fb2-b358-2612d8915d7a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:07.999829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43ed0a2b-7f53-4fb2-b358-2612d8915d7a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:08.279928 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-43ed0a2b-7f53-4fb2-b358-2612d8915d7a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:08.283182 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-245ad30a-142a-4790-a150-736d47dabc13 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:08.293316 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-43ed0a2b-7f53-4fb2-b358-2612d8915d7a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be" status: 200 len: 1504 microversion: 2.1 time: 0.308448 Sep 17 20:57:08.293574 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-245ad30a-142a-4790-a150-736d47dabc13 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1807 microversion: 2.1 time: 0.373203 Sep 17 20:57:08.294216 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 799/1659] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:07 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1807 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:08.301481 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 861/1660] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:07 2022] GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be => generated 1504 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:08.304510 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4c93fcd9-bbc2-4c7e-8eee-5b8987625669 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:08.305117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4c93fcd9-bbc2-4c7e-8eee-5b8987625669 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:08.308136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3f0386ad-0346-4fe9-96f4-6990586629ad tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:08.309797 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3f0386ad-0346-4fe9-96f4-6990586629ad tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:08.315137 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c93fcd9-bbc2-4c7e-8eee-5b8987625669 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:08.315869 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c93fcd9-bbc2-4c7e-8eee-5b8987625669 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:08.316513 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c93fcd9-bbc2-4c7e-8eee-5b8987625669 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:08.317384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c93fcd9-bbc2-4c7e-8eee-5b8987625669 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:08.318171 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c93fcd9-bbc2-4c7e-8eee-5b8987625669 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:08.318949 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c93fcd9-bbc2-4c7e-8eee-5b8987625669 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:08.330955 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f0386ad-0346-4fe9-96f4-6990586629ad tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:08.332394 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f0386ad-0346-4fe9-96f4-6990586629ad tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:08.333543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f0386ad-0346-4fe9-96f4-6990586629ad tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:08.334866 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f0386ad-0346-4fe9-96f4-6990586629ad tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:08.335493 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f0386ad-0346-4fe9-96f4-6990586629ad tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:08.336217 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f0386ad-0346-4fe9-96f4-6990586629ad tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:08.587752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4c93fcd9-bbc2-4c7e-8eee-5b8987625669 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:08.597933 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4c93fcd9-bbc2-4c7e-8eee-5b8987625669 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 200 len: 1497 microversion: 2.1 time: 0.302451 Sep 17 20:57:08.598957 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 800/1661] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:08 2022] GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 1497 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:08.610754 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d4b33c14-9d12-4579-b479-deb668d19428 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:08.613497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d4b33c14-9d12-4579-b479-deb668d19428 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: 15402a7f-bb11-44a8-b440-0511829670be] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:08.622307 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d4b33c14-9d12-4579-b479-deb668d19428 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:08.622818 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d4b33c14-9d12-4579-b479-deb668d19428 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:08.623632 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d4b33c14-9d12-4579-b479-deb668d19428 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:08.624402 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d4b33c14-9d12-4579-b479-deb668d19428 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:08.624882 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d4b33c14-9d12-4579-b479-deb668d19428 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:08.626319 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d4b33c14-9d12-4579-b479-deb668d19428 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:08.677911 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3f0386ad-0346-4fe9-96f4-6990586629ad tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:08.687414 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3f0386ad-0346-4fe9-96f4-6990586629ad tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1199 microversion: 2.1 time: 0.384520 Sep 17 20:57:08.698761 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 862/1662] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:08 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1199 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:08.820418 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0067ea9d-9451-4758-a1a6-0b4f23a27990 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:08.821445 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0067ea9d-9451-4758-a1a6-0b4f23a27990 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: 15f3f131-e02d-46b1-ba15-509016665f36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:08.839722 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d4b33c14-9d12-4579-b479-deb668d19428 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:08.840672 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0067ea9d-9451-4758-a1a6-0b4f23a27990 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:08.842770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0067ea9d-9451-4758-a1a6-0b4f23a27990 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:08.845099 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0067ea9d-9451-4758-a1a6-0b4f23a27990 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:08.845992 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0067ea9d-9451-4758-a1a6-0b4f23a27990 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:08.846855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0067ea9d-9451-4758-a1a6-0b4f23a27990 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:08.849660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0067ea9d-9451-4758-a1a6-0b4f23a27990 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:08.850072 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d4b33c14-9d12-4579-b479-deb668d19428 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be" status: 200 len: 1504 microversion: 2.1 time: 0.249749 Sep 17 20:57:08.867790 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 801/1663] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:08 2022] GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be => generated 1504 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:08.890032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3478b45b-c1c2-4287-9867-51b26d54960e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:08.895692 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3478b45b-c1c2-4287-9867-51b26d54960e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: 15402a7f-bb11-44a8-b440-0511829670be] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:08.910361 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3478b45b-c1c2-4287-9867-51b26d54960e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:08.910852 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3478b45b-c1c2-4287-9867-51b26d54960e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:08.914064 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3478b45b-c1c2-4287-9867-51b26d54960e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:08.914977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3478b45b-c1c2-4287-9867-51b26d54960e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:08.915661 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3478b45b-c1c2-4287-9867-51b26d54960e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:08.916248 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3478b45b-c1c2-4287-9867-51b26d54960e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:09.009042 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3478b45b-c1c2-4287-9867-51b26d54960e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "PUT /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be" status: 200 len: 1080 microversion: 2.1 time: 0.139332 Sep 17 20:57:09.010259 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 802/1664] 10.222.0.26 () {60 vars in 1256 bytes} [Sat Sep 17 20:57:08 2022] PUT /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be => generated 1080 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:09.015597 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6cd95285-213b-4e1e-960b-c44447878b07 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:09.016463 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6cd95285-213b-4e1e-960b-c44447878b07 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:09.025139 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6cd95285-213b-4e1e-960b-c44447878b07 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:09.026066 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6cd95285-213b-4e1e-960b-c44447878b07 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:09.026757 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6cd95285-213b-4e1e-960b-c44447878b07 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:09.031097 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6cd95285-213b-4e1e-960b-c44447878b07 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:09.031705 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6cd95285-213b-4e1e-960b-c44447878b07 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:09.032101 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6cd95285-213b-4e1e-960b-c44447878b07 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:09.132066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0067ea9d-9451-4758-a1a6-0b4f23a27990 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:09.145309 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0067ea9d-9451-4758-a1a6-0b4f23a27990 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36" status: 200 len: 1467 microversion: 2.1 time: 0.333245 Sep 17 20:57:09.146714 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 863/1665] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:08 2022] GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36 => generated 1467 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:57:09.175357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ea109ff7-4cdf-455e-9fab-d3bdb0fb0551 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:09.176251 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ea109ff7-4cdf-455e-9fab-d3bdb0fb0551 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: 15402a7f-bb11-44a8-b440-0511829670be] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:09.200709 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea109ff7-4cdf-455e-9fab-d3bdb0fb0551 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:09.201725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea109ff7-4cdf-455e-9fab-d3bdb0fb0551 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:09.202433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea109ff7-4cdf-455e-9fab-d3bdb0fb0551 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:09.203407 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea109ff7-4cdf-455e-9fab-d3bdb0fb0551 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:09.204060 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea109ff7-4cdf-455e-9fab-d3bdb0fb0551 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:09.204761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea109ff7-4cdf-455e-9fab-d3bdb0fb0551 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:09.322876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6cd95285-213b-4e1e-960b-c44447878b07 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:09.338963 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6cd95285-213b-4e1e-960b-c44447878b07 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:09.340413 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6cd95285-213b-4e1e-960b-c44447878b07 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:09.341648 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6cd95285-213b-4e1e-960b-c44447878b07 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 1732 microversion: 2.25 time: 0.330226 Sep 17 20:57:09.342234 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 803/1666] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:57:09 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 1732 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:57:09.354405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8df2a724-79a5-4afc-8d35-a723bb88636c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:09.355053 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8df2a724-79a5-4afc-8d35-a723bb88636c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:09.374047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8df2a724-79a5-4afc-8d35-a723bb88636c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:09.374557 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8df2a724-79a5-4afc-8d35-a723bb88636c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:09.374996 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8df2a724-79a5-4afc-8d35-a723bb88636c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:09.378803 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8df2a724-79a5-4afc-8d35-a723bb88636c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:09.382299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8df2a724-79a5-4afc-8d35-a723bb88636c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:09.383451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8df2a724-79a5-4afc-8d35-a723bb88636c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:09.558297 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ea109ff7-4cdf-455e-9fab-d3bdb0fb0551 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:09.566739 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ea109ff7-4cdf-455e-9fab-d3bdb0fb0551 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be" status: 200 len: 1506 microversion: 2.1 time: 0.418540 Sep 17 20:57:09.578421 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 864/1667] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:09 2022] GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be => generated 1506 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:09.592026 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6807ba82-e339-4702-8d38-cc3b2d92eb6f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:09.592667 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6807ba82-e339-4702-8d38-cc3b2d92eb6f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: 15402a7f-bb11-44a8-b440-0511829670be] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:09.602751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6807ba82-e339-4702-8d38-cc3b2d92eb6f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:09.603261 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6807ba82-e339-4702-8d38-cc3b2d92eb6f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:09.603716 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6807ba82-e339-4702-8d38-cc3b2d92eb6f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:09.604457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6807ba82-e339-4702-8d38-cc3b2d92eb6f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:09.604958 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6807ba82-e339-4702-8d38-cc3b2d92eb6f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:09.605332 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6807ba82-e339-4702-8d38-cc3b2d92eb6f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:09.796862 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8df2a724-79a5-4afc-8d35-a723bb88636c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:09.815031 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8df2a724-79a5-4afc-8d35-a723bb88636c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1807 microversion: 2.1 time: 0.471520 Sep 17 20:57:09.830097 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 804/1668] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:09 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1807 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:09.838344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7a7b7076-2a59-4e25-baf3-0c1999ca59d5 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:09.840037 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7a7b7076-2a59-4e25-baf3-0c1999ca59d5 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:09.846943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a7b7076-2a59-4e25-baf3-0c1999ca59d5 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:09.847806 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a7b7076-2a59-4e25-baf3-0c1999ca59d5 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:09.848481 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a7b7076-2a59-4e25-baf3-0c1999ca59d5 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:09.849433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a7b7076-2a59-4e25-baf3-0c1999ca59d5 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:09.850150 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a7b7076-2a59-4e25-baf3-0c1999ca59d5 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:09.850801 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a7b7076-2a59-4e25-baf3-0c1999ca59d5 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:10.221866 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6807ba82-e339-4702-8d38-cc3b2d92eb6f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:10.253575 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6807ba82-e339-4702-8d38-cc3b2d92eb6f tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be" status: 200 len: 1506 microversion: 2.1 time: 0.662757 Sep 17 20:57:10.257037 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 865/1669] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:09 2022] GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be => generated 1506 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:57:10.265566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-19e28c72-ef87-4793-9e40-0206a0531b9f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:10.266739 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-19e28c72-ef87-4793-9e40-0206a0531b9f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:10.283366 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-19e28c72-ef87-4793-9e40-0206a0531b9f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:10.285719 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-19e28c72-ef87-4793-9e40-0206a0531b9f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:10.286652 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-19e28c72-ef87-4793-9e40-0206a0531b9f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:10.287910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-19e28c72-ef87-4793-9e40-0206a0531b9f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:10.291476 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-19e28c72-ef87-4793-9e40-0206a0531b9f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:10.292333 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-19e28c72-ef87-4793-9e40-0206a0531b9f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:10.606263 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7a7b7076-2a59-4e25-baf3-0c1999ca59d5 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:10.628723 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7a7b7076-2a59-4e25-baf3-0c1999ca59d5 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 200 len: 1497 microversion: 2.1 time: 0.797207 Sep 17 20:57:10.629856 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 805/1670] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:09 2022] GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 1497 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:10.635761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5c320d51-e940-436b-821d-88021f62f83f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:10.644006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5c320d51-e940-436b-821d-88021f62f83f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: 15f3f131-e02d-46b1-ba15-509016665f36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:10.665524 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c320d51-e940-436b-821d-88021f62f83f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:10.672750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c320d51-e940-436b-821d-88021f62f83f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:10.673964 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c320d51-e940-436b-821d-88021f62f83f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:10.675096 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c320d51-e940-436b-821d-88021f62f83f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:10.675801 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c320d51-e940-436b-821d-88021f62f83f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:10.678401 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c320d51-e940-436b-821d-88021f62f83f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:11.347841 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5c320d51-e940-436b-821d-88021f62f83f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:11.366177 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5c320d51-e940-436b-821d-88021f62f83f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36" status: 200 len: 1425 microversion: 2.1 time: 0.734057 Sep 17 20:57:11.369685 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 806/1671] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:10 2022] GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36 => generated 1425 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:11.399939 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-17d73d05-2318-4e56-91dc-c65a8bd32737 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:11.401404 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-17d73d05-2318-4e56-91dc-c65a8bd32737 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: 15402a7f-bb11-44a8-b440-0511829670be] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:11.418466 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17d73d05-2318-4e56-91dc-c65a8bd32737 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:11.419119 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17d73d05-2318-4e56-91dc-c65a8bd32737 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:11.419782 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17d73d05-2318-4e56-91dc-c65a8bd32737 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:11.420665 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17d73d05-2318-4e56-91dc-c65a8bd32737 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:11.421250 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17d73d05-2318-4e56-91dc-c65a8bd32737 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:11.422045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17d73d05-2318-4e56-91dc-c65a8bd32737 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:11.448690 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:11.486074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-17d73d05-2318-4e56-91dc-c65a8bd32737 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: 15402a7f-bb11-44a8-b440-0511829670be] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:57:11.623208 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-19e28c72-ef87-4793-9e40-0206a0531b9f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:11.630661 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-17d73d05-2318-4e56-91dc-c65a8bd32737 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "DELETE /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be" status: 204 len: 0 microversion: 2.1 time: 0.257879 Sep 17 20:57:11.633361 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 807/1672] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:57:11 2022] DELETE /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:57:11.641742 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-19e28c72-ef87-4793-9e40-0206a0531b9f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1382 microversion: 2.1 time: 1.382602 Sep 17 20:57:11.644751 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 866/1673] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:10 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1382 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:11.645550 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-452e31b6-6ba5-43f7-844d-97c6f445f63b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:11.646673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-452e31b6-6ba5-43f7-844d-97c6f445f63b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:11.655850 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-452e31b6-6ba5-43f7-844d-97c6f445f63b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:11.656704 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-452e31b6-6ba5-43f7-844d-97c6f445f63b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:11.657291 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-452e31b6-6ba5-43f7-844d-97c6f445f63b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:11.658285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-452e31b6-6ba5-43f7-844d-97c6f445f63b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:11.659171 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-452e31b6-6ba5-43f7-844d-97c6f445f63b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:11.659855 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-452e31b6-6ba5-43f7-844d-97c6f445f63b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:11.660337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-b3d05c2a-8d3d-4419-854a-2c4b0688d1a9 req-c5b6d83b-d891-4555-a58e-cfdd0f1791e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f0fd2e6-7a40-44f0-9ab7-71ff4489741a", "name": "network-vif-deleted", "tag": "7fa83e5d-ec8d-48f1-b098-873e8265bb06"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:11.714399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b3d05c2a-8d3d-4419-854a-2c4b0688d1a9 req-c5b6d83b-d891-4555-a58e-cfdd0f1791e7 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:11.715407 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b3d05c2a-8d3d-4419-854a-2c4b0688d1a9 req-c5b6d83b-d891-4555-a58e-cfdd0f1791e7 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:11.716745 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b3d05c2a-8d3d-4419-854a-2c4b0688d1a9 req-c5b6d83b-d891-4555-a58e-cfdd0f1791e7 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:11.771215 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-b3d05c2a-8d3d-4419-854a-2c4b0688d1a9 req-c5b6d83b-d891-4555-a58e-cfdd0f1791e7 service nova] Creating event network-vif-deleted:7fa83e5d-ec8d-48f1-b098-873e8265bb06 for instance 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a on nch1-master-1 Sep 17 20:57:11.774068 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-452e31b6-6ba5-43f7-844d-97c6f445f63b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:11.774671 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-452e31b6-6ba5-43f7-844d-97c6f445f63b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:11.775460 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-452e31b6-6ba5-43f7-844d-97c6f445f63b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:11.776544 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-452e31b6-6ba5-43f7-844d-97c6f445f63b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lazy-loading 'fault' on Instance uuid 796a6ed8-e44a-4e34-849d-1daeb1f363dd {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:57:11.786675 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-b3d05c2a-8d3d-4419-854a-2c4b0688d1a9 req-c5b6d83b-d891-4555-a58e-cfdd0f1791e7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138934 Sep 17 20:57:11.790302 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 867/1674] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:11.808683 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a123d25a-be9f-4382-afb1-3b80e98dc632 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:11.810076 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a123d25a-be9f-4382-afb1-3b80e98dc632 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:11.817717 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a123d25a-be9f-4382-afb1-3b80e98dc632 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:11.819135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a123d25a-be9f-4382-afb1-3b80e98dc632 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:11.820184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a123d25a-be9f-4382-afb1-3b80e98dc632 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:11.830076 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a123d25a-be9f-4382-afb1-3b80e98dc632 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:11.831180 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a123d25a-be9f-4382-afb1-3b80e98dc632 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:11.832305 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a123d25a-be9f-4382-afb1-3b80e98dc632 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:12.345899 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-452e31b6-6ba5-43f7-844d-97c6f445f63b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:12.356781 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-452e31b6-6ba5-43f7-844d-97c6f445f63b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:12.359371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-452e31b6-6ba5-43f7-844d-97c6f445f63b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:12.361667 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-452e31b6-6ba5-43f7-844d-97c6f445f63b tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 200 len: 1375 microversion: 2.25 time: 0.725945 Sep 17 20:57:12.364102 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 808/1675] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:57:11 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 1375 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:57:12.377850 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-604f032b-7cdd-4e37-8684-1ba1629f37b8 req-395e2121-c7ed-48a0-98ab-fe44fa54a31b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15f3f131-e02d-46b1-ba15-509016665f36", "name": "network-vif-deleted", "tag": "9b9fb41b-b40c-44a0-bc52-610120eb986a"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:12.401886 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-604f032b-7cdd-4e37-8684-1ba1629f37b8 req-395e2121-c7ed-48a0-98ab-fe44fa54a31b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:12.402457 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-604f032b-7cdd-4e37-8684-1ba1629f37b8 req-395e2121-c7ed-48a0-98ab-fe44fa54a31b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:12.403172 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-604f032b-7cdd-4e37-8684-1ba1629f37b8 req-395e2121-c7ed-48a0-98ab-fe44fa54a31b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:12.423728 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-604f032b-7cdd-4e37-8684-1ba1629f37b8 req-395e2121-c7ed-48a0-98ab-fe44fa54a31b service nova] Creating event network-vif-deleted:9b9fb41b-b40c-44a0-bc52-610120eb986a for instance 15f3f131-e02d-46b1-ba15-509016665f36 on nch1-master-1 Sep 17 20:57:12.436275 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-604f032b-7cdd-4e37-8684-1ba1629f37b8 req-395e2121-c7ed-48a0-98ab-fe44fa54a31b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070425 Sep 17 20:57:12.438642 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 809/1676] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:12.452985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d8a1bbda-14e5-4070-a1b7-a428fe580b5e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:12.454412 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d8a1bbda-14e5-4070-a1b7-a428fe580b5e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: 15402a7f-bb11-44a8-b440-0511829670be] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:12.477409 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8a1bbda-14e5-4070-a1b7-a428fe580b5e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:12.481780 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8a1bbda-14e5-4070-a1b7-a428fe580b5e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:12.482541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8a1bbda-14e5-4070-a1b7-a428fe580b5e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:12.483342 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8a1bbda-14e5-4070-a1b7-a428fe580b5e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:12.485765 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8a1bbda-14e5-4070-a1b7-a428fe580b5e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:12.486214 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8a1bbda-14e5-4070-a1b7-a428fe580b5e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:12.575058 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d8a1bbda-14e5-4070-a1b7-a428fe580b5e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: 15402a7f-bb11-44a8-b440-0511829670be] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:57:12.608281 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a123d25a-be9f-4382-afb1-3b80e98dc632 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:12.623879 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a123d25a-be9f-4382-afb1-3b80e98dc632 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1765 microversion: 2.1 time: 0.830786 Sep 17 20:57:12.625519 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 868/1677] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:11 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1765 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:12.631165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-843f48b9-823a-46ef-b3bd-aab6c70c56f6 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:12.632155 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-843f48b9-823a-46ef-b3bd-aab6c70c56f6 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:12.640401 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-843f48b9-823a-46ef-b3bd-aab6c70c56f6 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:12.644890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-843f48b9-823a-46ef-b3bd-aab6c70c56f6 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:12.645975 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-843f48b9-823a-46ef-b3bd-aab6c70c56f6 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:12.649666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-843f48b9-823a-46ef-b3bd-aab6c70c56f6 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:12.650419 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-843f48b9-823a-46ef-b3bd-aab6c70c56f6 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:12.652073 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-843f48b9-823a-46ef-b3bd-aab6c70c56f6 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:12.715433 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.compute.api [None req-d8a1bbda-14e5-4070-a1b7-a428fe580b5e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: 15402a7f-bb11-44a8-b440-0511829670be] Instance is already in deleting state, ignoring this request Sep 17 20:57:12.716688 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d8a1bbda-14e5-4070-a1b7-a428fe580b5e tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "DELETE /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be" status: 204 len: 0 microversion: 2.1 time: 0.276613 Sep 17 20:57:12.725022 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 810/1678] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:57:12 2022] DELETE /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:57:12.732203 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a299edd9-6f01-4508-8249-df5cc504513c tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:12.732831 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a299edd9-6f01-4508-8249-df5cc504513c tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:12.749192 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a299edd9-6f01-4508-8249-df5cc504513c tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:12.754966 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a299edd9-6f01-4508-8249-df5cc504513c tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:12.755746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a299edd9-6f01-4508-8249-df5cc504513c tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:12.761982 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a299edd9-6f01-4508-8249-df5cc504513c tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:12.762815 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a299edd9-6f01-4508-8249-df5cc504513c tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:12.763277 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a299edd9-6f01-4508-8249-df5cc504513c tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:13.304415 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a299edd9-6f01-4508-8249-df5cc504513c tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1533 microversion: 2.1 time: 0.580535 Sep 17 20:57:13.305317 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 811/1679] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:12 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1533 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:13.321939 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-39c230f3-84f9-4c50-a0d3-1059ce0dbd6d tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:13.322949 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-39c230f3-84f9-4c50-a0d3-1059ce0dbd6d tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: 15f3f131-e02d-46b1-ba15-509016665f36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:13.325340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-843f48b9-823a-46ef-b3bd-aab6c70c56f6 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:13.333006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-39c230f3-84f9-4c50-a0d3-1059ce0dbd6d tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:13.333524 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-39c230f3-84f9-4c50-a0d3-1059ce0dbd6d tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:13.333961 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-39c230f3-84f9-4c50-a0d3-1059ce0dbd6d tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:13.334678 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-39c230f3-84f9-4c50-a0d3-1059ce0dbd6d tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:13.335129 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-39c230f3-84f9-4c50-a0d3-1059ce0dbd6d tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:13.335706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-39c230f3-84f9-4c50-a0d3-1059ce0dbd6d tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:13.346464 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-843f48b9-823a-46ef-b3bd-aab6c70c56f6 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 200 len: 1497 microversion: 2.1 time: 0.719466 Sep 17 20:57:13.358594 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 869/1680] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:12 2022] GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 1497 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:13.369056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-2ff486e3-6dce-469f-851e-f62fa1b5c132 req-d2d6503b-c13e-4503-ab0b-cabf01b8eac3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f0fd2e6-7a40-44f0-9ab7-71ff4489741a", "name": "network-vif-unplugged", "status": "completed", "tag": "b3992f00-9706-4260-982f-77dfde504678"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:13.374170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-39c230f3-84f9-4c50-a0d3-1059ce0dbd6d tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:13.375003 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-39c230f3-84f9-4c50-a0d3-1059ce0dbd6d tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:13.375793 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-39c230f3-84f9-4c50-a0d3-1059ce0dbd6d tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:13.376558 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-39c230f3-84f9-4c50-a0d3-1059ce0dbd6d tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lazy-loading 'fault' on Instance uuid 15f3f131-e02d-46b1-ba15-509016665f36 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:57:13.387529 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-2ff486e3-6dce-469f-851e-f62fa1b5c132 req-d2d6503b-c13e-4503-ab0b-cabf01b8eac3 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:13.388069 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-2ff486e3-6dce-469f-851e-f62fa1b5c132 req-d2d6503b-c13e-4503-ab0b-cabf01b8eac3 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:13.388505 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-2ff486e3-6dce-469f-851e-f62fa1b5c132 req-d2d6503b-c13e-4503-ab0b-cabf01b8eac3 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:13.412690 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-2ff486e3-6dce-469f-851e-f62fa1b5c132 req-d2d6503b-c13e-4503-ab0b-cabf01b8eac3 service nova] Creating event network-vif-unplugged:b3992f00-9706-4260-982f-77dfde504678 for instance 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a on nch1-master-1 Sep 17 20:57:13.424417 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-2ff486e3-6dce-469f-851e-f62fa1b5c132 req-d2d6503b-c13e-4503-ab0b-cabf01b8eac3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064273 Sep 17 20:57:13.430138 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 870/1681] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:13.441506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-87260135-ec16-4ab9-8d62-40c244953dae tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:13.442305 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-87260135-ec16-4ab9-8d62-40c244953dae tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: 15402a7f-bb11-44a8-b440-0511829670be] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:13.459947 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87260135-ec16-4ab9-8d62-40c244953dae tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:13.463888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87260135-ec16-4ab9-8d62-40c244953dae tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:13.464424 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87260135-ec16-4ab9-8d62-40c244953dae tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:13.465316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87260135-ec16-4ab9-8d62-40c244953dae tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:13.466066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87260135-ec16-4ab9-8d62-40c244953dae tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:13.467235 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87260135-ec16-4ab9-8d62-40c244953dae tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:13.579529 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-39c230f3-84f9-4c50-a0d3-1059ce0dbd6d tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:13.593875 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-39c230f3-84f9-4c50-a0d3-1059ce0dbd6d tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36" status: 200 len: 1311 microversion: 2.1 time: 0.284929 Sep 17 20:57:13.617610 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 812/1682] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:13 2022] GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36 => generated 1311 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:13.626748 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7ccf0751-8dd1-4334-8f6f-8f2478658a4a tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:13.629146 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7ccf0751-8dd1-4334-8f6f-8f2478658a4a tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:13.637211 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ccf0751-8dd1-4334-8f6f-8f2478658a4a tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:13.638022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ccf0751-8dd1-4334-8f6f-8f2478658a4a tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:13.639815 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ccf0751-8dd1-4334-8f6f-8f2478658a4a tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:13.640804 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ccf0751-8dd1-4334-8f6f-8f2478658a4a tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:13.641562 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ccf0751-8dd1-4334-8f6f-8f2478658a4a tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:13.642243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ccf0751-8dd1-4334-8f6f-8f2478658a4a tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:14.107896 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7ccf0751-8dd1-4334-8f6f-8f2478658a4a tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1533 microversion: 2.1 time: 0.486832 Sep 17 20:57:14.113344 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 813/1683] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:13 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1533 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:14.118403 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f1f98a57-588d-467c-a667-c0e707b0977a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:14.118922 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f1f98a57-588d-467c-a667-c0e707b0977a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 796a6ed8-e44a-4e34-849d-1daeb1f363dd] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:14.134305 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1f98a57-588d-467c-a667-c0e707b0977a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:14.135080 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1f98a57-588d-467c-a667-c0e707b0977a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:14.135698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1f98a57-588d-467c-a667-c0e707b0977a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:14.136576 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1f98a57-588d-467c-a667-c0e707b0977a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:14.137208 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1f98a57-588d-467c-a667-c0e707b0977a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:14.137825 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1f98a57-588d-467c-a667-c0e707b0977a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:14.154040 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-f1f98a57-588d-467c-a667-c0e707b0977a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] HTTP exception thrown: Instance 796a6ed8-e44a-4e34-849d-1daeb1f363dd could not be found. Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f1f98a57-588d-467c-a667-c0e707b0977a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Request method failure captured: Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd HTTP/1.1 Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjNRMAPX_oTsPhy9TfA5vu2vyNW5I1IgC_1G9MjGTLqycu01SdxDB1FQYnE4eP90RiN0J5FJdUywXLYCcYRiKroAyLyOhXaJdhri5JVTmmNDHZZ22UM3Q0dE9BqBpbNF6NGgyn9xK5g6Eb8IAu6FGQEDpUrY4GSRsSTNP6PFmk30ZJY Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: X-Openstack-Nova-Api-Version: 2.25 Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 7dc8bc81c2d74bae9612f7c9807350a7 Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1505099207 Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7dc8bc81c2d74bae9612f7c9807350a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7dc8bc81c2d74bae9612f7c9807350a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7dc8bc81c2d74bae9612f7c9807350a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7dc8bc81c2d74bae9612f7c9807350a7", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1505099207 Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 7dc8bc81c2d74bae9612f7c9807350a7 Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1505099207 Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-LiveAutoBlockMigrationV225Test-1505099207-project Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: f1134231b4a545fdb136a5204cb4f289 Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1505099207-project Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 796a6ed8-e44a-4e34-849d-1daeb1f363dd could not be found. Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '796a6ed8-e44a-4e34-849d-1daeb1f363dd'} Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 796a6ed8-e44a-4e34-849d-1daeb1f363dd could not be found. Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 796a6ed8-e44a-4e34-849d-1daeb1f363dd could not be found. Sep 17 20:57:14.156013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:57:14.161764 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:14.161764 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:57:14.161764 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:14.161764 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:14.161764 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:14.161764 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:57:14.161764 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:57:14.161764 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 796a6ed8-e44a-4e34-849d-1daeb1f363dd could not be found. Sep 17 20:57:14.161764 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:57:14.163058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-87260135-ec16-4ab9-8d62-40c244953dae tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:14.163986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f1f98a57-588d-467c-a667-c0e707b0977a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Returning 404 to user: Instance 796a6ed8-e44a-4e34-849d-1daeb1f363dd could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:57:14.165027 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f1f98a57-588d-467c-a667-c0e707b0977a tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd" status: 404 len: 111 microversion: 2.25 time: 0.050631 Sep 17 20:57:14.170333 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 814/1684] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:57:14 2022] GET /compute/v2.1/servers/796a6ed8-e44a-4e34-849d-1daeb1f363dd => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 17 20:57:14.177102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ccbefb59-db64-4416-a617-e8e93211a117 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:14.178856 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-87260135-ec16-4ab9-8d62-40c244953dae tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be" status: 200 len: 1512 microversion: 2.1 time: 0.747237 Sep 17 20:57:14.179472 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 871/1685] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:13 2022] GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be => generated 1512 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:14.182126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ccbefb59-db64-4416-a617-e8e93211a117 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:14.192484 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ccbefb59-db64-4416-a617-e8e93211a117 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:14.193633 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ccbefb59-db64-4416-a617-e8e93211a117 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:14.194115 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-606c7938-edec-4dac-a3b3-221f902759c4 req-4e1eb769-764d-42a7-8d68-8f8a3d2683e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "796a6ed8-e44a-4e34-849d-1daeb1f363dd", "name": "network-vif-deleted", "tag": "3825b5cf-93a8-4a37-b807-cab157be9707"}, {"server_uuid": "4f0fd2e6-7a40-44f0-9ab7-71ff4489741a", "name": "network-vif-deleted", "tag": "41a63a9c-a45e-49f6-98c5-c6e0496500b0"}, {"server_uuid": "4f0fd2e6-7a40-44f0-9ab7-71ff4489741a", "name": "network-vif-deleted", "tag": "b3992f00-9706-4260-982f-77dfde504678"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:14.194468 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ccbefb59-db64-4416-a617-e8e93211a117 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:14.195355 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ccbefb59-db64-4416-a617-e8e93211a117 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:14.196063 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ccbefb59-db64-4416-a617-e8e93211a117 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:14.196647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ccbefb59-db64-4416-a617-e8e93211a117 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:14.224346 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-606c7938-edec-4dac-a3b3-221f902759c4 req-4e1eb769-764d-42a7-8d68-8f8a3d2683e2 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:14.224834 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-606c7938-edec-4dac-a3b3-221f902759c4 req-4e1eb769-764d-42a7-8d68-8f8a3d2683e2 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:14.225271 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-606c7938-edec-4dac-a3b3-221f902759c4 req-4e1eb769-764d-42a7-8d68-8f8a3d2683e2 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:14.240349 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ccbefb59-db64-4416-a617-e8e93211a117 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:14.241140 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ccbefb59-db64-4416-a617-e8e93211a117 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:14.245148 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ccbefb59-db64-4416-a617-e8e93211a117 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:14.246631 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-ccbefb59-db64-4416-a617-e8e93211a117 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lazy-loading 'fault' on Instance uuid 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:57:14.271748 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-606c7938-edec-4dac-a3b3-221f902759c4 req-4e1eb769-764d-42a7-8d68-8f8a3d2683e2 service nova] Creating event network-vif-deleted:3825b5cf-93a8-4a37-b807-cab157be9707 for instance 796a6ed8-e44a-4e34-849d-1daeb1f363dd on nch1-master-1 Sep 17 20:57:14.272539 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-606c7938-edec-4dac-a3b3-221f902759c4 req-4e1eb769-764d-42a7-8d68-8f8a3d2683e2 service nova] Creating event network-vif-deleted:41a63a9c-a45e-49f6-98c5-c6e0496500b0 for instance 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a on nch1-master-1 Sep 17 20:57:14.273905 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-606c7938-edec-4dac-a3b3-221f902759c4 req-4e1eb769-764d-42a7-8d68-8f8a3d2683e2 service nova] Creating event network-vif-deleted:b3992f00-9706-4260-982f-77dfde504678 for instance 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a on nch1-master-1 Sep 17 20:57:14.295766 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-606c7938-edec-4dac-a3b3-221f902759c4 req-4e1eb769-764d-42a7-8d68-8f8a3d2683e2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.113035 Sep 17 20:57:14.299210 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 872/1686] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:14.314299 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8f5210a2-2a92-4443-9b30-909a378a4b65 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:14.326218 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f5210a2-2a92-4443-9b30-909a378a4b65 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:14.327113 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f5210a2-2a92-4443-9b30-909a378a4b65 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:14.328086 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f5210a2-2a92-4443-9b30-909a378a4b65 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:14.329700 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ccbefb59-db64-4416-a617-e8e93211a117 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:14.330481 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f5210a2-2a92-4443-9b30-909a378a4b65 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:14.331054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f5210a2-2a92-4443-9b30-909a378a4b65 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:14.333015 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f5210a2-2a92-4443-9b30-909a378a4b65 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:14.346031 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ccbefb59-db64-4416-a617-e8e93211a117 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 200 len: 1303 microversion: 2.1 time: 0.174196 Sep 17 20:57:14.360629 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 815/1687] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:14 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 1303 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:14.365851 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8f5210a2-2a92-4443-9b30-909a378a4b65 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.063066 Sep 17 20:57:14.367245 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 873/1688] 10.222.0.26 () {58 vars in 1176 bytes} [Sat Sep 17 20:57:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:14.375381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d11fc606-8bac-4e05-ad61-8964247d8c5f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:14.376645 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1e0e1036-0d88-4e75-8c15-da4e24824fb0 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '.version_select at 0x7f25a5801280>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:14.377297 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d11fc606-8bac-4e05-ad61-8964247d8c5f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:14.385553 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d11fc606-8bac-4e05-ad61-8964247d8c5f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:14.386562 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d11fc606-8bac-4e05-ad61-8964247d8c5f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:14.387457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d11fc606-8bac-4e05-ad61-8964247d8c5f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:14.388564 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d11fc606-8bac-4e05-ad61-8964247d8c5f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:14.389400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d11fc606-8bac-4e05-ad61-8964247d8c5f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:14.390242 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d11fc606-8bac-4e05-ad61-8964247d8c5f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:14.404292 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1e0e1036-0d88-4e75-8c15-da4e24824fb0 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1928430300" status: 204 len: 0 microversion: 2.25 time: 0.042284 Sep 17 20:57:14.408946 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 816/1689] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Sep 17 20:57:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1928430300 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 20:57:14.418068 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2e7dd0df-9590-4df0-a952-7a27496e91b7 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:14.423354 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2e7dd0df-9590-4df0-a952-7a27496e91b7 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:14.440223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e7dd0df-9590-4df0-a952-7a27496e91b7 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:14.441370 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e7dd0df-9590-4df0-a952-7a27496e91b7 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:14.442209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e7dd0df-9590-4df0-a952-7a27496e91b7 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:14.443480 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e7dd0df-9590-4df0-a952-7a27496e91b7 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:14.444262 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e7dd0df-9590-4df0-a952-7a27496e91b7 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:14.444983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e7dd0df-9590-4df0-a952-7a27496e91b7 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:14.543868 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-2e7dd0df-9590-4df0-a952-7a27496e91b7 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lazy-loading 'flavor' on Instance uuid 4ca7424d-e666-4a33-9cc7-c56de359e512 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:57:14.561431 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2e7dd0df-9590-4df0-a952-7a27496e91b7 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Going to try to live migrate instance to nch2-master-1 {{(pid=140523) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 17 20:57:14.817027 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d11fc606-8bac-4e05-ad61-8964247d8c5f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:14.834735 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d11fc606-8bac-4e05-ad61-8964247d8c5f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 200 len: 1497 microversion: 2.1 time: 0.460566 Sep 17 20:57:14.847090 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 874/1690] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:14 2022] GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 1497 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:14.852999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ddb9865c-b461-493b-91b1-ce9c9ce98563 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:14.853832 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ddb9865c-b461-493b-91b1-ce9c9ce98563 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: 15f3f131-e02d-46b1-ba15-509016665f36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:14.865519 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ddb9865c-b461-493b-91b1-ce9c9ce98563 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:14.867339 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ddb9865c-b461-493b-91b1-ce9c9ce98563 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:14.868239 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ddb9865c-b461-493b-91b1-ce9c9ce98563 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:14.869149 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ddb9865c-b461-493b-91b1-ce9c9ce98563 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:14.869792 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ddb9865c-b461-493b-91b1-ce9c9ce98563 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:14.870379 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ddb9865c-b461-493b-91b1-ce9c9ce98563 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:14.888078 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-ddb9865c-b461-493b-91b1-ce9c9ce98563 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] HTTP exception thrown: Instance 15f3f131-e02d-46b1-ba15-509016665f36 could not be found. Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ddb9865c-b461-493b-91b1-ce9c9ce98563 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Request method failure captured: Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36 HTTP/1.1 Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjRnByg7el3_ci4-mwics7eogLZU3YfvAOJkEJRgmVrtPOrbfj861LvSP5RJgKlgmn_6hklq9jZKijTAzX88d-QlLRRKpRiXUQC2_ZyLvmhgrQODiuyCQP8Ka0RTueLJFoJP8VaQCvCxvtrSZlintHTWgecKmKY11qplkE5Nobje0W4 Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 84caeb4c4b2e4dbda9bf7def13420af1 Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1051562480 Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/84caeb4c4b2e4dbda9bf7def13420af1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/84caeb4c4b2e4dbda9bf7def13420af1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/84caeb4c4b2e4dbda9bf7def13420af1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_84caeb4c4b2e4dbda9bf7def13420af1", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1051562480 Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 84caeb4c4b2e4dbda9bf7def13420af1 Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1051562480 Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersAdminNegativeTestJSON-1051562480-project Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 4d9c7f4729e04bf6b915246ca7b5a3cf Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1051562480-project Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 15f3f131-e02d-46b1-ba15-509016665f36 could not be found. Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '15f3f131-e02d-46b1-ba15-509016665f36'} Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15f3f131-e02d-46b1-ba15-509016665f36 could not be found. Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15f3f131-e02d-46b1-ba15-509016665f36 could not be found. Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:14.890246 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:14.896286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:14.896286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:14.896286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:14.896286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:14.896286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:57:14.896286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:57:14.896286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15f3f131-e02d-46b1-ba15-509016665f36 could not be found. Sep 17 20:57:14.896286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:14.898310 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ddb9865c-b461-493b-91b1-ce9c9ce98563 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Returning 404 to user: Instance 15f3f131-e02d-46b1-ba15-509016665f36 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:57:14.899426 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ddb9865c-b461-493b-91b1-ce9c9ce98563 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36" status: 404 len: 111 microversion: 2.1 time: 0.051129 Sep 17 20:57:14.903751 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 875/1691] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:14 2022] GET /compute/v2.1/servers/15f3f131-e02d-46b1-ba15-509016665f36 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:57:14.910601 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-28c77888-b6ec-47e6-b202-eb9cb69e2f9f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:14.911707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-28c77888-b6ec-47e6-b202-eb9cb69e2f9f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: fe75e57c-282a-4bac-b0a2-1c52dd110c84] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:14.920522 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28c77888-b6ec-47e6-b202-eb9cb69e2f9f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:14.921530 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28c77888-b6ec-47e6-b202-eb9cb69e2f9f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:14.922254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28c77888-b6ec-47e6-b202-eb9cb69e2f9f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:14.923229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28c77888-b6ec-47e6-b202-eb9cb69e2f9f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:14.924464 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28c77888-b6ec-47e6-b202-eb9cb69e2f9f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:14.924901 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28c77888-b6ec-47e6-b202-eb9cb69e2f9f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:14.962849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:14.984309 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-28c77888-b6ec-47e6-b202-eb9cb69e2f9f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: fe75e57c-282a-4bac-b0a2-1c52dd110c84] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:57:15.187470 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-28c77888-b6ec-47e6-b202-eb9cb69e2f9f tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84" status: 204 len: 0 microversion: 2.1 time: 0.282037 Sep 17 20:57:15.195228 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 876/1692] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:57:14 2022] DELETE /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:57:15.202298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-d164cda1-1fb2-46dd-b44d-50c93d9450e7 req-8dbff3a1-5ccc-44b2-99e5-d90a2bdd21c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15402a7f-bb11-44a8-b440-0511829670be", "name": "network-vif-deleted", "tag": "c2a55f8c-cf56-49c7-a27d-c270da5cb58a"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:15.219941 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d164cda1-1fb2-46dd-b44d-50c93d9450e7 req-8dbff3a1-5ccc-44b2-99e5-d90a2bdd21c6 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:15.220874 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d164cda1-1fb2-46dd-b44d-50c93d9450e7 req-8dbff3a1-5ccc-44b2-99e5-d90a2bdd21c6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:15.223557 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d164cda1-1fb2-46dd-b44d-50c93d9450e7 req-8dbff3a1-5ccc-44b2-99e5-d90a2bdd21c6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:15.258224 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-d164cda1-1fb2-46dd-b44d-50c93d9450e7 req-8dbff3a1-5ccc-44b2-99e5-d90a2bdd21c6 service nova] Creating event network-vif-deleted:c2a55f8c-cf56-49c7-a27d-c270da5cb58a for instance 15402a7f-bb11-44a8-b440-0511829670be on nch1-master-1 Sep 17 20:57:15.271355 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-d164cda1-1fb2-46dd-b44d-50c93d9450e7 req-8dbff3a1-5ccc-44b2-99e5-d90a2bdd21c6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072778 Sep 17 20:57:15.272039 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 877/1693] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:15.281679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0fd329cc-838b-4c7b-bd3e-219817529aa4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:15.284971 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0fd329cc-838b-4c7b-bd3e-219817529aa4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: fe75e57c-282a-4bac-b0a2-1c52dd110c84] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:15.293114 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0fd329cc-838b-4c7b-bd3e-219817529aa4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:15.295017 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0fd329cc-838b-4c7b-bd3e-219817529aa4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:15.295756 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0fd329cc-838b-4c7b-bd3e-219817529aa4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:15.296831 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0fd329cc-838b-4c7b-bd3e-219817529aa4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:15.298245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0fd329cc-838b-4c7b-bd3e-219817529aa4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:15.299348 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0fd329cc-838b-4c7b-bd3e-219817529aa4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:15.503817 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0fd329cc-838b-4c7b-bd3e-219817529aa4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:15.514879 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0fd329cc-838b-4c7b-bd3e-219817529aa4 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84" status: 200 len: 1477 microversion: 2.1 time: 0.238956 Sep 17 20:57:15.515844 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 878/1694] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:15 2022] GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84 => generated 1477 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:15.525357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1776201e-631f-46ba-9d01-df64b0c6d760 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:15.526167 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1776201e-631f-46ba-9d01-df64b0c6d760 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: 15402a7f-bb11-44a8-b440-0511829670be] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:15.530139 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:15.534709 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1776201e-631f-46ba-9d01-df64b0c6d760 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:15.535447 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1776201e-631f-46ba-9d01-df64b0c6d760 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:15.535931 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1776201e-631f-46ba-9d01-df64b0c6d760 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:15.537424 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1776201e-631f-46ba-9d01-df64b0c6d760 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:15.538044 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1776201e-631f-46ba-9d01-df64b0c6d760 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:15.539070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1776201e-631f-46ba-9d01-df64b0c6d760 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:15.616436 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1776201e-631f-46ba-9d01-df64b0c6d760 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd461326fa46149f5a49b278b32d9c9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c89ce6659b4b4b9d6a53c9a8d33b41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:15.628840 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1776201e-631f-46ba-9d01-df64b0c6d760 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be" status: 200 len: 1470 microversion: 2.1 time: 0.107607 Sep 17 20:57:15.630331 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 879/1695] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:15 2022] GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be => generated 1470 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:15.635777 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3bb6388a-4e11-45a9-9380-3ff30b560612 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:15.636651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3bb6388a-4e11-45a9-9380-3ff30b560612 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:15.644304 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3bb6388a-4e11-45a9-9380-3ff30b560612 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:15.645133 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3bb6388a-4e11-45a9-9380-3ff30b560612 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:15.645940 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3bb6388a-4e11-45a9-9380-3ff30b560612 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:15.646861 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3bb6388a-4e11-45a9-9380-3ff30b560612 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:15.647622 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3bb6388a-4e11-45a9-9380-3ff30b560612 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:15.648433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3bb6388a-4e11-45a9-9380-3ff30b560612 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:15.665894 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-3bb6388a-4e11-45a9-9380-3ff30b560612 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] HTTP exception thrown: Instance 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a could not be found. Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3bb6388a-4e11-45a9-9380-3ff30b560612 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Request method failure captured: Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a HTTP/1.1 Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjRq4nfGWPeRQ7QZvnGLf5y-vzIBDMTl68UT5y8pZXfg4guV28avkyxaTLFSWsXWUs9-t-k41Law6z_ozMoljlGGUJQqENEMg2zQEdFmEGMHqXuWu7zBUO8oPrqAAVMFisrczgFwZ_ORoimebWXsC5gH843V3K6Uvc01y9mMnD4zHgw Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 400242d681ab472d9c90de4fc7da202b Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersTestMultiNic-341763139 Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/400242d681ab472d9c90de4fc7da202b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/400242d681ab472d9c90de4fc7da202b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/400242d681ab472d9c90de4fc7da202b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_400242d681ab472d9c90de4fc7da202b", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersTestMultiNic-341763139 Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 400242d681ab472d9c90de4fc7da202b Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersTestMultiNic-341763139 Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersTestMultiNic-341763139-project Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: bc22daf24ce44eb28bb6e000316e4df4 Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersTestMultiNic-341763139-project Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a could not be found. Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '4f0fd2e6-7a40-44f0-9ab7-71ff4489741a'} Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a could not be found. Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a could not be found. Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:15.670765 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:15.675526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:15.675526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:15.675526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:15.675526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:57:15.675526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:57:15.675526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a could not be found. Sep 17 20:57:15.675526 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:15.675526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3bb6388a-4e11-45a9-9380-3ff30b560612 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Returning 404 to user: Instance 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:57:15.678442 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3bb6388a-4e11-45a9-9380-3ff30b560612 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 404 len: 111 microversion: 2.1 time: 0.046684 Sep 17 20:57:15.679357 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 880/1696] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:15 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:57:15.916169 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-001d6d4d-acb9-42c1-b023-ba418e2847e7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-367558422", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "25526ef3-eaa2-4f18-ac44-bfbbfae855ea"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:15.977378 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-001d6d4d-acb9-42c1-b023-ba418e2847e7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] validate_networks() for [('25526ef3-eaa2-4f18-ac44-bfbbfae855ea', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:57:17.000984 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-001d6d4d-acb9-42c1-b023-ba418e2847e7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:57:17.015506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-001d6d4d-acb9-42c1-b023-ba418e2847e7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:57:17.017444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-001d6d4d-acb9-42c1-b023-ba418e2847e7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:57:17.018116 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-001d6d4d-acb9-42c1-b023-ba418e2847e7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:57:17.021984 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-001d6d4d-acb9-42c1-b023-ba418e2847e7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:57:17.046858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-001d6d4d-acb9-42c1-b023-ba418e2847e7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:17.048583 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-001d6d4d-acb9-42c1-b023-ba418e2847e7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:17.049371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-001d6d4d-acb9-42c1-b023-ba418e2847e7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:17.052251 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-001d6d4d-acb9-42c1-b023-ba418e2847e7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:17.052994 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-001d6d4d-acb9-42c1-b023-ba418e2847e7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:17.053876 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-001d6d4d-acb9-42c1-b023-ba418e2847e7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:17.093498 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-001d6d4d-acb9-42c1-b023-ba418e2847e7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Getting quotas for project 89b46ae7347d4f2daf02f627e41a4847. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:57:17.104717 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-001d6d4d-acb9-42c1-b023-ba418e2847e7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Getting quotas for user 3009c5feb1ef43a08b07996d8f63bf11 and project 89b46ae7347d4f2daf02f627e41a4847. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:57:17.128917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-001d6d4d-acb9-42c1-b023-ba418e2847e7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:57:17.133759 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-001d6d4d-acb9-42c1-b023-ba418e2847e7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 39ba6ff9-97dd-4923-90d0-58479fb25bb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:57:17.212153 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-001d6d4d-acb9-42c1-b023-ba418e2847e7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.531912 Sep 17 20:57:17.213200 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 881/1697] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:57:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:57:17.220116 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cc5a5cf9-8c55-4020-acbc-7f837224f75f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:17.220986 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cc5a5cf9-8c55-4020-acbc-7f837224f75f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:17.229601 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc5a5cf9-8c55-4020-acbc-7f837224f75f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:17.232481 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc5a5cf9-8c55-4020-acbc-7f837224f75f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:17.233414 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc5a5cf9-8c55-4020-acbc-7f837224f75f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:17.234647 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc5a5cf9-8c55-4020-acbc-7f837224f75f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:17.235471 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc5a5cf9-8c55-4020-acbc-7f837224f75f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:17.236550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc5a5cf9-8c55-4020-acbc-7f837224f75f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:17.290089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cc5a5cf9-8c55-4020-acbc-7f837224f75f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:57:17.428067 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cc5a5cf9-8c55-4020-acbc-7f837224f75f tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "DELETE /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2" status: 204 len: 0 microversion: 2.25 time: 0.213050 Sep 17 20:57:17.429349 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 882/1698] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 17 20:57:17 2022] DELETE /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 20:57:17.438701 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f13bf1e5-c3c5-410f-997a-07175765e5a8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:17.440171 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f13bf1e5-c3c5-410f-997a-07175765e5a8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:17.456881 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f13bf1e5-c3c5-410f-997a-07175765e5a8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:17.459715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f13bf1e5-c3c5-410f-997a-07175765e5a8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:17.460418 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f13bf1e5-c3c5-410f-997a-07175765e5a8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:17.461306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f13bf1e5-c3c5-410f-997a-07175765e5a8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:17.461843 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f13bf1e5-c3c5-410f-997a-07175765e5a8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:17.464492 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f13bf1e5-c3c5-410f-997a-07175765e5a8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:18.068217 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f13bf1e5-c3c5-410f-997a-07175765e5a8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:18.088195 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f13bf1e5-c3c5-410f-997a-07175765e5a8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 200 len: 1497 microversion: 2.1 time: 0.657234 Sep 17 20:57:18.119258 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 883/1699] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:17 2022] GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 1497 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:18.144101 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0d1d51f5-1e48-49c1-a30b-043ccca13489 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:18.144763 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0d1d51f5-1e48-49c1-a30b-043ccca13489 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: fe75e57c-282a-4bac-b0a2-1c52dd110c84] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:18.161125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0d1d51f5-1e48-49c1-a30b-043ccca13489 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:18.170083 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0d1d51f5-1e48-49c1-a30b-043ccca13489 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:18.171044 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0d1d51f5-1e48-49c1-a30b-043ccca13489 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:18.172165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0d1d51f5-1e48-49c1-a30b-043ccca13489 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:18.178969 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0d1d51f5-1e48-49c1-a30b-043ccca13489 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:18.179887 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0d1d51f5-1e48-49c1-a30b-043ccca13489 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:18.416208 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0d1d51f5-1e48-49c1-a30b-043ccca13489 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:18.429431 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0d1d51f5-1e48-49c1-a30b-043ccca13489 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84" status: 200 len: 1435 microversion: 2.1 time: 0.306946 Sep 17 20:57:18.433130 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 884/1700] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:18 2022] GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84 => generated 1435 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:18.448734 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1e9474bc-ce06-4cb8-933c-171b3402ea3a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:18.453092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1e9474bc-ce06-4cb8-933c-171b3402ea3a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: 15402a7f-bb11-44a8-b440-0511829670be] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:18.477714 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e9474bc-ce06-4cb8-933c-171b3402ea3a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:18.478424 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e9474bc-ce06-4cb8-933c-171b3402ea3a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:18.479066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e9474bc-ce06-4cb8-933c-171b3402ea3a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:18.479988 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e9474bc-ce06-4cb8-933c-171b3402ea3a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:18.480653 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e9474bc-ce06-4cb8-933c-171b3402ea3a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:18.481094 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e9474bc-ce06-4cb8-933c-171b3402ea3a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:18.528750 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-1e9474bc-ce06-4cb8-933c-171b3402ea3a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] HTTP exception thrown: Instance 15402a7f-bb11-44a8-b440-0511829670be could not be found. Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1e9474bc-ce06-4cb8-933c-171b3402ea3a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Request method failure captured: Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be HTTP/1.1 Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjP8dRU1rLQx_uP7o3UKkD1AF5TEr2AB4JsE1Wz2cZm36G8IL4nElTSQ7lRGQ2fr1knsiL_QPPvjNO49HwObm4-v-mxRFF7svWPy6WSCsK1BiCkNaJ6g4iSOUK3znbTfmvHlAJVxkd03eMoRIL5w9nWsqotXP_fwzhc6EH7C-ueGsb4 Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 52c89ce6659b4b4b9d6a53c9a8d33b41 Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerDiskConfigTestJSON-423577089 Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/52c89ce6659b4b4b9d6a53c9a8d33b41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/52c89ce6659b4b4b9d6a53c9a8d33b41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/52c89ce6659b4b4b9d6a53c9a8d33b41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_52c89ce6659b4b4b9d6a53c9a8d33b41", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerDiskConfigTestJSON-423577089 Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 52c89ce6659b4b4b9d6a53c9a8d33b41 Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-423577089 Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerDiskConfigTestJSON-423577089-project Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: d461326fa46149f5a49b278b32d9c9fb Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerDiskConfigTestJSON-423577089-project Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 15402a7f-bb11-44a8-b440-0511829670be could not be found. Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '15402a7f-bb11-44a8-b440-0511829670be'} Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15402a7f-bb11-44a8-b440-0511829670be could not be found. Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15402a7f-bb11-44a8-b440-0511829670be could not be found. Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:18.530564 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:18.536917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:18.536917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:18.536917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:18.536917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:57:18.536917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:57:18.536917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15402a7f-bb11-44a8-b440-0511829670be could not be found. Sep 17 20:57:18.536917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:18.536917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1e9474bc-ce06-4cb8-933c-171b3402ea3a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Returning 404 to user: Instance 15402a7f-bb11-44a8-b440-0511829670be could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:57:18.536917 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1e9474bc-ce06-4cb8-933c-171b3402ea3a tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be" status: 404 len: 111 microversion: 2.1 time: 0.095992 Sep 17 20:57:18.538173 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 885/1701] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:18 2022] GET /compute/v2.1/servers/15402a7f-bb11-44a8-b440-0511829670be => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:57:18.557566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c9da27e2-37d1-42d9-8d66-111ed74595df tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:18.561688 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c9da27e2-37d1-42d9-8d66-111ed74595df tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 39ba6ff9-97dd-4923-90d0-58479fb25bb6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:18.585601 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9da27e2-37d1-42d9-8d66-111ed74595df tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:18.586140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9da27e2-37d1-42d9-8d66-111ed74595df tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:18.586601 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9da27e2-37d1-42d9-8d66-111ed74595df tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:18.587331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9da27e2-37d1-42d9-8d66-111ed74595df tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:18.588275 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9da27e2-37d1-42d9-8d66-111ed74595df tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:18.588861 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9da27e2-37d1-42d9-8d66-111ed74595df tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:18.886346 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c9da27e2-37d1-42d9-8d66-111ed74595df tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:18.920090 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c9da27e2-37d1-42d9-8d66-111ed74595df tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6" status: 200 len: 1210 microversion: 2.1 time: 0.377294 Sep 17 20:57:18.925650 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2e7dd0df-9590-4df0-a952-7a27496e91b7 tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512/action" status: 202 len: 0 microversion: 2.1 time: 4.514560 Sep 17 20:57:18.928217 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 817/1702] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:57:14 2022] POST /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512/action => generated 0 bytes in 4518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:57:18.934373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-45d5fe4e-dff1-4d4c-a142-dad32e21a279 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:18.935342 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-45d5fe4e-dff1-4d4c-a142-dad32e21a279 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:18.940217 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 886/1703] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:18 2022] GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6 => generated 1210 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:18.957503 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-94dc5e13-310d-4dea-b65a-77d9a0093ead tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:18.958654 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-94dc5e13-310d-4dea-b65a-77d9a0093ead tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:18.968313 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94dc5e13-310d-4dea-b65a-77d9a0093ead tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:18.969138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94dc5e13-310d-4dea-b65a-77d9a0093ead tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:18.969868 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94dc5e13-310d-4dea-b65a-77d9a0093ead tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:18.976094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45d5fe4e-dff1-4d4c-a142-dad32e21a279 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:18.981127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94dc5e13-310d-4dea-b65a-77d9a0093ead tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:18.981886 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45d5fe4e-dff1-4d4c-a142-dad32e21a279 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:18.983982 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94dc5e13-310d-4dea-b65a-77d9a0093ead tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:18.984699 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94dc5e13-310d-4dea-b65a-77d9a0093ead tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:18.986998 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45d5fe4e-dff1-4d4c-a142-dad32e21a279 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:18.992201 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45d5fe4e-dff1-4d4c-a142-dad32e21a279 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:18.996765 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45d5fe4e-dff1-4d4c-a142-dad32e21a279 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:18.997696 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45d5fe4e-dff1-4d4c-a142-dad32e21a279 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:19.032218 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-94dc5e13-310d-4dea-b65a-77d9a0093ead tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] HTTP exception thrown: Instance b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 could not be found. Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-94dc5e13-310d-4dea-b65a-77d9a0093ead tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Request method failure captured: Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 HTTP/1.1 Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjP8dRU1rLQx_uP7o3UKkD1AF5TEr2AB4JsE1Wz2cZm36G8IL4nElTSQ7lRGQ2fr1knsiL_QPPvjNO49HwObm4-v-mxRFF7svWPy6WSCsK1BiCkNaJ6g4iSOUK3znbTfmvHlAJVxkd03eMoRIL5w9nWsqotXP_fwzhc6EH7C-ueGsb4 Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 52c89ce6659b4b4b9d6a53c9a8d33b41 Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerDiskConfigTestJSON-423577089 Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/52c89ce6659b4b4b9d6a53c9a8d33b41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/52c89ce6659b4b4b9d6a53c9a8d33b41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/52c89ce6659b4b4b9d6a53c9a8d33b41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_52c89ce6659b4b4b9d6a53c9a8d33b41", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerDiskConfigTestJSON-423577089 Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 52c89ce6659b4b4b9d6a53c9a8d33b41 Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-423577089 Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerDiskConfigTestJSON-423577089-project Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: d461326fa46149f5a49b278b32d9c9fb Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerDiskConfigTestJSON-423577089-project Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 could not be found. Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08'} Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 could not be found. Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:57:19.034199 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:57:19.038618 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 could not be found. Sep 17 20:57:19.038618 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:19.038618 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:19.038618 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:19.038618 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:19.038618 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:19.038618 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:19.038618 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:57:19.038618 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:57:19.038618 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 could not be found. Sep 17 20:57:19.038618 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:19.040834 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-94dc5e13-310d-4dea-b65a-77d9a0093ead tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Returning 404 to user: Instance b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:57:19.041931 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-94dc5e13-310d-4dea-b65a-77d9a0093ead tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 404 len: 111 microversion: 2.1 time: 0.100667 Sep 17 20:57:19.042981 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 887/1704] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:57:18 2022] DELETE /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:57:19.048183 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fe5f4954-e59c-4cab-98cb-5c846973cb22 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:19.049046 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fe5f4954-e59c-4cab-98cb-5c846973cb22 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:19.056730 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe5f4954-e59c-4cab-98cb-5c846973cb22 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:19.057798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe5f4954-e59c-4cab-98cb-5c846973cb22 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:19.058473 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe5f4954-e59c-4cab-98cb-5c846973cb22 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:19.059430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe5f4954-e59c-4cab-98cb-5c846973cb22 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:19.060078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe5f4954-e59c-4cab-98cb-5c846973cb22 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:19.060703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe5f4954-e59c-4cab-98cb-5c846973cb22 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:19.344791 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fe5f4954-e59c-4cab-98cb-5c846973cb22 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:19.360059 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fe5f4954-e59c-4cab-98cb-5c846973cb22 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1392 microversion: 2.1 time: 0.315431 Sep 17 20:57:19.361538 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 888/1705] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:19 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1392 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:19.369013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-4d96fdfb-4b1b-4d0b-beec-deda2d645e61 req-d4859df8-ee23-4194-af64-75efc3f2f230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe75e57c-282a-4bac-b0a2-1c52dd110c84", "name": "network-vif-deleted", "tag": "006c319b-8066-40f4-b844-ba9882602395"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:19.400204 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4d96fdfb-4b1b-4d0b-beec-deda2d645e61 req-d4859df8-ee23-4194-af64-75efc3f2f230 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:19.400204 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4d96fdfb-4b1b-4d0b-beec-deda2d645e61 req-d4859df8-ee23-4194-af64-75efc3f2f230 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:19.411009 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4d96fdfb-4b1b-4d0b-beec-deda2d645e61 req-d4859df8-ee23-4194-af64-75efc3f2f230 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:19.430314 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-45d5fe4e-dff1-4d4c-a142-dad32e21a279 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:19.431039 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-4d96fdfb-4b1b-4d0b-beec-deda2d645e61 req-d4859df8-ee23-4194-af64-75efc3f2f230 service nova] Creating event network-vif-deleted:006c319b-8066-40f4-b844-ba9882602395 for instance fe75e57c-282a-4bac-b0a2-1c52dd110c84 on nch1-master-1 Sep 17 20:57:19.442907 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-4d96fdfb-4b1b-4d0b-beec-deda2d645e61 req-d4859df8-ee23-4194-af64-75efc3f2f230 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079640 Sep 17 20:57:19.444409 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-45d5fe4e-dff1-4d4c-a142-dad32e21a279 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:19.447097 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 889/1706] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:19.448510 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-45d5fe4e-dff1-4d4c-a142-dad32e21a279 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:19.450105 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-45d5fe4e-dff1-4d4c-a142-dad32e21a279 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2" status: 200 len: 1548 microversion: 2.25 time: 0.520196 Sep 17 20:57:19.452972 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 818/1707] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:57:18 2022] GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2 => generated 1548 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:57:19.457308 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-97f7da1f-4475-4751-8f97-8afc09b1caac tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:19.460225 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-31473494-af67-44de-81e1-27d3712df782 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:19.461350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-31473494-af67-44de-81e1-27d3712df782 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:19.462272 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-97f7da1f-4475-4751-8f97-8afc09b1caac tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:19.470141 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97f7da1f-4475-4751-8f97-8afc09b1caac tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:19.470589 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-31473494-af67-44de-81e1-27d3712df782 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:19.470741 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97f7da1f-4475-4751-8f97-8afc09b1caac tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:19.471158 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97f7da1f-4475-4751-8f97-8afc09b1caac tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:19.471491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-31473494-af67-44de-81e1-27d3712df782 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:19.472076 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97f7da1f-4475-4751-8f97-8afc09b1caac tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:19.472276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-31473494-af67-44de-81e1-27d3712df782 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:19.472609 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97f7da1f-4475-4751-8f97-8afc09b1caac tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:19.473043 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97f7da1f-4475-4751-8f97-8afc09b1caac tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:19.473536 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-31473494-af67-44de-81e1-27d3712df782 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:19.474156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-31473494-af67-44de-81e1-27d3712df782 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:19.474744 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-31473494-af67-44de-81e1-27d3712df782 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:19.495945 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-97f7da1f-4475-4751-8f97-8afc09b1caac tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] HTTP exception thrown: Instance b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 could not be found. Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-97f7da1f-4475-4751-8f97-8afc09b1caac tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Request method failure captured: Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 HTTP/1.1 Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjP8dRU1rLQx_uP7o3UKkD1AF5TEr2AB4JsE1Wz2cZm36G8IL4nElTSQ7lRGQ2fr1knsiL_QPPvjNO49HwObm4-v-mxRFF7svWPy6WSCsK1BiCkNaJ6g4iSOUK3znbTfmvHlAJVxkd03eMoRIL5w9nWsqotXP_fwzhc6EH7C-ueGsb4 Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 52c89ce6659b4b4b9d6a53c9a8d33b41 Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerDiskConfigTestJSON-423577089 Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/52c89ce6659b4b4b9d6a53c9a8d33b41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/52c89ce6659b4b4b9d6a53c9a8d33b41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/52c89ce6659b4b4b9d6a53c9a8d33b41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_52c89ce6659b4b4b9d6a53c9a8d33b41", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerDiskConfigTestJSON-423577089 Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 52c89ce6659b4b4b9d6a53c9a8d33b41 Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-423577089 Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerDiskConfigTestJSON-423577089-project Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: d461326fa46149f5a49b278b32d9c9fb Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerDiskConfigTestJSON-423577089-project Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 could not be found. Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08'} Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 could not be found. Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 could not be found. Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:19.497762 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:19.504628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:19.504628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:19.504628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:19.504628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:57:19.504628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:57:19.504628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 could not be found. Sep 17 20:57:19.504628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:19.504628 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-97f7da1f-4475-4751-8f97-8afc09b1caac tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Returning 404 to user: Instance b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:57:19.504628 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-97f7da1f-4475-4751-8f97-8afc09b1caac tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08" status: 404 len: 111 microversion: 2.1 time: 0.050774 Sep 17 20:57:19.504628 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 890/1708] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:19 2022] GET /compute/v2.1/servers/b99ef5eb-2aca-4275-ae57-dc7c0f6c8b08 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:57:19.506654 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ddb30ba0-3980-4297-86af-1b9c8c458d5e tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:19.507263 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ddb30ba0-3980-4297-86af-1b9c8c458d5e tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: fe75e57c-282a-4bac-b0a2-1c52dd110c84] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:19.513751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ddb30ba0-3980-4297-86af-1b9c8c458d5e tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:19.514247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ddb30ba0-3980-4297-86af-1b9c8c458d5e tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:19.514703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ddb30ba0-3980-4297-86af-1b9c8c458d5e tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:19.515540 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ddb30ba0-3980-4297-86af-1b9c8c458d5e tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:19.516078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ddb30ba0-3980-4297-86af-1b9c8c458d5e tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:19.516577 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ddb30ba0-3980-4297-86af-1b9c8c458d5e tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:19.592764 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ddb30ba0-3980-4297-86af-1b9c8c458d5e tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:19.593371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ddb30ba0-3980-4297-86af-1b9c8c458d5e tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:19.594054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ddb30ba0-3980-4297-86af-1b9c8c458d5e tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:19.594796 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-ddb30ba0-3980-4297-86af-1b9c8c458d5e tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lazy-loading 'fault' on Instance uuid fe75e57c-282a-4bac-b0a2-1c52dd110c84 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:57:19.727976 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ddb30ba0-3980-4297-86af-1b9c8c458d5e tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9c7f4729e04bf6b915246ca7b5a3cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84caeb4c4b2e4dbda9bf7def13420af1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:19.738701 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ddb30ba0-3980-4297-86af-1b9c8c458d5e tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84" status: 200 len: 1312 microversion: 2.1 time: 0.237546 Sep 17 20:57:19.739072 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 891/1709] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:19 2022] GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84 => generated 1312 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:19.770112 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e4a9fb50-0745-4b37-815d-ff032694b8f7 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:19.771036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e4a9fb50-0745-4b37-815d-ff032694b8f7 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:19.788332 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-31473494-af67-44de-81e1-27d3712df782 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:19.797141 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-31473494-af67-44de-81e1-27d3712df782 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 200 len: 1497 microversion: 2.1 time: 0.342760 Sep 17 20:57:19.798187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e4a9fb50-0745-4b37-815d-ff032694b8f7 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:19.799089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e4a9fb50-0745-4b37-815d-ff032694b8f7 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:19.799739 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e4a9fb50-0745-4b37-815d-ff032694b8f7 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:19.801582 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 819/1710] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:19 2022] GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 1497 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:19.801785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e4a9fb50-0745-4b37-815d-ff032694b8f7 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:19.802458 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e4a9fb50-0745-4b37-815d-ff032694b8f7 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:19.803073 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e4a9fb50-0745-4b37-815d-ff032694b8f7 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:19.835727 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-e4a9fb50-0745-4b37-815d-ff032694b8f7 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] HTTP exception thrown: Instance fdc5c241-5abc-4fde-b458-961a9cd5eb4c could not be found. Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e4a9fb50-0745-4b37-815d-ff032694b8f7 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Request method failure captured: Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c HTTP/1.1 Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjP8dRU1rLQx_uP7o3UKkD1AF5TEr2AB4JsE1Wz2cZm36G8IL4nElTSQ7lRGQ2fr1knsiL_QPPvjNO49HwObm4-v-mxRFF7svWPy6WSCsK1BiCkNaJ6g4iSOUK3znbTfmvHlAJVxkd03eMoRIL5w9nWsqotXP_fwzhc6EH7C-ueGsb4 Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 52c89ce6659b4b4b9d6a53c9a8d33b41 Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerDiskConfigTestJSON-423577089 Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/52c89ce6659b4b4b9d6a53c9a8d33b41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/52c89ce6659b4b4b9d6a53c9a8d33b41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/52c89ce6659b4b4b9d6a53c9a8d33b41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_52c89ce6659b4b4b9d6a53c9a8d33b41", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerDiskConfigTestJSON-423577089 Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 52c89ce6659b4b4b9d6a53c9a8d33b41 Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-423577089 Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerDiskConfigTestJSON-423577089-project Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: d461326fa46149f5a49b278b32d9c9fb Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerDiskConfigTestJSON-423577089-project Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance fdc5c241-5abc-4fde-b458-961a9cd5eb4c could not be found. Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'fdc5c241-5abc-4fde-b458-961a9cd5eb4c'} Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdc5c241-5abc-4fde-b458-961a9cd5eb4c could not be found. Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:57:19.838167 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:57:19.843647 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdc5c241-5abc-4fde-b458-961a9cd5eb4c could not be found. Sep 17 20:57:19.843647 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:19.843647 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:19.843647 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:19.843647 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:19.843647 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:19.843647 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:19.843647 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:57:19.843647 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:57:19.843647 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdc5c241-5abc-4fde-b458-961a9cd5eb4c could not be found. Sep 17 20:57:19.843647 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:19.843647 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e4a9fb50-0745-4b37-815d-ff032694b8f7 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Returning 404 to user: Instance fdc5c241-5abc-4fde-b458-961a9cd5eb4c could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:57:19.843647 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e4a9fb50-0745-4b37-815d-ff032694b8f7 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 404 len: 111 microversion: 2.1 time: 0.083656 Sep 17 20:57:19.843647 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 892/1711] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:57:19 2022] DELETE /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:57:19.851323 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5d9d776e-9203-4c40-aa9f-51e3523b1a15 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:19.852055 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5d9d776e-9203-4c40-aa9f-51e3523b1a15 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] [instance: fdc5c241-5abc-4fde-b458-961a9cd5eb4c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:19.859730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d9d776e-9203-4c40-aa9f-51e3523b1a15 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:19.860722 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d9d776e-9203-4c40-aa9f-51e3523b1a15 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:19.862109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d9d776e-9203-4c40-aa9f-51e3523b1a15 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:19.863141 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d9d776e-9203-4c40-aa9f-51e3523b1a15 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:19.863834 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d9d776e-9203-4c40-aa9f-51e3523b1a15 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:19.864581 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d9d776e-9203-4c40-aa9f-51e3523b1a15 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:19.903134 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-5d9d776e-9203-4c40-aa9f-51e3523b1a15 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] HTTP exception thrown: Instance fdc5c241-5abc-4fde-b458-961a9cd5eb4c could not be found. Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5d9d776e-9203-4c40-aa9f-51e3523b1a15 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Request method failure captured: Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c HTTP/1.1 Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjP8dRU1rLQx_uP7o3UKkD1AF5TEr2AB4JsE1Wz2cZm36G8IL4nElTSQ7lRGQ2fr1knsiL_QPPvjNO49HwObm4-v-mxRFF7svWPy6WSCsK1BiCkNaJ6g4iSOUK3znbTfmvHlAJVxkd03eMoRIL5w9nWsqotXP_fwzhc6EH7C-ueGsb4 Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 52c89ce6659b4b4b9d6a53c9a8d33b41 Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerDiskConfigTestJSON-423577089 Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/52c89ce6659b4b4b9d6a53c9a8d33b41"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/52c89ce6659b4b4b9d6a53c9a8d33b41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/52c89ce6659b4b4b9d6a53c9a8d33b41"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_52c89ce6659b4b4b9d6a53c9a8d33b41", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerDiskConfigTestJSON-423577089 Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 52c89ce6659b4b4b9d6a53c9a8d33b41 Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-423577089 Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerDiskConfigTestJSON-423577089-project Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: d461326fa46149f5a49b278b32d9c9fb Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerDiskConfigTestJSON-423577089-project Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance fdc5c241-5abc-4fde-b458-961a9cd5eb4c could not be found. Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'fdc5c241-5abc-4fde-b458-961a9cd5eb4c'} Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdc5c241-5abc-4fde-b458-961a9cd5eb4c could not be found. Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdc5c241-5abc-4fde-b458-961a9cd5eb4c could not be found. Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:19.905038 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:57:19.912932 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:19.912932 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:19.912932 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:19.912932 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:57:19.912932 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:57:19.912932 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdc5c241-5abc-4fde-b458-961a9cd5eb4c could not be found. Sep 17 20:57:19.912932 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:57:19.912932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5d9d776e-9203-4c40-aa9f-51e3523b1a15 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] Returning 404 to user: Instance fdc5c241-5abc-4fde-b458-961a9cd5eb4c could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:57:19.912932 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5d9d776e-9203-4c40-aa9f-51e3523b1a15 tempest-ServerDiskConfigTestJSON-423577089 tempest-ServerDiskConfigTestJSON-423577089-project] 10.222.0.26 "GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c" status: 404 len: 111 microversion: 2.1 time: 0.059885 Sep 17 20:57:19.912932 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 820/1712] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:19 2022] GET /compute/v2.1/servers/fdc5c241-5abc-4fde-b458-961a9cd5eb4c => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 20:57:19.948164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-248fae0c-db35-4a02-aa85-ee61f6b31eed tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:19.949256 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-248fae0c-db35-4a02-aa85-ee61f6b31eed tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 39ba6ff9-97dd-4923-90d0-58479fb25bb6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:19.974273 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-248fae0c-db35-4a02-aa85-ee61f6b31eed tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:19.978728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-248fae0c-db35-4a02-aa85-ee61f6b31eed tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:19.979601 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-248fae0c-db35-4a02-aa85-ee61f6b31eed tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:19.982187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-248fae0c-db35-4a02-aa85-ee61f6b31eed tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:19.985381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-248fae0c-db35-4a02-aa85-ee61f6b31eed tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:19.988598 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-248fae0c-db35-4a02-aa85-ee61f6b31eed tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:20.002342 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-3bbefabb-a2db-4c17-81a1-ba8427bd3b98 req-9bf99327-933b-43f9-baf0-f180826ecd51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58d4b11c-eac7-4725-be0b-d10e4cf15bc2", "name": "network-vif-deleted", "tag": "fb8fa2f7-3a6c-4af8-bb7a-8e20186076a7"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:20.043806 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-3bbefabb-a2db-4c17-81a1-ba8427bd3b98 req-9bf99327-933b-43f9-baf0-f180826ecd51 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:20.044851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-3bbefabb-a2db-4c17-81a1-ba8427bd3b98 req-9bf99327-933b-43f9-baf0-f180826ecd51 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:20.048239 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-3bbefabb-a2db-4c17-81a1-ba8427bd3b98 req-9bf99327-933b-43f9-baf0-f180826ecd51 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:20.089440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:20.098395 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-3bbefabb-a2db-4c17-81a1-ba8427bd3b98 req-9bf99327-933b-43f9-baf0-f180826ecd51 service nova] Creating event network-vif-deleted:fb8fa2f7-3a6c-4af8-bb7a-8e20186076a7 for instance 58d4b11c-eac7-4725-be0b-d10e4cf15bc2 on nch2-master-1 Sep 17 20:57:20.120485 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-3bbefabb-a2db-4c17-81a1-ba8427bd3b98 req-9bf99327-933b-43f9-baf0-f180826ecd51 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123083 Sep 17 20:57:20.124385 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 821/1713] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:20.221858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-248fae0c-db35-4a02-aa85-ee61f6b31eed tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:20.234218 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-248fae0c-db35-4a02-aa85-ee61f6b31eed tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6" status: 200 len: 1266 microversion: 2.1 time: 0.290972 Sep 17 20:57:20.235291 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 893/1714] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:19 2022] GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6 => generated 1266 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:20.395226 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2e5173ce-1291-419e-bb14-3967f7b19942 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:20.396527 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2e5173ce-1291-419e-bb14-3967f7b19942 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:20.408308 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e5173ce-1291-419e-bb14-3967f7b19942 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:20.409429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e5173ce-1291-419e-bb14-3967f7b19942 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:20.410592 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e5173ce-1291-419e-bb14-3967f7b19942 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:20.411583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e5173ce-1291-419e-bb14-3967f7b19942 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:20.412306 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e5173ce-1291-419e-bb14-3967f7b19942 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:20.412993 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e5173ce-1291-419e-bb14-3967f7b19942 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:20.487316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ee05a11c-d077-4630-b069-ca2eb8e2222e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:20.488717 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ee05a11c-d077-4630-b069-ca2eb8e2222e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:20.499061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee05a11c-d077-4630-b069-ca2eb8e2222e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:20.502454 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee05a11c-d077-4630-b069-ca2eb8e2222e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:20.503226 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee05a11c-d077-4630-b069-ca2eb8e2222e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:20.504817 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee05a11c-d077-4630-b069-ca2eb8e2222e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:20.505750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee05a11c-d077-4630-b069-ca2eb8e2222e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:20.506886 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee05a11c-d077-4630-b069-ca2eb8e2222e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:20.581068 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee05a11c-d077-4630-b069-ca2eb8e2222e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:20.581801 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee05a11c-d077-4630-b069-ca2eb8e2222e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:20.582263 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee05a11c-d077-4630-b069-ca2eb8e2222e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:20.584430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-ee05a11c-d077-4630-b069-ca2eb8e2222e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lazy-loading 'fault' on Instance uuid 58d4b11c-eac7-4725-be0b-d10e4cf15bc2 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:57:20.594900 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:20.770908 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ee05a11c-d077-4630-b069-ca2eb8e2222e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:20.789591 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ee05a11c-d077-4630-b069-ca2eb8e2222e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:20.791752 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ee05a11c-d077-4630-b069-ca2eb8e2222e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:20.793201 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ee05a11c-d077-4630-b069-ca2eb8e2222e tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2" status: 200 len: 1351 microversion: 2.25 time: 0.311862 Sep 17 20:57:20.793969 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 894/1715] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:57:20 2022] GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2 => generated 1351 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:57:20.819896 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e36a97d4-a5de-4194-a5c1-6a0efe5beb71 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:20.821400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e36a97d4-a5de-4194-a5c1-6a0efe5beb71 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] [instance: fe75e57c-282a-4bac-b0a2-1c52dd110c84] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:20.829135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e36a97d4-a5de-4194-a5c1-6a0efe5beb71 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:20.829876 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e36a97d4-a5de-4194-a5c1-6a0efe5beb71 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:20.830567 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e36a97d4-a5de-4194-a5c1-6a0efe5beb71 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:20.831606 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e36a97d4-a5de-4194-a5c1-6a0efe5beb71 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:20.832455 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e36a97d4-a5de-4194-a5c1-6a0efe5beb71 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:20.833088 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e36a97d4-a5de-4194-a5c1-6a0efe5beb71 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:20.850522 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-e36a97d4-a5de-4194-a5c1-6a0efe5beb71 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] HTTP exception thrown: Instance fe75e57c-282a-4bac-b0a2-1c52dd110c84 could not be found. Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e36a97d4-a5de-4194-a5c1-6a0efe5beb71 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Request method failure captured: Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84 HTTP/1.1 Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjRnByg7el3_ci4-mwics7eogLZU3YfvAOJkEJRgmVrtPOrbfj861LvSP5RJgKlgmn_6hklq9jZKijTAzX88d-QlLRRKpRiXUQC2_ZyLvmhgrQODiuyCQP8Ka0RTueLJFoJP8VaQCvCxvtrSZlintHTWgecKmKY11qplkE5Nobje0W4 Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 84caeb4c4b2e4dbda9bf7def13420af1 Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1051562480 Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/84caeb4c4b2e4dbda9bf7def13420af1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/84caeb4c4b2e4dbda9bf7def13420af1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/84caeb4c4b2e4dbda9bf7def13420af1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_84caeb4c4b2e4dbda9bf7def13420af1", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1051562480 Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 84caeb4c4b2e4dbda9bf7def13420af1 Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1051562480 Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersAdminNegativeTestJSON-1051562480-project Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 4d9c7f4729e04bf6b915246ca7b5a3cf Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1051562480-project Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance fe75e57c-282a-4bac-b0a2-1c52dd110c84 could not be found. Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'fe75e57c-282a-4bac-b0a2-1c52dd110c84'} Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe75e57c-282a-4bac-b0a2-1c52dd110c84 could not be found. Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe75e57c-282a-4bac-b0a2-1c52dd110c84 could not be found. Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:20.852315 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:20.858194 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:20.858194 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:20.858194 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:20.858194 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:20.858194 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:57:20.858194 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:57:20.858194 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe75e57c-282a-4bac-b0a2-1c52dd110c84 could not be found. Sep 17 20:57:20.858194 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:20.860675 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e36a97d4-a5de-4194-a5c1-6a0efe5beb71 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] Returning 404 to user: Instance fe75e57c-282a-4bac-b0a2-1c52dd110c84 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:57:20.862324 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e36a97d4-a5de-4194-a5c1-6a0efe5beb71 tempest-ServersAdminNegativeTestJSON-1051562480 tempest-ServersAdminNegativeTestJSON-1051562480-project] 10.222.0.26 "GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84" status: 404 len: 111 microversion: 2.1 time: 0.052659 Sep 17 20:57:20.863243 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 895/1716] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:20 2022] GET /compute/v2.1/servers/fe75e57c-282a-4bac-b0a2-1c52dd110c84 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:57:20.869133 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-acefa3ee-32ba-4a5f-9d1c-ed15913facb5 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:20.870642 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-acefa3ee-32ba-4a5f-9d1c-ed15913facb5 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:20.887211 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-acefa3ee-32ba-4a5f-9d1c-ed15913facb5 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:20.888031 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-acefa3ee-32ba-4a5f-9d1c-ed15913facb5 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:20.888643 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-acefa3ee-32ba-4a5f-9d1c-ed15913facb5 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:20.890404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-acefa3ee-32ba-4a5f-9d1c-ed15913facb5 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:20.891052 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-acefa3ee-32ba-4a5f-9d1c-ed15913facb5 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:20.891747 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-acefa3ee-32ba-4a5f-9d1c-ed15913facb5 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:21.094585 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2e5173ce-1291-419e-bb14-3967f7b19942 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:21.121963 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2e5173ce-1291-419e-bb14-3967f7b19942 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1392 microversion: 2.1 time: 0.733698 Sep 17 20:57:21.135281 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 822/1717] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:20 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1392 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:21.215828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-acefa3ee-32ba-4a5f-9d1c-ed15913facb5 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:21.229875 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-acefa3ee-32ba-4a5f-9d1c-ed15913facb5 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 200 len: 1497 microversion: 2.1 time: 0.365219 Sep 17 20:57:21.232684 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 896/1718] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:20 2022] GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 1497 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:21.270868 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8fb62336-d171-448c-b212-4abbdf2a4727 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:21.272934 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8fb62336-d171-448c-b212-4abbdf2a4727 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 39ba6ff9-97dd-4923-90d0-58479fb25bb6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:21.285621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8fb62336-d171-448c-b212-4abbdf2a4727 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:21.286059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8fb62336-d171-448c-b212-4abbdf2a4727 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:21.286901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8fb62336-d171-448c-b212-4abbdf2a4727 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:21.287863 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8fb62336-d171-448c-b212-4abbdf2a4727 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:21.289043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8fb62336-d171-448c-b212-4abbdf2a4727 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:21.289742 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8fb62336-d171-448c-b212-4abbdf2a4727 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:21.428423 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8fb62336-d171-448c-b212-4abbdf2a4727 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:21.462106 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8fb62336-d171-448c-b212-4abbdf2a4727 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6" status: 200 len: 1272 microversion: 2.1 time: 0.197137 Sep 17 20:57:21.467869 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 823/1719] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:21 2022] GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6 => generated 1272 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:21.828206 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bf1d8afd-4dff-4b3e-b1a6-4adfc5691ed0 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:21.830942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bf1d8afd-4dff-4b3e-b1a6-4adfc5691ed0 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 58d4b11c-eac7-4725-be0b-d10e4cf15bc2] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:21.840246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf1d8afd-4dff-4b3e-b1a6-4adfc5691ed0 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:21.841341 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf1d8afd-4dff-4b3e-b1a6-4adfc5691ed0 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:21.842147 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf1d8afd-4dff-4b3e-b1a6-4adfc5691ed0 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:21.843077 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf1d8afd-4dff-4b3e-b1a6-4adfc5691ed0 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:21.843718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf1d8afd-4dff-4b3e-b1a6-4adfc5691ed0 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:21.844904 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf1d8afd-4dff-4b3e-b1a6-4adfc5691ed0 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:21.869619 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-bf1d8afd-4dff-4b3e-b1a6-4adfc5691ed0 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] HTTP exception thrown: Instance 58d4b11c-eac7-4725-be0b-d10e4cf15bc2 could not be found. Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bf1d8afd-4dff-4b3e-b1a6-4adfc5691ed0 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Request method failure captured: Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2 HTTP/1.1 Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjNRMAPX_oTsPhy9TfA5vu2vyNW5I1IgC_1G9MjGTLqycu01SdxDB1FQYnE4eP90RiN0J5FJdUywXLYCcYRiKroAyLyOhXaJdhri5JVTmmNDHZZ22UM3Q0dE9BqBpbNF6NGgyn9xK5g6Eb8IAu6FGQEDpUrY4GSRsSTNP6PFmk30ZJY Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: X-Openstack-Nova-Api-Version: 2.25 Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 7dc8bc81c2d74bae9612f7c9807350a7 Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1505099207 Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7dc8bc81c2d74bae9612f7c9807350a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7dc8bc81c2d74bae9612f7c9807350a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7dc8bc81c2d74bae9612f7c9807350a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7dc8bc81c2d74bae9612f7c9807350a7", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1505099207 Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 7dc8bc81c2d74bae9612f7c9807350a7 Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1505099207 Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-LiveAutoBlockMigrationV225Test-1505099207-project Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: f1134231b4a545fdb136a5204cb4f289 Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1505099207-project Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 58d4b11c-eac7-4725-be0b-d10e4cf15bc2 could not be found. Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '58d4b11c-eac7-4725-be0b-d10e4cf15bc2'} Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58d4b11c-eac7-4725-be0b-d10e4cf15bc2 could not be found. Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58d4b11c-eac7-4725-be0b-d10e4cf15bc2 could not be found. Sep 17 20:57:21.871376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:21.882842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:21.882842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:21.882842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:21.882842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:21.882842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:21.882842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:57:21.882842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:57:21.882842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58d4b11c-eac7-4725-be0b-d10e4cf15bc2 could not be found. Sep 17 20:57:21.882842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:21.882842 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bf1d8afd-4dff-4b3e-b1a6-4adfc5691ed0 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Returning 404 to user: Instance 58d4b11c-eac7-4725-be0b-d10e4cf15bc2 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:57:21.882842 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bf1d8afd-4dff-4b3e-b1a6-4adfc5691ed0 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2" status: 404 len: 111 microversion: 2.25 time: 0.053103 Sep 17 20:57:21.884128 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-52b36159-69fd-4816-b136-e011f4431a68 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:21.884628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-52b36159-69fd-4816-b136-e011f4431a68 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:21.886103 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 897/1720] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:57:21 2022] GET /compute/v2.1/servers/58d4b11c-eac7-4725-be0b-d10e4cf15bc2 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 17 20:57:21.891865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-52b36159-69fd-4816-b136-e011f4431a68 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:21.892354 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-52b36159-69fd-4816-b136-e011f4431a68 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:21.899305 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-52b36159-69fd-4816-b136-e011f4431a68 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:21.900394 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-52b36159-69fd-4816-b136-e011f4431a68 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:21.900861 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-52b36159-69fd-4816-b136-e011f4431a68 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:21.905116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-52b36159-69fd-4816-b136-e011f4431a68 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:21.949293 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-52b36159-69fd-4816-b136-e011f4431a68 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:57:22.126737 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-52b36159-69fd-4816-b136-e011f4431a68 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9" status: 204 len: 0 microversion: 2.25 time: 0.243213 Sep 17 20:57:22.132092 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 824/1721] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 17 20:57:21 2022] DELETE /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 20:57:22.142441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-228b4854-3f53-4bbe-a377-b43af80fc7bb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:22.145353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-228b4854-3f53-4bbe-a377-b43af80fc7bb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:22.175756 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-73a248d6-2a0f-4da7-849e-dd8441f5055f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:22.176962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-73a248d6-2a0f-4da7-849e-dd8441f5055f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:22.185396 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-228b4854-3f53-4bbe-a377-b43af80fc7bb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:22.188617 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-228b4854-3f53-4bbe-a377-b43af80fc7bb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:22.191330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-228b4854-3f53-4bbe-a377-b43af80fc7bb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:22.194656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-228b4854-3f53-4bbe-a377-b43af80fc7bb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:22.195404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-228b4854-3f53-4bbe-a377-b43af80fc7bb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:22.196675 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-228b4854-3f53-4bbe-a377-b43af80fc7bb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:22.202778 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73a248d6-2a0f-4da7-849e-dd8441f5055f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:22.204274 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73a248d6-2a0f-4da7-849e-dd8441f5055f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:22.205045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73a248d6-2a0f-4da7-849e-dd8441f5055f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:22.206224 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73a248d6-2a0f-4da7-849e-dd8441f5055f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:22.208315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73a248d6-2a0f-4da7-849e-dd8441f5055f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:22.209820 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73a248d6-2a0f-4da7-849e-dd8441f5055f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:22.942001 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-73a248d6-2a0f-4da7-849e-dd8441f5055f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:22.950605 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-73a248d6-2a0f-4da7-849e-dd8441f5055f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1392 microversion: 2.1 time: 0.784809 Sep 17 20:57:22.951728 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 825/1722] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:22 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1392 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:57:22.957211 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7d5b6dbb-b2db-4db2-a166-aab957e988a1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:22.958017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7d5b6dbb-b2db-4db2-a166-aab957e988a1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:22.969947 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7d5b6dbb-b2db-4db2-a166-aab957e988a1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:22.970457 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7d5b6dbb-b2db-4db2-a166-aab957e988a1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:22.970888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7d5b6dbb-b2db-4db2-a166-aab957e988a1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:22.973196 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7d5b6dbb-b2db-4db2-a166-aab957e988a1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:22.976190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7d5b6dbb-b2db-4db2-a166-aab957e988a1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:22.976900 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7d5b6dbb-b2db-4db2-a166-aab957e988a1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:23.363524 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-228b4854-3f53-4bbe-a377-b43af80fc7bb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:23.375314 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-228b4854-3f53-4bbe-a377-b43af80fc7bb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:23.378459 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-228b4854-3f53-4bbe-a377-b43af80fc7bb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:23.380626 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-228b4854-3f53-4bbe-a377-b43af80fc7bb tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9" status: 200 len: 1565 microversion: 2.25 time: 1.244006 Sep 17 20:57:23.381423 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 898/1723] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:57:22 2022] GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9 => generated 1565 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:57:23.405725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-71f0bbbb-a4e8-4e30-a35a-1e96c23a9567 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:23.407219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-71f0bbbb-a4e8-4e30-a35a-1e96c23a9567 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 39ba6ff9-97dd-4923-90d0-58479fb25bb6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:23.417506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71f0bbbb-a4e8-4e30-a35a-1e96c23a9567 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:23.418230 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71f0bbbb-a4e8-4e30-a35a-1e96c23a9567 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:23.418966 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71f0bbbb-a4e8-4e30-a35a-1e96c23a9567 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:23.419931 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71f0bbbb-a4e8-4e30-a35a-1e96c23a9567 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:23.420789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71f0bbbb-a4e8-4e30-a35a-1e96c23a9567 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:23.421358 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71f0bbbb-a4e8-4e30-a35a-1e96c23a9567 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:23.477428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7d5b6dbb-b2db-4db2-a166-aab957e988a1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:23.495216 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7d5b6dbb-b2db-4db2-a166-aab957e988a1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 200 len: 1497 microversion: 2.1 time: 0.541989 Sep 17 20:57:23.496160 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 826/1724] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:22 2022] GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 1497 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:23.980847 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-69f2668e-cf7c-4e05-87a9-4295641808ac tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:23.982557 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-69f2668e-cf7c-4e05-87a9-4295641808ac tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:23.989972 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69f2668e-cf7c-4e05-87a9-4295641808ac tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:23.990625 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69f2668e-cf7c-4e05-87a9-4295641808ac tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:23.991159 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69f2668e-cf7c-4e05-87a9-4295641808ac tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:23.992004 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69f2668e-cf7c-4e05-87a9-4295641808ac tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:23.992552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69f2668e-cf7c-4e05-87a9-4295641808ac tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:23.993073 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69f2668e-cf7c-4e05-87a9-4295641808ac tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:24.349979 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-71f0bbbb-a4e8-4e30-a35a-1e96c23a9567 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:24.361606 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-71f0bbbb-a4e8-4e30-a35a-1e96c23a9567 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6" status: 200 len: 1314 microversion: 2.1 time: 0.978475 Sep 17 20:57:24.367818 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 899/1725] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:23 2022] GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6 => generated 1314 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:24.376471 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-b70d58d0-c715-4d4e-87dc-ecbc336f083b req-6b663aa2-268d-4732-8bfc-1228cc89b53a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7289e6c1-bbfd-4239-8a82-43ffe2335ec9", "name": "network-vif-deleted", "tag": "d7427540-da45-49cd-8b9c-b7aa57d8fc78"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:24.392226 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b70d58d0-c715-4d4e-87dc-ecbc336f083b req-6b663aa2-268d-4732-8bfc-1228cc89b53a service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:24.392699 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b70d58d0-c715-4d4e-87dc-ecbc336f083b req-6b663aa2-268d-4732-8bfc-1228cc89b53a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:24.393706 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b70d58d0-c715-4d4e-87dc-ecbc336f083b req-6b663aa2-268d-4732-8bfc-1228cc89b53a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:24.407360 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-b70d58d0-c715-4d4e-87dc-ecbc336f083b req-6b663aa2-268d-4732-8bfc-1228cc89b53a service nova] Creating event network-vif-deleted:d7427540-da45-49cd-8b9c-b7aa57d8fc78 for instance 7289e6c1-bbfd-4239-8a82-43ffe2335ec9 on nch2-master-1 Sep 17 20:57:24.413745 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-b70d58d0-c715-4d4e-87dc-ecbc336f083b req-6b663aa2-268d-4732-8bfc-1228cc89b53a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043449 Sep 17 20:57:24.414900 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 900/1726] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:24.421364 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6f32ead5-3bea-45ea-a7a0-637433b64157 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:24.422638 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6f32ead5-3bea-45ea-a7a0-637433b64157 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:24.430170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f32ead5-3bea-45ea-a7a0-637433b64157 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:24.430886 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f32ead5-3bea-45ea-a7a0-637433b64157 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:24.431497 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f32ead5-3bea-45ea-a7a0-637433b64157 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:24.432584 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f32ead5-3bea-45ea-a7a0-637433b64157 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:24.433568 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f32ead5-3bea-45ea-a7a0-637433b64157 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:24.434165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f32ead5-3bea-45ea-a7a0-637433b64157 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:24.518945 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-69f2668e-cf7c-4e05-87a9-4295641808ac tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:24.533835 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-69f2668e-cf7c-4e05-87a9-4295641808ac tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1392 microversion: 2.1 time: 0.557142 Sep 17 20:57:24.537301 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 827/1727] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:23 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1392 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:57:24.547311 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dbbdc4ee-5781-4fcd-b8a0-527a54ce1575 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:24.553411 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dbbdc4ee-5781-4fcd-b8a0-527a54ce1575 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:24.569873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dbbdc4ee-5781-4fcd-b8a0-527a54ce1575 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:24.570397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dbbdc4ee-5781-4fcd-b8a0-527a54ce1575 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:24.570842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dbbdc4ee-5781-4fcd-b8a0-527a54ce1575 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:24.571577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dbbdc4ee-5781-4fcd-b8a0-527a54ce1575 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:24.572249 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dbbdc4ee-5781-4fcd-b8a0-527a54ce1575 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:24.572968 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dbbdc4ee-5781-4fcd-b8a0-527a54ce1575 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:24.590810 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6f32ead5-3bea-45ea-a7a0-637433b64157 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:24.606948 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6f32ead5-3bea-45ea-a7a0-637433b64157 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:24.612611 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6f32ead5-3bea-45ea-a7a0-637433b64157 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:24.614013 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6f32ead5-3bea-45ea-a7a0-637433b64157 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9" status: 200 len: 1523 microversion: 2.25 time: 0.197805 Sep 17 20:57:24.618513 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 901/1728] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:57:24 2022] GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9 => generated 1523 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:57:25.059124 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dbbdc4ee-5781-4fcd-b8a0-527a54ce1575 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:25.072791 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dbbdc4ee-5781-4fcd-b8a0-527a54ce1575 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 200 len: 1497 microversion: 2.1 time: 0.533323 Sep 17 20:57:25.074467 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 828/1729] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:24 2022] GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 1497 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:25.396430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5725e4e9-f516-42cc-a515-f9c26597d404 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:25.397041 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5725e4e9-f516-42cc-a515-f9c26597d404 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 39ba6ff9-97dd-4923-90d0-58479fb25bb6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:25.427722 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5725e4e9-f516-42cc-a515-f9c26597d404 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:25.428227 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5725e4e9-f516-42cc-a515-f9c26597d404 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:25.428665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5725e4e9-f516-42cc-a515-f9c26597d404 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:25.429389 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5725e4e9-f516-42cc-a515-f9c26597d404 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:25.429916 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5725e4e9-f516-42cc-a515-f9c26597d404 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:25.430340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5725e4e9-f516-42cc-a515-f9c26597d404 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:25.557547 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-427ee317-a73f-4287-bf40-e2762b57db2f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:25.558131 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-427ee317-a73f-4287-bf40-e2762b57db2f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:25.571177 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-427ee317-a73f-4287-bf40-e2762b57db2f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:25.571748 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-427ee317-a73f-4287-bf40-e2762b57db2f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:25.572252 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-427ee317-a73f-4287-bf40-e2762b57db2f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:25.576206 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-427ee317-a73f-4287-bf40-e2762b57db2f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:25.576837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-427ee317-a73f-4287-bf40-e2762b57db2f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:25.584166 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-427ee317-a73f-4287-bf40-e2762b57db2f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:25.889639 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5725e4e9-f516-42cc-a515-f9c26597d404 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:25.904452 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5725e4e9-f516-42cc-a515-f9c26597d404 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6" status: 200 len: 1314 microversion: 2.1 time: 0.520821 Sep 17 20:57:25.910215 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 902/1730] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:25 2022] GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6 => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:25.927752 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-db4fe978-92b9-4baa-8324-20e03fa6aadc tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:25.928389 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-db4fe978-92b9-4baa-8324-20e03fa6aadc tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:25.947009 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-db4fe978-92b9-4baa-8324-20e03fa6aadc tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:25.947583 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-db4fe978-92b9-4baa-8324-20e03fa6aadc tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:25.948080 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-db4fe978-92b9-4baa-8324-20e03fa6aadc tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:25.959479 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-db4fe978-92b9-4baa-8324-20e03fa6aadc tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:25.960734 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-db4fe978-92b9-4baa-8324-20e03fa6aadc tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:25.965318 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-db4fe978-92b9-4baa-8324-20e03fa6aadc tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:25.975284 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-427ee317-a73f-4287-bf40-e2762b57db2f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:25.984586 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-427ee317-a73f-4287-bf40-e2762b57db2f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1392 microversion: 2.1 time: 0.432165 Sep 17 20:57:25.985593 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 829/1731] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:25 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1392 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:57:26.063747 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-db4fe978-92b9-4baa-8324-20e03fa6aadc tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:26.068306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-db4fe978-92b9-4baa-8324-20e03fa6aadc tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:26.069892 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-db4fe978-92b9-4baa-8324-20e03fa6aadc tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:26.070914 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-db4fe978-92b9-4baa-8324-20e03fa6aadc tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lazy-loading 'fault' on Instance uuid 7289e6c1-bbfd-4239-8a82-43ffe2335ec9 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:57:26.099999 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-765d75f6-a424-47c3-9f00-b5e8c3e754b8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:26.101413 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-765d75f6-a424-47c3-9f00-b5e8c3e754b8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:26.112824 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-765d75f6-a424-47c3-9f00-b5e8c3e754b8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:26.113778 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-765d75f6-a424-47c3-9f00-b5e8c3e754b8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:26.116900 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-765d75f6-a424-47c3-9f00-b5e8c3e754b8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:26.118018 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-765d75f6-a424-47c3-9f00-b5e8c3e754b8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:26.120988 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-765d75f6-a424-47c3-9f00-b5e8c3e754b8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:26.121775 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-765d75f6-a424-47c3-9f00-b5e8c3e754b8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:26.214326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-db4fe978-92b9-4baa-8324-20e03fa6aadc tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:26.228109 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-db4fe978-92b9-4baa-8324-20e03fa6aadc tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:26.231231 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-db4fe978-92b9-4baa-8324-20e03fa6aadc tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f1134231b4a545fdb136a5204cb4f289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc8bc81c2d74bae9612f7c9807350a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:26.235241 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-db4fe978-92b9-4baa-8324-20e03fa6aadc tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9" status: 200 len: 1352 microversion: 2.25 time: 0.322736 Sep 17 20:57:26.247302 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 903/1732] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:57:25 2022] GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9 => generated 1352 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:57:26.376908 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-765d75f6-a424-47c3-9f00-b5e8c3e754b8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:26.392024 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-765d75f6-a424-47c3-9f00-b5e8c3e754b8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 200 len: 1474 microversion: 2.1 time: 0.296408 Sep 17 20:57:26.397835 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 830/1733] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:26 2022] GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 1474 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:57:26.428040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-69f6dd69-b522-4dcc-9d54-fdb8498df614 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-70790464"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:26.431818 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-69f6dd69-b522-4dcc-9d54-fdb8498df614 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:26.452298 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-da676e79-dc14-46b8-83f8-2098b16bfe04 req-ca3dcafb-7843-4b5f-a9e1-0163d01e7a65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39ba6ff9-97dd-4923-90d0-58479fb25bb6", "tag": "30cee5cc-4c55-4908-aa51-7fc681a008dc"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:26.459656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69f6dd69-b522-4dcc-9d54-fdb8498df614 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:26.460291 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69f6dd69-b522-4dcc-9d54-fdb8498df614 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:26.460730 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69f6dd69-b522-4dcc-9d54-fdb8498df614 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:26.461381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69f6dd69-b522-4dcc-9d54-fdb8498df614 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:26.461894 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69f6dd69-b522-4dcc-9d54-fdb8498df614 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:26.471320 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69f6dd69-b522-4dcc-9d54-fdb8498df614 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:26.473960 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-da676e79-dc14-46b8-83f8-2098b16bfe04 req-ca3dcafb-7843-4b5f-a9e1-0163d01e7a65 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:26.474664 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-da676e79-dc14-46b8-83f8-2098b16bfe04 req-ca3dcafb-7843-4b5f-a9e1-0163d01e7a65 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:26.476074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-da676e79-dc14-46b8-83f8-2098b16bfe04 req-ca3dcafb-7843-4b5f-a9e1-0163d01e7a65 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:26.491333 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-da676e79-dc14-46b8-83f8-2098b16bfe04 req-ca3dcafb-7843-4b5f-a9e1-0163d01e7a65 service nova] Creating event network-changed:30cee5cc-4c55-4908-aa51-7fc681a008dc for instance 39ba6ff9-97dd-4923-90d0-58479fb25bb6 on nch2-master-1 Sep 17 20:57:26.498201 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-da676e79-dc14-46b8-83f8-2098b16bfe04 req-ca3dcafb-7843-4b5f-a9e1-0163d01e7a65 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050033 Sep 17 20:57:26.499566 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 831/1734] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:57:26.930170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-56ac9ce6-1932-49b5-99cf-1b8230452f40 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:26.931786 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-56ac9ce6-1932-49b5-99cf-1b8230452f40 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 39ba6ff9-97dd-4923-90d0-58479fb25bb6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:26.948263 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-69f6dd69-b522-4dcc-9d54-fdb8498df614 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "POST /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa/action" status: 202 len: 0 microversion: 2.1 time: 0.525443 Sep 17 20:57:26.949923 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 904/1735] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:57:26 2022] POST /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa/action => generated 0 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 17 20:57:26.960266 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56ac9ce6-1932-49b5-99cf-1b8230452f40 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:26.971512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6bdddc49-d9fe-4ad2-ba37-d063c6bc3693 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a9ea1f70>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:26.981495 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56ac9ce6-1932-49b5-99cf-1b8230452f40 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:26.982015 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56ac9ce6-1932-49b5-99cf-1b8230452f40 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:26.990124 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56ac9ce6-1932-49b5-99cf-1b8230452f40 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:26.994396 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56ac9ce6-1932-49b5-99cf-1b8230452f40 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:26.994778 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56ac9ce6-1932-49b5-99cf-1b8230452f40 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:27.071860 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6bdddc49-d9fe-4ad2-ba37-d063c6bc3693 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25" status: 200 len: 1412 microversion: 2.1 time: 0.108655 Sep 17 20:57:27.076891 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 905/1736] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:57:26 2022] GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25 => generated 1412 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:27.090199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f5e03aa3-2acb-43a0-a388-6add3a0bad69 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:27.094288 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f5e03aa3-2acb-43a0-a388-6add3a0bad69 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:27.136533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=4 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:27.143366 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=6 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:27.181752 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f5e03aa3-2acb-43a0-a388-6add3a0bad69 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:27.181752 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f5e03aa3-2acb-43a0-a388-6add3a0bad69 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:27.182290 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f5e03aa3-2acb-43a0-a388-6add3a0bad69 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:27.183302 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f5e03aa3-2acb-43a0-a388-6add3a0bad69 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:27.185496 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f5e03aa3-2acb-43a0-a388-6add3a0bad69 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:27.186133 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f5e03aa3-2acb-43a0-a388-6add3a0bad69 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:27.406647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-56ac9ce6-1932-49b5-99cf-1b8230452f40 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:27.417720 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-56ac9ce6-1932-49b5-99cf-1b8230452f40 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6" status: 200 len: 1314 microversion: 2.1 time: 0.493670 Sep 17 20:57:27.418617 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 832/1737] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:26 2022] GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6 => generated 1314 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:27.428694 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b535aad7-df09-4413-8719-21057f6901ff tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-2100128586", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "92dcfef7-2701-4489-ae37-0b43f703b31f"}, {"uuid": "964f106e-e3e9-4f94-9412-180a8fc780f0"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:27.496489 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f5e03aa3-2acb-43a0-a388-6add3a0bad69 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:27.513422 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f5e03aa3-2acb-43a0-a388-6add3a0bad69 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1392 microversion: 2.1 time: 0.435192 Sep 17 20:57:27.522541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-b535aad7-df09-4413-8719-21057f6901ff tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] validate_networks() for [('92dcfef7-2701-4489-ae37-0b43f703b31f', None, None, None, None, None), ('964f106e-e3e9-4f94-9412-180a8fc780f0', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:57:27.528556 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 906/1738] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:27 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1392 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:27.548066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-339c4bb3-7e7f-40ff-ade7-3a14510ac344 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:27.548693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-339c4bb3-7e7f-40ff-ade7-3a14510ac344 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] [instance: 7289e6c1-bbfd-4239-8a82-43ffe2335ec9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:27.573289 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-339c4bb3-7e7f-40ff-ade7-3a14510ac344 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:27.573839 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-339c4bb3-7e7f-40ff-ade7-3a14510ac344 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:27.574279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-339c4bb3-7e7f-40ff-ade7-3a14510ac344 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:27.575133 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-339c4bb3-7e7f-40ff-ade7-3a14510ac344 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:27.575590 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-339c4bb3-7e7f-40ff-ade7-3a14510ac344 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:27.576016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-339c4bb3-7e7f-40ff-ade7-3a14510ac344 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:27.614125 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-339c4bb3-7e7f-40ff-ade7-3a14510ac344 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] HTTP exception thrown: Instance 7289e6c1-bbfd-4239-8a82-43ffe2335ec9 could not be found. Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-339c4bb3-7e7f-40ff-ade7-3a14510ac344 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Request method failure captured: Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9 HTTP/1.1 Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjNRMAPX_oTsPhy9TfA5vu2vyNW5I1IgC_1G9MjGTLqycu01SdxDB1FQYnE4eP90RiN0J5FJdUywXLYCcYRiKroAyLyOhXaJdhri5JVTmmNDHZZ22UM3Q0dE9BqBpbNF6NGgyn9xK5g6Eb8IAu6FGQEDpUrY4GSRsSTNP6PFmk30ZJY Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: X-Openstack-Nova-Api-Version: 2.25 Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 7dc8bc81c2d74bae9612f7c9807350a7 Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1505099207 Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7dc8bc81c2d74bae9612f7c9807350a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7dc8bc81c2d74bae9612f7c9807350a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7dc8bc81c2d74bae9612f7c9807350a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7dc8bc81c2d74bae9612f7c9807350a7", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1505099207 Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 7dc8bc81c2d74bae9612f7c9807350a7 Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1505099207 Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-LiveAutoBlockMigrationV225Test-1505099207-project Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: f1134231b4a545fdb136a5204cb4f289 Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1505099207-project Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 7289e6c1-bbfd-4239-8a82-43ffe2335ec9 could not be found. Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '7289e6c1-bbfd-4239-8a82-43ffe2335ec9'} Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7289e6c1-bbfd-4239-8a82-43ffe2335ec9 could not be found. Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7289e6c1-bbfd-4239-8a82-43ffe2335ec9 could not be found. Sep 17 20:57:27.615841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:27.621494 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:27.621494 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:27.621494 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:27.621494 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:27.621494 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:27.621494 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:57:27.621494 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:57:27.621494 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7289e6c1-bbfd-4239-8a82-43ffe2335ec9 could not be found. Sep 17 20:57:27.621494 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:27.621494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-339c4bb3-7e7f-40ff-ade7-3a14510ac344 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] Returning 404 to user: Instance 7289e6c1-bbfd-4239-8a82-43ffe2335ec9 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:57:27.621494 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-339c4bb3-7e7f-40ff-ade7-3a14510ac344 tempest-LiveAutoBlockMigrationV225Test-1505099207 tempest-LiveAutoBlockMigrationV225Test-1505099207-project] 10.222.0.26 "GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9" status: 404 len: 111 microversion: 2.25 time: 0.087737 Sep 17 20:57:27.621494 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 907/1739] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:57:27 2022] GET /compute/v2.1/servers/7289e6c1-bbfd-4239-8a82-43ffe2335ec9 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 17 20:57:27.963339 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-09ace2be-4d34-4873-9d6b-46873f60cd88 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1317019110", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:28.055715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-09ace2be-4d34-4873-9d6b-46873f60cd88 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] validate_networks() for None {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:57:28.681991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-09ace2be-4d34-4873-9d6b-46873f60cd88 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:57:28.682605 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-09ace2be-4d34-4873-9d6b-46873f60cd88 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:57:28.682891 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-09ace2be-4d34-4873-9d6b-46873f60cd88 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:57:28.683299 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-09ace2be-4d34-4873-9d6b-46873f60cd88 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:57:28.683713 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-09ace2be-4d34-4873-9d6b-46873f60cd88 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:57:28.702003 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09ace2be-4d34-4873-9d6b-46873f60cd88 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:28.703358 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09ace2be-4d34-4873-9d6b-46873f60cd88 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:28.704166 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09ace2be-4d34-4873-9d6b-46873f60cd88 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:28.705189 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09ace2be-4d34-4873-9d6b-46873f60cd88 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:28.706930 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09ace2be-4d34-4873-9d6b-46873f60cd88 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:28.707586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09ace2be-4d34-4873-9d6b-46873f60cd88 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:28.747484 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-09ace2be-4d34-4873-9d6b-46873f60cd88 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for project 3515123097e744ef855ef1129fb59cf1. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:57:28.760386 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-09ace2be-4d34-4873-9d6b-46873f60cd88 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for user 0d48260054d84784b89a52d9b766d7c1 and project 3515123097e744ef855ef1129fb59cf1. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:57:28.778072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-09ace2be-4d34-4873-9d6b-46873f60cd88 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:57:28.782156 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-09ace2be-4d34-4873-9d6b-46873f60cd88 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 8f0929b7-f8de-4896-a0de-a2388fef54f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:57:28.848835 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-09ace2be-4d34-4873-9d6b-46873f60cd88 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.229691 Sep 17 20:57:28.850207 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 908/1740] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:57:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1231 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:57:28.855415 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bdcf070b-5976-4b94-9695-bbd526859fa4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a9eb1040>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:28.949683 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bdcf070b-5976-4b94-9695-bbd526859fa4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25" status: 200 len: 1412 microversion: 2.1 time: 0.098002 Sep 17 20:57:28.952725 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 909/1741] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:57:28 2022] GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25 => generated 1412 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:28.970319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fc619555-65b9-450c-9c24-e7b06c2d56aa tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:28.971517 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fc619555-65b9-450c-9c24-e7b06c2d56aa tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 39ba6ff9-97dd-4923-90d0-58479fb25bb6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:28.980540 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc619555-65b9-450c-9c24-e7b06c2d56aa tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:28.981404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc619555-65b9-450c-9c24-e7b06c2d56aa tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:28.983083 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc619555-65b9-450c-9c24-e7b06c2d56aa tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:28.984274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc619555-65b9-450c-9c24-e7b06c2d56aa tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:28.985122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc619555-65b9-450c-9c24-e7b06c2d56aa tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:28.986928 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc619555-65b9-450c-9c24-e7b06c2d56aa tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:29.230082 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-b535aad7-df09-4413-8719-21057f6901ff tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:57:29.231070 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-b535aad7-df09-4413-8719-21057f6901ff tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:57:29.231894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-b535aad7-df09-4413-8719-21057f6901ff tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:57:29.232356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-b535aad7-df09-4413-8719-21057f6901ff tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:57:29.233799 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-b535aad7-df09-4413-8719-21057f6901ff tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:57:29.249908 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b535aad7-df09-4413-8719-21057f6901ff tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:29.253105 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b535aad7-df09-4413-8719-21057f6901ff tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:29.255554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b535aad7-df09-4413-8719-21057f6901ff tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:29.256595 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b535aad7-df09-4413-8719-21057f6901ff tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:29.259599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b535aad7-df09-4413-8719-21057f6901ff tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:29.261186 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b535aad7-df09-4413-8719-21057f6901ff tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:29.293451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-b535aad7-df09-4413-8719-21057f6901ff tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Getting quotas for project 400242d681ab472d9c90de4fc7da202b. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:57:29.300234 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-b535aad7-df09-4413-8719-21057f6901ff tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Getting quotas for user bc22daf24ce44eb28bb6e000316e4df4 and project 400242d681ab472d9c90de4fc7da202b. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:57:29.313968 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:29.316042 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b535aad7-df09-4413-8719-21057f6901ff tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:57:29.318576 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b535aad7-df09-4413-8719-21057f6901ff tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: f3e67571-f038-485c-8685-af24123a5c10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:57:29.404738 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b535aad7-df09-4413-8719-21057f6901ff tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.981428 Sep 17 20:57:29.413527 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 833/1742] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:57:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:57:29.436182 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a2808e4f-82b3-40e7-92b7-422fd9061018 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:29.437337 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a2808e4f-82b3-40e7-92b7-422fd9061018 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:29.445122 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2808e4f-82b3-40e7-92b7-422fd9061018 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:29.445903 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2808e4f-82b3-40e7-92b7-422fd9061018 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:29.446497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2808e4f-82b3-40e7-92b7-422fd9061018 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:29.447401 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2808e4f-82b3-40e7-92b7-422fd9061018 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:29.448794 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2808e4f-82b3-40e7-92b7-422fd9061018 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:29.449387 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2808e4f-82b3-40e7-92b7-422fd9061018 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:29.677033 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fc619555-65b9-450c-9c24-e7b06c2d56aa tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:29.696958 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fc619555-65b9-450c-9c24-e7b06c2d56aa tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6" status: 200 len: 1314 microversion: 2.1 time: 0.734081 Sep 17 20:57:29.700141 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 910/1743] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:28 2022] GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6 => generated 1314 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:29.743780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-76ba62cf-b70a-4e2b-aada-6102c552302f req-95709c2e-0273-467d-b1dd-94faa4f0f2df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ca7424d-e666-4a33-9cc7-c56de359e512", "name": "network-vif-unplugged", "status": "completed", "tag": "7e2345f8-01ba-4dab-8432-e34b1aefa6e8"}, {"name": "network-changed", "server_uuid": "4ca7424d-e666-4a33-9cc7-c56de359e512", "tag": "7e2345f8-01ba-4dab-8432-e34b1aefa6e8"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:29.769970 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:29.798508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-76ba62cf-b70a-4e2b-aada-6102c552302f req-95709c2e-0273-467d-b1dd-94faa4f0f2df service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:29.807441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-76ba62cf-b70a-4e2b-aada-6102c552302f req-95709c2e-0273-467d-b1dd-94faa4f0f2df service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:29.809159 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-76ba62cf-b70a-4e2b-aada-6102c552302f req-95709c2e-0273-467d-b1dd-94faa4f0f2df service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:29.843651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a2808e4f-82b3-40e7-92b7-422fd9061018 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:29.867523 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a2808e4f-82b3-40e7-92b7-422fd9061018 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1392 microversion: 2.1 time: 0.457592 Sep 17 20:57:29.867677 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-76ba62cf-b70a-4e2b-aada-6102c552302f req-95709c2e-0273-467d-b1dd-94faa4f0f2df service nova] Creating event network-vif-unplugged:7e2345f8-01ba-4dab-8432-e34b1aefa6e8 for instance 4ca7424d-e666-4a33-9cc7-c56de359e512 on nch1-master-1 Sep 17 20:57:29.868096 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-76ba62cf-b70a-4e2b-aada-6102c552302f req-95709c2e-0273-467d-b1dd-94faa4f0f2df service nova] Creating event network-changed:7e2345f8-01ba-4dab-8432-e34b1aefa6e8 for instance 4ca7424d-e666-4a33-9cc7-c56de359e512 on nch1-master-1 Sep 17 20:57:29.868855 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 834/1744] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:29 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1392 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:29.885175 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-76ba62cf-b70a-4e2b-aada-6102c552302f req-95709c2e-0273-467d-b1dd-94faa4f0f2df service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.180777 Sep 17 20:57:29.893617 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 911/1745] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:29.910453 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9c4db92b-9170-4f4c-a38e-41f1177f81cb tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:29.911187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9c4db92b-9170-4f4c-a38e-41f1177f81cb tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: f3e67571-f038-485c-8685-af24123a5c10] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:29.946387 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e7dfd02f-ed81-4c53-85e7-16b419b39721 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:29.947159 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e7dfd02f-ed81-4c53-85e7-16b419b39721 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 8f0929b7-f8de-4896-a0de-a2388fef54f3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:29.978141 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7dfd02f-ed81-4c53-85e7-16b419b39721 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:29.978704 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7dfd02f-ed81-4c53-85e7-16b419b39721 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:29.979156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7dfd02f-ed81-4c53-85e7-16b419b39721 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:29.979921 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7dfd02f-ed81-4c53-85e7-16b419b39721 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:29.981416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7dfd02f-ed81-4c53-85e7-16b419b39721 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:29.982369 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7dfd02f-ed81-4c53-85e7-16b419b39721 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:30.496580 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9c4db92b-9170-4f4c-a38e-41f1177f81cb tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:30.513118 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9c4db92b-9170-4f4c-a38e-41f1177f81cb tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10" status: 200 len: 1213 microversion: 2.1 time: 0.618015 Sep 17 20:57:30.515857 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 912/1746] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:29 2022] GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10 => generated 1213 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:30.534556 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6025e156-e335-4a7d-a9a6-9359244f593e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4db9b80>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:30.602609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e7dfd02f-ed81-4c53-85e7-16b419b39721 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:30.631058 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e7dfd02f-ed81-4c53-85e7-16b419b39721 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3" status: 200 len: 1221 microversion: 2.1 time: 0.760802 Sep 17 20:57:30.634044 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 835/1747] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:29 2022] GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3 => generated 1221 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:30.673563 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6025e156-e335-4a7d-a9a6-9359244f593e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25" status: 200 len: 1412 microversion: 2.1 time: 0.153868 Sep 17 20:57:30.673563 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 913/1748] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:57:30 2022] GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25 => generated 1412 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:30.728720 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5d51e3e9-15f3-4bd1-939b-7cd0249be01c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:30.729713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5d51e3e9-15f3-4bd1-939b-7cd0249be01c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 39ba6ff9-97dd-4923-90d0-58479fb25bb6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:30.739932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d51e3e9-15f3-4bd1-939b-7cd0249be01c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:30.744055 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d51e3e9-15f3-4bd1-939b-7cd0249be01c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:30.744834 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d51e3e9-15f3-4bd1-939b-7cd0249be01c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:30.746621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d51e3e9-15f3-4bd1-939b-7cd0249be01c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:30.746621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d51e3e9-15f3-4bd1-939b-7cd0249be01c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:30.747067 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d51e3e9-15f3-4bd1-939b-7cd0249be01c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:30.893482 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-880efb91-47ce-4483-a3a9-a7637fc1c3a2 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:30.894102 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-880efb91-47ce-4483-a3a9-a7637fc1c3a2 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:30.909958 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-880efb91-47ce-4483-a3a9-a7637fc1c3a2 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:30.910682 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-880efb91-47ce-4483-a3a9-a7637fc1c3a2 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:30.911289 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-880efb91-47ce-4483-a3a9-a7637fc1c3a2 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:30.912201 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-880efb91-47ce-4483-a3a9-a7637fc1c3a2 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:30.913736 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-880efb91-47ce-4483-a3a9-a7637fc1c3a2 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:30.914377 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-880efb91-47ce-4483-a3a9-a7637fc1c3a2 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:32.031552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5d51e3e9-15f3-4bd1-939b-7cd0249be01c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:32.044585 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5d51e3e9-15f3-4bd1-939b-7cd0249be01c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6" status: 200 len: 1314 microversion: 2.1 time: 1.321685 Sep 17 20:57:32.049939 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 836/1749] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:30 2022] GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6 => generated 1314 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:32.061261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c0089cdd-ee2b-4a44-b1b3-beef1b819d54 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:32.064433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c0089cdd-ee2b-4a44-b1b3-beef1b819d54 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: f3e67571-f038-485c-8685-af24123a5c10] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:32.083123 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0089cdd-ee2b-4a44-b1b3-beef1b819d54 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:32.083936 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0089cdd-ee2b-4a44-b1b3-beef1b819d54 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:32.084507 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0089cdd-ee2b-4a44-b1b3-beef1b819d54 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:32.085406 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0089cdd-ee2b-4a44-b1b3-beef1b819d54 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:32.089139 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0089cdd-ee2b-4a44-b1b3-beef1b819d54 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:32.090495 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0089cdd-ee2b-4a44-b1b3-beef1b819d54 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:32.355696 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c0089cdd-ee2b-4a44-b1b3-beef1b819d54 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:32.367877 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c0089cdd-ee2b-4a44-b1b3-beef1b819d54 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10" status: 200 len: 1273 microversion: 2.1 time: 0.316348 Sep 17 20:57:32.382402 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 837/1750] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:32 2022] GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10 => generated 1273 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:32.396165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f1a9cb32-6aac-4dca-894d-cd74174c51ed tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:32.398360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f1a9cb32-6aac-4dca-894d-cd74174c51ed tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 8f0929b7-f8de-4896-a0de-a2388fef54f3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:32.414534 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1a9cb32-6aac-4dca-894d-cd74174c51ed tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:32.415053 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1a9cb32-6aac-4dca-894d-cd74174c51ed tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:32.415511 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1a9cb32-6aac-4dca-894d-cd74174c51ed tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:32.416264 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1a9cb32-6aac-4dca-894d-cd74174c51ed tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:32.416731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1a9cb32-6aac-4dca-894d-cd74174c51ed tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:32.417172 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1a9cb32-6aac-4dca-894d-cd74174c51ed tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:32.420445 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:32.722591 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f1a9cb32-6aac-4dca-894d-cd74174c51ed tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:32.736491 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f1a9cb32-6aac-4dca-894d-cd74174c51ed tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3" status: 200 len: 1275 microversion: 2.1 time: 0.350590 Sep 17 20:57:32.737683 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 838/1751] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:32 2022] GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3 => generated 1275 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:32.754511 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-abd5d3d5-e3ce-4b68-b9b2-8ca996684e48 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a5000310>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:32.848298 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-abd5d3d5-e3ce-4b68-b9b2-8ca996684e48 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25" status: 200 len: 1412 microversion: 2.1 time: 0.102599 Sep 17 20:57:32.848954 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 839/1752] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:57:32 2022] GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25 => generated 1412 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:32.997441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-880efb91-47ce-4483-a3a9-a7637fc1c3a2 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:33.022777 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-880efb91-47ce-4483-a3a9-a7637fc1c3a2 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1392 microversion: 2.1 time: 2.128762 Sep 17 20:57:33.034402 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 914/1753] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:30 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1392 bytes in 2143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:33.074334 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7a638e07-cb03-4499-ae20-94a6813e6a37 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:33.075648 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7a638e07-cb03-4499-ae20-94a6813e6a37 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 39ba6ff9-97dd-4923-90d0-58479fb25bb6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:33.113045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a638e07-cb03-4499-ae20-94a6813e6a37 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:33.116415 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a638e07-cb03-4499-ae20-94a6813e6a37 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:33.119192 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a638e07-cb03-4499-ae20-94a6813e6a37 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:33.125333 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a638e07-cb03-4499-ae20-94a6813e6a37 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:33.126780 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a638e07-cb03-4499-ae20-94a6813e6a37 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:33.129333 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a638e07-cb03-4499-ae20-94a6813e6a37 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:33.397883 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e19943e0-3d7d-4759-8644-8335718bdb05 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:33.398538 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e19943e0-3d7d-4759-8644-8335718bdb05 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: f3e67571-f038-485c-8685-af24123a5c10] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:33.410855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e19943e0-3d7d-4759-8644-8335718bdb05 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:33.411284 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e19943e0-3d7d-4759-8644-8335718bdb05 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:33.411774 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e19943e0-3d7d-4759-8644-8335718bdb05 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:33.412551 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e19943e0-3d7d-4759-8644-8335718bdb05 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:33.413078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e19943e0-3d7d-4759-8644-8335718bdb05 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:33.434370 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e19943e0-3d7d-4759-8644-8335718bdb05 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:33.869422 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e19943e0-3d7d-4759-8644-8335718bdb05 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:33.878279 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e19943e0-3d7d-4759-8644-8335718bdb05 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10" status: 200 len: 1271 microversion: 2.1 time: 0.484649 Sep 17 20:57:33.878882 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 915/1754] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:33 2022] GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10 => generated 1271 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:33.899731 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3f6485bd-6616-407e-9582-ce8583e37d89 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:33.900756 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3f6485bd-6616-407e-9582-ce8583e37d89 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 8f0929b7-f8de-4896-a0de-a2388fef54f3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:33.913874 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f6485bd-6616-407e-9582-ce8583e37d89 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:33.914689 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f6485bd-6616-407e-9582-ce8583e37d89 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:33.915316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f6485bd-6616-407e-9582-ce8583e37d89 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:33.916903 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f6485bd-6616-407e-9582-ce8583e37d89 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:33.917587 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f6485bd-6616-407e-9582-ce8583e37d89 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:33.918192 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f6485bd-6616-407e-9582-ce8583e37d89 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:33.935967 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7a638e07-cb03-4499-ae20-94a6813e6a37 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:33.948503 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7a638e07-cb03-4499-ae20-94a6813e6a37 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6" status: 200 len: 1314 microversion: 2.1 time: 0.879883 Sep 17 20:57:33.951968 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 840/1755] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:33 2022] GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6 => generated 1314 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:33.965144 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-eaa478dd-a09c-4b6e-95f9-af3552e737c8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4f964c0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:34.045098 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-eaa478dd-a09c-4b6e-95f9-af3552e737c8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25" status: 200 len: 1412 microversion: 2.1 time: 0.091825 Sep 17 20:57:34.057777 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 841/1756] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:57:33 2022] GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25 => generated 1412 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:34.063175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-be44c529-a183-4685-9515-b69b60202164 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:34.067533 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-be44c529-a183-4685-9515-b69b60202164 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:34.082025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be44c529-a183-4685-9515-b69b60202164 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:34.082729 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be44c529-a183-4685-9515-b69b60202164 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:34.082987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be44c529-a183-4685-9515-b69b60202164 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:34.084460 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be44c529-a183-4685-9515-b69b60202164 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:34.084999 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be44c529-a183-4685-9515-b69b60202164 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:34.085443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be44c529-a183-4685-9515-b69b60202164 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:34.275813 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3f6485bd-6616-407e-9582-ce8583e37d89 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:34.287906 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3f6485bd-6616-407e-9582-ce8583e37d89 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3" status: 200 len: 1275 microversion: 2.1 time: 0.404841 Sep 17 20:57:34.297746 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 916/1757] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:33 2022] GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3 => generated 1275 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:34.601702 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-be44c529-a183-4685-9515-b69b60202164 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:34.624876 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-be44c529-a183-4685-9515-b69b60202164 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1392 microversion: 2.1 time: 0.563155 Sep 17 20:57:34.629951 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 842/1758] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:34 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1392 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:34.906428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-12eaafec-9429-47c3-ac7f-1c06bab24ef4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:34.907293 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-12eaafec-9429-47c3-ac7f-1c06bab24ef4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: f3e67571-f038-485c-8685-af24123a5c10] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:34.925296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12eaafec-9429-47c3-ac7f-1c06bab24ef4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:34.925965 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12eaafec-9429-47c3-ac7f-1c06bab24ef4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:34.926498 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12eaafec-9429-47c3-ac7f-1c06bab24ef4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:34.927310 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12eaafec-9429-47c3-ac7f-1c06bab24ef4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:34.928005 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12eaafec-9429-47c3-ac7f-1c06bab24ef4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:34.928449 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12eaafec-9429-47c3-ac7f-1c06bab24ef4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:34.954035 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:34.979657 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8fc4f496-0311-4a28-9627-d13f20a99dde tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:34.980649 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8fc4f496-0311-4a28-9627-d13f20a99dde tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 39ba6ff9-97dd-4923-90d0-58479fb25bb6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:34.996089 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8fc4f496-0311-4a28-9627-d13f20a99dde tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:35.002274 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8fc4f496-0311-4a28-9627-d13f20a99dde tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:35.002919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8fc4f496-0311-4a28-9627-d13f20a99dde tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:35.003920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8fc4f496-0311-4a28-9627-d13f20a99dde tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:35.004551 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8fc4f496-0311-4a28-9627-d13f20a99dde tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:35.005279 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8fc4f496-0311-4a28-9627-d13f20a99dde tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:35.191476 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-12eaafec-9429-47c3-ac7f-1c06bab24ef4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:35.205765 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-12eaafec-9429-47c3-ac7f-1c06bab24ef4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10" status: 200 len: 1271 microversion: 2.1 time: 0.299940 Sep 17 20:57:35.210261 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 917/1759] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:34 2022] GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10 => generated 1271 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:35.224889 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-db521ac5-cf45-49c8-b806-737cd92020bd tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4d65820>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:35.300381 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-db521ac5-cf45-49c8-b806-737cd92020bd tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25" status: 200 len: 1412 microversion: 2.1 time: 0.088489 Sep 17 20:57:35.302076 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 918/1760] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:57:35 2022] GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25 => generated 1412 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:35.326458 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4d311cc6-4bd9-41d8-a7e8-d5b516edb5e4 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:35.330254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4d311cc6-4bd9-41d8-a7e8-d5b516edb5e4 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 8f0929b7-f8de-4896-a0de-a2388fef54f3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:35.348786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d311cc6-4bd9-41d8-a7e8-d5b516edb5e4 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:35.349864 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d311cc6-4bd9-41d8-a7e8-d5b516edb5e4 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:35.351401 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d311cc6-4bd9-41d8-a7e8-d5b516edb5e4 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:35.353986 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d311cc6-4bd9-41d8-a7e8-d5b516edb5e4 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:35.354799 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d311cc6-4bd9-41d8-a7e8-d5b516edb5e4 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:35.355731 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d311cc6-4bd9-41d8-a7e8-d5b516edb5e4 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:35.523508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4d311cc6-4bd9-41d8-a7e8-d5b516edb5e4 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:35.533148 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4d311cc6-4bd9-41d8-a7e8-d5b516edb5e4 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3" status: 200 len: 1275 microversion: 2.1 time: 0.215640 Sep 17 20:57:35.542303 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 919/1761] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:35 2022] GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3 => generated 1275 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:57:35.547922 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8fc4f496-0311-4a28-9627-d13f20a99dde tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:35.564874 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8fc4f496-0311-4a28-9627-d13f20a99dde tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6" status: 200 len: 1314 microversion: 2.1 time: 0.587227 Sep 17 20:57:35.565740 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 843/1762] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:34 2022] GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6 => generated 1314 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:57:35.655335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3fcccce6-a519-4739-a780-8f45a08a6c1b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:35.655978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3fcccce6-a519-4739-a780-8f45a08a6c1b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:35.678077 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3fcccce6-a519-4739-a780-8f45a08a6c1b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:35.678568 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3fcccce6-a519-4739-a780-8f45a08a6c1b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:35.679238 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3fcccce6-a519-4739-a780-8f45a08a6c1b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:35.680704 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3fcccce6-a519-4739-a780-8f45a08a6c1b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:35.681386 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3fcccce6-a519-4739-a780-8f45a08a6c1b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:35.682091 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3fcccce6-a519-4739-a780-8f45a08a6c1b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:36.013508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3fcccce6-a519-4739-a780-8f45a08a6c1b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:36.025367 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3fcccce6-a519-4739-a780-8f45a08a6c1b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1392 microversion: 2.1 time: 0.373977 Sep 17 20:57:36.030036 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 920/1763] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:35 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1392 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:36.236433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e0ec4009-461c-47e9-910f-496408b23c06 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:36.237968 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e0ec4009-461c-47e9-910f-496408b23c06 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: f3e67571-f038-485c-8685-af24123a5c10] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:36.251643 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0ec4009-461c-47e9-910f-496408b23c06 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:36.252721 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0ec4009-461c-47e9-910f-496408b23c06 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:36.253427 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0ec4009-461c-47e9-910f-496408b23c06 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:36.255630 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0ec4009-461c-47e9-910f-496408b23c06 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:36.256898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0ec4009-461c-47e9-910f-496408b23c06 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:36.258038 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0ec4009-461c-47e9-910f-496408b23c06 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:36.318166 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5d1c4fe5-61db-4c92-85b3-9761f8e39a0a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4d4dca0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:36.403917 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5d1c4fe5-61db-4c92-85b3-9761f8e39a0a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25" status: 200 len: 1412 microversion: 2.1 time: 0.091196 Sep 17 20:57:36.413551 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 921/1764] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:57:36 2022] GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25 => generated 1412 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:36.564971 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-eaceab34-aac9-4c1d-aaef-a50d36ba29cb tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:36.565627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-eaceab34-aac9-4c1d-aaef-a50d36ba29cb tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 8f0929b7-f8de-4896-a0de-a2388fef54f3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:36.575508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eaceab34-aac9-4c1d-aaef-a50d36ba29cb tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:36.576005 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eaceab34-aac9-4c1d-aaef-a50d36ba29cb tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:36.576455 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eaceab34-aac9-4c1d-aaef-a50d36ba29cb tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:36.577163 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eaceab34-aac9-4c1d-aaef-a50d36ba29cb tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:36.577648 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eaceab34-aac9-4c1d-aaef-a50d36ba29cb tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:36.578067 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eaceab34-aac9-4c1d-aaef-a50d36ba29cb tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:36.685637 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e0ec4009-461c-47e9-910f-496408b23c06 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:36.709906 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e0ec4009-461c-47e9-910f-496408b23c06 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10" status: 200 len: 1313 microversion: 2.1 time: 0.468471 Sep 17 20:57:36.710616 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 844/1765] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:36 2022] GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10 => generated 1313 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:36.715427 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4afa457a-00ad-45bf-bce8-49c09d892410 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:36.716043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4afa457a-00ad-45bf-bce8-49c09d892410 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 39ba6ff9-97dd-4923-90d0-58479fb25bb6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:36.730223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4afa457a-00ad-45bf-bce8-49c09d892410 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:36.730945 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4afa457a-00ad-45bf-bce8-49c09d892410 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:36.731567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4afa457a-00ad-45bf-bce8-49c09d892410 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:36.732494 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4afa457a-00ad-45bf-bce8-49c09d892410 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:36.733956 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4afa457a-00ad-45bf-bce8-49c09d892410 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:36.734690 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4afa457a-00ad-45bf-bce8-49c09d892410 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:37.423760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-eaceab34-aac9-4c1d-aaef-a50d36ba29cb tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:37.440392 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-eaceab34-aac9-4c1d-aaef-a50d36ba29cb tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3" status: 200 len: 1317 microversion: 2.1 time: 0.879655 Sep 17 20:57:37.444129 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 922/1766] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:36 2022] GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3 => generated 1317 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:57:37.460013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-7e870fc6-9777-44a6-9cfc-a68cd9087463 req-ac2330b4-810d-450a-9c35-6feda0b91259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be2b42c6-7d99-48b0-b515-26a7139e11aa", "name": "network-vif-plugged", "status": "completed", "tag": "6eb514c0-157c-49ae-bba8-9c080043b38a"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:37.487748 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4afa457a-00ad-45bf-bce8-49c09d892410 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:37.511688 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4afa457a-00ad-45bf-bce8-49c09d892410 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6" status: 200 len: 1314 microversion: 2.1 time: 0.799917 Sep 17 20:57:37.512549 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 845/1767] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:36 2022] GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6 => generated 1314 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:37.515820 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7e870fc6-9777-44a6-9cfc-a68cd9087463 req-ac2330b4-810d-450a-9c35-6feda0b91259 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:37.516344 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7e870fc6-9777-44a6-9cfc-a68cd9087463 req-ac2330b4-810d-450a-9c35-6feda0b91259 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:37.516818 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7e870fc6-9777-44a6-9cfc-a68cd9087463 req-ac2330b4-810d-450a-9c35-6feda0b91259 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:37.540035 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-df482892-0ba9-4cc5-8451-02c984cc8d6f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:37.540035 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-df482892-0ba9-4cc5-8451-02c984cc8d6f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:37.549787 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df482892-0ba9-4cc5-8451-02c984cc8d6f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:37.550552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df482892-0ba9-4cc5-8451-02c984cc8d6f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:37.551320 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df482892-0ba9-4cc5-8451-02c984cc8d6f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:37.552579 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df482892-0ba9-4cc5-8451-02c984cc8d6f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:37.553323 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df482892-0ba9-4cc5-8451-02c984cc8d6f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:37.554086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df482892-0ba9-4cc5-8451-02c984cc8d6f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:37.562378 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-7e870fc6-9777-44a6-9cfc-a68cd9087463 req-ac2330b4-810d-450a-9c35-6feda0b91259 service nova] Creating event network-vif-plugged:6eb514c0-157c-49ae-bba8-9c080043b38a for instance be2b42c6-7d99-48b0-b515-26a7139e11aa on nch2-master-1 Sep 17 20:57:37.575472 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-7e870fc6-9777-44a6-9cfc-a68cd9087463 req-ac2330b4-810d-450a-9c35-6feda0b91259 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129641 Sep 17 20:57:37.576661 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 923/1768] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:37.582227 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-28ddc565-75a8-419a-8f1d-274924a17b3a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4d4d820>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:37.661193 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-28ddc565-75a8-419a-8f1d-274924a17b3a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25" status: 200 len: 1412 microversion: 2.1 time: 0.083158 Sep 17 20:57:37.665809 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 924/1769] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:57:37 2022] GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25 => generated 1412 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:37.741378 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a8387f3c-0bb2-4e14-a619-f89d5c4ba5e0 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:37.742735 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a8387f3c-0bb2-4e14-a619-f89d5c4ba5e0 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: f3e67571-f038-485c-8685-af24123a5c10] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:37.763867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8387f3c-0bb2-4e14-a619-f89d5c4ba5e0 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:37.764737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8387f3c-0bb2-4e14-a619-f89d5c4ba5e0 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:37.765440 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8387f3c-0bb2-4e14-a619-f89d5c4ba5e0 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:37.766545 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8387f3c-0bb2-4e14-a619-f89d5c4ba5e0 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:37.767230 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8387f3c-0bb2-4e14-a619-f89d5c4ba5e0 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:37.768304 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8387f3c-0bb2-4e14-a619-f89d5c4ba5e0 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:38.636528 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-df482892-0ba9-4cc5-8451-02c984cc8d6f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:38.656798 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-df482892-0ba9-4cc5-8451-02c984cc8d6f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1392 microversion: 2.1 time: 1.143144 Sep 17 20:57:38.658893 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 846/1770] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:37 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1392 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:38.672954 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-597d75df-dbe5-4578-8cc7-9c30968665ed tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:38.674145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-597d75df-dbe5-4578-8cc7-9c30968665ed tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 8f0929b7-f8de-4896-a0de-a2388fef54f3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:38.695708 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-597d75df-dbe5-4578-8cc7-9c30968665ed tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:38.696460 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-597d75df-dbe5-4578-8cc7-9c30968665ed tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:38.698264 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-597d75df-dbe5-4578-8cc7-9c30968665ed tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:38.701004 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-597d75df-dbe5-4578-8cc7-9c30968665ed tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:38.702120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-597d75df-dbe5-4578-8cc7-9c30968665ed tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:38.704960 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-597d75df-dbe5-4578-8cc7-9c30968665ed tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:38.722938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:39.041079 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a8387f3c-0bb2-4e14-a619-f89d5c4ba5e0 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:39.050227 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a8387f3c-0bb2-4e14-a619-f89d5c4ba5e0 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10" status: 200 len: 1313 microversion: 2.1 time: 1.316762 Sep 17 20:57:39.069841 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 925/1771] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:37 2022] GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10 => generated 1313 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:39.075042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c405b28b-2266-4882-bf33-cb235bd831e0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:39.075708 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c405b28b-2266-4882-bf33-cb235bd831e0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 39ba6ff9-97dd-4923-90d0-58479fb25bb6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:39.117400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c405b28b-2266-4882-bf33-cb235bd831e0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:39.121498 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c405b28b-2266-4882-bf33-cb235bd831e0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:39.122335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c405b28b-2266-4882-bf33-cb235bd831e0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:39.130995 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c405b28b-2266-4882-bf33-cb235bd831e0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:39.131520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c405b28b-2266-4882-bf33-cb235bd831e0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:39.144303 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c405b28b-2266-4882-bf33-cb235bd831e0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:39.282198 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:39.310026 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:39.503462 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c405b28b-2266-4882-bf33-cb235bd831e0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:39.530354 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c405b28b-2266-4882-bf33-cb235bd831e0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6" status: 200 len: 1314 microversion: 2.1 time: 0.459081 Sep 17 20:57:39.538034 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 926/1772] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:39 2022] GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6 => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:39.553890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-125c6803-eafd-4812-abf5-83e6889dd140 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a9ebf160>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:39.593692 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-597d75df-dbe5-4578-8cc7-9c30968665ed tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:39.617099 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-597d75df-dbe5-4578-8cc7-9c30968665ed tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3" status: 200 len: 1317 microversion: 2.1 time: 0.954527 Sep 17 20:57:39.620061 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 847/1773] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:38 2022] GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3 => generated 1317 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:39.689962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4c399e0e-6439-4f43-bf23-e3474c6d8a9b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:39.692419 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4c399e0e-6439-4f43-bf23-e3474c6d8a9b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:39.699465 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-125c6803-eafd-4812-abf5-83e6889dd140 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25" status: 200 len: 1412 microversion: 2.1 time: 0.159382 Sep 17 20:57:39.700435 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 927/1774] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:57:39 2022] GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25 => generated 1412 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:39.701031 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c399e0e-6439-4f43-bf23-e3474c6d8a9b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:39.701694 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c399e0e-6439-4f43-bf23-e3474c6d8a9b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:39.702282 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c399e0e-6439-4f43-bf23-e3474c6d8a9b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:39.703482 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c399e0e-6439-4f43-bf23-e3474c6d8a9b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:39.704284 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c399e0e-6439-4f43-bf23-e3474c6d8a9b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:39.704852 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c399e0e-6439-4f43-bf23-e3474c6d8a9b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:39.762434 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-622bf302-9f61-47f6-ac5d-e79a29cdaf39 req-06eaa1f2-76cf-47bb-9430-5918b81a4a07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39ba6ff9-97dd-4923-90d0-58479fb25bb6", "name": "network-vif-plugged", "status": "completed", "tag": "30cee5cc-4c55-4908-aa51-7fc681a008dc"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:39.799734 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-622bf302-9f61-47f6-ac5d-e79a29cdaf39 req-06eaa1f2-76cf-47bb-9430-5918b81a4a07 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:39.804110 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-622bf302-9f61-47f6-ac5d-e79a29cdaf39 req-06eaa1f2-76cf-47bb-9430-5918b81a4a07 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:39.806972 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-622bf302-9f61-47f6-ac5d-e79a29cdaf39 req-06eaa1f2-76cf-47bb-9430-5918b81a4a07 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:39.824733 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-622bf302-9f61-47f6-ac5d-e79a29cdaf39 req-06eaa1f2-76cf-47bb-9430-5918b81a4a07 service nova] Creating event network-vif-plugged:30cee5cc-4c55-4908-aa51-7fc681a008dc for instance 39ba6ff9-97dd-4923-90d0-58479fb25bb6 on nch2-master-1 Sep 17 20:57:39.833705 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-622bf302-9f61-47f6-ac5d-e79a29cdaf39 req-06eaa1f2-76cf-47bb-9430-5918b81a4a07 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075027 Sep 17 20:57:39.835064 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 928/1775] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:40.100895 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f6580c3b-091a-40a0-8444-cffba4c75f47 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:40.104964 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f6580c3b-091a-40a0-8444-cffba4c75f47 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: f3e67571-f038-485c-8685-af24123a5c10] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:40.121802 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6580c3b-091a-40a0-8444-cffba4c75f47 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:40.122514 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6580c3b-091a-40a0-8444-cffba4c75f47 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:40.124331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6580c3b-091a-40a0-8444-cffba4c75f47 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:40.125394 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6580c3b-091a-40a0-8444-cffba4c75f47 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:40.126755 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6580c3b-091a-40a0-8444-cffba4c75f47 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:40.128909 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6580c3b-091a-40a0-8444-cffba4c75f47 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:40.283913 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4c399e0e-6439-4f43-bf23-e3474c6d8a9b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:40.303244 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4c399e0e-6439-4f43-bf23-e3474c6d8a9b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1392 microversion: 2.1 time: 0.618584 Sep 17 20:57:40.323010 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 848/1776] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:39 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1392 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:40.502230 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=8 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:40.521342 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f6580c3b-091a-40a0-8444-cffba4c75f47 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:40.538177 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f6580c3b-091a-40a0-8444-cffba4c75f47 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10" status: 200 len: 1334 microversion: 2.1 time: 0.444768 Sep 17 20:57:40.566458 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 929/1777] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:40 2022] GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10 => generated 1334 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:40.634713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-baeed462-8254-46df-bd6f-690643772cdb tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:40.635894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-baeed462-8254-46df-bd6f-690643772cdb tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 39ba6ff9-97dd-4923-90d0-58479fb25bb6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:40.658049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-baa29fa5-6d5f-4303-bacf-37479e6ed874 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:40.659350 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-baa29fa5-6d5f-4303-bacf-37479e6ed874 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 8f0929b7-f8de-4896-a0de-a2388fef54f3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:40.675762 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-baeed462-8254-46df-bd6f-690643772cdb tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:40.679933 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-baeed462-8254-46df-bd6f-690643772cdb tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:40.687355 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-baeed462-8254-46df-bd6f-690643772cdb tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:40.692195 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-baeed462-8254-46df-bd6f-690643772cdb tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:40.698550 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-baeed462-8254-46df-bd6f-690643772cdb tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:40.699802 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-baeed462-8254-46df-bd6f-690643772cdb tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:40.700140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-baa29fa5-6d5f-4303-bacf-37479e6ed874 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:40.702405 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-baa29fa5-6d5f-4303-bacf-37479e6ed874 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:40.704175 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-baa29fa5-6d5f-4303-bacf-37479e6ed874 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:40.705135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-baa29fa5-6d5f-4303-bacf-37479e6ed874 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:40.708679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-baa29fa5-6d5f-4303-bacf-37479e6ed874 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:40.709882 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-baa29fa5-6d5f-4303-bacf-37479e6ed874 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:41.944019 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-baeed462-8254-46df-bd6f-690643772cdb tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:41.960502 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-baeed462-8254-46df-bd6f-690643772cdb tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6" status: 200 len: 1314 microversion: 2.1 time: 1.330259 Sep 17 20:57:41.962688 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 849/1778] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:40 2022] GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6 => generated 1314 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:41.975922 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7ae32415-1d7c-4337-8f7b-d813b2758041 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a5045820>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:42.025183 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-baa29fa5-6d5f-4303-bacf-37479e6ed874 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:42.043768 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-baa29fa5-6d5f-4303-bacf-37479e6ed874 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3" status: 200 len: 1317 microversion: 2.1 time: 1.386943 Sep 17 20:57:42.045978 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 930/1779] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:40 2022] GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3 => generated 1317 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:57:42.083262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8dc52e3c-a3ae-4f4c-911d-a214e5f27da6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:42.083658 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8dc52e3c-a3ae-4f4c-911d-a214e5f27da6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:42.084737 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7ae32415-1d7c-4337-8f7b-d813b2758041 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25" status: 200 len: 1412 microversion: 2.1 time: 0.113995 Sep 17 20:57:42.095994 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8dc52e3c-a3ae-4f4c-911d-a214e5f27da6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:42.099319 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 850/1780] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:57:41 2022] GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25 => generated 1412 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:42.101012 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8dc52e3c-a3ae-4f4c-911d-a214e5f27da6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:42.102522 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8dc52e3c-a3ae-4f4c-911d-a214e5f27da6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:42.104223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8dc52e3c-a3ae-4f4c-911d-a214e5f27da6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:42.104960 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8dc52e3c-a3ae-4f4c-911d-a214e5f27da6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:42.105745 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8dc52e3c-a3ae-4f4c-911d-a214e5f27da6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:42.108285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6f9e315e-dbd2-4a1d-8cbf-c4d0d730bbb5 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:42.109531 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6f9e315e-dbd2-4a1d-8cbf-c4d0d730bbb5 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: f3e67571-f038-485c-8685-af24123a5c10] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:42.136927 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6f9e315e-dbd2-4a1d-8cbf-c4d0d730bbb5 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:42.138151 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6f9e315e-dbd2-4a1d-8cbf-c4d0d730bbb5 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:42.138941 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6f9e315e-dbd2-4a1d-8cbf-c4d0d730bbb5 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:42.140014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6f9e315e-dbd2-4a1d-8cbf-c4d0d730bbb5 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:42.140550 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6f9e315e-dbd2-4a1d-8cbf-c4d0d730bbb5 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:42.141104 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6f9e315e-dbd2-4a1d-8cbf-c4d0d730bbb5 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:42.919499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6f9e315e-dbd2-4a1d-8cbf-c4d0d730bbb5 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:42.940665 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6f9e315e-dbd2-4a1d-8cbf-c4d0d730bbb5 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10" status: 200 len: 1334 microversion: 2.1 time: 0.837291 Sep 17 20:57:42.965257 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8dc52e3c-a3ae-4f4c-911d-a214e5f27da6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:42.975860 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 851/1781] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:42 2022] GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10 => generated 1334 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:42.996952 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8dc52e3c-a3ae-4f4c-911d-a214e5f27da6 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1382 microversion: 2.1 time: 0.927662 Sep 17 20:57:43.005432 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-d62121e0-7b56-4069-9f93-c42a8d2316c7 req-c352b509-f7bd-446e-84aa-c0ddb854f7c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f0929b7-f8de-4896-a0de-a2388fef54f3", "tag": "875360ee-4e0d-4125-98cf-746e7cb35373"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:43.010570 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 931/1782] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:42 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1382 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:43.040720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c4f4345b-83ad-40af-9ac9-ee2c32a33833 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:43.042086 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c4f4345b-83ad-40af-9ac9-ee2c32a33833 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 39ba6ff9-97dd-4923-90d0-58479fb25bb6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:43.068064 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d62121e0-7b56-4069-9f93-c42a8d2316c7 req-c352b509-f7bd-446e-84aa-c0ddb854f7c4 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:43.068606 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d62121e0-7b56-4069-9f93-c42a8d2316c7 req-c352b509-f7bd-446e-84aa-c0ddb854f7c4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:43.069065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d62121e0-7b56-4069-9f93-c42a8d2316c7 req-c352b509-f7bd-446e-84aa-c0ddb854f7c4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:43.073204 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4f4345b-83ad-40af-9ac9-ee2c32a33833 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:43.073764 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4f4345b-83ad-40af-9ac9-ee2c32a33833 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:43.074238 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4f4345b-83ad-40af-9ac9-ee2c32a33833 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:43.075026 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4f4345b-83ad-40af-9ac9-ee2c32a33833 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:43.075511 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4f4345b-83ad-40af-9ac9-ee2c32a33833 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:43.075953 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4f4345b-83ad-40af-9ac9-ee2c32a33833 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:43.107736 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-d62121e0-7b56-4069-9f93-c42a8d2316c7 req-c352b509-f7bd-446e-84aa-c0ddb854f7c4 service nova] Creating event network-changed:875360ee-4e0d-4125-98cf-746e7cb35373 for instance 8f0929b7-f8de-4896-a0de-a2388fef54f3 on nch1-master-1 Sep 17 20:57:43.135698 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-d62121e0-7b56-4069-9f93-c42a8d2316c7 req-c352b509-f7bd-446e-84aa-c0ddb854f7c4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149981 Sep 17 20:57:43.145595 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 852/1783] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:43.178882 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-76b22c12-27c9-4ceb-ad04-5eec67403baf tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Calling method '.version_select at 0x7f25a5045430>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:43.194109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-76b22c12-27c9-4ceb-ad04-5eec67403baf tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:43.194917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-76b22c12-27c9-4ceb-ad04-5eec67403baf tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:43.195571 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-76b22c12-27c9-4ceb-ad04-5eec67403baf tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:43.218163 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-76b22c12-27c9-4ceb-ad04-5eec67403baf tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 1552 microversion: 2.1 time: 0.069772 Sep 17 20:57:43.219574 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 853/1784] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Sep 17 20:57:43 2022] GET /compute/v2.1/os-migrations => generated 1552 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:43.225802 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-994f5910-5acc-4eb9-8fbd-1900841464ef tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:43.226761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-994f5910-5acc-4eb9-8fbd-1900841464ef tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 8f0929b7-f8de-4896-a0de-a2388fef54f3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:43.235065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-994f5910-5acc-4eb9-8fbd-1900841464ef tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:43.235923 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-994f5910-5acc-4eb9-8fbd-1900841464ef tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:43.236556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-994f5910-5acc-4eb9-8fbd-1900841464ef tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:43.237482 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-994f5910-5acc-4eb9-8fbd-1900841464ef tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:43.238107 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-994f5910-5acc-4eb9-8fbd-1900841464ef tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:43.238712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-994f5910-5acc-4eb9-8fbd-1900841464ef tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:43.595304 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c4f4345b-83ad-40af-9ac9-ee2c32a33833 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:43.629434 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c4f4345b-83ad-40af-9ac9-ee2c32a33833 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6" status: 200 len: 1502 microversion: 2.1 time: 0.615657 Sep 17 20:57:43.633765 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 932/1785] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:43 2022] GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6 => generated 1502 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:43.654096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e3e9e456-68a9-4797-b497-80587cb01c90 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a9f75700>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:43.754136 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-994f5910-5acc-4eb9-8fbd-1900841464ef tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:43.765619 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-994f5910-5acc-4eb9-8fbd-1900841464ef tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3" status: 200 len: 1317 microversion: 2.1 time: 0.544432 Sep 17 20:57:43.766280 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 854/1786] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:43 2022] GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3 => generated 1317 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:43.770230 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e3e9e456-68a9-4797-b497-80587cb01c90 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25" status: 200 len: 1412 microversion: 2.1 time: 0.133374 Sep 17 20:57:43.771035 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 933/1787] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:57:43 2022] GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25 => generated 1412 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:43.778056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a0cf7fb9-c97a-44c9-b831-a6a42fbe4392 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:43.778824 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a0cf7fb9-c97a-44c9-b831-a6a42fbe4392 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 39ba6ff9-97dd-4923-90d0-58479fb25bb6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:43.784142 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d5e9c58a-a5df-41e9-aaf9-5f5603fae1cc tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:43.784799 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d5e9c58a-a5df-41e9-aaf9-5f5603fae1cc tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:43.789179 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0cf7fb9-c97a-44c9-b831-a6a42fbe4392 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:43.791101 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0cf7fb9-c97a-44c9-b831-a6a42fbe4392 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:43.792651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0cf7fb9-c97a-44c9-b831-a6a42fbe4392 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:43.793909 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0cf7fb9-c97a-44c9-b831-a6a42fbe4392 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:43.797044 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0cf7fb9-c97a-44c9-b831-a6a42fbe4392 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:43.797832 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0cf7fb9-c97a-44c9-b831-a6a42fbe4392 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:43.801389 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5e9c58a-a5df-41e9-aaf9-5f5603fae1cc tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:43.804643 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5e9c58a-a5df-41e9-aaf9-5f5603fae1cc tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:43.805127 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5e9c58a-a5df-41e9-aaf9-5f5603fae1cc tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:43.805932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5e9c58a-a5df-41e9-aaf9-5f5603fae1cc tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:43.806438 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5e9c58a-a5df-41e9-aaf9-5f5603fae1cc tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:43.806859 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5e9c58a-a5df-41e9-aaf9-5f5603fae1cc tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:43.850295 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a0cf7fb9-c97a-44c9-b831-a6a42fbe4392 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 39ba6ff9-97dd-4923-90d0-58479fb25bb6] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:57:44.084298 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a0cf7fb9-c97a-44c9-b831-a6a42fbe4392 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "DELETE /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6" status: 204 len: 0 microversion: 2.1 time: 0.311525 Sep 17 20:57:44.086709 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 934/1788] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:57:43 2022] DELETE /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:57:44.094513 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f850a7fe-269d-45f2-ac9d-8ee0efce9700 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:44.097157 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f850a7fe-269d-45f2-ac9d-8ee0efce9700 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: f3e67571-f038-485c-8685-af24123a5c10] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:44.111213 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f850a7fe-269d-45f2-ac9d-8ee0efce9700 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:44.111733 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f850a7fe-269d-45f2-ac9d-8ee0efce9700 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:44.112252 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f850a7fe-269d-45f2-ac9d-8ee0efce9700 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:44.134115 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f850a7fe-269d-45f2-ac9d-8ee0efce9700 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:44.135774 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f850a7fe-269d-45f2-ac9d-8ee0efce9700 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:44.136650 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f850a7fe-269d-45f2-ac9d-8ee0efce9700 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:44.807741 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d5e9c58a-a5df-41e9-aaf9-5f5603fae1cc tempest-LiveMigrationTest-703140491 tempest-LiveMigrationTest-703140491-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1533 microversion: 2.1 time: 1.027628 Sep 17 20:57:44.808332 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 855/1789] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:43 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1533 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:44.826452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d213e474-2b49-4807-854f-83cdfc9eb547 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:44.827081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d213e474-2b49-4807-854f-83cdfc9eb547 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 39ba6ff9-97dd-4923-90d0-58479fb25bb6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:44.842078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d213e474-2b49-4807-854f-83cdfc9eb547 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:44.842869 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d213e474-2b49-4807-854f-83cdfc9eb547 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:44.843472 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d213e474-2b49-4807-854f-83cdfc9eb547 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:44.844461 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d213e474-2b49-4807-854f-83cdfc9eb547 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:44.845080 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d213e474-2b49-4807-854f-83cdfc9eb547 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:44.845722 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d213e474-2b49-4807-854f-83cdfc9eb547 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:44.983461 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f850a7fe-269d-45f2-ac9d-8ee0efce9700 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:44.997624 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f850a7fe-269d-45f2-ac9d-8ee0efce9700 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10" status: 200 len: 1334 microversion: 2.1 time: 0.909341 Sep 17 20:57:45.000222 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 935/1790] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:44 2022] GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10 => generated 1334 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:45.005504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-21a9619b-609a-4a4f-88b5-793aa081bdbe tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a9f75d30>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:45.083635 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-21a9619b-609a-4a4f-88b5-793aa081bdbe tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25" status: 200 len: 1412 microversion: 2.1 time: 0.081736 Sep 17 20:57:45.093906 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 936/1791] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:57:45 2022] GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25 => generated 1412 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:45.104996 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-55b68a06-fb6d-4018-85f7-b4d6b54a18da tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:45.110762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-55b68a06-fb6d-4018-85f7-b4d6b54a18da tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 8f0929b7-f8de-4896-a0de-a2388fef54f3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:45.127659 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55b68a06-fb6d-4018-85f7-b4d6b54a18da tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:45.128339 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55b68a06-fb6d-4018-85f7-b4d6b54a18da tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:45.128913 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55b68a06-fb6d-4018-85f7-b4d6b54a18da tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:45.129829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55b68a06-fb6d-4018-85f7-b4d6b54a18da tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:45.130447 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55b68a06-fb6d-4018-85f7-b4d6b54a18da tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:45.131017 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55b68a06-fb6d-4018-85f7-b4d6b54a18da tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:45.243523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d213e474-2b49-4807-854f-83cdfc9eb547 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:45.253123 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d213e474-2b49-4807-854f-83cdfc9eb547 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6" status: 200 len: 1508 microversion: 2.1 time: 0.443737 Sep 17 20:57:45.255422 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 856/1792] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:44 2022] GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6 => generated 1508 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:45.263209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2d5a52e4-6f81-43a9-8636-9675f7b2ac6c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:45.275030 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2d5a52e4-6f81-43a9-8636-9675f7b2ac6c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:45.282407 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d5a52e4-6f81-43a9-8636-9675f7b2ac6c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:45.290885 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d5a52e4-6f81-43a9-8636-9675f7b2ac6c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:45.291636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d5a52e4-6f81-43a9-8636-9675f7b2ac6c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:45.292582 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d5a52e4-6f81-43a9-8636-9675f7b2ac6c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:45.293207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d5a52e4-6f81-43a9-8636-9675f7b2ac6c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:45.293837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d5a52e4-6f81-43a9-8636-9675f7b2ac6c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:45.356438 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2d5a52e4-6f81-43a9-8636-9675f7b2ac6c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:57:45.544994 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:45.625176 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2d5a52e4-6f81-43a9-8636-9675f7b2ac6c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 204 len: 0 microversion: 2.1 time: 0.364575 Sep 17 20:57:45.631439 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 857/1793] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:57:45 2022] DELETE /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:57:45.647966 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-791e2bfd-109f-4d2a-946d-c1d2d30f7cae req-eb4888f0-e1f3-4281-894e-1ad39ab91514 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3e67571-f038-485c-8685-af24123a5c10", "tag": "73929564-1075-468b-8252-81e6069bec7a"}, {"name": "network-changed", "server_uuid": "f3e67571-f038-485c-8685-af24123a5c10", "tag": "e4f76359-697f-489f-b5c5-59f550eaca0f"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:45.683820 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-791e2bfd-109f-4d2a-946d-c1d2d30f7cae req-eb4888f0-e1f3-4281-894e-1ad39ab91514 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:45.684754 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-791e2bfd-109f-4d2a-946d-c1d2d30f7cae req-eb4888f0-e1f3-4281-894e-1ad39ab91514 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:45.685364 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-791e2bfd-109f-4d2a-946d-c1d2d30f7cae req-eb4888f0-e1f3-4281-894e-1ad39ab91514 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:45.737508 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-791e2bfd-109f-4d2a-946d-c1d2d30f7cae req-eb4888f0-e1f3-4281-894e-1ad39ab91514 service nova] Creating event network-changed:73929564-1075-468b-8252-81e6069bec7a for instance f3e67571-f038-485c-8685-af24123a5c10 on nch1-master-1 Sep 17 20:57:45.739654 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-791e2bfd-109f-4d2a-946d-c1d2d30f7cae req-eb4888f0-e1f3-4281-894e-1ad39ab91514 service nova] Creating event network-changed:e4f76359-697f-489f-b5c5-59f550eaca0f for instance f3e67571-f038-485c-8685-af24123a5c10 on nch1-master-1 Sep 17 20:57:45.763335 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-791e2bfd-109f-4d2a-946d-c1d2d30f7cae req-eb4888f0-e1f3-4281-894e-1ad39ab91514 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.123412 Sep 17 20:57:45.764764 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 858/1794] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:45.775931 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-acb8c9a9-6ba6-4970-b935-1e76b0c9b449 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:45.777503 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-acb8c9a9-6ba6-4970-b935-1e76b0c9b449 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:45.802736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-acb8c9a9-6ba6-4970-b935-1e76b0c9b449 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:45.804559 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-acb8c9a9-6ba6-4970-b935-1e76b0c9b449 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:45.812773 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-acb8c9a9-6ba6-4970-b935-1e76b0c9b449 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:45.814531 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-acb8c9a9-6ba6-4970-b935-1e76b0c9b449 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:45.816298 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-acb8c9a9-6ba6-4970-b935-1e76b0c9b449 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:45.818022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-acb8c9a9-6ba6-4970-b935-1e76b0c9b449 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:46.107340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-55b68a06-fb6d-4018-85f7-b4d6b54a18da tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:46.120708 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-55b68a06-fb6d-4018-85f7-b4d6b54a18da tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3" status: 200 len: 1317 microversion: 2.1 time: 1.021265 Sep 17 20:57:46.123374 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 937/1795] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:45 2022] GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3 => generated 1317 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:46.132013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ec66666f-28f7-42d0-a951-33ab194002ce tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:46.133372 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ec66666f-28f7-42d0-a951-33ab194002ce tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: f3e67571-f038-485c-8685-af24123a5c10] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:46.166029 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ec66666f-28f7-42d0-a951-33ab194002ce tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:46.167535 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ec66666f-28f7-42d0-a951-33ab194002ce tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:46.168211 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ec66666f-28f7-42d0-a951-33ab194002ce tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:46.171711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ec66666f-28f7-42d0-a951-33ab194002ce tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:46.173709 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ec66666f-28f7-42d0-a951-33ab194002ce tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:46.175029 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ec66666f-28f7-42d0-a951-33ab194002ce tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:46.691362 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-acb8c9a9-6ba6-4970-b935-1e76b0c9b449 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:46.702868 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-acb8c9a9-6ba6-4970-b935-1e76b0c9b449 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1388 microversion: 2.1 time: 0.935660 Sep 17 20:57:46.713854 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 859/1796] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:45 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1388 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:46.719391 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c0624bf8-7984-42dd-a822-5ca2ac38e343 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4f71a60>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:46.816005 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c0624bf8-7984-42dd-a822-5ca2ac38e343 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25" status: 200 len: 1412 microversion: 2.1 time: 0.100568 Sep 17 20:57:46.819202 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 860/1797] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:57:46 2022] GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25 => generated 1412 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:46.826510 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e0ebc4d8-0b78-4e0b-b5ff-eee2c8f6c7a6 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:46.833827 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e0ebc4d8-0b78-4e0b-b5ff-eee2c8f6c7a6 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 39ba6ff9-97dd-4923-90d0-58479fb25bb6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:46.848880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0ebc4d8-0b78-4e0b-b5ff-eee2c8f6c7a6 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:46.850296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0ebc4d8-0b78-4e0b-b5ff-eee2c8f6c7a6 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:46.851517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0ebc4d8-0b78-4e0b-b5ff-eee2c8f6c7a6 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:46.854570 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0ebc4d8-0b78-4e0b-b5ff-eee2c8f6c7a6 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:46.855250 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0ebc4d8-0b78-4e0b-b5ff-eee2c8f6c7a6 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:46.855888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0ebc4d8-0b78-4e0b-b5ff-eee2c8f6c7a6 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:46.936425 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ec66666f-28f7-42d0-a951-33ab194002ce tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:46.949364 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ec66666f-28f7-42d0-a951-33ab194002ce tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10" status: 200 len: 1334 microversion: 2.1 time: 0.824565 Sep 17 20:57:46.950650 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 938/1798] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:46 2022] GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10 => generated 1334 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:47.240057 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-134f85af-bf4a-4eb4-a295-f4376211c19e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:47.240934 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-134f85af-bf4a-4eb4-a295-f4376211c19e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 8f0929b7-f8de-4896-a0de-a2388fef54f3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:47.274737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-134f85af-bf4a-4eb4-a295-f4376211c19e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:47.278509 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-134f85af-bf4a-4eb4-a295-f4376211c19e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:47.278881 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-134f85af-bf4a-4eb4-a295-f4376211c19e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:47.283661 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-134f85af-bf4a-4eb4-a295-f4376211c19e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:47.284151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-134f85af-bf4a-4eb4-a295-f4376211c19e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:47.284597 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-134f85af-bf4a-4eb4-a295-f4376211c19e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:48.316459 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-134f85af-bf4a-4eb4-a295-f4376211c19e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:48.320027 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:48.335696 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-134f85af-bf4a-4eb4-a295-f4376211c19e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3" status: 200 len: 1317 microversion: 2.1 time: 1.101443 Sep 17 20:57:48.337717 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 939/1799] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:47 2022] GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3 => generated 1317 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:57:48.366574 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4e60f065-1911-4fe8-b198-7940f6f48f1c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:48.367749 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4e60f065-1911-4fe8-b198-7940f6f48f1c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:48.384976 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e60f065-1911-4fe8-b198-7940f6f48f1c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:48.385494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e60f065-1911-4fe8-b198-7940f6f48f1c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:48.387176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e60f065-1911-4fe8-b198-7940f6f48f1c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:48.388112 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e60f065-1911-4fe8-b198-7940f6f48f1c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:48.395332 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e60f065-1911-4fe8-b198-7940f6f48f1c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:48.396813 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e60f065-1911-4fe8-b198-7940f6f48f1c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:48.484532 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e0ebc4d8-0b78-4e0b-b5ff-eee2c8f6c7a6 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:48.496080 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e0ebc4d8-0b78-4e0b-b5ff-eee2c8f6c7a6 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6" status: 200 len: 1508 microversion: 2.1 time: 1.673284 Sep 17 20:57:48.502536 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 861/1800] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:46 2022] GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6 => generated 1508 bytes in 1682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:48.519538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-caf6e05e-daeb-4429-b710-df889bb54189 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4f9bdc0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:48.648830 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-caf6e05e-daeb-4429-b710-df889bb54189 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25" status: 200 len: 1412 microversion: 2.1 time: 0.144917 Sep 17 20:57:48.653627 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 862/1801] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:57:48 2022] GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25 => generated 1412 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:48.658730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-162120f9-4477-4372-a86a-339632c88b7f req-8ff874e0-497b-44b9-9877-bff1c01e276f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f0929b7-f8de-4896-a0de-a2388fef54f3", "name": "network-vif-plugged", "status": "completed", "tag": "875360ee-4e0d-4125-98cf-746e7cb35373"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:48.684950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-162120f9-4477-4372-a86a-339632c88b7f req-8ff874e0-497b-44b9-9877-bff1c01e276f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:48.686555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-162120f9-4477-4372-a86a-339632c88b7f req-8ff874e0-497b-44b9-9877-bff1c01e276f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:48.688000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-162120f9-4477-4372-a86a-339632c88b7f req-8ff874e0-497b-44b9-9877-bff1c01e276f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:48.709807 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-162120f9-4477-4372-a86a-339632c88b7f req-8ff874e0-497b-44b9-9877-bff1c01e276f service nova] Creating event network-vif-plugged:875360ee-4e0d-4125-98cf-746e7cb35373 for instance 8f0929b7-f8de-4896-a0de-a2388fef54f3 on nch1-master-1 Sep 17 20:57:48.717276 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-162120f9-4477-4372-a86a-339632c88b7f req-8ff874e0-497b-44b9-9877-bff1c01e276f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061844 Sep 17 20:57:48.727511 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4e60f065-1911-4fe8-b198-7940f6f48f1c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:48.743548 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 863/1802] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:48.743845 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4e60f065-1911-4fe8-b198-7940f6f48f1c tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 200 len: 1184 microversion: 2.1 time: 0.403699 Sep 17 20:57:48.753672 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-aeb8ea90-4257-4536-a301-7697dc858f94 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:48.754641 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-aeb8ea90-4257-4536-a301-7697dc858f94 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: f3e67571-f038-485c-8685-af24123a5c10] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:48.769380 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 940/1803] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:48 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 1184 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:48.770620 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aeb8ea90-4257-4536-a301-7697dc858f94 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:48.772739 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aeb8ea90-4257-4536-a301-7697dc858f94 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:48.773865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aeb8ea90-4257-4536-a301-7697dc858f94 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:48.776475 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aeb8ea90-4257-4536-a301-7697dc858f94 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:48.777629 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aeb8ea90-4257-4536-a301-7697dc858f94 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:48.778036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-69b3614f-55e9-4aac-8d83-a9c0c706c653 req-f379e1af-1662-4176-96b5-55b1cb234792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ca7424d-e666-4a33-9cc7-c56de359e512", "name": "network-vif-deleted", "tag": "7e2345f8-01ba-4dab-8432-e34b1aefa6e8"}, {"server_uuid": "39ba6ff9-97dd-4923-90d0-58479fb25bb6", "name": "network-vif-deleted", "tag": "30cee5cc-4c55-4908-aa51-7fc681a008dc"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:48.794870 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aeb8ea90-4257-4536-a301-7697dc858f94 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:48.800941 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-69b3614f-55e9-4aac-8d83-a9c0c706c653 req-f379e1af-1662-4176-96b5-55b1cb234792 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:48.801801 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-69b3614f-55e9-4aac-8d83-a9c0c706c653 req-f379e1af-1662-4176-96b5-55b1cb234792 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:48.805715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-69b3614f-55e9-4aac-8d83-a9c0c706c653 req-f379e1af-1662-4176-96b5-55b1cb234792 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:48.823295 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-69b3614f-55e9-4aac-8d83-a9c0c706c653 req-f379e1af-1662-4176-96b5-55b1cb234792 service nova] Creating event network-vif-deleted:7e2345f8-01ba-4dab-8432-e34b1aefa6e8 for instance 4ca7424d-e666-4a33-9cc7-c56de359e512 on nch2-master-1 Sep 17 20:57:48.824105 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-69b3614f-55e9-4aac-8d83-a9c0c706c653 req-f379e1af-1662-4176-96b5-55b1cb234792 service nova] Creating event network-vif-deleted:30cee5cc-4c55-4908-aa51-7fc681a008dc for instance 39ba6ff9-97dd-4923-90d0-58479fb25bb6 on nch2-master-1 Sep 17 20:57:48.836000 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-69b3614f-55e9-4aac-8d83-a9c0c706c653 req-f379e1af-1662-4176-96b5-55b1cb234792 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.064977 Sep 17 20:57:48.837299 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 941/1804] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:49.385034 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6f5f9cae-9ba8-4684-8ea8-3a5c1ba8e72c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:49.385780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6f5f9cae-9ba8-4684-8ea8-3a5c1ba8e72c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 8f0929b7-f8de-4896-a0de-a2388fef54f3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:49.432249 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f5f9cae-9ba8-4684-8ea8-3a5c1ba8e72c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:49.434193 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f5f9cae-9ba8-4684-8ea8-3a5c1ba8e72c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:49.434657 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f5f9cae-9ba8-4684-8ea8-3a5c1ba8e72c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:49.441075 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f5f9cae-9ba8-4684-8ea8-3a5c1ba8e72c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:49.446328 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f5f9cae-9ba8-4684-8ea8-3a5c1ba8e72c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:49.447337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f5f9cae-9ba8-4684-8ea8-3a5c1ba8e72c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:50.099526 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-aeb8ea90-4257-4536-a301-7697dc858f94 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:50.127899 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-aeb8ea90-4257-4536-a301-7697dc858f94 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10" status: 200 len: 1334 microversion: 2.1 time: 1.377886 Sep 17 20:57:50.134770 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 864/1805] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:48 2022] GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10 => generated 1334 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:50.144084 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f27cc58d-ce24-4498-a07a-5005c71edfce tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:50.144716 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f27cc58d-ce24-4498-a07a-5005c71edfce tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 39ba6ff9-97dd-4923-90d0-58479fb25bb6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:50.183752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f27cc58d-ce24-4498-a07a-5005c71edfce tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:50.186136 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f27cc58d-ce24-4498-a07a-5005c71edfce tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:50.188941 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f27cc58d-ce24-4498-a07a-5005c71edfce tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:50.194204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f27cc58d-ce24-4498-a07a-5005c71edfce tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:50.195277 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f27cc58d-ce24-4498-a07a-5005c71edfce tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:50.195938 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f27cc58d-ce24-4498-a07a-5005c71edfce tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:50.238049 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-f27cc58d-ce24-4498-a07a-5005c71edfce tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] HTTP exception thrown: Instance 39ba6ff9-97dd-4923-90d0-58479fb25bb6 could not be found. Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f27cc58d-ce24-4498-a07a-5005c71edfce tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Request method failure captured: Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6 HTTP/1.1 Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjSr4eYJ5iRC0BESTxyEYBHr6fTKXAfzmSKRijJd1-Dg4_6zeDPSLMVKcn7Va4xyX_oACpKQBdCcihzycrxxeD9gtcf6rUAIbBHhHnQZK1W2woTj604P1AONqCzsshMWFY41NR-lshpdEXKwYePjmUqN1wZWN-nWEva1tUOKD4iFshs Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89b46ae7347d4f2daf02f627e41a4847", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-DeleteServersTestJSON-583053734 Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-DeleteServersTestJSON-583053734-project Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 3009c5feb1ef43a08b07996d8f63bf11 Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-DeleteServersTestJSON-583053734-project Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 39ba6ff9-97dd-4923-90d0-58479fb25bb6 could not be found. Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '39ba6ff9-97dd-4923-90d0-58479fb25bb6'} Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39ba6ff9-97dd-4923-90d0-58479fb25bb6 could not be found. Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39ba6ff9-97dd-4923-90d0-58479fb25bb6 could not be found. Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:50.239796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:57:50.245785 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:50.245785 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:50.245785 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:50.245785 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:57:50.245785 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:57:50.245785 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39ba6ff9-97dd-4923-90d0-58479fb25bb6 could not be found. Sep 17 20:57:50.245785 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:57:50.245785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f27cc58d-ce24-4498-a07a-5005c71edfce tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Returning 404 to user: Instance 39ba6ff9-97dd-4923-90d0-58479fb25bb6 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:57:50.245785 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f27cc58d-ce24-4498-a07a-5005c71edfce tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6" status: 404 len: 111 microversion: 2.1 time: 0.105186 Sep 17 20:57:50.251890 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 865/1806] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:50 2022] GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:57:50.275798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6f5f9cae-9ba8-4684-8ea8-3a5c1ba8e72c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:50.281121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-42fbcb5c-2f4f-4c16-b17b-d73b6caf4498 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a50000d0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:50.314718 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6f5f9cae-9ba8-4684-8ea8-3a5c1ba8e72c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3" status: 200 len: 1317 microversion: 2.1 time: 0.953643 Sep 17 20:57:50.318325 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 942/1807] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:49 2022] GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3 => generated 1317 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:50.347752 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ecdd7513-e048-4501-b2c7-f95a37658d4b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:50.354178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ecdd7513-e048-4501-b2c7-f95a37658d4b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4ca7424d-e666-4a33-9cc7-c56de359e512] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:50.389428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ecdd7513-e048-4501-b2c7-f95a37658d4b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:50.392351 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ecdd7513-e048-4501-b2c7-f95a37658d4b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:50.394284 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ecdd7513-e048-4501-b2c7-f95a37658d4b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:50.397058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ecdd7513-e048-4501-b2c7-f95a37658d4b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:50.399354 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ecdd7513-e048-4501-b2c7-f95a37658d4b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:50.400186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ecdd7513-e048-4501-b2c7-f95a37658d4b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:50.414689 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-42fbcb5c-2f4f-4c16-b17b-d73b6caf4498 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25" status: 200 len: 1412 microversion: 2.1 time: 0.137314 Sep 17 20:57:50.423603 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 866/1808] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:57:50 2022] GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25 => generated 1412 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:50.458703 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-ecdd7513-e048-4501-b2c7-f95a37658d4b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] HTTP exception thrown: Instance 4ca7424d-e666-4a33-9cc7-c56de359e512 could not be found. Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ecdd7513-e048-4501-b2c7-f95a37658d4b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Request method failure captured: Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 HTTP/1.1 Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjO4pMSDFI6Atu5kbd_vlRhbyV_fyPw2gdOrFx1mEyl4rL_CZavLzFaFFTIrDXVeI9bf87zTa9lzT1hke8Y8KagCjBPhEyXkmiJUAOGfheh5EfefZfrn_wGqKtQ01RGpNIahNrBgvi-tWdhaJbgej8MzwbEe3UEoa8f3i5egIziHROo Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: f6b44bc44e7c4a998bfd99e7d11e99fc Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-LiveMigrationTest-128259988 Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f6b44bc44e7c4a998bfd99e7d11e99fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f6b44bc44e7c4a998bfd99e7d11e99fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f6b44bc44e7c4a998bfd99e7d11e99fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f6b44bc44e7c4a998bfd99e7d11e99fc", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-LiveMigrationTest-128259988 Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: f6b44bc44e7c4a998bfd99e7d11e99fc Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-LiveMigrationTest-128259988 Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-LiveMigrationTest-128259988-project Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 9c2b746b7c194596808a7b0c736f3b53 Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-LiveMigrationTest-128259988-project Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 4ca7424d-e666-4a33-9cc7-c56de359e512 could not be found. Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '4ca7424d-e666-4a33-9cc7-c56de359e512'} Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ca7424d-e666-4a33-9cc7-c56de359e512 could not be found. Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ca7424d-e666-4a33-9cc7-c56de359e512 could not be found. Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:57:50.465885 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:50.471971 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:57:50.471971 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:57:50.471971 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:57:50.471971 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:57:50.471971 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:57:50.471971 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ca7424d-e666-4a33-9cc7-c56de359e512 could not be found. Sep 17 20:57:50.471971 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:57:50.474786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ecdd7513-e048-4501-b2c7-f95a37658d4b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Returning 404 to user: Instance 4ca7424d-e666-4a33-9cc7-c56de359e512 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:57:50.475935 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ecdd7513-e048-4501-b2c7-f95a37658d4b tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512" status: 404 len: 111 microversion: 2.1 time: 0.152605 Sep 17 20:57:50.483645 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 943/1809] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:50 2022] GET /compute/v2.1/servers/4ca7424d-e666-4a33-9cc7-c56de359e512 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:57:50.612552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d3d9e263-9b72-4ee9-b171-a8a8954e7bb8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-159194513", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "25526ef3-eaa2-4f18-ac44-bfbbfae855ea"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:50.760962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-d3d9e263-9b72-4ee9-b171-a8a8954e7bb8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] validate_networks() for [('25526ef3-eaa2-4f18-ac44-bfbbfae855ea', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:57:51.154915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0aafea23-5e19-4777-a102-8ca81775161c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:51.155697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0aafea23-5e19-4777-a102-8ca81775161c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: f3e67571-f038-485c-8685-af24123a5c10] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:51.167886 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0aafea23-5e19-4777-a102-8ca81775161c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:51.170494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0aafea23-5e19-4777-a102-8ca81775161c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:51.171435 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0aafea23-5e19-4777-a102-8ca81775161c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:51.174097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0aafea23-5e19-4777-a102-8ca81775161c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:51.175808 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0aafea23-5e19-4777-a102-8ca81775161c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:51.177748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0aafea23-5e19-4777-a102-8ca81775161c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:51.994680 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0aafea23-5e19-4777-a102-8ca81775161c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:52.014596 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0aafea23-5e19-4777-a102-8ca81775161c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10" status: 200 len: 1334 microversion: 2.1 time: 0.862742 Sep 17 20:57:52.018906 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 944/1810] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:51 2022] GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10 => generated 1334 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:57:52.032720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7ee54805-1986-4905-a88a-89db44e6e116 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:52.034677 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7ee54805-1986-4905-a88a-89db44e6e116 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 8f0929b7-f8de-4896-a0de-a2388fef54f3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:52.057158 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7ee54805-1986-4905-a88a-89db44e6e116 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:52.057693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7ee54805-1986-4905-a88a-89db44e6e116 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:52.059639 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7ee54805-1986-4905-a88a-89db44e6e116 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:52.061536 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7ee54805-1986-4905-a88a-89db44e6e116 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:52.062990 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7ee54805-1986-4905-a88a-89db44e6e116 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:52.065003 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7ee54805-1986-4905-a88a-89db44e6e116 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:52.453246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-d3d9e263-9b72-4ee9-b171-a8a8954e7bb8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:57:52.455076 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-d3d9e263-9b72-4ee9-b171-a8a8954e7bb8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:57:52.461081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-d3d9e263-9b72-4ee9-b171-a8a8954e7bb8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:57:52.466401 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-d3d9e263-9b72-4ee9-b171-a8a8954e7bb8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:57:52.476282 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-d3d9e263-9b72-4ee9-b171-a8a8954e7bb8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:57:52.562631 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d3d9e263-9b72-4ee9-b171-a8a8954e7bb8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:52.564974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d3d9e263-9b72-4ee9-b171-a8a8954e7bb8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:52.565308 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d3d9e263-9b72-4ee9-b171-a8a8954e7bb8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:52.567674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d3d9e263-9b72-4ee9-b171-a8a8954e7bb8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:52.571456 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d3d9e263-9b72-4ee9-b171-a8a8954e7bb8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:52.571907 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d3d9e263-9b72-4ee9-b171-a8a8954e7bb8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:52.697380 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7ee54805-1986-4905-a88a-89db44e6e116 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:52.710155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-d3d9e263-9b72-4ee9-b171-a8a8954e7bb8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Getting quotas for project 89b46ae7347d4f2daf02f627e41a4847. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:57:52.715347 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7ee54805-1986-4905-a88a-89db44e6e116 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3" status: 200 len: 1466 microversion: 2.1 time: 0.694878 Sep 17 20:57:52.715956 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 945/1811] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:52 2022] GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3 => generated 1466 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:52.741876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-d3d9e263-9b72-4ee9-b171-a8a8954e7bb8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Getting quotas for user 3009c5feb1ef43a08b07996d8f63bf11 and project 89b46ae7347d4f2daf02f627e41a4847. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:57:52.764105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0799470b-288a-4712-afb8-7cd47d57128d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4d18ca0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:52.779095 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d3d9e263-9b72-4ee9-b171-a8a8954e7bb8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:57:52.784924 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d3d9e263-9b72-4ee9-b171-a8a8954e7bb8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: c9fe0176-1bcf-4719-a87f-17b0e0c41b6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:57:52.865708 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0799470b-288a-4712-afb8-7cd47d57128d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25" status: 200 len: 1412 microversion: 2.1 time: 0.116943 Sep 17 20:57:52.866506 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 946/1812] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:57:52 2022] GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25 => generated 1412 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:52.938381 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d3d9e263-9b72-4ee9-b171-a8a8954e7bb8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.328313 Sep 17 20:57:52.942452 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 867/1813] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:57:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2336 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:57:52.961655 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1d41d3f9-362b-49b1-8810-a5faf20a6cdc tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:52.963710 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1d41d3f9-362b-49b1-8810-a5faf20a6cdc tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: c9fe0176-1bcf-4719-a87f-17b0e0c41b6c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:53.387164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4a5649a9-d9ed-4725-a8c6-818995a72f9b tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:53.389032 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4a5649a9-d9ed-4725-a8c6-818995a72f9b tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] [instance: 8f0929b7-f8de-4896-a0de-a2388fef54f3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:53.411489 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a5649a9-d9ed-4725-a8c6-818995a72f9b tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:53.412387 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a5649a9-d9ed-4725-a8c6-818995a72f9b tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:53.414331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a5649a9-d9ed-4725-a8c6-818995a72f9b tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:53.418131 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a5649a9-d9ed-4725-a8c6-818995a72f9b tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:53.419645 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a5649a9-d9ed-4725-a8c6-818995a72f9b tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:53.420097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a5649a9-d9ed-4725-a8c6-818995a72f9b tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:53.492258 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1d41d3f9-362b-49b1-8810-a5faf20a6cdc tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:53.524627 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1d41d3f9-362b-49b1-8810-a5faf20a6cdc tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c" status: 200 len: 1214 microversion: 2.1 time: 0.572287 Sep 17 20:57:53.527985 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 868/1814] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:52 2022] GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c => generated 1214 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:57:53.544066 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c107150b-7f5a-474b-9ec9-946d652d6640 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:53.545370 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c107150b-7f5a-474b-9ec9-946d652d6640 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: f3e67571-f038-485c-8685-af24123a5c10] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:53.564900 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c107150b-7f5a-474b-9ec9-946d652d6640 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:53.567229 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c107150b-7f5a-474b-9ec9-946d652d6640 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:53.567913 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c107150b-7f5a-474b-9ec9-946d652d6640 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:53.568947 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c107150b-7f5a-474b-9ec9-946d652d6640 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:53.569725 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c107150b-7f5a-474b-9ec9-946d652d6640 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:53.570463 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c107150b-7f5a-474b-9ec9-946d652d6640 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:54.181990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c107150b-7f5a-474b-9ec9-946d652d6640 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:54.199467 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c107150b-7f5a-474b-9ec9-946d652d6640 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10" status: 200 len: 1334 microversion: 2.1 time: 0.669018 Sep 17 20:57:54.205648 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 869/1815] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:53 2022] GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10 => generated 1334 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:54.212101 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7d7b1d7e-8e3d-44f6-ac45-1efa739776fe tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4f7e820>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:54.307345 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7d7b1d7e-8e3d-44f6-ac45-1efa739776fe tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25" status: 200 len: 1412 microversion: 2.1 time: 0.100182 Sep 17 20:57:54.319654 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 870/1816] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:57:54 2022] GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25 => generated 1412 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:54.335046 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-c657a86b-2949-46fb-b0c0-5f1ea8f200c3 req-d674c263-2ed1-4500-92cd-cee9efbc373e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3e67571-f038-485c-8685-af24123a5c10", "name": "network-vif-plugged", "status": "completed", "tag": "73929564-1075-468b-8252-81e6069bec7a"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:54.365756 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-c657a86b-2949-46fb-b0c0-5f1ea8f200c3 req-d674c263-2ed1-4500-92cd-cee9efbc373e service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:54.376047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-c657a86b-2949-46fb-b0c0-5f1ea8f200c3 req-d674c263-2ed1-4500-92cd-cee9efbc373e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:54.379643 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-c657a86b-2949-46fb-b0c0-5f1ea8f200c3 req-d674c263-2ed1-4500-92cd-cee9efbc373e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:54.406893 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-c657a86b-2949-46fb-b0c0-5f1ea8f200c3 req-d674c263-2ed1-4500-92cd-cee9efbc373e service nova] Creating event network-vif-plugged:73929564-1075-468b-8252-81e6069bec7a for instance f3e67571-f038-485c-8685-af24123a5c10 on nch1-master-1 Sep 17 20:57:54.451359 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-c657a86b-2949-46fb-b0c0-5f1ea8f200c3 req-d674c263-2ed1-4500-92cd-cee9efbc373e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129816 Sep 17 20:57:54.452951 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 871/1817] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:54.461508 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-918e8d1d-4faf-4344-80ce-da72c4c9cb32 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:54.463314 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-918e8d1d-4faf-4344-80ce-da72c4c9cb32 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:54.471550 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-918e8d1d-4faf-4344-80ce-da72c4c9cb32 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:54.472385 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-918e8d1d-4faf-4344-80ce-da72c4c9cb32 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:54.473032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-918e8d1d-4faf-4344-80ce-da72c4c9cb32 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:54.474080 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-918e8d1d-4faf-4344-80ce-da72c4c9cb32 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:54.475125 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-918e8d1d-4faf-4344-80ce-da72c4c9cb32 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:54.475871 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-918e8d1d-4faf-4344-80ce-da72c4c9cb32 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:54.516648 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-918e8d1d-4faf-4344-80ce-da72c4c9cb32 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:57:54.800887 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-918e8d1d-4faf-4344-80ce-da72c4c9cb32 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "DELETE /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 204 len: 0 microversion: 2.1 time: 0.346177 Sep 17 20:57:54.802841 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 872/1818] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:57:54 2022] DELETE /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:57:54.818764 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9cb05133-9020-446f-8e74-96e53199c1ad tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:54.828953 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9cb05133-9020-446f-8e74-96e53199c1ad tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: c9fe0176-1bcf-4719-a87f-17b0e0c41b6c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:54.845872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9cb05133-9020-446f-8e74-96e53199c1ad tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:54.846540 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9cb05133-9020-446f-8e74-96e53199c1ad tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:54.847294 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9cb05133-9020-446f-8e74-96e53199c1ad tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:54.850878 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9cb05133-9020-446f-8e74-96e53199c1ad tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:54.851759 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9cb05133-9020-446f-8e74-96e53199c1ad tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:54.852768 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9cb05133-9020-446f-8e74-96e53199c1ad tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:55.023998 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9cb05133-9020-446f-8e74-96e53199c1ad tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:55.042852 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9cb05133-9020-446f-8e74-96e53199c1ad tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c" status: 200 len: 1266 microversion: 2.1 time: 0.238499 Sep 17 20:57:55.052748 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 873/1819] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:54 2022] GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:55.062971 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c3ad25a6-5385-41dd-a509-4f2b005dbe13 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:55.069419 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c3ad25a6-5385-41dd-a509-4f2b005dbe13 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:55.086541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3ad25a6-5385-41dd-a509-4f2b005dbe13 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:55.088430 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3ad25a6-5385-41dd-a509-4f2b005dbe13 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:55.089196 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3ad25a6-5385-41dd-a509-4f2b005dbe13 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:55.101381 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3ad25a6-5385-41dd-a509-4f2b005dbe13 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:55.102144 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3ad25a6-5385-41dd-a509-4f2b005dbe13 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:55.102844 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3ad25a6-5385-41dd-a509-4f2b005dbe13 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:55.104128 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4a5649a9-d9ed-4725-a8c6-818995a72f9b tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3" status: 200 len: 1617 microversion: 2.1 time: 2.233822 Sep 17 20:57:55.105374 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 947/1820] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:52 2022] GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3 => generated 1617 bytes in 2239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:55.155082 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5bcf6dbc-7aaf-403e-871f-aceffc0a5fa5 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Action: 'create', calling method: .version_select at 0x7f25a9ef8310>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-556104990", "policies": ["affinity"]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:55.191287 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-5bcf6dbc-7aaf-403e-871f-aceffc0a5fa5 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for project 3515123097e744ef855ef1129fb59cf1. Resources: {'server_groups'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:57:55.208197 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-5bcf6dbc-7aaf-403e-871f-aceffc0a5fa5 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for user 0d48260054d84784b89a52d9b766d7c1 and project 3515123097e744ef855ef1129fb59cf1. Resources: {'server_groups'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:57:55.384080 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-5bcf6dbc-7aaf-403e-871f-aceffc0a5fa5 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for project 3515123097e744ef855ef1129fb59cf1. Resources: {'server_groups'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:57:55.394570 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-5bcf6dbc-7aaf-403e-871f-aceffc0a5fa5 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for user 0d48260054d84784b89a52d9b766d7c1 and project 3515123097e744ef855ef1129fb59cf1. Resources: {'server_groups'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:57:55.419487 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5bcf6dbc-7aaf-403e-871f-aceffc0a5fa5 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.272470 Sep 17 20:57:55.444512 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 948/1821] 10.222.0.26 () {60 vars in 1174 bytes} [Sat Sep 17 20:57:55 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:55.452387 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-edc37bbb-b8d4-431c-b441-386159af51df tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:55.453411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-edc37bbb-b8d4-431c-b441-386159af51df tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: f3e67571-f038-485c-8685-af24123a5c10] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:55.465870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-edc37bbb-b8d4-431c-b441-386159af51df tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:55.466799 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-edc37bbb-b8d4-431c-b441-386159af51df tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:55.467710 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-edc37bbb-b8d4-431c-b441-386159af51df tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:55.469176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-edc37bbb-b8d4-431c-b441-386159af51df tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:55.470341 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-edc37bbb-b8d4-431c-b441-386159af51df tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:55.472499 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-edc37bbb-b8d4-431c-b441-386159af51df tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:55.867954 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c3ad25a6-5385-41dd-a509-4f2b005dbe13 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:55.901339 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c3ad25a6-5385-41dd-a509-4f2b005dbe13 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1669 microversion: 2.1 time: 0.846135 Sep 17 20:57:55.902079 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 874/1822] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:55 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1669 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:55.907533 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-34709734-3c9a-4c24-832b-9d3ac4431d1c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a50008b0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:55.972343 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-34709734-3c9a-4c24-832b-9d3ac4431d1c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25" status: 200 len: 1421 microversion: 2.1 time: 0.068811 Sep 17 20:57:55.973112 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 875/1823] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:57:55 2022] GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25 => generated 1421 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:55.977939 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-78d7d1aa-a517-4a7b-b5a1-ef706fec3b1e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-454701974", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "51946a10-f884-4d05-8e1f-9dbf3dee88ef"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:55.986368 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:56.069500 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-78d7d1aa-a517-4a7b-b5a1-ef706fec3b1e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] validate_networks() for None {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:57:56.084977 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-edc37bbb-b8d4-431c-b441-386159af51df tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:56.098263 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-edc37bbb-b8d4-431c-b441-386159af51df tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10" status: 200 len: 1334 microversion: 2.1 time: 0.657221 Sep 17 20:57:56.099312 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 949/1824] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:55 2022] GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10 => generated 1334 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:56.106682 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-69b6ea80-e6db-4c5f-a29e-a0b7d43d484d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4d65ee0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:56.199690 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-69b6ea80-e6db-4c5f-a29e-a0b7d43d484d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25" status: 200 len: 1421 microversion: 2.1 time: 0.098883 Sep 17 20:57:56.214284 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 950/1825] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:57:56 2022] GET /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25 => generated 1421 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:56.226118 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-44a2d1ce-d5da-43b9-bcc3-491fe9346693 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:56.227019 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-44a2d1ce-d5da-43b9-bcc3-491fe9346693 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: c9fe0176-1bcf-4719-a87f-17b0e0c41b6c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:56.236311 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-44a2d1ce-d5da-43b9-bcc3-491fe9346693 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:56.237107 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-44a2d1ce-d5da-43b9-bcc3-491fe9346693 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:56.237736 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-44a2d1ce-d5da-43b9-bcc3-491fe9346693 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:56.238621 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-44a2d1ce-d5da-43b9-bcc3-491fe9346693 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:56.239245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-44a2d1ce-d5da-43b9-bcc3-491fe9346693 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:56.239841 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-44a2d1ce-d5da-43b9-bcc3-491fe9346693 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:56.328923 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-44a2d1ce-d5da-43b9-bcc3-491fe9346693 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:56.338225 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-44a2d1ce-d5da-43b9-bcc3-491fe9346693 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c" status: 200 len: 1272 microversion: 2.1 time: 0.121160 Sep 17 20:57:56.340824 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 951/1826] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:56 2022] GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c => generated 1272 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:56.347464 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cdeb2e8b-b042-4393-a185-3f19f97a47c6 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4d50700>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:56.606785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-78d7d1aa-a517-4a7b-b5a1-ef706fec3b1e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:57:56.606785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-78d7d1aa-a517-4a7b-b5a1-ef706fec3b1e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:57:56.607062 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-78d7d1aa-a517-4a7b-b5a1-ef706fec3b1e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:57:56.607689 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-78d7d1aa-a517-4a7b-b5a1-ef706fec3b1e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:57:56.608280 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-78d7d1aa-a517-4a7b-b5a1-ef706fec3b1e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:57:56.651261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-78d7d1aa-a517-4a7b-b5a1-ef706fec3b1e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:56.651764 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-78d7d1aa-a517-4a7b-b5a1-ef706fec3b1e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:56.652317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-78d7d1aa-a517-4a7b-b5a1-ef706fec3b1e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:56.653071 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-78d7d1aa-a517-4a7b-b5a1-ef706fec3b1e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:56.653647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-78d7d1aa-a517-4a7b-b5a1-ef706fec3b1e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:56.654083 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-78d7d1aa-a517-4a7b-b5a1-ef706fec3b1e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:56.674522 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-78d7d1aa-a517-4a7b-b5a1-ef706fec3b1e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for project 3515123097e744ef855ef1129fb59cf1. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:57:56.680689 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-78d7d1aa-a517-4a7b-b5a1-ef706fec3b1e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for user 0d48260054d84784b89a52d9b766d7c1 and project 3515123097e744ef855ef1129fb59cf1. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:57:56.699487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-78d7d1aa-a517-4a7b-b5a1-ef706fec3b1e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Going to run 2 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:57:56.702943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-78d7d1aa-a517-4a7b-b5a1-ef706fec3b1e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: faba011e-8cd7-4120-9e2d-8e98112899b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:57:56.771583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-78d7d1aa-a517-4a7b-b5a1-ef706fec3b1e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=140523) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 17 20:57:56.817077 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-78d7d1aa-a517-4a7b-b5a1-ef706fec3b1e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for project 3515123097e744ef855ef1129fb59cf1. Resources: {'server_group_members'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:57:56.831226 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-78d7d1aa-a517-4a7b-b5a1-ef706fec3b1e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for user 0d48260054d84784b89a52d9b766d7c1 and project 3515123097e744ef855ef1129fb59cf1. Resources: {'server_group_members'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:57:56.965921 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-78d7d1aa-a517-4a7b-b5a1-ef706fec3b1e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for project 3515123097e744ef855ef1129fb59cf1. Resources: {'server_group_members'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:57:56.974892 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-78d7d1aa-a517-4a7b-b5a1-ef706fec3b1e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for user 0d48260054d84784b89a52d9b766d7c1 and project 3515123097e744ef855ef1129fb59cf1. Resources: {'server_group_members'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:57:56.995820 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-78d7d1aa-a517-4a7b-b5a1-ef706fec3b1e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: e8e78e88-e04b-497b-bef8-c4b57aff1d1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=faba011e-8cd7-4120-9e2d-8e98112899b3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:57:57.128298 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-78d7d1aa-a517-4a7b-b5a1-ef706fec3b1e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for project 3515123097e744ef855ef1129fb59cf1. Resources: {'server_group_members'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:57:57.154059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-78d7d1aa-a517-4a7b-b5a1-ef706fec3b1e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for user 0d48260054d84784b89a52d9b766d7c1 and project 3515123097e744ef855ef1129fb59cf1. Resources: {'server_group_members'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:57:57.248942 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-78d7d1aa-a517-4a7b-b5a1-ef706fec3b1e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for project 3515123097e744ef855ef1129fb59cf1. Resources: {'server_group_members'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:57:57.263157 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-78d7d1aa-a517-4a7b-b5a1-ef706fec3b1e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for user 0d48260054d84784b89a52d9b766d7c1 and project 3515123097e744ef855ef1129fb59cf1. Resources: {'server_group_members'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:57:57.353623 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-78d7d1aa-a517-4a7b-b5a1-ef706fec3b1e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.379090 Sep 17 20:57:57.354268 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 876/1827] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:57:55 2022] POST /compute/v2.1/servers => generated 32 bytes in 1380 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 17 20:57:57.418948 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cdeb2e8b-b042-4393-a185-3f19f97a47c6 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "DELETE /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25" status: 204 len: 0 microversion: 2.1 time: 1.076289 Sep 17 20:57:57.420822 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 952/1828] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:56 2022] DELETE /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25 => generated 0 bytes in 1079 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:57:57.429526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-f4a5bb72-c8a7-4c33-a118-03bed1c7d636 req-8b9acc7e-1b4a-4a52-932e-988e11573a4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3e67571-f038-485c-8685-af24123a5c10", "name": "network-vif-plugged", "status": "completed", "tag": "e4f76359-697f-489f-b5c5-59f550eaca0f"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:57.450392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f4a5bb72-c8a7-4c33-a118-03bed1c7d636 req-8b9acc7e-1b4a-4a52-932e-988e11573a4a service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:57.453157 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f4a5bb72-c8a7-4c33-a118-03bed1c7d636 req-8b9acc7e-1b4a-4a52-932e-988e11573a4a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:57.453852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f4a5bb72-c8a7-4c33-a118-03bed1c7d636 req-8b9acc7e-1b4a-4a52-932e-988e11573a4a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:57.483087 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-f4a5bb72-c8a7-4c33-a118-03bed1c7d636 req-8b9acc7e-1b4a-4a52-932e-988e11573a4a service nova] Creating event network-vif-plugged:e4f76359-697f-489f-b5c5-59f550eaca0f for instance f3e67571-f038-485c-8685-af24123a5c10 on nch1-master-1 Sep 17 20:57:57.496135 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-f4a5bb72-c8a7-4c33-a118-03bed1c7d636 req-8b9acc7e-1b4a-4a52-932e-988e11573a4a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072929 Sep 17 20:57:57.497940 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 953/1829] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:57.507829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6a57f079-dc75-4eb9-a956-d6b4e154ca4a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:57.509630 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6a57f079-dc75-4eb9-a956-d6b4e154ca4a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:57.518896 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:57.521679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a57f079-dc75-4eb9-a956-d6b4e154ca4a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:57.523416 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a57f079-dc75-4eb9-a956-d6b4e154ca4a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:57.524122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a57f079-dc75-4eb9-a956-d6b4e154ca4a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:57.525421 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a57f079-dc75-4eb9-a956-d6b4e154ca4a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:57.526191 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a57f079-dc75-4eb9-a956-d6b4e154ca4a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:57.526857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a57f079-dc75-4eb9-a956-d6b4e154ca4a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:57.769661 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6a57f079-dc75-4eb9-a956-d6b4e154ca4a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:57.786653 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6a57f079-dc75-4eb9-a956-d6b4e154ca4a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1601 microversion: 2.1 time: 0.286784 Sep 17 20:57:57.787266 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 954/1830] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:57 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1601 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:57.796473 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c6a5a9fa-8ac5-44f7-9d08-26cc8ac76a04 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:57.797954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c6a5a9fa-8ac5-44f7-9d08-26cc8ac76a04 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: f3e67571-f038-485c-8685-af24123a5c10] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:57.821589 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c6a5a9fa-8ac5-44f7-9d08-26cc8ac76a04 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:57.822112 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c6a5a9fa-8ac5-44f7-9d08-26cc8ac76a04 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:57.822560 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c6a5a9fa-8ac5-44f7-9d08-26cc8ac76a04 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:57.823299 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c6a5a9fa-8ac5-44f7-9d08-26cc8ac76a04 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:57.836261 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c6a5a9fa-8ac5-44f7-9d08-26cc8ac76a04 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:57.838947 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c6a5a9fa-8ac5-44f7-9d08-26cc8ac76a04 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:58.023169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-17eab8e5-e093-424e-94d6-92e6490e6b1f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-2053519891", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "593ddbbf-41c8-4aa6-b6e1-08711882ccf0"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:58.124958 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-17eab8e5-e093-424e-94d6-92e6490e6b1f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] validate_networks() for [('593ddbbf-41c8-4aa6-b6e1-08711882ccf0', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:57:58.318871 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c6a5a9fa-8ac5-44f7-9d08-26cc8ac76a04 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:58.332565 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c6a5a9fa-8ac5-44f7-9d08-26cc8ac76a04 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10" status: 200 len: 1334 microversion: 2.1 time: 0.541833 Sep 17 20:57:58.336383 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 955/1831] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:57 2022] GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10 => generated 1334 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:58.349835 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-04c988cf-749d-4e9d-981a-dca0c5bf6578 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:58.354920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-04c988cf-749d-4e9d-981a-dca0c5bf6578 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:58.364567 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-04c988cf-749d-4e9d-981a-dca0c5bf6578 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Searching by: {'deleted': False, 'project_id': '3515123097e744ef855ef1129fb59cf1'} {{(pid=140524) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 20:57:58.429732 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-04c988cf-749d-4e9d-981a-dca0c5bf6578 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:58.435930 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-04c988cf-749d-4e9d-981a-dca0c5bf6578 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:58.436503 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-04c988cf-749d-4e9d-981a-dca0c5bf6578 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:58.439581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-04c988cf-749d-4e9d-981a-dca0c5bf6578 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:58.441635 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-04c988cf-749d-4e9d-981a-dca0c5bf6578 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:58.442400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-04c988cf-749d-4e9d-981a-dca0c5bf6578 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:58.509362 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.multi_cell_list [None req-04c988cf-749d-4e9d-981a-dca0c5bf6578 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=140524) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 20:57:58.588851 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-04c988cf-749d-4e9d-981a-dca0c5bf6578 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.250302 Sep 17 20:57:58.601830 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 956/1832] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Sep 17 20:57:58 2022] GET /compute/v2.1/servers => generated 1002 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:58.607314 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e2278e0c-6512-493c-bd04-e8ee06875c7a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:58.614922 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e2278e0c-6512-493c-bd04-e8ee06875c7a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: c9fe0176-1bcf-4719-a87f-17b0e0c41b6c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:58.631944 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2278e0c-6512-493c-bd04-e8ee06875c7a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:58.632858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2278e0c-6512-493c-bd04-e8ee06875c7a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:58.633641 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2278e0c-6512-493c-bd04-e8ee06875c7a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:58.634627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2278e0c-6512-493c-bd04-e8ee06875c7a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:58.637936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2278e0c-6512-493c-bd04-e8ee06875c7a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:58.638634 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2278e0c-6512-493c-bd04-e8ee06875c7a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:59.071373 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e2278e0c-6512-493c-bd04-e8ee06875c7a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:59.084852 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e2278e0c-6512-493c-bd04-e8ee06875c7a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c" status: 200 len: 1314 microversion: 2.1 time: 0.479944 Sep 17 20:57:59.086851 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 957/1833] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:58 2022] GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:59.102341 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d70981bb-b05f-4eb4-843e-e0fe3a094280 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:59.103446 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d70981bb-b05f-4eb4-843e-e0fe3a094280 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:59.121872 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d70981bb-b05f-4eb4-843e-e0fe3a094280 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:59.124034 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d70981bb-b05f-4eb4-843e-e0fe3a094280 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:59.125031 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d70981bb-b05f-4eb4-843e-e0fe3a094280 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:59.126061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d70981bb-b05f-4eb4-843e-e0fe3a094280 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:59.132787 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d70981bb-b05f-4eb4-843e-e0fe3a094280 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:59.133499 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d70981bb-b05f-4eb4-843e-e0fe3a094280 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:59.203788 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d70981bb-b05f-4eb4-843e-e0fe3a094280 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:57:59.418214 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-17eab8e5-e093-424e-94d6-92e6490e6b1f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:57:59.419591 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-17eab8e5-e093-424e-94d6-92e6490e6b1f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:57:59.420292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-17eab8e5-e093-424e-94d6-92e6490e6b1f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:57:59.420878 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-17eab8e5-e093-424e-94d6-92e6490e6b1f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:57:59.421663 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-17eab8e5-e093-424e-94d6-92e6490e6b1f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:57:59.436336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17eab8e5-e093-424e-94d6-92e6490e6b1f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:59.437246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17eab8e5-e093-424e-94d6-92e6490e6b1f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:59.437929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17eab8e5-e093-424e-94d6-92e6490e6b1f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:59.440213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17eab8e5-e093-424e-94d6-92e6490e6b1f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:59.441103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17eab8e5-e093-424e-94d6-92e6490e6b1f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:59.442113 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17eab8e5-e093-424e-94d6-92e6490e6b1f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:59.461568 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d70981bb-b05f-4eb4-843e-e0fe3a094280 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "DELETE /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 204 len: 0 microversion: 2.1 time: 0.372945 Sep 17 20:57:59.462225 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 958/1834] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:57:59 2022] DELETE /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:57:59.478715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4503f25c-8fd4-487c-bdd2-6f2f04b4aead tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:59.481345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4503f25c-8fd4-487c-bdd2-6f2f04b4aead tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: e8e78e88-e04b-497b-bef8-c4b57aff1d1d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:59.493630 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4503f25c-8fd4-487c-bdd2-6f2f04b4aead tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:59.494461 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4503f25c-8fd4-487c-bdd2-6f2f04b4aead tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:59.495182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4503f25c-8fd4-487c-bdd2-6f2f04b4aead tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:59.496129 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4503f25c-8fd4-487c-bdd2-6f2f04b4aead tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:59.496790 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4503f25c-8fd4-487c-bdd2-6f2f04b4aead tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:59.497943 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4503f25c-8fd4-487c-bdd2-6f2f04b4aead tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:59.529952 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-17eab8e5-e093-424e-94d6-92e6490e6b1f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Getting quotas for project 044cdbed43ed4de6b4cb7e1cd4802b65. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:57:59.548378 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-17eab8e5-e093-424e-94d6-92e6490e6b1f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Getting quotas for user 8db879fde0bd4bea81374a7f7bb627e6 and project 044cdbed43ed4de6b4cb7e1cd4802b65. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:57:59.598751 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-17eab8e5-e093-424e-94d6-92e6490e6b1f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:57:59.610766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-17eab8e5-e093-424e-94d6-92e6490e6b1f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] [instance: a6f98038-008a-49b5-968e-bcb0791d4678] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:57:59.665280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4503f25c-8fd4-487c-bdd2-6f2f04b4aead tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:59.689316 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4503f25c-8fd4-487c-bdd2-6f2f04b4aead tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d" status: 200 len: 1214 microversion: 2.1 time: 0.212131 Sep 17 20:57:59.691192 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 959/1835] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:59 2022] GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d => generated 1214 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:59.706866 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b27e2fe2-1bd5-4e1a-a843-b268a9a65799 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:59.712412 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b27e2fe2-1bd5-4e1a-a843-b268a9a65799 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:59.722274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b27e2fe2-1bd5-4e1a-a843-b268a9a65799 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:59.723857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b27e2fe2-1bd5-4e1a-a843-b268a9a65799 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:59.724706 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b27e2fe2-1bd5-4e1a-a843-b268a9a65799 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:59.734078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b27e2fe2-1bd5-4e1a-a843-b268a9a65799 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:59.735193 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b27e2fe2-1bd5-4e1a-a843-b268a9a65799 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:59.735846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b27e2fe2-1bd5-4e1a-a843-b268a9a65799 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:59.767368 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-17eab8e5-e093-424e-94d6-92e6490e6b1f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.408337 Sep 17 20:57:59.769506 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 877/1836] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:57:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2413 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:57:59.782383 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-2a620d12-668c-47a8-9e3a-f3a0f5fc7214 req-8773da06-d398-4f80-9442-69de5759953f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d60c84-b2e2-4376-a0ca-f0bee938fd9a", "name": "network-vif-deleted", "tag": "94958f55-6b3e-41f2-a7f1-6dd835192bd3"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:57:59.790012 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:57:59.811996 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2a620d12-668c-47a8-9e3a-f3a0f5fc7214 req-8773da06-d398-4f80-9442-69de5759953f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:59.812833 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2a620d12-668c-47a8-9e3a-f3a0f5fc7214 req-8773da06-d398-4f80-9442-69de5759953f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:59.813630 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2a620d12-668c-47a8-9e3a-f3a0f5fc7214 req-8773da06-d398-4f80-9442-69de5759953f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:59.829419 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-2a620d12-668c-47a8-9e3a-f3a0f5fc7214 req-8773da06-d398-4f80-9442-69de5759953f service nova] Creating event network-vif-deleted:94958f55-6b3e-41f2-a7f1-6dd835192bd3 for instance 46d60c84-b2e2-4376-a0ca-f0bee938fd9a on nch2-master-1 Sep 17 20:57:59.835264 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-2a620d12-668c-47a8-9e3a-f3a0f5fc7214 req-8773da06-d398-4f80-9442-69de5759953f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061593 Sep 17 20:57:59.836279 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 878/1837] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:57:59.838132 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b27e2fe2-1bd5-4e1a-a843-b268a9a65799 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:59.838929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b27e2fe2-1bd5-4e1a-a843-b268a9a65799 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:59.842141 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b27e2fe2-1bd5-4e1a-a843-b268a9a65799 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:59.842744 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-b27e2fe2-1bd5-4e1a-a843-b268a9a65799 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lazy-loading 'fault' on Instance uuid 46d60c84-b2e2-4376-a0ca-f0bee938fd9a {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:57:59.843415 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-aa95dc1f-445a-497c-bb65-cd1efbf2651c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:57:59.844951 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-aa95dc1f-445a-497c-bb65-cd1efbf2651c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: f3e67571-f038-485c-8685-af24123a5c10] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:57:59.855809 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa95dc1f-445a-497c-bb65-cd1efbf2651c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:59.857259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa95dc1f-445a-497c-bb65-cd1efbf2651c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:59.858375 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa95dc1f-445a-497c-bb65-cd1efbf2651c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:59.860138 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa95dc1f-445a-497c-bb65-cd1efbf2651c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:57:59.881123 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa95dc1f-445a-497c-bb65-cd1efbf2651c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:57:59.881694 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa95dc1f-445a-497c-bb65-cd1efbf2651c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:57:59.945978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b27e2fe2-1bd5-4e1a-a843-b268a9a65799 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:57:59.959113 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b27e2fe2-1bd5-4e1a-a843-b268a9a65799 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1325 microversion: 2.1 time: 0.266050 Sep 17 20:57:59.964703 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 960/1838] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:59 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1325 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:57:59.985884 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-138041ca-242a-4849-933a-5f441b1fc6f3 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1885170831", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "abd24085-3207-4975-a2e8-9c99f58fa2c7"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:00.112611 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-138041ca-242a-4849-933a-5f441b1fc6f3 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] validate_networks() for [('abd24085-3207-4975-a2e8-9c99f58fa2c7', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:58:00.354553 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-aa95dc1f-445a-497c-bb65-cd1efbf2651c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:00.368809 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-aa95dc1f-445a-497c-bb65-cd1efbf2651c tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10" status: 200 len: 1334 microversion: 2.1 time: 0.529635 Sep 17 20:58:00.372739 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 879/1839] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:57:59 2022] GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10 => generated 1334 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:00.383267 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5835e95c-c1df-4733-91b1-37699184d55f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:00.386564 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5835e95c-c1df-4733-91b1-37699184d55f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] [instance: a6f98038-008a-49b5-968e-bcb0791d4678] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:00.537662 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5835e95c-c1df-4733-91b1-37699184d55f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db879fde0bd4bea81374a7f7bb627e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cdbed43ed4de6b4cb7e1cd4802b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:00.547179 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5835e95c-c1df-4733-91b1-37699184d55f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] 10.222.0.26 "GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678" status: 200 len: 1225 microversion: 2.1 time: 0.171629 Sep 17 20:58:00.548464 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 880/1840] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:00 2022] GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678 => generated 1225 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:00.555874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1da46e79-344f-4118-a0ae-d1baa51eb61a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:00.556500 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1da46e79-344f-4118-a0ae-d1baa51eb61a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: c9fe0176-1bcf-4719-a87f-17b0e0c41b6c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:00.584621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1da46e79-344f-4118-a0ae-d1baa51eb61a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:00.585730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1da46e79-344f-4118-a0ae-d1baa51eb61a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:00.589124 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1da46e79-344f-4118-a0ae-d1baa51eb61a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:00.596063 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1da46e79-344f-4118-a0ae-d1baa51eb61a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:00.598297 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1da46e79-344f-4118-a0ae-d1baa51eb61a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:00.600023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1da46e79-344f-4118-a0ae-d1baa51eb61a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:01.592481 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1da46e79-344f-4118-a0ae-d1baa51eb61a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:01.600815 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1da46e79-344f-4118-a0ae-d1baa51eb61a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c" status: 200 len: 1314 microversion: 2.1 time: 1.049962 Sep 17 20:58:01.621537 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 881/1841] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:00 2022] GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c => generated 1314 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:01.627065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d2593396-51e4-4900-8f01-5aee791dc5cc tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:01.632080 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d2593396-51e4-4900-8f01-5aee791dc5cc tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: e8e78e88-e04b-497b-bef8-c4b57aff1d1d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:01.641358 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2593396-51e4-4900-8f01-5aee791dc5cc tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:01.642496 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2593396-51e4-4900-8f01-5aee791dc5cc tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:01.643109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2593396-51e4-4900-8f01-5aee791dc5cc tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:01.644178 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2593396-51e4-4900-8f01-5aee791dc5cc tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:01.644830 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2593396-51e4-4900-8f01-5aee791dc5cc tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:01.645451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2593396-51e4-4900-8f01-5aee791dc5cc tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:01.749739 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d2593396-51e4-4900-8f01-5aee791dc5cc tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:01.761099 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d2593396-51e4-4900-8f01-5aee791dc5cc tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d" status: 200 len: 1214 microversion: 2.1 time: 0.136507 Sep 17 20:58:01.762064 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 882/1842] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:01 2022] GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d => generated 1214 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:01.785646 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-967ae3d2-129a-47ef-8fe7-026bb72a0530 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:01.787577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-967ae3d2-129a-47ef-8fe7-026bb72a0530 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:01.791085 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:58:01.799477 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-967ae3d2-129a-47ef-8fe7-026bb72a0530 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:01.800167 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-967ae3d2-129a-47ef-8fe7-026bb72a0530 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:01.800615 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-967ae3d2-129a-47ef-8fe7-026bb72a0530 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:01.801335 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-967ae3d2-129a-47ef-8fe7-026bb72a0530 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:01.802012 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-967ae3d2-129a-47ef-8fe7-026bb72a0530 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:01.802636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-967ae3d2-129a-47ef-8fe7-026bb72a0530 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:01.852147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-967ae3d2-129a-47ef-8fe7-026bb72a0530 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:01.853047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-967ae3d2-129a-47ef-8fe7-026bb72a0530 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:01.854174 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-967ae3d2-129a-47ef-8fe7-026bb72a0530 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:01.854878 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-967ae3d2-129a-47ef-8fe7-026bb72a0530 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lazy-loading 'fault' on Instance uuid 46d60c84-b2e2-4376-a0ca-f0bee938fd9a {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:58:02.023949 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-967ae3d2-129a-47ef-8fe7-026bb72a0530 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:02.033533 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-967ae3d2-129a-47ef-8fe7-026bb72a0530 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 200 len: 1325 microversion: 2.1 time: 0.270094 Sep 17 20:58:02.039787 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 883/1843] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:01 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 1325 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:02.045671 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-d8ba175f-b0c2-4a99-8d5a-374e3d3435e7 req-794d5d1a-6ca1-49e1-9cce-0539363edfef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be2b42c6-7d99-48b0-b515-26a7139e11aa", "name": "network-vif-unplugged", "status": "completed", "tag": "6eb514c0-157c-49ae-bba8-9c080043b38a"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:02.098606 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d8ba175f-b0c2-4a99-8d5a-374e3d3435e7 req-794d5d1a-6ca1-49e1-9cce-0539363edfef service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:02.110932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d8ba175f-b0c2-4a99-8d5a-374e3d3435e7 req-794d5d1a-6ca1-49e1-9cce-0539363edfef service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:02.130767 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d8ba175f-b0c2-4a99-8d5a-374e3d3435e7 req-794d5d1a-6ca1-49e1-9cce-0539363edfef service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:02.163491 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-d8ba175f-b0c2-4a99-8d5a-374e3d3435e7 req-794d5d1a-6ca1-49e1-9cce-0539363edfef service nova] Creating event network-vif-unplugged:6eb514c0-157c-49ae-bba8-9c080043b38a for instance be2b42c6-7d99-48b0-b515-26a7139e11aa on nch2-master-1 Sep 17 20:58:02.185933 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-d8ba175f-b0c2-4a99-8d5a-374e3d3435e7 req-794d5d1a-6ca1-49e1-9cce-0539363edfef service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.144053 Sep 17 20:58:02.189754 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 884/1844] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:02.196427 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a4f81857-1f44-4670-b953-5af894cc4ed4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:02.197175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a4f81857-1f44-4670-b953-5af894cc4ed4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: f3e67571-f038-485c-8685-af24123a5c10] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:02.204758 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4f81857-1f44-4670-b953-5af894cc4ed4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:02.205433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4f81857-1f44-4670-b953-5af894cc4ed4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:02.205992 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4f81857-1f44-4670-b953-5af894cc4ed4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:02.206745 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4f81857-1f44-4670-b953-5af894cc4ed4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:02.207401 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4f81857-1f44-4670-b953-5af894cc4ed4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:02.208111 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4f81857-1f44-4670-b953-5af894cc4ed4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:02.235096 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:58:02.361390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-138041ca-242a-4849-933a-5f441b1fc6f3 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:58:02.362112 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-138041ca-242a-4849-933a-5f441b1fc6f3 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:58:02.362693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-138041ca-242a-4849-933a-5f441b1fc6f3 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:58:02.363556 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-138041ca-242a-4849-933a-5f441b1fc6f3 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:58:02.364080 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-138041ca-242a-4849-933a-5f441b1fc6f3 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:58:02.377180 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-138041ca-242a-4849-933a-5f441b1fc6f3 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:02.378053 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-138041ca-242a-4849-933a-5f441b1fc6f3 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:02.378587 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-138041ca-242a-4849-933a-5f441b1fc6f3 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:02.389041 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a4f81857-1f44-4670-b953-5af894cc4ed4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:02.390686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-138041ca-242a-4849-933a-5f441b1fc6f3 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:02.391442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-138041ca-242a-4849-933a-5f441b1fc6f3 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:02.392810 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-138041ca-242a-4849-933a-5f441b1fc6f3 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:02.406641 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a4f81857-1f44-4670-b953-5af894cc4ed4 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10" status: 200 len: 1669 microversion: 2.1 time: 0.215083 Sep 17 20:58:02.407598 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 885/1845] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:02 2022] GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10 => generated 1669 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:02.412749 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-801c3aab-bc2a-4b1d-90d2-d662daa23de9 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:02.413564 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-801c3aab-bc2a-4b1d-90d2-d662daa23de9 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] [instance: a6f98038-008a-49b5-968e-bcb0791d4678] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:02.427242 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-801c3aab-bc2a-4b1d-90d2-d662daa23de9 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:02.427697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-138041ca-242a-4849-933a-5f441b1fc6f3 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Getting quotas for project 2a4117ca05454573bbd93fbca50431d2. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:58:02.428050 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-801c3aab-bc2a-4b1d-90d2-d662daa23de9 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:02.428588 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-801c3aab-bc2a-4b1d-90d2-d662daa23de9 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:02.429407 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-801c3aab-bc2a-4b1d-90d2-d662daa23de9 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:02.430009 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-801c3aab-bc2a-4b1d-90d2-d662daa23de9 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:02.430527 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-801c3aab-bc2a-4b1d-90d2-d662daa23de9 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:02.432742 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-138041ca-242a-4849-933a-5f441b1fc6f3 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Getting quotas for user 6e33e0b756e14af28a90cc5c76d346e6 and project 2a4117ca05454573bbd93fbca50431d2. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:58:02.455417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-138041ca-242a-4849-933a-5f441b1fc6f3 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:58:02.457806 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-138041ca-242a-4849-933a-5f441b1fc6f3 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: bf08d895-d8f9-440d-8ade-fbc47dc6bde4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:58:02.519921 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-801c3aab-bc2a-4b1d-90d2-d662daa23de9 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db879fde0bd4bea81374a7f7bb627e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cdbed43ed4de6b4cb7e1cd4802b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:02.540544 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-138041ca-242a-4849-933a-5f441b1fc6f3 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.574698 Sep 17 20:58:02.541760 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-801c3aab-bc2a-4b1d-90d2-d662daa23de9 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] 10.222.0.26 "GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678" status: 200 len: 1221 microversion: 2.1 time: 0.132820 Sep 17 20:58:02.550317 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 961/1846] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:57:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:58:02.556057 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 886/1847] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:02 2022] GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678 => generated 1221 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:02.589732 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-ec59f9fb-2fdc-4b54-9c2b-dfa09e667873 req-c79dfd5c-3ec2-4991-842b-de3efe7955e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9fe0176-1bcf-4719-a87f-17b0e0c41b6c", "tag": "426f4af4-d3cb-4129-98a4-e9ba8b33cab4"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:02.617517 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-ec59f9fb-2fdc-4b54-9c2b-dfa09e667873 req-c79dfd5c-3ec2-4991-842b-de3efe7955e1 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:02.620685 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-ec59f9fb-2fdc-4b54-9c2b-dfa09e667873 req-c79dfd5c-3ec2-4991-842b-de3efe7955e1 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:02.621328 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-ec59f9fb-2fdc-4b54-9c2b-dfa09e667873 req-c79dfd5c-3ec2-4991-842b-de3efe7955e1 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:02.646623 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-ec59f9fb-2fdc-4b54-9c2b-dfa09e667873 req-c79dfd5c-3ec2-4991-842b-de3efe7955e1 service nova] Creating event network-changed:426f4af4-d3cb-4129-98a4-e9ba8b33cab4 for instance c9fe0176-1bcf-4719-a87f-17b0e0c41b6c on nch2-master-1 Sep 17 20:58:02.657726 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-ec59f9fb-2fdc-4b54-9c2b-dfa09e667873 req-c79dfd5c-3ec2-4991-842b-de3efe7955e1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097109 Sep 17 20:58:02.664007 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 962/1848] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:02.677552 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e5758fd9-ef59-4f8d-9f66-a002a6ba39ce tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:02.678184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e5758fd9-ef59-4f8d-9f66-a002a6ba39ce tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: f3e67571-f038-485c-8685-af24123a5c10] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:02.690665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5758fd9-ef59-4f8d-9f66-a002a6ba39ce tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:02.691303 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5758fd9-ef59-4f8d-9f66-a002a6ba39ce tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:02.691868 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5758fd9-ef59-4f8d-9f66-a002a6ba39ce tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:02.693770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5758fd9-ef59-4f8d-9f66-a002a6ba39ce tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:02.700586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5758fd9-ef59-4f8d-9f66-a002a6ba39ce tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:02.701050 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5758fd9-ef59-4f8d-9f66-a002a6ba39ce tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:02.733880 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e5758fd9-ef59-4f8d-9f66-a002a6ba39ce tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10/ips" status: 200 len: 179 microversion: 2.1 time: 0.068410 Sep 17 20:58:02.735064 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 963/1849] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Sep 17 20:58:02 2022] GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10/ips => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:02.742085 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c0d91d62-005c-4115-9562-b8231dd552ca tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:02.742927 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c0d91d62-005c-4115-9562-b8231dd552ca tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: bf08d895-d8f9-440d-8ade-fbc47dc6bde4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:02.762455 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e9eb98d2-8066-43b6-bf90-0fbe7d6a4352 tempest-QuotasAdminTestV236-1723358146 tempest-QuotasAdminTestV236-1723358146-project-admin] Action: 'update', calling method: .version_select at 0x7f25a4f71430>, body: {"quota_set": {"ram": "5120"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:02.819912 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c0d91d62-005c-4115-9562-b8231dd552ca tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:02.827544 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c0d91d62-005c-4115-9562-b8231dd552ca tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4" status: 200 len: 1208 microversion: 2.1 time: 0.090300 Sep 17 20:58:02.833849 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 964/1850] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:02 2022] GET /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4 => generated 1208 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:02.833849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a0ca6f87-73f0-487d-aca4-5680e046bf3d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:02.834257 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a0ca6f87-73f0-487d-aca4-5680e046bf3d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: c9fe0176-1bcf-4719-a87f-17b0e0c41b6c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:02.840311 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0ca6f87-73f0-487d-aca4-5680e046bf3d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:02.840812 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0ca6f87-73f0-487d-aca4-5680e046bf3d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:02.841252 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0ca6f87-73f0-487d-aca4-5680e046bf3d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:02.841977 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0ca6f87-73f0-487d-aca4-5680e046bf3d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:02.842441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0ca6f87-73f0-487d-aca4-5680e046bf3d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:02.843097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0ca6f87-73f0-487d-aca4-5680e046bf3d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:02.845499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9eb98d2-8066-43b6-bf90-0fbe7d6a4352 tempest-QuotasAdminTestV236-1723358146 tempest-QuotasAdminTestV236-1723358146-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:02.846746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9eb98d2-8066-43b6-bf90-0fbe7d6a4352 tempest-QuotasAdminTestV236-1723358146 tempest-QuotasAdminTestV236-1723358146-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:02.847264 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9eb98d2-8066-43b6-bf90-0fbe7d6a4352 tempest-QuotasAdminTestV236-1723358146 tempest-QuotasAdminTestV236-1723358146-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:02.848128 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9eb98d2-8066-43b6-bf90-0fbe7d6a4352 tempest-QuotasAdminTestV236-1723358146 tempest-QuotasAdminTestV236-1723358146-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:02.848589 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9eb98d2-8066-43b6-bf90-0fbe7d6a4352 tempest-QuotasAdminTestV236-1723358146 tempest-QuotasAdminTestV236-1723358146-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:02.849088 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9eb98d2-8066-43b6-bf90-0fbe7d6a4352 tempest-QuotasAdminTestV236-1723358146 tempest-QuotasAdminTestV236-1723358146-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:02.917786 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e9eb98d2-8066-43b6-bf90-0fbe7d6a4352 tempest-QuotasAdminTestV236-1723358146 tempest-QuotasAdminTestV236-1723358146-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/0da0997d32f248d0ba6fe26ccb0e60e4" status: 200 len: 240 microversion: 2.36 time: 0.358724 Sep 17 20:58:02.927025 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 887/1851] 10.222.0.26 () {62 vars in 1303 bytes} [Sat Sep 17 20:58:02 2022] PUT /compute/v2.1/os-quota-sets/0da0997d32f248d0ba6fe26ccb0e60e4 => generated 240 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:58:02.942698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d27511de-3d5c-489e-9b18-3a54315e87d9 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:02.943308 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d27511de-3d5c-489e-9b18-3a54315e87d9 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: f3e67571-f038-485c-8685-af24123a5c10] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:02.954466 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d27511de-3d5c-489e-9b18-3a54315e87d9 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:02.955140 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d27511de-3d5c-489e-9b18-3a54315e87d9 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:02.955857 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d27511de-3d5c-489e-9b18-3a54315e87d9 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:02.956625 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d27511de-3d5c-489e-9b18-3a54315e87d9 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:02.957102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d27511de-3d5c-489e-9b18-3a54315e87d9 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:02.957562 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d27511de-3d5c-489e-9b18-3a54315e87d9 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:02.992076 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d27511de-3d5c-489e-9b18-3a54315e87d9 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: f3e67571-f038-485c-8685-af24123a5c10] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:58:03.005453 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a0ca6f87-73f0-487d-aca4-5680e046bf3d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:03.015325 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a0ca6f87-73f0-487d-aca4-5680e046bf3d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c" status: 200 len: 1314 microversion: 2.1 time: 0.185382 Sep 17 20:58:03.015949 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 965/1852] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:02 2022] GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:03.028465 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c18d4974-1283-4dee-8ca5-8b9d36c5cf92 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:03.029404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c18d4974-1283-4dee-8ca5-8b9d36c5cf92 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: e8e78e88-e04b-497b-bef8-c4b57aff1d1d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:03.036597 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c18d4974-1283-4dee-8ca5-8b9d36c5cf92 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:03.037431 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c18d4974-1283-4dee-8ca5-8b9d36c5cf92 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:03.037865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c18d4974-1283-4dee-8ca5-8b9d36c5cf92 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:03.038681 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c18d4974-1283-4dee-8ca5-8b9d36c5cf92 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:03.039330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c18d4974-1283-4dee-8ca5-8b9d36c5cf92 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:03.039945 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c18d4974-1283-4dee-8ca5-8b9d36c5cf92 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:03.096727 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d27511de-3d5c-489e-9b18-3a54315e87d9 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10" status: 204 len: 0 microversion: 2.1 time: 0.167763 Sep 17 20:58:03.098164 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 888/1853] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:58:02 2022] DELETE /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:58:03.103724 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9f522f57-688e-4692-9b83-aeea25781984 tempest-QuotasAdminTestV236-1723358146 tempest-QuotasAdminTestV236-1723358146-project-admin] Calling method '.version_select at 0x7f25a5000430>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:03.132527 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c18d4974-1283-4dee-8ca5-8b9d36c5cf92 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:03.143016 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c18d4974-1283-4dee-8ca5-8b9d36c5cf92 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d" status: 200 len: 1270 microversion: 2.1 time: 0.124133 Sep 17 20:58:03.143945 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 966/1854] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:03 2022] GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d => generated 1270 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:03.149212 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1f933819-5b11-420f-97fa-efb7b52d9d18 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:03.150061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1f933819-5b11-420f-97fa-efb7b52d9d18 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 46d60c84-b2e2-4376-a0ca-f0bee938fd9a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:03.156327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f933819-5b11-420f-97fa-efb7b52d9d18 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:03.157219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f933819-5b11-420f-97fa-efb7b52d9d18 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:03.157984 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f933819-5b11-420f-97fa-efb7b52d9d18 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:03.158932 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f933819-5b11-420f-97fa-efb7b52d9d18 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:03.159564 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f933819-5b11-420f-97fa-efb7b52d9d18 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:03.160172 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f933819-5b11-420f-97fa-efb7b52d9d18 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:03.174810 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-1f933819-5b11-420f-97fa-efb7b52d9d18 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] HTTP exception thrown: Instance 46d60c84-b2e2-4376-a0ca-f0bee938fd9a could not be found. Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1f933819-5b11-420f-97fa-efb7b52d9d18 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Request method failure captured: Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a HTTP/1.1 Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjO4pMSDFI6Atu5kbd_vlRhbyV_fyPw2gdOrFx1mEyl4rL_CZavLzFaFFTIrDXVeI9bf87zTa9lzT1hke8Y8KagCjBPhEyXkmiJUAOGfheh5EfefZfrn_wGqKtQ01RGpNIahNrBgvi-tWdhaJbgej8MzwbEe3UEoa8f3i5egIziHROo Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: f6b44bc44e7c4a998bfd99e7d11e99fc Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-LiveMigrationTest-128259988 Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f6b44bc44e7c4a998bfd99e7d11e99fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f6b44bc44e7c4a998bfd99e7d11e99fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f6b44bc44e7c4a998bfd99e7d11e99fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f6b44bc44e7c4a998bfd99e7d11e99fc", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-LiveMigrationTest-128259988 Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: f6b44bc44e7c4a998bfd99e7d11e99fc Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-LiveMigrationTest-128259988 Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-LiveMigrationTest-128259988-project Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 9c2b746b7c194596808a7b0c736f3b53 Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-LiveMigrationTest-128259988-project Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 46d60c84-b2e2-4376-a0ca-f0bee938fd9a could not be found. Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '46d60c84-b2e2-4376-a0ca-f0bee938fd9a'} Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46d60c84-b2e2-4376-a0ca-f0bee938fd9a could not be found. Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46d60c84-b2e2-4376-a0ca-f0bee938fd9a could not be found. Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:03.176771 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:58:03.182063 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:03.182063 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:03.182063 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:03.182063 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:58:03.182063 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:58:03.182063 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46d60c84-b2e2-4376-a0ca-f0bee938fd9a could not be found. Sep 17 20:58:03.182063 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:58:03.182063 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1f933819-5b11-420f-97fa-efb7b52d9d18 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Returning 404 to user: Instance 46d60c84-b2e2-4376-a0ca-f0bee938fd9a could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:58:03.182063 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1f933819-5b11-420f-97fa-efb7b52d9d18 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a" status: 404 len: 111 microversion: 2.1 time: 0.033606 Sep 17 20:58:03.182063 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 967/1855] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:03 2022] GET /compute/v2.1/servers/46d60c84-b2e2-4376-a0ca-f0bee938fd9a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:58:03.184249 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f522f57-688e-4692-9b83-aeea25781984 tempest-QuotasAdminTestV236-1723358146 tempest-QuotasAdminTestV236-1723358146-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:03.184400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8765c307-8a39-49c7-9ca1-49bcd241bc99 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:03.184894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f522f57-688e-4692-9b83-aeea25781984 tempest-QuotasAdminTestV236-1723358146 tempest-QuotasAdminTestV236-1723358146-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:03.185189 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8765c307-8a39-49c7-9ca1-49bcd241bc99 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: f3e67571-f038-485c-8685-af24123a5c10] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:03.185421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f522f57-688e-4692-9b83-aeea25781984 tempest-QuotasAdminTestV236-1723358146 tempest-QuotasAdminTestV236-1723358146-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:03.186269 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f522f57-688e-4692-9b83-aeea25781984 tempest-QuotasAdminTestV236-1723358146 tempest-QuotasAdminTestV236-1723358146-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:03.186862 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f522f57-688e-4692-9b83-aeea25781984 tempest-QuotasAdminTestV236-1723358146 tempest-QuotasAdminTestV236-1723358146-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:03.187324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f522f57-688e-4692-9b83-aeea25781984 tempest-QuotasAdminTestV236-1723358146 tempest-QuotasAdminTestV236-1723358146-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:03.191767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8765c307-8a39-49c7-9ca1-49bcd241bc99 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:03.192254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8765c307-8a39-49c7-9ca1-49bcd241bc99 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:03.192691 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8765c307-8a39-49c7-9ca1-49bcd241bc99 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:03.193630 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8765c307-8a39-49c7-9ca1-49bcd241bc99 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:03.194093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8765c307-8a39-49c7-9ca1-49bcd241bc99 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:03.194557 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8765c307-8a39-49c7-9ca1-49bcd241bc99 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:03.209030 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9f522f57-688e-4692-9b83-aeea25781984 tempest-QuotasAdminTestV236-1723358146 tempest-QuotasAdminTestV236-1723358146-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/0da0997d32f248d0ba6fe26ccb0e60e4/detail" status: 200 len: 672 microversion: 2.36 time: 0.110066 Sep 17 20:58:03.209681 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 889/1856] 10.222.0.26 () {60 vars in 1304 bytes} [Sat Sep 17 20:58:03 2022] GET /compute/v2.1/os-quota-sets/0da0997d32f248d0ba6fe26ccb0e60e4/detail => generated 672 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:58:03.214453 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-84ac4298-1845-442b-a453-288351e11632 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '.version_select at 0x7f25a4f968b0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:03.239825 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-84ac4298-1845-442b-a453-288351e11632 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1548807653" status: 202 len: 0 microversion: 2.1 time: 0.028966 Sep 17 20:58:03.240381 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 890/1857] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Sep 17 20:58:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1548807653 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:58:03.364040 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2ea376e6-c2f3-4973-8a5f-5fd80c2f3711 tempest-QuotasAdminTestV236-1723358146 tempest-QuotasAdminTestV236-1723358146-project-admin] Action: 'update', calling method: .version_select at 0x7f25a4f35ee0>, body: {"quota_set": {"ram": "2048"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:03.427167 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8765c307-8a39-49c7-9ca1-49bcd241bc99 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:03.433397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ea376e6-c2f3-4973-8a5f-5fd80c2f3711 tempest-QuotasAdminTestV236-1723358146 tempest-QuotasAdminTestV236-1723358146-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:03.433923 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ea376e6-c2f3-4973-8a5f-5fd80c2f3711 tempest-QuotasAdminTestV236-1723358146 tempest-QuotasAdminTestV236-1723358146-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:03.434820 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ea376e6-c2f3-4973-8a5f-5fd80c2f3711 tempest-QuotasAdminTestV236-1723358146 tempest-QuotasAdminTestV236-1723358146-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:03.435638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ea376e6-c2f3-4973-8a5f-5fd80c2f3711 tempest-QuotasAdminTestV236-1723358146 tempest-QuotasAdminTestV236-1723358146-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:03.436219 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ea376e6-c2f3-4973-8a5f-5fd80c2f3711 tempest-QuotasAdminTestV236-1723358146 tempest-QuotasAdminTestV236-1723358146-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:03.436810 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8765c307-8a39-49c7-9ca1-49bcd241bc99 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10" status: 200 len: 1675 microversion: 2.1 time: 0.256569 Sep 17 20:58:03.437212 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ea376e6-c2f3-4973-8a5f-5fd80c2f3711 tempest-QuotasAdminTestV236-1723358146 tempest-QuotasAdminTestV236-1723358146-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:03.437400 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 968/1858] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:03 2022] GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10 => generated 1675 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:03.512192 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ea376e6-c2f3-4973-8a5f-5fd80c2f3711 tempest-QuotasAdminTestV236-1723358146 tempest-QuotasAdminTestV236-1723358146-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:03.512900 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ea376e6-c2f3-4973-8a5f-5fd80c2f3711 tempest-QuotasAdminTestV236-1723358146 tempest-QuotasAdminTestV236-1723358146-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:03.513666 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ea376e6-c2f3-4973-8a5f-5fd80c2f3711 tempest-QuotasAdminTestV236-1723358146 tempest-QuotasAdminTestV236-1723358146-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:03.514859 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ea376e6-c2f3-4973-8a5f-5fd80c2f3711 tempest-QuotasAdminTestV236-1723358146 tempest-QuotasAdminTestV236-1723358146-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:03.515523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ea376e6-c2f3-4973-8a5f-5fd80c2f3711 tempest-QuotasAdminTestV236-1723358146 tempest-QuotasAdminTestV236-1723358146-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:03.516115 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ea376e6-c2f3-4973-8a5f-5fd80c2f3711 tempest-QuotasAdminTestV236-1723358146 tempest-QuotasAdminTestV236-1723358146-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:03.569909 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ca4ea538-c35b-42c2-9bec-d49940ec9ad6 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:03.571468 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ca4ea538-c35b-42c2-9bec-d49940ec9ad6 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] [instance: a6f98038-008a-49b5-968e-bcb0791d4678] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:03.583634 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca4ea538-c35b-42c2-9bec-d49940ec9ad6 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:03.586011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca4ea538-c35b-42c2-9bec-d49940ec9ad6 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:03.586463 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca4ea538-c35b-42c2-9bec-d49940ec9ad6 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:03.589412 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca4ea538-c35b-42c2-9bec-d49940ec9ad6 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:03.593493 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca4ea538-c35b-42c2-9bec-d49940ec9ad6 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:03.597433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca4ea538-c35b-42c2-9bec-d49940ec9ad6 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:03.621833 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2ea376e6-c2f3-4973-8a5f-5fd80c2f3711 tempest-QuotasAdminTestV236-1723358146 tempest-QuotasAdminTestV236-1723358146-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/0da0997d32f248d0ba6fe26ccb0e60e4?user_id=9c420ada25594d48b3886759f0ed791f" status: 200 len: 240 microversion: 2.36 time: 0.261041 Sep 17 20:58:03.622909 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 891/1859] 10.222.0.26 () {62 vars in 1384 bytes} [Sat Sep 17 20:58:03 2022] PUT /compute/v2.1/os-quota-sets/0da0997d32f248d0ba6fe26ccb0e60e4?user_id=9c420ada25594d48b3886759f0ed791f => generated 240 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 17 20:58:03.642349 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f8e06e99-7d85-47bc-a40c-e5116ef9b26a tempest-QuotasAdminTestV236-1723358146 tempest-QuotasAdminTestV236-1723358146-project-admin] Calling method '.version_select at 0x7f25a4f1d8b0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:03.698454 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ca4ea538-c35b-42c2-9bec-d49940ec9ad6 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db879fde0bd4bea81374a7f7bb627e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cdbed43ed4de6b4cb7e1cd4802b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:03.707190 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ca4ea538-c35b-42c2-9bec-d49940ec9ad6 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] 10.222.0.26 "GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678" status: 200 len: 1221 microversion: 2.1 time: 0.141998 Sep 17 20:58:03.708300 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 969/1860] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:03 2022] GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678 => generated 1221 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:03.768743 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f8e06e99-7d85-47bc-a40c-e5116ef9b26a tempest-QuotasAdminTestV236-1723358146 tempest-QuotasAdminTestV236-1723358146-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/0da0997d32f248d0ba6fe26ccb0e60e4?user_id=9c420ada25594d48b3886759f0ed791f" status: 200 len: 282 microversion: 2.36 time: 0.137902 Sep 17 20:58:03.770342 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 892/1861] 10.222.0.26 () {60 vars in 1364 bytes} [Sat Sep 17 20:58:03 2022] GET /compute/v2.1/os-quota-sets/0da0997d32f248d0ba6fe26ccb0e60e4?user_id=9c420ada25594d48b3886759f0ed791f => generated 282 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:58:03.850997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-76816598-2ea3-40af-83c1-b895a503c439 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:03.851622 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-76816598-2ea3-40af-83c1-b895a503c439 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: bf08d895-d8f9-440d-8ade-fbc47dc6bde4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:03.863144 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76816598-2ea3-40af-83c1-b895a503c439 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:03.864023 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76816598-2ea3-40af-83c1-b895a503c439 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:03.864644 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76816598-2ea3-40af-83c1-b895a503c439 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:03.865995 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76816598-2ea3-40af-83c1-b895a503c439 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:03.867407 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76816598-2ea3-40af-83c1-b895a503c439 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:03.868479 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76816598-2ea3-40af-83c1-b895a503c439 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:03.976112 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-76816598-2ea3-40af-83c1-b895a503c439 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:03.988366 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-76816598-2ea3-40af-83c1-b895a503c439 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4" status: 200 len: 1212 microversion: 2.1 time: 0.141116 Sep 17 20:58:03.991287 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 970/1862] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:03 2022] GET /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4 => generated 1212 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:04.041426 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9162ae0c-7706-4650-97d1-10f922486225 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:04.042499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9162ae0c-7706-4650-97d1-10f922486225 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: c9fe0176-1bcf-4719-a87f-17b0e0c41b6c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:04.051253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9162ae0c-7706-4650-97d1-10f922486225 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:04.052124 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9162ae0c-7706-4650-97d1-10f922486225 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:04.052769 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9162ae0c-7706-4650-97d1-10f922486225 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:04.053730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9162ae0c-7706-4650-97d1-10f922486225 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:04.054370 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9162ae0c-7706-4650-97d1-10f922486225 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:04.054969 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9162ae0c-7706-4650-97d1-10f922486225 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:04.168983 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-989d115a-fe4b-4c4d-bd90-7b142d32ede0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:04.169969 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-989d115a-fe4b-4c4d-bd90-7b142d32ede0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: e8e78e88-e04b-497b-bef8-c4b57aff1d1d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:04.184826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-989d115a-fe4b-4c4d-bd90-7b142d32ede0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:04.186847 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-989d115a-fe4b-4c4d-bd90-7b142d32ede0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:04.187711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-989d115a-fe4b-4c4d-bd90-7b142d32ede0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:04.190465 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-989d115a-fe4b-4c4d-bd90-7b142d32ede0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:04.191226 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-989d115a-fe4b-4c4d-bd90-7b142d32ede0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:04.192852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-989d115a-fe4b-4c4d-bd90-7b142d32ede0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:04.404694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-989d115a-fe4b-4c4d-bd90-7b142d32ede0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:04.422618 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-989d115a-fe4b-4c4d-bd90-7b142d32ede0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d" status: 200 len: 1270 microversion: 2.1 time: 0.258420 Sep 17 20:58:04.423174 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9162ae0c-7706-4650-97d1-10f922486225 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:04.433270 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9162ae0c-7706-4650-97d1-10f922486225 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c" status: 200 len: 1314 microversion: 2.1 time: 0.395782 Sep 17 20:58:04.436236 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 893/1863] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:04 2022] GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:04.437903 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 971/1864] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:04 2022] GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d => generated 1270 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:04.462664 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-09744aa6-578b-41c3-92f7-3f9318e34883 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:04.463790 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-09744aa6-578b-41c3-92f7-3f9318e34883 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: f3e67571-f038-485c-8685-af24123a5c10] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:04.480807 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09744aa6-578b-41c3-92f7-3f9318e34883 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:04.482453 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09744aa6-578b-41c3-92f7-3f9318e34883 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:04.484162 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09744aa6-578b-41c3-92f7-3f9318e34883 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:04.486066 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09744aa6-578b-41c3-92f7-3f9318e34883 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:04.488245 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09744aa6-578b-41c3-92f7-3f9318e34883 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:04.488717 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09744aa6-578b-41c3-92f7-3f9318e34883 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:04.710056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-d3af8b21-312b-4a7d-b269-60c98c54c4f6 req-ccc1a12a-a1a7-476d-b291-e6bc65a4e773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be2b42c6-7d99-48b0-b515-26a7139e11aa", "name": "network-vif-deleted", "tag": "6eb514c0-157c-49ae-bba8-9c080043b38a"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:04.730642 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d3af8b21-312b-4a7d-b269-60c98c54c4f6 req-ccc1a12a-a1a7-476d-b291-e6bc65a4e773 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:04.733608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d3af8b21-312b-4a7d-b269-60c98c54c4f6 req-ccc1a12a-a1a7-476d-b291-e6bc65a4e773 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:04.734303 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d3af8b21-312b-4a7d-b269-60c98c54c4f6 req-ccc1a12a-a1a7-476d-b291-e6bc65a4e773 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:04.749797 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-d3af8b21-312b-4a7d-b269-60c98c54c4f6 req-ccc1a12a-a1a7-476d-b291-e6bc65a4e773 service nova] Creating event network-vif-deleted:6eb514c0-157c-49ae-bba8-9c080043b38a for instance be2b42c6-7d99-48b0-b515-26a7139e11aa on nch2-master-1 Sep 17 20:58:04.758974 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-d3af8b21-312b-4a7d-b269-60c98c54c4f6 req-ccc1a12a-a1a7-476d-b291-e6bc65a4e773 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052479 Sep 17 20:58:04.760918 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 972/1865] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:04.779351 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4005b8a9-a392-4073-b45d-4b3526108594 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:04.780449 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4005b8a9-a392-4073-b45d-4b3526108594 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] [instance: a6f98038-008a-49b5-968e-bcb0791d4678] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:04.803177 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4005b8a9-a392-4073-b45d-4b3526108594 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:04.810420 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4005b8a9-a392-4073-b45d-4b3526108594 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:04.823758 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4005b8a9-a392-4073-b45d-4b3526108594 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:04.824559 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4005b8a9-a392-4073-b45d-4b3526108594 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:04.825054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4005b8a9-a392-4073-b45d-4b3526108594 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:04.827499 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4005b8a9-a392-4073-b45d-4b3526108594 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:04.893727 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-09744aa6-578b-41c3-92f7-3f9318e34883 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:04.904124 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-09744aa6-578b-41c3-92f7-3f9318e34883 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10" status: 200 len: 1675 microversion: 2.1 time: 0.446130 Sep 17 20:58:04.909166 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 894/1866] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:04 2022] GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10 => generated 1675 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:58:05.020156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6c94142f-63a8-4964-8103-7869b8fff76b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:05.021285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6c94142f-63a8-4964-8103-7869b8fff76b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: bf08d895-d8f9-440d-8ade-fbc47dc6bde4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:05.036493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6c94142f-63a8-4964-8103-7869b8fff76b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:05.041975 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6c94142f-63a8-4964-8103-7869b8fff76b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:05.042625 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6c94142f-63a8-4964-8103-7869b8fff76b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:05.045518 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6c94142f-63a8-4964-8103-7869b8fff76b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:05.048737 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6c94142f-63a8-4964-8103-7869b8fff76b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:05.050287 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6c94142f-63a8-4964-8103-7869b8fff76b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:05.083933 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4005b8a9-a392-4073-b45d-4b3526108594 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db879fde0bd4bea81374a7f7bb627e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cdbed43ed4de6b4cb7e1cd4802b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:05.103987 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4005b8a9-a392-4073-b45d-4b3526108594 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] 10.222.0.26 "GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678" status: 200 len: 1277 microversion: 2.1 time: 0.341417 Sep 17 20:58:05.111539 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 973/1867] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:04 2022] GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678 => generated 1277 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:05.223924 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6c94142f-63a8-4964-8103-7869b8fff76b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:05.233942 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6c94142f-63a8-4964-8103-7869b8fff76b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4" status: 200 len: 1260 microversion: 2.1 time: 0.218841 Sep 17 20:58:05.235317 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 895/1868] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:05 2022] GET /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4 => generated 1260 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:58:05.446984 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e15b59cf-5a19-460a-8c5a-1fdb2f808a0f tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:05.448283 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e15b59cf-5a19-460a-8c5a-1fdb2f808a0f tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: e8e78e88-e04b-497b-bef8-c4b57aff1d1d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:05.461204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e0d3e063-5a6a-4ad8-a521-9233022c8255 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:05.462124 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e0d3e063-5a6a-4ad8-a521-9233022c8255 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: c9fe0176-1bcf-4719-a87f-17b0e0c41b6c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:05.465804 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e15b59cf-5a19-460a-8c5a-1fdb2f808a0f tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:05.466922 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e15b59cf-5a19-460a-8c5a-1fdb2f808a0f tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:05.467590 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e15b59cf-5a19-460a-8c5a-1fdb2f808a0f tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:05.471070 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0d3e063-5a6a-4ad8-a521-9233022c8255 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:05.472211 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e15b59cf-5a19-460a-8c5a-1fdb2f808a0f tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:05.473197 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e15b59cf-5a19-460a-8c5a-1fdb2f808a0f tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:05.473939 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e15b59cf-5a19-460a-8c5a-1fdb2f808a0f tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:05.475648 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0d3e063-5a6a-4ad8-a521-9233022c8255 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:05.476115 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0d3e063-5a6a-4ad8-a521-9233022c8255 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:05.476879 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0d3e063-5a6a-4ad8-a521-9233022c8255 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:05.477347 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0d3e063-5a6a-4ad8-a521-9233022c8255 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:05.478009 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0d3e063-5a6a-4ad8-a521-9233022c8255 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:05.682846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e15b59cf-5a19-460a-8c5a-1fdb2f808a0f tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:05.712075 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e15b59cf-5a19-460a-8c5a-1fdb2f808a0f tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d" status: 200 len: 1276 microversion: 2.1 time: 0.268792 Sep 17 20:58:05.712639 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 974/1869] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:05 2022] GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d => generated 1276 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:05.944491 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-08bfd3cb-c912-4a95-ac48-8e557e0dc997 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:05.945642 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-08bfd3cb-c912-4a95-ac48-8e557e0dc997 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: f3e67571-f038-485c-8685-af24123a5c10] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:05.958499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e0d3e063-5a6a-4ad8-a521-9233022c8255 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:05.962224 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-08bfd3cb-c912-4a95-ac48-8e557e0dc997 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:05.962797 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-08bfd3cb-c912-4a95-ac48-8e557e0dc997 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:05.963240 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-08bfd3cb-c912-4a95-ac48-8e557e0dc997 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:05.964291 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-08bfd3cb-c912-4a95-ac48-8e557e0dc997 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:05.964423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-08bfd3cb-c912-4a95-ac48-8e557e0dc997 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:05.964860 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-08bfd3cb-c912-4a95-ac48-8e557e0dc997 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:05.970300 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e0d3e063-5a6a-4ad8-a521-9233022c8255 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c" status: 200 len: 1314 microversion: 2.1 time: 0.513734 Sep 17 20:58:05.971374 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 896/1870] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:05 2022] GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c => generated 1314 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:58:06.136701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5a38d36c-d43a-46eb-a83c-921f0c6d1e57 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:06.137776 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5a38d36c-d43a-46eb-a83c-921f0c6d1e57 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] [instance: a6f98038-008a-49b5-968e-bcb0791d4678] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:06.153225 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5a38d36c-d43a-46eb-a83c-921f0c6d1e57 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:06.155299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5a38d36c-d43a-46eb-a83c-921f0c6d1e57 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:06.156706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5a38d36c-d43a-46eb-a83c-921f0c6d1e57 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:06.159291 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5a38d36c-d43a-46eb-a83c-921f0c6d1e57 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:06.160351 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5a38d36c-d43a-46eb-a83c-921f0c6d1e57 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:06.162425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5a38d36c-d43a-46eb-a83c-921f0c6d1e57 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:06.252237 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-08bfd3cb-c912-4a95-ac48-8e557e0dc997 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:06.269603 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-08bfd3cb-c912-4a95-ac48-8e557e0dc997 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10" status: 200 len: 1675 microversion: 2.1 time: 0.337229 Sep 17 20:58:06.275303 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 975/1871] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:05 2022] GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10 => generated 1675 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:06.290528 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-be88be2e-33dc-44b4-b2af-6e07086de476 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:06.291859 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-be88be2e-33dc-44b4-b2af-6e07086de476 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:06.310371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be88be2e-33dc-44b4-b2af-6e07086de476 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:06.312942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be88be2e-33dc-44b4-b2af-6e07086de476 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:06.313526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be88be2e-33dc-44b4-b2af-6e07086de476 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:06.315909 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be88be2e-33dc-44b4-b2af-6e07086de476 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:06.316468 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be88be2e-33dc-44b4-b2af-6e07086de476 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:06.316912 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be88be2e-33dc-44b4-b2af-6e07086de476 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:06.380915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-be88be2e-33dc-44b4-b2af-6e07086de476 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:58:06.479785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5a38d36c-d43a-46eb-a83c-921f0c6d1e57 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db879fde0bd4bea81374a7f7bb627e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cdbed43ed4de6b4cb7e1cd4802b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:06.501765 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5a38d36c-d43a-46eb-a83c-921f0c6d1e57 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] 10.222.0.26 "GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678" status: 200 len: 1283 microversion: 2.1 time: 0.368908 Sep 17 20:58:06.503005 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 897/1872] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:06 2022] GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678 => generated 1283 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:06.512898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-649e886e-9531-4c17-852e-fd47587fe081 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:06.518371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-649e886e-9531-4c17-852e-fd47587fe081 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: bf08d895-d8f9-440d-8ade-fbc47dc6bde4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:06.532267 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-649e886e-9531-4c17-852e-fd47587fe081 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:06.534426 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-649e886e-9531-4c17-852e-fd47587fe081 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:06.535679 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-649e886e-9531-4c17-852e-fd47587fe081 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:06.536796 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-649e886e-9531-4c17-852e-fd47587fe081 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:06.537562 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-649e886e-9531-4c17-852e-fd47587fe081 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:06.539210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-649e886e-9531-4c17-852e-fd47587fe081 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:06.546889 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-be88be2e-33dc-44b4-b2af-6e07086de476 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9" status: 204 len: 0 microversion: 2.1 time: 0.268130 Sep 17 20:58:06.548387 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 976/1873] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:58:06 2022] DELETE /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:58:06.562266 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-01b9b591-7e60-42e1-8ba6-7135c3e88adc req-294943e5-4d5c-48d4-b00d-f3139daf6882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9fe0176-1bcf-4719-a87f-17b0e0c41b6c", "name": "network-vif-plugged", "status": "completed", "tag": "426f4af4-d3cb-4129-98a4-e9ba8b33cab4"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:06.590613 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-01b9b591-7e60-42e1-8ba6-7135c3e88adc req-294943e5-4d5c-48d4-b00d-f3139daf6882 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:06.591810 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-01b9b591-7e60-42e1-8ba6-7135c3e88adc req-294943e5-4d5c-48d4-b00d-f3139daf6882 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:06.592683 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-01b9b591-7e60-42e1-8ba6-7135c3e88adc req-294943e5-4d5c-48d4-b00d-f3139daf6882 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:06.611616 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-01b9b591-7e60-42e1-8ba6-7135c3e88adc req-294943e5-4d5c-48d4-b00d-f3139daf6882 service nova] Creating event network-vif-plugged:426f4af4-d3cb-4129-98a4-e9ba8b33cab4 for instance c9fe0176-1bcf-4719-a87f-17b0e0c41b6c on nch2-master-1 Sep 17 20:58:06.621511 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-01b9b591-7e60-42e1-8ba6-7135c3e88adc req-294943e5-4d5c-48d4-b00d-f3139daf6882 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070963 Sep 17 20:58:06.622107 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 977/1874] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:06.633714 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cd855d16-313c-49b8-b155-5bc3f1aeb1c3 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:06.634931 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cd855d16-313c-49b8-b155-5bc3f1aeb1c3 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:06.643599 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd855d16-313c-49b8-b155-5bc3f1aeb1c3 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:06.644352 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd855d16-313c-49b8-b155-5bc3f1aeb1c3 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:06.645208 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd855d16-313c-49b8-b155-5bc3f1aeb1c3 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:06.646580 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd855d16-313c-49b8-b155-5bc3f1aeb1c3 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:06.647039 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd855d16-313c-49b8-b155-5bc3f1aeb1c3 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:06.647673 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd855d16-313c-49b8-b155-5bc3f1aeb1c3 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:06.663359 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-649e886e-9531-4c17-852e-fd47587fe081 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:06.671867 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-649e886e-9531-4c17-852e-fd47587fe081 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4" status: 200 len: 1266 microversion: 2.1 time: 0.166046 Sep 17 20:58:06.688295 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 898/1875] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:06 2022] GET /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:06.739027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-eff85ccb-c919-4129-9c2d-b9a3357f9b5d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:06.739573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-eff85ccb-c919-4129-9c2d-b9a3357f9b5d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: e8e78e88-e04b-497b-bef8-c4b57aff1d1d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:06.746887 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eff85ccb-c919-4129-9c2d-b9a3357f9b5d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:06.747653 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eff85ccb-c919-4129-9c2d-b9a3357f9b5d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:06.750045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eff85ccb-c919-4129-9c2d-b9a3357f9b5d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:06.750352 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eff85ccb-c919-4129-9c2d-b9a3357f9b5d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:06.751673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eff85ccb-c919-4129-9c2d-b9a3357f9b5d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:06.753564 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eff85ccb-c919-4129-9c2d-b9a3357f9b5d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:06.886584 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-eff85ccb-c919-4129-9c2d-b9a3357f9b5d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:06.910031 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-eff85ccb-c919-4129-9c2d-b9a3357f9b5d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d" status: 200 len: 1276 microversion: 2.1 time: 0.175092 Sep 17 20:58:06.912692 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 899/1876] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:06 2022] GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d => generated 1276 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:58:06.984204 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cd855d16-313c-49b8-b155-5bc3f1aeb1c3 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:07.001414 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cd855d16-313c-49b8-b155-5bc3f1aeb1c3 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9" status: 200 len: 1485 microversion: 2.1 time: 0.373864 Sep 17 20:58:07.006440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2caaff02-0f8e-400f-9148-8c7c65be342d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:07.008629 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2caaff02-0f8e-400f-9148-8c7c65be342d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: c9fe0176-1bcf-4719-a87f-17b0e0c41b6c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:07.014190 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 978/1877] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:06 2022] GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 => generated 1485 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:07.029270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2caaff02-0f8e-400f-9148-8c7c65be342d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:07.031171 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2caaff02-0f8e-400f-9148-8c7c65be342d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:07.033189 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2caaff02-0f8e-400f-9148-8c7c65be342d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:07.038250 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2caaff02-0f8e-400f-9148-8c7c65be342d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:07.043070 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2caaff02-0f8e-400f-9148-8c7c65be342d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:07.050831 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2caaff02-0f8e-400f-9148-8c7c65be342d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:07.302902 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-132fba4c-0788-4a90-8f52-489b2ab68877 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:07.303563 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-132fba4c-0788-4a90-8f52-489b2ab68877 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: f3e67571-f038-485c-8685-af24123a5c10] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:07.314458 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-132fba4c-0788-4a90-8f52-489b2ab68877 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:07.314958 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-132fba4c-0788-4a90-8f52-489b2ab68877 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:07.315402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-132fba4c-0788-4a90-8f52-489b2ab68877 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:07.316130 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-132fba4c-0788-4a90-8f52-489b2ab68877 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:07.316740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-132fba4c-0788-4a90-8f52-489b2ab68877 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:07.319815 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-132fba4c-0788-4a90-8f52-489b2ab68877 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:07.587457 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2caaff02-0f8e-400f-9148-8c7c65be342d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:07.598187 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2caaff02-0f8e-400f-9148-8c7c65be342d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c" status: 200 len: 1314 microversion: 2.1 time: 0.606133 Sep 17 20:58:07.599200 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 900/1878] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:06 2022] GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c => generated 1314 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:07.603896 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-f977af82-9e5a-41aa-b8d9-d598cb944397 req-c9d53941-5af7-46c5-b44d-e0387773ccef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3e67571-f038-485c-8685-af24123a5c10", "name": "network-vif-deleted", "tag": "e4f76359-697f-489f-b5c5-59f550eaca0f"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:07.647737 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f977af82-9e5a-41aa-b8d9-d598cb944397 req-c9d53941-5af7-46c5-b44d-e0387773ccef service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:07.653516 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f977af82-9e5a-41aa-b8d9-d598cb944397 req-c9d53941-5af7-46c5-b44d-e0387773ccef service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:07.654200 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f977af82-9e5a-41aa-b8d9-d598cb944397 req-c9d53941-5af7-46c5-b44d-e0387773ccef service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:07.696984 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-f977af82-9e5a-41aa-b8d9-d598cb944397 req-c9d53941-5af7-46c5-b44d-e0387773ccef service nova] Creating event network-vif-deleted:e4f76359-697f-489f-b5c5-59f550eaca0f for instance f3e67571-f038-485c-8685-af24123a5c10 on nch1-master-1 Sep 17 20:58:07.723230 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-f977af82-9e5a-41aa-b8d9-d598cb944397 req-c9d53941-5af7-46c5-b44d-e0387773ccef service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112065 Sep 17 20:58:07.724270 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 901/1879] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:07.732164 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f3819b01-e9d7-47ba-add3-068baf3127ae tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:07.737612 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f3819b01-e9d7-47ba-add3-068baf3127ae tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] [instance: a6f98038-008a-49b5-968e-bcb0791d4678] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:07.757313 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f3819b01-e9d7-47ba-add3-068baf3127ae tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:07.758080 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f3819b01-e9d7-47ba-add3-068baf3127ae tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:07.759385 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f3819b01-e9d7-47ba-add3-068baf3127ae tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:07.760315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f3819b01-e9d7-47ba-add3-068baf3127ae tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:07.760965 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f3819b01-e9d7-47ba-add3-068baf3127ae tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:07.761623 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f3819b01-e9d7-47ba-add3-068baf3127ae tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:07.972313 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-132fba4c-0788-4a90-8f52-489b2ab68877 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:07.977718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:58:07.986919 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-132fba4c-0788-4a90-8f52-489b2ab68877 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10" status: 200 len: 1654 microversion: 2.1 time: 0.690200 Sep 17 20:58:08.012837 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 979/1880] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:07 2022] GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10 => generated 1654 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:58:08.022303 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-abd25349-7858-4cc0-8cc9-2f018ad3de57 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:08.025848 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-abd25349-7858-4cc0-8cc9-2f018ad3de57 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: bf08d895-d8f9-440d-8ade-fbc47dc6bde4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:08.039971 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abd25349-7858-4cc0-8cc9-2f018ad3de57 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:08.041924 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abd25349-7858-4cc0-8cc9-2f018ad3de57 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:08.043164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abd25349-7858-4cc0-8cc9-2f018ad3de57 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:08.044649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abd25349-7858-4cc0-8cc9-2f018ad3de57 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:08.047441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abd25349-7858-4cc0-8cc9-2f018ad3de57 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:08.048166 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abd25349-7858-4cc0-8cc9-2f018ad3de57 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:08.265561 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f3819b01-e9d7-47ba-add3-068baf3127ae tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db879fde0bd4bea81374a7f7bb627e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cdbed43ed4de6b4cb7e1cd4802b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:08.267087 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-abd25349-7858-4cc0-8cc9-2f018ad3de57 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:08.279299 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f3819b01-e9d7-47ba-add3-068baf3127ae tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] 10.222.0.26 "GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678" status: 200 len: 1325 microversion: 2.1 time: 0.552240 Sep 17 20:58:08.280164 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 902/1881] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:07 2022] GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678 => generated 1325 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:08.281850 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-abd25349-7858-4cc0-8cc9-2f018ad3de57 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4" status: 200 len: 1266 microversion: 2.1 time: 0.262320 Sep 17 20:58:08.294224 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 980/1882] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:08 2022] GET /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4 => generated 1266 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:08.303890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a3fa3be3-9cd6-459c-b312-9d66a1ee669f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:08.304834 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a3fa3be3-9cd6-459c-b312-9d66a1ee669f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:08.306276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e2ac70d9-0243-4c66-a32a-74fa20d8d8be tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:08.306924 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e2ac70d9-0243-4c66-a32a-74fa20d8d8be tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: e8e78e88-e04b-497b-bef8-c4b57aff1d1d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:08.311970 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a3fa3be3-9cd6-459c-b312-9d66a1ee669f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:08.312471 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a3fa3be3-9cd6-459c-b312-9d66a1ee669f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:08.312918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a3fa3be3-9cd6-459c-b312-9d66a1ee669f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:08.313711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a3fa3be3-9cd6-459c-b312-9d66a1ee669f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:08.314180 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a3fa3be3-9cd6-459c-b312-9d66a1ee669f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:08.314701 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a3fa3be3-9cd6-459c-b312-9d66a1ee669f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:08.315476 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2ac70d9-0243-4c66-a32a-74fa20d8d8be tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:08.316525 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2ac70d9-0243-4c66-a32a-74fa20d8d8be tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:08.317129 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2ac70d9-0243-4c66-a32a-74fa20d8d8be tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:08.318090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2ac70d9-0243-4c66-a32a-74fa20d8d8be tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:08.319663 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2ac70d9-0243-4c66-a32a-74fa20d8d8be tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:08.320102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2ac70d9-0243-4c66-a32a-74fa20d8d8be tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:08.772952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a3fa3be3-9cd6-459c-b312-9d66a1ee669f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:08.797221 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a3fa3be3-9cd6-459c-b312-9d66a1ee669f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9" status: 200 len: 1485 microversion: 2.1 time: 0.498126 Sep 17 20:58:08.797221 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 981/1883] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:08 2022] GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 => generated 1485 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:08.803444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bca5982b-b5ab-464e-a945-7704bb02fada tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:08.805235 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bca5982b-b5ab-464e-a945-7704bb02fada tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: c9fe0176-1bcf-4719-a87f-17b0e0c41b6c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:08.819625 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bca5982b-b5ab-464e-a945-7704bb02fada tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:08.820883 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bca5982b-b5ab-464e-a945-7704bb02fada tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:08.821818 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bca5982b-b5ab-464e-a945-7704bb02fada tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:08.822858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bca5982b-b5ab-464e-a945-7704bb02fada tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:08.823578 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bca5982b-b5ab-464e-a945-7704bb02fada tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:08.824296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bca5982b-b5ab-464e-a945-7704bb02fada tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:08.829433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e2ac70d9-0243-4c66-a32a-74fa20d8d8be tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:08.838607 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e2ac70d9-0243-4c66-a32a-74fa20d8d8be tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d" status: 200 len: 1318 microversion: 2.1 time: 0.540862 Sep 17 20:58:08.839451 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 903/1884] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:08 2022] GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d => generated 1318 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:08.844485 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-01c2b3e0-8e1a-4dd0-9d48-858d492c3c67 req-ed546b31-83d3-454d-99cd-65b0fb4a7d46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3e67571-f038-485c-8685-af24123a5c10", "name": "network-vif-unplugged", "status": "completed", "tag": "73929564-1075-468b-8252-81e6069bec7a"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:08.854395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-01c2b3e0-8e1a-4dd0-9d48-858d492c3c67 req-ed546b31-83d3-454d-99cd-65b0fb4a7d46 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:08.855147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-01c2b3e0-8e1a-4dd0-9d48-858d492c3c67 req-ed546b31-83d3-454d-99cd-65b0fb4a7d46 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:08.855749 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-01c2b3e0-8e1a-4dd0-9d48-858d492c3c67 req-ed546b31-83d3-454d-99cd-65b0fb4a7d46 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:08.866885 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:58:08.869330 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-01c2b3e0-8e1a-4dd0-9d48-858d492c3c67 req-ed546b31-83d3-454d-99cd-65b0fb4a7d46 service nova] Creating event network-vif-unplugged:73929564-1075-468b-8252-81e6069bec7a for instance f3e67571-f038-485c-8685-af24123a5c10 on nch1-master-1 Sep 17 20:58:08.876147 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-01c2b3e0-8e1a-4dd0-9d48-858d492c3c67 req-ed546b31-83d3-454d-99cd-65b0fb4a7d46 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035321 Sep 17 20:58:08.882627 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 904/1885] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:09.021350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a35e7c51-946f-40c9-8909-a99b635b74e5 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:09.024129 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a35e7c51-946f-40c9-8909-a99b635b74e5 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: f3e67571-f038-485c-8685-af24123a5c10] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:09.044740 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a35e7c51-946f-40c9-8909-a99b635b74e5 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:09.045886 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a35e7c51-946f-40c9-8909-a99b635b74e5 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:09.054609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a35e7c51-946f-40c9-8909-a99b635b74e5 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:09.056575 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a35e7c51-946f-40c9-8909-a99b635b74e5 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:09.057153 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a35e7c51-946f-40c9-8909-a99b635b74e5 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:09.064017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a35e7c51-946f-40c9-8909-a99b635b74e5 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:09.824401 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a35e7c51-946f-40c9-8909-a99b635b74e5 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc22daf24ce44eb28bb6e000316e4df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '400242d681ab472d9c90de4fc7da202b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:09.832443 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a35e7c51-946f-40c9-8909-a99b635b74e5 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10" status: 200 len: 1454 microversion: 2.1 time: 0.818838 Sep 17 20:58:09.837663 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 905/1886] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:09 2022] GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10 => generated 1454 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:58:09.846786 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f7ad5893-6869-408c-878b-5b52b1b9ae2e tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:09.847411 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f7ad5893-6869-408c-878b-5b52b1b9ae2e tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] [instance: a6f98038-008a-49b5-968e-bcb0791d4678] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:09.857988 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bca5982b-b5ab-464e-a945-7704bb02fada tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:09.866772 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bca5982b-b5ab-464e-a945-7704bb02fada tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c" status: 200 len: 1501 microversion: 2.1 time: 1.070608 Sep 17 20:58:09.870619 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f7ad5893-6869-408c-878b-5b52b1b9ae2e tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:09.871121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f7ad5893-6869-408c-878b-5b52b1b9ae2e tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:09.871572 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f7ad5893-6869-408c-878b-5b52b1b9ae2e tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:09.872271 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f7ad5893-6869-408c-878b-5b52b1b9ae2e tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:09.872867 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f7ad5893-6869-408c-878b-5b52b1b9ae2e tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:09.873149 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f7ad5893-6869-408c-878b-5b52b1b9ae2e tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:09.873828 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 982/1887] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:08 2022] GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c => generated 1501 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:09.887280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-42db33e2-c92d-4855-b44f-064ef3713ca6 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:09.887280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-42db33e2-c92d-4855-b44f-064ef3713ca6 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: bf08d895-d8f9-440d-8ade-fbc47dc6bde4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:09.908847 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42db33e2-c92d-4855-b44f-064ef3713ca6 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:09.909355 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42db33e2-c92d-4855-b44f-064ef3713ca6 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:09.909846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42db33e2-c92d-4855-b44f-064ef3713ca6 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:09.910561 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42db33e2-c92d-4855-b44f-064ef3713ca6 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:09.913582 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42db33e2-c92d-4855-b44f-064ef3713ca6 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:09.914216 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42db33e2-c92d-4855-b44f-064ef3713ca6 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:10.427932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f7ad5893-6869-408c-878b-5b52b1b9ae2e tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db879fde0bd4bea81374a7f7bb627e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cdbed43ed4de6b4cb7e1cd4802b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:10.442086 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f7ad5893-6869-408c-878b-5b52b1b9ae2e tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] 10.222.0.26 "GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678" status: 200 len: 1325 microversion: 2.1 time: 0.603176 Sep 17 20:58:10.454225 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 906/1888] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:09 2022] GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678 => generated 1325 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:10.459465 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-06e94b3f-7d61-4525-b02d-08a4ec25786f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:10.466495 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-06e94b3f-7d61-4525-b02d-08a4ec25786f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:10.490746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:58:10.491728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-42db33e2-c92d-4855-b44f-064ef3713ca6 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:10.492722 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06e94b3f-7d61-4525-b02d-08a4ec25786f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:10.493386 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06e94b3f-7d61-4525-b02d-08a4ec25786f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:10.494037 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06e94b3f-7d61-4525-b02d-08a4ec25786f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:10.494931 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06e94b3f-7d61-4525-b02d-08a4ec25786f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:10.495551 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06e94b3f-7d61-4525-b02d-08a4ec25786f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:10.496145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06e94b3f-7d61-4525-b02d-08a4ec25786f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:10.503909 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-42db33e2-c92d-4855-b44f-064ef3713ca6 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4" status: 200 len: 1308 microversion: 2.1 time: 0.628899 Sep 17 20:58:10.505638 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 983/1889] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:09 2022] GET /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4 => generated 1308 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:10.521662 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-01c27a3b-f27c-4911-9da5-bb34836ef5c3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:10.524494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-01c27a3b-f27c-4911-9da5-bb34836ef5c3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: e8e78e88-e04b-497b-bef8-c4b57aff1d1d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:10.527634 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-06e94b3f-7d61-4525-b02d-08a4ec25786f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] HTTP exception thrown: Instance 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 could not be found. Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-06e94b3f-7d61-4525-b02d-08a4ec25786f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Request method failure captured: Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 HTTP/1.1 Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjO4pMSDFI6Atu5kbd_vlRhbyV_fyPw2gdOrFx1mEyl4rL_CZavLzFaFFTIrDXVeI9bf87zTa9lzT1hke8Y8KagCjBPhEyXkmiJUAOGfheh5EfefZfrn_wGqKtQ01RGpNIahNrBgvi-tWdhaJbgej8MzwbEe3UEoa8f3i5egIziHROo Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: f6b44bc44e7c4a998bfd99e7d11e99fc Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-LiveMigrationTest-128259988 Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f6b44bc44e7c4a998bfd99e7d11e99fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f6b44bc44e7c4a998bfd99e7d11e99fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f6b44bc44e7c4a998bfd99e7d11e99fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f6b44bc44e7c4a998bfd99e7d11e99fc", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-LiveMigrationTest-128259988 Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: f6b44bc44e7c4a998bfd99e7d11e99fc Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-LiveMigrationTest-128259988 Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-LiveMigrationTest-128259988-project Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 9c2b746b7c194596808a7b0c736f3b53 Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-LiveMigrationTest-128259988-project Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 could not be found. Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '4b3f5764-d941-4ddb-80fc-3e7b6409f7d9'} Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 could not be found. Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 could not be found. Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:10.529097 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:10.536812 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:10.536812 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:10.536812 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:10.536812 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:58:10.536812 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:58:10.536812 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 could not be found. Sep 17 20:58:10.536812 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:10.542058 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-06e94b3f-7d61-4525-b02d-08a4ec25786f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Returning 404 to user: Instance 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:58:10.543016 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-06e94b3f-7d61-4525-b02d-08a4ec25786f tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9" status: 404 len: 111 microversion: 2.1 time: 0.087541 Sep 17 20:58:10.543791 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 907/1890] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:10 2022] GET /compute/v2.1/servers/4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:58:10.544235 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-01c27a3b-f27c-4911-9da5-bb34836ef5c3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:10.544905 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-01c27a3b-f27c-4911-9da5-bb34836ef5c3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:10.546841 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-01c27a3b-f27c-4911-9da5-bb34836ef5c3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:10.547905 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-01c27a3b-f27c-4911-9da5-bb34836ef5c3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:10.549597 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-01c27a3b-f27c-4911-9da5-bb34836ef5c3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:10.549885 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-13eaecf6-0829-428c-8a72-dc6759610297 req-006d3b85-6673-448c-96bd-a6b8841855ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3e67571-f038-485c-8685-af24123a5c10", "name": "network-vif-deleted", "tag": "73929564-1075-468b-8252-81e6069bec7a"}, {"server_uuid": "4b3f5764-d941-4ddb-80fc-3e7b6409f7d9", "name": "network-vif-deleted", "tag": "da68fd65-992d-49fa-b979-c348cd631ce3"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:10.551313 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-01c27a3b-f27c-4911-9da5-bb34836ef5c3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:10.570729 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-13eaecf6-0829-428c-8a72-dc6759610297 req-006d3b85-6673-448c-96bd-a6b8841855ec service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:10.571213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-13eaecf6-0829-428c-8a72-dc6759610297 req-006d3b85-6673-448c-96bd-a6b8841855ec service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:10.571644 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-13eaecf6-0829-428c-8a72-dc6759610297 req-006d3b85-6673-448c-96bd-a6b8841855ec service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:10.596803 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-13eaecf6-0829-428c-8a72-dc6759610297 req-006d3b85-6673-448c-96bd-a6b8841855ec service nova] Creating event network-vif-deleted:73929564-1075-468b-8252-81e6069bec7a for instance f3e67571-f038-485c-8685-af24123a5c10 on nch1-master-1 Sep 17 20:58:10.598789 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-13eaecf6-0829-428c-8a72-dc6759610297 req-006d3b85-6673-448c-96bd-a6b8841855ec service nova] Creating event network-vif-deleted:da68fd65-992d-49fa-b979-c348cd631ce3 for instance 4b3f5764-d941-4ddb-80fc-3e7b6409f7d9 on nch2-master-1 Sep 17 20:58:10.614336 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-13eaecf6-0829-428c-8a72-dc6759610297 req-006d3b85-6673-448c-96bd-a6b8841855ec service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.068722 Sep 17 20:58:10.617385 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 908/1891] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:10.630220 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-459a8e67-9039-46ed-82d2-0debd5166032 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:10.631509 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-459a8e67-9039-46ed-82d2-0debd5166032 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:10.640673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-459a8e67-9039-46ed-82d2-0debd5166032 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:10.643427 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-459a8e67-9039-46ed-82d2-0debd5166032 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:10.644147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-459a8e67-9039-46ed-82d2-0debd5166032 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:10.645119 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-459a8e67-9039-46ed-82d2-0debd5166032 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:10.646165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-459a8e67-9039-46ed-82d2-0debd5166032 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:10.647098 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-459a8e67-9039-46ed-82d2-0debd5166032 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:10.700034 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-459a8e67-9039-46ed-82d2-0debd5166032 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:58:10.908941 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-01c27a3b-f27c-4911-9da5-bb34836ef5c3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:10.919227 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-459a8e67-9039-46ed-82d2-0debd5166032 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1" status: 204 len: 0 microversion: 2.1 time: 0.297831 Sep 17 20:58:10.920534 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 909/1892] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:58:10 2022] DELETE /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:58:10.922787 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-01c27a3b-f27c-4911-9da5-bb34836ef5c3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d" status: 200 len: 1318 microversion: 2.1 time: 0.414347 Sep 17 20:58:10.925353 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 984/1893] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:10 2022] GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d => generated 1318 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:10.929993 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4a21d1d4-ae9f-4861-b19a-557dea5295b1 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:10.930949 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4a21d1d4-ae9f-4861-b19a-557dea5295b1 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: f3e67571-f038-485c-8685-af24123a5c10] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:10.940917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a21d1d4-ae9f-4861-b19a-557dea5295b1 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:10.948304 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a21d1d4-ae9f-4861-b19a-557dea5295b1 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:10.948983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a21d1d4-ae9f-4861-b19a-557dea5295b1 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:10.949313 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-18c0aa33-b8d7-4c09-a0ad-95d41e7921c5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:10.949788 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a21d1d4-ae9f-4861-b19a-557dea5295b1 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:10.950268 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a21d1d4-ae9f-4861-b19a-557dea5295b1 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:10.950700 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a21d1d4-ae9f-4861-b19a-557dea5295b1 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:10.956728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-18c0aa33-b8d7-4c09-a0ad-95d41e7921c5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:10.981764 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18c0aa33-b8d7-4c09-a0ad-95d41e7921c5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:10.982341 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18c0aa33-b8d7-4c09-a0ad-95d41e7921c5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:10.982751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18c0aa33-b8d7-4c09-a0ad-95d41e7921c5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:10.984238 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18c0aa33-b8d7-4c09-a0ad-95d41e7921c5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:10.984238 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18c0aa33-b8d7-4c09-a0ad-95d41e7921c5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:10.984654 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18c0aa33-b8d7-4c09-a0ad-95d41e7921c5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:10.999223 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-4a21d1d4-ae9f-4861-b19a-557dea5295b1 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] HTTP exception thrown: Instance f3e67571-f038-485c-8685-af24123a5c10 could not be found. Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4a21d1d4-ae9f-4861-b19a-557dea5295b1 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Request method failure captured: Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10 HTTP/1.1 Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjRq4nfGWPeRQ7QZvnGLf5y-vzIBDMTl68UT5y8pZXfg4guV28avkyxaTLFSWsXWUs9-t-k41Law6z_ozMoljlGGUJQqENEMg2zQEdFmEGMHqXuWu7zBUO8oPrqAAVMFisrczgFwZ_ORoimebWXsC5gH843V3K6Uvc01y9mMnD4zHgw Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 400242d681ab472d9c90de4fc7da202b Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersTestMultiNic-341763139 Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/400242d681ab472d9c90de4fc7da202b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/400242d681ab472d9c90de4fc7da202b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/400242d681ab472d9c90de4fc7da202b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_400242d681ab472d9c90de4fc7da202b", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersTestMultiNic-341763139 Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 400242d681ab472d9c90de4fc7da202b Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersTestMultiNic-341763139 Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersTestMultiNic-341763139-project Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: bc22daf24ce44eb28bb6e000316e4df4 Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersTestMultiNic-341763139-project Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance f3e67571-f038-485c-8685-af24123a5c10 could not be found. Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'f3e67571-f038-485c-8685-af24123a5c10'} Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3e67571-f038-485c-8685-af24123a5c10 could not be found. Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3e67571-f038-485c-8685-af24123a5c10 could not be found. Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:11.001259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:11.006723 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:11.006723 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:11.006723 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:11.006723 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:58:11.006723 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:58:11.006723 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3e67571-f038-485c-8685-af24123a5c10 could not be found. Sep 17 20:58:11.006723 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:11.006723 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4a21d1d4-ae9f-4861-b19a-557dea5295b1 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Returning 404 to user: Instance f3e67571-f038-485c-8685-af24123a5c10 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:58:11.007399 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4a21d1d4-ae9f-4861-b19a-557dea5295b1 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10" status: 404 len: 111 microversion: 2.1 time: 0.080324 Sep 17 20:58:11.007866 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 910/1894] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:10 2022] GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:58:11.408800 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-18c0aa33-b8d7-4c09-a0ad-95d41e7921c5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:11.420267 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-18c0aa33-b8d7-4c09-a0ad-95d41e7921c5 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1" status: 200 len: 1501 microversion: 2.1 time: 0.474636 Sep 17 20:58:11.428690 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 985/1895] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:10 2022] GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 => generated 1501 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:11.483903 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-30516bf6-aec4-4d11-bdee-9eee27ae6d05 req-f0d2ff21-a318-4aa2-9e1e-758a02219f0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6f98038-008a-49b5-968e-bcb0791d4678", "tag": "aa59bb33-c576-4726-a83c-85d3a6aca3b0"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:11.486022 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e5efb4ac-0f19-4545-96d8-ebb6190ed801 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:11.486931 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e5efb4ac-0f19-4545-96d8-ebb6190ed801 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] [instance: a6f98038-008a-49b5-968e-bcb0791d4678] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:11.507561 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5efb4ac-0f19-4545-96d8-ebb6190ed801 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:11.510386 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5efb4ac-0f19-4545-96d8-ebb6190ed801 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:11.511098 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5efb4ac-0f19-4545-96d8-ebb6190ed801 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:11.514277 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-30516bf6-aec4-4d11-bdee-9eee27ae6d05 req-f0d2ff21-a318-4aa2-9e1e-758a02219f0c service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:11.515467 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5efb4ac-0f19-4545-96d8-ebb6190ed801 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:11.516269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5efb4ac-0f19-4545-96d8-ebb6190ed801 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:11.517305 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5efb4ac-0f19-4545-96d8-ebb6190ed801 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:11.519341 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-30516bf6-aec4-4d11-bdee-9eee27ae6d05 req-f0d2ff21-a318-4aa2-9e1e-758a02219f0c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:11.520929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-30516bf6-aec4-4d11-bdee-9eee27ae6d05 req-f0d2ff21-a318-4aa2-9e1e-758a02219f0c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:11.553290 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-30516bf6-aec4-4d11-bdee-9eee27ae6d05 req-f0d2ff21-a318-4aa2-9e1e-758a02219f0c service nova] Creating event network-changed:aa59bb33-c576-4726-a83c-85d3a6aca3b0 for instance a6f98038-008a-49b5-968e-bcb0791d4678 on nch2-master-1 Sep 17 20:58:11.566396 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-30516bf6-aec4-4d11-bdee-9eee27ae6d05 req-f0d2ff21-a318-4aa2-9e1e-758a02219f0c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.339717 Sep 17 20:58:11.569545 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 911/1896] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:58:11.580161 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-84adc65a-00df-4152-a253-783916b9c90b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:11.584675 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-84adc65a-00df-4152-a253-783916b9c90b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: bf08d895-d8f9-440d-8ade-fbc47dc6bde4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:11.596075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84adc65a-00df-4152-a253-783916b9c90b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:11.596951 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84adc65a-00df-4152-a253-783916b9c90b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:11.597764 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84adc65a-00df-4152-a253-783916b9c90b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:11.598781 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84adc65a-00df-4152-a253-783916b9c90b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:11.599822 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84adc65a-00df-4152-a253-783916b9c90b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:11.600481 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84adc65a-00df-4152-a253-783916b9c90b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:11.976708 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e5efb4ac-0f19-4545-96d8-ebb6190ed801 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db879fde0bd4bea81374a7f7bb627e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cdbed43ed4de6b4cb7e1cd4802b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:11.994370 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-84adc65a-00df-4152-a253-783916b9c90b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:12.006206 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-84adc65a-00df-4152-a253-783916b9c90b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4" status: 200 len: 1308 microversion: 2.1 time: 0.434320 Sep 17 20:58:12.006807 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 912/1897] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:11 2022] GET /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4 => generated 1308 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:12.020021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4bb52fa9-e92f-4191-9d64-794c5377f5b3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6852ac9c-d055-4788-8316-b59dbb632040"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:12.030478 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4bb52fa9-e92f-4191-9d64-794c5377f5b3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: c9fe0176-1bcf-4719-a87f-17b0e0c41b6c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:12.041026 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bb52fa9-e92f-4191-9d64-794c5377f5b3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:12.041545 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bb52fa9-e92f-4191-9d64-794c5377f5b3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:12.041984 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bb52fa9-e92f-4191-9d64-794c5377f5b3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:12.042663 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e5efb4ac-0f19-4545-96d8-ebb6190ed801 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] 10.222.0.26 "GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678" status: 200 len: 1325 microversion: 2.1 time: 0.545027 Sep 17 20:58:12.042802 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bb52fa9-e92f-4191-9d64-794c5377f5b3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:12.050232 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 986/1898] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:11 2022] GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678 => generated 1325 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:12.065704 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bb52fa9-e92f-4191-9d64-794c5377f5b3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:12.066531 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bb52fa9-e92f-4191-9d64-794c5377f5b3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:12.082991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4a5539d2-a0b3-4685-90e9-b05154dd850c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:12.085930 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4a5539d2-a0b3-4685-90e9-b05154dd850c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: e8e78e88-e04b-497b-bef8-c4b57aff1d1d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:12.119553 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a5539d2-a0b3-4685-90e9-b05154dd850c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:12.121506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a5539d2-a0b3-4685-90e9-b05154dd850c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:12.122895 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a5539d2-a0b3-4685-90e9-b05154dd850c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:12.125830 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a5539d2-a0b3-4685-90e9-b05154dd850c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:12.128099 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a5539d2-a0b3-4685-90e9-b05154dd850c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:12.128855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a5539d2-a0b3-4685-90e9-b05154dd850c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:12.406001 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=4 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:58:12.558155 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4bb52fa9-e92f-4191-9d64-794c5377f5b3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "POST /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.541051 Sep 17 20:58:12.559372 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 913/1899] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 17 20:58:12 2022] POST /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c/os-volume_attachments => generated 194 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:12.758455 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4a5539d2-a0b3-4685-90e9-b05154dd850c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:12.782329 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4a5539d2-a0b3-4685-90e9-b05154dd850c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d" status: 200 len: 1318 microversion: 2.1 time: 0.726413 Sep 17 20:58:12.783147 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 987/1900] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:12 2022] GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d => generated 1318 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:12.795458 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-64cd1939-6c9e-431f-9c1f-f6899e4c0152 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:12.796802 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-64cd1939-6c9e-431f-9c1f-f6899e4c0152 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:12.810439 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64cd1939-6c9e-431f-9c1f-f6899e4c0152 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:12.811910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64cd1939-6c9e-431f-9c1f-f6899e4c0152 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:12.813402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64cd1939-6c9e-431f-9c1f-f6899e4c0152 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:12.814848 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64cd1939-6c9e-431f-9c1f-f6899e4c0152 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:12.816878 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64cd1939-6c9e-431f-9c1f-f6899e4c0152 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:12.817653 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64cd1939-6c9e-431f-9c1f-f6899e4c0152 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:12.825116 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=16 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:58:12.850892 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2210e50c-0b4a-4dba-a6f2-351b1864a5f3 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1021756050", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:12.921212 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-2210e50c-0b4a-4dba-a6f2-351b1864a5f3 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] validate_networks() for None {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:58:13.306331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-64cd1939-6c9e-431f-9c1f-f6899e4c0152 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:13.319387 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-64cd1939-6c9e-431f-9c1f-f6899e4c0152 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1" status: 200 len: 1501 microversion: 2.1 time: 0.529879 Sep 17 20:58:13.320544 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 988/1901] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:12 2022] GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 => generated 1501 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:13.327960 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-71d094e5-50d6-4673-93f3-09d755c95580 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:13.330430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-71d094e5-50d6-4673-93f3-09d755c95580 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: bf08d895-d8f9-440d-8ade-fbc47dc6bde4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:13.342108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:58:13.354667 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71d094e5-50d6-4673-93f3-09d755c95580 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:13.355316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71d094e5-50d6-4673-93f3-09d755c95580 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:13.356228 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71d094e5-50d6-4673-93f3-09d755c95580 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:13.357254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71d094e5-50d6-4673-93f3-09d755c95580 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:13.357978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71d094e5-50d6-4673-93f3-09d755c95580 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:13.358671 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71d094e5-50d6-4673-93f3-09d755c95580 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:13.405917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-2210e50c-0b4a-4dba-a6f2-351b1864a5f3 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:58:13.406500 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-2210e50c-0b4a-4dba-a6f2-351b1864a5f3 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:58:13.406967 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-2210e50c-0b4a-4dba-a6f2-351b1864a5f3 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:58:13.408205 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-2210e50c-0b4a-4dba-a6f2-351b1864a5f3 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:58:13.408904 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-2210e50c-0b4a-4dba-a6f2-351b1864a5f3 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:58:13.419564 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2210e50c-0b4a-4dba-a6f2-351b1864a5f3 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:13.420055 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2210e50c-0b4a-4dba-a6f2-351b1864a5f3 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:13.420786 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2210e50c-0b4a-4dba-a6f2-351b1864a5f3 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:13.421513 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2210e50c-0b4a-4dba-a6f2-351b1864a5f3 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:13.422170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2210e50c-0b4a-4dba-a6f2-351b1864a5f3 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:13.422779 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2210e50c-0b4a-4dba-a6f2-351b1864a5f3 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:13.443816 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-2210e50c-0b4a-4dba-a6f2-351b1864a5f3 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Getting quotas for project 31d6f02f91d84fd59de856b10c42ac5d. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:58:13.449972 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-2210e50c-0b4a-4dba-a6f2-351b1864a5f3 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Getting quotas for user a6645db569614a10b1388a69b7e5a64f and project 31d6f02f91d84fd59de856b10c42ac5d. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:58:13.464896 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2210e50c-0b4a-4dba-a6f2-351b1864a5f3 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:58:13.468031 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2210e50c-0b4a-4dba-a6f2-351b1864a5f3 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] [instance: db1127cb-07c5-4e4d-8303-82b71dc31a55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:58:13.549564 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2210e50c-0b4a-4dba-a6f2-351b1864a5f3 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.988509 Sep 17 20:58:13.557727 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 914/1902] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:58:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:58:13.565039 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-46348425-94c8-4855-bcba-837737a2733c req-eebc8b6e-bd4b-47d0-96d2-105604ead252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faba011e-8cd7-4120-9e2d-8e98112899b3", "tag": "1dc51fd9-35d7-4713-b096-63b7f248f58f"}, {"name": "network-changed", "server_uuid": "bf08d895-d8f9-440d-8ade-fbc47dc6bde4", "tag": "e796f543-c137-42fa-b391-2f975c3df0e1"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:13.588172 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-46348425-94c8-4855-bcba-837737a2733c req-eebc8b6e-bd4b-47d0-96d2-105604ead252 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:13.589262 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-46348425-94c8-4855-bcba-837737a2733c req-eebc8b6e-bd4b-47d0-96d2-105604ead252 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:13.589916 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-46348425-94c8-4855-bcba-837737a2733c req-eebc8b6e-bd4b-47d0-96d2-105604ead252 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:13.613428 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-46348425-94c8-4855-bcba-837737a2733c req-eebc8b6e-bd4b-47d0-96d2-105604ead252 service nova] Creating event network-changed:1dc51fd9-35d7-4713-b096-63b7f248f58f for instance faba011e-8cd7-4120-9e2d-8e98112899b3 on nch2-master-1 Sep 17 20:58:13.614558 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-46348425-94c8-4855-bcba-837737a2733c req-eebc8b6e-bd4b-47d0-96d2-105604ead252 service nova] Creating event network-changed:e796f543-c137-42fa-b391-2f975c3df0e1 for instance bf08d895-d8f9-440d-8ade-fbc47dc6bde4 on nch1-master-1 Sep 17 20:58:13.627615 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-46348425-94c8-4855-bcba-837737a2733c req-eebc8b6e-bd4b-47d0-96d2-105604ead252 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.073898 Sep 17 20:58:13.628888 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 915/1903] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:13.636088 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8960f7b6-65b5-427e-ab78-ca32aba05bc4 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:13.637439 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8960f7b6-65b5-427e-ab78-ca32aba05bc4 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] [instance: a6f98038-008a-49b5-968e-bcb0791d4678] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:13.647280 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8960f7b6-65b5-427e-ab78-ca32aba05bc4 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:13.648117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8960f7b6-65b5-427e-ab78-ca32aba05bc4 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:13.648756 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8960f7b6-65b5-427e-ab78-ca32aba05bc4 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:13.649711 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8960f7b6-65b5-427e-ab78-ca32aba05bc4 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:13.650523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8960f7b6-65b5-427e-ab78-ca32aba05bc4 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:13.651347 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8960f7b6-65b5-427e-ab78-ca32aba05bc4 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:13.713870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-71d094e5-50d6-4673-93f3-09d755c95580 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:13.726579 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-71d094e5-50d6-4673-93f3-09d755c95580 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4" status: 200 len: 1308 microversion: 2.1 time: 0.404413 Sep 17 20:58:13.728117 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 989/1904] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:13 2022] GET /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4 => generated 1308 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:13.763171 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b8962530-3e0a-4bf6-a503-52738b20bfed tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:13.764956 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b8962530-3e0a-4bf6-a503-52738b20bfed tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] [instance: db1127cb-07c5-4e4d-8303-82b71dc31a55] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:13.881550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b8962530-3e0a-4bf6-a503-52738b20bfed tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6645db569614a10b1388a69b7e5a64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6f02f91d84fd59de856b10c42ac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:13.893406 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b8962530-3e0a-4bf6-a503-52738b20bfed tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] 10.222.0.26 "GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55" status: 200 len: 1223 microversion: 2.1 time: 0.163383 Sep 17 20:58:13.894350 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 990/1905] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:13 2022] GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55 => generated 1223 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:13.901807 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-32be6d9b-0eb0-4a83-b746-f6fd45f34539 req-d2b1f2ae-7307-4c98-b7bb-b8e1acce50dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8e78e88-e04b-497b-bef8-c4b57aff1d1d", "tag": "20742609-eb1b-4058-800c-a0a66327aa5c"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:13.935590 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-32be6d9b-0eb0-4a83-b746-f6fd45f34539 req-d2b1f2ae-7307-4c98-b7bb-b8e1acce50dc service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:13.939330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-32be6d9b-0eb0-4a83-b746-f6fd45f34539 req-d2b1f2ae-7307-4c98-b7bb-b8e1acce50dc service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:13.939823 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-32be6d9b-0eb0-4a83-b746-f6fd45f34539 req-d2b1f2ae-7307-4c98-b7bb-b8e1acce50dc service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:13.962708 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-32be6d9b-0eb0-4a83-b746-f6fd45f34539 req-d2b1f2ae-7307-4c98-b7bb-b8e1acce50dc service nova] Creating event network-changed:20742609-eb1b-4058-800c-a0a66327aa5c for instance e8e78e88-e04b-497b-bef8-c4b57aff1d1d on nch2-master-1 Sep 17 20:58:13.972617 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-32be6d9b-0eb0-4a83-b746-f6fd45f34539 req-d2b1f2ae-7307-4c98-b7bb-b8e1acce50dc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076671 Sep 17 20:58:13.973256 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 991/1906] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:13.988093 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8960f7b6-65b5-427e-ab78-ca32aba05bc4 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db879fde0bd4bea81374a7f7bb627e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cdbed43ed4de6b4cb7e1cd4802b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:13.994003 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3c6754d5-d55f-48e4-93c9-0bb68996eace tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:13.995153 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3c6754d5-d55f-48e4-93c9-0bb68996eace tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: e8e78e88-e04b-497b-bef8-c4b57aff1d1d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:14.009548 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8960f7b6-65b5-427e-ab78-ca32aba05bc4 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] 10.222.0.26 "GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678" status: 200 len: 1325 microversion: 2.1 time: 0.378858 Sep 17 20:58:14.009879 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c6754d5-d55f-48e4-93c9-0bb68996eace tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:14.010859 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c6754d5-d55f-48e4-93c9-0bb68996eace tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:14.011475 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c6754d5-d55f-48e4-93c9-0bb68996eace tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:14.011891 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 916/1907] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:13 2022] GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678 => generated 1325 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:14.012423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c6754d5-d55f-48e4-93c9-0bb68996eace tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:14.012887 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c6754d5-d55f-48e4-93c9-0bb68996eace tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:14.013315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c6754d5-d55f-48e4-93c9-0bb68996eace tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:14.347408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a989debe-ca24-42e8-acef-69e5959d3e98 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:14.348254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a989debe-ca24-42e8-acef-69e5959d3e98 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:14.360905 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a989debe-ca24-42e8-acef-69e5959d3e98 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:14.361416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a989debe-ca24-42e8-acef-69e5959d3e98 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:14.361968 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a989debe-ca24-42e8-acef-69e5959d3e98 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:14.362715 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a989debe-ca24-42e8-acef-69e5959d3e98 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:14.363170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a989debe-ca24-42e8-acef-69e5959d3e98 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:14.363783 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a989debe-ca24-42e8-acef-69e5959d3e98 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:14.482039 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a989debe-ca24-42e8-acef-69e5959d3e98 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:14.489205 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3c6754d5-d55f-48e4-93c9-0bb68996eace tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:14.496578 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a989debe-ca24-42e8-acef-69e5959d3e98 tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1" status: 200 len: 1459 microversion: 2.1 time: 0.152866 Sep 17 20:58:14.497924 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 917/1908] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:14 2022] GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 => generated 1459 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:14.500450 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3c6754d5-d55f-48e4-93c9-0bb68996eace tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d" status: 200 len: 1318 microversion: 2.1 time: 0.521852 Sep 17 20:58:14.514856 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 992/1909] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:13 2022] GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d => generated 1318 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:14.753916 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e4a206e5-4300-4848-a0fb-179d48429bbf tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:14.754842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e4a206e5-4300-4848-a0fb-179d48429bbf tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: bf08d895-d8f9-440d-8ade-fbc47dc6bde4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:14.761591 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e4a206e5-4300-4848-a0fb-179d48429bbf tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:14.762289 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e4a206e5-4300-4848-a0fb-179d48429bbf tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:14.762901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e4a206e5-4300-4848-a0fb-179d48429bbf tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:14.763784 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e4a206e5-4300-4848-a0fb-179d48429bbf tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:14.764401 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e4a206e5-4300-4848-a0fb-179d48429bbf tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:14.765059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e4a206e5-4300-4848-a0fb-179d48429bbf tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:14.921669 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5f992da0-7d87-48b3-b549-576d24cd5520 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:14.922936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5f992da0-7d87-48b3-b549-576d24cd5520 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] [instance: db1127cb-07c5-4e4d-8303-82b71dc31a55] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:14.931094 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5f992da0-7d87-48b3-b549-576d24cd5520 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:14.932036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5f992da0-7d87-48b3-b549-576d24cd5520 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:14.932826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5f992da0-7d87-48b3-b549-576d24cd5520 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:14.933971 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5f992da0-7d87-48b3-b549-576d24cd5520 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:14.934659 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5f992da0-7d87-48b3-b549-576d24cd5520 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:14.935308 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5f992da0-7d87-48b3-b549-576d24cd5520 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:15.030030 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5f992da0-7d87-48b3-b549-576d24cd5520 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6645db569614a10b1388a69b7e5a64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6f02f91d84fd59de856b10c42ac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:15.041093 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e4a206e5-4300-4848-a0fb-179d48429bbf tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:15.041324 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5f992da0-7d87-48b3-b549-576d24cd5520 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] 10.222.0.26 "GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55" status: 200 len: 1227 microversion: 2.1 time: 0.125663 Sep 17 20:58:15.041847 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 993/1910] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:14 2022] GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55 => generated 1227 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:58:15.047774 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fe17995b-bc2c-44ef-9076-e6016c31ef54 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:15.048757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fe17995b-bc2c-44ef-9076-e6016c31ef54 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] [instance: a6f98038-008a-49b5-968e-bcb0791d4678] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:15.053982 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e4a206e5-4300-4848-a0fb-179d48429bbf tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4" status: 200 len: 1308 microversion: 2.1 time: 0.303459 Sep 17 20:58:15.056608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe17995b-bc2c-44ef-9076-e6016c31ef54 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:15.057408 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe17995b-bc2c-44ef-9076-e6016c31ef54 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:15.058212 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe17995b-bc2c-44ef-9076-e6016c31ef54 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:15.059943 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe17995b-bc2c-44ef-9076-e6016c31ef54 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:15.060559 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe17995b-bc2c-44ef-9076-e6016c31ef54 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:15.061170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe17995b-bc2c-44ef-9076-e6016c31ef54 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:15.067214 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 918/1911] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:14 2022] GET /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4 => generated 1308 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:15.378708 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fe17995b-bc2c-44ef-9076-e6016c31ef54 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db879fde0bd4bea81374a7f7bb627e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cdbed43ed4de6b4cb7e1cd4802b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:15.389902 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fe17995b-bc2c-44ef-9076-e6016c31ef54 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] 10.222.0.26 "GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678" status: 200 len: 1325 microversion: 2.1 time: 0.346364 Sep 17 20:58:15.390985 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 994/1912] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:15 2022] GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678 => generated 1325 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:15.526153 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-00c1a6d9-5397-44b5-859c-f720f234db5a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:15.530050 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-00c1a6d9-5397-44b5-859c-f720f234db5a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:15.531515 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-00492182-4ed3-4b93-aa1a-8cfddf30af5c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:15.532219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-00492182-4ed3-4b93-aa1a-8cfddf30af5c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: e8e78e88-e04b-497b-bef8-c4b57aff1d1d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:15.541728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00492182-4ed3-4b93-aa1a-8cfddf30af5c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:15.542444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00492182-4ed3-4b93-aa1a-8cfddf30af5c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:15.544277 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00492182-4ed3-4b93-aa1a-8cfddf30af5c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:15.545279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00492182-4ed3-4b93-aa1a-8cfddf30af5c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:15.546167 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00c1a6d9-5397-44b5-859c-f720f234db5a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:15.546370 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00492182-4ed3-4b93-aa1a-8cfddf30af5c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:15.546828 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00c1a6d9-5397-44b5-859c-f720f234db5a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:15.547272 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00492182-4ed3-4b93-aa1a-8cfddf30af5c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:15.547395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00c1a6d9-5397-44b5-859c-f720f234db5a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:15.548456 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00c1a6d9-5397-44b5-859c-f720f234db5a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:15.550712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00c1a6d9-5397-44b5-859c-f720f234db5a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:15.551991 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00c1a6d9-5397-44b5-859c-f720f234db5a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:15.620865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00c1a6d9-5397-44b5-859c-f720f234db5a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:15.622083 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00c1a6d9-5397-44b5-859c-f720f234db5a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:15.623306 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00c1a6d9-5397-44b5-859c-f720f234db5a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:15.624148 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-00c1a6d9-5397-44b5-859c-f720f234db5a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lazy-loading 'fault' on Instance uuid 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:58:15.780161 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-00c1a6d9-5397-44b5-859c-f720f234db5a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:15.793853 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-00c1a6d9-5397-44b5-859c-f720f234db5a tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1" status: 200 len: 1301 microversion: 2.1 time: 0.273727 Sep 17 20:58:15.794760 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 919/1913] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:15 2022] GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 => generated 1301 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:15.802339 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-29bdcece-2a88-4d90-9338-a194060ce289 req-d82d99c1-9330-4276-9712-797a2618dd21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f598b03-b7f1-42ce-a5b0-2c140bde7ba1", "name": "network-vif-deleted", "tag": "a8ad5af8-55a2-4214-b840-cef45bde3c20"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:15.815433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-29bdcece-2a88-4d90-9338-a194060ce289 req-d82d99c1-9330-4276-9712-797a2618dd21 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:15.815909 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-29bdcece-2a88-4d90-9338-a194060ce289 req-d82d99c1-9330-4276-9712-797a2618dd21 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:15.816334 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-29bdcece-2a88-4d90-9338-a194060ce289 req-d82d99c1-9330-4276-9712-797a2618dd21 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:15.846714 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-29bdcece-2a88-4d90-9338-a194060ce289 req-d82d99c1-9330-4276-9712-797a2618dd21 service nova] Creating event network-vif-deleted:a8ad5af8-55a2-4214-b840-cef45bde3c20 for instance 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 on nch2-master-1 Sep 17 20:58:15.862268 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-29bdcece-2a88-4d90-9338-a194060ce289 req-d82d99c1-9330-4276-9712-797a2618dd21 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065272 Sep 17 20:58:15.863995 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 920/1914] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:15.967760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-00492182-4ed3-4b93-aa1a-8cfddf30af5c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:15.978605 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-00492182-4ed3-4b93-aa1a-8cfddf30af5c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d" status: 200 len: 1318 microversion: 2.1 time: 0.451692 Sep 17 20:58:15.979765 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 995/1915] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:15 2022] GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d => generated 1318 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:16.052746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a4942c1d-bc4b-4f31-935b-756d41d5b1fb tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:16.053616 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a4942c1d-bc4b-4f31-935b-756d41d5b1fb tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: f3e67571-f038-485c-8685-af24123a5c10] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:16.061185 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4942c1d-bc4b-4f31-935b-756d41d5b1fb tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:16.062992 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4942c1d-bc4b-4f31-935b-756d41d5b1fb tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:16.062992 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4942c1d-bc4b-4f31-935b-756d41d5b1fb tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:16.063210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4942c1d-bc4b-4f31-935b-756d41d5b1fb tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:16.063520 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4942c1d-bc4b-4f31-935b-756d41d5b1fb tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:16.063972 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4942c1d-bc4b-4f31-935b-756d41d5b1fb tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:16.068811 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c1ad5b20-47c6-43f3-9661-c2a292d21ff9 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:16.069530 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c1ad5b20-47c6-43f3-9661-c2a292d21ff9 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] [instance: db1127cb-07c5-4e4d-8303-82b71dc31a55] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:16.078340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1ad5b20-47c6-43f3-9661-c2a292d21ff9 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:16.091369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1ad5b20-47c6-43f3-9661-c2a292d21ff9 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:16.091684 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-a4942c1d-bc4b-4f31-935b-756d41d5b1fb tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] HTTP exception thrown: Instance f3e67571-f038-485c-8685-af24123a5c10 could not be found. Sep 17 20:58:16.092883 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1ad5b20-47c6-43f3-9661-c2a292d21ff9 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a4942c1d-bc4b-4f31-935b-756d41d5b1fb tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Request method failure captured: Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10 HTTP/1.1 Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjRq4nfGWPeRQ7QZvnGLf5y-vzIBDMTl68UT5y8pZXfg4guV28avkyxaTLFSWsXWUs9-t-k41Law6z_ozMoljlGGUJQqENEMg2zQEdFmEGMHqXuWu7zBUO8oPrqAAVMFisrczgFwZ_ORoimebWXsC5gH843V3K6Uvc01y9mMnD4zHgw Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 400242d681ab472d9c90de4fc7da202b Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersTestMultiNic-341763139 Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/400242d681ab472d9c90de4fc7da202b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/400242d681ab472d9c90de4fc7da202b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/400242d681ab472d9c90de4fc7da202b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_400242d681ab472d9c90de4fc7da202b", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersTestMultiNic-341763139 Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 400242d681ab472d9c90de4fc7da202b Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersTestMultiNic-341763139 Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersTestMultiNic-341763139-project Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: bc22daf24ce44eb28bb6e000316e4df4 Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersTestMultiNic-341763139-project Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance f3e67571-f038-485c-8685-af24123a5c10 could not be found. Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'f3e67571-f038-485c-8685-af24123a5c10'} Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3e67571-f038-485c-8685-af24123a5c10 could not be found. Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:58:16.093363 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:58:16.103557 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3e67571-f038-485c-8685-af24123a5c10 could not be found. Sep 17 20:58:16.103557 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:16.103557 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:16.103557 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:16.103557 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:16.103557 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:16.103557 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:16.103557 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:58:16.103557 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:58:16.103557 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3e67571-f038-485c-8685-af24123a5c10 could not be found. Sep 17 20:58:16.103557 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:16.103557 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a4942c1d-bc4b-4f31-935b-756d41d5b1fb tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Returning 404 to user: Instance f3e67571-f038-485c-8685-af24123a5c10 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:58:16.103557 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a4942c1d-bc4b-4f31-935b-756d41d5b1fb tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10" status: 404 len: 111 microversion: 2.1 time: 0.046663 Sep 17 20:58:16.103557 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 921/1916] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:58:16 2022] DELETE /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:58:16.106913 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1ad5b20-47c6-43f3-9661-c2a292d21ff9 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:16.107671 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1ad5b20-47c6-43f3-9661-c2a292d21ff9 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:16.108444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1ad5b20-47c6-43f3-9661-c2a292d21ff9 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:16.111478 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f1eac0e0-fdf4-41d5-a955-d20b33944512 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:16.112145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f1eac0e0-fdf4-41d5-a955-d20b33944512 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: bf08d895-d8f9-440d-8ade-fbc47dc6bde4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:16.118685 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1eac0e0-fdf4-41d5-a955-d20b33944512 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:16.119350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1eac0e0-fdf4-41d5-a955-d20b33944512 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:16.119621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1eac0e0-fdf4-41d5-a955-d20b33944512 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:16.120343 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1eac0e0-fdf4-41d5-a955-d20b33944512 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:16.120897 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1eac0e0-fdf4-41d5-a955-d20b33944512 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:16.121339 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1eac0e0-fdf4-41d5-a955-d20b33944512 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:16.230942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c1ad5b20-47c6-43f3-9661-c2a292d21ff9 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6645db569614a10b1388a69b7e5a64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6f02f91d84fd59de856b10c42ac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:16.243369 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c1ad5b20-47c6-43f3-9661-c2a292d21ff9 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] 10.222.0.26 "GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55" status: 200 len: 1275 microversion: 2.1 time: 0.177715 Sep 17 20:58:16.244323 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 996/1917] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:16 2022] GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55 => generated 1275 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:58:16.258662 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0edc7ab4-2a16-4c62-a256-e9258bf1c793 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:16.259872 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0edc7ab4-2a16-4c62-a256-e9258bf1c793 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: f3e67571-f038-485c-8685-af24123a5c10] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:16.267637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0edc7ab4-2a16-4c62-a256-e9258bf1c793 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:16.268266 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0edc7ab4-2a16-4c62-a256-e9258bf1c793 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:16.268974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0edc7ab4-2a16-4c62-a256-e9258bf1c793 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:16.271107 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0edc7ab4-2a16-4c62-a256-e9258bf1c793 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:16.271905 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0edc7ab4-2a16-4c62-a256-e9258bf1c793 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:16.272624 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0edc7ab4-2a16-4c62-a256-e9258bf1c793 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:16.290813 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-0edc7ab4-2a16-4c62-a256-e9258bf1c793 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] HTTP exception thrown: Instance f3e67571-f038-485c-8685-af24123a5c10 could not be found. Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0edc7ab4-2a16-4c62-a256-e9258bf1c793 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Request method failure captured: Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10 HTTP/1.1 Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjRq4nfGWPeRQ7QZvnGLf5y-vzIBDMTl68UT5y8pZXfg4guV28avkyxaTLFSWsXWUs9-t-k41Law6z_ozMoljlGGUJQqENEMg2zQEdFmEGMHqXuWu7zBUO8oPrqAAVMFisrczgFwZ_ORoimebWXsC5gH843V3K6Uvc01y9mMnD4zHgw Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 400242d681ab472d9c90de4fc7da202b Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersTestMultiNic-341763139 Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/400242d681ab472d9c90de4fc7da202b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/400242d681ab472d9c90de4fc7da202b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/400242d681ab472d9c90de4fc7da202b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_400242d681ab472d9c90de4fc7da202b", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersTestMultiNic-341763139 Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 400242d681ab472d9c90de4fc7da202b Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersTestMultiNic-341763139 Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersTestMultiNic-341763139-project Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: bc22daf24ce44eb28bb6e000316e4df4 Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersTestMultiNic-341763139-project Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance f3e67571-f038-485c-8685-af24123a5c10 could not be found. Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'f3e67571-f038-485c-8685-af24123a5c10'} Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3e67571-f038-485c-8685-af24123a5c10 could not be found. Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3e67571-f038-485c-8685-af24123a5c10 could not be found. Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:16.294708 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:58:16.301009 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:16.301009 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:16.301009 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:16.301009 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:58:16.301009 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:58:16.301009 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3e67571-f038-485c-8685-af24123a5c10 could not be found. Sep 17 20:58:16.301009 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:58:16.304246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0edc7ab4-2a16-4c62-a256-e9258bf1c793 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Returning 404 to user: Instance f3e67571-f038-485c-8685-af24123a5c10 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:58:16.305218 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0edc7ab4-2a16-4c62-a256-e9258bf1c793 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10" status: 404 len: 111 microversion: 2.1 time: 0.059891 Sep 17 20:58:16.306067 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 997/1918] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:16 2022] GET /compute/v2.1/servers/f3e67571-f038-485c-8685-af24123a5c10 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:58:16.316572 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5b3bf48e-1934-410d-a3c6-fcaeb6c209b2 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:16.317573 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5b3bf48e-1934-410d-a3c6-fcaeb6c209b2 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:16.336287 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b3bf48e-1934-410d-a3c6-fcaeb6c209b2 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:16.342292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b3bf48e-1934-410d-a3c6-fcaeb6c209b2 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:16.342966 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b3bf48e-1934-410d-a3c6-fcaeb6c209b2 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:16.343922 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b3bf48e-1934-410d-a3c6-fcaeb6c209b2 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:16.344625 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b3bf48e-1934-410d-a3c6-fcaeb6c209b2 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:16.345118 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b3bf48e-1934-410d-a3c6-fcaeb6c209b2 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:16.383422 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-5b3bf48e-1934-410d-a3c6-fcaeb6c209b2 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] HTTP exception thrown: Instance 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a could not be found. Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5b3bf48e-1934-410d-a3c6-fcaeb6c209b2 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Request method failure captured: Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a HTTP/1.1 Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjRq4nfGWPeRQ7QZvnGLf5y-vzIBDMTl68UT5y8pZXfg4guV28avkyxaTLFSWsXWUs9-t-k41Law6z_ozMoljlGGUJQqENEMg2zQEdFmEGMHqXuWu7zBUO8oPrqAAVMFisrczgFwZ_ORoimebWXsC5gH843V3K6Uvc01y9mMnD4zHgw Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 400242d681ab472d9c90de4fc7da202b Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersTestMultiNic-341763139 Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/400242d681ab472d9c90de4fc7da202b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/400242d681ab472d9c90de4fc7da202b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/400242d681ab472d9c90de4fc7da202b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_400242d681ab472d9c90de4fc7da202b", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersTestMultiNic-341763139 Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 400242d681ab472d9c90de4fc7da202b Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersTestMultiNic-341763139 Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersTestMultiNic-341763139-project Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: bc22daf24ce44eb28bb6e000316e4df4 Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersTestMultiNic-341763139-project Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a could not be found. Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '4f0fd2e6-7a40-44f0-9ab7-71ff4489741a'} Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a could not be found. Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:58:16.385338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:58:16.392385 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a could not be found. Sep 17 20:58:16.392385 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:58:16.392385 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:16.392385 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:58:16.392385 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:16.392385 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:16.392385 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:16.392385 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:58:16.392385 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:58:16.392385 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a could not be found. Sep 17 20:58:16.392385 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:58:16.396269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5b3bf48e-1934-410d-a3c6-fcaeb6c209b2 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Returning 404 to user: Instance 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:58:16.399910 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5b3bf48e-1934-410d-a3c6-fcaeb6c209b2 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 404 len: 111 microversion: 2.1 time: 0.089261 Sep 17 20:58:16.403163 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 998/1919] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:58:16 2022] DELETE /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:58:16.416626 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1e6fbce5-9ede-49e1-9c28-11e28dd35ba8 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:16.418857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1e6fbce5-9ede-49e1-9c28-11e28dd35ba8 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] [instance: 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:16.442172 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e6fbce5-9ede-49e1-9c28-11e28dd35ba8 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:16.442755 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e6fbce5-9ede-49e1-9c28-11e28dd35ba8 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:16.443485 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e6fbce5-9ede-49e1-9c28-11e28dd35ba8 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:16.444440 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e6fbce5-9ede-49e1-9c28-11e28dd35ba8 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:16.445066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e6fbce5-9ede-49e1-9c28-11e28dd35ba8 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:16.447377 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e6fbce5-9ede-49e1-9c28-11e28dd35ba8 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:16.533420 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-1e6fbce5-9ede-49e1-9c28-11e28dd35ba8 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] HTTP exception thrown: Instance 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a could not be found. Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1e6fbce5-9ede-49e1-9c28-11e28dd35ba8 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Request method failure captured: Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a HTTP/1.1 Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjRq4nfGWPeRQ7QZvnGLf5y-vzIBDMTl68UT5y8pZXfg4guV28avkyxaTLFSWsXWUs9-t-k41Law6z_ozMoljlGGUJQqENEMg2zQEdFmEGMHqXuWu7zBUO8oPrqAAVMFisrczgFwZ_ORoimebWXsC5gH843V3K6Uvc01y9mMnD4zHgw Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 400242d681ab472d9c90de4fc7da202b Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersTestMultiNic-341763139 Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/400242d681ab472d9c90de4fc7da202b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/400242d681ab472d9c90de4fc7da202b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/400242d681ab472d9c90de4fc7da202b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_400242d681ab472d9c90de4fc7da202b", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersTestMultiNic-341763139 Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 400242d681ab472d9c90de4fc7da202b Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersTestMultiNic-341763139 Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersTestMultiNic-341763139-project Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: bc22daf24ce44eb28bb6e000316e4df4 Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersTestMultiNic-341763139-project Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a could not be found. Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '4f0fd2e6-7a40-44f0-9ab7-71ff4489741a'} Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a could not be found. Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a could not be found. Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:16.535012 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:58:16.543011 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:16.543011 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:16.543011 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:16.543011 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:58:16.543011 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:58:16.543011 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a could not be found. Sep 17 20:58:16.543011 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:58:16.543011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1e6fbce5-9ede-49e1-9c28-11e28dd35ba8 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] Returning 404 to user: Instance 4f0fd2e6-7a40-44f0-9ab7-71ff4489741a could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:58:16.543011 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1e6fbce5-9ede-49e1-9c28-11e28dd35ba8 tempest-ServersTestMultiNic-341763139 tempest-ServersTestMultiNic-341763139-project] 10.222.0.26 "GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a" status: 404 len: 111 microversion: 2.1 time: 0.124797 Sep 17 20:58:16.552514 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 999/1920] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:16 2022] GET /compute/v2.1/servers/4f0fd2e6-7a40-44f0-9ab7-71ff4489741a => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:58:16.557603 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2b125ed3-c82f-4b94-9cf0-bd290dfec06d tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:16.558233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2b125ed3-c82f-4b94-9cf0-bd290dfec06d tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] [instance: a6f98038-008a-49b5-968e-bcb0791d4678] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:16.595359 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b125ed3-c82f-4b94-9cf0-bd290dfec06d tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:16.596078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b125ed3-c82f-4b94-9cf0-bd290dfec06d tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:16.596768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b125ed3-c82f-4b94-9cf0-bd290dfec06d tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:16.599090 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b125ed3-c82f-4b94-9cf0-bd290dfec06d tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:16.599826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b125ed3-c82f-4b94-9cf0-bd290dfec06d tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:16.600914 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b125ed3-c82f-4b94-9cf0-bd290dfec06d tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:16.633290 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:58:16.938051 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f1eac0e0-fdf4-41d5-a955-d20b33944512 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:16.954850 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f1eac0e0-fdf4-41d5-a955-d20b33944512 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4" status: 200 len: 1308 microversion: 2.1 time: 0.857194 Sep 17 20:58:16.955733 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 922/1921] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:16 2022] GET /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4 => generated 1308 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:16.975500 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ac6e574b-44b0-492b-a5af-dc851f7ef3fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:16.976268 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ac6e574b-44b0-492b-a5af-dc851f7ef3fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:16.993894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac6e574b-44b0-492b-a5af-dc851f7ef3fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:16.994398 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac6e574b-44b0-492b-a5af-dc851f7ef3fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:16.994849 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac6e574b-44b0-492b-a5af-dc851f7ef3fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:16.995575 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac6e574b-44b0-492b-a5af-dc851f7ef3fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:16.996038 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac6e574b-44b0-492b-a5af-dc851f7ef3fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:16.996464 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac6e574b-44b0-492b-a5af-dc851f7ef3fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:17.023193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:58:17.036497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac6e574b-44b0-492b-a5af-dc851f7ef3fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:17.037170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac6e574b-44b0-492b-a5af-dc851f7ef3fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:17.037828 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac6e574b-44b0-492b-a5af-dc851f7ef3fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:17.038452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-ac6e574b-44b0-492b-a5af-dc851f7ef3fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lazy-loading 'fault' on Instance uuid 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:58:17.132764 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ac6e574b-44b0-492b-a5af-dc851f7ef3fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c2b746b7c194596808a7b0c736f3b53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6b44bc44e7c4a998bfd99e7d11e99fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:17.145052 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ac6e574b-44b0-492b-a5af-dc851f7ef3fb tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1" status: 200 len: 1301 microversion: 2.1 time: 0.173541 Sep 17 20:58:17.146842 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 923/1922] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:16 2022] GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 => generated 1301 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:17.155201 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0f9c456e-001e-45a3-8b06-0c4db76a57e6 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:17.157091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0f9c456e-001e-45a3-8b06-0c4db76a57e6 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: e8e78e88-e04b-497b-bef8-c4b57aff1d1d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:17.177391 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0f9c456e-001e-45a3-8b06-0c4db76a57e6 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:17.178680 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0f9c456e-001e-45a3-8b06-0c4db76a57e6 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:17.179186 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0f9c456e-001e-45a3-8b06-0c4db76a57e6 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:17.180304 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0f9c456e-001e-45a3-8b06-0c4db76a57e6 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:17.180785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0f9c456e-001e-45a3-8b06-0c4db76a57e6 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:17.182992 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0f9c456e-001e-45a3-8b06-0c4db76a57e6 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:17.323390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2b125ed3-c82f-4b94-9cf0-bd290dfec06d tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db879fde0bd4bea81374a7f7bb627e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cdbed43ed4de6b4cb7e1cd4802b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:17.332766 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2b125ed3-c82f-4b94-9cf0-bd290dfec06d tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] 10.222.0.26 "GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678" status: 200 len: 1325 microversion: 2.1 time: 0.779132 Sep 17 20:58:17.334509 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1000/1923] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:16 2022] GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678 => generated 1325 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:17.351943 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a2ca295c-eb2c-45b2-91f3-a4a22d838211 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:17.353141 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a2ca295c-eb2c-45b2-91f3-a4a22d838211 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] [instance: db1127cb-07c5-4e4d-8303-82b71dc31a55] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:17.360699 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a2ca295c-eb2c-45b2-91f3-a4a22d838211 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:17.361208 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a2ca295c-eb2c-45b2-91f3-a4a22d838211 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:17.361685 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a2ca295c-eb2c-45b2-91f3-a4a22d838211 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:17.362406 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a2ca295c-eb2c-45b2-91f3-a4a22d838211 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:17.362868 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a2ca295c-eb2c-45b2-91f3-a4a22d838211 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:17.363309 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a2ca295c-eb2c-45b2-91f3-a4a22d838211 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:17.418288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0f9c456e-001e-45a3-8b06-0c4db76a57e6 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:17.429908 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0f9c456e-001e-45a3-8b06-0c4db76a57e6 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d" status: 200 len: 1318 microversion: 2.1 time: 0.281403 Sep 17 20:58:17.441607 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 924/1924] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:17 2022] GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:17.452600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a2ca295c-eb2c-45b2-91f3-a4a22d838211 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6645db569614a10b1388a69b7e5a64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6f02f91d84fd59de856b10c42ac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:17.468735 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a2ca295c-eb2c-45b2-91f3-a4a22d838211 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] 10.222.0.26 "GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55" status: 200 len: 1281 microversion: 2.1 time: 0.132906 Sep 17 20:58:17.491800 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1001/1925] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:17 2022] GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55 => generated 1281 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:17.934855 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-519fba6e-2b9d-4d91-8c18-2fd91ed9da6a req-36faa22a-7be3-41b5-8ad2-1427fe44ac77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf08d895-d8f9-440d-8ade-fbc47dc6bde4", "name": "network-vif-plugged", "status": "completed", "tag": "e796f543-c137-42fa-b391-2f975c3df0e1"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:17.981887 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5c3f6995-52cb-4e42-bc8f-12a2a6bde9c9 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:17.982489 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5c3f6995-52cb-4e42-bc8f-12a2a6bde9c9 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: bf08d895-d8f9-440d-8ade-fbc47dc6bde4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:17.985775 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-519fba6e-2b9d-4d91-8c18-2fd91ed9da6a req-36faa22a-7be3-41b5-8ad2-1427fe44ac77 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:17.987445 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-519fba6e-2b9d-4d91-8c18-2fd91ed9da6a req-36faa22a-7be3-41b5-8ad2-1427fe44ac77 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:17.988567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-519fba6e-2b9d-4d91-8c18-2fd91ed9da6a req-36faa22a-7be3-41b5-8ad2-1427fe44ac77 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:17.992953 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c3f6995-52cb-4e42-bc8f-12a2a6bde9c9 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:17.995996 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c3f6995-52cb-4e42-bc8f-12a2a6bde9c9 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:17.996656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c3f6995-52cb-4e42-bc8f-12a2a6bde9c9 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:18.001934 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c3f6995-52cb-4e42-bc8f-12a2a6bde9c9 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:18.003270 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c3f6995-52cb-4e42-bc8f-12a2a6bde9c9 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:18.003916 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c3f6995-52cb-4e42-bc8f-12a2a6bde9c9 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:18.072693 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-519fba6e-2b9d-4d91-8c18-2fd91ed9da6a req-36faa22a-7be3-41b5-8ad2-1427fe44ac77 service nova] Creating event network-vif-plugged:e796f543-c137-42fa-b391-2f975c3df0e1 for instance bf08d895-d8f9-440d-8ade-fbc47dc6bde4 on nch1-master-1 Sep 17 20:58:18.080808 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-519fba6e-2b9d-4d91-8c18-2fd91ed9da6a req-36faa22a-7be3-41b5-8ad2-1427fe44ac77 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153442 Sep 17 20:58:18.081441 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 925/1926] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:18.173579 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8760c5e5-7b11-49fd-8aa6-3f3328f3905e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:18.174765 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8760c5e5-7b11-49fd-8aa6-3f3328f3905e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] [instance: 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:18.184046 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8760c5e5-7b11-49fd-8aa6-3f3328f3905e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:18.184548 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8760c5e5-7b11-49fd-8aa6-3f3328f3905e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:18.184985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8760c5e5-7b11-49fd-8aa6-3f3328f3905e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:18.191263 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8760c5e5-7b11-49fd-8aa6-3f3328f3905e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:18.191811 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8760c5e5-7b11-49fd-8aa6-3f3328f3905e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:18.192260 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8760c5e5-7b11-49fd-8aa6-3f3328f3905e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:18.218170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5c3f6995-52cb-4e42-bc8f-12a2a6bde9c9 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:18.225188 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-8760c5e5-7b11-49fd-8aa6-3f3328f3905e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] HTTP exception thrown: Instance 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 could not be found. Sep 17 20:58:18.228654 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5c3f6995-52cb-4e42-bc8f-12a2a6bde9c9 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4" status: 200 len: 1308 microversion: 2.1 time: 0.250712 Sep 17 20:58:18.229540 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1002/1927] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:17 2022] GET /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4 => generated 1308 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8760c5e5-7b11-49fd-8aa6-3f3328f3905e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Request method failure captured: Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 HTTP/1.1 Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjO4pMSDFI6Atu5kbd_vlRhbyV_fyPw2gdOrFx1mEyl4rL_CZavLzFaFFTIrDXVeI9bf87zTa9lzT1hke8Y8KagCjBPhEyXkmiJUAOGfheh5EfefZfrn_wGqKtQ01RGpNIahNrBgvi-tWdhaJbgej8MzwbEe3UEoa8f3i5egIziHROo Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: f6b44bc44e7c4a998bfd99e7d11e99fc Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-LiveMigrationTest-128259988 Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f6b44bc44e7c4a998bfd99e7d11e99fc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f6b44bc44e7c4a998bfd99e7d11e99fc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f6b44bc44e7c4a998bfd99e7d11e99fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f6b44bc44e7c4a998bfd99e7d11e99fc", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-LiveMigrationTest-128259988 Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: f6b44bc44e7c4a998bfd99e7d11e99fc Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-LiveMigrationTest-128259988 Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-LiveMigrationTest-128259988-project Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 9c2b746b7c194596808a7b0c736f3b53 Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-LiveMigrationTest-128259988-project Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 could not be found. Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '6f598b03-b7f1-42ce-a5b0-2c140bde7ba1'} Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 could not be found. Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 could not be found. Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:18.250824 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:18.259966 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:18.259966 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:18.259966 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:18.259966 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:58:18.259966 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:58:18.259966 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 could not be found. Sep 17 20:58:18.259966 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:18.259966 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8760c5e5-7b11-49fd-8aa6-3f3328f3905e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] Returning 404 to user: Instance 6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:58:18.259966 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8760c5e5-7b11-49fd-8aa6-3f3328f3905e tempest-LiveMigrationTest-128259988 tempest-LiveMigrationTest-128259988-project] 10.222.0.26 "GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1" status: 404 len: 111 microversion: 2.1 time: 0.083810 Sep 17 20:58:18.262839 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 926/1928] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:18 2022] GET /compute/v2.1/servers/6f598b03-b7f1-42ce-a5b0-2c140bde7ba1 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 20:58:18.273554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4d3d7a43-c4f7-4516-9d46-2d87c5d3ebcb tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:18.274075 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4d3d7a43-c4f7-4516-9d46-2d87c5d3ebcb tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: c9fe0176-1bcf-4719-a87f-17b0e0c41b6c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:18.292544 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d3d7a43-c4f7-4516-9d46-2d87c5d3ebcb tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:18.294450 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d3d7a43-c4f7-4516-9d46-2d87c5d3ebcb tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:18.295730 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d3d7a43-c4f7-4516-9d46-2d87c5d3ebcb tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:18.298050 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d3d7a43-c4f7-4516-9d46-2d87c5d3ebcb tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:18.299694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d3d7a43-c4f7-4516-9d46-2d87c5d3ebcb tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:18.300151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d3d7a43-c4f7-4516-9d46-2d87c5d3ebcb tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:18.355917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4d3d7a43-c4f7-4516-9d46-2d87c5d3ebcb tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: c9fe0176-1bcf-4719-a87f-17b0e0c41b6c] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:58:18.356774 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7690f6ee-c93c-4f0a-a671-299a55ca951b tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:18.357567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7690f6ee-c93c-4f0a-a671-299a55ca951b tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] [instance: a6f98038-008a-49b5-968e-bcb0791d4678] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:18.365184 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7690f6ee-c93c-4f0a-a671-299a55ca951b tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:18.366159 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7690f6ee-c93c-4f0a-a671-299a55ca951b tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:18.367038 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7690f6ee-c93c-4f0a-a671-299a55ca951b tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:18.367983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7690f6ee-c93c-4f0a-a671-299a55ca951b tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:18.368793 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7690f6ee-c93c-4f0a-a671-299a55ca951b tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:18.369584 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7690f6ee-c93c-4f0a-a671-299a55ca951b tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:18.524001 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4d3d7a43-c4f7-4516-9d46-2d87c5d3ebcb tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c" status: 204 len: 0 microversion: 2.1 time: 0.261033 Sep 17 20:58:18.525084 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1003/1929] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:58:18 2022] DELETE /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:58:18.532095 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-87ec68a9-6770-40f5-a5e2-b63c285ee5b8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:18.533557 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-87ec68a9-6770-40f5-a5e2-b63c285ee5b8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: e8e78e88-e04b-497b-bef8-c4b57aff1d1d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:18.540998 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87ec68a9-6770-40f5-a5e2-b63c285ee5b8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:18.543074 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87ec68a9-6770-40f5-a5e2-b63c285ee5b8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:18.544029 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87ec68a9-6770-40f5-a5e2-b63c285ee5b8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:18.549174 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87ec68a9-6770-40f5-a5e2-b63c285ee5b8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:18.550011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87ec68a9-6770-40f5-a5e2-b63c285ee5b8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:18.552361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87ec68a9-6770-40f5-a5e2-b63c285ee5b8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:18.651244 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7690f6ee-c93c-4f0a-a671-299a55ca951b tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db879fde0bd4bea81374a7f7bb627e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cdbed43ed4de6b4cb7e1cd4802b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:18.663204 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7690f6ee-c93c-4f0a-a671-299a55ca951b tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] 10.222.0.26 "GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678" status: 200 len: 1325 microversion: 2.1 time: 0.310774 Sep 17 20:58:18.664005 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 927/1930] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:18 2022] GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678 => generated 1325 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:58:18.670061 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1b044bb3-e61b-4786-973e-624a9ee42c60 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:18.671627 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1b044bb3-e61b-4786-973e-624a9ee42c60 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] [instance: db1127cb-07c5-4e4d-8303-82b71dc31a55] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:18.679493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b044bb3-e61b-4786-973e-624a9ee42c60 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:18.679936 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b044bb3-e61b-4786-973e-624a9ee42c60 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:18.680508 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b044bb3-e61b-4786-973e-624a9ee42c60 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:18.681435 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b044bb3-e61b-4786-973e-624a9ee42c60 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:18.682568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b044bb3-e61b-4786-973e-624a9ee42c60 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:18.682568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b044bb3-e61b-4786-973e-624a9ee42c60 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:18.780831 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1b044bb3-e61b-4786-973e-624a9ee42c60 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6645db569614a10b1388a69b7e5a64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6f02f91d84fd59de856b10c42ac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:18.789411 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1b044bb3-e61b-4786-973e-624a9ee42c60 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] 10.222.0.26 "GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55" status: 200 len: 1281 microversion: 2.1 time: 0.124168 Sep 17 20:58:18.790377 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 928/1931] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:18 2022] GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55 => generated 1281 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:18.795226 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-02884477-b45f-4db6-a571-83a3b02bfcfd tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:18.796066 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-02884477-b45f-4db6-a571-83a3b02bfcfd tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: c9fe0176-1bcf-4719-a87f-17b0e0c41b6c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:18.802368 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02884477-b45f-4db6-a571-83a3b02bfcfd tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:18.803237 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02884477-b45f-4db6-a571-83a3b02bfcfd tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:18.803899 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02884477-b45f-4db6-a571-83a3b02bfcfd tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:18.804849 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02884477-b45f-4db6-a571-83a3b02bfcfd tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:18.805556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02884477-b45f-4db6-a571-83a3b02bfcfd tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:18.806365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02884477-b45f-4db6-a571-83a3b02bfcfd tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:18.896297 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-87ec68a9-6770-40f5-a5e2-b63c285ee5b8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:18.907093 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-87ec68a9-6770-40f5-a5e2-b63c285ee5b8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d" status: 200 len: 1318 microversion: 2.1 time: 0.380323 Sep 17 20:58:18.908719 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1004/1932] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:18 2022] GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:19.074314 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-02884477-b45f-4db6-a571-83a3b02bfcfd tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:19.085015 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-02884477-b45f-4db6-a571-83a3b02bfcfd tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c" status: 200 len: 1553 microversion: 2.1 time: 0.293272 Sep 17 20:58:19.086196 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 929/1933] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:18 2022] GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c => generated 1553 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:19.112307 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1b5c80d0-d6c2-46f3-8f79-99a8ffe00734 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:19.112921 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1b5c80d0-d6c2-46f3-8f79-99a8ffe00734 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:19.121368 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1b5c80d0-d6c2-46f3-8f79-99a8ffe00734 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:19.122678 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1b5c80d0-d6c2-46f3-8f79-99a8ffe00734 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:19.123734 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1b5c80d0-d6c2-46f3-8f79-99a8ffe00734 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:19.126453 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1b5c80d0-d6c2-46f3-8f79-99a8ffe00734 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:19.128822 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1b5c80d0-d6c2-46f3-8f79-99a8ffe00734 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:19.131494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1b5c80d0-d6c2-46f3-8f79-99a8ffe00734 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:19.261203 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-08467fdd-c883-4257-9a17-88f3da7438c6 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:19.262009 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-08467fdd-c883-4257-9a17-88f3da7438c6 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: bf08d895-d8f9-440d-8ade-fbc47dc6bde4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:19.276960 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08467fdd-c883-4257-9a17-88f3da7438c6 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:19.279451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08467fdd-c883-4257-9a17-88f3da7438c6 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:19.280974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08467fdd-c883-4257-9a17-88f3da7438c6 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:19.282068 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08467fdd-c883-4257-9a17-88f3da7438c6 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:19.282552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08467fdd-c883-4257-9a17-88f3da7438c6 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:19.283148 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08467fdd-c883-4257-9a17-88f3da7438c6 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:19.596680 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1b5c80d0-d6c2-46f3-8f79-99a8ffe00734 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:19.608442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1b5c80d0-d6c2-46f3-8f79-99a8ffe00734 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:19.624345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1b5c80d0-d6c2-46f3-8f79-99a8ffe00734 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:19.626699 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1b5c80d0-d6c2-46f3-8f79-99a8ffe00734 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 2950 microversion: 2.32 time: 0.518365 Sep 17 20:58:19.628482 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1005/1934] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:58:19 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 2950 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:58:19.656601 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2071ad83-1df7-4233-84db-e2fc4dff7201 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:19.657412 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2071ad83-1df7-4233-84db-e2fc4dff7201 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:19.676620 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2071ad83-1df7-4233-84db-e2fc4dff7201 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:19.677453 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2071ad83-1df7-4233-84db-e2fc4dff7201 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:19.681638 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2071ad83-1df7-4233-84db-e2fc4dff7201 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:19.682695 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2071ad83-1df7-4233-84db-e2fc4dff7201 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:19.683361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2071ad83-1df7-4233-84db-e2fc4dff7201 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:19.684057 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2071ad83-1df7-4233-84db-e2fc4dff7201 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:19.819552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-08467fdd-c883-4257-9a17-88f3da7438c6 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:19.831360 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-08467fdd-c883-4257-9a17-88f3da7438c6 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4" status: 200 len: 1308 microversion: 2.1 time: 0.578545 Sep 17 20:58:19.831964 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 930/1935] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:19 2022] GET /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4 => generated 1308 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:19.862677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-330247f4-f78e-4801-9c2e-37b644ae8ffd tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:19.863325 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-330247f4-f78e-4801-9c2e-37b644ae8ffd tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] [instance: a6f98038-008a-49b5-968e-bcb0791d4678] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:19.893569 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-330247f4-f78e-4801-9c2e-37b644ae8ffd tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:19.894309 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-330247f4-f78e-4801-9c2e-37b644ae8ffd tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:19.894547 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-330247f4-f78e-4801-9c2e-37b644ae8ffd tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:19.895322 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-330247f4-f78e-4801-9c2e-37b644ae8ffd tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:19.895787 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-330247f4-f78e-4801-9c2e-37b644ae8ffd tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:19.898056 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-330247f4-f78e-4801-9c2e-37b644ae8ffd tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:19.959182 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2071ad83-1df7-4233-84db-e2fc4dff7201 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.305869 Sep 17 20:58:19.960555 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1006/1936] 10.222.0.26 () {60 vars in 1316 bytes} [Sat Sep 17 20:58:19 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c/os-interface => generated 1831 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 20:58:19.980419 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e0b5196d-4b40-4ec5-9878-576542e662bc tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:19.981143 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e0b5196d-4b40-4ec5-9878-576542e662bc tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] [instance: db1127cb-07c5-4e4d-8303-82b71dc31a55] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:20.000771 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e0b5196d-4b40-4ec5-9878-576542e662bc tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:20.001762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e0b5196d-4b40-4ec5-9878-576542e662bc tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:20.003251 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e0b5196d-4b40-4ec5-9878-576542e662bc tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:20.004225 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e0b5196d-4b40-4ec5-9878-576542e662bc tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:20.004933 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e0b5196d-4b40-4ec5-9878-576542e662bc tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:20.005663 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e0b5196d-4b40-4ec5-9878-576542e662bc tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:20.308651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-330247f4-f78e-4801-9c2e-37b644ae8ffd tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db879fde0bd4bea81374a7f7bb627e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cdbed43ed4de6b4cb7e1cd4802b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:20.320912 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-330247f4-f78e-4801-9c2e-37b644ae8ffd tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] 10.222.0.26 "GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678" status: 200 len: 1325 microversion: 2.1 time: 0.468972 Sep 17 20:58:20.321544 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 931/1937] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:19 2022] GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678 => generated 1325 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:20.333853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-99e4948b-6da6-4967-8e63-d1192c24e838 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:20.334733 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-99e4948b-6da6-4967-8e63-d1192c24e838 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: e8e78e88-e04b-497b-bef8-c4b57aff1d1d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:20.347521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99e4948b-6da6-4967-8e63-d1192c24e838 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:20.350949 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99e4948b-6da6-4967-8e63-d1192c24e838 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:20.351671 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99e4948b-6da6-4967-8e63-d1192c24e838 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:20.352648 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99e4948b-6da6-4967-8e63-d1192c24e838 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:20.355860 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99e4948b-6da6-4967-8e63-d1192c24e838 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:20.356616 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99e4948b-6da6-4967-8e63-d1192c24e838 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:20.405265 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e0b5196d-4b40-4ec5-9878-576542e662bc tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6645db569614a10b1388a69b7e5a64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6f02f91d84fd59de856b10c42ac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:20.417545 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e0b5196d-4b40-4ec5-9878-576542e662bc tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] 10.222.0.26 "GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55" status: 200 len: 1323 microversion: 2.1 time: 0.455577 Sep 17 20:58:20.420642 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1007/1938] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:19 2022] GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55 => generated 1323 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:20.439388 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b443f2d1-51a2-4ea8-8d89-4615cbdf461c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:20.441026 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b443f2d1-51a2-4ea8-8d89-4615cbdf461c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: c9fe0176-1bcf-4719-a87f-17b0e0c41b6c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:20.459148 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b443f2d1-51a2-4ea8-8d89-4615cbdf461c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:20.460046 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b443f2d1-51a2-4ea8-8d89-4615cbdf461c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:20.460682 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b443f2d1-51a2-4ea8-8d89-4615cbdf461c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:20.465773 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b443f2d1-51a2-4ea8-8d89-4615cbdf461c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:20.466595 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b443f2d1-51a2-4ea8-8d89-4615cbdf461c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:20.467531 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b443f2d1-51a2-4ea8-8d89-4615cbdf461c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:20.874032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-99e4948b-6da6-4967-8e63-d1192c24e838 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:20.879372 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b443f2d1-51a2-4ea8-8d89-4615cbdf461c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:20.892482 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-99e4948b-6da6-4967-8e63-d1192c24e838 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d" status: 200 len: 1318 microversion: 2.1 time: 0.569590 Sep 17 20:58:20.894155 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b443f2d1-51a2-4ea8-8d89-4615cbdf461c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c" status: 200 len: 1553 microversion: 2.1 time: 0.470506 Sep 17 20:58:20.900918 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 932/1939] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:20 2022] GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d => generated 1318 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:20.911136 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1008/1940] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:20 2022] GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c => generated 1553 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:20.917656 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-62adde71-d89d-40ae-92c8-137b7e23867d req-8e367d15-185c-4959-b9ce-98f5c9ca6c0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f98038-008a-49b5-968e-bcb0791d4678", "name": "network-vif-plugged", "status": "completed", "tag": "aa59bb33-c576-4726-a83c-85d3a6aca3b0"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:20.919562 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e18f57a6-50be-4bfd-8918-f930a6e7ed0b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:20.920284 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e18f57a6-50be-4bfd-8918-f930a6e7ed0b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: bf08d895-d8f9-440d-8ade-fbc47dc6bde4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:20.931244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e18f57a6-50be-4bfd-8918-f930a6e7ed0b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:20.931780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e18f57a6-50be-4bfd-8918-f930a6e7ed0b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:20.932455 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e18f57a6-50be-4bfd-8918-f930a6e7ed0b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:20.934922 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e18f57a6-50be-4bfd-8918-f930a6e7ed0b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:20.935804 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e18f57a6-50be-4bfd-8918-f930a6e7ed0b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:20.936741 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e18f57a6-50be-4bfd-8918-f930a6e7ed0b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:20.940438 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-62adde71-d89d-40ae-92c8-137b7e23867d req-8e367d15-185c-4959-b9ce-98f5c9ca6c0b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:20.941698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-62adde71-d89d-40ae-92c8-137b7e23867d req-8e367d15-185c-4959-b9ce-98f5c9ca6c0b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:20.942780 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-62adde71-d89d-40ae-92c8-137b7e23867d req-8e367d15-185c-4959-b9ce-98f5c9ca6c0b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:20.967075 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-62adde71-d89d-40ae-92c8-137b7e23867d req-8e367d15-185c-4959-b9ce-98f5c9ca6c0b service nova] Creating event network-vif-plugged:aa59bb33-c576-4726-a83c-85d3a6aca3b0 for instance a6f98038-008a-49b5-968e-bcb0791d4678 on nch2-master-1 Sep 17 20:58:20.974119 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-62adde71-d89d-40ae-92c8-137b7e23867d req-8e367d15-185c-4959-b9ce-98f5c9ca6c0b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071479 Sep 17 20:58:20.982572 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 933/1941] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:21.292089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e18f57a6-50be-4bfd-8918-f930a6e7ed0b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:21.303389 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e18f57a6-50be-4bfd-8918-f930a6e7ed0b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4" status: 200 len: 1488 microversion: 2.1 time: 0.390835 Sep 17 20:58:21.304290 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1009/1942] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:20 2022] GET /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4 => generated 1488 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:21.335766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b6edf4fe-69a2-49f0-bf68-f4bdb7c753d9 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:21.338083 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b6edf4fe-69a2-49f0-bf68-f4bdb7c753d9 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: bf08d895-d8f9-440d-8ade-fbc47dc6bde4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:21.350851 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-91f14def-abc1-4643-8f18-310e98366699 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:21.351092 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6edf4fe-69a2-49f0-bf68-f4bdb7c753d9 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:21.351519 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6edf4fe-69a2-49f0-bf68-f4bdb7c753d9 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:21.352323 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6edf4fe-69a2-49f0-bf68-f4bdb7c753d9 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:21.354618 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6edf4fe-69a2-49f0-bf68-f4bdb7c753d9 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:21.354902 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-91f14def-abc1-4643-8f18-310e98366699 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] [instance: a6f98038-008a-49b5-968e-bcb0791d4678] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:21.355826 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6edf4fe-69a2-49f0-bf68-f4bdb7c753d9 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:21.356487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6edf4fe-69a2-49f0-bf68-f4bdb7c753d9 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:21.363442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-91f14def-abc1-4643-8f18-310e98366699 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:21.364026 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-91f14def-abc1-4643-8f18-310e98366699 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:21.364565 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-91f14def-abc1-4643-8f18-310e98366699 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:21.365524 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-91f14def-abc1-4643-8f18-310e98366699 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:21.366039 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-91f14def-abc1-4643-8f18-310e98366699 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:21.366544 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-91f14def-abc1-4643-8f18-310e98366699 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:21.401690 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-b6edf4fe-69a2-49f0-bf68-f4bdb7c753d9 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lazy-loading 'flavor' on Instance uuid bf08d895-d8f9-440d-8ade-fbc47dc6bde4 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:58:21.576580 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b6edf4fe-69a2-49f0-bf68-f4bdb7c753d9 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "POST /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4/action" status: 202 len: 0 microversion: 2.1 time: 0.250796 Sep 17 20:58:21.578720 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 934/1943] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:58:21 2022] POST /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:58:21.588590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4fed1d1a-a081-47a9-a63a-128675de3909 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:21.590570 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4fed1d1a-a081-47a9-a63a-128675de3909 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] [instance: db1127cb-07c5-4e4d-8303-82b71dc31a55] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:21.604688 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4fed1d1a-a081-47a9-a63a-128675de3909 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:21.605218 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4fed1d1a-a081-47a9-a63a-128675de3909 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:21.605749 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4fed1d1a-a081-47a9-a63a-128675de3909 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:21.606511 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4fed1d1a-a081-47a9-a63a-128675de3909 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:21.607017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4fed1d1a-a081-47a9-a63a-128675de3909 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:21.607436 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4fed1d1a-a081-47a9-a63a-128675de3909 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:21.737365 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-91f14def-abc1-4643-8f18-310e98366699 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db879fde0bd4bea81374a7f7bb627e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cdbed43ed4de6b4cb7e1cd4802b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:21.754392 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-91f14def-abc1-4643-8f18-310e98366699 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] 10.222.0.26 "GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678" status: 200 len: 1325 microversion: 2.1 time: 0.410497 Sep 17 20:58:21.755850 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1010/1944] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:21 2022] GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678 => generated 1325 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:58:21.760866 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-415e17da-8263-4173-aba2-c5f09bfa3d68 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:21.761758 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-415e17da-8263-4173-aba2-c5f09bfa3d68 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: bf08d895-d8f9-440d-8ade-fbc47dc6bde4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:21.778515 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-415e17da-8263-4173-aba2-c5f09bfa3d68 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:21.779022 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-415e17da-8263-4173-aba2-c5f09bfa3d68 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:21.779662 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-415e17da-8263-4173-aba2-c5f09bfa3d68 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:21.780614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-415e17da-8263-4173-aba2-c5f09bfa3d68 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:21.781262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-415e17da-8263-4173-aba2-c5f09bfa3d68 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:21.781920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-415e17da-8263-4173-aba2-c5f09bfa3d68 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:22.607683 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4fed1d1a-a081-47a9-a63a-128675de3909 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6645db569614a10b1388a69b7e5a64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6f02f91d84fd59de856b10c42ac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:22.621808 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4fed1d1a-a081-47a9-a63a-128675de3909 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] 10.222.0.26 "GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55" status: 200 len: 1323 microversion: 2.1 time: 1.036718 Sep 17 20:58:22.622539 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 935/1945] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:21 2022] GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55 => generated 1323 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:22.643888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4967c6d3-42a0-4546-9a57-821e5e736a39 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:22.645071 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4967c6d3-42a0-4546-9a57-821e5e736a39 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: e8e78e88-e04b-497b-bef8-c4b57aff1d1d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:22.658822 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4967c6d3-42a0-4546-9a57-821e5e736a39 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:22.659460 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4967c6d3-42a0-4546-9a57-821e5e736a39 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:22.659914 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4967c6d3-42a0-4546-9a57-821e5e736a39 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:22.660680 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4967c6d3-42a0-4546-9a57-821e5e736a39 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:22.667063 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4967c6d3-42a0-4546-9a57-821e5e736a39 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:22.669728 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4967c6d3-42a0-4546-9a57-821e5e736a39 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:22.944141 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-415e17da-8263-4173-aba2-c5f09bfa3d68 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:22.961163 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-415e17da-8263-4173-aba2-c5f09bfa3d68 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4" status: 200 len: 1496 microversion: 2.1 time: 1.202839 Sep 17 20:58:22.963856 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1011/1946] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:21 2022] GET /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4 => generated 1496 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:22.978914 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b7707300-ea42-48c1-a88f-1472124c43f4 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:22.981188 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b7707300-ea42-48c1-a88f-1472124c43f4 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: c9fe0176-1bcf-4719-a87f-17b0e0c41b6c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:23.000819 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b7707300-ea42-48c1-a88f-1472124c43f4 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:23.002131 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b7707300-ea42-48c1-a88f-1472124c43f4 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:23.005291 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b7707300-ea42-48c1-a88f-1472124c43f4 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:23.009870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b7707300-ea42-48c1-a88f-1472124c43f4 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:23.010748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b7707300-ea42-48c1-a88f-1472124c43f4 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:23.012740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b7707300-ea42-48c1-a88f-1472124c43f4 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:23.310780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b7707300-ea42-48c1-a88f-1472124c43f4 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:23.330603 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b7707300-ea42-48c1-a88f-1472124c43f4 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c" status: 200 len: 1345 microversion: 2.1 time: 0.365014 Sep 17 20:58:23.332581 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1012/1947] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:22 2022] GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c => generated 1345 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:23.345946 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fd592c42-e31b-4bbd-9209-83274d028377 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:23.351554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fd592c42-e31b-4bbd-9209-83274d028377 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] [instance: a6f98038-008a-49b5-968e-bcb0791d4678] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:23.367399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fd592c42-e31b-4bbd-9209-83274d028377 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:23.367888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fd592c42-e31b-4bbd-9209-83274d028377 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:23.380145 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fd592c42-e31b-4bbd-9209-83274d028377 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:23.383042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fd592c42-e31b-4bbd-9209-83274d028377 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:23.389190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fd592c42-e31b-4bbd-9209-83274d028377 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:23.389897 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fd592c42-e31b-4bbd-9209-83274d028377 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:23.433915 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=17 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:58:23.459622 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=70 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:58:23.569878 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4967c6d3-42a0-4546-9a57-821e5e736a39 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:23.585038 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4967c6d3-42a0-4546-9a57-821e5e736a39 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d" status: 200 len: 1318 microversion: 2.1 time: 0.961366 Sep 17 20:58:23.596974 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 936/1948] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:22 2022] GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d => generated 1318 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:23.602079 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-db0f2279-c7da-4198-bfd4-b279a53eb90e req-f03d690a-1334-4f24-b0e0-07975719bc89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db1127cb-07c5-4e4d-8303-82b71dc31a55", "tag": "7ccc18b2-9166-4b44-ac7e-9b13135b61de"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:23.621585 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-db0f2279-c7da-4198-bfd4-b279a53eb90e req-f03d690a-1334-4f24-b0e0-07975719bc89 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:23.622794 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-db0f2279-c7da-4198-bfd4-b279a53eb90e req-f03d690a-1334-4f24-b0e0-07975719bc89 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:23.623448 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-db0f2279-c7da-4198-bfd4-b279a53eb90e req-f03d690a-1334-4f24-b0e0-07975719bc89 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:23.642605 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-db0f2279-c7da-4198-bfd4-b279a53eb90e req-f03d690a-1334-4f24-b0e0-07975719bc89 service nova] Creating event network-changed:7ccc18b2-9166-4b44-ac7e-9b13135b61de for instance db1127cb-07c5-4e4d-8303-82b71dc31a55 on nch1-master-1 Sep 17 20:58:23.653124 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-db0f2279-c7da-4198-bfd4-b279a53eb90e req-f03d690a-1334-4f24-b0e0-07975719bc89 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054354 Sep 17 20:58:23.654556 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 937/1949] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:23.663611 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-6d139d07-191d-4c25-a1ef-361829c5a0e3 req-38f4f9b4-0599-4612-8a55-5cf96884e6df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faba011e-8cd7-4120-9e2d-8e98112899b3", "name": "network-vif-plugged", "status": "completed", "tag": "1dc51fd9-35d7-4713-b096-63b7f248f58f"}, {"server_uuid": "e8e78e88-e04b-497b-bef8-c4b57aff1d1d", "name": "network-vif-plugged", "status": "completed", "tag": "20742609-eb1b-4058-800c-a0a66327aa5c"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:23.688219 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-6d139d07-191d-4c25-a1ef-361829c5a0e3 req-38f4f9b4-0599-4612-8a55-5cf96884e6df service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:23.689627 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-6d139d07-191d-4c25-a1ef-361829c5a0e3 req-38f4f9b4-0599-4612-8a55-5cf96884e6df service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:23.690263 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-6d139d07-191d-4c25-a1ef-361829c5a0e3 req-38f4f9b4-0599-4612-8a55-5cf96884e6df service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:23.719875 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-6d139d07-191d-4c25-a1ef-361829c5a0e3 req-38f4f9b4-0599-4612-8a55-5cf96884e6df service nova] Creating event network-vif-plugged:1dc51fd9-35d7-4713-b096-63b7f248f58f for instance faba011e-8cd7-4120-9e2d-8e98112899b3 on nch2-master-1 Sep 17 20:58:23.720417 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-6d139d07-191d-4c25-a1ef-361829c5a0e3 req-38f4f9b4-0599-4612-8a55-5cf96884e6df service nova] Creating event network-vif-plugged:20742609-eb1b-4058-800c-a0a66327aa5c for instance e8e78e88-e04b-497b-bef8-c4b57aff1d1d on nch2-master-1 Sep 17 20:58:23.727889 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-6d139d07-191d-4c25-a1ef-361829c5a0e3 req-38f4f9b4-0599-4612-8a55-5cf96884e6df service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.069590 Sep 17 20:58:23.731181 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 938/1950] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:23.738266 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-88a12b4c-4c2f-4bce-8f35-778f00f7adbe tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:23.740384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-88a12b4c-4c2f-4bce-8f35-778f00f7adbe tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] [instance: db1127cb-07c5-4e4d-8303-82b71dc31a55] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:23.765100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-88a12b4c-4c2f-4bce-8f35-778f00f7adbe tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:23.766318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-88a12b4c-4c2f-4bce-8f35-778f00f7adbe tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:23.767684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-88a12b4c-4c2f-4bce-8f35-778f00f7adbe tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:23.771112 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-88a12b4c-4c2f-4bce-8f35-778f00f7adbe tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:23.771932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-88a12b4c-4c2f-4bce-8f35-778f00f7adbe tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:23.773231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-88a12b4c-4c2f-4bce-8f35-778f00f7adbe tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:23.830800 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fd592c42-e31b-4bbd-9209-83274d028377 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db879fde0bd4bea81374a7f7bb627e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cdbed43ed4de6b4cb7e1cd4802b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:23.848249 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fd592c42-e31b-4bbd-9209-83274d028377 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] 10.222.0.26 "GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678" status: 200 len: 1521 microversion: 2.1 time: 0.509071 Sep 17 20:58:23.849137 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1013/1951] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:23 2022] GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678 => generated 1521 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:23.875699 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d4818fbb-b8f7-4201-aaa0-680a7491c98f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:23.876240 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d4818fbb-b8f7-4201-aaa0-680a7491c98f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] [instance: a6f98038-008a-49b5-968e-bcb0791d4678] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:23.890352 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:58:23.895479 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d4818fbb-b8f7-4201-aaa0-680a7491c98f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:23.895981 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d4818fbb-b8f7-4201-aaa0-680a7491c98f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:23.896429 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d4818fbb-b8f7-4201-aaa0-680a7491c98f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:23.897157 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d4818fbb-b8f7-4201-aaa0-680a7491c98f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:23.909947 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d4818fbb-b8f7-4201-aaa0-680a7491c98f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:23.910477 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d4818fbb-b8f7-4201-aaa0-680a7491c98f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:23.972760 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-d4818fbb-b8f7-4201-aaa0-680a7491c98f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] HTTP exception thrown: Action 999 not found Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d4818fbb-b8f7-4201-aaa0-680a7491c98f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Request method failure captured: Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678/os-instance-actions/999 HTTP/1.1 Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjTUgiAu10zpY-IOLG41JnWWzQYCCySu2R0mdqxd4LJbe3tN8zfMJGK0PzwgLsuZnDBuCQXKgsUz_wYnhejtrfze5j84rQtrlmWEwLQVjexWe3Pc15F63qbEgduWvjnLk1ftKFvvxP4rU7i6caxa21aoSWLK_-A40JM3d3nGjsboIwg Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 044cdbed43ed4de6b4cb7e1cd4802b65 Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1307695587 Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/044cdbed43ed4de6b4cb7e1cd4802b65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/044cdbed43ed4de6b4cb7e1cd4802b65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/044cdbed43ed4de6b4cb7e1cd4802b65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_044cdbed43ed4de6b4cb7e1cd4802b65", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1307695587 Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 044cdbed43ed4de6b4cb7e1cd4802b65 Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1307695587 Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-InstanceActionsNegativeTestJSON-1307695587-project Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 8db879fde0bd4bea81374a7f7bb627e6 Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1307695587-project Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: exception: Action 999 not found Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'server_id': 'a6f98038-008a-49b5-968e-bcb0791d4678', 'id': '999'} Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Sep 17 20:58:23.976160 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:58:23.981396 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d4818fbb-b8f7-4201-aaa0-680a7491c98f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Returning 404 to user: Action 999 not found {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:58:23.983369 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d4818fbb-b8f7-4201-aaa0-680a7491c98f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] 10.222.0.26 "GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.112220 Sep 17 20:58:23.984325 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1014/1952] 10.222.0.26 () {58 vars in 1308 bytes} [Sat Sep 17 20:58:23 2022] GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678/os-instance-actions/999 => generated 66 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 20:58:23.998054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1ca05290-8ecd-4c04-afce-d7310b4a615c tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Calling method '.version_select at 0x7f25a4d73550>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:24.002000 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1ca05290-8ecd-4c04-afce-d7310b4a615c tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] [instance: 848dc271-faf5-4cfe-ad2f-eb76c0f11763] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:24.015220 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-1ca05290-8ecd-4c04-afce-d7310b4a615c tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] HTTP exception thrown: Instance 848dc271-faf5-4cfe-ad2f-eb76c0f11763 could not be found. Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1ca05290-8ecd-4c04-afce-d7310b4a615c tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Request method failure captured: Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/848dc271-faf5-4cfe-ad2f-eb76c0f11763/os-instance-actions HTTP/1.1 Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjTUgiAu10zpY-IOLG41JnWWzQYCCySu2R0mdqxd4LJbe3tN8zfMJGK0PzwgLsuZnDBuCQXKgsUz_wYnhejtrfze5j84rQtrlmWEwLQVjexWe3Pc15F63qbEgduWvjnLk1ftKFvvxP4rU7i6caxa21aoSWLK_-A40JM3d3nGjsboIwg Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 044cdbed43ed4de6b4cb7e1cd4802b65 Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1307695587 Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/044cdbed43ed4de6b4cb7e1cd4802b65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/044cdbed43ed4de6b4cb7e1cd4802b65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/044cdbed43ed4de6b4cb7e1cd4802b65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_044cdbed43ed4de6b4cb7e1cd4802b65", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1307695587 Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 044cdbed43ed4de6b4cb7e1cd4802b65 Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1307695587 Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-InstanceActionsNegativeTestJSON-1307695587-project Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 8db879fde0bd4bea81374a7f7bb627e6 Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1307695587-project Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 848dc271-faf5-4cfe-ad2f-eb76c0f11763 could not be found. Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'server_id': '848dc271-faf5-4cfe-ad2f-eb76c0f11763'} Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 848dc271-faf5-4cfe-ad2f-eb76c0f11763 could not be found. Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:58:24.017193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:58:24.022413 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 848dc271-faf5-4cfe-ad2f-eb76c0f11763 could not be found. Sep 17 20:58:24.022413 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:58:24.022413 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:24.022413 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:58:24.022413 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:24.022413 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:24.022413 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:24.022413 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:58:24.022413 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:58:24.022413 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 848dc271-faf5-4cfe-ad2f-eb76c0f11763 could not be found. Sep 17 20:58:24.022413 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:58:24.022413 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1ca05290-8ecd-4c04-afce-d7310b4a615c tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Returning 404 to user: Instance 848dc271-faf5-4cfe-ad2f-eb76c0f11763 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:58:24.022413 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1ca05290-8ecd-4c04-afce-d7310b4a615c tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] 10.222.0.26 "GET /compute/v2.1/servers/848dc271-faf5-4cfe-ad2f-eb76c0f11763/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.024705 Sep 17 20:58:24.022413 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1015/1953] 10.222.0.26 () {58 vars in 1296 bytes} [Sat Sep 17 20:58:23 2022] GET /compute/v2.1/servers/848dc271-faf5-4cfe-ad2f-eb76c0f11763/os-instance-actions => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:58:24.042456 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d918c014-f37d-4260-bf48-495ddaaf766a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:24.043312 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d918c014-f37d-4260-bf48-495ddaaf766a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: bf08d895-d8f9-440d-8ade-fbc47dc6bde4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:24.050145 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d918c014-f37d-4260-bf48-495ddaaf766a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:24.050909 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d918c014-f37d-4260-bf48-495ddaaf766a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:24.051612 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d918c014-f37d-4260-bf48-495ddaaf766a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:24.052540 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d918c014-f37d-4260-bf48-495ddaaf766a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:24.054344 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d918c014-f37d-4260-bf48-495ddaaf766a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:24.058165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d918c014-f37d-4260-bf48-495ddaaf766a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:24.084286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:58:24.198517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-88a12b4c-4c2f-4bce-8f35-778f00f7adbe tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6645db569614a10b1388a69b7e5a64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6f02f91d84fd59de856b10c42ac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:24.208584 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-88a12b4c-4c2f-4bce-8f35-778f00f7adbe tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] 10.222.0.26 "GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55" status: 200 len: 1323 microversion: 2.1 time: 0.475102 Sep 17 20:58:24.222375 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 939/1954] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:23 2022] GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55 => generated 1323 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:24.235485 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a81aa543-031a-4794-839b-be4cb487c0c6 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:24.237441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a81aa543-031a-4794-839b-be4cb487c0c6 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] [instance: a6f98038-008a-49b5-968e-bcb0791d4678] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:24.244952 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a81aa543-031a-4794-839b-be4cb487c0c6 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:24.245644 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a81aa543-031a-4794-839b-be4cb487c0c6 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:24.246347 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a81aa543-031a-4794-839b-be4cb487c0c6 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:24.247308 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a81aa543-031a-4794-839b-be4cb487c0c6 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:24.247970 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a81aa543-031a-4794-839b-be4cb487c0c6 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:24.248641 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a81aa543-031a-4794-839b-be4cb487c0c6 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:24.291976 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a81aa543-031a-4794-839b-be4cb487c0c6 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] [instance: a6f98038-008a-49b5-968e-bcb0791d4678] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:58:24.326255 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:58:24.395702 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d918c014-f37d-4260-bf48-495ddaaf766a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:24.411013 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a81aa543-031a-4794-839b-be4cb487c0c6 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678" status: 204 len: 0 microversion: 2.1 time: 0.186818 Sep 17 20:58:24.412132 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 940/1955] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:58:24 2022] DELETE /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:58:24.413385 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d918c014-f37d-4260-bf48-495ddaaf766a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4" status: 200 len: 1479 microversion: 2.1 time: 0.393108 Sep 17 20:58:24.417616 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d592dd10-ca79-40a2-bc93-67093e81baee tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:24.418534 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d592dd10-ca79-40a2-bc93-67093e81baee tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: c9fe0176-1bcf-4719-a87f-17b0e0c41b6c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:24.426025 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1016/1956] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:24 2022] GET /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4 => generated 1479 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:24.433428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d592dd10-ca79-40a2-bc93-67093e81baee tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:24.433954 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d592dd10-ca79-40a2-bc93-67093e81baee tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:24.435685 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d592dd10-ca79-40a2-bc93-67093e81baee tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:24.435685 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d592dd10-ca79-40a2-bc93-67093e81baee tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:24.435685 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d592dd10-ca79-40a2-bc93-67093e81baee tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:24.436122 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d592dd10-ca79-40a2-bc93-67093e81baee tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:24.439381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a82e5332-7d27-400d-9e91-fb0036676bd8 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:24.441744 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a82e5332-7d27-400d-9e91-fb0036676bd8 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] [instance: a6f98038-008a-49b5-968e-bcb0791d4678] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:24.448892 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a82e5332-7d27-400d-9e91-fb0036676bd8 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:24.449294 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a82e5332-7d27-400d-9e91-fb0036676bd8 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:24.450029 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a82e5332-7d27-400d-9e91-fb0036676bd8 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:24.450986 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a82e5332-7d27-400d-9e91-fb0036676bd8 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:24.451745 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a82e5332-7d27-400d-9e91-fb0036676bd8 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:24.452415 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a82e5332-7d27-400d-9e91-fb0036676bd8 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:24.472405 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-d592dd10-ca79-40a2-bc93-67093e81baee tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] HTTP exception thrown: Instance c9fe0176-1bcf-4719-a87f-17b0e0c41b6c could not be found. Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d592dd10-ca79-40a2-bc93-67093e81baee tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Request method failure captured: Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c HTTP/1.1 Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjSr4eYJ5iRC0BESTxyEYBHr6fTKXAfzmSKRijJd1-Dg4_6zeDPSLMVKcn7Va4xyX_oACpKQBdCcihzycrxxeD9gtcf6rUAIbBHhHnQZK1W2woTj604P1AONqCzsshMWFY41NR-lshpdEXKwYePjmUqN1wZWN-nWEva1tUOKD4iFshs Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89b46ae7347d4f2daf02f627e41a4847", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-DeleteServersTestJSON-583053734 Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-DeleteServersTestJSON-583053734-project Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 3009c5feb1ef43a08b07996d8f63bf11 Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-DeleteServersTestJSON-583053734-project Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance c9fe0176-1bcf-4719-a87f-17b0e0c41b6c could not be found. Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'c9fe0176-1bcf-4719-a87f-17b0e0c41b6c'} Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9fe0176-1bcf-4719-a87f-17b0e0c41b6c could not be found. Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9fe0176-1bcf-4719-a87f-17b0e0c41b6c could not be found. Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:24.478876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:24.486826 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:24.486826 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:24.486826 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:24.486826 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:58:24.486826 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:58:24.486826 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9fe0176-1bcf-4719-a87f-17b0e0c41b6c could not be found. Sep 17 20:58:24.486826 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:24.490441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d592dd10-ca79-40a2-bc93-67093e81baee tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Returning 404 to user: Instance c9fe0176-1bcf-4719-a87f-17b0e0c41b6c could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:58:24.492329 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d592dd10-ca79-40a2-bc93-67093e81baee tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c" status: 404 len: 111 microversion: 2.1 time: 0.079033 Sep 17 20:58:24.493098 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 941/1957] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:24 2022] GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:58:24.503287 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0ba3992b-6fed-4999-9a3c-c9853d98baca tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-478630660"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:24.510162 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0ba3992b-6fed-4999-9a3c-c9853d98baca tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: bf08d895-d8f9-440d-8ade-fbc47dc6bde4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:24.523897 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:58:24.525839 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ba3992b-6fed-4999-9a3c-c9853d98baca tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:24.526621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ba3992b-6fed-4999-9a3c-c9853d98baca tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:24.527237 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ba3992b-6fed-4999-9a3c-c9853d98baca tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:24.528552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ba3992b-6fed-4999-9a3c-c9853d98baca tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:24.529408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ba3992b-6fed-4999-9a3c-c9853d98baca tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:24.531542 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ba3992b-6fed-4999-9a3c-c9853d98baca tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:24.802160 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a82e5332-7d27-400d-9e91-fb0036676bd8 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db879fde0bd4bea81374a7f7bb627e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cdbed43ed4de6b4cb7e1cd4802b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:24.813251 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a82e5332-7d27-400d-9e91-fb0036676bd8 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] 10.222.0.26 "GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678" status: 200 len: 1527 microversion: 2.1 time: 0.385036 Sep 17 20:58:24.817814 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1017/1958] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:24 2022] GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678 => generated 1527 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:24.824052 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1c90348b-3b16-47d1-9859-a011cefdcb82 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:24.828246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1c90348b-3b16-47d1-9859-a011cefdcb82 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: e8e78e88-e04b-497b-bef8-c4b57aff1d1d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:24.850099 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c90348b-3b16-47d1-9859-a011cefdcb82 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:24.859023 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c90348b-3b16-47d1-9859-a011cefdcb82 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:24.859620 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c90348b-3b16-47d1-9859-a011cefdcb82 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:24.860567 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c90348b-3b16-47d1-9859-a011cefdcb82 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:24.861342 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c90348b-3b16-47d1-9859-a011cefdcb82 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:24.861950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c90348b-3b16-47d1-9859-a011cefdcb82 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:24.961311 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0ba3992b-6fed-4999-9a3c-c9853d98baca tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "POST /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4/action" status: 202 len: 0 microversion: 2.1 time: 0.465063 Sep 17 20:58:24.962192 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 942/1959] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:58:24 2022] POST /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 17 20:58:24.974102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6fcd046e-42f5-426a-933f-403809f084cf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:24.976591 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6fcd046e-42f5-426a-933f-403809f084cf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: c9fe0176-1bcf-4719-a87f-17b0e0c41b6c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:24.986890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fcd046e-42f5-426a-933f-403809f084cf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:24.986890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fcd046e-42f5-426a-933f-403809f084cf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:24.987528 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fcd046e-42f5-426a-933f-403809f084cf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:24.988550 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fcd046e-42f5-426a-933f-403809f084cf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:24.989003 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fcd046e-42f5-426a-933f-403809f084cf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:24.989886 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fcd046e-42f5-426a-933f-403809f084cf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:25.013446 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-6fcd046e-42f5-426a-933f-403809f084cf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] HTTP exception thrown: Instance c9fe0176-1bcf-4719-a87f-17b0e0c41b6c could not be found. Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6fcd046e-42f5-426a-933f-403809f084cf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Request method failure captured: Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c/os-volume_attachments HTTP/1.1 Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjSr4eYJ5iRC0BESTxyEYBHr6fTKXAfzmSKRijJd1-Dg4_6zeDPSLMVKcn7Va4xyX_oACpKQBdCcihzycrxxeD9gtcf6rUAIbBHhHnQZK1W2woTj604P1AONqCzsshMWFY41NR-lshpdEXKwYePjmUqN1wZWN-nWEva1tUOKD4iFshs Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89b46ae7347d4f2daf02f627e41a4847", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-DeleteServersTestJSON-583053734 Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-DeleteServersTestJSON-583053734-project Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 3009c5feb1ef43a08b07996d8f63bf11 Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-DeleteServersTestJSON-583053734-project Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance c9fe0176-1bcf-4719-a87f-17b0e0c41b6c could not be found. Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'server_id': 'c9fe0176-1bcf-4719-a87f-17b0e0c41b6c'} Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9fe0176-1bcf-4719-a87f-17b0e0c41b6c could not be found. Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:58:25.016746 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:58:25.022401 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9fe0176-1bcf-4719-a87f-17b0e0c41b6c could not be found. Sep 17 20:58:25.022401 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:25.022401 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:25.022401 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:25.022401 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:25.022401 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:25.022401 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:25.022401 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:58:25.022401 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:58:25.022401 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9fe0176-1bcf-4719-a87f-17b0e0c41b6c could not be found. Sep 17 20:58:25.022401 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:25.025684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6fcd046e-42f5-426a-933f-403809f084cf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Returning 404 to user: Instance c9fe0176-1bcf-4719-a87f-17b0e0c41b6c could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:58:25.026652 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6fcd046e-42f5-426a-933f-403809f084cf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.063037 Sep 17 20:58:25.027307 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 943/1960] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 17 20:58:24 2022] GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c/os-volume_attachments => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:58:25.034913 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-aec88f33-01ac-4129-a389-4ea2b380efac tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4f359d0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:25.100445 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-aec88f33-01ac-4129-a389-4ea2b380efac tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b" status: 200 len: 1439 microversion: 2.1 time: 0.071279 Sep 17 20:58:25.102150 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 944/1961] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:58:25 2022] GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b => generated 1439 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:25.239178 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a0095c45-c132-414b-bcc6-0505e6019bb4 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:25.239878 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a0095c45-c132-414b-bcc6-0505e6019bb4 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] [instance: db1127cb-07c5-4e4d-8303-82b71dc31a55] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:25.254936 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0095c45-c132-414b-bcc6-0505e6019bb4 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:25.256114 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0095c45-c132-414b-bcc6-0505e6019bb4 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:25.263790 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0095c45-c132-414b-bcc6-0505e6019bb4 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:25.264653 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0095c45-c132-414b-bcc6-0505e6019bb4 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:25.265141 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0095c45-c132-414b-bcc6-0505e6019bb4 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:25.271671 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0095c45-c132-414b-bcc6-0505e6019bb4 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:25.303526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1c90348b-3b16-47d1-9859-a011cefdcb82 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:25.331125 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1c90348b-3b16-47d1-9859-a011cefdcb82 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d" status: 200 len: 1318 microversion: 2.1 time: 0.510813 Sep 17 20:58:25.331751 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1018/1962] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:24 2022] GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d => generated 1318 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:25.349573 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-84eb366a-9e47-481e-b2c0-f2196d12ef75 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1537209078", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "25526ef3-eaa2-4f18-ac44-bfbbfae855ea"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:25.419862 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-84eb366a-9e47-481e-b2c0-f2196d12ef75 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] validate_networks() for [('25526ef3-eaa2-4f18-ac44-bfbbfae855ea', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:58:25.733072 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a0095c45-c132-414b-bcc6-0505e6019bb4 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6645db569614a10b1388a69b7e5a64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6f02f91d84fd59de856b10c42ac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:25.743988 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a0095c45-c132-414b-bcc6-0505e6019bb4 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] 10.222.0.26 "GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55" status: 200 len: 1323 microversion: 2.1 time: 0.508672 Sep 17 20:58:25.744783 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 945/1963] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:25 2022] GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55 => generated 1323 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:25.752106 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-fa72e560-25ec-45f6-85c2-6ca58a582cc6 req-d43f5bfd-59a6-48b8-93c5-ce88c69f4714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9fe0176-1bcf-4719-a87f-17b0e0c41b6c", "name": "network-vif-deleted", "tag": "426f4af4-d3cb-4129-98a4-e9ba8b33cab4"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:25.763730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-fa72e560-25ec-45f6-85c2-6ca58a582cc6 req-d43f5bfd-59a6-48b8-93c5-ce88c69f4714 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:25.764880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-fa72e560-25ec-45f6-85c2-6ca58a582cc6 req-d43f5bfd-59a6-48b8-93c5-ce88c69f4714 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:25.765651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-fa72e560-25ec-45f6-85c2-6ca58a582cc6 req-d43f5bfd-59a6-48b8-93c5-ce88c69f4714 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:25.779572 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-fa72e560-25ec-45f6-85c2-6ca58a582cc6 req-d43f5bfd-59a6-48b8-93c5-ce88c69f4714 service nova] Creating event network-vif-deleted:426f4af4-d3cb-4129-98a4-e9ba8b33cab4 for instance c9fe0176-1bcf-4719-a87f-17b0e0c41b6c on nch2-master-1 Sep 17 20:58:25.790205 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-fa72e560-25ec-45f6-85c2-6ca58a582cc6 req-d43f5bfd-59a6-48b8-93c5-ce88c69f4714 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042275 Sep 17 20:58:25.791821 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 946/1964] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:25.846864 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b61f175f-1837-4f56-8147-20988e8797bf tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:25.849200 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b61f175f-1837-4f56-8147-20988e8797bf tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] [instance: a6f98038-008a-49b5-968e-bcb0791d4678] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:25.872638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b61f175f-1837-4f56-8147-20988e8797bf tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:25.873389 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b61f175f-1837-4f56-8147-20988e8797bf tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:25.874231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b61f175f-1837-4f56-8147-20988e8797bf tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:25.875478 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b61f175f-1837-4f56-8147-20988e8797bf tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:25.877633 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b61f175f-1837-4f56-8147-20988e8797bf tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:25.878344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b61f175f-1837-4f56-8147-20988e8797bf tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:26.270246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b61f175f-1837-4f56-8147-20988e8797bf tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db879fde0bd4bea81374a7f7bb627e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cdbed43ed4de6b4cb7e1cd4802b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:26.288367 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b61f175f-1837-4f56-8147-20988e8797bf tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] 10.222.0.26 "GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678" status: 200 len: 1527 microversion: 2.1 time: 0.449263 Sep 17 20:58:26.290660 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 947/1965] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:25 2022] GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678 => generated 1527 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:58:26.306429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b3aa7d61-d376-42b4-8eda-c87e968ee57b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4f6b310>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:26.497876 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b3aa7d61-d376-42b4-8eda-c87e968ee57b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b" status: 200 len: 1439 microversion: 2.1 time: 0.203987 Sep 17 20:58:26.499280 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 948/1966] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:58:26 2022] GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b => generated 1439 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:26.540161 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-27719c79-5f37-44d7-ae27-326d37a4eb36 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:26.553890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-27719c79-5f37-44d7-ae27-326d37a4eb36 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: e8e78e88-e04b-497b-bef8-c4b57aff1d1d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:26.585070 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-27719c79-5f37-44d7-ae27-326d37a4eb36 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:26.585626 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-27719c79-5f37-44d7-ae27-326d37a4eb36 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:26.586151 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-27719c79-5f37-44d7-ae27-326d37a4eb36 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:26.587169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-27719c79-5f37-44d7-ae27-326d37a4eb36 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:26.587371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-27719c79-5f37-44d7-ae27-326d37a4eb36 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:26.587832 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-27719c79-5f37-44d7-ae27-326d37a4eb36 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:26.622460 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-84eb366a-9e47-481e-b2c0-f2196d12ef75 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:58:26.623021 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-84eb366a-9e47-481e-b2c0-f2196d12ef75 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:58:26.623331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-84eb366a-9e47-481e-b2c0-f2196d12ef75 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:58:26.624154 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-84eb366a-9e47-481e-b2c0-f2196d12ef75 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:58:26.625679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-84eb366a-9e47-481e-b2c0-f2196d12ef75 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:58:26.658284 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84eb366a-9e47-481e-b2c0-f2196d12ef75 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:26.658692 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84eb366a-9e47-481e-b2c0-f2196d12ef75 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:26.659895 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84eb366a-9e47-481e-b2c0-f2196d12ef75 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:26.660056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84eb366a-9e47-481e-b2c0-f2196d12ef75 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:26.660482 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84eb366a-9e47-481e-b2c0-f2196d12ef75 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:26.660926 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84eb366a-9e47-481e-b2c0-f2196d12ef75 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:26.709328 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-84eb366a-9e47-481e-b2c0-f2196d12ef75 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Getting quotas for project 89b46ae7347d4f2daf02f627e41a4847. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:58:26.715245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-84eb366a-9e47-481e-b2c0-f2196d12ef75 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Getting quotas for user 3009c5feb1ef43a08b07996d8f63bf11 and project 89b46ae7347d4f2daf02f627e41a4847. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:58:26.733707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-84eb366a-9e47-481e-b2c0-f2196d12ef75 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:58:26.736770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-84eb366a-9e47-481e-b2c0-f2196d12ef75 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: fe3b5d5c-7a30-4126-bea8-39665108391b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:58:26.832554 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-84eb366a-9e47-481e-b2c0-f2196d12ef75 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.499456 Sep 17 20:58:26.836139 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1019/1967] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:58:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:58:26.859773 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7a96a3fa-62c1-4963-ba67-0d0880ca700e tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:26.863273 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7a96a3fa-62c1-4963-ba67-0d0880ca700e tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] [instance: db1127cb-07c5-4e4d-8303-82b71dc31a55] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:26.880356 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a96a3fa-62c1-4963-ba67-0d0880ca700e tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:26.881749 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a96a3fa-62c1-4963-ba67-0d0880ca700e tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:26.883881 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a96a3fa-62c1-4963-ba67-0d0880ca700e tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:26.884879 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a96a3fa-62c1-4963-ba67-0d0880ca700e tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:26.885610 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a96a3fa-62c1-4963-ba67-0d0880ca700e tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:26.887025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a96a3fa-62c1-4963-ba67-0d0880ca700e tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:26.961562 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-27719c79-5f37-44d7-ae27-326d37a4eb36 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:26.973245 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-27719c79-5f37-44d7-ae27-326d37a4eb36 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d" status: 200 len: 1318 microversion: 2.1 time: 0.466179 Sep 17 20:58:26.977030 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 949/1968] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:26 2022] GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d => generated 1318 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:26.985592 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-964f6599-a027-46a1-95e5-593c0c47bd95 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:26.986420 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-964f6599-a027-46a1-95e5-593c0c47bd95 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: fe3b5d5c-7a30-4126-bea8-39665108391b] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:27.105318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-964f6599-a027-46a1-95e5-593c0c47bd95 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:27.112519 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-964f6599-a027-46a1-95e5-593c0c47bd95 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/fe3b5d5c-7a30-4126-bea8-39665108391b" status: 200 len: 1215 microversion: 2.1 time: 0.134172 Sep 17 20:58:27.116263 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 950/1969] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:26 2022] GET /compute/v2.1/servers/fe3b5d5c-7a30-4126-bea8-39665108391b => generated 1215 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:27.145919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5394a763-30c2-47ca-8479-62178f986f26 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:27.147144 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5394a763-30c2-47ca-8479-62178f986f26 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: fe3b5d5c-7a30-4126-bea8-39665108391b] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:27.188804 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5394a763-30c2-47ca-8479-62178f986f26 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: fe3b5d5c-7a30-4126-bea8-39665108391b] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:58:27.345297 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7a96a3fa-62c1-4963-ba67-0d0880ca700e tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6645db569614a10b1388a69b7e5a64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6f02f91d84fd59de856b10c42ac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:27.374362 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7a96a3fa-62c1-4963-ba67-0d0880ca700e tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] 10.222.0.26 "GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55" status: 200 len: 1323 microversion: 2.1 time: 0.535815 Sep 17 20:58:27.375702 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1020/1970] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:26 2022] GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55 => generated 1323 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:27.415424 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-05b2eec3-c62f-49bb-846d-6bf192c695c4 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:27.421783 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-05b2eec3-c62f-49bb-846d-6bf192c695c4 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] [instance: a6f98038-008a-49b5-968e-bcb0791d4678] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:27.474953 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-05b2eec3-c62f-49bb-846d-6bf192c695c4 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:27.475984 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-05b2eec3-c62f-49bb-846d-6bf192c695c4 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:27.476874 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-05b2eec3-c62f-49bb-846d-6bf192c695c4 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:27.478706 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-05b2eec3-c62f-49bb-846d-6bf192c695c4 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:27.479614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-05b2eec3-c62f-49bb-846d-6bf192c695c4 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:27.480760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-05b2eec3-c62f-49bb-846d-6bf192c695c4 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:27.525115 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.scheduler.client.report [None req-5394a763-30c2-47ca-8479-62178f986f26 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Deleted allocations for instance fe3b5d5c-7a30-4126-bea8-39665108391b Sep 17 20:58:27.534956 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.compute.api [None req-5394a763-30c2-47ca-8479-62178f986f26 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: fe3b5d5c-7a30-4126-bea8-39665108391b] Instance Mapping does not exist while attempting local delete cleanup. Sep 17 20:58:27.535815 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5394a763-30c2-47ca-8479-62178f986f26 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fe3b5d5c-7a30-4126-bea8-39665108391b" status: 204 len: 0 microversion: 2.1 time: 0.394652 Sep 17 20:58:27.536410 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 951/1971] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:58:27 2022] DELETE /compute/v2.1/servers/fe3b5d5c-7a30-4126-bea8-39665108391b => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:58:27.553346 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d84b6312-915e-49cd-8072-ba1a602f5eed tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4e95310>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:27.640125 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d84b6312-915e-49cd-8072-ba1a602f5eed tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b" status: 200 len: 1439 microversion: 2.1 time: 0.102634 Sep 17 20:58:27.641189 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 952/1972] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:58:27 2022] GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b => generated 1439 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:27.646149 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e12995a8-949e-4a97-b55f-a7093349f3a0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:27.654411 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e12995a8-949e-4a97-b55f-a7093349f3a0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: fe3b5d5c-7a30-4126-bea8-39665108391b] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:27.684589 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-e12995a8-949e-4a97-b55f-a7093349f3a0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] HTTP exception thrown: Instance fe3b5d5c-7a30-4126-bea8-39665108391b could not be found. Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e12995a8-949e-4a97-b55f-a7093349f3a0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Request method failure captured: Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/fe3b5d5c-7a30-4126-bea8-39665108391b HTTP/1.1 Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjSr4eYJ5iRC0BESTxyEYBHr6fTKXAfzmSKRijJd1-Dg4_6zeDPSLMVKcn7Va4xyX_oACpKQBdCcihzycrxxeD9gtcf6rUAIbBHhHnQZK1W2woTj604P1AONqCzsshMWFY41NR-lshpdEXKwYePjmUqN1wZWN-nWEva1tUOKD4iFshs Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89b46ae7347d4f2daf02f627e41a4847", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-DeleteServersTestJSON-583053734 Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-DeleteServersTestJSON-583053734-project Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 3009c5feb1ef43a08b07996d8f63bf11 Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-DeleteServersTestJSON-583053734-project Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance fe3b5d5c-7a30-4126-bea8-39665108391b could not be found. Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'fe3b5d5c-7a30-4126-bea8-39665108391b'} Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe3b5d5c-7a30-4126-bea8-39665108391b could not be found. Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe3b5d5c-7a30-4126-bea8-39665108391b could not be found. Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:27.688804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:27.694085 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:27.694085 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:58:27.694085 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:58:27.694085 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe3b5d5c-7a30-4126-bea8-39665108391b could not be found. Sep 17 20:58:27.694085 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:27.694085 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e12995a8-949e-4a97-b55f-a7093349f3a0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Returning 404 to user: Instance fe3b5d5c-7a30-4126-bea8-39665108391b could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:58:27.694085 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e12995a8-949e-4a97-b55f-a7093349f3a0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/fe3b5d5c-7a30-4126-bea8-39665108391b" status: 404 len: 111 microversion: 2.1 time: 0.047951 Sep 17 20:58:27.694085 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 953/1973] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:27 2022] GET /compute/v2.1/servers/fe3b5d5c-7a30-4126-bea8-39665108391b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:58:27.838855 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d2d26387-a60e-4f1a-8c09-1e9487c20a41 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-879599263", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "25526ef3-eaa2-4f18-ac44-bfbbfae855ea"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:27.863070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-05b2eec3-c62f-49bb-846d-6bf192c695c4 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8db879fde0bd4bea81374a7f7bb627e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044cdbed43ed4de6b4cb7e1cd4802b65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:27.871453 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-05b2eec3-c62f-49bb-846d-6bf192c695c4 tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] 10.222.0.26 "GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678" status: 200 len: 1527 microversion: 2.1 time: 0.494510 Sep 17 20:58:27.873297 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1021/1974] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:27 2022] GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678 => generated 1527 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:27.900314 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-d2d26387-a60e-4f1a-8c09-1e9487c20a41 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] validate_networks() for [('25526ef3-eaa2-4f18-ac44-bfbbfae855ea', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:58:28.007599 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e3577920-9987-48e3-96c2-51fa391c8e0b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:28.008658 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e3577920-9987-48e3-96c2-51fa391c8e0b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: e8e78e88-e04b-497b-bef8-c4b57aff1d1d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:28.020109 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e3577920-9987-48e3-96c2-51fa391c8e0b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:28.021599 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e3577920-9987-48e3-96c2-51fa391c8e0b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:28.022386 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e3577920-9987-48e3-96c2-51fa391c8e0b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:28.023247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e3577920-9987-48e3-96c2-51fa391c8e0b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:28.023815 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e3577920-9987-48e3-96c2-51fa391c8e0b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:28.024345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e3577920-9987-48e3-96c2-51fa391c8e0b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:28.326901 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e3577920-9987-48e3-96c2-51fa391c8e0b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:28.335931 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e3577920-9987-48e3-96c2-51fa391c8e0b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d" status: 200 len: 1468 microversion: 2.1 time: 0.332208 Sep 17 20:58:28.339316 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1022/1975] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:28 2022] GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d => generated 1468 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:58:28.354406 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-8c5279fb-eb39-4c06-8707-b4c1bfa7263f req-e0532d5d-aa39-48d1-b670-9906e0358e51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6f98038-008a-49b5-968e-bcb0791d4678", "name": "network-vif-deleted", "tag": "aa59bb33-c576-4726-a83c-85d3a6aca3b0"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:28.377049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8c5279fb-eb39-4c06-8707-b4c1bfa7263f req-e0532d5d-aa39-48d1-b670-9906e0358e51 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:28.382956 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8c5279fb-eb39-4c06-8707-b4c1bfa7263f req-e0532d5d-aa39-48d1-b670-9906e0358e51 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:28.383582 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8c5279fb-eb39-4c06-8707-b4c1bfa7263f req-e0532d5d-aa39-48d1-b670-9906e0358e51 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:28.405282 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-8c5279fb-eb39-4c06-8707-b4c1bfa7263f req-e0532d5d-aa39-48d1-b670-9906e0358e51 service nova] Creating event network-vif-deleted:aa59bb33-c576-4726-a83c-85d3a6aca3b0 for instance a6f98038-008a-49b5-968e-bcb0791d4678 on nch2-master-1 Sep 17 20:58:28.422176 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-8c5279fb-eb39-4c06-8707-b4c1bfa7263f req-e0532d5d-aa39-48d1-b670-9906e0358e51 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080643 Sep 17 20:58:28.423054 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1023/1976] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:28.435522 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9076afbc-4d53-4af4-ab30-e7e57354deb4 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:28.439083 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9076afbc-4d53-4af4-ab30-e7e57354deb4 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: faba011e-8cd7-4120-9e2d-8e98112899b3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:28.457340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9076afbc-4d53-4af4-ab30-e7e57354deb4 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:28.458466 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9076afbc-4d53-4af4-ab30-e7e57354deb4 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:28.459707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9076afbc-4d53-4af4-ab30-e7e57354deb4 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:28.462619 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9076afbc-4d53-4af4-ab30-e7e57354deb4 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:28.463777 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9076afbc-4d53-4af4-ab30-e7e57354deb4 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:28.466465 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9076afbc-4d53-4af4-ab30-e7e57354deb4 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:28.718332 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-d2d26387-a60e-4f1a-8c09-1e9487c20a41 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:58:28.719421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-d2d26387-a60e-4f1a-8c09-1e9487c20a41 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:58:28.720196 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-d2d26387-a60e-4f1a-8c09-1e9487c20a41 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:58:28.721107 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-d2d26387-a60e-4f1a-8c09-1e9487c20a41 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:58:28.722082 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-d2d26387-a60e-4f1a-8c09-1e9487c20a41 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:58:28.737125 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2d26387-a60e-4f1a-8c09-1e9487c20a41 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:28.737813 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2d26387-a60e-4f1a-8c09-1e9487c20a41 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:28.738551 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2d26387-a60e-4f1a-8c09-1e9487c20a41 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:28.740095 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2d26387-a60e-4f1a-8c09-1e9487c20a41 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:28.741155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2d26387-a60e-4f1a-8c09-1e9487c20a41 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:28.741843 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2d26387-a60e-4f1a-8c09-1e9487c20a41 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:28.744070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9076afbc-4d53-4af4-ab30-e7e57354deb4 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:28.764375 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9076afbc-4d53-4af4-ab30-e7e57354deb4 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/faba011e-8cd7-4120-9e2d-8e98112899b3" status: 200 len: 1468 microversion: 2.1 time: 0.336955 Sep 17 20:58:28.777495 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1024/1977] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:28 2022] GET /compute/v2.1/servers/faba011e-8cd7-4120-9e2d-8e98112899b3 => generated 1468 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:28.777495 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c01a9921-87b8-4629-9a77-2cb1fdc3e070 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:28.777495 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c01a9921-87b8-4629-9a77-2cb1fdc3e070 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] [instance: db1127cb-07c5-4e4d-8303-82b71dc31a55] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:28.778327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c01a9921-87b8-4629-9a77-2cb1fdc3e070 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:28.779011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c01a9921-87b8-4629-9a77-2cb1fdc3e070 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:28.779704 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c01a9921-87b8-4629-9a77-2cb1fdc3e070 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:28.781178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c01a9921-87b8-4629-9a77-2cb1fdc3e070 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:28.781969 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c01a9921-87b8-4629-9a77-2cb1fdc3e070 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:28.782589 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c01a9921-87b8-4629-9a77-2cb1fdc3e070 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:28.786350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-d2d26387-a60e-4f1a-8c09-1e9487c20a41 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Getting quotas for project 89b46ae7347d4f2daf02f627e41a4847. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:58:28.793912 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-d2d26387-a60e-4f1a-8c09-1e9487c20a41 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Getting quotas for user 3009c5feb1ef43a08b07996d8f63bf11 and project 89b46ae7347d4f2daf02f627e41a4847. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:58:28.820671 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d2d26387-a60e-4f1a-8c09-1e9487c20a41 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:58:28.826329 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d2d26387-a60e-4f1a-8c09-1e9487c20a41 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 1170d308-122b-4c9e-abf1-5d206d3b75f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:58:28.939701 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d2d26387-a60e-4f1a-8c09-1e9487c20a41 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.105399 Sep 17 20:58:28.946734 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 954/1978] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:58:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 17 20:58:28.954459 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a24982d7-c3d5-4fad-a0ef-2b37f7809db8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4e728b0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:28.988419 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c01a9921-87b8-4629-9a77-2cb1fdc3e070 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6645db569614a10b1388a69b7e5a64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6f02f91d84fd59de856b10c42ac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:28.998177 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c01a9921-87b8-4629-9a77-2cb1fdc3e070 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] 10.222.0.26 "GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55" status: 200 len: 1323 microversion: 2.1 time: 0.231048 Sep 17 20:58:28.998698 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1025/1979] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:28 2022] GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55 => generated 1323 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:29.009807 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-67cb15de-d5f9-4c15-a232-d4b7eeecbabe tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:29.024690 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-67cb15de-d5f9-4c15-a232-d4b7eeecbabe tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:29.028888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-67cb15de-d5f9-4c15-a232-d4b7eeecbabe tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Searching by: {'reservation_id': 'r-gpby45tr', 'deleted': False, 'project_id': '3515123097e744ef855ef1129fb59cf1'} {{(pid=140524) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 20:58:29.041349 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-67cb15de-d5f9-4c15-a232-d4b7eeecbabe tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:29.042991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-67cb15de-d5f9-4c15-a232-d4b7eeecbabe tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:29.047721 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-67cb15de-d5f9-4c15-a232-d4b7eeecbabe tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:29.048788 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-67cb15de-d5f9-4c15-a232-d4b7eeecbabe tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:29.050157 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-67cb15de-d5f9-4c15-a232-d4b7eeecbabe tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:29.052054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-67cb15de-d5f9-4c15-a232-d4b7eeecbabe tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:29.060901 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a24982d7-c3d5-4fad-a0ef-2b37f7809db8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b" status: 200 len: 1439 microversion: 2.1 time: 0.109762 Sep 17 20:58:29.063969 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 955/1980] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:58:28 2022] GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b => generated 1439 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:29.075543 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fbf62d8f-fb6f-46cd-86c4-6c6ad5f1d49f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:29.076579 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fbf62d8f-fb6f-46cd-86c4-6c6ad5f1d49f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] [instance: a6f98038-008a-49b5-968e-bcb0791d4678] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:29.086958 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fbf62d8f-fb6f-46cd-86c4-6c6ad5f1d49f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:29.087796 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fbf62d8f-fb6f-46cd-86c4-6c6ad5f1d49f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:29.088495 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fbf62d8f-fb6f-46cd-86c4-6c6ad5f1d49f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:29.089513 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fbf62d8f-fb6f-46cd-86c4-6c6ad5f1d49f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:29.090198 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fbf62d8f-fb6f-46cd-86c4-6c6ad5f1d49f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:29.090997 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fbf62d8f-fb6f-46cd-86c4-6c6ad5f1d49f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:29.117991 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-fbf62d8f-fb6f-46cd-86c4-6c6ad5f1d49f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] HTTP exception thrown: Instance a6f98038-008a-49b5-968e-bcb0791d4678 could not be found. Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fbf62d8f-fb6f-46cd-86c4-6c6ad5f1d49f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Request method failure captured: Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678 HTTP/1.1 Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjTUgiAu10zpY-IOLG41JnWWzQYCCySu2R0mdqxd4LJbe3tN8zfMJGK0PzwgLsuZnDBuCQXKgsUz_wYnhejtrfze5j84rQtrlmWEwLQVjexWe3Pc15F63qbEgduWvjnLk1ftKFvvxP4rU7i6caxa21aoSWLK_-A40JM3d3nGjsboIwg Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 044cdbed43ed4de6b4cb7e1cd4802b65 Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1307695587 Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/044cdbed43ed4de6b4cb7e1cd4802b65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/044cdbed43ed4de6b4cb7e1cd4802b65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/044cdbed43ed4de6b4cb7e1cd4802b65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_044cdbed43ed4de6b4cb7e1cd4802b65", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1307695587 Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 044cdbed43ed4de6b4cb7e1cd4802b65 Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1307695587 Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-InstanceActionsNegativeTestJSON-1307695587-project Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 8db879fde0bd4bea81374a7f7bb627e6 Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1307695587-project Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance a6f98038-008a-49b5-968e-bcb0791d4678 could not be found. Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'a6f98038-008a-49b5-968e-bcb0791d4678'} Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6f98038-008a-49b5-968e-bcb0791d4678 could not be found. Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6f98038-008a-49b5-968e-bcb0791d4678 could not be found. Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:29.124931 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:29.129718 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:29.129718 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:29.129718 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:29.129718 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:29.129718 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:58:29.129718 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:58:29.129718 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6f98038-008a-49b5-968e-bcb0791d4678 could not be found. Sep 17 20:58:29.129718 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:29.132824 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fbf62d8f-fb6f-46cd-86c4-6c6ad5f1d49f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] Returning 404 to user: Instance a6f98038-008a-49b5-968e-bcb0791d4678 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:58:29.134181 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fbf62d8f-fb6f-46cd-86c4-6c6ad5f1d49f tempest-InstanceActionsNegativeTestJSON-1307695587 tempest-InstanceActionsNegativeTestJSON-1307695587-project] 10.222.0.26 "GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678" status: 404 len: 111 microversion: 2.1 time: 0.068504 Sep 17 20:58:29.149588 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 956/1981] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:29 2022] GET /compute/v2.1/servers/a6f98038-008a-49b5-968e-bcb0791d4678 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:58:29.168968 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fe5776fa-a8ed-4a6d-bbf0-7fd503973591 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:29.178537 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fe5776fa-a8ed-4a6d-bbf0-7fd503973591 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 1170d308-122b-4c9e-abf1-5d206d3b75f1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:29.304170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fe5776fa-a8ed-4a6d-bbf0-7fd503973591 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:29.315949 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fe5776fa-a8ed-4a6d-bbf0-7fd503973591 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1" status: 200 len: 1214 microversion: 2.1 time: 0.165145 Sep 17 20:58:29.321917 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 957/1982] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:29 2022] GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1 => generated 1214 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:29.777894 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.multi_cell_list [None req-67cb15de-d5f9-4c15-a232-d4b7eeecbabe tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140524) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 20:58:29.959842 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-67cb15de-d5f9-4c15-a232-d4b7eeecbabe tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:29.974088 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-67cb15de-d5f9-4c15-a232-d4b7eeecbabe tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:29.976026 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-67cb15de-d5f9-4c15-a232-d4b7eeecbabe tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:29.976845 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-67cb15de-d5f9-4c15-a232-d4b7eeecbabe tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:30.026918 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-35732798-dae0-4761-b375-0c68be9c7f30 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:30.028469 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-35732798-dae0-4761-b375-0c68be9c7f30 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] [instance: db1127cb-07c5-4e4d-8303-82b71dc31a55] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:30.037894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35732798-dae0-4761-b375-0c68be9c7f30 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:30.038888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35732798-dae0-4761-b375-0c68be9c7f30 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:30.039635 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35732798-dae0-4761-b375-0c68be9c7f30 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:30.040700 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35732798-dae0-4761-b375-0c68be9c7f30 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:30.042424 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35732798-dae0-4761-b375-0c68be9c7f30 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:30.043164 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35732798-dae0-4761-b375-0c68be9c7f30 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:30.689840 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-35732798-dae0-4761-b375-0c68be9c7f30 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6645db569614a10b1388a69b7e5a64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6f02f91d84fd59de856b10c42ac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:30.702179 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-35732798-dae0-4761-b375-0c68be9c7f30 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] 10.222.0.26 "GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55" status: 200 len: 1323 microversion: 2.1 time: 0.682610 Sep 17 20:58:30.702765 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 958/1983] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:30 2022] GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55 => generated 1323 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:30.707568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d9b81227-c62e-4703-8549-318d5b77cad7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4dd08b0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:30.782353 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d9b81227-c62e-4703-8549-318d5b77cad7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b" status: 200 len: 1439 microversion: 2.1 time: 0.078241 Sep 17 20:58:30.782936 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 959/1984] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:58:30 2022] GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b => generated 1439 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:30.793092 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-c4283e80-8dd6-4339-9fcb-6f012a55bf20 req-6f878e4e-5b4c-42f3-8772-9dc03fe48c27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db1127cb-07c5-4e4d-8303-82b71dc31a55", "name": "network-vif-plugged", "status": "completed", "tag": "7ccc18b2-9166-4b44-ac7e-9b13135b61de"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:30.816213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-c4283e80-8dd6-4339-9fcb-6f012a55bf20 req-6f878e4e-5b4c-42f3-8772-9dc03fe48c27 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:30.816690 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-c4283e80-8dd6-4339-9fcb-6f012a55bf20 req-6f878e4e-5b4c-42f3-8772-9dc03fe48c27 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:30.817130 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-c4283e80-8dd6-4339-9fcb-6f012a55bf20 req-6f878e4e-5b4c-42f3-8772-9dc03fe48c27 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:30.838421 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-67cb15de-d5f9-4c15-a232-d4b7eeecbabe tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?reservation_id=r-gpby45tr" status: 200 len: 2929 microversion: 2.1 time: 1.834709 Sep 17 20:58:30.839388 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1026/1985] 10.222.0.26 () {58 vars in 1197 bytes} [Sat Sep 17 20:58:29 2022] GET /compute/v2.1/servers/detail?reservation_id=r-gpby45tr => generated 2929 bytes in 1837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:30.844214 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f185bdd2-363c-4506-b3f2-c127519018ee tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:30.844832 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f185bdd2-363c-4506-b3f2-c127519018ee tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 1170d308-122b-4c9e-abf1-5d206d3b75f1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:30.851383 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:58:30.860687 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f185bdd2-363c-4506-b3f2-c127519018ee tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:30.861193 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f185bdd2-363c-4506-b3f2-c127519018ee tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:30.861747 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f185bdd2-363c-4506-b3f2-c127519018ee tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:30.862471 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f185bdd2-363c-4506-b3f2-c127519018ee tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:30.862932 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f185bdd2-363c-4506-b3f2-c127519018ee tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:30.863361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f185bdd2-363c-4506-b3f2-c127519018ee tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:30.864935 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-c4283e80-8dd6-4339-9fcb-6f012a55bf20 req-6f878e4e-5b4c-42f3-8772-9dc03fe48c27 service nova] Creating event network-vif-plugged:7ccc18b2-9166-4b44-ac7e-9b13135b61de for instance db1127cb-07c5-4e4d-8303-82b71dc31a55 on nch1-master-1 Sep 17 20:58:30.875378 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-c4283e80-8dd6-4339-9fcb-6f012a55bf20 req-6f878e4e-5b4c-42f3-8772-9dc03fe48c27 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090848 Sep 17 20:58:30.886882 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 960/1986] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:30.895099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4b098729-070b-4cb0-a21b-5a987218cc41 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:30.942048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.compute.server_groups [None req-4b098729-070b-4cb0-a21b-5a987218cc41 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Querying cell 056db90a-cdd9-42b2-a8c3-cd5ab36662a4(cell1) for 2 instances {{(pid=140523) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 17 20:58:30.952804 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b098729-070b-4cb0-a21b-5a987218cc41 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:30.960473 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b098729-070b-4cb0-a21b-5a987218cc41 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:30.969123 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b098729-070b-4cb0-a21b-5a987218cc41 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:31.033423 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4b098729-070b-4cb0-a21b-5a987218cc41 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups/51946a10-f884-4d05-8e1f-9dbf3dee88ef" status: 200 len: 265 microversion: 2.1 time: 0.145148 Sep 17 20:58:31.035704 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 961/1987] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Sep 17 20:58:30 2022] GET /compute/v2.1/os-server-groups/51946a10-f884-4d05-8e1f-9dbf3dee88ef => generated 265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:31.047101 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1583b25e-2279-4ef1-a8dd-ae6f01d89e1c tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:31.062658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1583b25e-2279-4ef1-a8dd-ae6f01d89e1c tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] [instance: e8e78e88-e04b-497b-bef8-c4b57aff1d1d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:31.069712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1583b25e-2279-4ef1-a8dd-ae6f01d89e1c tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:31.070701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1583b25e-2279-4ef1-a8dd-ae6f01d89e1c tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:31.071320 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1583b25e-2279-4ef1-a8dd-ae6f01d89e1c tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:31.072570 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1583b25e-2279-4ef1-a8dd-ae6f01d89e1c tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:31.073414 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1583b25e-2279-4ef1-a8dd-ae6f01d89e1c tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:31.074121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1583b25e-2279-4ef1-a8dd-ae6f01d89e1c tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:31.097611 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f185bdd2-363c-4506-b3f2-c127519018ee tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:31.106518 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f185bdd2-363c-4506-b3f2-c127519018ee tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1" status: 200 len: 1266 microversion: 2.1 time: 0.265985 Sep 17 20:58:31.125953 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1027/1988] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:30 2022] GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1 => generated 1266 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:31.433431 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1583b25e-2279-4ef1-a8dd-ae6f01d89e1c tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d" status: 200 len: 1619 microversion: 2.1 time: 0.389980 Sep 17 20:58:31.437392 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 962/1989] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:31 2022] GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d => generated 1619 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:58:31.461992 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-92e696df-ea9e-446d-9038-e7dc0d3792e1 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:31.462618 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-92e696df-ea9e-446d-9038-e7dc0d3792e1 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] [instance: faba011e-8cd7-4120-9e2d-8e98112899b3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:31.470850 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92e696df-ea9e-446d-9038-e7dc0d3792e1 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:31.471353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92e696df-ea9e-446d-9038-e7dc0d3792e1 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:31.471806 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92e696df-ea9e-446d-9038-e7dc0d3792e1 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:31.472521 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92e696df-ea9e-446d-9038-e7dc0d3792e1 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:31.474321 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92e696df-ea9e-446d-9038-e7dc0d3792e1 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:31.475422 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92e696df-ea9e-446d-9038-e7dc0d3792e1 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:31.728732 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3d915212-1dd1-46c4-9636-b948bd21b12a tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:31.729706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3d915212-1dd1-46c4-9636-b948bd21b12a tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] [instance: db1127cb-07c5-4e4d-8303-82b71dc31a55] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:31.740243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3d915212-1dd1-46c4-9636-b948bd21b12a tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:31.742335 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3d915212-1dd1-46c4-9636-b948bd21b12a tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:31.742990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3d915212-1dd1-46c4-9636-b948bd21b12a tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:31.744802 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3d915212-1dd1-46c4-9636-b948bd21b12a tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:31.745445 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3d915212-1dd1-46c4-9636-b948bd21b12a tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:31.746090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3d915212-1dd1-46c4-9636-b948bd21b12a tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:31.868020 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-92e696df-ea9e-446d-9038-e7dc0d3792e1 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/faba011e-8cd7-4120-9e2d-8e98112899b3" status: 200 len: 1619 microversion: 2.1 time: 0.409806 Sep 17 20:58:31.869216 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1028/1990] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:31 2022] GET /compute/v2.1/servers/faba011e-8cd7-4120-9e2d-8e98112899b3 => generated 1619 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:31.874232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-448de3c3-662c-4ba3-a0bf-d9b952dda08c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4d9b5e0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:31.972334 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-448de3c3-662c-4ba3-a0bf-d9b952dda08c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b" status: 200 len: 1439 microversion: 2.1 time: 0.101731 Sep 17 20:58:31.973164 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1029/1991] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:58:31 2022] GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b => generated 1439 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:31.984473 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d502c48a-7fae-43be-95bf-37689972906b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Action: 'create', calling method: .version_select at 0x7f25a4d8caf0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1645817948", "policies": ["anti-affinity"]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:32.015374 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-d502c48a-7fae-43be-95bf-37689972906b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for project 3515123097e744ef855ef1129fb59cf1. Resources: {'server_groups'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:58:32.034951 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-d502c48a-7fae-43be-95bf-37689972906b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for user 0d48260054d84784b89a52d9b766d7c1 and project 3515123097e744ef855ef1129fb59cf1. Resources: {'server_groups'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:58:32.101080 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-d502c48a-7fae-43be-95bf-37689972906b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for project 3515123097e744ef855ef1129fb59cf1. Resources: {'server_groups'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:58:32.107355 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-d502c48a-7fae-43be-95bf-37689972906b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for user 0d48260054d84784b89a52d9b766d7c1 and project 3515123097e744ef855ef1129fb59cf1. Resources: {'server_groups'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:58:32.124047 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d502c48a-7fae-43be-95bf-37689972906b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.147875 Sep 17 20:58:32.124935 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1030/1992] 10.222.0.26 () {60 vars in 1174 bytes} [Sat Sep 17 20:58:31 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:32.140518 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-70227964-4455-40a6-9461-a01669f050d7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:32.141914 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-70227964-4455-40a6-9461-a01669f050d7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 1170d308-122b-4c9e-abf1-5d206d3b75f1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:32.153789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-70227964-4455-40a6-9461-a01669f050d7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:32.154738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-70227964-4455-40a6-9461-a01669f050d7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:32.155403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-70227964-4455-40a6-9461-a01669f050d7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:32.156437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-70227964-4455-40a6-9461-a01669f050d7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:32.157068 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-70227964-4455-40a6-9461-a01669f050d7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:32.158226 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-70227964-4455-40a6-9461-a01669f050d7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:32.363078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3d915212-1dd1-46c4-9636-b948bd21b12a tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6645db569614a10b1388a69b7e5a64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6f02f91d84fd59de856b10c42ac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:32.374495 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3d915212-1dd1-46c4-9636-b948bd21b12a tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] 10.222.0.26 "GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55" status: 200 len: 1323 microversion: 2.1 time: 0.649296 Sep 17 20:58:32.389490 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 963/1993] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:31 2022] GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55 => generated 1323 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:32.389490 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b1e62965-85cc-419c-9b68-6bc52ab1c30c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1299417584", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "3ec7ae95-2707-4480-b831-a65a9b35cb03"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:32.419568 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-70227964-4455-40a6-9461-a01669f050d7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:32.431025 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-70227964-4455-40a6-9461-a01669f050d7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1" status: 200 len: 1272 microversion: 2.1 time: 0.301032 Sep 17 20:58:32.433239 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1031/1994] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:32 2022] GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1 => generated 1272 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:32.546557 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-b1e62965-85cc-419c-9b68-6bc52ab1c30c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] validate_networks() for None {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:58:32.912260 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-0bc7e0e5-50eb-4ff7-bade-32f631fa843c req-b0d58ad6-ada0-478f-bea3-e9978c5aaf13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf08d895-d8f9-440d-8ade-fbc47dc6bde4", "name": "network-vif-plugged", "status": "completed", "tag": "e796f543-c137-42fa-b391-2f975c3df0e1"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:32.938304 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-0bc7e0e5-50eb-4ff7-bade-32f631fa843c req-b0d58ad6-ada0-478f-bea3-e9978c5aaf13 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:32.938801 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-0bc7e0e5-50eb-4ff7-bade-32f631fa843c req-b0d58ad6-ada0-478f-bea3-e9978c5aaf13 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:32.944557 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-0bc7e0e5-50eb-4ff7-bade-32f631fa843c req-b0d58ad6-ada0-478f-bea3-e9978c5aaf13 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:32.963998 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-0bc7e0e5-50eb-4ff7-bade-32f631fa843c req-b0d58ad6-ada0-478f-bea3-e9978c5aaf13 service nova] Creating event network-vif-plugged:e796f543-c137-42fa-b391-2f975c3df0e1 for instance bf08d895-d8f9-440d-8ade-fbc47dc6bde4 on nch1-master-1 Sep 17 20:58:32.970999 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-0bc7e0e5-50eb-4ff7-bade-32f631fa843c req-b0d58ad6-ada0-478f-bea3-e9978c5aaf13 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061402 Sep 17 20:58:32.977075 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1032/1995] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:32.990380 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a7b281e7-dc92-454c-b092-d1a4f2a1085e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4d6f160>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:33.066677 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a7b281e7-dc92-454c-b092-d1a4f2a1085e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b" status: 200 len: 1439 microversion: 2.1 time: 0.081663 Sep 17 20:58:33.068152 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1033/1996] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:58:32 2022] GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b => generated 1439 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:58:33.407189 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-70ff7afe-7411-4543-9d93-7fd2bb2925c7 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:33.407942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-70ff7afe-7411-4543-9d93-7fd2bb2925c7 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] [instance: db1127cb-07c5-4e4d-8303-82b71dc31a55] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:33.416170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-70ff7afe-7411-4543-9d93-7fd2bb2925c7 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:33.416945 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-70ff7afe-7411-4543-9d93-7fd2bb2925c7 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:33.417741 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-70ff7afe-7411-4543-9d93-7fd2bb2925c7 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:33.418753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-70ff7afe-7411-4543-9d93-7fd2bb2925c7 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:33.419649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-70ff7afe-7411-4543-9d93-7fd2bb2925c7 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:33.420400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-70ff7afe-7411-4543-9d93-7fd2bb2925c7 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:33.455915 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-b1e62965-85cc-419c-9b68-6bc52ab1c30c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:58:33.456985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-b1e62965-85cc-419c-9b68-6bc52ab1c30c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:58:33.457795 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-b1e62965-85cc-419c-9b68-6bc52ab1c30c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:58:33.458515 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-b1e62965-85cc-419c-9b68-6bc52ab1c30c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:58:33.459179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-b1e62965-85cc-419c-9b68-6bc52ab1c30c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:58:33.499733 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b1e62965-85cc-419c-9b68-6bc52ab1c30c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:33.500677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b1e62965-85cc-419c-9b68-6bc52ab1c30c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:33.501349 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b1e62965-85cc-419c-9b68-6bc52ab1c30c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:33.502902 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b1e62965-85cc-419c-9b68-6bc52ab1c30c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:33.505593 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b1e62965-85cc-419c-9b68-6bc52ab1c30c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:33.506331 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b1e62965-85cc-419c-9b68-6bc52ab1c30c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:33.539265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-b1e62965-85cc-419c-9b68-6bc52ab1c30c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for project 3515123097e744ef855ef1129fb59cf1. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:58:33.545340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-b1e62965-85cc-419c-9b68-6bc52ab1c30c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for user 0d48260054d84784b89a52d9b766d7c1 and project 3515123097e744ef855ef1129fb59cf1. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:58:33.560555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b1e62965-85cc-419c-9b68-6bc52ab1c30c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Going to run 2 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:58:33.563766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b1e62965-85cc-419c-9b68-6bc52ab1c30c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: e16ee697-bc81-4c87-a419-9485374a111a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:58:33.636172 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-b1e62965-85cc-419c-9b68-6bc52ab1c30c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for project 3515123097e744ef855ef1129fb59cf1. Resources: {'server_group_members'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:58:33.642813 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-b1e62965-85cc-419c-9b68-6bc52ab1c30c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for user 0d48260054d84784b89a52d9b766d7c1 and project 3515123097e744ef855ef1129fb59cf1. Resources: {'server_group_members'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:58:33.733815 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-b1e62965-85cc-419c-9b68-6bc52ab1c30c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for project 3515123097e744ef855ef1129fb59cf1. Resources: {'server_group_members'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:58:33.742696 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:58:33.744866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-b1e62965-85cc-419c-9b68-6bc52ab1c30c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for user 0d48260054d84784b89a52d9b766d7c1 and project 3515123097e744ef855ef1129fb59cf1. Resources: {'server_group_members'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:58:33.765017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b1e62965-85cc-419c-9b68-6bc52ab1c30c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 7b07abb3-f10d-4b65-9a52-28bb33b47567] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=e16ee697-bc81-4c87-a419-9485374a111a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:58:33.821921 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-70ff7afe-7411-4543-9d93-7fd2bb2925c7 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6645db569614a10b1388a69b7e5a64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6f02f91d84fd59de856b10c42ac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:33.830870 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-70ff7afe-7411-4543-9d93-7fd2bb2925c7 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] 10.222.0.26 "GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55" status: 200 len: 1472 microversion: 2.1 time: 0.428271 Sep 17 20:58:33.836261 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1034/1997] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:33 2022] GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55 => generated 1472 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:33.841310 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-83e7a065-8bea-4513-9a11-aa0c9ce816fd tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:33.844509 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-83e7a065-8bea-4513-9a11-aa0c9ce816fd tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 1170d308-122b-4c9e-abf1-5d206d3b75f1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:33.851494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-83e7a065-8bea-4513-9a11-aa0c9ce816fd tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:33.852151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-83e7a065-8bea-4513-9a11-aa0c9ce816fd tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:33.853137 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-83e7a065-8bea-4513-9a11-aa0c9ce816fd tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:33.853983 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-83e7a065-8bea-4513-9a11-aa0c9ce816fd tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:33.854584 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-83e7a065-8bea-4513-9a11-aa0c9ce816fd tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:33.855132 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-83e7a065-8bea-4513-9a11-aa0c9ce816fd tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:33.902836 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-b1e62965-85cc-419c-9b68-6bc52ab1c30c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for project 3515123097e744ef855ef1129fb59cf1. Resources: {'server_group_members'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:58:33.918376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-b1e62965-85cc-419c-9b68-6bc52ab1c30c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for user 0d48260054d84784b89a52d9b766d7c1 and project 3515123097e744ef855ef1129fb59cf1. Resources: {'server_group_members'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:58:34.028020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-b1e62965-85cc-419c-9b68-6bc52ab1c30c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for project 3515123097e744ef855ef1129fb59cf1. Resources: {'server_group_members'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:58:34.040003 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-b1e62965-85cc-419c-9b68-6bc52ab1c30c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for user 0d48260054d84784b89a52d9b766d7c1 and project 3515123097e744ef855ef1129fb59cf1. Resources: {'server_group_members'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:58:34.119429 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b1e62965-85cc-419c-9b68-6bc52ab1c30c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.740492 Sep 17 20:58:34.121037 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 964/1998] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:58:32 2022] POST /compute/v2.1/servers => generated 32 bytes in 1743 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 17 20:58:34.133560 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-619023f0-559d-40f0-bcb3-512cca8cda8d tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:34.135209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-619023f0-559d-40f0-bcb3-512cca8cda8d tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] [instance: db1127cb-07c5-4e4d-8303-82b71dc31a55] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:34.152003 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-619023f0-559d-40f0-bcb3-512cca8cda8d tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:34.153733 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-619023f0-559d-40f0-bcb3-512cca8cda8d tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:34.154661 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-619023f0-559d-40f0-bcb3-512cca8cda8d tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:34.155733 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-619023f0-559d-40f0-bcb3-512cca8cda8d tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:34.157735 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-619023f0-559d-40f0-bcb3-512cca8cda8d tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:34.158445 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-619023f0-559d-40f0-bcb3-512cca8cda8d tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:34.162468 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-83e7a065-8bea-4513-9a11-aa0c9ce816fd tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:34.172960 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-83e7a065-8bea-4513-9a11-aa0c9ce816fd tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1" status: 200 len: 1272 microversion: 2.1 time: 0.335262 Sep 17 20:58:34.176391 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1035/1999] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:33 2022] GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1 => generated 1272 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:34.190243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-619023f0-559d-40f0-bcb3-512cca8cda8d tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'a6645db569614a10b1388a69b7e5a64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6f02f91d84fd59de856b10c42ac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-619023f0-559d-40f0-bcb3-512cca8cda8d tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Request method failure captured: Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55/diagnostics HTTP/1.1 Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjTiFI1mg1ULeZJmnE75gkJsv_YYVq138K9U-nwSxeI8lC6L0y2_DR9UBjAQh44LAfcQ_t942JCVBdZLPPaJeKBFv26b0qdvqeVlGNqV1WaSbHI88Z1E6LyneLlOI9nLvmVh7Ga2Hoj5UalAFyEnuZeR1BEAVpHVJyOgHyjUhOdNvJ4 Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 31d6f02f91d84fd59de856b10c42ac5d Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-936895532 Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/31d6f02f91d84fd59de856b10c42ac5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/31d6f02f91d84fd59de856b10c42ac5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/31d6f02f91d84fd59de856b10c42ac5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_31d6f02f91d84fd59de856b10c42ac5d", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-936895532 Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 31d6f02f91d84fd59de856b10c42ac5d Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-936895532 Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerDiagnosticsNegativeTest-936895532-project Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: a6645db569614a10b1388a69b7e5a64f Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-936895532-project Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'server_id': 'db1127cb-07c5-4e4d-8303-82b71dc31a55'} Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:34.192685 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:34.198397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:34.198397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:34.198397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 17 20:58:34.198397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 17 20:58:34.198397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 17 20:58:34.198397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:34.200136 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-619023f0-559d-40f0-bcb3-512cca8cda8d tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:58:34.201382 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-619023f0-559d-40f0-bcb3-512cca8cda8d tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] 10.222.0.26 "GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.078468 Sep 17 20:58:34.202144 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 965/2000] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 20:58:34 2022] GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55/diagnostics => generated 117 bytes in 80 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:58:34.208475 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ed56102a-89e6-47cb-b97d-e2cc6618cdd6 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:34.211823 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3c88b5a1-4d93-4855-b9fe-7d1457c38e1e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4d9b160>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:34.214595 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ed56102a-89e6-47cb-b97d-e2cc6618cdd6 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:34.215616 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ed56102a-89e6-47cb-b97d-e2cc6618cdd6 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Searching by: {'deleted': False, 'project_id': '3515123097e744ef855ef1129fb59cf1'} {{(pid=140523) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 20:58:34.272441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ed56102a-89e6-47cb-b97d-e2cc6618cdd6 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:34.273279 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ed56102a-89e6-47cb-b97d-e2cc6618cdd6 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:34.274803 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ed56102a-89e6-47cb-b97d-e2cc6618cdd6 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:34.279377 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ed56102a-89e6-47cb-b97d-e2cc6618cdd6 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:34.281243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ed56102a-89e6-47cb-b97d-e2cc6618cdd6 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:34.282100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ed56102a-89e6-47cb-b97d-e2cc6618cdd6 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:34.333670 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3c88b5a1-4d93-4855-b9fe-7d1457c38e1e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b" status: 200 len: 1439 microversion: 2.1 time: 0.140384 Sep 17 20:58:34.335240 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1036/2001] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:58:34 2022] GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b => generated 1439 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:34.357943 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-23277ed1-ad97-4941-87f4-47d79967fb06 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:34.358959 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-23277ed1-ad97-4941-87f4-47d79967fb06 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] [instance: db1127cb-07c5-4e4d-8303-82b71dc31a55] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:34.384520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23277ed1-ad97-4941-87f4-47d79967fb06 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:34.387396 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23277ed1-ad97-4941-87f4-47d79967fb06 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:34.387990 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23277ed1-ad97-4941-87f4-47d79967fb06 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:34.390282 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23277ed1-ad97-4941-87f4-47d79967fb06 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:34.398078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23277ed1-ad97-4941-87f4-47d79967fb06 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:34.399507 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23277ed1-ad97-4941-87f4-47d79967fb06 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:34.475915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-23277ed1-ad97-4941-87f4-47d79967fb06 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] [instance: db1127cb-07c5-4e4d-8303-82b71dc31a55] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:58:34.537783 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.multi_cell_list [None req-ed56102a-89e6-47cb-b97d-e2cc6618cdd6 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=140523) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 20:58:34.604676 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:58:34.659554 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ed56102a-89e6-47cb-b97d-e2cc6618cdd6 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.455991 Sep 17 20:58:34.662724 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 966/2002] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Sep 17 20:58:34 2022] GET /compute/v2.1/servers => generated 1664 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:34.678287 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-28c3958e-82cd-42c1-b386-f8254931f6c7 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:34.705775 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-28c3958e-82cd-42c1-b386-f8254931f6c7 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 7b07abb3-f10d-4b65-9a52-28bb33b47567] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:34.798569 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-23277ed1-ad97-4941-87f4-47d79967fb06 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] 10.222.0.26 "DELETE /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55" status: 204 len: 0 microversion: 2.1 time: 0.461191 Sep 17 20:58:34.802537 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1037/2003] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:58:34 2022] DELETE /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:58:34.825869 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-03fdf68a-b98d-4a38-b831-88aeab8b6c80 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:34.826878 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-03fdf68a-b98d-4a38-b831-88aeab8b6c80 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] [instance: db1127cb-07c5-4e4d-8303-82b71dc31a55] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:34.852283 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03fdf68a-b98d-4a38-b831-88aeab8b6c80 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:34.852989 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03fdf68a-b98d-4a38-b831-88aeab8b6c80 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:34.854090 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03fdf68a-b98d-4a38-b831-88aeab8b6c80 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:34.856816 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03fdf68a-b98d-4a38-b831-88aeab8b6c80 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:34.859056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03fdf68a-b98d-4a38-b831-88aeab8b6c80 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:34.860193 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03fdf68a-b98d-4a38-b831-88aeab8b6c80 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:34.964669 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-28c3958e-82cd-42c1-b386-f8254931f6c7 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:34.978918 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-28c3958e-82cd-42c1-b386-f8254931f6c7 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567" status: 200 len: 1219 microversion: 2.1 time: 0.303656 Sep 17 20:58:34.981572 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 967/2004] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:34 2022] GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567 => generated 1219 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:35.213741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f6d34260-6725-4034-a0c2-cb77b4e97cc8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:35.216831 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f6d34260-6725-4034-a0c2-cb77b4e97cc8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 1170d308-122b-4c9e-abf1-5d206d3b75f1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:35.230801 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f6d34260-6725-4034-a0c2-cb77b4e97cc8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:35.238132 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f6d34260-6725-4034-a0c2-cb77b4e97cc8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:35.239560 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f6d34260-6725-4034-a0c2-cb77b4e97cc8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:35.241327 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f6d34260-6725-4034-a0c2-cb77b4e97cc8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:35.242561 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f6d34260-6725-4034-a0c2-cb77b4e97cc8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:35.244698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f6d34260-6725-4034-a0c2-cb77b4e97cc8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:35.683935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f6d34260-6725-4034-a0c2-cb77b4e97cc8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:35.718935 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f6d34260-6725-4034-a0c2-cb77b4e97cc8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1" status: 200 len: 1314 microversion: 2.1 time: 0.518771 Sep 17 20:58:35.723902 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 968/2005] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:35 2022] GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1 => generated 1314 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:35.738115 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1cc6c56d-834b-45bd-a0b7-67b55a652978 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4ed0a60>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:35.896835 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1cc6c56d-834b-45bd-a0b7-67b55a652978 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b" status: 200 len: 1439 microversion: 2.1 time: 0.170493 Sep 17 20:58:35.898237 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 969/2006] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:58:35 2022] GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b => generated 1439 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:36.004244 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ba091e02-011e-4bdb-9d0b-156034f016d0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:36.004878 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ba091e02-011e-4bdb-9d0b-156034f016d0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 7b07abb3-f10d-4b65-9a52-28bb33b47567] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:36.015470 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ba091e02-011e-4bdb-9d0b-156034f016d0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:36.017925 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ba091e02-011e-4bdb-9d0b-156034f016d0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:36.018400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ba091e02-011e-4bdb-9d0b-156034f016d0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:36.021665 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ba091e02-011e-4bdb-9d0b-156034f016d0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:36.022272 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ba091e02-011e-4bdb-9d0b-156034f016d0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:36.022736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ba091e02-011e-4bdb-9d0b-156034f016d0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:36.462796 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-03fdf68a-b98d-4a38-b831-88aeab8b6c80 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6645db569614a10b1388a69b7e5a64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6f02f91d84fd59de856b10c42ac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:36.478930 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-03fdf68a-b98d-4a38-b831-88aeab8b6c80 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] 10.222.0.26 "GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55" status: 200 len: 1478 microversion: 2.1 time: 1.671624 Sep 17 20:58:36.497556 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1038/2007] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:34 2022] GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55 => generated 1478 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:36.728598 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ba091e02-011e-4bdb-9d0b-156034f016d0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:36.751598 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-66617000-a87f-4a7d-9935-b14496ed2490 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:36.752126 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-66617000-a87f-4a7d-9935-b14496ed2490 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 1170d308-122b-4c9e-abf1-5d206d3b75f1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:36.761314 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ba091e02-011e-4bdb-9d0b-156034f016d0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567" status: 200 len: 1223 microversion: 2.1 time: 0.739923 Sep 17 20:58:36.766894 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 970/2008] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:35 2022] GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567 => generated 1223 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:36.788254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66617000-a87f-4a7d-9935-b14496ed2490 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:36.788929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66617000-a87f-4a7d-9935-b14496ed2490 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:36.789364 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66617000-a87f-4a7d-9935-b14496ed2490 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:36.797300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66617000-a87f-4a7d-9935-b14496ed2490 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:36.798059 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66617000-a87f-4a7d-9935-b14496ed2490 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:36.798848 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66617000-a87f-4a7d-9935-b14496ed2490 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:36.912344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b14768e8-bbcc-4153-b5c6-22a933a7254d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4f71a60>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:37.065967 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b14768e8-bbcc-4153-b5c6-22a933a7254d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b" status: 200 len: 1439 microversion: 2.1 time: 0.156973 Sep 17 20:58:37.066637 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 971/2009] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:58:36 2022] GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b => generated 1439 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:37.352551 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-66617000-a87f-4a7d-9935-b14496ed2490 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:37.389645 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-66617000-a87f-4a7d-9935-b14496ed2490 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1" status: 200 len: 1314 microversion: 2.1 time: 0.642483 Sep 17 20:58:37.391645 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1039/2010] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:36 2022] GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1 => generated 1314 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:37.509955 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-664448e1-488d-43db-b2eb-5537bc7adf28 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:37.511246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-664448e1-488d-43db-b2eb-5537bc7adf28 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] [instance: db1127cb-07c5-4e4d-8303-82b71dc31a55] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:37.536387 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-664448e1-488d-43db-b2eb-5537bc7adf28 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:37.539547 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-664448e1-488d-43db-b2eb-5537bc7adf28 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:37.542003 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-664448e1-488d-43db-b2eb-5537bc7adf28 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:37.543440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-664448e1-488d-43db-b2eb-5537bc7adf28 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:37.544349 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-664448e1-488d-43db-b2eb-5537bc7adf28 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:37.545119 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-664448e1-488d-43db-b2eb-5537bc7adf28 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:37.582360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:58:37.794815 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5d5ea7b5-76c9-4926-859b-0fc95b8ddb6c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:37.796460 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5d5ea7b5-76c9-4926-859b-0fc95b8ddb6c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 7b07abb3-f10d-4b65-9a52-28bb33b47567] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:37.814013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d5ea7b5-76c9-4926-859b-0fc95b8ddb6c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:37.815864 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d5ea7b5-76c9-4926-859b-0fc95b8ddb6c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:37.816999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d5ea7b5-76c9-4926-859b-0fc95b8ddb6c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:37.820182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d5ea7b5-76c9-4926-859b-0fc95b8ddb6c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:37.821852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d5ea7b5-76c9-4926-859b-0fc95b8ddb6c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:37.822493 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d5ea7b5-76c9-4926-859b-0fc95b8ddb6c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:38.146428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5d5ea7b5-76c9-4926-859b-0fc95b8ddb6c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:38.163928 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5d5ea7b5-76c9-4926-859b-0fc95b8ddb6c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567" status: 200 len: 1279 microversion: 2.1 time: 0.372451 Sep 17 20:58:38.179874 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1040/2011] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:37 2022] GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567 => generated 1279 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:38.179874 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4b95e8c6-344a-4c7f-85cb-c136998a7646 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4d4ddc0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:38.257115 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4b95e8c6-344a-4c7f-85cb-c136998a7646 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b" status: 200 len: 1439 microversion: 2.1 time: 0.088736 Sep 17 20:58:38.257959 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1041/2012] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:58:38 2022] GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b => generated 1439 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:38.379451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-664448e1-488d-43db-b2eb-5537bc7adf28 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6645db569614a10b1388a69b7e5a64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6f02f91d84fd59de856b10c42ac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:38.394268 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-664448e1-488d-43db-b2eb-5537bc7adf28 tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] 10.222.0.26 "GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55" status: 200 len: 1478 microversion: 2.1 time: 0.893681 Sep 17 20:58:38.397261 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 972/2013] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:37 2022] GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55 => generated 1478 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:58:38.413808 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-32567b1f-e4c7-4fee-b62c-c4fbe7c8e3ac tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:38.413808 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-32567b1f-e4c7-4fee-b62c-c4fbe7c8e3ac tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 1170d308-122b-4c9e-abf1-5d206d3b75f1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:38.434532 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32567b1f-e4c7-4fee-b62c-c4fbe7c8e3ac tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:38.435116 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32567b1f-e4c7-4fee-b62c-c4fbe7c8e3ac tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:38.435477 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32567b1f-e4c7-4fee-b62c-c4fbe7c8e3ac tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:38.436255 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32567b1f-e4c7-4fee-b62c-c4fbe7c8e3ac tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:38.441768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32567b1f-e4c7-4fee-b62c-c4fbe7c8e3ac tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:38.442292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32567b1f-e4c7-4fee-b62c-c4fbe7c8e3ac tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:39.168642 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=4 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:58:39.189610 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cdb4065f-ec46-4b84-a31e-85e337d78202 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:39.190946 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cdb4065f-ec46-4b84-a31e-85e337d78202 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 7b07abb3-f10d-4b65-9a52-28bb33b47567] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:39.201415 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-32567b1f-e4c7-4fee-b62c-c4fbe7c8e3ac tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:39.214632 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cdb4065f-ec46-4b84-a31e-85e337d78202 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:39.217941 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cdb4065f-ec46-4b84-a31e-85e337d78202 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:39.218828 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cdb4065f-ec46-4b84-a31e-85e337d78202 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:39.220656 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-32567b1f-e4c7-4fee-b62c-c4fbe7c8e3ac tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1" status: 200 len: 1314 microversion: 2.1 time: 0.811685 Sep 17 20:58:39.223826 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cdb4065f-ec46-4b84-a31e-85e337d78202 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:39.224783 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cdb4065f-ec46-4b84-a31e-85e337d78202 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:39.228943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cdb4065f-ec46-4b84-a31e-85e337d78202 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:39.241737 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1042/2014] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:38 2022] GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1 => generated 1314 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:39.273824 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-981b5ebd-1dc2-4f71-943d-cd9af3c8c53a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a9eeed30>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:39.359834 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-981b5ebd-1dc2-4f71-943d-cd9af3c8c53a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b" status: 200 len: 1439 microversion: 2.1 time: 0.090417 Sep 17 20:58:39.360116 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1043/2015] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:58:39 2022] GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b => generated 1439 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:39.400568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cdb4065f-ec46-4b84-a31e-85e337d78202 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:39.410229 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cdb4065f-ec46-4b84-a31e-85e337d78202 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567" status: 200 len: 1277 microversion: 2.1 time: 0.226058 Sep 17 20:58:39.412046 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 973/2016] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:39 2022] GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567 => generated 1277 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:39.434888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b3174bac-af7e-4a31-aafd-d45b44d3324f tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:39.436959 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b3174bac-af7e-4a31-aafd-d45b44d3324f tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] [instance: db1127cb-07c5-4e4d-8303-82b71dc31a55] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:39.451278 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3174bac-af7e-4a31-aafd-d45b44d3324f tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:39.451975 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3174bac-af7e-4a31-aafd-d45b44d3324f tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:39.452429 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3174bac-af7e-4a31-aafd-d45b44d3324f tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:39.453186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3174bac-af7e-4a31-aafd-d45b44d3324f tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:39.462642 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3174bac-af7e-4a31-aafd-d45b44d3324f tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:39.463397 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3174bac-af7e-4a31-aafd-d45b44d3324f tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:40.039883 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-e7029b4f-8064-4eae-936c-0d22febd89af req-0d473869-0cee-445d-9222-a366304ee103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db1127cb-07c5-4e4d-8303-82b71dc31a55", "name": "network-vif-deleted", "tag": "7ccc18b2-9166-4b44-ac7e-9b13135b61de"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:40.080440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-e7029b4f-8064-4eae-936c-0d22febd89af req-0d473869-0cee-445d-9222-a366304ee103 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:40.080956 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-e7029b4f-8064-4eae-936c-0d22febd89af req-0d473869-0cee-445d-9222-a366304ee103 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:40.081401 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-e7029b4f-8064-4eae-936c-0d22febd89af req-0d473869-0cee-445d-9222-a366304ee103 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:40.103990 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-e7029b4f-8064-4eae-936c-0d22febd89af req-0d473869-0cee-445d-9222-a366304ee103 service nova] Creating event network-vif-deleted:7ccc18b2-9166-4b44-ac7e-9b13135b61de for instance db1127cb-07c5-4e4d-8303-82b71dc31a55 on nch1-master-1 Sep 17 20:58:40.110007 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-e7029b4f-8064-4eae-936c-0d22febd89af req-0d473869-0cee-445d-9222-a366304ee103 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077250 Sep 17 20:58:40.147143 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 974/2017] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:40.180530 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b3174bac-af7e-4a31-aafd-d45b44d3324f tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6645db569614a10b1388a69b7e5a64f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31d6f02f91d84fd59de856b10c42ac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:40.193451 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b3174bac-af7e-4a31-aafd-d45b44d3324f tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] 10.222.0.26 "GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55" status: 200 len: 1478 microversion: 2.1 time: 0.759890 Sep 17 20:58:40.194405 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1044/2018] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:39 2022] GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55 => generated 1478 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:40.250108 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8cddef32-c399-4314-a018-df4101f13dbe tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:40.250860 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8cddef32-c399-4314-a018-df4101f13dbe tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 1170d308-122b-4c9e-abf1-5d206d3b75f1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:40.262030 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8cddef32-c399-4314-a018-df4101f13dbe tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:40.263112 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8cddef32-c399-4314-a018-df4101f13dbe tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:40.264270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8cddef32-c399-4314-a018-df4101f13dbe tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:40.265196 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8cddef32-c399-4314-a018-df4101f13dbe tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:40.266488 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8cddef32-c399-4314-a018-df4101f13dbe tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:40.267061 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8cddef32-c399-4314-a018-df4101f13dbe tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:40.377047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c34140fb-17e3-4c11-a7bc-949053bcff78 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a9f303a0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:40.476624 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c34140fb-17e3-4c11-a7bc-949053bcff78 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b" status: 200 len: 1439 microversion: 2.1 time: 0.104302 Sep 17 20:58:40.477384 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1045/2019] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:58:40 2022] GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b => generated 1439 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:58:40.483974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-50a455ba-4fa1-49ec-b4de-843d172cc333 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:40.485285 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-50a455ba-4fa1-49ec-b4de-843d172cc333 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 7b07abb3-f10d-4b65-9a52-28bb33b47567] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:40.493691 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50a455ba-4fa1-49ec-b4de-843d172cc333 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:40.496150 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50a455ba-4fa1-49ec-b4de-843d172cc333 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:40.496829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50a455ba-4fa1-49ec-b4de-843d172cc333 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:40.497922 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50a455ba-4fa1-49ec-b4de-843d172cc333 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:40.498614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50a455ba-4fa1-49ec-b4de-843d172cc333 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:40.499523 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50a455ba-4fa1-49ec-b4de-843d172cc333 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:40.632308 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-50a455ba-4fa1-49ec-b4de-843d172cc333 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:40.641426 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-50a455ba-4fa1-49ec-b4de-843d172cc333 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567" status: 200 len: 1277 microversion: 2.1 time: 0.162154 Sep 17 20:58:40.659608 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1046/2020] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:40 2022] GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567 => generated 1277 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:41.006994 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8cddef32-c399-4314-a018-df4101f13dbe tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:41.022260 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8cddef32-c399-4314-a018-df4101f13dbe tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1" status: 200 len: 1314 microversion: 2.1 time: 0.777996 Sep 17 20:58:41.036580 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 975/2021] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:40 2022] GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1 => generated 1314 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:41.230095 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c1d9ff06-438e-40a2-9aac-8bc5a6ab3b5c tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:41.230671 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c1d9ff06-438e-40a2-9aac-8bc5a6ab3b5c tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] [instance: db1127cb-07c5-4e4d-8303-82b71dc31a55] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:41.247681 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1d9ff06-438e-40a2-9aac-8bc5a6ab3b5c tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:41.248285 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1d9ff06-438e-40a2-9aac-8bc5a6ab3b5c tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:41.248742 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1d9ff06-438e-40a2-9aac-8bc5a6ab3b5c tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:41.249498 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1d9ff06-438e-40a2-9aac-8bc5a6ab3b5c tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:41.249977 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1d9ff06-438e-40a2-9aac-8bc5a6ab3b5c tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:41.250414 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1d9ff06-438e-40a2-9aac-8bc5a6ab3b5c tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:41.291439 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-c1d9ff06-438e-40a2-9aac-8bc5a6ab3b5c tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] HTTP exception thrown: Instance db1127cb-07c5-4e4d-8303-82b71dc31a55 could not be found. Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c1d9ff06-438e-40a2-9aac-8bc5a6ab3b5c tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Request method failure captured: Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55 HTTP/1.1 Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjTiFI1mg1ULeZJmnE75gkJsv_YYVq138K9U-nwSxeI8lC6L0y2_DR9UBjAQh44LAfcQ_t942JCVBdZLPPaJeKBFv26b0qdvqeVlGNqV1WaSbHI88Z1E6LyneLlOI9nLvmVh7Ga2Hoj5UalAFyEnuZeR1BEAVpHVJyOgHyjUhOdNvJ4 Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 31d6f02f91d84fd59de856b10c42ac5d Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-936895532 Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/31d6f02f91d84fd59de856b10c42ac5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/31d6f02f91d84fd59de856b10c42ac5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/31d6f02f91d84fd59de856b10c42ac5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_31d6f02f91d84fd59de856b10c42ac5d", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-936895532 Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 31d6f02f91d84fd59de856b10c42ac5d Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-936895532 Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerDiagnosticsNegativeTest-936895532-project Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: a6645db569614a10b1388a69b7e5a64f Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-936895532-project Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance db1127cb-07c5-4e4d-8303-82b71dc31a55 could not be found. Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'db1127cb-07c5-4e4d-8303-82b71dc31a55'} Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db1127cb-07c5-4e4d-8303-82b71dc31a55 could not be found. Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db1127cb-07c5-4e4d-8303-82b71dc31a55 could not be found. Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:58:41.293273 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:41.296610 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:58:41.296610 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:41.296610 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:41.296610 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:41.296610 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:58:41.296610 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:58:41.296610 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db1127cb-07c5-4e4d-8303-82b71dc31a55 could not be found. Sep 17 20:58:41.296610 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:58:41.296610 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c1d9ff06-438e-40a2-9aac-8bc5a6ab3b5c tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] Returning 404 to user: Instance db1127cb-07c5-4e4d-8303-82b71dc31a55 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:58:41.296610 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c1d9ff06-438e-40a2-9aac-8bc5a6ab3b5c tempest-ServerDiagnosticsNegativeTest-936895532 tempest-ServerDiagnosticsNegativeTest-936895532-project] 10.222.0.26 "GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55" status: 404 len: 111 microversion: 2.1 time: 0.069091 Sep 17 20:58:41.298680 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1047/2022] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:41 2022] GET /compute/v2.1/servers/db1127cb-07c5-4e4d-8303-82b71dc31a55 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:58:41.493812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-abbe3675-764b-4d55-9aed-a5bbdab269d8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4f6bdc0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:41.606883 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-abbe3675-764b-4d55-9aed-a5bbdab269d8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b" status: 200 len: 1439 microversion: 2.1 time: 0.117090 Sep 17 20:58:41.613287 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 976/2023] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:58:41 2022] GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b => generated 1439 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:41.664495 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-89d8d3bc-4fe8-4524-8e48-728ce43a2f17 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:41.665266 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-89d8d3bc-4fe8-4524-8e48-728ce43a2f17 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 7b07abb3-f10d-4b65-9a52-28bb33b47567] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:41.681387 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-89d8d3bc-4fe8-4524-8e48-728ce43a2f17 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:41.682356 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-89d8d3bc-4fe8-4524-8e48-728ce43a2f17 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:41.684397 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-89d8d3bc-4fe8-4524-8e48-728ce43a2f17 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:41.686624 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-89d8d3bc-4fe8-4524-8e48-728ce43a2f17 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:41.687536 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-89d8d3bc-4fe8-4524-8e48-728ce43a2f17 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:41.691384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-89d8d3bc-4fe8-4524-8e48-728ce43a2f17 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:42.010036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-89d8d3bc-4fe8-4524-8e48-728ce43a2f17 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:42.022380 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-89d8d3bc-4fe8-4524-8e48-728ce43a2f17 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567" status: 200 len: 1277 microversion: 2.1 time: 0.361818 Sep 17 20:58:42.028203 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1048/2024] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:41 2022] GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567 => generated 1277 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:42.055353 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5aeaed24-be43-4d23-9de4-978ed3fb2fc9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:42.057259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5aeaed24-be43-4d23-9de4-978ed3fb2fc9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 1170d308-122b-4c9e-abf1-5d206d3b75f1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:42.086648 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5aeaed24-be43-4d23-9de4-978ed3fb2fc9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:42.087543 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5aeaed24-be43-4d23-9de4-978ed3fb2fc9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:42.089584 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5aeaed24-be43-4d23-9de4-978ed3fb2fc9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:42.093629 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5aeaed24-be43-4d23-9de4-978ed3fb2fc9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:42.096262 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5aeaed24-be43-4d23-9de4-978ed3fb2fc9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:42.097988 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5aeaed24-be43-4d23-9de4-978ed3fb2fc9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:42.172519 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-599ca5a7-f8fa-4c85-976c-c574a9fc3f69 req-1e027915-8812-4cbb-8eac-7952bc6c5ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1170d308-122b-4c9e-abf1-5d206d3b75f1", "tag": "9d01a13c-3b68-4cfc-aebd-9a72fb8b76d8"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:42.177922 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=16 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:58:42.206865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-599ca5a7-f8fa-4c85-976c-c574a9fc3f69 req-1e027915-8812-4cbb-8eac-7952bc6c5ac3 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:42.207384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-599ca5a7-f8fa-4c85-976c-c574a9fc3f69 req-1e027915-8812-4cbb-8eac-7952bc6c5ac3 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:42.207841 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-599ca5a7-f8fa-4c85-976c-c574a9fc3f69 req-1e027915-8812-4cbb-8eac-7952bc6c5ac3 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:42.238317 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-599ca5a7-f8fa-4c85-976c-c574a9fc3f69 req-1e027915-8812-4cbb-8eac-7952bc6c5ac3 service nova] Creating event network-changed:9d01a13c-3b68-4cfc-aebd-9a72fb8b76d8 for instance 1170d308-122b-4c9e-abf1-5d206d3b75f1 on nch1-master-1 Sep 17 20:58:42.280383 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-599ca5a7-f8fa-4c85-976c-c574a9fc3f69 req-1e027915-8812-4cbb-8eac-7952bc6c5ac3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111874 Sep 17 20:58:42.288646 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1049/2025] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:58:42.628697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-aa6fd75c-7024-4c58-9ed6-d72210e63c2b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a9ef8310>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:42.702100 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-aa6fd75c-7024-4c58-9ed6-d72210e63c2b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b" status: 200 len: 1439 microversion: 2.1 time: 0.078264 Sep 17 20:58:42.713154 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1050/2026] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:58:42 2022] GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b => generated 1439 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:58:43.050007 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3ddbe78a-855a-42e4-9e5f-69ba2fd7fadf tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:43.051070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3ddbe78a-855a-42e4-9e5f-69ba2fd7fadf tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 7b07abb3-f10d-4b65-9a52-28bb33b47567] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:43.066929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ddbe78a-855a-42e4-9e5f-69ba2fd7fadf tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:43.068274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ddbe78a-855a-42e4-9e5f-69ba2fd7fadf tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:43.070545 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ddbe78a-855a-42e4-9e5f-69ba2fd7fadf tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:43.071789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ddbe78a-855a-42e4-9e5f-69ba2fd7fadf tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:43.073178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ddbe78a-855a-42e4-9e5f-69ba2fd7fadf tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:43.073846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ddbe78a-855a-42e4-9e5f-69ba2fd7fadf tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:43.812538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5aeaed24-be43-4d23-9de4-978ed3fb2fc9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:43.833779 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5aeaed24-be43-4d23-9de4-978ed3fb2fc9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1" status: 200 len: 1314 microversion: 2.1 time: 1.770968 Sep 17 20:58:43.836621 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 977/2027] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:42 2022] GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1 => generated 1314 bytes in 1789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:43.841636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d8c10c28-c603-4bde-b5f4-e346efb2f67a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4cccf70>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:43.991340 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d8c10c28-c603-4bde-b5f4-e346efb2f67a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b" status: 200 len: 1439 microversion: 2.1 time: 0.153067 Sep 17 20:58:43.995216 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 978/2028] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:58:43 2022] GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b => generated 1439 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:44.088080 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3ddbe78a-855a-42e4-9e5f-69ba2fd7fadf tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:44.098471 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3ddbe78a-855a-42e4-9e5f-69ba2fd7fadf tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567" status: 200 len: 1319 microversion: 2.1 time: 1.053227 Sep 17 20:58:44.127305 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1051/2029] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:43 2022] GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567 => generated 1319 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:58:44.618183 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:58:44.863041 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fe91da96-e198-4542-891d-69a0b051ee22 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:44.863662 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fe91da96-e198-4542-891d-69a0b051ee22 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 1170d308-122b-4c9e-abf1-5d206d3b75f1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:44.879811 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe91da96-e198-4542-891d-69a0b051ee22 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:44.880769 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe91da96-e198-4542-891d-69a0b051ee22 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:44.888845 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe91da96-e198-4542-891d-69a0b051ee22 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:44.889882 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe91da96-e198-4542-891d-69a0b051ee22 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:44.890874 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe91da96-e198-4542-891d-69a0b051ee22 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:44.898326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe91da96-e198-4542-891d-69a0b051ee22 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:44.970964 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=36 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:58:45.260246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-41cf39ae-00cd-4f08-b11c-fa48d477aada tempest-NetworksTest-841609602 tempest-NetworksTest-841609602-project-admin] Calling method '.version_select at 0x7f25a4cf4b80>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:45.455948 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fe91da96-e198-4542-891d-69a0b051ee22 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:45.467818 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fe91da96-e198-4542-891d-69a0b051ee22 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1" status: 200 len: 1314 microversion: 2.1 time: 0.608540 Sep 17 20:58:45.469142 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1052/2030] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:44 2022] GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1 => generated 1314 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:45.487043 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-58c89164-ae28-4d39-8e5c-16a476449c42 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4d6ff70>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:45.592264 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-58c89164-ae28-4d39-8e5c-16a476449c42 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b" status: 200 len: 1439 microversion: 2.1 time: 0.116265 Sep 17 20:58:45.595709 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1053/2031] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:58:45 2022] GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b => generated 1439 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:45.611668 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-92b803c7-aa51-4385-bb64-323edd90e5e3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:45.614248 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-92b803c7-aa51-4385-bb64-323edd90e5e3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 7b07abb3-f10d-4b65-9a52-28bb33b47567] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:45.625832 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92b803c7-aa51-4385-bb64-323edd90e5e3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:45.628918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92b803c7-aa51-4385-bb64-323edd90e5e3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:45.629934 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92b803c7-aa51-4385-bb64-323edd90e5e3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:45.632327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92b803c7-aa51-4385-bb64-323edd90e5e3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:45.632972 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92b803c7-aa51-4385-bb64-323edd90e5e3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:45.634036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92b803c7-aa51-4385-bb64-323edd90e5e3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:45.658356 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-41cf39ae-00cd-4f08-b11c-fa48d477aada tempest-NetworksTest-841609602 tempest-NetworksTest-841609602-project-admin] 10.222.0.26 "GET /compute/v2.1/os-networks" status: 200 len: 6688 microversion: 2.1 time: 1.044907 Sep 17 20:58:45.664546 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 979/2032] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Sep 17 20:58:44 2022] GET /compute/v2.1/os-networks => generated 6688 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:45.671000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-31b2cf81-8a4d-44b2-adbf-d109e9d9c51a tempest-NetworksTest-841609602 tempest-NetworksTest-841609602-project-admin] Calling method '.version_select at 0x7f25a4cf4e50>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:46.112272 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-92b803c7-aa51-4385-bb64-323edd90e5e3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:46.120378 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-92b803c7-aa51-4385-bb64-323edd90e5e3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567" status: 200 len: 1319 microversion: 2.1 time: 0.523398 Sep 17 20:58:46.120974 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1054/2033] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:45 2022] GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567 => generated 1319 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:46.132346 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-31b2cf81-8a4d-44b2-adbf-d109e9d9c51a tempest-NetworksTest-841609602 tempest-NetworksTest-841609602-project-admin] 10.222.0.26 "GET /compute/v2.1/os-networks/65a1299f-7295-4ddf-9578-cb304a29a96a" status: 200 len: 652 microversion: 2.1 time: 0.466351 Sep 17 20:58:46.133770 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 980/2034] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Sep 17 20:58:45 2022] GET /compute/v2.1/os-networks/65a1299f-7295-4ddf-9578-cb304a29a96a => generated 652 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:46.147294 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-35406c50-50a4-4c4e-b908-253755b40e0c tempest-NetworksTest-841609602 tempest-NetworksTest-841609602-project-admin] Calling method '.version_select at 0x7f25a9ef85e0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:46.343053 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-35406c50-50a4-4c4e-b908-253755b40e0c tempest-NetworksTest-841609602 tempest-NetworksTest-841609602-project-admin] 10.222.0.26 "GET /compute/v2.1/os-networks" status: 200 len: 6688 microversion: 2.1 time: 0.199472 Sep 17 20:58:46.344327 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1055/2035] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Sep 17 20:58:46 2022] GET /compute/v2.1/os-networks => generated 6688 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:46.491957 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ff62282d-a17b-4fdf-beb7-83e01e700859 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:46.492673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ff62282d-a17b-4fdf-beb7-83e01e700859 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 1170d308-122b-4c9e-abf1-5d206d3b75f1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:46.503507 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff62282d-a17b-4fdf-beb7-83e01e700859 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:46.513970 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff62282d-a17b-4fdf-beb7-83e01e700859 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:46.514722 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff62282d-a17b-4fdf-beb7-83e01e700859 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:46.516183 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff62282d-a17b-4fdf-beb7-83e01e700859 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:46.517624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff62282d-a17b-4fdf-beb7-83e01e700859 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:46.518633 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff62282d-a17b-4fdf-beb7-83e01e700859 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:46.611849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-10a6046a-659b-4115-b01d-5e1725e8a51a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a9eee550>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:46.709784 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-10a6046a-659b-4115-b01d-5e1725e8a51a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b" status: 200 len: 1439 microversion: 2.1 time: 0.102631 Sep 17 20:58:46.710578 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1056/2036] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:58:46 2022] GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b => generated 1439 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:58:46.737037 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-e2b56ed7-170c-4018-92be-2a55438a09b1 req-c776b377-116c-458e-9957-0830df7dba7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e16ee697-bc81-4c87-a419-9485374a111a", "tag": "9a3df8b6-f94c-4f97-8b6f-ec09d9194b52"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:46.759291 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e2b56ed7-170c-4018-92be-2a55438a09b1 req-c776b377-116c-458e-9957-0830df7dba7f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:46.762537 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e2b56ed7-170c-4018-92be-2a55438a09b1 req-c776b377-116c-458e-9957-0830df7dba7f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:46.762980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e2b56ed7-170c-4018-92be-2a55438a09b1 req-c776b377-116c-458e-9957-0830df7dba7f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:46.794196 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-e2b56ed7-170c-4018-92be-2a55438a09b1 req-c776b377-116c-458e-9957-0830df7dba7f service nova] Creating event network-changed:9a3df8b6-f94c-4f97-8b6f-ec09d9194b52 for instance e16ee697-bc81-4c87-a419-9485374a111a on nch2-master-1 Sep 17 20:58:46.811571 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-e2b56ed7-170c-4018-92be-2a55438a09b1 req-c776b377-116c-458e-9957-0830df7dba7f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098381 Sep 17 20:58:46.814178 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1057/2037] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:46.913857 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ff62282d-a17b-4fdf-beb7-83e01e700859 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:46.923814 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ff62282d-a17b-4fdf-beb7-83e01e700859 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1" status: 200 len: 1314 microversion: 2.1 time: 0.435990 Sep 17 20:58:46.930293 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 981/2038] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:46 2022] GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:47.159615 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-382143ab-cf07-4af1-964a-66ab4957a34a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:47.166394 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-382143ab-cf07-4af1-964a-66ab4957a34a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 7b07abb3-f10d-4b65-9a52-28bb33b47567] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:47.191623 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-382143ab-cf07-4af1-964a-66ab4957a34a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:47.193290 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-382143ab-cf07-4af1-964a-66ab4957a34a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:47.193946 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-382143ab-cf07-4af1-964a-66ab4957a34a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:47.195533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-382143ab-cf07-4af1-964a-66ab4957a34a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:47.196199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-382143ab-cf07-4af1-964a-66ab4957a34a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:47.196929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-382143ab-cf07-4af1-964a-66ab4957a34a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:47.617245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-382143ab-cf07-4af1-964a-66ab4957a34a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:47.625903 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-382143ab-cf07-4af1-964a-66ab4957a34a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567" status: 200 len: 1319 microversion: 2.1 time: 0.486387 Sep 17 20:58:47.626501 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1058/2039] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:47 2022] GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567 => generated 1319 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:47.726096 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-40f2b874-dd67-423f-9a36-b501178fd096 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4cf4e50>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:47.843749 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-40f2b874-dd67-423f-9a36-b501178fd096 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b" status: 200 len: 1439 microversion: 2.1 time: 0.121562 Sep 17 20:58:47.844476 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 982/2040] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:58:47 2022] GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b => generated 1439 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:47.955534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e8f3a2b2-745b-410c-bef6-d70f7761648f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:47.956433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e8f3a2b2-745b-410c-bef6-d70f7761648f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 1170d308-122b-4c9e-abf1-5d206d3b75f1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:47.970703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8f3a2b2-745b-410c-bef6-d70f7761648f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:47.971225 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8f3a2b2-745b-410c-bef6-d70f7761648f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:47.971649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8f3a2b2-745b-410c-bef6-d70f7761648f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:47.972385 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8f3a2b2-745b-410c-bef6-d70f7761648f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:47.972842 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8f3a2b2-745b-410c-bef6-d70f7761648f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:47.973270 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8f3a2b2-745b-410c-bef6-d70f7761648f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:48.612328 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e8f3a2b2-745b-410c-bef6-d70f7761648f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:48.626050 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e8f3a2b2-745b-410c-bef6-d70f7761648f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1" status: 200 len: 1314 microversion: 2.1 time: 0.674151 Sep 17 20:58:48.629804 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1059/2041] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:47 2022] GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1 => generated 1314 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:48.650207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4f2e1d47-c3ea-49cc-b650-d185e3309051 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:48.651139 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4f2e1d47-c3ea-49cc-b650-d185e3309051 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 7b07abb3-f10d-4b65-9a52-28bb33b47567] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:48.658856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f2e1d47-c3ea-49cc-b650-d185e3309051 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:48.664282 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f2e1d47-c3ea-49cc-b650-d185e3309051 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:48.664932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f2e1d47-c3ea-49cc-b650-d185e3309051 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:48.666053 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f2e1d47-c3ea-49cc-b650-d185e3309051 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:48.669092 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f2e1d47-c3ea-49cc-b650-d185e3309051 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:48.670285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f2e1d47-c3ea-49cc-b650-d185e3309051 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:48.848404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-7749b2c5-5557-48a9-8e82-37a59fa0429a req-6b3c67ce-4817-4f26-b0bc-dc3f7c56886e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b07abb3-f10d-4b65-9a52-28bb33b47567", "tag": "dc17c9e2-7720-4027-baf7-177d28086374"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:48.867677 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7749b2c5-5557-48a9-8e82-37a59fa0429a req-6b3c67ce-4817-4f26-b0bc-dc3f7c56886e service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:48.880198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7749b2c5-5557-48a9-8e82-37a59fa0429a req-6b3c67ce-4817-4f26-b0bc-dc3f7c56886e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:48.880757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7749b2c5-5557-48a9-8e82-37a59fa0429a req-6b3c67ce-4817-4f26-b0bc-dc3f7c56886e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:48.960691 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-7749b2c5-5557-48a9-8e82-37a59fa0429a req-6b3c67ce-4817-4f26-b0bc-dc3f7c56886e service nova] Creating event network-changed:dc17c9e2-7720-4027-baf7-177d28086374 for instance 7b07abb3-f10d-4b65-9a52-28bb33b47567 on nch1-master-1 Sep 17 20:58:48.992507 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-7749b2c5-5557-48a9-8e82-37a59fa0429a req-6b3c67ce-4817-4f26-b0bc-dc3f7c56886e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135475 Sep 17 20:58:48.993238 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1060/2042] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:49.027837 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8b0a59c5-8faf-4e04-a6e1-9f1c4a34d3ca tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4d4d790>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:49.186981 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8b0a59c5-8faf-4e04-a6e1-9f1c4a34d3ca tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b" status: 200 len: 1439 microversion: 2.1 time: 0.187196 Sep 17 20:58:49.188234 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1061/2043] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:58:48 2022] GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b => generated 1439 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:49.539045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4f2e1d47-c3ea-49cc-b650-d185e3309051 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:49.550216 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4f2e1d47-c3ea-49cc-b650-d185e3309051 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567" status: 200 len: 1319 microversion: 2.1 time: 0.903426 Sep 17 20:58:49.567212 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 983/2044] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:48 2022] GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567 => generated 1319 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:49.653102 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-dd0e0628-bc3e-4b13-893b-4db89e26ec6f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:49.654623 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-dd0e0628-bc3e-4b13-893b-4db89e26ec6f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 1170d308-122b-4c9e-abf1-5d206d3b75f1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:49.667165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd0e0628-bc3e-4b13-893b-4db89e26ec6f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:49.670337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd0e0628-bc3e-4b13-893b-4db89e26ec6f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:49.671011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd0e0628-bc3e-4b13-893b-4db89e26ec6f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:49.672039 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd0e0628-bc3e-4b13-893b-4db89e26ec6f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:49.679555 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd0e0628-bc3e-4b13-893b-4db89e26ec6f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:49.680195 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd0e0628-bc3e-4b13-893b-4db89e26ec6f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:49.917740 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-51423001-16cb-4bc1-85ea-fd700d6ec707 req-1426c60a-8a01-4eb7-bc97-7e0a2d46bf45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1170d308-122b-4c9e-abf1-5d206d3b75f1", "name": "network-vif-plugged", "status": "completed", "tag": "9d01a13c-3b68-4cfc-aebd-9a72fb8b76d8"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:49.934833 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-51423001-16cb-4bc1-85ea-fd700d6ec707 req-1426c60a-8a01-4eb7-bc97-7e0a2d46bf45 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:49.935459 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-51423001-16cb-4bc1-85ea-fd700d6ec707 req-1426c60a-8a01-4eb7-bc97-7e0a2d46bf45 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:49.935888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-51423001-16cb-4bc1-85ea-fd700d6ec707 req-1426c60a-8a01-4eb7-bc97-7e0a2d46bf45 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:49.981185 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-51423001-16cb-4bc1-85ea-fd700d6ec707 req-1426c60a-8a01-4eb7-bc97-7e0a2d46bf45 service nova] Creating event network-vif-plugged:9d01a13c-3b68-4cfc-aebd-9a72fb8b76d8 for instance 1170d308-122b-4c9e-abf1-5d206d3b75f1 on nch1-master-1 Sep 17 20:58:50.005389 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-51423001-16cb-4bc1-85ea-fd700d6ec707 req-1426c60a-8a01-4eb7-bc97-7e0a2d46bf45 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089922 Sep 17 20:58:50.020141 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 984/2045] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:58:50.289525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-dd0e0628-bc3e-4b13-893b-4db89e26ec6f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:50.310008 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-dd0e0628-bc3e-4b13-893b-4db89e26ec6f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1" status: 200 len: 1314 microversion: 2.1 time: 0.662186 Sep 17 20:58:50.332715 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1062/2046] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:49 2022] GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1 => generated 1314 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:50.350697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-dc387207-9b52-4607-845b-fbadedff017a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a9f8e4c0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:50.404979 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-548f75a0-c2c0-44f3-99c6-b97065296096 tempest-ServicesAdminTestJSON-1189016477 tempest-ServicesAdminTestJSON-1189016477-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:50.410678 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-548f75a0-c2c0-44f3-99c6-b97065296096 tempest-ServicesAdminTestJSON-1189016477 tempest-ServicesAdminTestJSON-1189016477-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:50.412122 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-548f75a0-c2c0-44f3-99c6-b97065296096 tempest-ServicesAdminTestJSON-1189016477 tempest-ServicesAdminTestJSON-1189016477-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:50.412578 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-548f75a0-c2c0-44f3-99c6-b97065296096 tempest-ServicesAdminTestJSON-1189016477 tempest-ServicesAdminTestJSON-1189016477-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:50.416614 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-548f75a0-c2c0-44f3-99c6-b97065296096 tempest-ServicesAdminTestJSON-1189016477 tempest-ServicesAdminTestJSON-1189016477-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:50.417096 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-548f75a0-c2c0-44f3-99c6-b97065296096 tempest-ServicesAdminTestJSON-1189016477 tempest-ServicesAdminTestJSON-1189016477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:50.417541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-548f75a0-c2c0-44f3-99c6-b97065296096 tempest-ServicesAdminTestJSON-1189016477 tempest-ServicesAdminTestJSON-1189016477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:50.422681 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-dc387207-9b52-4607-845b-fbadedff017a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b" status: 200 len: 1439 microversion: 2.1 time: 0.088756 Sep 17 20:58:50.423783 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1063/2047] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:58:50 2022] GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b => generated 1439 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:50.548309 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-548f75a0-c2c0-44f3-99c6-b97065296096 tempest-ServicesAdminTestJSON-1189016477 tempest-ServicesAdminTestJSON-1189016477-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.437878 Sep 17 20:58:50.557644 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 985/2048] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Sep 17 20:58:50 2022] GET /compute/v2.1/os-services => generated 947 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:50.564789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-981a7055-7a04-4214-b1a1-e1036f1aeed2 tempest-ServicesAdminTestJSON-1189016477 tempest-ServicesAdminTestJSON-1189016477-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:50.576572 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-981a7055-7a04-4214-b1a1-e1036f1aeed2 tempest-ServicesAdminTestJSON-1189016477 tempest-ServicesAdminTestJSON-1189016477-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:50.577066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-981a7055-7a04-4214-b1a1-e1036f1aeed2 tempest-ServicesAdminTestJSON-1189016477 tempest-ServicesAdminTestJSON-1189016477-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:50.591924 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ef23ef09-4208-4052-8b89-45e9657502b1 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:50.592720 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ef23ef09-4208-4052-8b89-45e9657502b1 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 7b07abb3-f10d-4b65-9a52-28bb33b47567] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:50.594329 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-981a7055-7a04-4214-b1a1-e1036f1aeed2 tempest-ServicesAdminTestJSON-1189016477 tempest-ServicesAdminTestJSON-1189016477-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:50.601783 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-981a7055-7a04-4214-b1a1-e1036f1aeed2 tempest-ServicesAdminTestJSON-1189016477 tempest-ServicesAdminTestJSON-1189016477-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:50.602292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-981a7055-7a04-4214-b1a1-e1036f1aeed2 tempest-ServicesAdminTestJSON-1189016477 tempest-ServicesAdminTestJSON-1189016477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:50.602734 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-981a7055-7a04-4214-b1a1-e1036f1aeed2 tempest-ServicesAdminTestJSON-1189016477 tempest-ServicesAdminTestJSON-1189016477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:50.603353 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef23ef09-4208-4052-8b89-45e9657502b1 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:50.605413 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef23ef09-4208-4052-8b89-45e9657502b1 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:50.606026 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef23ef09-4208-4052-8b89-45e9657502b1 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:50.609400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef23ef09-4208-4052-8b89-45e9657502b1 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:50.610175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef23ef09-4208-4052-8b89-45e9657502b1 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:50.610767 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef23ef09-4208-4052-8b89-45e9657502b1 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:50.723361 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-981a7055-7a04-4214-b1a1-e1036f1aeed2 tempest-ServicesAdminTestJSON-1189016477 tempest-ServicesAdminTestJSON-1189016477-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.163687 Sep 17 20:58:50.737769 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1064/2049] 10.222.0.26 () {58 vars in 1174 bytes} [Sat Sep 17 20:58:50 2022] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:58:50.754108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a8d3501e-9429-4081-8176-1f832fd1a667 tempest-ServicesAdminTestJSON-1189016477 tempest-ServicesAdminTestJSON-1189016477-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:50.773720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8d3501e-9429-4081-8176-1f832fd1a667 tempest-ServicesAdminTestJSON-1189016477 tempest-ServicesAdminTestJSON-1189016477-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:50.778007 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8d3501e-9429-4081-8176-1f832fd1a667 tempest-ServicesAdminTestJSON-1189016477 tempest-ServicesAdminTestJSON-1189016477-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:50.780334 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8d3501e-9429-4081-8176-1f832fd1a667 tempest-ServicesAdminTestJSON-1189016477 tempest-ServicesAdminTestJSON-1189016477-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:50.781398 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8d3501e-9429-4081-8176-1f832fd1a667 tempest-ServicesAdminTestJSON-1189016477 tempest-ServicesAdminTestJSON-1189016477-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:50.785058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8d3501e-9429-4081-8176-1f832fd1a667 tempest-ServicesAdminTestJSON-1189016477 tempest-ServicesAdminTestJSON-1189016477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:50.785706 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8d3501e-9429-4081-8176-1f832fd1a667 tempest-ServicesAdminTestJSON-1189016477 tempest-ServicesAdminTestJSON-1189016477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:50.830937 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a8d3501e-9429-4081-8176-1f832fd1a667 tempest-ServicesAdminTestJSON-1189016477 tempest-ServicesAdminTestJSON-1189016477-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.083319 Sep 17 20:58:50.832130 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1065/2050] 10.222.0.26 () {58 vars in 1176 bytes} [Sat Sep 17 20:58:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:50.930079 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ef23ef09-4208-4052-8b89-45e9657502b1 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:50.945545 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ef23ef09-4208-4052-8b89-45e9657502b1 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567" status: 200 len: 1319 microversion: 2.1 time: 0.373201 Sep 17 20:58:50.946340 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 986/2051] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:50 2022] GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567 => generated 1319 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:58:50.961621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-12af2ebc-1446-4b24-8661-8b37d926428a tempest-ServicesAdminTestJSON-1189016477 tempest-ServicesAdminTestJSON-1189016477-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:50.973727 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12af2ebc-1446-4b24-8661-8b37d926428a tempest-ServicesAdminTestJSON-1189016477 tempest-ServicesAdminTestJSON-1189016477-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:50.980526 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12af2ebc-1446-4b24-8661-8b37d926428a tempest-ServicesAdminTestJSON-1189016477 tempest-ServicesAdminTestJSON-1189016477-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:50.983327 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12af2ebc-1446-4b24-8661-8b37d926428a tempest-ServicesAdminTestJSON-1189016477 tempest-ServicesAdminTestJSON-1189016477-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:50.984943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12af2ebc-1446-4b24-8661-8b37d926428a tempest-ServicesAdminTestJSON-1189016477 tempest-ServicesAdminTestJSON-1189016477-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:50.985990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12af2ebc-1446-4b24-8661-8b37d926428a tempest-ServicesAdminTestJSON-1189016477 tempest-ServicesAdminTestJSON-1189016477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:50.988868 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12af2ebc-1446-4b24-8661-8b37d926428a tempest-ServicesAdminTestJSON-1189016477 tempest-ServicesAdminTestJSON-1189016477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:51.044997 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-12af2ebc-1446-4b24-8661-8b37d926428a tempest-ServicesAdminTestJSON-1189016477 tempest-ServicesAdminTestJSON-1189016477-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.097348 Sep 17 20:58:51.050106 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 987/2052] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Sep 17 20:58:50 2022] GET /compute/v2.1/os-services => generated 947 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:51.073559 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-073b3a1a-5eae-4f6b-8321-a7b42baf7f46 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-539837767", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "3dee7466-4326-46ec-ae2d-96ee5b1e633d"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:51.231660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-073b3a1a-5eae-4f6b-8321-a7b42baf7f46 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] validate_networks() for [('3dee7466-4326-46ec-ae2d-96ee5b1e633d', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:58:51.332972 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1a5c111f-35c6-4754-8c28-fa49825bfa21 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:51.333635 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1a5c111f-35c6-4754-8c28-fa49825bfa21 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 1170d308-122b-4c9e-abf1-5d206d3b75f1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:51.342673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a5c111f-35c6-4754-8c28-fa49825bfa21 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:51.343173 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a5c111f-35c6-4754-8c28-fa49825bfa21 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:51.343614 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a5c111f-35c6-4754-8c28-fa49825bfa21 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:51.351348 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a5c111f-35c6-4754-8c28-fa49825bfa21 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:51.351913 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a5c111f-35c6-4754-8c28-fa49825bfa21 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:51.352367 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a5c111f-35c6-4754-8c28-fa49825bfa21 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:52.118169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1a5c111f-35c6-4754-8c28-fa49825bfa21 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:52.135442 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1a5c111f-35c6-4754-8c28-fa49825bfa21 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1" status: 200 len: 1314 microversion: 2.1 time: 0.805311 Sep 17 20:58:52.153422 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 988/2053] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:51 2022] GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1 => generated 1314 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:52.164983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-764ac4be-a46e-414a-a293-fce1e328d7f1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a9fc1e50>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:52.278937 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-764ac4be-a46e-414a-a293-fce1e328d7f1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b" status: 200 len: 1439 microversion: 2.1 time: 0.123845 Sep 17 20:58:52.279862 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 989/2054] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:58:52 2022] GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b => generated 1439 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:52.292785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3ebb5566-a1f1-46e2-8fcd-23f53b382759 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:52.294398 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3ebb5566-a1f1-46e2-8fcd-23f53b382759 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 7b07abb3-f10d-4b65-9a52-28bb33b47567] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:52.311973 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3ebb5566-a1f1-46e2-8fcd-23f53b382759 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:52.313337 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3ebb5566-a1f1-46e2-8fcd-23f53b382759 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:52.314599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3ebb5566-a1f1-46e2-8fcd-23f53b382759 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:52.322675 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3ebb5566-a1f1-46e2-8fcd-23f53b382759 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:52.333193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3ebb5566-a1f1-46e2-8fcd-23f53b382759 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:52.334769 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3ebb5566-a1f1-46e2-8fcd-23f53b382759 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:52.518399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-073b3a1a-5eae-4f6b-8321-a7b42baf7f46 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:58:52.521291 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-073b3a1a-5eae-4f6b-8321-a7b42baf7f46 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:58:52.522086 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-073b3a1a-5eae-4f6b-8321-a7b42baf7f46 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:58:52.522725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-073b3a1a-5eae-4f6b-8321-a7b42baf7f46 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:58:52.523448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-073b3a1a-5eae-4f6b-8321-a7b42baf7f46 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:58:52.534292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-073b3a1a-5eae-4f6b-8321-a7b42baf7f46 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:52.535070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-073b3a1a-5eae-4f6b-8321-a7b42baf7f46 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:52.536604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-073b3a1a-5eae-4f6b-8321-a7b42baf7f46 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:52.537858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-073b3a1a-5eae-4f6b-8321-a7b42baf7f46 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:52.538551 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-073b3a1a-5eae-4f6b-8321-a7b42baf7f46 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:52.539186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-073b3a1a-5eae-4f6b-8321-a7b42baf7f46 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:52.622080 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-073b3a1a-5eae-4f6b-8321-a7b42baf7f46 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Getting quotas for project 9b45a150f2db4c2bb4871cd1d1cab898. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:58:52.645102 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-073b3a1a-5eae-4f6b-8321-a7b42baf7f46 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Getting quotas for user da76bbe04c22456f957be0675892359d and project 9b45a150f2db4c2bb4871cd1d1cab898. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:58:52.681672 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3ebb5566-a1f1-46e2-8fcd-23f53b382759 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:52.691680 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-073b3a1a-5eae-4f6b-8321-a7b42baf7f46 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:58:52.704386 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-073b3a1a-5eae-4f6b-8321-a7b42baf7f46 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:58:52.705826 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3ebb5566-a1f1-46e2-8fcd-23f53b382759 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567" status: 200 len: 1319 microversion: 2.1 time: 0.421971 Sep 17 20:58:52.706453 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 990/2055] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:52 2022] GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567 => generated 1319 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:52.750705 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:58:52.804495 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-073b3a1a-5eae-4f6b-8321-a7b42baf7f46 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.970995 Sep 17 20:58:52.805851 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1066/2056] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:58:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:58:53.008990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-311d04e5-df60-4f54-89e3-5c7cadfc778e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-293894855", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "3dee7466-4326-46ec-ae2d-96ee5b1e633d"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:53.168098 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0a161a07-da1e-4946-aec6-b1dc0c72c605 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:53.168765 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0a161a07-da1e-4946-aec6-b1dc0c72c605 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 1170d308-122b-4c9e-abf1-5d206d3b75f1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:53.174112 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-311d04e5-df60-4f54-89e3-5c7cadfc778e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] validate_networks() for [('3dee7466-4326-46ec-ae2d-96ee5b1e633d', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:58:53.189519 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a161a07-da1e-4946-aec6-b1dc0c72c605 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:53.190090 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a161a07-da1e-4946-aec6-b1dc0c72c605 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:53.190604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a161a07-da1e-4946-aec6-b1dc0c72c605 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:53.191391 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a161a07-da1e-4946-aec6-b1dc0c72c605 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:53.191888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a161a07-da1e-4946-aec6-b1dc0c72c605 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:53.192328 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a161a07-da1e-4946-aec6-b1dc0c72c605 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:53.295015 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:58:53.916520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0a161a07-da1e-4946-aec6-b1dc0c72c605 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:53.932855 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0a161a07-da1e-4946-aec6-b1dc0c72c605 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1" status: 200 len: 1501 microversion: 2.1 time: 0.763180 Sep 17 20:58:53.933793 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1067/2057] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:53 2022] GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1 => generated 1501 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:53.949277 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-146591fa-5236-415c-9c10-9b3f41614e1b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4d4df70>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:54.067668 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-146591fa-5236-415c-9c10-9b3f41614e1b tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b" status: 200 len: 1439 microversion: 2.1 time: 0.129740 Sep 17 20:58:54.068696 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1068/2058] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:58:53 2022] GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b => generated 1439 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:54.082388 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-126ee55f-d31f-460e-acf2-e17222676996 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:54.095411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-126ee55f-d31f-460e-acf2-e17222676996 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 7b07abb3-f10d-4b65-9a52-28bb33b47567] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:54.146877 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-126ee55f-d31f-460e-acf2-e17222676996 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:54.152715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-126ee55f-d31f-460e-acf2-e17222676996 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:54.162883 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-126ee55f-d31f-460e-acf2-e17222676996 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:54.168416 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-126ee55f-d31f-460e-acf2-e17222676996 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:54.178008 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-126ee55f-d31f-460e-acf2-e17222676996 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:54.181711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-126ee55f-d31f-460e-acf2-e17222676996 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:54.274581 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-311d04e5-df60-4f54-89e3-5c7cadfc778e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:58:54.274581 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-311d04e5-df60-4f54-89e3-5c7cadfc778e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:58:54.274581 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-311d04e5-df60-4f54-89e3-5c7cadfc778e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:58:54.274581 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-311d04e5-df60-4f54-89e3-5c7cadfc778e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:58:54.274581 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-311d04e5-df60-4f54-89e3-5c7cadfc778e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:58:54.284650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-311d04e5-df60-4f54-89e3-5c7cadfc778e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:54.285562 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-311d04e5-df60-4f54-89e3-5c7cadfc778e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:54.286177 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-311d04e5-df60-4f54-89e3-5c7cadfc778e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:54.287107 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-311d04e5-df60-4f54-89e3-5c7cadfc778e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:54.287730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-311d04e5-df60-4f54-89e3-5c7cadfc778e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:54.288437 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-311d04e5-df60-4f54-89e3-5c7cadfc778e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:54.334555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-311d04e5-df60-4f54-89e3-5c7cadfc778e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Getting quotas for project 9b45a150f2db4c2bb4871cd1d1cab898. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:58:54.355039 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-311d04e5-df60-4f54-89e3-5c7cadfc778e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Getting quotas for user da76bbe04c22456f957be0675892359d and project 9b45a150f2db4c2bb4871cd1d1cab898. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:58:54.413739 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-311d04e5-df60-4f54-89e3-5c7cadfc778e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:58:54.416987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-311d04e5-df60-4f54-89e3-5c7cadfc778e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 526330e7-cd66-44c3-9453-ea80479469a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:58:54.582595 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-311d04e5-df60-4f54-89e3-5c7cadfc778e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.577868 Sep 17 20:58:54.597987 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 991/2059] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:58:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:58:54.618372 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a9ac41cf-3b71-449e-ba6a-8f982578e80a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:54.621350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a9ac41cf-3b71-449e-ba6a-8f982578e80a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 1170d308-122b-4c9e-abf1-5d206d3b75f1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:54.636908 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a9ac41cf-3b71-449e-ba6a-8f982578e80a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:54.637203 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a9ac41cf-3b71-449e-ba6a-8f982578e80a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:54.638009 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a9ac41cf-3b71-449e-ba6a-8f982578e80a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:54.641074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a9ac41cf-3b71-449e-ba6a-8f982578e80a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:54.641669 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a9ac41cf-3b71-449e-ba6a-8f982578e80a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:54.642811 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a9ac41cf-3b71-449e-ba6a-8f982578e80a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:54.723088 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-126ee55f-d31f-460e-acf2-e17222676996 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:54.739436 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-126ee55f-d31f-460e-acf2-e17222676996 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567" status: 200 len: 1319 microversion: 2.1 time: 0.667347 Sep 17 20:58:54.741597 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1069/2060] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:54 2022] GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567 => generated 1319 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:54.835806 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a9ac41cf-3b71-449e-ba6a-8f982578e80a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "POST /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1/action" status: 202 len: 0 microversion: 2.1 time: 0.235385 Sep 17 20:58:54.838116 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 992/2061] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:58:54 2022] POST /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:58:54.916605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3b731e8a-4910-4a61-b3c3-7aa5e6fd945b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:54.931612 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3b731e8a-4910-4a61-b3c3-7aa5e6fd945b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 1170d308-122b-4c9e-abf1-5d206d3b75f1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:54.970783 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3b731e8a-4910-4a61-b3c3-7aa5e6fd945b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:54.971328 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3b731e8a-4910-4a61-b3c3-7aa5e6fd945b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:54.971778 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3b731e8a-4910-4a61-b3c3-7aa5e6fd945b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:54.975279 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3b731e8a-4910-4a61-b3c3-7aa5e6fd945b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:54.975791 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3b731e8a-4910-4a61-b3c3-7aa5e6fd945b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:54.982043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3b731e8a-4910-4a61-b3c3-7aa5e6fd945b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:55.432021 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-85c72abd-762c-4021-b2e6-0f3607872179 tempest-QuotaClassesAdminTestJSON-1537203361 tempest-QuotaClassesAdminTestJSON-1537203361-project-admin] Calling method '.version_select at 0x7f25a9f8ef70>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:55.455711 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-85c72abd-762c-4021-b2e6-0f3607872179 tempest-QuotaClassesAdminTestJSON-1537203361 tempest-QuotaClassesAdminTestJSON-1537203361-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.712749 Sep 17 20:58:55.458099 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1070/2062] 10.222.0.26 () {58 vars in 1185 bytes} [Sat Sep 17 20:58:54 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:55.541177 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3b731e8a-4910-4a61-b3c3-7aa5e6fd945b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:55.560262 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3b731e8a-4910-4a61-b3c3-7aa5e6fd945b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1" status: 200 len: 1506 microversion: 2.1 time: 0.715202 Sep 17 20:58:55.591453 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 993/2063] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:54 2022] GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1 => generated 1506 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:55.605428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b706daa7-b53b-4896-a8a2-b5f786872dbf tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1407937513", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "451", "networks": [{"uuid": "3dee7466-4326-46ec-ae2d-96ee5b1e633d"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:55.761394 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-b706daa7-b53b-4896-a8a2-b5f786872dbf tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] validate_networks() for [('3dee7466-4326-46ec-ae2d-96ee5b1e633d', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:58:55.997625 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b997105f-6180-4e23-8f6f-9875f2d85611 tempest-ServerGroup264TestJSON-1077824913 tempest-ServerGroup264TestJSON-1077824913-project] Action: 'create', calling method: .version_select at 0x7f25a9f751f0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:56.080666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-b997105f-6180-4e23-8f6f-9875f2d85611 tempest-ServerGroup264TestJSON-1077824913 tempest-ServerGroup264TestJSON-1077824913-project] Getting quotas for project d957f65ae29b4829b478e118ed2f89d5. Resources: {'server_groups'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:58:56.085997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-b997105f-6180-4e23-8f6f-9875f2d85611 tempest-ServerGroup264TestJSON-1077824913 tempest-ServerGroup264TestJSON-1077824913-project] Getting quotas for user 87ee132f0e2f42f69b149570329b4855 and project d957f65ae29b4829b478e118ed2f89d5. Resources: {'server_groups'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:58:56.264337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-b997105f-6180-4e23-8f6f-9875f2d85611 tempest-ServerGroup264TestJSON-1077824913 tempest-ServerGroup264TestJSON-1077824913-project] Getting quotas for project d957f65ae29b4829b478e118ed2f89d5. Resources: {'server_groups'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:58:56.272215 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-b997105f-6180-4e23-8f6f-9875f2d85611 tempest-ServerGroup264TestJSON-1077824913 tempest-ServerGroup264TestJSON-1077824913-project] Getting quotas for user 87ee132f0e2f42f69b149570329b4855 and project d957f65ae29b4829b478e118ed2f89d5. Resources: {'server_groups'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:58:56.289022 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b997105f-6180-4e23-8f6f-9875f2d85611 tempest-ServerGroup264TestJSON-1077824913 tempest-ServerGroup264TestJSON-1077824913-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.820099 Sep 17 20:58:56.290287 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1071/2064] 10.222.0.26 () {62 vars in 1214 bytes} [Sat Sep 17 20:58:55 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:58:56.295995 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-adb295f9-ee9a-44a6-809f-03ee3679e7ae tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a9f75670>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:56.386399 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-adb295f9-ee9a-44a6-809f-03ee3679e7ae tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b" status: 200 len: 1439 microversion: 2.1 time: 0.094859 Sep 17 20:58:56.387657 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1072/2065] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:58:56 2022] GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b => generated 1439 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:56.392899 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f20aceac-c164-4cff-860b-21314d4c4813 tempest-QuotaClassesAdminTestJSON-1537203361 tempest-QuotaClassesAdminTestJSON-1537203361-project-admin] Action: 'update', calling method: .version_select at 0x7f25a9f75040>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:56.684412 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-b706daa7-b53b-4896-a8a2-b5f786872dbf tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:58:56.688750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-b706daa7-b53b-4896-a8a2-b5f786872dbf tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:58:56.688750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-b706daa7-b53b-4896-a8a2-b5f786872dbf tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:58:56.688750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-b706daa7-b53b-4896-a8a2-b5f786872dbf tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:58:56.688750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-b706daa7-b53b-4896-a8a2-b5f786872dbf tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:58:56.703078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b706daa7-b53b-4896-a8a2-b5f786872dbf tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:56.703813 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b706daa7-b53b-4896-a8a2-b5f786872dbf tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:56.704467 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b706daa7-b53b-4896-a8a2-b5f786872dbf tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:56.705501 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b706daa7-b53b-4896-a8a2-b5f786872dbf tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:56.706489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b706daa7-b53b-4896-a8a2-b5f786872dbf tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:56.707146 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b706daa7-b53b-4896-a8a2-b5f786872dbf tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:56.750056 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:58:56.755939 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-b706daa7-b53b-4896-a8a2-b5f786872dbf tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Getting quotas for project 9b45a150f2db4c2bb4871cd1d1cab898. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:58:56.770690 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-b706daa7-b53b-4896-a8a2-b5f786872dbf tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Getting quotas for user da76bbe04c22456f957be0675892359d and project 9b45a150f2db4c2bb4871cd1d1cab898. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:58:56.839910 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b706daa7-b53b-4896-a8a2-b5f786872dbf tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:58:56.845273 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b706daa7-b53b-4896-a8a2-b5f786872dbf tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 563a230c-e153-4283-9d88-9e853f63574a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:58:56.955357 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f20aceac-c164-4cff-860b-21314d4c4813 tempest-QuotaClassesAdminTestJSON-1537203361 tempest-QuotaClassesAdminTestJSON-1537203361-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.566287 Sep 17 20:58:56.958415 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1073/2066] 10.222.0.26 () {60 vars in 1206 bytes} [Sat Sep 17 20:58:56 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:56.973794 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-709d1ae2-46e9-40a4-8b7b-348548a7c1ae tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:56.975433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-709d1ae2-46e9-40a4-8b7b-348548a7c1ae tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 7b07abb3-f10d-4b65-9a52-28bb33b47567] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:56.990629 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b706daa7-b53b-4896-a8a2-b5f786872dbf tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.397869 Sep 17 20:58:56.996920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-709d1ae2-46e9-40a4-8b7b-348548a7c1ae tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:56.996920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-709d1ae2-46e9-40a4-8b7b-348548a7c1ae tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:56.996920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-709d1ae2-46e9-40a4-8b7b-348548a7c1ae tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:56.997231 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 994/2067] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:58:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1402 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:58:56.999371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-125cc7b0-a758-4aa5-bf97-1935be1d5f39 tempest-ServerGroup264TestJSON-1077824913 tempest-ServerGroup264TestJSON-1077824913-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:57.001496 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-709d1ae2-46e9-40a4-8b7b-348548a7c1ae tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:57.002363 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-709d1ae2-46e9-40a4-8b7b-348548a7c1ae tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:57.002836 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-709d1ae2-46e9-40a4-8b7b-348548a7c1ae tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:57.043737 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-125cc7b0-a758-4aa5-bf97-1935be1d5f39 tempest-ServerGroup264TestJSON-1077824913 tempest-ServerGroup264TestJSON-1077824913-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.047585 Sep 17 20:58:57.045309 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 995/2068] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Sep 17 20:58:56 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:58:57.053016 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ee6ff8a6-228d-4097-960f-f3f292ec3b4c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:57.059631 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ee6ff8a6-228d-4097-960f-f3f292ec3b4c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 1170d308-122b-4c9e-abf1-5d206d3b75f1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:57.071286 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee6ff8a6-228d-4097-960f-f3f292ec3b4c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:57.071809 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee6ff8a6-228d-4097-960f-f3f292ec3b4c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:57.072265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee6ff8a6-228d-4097-960f-f3f292ec3b4c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:57.072990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee6ff8a6-228d-4097-960f-f3f292ec3b4c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:57.086422 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee6ff8a6-228d-4097-960f-f3f292ec3b4c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:57.087238 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee6ff8a6-228d-4097-960f-f3f292ec3b4c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:57.385360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-709d1ae2-46e9-40a4-8b7b-348548a7c1ae tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:57.398605 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-709d1ae2-46e9-40a4-8b7b-348548a7c1ae tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567" status: 200 len: 1319 microversion: 2.1 time: 0.438417 Sep 17 20:58:57.401774 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1074/2069] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:56 2022] GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567 => generated 1319 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:57.431910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ff26260c-313b-4f5b-8552-558c54f3e9a7 tempest-QuotaClassesAdminTestJSON-1537203361 tempest-QuotaClassesAdminTestJSON-1537203361-project-admin] Calling method '.version_select at 0x7f25a9f30550>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:57.483063 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ff26260c-313b-4f5b-8552-558c54f3e9a7 tempest-QuotaClassesAdminTestJSON-1537203361 tempest-QuotaClassesAdminTestJSON-1537203361-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.076120 Sep 17 20:58:57.487016 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1075/2070] 10.222.0.26 () {58 vars in 1185 bytes} [Sat Sep 17 20:58:57 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:57.504328 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-117c690e-fc73-4af7-b7ce-f3bd2388662b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:57.506409 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-117c690e-fc73-4af7-b7ce-f3bd2388662b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 563a230c-e153-4283-9d88-9e853f63574a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:57.734215 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-117c690e-fc73-4af7-b7ce-f3bd2388662b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:57.751224 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ee6ff8a6-228d-4097-960f-f3f292ec3b4c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:57.753004 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-117c690e-fc73-4af7-b7ce-f3bd2388662b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a" status: 200 len: 1221 microversion: 2.1 time: 0.262637 Sep 17 20:58:57.753786 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1076/2071] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:57 2022] GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a => generated 1221 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:57.771730 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5834c4d3-0f20-407c-ae08-8aa7ed4b052b tempest-ServerGroup264TestJSON-1077824913 tempest-ServerGroup264TestJSON-1077824913-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:57.772155 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ee6ff8a6-228d-4097-960f-f3f292ec3b4c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1" status: 200 len: 1486 microversion: 2.1 time: 0.720860 Sep 17 20:58:57.786501 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 996/2072] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:57 2022] GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1 => generated 1486 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:57.806076 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a3db2133-152e-4efd-ae84-9cbff951e92c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4cd3af0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:57.827579 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5834c4d3-0f20-407c-ae08-8aa7ed4b052b tempest-ServerGroup264TestJSON-1077824913 tempest-ServerGroup264TestJSON-1077824913-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups/fcca1451-578d-4bb1-950d-364cb087f563" status: 200 len: 235 microversion: 2.64 time: 0.071815 Sep 17 20:58:57.829666 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1077/2073] 10.222.0.26 () {60 vars in 1304 bytes} [Sat Sep 17 20:58:57 2022] GET /compute/v2.1/os-server-groups/fcca1451-578d-4bb1-950d-364cb087f563 => generated 235 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 20:58:57.848002 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9b71c185-08bd-46ca-8b21-dc48e8b25937 tempest-QuotaClassesAdminTestJSON-1537203361 tempest-QuotaClassesAdminTestJSON-1537203361-project-admin] Action: 'update', calling method: .version_select at 0x7f25a4d6fca0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:57.869078 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a3db2133-152e-4efd-ae84-9cbff951e92c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b" status: 200 len: 1448 microversion: 2.1 time: 0.080936 Sep 17 20:58:57.872927 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 997/2074] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:58:57 2022] GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b => generated 1448 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:57.884545 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-a52acd2d-d77c-4ada-a961-0a857288a97f req-54850676-c4c3-4844-867f-f493ba25695d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e16ee697-bc81-4c87-a419-9485374a111a", "name": "network-vif-plugged", "status": "completed", "tag": "9a3df8b6-f94c-4f97-8b6f-ec09d9194b52"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:58:57.920409 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-a52acd2d-d77c-4ada-a961-0a857288a97f req-54850676-c4c3-4844-867f-f493ba25695d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:57.922052 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-a52acd2d-d77c-4ada-a961-0a857288a97f req-54850676-c4c3-4844-867f-f493ba25695d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:57.923366 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-a52acd2d-d77c-4ada-a961-0a857288a97f req-54850676-c4c3-4844-867f-f493ba25695d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:57.936029 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:INSERT=12,nova_api:SELECT=73,nova_api:UPDATE=15 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:58:57.958567 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-a52acd2d-d77c-4ada-a961-0a857288a97f req-54850676-c4c3-4844-867f-f493ba25695d service nova] Creating event network-vif-plugged:9a3df8b6-f94c-4f97-8b6f-ec09d9194b52 for instance e16ee697-bc81-4c87-a419-9485374a111a on nch2-master-1 Sep 17 20:58:57.972116 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-a52acd2d-d77c-4ada-a961-0a857288a97f req-54850676-c4c3-4844-867f-f493ba25695d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096025 Sep 17 20:58:57.975019 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 998/2075] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:57.990292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-17209e33-6211-48ee-943c-231f33f07c3c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:57.995130 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-17209e33-6211-48ee-943c-231f33f07c3c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 1170d308-122b-4c9e-abf1-5d206d3b75f1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:58.021040 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17209e33-6211-48ee-943c-231f33f07c3c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:58.021627 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17209e33-6211-48ee-943c-231f33f07c3c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:58.025334 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17209e33-6211-48ee-943c-231f33f07c3c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:58.029601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17209e33-6211-48ee-943c-231f33f07c3c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:58.030825 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17209e33-6211-48ee-943c-231f33f07c3c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:58.032958 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17209e33-6211-48ee-943c-231f33f07c3c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:58.084372 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-17209e33-6211-48ee-943c-231f33f07c3c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 1170d308-122b-4c9e-abf1-5d206d3b75f1] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:58:58.155107 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9b71c185-08bd-46ca-8b21-dc48e8b25937 tempest-QuotaClassesAdminTestJSON-1537203361 tempest-QuotaClassesAdminTestJSON-1537203361-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.316831 Sep 17 20:58:58.155779 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1078/2076] 10.222.0.26 () {60 vars in 1206 bytes} [Sat Sep 17 20:58:57 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:58:58.169335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a1cfa8a6-d685-4031-b0e1-8edc51ab0868 tempest-ServerGroup264TestJSON-1077824913 tempest-ServerGroup264TestJSON-1077824913-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:58.176890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:58:58.267600 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a1cfa8a6-d685-4031-b0e1-8edc51ab0868 tempest-ServerGroup264TestJSON-1077824913 tempest-ServerGroup264TestJSON-1077824913-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/fcca1451-578d-4bb1-950d-364cb087f563" status: 204 len: 0 microversion: 2.64 time: 0.110098 Sep 17 20:58:58.274367 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1079/2077] 10.222.0.26 () {60 vars in 1307 bytes} [Sat Sep 17 20:58:58 2022] DELETE /compute/v2.1/os-server-groups/fcca1451-578d-4bb1-950d-364cb087f563 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 20:58:58.288485 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d5491cbd-ebcd-4c5e-8651-47589a838595 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a9ef85e0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:58.298118 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-17209e33-6211-48ee-943c-231f33f07c3c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1" status: 204 len: 0 microversion: 2.1 time: 0.320129 Sep 17 20:58:58.298420 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 999/2078] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:58:57 2022] DELETE /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:58:58.309532 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-94136da0-c170-4e4e-bfdc-c548120eb852 tempest-ServerGroup264TestJSON-1077824913 tempest-ServerGroup264TestJSON-1077824913-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:58.322577 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-94136da0-c170-4e4e-bfdc-c548120eb852 tempest-ServerGroup264TestJSON-1077824913 tempest-ServerGroup264TestJSON-1077824913-project] HTTP exception thrown: Instance group fcca1451-578d-4bb1-950d-364cb087f563 could not be found. Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-94136da0-c170-4e4e-bfdc-c548120eb852 tempest-ServerGroup264TestJSON-1077824913 tempest-ServerGroup264TestJSON-1077824913-project] Request method failure captured: Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/os-server-groups/fcca1451-578d-4bb1-950d-364cb087f563 HTTP/1.1 Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjUOTZFhi-LJfmP4Y8wVx-JDAf3VXJVKOO8hSgq785B6W5-3mOttCvYvXsGFWlvtISfkEoooEcW71xoiJvNVXc4ClyIId7eYmLqY2CvlLaRh7xv_D2wczABfL4Xe-EkMNbNlFxpoEdHQ-kt6EG8Jkrztw0xID9QkIEzBx1INu4s11E0 Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: X-Openstack-Nova-Api-Version: 2.64 Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: d957f65ae29b4829b478e118ed2f89d5 Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerGroup264TestJSON-1077824913 Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d957f65ae29b4829b478e118ed2f89d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d957f65ae29b4829b478e118ed2f89d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d957f65ae29b4829b478e118ed2f89d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d957f65ae29b4829b478e118ed2f89d5", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerGroup264TestJSON-1077824913 Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: d957f65ae29b4829b478e118ed2f89d5 Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1077824913 Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerGroup264TestJSON-1077824913-project Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 87ee132f0e2f42f69b149570329b4855 Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerGroup264TestJSON-1077824913-project Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance group fcca1451-578d-4bb1-950d-364cb087f563 could not be found. Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'fcca1451-578d-4bb1-950d-364cb087f563'} Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group fcca1451-578d-4bb1-950d-364cb087f563 could not be found. Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group fcca1451-578d-4bb1-950d-364cb087f563 could not be found. Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:58.328823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:58:58.338721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:58:58.338721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:58:58.338721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:58:58.338721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:58:58.338721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group fcca1451-578d-4bb1-950d-364cb087f563 could not be found. Sep 17 20:58:58.338721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:58:58.338721 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-94136da0-c170-4e4e-bfdc-c548120eb852 tempest-ServerGroup264TestJSON-1077824913 tempest-ServerGroup264TestJSON-1077824913-project] Returning 404 to user: Instance group fcca1451-578d-4bb1-950d-364cb087f563 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:58:58.338721 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-94136da0-c170-4e4e-bfdc-c548120eb852 tempest-ServerGroup264TestJSON-1077824913 tempest-ServerGroup264TestJSON-1077824913-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/fcca1451-578d-4bb1-950d-364cb087f563" status: 404 len: 117 microversion: 2.64 time: 0.030152 Sep 17 20:58:58.338721 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1000/2079] 10.222.0.26 () {60 vars in 1307 bytes} [Sat Sep 17 20:58:58 2022] DELETE /compute/v2.1/os-server-groups/fcca1451-578d-4bb1-950d-364cb087f563 => generated 117 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 17 20:58:58.343528 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-50ffb508-ebef-4801-aa13-5287cf1b5be1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:58.347870 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-50ffb508-ebef-4801-aa13-5287cf1b5be1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 1170d308-122b-4c9e-abf1-5d206d3b75f1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:58.374829 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-50ffb508-ebef-4801-aa13-5287cf1b5be1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:58.375350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-50ffb508-ebef-4801-aa13-5287cf1b5be1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:58.375806 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-50ffb508-ebef-4801-aa13-5287cf1b5be1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:58.379274 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-50ffb508-ebef-4801-aa13-5287cf1b5be1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:58.379762 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-50ffb508-ebef-4801-aa13-5287cf1b5be1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:58.380201 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-50ffb508-ebef-4801-aa13-5287cf1b5be1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:58.412471 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d5491cbd-ebcd-4c5e-8651-47589a838595 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b" status: 200 len: 1448 microversion: 2.1 time: 0.133299 Sep 17 20:58:58.413722 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1080/2080] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:58:58 2022] GET /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b => generated 1448 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:58.434572 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-96a20f21-8d44-4890-a393-c3ab5b827942 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:58.435731 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-96a20f21-8d44-4890-a393-c3ab5b827942 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 7b07abb3-f10d-4b65-9a52-28bb33b47567] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:58.461628 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-96a20f21-8d44-4890-a393-c3ab5b827942 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:58.462161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-96a20f21-8d44-4890-a393-c3ab5b827942 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:58.462617 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-96a20f21-8d44-4890-a393-c3ab5b827942 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:58.463338 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-96a20f21-8d44-4890-a393-c3ab5b827942 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:58.468682 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-96a20f21-8d44-4890-a393-c3ab5b827942 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:58.471794 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-96a20f21-8d44-4890-a393-c3ab5b827942 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:59.521672 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-50ffb508-ebef-4801-aa13-5287cf1b5be1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:59.538392 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-50ffb508-ebef-4801-aa13-5287cf1b5be1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1" status: 200 len: 1492 microversion: 2.1 time: 1.201615 Sep 17 20:58:59.539841 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1001/2081] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:58 2022] GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1 => generated 1492 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:59.551089 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-78f6f253-b677-468f-aa48-724659f04edb tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4ca6820>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:59.643754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-96a20f21-8d44-4890-a393-c3ab5b827942 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:59.653998 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-96a20f21-8d44-4890-a393-c3ab5b827942 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567" status: 200 len: 1319 microversion: 2.1 time: 1.232870 Sep 17 20:58:59.679843 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1081/2082] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:58 2022] GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567 => generated 1319 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:58:59.685176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-14db5743-f2de-4fbe-8ba5-ca4bdc9ca56d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:58:59.685833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-14db5743-f2de-4fbe-8ba5-ca4bdc9ca56d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 563a230c-e153-4283-9d88-9e853f63574a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:58:59.699430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14db5743-f2de-4fbe-8ba5-ca4bdc9ca56d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:59.700114 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14db5743-f2de-4fbe-8ba5-ca4bdc9ca56d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:59.700757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14db5743-f2de-4fbe-8ba5-ca4bdc9ca56d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:59.701696 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14db5743-f2de-4fbe-8ba5-ca4bdc9ca56d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:58:59.702524 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14db5743-f2de-4fbe-8ba5-ca4bdc9ca56d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:58:59.703399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14db5743-f2de-4fbe-8ba5-ca4bdc9ca56d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:58:59.836775 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-14db5743-f2de-4fbe-8ba5-ca4bdc9ca56d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:58:59.849403 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-14db5743-f2de-4fbe-8ba5-ca4bdc9ca56d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a" status: 200 len: 1273 microversion: 2.1 time: 0.168137 Sep 17 20:58:59.855173 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1082/2083] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:59 2022] GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a => generated 1273 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:00.152634 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1604fda3-2982-435b-b76e-3644a7b2ab0f tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:00.156898 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1604fda3-2982-435b-b76e-3644a7b2ab0f tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:00.158286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1604fda3-2982-435b-b76e-3644a7b2ab0f tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:00.158912 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1604fda3-2982-435b-b76e-3644a7b2ab0f tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:00.160629 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1604fda3-2982-435b-b76e-3644a7b2ab0f tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:00.161364 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1604fda3-2982-435b-b76e-3644a7b2ab0f tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:00.162030 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1604fda3-2982-435b-b76e-3644a7b2ab0f tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:00.208575 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1604fda3-2982-435b-b76e-3644a7b2ab0f tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.352170 Sep 17 20:59:00.209833 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1083/2084] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Sep 17 20:58:59 2022] GET /compute/v2.1/os-services => generated 947 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:00.216734 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-3d11d91d-14b5-4ee4-bce1-8626286bc242 req-c9e936c6-695c-4f00-a2a2-3a590ebfd681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b07abb3-f10d-4b65-9a52-28bb33b47567", "name": "network-vif-plugged", "status": "completed", "tag": "dc17c9e2-7720-4027-baf7-177d28086374"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:00.270435 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-3d11d91d-14b5-4ee4-bce1-8626286bc242 req-c9e936c6-695c-4f00-a2a2-3a590ebfd681 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:00.271317 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-3d11d91d-14b5-4ee4-bce1-8626286bc242 req-c9e936c6-695c-4f00-a2a2-3a590ebfd681 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:00.273044 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-3d11d91d-14b5-4ee4-bce1-8626286bc242 req-c9e936c6-695c-4f00-a2a2-3a590ebfd681 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:00.315298 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-3d11d91d-14b5-4ee4-bce1-8626286bc242 req-c9e936c6-695c-4f00-a2a2-3a590ebfd681 service nova] Creating event network-vif-plugged:dc17c9e2-7720-4027-baf7-177d28086374 for instance 7b07abb3-f10d-4b65-9a52-28bb33b47567 on nch1-master-1 Sep 17 20:59:00.335423 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-3d11d91d-14b5-4ee4-bce1-8626286bc242 req-c9e936c6-695c-4f00-a2a2-3a590ebfd681 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123778 Sep 17 20:59:00.341199 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1084/2085] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:00.365154 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-80d9e65a-b877-4b9d-ad45-f9c680eb95a5 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:00.369712 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-80d9e65a-b877-4b9d-ad45-f9c680eb95a5 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:00.383011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-80d9e65a-b877-4b9d-ad45-f9c680eb95a5 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:00.383859 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-80d9e65a-b877-4b9d-ad45-f9c680eb95a5 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:00.384938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-80d9e65a-b877-4b9d-ad45-f9c680eb95a5 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:00.393694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-80d9e65a-b877-4b9d-ad45-f9c680eb95a5 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:00.401198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-80d9e65a-b877-4b9d-ad45-f9c680eb95a5 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:00.460568 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-80d9e65a-b877-4b9d-ad45-f9c680eb95a5 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.116177 Sep 17 20:59:00.465505 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1085/2086] 10.222.0.26 () {58 vars in 1170 bytes} [Sat Sep 17 20:59:00 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:00.487260 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9c89ea79-1c0a-462f-90b9-ce87289fe9a0 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:00.493120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9c89ea79-1c0a-462f-90b9-ce87289fe9a0 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:00.494636 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9c89ea79-1c0a-462f-90b9-ce87289fe9a0 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:00.498535 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9c89ea79-1c0a-462f-90b9-ce87289fe9a0 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:00.501307 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9c89ea79-1c0a-462f-90b9-ce87289fe9a0 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:00.505130 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9c89ea79-1c0a-462f-90b9-ce87289fe9a0 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:00.506371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9c89ea79-1c0a-462f-90b9-ce87289fe9a0 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:00.593284 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9c89ea79-1c0a-462f-90b9-ce87289fe9a0 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.111382 Sep 17 20:59:00.594525 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1086/2087] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Sep 17 20:59:00 2022] GET /compute/v2.1/os-services => generated 947 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:00.600628 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-09b8e923-a347-495f-8348-20221dd4143c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:00.605839 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-09b8e923-a347-495f-8348-20221dd4143c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 1170d308-122b-4c9e-abf1-5d206d3b75f1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:00.617310 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09b8e923-a347-495f-8348-20221dd4143c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:00.618170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09b8e923-a347-495f-8348-20221dd4143c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:00.618798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09b8e923-a347-495f-8348-20221dd4143c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:00.619714 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09b8e923-a347-495f-8348-20221dd4143c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:00.620573 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09b8e923-a347-495f-8348-20221dd4143c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:00.621184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09b8e923-a347-495f-8348-20221dd4143c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:00.764707 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-78f6f253-b677-468f-aa48-724659f04edb tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "DELETE /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b" status: 204 len: 0 microversion: 2.1 time: 1.222738 Sep 17 20:59:00.765983 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1002/2088] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:58:59 2022] DELETE /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b => generated 0 bytes in 1225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:59:00.771311 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-74618f82-e200-46af-8447-92d068c1c5c5 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:00.776708 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74618f82-e200-46af-8447-92d068c1c5c5 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:00.777522 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74618f82-e200-46af-8447-92d068c1c5c5 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:00.778308 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74618f82-e200-46af-8447-92d068c1c5c5 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:00.779731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74618f82-e200-46af-8447-92d068c1c5c5 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:00.780411 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74618f82-e200-46af-8447-92d068c1c5c5 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:00.781052 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74618f82-e200-46af-8447-92d068c1c5c5 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:00.813671 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-74618f82-e200-46af-8447-92d068c1c5c5 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.046057 Sep 17 20:59:00.815094 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1003/2089] 10.222.0.26 () {58 vars in 1196 bytes} [Sat Sep 17 20:59:00 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:59:00.822853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9bd71525-5a24-4dd4-989a-337f755a7dfb tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:00.823852 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9bd71525-5a24-4dd4-989a-337f755a7dfb tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 7b07abb3-f10d-4b65-9a52-28bb33b47567] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:00.831720 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9bd71525-5a24-4dd4-989a-337f755a7dfb tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:00.832659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9bd71525-5a24-4dd4-989a-337f755a7dfb tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:00.833351 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9bd71525-5a24-4dd4-989a-337f755a7dfb tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:00.834318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9bd71525-5a24-4dd4-989a-337f755a7dfb tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:00.834979 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9bd71525-5a24-4dd4-989a-337f755a7dfb tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:00.835621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9bd71525-5a24-4dd4-989a-337f755a7dfb tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:01.053563 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-09b8e923-a347-495f-8348-20221dd4143c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:01.061983 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-09b8e923-a347-495f-8348-20221dd4143c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1" status: 200 len: 1492 microversion: 2.1 time: 0.466121 Sep 17 20:59:01.074039 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1087/2090] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:00 2022] GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1 => generated 1492 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:01.085178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6e8a6145-89c7-4ae5-a1dc-bee6ec0706bb tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:01.085714 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6e8a6145-89c7-4ae5-a1dc-bee6ec0706bb tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: bf08d895-d8f9-440d-8ade-fbc47dc6bde4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:01.092966 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6e8a6145-89c7-4ae5-a1dc-bee6ec0706bb tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:01.093698 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6e8a6145-89c7-4ae5-a1dc-bee6ec0706bb tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:01.094296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6e8a6145-89c7-4ae5-a1dc-bee6ec0706bb tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:01.095167 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6e8a6145-89c7-4ae5-a1dc-bee6ec0706bb tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:01.095760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6e8a6145-89c7-4ae5-a1dc-bee6ec0706bb tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:01.096324 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6e8a6145-89c7-4ae5-a1dc-bee6ec0706bb tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:01.127739 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6e8a6145-89c7-4ae5-a1dc-bee6ec0706bb tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: bf08d895-d8f9-440d-8ade-fbc47dc6bde4] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:59:01.213233 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9bd71525-5a24-4dd4-989a-337f755a7dfb tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:01.223867 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9bd71525-5a24-4dd4-989a-337f755a7dfb tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567" status: 200 len: 1319 microversion: 2.1 time: 0.407373 Sep 17 20:59:01.224641 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1004/2091] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:00 2022] GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567 => generated 1319 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:01.233031 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8bffa244-e44e-4776-950f-5748c4a48da5 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:01.237428 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6e8a6145-89c7-4ae5-a1dc-bee6ec0706bb tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4" status: 204 len: 0 microversion: 2.1 time: 0.161647 Sep 17 20:59:01.241756 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1088/2092] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:59:01 2022] DELETE /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:59:01.249316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-990caa42-be4f-4ddc-9bd0-141137b7ff0d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:01.254000 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-990caa42-be4f-4ddc-9bd0-141137b7ff0d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 563a230c-e153-4283-9d88-9e853f63574a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:01.262876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8bffa244-e44e-4776-950f-5748c4a48da5 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:01.266857 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8bffa244-e44e-4776-950f-5748c4a48da5 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:01.268179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8bffa244-e44e-4776-950f-5748c4a48da5 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:01.269257 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8bffa244-e44e-4776-950f-5748c4a48da5 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:01.269986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8bffa244-e44e-4776-950f-5748c4a48da5 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:01.270622 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8bffa244-e44e-4776-950f-5748c4a48da5 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:01.291997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-990caa42-be4f-4ddc-9bd0-141137b7ff0d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:01.292936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-990caa42-be4f-4ddc-9bd0-141137b7ff0d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:01.293605 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-990caa42-be4f-4ddc-9bd0-141137b7ff0d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:01.296003 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-990caa42-be4f-4ddc-9bd0-141137b7ff0d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:01.296942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-990caa42-be4f-4ddc-9bd0-141137b7ff0d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:01.297620 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-990caa42-be4f-4ddc-9bd0-141137b7ff0d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:01.338394 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8bffa244-e44e-4776-950f-5748c4a48da5 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.111333 Sep 17 20:59:01.339407 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1005/2093] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Sep 17 20:59:01 2022] GET /compute/v2.1/os-services => generated 947 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:01.345415 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-cda64268-751a-4c78-81df-13da9c51152e req-2844838c-49a3-4afb-9925-8d36d8691087 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5", "tag": "b672db1d-cb3f-4522-94a2-b7c9c48b98d9"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:01.358555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-cda64268-751a-4c78-81df-13da9c51152e req-2844838c-49a3-4afb-9925-8d36d8691087 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:01.359518 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-cda64268-751a-4c78-81df-13da9c51152e req-2844838c-49a3-4afb-9925-8d36d8691087 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:01.360145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-cda64268-751a-4c78-81df-13da9c51152e req-2844838c-49a3-4afb-9925-8d36d8691087 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:01.376738 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-cda64268-751a-4c78-81df-13da9c51152e req-2844838c-49a3-4afb-9925-8d36d8691087 service nova] Creating event network-changed:b672db1d-cb3f-4522-94a2-b7c9c48b98d9 for instance caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 on nch1-master-1 Sep 17 20:59:01.384121 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-cda64268-751a-4c78-81df-13da9c51152e req-2844838c-49a3-4afb-9925-8d36d8691087 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042317 Sep 17 20:59:01.385664 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1006/2094] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:01.392570 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-06d8f148-b60d-4004-bff4-52bbb76b9a87 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:01.398789 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06d8f148-b60d-4004-bff4-52bbb76b9a87 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:01.399325 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06d8f148-b60d-4004-bff4-52bbb76b9a87 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:01.399894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06d8f148-b60d-4004-bff4-52bbb76b9a87 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:01.401388 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06d8f148-b60d-4004-bff4-52bbb76b9a87 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:01.402248 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06d8f148-b60d-4004-bff4-52bbb76b9a87 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:01.403351 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06d8f148-b60d-4004-bff4-52bbb76b9a87 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:01.442179 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-990caa42-be4f-4ddc-9bd0-141137b7ff0d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:01.443595 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-06d8f148-b60d-4004-bff4-52bbb76b9a87 tempest-ServicesAdminNegativeTestJSON-1999979310 tempest-ServicesAdminNegativeTestJSON-1999979310-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.056397 Sep 17 20:59:01.445024 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1007/2095] 10.222.0.26 () {58 vars in 1198 bytes} [Sat Sep 17 20:59:01 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 20:59:01.455883 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-990caa42-be4f-4ddc-9bd0-141137b7ff0d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a" status: 200 len: 1279 microversion: 2.1 time: 0.215900 Sep 17 20:59:01.463207 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1089/2096] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:01 2022] GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a => generated 1279 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:01.501094 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-02fe23f8-45c0-4d20-9b7a-12cbece1640e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1457387358", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "abd24085-3207-4975-a2e8-9c99f58fa2c7"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:01.591855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-02fe23f8-45c0-4d20-9b7a-12cbece1640e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] validate_networks() for [('abd24085-3207-4975-a2e8-9c99f58fa2c7', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:59:01.646959 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4dc2fd4b-09e5-4faf-9db3-8ac0913ac53c tempest-ServicesAdminNegativeTestJSON-1967785438 tempest-ServicesAdminNegativeTestJSON-1967785438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:01.655356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4dc2fd4b-09e5-4faf-9db3-8ac0913ac53c tempest-ServicesAdminNegativeTestJSON-1967785438 tempest-ServicesAdminNegativeTestJSON-1967785438-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'dd724397e60b45fba695b208f1d50506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e56ac292d5b4ca4b33eb14177bae033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4dc2fd4b-09e5-4faf-9db3-8ac0913ac53c tempest-ServicesAdminNegativeTestJSON-1967785438 tempest-ServicesAdminNegativeTestJSON-1967785438-project] Request method failure captured: Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjUSIBoBvcQorTRS99wWiWvtrZzSBAm4cFSWHnvqRU82nVv48CFDCnO_rSqMpmk5TL3k0d93pAlln1eerLgYAP71UmV0o8BtkUH_imfPd9ExVst_3UPrUGYmYidCKe1S7ZDDv3SDBVOtiax3-a4Hgs6iUKmqhLJcCG6T11qiJvW0qiU Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 0e56ac292d5b4ca4b33eb14177bae033 Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1967785438 Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0e56ac292d5b4ca4b33eb14177bae033"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0e56ac292d5b4ca4b33eb14177bae033"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0e56ac292d5b4ca4b33eb14177bae033"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0e56ac292d5b4ca4b33eb14177bae033", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1967785438 Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 0e56ac292d5b4ca4b33eb14177bae033 Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1967785438 Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServicesAdminNegativeTestJSON-1967785438-project Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: dd724397e60b45fba695b208f1d50506 Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1967785438-project Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: action_args: {} Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 17 20:59:01.658877 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:01.662975 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:01.662975 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:01.662975 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:01.662975 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:01.662975 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:01.662975 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 17 20:59:01.662975 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 17 20:59:01.662975 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 17 20:59:01.662975 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:01.662975 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4dc2fd4b-09e5-4faf-9db3-8ac0913ac53c tempest-ServicesAdminNegativeTestJSON-1967785438 tempest-ServicesAdminNegativeTestJSON-1967785438-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:59:01.662975 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4dc2fd4b-09e5-4faf-9db3-8ac0913ac53c tempest-ServicesAdminNegativeTestJSON-1967785438 tempest-ServicesAdminNegativeTestJSON-1967785438-project] 10.222.0.26 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.203185 Sep 17 20:59:01.662975 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1008/2097] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Sep 17 20:59:01 2022] GET /compute/v2.1/os-services => generated 112 bytes in 204 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:59:02.096350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-aa1aa4ac-5a2e-4763-9893-a5da5c7af148 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:02.098200 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-aa1aa4ac-5a2e-4763-9893-a5da5c7af148 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 1170d308-122b-4c9e-abf1-5d206d3b75f1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:02.118612 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa1aa4ac-5a2e-4763-9893-a5da5c7af148 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:02.123750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa1aa4ac-5a2e-4763-9893-a5da5c7af148 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:02.124546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa1aa4ac-5a2e-4763-9893-a5da5c7af148 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:02.126187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa1aa4ac-5a2e-4763-9893-a5da5c7af148 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:02.128551 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa1aa4ac-5a2e-4763-9893-a5da5c7af148 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:02.129190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa1aa4ac-5a2e-4763-9893-a5da5c7af148 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:02.312069 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-aa1aa4ac-5a2e-4763-9893-a5da5c7af148 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:02.334189 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-aa1aa4ac-5a2e-4763-9893-a5da5c7af148 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1" status: 200 len: 1450 microversion: 2.1 time: 0.241109 Sep 17 20:59:02.363803 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1009/2098] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:02 2022] GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1 => generated 1450 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:02.375961 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-332c9bae-44c6-4e96-b303-a125faf2cb3a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:02.378306 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-332c9bae-44c6-4e96-b303-a125faf2cb3a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 7b07abb3-f10d-4b65-9a52-28bb33b47567] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:02.391171 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-332c9bae-44c6-4e96-b303-a125faf2cb3a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:02.391885 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-332c9bae-44c6-4e96-b303-a125faf2cb3a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:02.392777 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-332c9bae-44c6-4e96-b303-a125faf2cb3a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:02.393890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-332c9bae-44c6-4e96-b303-a125faf2cb3a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:02.394535 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-332c9bae-44c6-4e96-b303-a125faf2cb3a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:02.395652 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-332c9bae-44c6-4e96-b303-a125faf2cb3a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:02.495369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-02fe23f8-45c0-4d20-9b7a-12cbece1640e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:59:02.495876 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-02fe23f8-45c0-4d20-9b7a-12cbece1640e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:59:02.496350 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-02fe23f8-45c0-4d20-9b7a-12cbece1640e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:59:02.496777 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-02fe23f8-45c0-4d20-9b7a-12cbece1640e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:59:02.497203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-02fe23f8-45c0-4d20-9b7a-12cbece1640e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:59:02.517627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02fe23f8-45c0-4d20-9b7a-12cbece1640e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:02.518471 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02fe23f8-45c0-4d20-9b7a-12cbece1640e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:02.519132 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02fe23f8-45c0-4d20-9b7a-12cbece1640e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:02.520479 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02fe23f8-45c0-4d20-9b7a-12cbece1640e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:02.521217 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02fe23f8-45c0-4d20-9b7a-12cbece1640e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:02.522148 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02fe23f8-45c0-4d20-9b7a-12cbece1640e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:02.545092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-02fe23f8-45c0-4d20-9b7a-12cbece1640e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Getting quotas for project 2a4117ca05454573bbd93fbca50431d2. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:59:02.553094 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-02fe23f8-45c0-4d20-9b7a-12cbece1640e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Getting quotas for user 6e33e0b756e14af28a90cc5c76d346e6 and project 2a4117ca05454573bbd93fbca50431d2. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:59:02.568632 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-02fe23f8-45c0-4d20-9b7a-12cbece1640e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:59:02.571671 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-02fe23f8-45c0-4d20-9b7a-12cbece1640e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: ed5493ed-b5ec-49fe-994f-1a4da1e61618] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:59:02.641725 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-02fe23f8-45c0-4d20-9b7a-12cbece1640e tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.146598 Sep 17 20:59:02.642572 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1090/2099] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:59:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 17 20:59:02.649669 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-aba02c1e-7a95-4cd1-a626-41623d549044 req-84a7f437-fb61-4b86-ab27-869bb8d7e1bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf08d895-d8f9-440d-8ade-fbc47dc6bde4", "name": "network-vif-unplugged", "status": "completed", "tag": "e796f543-c137-42fa-b391-2f975c3df0e1"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:02.660437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-aba02c1e-7a95-4cd1-a626-41623d549044 req-84a7f437-fb61-4b86-ab27-869bb8d7e1bf service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:02.661396 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-aba02c1e-7a95-4cd1-a626-41623d549044 req-84a7f437-fb61-4b86-ab27-869bb8d7e1bf service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:02.663163 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-aba02c1e-7a95-4cd1-a626-41623d549044 req-84a7f437-fb61-4b86-ab27-869bb8d7e1bf service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:02.682802 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-aba02c1e-7a95-4cd1-a626-41623d549044 req-84a7f437-fb61-4b86-ab27-869bb8d7e1bf service nova] Creating event network-vif-unplugged:e796f543-c137-42fa-b391-2f975c3df0e1 for instance bf08d895-d8f9-440d-8ade-fbc47dc6bde4 on nch1-master-1 Sep 17 20:59:02.720231 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-aba02c1e-7a95-4cd1-a626-41623d549044 req-84a7f437-fb61-4b86-ab27-869bb8d7e1bf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074733 Sep 17 20:59:02.722626 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1091/2100] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:02.746782 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b1dae837-c9ff-476e-b27c-08b90c7f093a tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:02.748972 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b1dae837-c9ff-476e-b27c-08b90c7f093a tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 563a230c-e153-4283-9d88-9e853f63574a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:02.756145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-332c9bae-44c6-4e96-b303-a125faf2cb3a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:02.770432 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-332c9bae-44c6-4e96-b303-a125faf2cb3a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567" status: 200 len: 1319 microversion: 2.1 time: 0.404755 Sep 17 20:59:02.773567 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1dae837-c9ff-476e-b27c-08b90c7f093a tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:02.773875 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1dae837-c9ff-476e-b27c-08b90c7f093a tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:02.775942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1dae837-c9ff-476e-b27c-08b90c7f093a tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:02.777967 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1dae837-c9ff-476e-b27c-08b90c7f093a tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:02.778082 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1010/2101] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:02 2022] GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567 => generated 1319 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:02.791142 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1dae837-c9ff-476e-b27c-08b90c7f093a tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:02.791142 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1dae837-c9ff-476e-b27c-08b90c7f093a tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:02.799682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c02dfbb3-f9af-442e-8d98-a752e75944e9 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:02.799968 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c02dfbb3-f9af-442e-8d98-a752e75944e9 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: ed5493ed-b5ec-49fe-994f-1a4da1e61618] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:02.999764 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c02dfbb3-f9af-442e-8d98-a752e75944e9 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:03.024322 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c02dfbb3-f9af-442e-8d98-a752e75944e9 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618" status: 200 len: 1208 microversion: 2.1 time: 0.244401 Sep 17 20:59:03.025567 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1011/2102] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:02 2022] GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618 => generated 1208 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:03.287951 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b1dae837-c9ff-476e-b27c-08b90c7f093a tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:03.298573 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b1dae837-c9ff-476e-b27c-08b90c7f093a tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a" status: 200 len: 1321 microversion: 2.1 time: 0.571501 Sep 17 20:59:03.299175 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1092/2103] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:02 2022] GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a => generated 1321 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:03.363253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d610ecac-0735-4488-8389-9a0d21be71b1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:03.363980 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d610ecac-0735-4488-8389-9a0d21be71b1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 1170d308-122b-4c9e-abf1-5d206d3b75f1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:03.372279 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d610ecac-0735-4488-8389-9a0d21be71b1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:03.373052 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d610ecac-0735-4488-8389-9a0d21be71b1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:03.374043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d610ecac-0735-4488-8389-9a0d21be71b1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:03.375225 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d610ecac-0735-4488-8389-9a0d21be71b1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:03.375960 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d610ecac-0735-4488-8389-9a0d21be71b1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:03.376591 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d610ecac-0735-4488-8389-9a0d21be71b1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:03.433589 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d610ecac-0735-4488-8389-9a0d21be71b1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:03.434484 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d610ecac-0735-4488-8389-9a0d21be71b1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:03.435185 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d610ecac-0735-4488-8389-9a0d21be71b1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:03.435814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-d610ecac-0735-4488-8389-9a0d21be71b1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lazy-loading 'fault' on Instance uuid 1170d308-122b-4c9e-abf1-5d206d3b75f1 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:59:03.455602 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-207f67d5-f7a6-467f-bccc-7d2bef912ebd req-eff9b4c1-3cc9-4560-8cb6-1e6d17462199 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1170d308-122b-4c9e-abf1-5d206d3b75f1", "name": "network-vif-deleted", "tag": "9d01a13c-3b68-4cfc-aebd-9a72fb8b76d8"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:03.479357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-207f67d5-f7a6-467f-bccc-7d2bef912ebd req-eff9b4c1-3cc9-4560-8cb6-1e6d17462199 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:03.480096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-207f67d5-f7a6-467f-bccc-7d2bef912ebd req-eff9b4c1-3cc9-4560-8cb6-1e6d17462199 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:03.480683 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-207f67d5-f7a6-467f-bccc-7d2bef912ebd req-eff9b4c1-3cc9-4560-8cb6-1e6d17462199 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:03.503115 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-207f67d5-f7a6-467f-bccc-7d2bef912ebd req-eff9b4c1-3cc9-4560-8cb6-1e6d17462199 service nova] Creating event network-vif-deleted:9d01a13c-3b68-4cfc-aebd-9a72fb8b76d8 for instance 1170d308-122b-4c9e-abf1-5d206d3b75f1 on nch1-master-1 Sep 17 20:59:03.516609 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-207f67d5-f7a6-467f-bccc-7d2bef912ebd req-eff9b4c1-3cc9-4560-8cb6-1e6d17462199 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063792 Sep 17 20:59:03.517241 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1093/2104] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 20:59:03.554771 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d610ecac-0735-4488-8389-9a0d21be71b1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:03.566031 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d610ecac-0735-4488-8389-9a0d21be71b1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1" status: 200 len: 1304 microversion: 2.1 time: 0.207544 Sep 17 20:59:03.567545 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1012/2105] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:03 2022] GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1 => generated 1304 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:03.806479 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3f0885ad-9090-422e-98e3-5c8fc0e6b76a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:03.807653 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3f0885ad-9090-422e-98e3-5c8fc0e6b76a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 7b07abb3-f10d-4b65-9a52-28bb33b47567] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:03.821807 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f0885ad-9090-422e-98e3-5c8fc0e6b76a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:03.822846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f0885ad-9090-422e-98e3-5c8fc0e6b76a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:03.825249 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f0885ad-9090-422e-98e3-5c8fc0e6b76a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:03.827086 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f0885ad-9090-422e-98e3-5c8fc0e6b76a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:03.829304 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f0885ad-9090-422e-98e3-5c8fc0e6b76a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:03.829919 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f0885ad-9090-422e-98e3-5c8fc0e6b76a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:04.048465 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-145806b8-82db-471c-9064-ac5cc0def883 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:04.049379 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-145806b8-82db-471c-9064-ac5cc0def883 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: ed5493ed-b5ec-49fe-994f-1a4da1e61618] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:04.060980 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-145806b8-82db-471c-9064-ac5cc0def883 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:04.061749 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-145806b8-82db-471c-9064-ac5cc0def883 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:04.063820 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-145806b8-82db-471c-9064-ac5cc0def883 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:04.067521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-145806b8-82db-471c-9064-ac5cc0def883 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:04.068199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-145806b8-82db-471c-9064-ac5cc0def883 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:04.068896 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-145806b8-82db-471c-9064-ac5cc0def883 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:04.269199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-145806b8-82db-471c-9064-ac5cc0def883 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:04.281910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3f0885ad-9090-422e-98e3-5c8fc0e6b76a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:04.282769 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-145806b8-82db-471c-9064-ac5cc0def883 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618" status: 200 len: 1260 microversion: 2.1 time: 0.238279 Sep 17 20:59:04.298197 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3f0885ad-9090-422e-98e3-5c8fc0e6b76a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567" status: 200 len: 1469 microversion: 2.1 time: 0.497459 Sep 17 20:59:04.298955 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1094/2106] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:03 2022] GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567 => generated 1469 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:04.302373 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1013/2107] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:04 2022] GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618 => generated 1260 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:59:04.322416 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7b680f5e-17c6-4264-92b3-4522c72ec511 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:04.323036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7b680f5e-17c6-4264-92b3-4522c72ec511 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: e16ee697-bc81-4c87-a419-9485374a111a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:04.331050 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2ec8db02-e987-40b7-a626-d7ce1e9d429b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:04.334844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7b680f5e-17c6-4264-92b3-4522c72ec511 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:04.335806 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7b680f5e-17c6-4264-92b3-4522c72ec511 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:04.336576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7b680f5e-17c6-4264-92b3-4522c72ec511 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:04.337548 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7b680f5e-17c6-4264-92b3-4522c72ec511 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:04.338542 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2ec8db02-e987-40b7-a626-d7ce1e9d429b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 563a230c-e153-4283-9d88-9e853f63574a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:04.339254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7b680f5e-17c6-4264-92b3-4522c72ec511 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:04.341762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7b680f5e-17c6-4264-92b3-4522c72ec511 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:04.351590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ec8db02-e987-40b7-a626-d7ce1e9d429b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:04.361208 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ec8db02-e987-40b7-a626-d7ce1e9d429b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:04.362429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ec8db02-e987-40b7-a626-d7ce1e9d429b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:04.363405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ec8db02-e987-40b7-a626-d7ce1e9d429b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:04.364690 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ec8db02-e987-40b7-a626-d7ce1e9d429b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:04.365338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ec8db02-e987-40b7-a626-d7ce1e9d429b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:04.729190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7b680f5e-17c6-4264-92b3-4522c72ec511 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:04.750939 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7b680f5e-17c6-4264-92b3-4522c72ec511 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/e16ee697-bc81-4c87-a419-9485374a111a" status: 200 len: 1469 microversion: 2.1 time: 0.430685 Sep 17 20:59:04.767934 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1095/2108] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:04 2022] GET /compute/v2.1/servers/e16ee697-bc81-4c87-a419-9485374a111a => generated 1469 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:04.785318 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-baf0db40-cd7e-4d55-95c9-15b1a1d8b01c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:04.786341 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-baf0db40-cd7e-4d55-95c9-15b1a1d8b01c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 1170d308-122b-4c9e-abf1-5d206d3b75f1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:04.801418 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-baf0db40-cd7e-4d55-95c9-15b1a1d8b01c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:04.802335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-baf0db40-cd7e-4d55-95c9-15b1a1d8b01c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:04.802923 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-baf0db40-cd7e-4d55-95c9-15b1a1d8b01c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:04.803859 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-baf0db40-cd7e-4d55-95c9-15b1a1d8b01c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:04.805389 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-baf0db40-cd7e-4d55-95c9-15b1a1d8b01c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:04.806015 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-baf0db40-cd7e-4d55-95c9-15b1a1d8b01c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:04.825017 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-baf0db40-cd7e-4d55-95c9-15b1a1d8b01c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] HTTP exception thrown: Instance 1170d308-122b-4c9e-abf1-5d206d3b75f1 could not be found. Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-baf0db40-cd7e-4d55-95c9-15b1a1d8b01c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Request method failure captured: Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1 HTTP/1.1 Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjSr4eYJ5iRC0BESTxyEYBHr6fTKXAfzmSKRijJd1-Dg4_6zeDPSLMVKcn7Va4xyX_oACpKQBdCcihzycrxxeD9gtcf6rUAIbBHhHnQZK1W2woTj604P1AONqCzsshMWFY41NR-lshpdEXKwYePjmUqN1wZWN-nWEva1tUOKD4iFshs Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89b46ae7347d4f2daf02f627e41a4847", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-DeleteServersTestJSON-583053734 Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-DeleteServersTestJSON-583053734-project Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 3009c5feb1ef43a08b07996d8f63bf11 Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-DeleteServersTestJSON-583053734-project Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 1170d308-122b-4c9e-abf1-5d206d3b75f1 could not be found. Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '1170d308-122b-4c9e-abf1-5d206d3b75f1'} Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1170d308-122b-4c9e-abf1-5d206d3b75f1 could not be found. Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1170d308-122b-4c9e-abf1-5d206d3b75f1 could not be found. Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:04.827367 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:04.830662 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:04.830662 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:04.830662 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:04.830662 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:59:04.830662 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:59:04.830662 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1170d308-122b-4c9e-abf1-5d206d3b75f1 could not be found. Sep 17 20:59:04.830662 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:04.833434 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-baf0db40-cd7e-4d55-95c9-15b1a1d8b01c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Returning 404 to user: Instance 1170d308-122b-4c9e-abf1-5d206d3b75f1 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:59:04.834677 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-baf0db40-cd7e-4d55-95c9-15b1a1d8b01c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1" status: 404 len: 111 microversion: 2.1 time: 0.065198 Sep 17 20:59:04.836275 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1096/2109] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:04 2022] GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:59:04.843985 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a0ece4a1-31d9-4554-b31f-de21c6a49d07 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:04.850925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a0ece4a1-31d9-4554-b31f-de21c6a49d07 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:04.853171 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a0ece4a1-31d9-4554-b31f-de21c6a49d07 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Searching by: {'reservation_id': 'r-k3mwq3pf', 'deleted': False, 'project_id': '3515123097e744ef855ef1129fb59cf1'} {{(pid=140524) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 20:59:04.861934 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0ece4a1-31d9-4554-b31f-de21c6a49d07 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:04.862713 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0ece4a1-31d9-4554-b31f-de21c6a49d07 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:04.863737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0ece4a1-31d9-4554-b31f-de21c6a49d07 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:04.864722 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0ece4a1-31d9-4554-b31f-de21c6a49d07 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:04.865439 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0ece4a1-31d9-4554-b31f-de21c6a49d07 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:04.866131 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0ece4a1-31d9-4554-b31f-de21c6a49d07 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:04.985452 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.multi_cell_list [None req-a0ece4a1-31d9-4554-b31f-de21c6a49d07 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140524) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 20:59:05.022107 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2ec8db02-e987-40b7-a626-d7ce1e9d429b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:05.037299 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2ec8db02-e987-40b7-a626-d7ce1e9d429b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a" status: 200 len: 1321 microversion: 2.1 time: 0.707731 Sep 17 20:59:05.040095 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1014/2110] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:04 2022] GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a => generated 1321 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:05.058382 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9dfa2e19-3cce-4d33-8e02-561a38bb7177 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-374601806", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "25526ef3-eaa2-4f18-ac44-bfbbfae855ea"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:05.111649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a0ece4a1-31d9-4554-b31f-de21c6a49d07 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:05.127192 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-9dfa2e19-3cce-4d33-8e02-561a38bb7177 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] validate_networks() for [('25526ef3-eaa2-4f18-ac44-bfbbfae855ea', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:59:05.148803 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0ece4a1-31d9-4554-b31f-de21c6a49d07 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:05.149223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0ece4a1-31d9-4554-b31f-de21c6a49d07 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:05.149707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0ece4a1-31d9-4554-b31f-de21c6a49d07 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:05.167150 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:59:05.591942 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a0ece4a1-31d9-4554-b31f-de21c6a49d07 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?reservation_id=r-k3mwq3pf" status: 200 len: 2931 microversion: 2.1 time: 0.754055 Sep 17 20:59:05.592812 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1097/2111] 10.222.0.26 () {58 vars in 1197 bytes} [Sat Sep 17 20:59:04 2022] GET /compute/v2.1/servers/detail?reservation_id=r-k3mwq3pf => generated 2931 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:05.634293 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f964dfe7-994b-4eb7-b676-8975832db70f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:05.634916 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f964dfe7-994b-4eb7-b676-8975832db70f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: ed5493ed-b5ec-49fe-994f-1a4da1e61618] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:05.655472 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f964dfe7-994b-4eb7-b676-8975832db70f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:05.655976 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f964dfe7-994b-4eb7-b676-8975832db70f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:05.656425 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f964dfe7-994b-4eb7-b676-8975832db70f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:05.657143 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f964dfe7-994b-4eb7-b676-8975832db70f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:05.660507 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f964dfe7-994b-4eb7-b676-8975832db70f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:05.661007 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f964dfe7-994b-4eb7-b676-8975832db70f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:05.821549 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f964dfe7-994b-4eb7-b676-8975832db70f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:05.832656 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f964dfe7-994b-4eb7-b676-8975832db70f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618" status: 200 len: 1266 microversion: 2.1 time: 0.228868 Sep 17 20:59:05.833259 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1098/2112] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:05 2022] GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618 => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:05.850710 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-81e49798-4e5d-4c41-a96f-ba6ae8055c42 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:05.879882 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.compute.server_groups [None req-81e49798-4e5d-4c41-a96f-ba6ae8055c42 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Querying cell 056db90a-cdd9-42b2-a8c3-cd5ab36662a4(cell1) for 2 instances {{(pid=140524) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 17 20:59:05.880953 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-81e49798-4e5d-4c41-a96f-ba6ae8055c42 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:05.890170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-81e49798-4e5d-4c41-a96f-ba6ae8055c42 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:05.891031 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-81e49798-4e5d-4c41-a96f-ba6ae8055c42 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:05.958062 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-81e49798-4e5d-4c41-a96f-ba6ae8055c42 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups/3ec7ae95-2707-4480-b831-a65a9b35cb03" status: 200 len: 271 microversion: 2.1 time: 0.121631 Sep 17 20:59:05.967662 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1099/2113] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Sep 17 20:59:05 2022] GET /compute/v2.1/os-server-groups/3ec7ae95-2707-4480-b831-a65a9b35cb03 => generated 271 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:05.986735 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fe8f9739-5762-4661-b14e-113ffd3b02f7 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:05.988520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fe8f9739-5762-4661-b14e-113ffd3b02f7 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] [instance: 7b07abb3-f10d-4b65-9a52-28bb33b47567] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:06.001529 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe8f9739-5762-4661-b14e-113ffd3b02f7 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:06.003299 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe8f9739-5762-4661-b14e-113ffd3b02f7 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:06.004243 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe8f9739-5762-4661-b14e-113ffd3b02f7 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:06.007009 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe8f9739-5762-4661-b14e-113ffd3b02f7 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:06.007624 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe8f9739-5762-4661-b14e-113ffd3b02f7 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:06.008188 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe8f9739-5762-4661-b14e-113ffd3b02f7 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:06.031986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-9dfa2e19-3cce-4d33-8e02-561a38bb7177 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:59:06.033041 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-9dfa2e19-3cce-4d33-8e02-561a38bb7177 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:59:06.034568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-9dfa2e19-3cce-4d33-8e02-561a38bb7177 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:59:06.035785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-9dfa2e19-3cce-4d33-8e02-561a38bb7177 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:59:06.036599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-9dfa2e19-3cce-4d33-8e02-561a38bb7177 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:59:06.051498 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9dfa2e19-3cce-4d33-8e02-561a38bb7177 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:06.052425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9dfa2e19-3cce-4d33-8e02-561a38bb7177 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:06.053018 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9dfa2e19-3cce-4d33-8e02-561a38bb7177 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:06.053944 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9dfa2e19-3cce-4d33-8e02-561a38bb7177 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:06.054887 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9dfa2e19-3cce-4d33-8e02-561a38bb7177 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:06.055747 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9dfa2e19-3cce-4d33-8e02-561a38bb7177 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:06.091475 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-9dfa2e19-3cce-4d33-8e02-561a38bb7177 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Getting quotas for project 89b46ae7347d4f2daf02f627e41a4847. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:59:06.101801 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-9dfa2e19-3cce-4d33-8e02-561a38bb7177 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Getting quotas for user 3009c5feb1ef43a08b07996d8f63bf11 and project 89b46ae7347d4f2daf02f627e41a4847. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:59:06.120238 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9dfa2e19-3cce-4d33-8e02-561a38bb7177 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:59:06.123210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9dfa2e19-3cce-4d33-8e02-561a38bb7177 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:59:06.196237 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9dfa2e19-3cce-4d33-8e02-561a38bb7177 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.142579 Sep 17 20:59:06.198144 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1015/2114] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:59:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:59:06.204818 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2be0d162-b3b1-4369-9240-5f35b6b86136 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:06.205670 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2be0d162-b3b1-4369-9240-5f35b6b86136 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 563a230c-e153-4283-9d88-9e853f63574a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:06.214386 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2be0d162-b3b1-4369-9240-5f35b6b86136 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:06.218526 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fe8f9739-5762-4661-b14e-113ffd3b02f7 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567" status: 200 len: 1620 microversion: 2.1 time: 0.247898 Sep 17 20:59:06.218526 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1100/2115] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:05 2022] GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567 => generated 1620 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:06.220580 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2be0d162-b3b1-4369-9240-5f35b6b86136 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:06.221636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2be0d162-b3b1-4369-9240-5f35b6b86136 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:06.222770 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2be0d162-b3b1-4369-9240-5f35b6b86136 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:06.223254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2be0d162-b3b1-4369-9240-5f35b6b86136 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:06.223719 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2be0d162-b3b1-4369-9240-5f35b6b86136 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:06.224527 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d927b4cd-9d91-4087-a479-00b1f681b190 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:06.225242 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d927b4cd-9d91-4087-a479-00b1f681b190 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:06.249453 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:UPDATE=10,nova_api:SELECT=84,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:59:06.319031 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d927b4cd-9d91-4087-a479-00b1f681b190 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:06.329352 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d927b4cd-9d91-4087-a479-00b1f681b190 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1214 microversion: 2.1 time: 0.109596 Sep 17 20:59:06.344012 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1101/2116] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:06 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1214 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:06.358636 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6a0e694d-50ac-4f1c-9abf-164a0a3be87d tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:06.359586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6a0e694d-50ac-4f1c-9abf-164a0a3be87d tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] [instance: e16ee697-bc81-4c87-a419-9485374a111a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:06.367251 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a0e694d-50ac-4f1c-9abf-164a0a3be87d tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:06.367959 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a0e694d-50ac-4f1c-9abf-164a0a3be87d tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:06.369004 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a0e694d-50ac-4f1c-9abf-164a0a3be87d tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:06.369937 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a0e694d-50ac-4f1c-9abf-164a0a3be87d tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:06.370599 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a0e694d-50ac-4f1c-9abf-164a0a3be87d tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:06.371216 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a0e694d-50ac-4f1c-9abf-164a0a3be87d tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:06.736069 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2be0d162-b3b1-4369-9240-5f35b6b86136 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:06.748717 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2be0d162-b3b1-4369-9240-5f35b6b86136 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a" status: 200 len: 1321 microversion: 2.1 time: 0.547884 Sep 17 20:59:06.758304 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1016/2117] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:06 2022] GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a => generated 1321 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:06.771805 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-09b6227a-7cb6-44a8-bc96-7219fa6390eb req-bb90641f-7270-4e5c-9164-12bdef532686 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "526330e7-cd66-44c3-9453-ea80479469a8", "tag": "c93203a9-6cc3-4130-9503-a63df25cd048"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:06.795907 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-09b6227a-7cb6-44a8-bc96-7219fa6390eb req-bb90641f-7270-4e5c-9164-12bdef532686 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:06.796717 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-09b6227a-7cb6-44a8-bc96-7219fa6390eb req-bb90641f-7270-4e5c-9164-12bdef532686 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:06.797357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-09b6227a-7cb6-44a8-bc96-7219fa6390eb req-bb90641f-7270-4e5c-9164-12bdef532686 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:06.810909 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-09b6227a-7cb6-44a8-bc96-7219fa6390eb req-bb90641f-7270-4e5c-9164-12bdef532686 service nova] Creating event network-changed:c93203a9-6cc3-4130-9503-a63df25cd048 for instance 526330e7-cd66-44c3-9453-ea80479469a8 on nch2-master-1 Sep 17 20:59:06.814587 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6a0e694d-50ac-4f1c-9abf-164a0a3be87d tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/e16ee697-bc81-4c87-a419-9485374a111a" status: 200 len: 1620 microversion: 2.1 time: 0.465863 Sep 17 20:59:06.816606 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1102/2118] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:06 2022] GET /compute/v2.1/servers/e16ee697-bc81-4c87-a419-9485374a111a => generated 1620 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:06.832045 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-09b6227a-7cb6-44a8-bc96-7219fa6390eb req-bb90641f-7270-4e5c-9164-12bdef532686 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072087 Sep 17 20:59:06.834967 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1017/2119] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:06.863234 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bdc2eb48-28c3-4e96-ab02-ca3ea659e132 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:06.866594 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bdc2eb48-28c3-4e96-ab02-ca3ea659e132 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: ed5493ed-b5ec-49fe-994f-1a4da1e61618] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:06.879500 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bdc2eb48-28c3-4e96-ab02-ca3ea659e132 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:06.880357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bdc2eb48-28c3-4e96-ab02-ca3ea659e132 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:06.881018 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bdc2eb48-28c3-4e96-ab02-ca3ea659e132 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:06.882058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bdc2eb48-28c3-4e96-ab02-ca3ea659e132 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:06.882770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bdc2eb48-28c3-4e96-ab02-ca3ea659e132 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:06.883397 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bdc2eb48-28c3-4e96-ab02-ca3ea659e132 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:06.964529 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bdc2eb48-28c3-4e96-ab02-ca3ea659e132 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:06.975727 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bdc2eb48-28c3-4e96-ab02-ca3ea659e132 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618" status: 200 len: 1266 microversion: 2.1 time: 0.120228 Sep 17 20:59:06.976923 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1103/2120] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:06 2022] GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618 => generated 1266 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:07.085966 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-08c64e9c-97f1-453f-b24d-4d48cc211998 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-628990488", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "8f0929b7-f8de-4896-a0de-a2388fef54f3"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:07.198476 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-08c64e9c-97f1-453f-b24d-4d48cc211998 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] validate_networks() for None {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:59:07.513988 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-72ebb270-1798-43c5-87a6-db4546b4a687 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-564553266", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:07.585354 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-72ebb270-1798-43c5-87a6-db4546b4a687 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] validate_networks() for None {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:59:07.987182 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-08c64e9c-97f1-453f-b24d-4d48cc211998 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:59:07.987856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-08c64e9c-97f1-453f-b24d-4d48cc211998 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:59:07.988400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-08c64e9c-97f1-453f-b24d-4d48cc211998 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:59:07.988813 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-08c64e9c-97f1-453f-b24d-4d48cc211998 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:59:07.989229 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-08c64e9c-97f1-453f-b24d-4d48cc211998 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:59:08.007489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08c64e9c-97f1-453f-b24d-4d48cc211998 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:08.008145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08c64e9c-97f1-453f-b24d-4d48cc211998 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:08.008652 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08c64e9c-97f1-453f-b24d-4d48cc211998 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:08.009483 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08c64e9c-97f1-453f-b24d-4d48cc211998 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:08.010272 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08c64e9c-97f1-453f-b24d-4d48cc211998 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:08.011032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08c64e9c-97f1-453f-b24d-4d48cc211998 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:08.035846 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-08c64e9c-97f1-453f-b24d-4d48cc211998 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for project 3515123097e744ef855ef1129fb59cf1. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:59:08.040606 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-72ebb270-1798-43c5-87a6-db4546b4a687 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:59:08.041940 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-72ebb270-1798-43c5-87a6-db4546b4a687 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:59:08.043599 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-72ebb270-1798-43c5-87a6-db4546b4a687 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:59:08.044239 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-72ebb270-1798-43c5-87a6-db4546b4a687 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:59:08.044414 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-08c64e9c-97f1-453f-b24d-4d48cc211998 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for user 0d48260054d84784b89a52d9b766d7c1 and project 3515123097e744ef855ef1129fb59cf1. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:59:08.044979 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-72ebb270-1798-43c5-87a6-db4546b4a687 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:59:08.057179 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72ebb270-1798-43c5-87a6-db4546b4a687 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:08.058926 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72ebb270-1798-43c5-87a6-db4546b4a687 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:08.059533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72ebb270-1798-43c5-87a6-db4546b4a687 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:08.060063 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-08c64e9c-97f1-453f-b24d-4d48cc211998 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:59:08.061225 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72ebb270-1798-43c5-87a6-db4546b4a687 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:08.062161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72ebb270-1798-43c5-87a6-db4546b4a687 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:08.062852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72ebb270-1798-43c5-87a6-db4546b4a687 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:08.063341 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-08c64e9c-97f1-453f-b24d-4d48cc211998 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 71d2c783-2772-442d-b38c-920fcf895b77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:59:08.111960 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-72ebb270-1798-43c5-87a6-db4546b4a687 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Getting quotas for project a0c2cdfddf5b4d35a0ca3c7554271365. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:59:08.124225 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-72ebb270-1798-43c5-87a6-db4546b4a687 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Getting quotas for user 1fff4805e6fb45a0b7c8b4dc08c4dedb and project a0c2cdfddf5b4d35a0ca3c7554271365. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:59:08.142609 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-08c64e9c-97f1-453f-b24d-4d48cc211998 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.061191 Sep 17 20:59:08.150446 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1018/2121] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:59:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:59:08.150627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-72ebb270-1798-43c5-87a6-db4546b4a687 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:59:08.156187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-72ebb270-1798-43c5-87a6-db4546b4a687 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:59:08.156631 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c7f385b9-ab42-458b-b9d4-63218d6d1778 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:08.157425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c7f385b9-ab42-458b-b9d4-63218d6d1778 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:08.166401 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c7f385b9-ab42-458b-b9d4-63218d6d1778 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:08.167352 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c7f385b9-ab42-458b-b9d4-63218d6d1778 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:08.167978 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c7f385b9-ab42-458b-b9d4-63218d6d1778 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:08.168917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c7f385b9-ab42-458b-b9d4-63218d6d1778 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:08.169671 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c7f385b9-ab42-458b-b9d4-63218d6d1778 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:08.171523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c7f385b9-ab42-458b-b9d4-63218d6d1778 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:08.247214 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c7f385b9-ab42-458b-b9d4-63218d6d1778 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:08.258152 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c7f385b9-ab42-458b-b9d4-63218d6d1778 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1210 microversion: 2.1 time: 0.104583 Sep 17 20:59:08.259423 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1019/2122] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:08 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1210 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:08.266726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6c4f7716-a903-4dc0-b1aa-ef3dfb80aa3f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:08.268286 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6c4f7716-a903-4dc0-b1aa-ef3dfb80aa3f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 563a230c-e153-4283-9d88-9e853f63574a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:08.276313 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:59:08.277503 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-72ebb270-1798-43c5-87a6-db4546b4a687 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.167626 Sep 17 20:59:08.281559 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1104/2123] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:59:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 17 20:59:08.286329 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0af474f3-f8ec-4808-b166-997b311f2dd8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:08.286956 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0af474f3-f8ec-4808-b166-997b311f2dd8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: ed5493ed-b5ec-49fe-994f-1a4da1e61618] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:08.288714 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6c4f7716-a903-4dc0-b1aa-ef3dfb80aa3f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:08.289556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6c4f7716-a903-4dc0-b1aa-ef3dfb80aa3f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:08.290022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6c4f7716-a903-4dc0-b1aa-ef3dfb80aa3f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:08.290781 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6c4f7716-a903-4dc0-b1aa-ef3dfb80aa3f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:08.292253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6c4f7716-a903-4dc0-b1aa-ef3dfb80aa3f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:08.292726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6c4f7716-a903-4dc0-b1aa-ef3dfb80aa3f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:08.311050 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0af474f3-f8ec-4808-b166-997b311f2dd8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:08.311568 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0af474f3-f8ec-4808-b166-997b311f2dd8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:08.312018 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0af474f3-f8ec-4808-b166-997b311f2dd8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:08.313366 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0af474f3-f8ec-4808-b166-997b311f2dd8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:08.314065 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0af474f3-f8ec-4808-b166-997b311f2dd8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:08.314296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0af474f3-f8ec-4808-b166-997b311f2dd8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:08.513944 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6c4f7716-a903-4dc0-b1aa-ef3dfb80aa3f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:08.522999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0af474f3-f8ec-4808-b166-997b311f2dd8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:08.535372 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0af474f3-f8ec-4808-b166-997b311f2dd8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618" status: 200 len: 1266 microversion: 2.1 time: 0.252724 Sep 17 20:59:08.539447 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6c4f7716-a903-4dc0-b1aa-ef3dfb80aa3f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a" status: 200 len: 1321 microversion: 2.1 time: 0.278444 Sep 17 20:59:08.539955 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1020/2125] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:08 2022] GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a => generated 1321 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:08.541232 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1105/2125] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:08 2022] GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618 => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:08.548909 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e8046a43-1fea-47de-9773-3edb2e2e45b8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:08.564722 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e8046a43-1fea-47de-9773-3edb2e2e45b8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 71d2c783-2772-442d-b38c-920fcf895b77] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:08.640398 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e8046a43-1fea-47de-9773-3edb2e2e45b8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:08.670855 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e8046a43-1fea-47de-9773-3edb2e2e45b8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77" status: 200 len: 1216 microversion: 2.1 time: 0.128358 Sep 17 20:59:08.689876 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1021/2126] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:08 2022] GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77 => generated 1216 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:08.704562 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f9a479ad-6bdf-4501-b993-86e2feef30e5 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1589751549", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:08.838369 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-f9a479ad-6bdf-4501-b993-86e2feef30e5 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] validate_networks() for None {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:59:08.900988 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6423276e-003e-4aff-aefd-761efa8688e1 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Action: 'update', calling method: .version_select at 0x7f25a4d14e50>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:08.910719 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6423276e-003e-4aff-aefd-761efa8688e1 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:08.915142 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6423276e-003e-4aff-aefd-761efa8688e1 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:08.917269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6423276e-003e-4aff-aefd-761efa8688e1 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:08.948735 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6423276e-003e-4aff-aefd-761efa8688e1 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:08.950515 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6423276e-003e-4aff-aefd-761efa8688e1 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:08.950988 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6423276e-003e-4aff-aefd-761efa8688e1 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:08.983933 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-6423276e-003e-4aff-aefd-761efa8688e1 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] HTTP exception thrown: Service d9118c2d-439f-4b65-b1b7-9e1c546d6c06 could not be found. Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6423276e-003e-4aff-aefd-761efa8688e1 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Request method failure captured: Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: request: PUT /compute/v2.1/os-services/d9118c2d-439f-4b65-b1b7-9e1c546d6c06 HTTP/1.1 Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 56 Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjUchZOH9treHEez4_mkMaVvEXhIIc3ilShomPcJ1NMcNXxu0Ts23hAtliw3cO9j3MSjWYnrjgacYSaitfVLnon4bVS1QIb-fcBgDMH3b02KHienU7lYtjAE9IWfhwWbsmWgWSohiPjF0i6gcux_iUqCF7MXn00NlmWQ6ms6UmLy2GM Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: X-Openstack-Nova-Api-Version: 2.53 Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 2142b9af3d894f4caecea660a1be854f Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2105031389 Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: X-Role: admin,member,reader Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: admin,member,reader Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2142b9af3d894f4caecea660a1be854f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2142b9af3d894f4caecea660a1be854f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2142b9af3d894f4caecea660a1be854f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2142b9af3d894f4caecea660a1be854f", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2105031389 Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 2142b9af3d894f4caecea660a1be854f Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2105031389 Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 6d16dcc6227a48dab66c34b3c00cfa9a Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: {"status": "disabled", "disabled_reason": "maintenance"} Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: exception: Service d9118c2d-439f-4b65-b1b7-9e1c546d6c06 could not be found. Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'd9118c2d-439f-4b65-b1b7-9e1c546d6c06', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service d9118c2d-439f-4b65-b1b7-9e1c546d6c06 could not be found. Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:59:08.988151 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:59:08.993296 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 17 20:59:08.993296 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:59:08.993296 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service d9118c2d-439f-4b65-b1b7-9e1c546d6c06 could not be found. Sep 17 20:59:08.993296 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:08.993296 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:08.993296 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:08.993296 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:08.993296 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:08.993296 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:08.993296 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:59:08.993296 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:59:08.993296 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service d9118c2d-439f-4b65-b1b7-9e1c546d6c06 could not be found. Sep 17 20:59:08.993296 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:08.993296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6423276e-003e-4aff-aefd-761efa8688e1 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Returning 404 to user: Service d9118c2d-439f-4b65-b1b7-9e1c546d6c06 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:59:08.993296 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6423276e-003e-4aff-aefd-761efa8688e1 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-services/d9118c2d-439f-4b65-b1b7-9e1c546d6c06" status: 404 len: 110 microversion: 2.53 time: 0.447386 Sep 17 20:59:08.993296 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1106/2127] 10.222.0.26 () {62 vars in 1309 bytes} [Sat Sep 17 20:59:08 2022] PUT /compute/v2.1/os-services/d9118c2d-439f-4b65-b1b7-9e1c546d6c06 => generated 110 bytes in 448 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 17 20:59:09.006758 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-cd224f65-9dde-4ad0-86aa-95320e69acd0 req-865171a2-349e-4813-83c1-7b8d58c0c9c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf08d895-d8f9-440d-8ade-fbc47dc6bde4", "name": "network-vif-deleted", "tag": "e796f543-c137-42fa-b391-2f975c3df0e1"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:09.027334 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-cd224f65-9dde-4ad0-86aa-95320e69acd0 req-865171a2-349e-4813-83c1-7b8d58c0c9c9 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:09.027728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-cd224f65-9dde-4ad0-86aa-95320e69acd0 req-865171a2-349e-4813-83c1-7b8d58c0c9c9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:09.028165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-cd224f65-9dde-4ad0-86aa-95320e69acd0 req-865171a2-349e-4813-83c1-7b8d58c0c9c9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:09.041663 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-cd224f65-9dde-4ad0-86aa-95320e69acd0 req-865171a2-349e-4813-83c1-7b8d58c0c9c9 service nova] Creating event network-vif-deleted:e796f543-c137-42fa-b391-2f975c3df0e1 for instance bf08d895-d8f9-440d-8ade-fbc47dc6bde4 on nch1-master-1 Sep 17 20:59:09.048578 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-cd224f65-9dde-4ad0-86aa-95320e69acd0 req-865171a2-349e-4813-83c1-7b8d58c0c9c9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056820 Sep 17 20:59:09.049689 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1107/2128] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:09.055621 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0f344c9e-f135-40b0-aa81-2119dc6d3ae7 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Action: 'update', calling method: .version_select at 0x7f25a9f62670>, body: {"status": "disabled"} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:09.060250 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f344c9e-f135-40b0-aa81-2119dc6d3ae7 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:09.061754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f344c9e-f135-40b0-aa81-2119dc6d3ae7 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:09.063691 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f344c9e-f135-40b0-aa81-2119dc6d3ae7 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:09.078069 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f344c9e-f135-40b0-aa81-2119dc6d3ae7 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:09.078812 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f344c9e-f135-40b0-aa81-2119dc6d3ae7 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:09.079446 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f344c9e-f135-40b0-aa81-2119dc6d3ae7 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:09.088608 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-0f344c9e-f135-40b0-aa81-2119dc6d3ae7 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] HTTP exception thrown: Service d9118c2d-439f-4b65-b1b7-9e1c546d6c06 could not be found. Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0f344c9e-f135-40b0-aa81-2119dc6d3ae7 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Request method failure captured: Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: request: PUT /compute/v2.1/os-services/d9118c2d-439f-4b65-b1b7-9e1c546d6c06 HTTP/1.1 Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 22 Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjUchZOH9treHEez4_mkMaVvEXhIIc3ilShomPcJ1NMcNXxu0Ts23hAtliw3cO9j3MSjWYnrjgacYSaitfVLnon4bVS1QIb-fcBgDMH3b02KHienU7lYtjAE9IWfhwWbsmWgWSohiPjF0i6gcux_iUqCF7MXn00NlmWQ6ms6UmLy2GM Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: X-Openstack-Nova-Api-Version: 2.53 Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 2142b9af3d894f4caecea660a1be854f Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2105031389 Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: X-Role: admin,member,reader Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: admin,member,reader Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2142b9af3d894f4caecea660a1be854f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2142b9af3d894f4caecea660a1be854f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2142b9af3d894f4caecea660a1be854f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2142b9af3d894f4caecea660a1be854f", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2105031389 Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 2142b9af3d894f4caecea660a1be854f Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2105031389 Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 6d16dcc6227a48dab66c34b3c00cfa9a Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: {"status": "disabled"} Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: exception: Service d9118c2d-439f-4b65-b1b7-9e1c546d6c06 could not be found. Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'd9118c2d-439f-4b65-b1b7-9e1c546d6c06', 'body': {'status': 'disabled'}} Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service d9118c2d-439f-4b65-b1b7-9e1c546d6c06 could not be found. Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:59:09.091065 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:59:09.094999 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 17 20:59:09.094999 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:59:09.094999 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service d9118c2d-439f-4b65-b1b7-9e1c546d6c06 could not be found. Sep 17 20:59:09.094999 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:09.094999 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:09.094999 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:09.094999 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:09.094999 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:09.094999 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:09.094999 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:59:09.094999 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:59:09.094999 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service d9118c2d-439f-4b65-b1b7-9e1c546d6c06 could not be found. Sep 17 20:59:09.094999 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:09.094999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0f344c9e-f135-40b0-aa81-2119dc6d3ae7 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Returning 404 to user: Service d9118c2d-439f-4b65-b1b7-9e1c546d6c06 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:59:09.097989 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0f344c9e-f135-40b0-aa81-2119dc6d3ae7 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-services/d9118c2d-439f-4b65-b1b7-9e1c546d6c06" status: 404 len: 110 microversion: 2.53 time: 0.044310 Sep 17 20:59:09.098960 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1108/2129] 10.222.0.26 () {62 vars in 1309 bytes} [Sat Sep 17 20:59:09 2022] PUT /compute/v2.1/os-services/d9118c2d-439f-4b65-b1b7-9e1c546d6c06 => generated 110 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 17 20:59:09.108479 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-41f96acd-b349-441b-aac7-7d89e39f6c99 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Action: 'update', calling method: .version_select at 0x7f25a9fa59d0>, body: {"status": "enabled"} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:09.113444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-41f96acd-b349-441b-aac7-7d89e39f6c99 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:09.114239 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-41f96acd-b349-441b-aac7-7d89e39f6c99 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:09.114823 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-41f96acd-b349-441b-aac7-7d89e39f6c99 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:09.126670 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-41f96acd-b349-441b-aac7-7d89e39f6c99 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:09.127463 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-41f96acd-b349-441b-aac7-7d89e39f6c99 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:09.128151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-41f96acd-b349-441b-aac7-7d89e39f6c99 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:09.135511 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-41f96acd-b349-441b-aac7-7d89e39f6c99 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] HTTP exception thrown: Service d9118c2d-439f-4b65-b1b7-9e1c546d6c06 could not be found. Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-41f96acd-b349-441b-aac7-7d89e39f6c99 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Request method failure captured: Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: request: PUT /compute/v2.1/os-services/d9118c2d-439f-4b65-b1b7-9e1c546d6c06 HTTP/1.1 Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 21 Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjUchZOH9treHEez4_mkMaVvEXhIIc3ilShomPcJ1NMcNXxu0Ts23hAtliw3cO9j3MSjWYnrjgacYSaitfVLnon4bVS1QIb-fcBgDMH3b02KHienU7lYtjAE9IWfhwWbsmWgWSohiPjF0i6gcux_iUqCF7MXn00NlmWQ6ms6UmLy2GM Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: X-Openstack-Nova-Api-Version: 2.53 Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 2142b9af3d894f4caecea660a1be854f Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2105031389 Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: X-Role: admin,member,reader Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: admin,member,reader Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2142b9af3d894f4caecea660a1be854f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2142b9af3d894f4caecea660a1be854f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2142b9af3d894f4caecea660a1be854f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2142b9af3d894f4caecea660a1be854f", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2105031389 Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 2142b9af3d894f4caecea660a1be854f Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2105031389 Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 6d16dcc6227a48dab66c34b3c00cfa9a Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: {"status": "enabled"} Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: exception: Service d9118c2d-439f-4b65-b1b7-9e1c546d6c06 could not be found. Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'd9118c2d-439f-4b65-b1b7-9e1c546d6c06', 'body': {'status': 'enabled'}} Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service d9118c2d-439f-4b65-b1b7-9e1c546d6c06 could not be found. Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 20:59:09.138053 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:59:09.143046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 17 20:59:09.143046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:59:09.143046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service d9118c2d-439f-4b65-b1b7-9e1c546d6c06 could not be found. Sep 17 20:59:09.143046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:09.143046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:09.143046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:09.143046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:09.143046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:09.143046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:09.143046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:59:09.143046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:59:09.143046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service d9118c2d-439f-4b65-b1b7-9e1c546d6c06 could not be found. Sep 17 20:59:09.143046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:09.145868 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-41f96acd-b349-441b-aac7-7d89e39f6c99 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Returning 404 to user: Service d9118c2d-439f-4b65-b1b7-9e1c546d6c06 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:59:09.148687 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-41f96acd-b349-441b-aac7-7d89e39f6c99 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-services/d9118c2d-439f-4b65-b1b7-9e1c546d6c06" status: 404 len: 110 microversion: 2.53 time: 0.042595 Sep 17 20:59:09.149901 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1109/2130] 10.222.0.26 () {62 vars in 1309 bytes} [Sat Sep 17 20:59:09 2022] PUT /compute/v2.1/os-services/d9118c2d-439f-4b65-b1b7-9e1c546d6c06 => generated 110 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 17 20:59:09.162343 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9fceaaca-1eda-473d-a99e-4236c4295b7f tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:09.170927 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9fceaaca-1eda-473d-a99e-4236c4295b7f tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:09.171426 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9fceaaca-1eda-473d-a99e-4236c4295b7f tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:09.176482 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9fceaaca-1eda-473d-a99e-4236c4295b7f tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:09.180778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9fceaaca-1eda-473d-a99e-4236c4295b7f tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:09.181556 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9fceaaca-1eda-473d-a99e-4236c4295b7f tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:09.182160 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9fceaaca-1eda-473d-a99e-4236c4295b7f tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:09.245023 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9fceaaca-1eda-473d-a99e-4236c4295b7f tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.088231 Sep 17 20:59:09.245726 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1110/2131] 10.222.0.26 () {60 vars in 1178 bytes} [Sat Sep 17 20:59:09 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:59:09.264233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fa4b07db-3589-4452-817f-65c3762f1305 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:09.270893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa4b07db-3589-4452-817f-65c3762f1305 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:09.271746 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa4b07db-3589-4452-817f-65c3762f1305 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:09.280770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa4b07db-3589-4452-817f-65c3762f1305 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:09.282062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa4b07db-3589-4452-817f-65c3762f1305 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:09.285625 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa4b07db-3589-4452-817f-65c3762f1305 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:09.286433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa4b07db-3589-4452-817f-65c3762f1305 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:09.361871 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fa4b07db-3589-4452-817f-65c3762f1305 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.104176 Sep 17 20:59:09.363196 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1111/2132] 10.222.0.26 () {60 vars in 1211 bytes} [Sat Sep 17 20:59:09 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:59:09.379385 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e478d6ca-caa7-4178-a683-4c6a270b198a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:09.380866 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e478d6ca-caa7-4178-a683-4c6a270b198a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:09.389445 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e478d6ca-caa7-4178-a683-4c6a270b198a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:09.391072 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-f9a479ad-6bdf-4501-b993-86e2feef30e5 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:59:09.391705 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-f9a479ad-6bdf-4501-b993-86e2feef30e5 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:59:09.391965 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-f9a479ad-6bdf-4501-b993-86e2feef30e5 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:59:09.392382 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-f9a479ad-6bdf-4501-b993-86e2feef30e5 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:59:09.392860 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-f9a479ad-6bdf-4501-b993-86e2feef30e5 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:59:09.407149 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e478d6ca-caa7-4178-a683-4c6a270b198a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:09.408183 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e478d6ca-caa7-4178-a683-4c6a270b198a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:09.410157 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e478d6ca-caa7-4178-a683-4c6a270b198a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:09.410902 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e478d6ca-caa7-4178-a683-4c6a270b198a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:09.411587 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e478d6ca-caa7-4178-a683-4c6a270b198a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:09.443240 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f9a479ad-6bdf-4501-b993-86e2feef30e5 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:09.443744 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f9a479ad-6bdf-4501-b993-86e2feef30e5 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:09.444179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f9a479ad-6bdf-4501-b993-86e2feef30e5 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:09.452828 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f9a479ad-6bdf-4501-b993-86e2feef30e5 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:09.457351 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f9a479ad-6bdf-4501-b993-86e2feef30e5 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:09.458716 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f9a479ad-6bdf-4501-b993-86e2feef30e5 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:09.515741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-f9a479ad-6bdf-4501-b993-86e2feef30e5 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Getting quotas for project a0c2cdfddf5b4d35a0ca3c7554271365. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:59:09.522423 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-f9a479ad-6bdf-4501-b993-86e2feef30e5 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Getting quotas for user 1fff4805e6fb45a0b7c8b4dc08c4dedb and project a0c2cdfddf5b4d35a0ca3c7554271365. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:59:09.544642 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f9a479ad-6bdf-4501-b993-86e2feef30e5 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:59:09.547185 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f9a479ad-6bdf-4501-b993-86e2feef30e5 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 67aeba5b-d1f8-4487-be79-97da63c34fc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:59:09.602502 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e478d6ca-caa7-4178-a683-4c6a270b198a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:09.632681 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e478d6ca-caa7-4178-a683-4c6a270b198a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1266 microversion: 2.1 time: 0.268027 Sep 17 20:59:09.639003 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1112/2133] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:09 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1266 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:09.658266 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5d57bdbc-9429-44b1-a814-a53b6277cf9c tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:09.662206 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d57bdbc-9429-44b1-a814-a53b6277cf9c tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:09.662816 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d57bdbc-9429-44b1-a814-a53b6277cf9c tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:09.663484 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f9a479ad-6bdf-4501-b993-86e2feef30e5 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.972124 Sep 17 20:59:09.664176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d57bdbc-9429-44b1-a814-a53b6277cf9c tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:09.665195 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d57bdbc-9429-44b1-a814-a53b6277cf9c tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:09.666155 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d57bdbc-9429-44b1-a814-a53b6277cf9c tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:09.666799 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d57bdbc-9429-44b1-a814-a53b6277cf9c tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:09.676770 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1022/2134] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:59:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:59:09.695890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6964d3f3-1ad7-4b3b-aae7-afc47dcf60ce tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:09.696308 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6964d3f3-1ad7-4b3b-aae7-afc47dcf60ce tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: ed5493ed-b5ec-49fe-994f-1a4da1e61618] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:09.717112 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6964d3f3-1ad7-4b3b-aae7-afc47dcf60ce tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:09.717873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6964d3f3-1ad7-4b3b-aae7-afc47dcf60ce tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:09.718461 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6964d3f3-1ad7-4b3b-aae7-afc47dcf60ce tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:09.719675 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6964d3f3-1ad7-4b3b-aae7-afc47dcf60ce tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:09.720580 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5d57bdbc-9429-44b1-a814-a53b6277cf9c tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.073468 Sep 17 20:59:09.729028 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1113/2135] 10.222.0.26 () {60 vars in 1178 bytes} [Sat Sep 17 20:59:09 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:59:09.729398 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-90120626-a6aa-459b-8532-70c77ab0d4bd tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:09.730302 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6964d3f3-1ad7-4b3b-aae7-afc47dcf60ce tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:09.732381 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6964d3f3-1ad7-4b3b-aae7-afc47dcf60ce tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:09.735863 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-90120626-a6aa-459b-8532-70c77ab0d4bd tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 563a230c-e153-4283-9d88-9e853f63574a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:09.752222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90120626-a6aa-459b-8532-70c77ab0d4bd tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:09.752751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90120626-a6aa-459b-8532-70c77ab0d4bd tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:09.753205 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90120626-a6aa-459b-8532-70c77ab0d4bd tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:09.756937 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90120626-a6aa-459b-8532-70c77ab0d4bd tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:09.758811 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90120626-a6aa-459b-8532-70c77ab0d4bd tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:09.759434 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90120626-a6aa-459b-8532-70c77ab0d4bd tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:10.282832 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-90120626-a6aa-459b-8532-70c77ab0d4bd tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:10.298015 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-90120626-a6aa-459b-8532-70c77ab0d4bd tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a" status: 200 len: 1321 microversion: 2.1 time: 0.572788 Sep 17 20:59:10.299467 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1114/2136] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:09 2022] GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a => generated 1321 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:10.306417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-10cdf1a4-aa6a-41b4-8970-8c455949b707 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:10.308475 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-10cdf1a4-aa6a-41b4-8970-8c455949b707 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 67aeba5b-d1f8-4487-be79-97da63c34fc5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:10.326380 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6964d3f3-1ad7-4b3b-aae7-afc47dcf60ce tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:10.334465 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6964d3f3-1ad7-4b3b-aae7-afc47dcf60ce tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618" status: 200 len: 1308 microversion: 2.1 time: 0.656261 Sep 17 20:59:10.338432 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1023/2137] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:09 2022] GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618 => generated 1308 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:10.344839 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b29785ab-dbee-4da1-9f25-824e6d4ce32c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:10.345792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b29785ab-dbee-4da1-9f25-824e6d4ce32c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 71d2c783-2772-442d-b38c-920fcf895b77] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:10.354136 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b29785ab-dbee-4da1-9f25-824e6d4ce32c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:10.354941 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b29785ab-dbee-4da1-9f25-824e6d4ce32c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:10.355573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b29785ab-dbee-4da1-9f25-824e6d4ce32c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:10.367876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b29785ab-dbee-4da1-9f25-824e6d4ce32c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:10.369989 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b29785ab-dbee-4da1-9f25-824e6d4ce32c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:10.370659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b29785ab-dbee-4da1-9f25-824e6d4ce32c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:10.493693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-10cdf1a4-aa6a-41b4-8970-8c455949b707 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:10.504815 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-10cdf1a4-aa6a-41b4-8970-8c455949b707 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5" status: 200 len: 1214 microversion: 2.1 time: 0.202535 Sep 17 20:59:10.507959 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1115/2138] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:10 2022] GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5 => generated 1214 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:10.514095 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cb4d1c62-a738-4404-ab15-05e65e8ba76d tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:10.518890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb4d1c62-a738-4404-ab15-05e65e8ba76d tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:10.519609 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb4d1c62-a738-4404-ab15-05e65e8ba76d tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:10.520330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb4d1c62-a738-4404-ab15-05e65e8ba76d tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:10.521340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb4d1c62-a738-4404-ab15-05e65e8ba76d tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:10.522201 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb4d1c62-a738-4404-ab15-05e65e8ba76d tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:10.522840 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb4d1c62-a738-4404-ab15-05e65e8ba76d tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:10.545281 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b29785ab-dbee-4da1-9f25-824e6d4ce32c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:10.555601 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b29785ab-dbee-4da1-9f25-824e6d4ce32c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77" status: 200 len: 1212 microversion: 2.1 time: 0.214455 Sep 17 20:59:10.556173 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1024/2139] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:10 2022] GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77 => generated 1212 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:10.558583 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cb4d1c62-a738-4404-ab15-05e65e8ba76d tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.049262 Sep 17 20:59:10.559737 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1116/2140] 10.222.0.26 () {60 vars in 1237 bytes} [Sat Sep 17 20:59:10 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:10.572503 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bfc64841-3925-4330-982e-b725726d1693 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:10.581115 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bfc64841-3925-4330-982e-b725726d1693 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:10.582326 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bfc64841-3925-4330-982e-b725726d1693 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:10.583425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bfc64841-3925-4330-982e-b725726d1693 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:10.586475 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bfc64841-3925-4330-982e-b725726d1693 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:10.601496 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bfc64841-3925-4330-982e-b725726d1693 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:10.602175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bfc64841-3925-4330-982e-b725726d1693 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:10.655391 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bfc64841-3925-4330-982e-b725726d1693 tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.086367 Sep 17 20:59:10.656480 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1025/2141] 10.222.0.26 () {60 vars in 1178 bytes} [Sat Sep 17 20:59:10 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:59:10.662005 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f4cc9219-712c-4132-893e-aebcf41febd1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:10.662728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f4cc9219-712c-4132-893e-aebcf41febd1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:10.669947 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-82a33a67-cafd-4d63-84cc-77d1c2df539b tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:10.672652 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4cc9219-712c-4132-893e-aebcf41febd1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:10.675348 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4cc9219-712c-4132-893e-aebcf41febd1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:10.676459 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4cc9219-712c-4132-893e-aebcf41febd1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:10.678144 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4cc9219-712c-4132-893e-aebcf41febd1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:10.678269 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82a33a67-cafd-4d63-84cc-77d1c2df539b tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:10.678628 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4cc9219-712c-4132-893e-aebcf41febd1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:10.678732 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82a33a67-cafd-4d63-84cc-77d1c2df539b tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:10.679067 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4cc9219-712c-4132-893e-aebcf41febd1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:10.679195 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82a33a67-cafd-4d63-84cc-77d1c2df539b tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:10.679880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82a33a67-cafd-4d63-84cc-77d1c2df539b tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:10.680344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82a33a67-cafd-4d63-84cc-77d1c2df539b tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:10.681159 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82a33a67-cafd-4d63-84cc-77d1c2df539b tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:10.694950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:59:10.723250 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-82a33a67-cafd-4d63-84cc-77d1c2df539b tempest-ServicesAdminNegativeV253TestJSON-2105031389 tempest-ServicesAdminNegativeV253TestJSON-2105031389-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.53 time: 0.057835 Sep 17 20:59:10.724426 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1026/2142] 10.222.0.26 () {60 vars in 1239 bytes} [Sat Sep 17 20:59:10 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:10.830461 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f4cc9219-712c-4132-893e-aebcf41febd1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:10.840159 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f4cc9219-712c-4132-893e-aebcf41febd1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1272 microversion: 2.1 time: 0.182261 Sep 17 20:59:10.859903 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1117/2143] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:10 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1272 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:59:10.885533 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6b2ae599-e8c9-4726-927b-58a86899e031 tempest-ServicesAdminNegativeV253TestJSON-1692299359 tempest-ServicesAdminNegativeV253TestJSON-1692299359-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:10.891570 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6b2ae599-e8c9-4726-927b-58a86899e031 tempest-ServicesAdminNegativeV253TestJSON-1692299359 tempest-ServicesAdminNegativeV253TestJSON-1692299359-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '130da60ae25c4da2b70be30d77e3c435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b36aa6378b248c786edfa7fa3816d86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6b2ae599-e8c9-4726-927b-58a86899e031 tempest-ServicesAdminNegativeV253TestJSON-1692299359 tempest-ServicesAdminNegativeV253TestJSON-1692299359-project] Request method failure captured: Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjUbBIyph5wrtM8PMYESu1-d1Ch9uyxmM4K_kIwIUy2nMJfVd5T8Puky_01hU0cQDpelS8C--DgTvh7av0U4yPw6eYFyXv16_iJKdefUIw6fqkBYVRZiUo8H1iKEBGgODDalS9Bvxkh7NkOhBpmT4VLjwtosd0F7TB0Wyf99Qg9_l6U Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: X-Openstack-Nova-Api-Version: 2.53 Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 6b36aa6378b248c786edfa7fa3816d86 Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1692299359 Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6b36aa6378b248c786edfa7fa3816d86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6b36aa6378b248c786edfa7fa3816d86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6b36aa6378b248c786edfa7fa3816d86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6b36aa6378b248c786edfa7fa3816d86", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1692299359 Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 6b36aa6378b248c786edfa7fa3816d86 Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1692299359 Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1692299359-project Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 130da60ae25c4da2b70be30d77e3c435 Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1692299359-project Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: action_args: {} Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise self.value Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 17 20:59:10.909215 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 17 20:59:10.912845 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:10.912845 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:10.912845 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:10.912845 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:10.912845 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:10.912845 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:10.912845 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 17 20:59:10.912845 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 17 20:59:10.912845 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 17 20:59:10.912845 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:10.912845 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6b2ae599-e8c9-4726-927b-58a86899e031 tempest-ServicesAdminNegativeV253TestJSON-1692299359 tempest-ServicesAdminNegativeV253TestJSON-1692299359-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:59:10.912845 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6b2ae599-e8c9-4726-927b-58a86899e031 tempest-ServicesAdminNegativeV253TestJSON-1692299359 tempest-ServicesAdminNegativeV253TestJSON-1692299359-project] 10.222.0.26 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.176238 Sep 17 20:59:10.912845 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1027/2144] 10.222.0.26 () {60 vars in 1178 bytes} [Sat Sep 17 20:59:10 2022] GET /compute/v2.1/os-services => generated 112 bytes in 177 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Sep 17 20:59:11.188113 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-b7ab0d60-c745-4117-9f1d-4d1353f6577b req-40a3827d-b7c9-4828-aa0c-17b76c6a875e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "563a230c-e153-4283-9d88-9e853f63574a", "tag": "8bbe7d40-e648-45cd-bb92-6c833bfc9aca"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:11.210244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b7ab0d60-c745-4117-9f1d-4d1353f6577b req-40a3827d-b7c9-4828-aa0c-17b76c6a875e service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:11.210764 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b7ab0d60-c745-4117-9f1d-4d1353f6577b req-40a3827d-b7c9-4828-aa0c-17b76c6a875e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:11.211641 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b7ab0d60-c745-4117-9f1d-4d1353f6577b req-40a3827d-b7c9-4828-aa0c-17b76c6a875e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:11.224505 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-b7ab0d60-c745-4117-9f1d-4d1353f6577b req-40a3827d-b7c9-4828-aa0c-17b76c6a875e service nova] Creating event network-changed:8bbe7d40-e648-45cd-bb92-6c833bfc9aca for instance 563a230c-e153-4283-9d88-9e853f63574a on nch1-master-1 Sep 17 20:59:11.230244 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-b7ab0d60-c745-4117-9f1d-4d1353f6577b req-40a3827d-b7c9-4828-aa0c-17b76c6a875e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047058 Sep 17 20:59:11.232133 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1118/2145] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:11.329070 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4d3d7f5f-eb61-49fb-bd1a-b64972b2e613 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:11.330005 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4d3d7f5f-eb61-49fb-bd1a-b64972b2e613 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 563a230c-e153-4283-9d88-9e853f63574a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:11.340610 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d3d7f5f-eb61-49fb-bd1a-b64972b2e613 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:11.341972 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d3d7f5f-eb61-49fb-bd1a-b64972b2e613 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:11.346611 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d3d7f5f-eb61-49fb-bd1a-b64972b2e613 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:11.349399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d3d7f5f-eb61-49fb-bd1a-b64972b2e613 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:11.350532 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d3d7f5f-eb61-49fb-bd1a-b64972b2e613 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:11.354091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d3d7f5f-eb61-49fb-bd1a-b64972b2e613 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:11.365898 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e8196bdc-bd86-4424-ae2e-97d274b90e5c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:11.372751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e8196bdc-bd86-4424-ae2e-97d274b90e5c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: ed5493ed-b5ec-49fe-994f-1a4da1e61618] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:11.405997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8196bdc-bd86-4424-ae2e-97d274b90e5c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:11.410408 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8196bdc-bd86-4424-ae2e-97d274b90e5c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:11.412308 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8196bdc-bd86-4424-ae2e-97d274b90e5c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:11.414319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8196bdc-bd86-4424-ae2e-97d274b90e5c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:11.417563 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8196bdc-bd86-4424-ae2e-97d274b90e5c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:11.419210 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8196bdc-bd86-4424-ae2e-97d274b90e5c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:11.965623 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4d3d7f5f-eb61-49fb-bd1a-b64972b2e613 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:11.980681 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4d3d7f5f-eb61-49fb-bd1a-b64972b2e613 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a" status: 200 len: 1321 microversion: 2.1 time: 0.655713 Sep 17 20:59:11.981614 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1028/2146] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:11 2022] GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a => generated 1321 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:11.986798 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f9fd8a66-07a3-4f33-857f-546beb5ec071 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:11.987675 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f9fd8a66-07a3-4f33-857f-546beb5ec071 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 67aeba5b-d1f8-4487-be79-97da63c34fc5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:11.994760 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f9fd8a66-07a3-4f33-857f-546beb5ec071 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:11.995561 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f9fd8a66-07a3-4f33-857f-546beb5ec071 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:11.996209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f9fd8a66-07a3-4f33-857f-546beb5ec071 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:11.997200 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f9fd8a66-07a3-4f33-857f-546beb5ec071 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:11.997964 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f9fd8a66-07a3-4f33-857f-546beb5ec071 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:11.998627 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f9fd8a66-07a3-4f33-857f-546beb5ec071 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:12.111784 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e8196bdc-bd86-4424-ae2e-97d274b90e5c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:12.128978 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e8196bdc-bd86-4424-ae2e-97d274b90e5c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618" status: 200 len: 1308 microversion: 2.1 time: 0.770099 Sep 17 20:59:12.129612 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1119/2147] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:11 2022] GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618 => generated 1308 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:59:12.134358 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6988e40d-c74c-47c7-b5cf-39b8316d4b0e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:12.136112 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6988e40d-c74c-47c7-b5cf-39b8316d4b0e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 71d2c783-2772-442d-b38c-920fcf895b77] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:12.146212 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f9fd8a66-07a3-4f33-857f-546beb5ec071 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:12.157036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6988e40d-c74c-47c7-b5cf-39b8316d4b0e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:12.157580 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6988e40d-c74c-47c7-b5cf-39b8316d4b0e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:12.158255 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6988e40d-c74c-47c7-b5cf-39b8316d4b0e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:12.159201 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6988e40d-c74c-47c7-b5cf-39b8316d4b0e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:12.159862 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6988e40d-c74c-47c7-b5cf-39b8316d4b0e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:12.160518 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6988e40d-c74c-47c7-b5cf-39b8316d4b0e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:12.162271 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f9fd8a66-07a3-4f33-857f-546beb5ec071 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5" status: 200 len: 1210 microversion: 2.1 time: 0.179045 Sep 17 20:59:12.163256 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1029/2148] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:11 2022] GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5 => generated 1210 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:12.167980 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8156efa7-72f3-46fc-b157-604b47f238e3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:12.168590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8156efa7-72f3-46fc-b157-604b47f238e3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:12.186650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8156efa7-72f3-46fc-b157-604b47f238e3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:12.187845 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8156efa7-72f3-46fc-b157-604b47f238e3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:12.188445 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8156efa7-72f3-46fc-b157-604b47f238e3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:12.189324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8156efa7-72f3-46fc-b157-604b47f238e3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:12.189959 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8156efa7-72f3-46fc-b157-604b47f238e3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:12.190541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8156efa7-72f3-46fc-b157-604b47f238e3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:12.290040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6988e40d-c74c-47c7-b5cf-39b8316d4b0e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:12.303491 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6988e40d-c74c-47c7-b5cf-39b8316d4b0e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77" status: 200 len: 1274 microversion: 2.1 time: 0.172656 Sep 17 20:59:12.304294 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1120/2149] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:12 2022] GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77 => generated 1274 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:12.327269 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8156efa7-72f3-46fc-b157-604b47f238e3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:12.348012 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8156efa7-72f3-46fc-b157-604b47f238e3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1272 microversion: 2.1 time: 0.183583 Sep 17 20:59:12.349280 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1030/2150] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:12 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1272 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:13.004893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-28356d59-4fe7-4bd8-8565-8544b28b444e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:13.005568 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-28356d59-4fe7-4bd8-8565-8544b28b444e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 563a230c-e153-4283-9d88-9e853f63574a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:13.021414 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28356d59-4fe7-4bd8-8565-8544b28b444e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:13.025328 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28356d59-4fe7-4bd8-8565-8544b28b444e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:13.029584 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28356d59-4fe7-4bd8-8565-8544b28b444e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:13.032093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28356d59-4fe7-4bd8-8565-8544b28b444e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:13.033423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28356d59-4fe7-4bd8-8565-8544b28b444e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:13.035517 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28356d59-4fe7-4bd8-8565-8544b28b444e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:13.156260 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-214b33f0-a72e-4a37-bf53-4887fbc76aa5 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:13.156856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-214b33f0-a72e-4a37-bf53-4887fbc76aa5 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: ed5493ed-b5ec-49fe-994f-1a4da1e61618] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:13.172754 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-214b33f0-a72e-4a37-bf53-4887fbc76aa5 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:13.176521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-214b33f0-a72e-4a37-bf53-4887fbc76aa5 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:13.178084 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-214b33f0-a72e-4a37-bf53-4887fbc76aa5 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:13.181868 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-214b33f0-a72e-4a37-bf53-4887fbc76aa5 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:13.185876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-214b33f0-a72e-4a37-bf53-4887fbc76aa5 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:13.187150 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-214b33f0-a72e-4a37-bf53-4887fbc76aa5 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:13.789497 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-28356d59-4fe7-4bd8-8565-8544b28b444e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:13.802532 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-28356d59-4fe7-4bd8-8565-8544b28b444e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a" status: 200 len: 1321 microversion: 2.1 time: 0.802320 Sep 17 20:59:13.804331 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1121/2151] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:12 2022] GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a => generated 1321 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:13.815597 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-75146c8d-7012-412d-bba8-867424aa9db1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:13.816473 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-75146c8d-7012-412d-bba8-867424aa9db1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 67aeba5b-d1f8-4487-be79-97da63c34fc5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:13.841095 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75146c8d-7012-412d-bba8-867424aa9db1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:13.842325 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75146c8d-7012-412d-bba8-867424aa9db1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:13.843368 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75146c8d-7012-412d-bba8-867424aa9db1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:13.845057 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75146c8d-7012-412d-bba8-867424aa9db1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:13.846586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75146c8d-7012-412d-bba8-867424aa9db1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:13.850146 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75146c8d-7012-412d-bba8-867424aa9db1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:14.063382 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-75146c8d-7012-412d-bba8-867424aa9db1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:14.074232 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-75146c8d-7012-412d-bba8-867424aa9db1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5" status: 200 len: 1272 microversion: 2.1 time: 0.267372 Sep 17 20:59:14.075485 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1122/2152] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:13 2022] GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5 => generated 1272 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:14.083627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-d01003ec-4887-4b59-89b3-764b86461830 req-3234762f-8246-4cc7-9ec3-5c2b0912c292 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed5493ed-b5ec-49fe-994f-1a4da1e61618", "tag": "1305b3e8-632f-48d1-b910-5428df34195c"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:14.093788 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d01003ec-4887-4b59-89b3-764b86461830 req-3234762f-8246-4cc7-9ec3-5c2b0912c292 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:14.094584 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d01003ec-4887-4b59-89b3-764b86461830 req-3234762f-8246-4cc7-9ec3-5c2b0912c292 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:14.095420 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d01003ec-4887-4b59-89b3-764b86461830 req-3234762f-8246-4cc7-9ec3-5c2b0912c292 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:14.109894 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-d01003ec-4887-4b59-89b3-764b86461830 req-3234762f-8246-4cc7-9ec3-5c2b0912c292 service nova] Creating event network-changed:1305b3e8-632f-48d1-b910-5428df34195c for instance ed5493ed-b5ec-49fe-994f-1a4da1e61618 on nch2-master-1 Sep 17 20:59:14.116040 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-d01003ec-4887-4b59-89b3-764b86461830 req-3234762f-8246-4cc7-9ec3-5c2b0912c292 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038063 Sep 17 20:59:14.117513 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1123/2153] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:14.124318 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fc0aebce-1b52-4e07-a2da-405df4b4e725 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:14.124609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-214b33f0-a72e-4a37-bf53-4887fbc76aa5 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:14.125648 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fc0aebce-1b52-4e07-a2da-405df4b4e725 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 71d2c783-2772-442d-b38c-920fcf895b77] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:14.134519 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc0aebce-1b52-4e07-a2da-405df4b4e725 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:14.135363 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc0aebce-1b52-4e07-a2da-405df4b4e725 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:14.136016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc0aebce-1b52-4e07-a2da-405df4b4e725 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:14.137151 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-214b33f0-a72e-4a37-bf53-4887fbc76aa5 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618" status: 200 len: 1308 microversion: 2.1 time: 0.983465 Sep 17 20:59:14.137507 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc0aebce-1b52-4e07-a2da-405df4b4e725 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:14.138199 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1031/2154] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:13 2022] GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618 => generated 1308 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:14.138855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc0aebce-1b52-4e07-a2da-405df4b4e725 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:14.139987 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc0aebce-1b52-4e07-a2da-405df4b4e725 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:14.148606 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b0e5dcf9-1e44-4e91-9373-ff3449e4bec9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:14.149268 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b0e5dcf9-1e44-4e91-9373-ff3449e4bec9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:14.165091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0e5dcf9-1e44-4e91-9373-ff3449e4bec9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:14.166525 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0e5dcf9-1e44-4e91-9373-ff3449e4bec9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:14.167479 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0e5dcf9-1e44-4e91-9373-ff3449e4bec9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:14.168225 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0e5dcf9-1e44-4e91-9373-ff3449e4bec9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:14.168690 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0e5dcf9-1e44-4e91-9373-ff3449e4bec9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:14.171310 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0e5dcf9-1e44-4e91-9373-ff3449e4bec9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:14.172021 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:59:14.450829 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b0e5dcf9-1e44-4e91-9373-ff3449e4bec9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:14.460843 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b0e5dcf9-1e44-4e91-9373-ff3449e4bec9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1272 microversion: 2.1 time: 0.320203 Sep 17 20:59:14.461790 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1032/2155] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:14 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1272 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:14.468821 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-f02e8976-3655-4cf0-ab4d-3e32908e6cdf req-ebeef18d-72d3-48b0-98cd-c92148e9bebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5", "name": "network-vif-plugged", "status": "completed", "tag": "b672db1d-cb3f-4522-94a2-b7c9c48b98d9"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:14.483199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f02e8976-3655-4cf0-ab4d-3e32908e6cdf req-ebeef18d-72d3-48b0-98cd-c92148e9bebf service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:14.484296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f02e8976-3655-4cf0-ab4d-3e32908e6cdf req-ebeef18d-72d3-48b0-98cd-c92148e9bebf service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:14.485347 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f02e8976-3655-4cf0-ab4d-3e32908e6cdf req-ebeef18d-72d3-48b0-98cd-c92148e9bebf service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:14.513866 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-f02e8976-3655-4cf0-ab4d-3e32908e6cdf req-ebeef18d-72d3-48b0-98cd-c92148e9bebf service nova] Creating event network-vif-plugged:b672db1d-cb3f-4522-94a2-b7c9c48b98d9 for instance caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 on nch1-master-1 Sep 17 20:59:14.525617 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-f02e8976-3655-4cf0-ab4d-3e32908e6cdf req-ebeef18d-72d3-48b0-98cd-c92148e9bebf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061064 Sep 17 20:59:14.527397 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1033/2156] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:14.686469 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fc0aebce-1b52-4e07-a2da-405df4b4e725 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:14.701929 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fc0aebce-1b52-4e07-a2da-405df4b4e725 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77" status: 200 len: 1316 microversion: 2.1 time: 0.582712 Sep 17 20:59:14.707189 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1124/2157] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:14 2022] GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77 => generated 1316 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:14.834294 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-92e3e480-08f0-4a58-9b4f-ae4688225698 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:14.835096 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-92e3e480-08f0-4a58-9b4f-ae4688225698 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 563a230c-e153-4283-9d88-9e853f63574a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:14.846917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92e3e480-08f0-4a58-9b4f-ae4688225698 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:14.848173 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92e3e480-08f0-4a58-9b4f-ae4688225698 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:14.848670 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92e3e480-08f0-4a58-9b4f-ae4688225698 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:14.849713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92e3e480-08f0-4a58-9b4f-ae4688225698 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:14.850428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92e3e480-08f0-4a58-9b4f-ae4688225698 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:14.850911 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92e3e480-08f0-4a58-9b4f-ae4688225698 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:15.099057 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e87f193b-7018-4c25-8dd7-de8c6f55851a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:15.100367 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e87f193b-7018-4c25-8dd7-de8c6f55851a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 67aeba5b-d1f8-4487-be79-97da63c34fc5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:15.109030 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e87f193b-7018-4c25-8dd7-de8c6f55851a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:15.110330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e87f193b-7018-4c25-8dd7-de8c6f55851a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:15.111257 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e87f193b-7018-4c25-8dd7-de8c6f55851a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:15.112420 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e87f193b-7018-4c25-8dd7-de8c6f55851a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:15.113212 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e87f193b-7018-4c25-8dd7-de8c6f55851a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:15.113982 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e87f193b-7018-4c25-8dd7-de8c6f55851a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:15.539580 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e87f193b-7018-4c25-8dd7-de8c6f55851a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:15.555692 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e87f193b-7018-4c25-8dd7-de8c6f55851a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5" status: 200 len: 1272 microversion: 2.1 time: 0.460518 Sep 17 20:59:15.571498 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1125/2158] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:15 2022] GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5 => generated 1272 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:15.576890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-902bfb3c-4238-4bf2-82d8-61396b3b0ade tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:15.577737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-902bfb3c-4238-4bf2-82d8-61396b3b0ade tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: ed5493ed-b5ec-49fe-994f-1a4da1e61618] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:15.591081 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-902bfb3c-4238-4bf2-82d8-61396b3b0ade tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:15.591745 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-902bfb3c-4238-4bf2-82d8-61396b3b0ade tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:15.592542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-902bfb3c-4238-4bf2-82d8-61396b3b0ade tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:15.593265 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-902bfb3c-4238-4bf2-82d8-61396b3b0ade tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:15.593761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-902bfb3c-4238-4bf2-82d8-61396b3b0ade tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:15.596608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-902bfb3c-4238-4bf2-82d8-61396b3b0ade tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:16.278020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-92e3e480-08f0-4a58-9b4f-ae4688225698 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:16.289285 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-92e3e480-08f0-4a58-9b4f-ae4688225698 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a" status: 200 len: 1321 microversion: 2.1 time: 1.461856 Sep 17 20:59:16.292957 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1034/2159] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:14 2022] GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a => generated 1321 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:16.305313 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e8d933e5-482e-4b6e-a401-f8fa048c2943 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:16.308455 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e8d933e5-482e-4b6e-a401-f8fa048c2943 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:16.312950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-902bfb3c-4238-4bf2-82d8-61396b3b0ade tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:16.335195 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-902bfb3c-4238-4bf2-82d8-61396b3b0ade tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618" status: 200 len: 1308 microversion: 2.1 time: 0.754381 Sep 17 20:59:16.338188 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1126/2160] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:15 2022] GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618 => generated 1308 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:16.342091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8d933e5-482e-4b6e-a401-f8fa048c2943 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:16.342939 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8d933e5-482e-4b6e-a401-f8fa048c2943 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:16.343581 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8d933e5-482e-4b6e-a401-f8fa048c2943 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:16.344508 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8d933e5-482e-4b6e-a401-f8fa048c2943 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:16.347784 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8d933e5-482e-4b6e-a401-f8fa048c2943 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:16.348951 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8d933e5-482e-4b6e-a401-f8fa048c2943 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:16.353304 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-54cffa90-30f5-4378-b577-a72a6547d067 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:16.354041 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-54cffa90-30f5-4378-b577-a72a6547d067 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 71d2c783-2772-442d-b38c-920fcf895b77] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:16.375348 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-54cffa90-30f5-4378-b577-a72a6547d067 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:16.379245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-54cffa90-30f5-4378-b577-a72a6547d067 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:16.381977 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-54cffa90-30f5-4378-b577-a72a6547d067 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:16.382863 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-54cffa90-30f5-4378-b577-a72a6547d067 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:16.389171 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-54cffa90-30f5-4378-b577-a72a6547d067 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:16.391503 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-54cffa90-30f5-4378-b577-a72a6547d067 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:16.995992 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e8d933e5-482e-4b6e-a401-f8fa048c2943 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:17.011443 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e8d933e5-482e-4b6e-a401-f8fa048c2943 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1314 microversion: 2.1 time: 0.713731 Sep 17 20:59:17.013515 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1035/2161] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:16 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1314 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:17.022419 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-4d7d6d0d-7eb8-4068-ab5c-c5fd50f8b5b0 req-5c8f7f20-0676-4624-973b-297c853b8d86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "563a230c-e153-4283-9d88-9e853f63574a", "name": "network-vif-plugged", "status": "completed", "tag": "8bbe7d40-e648-45cd-bb92-6c833bfc9aca"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:17.038696 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-4d7d6d0d-7eb8-4068-ab5c-c5fd50f8b5b0 req-5c8f7f20-0676-4624-973b-297c853b8d86 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:17.039787 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-4d7d6d0d-7eb8-4068-ab5c-c5fd50f8b5b0 req-5c8f7f20-0676-4624-973b-297c853b8d86 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:17.041290 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-4d7d6d0d-7eb8-4068-ab5c-c5fd50f8b5b0 req-5c8f7f20-0676-4624-973b-297c853b8d86 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:17.058966 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-54cffa90-30f5-4378-b577-a72a6547d067 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:17.065542 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-4d7d6d0d-7eb8-4068-ab5c-c5fd50f8b5b0 req-5c8f7f20-0676-4624-973b-297c853b8d86 service nova] Creating event network-vif-plugged:8bbe7d40-e648-45cd-bb92-6c833bfc9aca for instance 563a230c-e153-4283-9d88-9e853f63574a on nch1-master-1 Sep 17 20:59:17.080036 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-54cffa90-30f5-4378-b577-a72a6547d067 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77" status: 200 len: 1316 microversion: 2.1 time: 0.740396 Sep 17 20:59:17.080898 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-4d7d6d0d-7eb8-4068-ab5c-c5fd50f8b5b0 req-5c8f7f20-0676-4624-973b-297c853b8d86 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063436 Sep 17 20:59:17.082910 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1036/2162] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:17.092870 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-10b002d4-2d22-4933-a642-cb1f73a6f883 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:17.094280 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-10b002d4-2d22-4933-a642-cb1f73a6f883 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 67aeba5b-d1f8-4487-be79-97da63c34fc5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:17.105919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10b002d4-2d22-4933-a642-cb1f73a6f883 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:17.108033 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10b002d4-2d22-4933-a642-cb1f73a6f883 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:17.109182 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10b002d4-2d22-4933-a642-cb1f73a6f883 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:17.109897 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1127/2163] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:16 2022] GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77 => generated 1316 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:17.113639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10b002d4-2d22-4933-a642-cb1f73a6f883 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:17.114518 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10b002d4-2d22-4933-a642-cb1f73a6f883 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:17.116154 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10b002d4-2d22-4933-a642-cb1f73a6f883 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:17.138961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-28a9251f-27a6-49b2-908f-c13c7467927c req-490e539b-a1ec-45f9-b8d0-92af3261ba40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "126bfb0a-a567-407a-becb-4f5a814da7c6", "tag": "6804739c-1745-41d6-b864-b17b1ed8921d"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:17.185057 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-28a9251f-27a6-49b2-908f-c13c7467927c req-490e539b-a1ec-45f9-b8d0-92af3261ba40 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:17.186125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-28a9251f-27a6-49b2-908f-c13c7467927c req-490e539b-a1ec-45f9-b8d0-92af3261ba40 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:17.186799 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-28a9251f-27a6-49b2-908f-c13c7467927c req-490e539b-a1ec-45f9-b8d0-92af3261ba40 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:17.207241 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-28a9251f-27a6-49b2-908f-c13c7467927c req-490e539b-a1ec-45f9-b8d0-92af3261ba40 service nova] Creating event network-changed:6804739c-1745-41d6-b864-b17b1ed8921d for instance 126bfb0a-a567-407a-becb-4f5a814da7c6 on nch1-master-1 Sep 17 20:59:17.214065 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-28a9251f-27a6-49b2-908f-c13c7467927c req-490e539b-a1ec-45f9-b8d0-92af3261ba40 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101132 Sep 17 20:59:17.218458 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1128/2164] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:17.226405 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-7ea6a778-cc9d-430e-854d-a8de9f40e77e req-27b4d537-993c-4961-9735-4a37e6051a56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71d2c783-2772-442d-b38c-920fcf895b77", "tag": "ea7793b0-9fda-46af-b315-de942d1003d2"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:17.242302 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7ea6a778-cc9d-430e-854d-a8de9f40e77e req-27b4d537-993c-4961-9735-4a37e6051a56 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:17.243066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7ea6a778-cc9d-430e-854d-a8de9f40e77e req-27b4d537-993c-4961-9735-4a37e6051a56 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:17.243758 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7ea6a778-cc9d-430e-854d-a8de9f40e77e req-27b4d537-993c-4961-9735-4a37e6051a56 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:17.257087 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-7ea6a778-cc9d-430e-854d-a8de9f40e77e req-27b4d537-993c-4961-9735-4a37e6051a56 service nova] Creating event network-changed:ea7793b0-9fda-46af-b315-de942d1003d2 for instance 71d2c783-2772-442d-b38c-920fcf895b77 on nch2-master-1 Sep 17 20:59:17.262937 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-7ea6a778-cc9d-430e-854d-a8de9f40e77e req-27b4d537-993c-4961-9735-4a37e6051a56 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042182 Sep 17 20:59:17.264178 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1129/2165] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:17.317136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a70fea76-f434-48d9-b00a-5f70b105233f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:17.318994 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a70fea76-f434-48d9-b00a-5f70b105233f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 563a230c-e153-4283-9d88-9e853f63574a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:17.326033 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a70fea76-f434-48d9-b00a-5f70b105233f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:17.326764 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a70fea76-f434-48d9-b00a-5f70b105233f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:17.327388 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a70fea76-f434-48d9-b00a-5f70b105233f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:17.328267 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a70fea76-f434-48d9-b00a-5f70b105233f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:17.329821 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a70fea76-f434-48d9-b00a-5f70b105233f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:17.330254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a70fea76-f434-48d9-b00a-5f70b105233f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:17.398284 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-10b002d4-2d22-4933-a642-cb1f73a6f883 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:17.409072 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-10b002d4-2d22-4933-a642-cb1f73a6f883 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5" status: 200 len: 1272 microversion: 2.1 time: 0.324320 Sep 17 20:59:17.418410 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1037/2166] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:17 2022] GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5 => generated 1272 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:17.425322 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ff723fa8-b4f7-451d-8a99-797b25077ead tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:17.426503 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ff723fa8-b4f7-451d-8a99-797b25077ead tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: ed5493ed-b5ec-49fe-994f-1a4da1e61618] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:17.435202 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff723fa8-b4f7-451d-8a99-797b25077ead tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:17.436404 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff723fa8-b4f7-451d-8a99-797b25077ead tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:17.437257 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff723fa8-b4f7-451d-8a99-797b25077ead tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:17.438800 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff723fa8-b4f7-451d-8a99-797b25077ead tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:17.439174 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff723fa8-b4f7-451d-8a99-797b25077ead tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:17.439604 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff723fa8-b4f7-451d-8a99-797b25077ead tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:17.993147 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a70fea76-f434-48d9-b00a-5f70b105233f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:18.010387 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a70fea76-f434-48d9-b00a-5f70b105233f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a" status: 200 len: 1321 microversion: 2.1 time: 0.697373 Sep 17 20:59:18.015194 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1130/2167] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:17 2022] GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a => generated 1321 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:18.021160 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ff723fa8-b4f7-451d-8a99-797b25077ead tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:18.031792 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ff723fa8-b4f7-451d-8a99-797b25077ead tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618" status: 200 len: 1308 microversion: 2.1 time: 0.611852 Sep 17 20:59:18.032732 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1038/2168] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:17 2022] GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618 => generated 1308 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:18.041751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-918359d6-f30d-44a0-ad42-6e57cc9b0115 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:18.042622 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-918359d6-f30d-44a0-ad42-6e57cc9b0115 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:18.075408 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-918359d6-f30d-44a0-ad42-6e57cc9b0115 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:18.077231 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-918359d6-f30d-44a0-ad42-6e57cc9b0115 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:18.077878 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-918359d6-f30d-44a0-ad42-6e57cc9b0115 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:18.078809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-918359d6-f30d-44a0-ad42-6e57cc9b0115 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:18.079526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-918359d6-f30d-44a0-ad42-6e57cc9b0115 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:18.080038 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-918359d6-f30d-44a0-ad42-6e57cc9b0115 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:18.120317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2eff597c-2802-4896-835b-bbc63aa466c8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:18.120970 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2eff597c-2802-4896-835b-bbc63aa466c8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 71d2c783-2772-442d-b38c-920fcf895b77] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:18.135389 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2eff597c-2802-4896-835b-bbc63aa466c8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:18.135912 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2eff597c-2802-4896-835b-bbc63aa466c8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:18.136491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2eff597c-2802-4896-835b-bbc63aa466c8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:18.137232 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2eff597c-2802-4896-835b-bbc63aa466c8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:18.137801 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2eff597c-2802-4896-835b-bbc63aa466c8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:18.138240 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2eff597c-2802-4896-835b-bbc63aa466c8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:18.765470 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-918359d6-f30d-44a0-ad42-6e57cc9b0115 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:18.789516 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-918359d6-f30d-44a0-ad42-6e57cc9b0115 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1314 microversion: 2.1 time: 0.753531 Sep 17 20:59:18.792392 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1131/2169] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:18 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1314 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:18.817220 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cf873e80-5903-4b4c-bbfa-e072dc6c705e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:18.818433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cf873e80-5903-4b4c-bbfa-e072dc6c705e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 67aeba5b-d1f8-4487-be79-97da63c34fc5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:18.828316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cf873e80-5903-4b4c-bbfa-e072dc6c705e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:18.829063 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cf873e80-5903-4b4c-bbfa-e072dc6c705e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:18.829899 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cf873e80-5903-4b4c-bbfa-e072dc6c705e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:18.830761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cf873e80-5903-4b4c-bbfa-e072dc6c705e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:18.832192 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cf873e80-5903-4b4c-bbfa-e072dc6c705e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:18.832960 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cf873e80-5903-4b4c-bbfa-e072dc6c705e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:18.852803 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2eff597c-2802-4896-835b-bbc63aa466c8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:18.888754 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2eff597c-2802-4896-835b-bbc63aa466c8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77" status: 200 len: 1316 microversion: 2.1 time: 0.777527 Sep 17 20:59:18.893011 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1039/2170] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:18 2022] GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77 => generated 1316 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:19.042051 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5823fb19-2f80-43b1-a556-46e96edf9802 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:19.042974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5823fb19-2f80-43b1-a556-46e96edf9802 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 563a230c-e153-4283-9d88-9e853f63574a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:19.050921 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5823fb19-2f80-43b1-a556-46e96edf9802 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:19.051728 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5823fb19-2f80-43b1-a556-46e96edf9802 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:19.052364 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5823fb19-2f80-43b1-a556-46e96edf9802 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:19.053347 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5823fb19-2f80-43b1-a556-46e96edf9802 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:19.053963 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5823fb19-2f80-43b1-a556-46e96edf9802 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:19.054855 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5823fb19-2f80-43b1-a556-46e96edf9802 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:19.534126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=34 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:59:19.629308 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cf873e80-5903-4b4c-bbfa-e072dc6c705e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:19.646324 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cf873e80-5903-4b4c-bbfa-e072dc6c705e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5" status: 200 len: 1314 microversion: 2.1 time: 0.850507 Sep 17 20:59:19.647206 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1132/2171] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:18 2022] GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5 => generated 1314 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:19.652545 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b61537cd-9acd-4554-ab45-35f3c5355e08 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:19.653520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b61537cd-9acd-4554-ab45-35f3c5355e08 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: ed5493ed-b5ec-49fe-994f-1a4da1e61618] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:19.660268 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b61537cd-9acd-4554-ab45-35f3c5355e08 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:19.660940 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b61537cd-9acd-4554-ab45-35f3c5355e08 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:19.661552 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b61537cd-9acd-4554-ab45-35f3c5355e08 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:19.662457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b61537cd-9acd-4554-ab45-35f3c5355e08 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:19.663118 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b61537cd-9acd-4554-ab45-35f3c5355e08 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:19.663696 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b61537cd-9acd-4554-ab45-35f3c5355e08 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:20.084721 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5823fb19-2f80-43b1-a556-46e96edf9802 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:20.103973 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5823fb19-2f80-43b1-a556-46e96edf9802 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a" status: 200 len: 1513 microversion: 2.1 time: 1.065670 Sep 17 20:59:20.104926 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1040/2172] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:19 2022] GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a => generated 1513 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:59:20.109995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-4633d5d9-7cd0-451d-bc44-40e07c9a6122 req-8d326f97-dc2d-4254-89a7-27ba6bb015dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "526330e7-cd66-44c3-9453-ea80479469a8", "name": "network-vif-plugged", "status": "completed", "tag": "c93203a9-6cc3-4130-9503-a63df25cd048"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:20.151941 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-4633d5d9-7cd0-451d-bc44-40e07c9a6122 req-8d326f97-dc2d-4254-89a7-27ba6bb015dd service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:20.152460 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-4633d5d9-7cd0-451d-bc44-40e07c9a6122 req-8d326f97-dc2d-4254-89a7-27ba6bb015dd service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:20.152890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-4633d5d9-7cd0-451d-bc44-40e07c9a6122 req-8d326f97-dc2d-4254-89a7-27ba6bb015dd service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:20.187261 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-4633d5d9-7cd0-451d-bc44-40e07c9a6122 req-8d326f97-dc2d-4254-89a7-27ba6bb015dd service nova] Creating event network-vif-plugged:c93203a9-6cc3-4130-9503-a63df25cd048 for instance 526330e7-cd66-44c3-9453-ea80479469a8 on nch2-master-1 Sep 17 20:59:20.208339 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-4633d5d9-7cd0-451d-bc44-40e07c9a6122 req-8d326f97-dc2d-4254-89a7-27ba6bb015dd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094062 Sep 17 20:59:20.209448 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1041/2173] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:20.224805 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-cc3c0251-30bd-4e66-bfcb-2389f2f90047 req-9368b667-40e6-4e46-805c-ef77269ae3fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cbeb946-182e-4489-b637-556194f5722e", "tag": "37410e23-230b-4735-b847-6de46f2c7ac9"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:20.253024 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-cc3c0251-30bd-4e66-bfcb-2389f2f90047 req-9368b667-40e6-4e46-805c-ef77269ae3fe service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:20.253844 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-cc3c0251-30bd-4e66-bfcb-2389f2f90047 req-9368b667-40e6-4e46-805c-ef77269ae3fe service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:20.255772 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-cc3c0251-30bd-4e66-bfcb-2389f2f90047 req-9368b667-40e6-4e46-805c-ef77269ae3fe service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:20.296779 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-cc3c0251-30bd-4e66-bfcb-2389f2f90047 req-9368b667-40e6-4e46-805c-ef77269ae3fe service nova] Creating event network-changed:37410e23-230b-4735-b847-6de46f2c7ac9 for instance 8cbeb946-182e-4489-b637-556194f5722e on nch1-master-1 Sep 17 20:59:20.308831 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-cc3c0251-30bd-4e66-bfcb-2389f2f90047 req-9368b667-40e6-4e46-805c-ef77269ae3fe service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097345 Sep 17 20:59:20.312362 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1042/2174] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:20.319729 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-773036cf-73ab-4a4d-9aa7-384c8b90936a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:20.325212 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-773036cf-73ab-4a4d-9aa7-384c8b90936a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:20.341389 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-773036cf-73ab-4a4d-9aa7-384c8b90936a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:20.343223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-773036cf-73ab-4a4d-9aa7-384c8b90936a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:20.343688 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-773036cf-73ab-4a4d-9aa7-384c8b90936a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:20.348285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-773036cf-73ab-4a4d-9aa7-384c8b90936a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:20.348978 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-773036cf-73ab-4a4d-9aa7-384c8b90936a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:20.349442 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-773036cf-73ab-4a4d-9aa7-384c8b90936a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:20.424306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b61537cd-9acd-4554-ab45-35f3c5355e08 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:20.434448 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b61537cd-9acd-4554-ab45-35f3c5355e08 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618" status: 200 len: 1308 microversion: 2.1 time: 0.785093 Sep 17 20:59:20.435668 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1133/2175] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:19 2022] GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618 => generated 1308 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:20.442412 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-026948d9-cdf0-4b1b-9b58-d98b7f308194 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:20.443323 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-026948d9-cdf0-4b1b-9b58-d98b7f308194 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 71d2c783-2772-442d-b38c-920fcf895b77] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:20.451293 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-026948d9-cdf0-4b1b-9b58-d98b7f308194 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:20.452068 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-026948d9-cdf0-4b1b-9b58-d98b7f308194 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:20.452707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-026948d9-cdf0-4b1b-9b58-d98b7f308194 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:20.453656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-026948d9-cdf0-4b1b-9b58-d98b7f308194 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:20.454417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-026948d9-cdf0-4b1b-9b58-d98b7f308194 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:20.455049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-026948d9-cdf0-4b1b-9b58-d98b7f308194 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:20.510995 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=63,nova_cell0:UPDATE=7 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:59:20.538721 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=32 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:59:20.696291 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=24 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:59:20.987218 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-773036cf-73ab-4a4d-9aa7-384c8b90936a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:21.023182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-026948d9-cdf0-4b1b-9b58-d98b7f308194 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:21.038194 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-026948d9-cdf0-4b1b-9b58-d98b7f308194 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77" status: 200 len: 1316 microversion: 2.1 time: 0.600945 Sep 17 20:59:21.039361 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1134/2176] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:20 2022] GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77 => generated 1316 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:21.042911 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-773036cf-73ab-4a4d-9aa7-384c8b90936a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1314 microversion: 2.1 time: 0.728899 Sep 17 20:59:21.043884 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1043/2177] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:20 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1314 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:21.044394 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a9f79eb6-59af-41e1-bf1c-716006d5f4a4 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:21.049583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1ae74ff9-11e6-4ded-bd25-4c20000039b8 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:21.050568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1ae74ff9-11e6-4ded-bd25-4c20000039b8 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 67aeba5b-d1f8-4487-be79-97da63c34fc5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:21.057577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ae74ff9-11e6-4ded-bd25-4c20000039b8 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:21.058445 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ae74ff9-11e6-4ded-bd25-4c20000039b8 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:21.059108 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ae74ff9-11e6-4ded-bd25-4c20000039b8 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:21.060081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ae74ff9-11e6-4ded-bd25-4c20000039b8 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:21.060872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ae74ff9-11e6-4ded-bd25-4c20000039b8 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:21.061542 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ae74ff9-11e6-4ded-bd25-4c20000039b8 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:21.070484 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a9f79eb6-59af-41e1-bf1c-716006d5f4a4 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:21.077152 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a9f79eb6-59af-41e1-bf1c-716006d5f4a4 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:21.077680 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a9f79eb6-59af-41e1-bf1c-716006d5f4a4 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:21.078287 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a9f79eb6-59af-41e1-bf1c-716006d5f4a4 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:21.079151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a9f79eb6-59af-41e1-bf1c-716006d5f4a4 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:21.079749 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a9f79eb6-59af-41e1-bf1c-716006d5f4a4 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:21.080317 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a9f79eb6-59af-41e1-bf1c-716006d5f4a4 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:21.794532 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1ae74ff9-11e6-4ded-bd25-4c20000039b8 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:21.807123 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1ae74ff9-11e6-4ded-bd25-4c20000039b8 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5" status: 200 len: 1314 microversion: 2.1 time: 0.758363 Sep 17 20:59:21.810596 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1044/2178] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:21 2022] GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5 => generated 1314 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:21.823353 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4507c577-a02e-4b38-b4a9-94576a7279c7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:21.824227 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4507c577-a02e-4b38-b4a9-94576a7279c7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: ed5493ed-b5ec-49fe-994f-1a4da1e61618] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:21.840812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4507c577-a02e-4b38-b4a9-94576a7279c7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:21.842990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4507c577-a02e-4b38-b4a9-94576a7279c7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:21.844163 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4507c577-a02e-4b38-b4a9-94576a7279c7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:21.847111 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4507c577-a02e-4b38-b4a9-94576a7279c7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:21.850037 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4507c577-a02e-4b38-b4a9-94576a7279c7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:21.850894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4507c577-a02e-4b38-b4a9-94576a7279c7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:22.018427 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a9f79eb6-59af-41e1-bf1c-716006d5f4a4 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:22.030597 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a9f79eb6-59af-41e1-bf1c-716006d5f4a4 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5" status: 200 len: 1511 microversion: 2.1 time: 0.989985 Sep 17 20:59:22.031226 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1135/2179] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:21 2022] GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 => generated 1511 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:22.059010 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ce2ad869-125c-46bc-9152-4e4cceb52a9d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:22.060011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ce2ad869-125c-46bc-9152-4e4cceb52a9d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 526330e7-cd66-44c3-9453-ea80479469a8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:22.070835 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce2ad869-125c-46bc-9152-4e4cceb52a9d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:22.071660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce2ad869-125c-46bc-9152-4e4cceb52a9d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:22.072296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce2ad869-125c-46bc-9152-4e4cceb52a9d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:22.073304 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce2ad869-125c-46bc-9152-4e4cceb52a9d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:22.074301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce2ad869-125c-46bc-9152-4e4cceb52a9d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:22.075047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce2ad869-125c-46bc-9152-4e4cceb52a9d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:22.538122 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4507c577-a02e-4b38-b4a9-94576a7279c7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:22.566284 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4507c577-a02e-4b38-b4a9-94576a7279c7 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618" status: 200 len: 1308 microversion: 2.1 time: 0.750793 Sep 17 20:59:22.593497 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1045/2180] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:21 2022] GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618 => generated 1308 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:22.642509 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2f8238b8-ed7e-47e7-913a-e5f227185e8a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:22.649908 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2f8238b8-ed7e-47e7-913a-e5f227185e8a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 71d2c783-2772-442d-b38c-920fcf895b77] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:22.660854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f8238b8-ed7e-47e7-913a-e5f227185e8a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:22.661677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f8238b8-ed7e-47e7-913a-e5f227185e8a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:22.662421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f8238b8-ed7e-47e7-913a-e5f227185e8a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:22.663312 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f8238b8-ed7e-47e7-913a-e5f227185e8a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:22.663899 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f8238b8-ed7e-47e7-913a-e5f227185e8a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:22.664524 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f8238b8-ed7e-47e7-913a-e5f227185e8a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:23.124694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ce2ad869-125c-46bc-9152-4e4cceb52a9d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:23.137350 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ce2ad869-125c-46bc-9152-4e4cceb52a9d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/526330e7-cd66-44c3-9453-ea80479469a8" status: 200 len: 1320 microversion: 2.1 time: 1.084589 Sep 17 20:59:23.140491 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1136/2181] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:22 2022] GET /compute/v2.1/servers/526330e7-cd66-44c3-9453-ea80479469a8 => generated 1320 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:59:23.167021 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-018e9aee-f3eb-4741-b06e-cd871c2a182d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:23.168890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-018e9aee-f3eb-4741-b06e-cd871c2a182d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:23.190803 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-018e9aee-f3eb-4741-b06e-cd871c2a182d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:23.191754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-018e9aee-f3eb-4741-b06e-cd871c2a182d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:23.196293 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-018e9aee-f3eb-4741-b06e-cd871c2a182d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:23.197287 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-018e9aee-f3eb-4741-b06e-cd871c2a182d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:23.197935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-018e9aee-f3eb-4741-b06e-cd871c2a182d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:23.198515 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-018e9aee-f3eb-4741-b06e-cd871c2a182d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:23.264553 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2f8238b8-ed7e-47e7-913a-e5f227185e8a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:23.278211 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2f8238b8-ed7e-47e7-913a-e5f227185e8a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77" status: 200 len: 1316 microversion: 2.1 time: 0.646723 Sep 17 20:59:23.278996 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1046/2182] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:22 2022] GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77 => generated 1316 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:23.300401 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-0a64f893-4c68-49ed-b2bd-5dc3c3d8b058 req-ac10cad5-95e9-4cc3-9268-d11fedba0f76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed5493ed-b5ec-49fe-994f-1a4da1e61618", "name": "network-vif-plugged", "status": "completed", "tag": "1305b3e8-632f-48d1-b910-5428df34195c"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:23.310830 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-0a64f893-4c68-49ed-b2bd-5dc3c3d8b058 req-ac10cad5-95e9-4cc3-9268-d11fedba0f76 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:23.311579 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-0a64f893-4c68-49ed-b2bd-5dc3c3d8b058 req-ac10cad5-95e9-4cc3-9268-d11fedba0f76 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:23.312170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-0a64f893-4c68-49ed-b2bd-5dc3c3d8b058 req-ac10cad5-95e9-4cc3-9268-d11fedba0f76 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:23.317075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:59:23.328266 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-0a64f893-4c68-49ed-b2bd-5dc3c3d8b058 req-ac10cad5-95e9-4cc3-9268-d11fedba0f76 service nova] Creating event network-vif-plugged:1305b3e8-632f-48d1-b910-5428df34195c for instance ed5493ed-b5ec-49fe-994f-1a4da1e61618 on nch2-master-1 Sep 17 20:59:23.335192 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-0a64f893-4c68-49ed-b2bd-5dc3c3d8b058 req-ac10cad5-95e9-4cc3-9268-d11fedba0f76 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043449 Sep 17 20:59:23.336083 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1047/2183] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:23.341588 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-7936bfd8-b5a1-4f9d-a388-31d6bb5322ef req-7a868f5c-f8c4-420d-bc02-129037499334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67aeba5b-d1f8-4487-be79-97da63c34fc5", "tag": "1058d1b5-6690-4868-b306-534692f06487"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:23.352539 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-7936bfd8-b5a1-4f9d-a388-31d6bb5322ef req-7a868f5c-f8c4-420d-bc02-129037499334 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:23.353311 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-7936bfd8-b5a1-4f9d-a388-31d6bb5322ef req-7a868f5c-f8c4-420d-bc02-129037499334 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:23.354045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-7936bfd8-b5a1-4f9d-a388-31d6bb5322ef req-7a868f5c-f8c4-420d-bc02-129037499334 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:23.368318 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-7936bfd8-b5a1-4f9d-a388-31d6bb5322ef req-7a868f5c-f8c4-420d-bc02-129037499334 service nova] Creating event network-changed:1058d1b5-6690-4868-b306-534692f06487 for instance 67aeba5b-d1f8-4487-be79-97da63c34fc5 on nch1-master-1 Sep 17 20:59:23.373773 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-7936bfd8-b5a1-4f9d-a388-31d6bb5322ef req-7a868f5c-f8c4-420d-bc02-129037499334 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036069 Sep 17 20:59:23.374959 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1048/2184] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:23.382118 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-390a4359-8dba-4afb-b6b5-24831002da75 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:23.383225 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-390a4359-8dba-4afb-b6b5-24831002da75 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 67aeba5b-d1f8-4487-be79-97da63c34fc5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:23.391033 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-390a4359-8dba-4afb-b6b5-24831002da75 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:23.391735 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-390a4359-8dba-4afb-b6b5-24831002da75 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:23.392405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-390a4359-8dba-4afb-b6b5-24831002da75 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:23.393521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-390a4359-8dba-4afb-b6b5-24831002da75 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:23.394151 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-390a4359-8dba-4afb-b6b5-24831002da75 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:23.394737 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-390a4359-8dba-4afb-b6b5-24831002da75 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:24.457072 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-390a4359-8dba-4afb-b6b5-24831002da75 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:24.467381 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-390a4359-8dba-4afb-b6b5-24831002da75 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5" status: 200 len: 1314 microversion: 2.1 time: 1.091025 Sep 17 20:59:24.487963 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1049/2185] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:23 2022] GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5 => generated 1314 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:24.502691 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7cca55b8-2ff2-4cd6-b6dd-aeffc3521509 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:24.503918 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7cca55b8-2ff2-4cd6-b6dd-aeffc3521509 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: ed5493ed-b5ec-49fe-994f-1a4da1e61618] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:24.511396 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cca55b8-2ff2-4cd6-b6dd-aeffc3521509 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:24.513179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cca55b8-2ff2-4cd6-b6dd-aeffc3521509 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:24.513825 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cca55b8-2ff2-4cd6-b6dd-aeffc3521509 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:24.515096 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cca55b8-2ff2-4cd6-b6dd-aeffc3521509 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:24.515710 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cca55b8-2ff2-4cd6-b6dd-aeffc3521509 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:24.517264 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cca55b8-2ff2-4cd6-b6dd-aeffc3521509 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:24.584626 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-018e9aee-f3eb-4741-b06e-cd871c2a182d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:24.598109 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-018e9aee-f3eb-4741-b06e-cd871c2a182d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1314 microversion: 2.1 time: 1.455254 Sep 17 20:59:24.598694 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1137/2186] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:23 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1314 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:24.603766 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ea02ba54-e8d0-43a0-81c2-70f73533d87f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:24.609181 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ea02ba54-e8d0-43a0-81c2-70f73533d87f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 526330e7-cd66-44c3-9453-ea80479469a8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:24.621452 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea02ba54-e8d0-43a0-81c2-70f73533d87f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:24.625809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea02ba54-e8d0-43a0-81c2-70f73533d87f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:24.630042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea02ba54-e8d0-43a0-81c2-70f73533d87f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:24.631140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea02ba54-e8d0-43a0-81c2-70f73533d87f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:24.631789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea02ba54-e8d0-43a0-81c2-70f73533d87f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:24.632426 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea02ba54-e8d0-43a0-81c2-70f73533d87f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:25.149220 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7cca55b8-2ff2-4cd6-b6dd-aeffc3521509 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:25.157490 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7cca55b8-2ff2-4cd6-b6dd-aeffc3521509 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618" status: 200 len: 1308 microversion: 2.1 time: 0.668129 Sep 17 20:59:25.158066 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1050/2187] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:24 2022] GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618 => generated 1308 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:25.179371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0e407219-5312-4d70-96e1-2fa40b27bad3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:25.180102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0e407219-5312-4d70-96e1-2fa40b27bad3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 71d2c783-2772-442d-b38c-920fcf895b77] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:25.182506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ea02ba54-e8d0-43a0-81c2-70f73533d87f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:25.192134 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ea02ba54-e8d0-43a0-81c2-70f73533d87f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/526330e7-cd66-44c3-9453-ea80479469a8" status: 200 len: 1512 microversion: 2.1 time: 0.592165 Sep 17 20:59:25.195678 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e407219-5312-4d70-96e1-2fa40b27bad3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:25.196190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e407219-5312-4d70-96e1-2fa40b27bad3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:25.196652 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e407219-5312-4d70-96e1-2fa40b27bad3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:25.199553 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1138/2188] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:24 2022] GET /compute/v2.1/servers/526330e7-cd66-44c3-9453-ea80479469a8 => generated 1512 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:25.200756 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e407219-5312-4d70-96e1-2fa40b27bad3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:25.201247 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e407219-5312-4d70-96e1-2fa40b27bad3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:25.201747 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e407219-5312-4d70-96e1-2fa40b27bad3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:25.235062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d135df7f-69c1-4c29-b48b-41b3eabe2e7d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:25.240383 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d135df7f-69c1-4c29-b48b-41b3eabe2e7d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:25.241353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d135df7f-69c1-4c29-b48b-41b3eabe2e7d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898'} {{(pid=140524) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 20:59:25.256468 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d135df7f-69c1-4c29-b48b-41b3eabe2e7d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:25.257304 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d135df7f-69c1-4c29-b48b-41b3eabe2e7d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:25.258079 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d135df7f-69c1-4c29-b48b-41b3eabe2e7d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:25.259226 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d135df7f-69c1-4c29-b48b-41b3eabe2e7d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:25.260007 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d135df7f-69c1-4c29-b48b-41b3eabe2e7d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:25.260685 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d135df7f-69c1-4c29-b48b-41b3eabe2e7d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:25.398262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.multi_cell_list [None req-d135df7f-69c1-4c29-b48b-41b3eabe2e7d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140524) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 20:59:25.533057 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d135df7f-69c1-4c29-b48b-41b3eabe2e7d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:25.540424 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d135df7f-69c1-4c29-b48b-41b3eabe2e7d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:25.541432 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d135df7f-69c1-4c29-b48b-41b3eabe2e7d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:25.542279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d135df7f-69c1-4c29-b48b-41b3eabe2e7d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:25.736324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0e407219-5312-4d70-96e1-2fa40b27bad3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:25.745550 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0e407219-5312-4d70-96e1-2fa40b27bad3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77" status: 200 len: 1316 microversion: 2.1 time: 0.572735 Sep 17 20:59:25.781775 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1051/2189] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:25 2022] GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77 => generated 1316 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:25.787345 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4c025a3f-3966-4b31-bc2e-f5a90246505e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:25.807442 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4c025a3f-3966-4b31-bc2e-f5a90246505e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 67aeba5b-d1f8-4487-be79-97da63c34fc5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:25.823604 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c025a3f-3966-4b31-bc2e-f5a90246505e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:25.824321 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c025a3f-3966-4b31-bc2e-f5a90246505e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:25.825007 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c025a3f-3966-4b31-bc2e-f5a90246505e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:25.826008 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c025a3f-3966-4b31-bc2e-f5a90246505e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:25.826616 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c025a3f-3966-4b31-bc2e-f5a90246505e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:25.827525 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c025a3f-3966-4b31-bc2e-f5a90246505e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:25.835752 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d135df7f-69c1-4c29-b48b-41b3eabe2e7d tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1516 microversion: 2.1 time: 0.613626 Sep 17 20:59:25.836370 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1139/2190] 10.222.0.26 () {58 vars in 1167 bytes} [Sat Sep 17 20:59:25 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1516 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:59:25.852154 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-23d64620-f918-42a0-86a7-ee232a2f86b5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:25.852154 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-23d64620-f918-42a0-86a7-ee232a2f86b5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:25.852154 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:59:25.883999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23d64620-f918-42a0-86a7-ee232a2f86b5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:25.884518 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23d64620-f918-42a0-86a7-ee232a2f86b5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:25.884971 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23d64620-f918-42a0-86a7-ee232a2f86b5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:25.885734 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23d64620-f918-42a0-86a7-ee232a2f86b5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:25.886199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23d64620-f918-42a0-86a7-ee232a2f86b5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:25.886634 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23d64620-f918-42a0-86a7-ee232a2f86b5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:26.324005 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4c025a3f-3966-4b31-bc2e-f5a90246505e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:26.335126 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-23d64620-f918-42a0-86a7-ee232a2f86b5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:26.357340 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4c025a3f-3966-4b31-bc2e-f5a90246505e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5" status: 200 len: 1314 microversion: 2.1 time: 0.573548 Sep 17 20:59:26.358329 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1052/2191] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:25 2022] GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5 => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:26.359981 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-23d64620-f918-42a0-86a7-ee232a2f86b5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1314 microversion: 2.1 time: 0.522497 Sep 17 20:59:26.360875 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1140/2192] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:25 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1314 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:26.368274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-59ccbffa-0485-4ea6-b397-595791f3cb5d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:26.368827 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-59ccbffa-0485-4ea6-b397-595791f3cb5d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: ed5493ed-b5ec-49fe-994f-1a4da1e61618] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:26.383440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dcf52372-1465-4198-b2da-60551e94762e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:26.391066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59ccbffa-0485-4ea6-b397-595791f3cb5d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:26.391576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59ccbffa-0485-4ea6-b397-595791f3cb5d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:26.392027 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59ccbffa-0485-4ea6-b397-595791f3cb5d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:26.392756 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59ccbffa-0485-4ea6-b397-595791f3cb5d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:26.393221 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59ccbffa-0485-4ea6-b397-595791f3cb5d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:26.393761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59ccbffa-0485-4ea6-b397-595791f3cb5d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:26.394651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dcf52372-1465-4198-b2da-60551e94762e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:26.395581 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dcf52372-1465-4198-b2da-60551e94762e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-539837767', 'deleted': False, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898'} {{(pid=140523) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 20:59:26.404365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dcf52372-1465-4198-b2da-60551e94762e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:26.404862 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dcf52372-1465-4198-b2da-60551e94762e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:26.405562 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dcf52372-1465-4198-b2da-60551e94762e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:26.419945 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dcf52372-1465-4198-b2da-60551e94762e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:26.426504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:59:26.434436 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dcf52372-1465-4198-b2da-60551e94762e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:26.435362 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dcf52372-1465-4198-b2da-60551e94762e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:26.592514 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.multi_cell_list [None req-dcf52372-1465-4198-b2da-60551e94762e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140523) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 20:59:26.722011 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dcf52372-1465-4198-b2da-60551e94762e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:26.726231 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-59ccbffa-0485-4ea6-b397-595791f3cb5d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:26.731218 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dcf52372-1465-4198-b2da-60551e94762e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:26.731960 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dcf52372-1465-4198-b2da-60551e94762e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:26.734931 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-59ccbffa-0485-4ea6-b397-595791f3cb5d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618" status: 200 len: 1487 microversion: 2.1 time: 0.371288 Sep 17 20:59:26.735528 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1141/2193] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:26 2022] GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618 => generated 1487 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:26.740045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dcf52372-1465-4198-b2da-60551e94762e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:26.758257 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6ecf56a6-cb5d-471d-8b47-6e3325b45138 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-45925102"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:26.766213 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6ecf56a6-cb5d-471d-8b47-6e3325b45138 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: ed5493ed-b5ec-49fe-994f-1a4da1e61618] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:26.780046 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ecf56a6-cb5d-471d-8b47-6e3325b45138 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:26.780654 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ecf56a6-cb5d-471d-8b47-6e3325b45138 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:26.781191 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ecf56a6-cb5d-471d-8b47-6e3325b45138 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:26.782113 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ecf56a6-cb5d-471d-8b47-6e3325b45138 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:26.782634 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ecf56a6-cb5d-471d-8b47-6e3325b45138 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:26.783290 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ecf56a6-cb5d-471d-8b47-6e3325b45138 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:27.003221 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dcf52372-1465-4198-b2da-60551e94762e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-539837767" status: 200 len: 1514 microversion: 2.1 time: 0.643012 Sep 17 20:59:27.013534 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1053/2194] 10.222.0.26 () {58 vars in 1261 bytes} [Sat Sep 17 20:59:26 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-539837767 => generated 1514 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:27.013534 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-be4ceb37-39de-4468-a5df-69e539695587 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:27.013534 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-be4ceb37-39de-4468-a5df-69e539695587 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 71d2c783-2772-442d-b38c-920fcf895b77] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:27.026632 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be4ceb37-39de-4468-a5df-69e539695587 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:27.026632 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be4ceb37-39de-4468-a5df-69e539695587 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:27.026936 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be4ceb37-39de-4468-a5df-69e539695587 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:27.027627 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be4ceb37-39de-4468-a5df-69e539695587 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:27.028137 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be4ceb37-39de-4468-a5df-69e539695587 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:27.028563 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be4ceb37-39de-4468-a5df-69e539695587 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:27.098439 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6ecf56a6-cb5d-471d-8b47-6e3325b45138 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "POST /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618/action" status: 202 len: 0 microversion: 2.1 time: 0.343864 Sep 17 20:59:27.099908 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1142/2195] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:59:26 2022] POST /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 17 20:59:27.111054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cd9cae23-1963-4f11-b13b-226dec538275 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:27.118300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cd9cae23-1963-4f11-b13b-226dec538275 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:27.119849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cd9cae23-1963-4f11-b13b-226dec538275 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898'} {{(pid=140524) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 20:59:27.128159 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd9cae23-1963-4f11-b13b-226dec538275 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:27.128920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd9cae23-1963-4f11-b13b-226dec538275 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:27.129468 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd9cae23-1963-4f11-b13b-226dec538275 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:27.130873 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd9cae23-1963-4f11-b13b-226dec538275 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:27.132056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd9cae23-1963-4f11-b13b-226dec538275 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:27.132676 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd9cae23-1963-4f11-b13b-226dec538275 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:27.272600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.multi_cell_list [None req-cd9cae23-1963-4f11-b13b-226dec538275 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140524) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 20:59:27.403559 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cd9cae23-1963-4f11-b13b-226dec538275 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:27.413522 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd9cae23-1963-4f11-b13b-226dec538275 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:27.413522 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd9cae23-1963-4f11-b13b-226dec538275 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:27.413936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd9cae23-1963-4f11-b13b-226dec538275 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:27.707340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-be4ceb37-39de-4468-a5df-69e539695587 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:27.724940 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-be4ceb37-39de-4468-a5df-69e539695587 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77" status: 200 len: 1316 microversion: 2.1 time: 0.719320 Sep 17 20:59:27.727518 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1054/2196] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:27 2022] GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77 => generated 1316 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:27.735712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5eb600b2-cea4-47f8-9966-88c15f52162d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4c16ee0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:27.761545 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cd9cae23-1963-4f11-b13b-226dec538275 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 0.660016 Sep 17 20:59:27.764784 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1143/2197] 10.222.0.26 () {58 vars in 1173 bytes} [Sat Sep 17 20:59:27 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:27.785406 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bd55670e-8d2a-4487-82c9-6bd166634bd8 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:27.788150 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bd55670e-8d2a-4487-82c9-6bd166634bd8 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 67aeba5b-d1f8-4487-be79-97da63c34fc5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:27.809649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd55670e-8d2a-4487-82c9-6bd166634bd8 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:27.809877 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5eb600b2-cea4-47f8-9966-88c15f52162d tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/af38cca4-fecd-47dc-85ab-6306f0a73a45" status: 200 len: 1412 microversion: 2.1 time: 0.080813 Sep 17 20:59:27.810330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd55670e-8d2a-4487-82c9-6bd166634bd8 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:27.810592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd55670e-8d2a-4487-82c9-6bd166634bd8 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:27.813841 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd55670e-8d2a-4487-82c9-6bd166634bd8 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:27.814555 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd55670e-8d2a-4487-82c9-6bd166634bd8 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:27.820604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd55670e-8d2a-4487-82c9-6bd166634bd8 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:27.822096 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1055/2198] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:59:27 2022] GET /compute/v2.1/images/af38cca4-fecd-47dc-85ab-6306f0a73a45 => generated 1412 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:27.831110 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f0954887-8676-4908-86d4-3ad098dff6d0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:27.832375 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f0954887-8676-4908-86d4-3ad098dff6d0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:27.842186 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0954887-8676-4908-86d4-3ad098dff6d0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:27.843937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0954887-8676-4908-86d4-3ad098dff6d0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:27.845051 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0954887-8676-4908-86d4-3ad098dff6d0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:27.846198 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0954887-8676-4908-86d4-3ad098dff6d0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:27.846890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0954887-8676-4908-86d4-3ad098dff6d0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:27.848807 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0954887-8676-4908-86d4-3ad098dff6d0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:28.486819 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bd55670e-8d2a-4487-82c9-6bd166634bd8 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:28.489872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f0954887-8676-4908-86d4-3ad098dff6d0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:28.495796 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bd55670e-8d2a-4487-82c9-6bd166634bd8 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5" status: 200 len: 1314 microversion: 2.1 time: 0.729789 Sep 17 20:59:28.513049 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1144/2199] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:27 2022] GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5 => generated 1314 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:28.520013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8469bbb1-ac41-4810-8b7e-9ca25bf4c86c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:28.534811 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8469bbb1-ac41-4810-8b7e-9ca25bf4c86c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:28.535519 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.compute.servers [None req-8469bbb1-ac41-4810-8b7e-9ca25bf4c86c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Removing options 'limit' from query {{(pid=140524) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 17 20:59:28.536820 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8469bbb1-ac41-4810-8b7e-9ca25bf4c86c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Searching by: {'deleted': False, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898'} {{(pid=140524) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 20:59:28.537104 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f0954887-8676-4908-86d4-3ad098dff6d0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1314 microversion: 2.1 time: 0.709580 Sep 17 20:59:28.538519 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1056/2200] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:27 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1314 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:28.560123 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8469bbb1-ac41-4810-8b7e-9ca25bf4c86c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:28.560896 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-38be5ad2-6c32-410c-9c90-f4016f381a8a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4c7c3a0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:28.561760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8469bbb1-ac41-4810-8b7e-9ca25bf4c86c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:28.564945 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8469bbb1-ac41-4810-8b7e-9ca25bf4c86c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:28.569805 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8469bbb1-ac41-4810-8b7e-9ca25bf4c86c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:28.574465 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8469bbb1-ac41-4810-8b7e-9ca25bf4c86c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:28.574732 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8469bbb1-ac41-4810-8b7e-9ca25bf4c86c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:28.645818 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-38be5ad2-6c32-410c-9c90-f4016f381a8a tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/af38cca4-fecd-47dc-85ab-6306f0a73a45" status: 200 len: 1412 microversion: 2.1 time: 0.101567 Sep 17 20:59:28.655930 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8469bbb1-ac41-4810-8b7e-9ca25bf4c86c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:28.659043 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1057/2201] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:59:28 2022] GET /compute/v2.1/images/af38cca4-fecd-47dc-85ab-6306f0a73a45 => generated 1412 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:28.663910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8469bbb1-ac41-4810-8b7e-9ca25bf4c86c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:28.664609 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8469bbb1-ac41-4810-8b7e-9ca25bf4c86c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:28.665514 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8469bbb1-ac41-4810-8b7e-9ca25bf4c86c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:28.671675 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-b3224912-5d6c-40ed-912a-8acc2deac730 req-4ba8f6f2-4537-42c0-baeb-1edaf4ca18bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71d2c783-2772-442d-b38c-920fcf895b77", "name": "network-vif-plugged", "status": "completed", "tag": "ea7793b0-9fda-46af-b315-de942d1003d2"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:28.694001 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b3224912-5d6c-40ed-912a-8acc2deac730 req-4ba8f6f2-4537-42c0-baeb-1edaf4ca18bb service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:28.694799 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b3224912-5d6c-40ed-912a-8acc2deac730 req-4ba8f6f2-4537-42c0-baeb-1edaf4ca18bb service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:28.695597 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b3224912-5d6c-40ed-912a-8acc2deac730 req-4ba8f6f2-4537-42c0-baeb-1edaf4ca18bb service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:28.710236 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-b3224912-5d6c-40ed-912a-8acc2deac730 req-4ba8f6f2-4537-42c0-baeb-1edaf4ca18bb service nova] Creating event network-vif-plugged:ea7793b0-9fda-46af-b315-de942d1003d2 for instance 71d2c783-2772-442d-b38c-920fcf895b77 on nch2-master-1 Sep 17 20:59:28.719334 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-b3224912-5d6c-40ed-912a-8acc2deac730 req-4ba8f6f2-4537-42c0-baeb-1edaf4ca18bb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058218 Sep 17 20:59:28.721000 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1058/2202] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:28.727439 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-71c1ec11-6f57-49c7-89ad-00bdde600431 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4e525e0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:28.903820 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8469bbb1-ac41-4810-8b7e-9ca25bf4c86c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1662 microversion: 2.1 time: 0.389100 Sep 17 20:59:28.922333 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1145/2203] 10.222.0.26 () {58 vars in 1161 bytes} [Sat Sep 17 20:59:28 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1662 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:28.931694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-eb66c5a3-0141-46b2-a7ab-b7426df3430b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:28.933297 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-eb66c5a3-0141-46b2-a7ab-b7426df3430b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 71d2c783-2772-442d-b38c-920fcf895b77] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:28.941427 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eb66c5a3-0141-46b2-a7ab-b7426df3430b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:28.942263 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eb66c5a3-0141-46b2-a7ab-b7426df3430b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:28.942869 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eb66c5a3-0141-46b2-a7ab-b7426df3430b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:28.943849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eb66c5a3-0141-46b2-a7ab-b7426df3430b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:28.944769 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eb66c5a3-0141-46b2-a7ab-b7426df3430b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:28.945370 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eb66c5a3-0141-46b2-a7ab-b7426df3430b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:29.022967 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-71c1ec11-6f57-49c7-89ad-00bdde600431 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "DELETE /compute/v2.1/images/af38cca4-fecd-47dc-85ab-6306f0a73a45" status: 204 len: 0 microversion: 2.1 time: 0.299222 Sep 17 20:59:29.029005 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1059/2204] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:28 2022] DELETE /compute/v2.1/images/af38cca4-fecd-47dc-85ab-6306f0a73a45 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:59:29.041179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b099b6db-7862-4771-a8f0-14ca0d7f23bf tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:29.058743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b099b6db-7862-4771-a8f0-14ca0d7f23bf tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:29.063228 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b099b6db-7862-4771-a8f0-14ca0d7f23bf tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898'} {{(pid=140523) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 20:59:29.079407 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b099b6db-7862-4771-a8f0-14ca0d7f23bf tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:29.079927 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b099b6db-7862-4771-a8f0-14ca0d7f23bf tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:29.082816 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b099b6db-7862-4771-a8f0-14ca0d7f23bf tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:29.083710 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b099b6db-7862-4771-a8f0-14ca0d7f23bf tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:29.084189 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b099b6db-7862-4771-a8f0-14ca0d7f23bf tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:29.084627 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b099b6db-7862-4771-a8f0-14ca0d7f23bf tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:29.259407 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-eb66c5a3-0141-46b2-a7ab-b7426df3430b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:29.270227 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-eb66c5a3-0141-46b2-a7ab-b7426df3430b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77" status: 200 len: 1316 microversion: 2.1 time: 0.345578 Sep 17 20:59:29.272731 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1146/2205] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:28 2022] GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77 => generated 1316 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:29.368557 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.multi_cell_list [None req-b099b6db-7862-4771-a8f0-14ca0d7f23bf tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140523) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 20:59:29.451880 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b099b6db-7862-4771-a8f0-14ca0d7f23bf tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.421411 Sep 17 20:59:29.461479 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1060/2206] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Sep 17 20:59:29 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:29.467165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7eb0a167-0416-4f49-a30d-3f128715d454 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a4c56040>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:29.492551 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-7eb0a167-0416-4f49-a30d-3f128715d454 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] HTTP exception thrown: Image not found. Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7eb0a167-0416-4f49-a30d-3f128715d454 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Request method failure captured: Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/images/af38cca4-fecd-47dc-85ab-6306f0a73a45 HTTP/1.1 Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjRFn2tQKGC1uAe9bqpTP_NrkyiVoEPWPj6EeaKBRFTcT_3xnlWY0pTkMJ4hC5pRCxUNPE-AOKqpt1bSrALS7ehDCQMiEha4CW5FDEWUPQj4njVXPv741ea7tr-65nzH_eSaKOIbqjpzDtqiEt9RhuydzmAVBkSwGPhgySaxy-1FUPg Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 2a4117ca05454573bbd93fbca50431d2 Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2a4117ca05454573bbd93fbca50431d2", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 2a4117ca05454573bbd93fbca50431d2 Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ImagesTestJSON-1640721037-project Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 6e33e0b756e14af28a90cc5c76d346e6 Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ImagesTestJSON-1640721037-project Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: exception: Image not found. Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'af38cca4-fecd-47dc-85ab-6306f0a73a45'} Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID af38cca4-fecd-47dc-85ab-6306f0a73a45 Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 17 20:59:29.494617 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image af38cca4-fecd-47dc-85ab-6306f0a73a45 could not be found. Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 17 20:59:29.503249 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:29.508795 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7eb0a167-0416-4f49-a30d-3f128715d454 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Returning 404 to user: Image not found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:59:29.510284 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7eb0a167-0416-4f49-a30d-3f128715d454 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/images/af38cca4-fecd-47dc-85ab-6306f0a73a45" status: 404 len: 62 microversion: 2.1 time: 0.047332 Sep 17 20:59:29.514942 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1061/2207] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 20:59:29 2022] GET /compute/v2.1/images/af38cca4-fecd-47dc-85ab-6306f0a73a45 => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 20:59:29.520379 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-73e74290-07fb-43a8-8e12-3a72d06f8145 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:29.527890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-73e74290-07fb-43a8-8e12-3a72d06f8145 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:29.528365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.compute.servers [None req-73e74290-07fb-43a8-8e12-3a72d06f8145 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Removing options 'limit' from query {{(pid=140523) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 17 20:59:29.529126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-73e74290-07fb-43a8-8e12-3a72d06f8145 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Searching by: {'deleted': False, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898'} {{(pid=140523) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 20:59:29.535675 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73e74290-07fb-43a8-8e12-3a72d06f8145 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:29.536261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73e74290-07fb-43a8-8e12-3a72d06f8145 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:29.536708 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73e74290-07fb-43a8-8e12-3a72d06f8145 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:29.537650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73e74290-07fb-43a8-8e12-3a72d06f8145 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:29.538114 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73e74290-07fb-43a8-8e12-3a72d06f8145 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:29.538672 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73e74290-07fb-43a8-8e12-3a72d06f8145 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:29.550261 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a517dd79-12e4-48f4-9931-630ab8215e46 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-731376886", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "d6c20004-bd9d-4e46-b854-f5b845a75711"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:29.569658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.multi_cell_list [None req-73e74290-07fb-43a8-8e12-3a72d06f8145 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140523) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 20:59:29.602555 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-73e74290-07fb-43a8-8e12-3a72d06f8145 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.090558 Sep 17 20:59:29.603273 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1062/2208] 10.222.0.26 () {58 vars in 1150 bytes} [Sat Sep 17 20:59:29 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:29.616103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ed7d31bd-8823-4eec-8344-c259020b5339 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:29.617705 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ed7d31bd-8823-4eec-8344-c259020b5339 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 67aeba5b-d1f8-4487-be79-97da63c34fc5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:29.624804 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ed7d31bd-8823-4eec-8344-c259020b5339 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:29.626440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ed7d31bd-8823-4eec-8344-c259020b5339 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:29.626440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ed7d31bd-8823-4eec-8344-c259020b5339 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:29.627847 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ed7d31bd-8823-4eec-8344-c259020b5339 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:29.627847 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ed7d31bd-8823-4eec-8344-c259020b5339 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:29.627847 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ed7d31bd-8823-4eec-8344-c259020b5339 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:29.662111 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-a517dd79-12e4-48f4-9931-630ab8215e46 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] validate_networks() for [('d6c20004-bd9d-4e46-b854-f5b845a75711', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:59:29.915316 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ed7d31bd-8823-4eec-8344-c259020b5339 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:29.926878 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ed7d31bd-8823-4eec-8344-c259020b5339 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5" status: 200 len: 1314 microversion: 2.1 time: 0.314652 Sep 17 20:59:29.927482 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1063/2209] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:29 2022] GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:29.939503 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ad459247-5d22-444e-a61f-400af262a695 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:29.940775 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ad459247-5d22-444e-a61f-400af262a695 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: ed5493ed-b5ec-49fe-994f-1a4da1e61618] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:29.956634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:59:29.979270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad459247-5d22-444e-a61f-400af262a695 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:29.979523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad459247-5d22-444e-a61f-400af262a695 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:29.980631 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad459247-5d22-444e-a61f-400af262a695 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:29.980631 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad459247-5d22-444e-a61f-400af262a695 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:29.981059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad459247-5d22-444e-a61f-400af262a695 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:29.981575 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad459247-5d22-444e-a61f-400af262a695 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:30.277793 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ad459247-5d22-444e-a61f-400af262a695 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:30.291338 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ad459247-5d22-444e-a61f-400af262a695 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618" status: 200 len: 1505 microversion: 2.1 time: 0.357844 Sep 17 20:59:30.295404 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1064/2210] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:29 2022] GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618 => generated 1505 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:30.310816 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f8ee7091-5d4d-4777-85e1-b0b030d74dc5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:30.311444 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f8ee7091-5d4d-4777-85e1-b0b030d74dc5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:30.326169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8ee7091-5d4d-4777-85e1-b0b030d74dc5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:30.327309 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8ee7091-5d4d-4777-85e1-b0b030d74dc5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:30.331580 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8ee7091-5d4d-4777-85e1-b0b030d74dc5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:30.332443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8ee7091-5d4d-4777-85e1-b0b030d74dc5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:30.335935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8ee7091-5d4d-4777-85e1-b0b030d74dc5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:30.336623 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8ee7091-5d4d-4777-85e1-b0b030d74dc5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:30.620078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f8ee7091-5d4d-4777-85e1-b0b030d74dc5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:30.632805 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f8ee7091-5d4d-4777-85e1-b0b030d74dc5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1314 microversion: 2.1 time: 0.332339 Sep 17 20:59:30.634102 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1065/2211] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:30 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:30.669743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7403cf8d-6c1f-446b-ac40-fd77530d8f8b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:30.685938 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7403cf8d-6c1f-446b-ac40-fd77530d8f8b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:30.692896 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7403cf8d-6c1f-446b-ac40-fd77530d8f8b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Searching by: {'deleted': False, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898'} {{(pid=140523) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 20:59:30.704981 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7403cf8d-6c1f-446b-ac40-fd77530d8f8b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:30.705572 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7403cf8d-6c1f-446b-ac40-fd77530d8f8b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:30.706026 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7403cf8d-6c1f-446b-ac40-fd77530d8f8b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:30.706806 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7403cf8d-6c1f-446b-ac40-fd77530d8f8b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:30.707299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7403cf8d-6c1f-446b-ac40-fd77530d8f8b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:30.707735 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7403cf8d-6c1f-446b-ac40-fd77530d8f8b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:30.743331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-a517dd79-12e4-48f4-9931-630ab8215e46 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:59:30.743966 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-a517dd79-12e4-48f4-9931-630ab8215e46 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:59:30.744476 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-a517dd79-12e4-48f4-9931-630ab8215e46 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:59:30.744955 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-a517dd79-12e4-48f4-9931-630ab8215e46 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:59:30.745487 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-a517dd79-12e4-48f4-9931-630ab8215e46 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:59:30.754906 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.multi_cell_list [None req-7403cf8d-6c1f-446b-ac40-fd77530d8f8b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140523) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 20:59:30.765065 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a517dd79-12e4-48f4-9931-630ab8215e46 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:30.765691 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a517dd79-12e4-48f4-9931-630ab8215e46 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:30.766492 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a517dd79-12e4-48f4-9931-630ab8215e46 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:30.767546 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a517dd79-12e4-48f4-9931-630ab8215e46 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:30.768201 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a517dd79-12e4-48f4-9931-630ab8215e46 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:30.768780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a517dd79-12e4-48f4-9931-630ab8215e46 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:30.787781 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7403cf8d-6c1f-446b-ac40-fd77530d8f8b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.152103 Sep 17 20:59:30.789183 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1066/2212] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Sep 17 20:59:30 2022] GET /compute/v2.1/servers => generated 1010 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:30.794252 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-aa3de9ee-200c-4efe-86a4-3425283e1358 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:30.795193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-aa3de9ee-200c-4efe-86a4-3425283e1358 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 71d2c783-2772-442d-b38c-920fcf895b77] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:30.803531 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa3de9ee-200c-4efe-86a4-3425283e1358 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:30.804251 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa3de9ee-200c-4efe-86a4-3425283e1358 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:30.804983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa3de9ee-200c-4efe-86a4-3425283e1358 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:30.805873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa3de9ee-200c-4efe-86a4-3425283e1358 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:30.806479 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa3de9ee-200c-4efe-86a4-3425283e1358 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:30.807226 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa3de9ee-200c-4efe-86a4-3425283e1358 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:30.807701 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-a517dd79-12e4-48f4-9931-630ab8215e46 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Getting quotas for project 123af01a2abf4b24920c623a0bbe6330. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:59:30.818903 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-a517dd79-12e4-48f4-9931-630ab8215e46 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Getting quotas for user 88c9912ab49942f7943cd766ba040cc5 and project 123af01a2abf4b24920c623a0bbe6330. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:59:30.840970 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a517dd79-12e4-48f4-9931-630ab8215e46 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:59:30.845035 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a517dd79-12e4-48f4-9931-630ab8215e46 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:59:31.003487 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a517dd79-12e4-48f4-9931-630ab8215e46 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.725123 Sep 17 20:59:31.017357 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1147/2213] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Sep 17 20:59:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1745 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 17 20:59:31.026708 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9dfd7b7b-c5b6-4480-aff0-1842ee9a6b08 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:31.036032 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9dfd7b7b-c5b6-4480-aff0-1842ee9a6b08 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:31.036739 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9dfd7b7b-c5b6-4480-aff0-1842ee9a6b08 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898'} {{(pid=140524) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 20:59:31.055840 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9dfd7b7b-c5b6-4480-aff0-1842ee9a6b08 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:31.056986 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9dfd7b7b-c5b6-4480-aff0-1842ee9a6b08 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:31.058473 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9dfd7b7b-c5b6-4480-aff0-1842ee9a6b08 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:31.059515 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9dfd7b7b-c5b6-4480-aff0-1842ee9a6b08 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:31.060306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9dfd7b7b-c5b6-4480-aff0-1842ee9a6b08 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:31.062632 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9dfd7b7b-c5b6-4480-aff0-1842ee9a6b08 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:31.238906 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-aa3de9ee-200c-4efe-86a4-3425283e1358 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:31.268536 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-aa3de9ee-200c-4efe-86a4-3425283e1358 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77" status: 200 len: 1316 microversion: 2.1 time: 0.477885 Sep 17 20:59:31.269905 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1067/2214] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:30 2022] GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77 => generated 1316 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:31.276414 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-ab818420-6989-4cae-9d5c-8350a8f8fa7e req-70d3aea1-5595-4d18-b57a-52594d5080af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cbeb946-182e-4489-b637-556194f5722e", "name": "network-vif-plugged", "status": "completed", "tag": "37410e23-230b-4735-b847-6de46f2c7ac9"}, {"server_uuid": "126bfb0a-a567-407a-becb-4f5a814da7c6", "name": "network-vif-plugged", "status": "completed", "tag": "6804739c-1745-41d6-b864-b17b1ed8921d"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:31.290642 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-ab818420-6989-4cae-9d5c-8350a8f8fa7e req-70d3aea1-5595-4d18-b57a-52594d5080af service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:31.291738 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-ab818420-6989-4cae-9d5c-8350a8f8fa7e req-70d3aea1-5595-4d18-b57a-52594d5080af service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:31.292661 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-ab818420-6989-4cae-9d5c-8350a8f8fa7e req-70d3aea1-5595-4d18-b57a-52594d5080af service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:31.299161 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:59:31.318454 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-ab818420-6989-4cae-9d5c-8350a8f8fa7e req-70d3aea1-5595-4d18-b57a-52594d5080af service nova] Creating event network-vif-plugged:37410e23-230b-4735-b847-6de46f2c7ac9 for instance 8cbeb946-182e-4489-b637-556194f5722e on nch1-master-1 Sep 17 20:59:31.320876 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-ab818420-6989-4cae-9d5c-8350a8f8fa7e req-70d3aea1-5595-4d18-b57a-52594d5080af service nova] Creating event network-vif-plugged:6804739c-1745-41d6-b864-b17b1ed8921d for instance 126bfb0a-a567-407a-becb-4f5a814da7c6 on nch1-master-1 Sep 17 20:59:31.335807 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-ab818420-6989-4cae-9d5c-8350a8f8fa7e req-70d3aea1-5595-4d18-b57a-52594d5080af service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.062649 Sep 17 20:59:31.336859 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1068/2215] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:31.344210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-516a6662-cd1c-4263-a128-93fb7f6308c1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:31.345943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-516a6662-cd1c-4263-a128-93fb7f6308c1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 67aeba5b-d1f8-4487-be79-97da63c34fc5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:31.395962 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.multi_cell_list [None req-9dfd7b7b-c5b6-4480-aff0-1842ee9a6b08 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140524) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 20:59:31.405923 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-516a6662-cd1c-4263-a128-93fb7f6308c1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:31.413774 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-516a6662-cd1c-4263-a128-93fb7f6308c1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:31.414879 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-516a6662-cd1c-4263-a128-93fb7f6308c1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:31.420506 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-516a6662-cd1c-4263-a128-93fb7f6308c1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:31.421800 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-516a6662-cd1c-4263-a128-93fb7f6308c1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:31.425704 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-516a6662-cd1c-4263-a128-93fb7f6308c1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:31.606505 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9dfd7b7b-c5b6-4480-aff0-1842ee9a6b08 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.587380 Sep 17 20:59:31.618140 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1148/2216] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 20:59:31 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:31.642203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-96d0d713-8376-4710-9d61-7e3ca6b75711 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:31.642831 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-96d0d713-8376-4710-9d61-7e3ca6b75711 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:31.881260 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-96d0d713-8376-4710-9d61-7e3ca6b75711 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:31.904665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-96d0d713-8376-4710-9d61-7e3ca6b75711 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:31.906732 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-96d0d713-8376-4710-9d61-7e3ca6b75711 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:31.908455 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-96d0d713-8376-4710-9d61-7e3ca6b75711 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc" status: 200 len: 1261 microversion: 2.26 time: 0.289159 Sep 17 20:59:31.909895 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1149/2217] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:59:31 2022] GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc => generated 1261 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:59:31.915655 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-dbcb0b37-151e-473b-8bae-b80fe9d7f218 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:31.916541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-dbcb0b37-151e-473b-8bae-b80fe9d7f218 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: ed5493ed-b5ec-49fe-994f-1a4da1e61618] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:31.923877 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dbcb0b37-151e-473b-8bae-b80fe9d7f218 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:31.924596 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dbcb0b37-151e-473b-8bae-b80fe9d7f218 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:31.925202 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dbcb0b37-151e-473b-8bae-b80fe9d7f218 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:31.926223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dbcb0b37-151e-473b-8bae-b80fe9d7f218 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:31.926890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dbcb0b37-151e-473b-8bae-b80fe9d7f218 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:31.927863 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dbcb0b37-151e-473b-8bae-b80fe9d7f218 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:31.938630 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-516a6662-cd1c-4263-a128-93fb7f6308c1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:31.962792 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-516a6662-cd1c-4263-a128-93fb7f6308c1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5" status: 200 len: 1314 microversion: 2.1 time: 0.623622 Sep 17 20:59:31.990212 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1069/2218] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:31 2022] GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5 => generated 1314 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:32.008090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-283acdad-ab07-4734-a7a1-f25f2d61d2d6 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:32.027969 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-283acdad-ab07-4734-a7a1-f25f2d61d2d6 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:32.028451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.compute.servers [None req-283acdad-ab07-4734-a7a1-f25f2d61d2d6 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Removing options 'limit' from query {{(pid=140523) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 17 20:59:32.029392 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-283acdad-ab07-4734-a7a1-f25f2d61d2d6 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Searching by: {'deleted': False, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898'} {{(pid=140523) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 20:59:32.050679 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-283acdad-ab07-4734-a7a1-f25f2d61d2d6 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:32.051163 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-283acdad-ab07-4734-a7a1-f25f2d61d2d6 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:32.051647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-283acdad-ab07-4734-a7a1-f25f2d61d2d6 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:32.052459 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-283acdad-ab07-4734-a7a1-f25f2d61d2d6 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:32.054964 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-283acdad-ab07-4734-a7a1-f25f2d61d2d6 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:32.055751 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-283acdad-ab07-4734-a7a1-f25f2d61d2d6 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:32.128333 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-283acdad-ab07-4734-a7a1-f25f2d61d2d6 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.136556 Sep 17 20:59:32.130249 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1070/2219] 10.222.0.26 () {58 vars in 1140 bytes} [Sat Sep 17 20:59:31 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:32.137575 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ac76ab7b-3b2b-4c3d-8af6-5e21824ce4d1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:32.137575 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ac76ab7b-3b2b-4c3d-8af6-5e21824ce4d1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:32.156163 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac76ab7b-3b2b-4c3d-8af6-5e21824ce4d1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:32.161931 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac76ab7b-3b2b-4c3d-8af6-5e21824ce4d1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:32.162684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac76ab7b-3b2b-4c3d-8af6-5e21824ce4d1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:32.163657 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac76ab7b-3b2b-4c3d-8af6-5e21824ce4d1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:32.164305 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac76ab7b-3b2b-4c3d-8af6-5e21824ce4d1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:32.165100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac76ab7b-3b2b-4c3d-8af6-5e21824ce4d1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:32.553075 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-dbcb0b37-151e-473b-8bae-b80fe9d7f218 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:32.579710 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-dbcb0b37-151e-473b-8bae-b80fe9d7f218 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618" status: 200 len: 1487 microversion: 2.1 time: 0.666295 Sep 17 20:59:32.582218 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1150/2220] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:31 2022] GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618 => generated 1487 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:32.593715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9d7bc4f3-9f96-4bcc-94a2-34948cbfac69 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:32.602130 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9d7bc4f3-9f96-4bcc-94a2-34948cbfac69 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:32.603197 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9d7bc4f3-9f96-4bcc-94a2-34948cbfac69 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-539837767', 'deleted': False, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898'} {{(pid=140524) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 20:59:32.626317 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d7bc4f3-9f96-4bcc-94a2-34948cbfac69 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:32.628588 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d7bc4f3-9f96-4bcc-94a2-34948cbfac69 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:32.633303 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d7bc4f3-9f96-4bcc-94a2-34948cbfac69 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:32.634396 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d7bc4f3-9f96-4bcc-94a2-34948cbfac69 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:32.637270 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d7bc4f3-9f96-4bcc-94a2-34948cbfac69 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:32.638279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d7bc4f3-9f96-4bcc-94a2-34948cbfac69 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:32.649307 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ac76ab7b-3b2b-4c3d-8af6-5e21824ce4d1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:32.665258 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ac76ab7b-3b2b-4c3d-8af6-5e21824ce4d1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1314 microversion: 2.1 time: 0.532254 Sep 17 20:59:32.667120 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1071/2221] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:32 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:32.699874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-33b59412-4065-4780-8fb1-a8b61382b335 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:32.704526 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-33b59412-4065-4780-8fb1-a8b61382b335 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 71d2c783-2772-442d-b38c-920fcf895b77] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:32.721215 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-33b59412-4065-4780-8fb1-a8b61382b335 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:32.722202 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-33b59412-4065-4780-8fb1-a8b61382b335 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:32.724689 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-33b59412-4065-4780-8fb1-a8b61382b335 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:32.726494 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-33b59412-4065-4780-8fb1-a8b61382b335 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:32.729084 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-33b59412-4065-4780-8fb1-a8b61382b335 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:32.739788 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-33b59412-4065-4780-8fb1-a8b61382b335 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:32.774016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.multi_cell_list [None req-9d7bc4f3-9f96-4bcc-94a2-34948cbfac69 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140524) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 20:59:32.870901 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9d7bc4f3-9f96-4bcc-94a2-34948cbfac69 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-539837767" status: 200 len: 345 microversion: 2.1 time: 0.287232 Sep 17 20:59:32.872388 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1151/2222] 10.222.0.26 () {58 vars in 1240 bytes} [Sat Sep 17 20:59:32 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-539837767 => generated 345 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:32.884948 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2b5950cf-9eb3-410f-8ec0-baa19ea10a77 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:32.886314 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2b5950cf-9eb3-410f-8ec0-baa19ea10a77 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: ed5493ed-b5ec-49fe-994f-1a4da1e61618] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:32.897765 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b5950cf-9eb3-410f-8ec0-baa19ea10a77 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:32.898489 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b5950cf-9eb3-410f-8ec0-baa19ea10a77 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:32.899136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b5950cf-9eb3-410f-8ec0-baa19ea10a77 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:32.900303 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b5950cf-9eb3-410f-8ec0-baa19ea10a77 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:32.900946 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b5950cf-9eb3-410f-8ec0-baa19ea10a77 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:32.901597 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b5950cf-9eb3-410f-8ec0-baa19ea10a77 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:32.946369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2b5950cf-9eb3-410f-8ec0-baa19ea10a77 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: ed5493ed-b5ec-49fe-994f-1a4da1e61618] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:59:33.061141 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-33b59412-4065-4780-8fb1-a8b61382b335 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:33.073593 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-33b59412-4065-4780-8fb1-a8b61382b335 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77" status: 200 len: 1466 microversion: 2.1 time: 0.384994 Sep 17 20:59:33.075604 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1072/2223] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:32 2022] GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77 => generated 1466 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:33.093143 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fc133386-5ddc-4353-a532-0de331211cca tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:33.115048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc133386-5ddc-4353-a532-0de331211cca tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:33.115587 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc133386-5ddc-4353-a532-0de331211cca tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:33.116187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc133386-5ddc-4353-a532-0de331211cca tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:33.155790 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2b5950cf-9eb3-410f-8ec0-baa19ea10a77 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618" status: 204 len: 0 microversion: 2.1 time: 0.281944 Sep 17 20:59:33.156860 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1152/2224] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:59:32 2022] DELETE /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:59:33.167694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-65e20690-da7e-4a72-85e1-98cceca24f2e tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:33.169768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-65e20690-da7e-4a72-85e1-98cceca24f2e tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:33.195791 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-65e20690-da7e-4a72-85e1-98cceca24f2e tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:33.202750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-65e20690-da7e-4a72-85e1-98cceca24f2e tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:33.203398 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-65e20690-da7e-4a72-85e1-98cceca24f2e tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:33.204419 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-65e20690-da7e-4a72-85e1-98cceca24f2e tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:33.206576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-65e20690-da7e-4a72-85e1-98cceca24f2e tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:33.221319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-65e20690-da7e-4a72-85e1-98cceca24f2e tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:33.249329 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fc133386-5ddc-4353-a532-0de331211cca tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5] Going to try to stop instance {{(pid=140523) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 17 20:59:33.336157 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fc133386-5ddc-4353-a532-0de331211cca tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "POST /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5/action" status: 202 len: 0 microversion: 2.1 time: 0.247592 Sep 17 20:59:33.337103 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1073/2225] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:59:33 2022] POST /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:59:33.343746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b80f2553-a48d-4dd4-abe1-55eb3ced4bee tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:33.345121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b80f2553-a48d-4dd4-abe1-55eb3ced4bee tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 67aeba5b-d1f8-4487-be79-97da63c34fc5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:33.353289 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b80f2553-a48d-4dd4-abe1-55eb3ced4bee tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:33.354216 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b80f2553-a48d-4dd4-abe1-55eb3ced4bee tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:33.354934 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b80f2553-a48d-4dd4-abe1-55eb3ced4bee tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:33.355155 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-65e20690-da7e-4a72-85e1-98cceca24f2e tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:33.356556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b80f2553-a48d-4dd4-abe1-55eb3ced4bee tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:33.357420 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b80f2553-a48d-4dd4-abe1-55eb3ced4bee tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:33.358068 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b80f2553-a48d-4dd4-abe1-55eb3ced4bee tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:33.368243 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-65e20690-da7e-4a72-85e1-98cceca24f2e tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:33.369728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-65e20690-da7e-4a72-85e1-98cceca24f2e tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:33.376008 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-65e20690-da7e-4a72-85e1-98cceca24f2e tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc" status: 200 len: 1313 microversion: 2.26 time: 0.217362 Sep 17 20:59:33.378099 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1153/2226] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:59:33 2022] GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:59:33.391211 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d4153ba5-007d-4b4a-8b9a-c260cc080071 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:33.395161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d4153ba5-007d-4b4a-8b9a-c260cc080071 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] [instance: 71d2c783-2772-442d-b38c-920fcf895b77] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:33.405199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d4153ba5-007d-4b4a-8b9a-c260cc080071 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:33.406024 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d4153ba5-007d-4b4a-8b9a-c260cc080071 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:33.406656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d4153ba5-007d-4b4a-8b9a-c260cc080071 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:33.407558 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d4153ba5-007d-4b4a-8b9a-c260cc080071 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:33.408174 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d4153ba5-007d-4b4a-8b9a-c260cc080071 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:33.409353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d4153ba5-007d-4b4a-8b9a-c260cc080071 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:33.685019 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b80f2553-a48d-4dd4-abe1-55eb3ced4bee tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:33.701073 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d4153ba5-007d-4b4a-8b9a-c260cc080071 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77" status: 200 len: 1617 microversion: 2.1 time: 0.321250 Sep 17 20:59:33.702021 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b80f2553-a48d-4dd4-abe1-55eb3ced4bee tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5" status: 200 len: 1314 microversion: 2.1 time: 0.363371 Sep 17 20:59:33.704419 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1154/2227] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:33 2022] GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77 => generated 1617 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:33.718792 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1074/2228] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:33 2022] GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5 => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:33.720384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0229efab-6b9a-4f70-9a8d-0687995f1a66 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a579e550>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:33.728914 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0e153fb3-c52f-4b7c-8d32-8172ef3e2c32 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:33.728914 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0e153fb3-c52f-4b7c-8d32-8172ef3e2c32 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:33.745632 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e153fb3-c52f-4b7c-8d32-8172ef3e2c32 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:33.746676 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e153fb3-c52f-4b7c-8d32-8172ef3e2c32 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:33.746998 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e153fb3-c52f-4b7c-8d32-8172ef3e2c32 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:33.747913 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e153fb3-c52f-4b7c-8d32-8172ef3e2c32 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:33.748812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e153fb3-c52f-4b7c-8d32-8172ef3e2c32 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:33.750432 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e153fb3-c52f-4b7c-8d32-8172ef3e2c32 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:33.805841 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-0229efab-6b9a-4f70-9a8d-0687995f1a66 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] HTTP exception thrown: Image not found. Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0229efab-6b9a-4f70-9a8d-0687995f1a66 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Request method failure captured: Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/images/af38cca4-fecd-47dc-85ab-6306f0a73a45 HTTP/1.1 Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjRFn2tQKGC1uAe9bqpTP_NrkyiVoEPWPj6EeaKBRFTcT_3xnlWY0pTkMJ4hC5pRCxUNPE-AOKqpt1bSrALS7ehDCQMiEha4CW5FDEWUPQj4njVXPv741ea7tr-65nzH_eSaKOIbqjpzDtqiEt9RhuydzmAVBkSwGPhgySaxy-1FUPg Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 2a4117ca05454573bbd93fbca50431d2 Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2a4117ca05454573bbd93fbca50431d2", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 2a4117ca05454573bbd93fbca50431d2 Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ImagesTestJSON-1640721037-project Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 6e33e0b756e14af28a90cc5c76d346e6 Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ImagesTestJSON-1640721037-project Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: exception: Image not found. Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'af38cca4-fecd-47dc-85ab-6306f0a73a45'} Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image af38cca4-fecd-47dc-85ab-6306f0a73a45 to delete Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image af38cca4-fecd-47dc-85ab-6306f0a73a45 could not be found. Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:33.808447 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:33.812309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:33.812309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:33.812309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:59:33.812309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:59:33.812309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:59:33.812309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:59:33.812309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:59:33.812309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:59:33.812309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 17 20:59:33.812309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 17 20:59:33.812309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 17 20:59:33.812309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:33.812309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:33.812309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:33.812309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:33.812309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:33.812309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:33.812309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:59:33.812309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:59:33.812309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 17 20:59:33.812309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:33.816148 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0229efab-6b9a-4f70-9a8d-0687995f1a66 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Returning 404 to user: Image not found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:59:33.817324 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0229efab-6b9a-4f70-9a8d-0687995f1a66 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "DELETE /compute/v2.1/images/af38cca4-fecd-47dc-85ab-6306f0a73a45" status: 404 len: 62 microversion: 2.1 time: 0.111279 Sep 17 20:59:33.818477 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1155/2229] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:33 2022] DELETE /compute/v2.1/images/af38cca4-fecd-47dc-85ab-6306f0a73a45 => generated 62 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 20:59:33.834128 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-f1247f2a-73c2-4556-8cd1-62e69068674e req-0820786b-4987-44c3-9724-37a2e67c6a0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed5493ed-b5ec-49fe-994f-1a4da1e61618", "name": "network-vif-plugged", "status": "completed", "tag": "1305b3e8-632f-48d1-b910-5428df34195c"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:33.875147 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f1247f2a-73c2-4556-8cd1-62e69068674e req-0820786b-4987-44c3-9724-37a2e67c6a0d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:33.879799 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f1247f2a-73c2-4556-8cd1-62e69068674e req-0820786b-4987-44c3-9724-37a2e67c6a0d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:33.881944 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f1247f2a-73c2-4556-8cd1-62e69068674e req-0820786b-4987-44c3-9724-37a2e67c6a0d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:33.921715 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-f1247f2a-73c2-4556-8cd1-62e69068674e req-0820786b-4987-44c3-9724-37a2e67c6a0d service nova] Creating event network-vif-plugged:1305b3e8-632f-48d1-b910-5428df34195c for instance ed5493ed-b5ec-49fe-994f-1a4da1e61618 on nch2-master-1 Sep 17 20:59:33.945555 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-f1247f2a-73c2-4556-8cd1-62e69068674e req-0820786b-4987-44c3-9724-37a2e67c6a0d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124142 Sep 17 20:59:33.950579 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1156/2230] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:33.962686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-96c6cab3-520a-4079-91b0-2d0c6d827237 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:33.964758 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-96c6cab3-520a-4079-91b0-2d0c6d827237 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:33.985339 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-96c6cab3-520a-4079-91b0-2d0c6d827237 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:33.988465 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-96c6cab3-520a-4079-91b0-2d0c6d827237 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:33.989213 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-96c6cab3-520a-4079-91b0-2d0c6d827237 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:33.991833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-96c6cab3-520a-4079-91b0-2d0c6d827237 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:33.992542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-96c6cab3-520a-4079-91b0-2d0c6d827237 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:33.992969 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-96c6cab3-520a-4079-91b0-2d0c6d827237 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:34.046450 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:59:34.109195 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0e153fb3-c52f-4b7c-8d32-8172ef3e2c32 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:34.121478 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0e153fb3-c52f-4b7c-8d32-8172ef3e2c32 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5" status: 200 len: 1521 microversion: 2.1 time: 0.401308 Sep 17 20:59:34.122806 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1075/2231] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:33 2022] GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 => generated 1521 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:34.130321 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-de319732-b6af-4479-b1d9-2cfbe497f2d8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:34.131172 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-de319732-b6af-4479-b1d9-2cfbe497f2d8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: ed5493ed-b5ec-49fe-994f-1a4da1e61618] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:34.139321 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de319732-b6af-4479-b1d9-2cfbe497f2d8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:34.140257 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de319732-b6af-4479-b1d9-2cfbe497f2d8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:34.140952 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de319732-b6af-4479-b1d9-2cfbe497f2d8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:34.142011 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de319732-b6af-4479-b1d9-2cfbe497f2d8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:34.143554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de319732-b6af-4479-b1d9-2cfbe497f2d8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:34.144218 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de319732-b6af-4479-b1d9-2cfbe497f2d8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:34.177434 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-de319732-b6af-4479-b1d9-2cfbe497f2d8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: ed5493ed-b5ec-49fe-994f-1a4da1e61618] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 20:59:34.282170 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.compute.api [None req-de319732-b6af-4479-b1d9-2cfbe497f2d8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: ed5493ed-b5ec-49fe-994f-1a4da1e61618] Instance is already in deleting state, ignoring this request Sep 17 20:59:34.284672 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-de319732-b6af-4479-b1d9-2cfbe497f2d8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618" status: 204 len: 0 microversion: 2.1 time: 0.160599 Sep 17 20:59:34.285514 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-96c6cab3-520a-4079-91b0-2d0c6d827237 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:34.289372 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1076/2232] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:59:34 2022] DELETE /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 20:59:34.291660 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-69eb7299-1528-4915-b3bb-6d111e78c9bd tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-275635116", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["8f0929b7-f8de-4896-a0de-a2388fef54f3"]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:34.296752 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-96c6cab3-520a-4079-91b0-2d0c6d827237 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1502 microversion: 2.1 time: 0.344231 Sep 17 20:59:34.297908 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1157/2233] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:33 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1502 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:34.308679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b6c1de0a-9b73-41e9-bfeb-7ea345603962 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:34.309716 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b6c1de0a-9b73-41e9-bfeb-7ea345603962 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: ed5493ed-b5ec-49fe-994f-1a4da1e61618] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:34.318548 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b6c1de0a-9b73-41e9-bfeb-7ea345603962 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:34.330806 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b6c1de0a-9b73-41e9-bfeb-7ea345603962 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:34.331658 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b6c1de0a-9b73-41e9-bfeb-7ea345603962 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:34.332845 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b6c1de0a-9b73-41e9-bfeb-7ea345603962 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:34.333488 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b6c1de0a-9b73-41e9-bfeb-7ea345603962 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:34.334635 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b6c1de0a-9b73-41e9-bfeb-7ea345603962 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:34.370347 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-69eb7299-1528-4915-b3bb-6d111e78c9bd tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] validate_networks() for None {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:59:34.796440 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b6c1de0a-9b73-41e9-bfeb-7ea345603962 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:34.818894 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b6c1de0a-9b73-41e9-bfeb-7ea345603962 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618" status: 200 len: 1493 microversion: 2.1 time: 0.514444 Sep 17 20:59:34.819531 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1158/2234] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:34 2022] GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618 => generated 1493 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:34.835010 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4208432f-b093-43c3-ac08-b39ef3f21d5f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:34.836373 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4208432f-b093-43c3-ac08-b39ef3f21d5f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:34.853528 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4208432f-b093-43c3-ac08-b39ef3f21d5f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:34.854024 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4208432f-b093-43c3-ac08-b39ef3f21d5f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:34.854466 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4208432f-b093-43c3-ac08-b39ef3f21d5f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:34.855426 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4208432f-b093-43c3-ac08-b39ef3f21d5f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:34.856003 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4208432f-b093-43c3-ac08-b39ef3f21d5f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:34.856498 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4208432f-b093-43c3-ac08-b39ef3f21d5f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:34.899572 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-4208432f-b093-43c3-ac08-b39ef3f21d5f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lazy-loading 'flavor' on Instance uuid 126bfb0a-a567-407a-becb-4f5a814da7c6 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:59:34.909485 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-69eb7299-1528-4915-b3bb-6d111e78c9bd tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:59:34.910062 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-69eb7299-1528-4915-b3bb-6d111e78c9bd tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:59:34.910543 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-69eb7299-1528-4915-b3bb-6d111e78c9bd tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:59:34.910961 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-69eb7299-1528-4915-b3bb-6d111e78c9bd tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:59:34.911441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-69eb7299-1528-4915-b3bb-6d111e78c9bd tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:59:34.922786 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69eb7299-1528-4915-b3bb-6d111e78c9bd tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:34.923278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69eb7299-1528-4915-b3bb-6d111e78c9bd tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:34.923714 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69eb7299-1528-4915-b3bb-6d111e78c9bd tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:34.924449 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69eb7299-1528-4915-b3bb-6d111e78c9bd tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:34.924996 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69eb7299-1528-4915-b3bb-6d111e78c9bd tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:34.925655 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69eb7299-1528-4915-b3bb-6d111e78c9bd tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:34.945958 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-69eb7299-1528-4915-b3bb-6d111e78c9bd tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for project 3515123097e744ef855ef1129fb59cf1. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:59:34.952517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-69eb7299-1528-4915-b3bb-6d111e78c9bd tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for user 0d48260054d84784b89a52d9b766d7c1 and project 3515123097e744ef855ef1129fb59cf1. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:59:34.968755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-69eb7299-1528-4915-b3bb-6d111e78c9bd tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:59:34.971510 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-69eb7299-1528-4915-b3bb-6d111e78c9bd tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 1d44abe5-d50f-4f59-83fd-65376778153a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:59:35.039921 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-69eb7299-1528-4915-b3bb-6d111e78c9bd tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.752054 Sep 17 20:59:35.047302 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1077/2235] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:59:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:59:35.055636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dd1f7669-131c-40e7-a0a4-d09589a074cd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:35.060157 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dd1f7669-131c-40e7-a0a4-d09589a074cd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:35.071688 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd1f7669-131c-40e7-a0a4-d09589a074cd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:35.073959 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd1f7669-131c-40e7-a0a4-d09589a074cd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:35.074517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd1f7669-131c-40e7-a0a4-d09589a074cd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:35.075374 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd1f7669-131c-40e7-a0a4-d09589a074cd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:35.075881 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd1f7669-131c-40e7-a0a4-d09589a074cd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:35.076313 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd1f7669-131c-40e7-a0a4-d09589a074cd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:35.243007 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dd1f7669-131c-40e7-a0a4-d09589a074cd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:35.252182 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dd1f7669-131c-40e7-a0a4-d09589a074cd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:35.258766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dd1f7669-131c-40e7-a0a4-d09589a074cd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:35.259942 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dd1f7669-131c-40e7-a0a4-d09589a074cd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc" status: 200 len: 1313 microversion: 2.26 time: 0.218374 Sep 17 20:59:35.265710 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1078/2236] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:59:35 2022] GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:59:35.277840 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6c354696-009b-4325-8726-db5781f503a2 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:35.279638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6c354696-009b-4325-8726-db5781f503a2 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 67aeba5b-d1f8-4487-be79-97da63c34fc5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:35.295074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6c354696-009b-4325-8726-db5781f503a2 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:35.301318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6c354696-009b-4325-8726-db5781f503a2 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:35.302200 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6c354696-009b-4325-8726-db5781f503a2 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:35.303407 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6c354696-009b-4325-8726-db5781f503a2 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:35.304090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6c354696-009b-4325-8726-db5781f503a2 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:35.305873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6c354696-009b-4325-8726-db5781f503a2 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:35.319368 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4208432f-b093-43c3-ac08-b39ef3f21d5f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "POST /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6/action" status: 202 len: 0 microversion: 2.1 time: 0.488676 Sep 17 20:59:35.320036 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1159/2237] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:59:34 2022] POST /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:59:35.326312 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-41f7ca46-57b8-4554-baed-35e1a17a5c5d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:35.328510 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-41f7ca46-57b8-4554-baed-35e1a17a5c5d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 1d44abe5-d50f-4f59-83fd-65376778153a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:35.497134 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-41f7ca46-57b8-4554-baed-35e1a17a5c5d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:35.531943 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-41f7ca46-57b8-4554-baed-35e1a17a5c5d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a" status: 200 len: 1216 microversion: 2.1 time: 0.210186 Sep 17 20:59:35.535361 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1160/2238] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:35 2022] GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a => generated 1216 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:35.579769 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b734eab2-284a-40d5-a1f4-abba2ad74cd8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:35.581703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b734eab2-284a-40d5-a1f4-abba2ad74cd8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:35.603387 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b734eab2-284a-40d5-a1f4-abba2ad74cd8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:35.604533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b734eab2-284a-40d5-a1f4-abba2ad74cd8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:35.605808 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b734eab2-284a-40d5-a1f4-abba2ad74cd8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:35.610461 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b734eab2-284a-40d5-a1f4-abba2ad74cd8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:35.612047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b734eab2-284a-40d5-a1f4-abba2ad74cd8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:35.613662 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b734eab2-284a-40d5-a1f4-abba2ad74cd8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:35.855511 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6c354696-009b-4325-8726-db5781f503a2 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:35.866871 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6c354696-009b-4325-8726-db5781f503a2 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5" status: 200 len: 1314 microversion: 2.1 time: 0.599751 Sep 17 20:59:35.870805 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1079/2239] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:35 2022] GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5 => generated 1314 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:35.914520 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2cbcc5e2-29eb-48ce-ad25-b542953c008a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:35.918351 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2cbcc5e2-29eb-48ce-ad25-b542953c008a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:35.928758 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2cbcc5e2-29eb-48ce-ad25-b542953c008a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:35.929516 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2cbcc5e2-29eb-48ce-ad25-b542953c008a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:35.930266 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2cbcc5e2-29eb-48ce-ad25-b542953c008a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:35.931153 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2cbcc5e2-29eb-48ce-ad25-b542953c008a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:35.931875 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2cbcc5e2-29eb-48ce-ad25-b542953c008a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:35.932440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2cbcc5e2-29eb-48ce-ad25-b542953c008a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:36.116977 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b734eab2-284a-40d5-a1f4-abba2ad74cd8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:36.182835 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b734eab2-284a-40d5-a1f4-abba2ad74cd8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5" status: 200 len: 1521 microversion: 2.1 time: 0.624076 Sep 17 20:59:36.185866 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1161/2240] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:35 2022] GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 => generated 1521 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:36.208367 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-af214ab0-56c8-48cd-868b-efbde60d32a8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:36.213262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-af214ab0-56c8-48cd-868b-efbde60d32a8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: ed5493ed-b5ec-49fe-994f-1a4da1e61618] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:36.235646 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af214ab0-56c8-48cd-868b-efbde60d32a8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:36.239103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2cbcc5e2-29eb-48ce-ad25-b542953c008a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:36.240274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af214ab0-56c8-48cd-868b-efbde60d32a8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:36.242017 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af214ab0-56c8-48cd-868b-efbde60d32a8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:36.250199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af214ab0-56c8-48cd-868b-efbde60d32a8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:36.253356 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af214ab0-56c8-48cd-868b-efbde60d32a8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:36.258490 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af214ab0-56c8-48cd-868b-efbde60d32a8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:36.258735 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2cbcc5e2-29eb-48ce-ad25-b542953c008a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1508 microversion: 2.1 time: 0.355562 Sep 17 20:59:36.260491 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1080/2241] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:35 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1508 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:36.271973 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-10c51bad-8575-4c38-b505-fa3b9dbc79eb req-d268ee58-3ccf-4d9e-9ac9-31aa49a73c24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67aeba5b-d1f8-4487-be79-97da63c34fc5", "name": "network-vif-plugged", "status": "completed", "tag": "1058d1b5-6690-4868-b306-534692f06487"}, {"server_uuid": "ed5493ed-b5ec-49fe-994f-1a4da1e61618", "name": "network-vif-unplugged", "status": "completed", "tag": "1305b3e8-632f-48d1-b910-5428df34195c"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:36.285160 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-10c51bad-8575-4c38-b505-fa3b9dbc79eb req-d268ee58-3ccf-4d9e-9ac9-31aa49a73c24 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:36.285683 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-10c51bad-8575-4c38-b505-fa3b9dbc79eb req-d268ee58-3ccf-4d9e-9ac9-31aa49a73c24 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:36.286305 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-10c51bad-8575-4c38-b505-fa3b9dbc79eb req-d268ee58-3ccf-4d9e-9ac9-31aa49a73c24 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:36.335133 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-10c51bad-8575-4c38-b505-fa3b9dbc79eb req-d268ee58-3ccf-4d9e-9ac9-31aa49a73c24 service nova] Creating event network-vif-plugged:1058d1b5-6690-4868-b306-534692f06487 for instance 67aeba5b-d1f8-4487-be79-97da63c34fc5 on nch1-master-1 Sep 17 20:59:36.338232 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-10c51bad-8575-4c38-b505-fa3b9dbc79eb req-d268ee58-3ccf-4d9e-9ac9-31aa49a73c24 service nova] Creating event network-vif-unplugged:1305b3e8-632f-48d1-b910-5428df34195c for instance ed5493ed-b5ec-49fe-994f-1a4da1e61618 on nch2-master-1 Sep 17 20:59:36.391225 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-10c51bad-8575-4c38-b505-fa3b9dbc79eb req-d268ee58-3ccf-4d9e-9ac9-31aa49a73c24 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.126007 Sep 17 20:59:36.393282 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1081/2242] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:36.418535 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-527c3859-10c3-4aa8-bf60-bae15997a9da tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:36.421074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-527c3859-10c3-4aa8-bf60-bae15997a9da tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:36.443094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-527c3859-10c3-4aa8-bf60-bae15997a9da tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:36.445078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-527c3859-10c3-4aa8-bf60-bae15997a9da tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:36.447018 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-527c3859-10c3-4aa8-bf60-bae15997a9da tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:36.448439 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-527c3859-10c3-4aa8-bf60-bae15997a9da tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:36.449814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-527c3859-10c3-4aa8-bf60-bae15997a9da tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:36.451207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-527c3859-10c3-4aa8-bf60-bae15997a9da tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:36.805638 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-af214ab0-56c8-48cd-868b-efbde60d32a8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:36.808379 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-527c3859-10c3-4aa8-bf60-bae15997a9da tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:36.825792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-527c3859-10c3-4aa8-bf60-bae15997a9da tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:36.829382 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-527c3859-10c3-4aa8-bf60-bae15997a9da tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:36.834231 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-527c3859-10c3-4aa8-bf60-bae15997a9da tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc" status: 200 len: 1319 microversion: 2.26 time: 0.433799 Sep 17 20:59:36.837144 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1082/2243] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:59:36 2022] GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc => generated 1319 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:59:36.850288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c21859e3-c3b9-4735-9da6-7d3fbb936e4d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:36.851788 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c21859e3-c3b9-4735-9da6-7d3fbb936e4d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 1d44abe5-d50f-4f59-83fd-65376778153a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:36.869004 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c21859e3-c3b9-4735-9da6-7d3fbb936e4d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:36.869844 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c21859e3-c3b9-4735-9da6-7d3fbb936e4d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:36.873106 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c21859e3-c3b9-4735-9da6-7d3fbb936e4d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:36.874299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c21859e3-c3b9-4735-9da6-7d3fbb936e4d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:36.874940 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c21859e3-c3b9-4735-9da6-7d3fbb936e4d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:36.876578 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-af214ab0-56c8-48cd-868b-efbde60d32a8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618" status: 200 len: 1493 microversion: 2.1 time: 0.687128 Sep 17 20:59:36.879051 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c21859e3-c3b9-4735-9da6-7d3fbb936e4d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:36.879325 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1162/2244] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:36 2022] GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618 => generated 1493 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:36.906697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-00a036cc-e90c-4bc8-871a-f776e548c1fb tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:36.908354 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-00a036cc-e90c-4bc8-871a-f776e548c1fb tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 67aeba5b-d1f8-4487-be79-97da63c34fc5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:36.937129 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00a036cc-e90c-4bc8-871a-f776e548c1fb tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:36.938517 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00a036cc-e90c-4bc8-871a-f776e548c1fb tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:36.941877 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00a036cc-e90c-4bc8-871a-f776e548c1fb tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:36.942805 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00a036cc-e90c-4bc8-871a-f776e548c1fb tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:36.943392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00a036cc-e90c-4bc8-871a-f776e548c1fb tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:36.943926 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00a036cc-e90c-4bc8-871a-f776e548c1fb tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:37.075502 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c21859e3-c3b9-4735-9da6-7d3fbb936e4d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:37.091514 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c21859e3-c3b9-4735-9da6-7d3fbb936e4d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a" status: 200 len: 1268 microversion: 2.1 time: 0.248317 Sep 17 20:59:37.094025 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1083/2245] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:36 2022] GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a => generated 1268 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:37.123850 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-edd0dc95-84cc-4328-9aff-b9d45d61ef59 req-66693f47-5aee-40dd-9b4a-b4f13bffa9b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed5493ed-b5ec-49fe-994f-1a4da1e61618", "name": "network-vif-deleted", "tag": "1305b3e8-632f-48d1-b910-5428df34195c"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:37.164740 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-edd0dc95-84cc-4328-9aff-b9d45d61ef59 req-66693f47-5aee-40dd-9b4a-b4f13bffa9b3 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:37.178320 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-edd0dc95-84cc-4328-9aff-b9d45d61ef59 req-66693f47-5aee-40dd-9b4a-b4f13bffa9b3 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:37.178905 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-edd0dc95-84cc-4328-9aff-b9d45d61ef59 req-66693f47-5aee-40dd-9b4a-b4f13bffa9b3 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:37.226536 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-edd0dc95-84cc-4328-9aff-b9d45d61ef59 req-66693f47-5aee-40dd-9b4a-b4f13bffa9b3 service nova] Creating event network-vif-deleted:1305b3e8-632f-48d1-b910-5428df34195c for instance ed5493ed-b5ec-49fe-994f-1a4da1e61618 on nch2-master-1 Sep 17 20:59:37.237193 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-edd0dc95-84cc-4328-9aff-b9d45d61ef59 req-66693f47-5aee-40dd-9b4a-b4f13bffa9b3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126631 Sep 17 20:59:37.241869 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1084/2246] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:37.256270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-399dab1c-25ec-40f5-98fb-8262812e4197 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:37.259499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-399dab1c-25ec-40f5-98fb-8262812e4197 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:37.282692 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-399dab1c-25ec-40f5-98fb-8262812e4197 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:37.284166 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-399dab1c-25ec-40f5-98fb-8262812e4197 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:37.284890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-399dab1c-25ec-40f5-98fb-8262812e4197 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:37.287796 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-399dab1c-25ec-40f5-98fb-8262812e4197 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:37.288509 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-399dab1c-25ec-40f5-98fb-8262812e4197 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:37.289151 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-399dab1c-25ec-40f5-98fb-8262812e4197 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:37.339275 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-00a036cc-e90c-4bc8-871a-f776e548c1fb tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:37.349097 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-00a036cc-e90c-4bc8-871a-f776e548c1fb tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5" status: 200 len: 1314 microversion: 2.1 time: 0.454814 Sep 17 20:59:37.350593 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1163/2247] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:36 2022] GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5 => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:59:37.358828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-896a71e2-ea39-4c01-91cf-4697ac2dd502 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:37.359893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-896a71e2-ea39-4c01-91cf-4697ac2dd502 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:37.370280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-896a71e2-ea39-4c01-91cf-4697ac2dd502 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:37.371113 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-896a71e2-ea39-4c01-91cf-4697ac2dd502 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:37.372062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-896a71e2-ea39-4c01-91cf-4697ac2dd502 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:37.373184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-896a71e2-ea39-4c01-91cf-4697ac2dd502 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:37.374326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-896a71e2-ea39-4c01-91cf-4697ac2dd502 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:37.375290 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-896a71e2-ea39-4c01-91cf-4697ac2dd502 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:37.788100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-399dab1c-25ec-40f5-98fb-8262812e4197 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:37.794845 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:59:37.818464 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-399dab1c-25ec-40f5-98fb-8262812e4197 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5" status: 200 len: 1521 microversion: 2.1 time: 0.568750 Sep 17 20:59:37.824916 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1085/2248] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:37 2022] GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 => generated 1521 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:37.864032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-94411df9-7395-42cd-943a-1b47cbf825d6 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:37.864847 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-94411df9-7395-42cd-943a-1b47cbf825d6 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:37.881167 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-94411df9-7395-42cd-943a-1b47cbf825d6 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:37.895317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-94411df9-7395-42cd-943a-1b47cbf825d6 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:37.898882 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-94411df9-7395-42cd-943a-1b47cbf825d6 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:37.899748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-896a71e2-ea39-4c01-91cf-4697ac2dd502 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:37.900851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-94411df9-7395-42cd-943a-1b47cbf825d6 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:37.901598 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-94411df9-7395-42cd-943a-1b47cbf825d6 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:37.902556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-94411df9-7395-42cd-943a-1b47cbf825d6 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:37.934316 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-896a71e2-ea39-4c01-91cf-4697ac2dd502 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1508 microversion: 2.1 time: 0.582128 Sep 17 20:59:37.951798 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1164/2249] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:37 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1508 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:37.973897 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7e06548b-7955-436c-9f6e-7370e8fb6387 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:37.974534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7e06548b-7955-436c-9f6e-7370e8fb6387 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: ed5493ed-b5ec-49fe-994f-1a4da1e61618] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:37.998234 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e06548b-7955-436c-9f6e-7370e8fb6387 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:38.000079 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e06548b-7955-436c-9f6e-7370e8fb6387 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:38.000674 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e06548b-7955-436c-9f6e-7370e8fb6387 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:38.002584 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e06548b-7955-436c-9f6e-7370e8fb6387 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:38.005394 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e06548b-7955-436c-9f6e-7370e8fb6387 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:38.006092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e06548b-7955-436c-9f6e-7370e8fb6387 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:38.140531 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e06548b-7955-436c-9f6e-7370e8fb6387 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:38.141106 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e06548b-7955-436c-9f6e-7370e8fb6387 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:38.142281 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e06548b-7955-436c-9f6e-7370e8fb6387 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:38.143924 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-7e06548b-7955-436c-9f6e-7370e8fb6387 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lazy-loading 'fault' on Instance uuid ed5493ed-b5ec-49fe-994f-1a4da1e61618 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:59:38.167532 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-94411df9-7395-42cd-943a-1b47cbf825d6 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:38.180586 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-94411df9-7395-42cd-943a-1b47cbf825d6 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:38.184895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-94411df9-7395-42cd-943a-1b47cbf825d6 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:38.187471 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-94411df9-7395-42cd-943a-1b47cbf825d6 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc" status: 200 len: 1319 microversion: 2.26 time: 0.327806 Sep 17 20:59:38.188864 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1086/2250] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:59:37 2022] GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc => generated 1319 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 20:59:38.195756 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a1d97438-1785-4ff8-b470-16bb7014c3bd tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:38.196758 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a1d97438-1785-4ff8-b470-16bb7014c3bd tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 1d44abe5-d50f-4f59-83fd-65376778153a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:38.204347 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1d97438-1785-4ff8-b470-16bb7014c3bd tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:38.205873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1d97438-1785-4ff8-b470-16bb7014c3bd tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:38.206737 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1d97438-1785-4ff8-b470-16bb7014c3bd tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:38.207703 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1d97438-1785-4ff8-b470-16bb7014c3bd tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:38.208361 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1d97438-1785-4ff8-b470-16bb7014c3bd tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:38.208983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1d97438-1785-4ff8-b470-16bb7014c3bd tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:38.231650 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7e06548b-7955-436c-9f6e-7370e8fb6387 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e33e0b756e14af28a90cc5c76d346e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4117ca05454573bbd93fbca50431d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:38.240574 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7e06548b-7955-436c-9f6e-7370e8fb6387 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618" status: 200 len: 1298 microversion: 2.1 time: 0.285100 Sep 17 20:59:38.243527 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1165/2251] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:37 2022] GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618 => generated 1298 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:38.348460 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a1d97438-1785-4ff8-b470-16bb7014c3bd tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:38.360722 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a1d97438-1785-4ff8-b470-16bb7014c3bd tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a" status: 200 len: 1274 microversion: 2.1 time: 0.170204 Sep 17 20:59:38.362361 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1087/2252] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:38 2022] GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a => generated 1274 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:38.372605 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-371295d0-05ca-4a53-bb0e-7a0ecc7d30c3 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:38.373235 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-371295d0-05ca-4a53-bb0e-7a0ecc7d30c3 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 67aeba5b-d1f8-4487-be79-97da63c34fc5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:38.391482 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-371295d0-05ca-4a53-bb0e-7a0ecc7d30c3 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:38.392403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-371295d0-05ca-4a53-bb0e-7a0ecc7d30c3 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:38.392994 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-371295d0-05ca-4a53-bb0e-7a0ecc7d30c3 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:38.393994 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-371295d0-05ca-4a53-bb0e-7a0ecc7d30c3 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:38.394666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-371295d0-05ca-4a53-bb0e-7a0ecc7d30c3 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:38.395337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-371295d0-05ca-4a53-bb0e-7a0ecc7d30c3 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:38.849387 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-eb76f1f4-e56c-43d4-8d6c-ccd366344845 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:38.850412 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-eb76f1f4-e56c-43d4-8d6c-ccd366344845 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:38.864142 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eb76f1f4-e56c-43d4-8d6c-ccd366344845 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:38.865061 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eb76f1f4-e56c-43d4-8d6c-ccd366344845 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:38.865823 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eb76f1f4-e56c-43d4-8d6c-ccd366344845 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:38.866861 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eb76f1f4-e56c-43d4-8d6c-ccd366344845 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:38.869123 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eb76f1f4-e56c-43d4-8d6c-ccd366344845 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:38.871544 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eb76f1f4-e56c-43d4-8d6c-ccd366344845 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:38.893198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-371295d0-05ca-4a53-bb0e-7a0ecc7d30c3 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:38.902427 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-371295d0-05ca-4a53-bb0e-7a0ecc7d30c3 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5" status: 200 len: 1314 microversion: 2.1 time: 0.533709 Sep 17 20:59:38.916190 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1166/2253] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:38 2022] GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5 => generated 1314 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:38.965118 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fbb410d3-f5d3-444c-881d-5dd2e32bc49b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:38.966224 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fbb410d3-f5d3-444c-881d-5dd2e32bc49b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:38.976319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbb410d3-f5d3-444c-881d-5dd2e32bc49b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:38.979414 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbb410d3-f5d3-444c-881d-5dd2e32bc49b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:38.980116 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbb410d3-f5d3-444c-881d-5dd2e32bc49b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:38.981229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbb410d3-f5d3-444c-881d-5dd2e32bc49b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:38.983025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbb410d3-f5d3-444c-881d-5dd2e32bc49b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:38.986329 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbb410d3-f5d3-444c-881d-5dd2e32bc49b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:39.329502 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-eb76f1f4-e56c-43d4-8d6c-ccd366344845 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:39.340871 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-eb76f1f4-e56c-43d4-8d6c-ccd366344845 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5" status: 200 len: 1521 microversion: 2.1 time: 0.495740 Sep 17 20:59:39.341880 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1088/2254] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:38 2022] GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 => generated 1521 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:59:39.349863 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7ff912f8-acda-452a-97fc-cb8c484d7484 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:39.354247 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7ff912f8-acda-452a-97fc-cb8c484d7484 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:39.367278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ff912f8-acda-452a-97fc-cb8c484d7484 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:39.370690 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ff912f8-acda-452a-97fc-cb8c484d7484 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:39.374951 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ff912f8-acda-452a-97fc-cb8c484d7484 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:39.378440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ff912f8-acda-452a-97fc-cb8c484d7484 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:39.380122 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ff912f8-acda-452a-97fc-cb8c484d7484 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:39.381233 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ff912f8-acda-452a-97fc-cb8c484d7484 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:39.399796 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fbb410d3-f5d3-444c-881d-5dd2e32bc49b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:39.414857 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fbb410d3-f5d3-444c-881d-5dd2e32bc49b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1508 microversion: 2.1 time: 0.454587 Sep 17 20:59:39.418722 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1167/2255] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:38 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1508 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:39.430232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8cb194b2-6428-4e6a-b8af-b53d55414fb1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:39.435450 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8cb194b2-6428-4e6a-b8af-b53d55414fb1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: ed5493ed-b5ec-49fe-994f-1a4da1e61618] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:39.445711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8cb194b2-6428-4e6a-b8af-b53d55414fb1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:39.451277 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8cb194b2-6428-4e6a-b8af-b53d55414fb1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:39.452048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8cb194b2-6428-4e6a-b8af-b53d55414fb1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:39.453034 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8cb194b2-6428-4e6a-b8af-b53d55414fb1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:39.453771 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8cb194b2-6428-4e6a-b8af-b53d55414fb1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:39.455662 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8cb194b2-6428-4e6a-b8af-b53d55414fb1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:39.482514 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-8cb194b2-6428-4e6a-b8af-b53d55414fb1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] HTTP exception thrown: Instance ed5493ed-b5ec-49fe-994f-1a4da1e61618 could not be found. Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8cb194b2-6428-4e6a-b8af-b53d55414fb1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Request method failure captured: Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618 HTTP/1.1 Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjRFn2tQKGC1uAe9bqpTP_NrkyiVoEPWPj6EeaKBRFTcT_3xnlWY0pTkMJ4hC5pRCxUNPE-AOKqpt1bSrALS7ehDCQMiEha4CW5FDEWUPQj4njVXPv741ea7tr-65nzH_eSaKOIbqjpzDtqiEt9RhuydzmAVBkSwGPhgySaxy-1FUPg Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 2a4117ca05454573bbd93fbca50431d2 Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2a4117ca05454573bbd93fbca50431d2", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 2a4117ca05454573bbd93fbca50431d2 Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ImagesTestJSON-1640721037-project Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 6e33e0b756e14af28a90cc5c76d346e6 Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ImagesTestJSON-1640721037-project Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance ed5493ed-b5ec-49fe-994f-1a4da1e61618 could not be found. Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'ed5493ed-b5ec-49fe-994f-1a4da1e61618'} Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed5493ed-b5ec-49fe-994f-1a4da1e61618 could not be found. Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed5493ed-b5ec-49fe-994f-1a4da1e61618 could not be found. Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:39.485282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:39.488990 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:39.488990 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:39.488990 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:59:39.488990 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:59:39.488990 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed5493ed-b5ec-49fe-994f-1a4da1e61618 could not be found. Sep 17 20:59:39.488990 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:39.491484 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8cb194b2-6428-4e6a-b8af-b53d55414fb1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Returning 404 to user: Instance ed5493ed-b5ec-49fe-994f-1a4da1e61618 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:59:39.492643 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8cb194b2-6428-4e6a-b8af-b53d55414fb1 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618" status: 404 len: 111 microversion: 2.1 time: 0.072597 Sep 17 20:59:39.493997 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1168/2256] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:39 2022] GET /compute/v2.1/servers/ed5493ed-b5ec-49fe-994f-1a4da1e61618 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:59:39.500717 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3b080f37-6bdb-494d-b691-2f0437beccc5 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:39.501761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3b080f37-6bdb-494d-b691-2f0437beccc5 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 1d44abe5-d50f-4f59-83fd-65376778153a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:39.508991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b080f37-6bdb-494d-b691-2f0437beccc5 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:39.510578 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b080f37-6bdb-494d-b691-2f0437beccc5 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:39.511400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b080f37-6bdb-494d-b691-2f0437beccc5 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:39.513189 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b080f37-6bdb-494d-b691-2f0437beccc5 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:39.514333 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b080f37-6bdb-494d-b691-2f0437beccc5 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:39.514972 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b080f37-6bdb-494d-b691-2f0437beccc5 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:39.674138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3b080f37-6bdb-494d-b691-2f0437beccc5 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:39.691376 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3b080f37-6bdb-494d-b691-2f0437beccc5 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a" status: 200 len: 1274 microversion: 2.1 time: 0.194623 Sep 17 20:59:39.701678 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1169/2257] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:39 2022] GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a => generated 1274 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:39.709302 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4d5e1771-153c-4846-8f3e-532b88573b77 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a54b8c10>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:39.763595 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-4d5e1771-153c-4846-8f3e-532b88573b77 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] HTTP exception thrown: Image not found. Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4d5e1771-153c-4846-8f3e-532b88573b77 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Request method failure captured: Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b HTTP/1.1 Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjRFn2tQKGC1uAe9bqpTP_NrkyiVoEPWPj6EeaKBRFTcT_3xnlWY0pTkMJ4hC5pRCxUNPE-AOKqpt1bSrALS7ehDCQMiEha4CW5FDEWUPQj4njVXPv741ea7tr-65nzH_eSaKOIbqjpzDtqiEt9RhuydzmAVBkSwGPhgySaxy-1FUPg Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 2a4117ca05454573bbd93fbca50431d2 Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2a4117ca05454573bbd93fbca50431d2", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 2a4117ca05454573bbd93fbca50431d2 Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ImagesTestJSON-1640721037-project Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 6e33e0b756e14af28a90cc5c76d346e6 Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ImagesTestJSON-1640721037-project Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: exception: Image not found. Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b'} Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b to delete Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b could not be found. Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:39.766049 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:39.771617 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:39.771617 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:39.771617 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:59:39.771617 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:59:39.771617 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:59:39.771617 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:59:39.771617 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:59:39.771617 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:59:39.771617 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 17 20:59:39.771617 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 17 20:59:39.771617 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 17 20:59:39.771617 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:39.771617 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:39.771617 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:39.771617 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:39.771617 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:39.771617 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:39.771617 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:59:39.771617 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:59:39.771617 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 17 20:59:39.771617 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:39.771617 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4d5e1771-153c-4846-8f3e-532b88573b77 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Returning 404 to user: Image not found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:59:39.771617 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4d5e1771-153c-4846-8f3e-532b88573b77 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "DELETE /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b" status: 404 len: 62 microversion: 2.1 time: 0.064755 Sep 17 20:59:39.771617 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1170/2258] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:39 2022] DELETE /compute/v2.1/images/8d5c0485-e1aa-49ab-8fe6-4f5ea6d55c9b => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 20:59:39.776139 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d8047ebc-4172-4a9d-b356-6aa33afaa17f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:39.776645 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d8047ebc-4172-4a9d-b356-6aa33afaa17f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: bf08d895-d8f9-440d-8ade-fbc47dc6bde4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:39.793834 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d8047ebc-4172-4a9d-b356-6aa33afaa17f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:39.794585 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d8047ebc-4172-4a9d-b356-6aa33afaa17f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:39.795445 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d8047ebc-4172-4a9d-b356-6aa33afaa17f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:39.796486 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d8047ebc-4172-4a9d-b356-6aa33afaa17f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:39.798372 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d8047ebc-4172-4a9d-b356-6aa33afaa17f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:39.799335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d8047ebc-4172-4a9d-b356-6aa33afaa17f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:39.835136 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-d8047ebc-4172-4a9d-b356-6aa33afaa17f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] HTTP exception thrown: Instance bf08d895-d8f9-440d-8ade-fbc47dc6bde4 could not be found. Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d8047ebc-4172-4a9d-b356-6aa33afaa17f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Request method failure captured: Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4 HTTP/1.1 Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjRFn2tQKGC1uAe9bqpTP_NrkyiVoEPWPj6EeaKBRFTcT_3xnlWY0pTkMJ4hC5pRCxUNPE-AOKqpt1bSrALS7ehDCQMiEha4CW5FDEWUPQj4njVXPv741ea7tr-65nzH_eSaKOIbqjpzDtqiEt9RhuydzmAVBkSwGPhgySaxy-1FUPg Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 2a4117ca05454573bbd93fbca50431d2 Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2a4117ca05454573bbd93fbca50431d2", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 2a4117ca05454573bbd93fbca50431d2 Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ImagesTestJSON-1640721037-project Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 6e33e0b756e14af28a90cc5c76d346e6 Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ImagesTestJSON-1640721037-project Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance bf08d895-d8f9-440d-8ade-fbc47dc6bde4 could not be found. Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'bf08d895-d8f9-440d-8ade-fbc47dc6bde4'} Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf08d895-d8f9-440d-8ade-fbc47dc6bde4 could not be found. Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:59:39.837767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf08d895-d8f9-440d-8ade-fbc47dc6bde4 could not be found. Sep 17 20:59:39.842112 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:39.842112 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:39.842112 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:39.842112 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:39.842112 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:39.842112 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:39.842112 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:59:39.842112 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:59:39.842112 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf08d895-d8f9-440d-8ade-fbc47dc6bde4 could not be found. Sep 17 20:59:39.842112 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:39.843617 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d8047ebc-4172-4a9d-b356-6aa33afaa17f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Returning 404 to user: Instance bf08d895-d8f9-440d-8ade-fbc47dc6bde4 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:59:39.844654 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d8047ebc-4172-4a9d-b356-6aa33afaa17f tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4" status: 404 len: 111 microversion: 2.1 time: 0.072360 Sep 17 20:59:39.845731 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1171/2259] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:59:39 2022] DELETE /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 20:59:39.854847 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-392afdcf-8fe3-41de-b0b5-1a5e9d3f4976 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:39.855795 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-392afdcf-8fe3-41de-b0b5-1a5e9d3f4976 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: bf08d895-d8f9-440d-8ade-fbc47dc6bde4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:39.870278 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-392afdcf-8fe3-41de-b0b5-1a5e9d3f4976 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:39.871062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-392afdcf-8fe3-41de-b0b5-1a5e9d3f4976 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:39.871689 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-392afdcf-8fe3-41de-b0b5-1a5e9d3f4976 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:39.872580 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-392afdcf-8fe3-41de-b0b5-1a5e9d3f4976 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:39.873374 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-392afdcf-8fe3-41de-b0b5-1a5e9d3f4976 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:39.874030 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-392afdcf-8fe3-41de-b0b5-1a5e9d3f4976 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:39.906980 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-392afdcf-8fe3-41de-b0b5-1a5e9d3f4976 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] HTTP exception thrown: Instance bf08d895-d8f9-440d-8ade-fbc47dc6bde4 could not be found. Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-392afdcf-8fe3-41de-b0b5-1a5e9d3f4976 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Request method failure captured: Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4 HTTP/1.1 Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjRFn2tQKGC1uAe9bqpTP_NrkyiVoEPWPj6EeaKBRFTcT_3xnlWY0pTkMJ4hC5pRCxUNPE-AOKqpt1bSrALS7ehDCQMiEha4CW5FDEWUPQj4njVXPv741ea7tr-65nzH_eSaKOIbqjpzDtqiEt9RhuydzmAVBkSwGPhgySaxy-1FUPg Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 2a4117ca05454573bbd93fbca50431d2 Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2a4117ca05454573bbd93fbca50431d2", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 2a4117ca05454573bbd93fbca50431d2 Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ImagesTestJSON-1640721037-project Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 6e33e0b756e14af28a90cc5c76d346e6 Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ImagesTestJSON-1640721037-project Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance bf08d895-d8f9-440d-8ade-fbc47dc6bde4 could not be found. Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'bf08d895-d8f9-440d-8ade-fbc47dc6bde4'} Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf08d895-d8f9-440d-8ade-fbc47dc6bde4 could not be found. Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf08d895-d8f9-440d-8ade-fbc47dc6bde4 could not be found. Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:39.909380 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:39.913993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:39.913993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:39.913993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:59:39.913993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:59:39.913993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf08d895-d8f9-440d-8ade-fbc47dc6bde4 could not be found. Sep 17 20:59:39.913993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:39.915193 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-392afdcf-8fe3-41de-b0b5-1a5e9d3f4976 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Returning 404 to user: Instance bf08d895-d8f9-440d-8ade-fbc47dc6bde4 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:59:39.916221 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-392afdcf-8fe3-41de-b0b5-1a5e9d3f4976 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4" status: 404 len: 111 microversion: 2.1 time: 0.066672 Sep 17 20:59:39.917615 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1172/2260] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:39 2022] GET /compute/v2.1/servers/bf08d895-d8f9-440d-8ade-fbc47dc6bde4 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:59:39.926607 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7fc2ea9e-94da-49bd-9704-9b134f790084 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a52eef70>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:39.963767 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-7fc2ea9e-94da-49bd-9704-9b134f790084 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] HTTP exception thrown: Image not found. Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7fc2ea9e-94da-49bd-9704-9b134f790084 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Request method failure captured: Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25 HTTP/1.1 Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjRFn2tQKGC1uAe9bqpTP_NrkyiVoEPWPj6EeaKBRFTcT_3xnlWY0pTkMJ4hC5pRCxUNPE-AOKqpt1bSrALS7ehDCQMiEha4CW5FDEWUPQj4njVXPv741ea7tr-65nzH_eSaKOIbqjpzDtqiEt9RhuydzmAVBkSwGPhgySaxy-1FUPg Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 2a4117ca05454573bbd93fbca50431d2 Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2a4117ca05454573bbd93fbca50431d2", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 2a4117ca05454573bbd93fbca50431d2 Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ImagesTestJSON-1640721037-project Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 6e33e0b756e14af28a90cc5c76d346e6 Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ImagesTestJSON-1640721037-project Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: exception: Image not found. Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'd934e6fd-b862-45db-bf73-0d4759d59e25'} Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d934e6fd-b862-45db-bf73-0d4759d59e25 to delete Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d934e6fd-b862-45db-bf73-0d4759d59e25 could not be found. Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:39.969828 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:39.973417 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:39.973417 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:39.973417 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:59:39.973417 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:59:39.973417 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:59:39.973417 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:59:39.973417 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:59:39.973417 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:59:39.973417 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 17 20:59:39.973417 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 17 20:59:39.973417 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 17 20:59:39.973417 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:39.973417 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:39.973417 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:39.973417 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:39.973417 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:39.973417 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:39.973417 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:59:39.973417 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:59:39.973417 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 17 20:59:39.973417 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:39.973417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7fc2ea9e-94da-49bd-9704-9b134f790084 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Returning 404 to user: Image not found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:59:39.976410 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7fc2ea9e-94da-49bd-9704-9b134f790084 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "DELETE /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25" status: 404 len: 62 microversion: 2.1 time: 0.054019 Sep 17 20:59:39.977319 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1173/2261] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:39 2022] DELETE /compute/v2.1/images/d934e6fd-b862-45db-bf73-0d4759d59e25 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 20:59:39.984712 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2faa5e10-6644-4bb0-b26b-c3f6f21f625f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:39.985337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2faa5e10-6644-4bb0-b26b-c3f6f21f625f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 67aeba5b-d1f8-4487-be79-97da63c34fc5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:39.994536 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2faa5e10-6644-4bb0-b26b-c3f6f21f625f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:39.994961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2faa5e10-6644-4bb0-b26b-c3f6f21f625f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:39.995400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2faa5e10-6644-4bb0-b26b-c3f6f21f625f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:39.996148 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2faa5e10-6644-4bb0-b26b-c3f6f21f625f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:39.996605 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2faa5e10-6644-4bb0-b26b-c3f6f21f625f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:39.997776 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2faa5e10-6644-4bb0-b26b-c3f6f21f625f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:40.077887 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7ff912f8-acda-452a-97fc-cb8c484d7484 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:40.089451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7ff912f8-acda-452a-97fc-cb8c484d7484 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:40.091275 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7ff912f8-acda-452a-97fc-cb8c484d7484 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:40.092667 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7ff912f8-acda-452a-97fc-cb8c484d7484 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc" status: 200 len: 1361 microversion: 2.26 time: 0.746598 Sep 17 20:59:40.106593 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1089/2262] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:59:39 2022] GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc => generated 1361 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:59:40.119274 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8fa15002-08c0-436b-ba78-5112e4672b70 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:40.122954 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8fa15002-08c0-436b-ba78-5112e4672b70 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:40.136440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8fa15002-08c0-436b-ba78-5112e4672b70 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:40.137069 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8fa15002-08c0-436b-ba78-5112e4672b70 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:40.137691 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8fa15002-08c0-436b-ba78-5112e4672b70 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:40.138626 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8fa15002-08c0-436b-ba78-5112e4672b70 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:40.140027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8fa15002-08c0-436b-ba78-5112e4672b70 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:40.140659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8fa15002-08c0-436b-ba78-5112e4672b70 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:40.161659 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-8fa15002-08c0-436b-ba78-5112e4672b70 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] HTTP exception thrown: Instance be2b42c6-7d99-48b0-b515-26a7139e11aa could not be found. Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8fa15002-08c0-436b-ba78-5112e4672b70 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Request method failure captured: Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa HTTP/1.1 Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjRFn2tQKGC1uAe9bqpTP_NrkyiVoEPWPj6EeaKBRFTcT_3xnlWY0pTkMJ4hC5pRCxUNPE-AOKqpt1bSrALS7ehDCQMiEha4CW5FDEWUPQj4njVXPv741ea7tr-65nzH_eSaKOIbqjpzDtqiEt9RhuydzmAVBkSwGPhgySaxy-1FUPg Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 2a4117ca05454573bbd93fbca50431d2 Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2a4117ca05454573bbd93fbca50431d2", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 2a4117ca05454573bbd93fbca50431d2 Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ImagesTestJSON-1640721037-project Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 6e33e0b756e14af28a90cc5c76d346e6 Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ImagesTestJSON-1640721037-project Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance be2b42c6-7d99-48b0-b515-26a7139e11aa could not be found. Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'be2b42c6-7d99-48b0-b515-26a7139e11aa'} Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be2b42c6-7d99-48b0-b515-26a7139e11aa could not be found. Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:59:40.164667 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be2b42c6-7d99-48b0-b515-26a7139e11aa could not be found. Sep 17 20:59:40.169765 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:40.169765 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:40.169765 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:40.169765 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:40.169765 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:40.169765 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:40.169765 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:59:40.169765 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:59:40.169765 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be2b42c6-7d99-48b0-b515-26a7139e11aa could not be found. Sep 17 20:59:40.169765 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:40.170898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8fa15002-08c0-436b-ba78-5112e4672b70 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Returning 404 to user: Instance be2b42c6-7d99-48b0-b515-26a7139e11aa could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:59:40.172172 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8fa15002-08c0-436b-ba78-5112e4672b70 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "DELETE /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 404 len: 111 microversion: 2.1 time: 0.064181 Sep 17 20:59:40.176923 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1090/2263] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:59:40 2022] DELETE /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:59:40.183019 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d3567402-028a-4e10-94f4-be828f7699b4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:40.183916 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d3567402-028a-4e10-94f4-be828f7699b4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: be2b42c6-7d99-48b0-b515-26a7139e11aa] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:40.194409 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d3567402-028a-4e10-94f4-be828f7699b4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:40.195282 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d3567402-028a-4e10-94f4-be828f7699b4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:40.195923 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d3567402-028a-4e10-94f4-be828f7699b4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:40.196930 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d3567402-028a-4e10-94f4-be828f7699b4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:40.197697 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d3567402-028a-4e10-94f4-be828f7699b4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:40.198355 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d3567402-028a-4e10-94f4-be828f7699b4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:40.224846 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-d3567402-028a-4e10-94f4-be828f7699b4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] HTTP exception thrown: Instance be2b42c6-7d99-48b0-b515-26a7139e11aa could not be found. Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d3567402-028a-4e10-94f4-be828f7699b4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Request method failure captured: Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa HTTP/1.1 Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjRFn2tQKGC1uAe9bqpTP_NrkyiVoEPWPj6EeaKBRFTcT_3xnlWY0pTkMJ4hC5pRCxUNPE-AOKqpt1bSrALS7ehDCQMiEha4CW5FDEWUPQj4njVXPv741ea7tr-65nzH_eSaKOIbqjpzDtqiEt9RhuydzmAVBkSwGPhgySaxy-1FUPg Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 2a4117ca05454573bbd93fbca50431d2 Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2a4117ca05454573bbd93fbca50431d2", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 2a4117ca05454573bbd93fbca50431d2 Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ImagesTestJSON-1640721037-project Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 6e33e0b756e14af28a90cc5c76d346e6 Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ImagesTestJSON-1640721037-project Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance be2b42c6-7d99-48b0-b515-26a7139e11aa could not be found. Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'be2b42c6-7d99-48b0-b515-26a7139e11aa'} Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be2b42c6-7d99-48b0-b515-26a7139e11aa could not be found. Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be2b42c6-7d99-48b0-b515-26a7139e11aa could not be found. Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:40.233225 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:40.236823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:40.236823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:40.236823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:59:40.236823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:59:40.236823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be2b42c6-7d99-48b0-b515-26a7139e11aa could not be found. Sep 17 20:59:40.236823 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:40.240890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d3567402-028a-4e10-94f4-be828f7699b4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Returning 404 to user: Instance be2b42c6-7d99-48b0-b515-26a7139e11aa could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:59:40.248316 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d3567402-028a-4e10-94f4-be828f7699b4 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa" status: 404 len: 111 microversion: 2.1 time: 0.069849 Sep 17 20:59:40.249160 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1091/2264] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:40 2022] GET /compute/v2.1/servers/be2b42c6-7d99-48b0-b515-26a7139e11aa => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:59:40.259135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2faa5e10-6644-4bb0-b26b-c3f6f21f625f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:40.267976 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-50a2d76b-fc6d-4c5c-8e5c-39925b9ce805 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '.version_select at 0x7f25a5bcdc10>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:40.274071 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2faa5e10-6644-4bb0-b26b-c3f6f21f625f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5" status: 200 len: 1463 microversion: 2.1 time: 0.294543 Sep 17 20:59:40.282371 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1174/2265] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:39 2022] GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5 => generated 1463 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:40.300852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f5da3a63-d797-4dbe-ac1b-b1c1d0870c67 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:40.302856 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f5da3a63-d797-4dbe-ac1b-b1c1d0870c67 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:40.313349 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f5da3a63-d797-4dbe-ac1b-b1c1d0870c67 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:40.316108 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-50a2d76b-fc6d-4c5c-8e5c-39925b9ce805 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] HTTP exception thrown: Image not found. Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-50a2d76b-fc6d-4c5c-8e5c-39925b9ce805 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Request method failure captured: Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3 HTTP/1.1 Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjRFn2tQKGC1uAe9bqpTP_NrkyiVoEPWPj6EeaKBRFTcT_3xnlWY0pTkMJ4hC5pRCxUNPE-AOKqpt1bSrALS7ehDCQMiEha4CW5FDEWUPQj4njVXPv741ea7tr-65nzH_eSaKOIbqjpzDtqiEt9RhuydzmAVBkSwGPhgySaxy-1FUPg Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 2a4117ca05454573bbd93fbca50431d2 Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2a4117ca05454573bbd93fbca50431d2", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 2a4117ca05454573bbd93fbca50431d2 Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ImagesTestJSON-1640721037-project Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 6e33e0b756e14af28a90cc5c76d346e6 Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ImagesTestJSON-1640721037-project Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: exception: Image not found. Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '791112c1-18cb-41c4-b7c7-64f001f7b2f3'} Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 791112c1-18cb-41c4-b7c7-64f001f7b2f3 to delete Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 791112c1-18cb-41c4-b7c7-64f001f7b2f3 could not be found. Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:40.320352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:40.324537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:40.324537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:40.324537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:59:40.324537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:59:40.324537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 20:59:40.324537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 20:59:40.324537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:59:40.324537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:59:40.324537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 17 20:59:40.324537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 17 20:59:40.324537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 17 20:59:40.324537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:40.324537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:40.324537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:40.324537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:40.324537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:40.324537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:40.324537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:59:40.324537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:59:40.324537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 17 20:59:40.324537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:40.329449 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-50a2d76b-fc6d-4c5c-8e5c-39925b9ce805 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Returning 404 to user: Image not found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:59:40.330613 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-50a2d76b-fc6d-4c5c-8e5c-39925b9ce805 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "DELETE /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3" status: 404 len: 62 microversion: 2.1 time: 0.077333 Sep 17 20:59:40.332261 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1092/2266] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:40 2022] DELETE /compute/v2.1/images/791112c1-18cb-41c4-b7c7-64f001f7b2f3 => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 20:59:40.333097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f5da3a63-d797-4dbe-ac1b-b1c1d0870c67 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:40.333839 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f5da3a63-d797-4dbe-ac1b-b1c1d0870c67 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:40.334822 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f5da3a63-d797-4dbe-ac1b-b1c1d0870c67 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:40.347397 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f5da3a63-d797-4dbe-ac1b-b1c1d0870c67 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:40.348688 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f5da3a63-d797-4dbe-ac1b-b1c1d0870c67 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:40.350240 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b5d844f4-2564-43f3-afaf-6ed01bc1c5c8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:40.362806 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b5d844f4-2564-43f3-afaf-6ed01bc1c5c8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: d99ba94b-addd-4964-8d95-91de304a4988] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:40.385036 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b5d844f4-2564-43f3-afaf-6ed01bc1c5c8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:40.385813 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b5d844f4-2564-43f3-afaf-6ed01bc1c5c8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:40.386835 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b5d844f4-2564-43f3-afaf-6ed01bc1c5c8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:40.411969 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b5d844f4-2564-43f3-afaf-6ed01bc1c5c8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:40.413736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b5d844f4-2564-43f3-afaf-6ed01bc1c5c8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:40.415545 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b5d844f4-2564-43f3-afaf-6ed01bc1c5c8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:40.451805 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-b5d844f4-2564-43f3-afaf-6ed01bc1c5c8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] HTTP exception thrown: Instance d99ba94b-addd-4964-8d95-91de304a4988 could not be found. Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b5d844f4-2564-43f3-afaf-6ed01bc1c5c8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Request method failure captured: Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988 HTTP/1.1 Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjRFn2tQKGC1uAe9bqpTP_NrkyiVoEPWPj6EeaKBRFTcT_3xnlWY0pTkMJ4hC5pRCxUNPE-AOKqpt1bSrALS7ehDCQMiEha4CW5FDEWUPQj4njVXPv741ea7tr-65nzH_eSaKOIbqjpzDtqiEt9RhuydzmAVBkSwGPhgySaxy-1FUPg Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 2a4117ca05454573bbd93fbca50431d2 Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2a4117ca05454573bbd93fbca50431d2", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 2a4117ca05454573bbd93fbca50431d2 Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ImagesTestJSON-1640721037-project Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 6e33e0b756e14af28a90cc5c76d346e6 Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ImagesTestJSON-1640721037-project Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance d99ba94b-addd-4964-8d95-91de304a4988 could not be found. Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'd99ba94b-addd-4964-8d95-91de304a4988'} Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d99ba94b-addd-4964-8d95-91de304a4988 could not be found. Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:59:40.453862 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d99ba94b-addd-4964-8d95-91de304a4988 could not be found. Sep 17 20:59:40.458599 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:40.458599 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:40.458599 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:40.458599 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:40.458599 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:40.458599 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:40.458599 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:59:40.458599 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:59:40.458599 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d99ba94b-addd-4964-8d95-91de304a4988 could not be found. Sep 17 20:59:40.458599 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 20:59:40.461512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b5d844f4-2564-43f3-afaf-6ed01bc1c5c8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Returning 404 to user: Instance d99ba94b-addd-4964-8d95-91de304a4988 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:59:40.462735 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b5d844f4-2564-43f3-afaf-6ed01bc1c5c8 tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988" status: 404 len: 111 microversion: 2.1 time: 0.125934 Sep 17 20:59:40.463957 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1093/2267] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 20:59:40 2022] DELETE /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:59:40.472618 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a6cdf9cc-558f-441a-8640-074ca6e38cf8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:40.473647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a6cdf9cc-558f-441a-8640-074ca6e38cf8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:40.482985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6cdf9cc-558f-441a-8640-074ca6e38cf8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:40.483706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6cdf9cc-558f-441a-8640-074ca6e38cf8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:40.484618 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6cdf9cc-558f-441a-8640-074ca6e38cf8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:40.485677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6cdf9cc-558f-441a-8640-074ca6e38cf8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:40.486609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6cdf9cc-558f-441a-8640-074ca6e38cf8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:40.487437 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6cdf9cc-558f-441a-8640-074ca6e38cf8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:41.481934 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a6cdf9cc-558f-441a-8640-074ca6e38cf8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:41.495286 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a6cdf9cc-558f-441a-8640-074ca6e38cf8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5" status: 200 len: 1521 microversion: 2.1 time: 1.029981 Sep 17 20:59:41.496177 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1094/2268] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:40 2022] GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 => generated 1521 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:41.510318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8cd3dfbf-a338-4e2e-af7b-7af8e5fd0f47 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:41.511966 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f5da3a63-d797-4dbe-ac1b-b1c1d0870c67 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:41.517498 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8cd3dfbf-a338-4e2e-af7b-7af8e5fd0f47 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:41.533658 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f5da3a63-d797-4dbe-ac1b-b1c1d0870c67 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1463 microversion: 2.1 time: 1.237739 Sep 17 20:59:41.536341 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1175/2269] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:40 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1463 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:59:41.548531 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8cd3dfbf-a338-4e2e-af7b-7af8e5fd0f47 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:41.549559 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8cd3dfbf-a338-4e2e-af7b-7af8e5fd0f47 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:41.550178 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8cd3dfbf-a338-4e2e-af7b-7af8e5fd0f47 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:41.551080 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8cd3dfbf-a338-4e2e-af7b-7af8e5fd0f47 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:41.551693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5a1eea9a-06be-4e24-9a7d-6789b6cfa66c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:41.553048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8cd3dfbf-a338-4e2e-af7b-7af8e5fd0f47 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:41.553687 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5a1eea9a-06be-4e24-9a7d-6789b6cfa66c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] [instance: d99ba94b-addd-4964-8d95-91de304a4988] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:41.554938 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8cd3dfbf-a338-4e2e-af7b-7af8e5fd0f47 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:41.572988 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a1eea9a-06be-4e24-9a7d-6789b6cfa66c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:41.579321 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a1eea9a-06be-4e24-9a7d-6789b6cfa66c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:41.582677 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a1eea9a-06be-4e24-9a7d-6789b6cfa66c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:41.583709 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a1eea9a-06be-4e24-9a7d-6789b6cfa66c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:41.588280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a1eea9a-06be-4e24-9a7d-6789b6cfa66c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:41.589288 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a1eea9a-06be-4e24-9a7d-6789b6cfa66c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:41.650122 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-5a1eea9a-06be-4e24-9a7d-6789b6cfa66c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] HTTP exception thrown: Instance d99ba94b-addd-4964-8d95-91de304a4988 could not be found. Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5a1eea9a-06be-4e24-9a7d-6789b6cfa66c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Request method failure captured: Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988 HTTP/1.1 Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjRFn2tQKGC1uAe9bqpTP_NrkyiVoEPWPj6EeaKBRFTcT_3xnlWY0pTkMJ4hC5pRCxUNPE-AOKqpt1bSrALS7ehDCQMiEha4CW5FDEWUPQj4njVXPv741ea7tr-65nzH_eSaKOIbqjpzDtqiEt9RhuydzmAVBkSwGPhgySaxy-1FUPg Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 2a4117ca05454573bbd93fbca50431d2 Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2a4117ca05454573bbd93fbca50431d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2a4117ca05454573bbd93fbca50431d2", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 2a4117ca05454573bbd93fbca50431d2 Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ImagesTestJSON-1640721037 Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ImagesTestJSON-1640721037-project Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 6e33e0b756e14af28a90cc5c76d346e6 Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ImagesTestJSON-1640721037-project Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance d99ba94b-addd-4964-8d95-91de304a4988 could not be found. Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'd99ba94b-addd-4964-8d95-91de304a4988'} Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d99ba94b-addd-4964-8d95-91de304a4988 could not be found. Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d99ba94b-addd-4964-8d95-91de304a4988 could not be found. Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:41.652457 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 20:59:41.656368 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 20:59:41.656368 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 20:59:41.656368 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 20:59:41.656368 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 20:59:41.656368 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d99ba94b-addd-4964-8d95-91de304a4988 could not be found. Sep 17 20:59:41.656368 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 20:59:41.656368 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5a1eea9a-06be-4e24-9a7d-6789b6cfa66c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] Returning 404 to user: Instance d99ba94b-addd-4964-8d95-91de304a4988 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 20:59:41.661606 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5a1eea9a-06be-4e24-9a7d-6789b6cfa66c tempest-ImagesTestJSON-1640721037 tempest-ImagesTestJSON-1640721037-project] 10.222.0.26 "GET /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988" status: 404 len: 111 microversion: 2.1 time: 0.122015 Sep 17 20:59:41.662898 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1176/2270] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:41 2022] GET /compute/v2.1/servers/d99ba94b-addd-4964-8d95-91de304a4988 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 20:59:41.679052 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-af4ec765-95b9-4ae7-9ed3-bc1c3ad016c0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:41.679839 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-af4ec765-95b9-4ae7-9ed3-bc1c3ad016c0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 1d44abe5-d50f-4f59-83fd-65376778153a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:41.684198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:59:41.688380 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af4ec765-95b9-4ae7-9ed3-bc1c3ad016c0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:41.689069 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af4ec765-95b9-4ae7-9ed3-bc1c3ad016c0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:41.689819 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af4ec765-95b9-4ae7-9ed3-bc1c3ad016c0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:41.690757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af4ec765-95b9-4ae7-9ed3-bc1c3ad016c0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:41.691807 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af4ec765-95b9-4ae7-9ed3-bc1c3ad016c0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:41.693011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af4ec765-95b9-4ae7-9ed3-bc1c3ad016c0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:41.699515 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:59:42.121496 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8cd3dfbf-a338-4e2e-af7b-7af8e5fd0f47 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:42.130180 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8cd3dfbf-a338-4e2e-af7b-7af8e5fd0f47 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1508 microversion: 2.1 time: 0.632666 Sep 17 20:59:42.131000 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1095/2271] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:41 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1508 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:42.135717 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7b5db53e-c7d9-480b-ac6e-b7ed8fb59202 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:42.136326 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7b5db53e-c7d9-480b-ac6e-b7ed8fb59202 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:42.143083 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7b5db53e-c7d9-480b-ac6e-b7ed8fb59202 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:42.143894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7b5db53e-c7d9-480b-ac6e-b7ed8fb59202 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:42.144493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7b5db53e-c7d9-480b-ac6e-b7ed8fb59202 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:42.145394 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7b5db53e-c7d9-480b-ac6e-b7ed8fb59202 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:42.146048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7b5db53e-c7d9-480b-ac6e-b7ed8fb59202 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:42.146692 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7b5db53e-c7d9-480b-ac6e-b7ed8fb59202 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:42.332972 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-af4ec765-95b9-4ae7-9ed3-bc1c3ad016c0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:42.342639 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-af4ec765-95b9-4ae7-9ed3-bc1c3ad016c0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a" status: 200 len: 1316 microversion: 2.1 time: 0.678512 Sep 17 20:59:42.347756 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1177/2272] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:41 2022] GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a => generated 1316 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:42.354827 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4c42e4a4-87f7-4a93-a291-5f71fa903e5f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-291651536", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "8cbeb946-182e-4489-b637-556194f5722e"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:42.463961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-4c42e4a4-87f7-4a93-a291-5f71fa903e5f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] validate_networks() for None {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:59:42.685546 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=12 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:59:42.691018 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7b5db53e-c7d9-480b-ac6e-b7ed8fb59202 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:42.700166 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7b5db53e-c7d9-480b-ac6e-b7ed8fb59202 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:42.701969 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7b5db53e-c7d9-480b-ac6e-b7ed8fb59202 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:42.703483 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7b5db53e-c7d9-480b-ac6e-b7ed8fb59202 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc" status: 200 len: 1361 microversion: 2.26 time: 0.571190 Sep 17 20:59:42.704507 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1096/2273] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:59:42 2022] GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc => generated 1361 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:59:42.709237 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-41697db8-ca92-4e60-9788-0a387bda80a4 req-60fcd4dc-f659-46fb-a76c-d324acb8b011 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc", "tag": "aac9debb-24da-4f8d-957a-4b9a05677c5c"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:42.720401 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-41697db8-ca92-4e60-9788-0a387bda80a4 req-60fcd4dc-f659-46fb-a76c-d324acb8b011 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:42.721082 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-41697db8-ca92-4e60-9788-0a387bda80a4 req-60fcd4dc-f659-46fb-a76c-d324acb8b011 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:42.721686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-41697db8-ca92-4e60-9788-0a387bda80a4 req-60fcd4dc-f659-46fb-a76c-d324acb8b011 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:42.743530 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-41697db8-ca92-4e60-9788-0a387bda80a4 req-60fcd4dc-f659-46fb-a76c-d324acb8b011 service nova] Creating event network-changed:aac9debb-24da-4f8d-957a-4b9a05677c5c for instance 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc on nch2-master-1 Sep 17 20:59:42.749183 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-41697db8-ca92-4e60-9788-0a387bda80a4 req-60fcd4dc-f659-46fb-a76c-d324acb8b011 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043202 Sep 17 20:59:42.751711 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1097/2274] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:42.757349 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8c270f36-d437-4a46-932b-d02523d6ddd4 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:42.758084 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8c270f36-d437-4a46-932b-d02523d6ddd4 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:42.765322 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c270f36-d437-4a46-932b-d02523d6ddd4 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:42.766071 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c270f36-d437-4a46-932b-d02523d6ddd4 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:42.766655 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c270f36-d437-4a46-932b-d02523d6ddd4 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:42.767524 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c270f36-d437-4a46-932b-d02523d6ddd4 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:42.768152 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c270f36-d437-4a46-932b-d02523d6ddd4 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:42.768724 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c270f36-d437-4a46-932b-d02523d6ddd4 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:43.179547 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-4c42e4a4-87f7-4a93-a291-5f71fa903e5f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:59:43.180201 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-4c42e4a4-87f7-4a93-a291-5f71fa903e5f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:59:43.180820 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-4c42e4a4-87f7-4a93-a291-5f71fa903e5f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:59:43.181383 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-4c42e4a4-87f7-4a93-a291-5f71fa903e5f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:59:43.181828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-4c42e4a4-87f7-4a93-a291-5f71fa903e5f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:59:43.193085 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c42e4a4-87f7-4a93-a291-5f71fa903e5f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:43.193700 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c42e4a4-87f7-4a93-a291-5f71fa903e5f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:43.194134 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c42e4a4-87f7-4a93-a291-5f71fa903e5f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:43.194866 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c42e4a4-87f7-4a93-a291-5f71fa903e5f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:43.195436 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c42e4a4-87f7-4a93-a291-5f71fa903e5f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:43.195995 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c42e4a4-87f7-4a93-a291-5f71fa903e5f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:43.216171 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-4c42e4a4-87f7-4a93-a291-5f71fa903e5f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Getting quotas for project a0c2cdfddf5b4d35a0ca3c7554271365. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:59:43.222370 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-4c42e4a4-87f7-4a93-a291-5f71fa903e5f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Getting quotas for user 1fff4805e6fb45a0b7c8b4dc08c4dedb and project a0c2cdfddf5b4d35a0ca3c7554271365. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:59:43.235624 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4c42e4a4-87f7-4a93-a291-5f71fa903e5f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:59:43.238228 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4c42e4a4-87f7-4a93-a291-5f71fa903e5f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 40199006-23db-454e-8f31-47dc0532b119] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:59:43.251870 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8c270f36-d437-4a46-932b-d02523d6ddd4 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:43.293732 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8c270f36-d437-4a46-932b-d02523d6ddd4 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5" status: 200 len: 1521 microversion: 2.1 time: 0.535858 Sep 17 20:59:43.310277 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1098/2275] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:42 2022] GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 => generated 1521 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:43.310762 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4c42e4a4-87f7-4a93-a291-5f71fa903e5f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.958923 Sep 17 20:59:43.313117 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1178/2276] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:59:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:59:43.323217 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-7ebc2079-caa1-4bbe-a423-aa5ecefa34b5 req-092d8c1d-1232-4a31-8dee-51f36c788ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d44abe5-d50f-4f59-83fd-65376778153a", "tag": "4ed5e734-5b30-4dff-a533-9bccd03f22ae"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:43.337767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1d0a2c82-ed91-4da4-9b58-8627da2e7184 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:43.339419 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1d0a2c82-ed91-4da4-9b58-8627da2e7184 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:43.349056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d0a2c82-ed91-4da4-9b58-8627da2e7184 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:43.349887 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d0a2c82-ed91-4da4-9b58-8627da2e7184 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:43.351229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d0a2c82-ed91-4da4-9b58-8627da2e7184 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:43.352210 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d0a2c82-ed91-4da4-9b58-8627da2e7184 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:43.352897 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d0a2c82-ed91-4da4-9b58-8627da2e7184 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:43.353768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d0a2c82-ed91-4da4-9b58-8627da2e7184 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:43.360066 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-7ebc2079-caa1-4bbe-a423-aa5ecefa34b5 req-092d8c1d-1232-4a31-8dee-51f36c788ed0 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:43.360570 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-7ebc2079-caa1-4bbe-a423-aa5ecefa34b5 req-092d8c1d-1232-4a31-8dee-51f36c788ed0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:43.370621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-7ebc2079-caa1-4bbe-a423-aa5ecefa34b5 req-092d8c1d-1232-4a31-8dee-51f36c788ed0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:43.398128 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-7ebc2079-caa1-4bbe-a423-aa5ecefa34b5 req-092d8c1d-1232-4a31-8dee-51f36c788ed0 service nova] Creating event network-changed:4ed5e734-5b30-4dff-a533-9bccd03f22ae for instance 1d44abe5-d50f-4f59-83fd-65376778153a on nch2-master-1 Sep 17 20:59:43.407772 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-7ebc2079-caa1-4bbe-a423-aa5ecefa34b5 req-092d8c1d-1232-4a31-8dee-51f36c788ed0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094209 Sep 17 20:59:43.410422 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1099/2277] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:43.420096 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-98d93c32-d624-43ce-ab99-89a04ac00b9f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:43.424555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-98d93c32-d624-43ce-ab99-89a04ac00b9f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 40199006-23db-454e-8f31-47dc0532b119] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:43.571934 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-98d93c32-d624-43ce-ab99-89a04ac00b9f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:43.586045 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-98d93c32-d624-43ce-ab99-89a04ac00b9f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119" status: 200 len: 1213 microversion: 2.1 time: 0.173265 Sep 17 20:59:43.586659 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1100/2278] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:43 2022] GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119 => generated 1213 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:43.612239 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e8c6f19b-ca5b-4d46-aa1f-4e34e89c5e84 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:43.612886 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e8c6f19b-ca5b-4d46-aa1f-4e34e89c5e84 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 1d44abe5-d50f-4f59-83fd-65376778153a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:43.631543 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8c6f19b-ca5b-4d46-aa1f-4e34e89c5e84 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:43.632613 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8c6f19b-ca5b-4d46-aa1f-4e34e89c5e84 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:43.633063 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8c6f19b-ca5b-4d46-aa1f-4e34e89c5e84 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:43.636773 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8c6f19b-ca5b-4d46-aa1f-4e34e89c5e84 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:43.637270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8c6f19b-ca5b-4d46-aa1f-4e34e89c5e84 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:43.637744 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8c6f19b-ca5b-4d46-aa1f-4e34e89c5e84 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:43.928478 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1d0a2c82-ed91-4da4-9b58-8627da2e7184 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:43.938420 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1d0a2c82-ed91-4da4-9b58-8627da2e7184 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1508 microversion: 2.1 time: 0.623977 Sep 17 20:59:43.945089 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1179/2279] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:43 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1508 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:43.954854 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1b489001-5894-4c32-a62c-2a5bb82bf8fd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:43.956809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1b489001-5894-4c32-a62c-2a5bb82bf8fd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:43.971156 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1b489001-5894-4c32-a62c-2a5bb82bf8fd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:43.974326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1b489001-5894-4c32-a62c-2a5bb82bf8fd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:43.976630 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1b489001-5894-4c32-a62c-2a5bb82bf8fd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:43.977715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1b489001-5894-4c32-a62c-2a5bb82bf8fd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:43.979638 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1b489001-5894-4c32-a62c-2a5bb82bf8fd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:43.981081 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1b489001-5894-4c32-a62c-2a5bb82bf8fd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:44.019369 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e8c6f19b-ca5b-4d46-aa1f-4e34e89c5e84 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:44.041332 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e8c6f19b-ca5b-4d46-aa1f-4e34e89c5e84 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a" status: 200 len: 1316 microversion: 2.1 time: 0.451278 Sep 17 20:59:44.051522 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1101/2280] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:43 2022] GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a => generated 1316 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:44.329806 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e1a9c244-6c35-4f97-8edf-86ead92e4d38 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:44.330374 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e1a9c244-6c35-4f97-8edf-86ead92e4d38 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:44.337788 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e1a9c244-6c35-4f97-8edf-86ead92e4d38 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:44.338279 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e1a9c244-6c35-4f97-8edf-86ead92e4d38 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:44.338953 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e1a9c244-6c35-4f97-8edf-86ead92e4d38 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:44.339957 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e1a9c244-6c35-4f97-8edf-86ead92e4d38 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:44.340709 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e1a9c244-6c35-4f97-8edf-86ead92e4d38 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:44.341397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e1a9c244-6c35-4f97-8edf-86ead92e4d38 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:44.422823 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1b489001-5894-4c32-a62c-2a5bb82bf8fd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:44.431711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1b489001-5894-4c32-a62c-2a5bb82bf8fd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:44.458965 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1b489001-5894-4c32-a62c-2a5bb82bf8fd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:44.460184 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1b489001-5894-4c32-a62c-2a5bb82bf8fd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc" status: 200 len: 1361 microversion: 2.26 time: 0.513676 Sep 17 20:59:44.460763 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1180/2281] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:59:43 2022] GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc => generated 1361 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:59:44.615404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9d442b54-c1b9-41ed-9063-d95314735b02 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:44.616073 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9d442b54-c1b9-41ed-9063-d95314735b02 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 40199006-23db-454e-8f31-47dc0532b119] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:44.631325 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d442b54-c1b9-41ed-9063-d95314735b02 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:44.631825 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d442b54-c1b9-41ed-9063-d95314735b02 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:44.632388 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d442b54-c1b9-41ed-9063-d95314735b02 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:44.633199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d442b54-c1b9-41ed-9063-d95314735b02 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:44.638084 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d442b54-c1b9-41ed-9063-d95314735b02 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:44.639090 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d442b54-c1b9-41ed-9063-d95314735b02 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:44.722987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e1a9c244-6c35-4f97-8edf-86ead92e4d38 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:44.734430 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e1a9c244-6c35-4f97-8edf-86ead92e4d38 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5" status: 200 len: 1521 microversion: 2.1 time: 0.411015 Sep 17 20:59:44.738630 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1102/2282] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:44 2022] GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 => generated 1521 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:44.879825 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9d442b54-c1b9-41ed-9063-d95314735b02 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:44.894332 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9d442b54-c1b9-41ed-9063-d95314735b02 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119" status: 200 len: 1209 microversion: 2.1 time: 0.283515 Sep 17 20:59:44.895250 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1181/2283] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:44 2022] GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119 => generated 1209 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:59:44.985487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1f48716e-3d27-4253-8965-eb0cf4ae4990 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:44.986636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1f48716e-3d27-4253-8965-eb0cf4ae4990 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:44.999673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=12 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:59:45.005066 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1f48716e-3d27-4253-8965-eb0cf4ae4990 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:45.006142 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1f48716e-3d27-4253-8965-eb0cf4ae4990 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:45.007901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1f48716e-3d27-4253-8965-eb0cf4ae4990 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:45.009722 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1f48716e-3d27-4253-8965-eb0cf4ae4990 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:45.012314 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1f48716e-3d27-4253-8965-eb0cf4ae4990 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:45.013134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1f48716e-3d27-4253-8965-eb0cf4ae4990 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:45.081411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c1ac749f-efc4-4cc8-a298-c26040fce40b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:45.082163 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c1ac749f-efc4-4cc8-a298-c26040fce40b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 1d44abe5-d50f-4f59-83fd-65376778153a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:45.097559 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1ac749f-efc4-4cc8-a298-c26040fce40b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:45.099166 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1ac749f-efc4-4cc8-a298-c26040fce40b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:45.100727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1ac749f-efc4-4cc8-a298-c26040fce40b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:45.102406 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1ac749f-efc4-4cc8-a298-c26040fce40b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:45.103179 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1ac749f-efc4-4cc8-a298-c26040fce40b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:45.103760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1ac749f-efc4-4cc8-a298-c26040fce40b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:45.282850 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1f48716e-3d27-4253-8965-eb0cf4ae4990 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:45.290105 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1f48716e-3d27-4253-8965-eb0cf4ae4990 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1508 microversion: 2.1 time: 0.323530 Sep 17 20:59:45.290928 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1103/2284] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:44 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1508 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:45.487352 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-22904ce2-ec0e-4ea4-b567-82de0853548f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:45.488452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-22904ce2-ec0e-4ea4-b567-82de0853548f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:45.501091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-22904ce2-ec0e-4ea4-b567-82de0853548f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:45.501888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-22904ce2-ec0e-4ea4-b567-82de0853548f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:45.502688 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-22904ce2-ec0e-4ea4-b567-82de0853548f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:45.509815 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-22904ce2-ec0e-4ea4-b567-82de0853548f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:45.510726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-22904ce2-ec0e-4ea4-b567-82de0853548f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:45.512552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-22904ce2-ec0e-4ea4-b567-82de0853548f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:45.556615 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c1ac749f-efc4-4cc8-a298-c26040fce40b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:45.569152 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c1ac749f-efc4-4cc8-a298-c26040fce40b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a" status: 200 len: 1316 microversion: 2.1 time: 0.498822 Sep 17 20:59:45.572239 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1182/2285] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:45 2022] GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a => generated 1316 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:45.762546 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a606acc0-d270-4c9c-8b21-92bb6ecdb481 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:45.763969 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a606acc0-d270-4c9c-8b21-92bb6ecdb481 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:45.776983 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a606acc0-d270-4c9c-8b21-92bb6ecdb481 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:45.795276 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a606acc0-d270-4c9c-8b21-92bb6ecdb481 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:45.796089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a606acc0-d270-4c9c-8b21-92bb6ecdb481 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:45.797022 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a606acc0-d270-4c9c-8b21-92bb6ecdb481 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:45.797659 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a606acc0-d270-4c9c-8b21-92bb6ecdb481 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:45.801879 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a606acc0-d270-4c9c-8b21-92bb6ecdb481 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:46.809708 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-22904ce2-ec0e-4ea4-b567-82de0853548f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:46.823578 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-22904ce2-ec0e-4ea4-b567-82de0853548f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:46.825417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-22904ce2-ec0e-4ea4-b567-82de0853548f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:46.827027 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-22904ce2-ec0e-4ea4-b567-82de0853548f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc" status: 200 len: 1361 microversion: 2.26 time: 1.344525 Sep 17 20:59:46.828354 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1104/2286] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:59:45 2022] GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc => generated 1361 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:59:46.834818 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0e0afd6d-67b0-4eab-9621-40bd6dfdd0da tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:46.835607 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0e0afd6d-67b0-4eab-9621-40bd6dfdd0da tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 40199006-23db-454e-8f31-47dc0532b119] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:46.843220 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e0afd6d-67b0-4eab-9621-40bd6dfdd0da tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:46.844133 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e0afd6d-67b0-4eab-9621-40bd6dfdd0da tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:46.845352 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e0afd6d-67b0-4eab-9621-40bd6dfdd0da tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:46.846366 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e0afd6d-67b0-4eab-9621-40bd6dfdd0da tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:46.847132 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e0afd6d-67b0-4eab-9621-40bd6dfdd0da tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:46.847713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e0afd6d-67b0-4eab-9621-40bd6dfdd0da tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:47.000864 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0e0afd6d-67b0-4eab-9621-40bd6dfdd0da tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:47.014072 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0e0afd6d-67b0-4eab-9621-40bd6dfdd0da tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119" status: 200 len: 1271 microversion: 2.1 time: 0.183704 Sep 17 20:59:47.027607 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1105/2287] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:46 2022] GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119 => generated 1271 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:47.032880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f3759728-9cbd-426e-a28a-9b69a9e01ac5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:47.039395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f3759728-9cbd-426e-a28a-9b69a9e01ac5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:47.046333 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f3759728-9cbd-426e-a28a-9b69a9e01ac5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:47.047062 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f3759728-9cbd-426e-a28a-9b69a9e01ac5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:47.047657 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f3759728-9cbd-426e-a28a-9b69a9e01ac5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:47.048527 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f3759728-9cbd-426e-a28a-9b69a9e01ac5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:47.050000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f3759728-9cbd-426e-a28a-9b69a9e01ac5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:47.050588 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f3759728-9cbd-426e-a28a-9b69a9e01ac5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:47.314490 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a606acc0-d270-4c9c-8b21-92bb6ecdb481 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:47.331829 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a606acc0-d270-4c9c-8b21-92bb6ecdb481 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5" status: 200 len: 1521 microversion: 2.1 time: 1.570044 Sep 17 20:59:47.333335 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1183/2288] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:45 2022] GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 => generated 1521 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:59:47.366640 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-00bed58f-4b69-43e1-9534-58505b92f7bc tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:47.367272 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-00bed58f-4b69-43e1-9534-58505b92f7bc tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 1d44abe5-d50f-4f59-83fd-65376778153a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:47.373857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00bed58f-4b69-43e1-9534-58505b92f7bc tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:47.374360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00bed58f-4b69-43e1-9534-58505b92f7bc tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:47.374986 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00bed58f-4b69-43e1-9534-58505b92f7bc tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:47.375733 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00bed58f-4b69-43e1-9534-58505b92f7bc tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:47.376205 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00bed58f-4b69-43e1-9534-58505b92f7bc tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:47.376628 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00bed58f-4b69-43e1-9534-58505b92f7bc tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:47.661121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f3759728-9cbd-426e-a28a-9b69a9e01ac5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:47.673843 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f3759728-9cbd-426e-a28a-9b69a9e01ac5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1508 microversion: 2.1 time: 0.640454 Sep 17 20:59:47.675010 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1106/2289] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:47 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1508 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:47.856739 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ece994d4-c8c9-402a-b89f-f57cff1e38e1 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:47.857536 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ece994d4-c8c9-402a-b89f-f57cff1e38e1 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:47.866988 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:59:47.868674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ece994d4-c8c9-402a-b89f-f57cff1e38e1 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:47.871169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ece994d4-c8c9-402a-b89f-f57cff1e38e1 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:47.873442 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ece994d4-c8c9-402a-b89f-f57cff1e38e1 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:47.874483 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ece994d4-c8c9-402a-b89f-f57cff1e38e1 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:47.878131 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ece994d4-c8c9-402a-b89f-f57cff1e38e1 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:47.878807 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ece994d4-c8c9-402a-b89f-f57cff1e38e1 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:48.298779 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-00bed58f-4b69-43e1-9534-58505b92f7bc tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:48.310457 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-00bed58f-4b69-43e1-9534-58505b92f7bc tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a" status: 200 len: 1316 microversion: 2.1 time: 0.962057 Sep 17 20:59:48.311083 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1184/2290] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:47 2022] GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a => generated 1316 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:48.323032 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2486ffae-3bf9-4b41-92e9-a4aaec9f45f4 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:48.324913 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2486ffae-3bf9-4b41-92e9-a4aaec9f45f4 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 40199006-23db-454e-8f31-47dc0532b119] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:48.344389 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2486ffae-3bf9-4b41-92e9-a4aaec9f45f4 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:48.345036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2486ffae-3bf9-4b41-92e9-a4aaec9f45f4 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:48.345512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2486ffae-3bf9-4b41-92e9-a4aaec9f45f4 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:48.346278 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2486ffae-3bf9-4b41-92e9-a4aaec9f45f4 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:48.351346 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2486ffae-3bf9-4b41-92e9-a4aaec9f45f4 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:48.351891 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2486ffae-3bf9-4b41-92e9-a4aaec9f45f4 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:48.417187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ece994d4-c8c9-402a-b89f-f57cff1e38e1 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:48.420210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:59:48.437014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ece994d4-c8c9-402a-b89f-f57cff1e38e1 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:48.438610 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ece994d4-c8c9-402a-b89f-f57cff1e38e1 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:48.443706 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ece994d4-c8c9-402a-b89f-f57cff1e38e1 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc" status: 200 len: 1361 microversion: 2.26 time: 0.591337 Sep 17 20:59:48.453919 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1107/2291] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:59:47 2022] GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc => generated 1361 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 20:59:48.481920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b334c925-4913-4b60-af57-a48ca12d78b4 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:48.485392 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b334c925-4913-4b60-af57-a48ca12d78b4 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:48.504387 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b334c925-4913-4b60-af57-a48ca12d78b4 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:48.505143 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b334c925-4913-4b60-af57-a48ca12d78b4 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:48.506546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b334c925-4913-4b60-af57-a48ca12d78b4 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:48.509560 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b334c925-4913-4b60-af57-a48ca12d78b4 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:48.510856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b334c925-4913-4b60-af57-a48ca12d78b4 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:48.511592 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b334c925-4913-4b60-af57-a48ca12d78b4 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:48.631306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2486ffae-3bf9-4b41-92e9-a4aaec9f45f4 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:48.640874 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2486ffae-3bf9-4b41-92e9-a4aaec9f45f4 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119" status: 200 len: 1271 microversion: 2.1 time: 0.326569 Sep 17 20:59:48.642385 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1185/2292] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:48 2022] GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119 => generated 1271 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:48.700984 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ac4ba2e6-fc55-4943-8caa-101ade5955a8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:48.702224 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ac4ba2e6-fc55-4943-8caa-101ade5955a8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:48.711265 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac4ba2e6-fc55-4943-8caa-101ade5955a8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:48.711838 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac4ba2e6-fc55-4943-8caa-101ade5955a8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:48.712369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac4ba2e6-fc55-4943-8caa-101ade5955a8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:48.713172 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac4ba2e6-fc55-4943-8caa-101ade5955a8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:48.714221 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac4ba2e6-fc55-4943-8caa-101ade5955a8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:48.715164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac4ba2e6-fc55-4943-8caa-101ade5955a8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:48.868982 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b334c925-4913-4b60-af57-a48ca12d78b4 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:48.878570 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b334c925-4913-4b60-af57-a48ca12d78b4 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5" status: 200 len: 1521 microversion: 2.1 time: 0.422951 Sep 17 20:59:48.878784 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1108/2293] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:48 2022] GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 => generated 1521 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:49.102358 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ac4ba2e6-fc55-4943-8caa-101ade5955a8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:49.112170 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ac4ba2e6-fc55-4943-8caa-101ade5955a8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1508 microversion: 2.1 time: 0.415460 Sep 17 20:59:49.116916 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1186/2294] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:48 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1508 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:49.344957 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-56c3b066-7213-466a-aed3-a236c69f843a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:49.345969 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-56c3b066-7213-466a-aed3-a236c69f843a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 1d44abe5-d50f-4f59-83fd-65376778153a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:49.356696 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56c3b066-7213-466a-aed3-a236c69f843a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:49.357384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56c3b066-7213-466a-aed3-a236c69f843a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:49.359250 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56c3b066-7213-466a-aed3-a236c69f843a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:49.360292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56c3b066-7213-466a-aed3-a236c69f843a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:49.362491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56c3b066-7213-466a-aed3-a236c69f843a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:49.363113 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56c3b066-7213-466a-aed3-a236c69f843a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:49.486602 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-78f6bb93-fc5f-4469-822a-0899f19732b5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:49.487865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-78f6bb93-fc5f-4469-822a-0899f19732b5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:49.498890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-78f6bb93-fc5f-4469-822a-0899f19732b5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:49.499720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-78f6bb93-fc5f-4469-822a-0899f19732b5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:49.500438 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-78f6bb93-fc5f-4469-822a-0899f19732b5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:49.501363 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-78f6bb93-fc5f-4469-822a-0899f19732b5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:49.503528 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-78f6bb93-fc5f-4469-822a-0899f19732b5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:49.506465 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-78f6bb93-fc5f-4469-822a-0899f19732b5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:50.006001 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-56c3b066-7213-466a-aed3-a236c69f843a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:50.023319 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-56c3b066-7213-466a-aed3-a236c69f843a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a" status: 200 len: 1316 microversion: 2.1 time: 0.680108 Sep 17 20:59:50.025281 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1109/2295] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:49 2022] GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a => generated 1316 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:50.035989 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f35fb308-0235-4c12-ba3d-e8ae19f0535a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:50.041565 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f35fb308-0235-4c12-ba3d-e8ae19f0535a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 40199006-23db-454e-8f31-47dc0532b119] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:50.054856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f35fb308-0235-4c12-ba3d-e8ae19f0535a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:50.055381 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f35fb308-0235-4c12-ba3d-e8ae19f0535a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:50.055813 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f35fb308-0235-4c12-ba3d-e8ae19f0535a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:50.056551 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f35fb308-0235-4c12-ba3d-e8ae19f0535a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:50.057003 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f35fb308-0235-4c12-ba3d-e8ae19f0535a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:50.057435 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f35fb308-0235-4c12-ba3d-e8ae19f0535a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:50.121192 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-78f6bb93-fc5f-4469-822a-0899f19732b5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:50.136596 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-78f6bb93-fc5f-4469-822a-0899f19732b5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:50.140299 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-78f6bb93-fc5f-4469-822a-0899f19732b5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:50.142437 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-78f6bb93-fc5f-4469-822a-0899f19732b5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc" status: 200 len: 1361 microversion: 2.26 time: 0.662179 Sep 17 20:59:50.155271 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1187/2296] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:59:49 2022] GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc => generated 1361 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 20:59:50.183228 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-46525d1c-8db8-4535-8c54-c6e8651af328 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:50.184309 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-46525d1c-8db8-4535-8c54-c6e8651af328 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:50.193110 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46525d1c-8db8-4535-8c54-c6e8651af328 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:50.193975 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46525d1c-8db8-4535-8c54-c6e8651af328 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:50.194629 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46525d1c-8db8-4535-8c54-c6e8651af328 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:50.195555 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46525d1c-8db8-4535-8c54-c6e8651af328 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:50.196310 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46525d1c-8db8-4535-8c54-c6e8651af328 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:50.197765 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46525d1c-8db8-4535-8c54-c6e8651af328 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:50.586141 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-46525d1c-8db8-4535-8c54-c6e8651af328 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:50.589937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f35fb308-0235-4c12-ba3d-e8ae19f0535a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:50.599051 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f35fb308-0235-4c12-ba3d-e8ae19f0535a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119" status: 200 len: 1313 microversion: 2.1 time: 0.572537 Sep 17 20:59:50.599650 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1110/2297] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:50 2022] GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119 => generated 1313 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:50.607198 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-46525d1c-8db8-4535-8c54-c6e8651af328 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5" status: 200 len: 1521 microversion: 2.1 time: 0.448226 Sep 17 20:59:50.607198 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1188/2298] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:50 2022] GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 => generated 1521 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:50.612716 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ccb822fc-a5dd-42f6-a1de-28af85048a8a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:50.613556 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ccb822fc-a5dd-42f6-a1de-28af85048a8a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:50.634694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ccb822fc-a5dd-42f6-a1de-28af85048a8a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:50.635574 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ccb822fc-a5dd-42f6-a1de-28af85048a8a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:50.636289 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ccb822fc-a5dd-42f6-a1de-28af85048a8a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:50.637820 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ccb822fc-a5dd-42f6-a1de-28af85048a8a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:50.639263 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ccb822fc-a5dd-42f6-a1de-28af85048a8a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:50.639881 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ccb822fc-a5dd-42f6-a1de-28af85048a8a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:50.915632 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ccb822fc-a5dd-42f6-a1de-28af85048a8a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:50.927467 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ccb822fc-a5dd-42f6-a1de-28af85048a8a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1508 microversion: 2.1 time: 0.319820 Sep 17 20:59:50.939341 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1189/2299] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:50 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1508 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:51.052593 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-64732b7b-4ead-4c0e-adcd-4adf070ed1bb tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:51.053285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-64732b7b-4ead-4c0e-adcd-4adf070ed1bb tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 1d44abe5-d50f-4f59-83fd-65376778153a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:51.062219 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-64732b7b-4ead-4c0e-adcd-4adf070ed1bb tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:51.066231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-64732b7b-4ead-4c0e-adcd-4adf070ed1bb tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:51.068190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-64732b7b-4ead-4c0e-adcd-4adf070ed1bb tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:51.069123 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-64732b7b-4ead-4c0e-adcd-4adf070ed1bb tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:51.070093 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-64732b7b-4ead-4c0e-adcd-4adf070ed1bb tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:51.072324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-64732b7b-4ead-4c0e-adcd-4adf070ed1bb tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:51.186199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-dfc4d866-c311-4164-a578-a4a7d43572cf tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:51.187114 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-dfc4d866-c311-4164-a578-a4a7d43572cf tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:51.195337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dfc4d866-c311-4164-a578-a4a7d43572cf tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:51.203348 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dfc4d866-c311-4164-a578-a4a7d43572cf tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:51.204093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dfc4d866-c311-4164-a578-a4a7d43572cf tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:51.204998 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dfc4d866-c311-4164-a578-a4a7d43572cf tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:51.205675 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dfc4d866-c311-4164-a578-a4a7d43572cf tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:51.206250 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dfc4d866-c311-4164-a578-a4a7d43572cf tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:51.507296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-64732b7b-4ead-4c0e-adcd-4adf070ed1bb tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:51.516736 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-64732b7b-4ead-4c0e-adcd-4adf070ed1bb tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a" status: 200 len: 1316 microversion: 2.1 time: 0.468815 Sep 17 20:59:51.532764 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1111/2300] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:51 2022] GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a => generated 1316 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:51.624640 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8303b0e9-785b-4f8d-be7b-65f32ad51a2a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:51.625858 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8303b0e9-785b-4f8d-be7b-65f32ad51a2a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 40199006-23db-454e-8f31-47dc0532b119] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:51.632048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-dfc4d866-c311-4164-a578-a4a7d43572cf tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:51.638121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8303b0e9-785b-4f8d-be7b-65f32ad51a2a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:51.642128 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8303b0e9-785b-4f8d-be7b-65f32ad51a2a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:51.642813 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8303b0e9-785b-4f8d-be7b-65f32ad51a2a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:51.643760 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8303b0e9-785b-4f8d-be7b-65f32ad51a2a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:51.644928 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-dfc4d866-c311-4164-a578-a4a7d43572cf tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:51.645706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8303b0e9-785b-4f8d-be7b-65f32ad51a2a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:51.646450 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-dfc4d866-c311-4164-a578-a4a7d43572cf tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:51.647627 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-dfc4d866-c311-4164-a578-a4a7d43572cf tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc" status: 200 len: 1361 microversion: 2.26 time: 0.465475 Sep 17 20:59:51.648076 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8303b0e9-785b-4f8d-be7b-65f32ad51a2a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:51.684077 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1190/2301] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:59:51 2022] GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc => generated 1361 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:59:51.701621 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4bed6a78-2c48-499c-86b9-1686f7ae39a1 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:51.707411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4bed6a78-2c48-499c-86b9-1686f7ae39a1 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:51.720564 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4bed6a78-2c48-499c-86b9-1686f7ae39a1 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:51.724043 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4bed6a78-2c48-499c-86b9-1686f7ae39a1 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:51.724722 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4bed6a78-2c48-499c-86b9-1686f7ae39a1 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:51.726367 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4bed6a78-2c48-499c-86b9-1686f7ae39a1 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:51.727047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4bed6a78-2c48-499c-86b9-1686f7ae39a1 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:51.728593 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4bed6a78-2c48-499c-86b9-1686f7ae39a1 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:52.031700 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8303b0e9-785b-4f8d-be7b-65f32ad51a2a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:52.041138 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8303b0e9-785b-4f8d-be7b-65f32ad51a2a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119" status: 200 len: 1313 microversion: 2.1 time: 0.420562 Sep 17 20:59:52.045496 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1112/2302] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:51 2022] GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119 => generated 1313 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:59:52.082670 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-211683b2-422c-47c5-b65d-530ba43f5425 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:52.084399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-211683b2-422c-47c5-b65d-530ba43f5425 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:52.095288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-211683b2-422c-47c5-b65d-530ba43f5425 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:52.095774 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-211683b2-422c-47c5-b65d-530ba43f5425 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:52.096374 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-211683b2-422c-47c5-b65d-530ba43f5425 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:52.097371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-211683b2-422c-47c5-b65d-530ba43f5425 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:52.098547 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-211683b2-422c-47c5-b65d-530ba43f5425 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:52.099263 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-211683b2-422c-47c5-b65d-530ba43f5425 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:52.578555 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4bed6a78-2c48-499c-86b9-1686f7ae39a1 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:52.594770 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4bed6a78-2c48-499c-86b9-1686f7ae39a1 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5" status: 200 len: 1521 microversion: 2.1 time: 0.909333 Sep 17 20:59:52.598640 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1191/2303] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:51 2022] GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 => generated 1521 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:52.607785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-1feca68c-1f2d-4352-9302-aacc99c3339f req-a4a86557-41e8-4cfe-96bd-0bf2adf11d10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40199006-23db-454e-8f31-47dc0532b119", "tag": "5ffd676b-d079-4fa9-b950-637c46640d96"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:52.641088 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-1feca68c-1f2d-4352-9302-aacc99c3339f req-a4a86557-41e8-4cfe-96bd-0bf2adf11d10 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:52.642792 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-1feca68c-1f2d-4352-9302-aacc99c3339f req-a4a86557-41e8-4cfe-96bd-0bf2adf11d10 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:52.643763 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-1feca68c-1f2d-4352-9302-aacc99c3339f req-a4a86557-41e8-4cfe-96bd-0bf2adf11d10 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:52.655127 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-211683b2-422c-47c5-b65d-530ba43f5425 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:52.670372 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-1feca68c-1f2d-4352-9302-aacc99c3339f req-a4a86557-41e8-4cfe-96bd-0bf2adf11d10 service nova] Creating event network-changed:5ffd676b-d079-4fa9-b950-637c46640d96 for instance 40199006-23db-454e-8f31-47dc0532b119 on nch1-master-1 Sep 17 20:59:52.685831 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-1feca68c-1f2d-4352-9302-aacc99c3339f req-a4a86557-41e8-4cfe-96bd-0bf2adf11d10 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082848 Sep 17 20:59:52.688677 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1192/2304] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:52.690610 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-211683b2-422c-47c5-b65d-530ba43f5425 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1508 microversion: 2.1 time: 0.643258 Sep 17 20:59:52.696339 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1113/2305] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:52 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1508 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:52.702888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-c2ccba98-10ba-4d55-ab87-dbaa9ab53641 req-14a168f6-c3d8-4c06-9c26-d69c3bea16f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d44abe5-d50f-4f59-83fd-65376778153a", "name": "network-vif-plugged", "status": "completed", "tag": "4ed5e734-5b30-4dff-a533-9bccd03f22ae"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:52.711800 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8fca6849-e8c5-4f48-86ce-d055403e76d4 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:52.713275 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8fca6849-e8c5-4f48-86ce-d055403e76d4 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 1d44abe5-d50f-4f59-83fd-65376778153a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:52.721841 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8fca6849-e8c5-4f48-86ce-d055403e76d4 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:52.723132 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8fca6849-e8c5-4f48-86ce-d055403e76d4 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:52.724039 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8fca6849-e8c5-4f48-86ce-d055403e76d4 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:52.726361 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8fca6849-e8c5-4f48-86ce-d055403e76d4 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:52.727818 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8fca6849-e8c5-4f48-86ce-d055403e76d4 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:52.728481 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8fca6849-e8c5-4f48-86ce-d055403e76d4 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:52.729780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c2ccba98-10ba-4d55-ab87-dbaa9ab53641 req-14a168f6-c3d8-4c06-9c26-d69c3bea16f7 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:52.730359 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c2ccba98-10ba-4d55-ab87-dbaa9ab53641 req-14a168f6-c3d8-4c06-9c26-d69c3bea16f7 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:52.731135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c2ccba98-10ba-4d55-ab87-dbaa9ab53641 req-14a168f6-c3d8-4c06-9c26-d69c3bea16f7 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:52.768020 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-c2ccba98-10ba-4d55-ab87-dbaa9ab53641 req-14a168f6-c3d8-4c06-9c26-d69c3bea16f7 service nova] Creating event network-vif-plugged:4ed5e734-5b30-4dff-a533-9bccd03f22ae for instance 1d44abe5-d50f-4f59-83fd-65376778153a on nch2-master-1 Sep 17 20:59:52.805649 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-c2ccba98-10ba-4d55-ab87-dbaa9ab53641 req-14a168f6-c3d8-4c06-9c26-d69c3bea16f7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112335 Sep 17 20:59:52.808348 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1193/2306] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:52.827111 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c1da3fc2-a672-4540-8d96-db20a9e12945 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:52.829233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c1da3fc2-a672-4540-8d96-db20a9e12945 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:52.867532 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1da3fc2-a672-4540-8d96-db20a9e12945 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:52.870142 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1da3fc2-a672-4540-8d96-db20a9e12945 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:52.870595 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1da3fc2-a672-4540-8d96-db20a9e12945 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:52.876223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1da3fc2-a672-4540-8d96-db20a9e12945 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:52.876848 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1da3fc2-a672-4540-8d96-db20a9e12945 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:52.879817 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1da3fc2-a672-4540-8d96-db20a9e12945 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:53.207662 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:59:53.232303 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=22 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:59:53.445556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8fca6849-e8c5-4f48-86ce-d055403e76d4 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:53.469139 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8fca6849-e8c5-4f48-86ce-d055403e76d4 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a" status: 200 len: 1316 microversion: 2.1 time: 0.771344 Sep 17 20:59:53.471398 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1114/2307] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:52 2022] GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a => generated 1316 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:53.477924 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f5d4d59c-3104-4e7f-88ec-fea11062bacc tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:53.478802 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f5d4d59c-3104-4e7f-88ec-fea11062bacc tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 40199006-23db-454e-8f31-47dc0532b119] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:53.500366 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f5d4d59c-3104-4e7f-88ec-fea11062bacc tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:53.501104 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f5d4d59c-3104-4e7f-88ec-fea11062bacc tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:53.501821 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f5d4d59c-3104-4e7f-88ec-fea11062bacc tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:53.502750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f5d4d59c-3104-4e7f-88ec-fea11062bacc tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:53.503497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f5d4d59c-3104-4e7f-88ec-fea11062bacc tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:53.504026 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f5d4d59c-3104-4e7f-88ec-fea11062bacc tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:53.581807 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=10 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:59:53.678156 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c1da3fc2-a672-4540-8d96-db20a9e12945 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:53.687690 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c1da3fc2-a672-4540-8d96-db20a9e12945 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:53.689129 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c1da3fc2-a672-4540-8d96-db20a9e12945 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:53.692756 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c1da3fc2-a672-4540-8d96-db20a9e12945 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc" status: 200 len: 1361 microversion: 2.26 time: 0.881610 Sep 17 20:59:53.693534 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1194/2308] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:59:52 2022] GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc => generated 1361 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:59:53.712830 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-242c61ad-be06-4360-bc84-e5ce985b0891 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:53.718125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-242c61ad-be06-4360-bc84-e5ce985b0891 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:53.732276 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-242c61ad-be06-4360-bc84-e5ce985b0891 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:53.732800 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-242c61ad-be06-4360-bc84-e5ce985b0891 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:53.733334 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-242c61ad-be06-4360-bc84-e5ce985b0891 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:53.735128 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-242c61ad-be06-4360-bc84-e5ce985b0891 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:53.735608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-242c61ad-be06-4360-bc84-e5ce985b0891 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:53.736057 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-242c61ad-be06-4360-bc84-e5ce985b0891 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:53.755422 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f5d4d59c-3104-4e7f-88ec-fea11062bacc tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:53.770472 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f5d4d59c-3104-4e7f-88ec-fea11062bacc tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119" status: 200 len: 1313 microversion: 2.1 time: 0.297699 Sep 17 20:59:53.783683 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1115/2309] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:53 2022] GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119 => generated 1313 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:53.796748 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-325c86e3-1acb-4e22-85de-c6dc370d4514 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:53.797860 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-325c86e3-1acb-4e22-85de-c6dc370d4514 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:53.813167 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-325c86e3-1acb-4e22-85de-c6dc370d4514 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:53.813792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-325c86e3-1acb-4e22-85de-c6dc370d4514 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:53.814304 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-325c86e3-1acb-4e22-85de-c6dc370d4514 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:53.822481 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-325c86e3-1acb-4e22-85de-c6dc370d4514 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:53.826698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-325c86e3-1acb-4e22-85de-c6dc370d4514 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:53.827418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-325c86e3-1acb-4e22-85de-c6dc370d4514 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:53.993088 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-242c61ad-be06-4360-bc84-e5ce985b0891 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:54.000757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:59:54.004486 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-242c61ad-be06-4360-bc84-e5ce985b0891 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5" status: 200 len: 1521 microversion: 2.1 time: 0.299924 Sep 17 20:59:54.013973 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1195/2310] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:53 2022] GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:54.024888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-325c86e3-1acb-4e22-85de-c6dc370d4514 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:54.030820 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-325c86e3-1acb-4e22-85de-c6dc370d4514 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1508 microversion: 2.1 time: 0.244410 Sep 17 20:59:54.042035 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1116/2311] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:53 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1508 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:54.500199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-14009679-588b-4592-9205-e326232cf2d7 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:54.501757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-14009679-588b-4592-9205-e326232cf2d7 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 1d44abe5-d50f-4f59-83fd-65376778153a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:54.510178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14009679-588b-4592-9205-e326232cf2d7 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:54.511343 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14009679-588b-4592-9205-e326232cf2d7 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:54.512105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14009679-588b-4592-9205-e326232cf2d7 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:54.513144 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14009679-588b-4592-9205-e326232cf2d7 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:54.514233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14009679-588b-4592-9205-e326232cf2d7 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:54.514902 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14009679-588b-4592-9205-e326232cf2d7 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:54.728211 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-574d72ef-1930-4a9a-82a7-b76e111e5a39 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:54.730472 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-574d72ef-1930-4a9a-82a7-b76e111e5a39 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:54.739837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-574d72ef-1930-4a9a-82a7-b76e111e5a39 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:54.741020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-574d72ef-1930-4a9a-82a7-b76e111e5a39 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:54.741947 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-574d72ef-1930-4a9a-82a7-b76e111e5a39 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:54.743142 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-574d72ef-1930-4a9a-82a7-b76e111e5a39 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:54.743991 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-574d72ef-1930-4a9a-82a7-b76e111e5a39 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:54.755522 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-14009679-588b-4592-9205-e326232cf2d7 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:54.763088 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-574d72ef-1930-4a9a-82a7-b76e111e5a39 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:54.771607 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-14009679-588b-4592-9205-e326232cf2d7 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a" status: 200 len: 1316 microversion: 2.1 time: 0.276596 Sep 17 20:59:54.772514 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1196/2312] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:54 2022] GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a => generated 1316 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:54.811551 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c57e6959-95dd-464d-93e1-b2c2e076ef41 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:54.813100 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c57e6959-95dd-464d-93e1-b2c2e076ef41 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 40199006-23db-454e-8f31-47dc0532b119] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:54.825254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c57e6959-95dd-464d-93e1-b2c2e076ef41 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:54.826109 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c57e6959-95dd-464d-93e1-b2c2e076ef41 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:54.828074 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c57e6959-95dd-464d-93e1-b2c2e076ef41 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:54.829145 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c57e6959-95dd-464d-93e1-b2c2e076ef41 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:54.830898 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c57e6959-95dd-464d-93e1-b2c2e076ef41 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:54.834235 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c57e6959-95dd-464d-93e1-b2c2e076ef41 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:55.191390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-574d72ef-1930-4a9a-82a7-b76e111e5a39 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:55.208522 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-574d72ef-1930-4a9a-82a7-b76e111e5a39 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:55.210741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-574d72ef-1930-4a9a-82a7-b76e111e5a39 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:55.213336 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-574d72ef-1930-4a9a-82a7-b76e111e5a39 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc" status: 200 len: 1361 microversion: 2.26 time: 0.491643 Sep 17 20:59:55.214582 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1117/2313] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:59:54 2022] GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc => generated 1361 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:59:55.229351 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-d679cef5-df5b-4db5-8edb-32c1d83eec42 req-37dd0d1e-7d2c-415b-b9b7-d6100e534a5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc", "name": "network-vif-plugged", "status": "completed", "tag": "aac9debb-24da-4f8d-957a-4b9a05677c5c"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:55.250001 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d679cef5-df5b-4db5-8edb-32c1d83eec42 req-37dd0d1e-7d2c-415b-b9b7-d6100e534a5d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:55.250787 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d679cef5-df5b-4db5-8edb-32c1d83eec42 req-37dd0d1e-7d2c-415b-b9b7-d6100e534a5d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:55.251476 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d679cef5-df5b-4db5-8edb-32c1d83eec42 req-37dd0d1e-7d2c-415b-b9b7-d6100e534a5d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:55.269014 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-d679cef5-df5b-4db5-8edb-32c1d83eec42 req-37dd0d1e-7d2c-415b-b9b7-d6100e534a5d service nova] Creating event network-vif-plugged:aac9debb-24da-4f8d-957a-4b9a05677c5c for instance 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc on nch2-master-1 Sep 17 20:59:55.281875 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-d679cef5-df5b-4db5-8edb-32c1d83eec42 req-37dd0d1e-7d2c-415b-b9b7-d6100e534a5d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063194 Sep 17 20:59:55.284761 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1118/2314] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 20:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:55.291351 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c57e6959-95dd-464d-93e1-b2c2e076ef41 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:55.306537 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c57e6959-95dd-464d-93e1-b2c2e076ef41 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119" status: 200 len: 1313 microversion: 2.1 time: 0.498328 Sep 17 20:59:55.310181 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1197/2315] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:54 2022] GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119 => generated 1313 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:55.320760 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2d2d24a4-6533-4b12-9080-abd4be41982e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:55.322043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2d2d24a4-6533-4b12-9080-abd4be41982e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:55.325409 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-87e155b6-5d93-4b0f-a7b3-ebb755132dbe tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:55.332153 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-87e155b6-5d93-4b0f-a7b3-ebb755132dbe tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:55.343411 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d2d24a4-6533-4b12-9080-abd4be41982e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:55.346280 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d2d24a4-6533-4b12-9080-abd4be41982e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:55.347116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d2d24a4-6533-4b12-9080-abd4be41982e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:55.348414 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d2d24a4-6533-4b12-9080-abd4be41982e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:55.350376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d2d24a4-6533-4b12-9080-abd4be41982e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:55.350926 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87e155b6-5d93-4b0f-a7b3-ebb755132dbe tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:55.351728 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d2d24a4-6533-4b12-9080-abd4be41982e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:55.352446 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87e155b6-5d93-4b0f-a7b3-ebb755132dbe tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:55.356713 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87e155b6-5d93-4b0f-a7b3-ebb755132dbe tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:55.359192 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87e155b6-5d93-4b0f-a7b3-ebb755132dbe tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:55.368051 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87e155b6-5d93-4b0f-a7b3-ebb755132dbe tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:55.372477 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87e155b6-5d93-4b0f-a7b3-ebb755132dbe tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:55.952329 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-87e155b6-5d93-4b0f-a7b3-ebb755132dbe tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:55.968286 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-87e155b6-5d93-4b0f-a7b3-ebb755132dbe tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1508 microversion: 2.1 time: 0.653272 Sep 17 20:59:55.968902 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1198/2316] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:55 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1508 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:56.000869 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b071eb47-2888-4dec-a6ec-25ebd91c915a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:56.002563 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b071eb47-2888-4dec-a6ec-25ebd91c915a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 1d44abe5-d50f-4f59-83fd-65376778153a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:56.021098 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b071eb47-2888-4dec-a6ec-25ebd91c915a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:56.029336 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b071eb47-2888-4dec-a6ec-25ebd91c915a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:56.030512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b071eb47-2888-4dec-a6ec-25ebd91c915a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:56.031283 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b071eb47-2888-4dec-a6ec-25ebd91c915a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:56.031761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b071eb47-2888-4dec-a6ec-25ebd91c915a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:56.034116 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b071eb47-2888-4dec-a6ec-25ebd91c915a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:56.131617 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2d2d24a4-6533-4b12-9080-abd4be41982e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:56.141946 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2d2d24a4-6533-4b12-9080-abd4be41982e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5" status: 200 len: 1498 microversion: 2.1 time: 0.855533 Sep 17 20:59:56.152379 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1119/2317] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:55 2022] GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 => generated 1498 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:56.172023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7f9f8a43-4568-431a-95f4-0e055f04cf51 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:56.177395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7f9f8a43-4568-431a-95f4-0e055f04cf51 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:56.188766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7f9f8a43-4568-431a-95f4-0e055f04cf51 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898'} {{(pid=140523) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 20:59:56.200935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7f9f8a43-4568-431a-95f4-0e055f04cf51 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:56.201384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7f9f8a43-4568-431a-95f4-0e055f04cf51 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:56.202110 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7f9f8a43-4568-431a-95f4-0e055f04cf51 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:56.203018 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7f9f8a43-4568-431a-95f4-0e055f04cf51 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:56.203478 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7f9f8a43-4568-431a-95f4-0e055f04cf51 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:56.203998 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7f9f8a43-4568-431a-95f4-0e055f04cf51 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:56.274784 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.multi_cell_list [None req-7f9f8a43-4568-431a-95f4-0e055f04cf51 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140523) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 20:59:56.328157 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7f9f8a43-4568-431a-95f4-0e055f04cf51 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.159840 Sep 17 20:59:56.332756 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1120/2318] 10.222.0.26 () {58 vars in 1154 bytes} [Sat Sep 17 20:59:56 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 20:59:56.337291 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0666b779-a0b8-40d2-b67d-f1e43d2f4cdd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:56.337938 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0666b779-a0b8-40d2-b67d-f1e43d2f4cdd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:56.344682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0666b779-a0b8-40d2-b67d-f1e43d2f4cdd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:56.345273 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0666b779-a0b8-40d2-b67d-f1e43d2f4cdd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:56.345748 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0666b779-a0b8-40d2-b67d-f1e43d2f4cdd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:56.346509 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0666b779-a0b8-40d2-b67d-f1e43d2f4cdd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:56.346965 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0666b779-a0b8-40d2-b67d-f1e43d2f4cdd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:56.347398 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0666b779-a0b8-40d2-b67d-f1e43d2f4cdd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:56.563334 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b071eb47-2888-4dec-a6ec-25ebd91c915a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:56.584867 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b071eb47-2888-4dec-a6ec-25ebd91c915a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a" status: 200 len: 1466 microversion: 2.1 time: 0.598961 Sep 17 20:59:56.586153 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1199/2319] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:55 2022] GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a => generated 1466 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:56.597637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-079838b5-e71e-42f5-851d-737232407d5e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:56.613829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-079838b5-e71e-42f5-851d-737232407d5e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:56.614337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-079838b5-e71e-42f5-851d-737232407d5e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:56.614998 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-079838b5-e71e-42f5-851d-737232407d5e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:56.652283 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-079838b5-e71e-42f5-851d-737232407d5e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5] Going to try to start instance {{(pid=140524) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 17 20:59:56.698284 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0666b779-a0b8-40d2-b67d-f1e43d2f4cdd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:56.721819 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0666b779-a0b8-40d2-b67d-f1e43d2f4cdd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:56.723319 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0666b779-a0b8-40d2-b67d-f1e43d2f4cdd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:56.724537 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0666b779-a0b8-40d2-b67d-f1e43d2f4cdd tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc" status: 200 len: 1361 microversion: 2.26 time: 0.391264 Sep 17 20:59:56.728570 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1121/2320] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:59:56 2022] GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc => generated 1361 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:59:56.756474 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-079838b5-e71e-42f5-851d-737232407d5e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "POST /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5/action" status: 202 len: 0 microversion: 2.1 time: 0.168271 Sep 17 20:59:56.756720 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f722dd09-6896-4b7b-b6d5-c4d57ecd69b9 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:56.758213 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1200/2321] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 20:59:56 2022] POST /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 20:59:56.759769 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f722dd09-6896-4b7b-b6d5-c4d57ecd69b9 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 40199006-23db-454e-8f31-47dc0532b119] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:56.767488 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b36fb7fc-5847-4417-9a77-f6a0a4dcbb73 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:56.775936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b36fb7fc-5847-4417-9a77-f6a0a4dcbb73 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] [instance: 1d44abe5-d50f-4f59-83fd-65376778153a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:56.777047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f722dd09-6896-4b7b-b6d5-c4d57ecd69b9 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:56.777819 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f722dd09-6896-4b7b-b6d5-c4d57ecd69b9 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:56.778460 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f722dd09-6896-4b7b-b6d5-c4d57ecd69b9 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:56.784012 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f722dd09-6896-4b7b-b6d5-c4d57ecd69b9 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:56.784706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f722dd09-6896-4b7b-b6d5-c4d57ecd69b9 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:56.785304 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f722dd09-6896-4b7b-b6d5-c4d57ecd69b9 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:56.789154 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b36fb7fc-5847-4417-9a77-f6a0a4dcbb73 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:56.789851 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b36fb7fc-5847-4417-9a77-f6a0a4dcbb73 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:56.791434 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b36fb7fc-5847-4417-9a77-f6a0a4dcbb73 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:56.792509 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b36fb7fc-5847-4417-9a77-f6a0a4dcbb73 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:56.804507 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b36fb7fc-5847-4417-9a77-f6a0a4dcbb73 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:56.805531 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b36fb7fc-5847-4417-9a77-f6a0a4dcbb73 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:57.187666 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b36fb7fc-5847-4417-9a77-f6a0a4dcbb73 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a" status: 200 len: 1617 microversion: 2.1 time: 0.423472 Sep 17 20:59:57.191322 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1201/2322] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:56 2022] GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a => generated 1617 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:57.202937 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f0187a72-e14f-476c-9649-01ea82d3a961 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:57.204464 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f0187a72-e14f-476c-9649-01ea82d3a961 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:57.209983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f722dd09-6896-4b7b-b6d5-c4d57ecd69b9 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:57.213618 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f0187a72-e14f-476c-9649-01ea82d3a961 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:57.214173 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f0187a72-e14f-476c-9649-01ea82d3a961 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:57.215105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f0187a72-e14f-476c-9649-01ea82d3a961 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:57.215821 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f0187a72-e14f-476c-9649-01ea82d3a961 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:57.216491 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f0187a72-e14f-476c-9649-01ea82d3a961 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:57.217072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f0187a72-e14f-476c-9649-01ea82d3a961 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:57.231712 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f722dd09-6896-4b7b-b6d5-c4d57ecd69b9 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119" status: 200 len: 1313 microversion: 2.1 time: 0.488246 Sep 17 20:59:57.232330 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1122/2323] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:56 2022] GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119 => generated 1313 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:57.236979 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0ecc305b-08f2-4cb7-9ead-f27137a2fd99 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:57.253803 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0ecc305b-08f2-4cb7-9ead-f27137a2fd99 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:57.275329 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ecc305b-08f2-4cb7-9ead-f27137a2fd99 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:57.275700 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ecc305b-08f2-4cb7-9ead-f27137a2fd99 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:57.280894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ecc305b-08f2-4cb7-9ead-f27137a2fd99 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:57.281929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ecc305b-08f2-4cb7-9ead-f27137a2fd99 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:57.282566 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ecc305b-08f2-4cb7-9ead-f27137a2fd99 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:57.283182 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ecc305b-08f2-4cb7-9ead-f27137a2fd99 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:57.649984 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f0187a72-e14f-476c-9649-01ea82d3a961 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:57.658458 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f0187a72-e14f-476c-9649-01ea82d3a961 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5" status: 200 len: 1507 microversion: 2.1 time: 0.464813 Sep 17 20:59:57.692582 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1202/2324] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:57 2022] GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 => generated 1507 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:57.698008 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f3bea748-eecd-4c5a-8ce4-a696184fc022 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1758643986", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "8f0929b7-f8de-4896-a0de-a2388fef54f3"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 20:59:57.790171 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0ecc305b-08f2-4cb7-9ead-f27137a2fd99 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:57.806619 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0ecc305b-08f2-4cb7-9ead-f27137a2fd99 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1508 microversion: 2.1 time: 0.573144 Sep 17 20:59:57.811641 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1123/2325] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:57 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1508 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:57.825811 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-206acb1e-7f09-4839-907a-62b4d095d628 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:57.827194 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-206acb1e-7f09-4839-907a-62b4d095d628 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:57.846414 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-206acb1e-7f09-4839-907a-62b4d095d628 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:57.849427 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-206acb1e-7f09-4839-907a-62b4d095d628 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:57.850134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-206acb1e-7f09-4839-907a-62b4d095d628 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:57.851126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-206acb1e-7f09-4839-907a-62b4d095d628 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:57.851433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-f3bea748-eecd-4c5a-8ce4-a696184fc022 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] validate_networks() for None {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 20:59:57.855122 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-206acb1e-7f09-4839-907a-62b4d095d628 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:57.859238 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-206acb1e-7f09-4839-907a-62b4d095d628 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:58.337503 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-206acb1e-7f09-4839-907a-62b4d095d628 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:58.340120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 20:59:58.361261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-206acb1e-7f09-4839-907a-62b4d095d628 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:58.363878 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-206acb1e-7f09-4839-907a-62b4d095d628 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:58.365510 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-206acb1e-7f09-4839-907a-62b4d095d628 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc" status: 200 len: 1546 microversion: 2.26 time: 0.552830 Sep 17 20:59:58.366296 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1124/2326] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 20:59:57 2022] GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc => generated 1546 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 20:59:58.374677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9083ec47-5cfa-45d7-b3c1-8a059a393825 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:58.375530 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9083ec47-5cfa-45d7-b3c1-8a059a393825 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 40199006-23db-454e-8f31-47dc0532b119] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:58.393147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9083ec47-5cfa-45d7-b3c1-8a059a393825 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:58.406159 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9083ec47-5cfa-45d7-b3c1-8a059a393825 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:58.406930 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9083ec47-5cfa-45d7-b3c1-8a059a393825 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:58.407851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9083ec47-5cfa-45d7-b3c1-8a059a393825 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:58.408480 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9083ec47-5cfa-45d7-b3c1-8a059a393825 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:58.409065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9083ec47-5cfa-45d7-b3c1-8a059a393825 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:58.481102 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-f3bea748-eecd-4c5a-8ce4-a696184fc022 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 20:59:58.482161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-f3bea748-eecd-4c5a-8ce4-a696184fc022 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 20:59:58.482793 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-f3bea748-eecd-4c5a-8ce4-a696184fc022 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 20:59:58.483349 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-f3bea748-eecd-4c5a-8ce4-a696184fc022 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 20:59:58.483898 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-f3bea748-eecd-4c5a-8ce4-a696184fc022 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 20:59:58.500354 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3bea748-eecd-4c5a-8ce4-a696184fc022 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:58.502557 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3bea748-eecd-4c5a-8ce4-a696184fc022 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:58.503773 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3bea748-eecd-4c5a-8ce4-a696184fc022 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:58.505229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3bea748-eecd-4c5a-8ce4-a696184fc022 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:58.508780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3bea748-eecd-4c5a-8ce4-a696184fc022 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:58.509518 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3bea748-eecd-4c5a-8ce4-a696184fc022 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:58.546478 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-f3bea748-eecd-4c5a-8ce4-a696184fc022 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for project 3515123097e744ef855ef1129fb59cf1. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 20:59:58.554033 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-f3bea748-eecd-4c5a-8ce4-a696184fc022 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Getting quotas for user 0d48260054d84784b89a52d9b766d7c1 and project 3515123097e744ef855ef1129fb59cf1. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 20:59:58.577854 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f3bea748-eecd-4c5a-8ce4-a696184fc022 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 20:59:58.584507 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f3bea748-eecd-4c5a-8ce4-a696184fc022 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 04b100b4-eb98-4ee9-8897-6d25697d2d71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 20:59:58.666405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9083ec47-5cfa-45d7-b3c1-8a059a393825 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:58.699472 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9083ec47-5cfa-45d7-b3c1-8a059a393825 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119" status: 200 len: 1313 microversion: 2.1 time: 0.326707 Sep 17 20:59:58.700379 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1125/2327] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:58 2022] GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119 => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:58.721092 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4824035c-267b-4364-904f-3e5f2b490cab tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '.version_select at 0x7f25a5c15700>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:58.742782 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4824035c-267b-4364-904f-3e5f2b490cab tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:58.743073 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4824035c-267b-4364-904f-3e5f2b490cab tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:58.745179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4824035c-267b-4364-904f-3e5f2b490cab tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:58.745674 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f3bea748-eecd-4c5a-8ce4-a696184fc022 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.051302 Sep 17 20:59:58.746337 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4824035c-267b-4364-904f-3e5f2b490cab tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:58.746837 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1203/2328] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 20:59:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 20:59:58.752347 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b241e0a8-b96f-4979-974e-527f932bb714 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:58.753145 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b241e0a8-b96f-4979-974e-527f932bb714 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:58.760177 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4824035c-267b-4364-904f-3e5f2b490cab tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:58.760900 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4824035c-267b-4364-904f-3e5f2b490cab tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:58.761659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4824035c-267b-4364-904f-3e5f2b490cab tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:58.765125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b241e0a8-b96f-4979-974e-527f932bb714 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:58.765831 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b241e0a8-b96f-4979-974e-527f932bb714 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:58.766192 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4824035c-267b-4364-904f-3e5f2b490cab tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:58.766485 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b241e0a8-b96f-4979-974e-527f932bb714 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:58.766998 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4824035c-267b-4364-904f-3e5f2b490cab tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:58.767437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b241e0a8-b96f-4979-974e-527f932bb714 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:58.767982 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b241e0a8-b96f-4979-974e-527f932bb714 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:58.768513 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b241e0a8-b96f-4979-974e-527f932bb714 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:58.768830 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4824035c-267b-4364-904f-3e5f2b490cab tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:58.834261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4824035c-267b-4364-904f-3e5f2b490cab tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:58.835125 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4824035c-267b-4364-904f-3e5f2b490cab tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:58.835719 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4824035c-267b-4364-904f-3e5f2b490cab tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:58.851638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4824035c-267b-4364-904f-3e5f2b490cab tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:58.852385 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4824035c-267b-4364-904f-3e5f2b490cab tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:58.852968 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4824035c-267b-4364-904f-3e5f2b490cab tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:58.893811 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-4824035c-267b-4364-904f-3e5f2b490cab tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lazy-loading 'flavor' on Instance uuid 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:59:58.925184 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4824035c-267b-4364-904f-3e5f2b490cab tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "PUT /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags/tempest-tag-1647029912" status: 201 len: 0 microversion: 2.26 time: 0.215225 Sep 17 20:59:58.932737 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1126/2329] 10.222.0.26 () {62 vars in 1380 bytes} [Sat Sep 17 20:59:58 2022] PUT /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags/tempest-tag-1647029912 => generated 0 bytes in 224 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 17 20:59:58.938545 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a4c31015-89cc-48b0-b0e7-6c783ac82582 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:58.939332 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a4c31015-89cc-48b0-b0e7-6c783ac82582 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 04b100b4-eb98-4ee9-8897-6d25697d2d71] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:59.013517 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b241e0a8-b96f-4979-974e-527f932bb714 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:59.032185 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b241e0a8-b96f-4979-974e-527f932bb714 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5" status: 200 len: 1507 microversion: 2.1 time: 0.284160 Sep 17 20:59:59.033209 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1204/2330] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:58 2022] GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 => generated 1507 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:59.051256 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-00ee8e16-d44c-4f43-a1cc-d45871e3f565 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:59.053644 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-00ee8e16-d44c-4f43-a1cc-d45871e3f565 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:59.060594 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00ee8e16-d44c-4f43-a1cc-d45871e3f565 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:59.061402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00ee8e16-d44c-4f43-a1cc-d45871e3f565 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:59.062048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00ee8e16-d44c-4f43-a1cc-d45871e3f565 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:59.063045 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00ee8e16-d44c-4f43-a1cc-d45871e3f565 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:59.063662 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00ee8e16-d44c-4f43-a1cc-d45871e3f565 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:59.064654 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00ee8e16-d44c-4f43-a1cc-d45871e3f565 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:59.098610 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a4c31015-89cc-48b0-b0e7-6c783ac82582 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:59.110146 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a4c31015-89cc-48b0-b0e7-6c783ac82582 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71" status: 200 len: 1217 microversion: 2.1 time: 0.175974 Sep 17 20:59:59.115290 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1127/2331] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:58 2022] GET /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71 => generated 1217 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:59.124801 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-de24a157-9c7e-476b-a323-c94bff5b6f6f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '.version_select at 0x7f25a5045940>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:59.153340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de24a157-9c7e-476b-a323-c94bff5b6f6f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:59.156103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de24a157-9c7e-476b-a323-c94bff5b6f6f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:59.157222 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de24a157-9c7e-476b-a323-c94bff5b6f6f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:59.190201 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-de24a157-9c7e-476b-a323-c94bff5b6f6f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags/tempest-tag-1647029912" status: 204 len: 0 microversion: 2.26 time: 0.073360 Sep 17 20:59:59.194633 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1128/2332] 10.222.0.26 () {60 vars in 1361 bytes} [Sat Sep 17 20:59:59 2022] GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags/tempest-tag-1647029912 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 20:59:59.204916 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1614e2f8-7df1-40d8-9f3e-beb8fa859fc8 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '.version_select at 0x7f25a4fe5670>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:59.249848 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1614e2f8-7df1-40d8-9f3e-beb8fa859fc8 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:59.250750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1614e2f8-7df1-40d8-9f3e-beb8fa859fc8 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:59.254723 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1614e2f8-7df1-40d8-9f3e-beb8fa859fc8 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:59.255772 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1614e2f8-7df1-40d8-9f3e-beb8fa859fc8 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:59.285848 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1614e2f8-7df1-40d8-9f3e-beb8fa859fc8 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:59.293785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1614e2f8-7df1-40d8-9f3e-beb8fa859fc8 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:59.299470 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1614e2f8-7df1-40d8-9f3e-beb8fa859fc8 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:59.300551 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1614e2f8-7df1-40d8-9f3e-beb8fa859fc8 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:59.301153 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1614e2f8-7df1-40d8-9f3e-beb8fa859fc8 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:59.301733 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1614e2f8-7df1-40d8-9f3e-beb8fa859fc8 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:59.356023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1614e2f8-7df1-40d8-9f3e-beb8fa859fc8 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:59.362093 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1614e2f8-7df1-40d8-9f3e-beb8fa859fc8 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:59.364179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1614e2f8-7df1-40d8-9f3e-beb8fa859fc8 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:59.406151 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-1614e2f8-7df1-40d8-9f3e-beb8fa859fc8 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lazy-loading 'flavor' on Instance uuid 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:59:59.422703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-00ee8e16-d44c-4f43-a1cc-d45871e3f565 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 20:59:59.453627 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-00ee8e16-d44c-4f43-a1cc-d45871e3f565 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1508 microversion: 2.1 time: 0.415890 Sep 17 20:59:59.455193 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1205/2333] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:59 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1508 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:59.482197 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1614e2f8-7df1-40d8-9f3e-beb8fa859fc8 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "DELETE /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags" status: 204 len: 0 microversion: 2.26 time: 0.276528 Sep 17 20:59:59.486182 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1129/2334] 10.222.0.26 () {60 vars in 1295 bytes} [Sat Sep 17 20:59:59 2022] DELETE /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 20:59:59.497867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-733537c3-53d2-41c0-a220-8f5f79c3ed44 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '.version_select at 0x7f25a54f0f70>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:59.524909 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-733537c3-53d2-41c0-a220-8f5f79c3ed44 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:59.526335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-733537c3-53d2-41c0-a220-8f5f79c3ed44 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:59.528538 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-733537c3-53d2-41c0-a220-8f5f79c3ed44 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:59.574679 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-733537c3-53d2-41c0-a220-8f5f79c3ed44 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags" status: 200 len: 12 microversion: 2.26 time: 0.080683 Sep 17 20:59:59.575354 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1206/2335] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Sep 17 20:59:59 2022] GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags => generated 12 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 20:59:59.590237 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-11bd6613-5309-4939-9ecb-38ee64a57ed5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '.version_select at 0x7f25a5befaf0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:59.626623 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11bd6613-5309-4939-9ecb-38ee64a57ed5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:59.637528 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11bd6613-5309-4939-9ecb-38ee64a57ed5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:59.639320 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11bd6613-5309-4939-9ecb-38ee64a57ed5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:59.641357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-11bd6613-5309-4939-9ecb-38ee64a57ed5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:59.658410 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11bd6613-5309-4939-9ecb-38ee64a57ed5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:59.659194 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11bd6613-5309-4939-9ecb-38ee64a57ed5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:59.659851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11bd6613-5309-4939-9ecb-38ee64a57ed5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:59.660759 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11bd6613-5309-4939-9ecb-38ee64a57ed5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:59.668181 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11bd6613-5309-4939-9ecb-38ee64a57ed5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:59.669395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11bd6613-5309-4939-9ecb-38ee64a57ed5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:59.724634 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c9d204c6-64e5-4fcc-84b6-220752e55df7 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:59.725416 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c9d204c6-64e5-4fcc-84b6-220752e55df7 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 40199006-23db-454e-8f31-47dc0532b119] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 20:59:59.738594 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11bd6613-5309-4939-9ecb-38ee64a57ed5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:59.740483 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11bd6613-5309-4939-9ecb-38ee64a57ed5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:59.741118 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11bd6613-5309-4939-9ecb-38ee64a57ed5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:59.747808 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9d204c6-64e5-4fcc-84b6-220752e55df7 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:59.747808 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9d204c6-64e5-4fcc-84b6-220752e55df7 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:59.750107 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9d204c6-64e5-4fcc-84b6-220752e55df7 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:59.750107 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9d204c6-64e5-4fcc-84b6-220752e55df7 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:59.753918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9d204c6-64e5-4fcc-84b6-220752e55df7 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:59.755447 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9d204c6-64e5-4fcc-84b6-220752e55df7 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:59.774045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11bd6613-5309-4939-9ecb-38ee64a57ed5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:59.774502 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11bd6613-5309-4939-9ecb-38ee64a57ed5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:59.775032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11bd6613-5309-4939-9ecb-38ee64a57ed5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:59.851433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-11bd6613-5309-4939-9ecb-38ee64a57ed5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lazy-loading 'flavor' on Instance uuid 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 20:59:59.892957 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-11bd6613-5309-4939-9ecb-38ee64a57ed5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "PUT /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags/tempest-tag-2108078851" status: 201 len: 0 microversion: 2.26 time: 0.310128 Sep 17 20:59:59.900086 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1130/2336] 10.222.0.26 () {62 vars in 1380 bytes} [Sat Sep 17 20:59:59 2022] PUT /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags/tempest-tag-2108078851 => generated 0 bytes in 318 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 17 20:59:59.911797 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-47dc0e0d-7084-4f95-bf5e-06aadb92df26 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '.version_select at 0x7f25a51eed30>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:59.931595 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47dc0e0d-7084-4f95-bf5e-06aadb92df26 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:59.932175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47dc0e0d-7084-4f95-bf5e-06aadb92df26 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 20:59:59.932811 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47dc0e0d-7084-4f95-bf5e-06aadb92df26 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 20:59:59.956376 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-47dc0e0d-7084-4f95-bf5e-06aadb92df26 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags" status: 200 len: 36 microversion: 2.26 time: 0.055024 Sep 17 20:59:59.957041 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1131/2337] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Sep 17 20:59:59 2022] GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags => generated 36 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 20:59:59.977068 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7963408a-9df9-421a-8977-29207c4ba28e tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '.version_select at 0x7f25a5207e50>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 20:59:59.996412 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7963408a-9df9-421a-8977-29207c4ba28e tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 20:59:59.996929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7963408a-9df9-421a-8977-29207c4ba28e tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:00.002194 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7963408a-9df9-421a-8977-29207c4ba28e tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:00.004078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7963408a-9df9-421a-8977-29207c4ba28e tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:00.020058 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7963408a-9df9-421a-8977-29207c4ba28e tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:00.020569 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7963408a-9df9-421a-8977-29207c4ba28e tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:00.021017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7963408a-9df9-421a-8977-29207c4ba28e tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:00.025087 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7963408a-9df9-421a-8977-29207c4ba28e tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:00.025515 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7963408a-9df9-421a-8977-29207c4ba28e tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:00.030675 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7963408a-9df9-421a-8977-29207c4ba28e tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:00.072537 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c9d204c6-64e5-4fcc-84b6-220752e55df7 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:00.085276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7963408a-9df9-421a-8977-29207c4ba28e tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:00.085818 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7963408a-9df9-421a-8977-29207c4ba28e tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:00.086266 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7963408a-9df9-421a-8977-29207c4ba28e tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:00.095690 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c9d204c6-64e5-4fcc-84b6-220752e55df7 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119" status: 200 len: 1313 microversion: 2.1 time: 0.376701 Sep 17 21:00:00.096585 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1207/2338] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 20:59:59 2022] GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119 => generated 1313 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:00:00.103386 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4c13047c-c10d-4dfc-9ec5-41708b8fb487 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:00.104402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4c13047c-c10d-4dfc-9ec5-41708b8fb487 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:00.114876 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c13047c-c10d-4dfc-9ec5-41708b8fb487 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:00.115516 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c13047c-c10d-4dfc-9ec5-41708b8fb487 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:00.115965 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c13047c-c10d-4dfc-9ec5-41708b8fb487 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:00.116685 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c13047c-c10d-4dfc-9ec5-41708b8fb487 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:00.117134 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c13047c-c10d-4dfc-9ec5-41708b8fb487 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:00.118329 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c13047c-c10d-4dfc-9ec5-41708b8fb487 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:00.154075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-7963408a-9df9-421a-8977-29207c4ba28e tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lazy-loading 'flavor' on Instance uuid 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:00:00.187300 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7963408a-9df9-421a-8977-29207c4ba28e tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "DELETE /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags/tempest-tag-2108078851" status: 204 len: 0 microversion: 2.26 time: 0.223801 Sep 17 21:00:00.188085 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1132/2339] 10.222.0.26 () {60 vars in 1364 bytes} [Sat Sep 17 20:59:59 2022] DELETE /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags/tempest-tag-2108078851 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 17 21:00:00.193008 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-afd74808-4906-45f0-a326-a85c62a1c071 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:00.193711 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-afd74808-4906-45f0-a326-a85c62a1c071 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 04b100b4-eb98-4ee9-8897-6d25697d2d71] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:00.206414 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afd74808-4906-45f0-a326-a85c62a1c071 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:00.206924 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afd74808-4906-45f0-a326-a85c62a1c071 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:00.207372 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afd74808-4906-45f0-a326-a85c62a1c071 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:00.208093 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afd74808-4906-45f0-a326-a85c62a1c071 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:00.208554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afd74808-4906-45f0-a326-a85c62a1c071 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:00.208980 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afd74808-4906-45f0-a326-a85c62a1c071 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:00.475592 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-afd74808-4906-45f0-a326-a85c62a1c071 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:00.492176 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-afd74808-4906-45f0-a326-a85c62a1c071 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71" status: 200 len: 1269 microversion: 2.1 time: 0.303063 Sep 17 21:00:00.495816 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1133/2340] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:00 2022] GET /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71 => generated 1269 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:00.509652 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7d1e1a34-8409-4f88-b37c-597bbfdd2f90 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '.version_select at 0x7f25a4ebbd30>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:00.535556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7d1e1a34-8409-4f88-b37c-597bbfdd2f90 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:00.536826 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7d1e1a34-8409-4f88-b37c-597bbfdd2f90 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:00.537300 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7d1e1a34-8409-4f88-b37c-597bbfdd2f90 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:00.543641 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4c13047c-c10d-4dfc-9ec5-41708b8fb487 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:00.552859 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4c13047c-c10d-4dfc-9ec5-41708b8fb487 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5" status: 200 len: 1511 microversion: 2.1 time: 0.454242 Sep 17 21:00:00.565880 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1208/2341] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:00 2022] GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 => generated 1511 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:00.565880 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b0d3187f-252b-4d0a-86ef-8da8d021d83c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:00.565880 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b0d3187f-252b-4d0a-86ef-8da8d021d83c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:00.568575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b0d3187f-252b-4d0a-86ef-8da8d021d83c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:00.569075 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b0d3187f-252b-4d0a-86ef-8da8d021d83c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:00.573533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b0d3187f-252b-4d0a-86ef-8da8d021d83c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:00.573533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b0d3187f-252b-4d0a-86ef-8da8d021d83c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:00.573533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b0d3187f-252b-4d0a-86ef-8da8d021d83c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:00.573533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b0d3187f-252b-4d0a-86ef-8da8d021d83c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:00.573933 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7d1e1a34-8409-4f88-b37c-597bbfdd2f90 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags" status: 200 len: 12 microversion: 2.26 time: 0.074801 Sep 17 21:00:00.575928 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1134/2342] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Sep 17 21:00:00 2022] GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags => generated 12 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:00.587231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9f203d35-9879-4922-be13-daa053069ca5 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:00.596240 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9f203d35-9879-4922-be13-daa053069ca5 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:00.597062 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.compute.servers [None req-9f203d35-9879-4922-be13-daa053069ca5 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Removing options 'limit' from query {{(pid=140523) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 17 21:00:00.598001 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9f203d35-9879-4922-be13-daa053069ca5 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Searching by: {'deleted': False, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898'} {{(pid=140523) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:00:00.599247 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f203d35-9879-4922-be13-daa053069ca5 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:00.599940 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f203d35-9879-4922-be13-daa053069ca5 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:00.601434 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f203d35-9879-4922-be13-daa053069ca5 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:00.602352 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f203d35-9879-4922-be13-daa053069ca5 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:00.602927 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f203d35-9879-4922-be13-daa053069ca5 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:00.603423 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f203d35-9879-4922-be13-daa053069ca5 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:00.605429 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9f203d35-9879-4922-be13-daa053069ca5 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.022707 Sep 17 21:00:00.606443 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1135/2343] 10.222.0.26 () {58 vars in 1140 bytes} [Sat Sep 17 21:00:00 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:00:00.621764 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2f8509d6-39d9-4f6c-b00c-143af55336c0 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '.version_select at 0x7f25a5801700>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:00.642011 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f8509d6-39d9-4f6c-b00c-143af55336c0 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:00.644675 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f8509d6-39d9-4f6c-b00c-143af55336c0 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:00.645224 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f8509d6-39d9-4f6c-b00c-143af55336c0 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:00.645858 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2f8509d6-39d9-4f6c-b00c-143af55336c0 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:00.652236 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f8509d6-39d9-4f6c-b00c-143af55336c0 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:00.652814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f8509d6-39d9-4f6c-b00c-143af55336c0 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:00.653322 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f8509d6-39d9-4f6c-b00c-143af55336c0 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:00.654280 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f8509d6-39d9-4f6c-b00c-143af55336c0 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:00.654831 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f8509d6-39d9-4f6c-b00c-143af55336c0 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:00.655329 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f8509d6-39d9-4f6c-b00c-143af55336c0 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:00.704114 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f8509d6-39d9-4f6c-b00c-143af55336c0 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:00.704622 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f8509d6-39d9-4f6c-b00c-143af55336c0 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:00.705071 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f8509d6-39d9-4f6c-b00c-143af55336c0 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:00.734015 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-2f8509d6-39d9-4f6c-b00c-143af55336c0 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lazy-loading 'flavor' on Instance uuid 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:00:00.772315 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2f8509d6-39d9-4f6c-b00c-143af55336c0 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "DELETE /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags" status: 204 len: 0 microversion: 2.26 time: 0.164503 Sep 17 21:00:00.780353 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1136/2344] 10.222.0.26 () {60 vars in 1295 bytes} [Sat Sep 17 21:00:00 2022] DELETE /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 21:00:00.784081 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b0d3187f-252b-4d0a-86ef-8da8d021d83c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:00.786360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-45928fb3-009e-458e-9157-129e2bd26c1b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:00.788198 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-45928fb3-009e-458e-9157-129e2bd26c1b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:00.795132 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b0d3187f-252b-4d0a-86ef-8da8d021d83c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1508 microversion: 2.1 time: 0.239788 Sep 17 21:00:00.795967 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1209/2345] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:00 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1508 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:00.812776 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45928fb3-009e-458e-9157-129e2bd26c1b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:00.813503 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45928fb3-009e-458e-9157-129e2bd26c1b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:00.813823 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2117100b-ccdf-4139-a14c-0cb87de1e666 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '.version_select at 0x7f25a54f0a60>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:00.815095 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45928fb3-009e-458e-9157-129e2bd26c1b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:00.816285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45928fb3-009e-458e-9157-129e2bd26c1b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:00.817026 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45928fb3-009e-458e-9157-129e2bd26c1b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:00.817491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45928fb3-009e-458e-9157-129e2bd26c1b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:00.848850 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2117100b-ccdf-4139-a14c-0cb87de1e666 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:00.852272 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2117100b-ccdf-4139-a14c-0cb87de1e666 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:00.852463 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2117100b-ccdf-4139-a14c-0cb87de1e666 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:00.852867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2117100b-ccdf-4139-a14c-0cb87de1e666 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:00.867205 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2117100b-ccdf-4139-a14c-0cb87de1e666 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:00.867720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2117100b-ccdf-4139-a14c-0cb87de1e666 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:00.868174 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2117100b-ccdf-4139-a14c-0cb87de1e666 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:00.869000 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2117100b-ccdf-4139-a14c-0cb87de1e666 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:00.869399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2117100b-ccdf-4139-a14c-0cb87de1e666 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:00.869863 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2117100b-ccdf-4139-a14c-0cb87de1e666 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:00.954141 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2117100b-ccdf-4139-a14c-0cb87de1e666 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:00.954626 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2117100b-ccdf-4139-a14c-0cb87de1e666 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:00.955108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2117100b-ccdf-4139-a14c-0cb87de1e666 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:00.975895 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2117100b-ccdf-4139-a14c-0cb87de1e666 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:00.976394 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2117100b-ccdf-4139-a14c-0cb87de1e666 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:00.976845 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2117100b-ccdf-4139-a14c-0cb87de1e666 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:01.053938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-2117100b-ccdf-4139-a14c-0cb87de1e666 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lazy-loading 'flavor' on Instance uuid 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:00:01.058798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:01.097971 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2117100b-ccdf-4139-a14c-0cb87de1e666 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "PUT /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags/tempest-tag-1978580934" status: 201 len: 0 microversion: 2.26 time: 0.298704 Sep 17 21:00:01.103586 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1210/2346] 10.222.0.26 () {62 vars in 1380 bytes} [Sat Sep 17 21:00:00 2022] PUT /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags/tempest-tag-1978580934 => generated 0 bytes in 307 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 17 21:00:01.111163 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4036afc7-8ca7-4fec-a8b7-a7989321021c tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '.version_select at 0x7f25a53b81f0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:01.170875 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4036afc7-8ca7-4fec-a8b7-a7989321021c tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:01.184530 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4036afc7-8ca7-4fec-a8b7-a7989321021c tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:01.185119 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4036afc7-8ca7-4fec-a8b7-a7989321021c tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:01.185723 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4036afc7-8ca7-4fec-a8b7-a7989321021c tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:01.194982 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:01.200540 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4036afc7-8ca7-4fec-a8b7-a7989321021c tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:01.208142 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4036afc7-8ca7-4fec-a8b7-a7989321021c tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:01.208847 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4036afc7-8ca7-4fec-a8b7-a7989321021c tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:01.209833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4036afc7-8ca7-4fec-a8b7-a7989321021c tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:01.210448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4036afc7-8ca7-4fec-a8b7-a7989321021c tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:01.211032 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4036afc7-8ca7-4fec-a8b7-a7989321021c tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:01.227216 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-45928fb3-009e-458e-9157-129e2bd26c1b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:01.237829 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-45928fb3-009e-458e-9157-129e2bd26c1b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5" status: 200 len: 1511 microversion: 2.1 time: 0.456114 Sep 17 21:00:01.253862 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1137/2347] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:00 2022] GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 => generated 1511 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:01.266519 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-60d6b8df-b1fc-49e7-b39f-e98f84e233a1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:01.270110 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-60d6b8df-b1fc-49e7-b39f-e98f84e233a1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 40199006-23db-454e-8f31-47dc0532b119] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:01.289311 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60d6b8df-b1fc-49e7-b39f-e98f84e233a1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:01.293202 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4036afc7-8ca7-4fec-a8b7-a7989321021c tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:01.293979 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4036afc7-8ca7-4fec-a8b7-a7989321021c tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:01.295001 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4036afc7-8ca7-4fec-a8b7-a7989321021c tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:01.296047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60d6b8df-b1fc-49e7-b39f-e98f84e233a1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:01.298985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60d6b8df-b1fc-49e7-b39f-e98f84e233a1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:01.300732 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60d6b8df-b1fc-49e7-b39f-e98f84e233a1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:01.306303 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60d6b8df-b1fc-49e7-b39f-e98f84e233a1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:01.307850 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60d6b8df-b1fc-49e7-b39f-e98f84e233a1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:01.320298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4036afc7-8ca7-4fec-a8b7-a7989321021c tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:01.320795 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4036afc7-8ca7-4fec-a8b7-a7989321021c tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:01.321248 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4036afc7-8ca7-4fec-a8b7-a7989321021c tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:01.368486 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-4036afc7-8ca7-4fec-a8b7-a7989321021c tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lazy-loading 'flavor' on Instance uuid 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:00:01.431214 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4036afc7-8ca7-4fec-a8b7-a7989321021c tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "PUT /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags/tempest-tag-175262365" status: 201 len: 0 microversion: 2.26 time: 0.324393 Sep 17 21:00:01.431907 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1211/2348] 10.222.0.26 () {62 vars in 1377 bytes} [Sat Sep 17 21:00:01 2022] PUT /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags/tempest-tag-175262365 => generated 0 bytes in 326 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 17 21:00:01.446182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-89186e9c-7433-4d4b-8b5d-19a7a23a326e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:01.446822 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-89186e9c-7433-4d4b-8b5d-19a7a23a326e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 526330e7-cd66-44c3-9453-ea80479469a8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:01.465580 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-89186e9c-7433-4d4b-8b5d-19a7a23a326e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:01.466102 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-89186e9c-7433-4d4b-8b5d-19a7a23a326e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:01.466551 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-89186e9c-7433-4d4b-8b5d-19a7a23a326e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:01.467279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-89186e9c-7433-4d4b-8b5d-19a7a23a326e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:01.467743 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-89186e9c-7433-4d4b-8b5d-19a7a23a326e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:01.468175 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-89186e9c-7433-4d4b-8b5d-19a7a23a326e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:01.812333 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-60d6b8df-b1fc-49e7-b39f-e98f84e233a1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:01.822015 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-60d6b8df-b1fc-49e7-b39f-e98f84e233a1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119" status: 200 len: 1313 microversion: 2.1 time: 0.565914 Sep 17 21:00:01.822536 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1138/2349] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:01 2022] GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119 => generated 1313 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:01.858268 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a29f375c-1cb0-4f13-a35b-1f49e9433a7f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '.version_select at 0x7f25a4fc4040>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:01.882577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a29f375c-1cb0-4f13-a35b-1f49e9433a7f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:01.883522 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a29f375c-1cb0-4f13-a35b-1f49e9433a7f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:01.884177 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a29f375c-1cb0-4f13-a35b-1f49e9433a7f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:01.884892 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a29f375c-1cb0-4f13-a35b-1f49e9433a7f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:01.894068 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a29f375c-1cb0-4f13-a35b-1f49e9433a7f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:01.894923 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a29f375c-1cb0-4f13-a35b-1f49e9433a7f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:01.895729 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a29f375c-1cb0-4f13-a35b-1f49e9433a7f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:01.896689 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a29f375c-1cb0-4f13-a35b-1f49e9433a7f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:01.897352 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a29f375c-1cb0-4f13-a35b-1f49e9433a7f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:01.898144 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a29f375c-1cb0-4f13-a35b-1f49e9433a7f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:01.914907 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=91,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:01.954748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-89186e9c-7433-4d4b-8b5d-19a7a23a326e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:01.983105 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-89186e9c-7433-4d4b-8b5d-19a7a23a326e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/526330e7-cd66-44c3-9453-ea80479469a8" status: 200 len: 1512 microversion: 2.1 time: 0.542947 Sep 17 21:00:02.004840 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1212/2350] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:01 2022] GET /compute/v2.1/servers/526330e7-cd66-44c3-9453-ea80479469a8 => generated 1512 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:02.015599 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3ff6bed3-08b9-4b1c-b620-b0345c8c23ae tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:02.016252 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3ff6bed3-08b9-4b1c-b620-b0345c8c23ae tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 04b100b4-eb98-4ee9-8897-6d25697d2d71] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:02.030027 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ff6bed3-08b9-4b1c-b620-b0345c8c23ae tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:02.034063 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ff6bed3-08b9-4b1c-b620-b0345c8c23ae tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:02.035200 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ff6bed3-08b9-4b1c-b620-b0345c8c23ae tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:02.038593 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ff6bed3-08b9-4b1c-b620-b0345c8c23ae tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:02.039269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ff6bed3-08b9-4b1c-b620-b0345c8c23ae tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:02.040818 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ff6bed3-08b9-4b1c-b620-b0345c8c23ae tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:02.044935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a29f375c-1cb0-4f13-a35b-1f49e9433a7f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:02.047298 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a29f375c-1cb0-4f13-a35b-1f49e9433a7f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:02.048101 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a29f375c-1cb0-4f13-a35b-1f49e9433a7f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:02.089450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-a29f375c-1cb0-4f13-a35b-1f49e9433a7f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lazy-loading 'flavor' on Instance uuid 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:00:02.140203 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a29f375c-1cb0-4f13-a35b-1f49e9433a7f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "DELETE /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags" status: 204 len: 0 microversion: 2.26 time: 0.292309 Sep 17 21:00:02.146567 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1139/2351] 10.222.0.26 () {60 vars in 1295 bytes} [Sat Sep 17 21:00:01 2022] DELETE /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 21:00:02.157866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6c3caab6-a880-475b-b3e7-256e47b54831 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:02.158501 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6c3caab6-a880-475b-b3e7-256e47b54831 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:02.173746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6c3caab6-a880-475b-b3e7-256e47b54831 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:02.174638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6c3caab6-a880-475b-b3e7-256e47b54831 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:02.175336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6c3caab6-a880-475b-b3e7-256e47b54831 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:02.176273 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6c3caab6-a880-475b-b3e7-256e47b54831 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:02.183756 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6c3caab6-a880-475b-b3e7-256e47b54831 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:02.184777 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6c3caab6-a880-475b-b3e7-256e47b54831 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:02.228457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3ff6bed3-08b9-4b1c-b620-b0345c8c23ae tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:02.238761 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3ff6bed3-08b9-4b1c-b620-b0345c8c23ae tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71" status: 200 len: 1275 microversion: 2.1 time: 0.241392 Sep 17 21:00:02.243683 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1213/2352] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:01 2022] GET /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71 => generated 1275 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:02.252568 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-62f59434-5d97-42b7-987b-db1f7ff30a77 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:02.256203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-62f59434-5d97-42b7-987b-db1f7ff30a77 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 563a230c-e153-4283-9d88-9e853f63574a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:02.273674 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62f59434-5d97-42b7-987b-db1f7ff30a77 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:02.274551 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62f59434-5d97-42b7-987b-db1f7ff30a77 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:02.275161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62f59434-5d97-42b7-987b-db1f7ff30a77 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:02.276073 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62f59434-5d97-42b7-987b-db1f7ff30a77 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:02.276832 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62f59434-5d97-42b7-987b-db1f7ff30a77 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:02.281778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62f59434-5d97-42b7-987b-db1f7ff30a77 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:02.572929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6c3caab6-a880-475b-b3e7-256e47b54831 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:02.582437 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6c3caab6-a880-475b-b3e7-256e47b54831 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1508 microversion: 2.1 time: 0.434183 Sep 17 21:00:02.583026 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1140/2353] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:02 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1508 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:02.596271 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-46dde252-8c0c-4a3e-9294-e86ba4c7c704 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '.version_select at 0x7f25a9fc19d0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:02.612567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46dde252-8c0c-4a3e-9294-e86ba4c7c704 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:02.620145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46dde252-8c0c-4a3e-9294-e86ba4c7c704 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:02.620883 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46dde252-8c0c-4a3e-9294-e86ba4c7c704 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:02.641050 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-46dde252-8c0c-4a3e-9294-e86ba4c7c704 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags" status: 200 len: 12 microversion: 2.26 time: 0.054113 Sep 17 21:00:02.643173 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1141/2354] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Sep 17 21:00:02 2022] GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags => generated 12 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:02.734493 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-62f59434-5d97-42b7-987b-db1f7ff30a77 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:02.744669 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-62f59434-5d97-42b7-987b-db1f7ff30a77 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a" status: 200 len: 1513 microversion: 2.1 time: 0.499671 Sep 17 21:00:02.748151 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1214/2355] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:02 2022] GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a => generated 1513 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:02.761902 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6554ee56-599d-4e53-b6c7-cc3211e6fe99 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '.version_select at 0x7f25a4d13430>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:02.795694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6554ee56-599d-4e53-b6c7-cc3211e6fe99 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:02.799878 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6554ee56-599d-4e53-b6c7-cc3211e6fe99 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:02.800698 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6554ee56-599d-4e53-b6c7-cc3211e6fe99 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:02.801262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6554ee56-599d-4e53-b6c7-cc3211e6fe99 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:02.817073 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6554ee56-599d-4e53-b6c7-cc3211e6fe99 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:02.821905 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6554ee56-599d-4e53-b6c7-cc3211e6fe99 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:02.824835 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6554ee56-599d-4e53-b6c7-cc3211e6fe99 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:02.828311 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6554ee56-599d-4e53-b6c7-cc3211e6fe99 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:02.830232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6554ee56-599d-4e53-b6c7-cc3211e6fe99 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:02.832313 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6554ee56-599d-4e53-b6c7-cc3211e6fe99 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:02.883445 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6554ee56-599d-4e53-b6c7-cc3211e6fe99 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:02.884186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6554ee56-599d-4e53-b6c7-cc3211e6fe99 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:02.884784 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6554ee56-599d-4e53-b6c7-cc3211e6fe99 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:02.884915 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-312b428b-3fcd-4a10-9b2a-24214be7452a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1631763254", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "44a79b47-4be7-467a-8a8c-21d428a823c4"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:02.914926 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-6554ee56-599d-4e53-b6c7-cc3211e6fe99 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lazy-loading 'flavor' on Instance uuid 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:00:02.945851 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6554ee56-599d-4e53-b6c7-cc3211e6fe99 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "DELETE /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags" status: 204 len: 0 microversion: 2.26 time: 0.196372 Sep 17 21:00:02.946474 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1215/2356] 10.222.0.26 () {60 vars in 1295 bytes} [Sat Sep 17 21:00:02 2022] DELETE /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 21:00:02.956564 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-bff82ec8-fb3a-4d78-a731-f02233f8c178 req-4349ca48-acf5-4baa-9509-c80bb5074baa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40199006-23db-454e-8f31-47dc0532b119", "name": "network-vif-plugged", "status": "completed", "tag": "5ffd676b-d079-4fa9-b950-637c46640d96"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:02.967406 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-312b428b-3fcd-4a10-9b2a-24214be7452a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] validate_networks() for [('44a79b47-4be7-467a-8a8c-21d428a823c4', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:00:02.969392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-bff82ec8-fb3a-4d78-a731-f02233f8c178 req-4349ca48-acf5-4baa-9509-c80bb5074baa service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:02.969900 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-bff82ec8-fb3a-4d78-a731-f02233f8c178 req-4349ca48-acf5-4baa-9509-c80bb5074baa service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:02.970336 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-bff82ec8-fb3a-4d78-a731-f02233f8c178 req-4349ca48-acf5-4baa-9509-c80bb5074baa service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:02.985005 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-bff82ec8-fb3a-4d78-a731-f02233f8c178 req-4349ca48-acf5-4baa-9509-c80bb5074baa service nova] Creating event network-vif-plugged:5ffd676b-d079-4fa9-b950-637c46640d96 for instance 40199006-23db-454e-8f31-47dc0532b119 on nch1-master-1 Sep 17 21:00:02.990600 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-bff82ec8-fb3a-4d78-a731-f02233f8c178 req-4349ca48-acf5-4baa-9509-c80bb5074baa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042723 Sep 17 21:00:02.995121 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1216/2357] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:03.000618 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0f908738-314b-4dc5-86bc-bcf1bd3be5b1 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:03.006720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0f908738-314b-4dc5-86bc-bcf1bd3be5b1 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:03.007615 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0f908738-314b-4dc5-86bc-bcf1bd3be5b1 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898'} {{(pid=140524) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:00:03.624159 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f908738-314b-4dc5-86bc-bcf1bd3be5b1 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:03.624654 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f908738-314b-4dc5-86bc-bcf1bd3be5b1 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:03.625105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f908738-314b-4dc5-86bc-bcf1bd3be5b1 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:03.625871 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f908738-314b-4dc5-86bc-bcf1bd3be5b1 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:03.626342 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f908738-314b-4dc5-86bc-bcf1bd3be5b1 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:03.626778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f908738-314b-4dc5-86bc-bcf1bd3be5b1 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:03.723185 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.multi_cell_list [None req-0f908738-314b-4dc5-86bc-bcf1bd3be5b1 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140524) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 21:00:03.799744 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0f908738-314b-4dc5-86bc-bcf1bd3be5b1 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 345 microversion: 2.1 time: 0.803245 Sep 17 21:00:03.800529 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1217/2358] 10.222.0.26 () {58 vars in 1154 bytes} [Sat Sep 17 21:00:02 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 345 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:03.805854 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a7e47d78-f444-45a0-92d5-2b0ce7151e32 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:03.806768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a7e47d78-f444-45a0-92d5-2b0ce7151e32 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 40199006-23db-454e-8f31-47dc0532b119] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:03.814051 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7e47d78-f444-45a0-92d5-2b0ce7151e32 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:03.814912 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7e47d78-f444-45a0-92d5-2b0ce7151e32 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:03.815496 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7e47d78-f444-45a0-92d5-2b0ce7151e32 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:03.817224 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7e47d78-f444-45a0-92d5-2b0ce7151e32 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:03.821895 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7e47d78-f444-45a0-92d5-2b0ce7151e32 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:03.824048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7e47d78-f444-45a0-92d5-2b0ce7151e32 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:04.518917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a7e47d78-f444-45a0-92d5-2b0ce7151e32 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:04.530489 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a7e47d78-f444-45a0-92d5-2b0ce7151e32 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119" status: 200 len: 1313 microversion: 2.1 time: 0.728702 Sep 17 21:00:04.545505 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1218/2359] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:03 2022] GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119 => generated 1313 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:04.551837 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0c794864-da80-4228-b205-9020a620a604 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '.version_select at 0x7f25a9f043a0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:04.566157 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c794864-da80-4228-b205-9020a620a604 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:04.566827 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c794864-da80-4228-b205-9020a620a604 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:04.567338 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c794864-da80-4228-b205-9020a620a604 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:04.567903 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0c794864-da80-4228-b205-9020a620a604 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:04.576242 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c794864-da80-4228-b205-9020a620a604 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:04.576926 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c794864-da80-4228-b205-9020a620a604 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:04.578182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c794864-da80-4228-b205-9020a620a604 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:04.579297 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c794864-da80-4228-b205-9020a620a604 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:04.580095 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c794864-da80-4228-b205-9020a620a604 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:04.580608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c794864-da80-4228-b205-9020a620a604 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:04.615961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c794864-da80-4228-b205-9020a620a604 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:04.616727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c794864-da80-4228-b205-9020a620a604 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:04.617296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c794864-da80-4228-b205-9020a620a604 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:04.619260 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-312b428b-3fcd-4a10-9b2a-24214be7452a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:00:04.620452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-312b428b-3fcd-4a10-9b2a-24214be7452a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:00:04.621429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-312b428b-3fcd-4a10-9b2a-24214be7452a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:00:04.622986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-312b428b-3fcd-4a10-9b2a-24214be7452a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:00:04.623823 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-312b428b-3fcd-4a10-9b2a-24214be7452a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:00:04.635379 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-312b428b-3fcd-4a10-9b2a-24214be7452a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:04.636323 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-312b428b-3fcd-4a10-9b2a-24214be7452a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:04.636725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c794864-da80-4228-b205-9020a620a604 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:04.637049 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-312b428b-3fcd-4a10-9b2a-24214be7452a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:04.637222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c794864-da80-4228-b205-9020a620a604 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:04.637703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c794864-da80-4228-b205-9020a620a604 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:04.638334 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-312b428b-3fcd-4a10-9b2a-24214be7452a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:04.638854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-312b428b-3fcd-4a10-9b2a-24214be7452a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:04.639356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-312b428b-3fcd-4a10-9b2a-24214be7452a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:04.687263 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-0c794864-da80-4228-b205-9020a620a604 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lazy-loading 'flavor' on Instance uuid 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:00:04.700255 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-312b428b-3fcd-4a10-9b2a-24214be7452a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Getting quotas for project 004f77fba4b14080bca4ae36c857add3. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:00:04.706912 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-312b428b-3fcd-4a10-9b2a-24214be7452a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Getting quotas for user 22306a93c9404db393b92a267d6258d4 and project 004f77fba4b14080bca4ae36c857add3. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:00:04.719669 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0c794864-da80-4228-b205-9020a620a604 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "PUT /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags/tempest-tag-1863797736" status: 201 len: 0 microversion: 2.26 time: 0.183877 Sep 17 21:00:04.720436 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1219/2360] 10.222.0.26 () {62 vars in 1380 bytes} [Sat Sep 17 21:00:04 2022] PUT /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags/tempest-tag-1863797736 => generated 0 bytes in 186 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 17 21:00:04.722051 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-312b428b-3fcd-4a10-9b2a-24214be7452a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:00:04.725691 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-312b428b-3fcd-4a10-9b2a-24214be7452a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:00:04.736703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2e06a227-fc40-49e5-8179-3d58de9e54d8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:04.737347 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2e06a227-fc40-49e5-8179-3d58de9e54d8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 04b100b4-eb98-4ee9-8897-6d25697d2d71] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:04.755907 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e06a227-fc40-49e5-8179-3d58de9e54d8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:04.756581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e06a227-fc40-49e5-8179-3d58de9e54d8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:04.757040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e06a227-fc40-49e5-8179-3d58de9e54d8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:04.758077 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e06a227-fc40-49e5-8179-3d58de9e54d8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:04.758719 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e06a227-fc40-49e5-8179-3d58de9e54d8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:04.759326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e06a227-fc40-49e5-8179-3d58de9e54d8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:04.807286 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-312b428b-3fcd-4a10-9b2a-24214be7452a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.162780 Sep 17 21:00:04.823693 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1142/2361] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:00:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:00:04.842051 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c05c1c89-2bd3-4502-8389-392dd97097d3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:04.842968 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c05c1c89-2bd3-4502-8389-392dd97097d3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:04.850184 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c05c1c89-2bd3-4502-8389-392dd97097d3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:04.851594 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c05c1c89-2bd3-4502-8389-392dd97097d3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:04.852505 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c05c1c89-2bd3-4502-8389-392dd97097d3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:04.853716 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c05c1c89-2bd3-4502-8389-392dd97097d3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:04.854334 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c05c1c89-2bd3-4502-8389-392dd97097d3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:04.855059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c05c1c89-2bd3-4502-8389-392dd97097d3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:05.164939 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2e06a227-fc40-49e5-8179-3d58de9e54d8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:05.174230 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2e06a227-fc40-49e5-8179-3d58de9e54d8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71" status: 200 len: 1317 microversion: 2.1 time: 0.452744 Sep 17 21:00:05.176357 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1220/2362] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:04 2022] GET /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71 => generated 1317 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:05.188232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2f53047c-2ace-47df-89be-76b57995bf2f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:05.191965 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c05c1c89-2bd3-4502-8389-392dd97097d3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:05.200331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2f53047c-2ace-47df-89be-76b57995bf2f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:05.203758 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c05c1c89-2bd3-4502-8389-392dd97097d3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1508 microversion: 2.1 time: 0.378626 Sep 17 21:00:05.222117 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1143/2363] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:04 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1508 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:05.243537 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f53047c-2ace-47df-89be-76b57995bf2f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:05.245638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-055e2c4b-9bb2-44fe-b740-561a6e925aa5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '.version_select at 0x7f25a9fc14c0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:05.246238 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f53047c-2ace-47df-89be-76b57995bf2f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:05.246896 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f53047c-2ace-47df-89be-76b57995bf2f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:05.256587 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f53047c-2ace-47df-89be-76b57995bf2f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:05.258070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f53047c-2ace-47df-89be-76b57995bf2f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:05.258812 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f53047c-2ace-47df-89be-76b57995bf2f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:05.270533 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:05.286548 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-055e2c4b-9bb2-44fe-b740-561a6e925aa5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:05.289654 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-055e2c4b-9bb2-44fe-b740-561a6e925aa5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:05.291886 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-055e2c4b-9bb2-44fe-b740-561a6e925aa5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:05.294265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-055e2c4b-9bb2-44fe-b740-561a6e925aa5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:05.311204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-055e2c4b-9bb2-44fe-b740-561a6e925aa5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:05.312057 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-055e2c4b-9bb2-44fe-b740-561a6e925aa5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:05.312772 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-055e2c4b-9bb2-44fe-b740-561a6e925aa5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:05.313736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-055e2c4b-9bb2-44fe-b740-561a6e925aa5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:05.314428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-055e2c4b-9bb2-44fe-b740-561a6e925aa5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:05.315092 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-055e2c4b-9bb2-44fe-b740-561a6e925aa5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:05.388943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-055e2c4b-9bb2-44fe-b740-561a6e925aa5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:05.394863 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-055e2c4b-9bb2-44fe-b740-561a6e925aa5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:05.395747 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-055e2c4b-9bb2-44fe-b740-561a6e925aa5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:05.416034 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-055e2c4b-9bb2-44fe-b740-561a6e925aa5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:05.416784 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-055e2c4b-9bb2-44fe-b740-561a6e925aa5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:05.417396 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-055e2c4b-9bb2-44fe-b740-561a6e925aa5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:05.459486 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-055e2c4b-9bb2-44fe-b740-561a6e925aa5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lazy-loading 'flavor' on Instance uuid 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:00:05.480545 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-055e2c4b-9bb2-44fe-b740-561a6e925aa5 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "PUT /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags/tempest-tag-2014693257" status: 201 len: 0 microversion: 2.26 time: 0.256723 Sep 17 21:00:05.486439 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1144/2364] 10.222.0.26 () {62 vars in 1380 bytes} [Sat Sep 17 21:00:05 2022] PUT /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags/tempest-tag-2014693257 => generated 0 bytes in 264 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 17 21:00:05.494149 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-025e6e98-cb07-46e0-914b-f2610c05e82f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:05.494858 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-025e6e98-cb07-46e0-914b-f2610c05e82f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:05.591561 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-025e6e98-cb07-46e0-914b-f2610c05e82f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:05.615624 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-025e6e98-cb07-46e0-914b-f2610c05e82f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1" status: 200 len: 1225 microversion: 2.1 time: 0.121700 Sep 17 21:00:05.619254 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1145/2365] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:05 2022] GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 => generated 1225 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:05.638524 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3c4407a0-ed2e-4c2c-992f-59281cca48b9 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Action: 'update_all', calling method: .version_select at 0x7f25a5107b80>, body: {"tags": ["tempest-tag-1768100115", "tempest-tag-1093664742"]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:05.658584 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3c4407a0-ed2e-4c2c-992f-59281cca48b9 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:05.659099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3c4407a0-ed2e-4c2c-992f-59281cca48b9 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:05.659551 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3c4407a0-ed2e-4c2c-992f-59281cca48b9 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:05.660052 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3c4407a0-ed2e-4c2c-992f-59281cca48b9 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:05.681913 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3c4407a0-ed2e-4c2c-992f-59281cca48b9 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:05.682408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3c4407a0-ed2e-4c2c-992f-59281cca48b9 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:05.682871 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3c4407a0-ed2e-4c2c-992f-59281cca48b9 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:05.683647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3c4407a0-ed2e-4c2c-992f-59281cca48b9 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:05.684189 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3c4407a0-ed2e-4c2c-992f-59281cca48b9 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:05.684624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3c4407a0-ed2e-4c2c-992f-59281cca48b9 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:05.729424 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3c4407a0-ed2e-4c2c-992f-59281cca48b9 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:05.730008 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3c4407a0-ed2e-4c2c-992f-59281cca48b9 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:05.730453 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3c4407a0-ed2e-4c2c-992f-59281cca48b9 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:05.756350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-3c4407a0-ed2e-4c2c-992f-59281cca48b9 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lazy-loading 'flavor' on Instance uuid 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:00:05.765962 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2f53047c-2ace-47df-89be-76b57995bf2f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:05.774488 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2f53047c-2ace-47df-89be-76b57995bf2f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5" status: 200 len: 1511 microversion: 2.1 time: 0.596176 Sep 17 21:00:05.775390 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1221/2366] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:05 2022] GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 => generated 1511 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:05.780433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d280b0e6-edab-44a1-9618-604a2a7e8652 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:05.781248 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d280b0e6-edab-44a1-9618-604a2a7e8652 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 40199006-23db-454e-8f31-47dc0532b119] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:05.787655 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d280b0e6-edab-44a1-9618-604a2a7e8652 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:05.790245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d280b0e6-edab-44a1-9618-604a2a7e8652 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:05.790858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d280b0e6-edab-44a1-9618-604a2a7e8652 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:05.793950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d280b0e6-edab-44a1-9618-604a2a7e8652 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:05.794575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d280b0e6-edab-44a1-9618-604a2a7e8652 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:05.795168 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d280b0e6-edab-44a1-9618-604a2a7e8652 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:05.805280 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3c4407a0-ed2e-4c2c-992f-59281cca48b9 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "PUT /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags" status: 200 len: 62 microversion: 2.26 time: 0.183409 Sep 17 21:00:05.806584 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1146/2367] 10.222.0.26 () {62 vars in 1312 bytes} [Sat Sep 17 21:00:05 2022] PUT /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags => generated 62 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:05.812935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-433b77e7-e3a4-4d94-a7d9-c7dcdcc40474 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:05.814804 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-433b77e7-e3a4-4d94-a7d9-c7dcdcc40474 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 526330e7-cd66-44c3-9453-ea80479469a8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:05.824203 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-433b77e7-e3a4-4d94-a7d9-c7dcdcc40474 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:05.825072 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-433b77e7-e3a4-4d94-a7d9-c7dcdcc40474 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:05.825841 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-433b77e7-e3a4-4d94-a7d9-c7dcdcc40474 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:05.826846 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-433b77e7-e3a4-4d94-a7d9-c7dcdcc40474 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:05.827712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-433b77e7-e3a4-4d94-a7d9-c7dcdcc40474 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:05.828360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-433b77e7-e3a4-4d94-a7d9-c7dcdcc40474 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:06.232358 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-433b77e7-e3a4-4d94-a7d9-c7dcdcc40474 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:06.243567 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-433b77e7-e3a4-4d94-a7d9-c7dcdcc40474 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/526330e7-cd66-44c3-9453-ea80479469a8" status: 200 len: 1512 microversion: 2.1 time: 0.435507 Sep 17 21:00:06.244501 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1147/2368] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:05 2022] GET /compute/v2.1/servers/526330e7-cd66-44c3-9453-ea80479469a8 => generated 1512 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:06.252416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0ae9dc6e-be3f-4404-9982-dc2dc86db23f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '.version_select at 0x7f25a516ad30>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:06.273798 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ae9dc6e-be3f-4404-9982-dc2dc86db23f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:06.274669 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ae9dc6e-be3f-4404-9982-dc2dc86db23f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:06.274791 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ae9dc6e-be3f-4404-9982-dc2dc86db23f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:06.307097 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0ae9dc6e-be3f-4404-9982-dc2dc86db23f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags" status: 200 len: 62 microversion: 2.26 time: 0.061294 Sep 17 21:00:06.307705 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1148/2369] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Sep 17 21:00:06 2022] GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags => generated 62 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:06.321874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-868cc55c-b12d-4fbf-9e54-b72a301916ca tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:06.334795 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-868cc55c-b12d-4fbf-9e54-b72a301916ca tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 04b100b4-eb98-4ee9-8897-6d25697d2d71] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:06.341754 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-868cc55c-b12d-4fbf-9e54-b72a301916ca tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:06.342474 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-868cc55c-b12d-4fbf-9e54-b72a301916ca tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:06.353809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d280b0e6-edab-44a1-9618-604a2a7e8652 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:06.358499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-868cc55c-b12d-4fbf-9e54-b72a301916ca tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:06.363693 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d280b0e6-edab-44a1-9618-604a2a7e8652 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119" status: 200 len: 1463 microversion: 2.1 time: 0.586972 Sep 17 21:00:06.364225 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-868cc55c-b12d-4fbf-9e54-b72a301916ca tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:06.364903 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-868cc55c-b12d-4fbf-9e54-b72a301916ca tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:06.366216 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-868cc55c-b12d-4fbf-9e54-b72a301916ca tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:06.366560 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1222/2370] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:05 2022] GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119 => generated 1463 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:06.375908 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2da91bd6-095f-4a8b-a5be-89fd37e5a427 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:06.376545 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2da91bd6-095f-4a8b-a5be-89fd37e5a427 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:06.409040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2da91bd6-095f-4a8b-a5be-89fd37e5a427 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:06.419607 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2da91bd6-095f-4a8b-a5be-89fd37e5a427 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:06.421268 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2da91bd6-095f-4a8b-a5be-89fd37e5a427 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:06.424814 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2da91bd6-095f-4a8b-a5be-89fd37e5a427 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:06.425562 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2da91bd6-095f-4a8b-a5be-89fd37e5a427 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:06.426204 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2da91bd6-095f-4a8b-a5be-89fd37e5a427 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:06.854015 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-868cc55c-b12d-4fbf-9e54-b72a301916ca tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:06.870288 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-868cc55c-b12d-4fbf-9e54-b72a301916ca tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71" status: 200 len: 1317 microversion: 2.1 time: 0.554297 Sep 17 21:00:06.870952 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1149/2371] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:06 2022] GET /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71 => generated 1317 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:06.875733 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d1f5e4ff-3b9f-4e6a-aef7-0f61376a54fd tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:06.876504 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d1f5e4ff-3b9f-4e6a-aef7-0f61376a54fd tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 563a230c-e153-4283-9d88-9e853f63574a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:06.899296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1f5e4ff-3b9f-4e6a-aef7-0f61376a54fd tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:06.900040 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1f5e4ff-3b9f-4e6a-aef7-0f61376a54fd tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:06.900624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1f5e4ff-3b9f-4e6a-aef7-0f61376a54fd tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:06.901549 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1f5e4ff-3b9f-4e6a-aef7-0f61376a54fd tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:06.902198 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1f5e4ff-3b9f-4e6a-aef7-0f61376a54fd tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:06.902802 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1f5e4ff-3b9f-4e6a-aef7-0f61376a54fd tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:07.011556 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2da91bd6-095f-4a8b-a5be-89fd37e5a427 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:07.014317 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:07.024159 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2da91bd6-095f-4a8b-a5be-89fd37e5a427 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1529 microversion: 2.1 time: 0.656497 Sep 17 21:00:07.024759 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1223/2372] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:06 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1529 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:07.037724 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9710ef69-5c57-40e8-ad72-1bc9e1eb9b95 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '.version_select at 0x7f25a4d73940>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:07.059550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9710ef69-5c57-40e8-ad72-1bc9e1eb9b95 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:07.060046 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9710ef69-5c57-40e8-ad72-1bc9e1eb9b95 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:07.060520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9710ef69-5c57-40e8-ad72-1bc9e1eb9b95 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:07.063164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9710ef69-5c57-40e8-ad72-1bc9e1eb9b95 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:07.084190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9710ef69-5c57-40e8-ad72-1bc9e1eb9b95 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:07.084697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9710ef69-5c57-40e8-ad72-1bc9e1eb9b95 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:07.085138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9710ef69-5c57-40e8-ad72-1bc9e1eb9b95 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:07.085893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9710ef69-5c57-40e8-ad72-1bc9e1eb9b95 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:07.086346 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9710ef69-5c57-40e8-ad72-1bc9e1eb9b95 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:07.086770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9710ef69-5c57-40e8-ad72-1bc9e1eb9b95 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:07.137251 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9710ef69-5c57-40e8-ad72-1bc9e1eb9b95 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:07.138559 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9710ef69-5c57-40e8-ad72-1bc9e1eb9b95 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:07.140310 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9710ef69-5c57-40e8-ad72-1bc9e1eb9b95 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:07.185579 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-9710ef69-5c57-40e8-ad72-1bc9e1eb9b95 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lazy-loading 'flavor' on Instance uuid 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:00:07.204151 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9710ef69-5c57-40e8-ad72-1bc9e1eb9b95 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "DELETE /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags" status: 204 len: 0 microversion: 2.26 time: 0.178108 Sep 17 21:00:07.205275 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1224/2373] 10.222.0.26 () {60 vars in 1295 bytes} [Sat Sep 17 21:00:07 2022] DELETE /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc/tags => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 21:00:07.312991 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d1f5e4ff-3b9f-4e6a-aef7-0f61376a54fd tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:07.321632 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d1f5e4ff-3b9f-4e6a-aef7-0f61376a54fd tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a" status: 200 len: 1513 microversion: 2.1 time: 0.449431 Sep 17 21:00:07.326362 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1150/2374] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:06 2022] GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a => generated 1513 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:07.335582 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ff1561b8-7bd4-44a1-92e0-1c8635673afd tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:07.336423 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ff1561b8-7bd4-44a1-92e0-1c8635673afd tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:07.355599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff1561b8-7bd4-44a1-92e0-1c8635673afd tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:07.356418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff1561b8-7bd4-44a1-92e0-1c8635673afd tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:07.358700 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff1561b8-7bd4-44a1-92e0-1c8635673afd tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:07.359608 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff1561b8-7bd4-44a1-92e0-1c8635673afd tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:07.360232 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff1561b8-7bd4-44a1-92e0-1c8635673afd tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:07.365091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff1561b8-7bd4-44a1-92e0-1c8635673afd tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:07.452449 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-583deae8-146b-4085-a9a4-741b5ab2f024 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:07.459401 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-583deae8-146b-4085-a9a4-741b5ab2f024 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Searching by: {'deleted': False, 'project_id': 'c81f6785bd004f7c8d04b6d5979b4aa4'} {{(pid=140524) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:00:07.476722 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-583deae8-146b-4085-a9a4-741b5ab2f024 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:07.478386 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-583deae8-146b-4085-a9a4-741b5ab2f024 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:07.479529 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-583deae8-146b-4085-a9a4-741b5ab2f024 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:07.483644 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-583deae8-146b-4085-a9a4-741b5ab2f024 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:07.485151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-583deae8-146b-4085-a9a4-741b5ab2f024 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:07.488025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-583deae8-146b-4085-a9a4-741b5ab2f024 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:07.537074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ff1561b8-7bd4-44a1-92e0-1c8635673afd tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:07.545065 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ff1561b8-7bd4-44a1-92e0-1c8635673afd tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1" status: 200 len: 1295 microversion: 2.1 time: 0.216357 Sep 17 21:00:07.549384 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1151/2375] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:07 2022] GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 => generated 1295 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:07.554086 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-583deae8-146b-4085-a9a4-741b5ab2f024 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.346204 Sep 17 21:00:07.576507 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-5b122b80-a043-49e9-b412-96142414f14f req-66a958be-9cd5-4759-9db8-7fe7294c267f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04b100b4-eb98-4ee9-8897-6d25697d2d71", "tag": "24a034e1-4979-4b12-83a1-24ba4387e5b8"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:07.579571 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1225/2376] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 21:00:07 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:00:07.591407 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bed76ae9-194a-4c7e-b07f-e49b1218bbae tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:07.592278 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bed76ae9-194a-4c7e-b07f-e49b1218bbae tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:07.596582 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-5b122b80-a043-49e9-b412-96142414f14f req-66a958be-9cd5-4759-9db8-7fe7294c267f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:07.597083 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-5b122b80-a043-49e9-b412-96142414f14f req-66a958be-9cd5-4759-9db8-7fe7294c267f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:07.597542 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-5b122b80-a043-49e9-b412-96142414f14f req-66a958be-9cd5-4759-9db8-7fe7294c267f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:07.600080 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bed76ae9-194a-4c7e-b07f-e49b1218bbae tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:07.600788 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bed76ae9-194a-4c7e-b07f-e49b1218bbae tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:07.601552 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bed76ae9-194a-4c7e-b07f-e49b1218bbae tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:07.602483 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bed76ae9-194a-4c7e-b07f-e49b1218bbae tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:07.603175 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bed76ae9-194a-4c7e-b07f-e49b1218bbae tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:07.603804 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bed76ae9-194a-4c7e-b07f-e49b1218bbae tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:07.620432 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-5b122b80-a043-49e9-b412-96142414f14f req-66a958be-9cd5-4759-9db8-7fe7294c267f service nova] Creating event network-changed:24a034e1-4979-4b12-83a1-24ba4387e5b8 for instance 04b100b4-eb98-4ee9-8897-6d25697d2d71 on nch1-master-1 Sep 17 21:00:07.630115 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-5b122b80-a043-49e9-b412-96142414f14f req-66a958be-9cd5-4759-9db8-7fe7294c267f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069704 Sep 17 21:00:07.633249 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1152/2377] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:07.634261 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bed76ae9-194a-4c7e-b07f-e49b1218bbae tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:00:07.642324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f0837fed-e04a-4108-a315-67120f4b7ea5 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:07.661177 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f0837fed-e04a-4108-a315-67120f4b7ea5 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:07.662368 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f0837fed-e04a-4108-a315-67120f4b7ea5 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Searching by: {'deleted': False, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898'} {{(pid=140523) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:00:07.671057 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0837fed-e04a-4108-a315-67120f4b7ea5 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:07.671517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0837fed-e04a-4108-a315-67120f4b7ea5 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:07.671909 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0837fed-e04a-4108-a315-67120f4b7ea5 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:07.672647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0837fed-e04a-4108-a315-67120f4b7ea5 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:07.673408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0837fed-e04a-4108-a315-67120f4b7ea5 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:07.679097 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0837fed-e04a-4108-a315-67120f4b7ea5 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:07.740889 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.multi_cell_list [None req-f0837fed-e04a-4108-a315-67120f4b7ea5 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140523) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 21:00:07.786715 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bed76ae9-194a-4c7e-b07f-e49b1218bbae tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "DELETE /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc" status: 204 len: 0 microversion: 2.26 time: 0.199329 Sep 17 21:00:07.788968 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1226/2378] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 17 21:00:07 2022] DELETE /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 21:00:07.795573 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-adf452f5-7b45-4b6a-ac60-b48a4f8cc187 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:07.817294 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-adf452f5-7b45-4b6a-ac60-b48a4f8cc187 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Searching by: {'deleted': False} {{(pid=140524) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:00:07.818561 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f0837fed-e04a-4108-a315-67120f4b7ea5 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:07.839816 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0837fed-e04a-4108-a315-67120f4b7ea5 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:07.841447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0837fed-e04a-4108-a315-67120f4b7ea5 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:07.841447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0837fed-e04a-4108-a315-67120f4b7ea5 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:07.842509 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-adf452f5-7b45-4b6a-ac60-b48a4f8cc187 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:07.843246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-adf452f5-7b45-4b6a-ac60-b48a4f8cc187 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:07.846156 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-adf452f5-7b45-4b6a-ac60-b48a4f8cc187 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:07.847213 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-adf452f5-7b45-4b6a-ac60-b48a4f8cc187 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:07.849190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-adf452f5-7b45-4b6a-ac60-b48a4f8cc187 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:07.850015 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-adf452f5-7b45-4b6a-ac60-b48a4f8cc187 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:08.046340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.multi_cell_list [None req-adf452f5-7b45-4b6a-ac60-b48a4f8cc187 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Listed batch of 18 results from cell out of 1000 limit. Returned 18 total so far. {{(pid=140524) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 21:00:08.224534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-adf452f5-7b45-4b6a-ac60-b48a4f8cc187 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:08.225586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-adf452f5-7b45-4b6a-ac60-b48a4f8cc187 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:08.226038 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-adf452f5-7b45-4b6a-ac60-b48a4f8cc187 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:08.476519 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f0837fed-e04a-4108-a315-67120f4b7ea5 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 0.841918 Sep 17 21:00:08.477681 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1153/2379] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 21:00:07 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:08.494819 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-975c69ab-785e-4f06-90e9-42ba49d9ab9c tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:08.495990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-975c69ab-785e-4f06-90e9-42ba49d9ab9c tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:08.507536 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-975c69ab-785e-4f06-90e9-42ba49d9ab9c tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:08.509179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-975c69ab-785e-4f06-90e9-42ba49d9ab9c tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:08.509910 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-975c69ab-785e-4f06-90e9-42ba49d9ab9c tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:08.510869 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-975c69ab-785e-4f06-90e9-42ba49d9ab9c tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:08.514230 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-975c69ab-785e-4f06-90e9-42ba49d9ab9c tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:08.515883 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-975c69ab-785e-4f06-90e9-42ba49d9ab9c tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:08.947304 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-975c69ab-785e-4f06-90e9-42ba49d9ab9c tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:08.969715 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-975c69ab-785e-4f06-90e9-42ba49d9ab9c tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:08.975274 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-975c69ab-785e-4f06-90e9-42ba49d9ab9c tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:08.981358 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-975c69ab-785e-4f06-90e9-42ba49d9ab9c tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc" status: 200 len: 1552 microversion: 2.26 time: 0.502325 Sep 17 21:00:08.996075 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1154/2380] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:00:08 2022] GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc => generated 1552 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:00:09.008644 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-44c64f28-2c8c-4600-8591-4b65790bc267 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:09.009615 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-44c64f28-2c8c-4600-8591-4b65790bc267 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 04b100b4-eb98-4ee9-8897-6d25697d2d71] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:09.019504 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44c64f28-2c8c-4600-8591-4b65790bc267 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:09.020409 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44c64f28-2c8c-4600-8591-4b65790bc267 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:09.021508 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44c64f28-2c8c-4600-8591-4b65790bc267 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:09.023799 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44c64f28-2c8c-4600-8591-4b65790bc267 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:09.024514 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44c64f28-2c8c-4600-8591-4b65790bc267 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:09.025444 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44c64f28-2c8c-4600-8591-4b65790bc267 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:09.031225 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=94,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:09.196146 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-adf452f5-7b45-4b6a-ac60-b48a4f8cc187 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 30183 microversion: 2.1 time: 1.405442 Sep 17 21:00:09.197155 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1227/2381] 10.222.0.26 () {58 vars in 1171 bytes} [Sat Sep 17 21:00:07 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 30183 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:00:09.202111 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5fb4bba5-b41e-4a98-a2db-fe11a67b5bdc tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:09.202845 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5fb4bba5-b41e-4a98-a2db-fe11a67b5bdc tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:09.217960 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5fb4bba5-b41e-4a98-a2db-fe11a67b5bdc tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:09.218735 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5fb4bba5-b41e-4a98-a2db-fe11a67b5bdc tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:09.219346 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5fb4bba5-b41e-4a98-a2db-fe11a67b5bdc tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:09.230695 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5fb4bba5-b41e-4a98-a2db-fe11a67b5bdc tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:09.231473 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5fb4bba5-b41e-4a98-a2db-fe11a67b5bdc tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:09.232075 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5fb4bba5-b41e-4a98-a2db-fe11a67b5bdc tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:09.292423 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-44c64f28-2c8c-4600-8591-4b65790bc267 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:09.303123 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-44c64f28-2c8c-4600-8591-4b65790bc267 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71" status: 200 len: 1317 microversion: 2.1 time: 0.299002 Sep 17 21:00:09.304015 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1155/2382] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:08 2022] GET /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71 => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:09.310693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-975893d1-52da-4594-8b4f-4df2a2c14a08 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:09.322410 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-975893d1-52da-4594-8b4f-4df2a2c14a08 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:09.323412 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-975893d1-52da-4594-8b4f-4df2a2c14a08 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898'} {{(pid=140523) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:00:09.963234 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-975893d1-52da-4594-8b4f-4df2a2c14a08 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:09.963802 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-975893d1-52da-4594-8b4f-4df2a2c14a08 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:09.964221 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-975893d1-52da-4594-8b4f-4df2a2c14a08 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:09.964975 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-975893d1-52da-4594-8b4f-4df2a2c14a08 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:09.965436 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-975893d1-52da-4594-8b4f-4df2a2c14a08 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:09.965909 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-975893d1-52da-4594-8b4f-4df2a2c14a08 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:10.119611 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.multi_cell_list [None req-975893d1-52da-4594-8b4f-4df2a2c14a08 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140523) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 21:00:10.128480 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5fb4bba5-b41e-4a98-a2db-fe11a67b5bdc tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:10.142527 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5fb4bba5-b41e-4a98-a2db-fe11a67b5bdc tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1529 microversion: 2.1 time: 0.944125 Sep 17 21:00:10.157489 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1228/2383] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:09 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1529 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:10.157489 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6a512dc4-506f-4329-877a-eae03893a288 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:10.157489 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6a512dc4-506f-4329-877a-eae03893a288 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:10.169589 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a512dc4-506f-4329-877a-eae03893a288 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:10.170363 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a512dc4-506f-4329-877a-eae03893a288 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:10.173122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a512dc4-506f-4329-877a-eae03893a288 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:10.174218 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a512dc4-506f-4329-877a-eae03893a288 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:10.174930 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a512dc4-506f-4329-877a-eae03893a288 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:10.175514 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a512dc4-506f-4329-877a-eae03893a288 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:10.261014 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-975893d1-52da-4594-8b4f-4df2a2c14a08 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.955195 Sep 17 21:00:10.271590 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1156/2384] 10.222.0.26 () {58 vars in 1150 bytes} [Sat Sep 17 21:00:09 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:10.276435 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9d8cfa3a-46df-4d18-9fdd-58312234f97d tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:10.298626 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9d8cfa3a-46df-4d18-9fdd-58312234f97d tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Searching by: {'deleted': False, 'project_id': 'c81f6785bd004f7c8d04b6d5979b4aa4'} {{(pid=140523) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:00:10.316993 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d8cfa3a-46df-4d18-9fdd-58312234f97d tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:10.318117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d8cfa3a-46df-4d18-9fdd-58312234f97d tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:10.318561 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d8cfa3a-46df-4d18-9fdd-58312234f97d tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:10.319957 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d8cfa3a-46df-4d18-9fdd-58312234f97d tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:10.320440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d8cfa3a-46df-4d18-9fdd-58312234f97d tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:10.320874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d8cfa3a-46df-4d18-9fdd-58312234f97d tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:10.391528 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9d8cfa3a-46df-4d18-9fdd-58312234f97d tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail?tenant_id=a0c2cdfddf5b4d35a0ca3c7554271365" status: 200 len: 15 microversion: 2.1 time: 0.118672 Sep 17 21:00:10.392124 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1157/2385] 10.222.0.26 () {58 vars in 1231 bytes} [Sat Sep 17 21:00:10 2022] GET /compute/v2.1/servers/detail?tenant_id=a0c2cdfddf5b4d35a0ca3c7554271365 => generated 15 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:00:10.396963 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cc3fff7d-5d77-41ce-b40c-ae24849fb91f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:10.405559 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cc3fff7d-5d77-41ce-b40c-ae24849fb91f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:10.414479 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc3fff7d-5d77-41ce-b40c-ae24849fb91f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:10.429329 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc3fff7d-5d77-41ce-b40c-ae24849fb91f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:10.429830 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc3fff7d-5d77-41ce-b40c-ae24849fb91f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:10.430588 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc3fff7d-5d77-41ce-b40c-ae24849fb91f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:10.431210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc3fff7d-5d77-41ce-b40c-ae24849fb91f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:10.431794 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc3fff7d-5d77-41ce-b40c-ae24849fb91f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:10.699835 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cc3fff7d-5d77-41ce-b40c-ae24849fb91f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:10.712777 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cc3fff7d-5d77-41ce-b40c-ae24849fb91f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:10.719305 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cc3fff7d-5d77-41ce-b40c-ae24849fb91f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '88c9912ab49942f7943cd766ba040cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '123af01a2abf4b24920c623a0bbe6330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:10.723705 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cc3fff7d-5d77-41ce-b40c-ae24849fb91f tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc" status: 200 len: 1510 microversion: 2.26 time: 0.330369 Sep 17 21:00:10.724431 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1158/2386] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:00:10 2022] GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc => generated 1510 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:00:10.735417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-abf410ea-be30-4e5b-9497-f8813fbb7cbb tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:10.748290 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-abf410ea-be30-4e5b-9497-f8813fbb7cbb tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:10.754849 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-abf410ea-be30-4e5b-9497-f8813fbb7cbb tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898'} {{(pid=140523) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:00:10.765210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-abf410ea-be30-4e5b-9497-f8813fbb7cbb tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:10.771541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-abf410ea-be30-4e5b-9497-f8813fbb7cbb tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:10.772235 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-abf410ea-be30-4e5b-9497-f8813fbb7cbb tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:10.773423 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-abf410ea-be30-4e5b-9497-f8813fbb7cbb tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:10.789160 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-abf410ea-be30-4e5b-9497-f8813fbb7cbb tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:10.789911 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-abf410ea-be30-4e5b-9497-f8813fbb7cbb tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:10.874573 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6a512dc4-506f-4329-877a-eae03893a288 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:10.883099 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6a512dc4-506f-4329-877a-eae03893a288 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1" status: 200 len: 1325 microversion: 2.1 time: 0.738424 Sep 17 21:00:10.899363 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1229/2387] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:10 2022] GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 => generated 1325 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:10.904738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0b2aa9cc-80b8-4c37-8c03-7c3181331273 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:10.910575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0b2aa9cc-80b8-4c37-8c03-7c3181331273 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 04b100b4-eb98-4ee9-8897-6d25697d2d71] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:10.926050 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b2aa9cc-80b8-4c37-8c03-7c3181331273 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:10.933253 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b2aa9cc-80b8-4c37-8c03-7c3181331273 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:10.941979 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b2aa9cc-80b8-4c37-8c03-7c3181331273 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:10.942955 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b2aa9cc-80b8-4c37-8c03-7c3181331273 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:10.943678 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b2aa9cc-80b8-4c37-8c03-7c3181331273 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:10.944274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b2aa9cc-80b8-4c37-8c03-7c3181331273 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:11.041869 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.multi_cell_list [None req-abf410ea-be30-4e5b-9497-f8813fbb7cbb tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140523) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 21:00:11.168241 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-abf410ea-be30-4e5b-9497-f8813fbb7cbb tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.440757 Sep 17 21:00:11.172497 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1159/2388] 10.222.0.26 () {58 vars in 1212 bytes} [Sat Sep 17 21:00:10 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:11.185311 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-abf8e85a-b974-4685-9dd9-cbd42563a8e2 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:11.216852 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-abf8e85a-b974-4685-9dd9-cbd42563a8e2 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Searching by: {'tenant_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'deleted': False} {{(pid=140523) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:00:11.225580 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-abf8e85a-b974-4685-9dd9-cbd42563a8e2 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:11.226412 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-abf8e85a-b974-4685-9dd9-cbd42563a8e2 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:11.227065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-abf8e85a-b974-4685-9dd9-cbd42563a8e2 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:11.228035 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-abf8e85a-b974-4685-9dd9-cbd42563a8e2 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:11.228725 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-abf8e85a-b974-4685-9dd9-cbd42563a8e2 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:11.229362 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-abf8e85a-b974-4685-9dd9-cbd42563a8e2 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:11.307119 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.multi_cell_list [None req-abf8e85a-b974-4685-9dd9-cbd42563a8e2 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140523) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 21:00:11.403999 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-abf8e85a-b974-4685-9dd9-cbd42563a8e2 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:11.413755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-abf8e85a-b974-4685-9dd9-cbd42563a8e2 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:11.415804 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-abf8e85a-b974-4685-9dd9-cbd42563a8e2 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:12.060403 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-abf8e85a-b974-4685-9dd9-cbd42563a8e2 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a0c2cdfddf5b4d35a0ca3c7554271365" status: 200 len: 4825 microversion: 2.1 time: 0.885733 Sep 17 21:00:12.062286 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1160/2389] 10.222.0.26 () {58 vars in 1257 bytes} [Sat Sep 17 21:00:11 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=a0c2cdfddf5b4d35a0ca3c7554271365 => generated 4825 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:12.069483 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-a722866c-2de4-4ccb-8f21-39b3db60aa7d req-b630b98f-c970-4389-82e9-dcf84881f204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc", "name": "network-vif-deleted", "tag": "aac9debb-24da-4f8d-957a-4b9a05677c5c"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:12.089684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0b2aa9cc-80b8-4c37-8c03-7c3181331273 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:12.093730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-a722866c-2de4-4ccb-8f21-39b3db60aa7d req-b630b98f-c970-4389-82e9-dcf84881f204 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:12.098118 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-a722866c-2de4-4ccb-8f21-39b3db60aa7d req-b630b98f-c970-4389-82e9-dcf84881f204 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:12.099482 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-a722866c-2de4-4ccb-8f21-39b3db60aa7d req-b630b98f-c970-4389-82e9-dcf84881f204 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:12.115262 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0b2aa9cc-80b8-4c37-8c03-7c3181331273 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71" status: 200 len: 1317 microversion: 2.1 time: 1.214391 Sep 17 21:00:12.127503 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1230/2390] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:10 2022] GET /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71 => generated 1317 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:12.138555 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-a722866c-2de4-4ccb-8f21-39b3db60aa7d req-b630b98f-c970-4389-82e9-dcf84881f204 service nova] Creating event network-vif-deleted:aac9debb-24da-4f8d-957a-4b9a05677c5c for instance 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc on nch2-master-1 Sep 17 21:00:12.140291 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-3f89c3d1-cfca-480f-8d6d-142a3926b43d req-3a5c05d6-5425-4b58-a348-af5662fe3990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "126bfb0a-a567-407a-becb-4f5a814da7c6", "name": "network-vif-plugged", "status": "completed", "tag": "6804739c-1745-41d6-b864-b17b1ed8921d"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:12.149760 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-a722866c-2de4-4ccb-8f21-39b3db60aa7d req-b630b98f-c970-4389-82e9-dcf84881f204 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085848 Sep 17 21:00:12.153114 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1161/2391] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:12.161811 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ff5ca7bc-d8b1-4d5d-8865-0d782b2f5f38 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:12.162767 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ff5ca7bc-d8b1-4d5d-8865-0d782b2f5f38 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:12.167383 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-3f89c3d1-cfca-480f-8d6d-142a3926b43d req-3a5c05d6-5425-4b58-a348-af5662fe3990 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:12.171072 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff5ca7bc-d8b1-4d5d-8865-0d782b2f5f38 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:12.171760 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff5ca7bc-d8b1-4d5d-8865-0d782b2f5f38 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:12.172483 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff5ca7bc-d8b1-4d5d-8865-0d782b2f5f38 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:12.173544 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff5ca7bc-d8b1-4d5d-8865-0d782b2f5f38 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:12.174149 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff5ca7bc-d8b1-4d5d-8865-0d782b2f5f38 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:12.174721 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff5ca7bc-d8b1-4d5d-8865-0d782b2f5f38 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:12.178742 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-3f89c3d1-cfca-480f-8d6d-142a3926b43d req-3a5c05d6-5425-4b58-a348-af5662fe3990 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:12.179686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-3f89c3d1-cfca-480f-8d6d-142a3926b43d req-3a5c05d6-5425-4b58-a348-af5662fe3990 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:12.210317 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-3f89c3d1-cfca-480f-8d6d-142a3926b43d req-3a5c05d6-5425-4b58-a348-af5662fe3990 service nova] Creating event network-vif-plugged:6804739c-1745-41d6-b864-b17b1ed8921d for instance 126bfb0a-a567-407a-becb-4f5a814da7c6 on nch1-master-1 Sep 17 21:00:12.220975 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-3f89c3d1-cfca-480f-8d6d-142a3926b43d req-3a5c05d6-5425-4b58-a348-af5662fe3990 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090660 Sep 17 21:00:12.222124 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1231/2392] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:12.239818 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5347bfc6-fe95-4a2a-8918-039d3f7cd90e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:12.247546 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5347bfc6-fe95-4a2a-8918-039d3f7cd90e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:12.248574 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5347bfc6-fe95-4a2a-8918-039d3f7cd90e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898'} {{(pid=140524) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:00:12.262278 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5347bfc6-fe95-4a2a-8918-039d3f7cd90e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:12.263127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5347bfc6-fe95-4a2a-8918-039d3f7cd90e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:12.263792 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5347bfc6-fe95-4a2a-8918-039d3f7cd90e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:12.264511 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5347bfc6-fe95-4a2a-8918-039d3f7cd90e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:12.264966 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5347bfc6-fe95-4a2a-8918-039d3f7cd90e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:12.265399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5347bfc6-fe95-4a2a-8918-039d3f7cd90e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:12.465788 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.multi_cell_list [None req-5347bfc6-fe95-4a2a-8918-039d3f7cd90e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140524) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 21:00:12.680470 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5347bfc6-fe95-4a2a-8918-039d3f7cd90e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.456975 Sep 17 21:00:12.681664 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1232/2393] 10.222.0.26 () {58 vars in 1196 bytes} [Sat Sep 17 21:00:12 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:12.702585 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c386e924-1eb3-48fe-826f-349ebadcd456 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:12.706247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c386e924-1eb3-48fe-826f-349ebadcd456 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] [instance: 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:12.720706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ff5ca7bc-d8b1-4d5d-8865-0d782b2f5f38 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:12.721479 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c386e924-1eb3-48fe-826f-349ebadcd456 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:12.722136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c386e924-1eb3-48fe-826f-349ebadcd456 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:12.722756 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c386e924-1eb3-48fe-826f-349ebadcd456 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:12.723625 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c386e924-1eb3-48fe-826f-349ebadcd456 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:12.724232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c386e924-1eb3-48fe-826f-349ebadcd456 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:12.724812 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c386e924-1eb3-48fe-826f-349ebadcd456 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:12.735491 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ff5ca7bc-d8b1-4d5d-8865-0d782b2f5f38 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1524 microversion: 2.1 time: 0.580862 Sep 17 21:00:12.738238 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1162/2394] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:12 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1524 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:12.759088 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-c386e924-1eb3-48fe-826f-349ebadcd456 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] HTTP exception thrown: Instance 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc could not be found. Sep 17 21:00:12.760082 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-42130e03-5823-428a-9415-a8006d57c341 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:12.760082 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-42130e03-5823-428a-9415-a8006d57c341 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c386e924-1eb3-48fe-826f-349ebadcd456 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Request method failure captured: Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc HTTP/1.1 Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjUw7pT4j2sfVU2OXKh7Cnuag_IgtgnyGsXWDFquqUBm27whQJYEg2nv8BaxRR-Scg3pQtOIdm3R0JjpayjWMolK19HBQ82eC47F9gSSn5qA7W12oIw6lcLkeXsOBkxGvS6uy3LcJmQrODOssldFyLxuMOSUN8wbgtcbT1Q1Z8yGv20 Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: X-Openstack-Nova-Api-Version: 2.26 Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 123af01a2abf4b24920c623a0bbe6330 Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerTagsTestJSON-1668362601 Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/123af01a2abf4b24920c623a0bbe6330"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/123af01a2abf4b24920c623a0bbe6330"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/123af01a2abf4b24920c623a0bbe6330"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_123af01a2abf4b24920c623a0bbe6330", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerTagsTestJSON-1668362601 Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 123af01a2abf4b24920c623a0bbe6330 Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerTagsTestJSON-1668362601 Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerTagsTestJSON-1668362601-project Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 88c9912ab49942f7943cd766ba040cc5 Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerTagsTestJSON-1668362601-project Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc could not be found. Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc'} Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc could not be found. Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc could not be found. Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:00:12.769609 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:12.774381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:12.774381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:00:12.774381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:00:12.774381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:00:12.774381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:00:12.774381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc could not be found. Sep 17 21:00:12.774381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:12.775665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c386e924-1eb3-48fe-826f-349ebadcd456 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] Returning 404 to user: Instance 45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:00:12.776882 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c386e924-1eb3-48fe-826f-349ebadcd456 tempest-ServerTagsTestJSON-1668362601 tempest-ServerTagsTestJSON-1668362601-project] 10.222.0.26 "GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc" status: 404 len: 111 microversion: 2.26 time: 0.093948 Sep 17 21:00:12.777946 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1233/2395] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:00:12 2022] GET /compute/v2.1/servers/45cb2aa6-c9bc-4087-80c2-fa3f1edbb2bc => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:00:12.783799 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-42130e03-5823-428a-9415-a8006d57c341 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:12.783938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ac8c5096-057b-4c64-be41-5ba7415f90dc tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:12.784304 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-42130e03-5823-428a-9415-a8006d57c341 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:12.784780 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-42130e03-5823-428a-9415-a8006d57c341 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:12.785507 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-42130e03-5823-428a-9415-a8006d57c341 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:12.786000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-42130e03-5823-428a-9415-a8006d57c341 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:12.792661 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ac8c5096-057b-4c64-be41-5ba7415f90dc tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Searching by: {'tenant_id': 'c81f6785bd004f7c8d04b6d5979b4aa4', 'deleted': False} {{(pid=140524) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:00:12.801720 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-42130e03-5823-428a-9415-a8006d57c341 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:12.810776 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac8c5096-057b-4c64-be41-5ba7415f90dc tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:12.815018 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac8c5096-057b-4c64-be41-5ba7415f90dc tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:12.815594 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac8c5096-057b-4c64-be41-5ba7415f90dc tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:12.816542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac8c5096-057b-4c64-be41-5ba7415f90dc tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:12.817136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac8c5096-057b-4c64-be41-5ba7415f90dc tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:12.817714 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac8c5096-057b-4c64-be41-5ba7415f90dc tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:12.901862 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ac8c5096-057b-4c64-be41-5ba7415f90dc tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c81f6785bd004f7c8d04b6d5979b4aa4" status: 200 len: 15 microversion: 2.1 time: 0.118238 Sep 17 21:00:12.917361 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1234/2396] 10.222.0.26 () {58 vars in 1257 bytes} [Sat Sep 17 21:00:12 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c81f6785bd004f7c8d04b6d5979b4aa4 => generated 15 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:00:12.926576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-406ce3cc-cfd0-476b-a22b-6dc66c4b6342 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:12.931873 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-406ce3cc-cfd0-476b-a22b-6dc66c4b6342 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:12.932807 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-406ce3cc-cfd0-476b-a22b-6dc66c4b6342 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Searching by: {'name': '-539837767', 'deleted': False, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898'} {{(pid=140524) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:00:12.946223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-406ce3cc-cfd0-476b-a22b-6dc66c4b6342 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:12.947814 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-406ce3cc-cfd0-476b-a22b-6dc66c4b6342 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:12.950145 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-406ce3cc-cfd0-476b-a22b-6dc66c4b6342 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:12.960281 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-406ce3cc-cfd0-476b-a22b-6dc66c4b6342 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:12.966610 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-406ce3cc-cfd0-476b-a22b-6dc66c4b6342 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:12.967301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-406ce3cc-cfd0-476b-a22b-6dc66c4b6342 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:13.142782 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-42130e03-5823-428a-9415-a8006d57c341 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:13.163249 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-42130e03-5823-428a-9415-a8006d57c341 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1" status: 200 len: 1325 microversion: 2.1 time: 0.424039 Sep 17 21:00:13.167109 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1163/2397] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:12 2022] GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 => generated 1325 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:13.186103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-f299a8e4-7e8a-433b-bba7-e4e2b3008c36 req-0fccf17c-7fa9-46ce-a734-804d00163b75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1", "tag": "144ada83-ad9c-4eae-9a08-a67f7dd67cbf"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:13.209603 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f299a8e4-7e8a-433b-bba7-e4e2b3008c36 req-0fccf17c-7fa9-46ce-a734-804d00163b75 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:13.210479 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f299a8e4-7e8a-433b-bba7-e4e2b3008c36 req-0fccf17c-7fa9-46ce-a734-804d00163b75 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:13.211140 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f299a8e4-7e8a-433b-bba7-e4e2b3008c36 req-0fccf17c-7fa9-46ce-a734-804d00163b75 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:13.240562 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-f299a8e4-7e8a-433b-bba7-e4e2b3008c36 req-0fccf17c-7fa9-46ce-a734-804d00163b75 service nova] Creating event network-changed:144ada83-ad9c-4eae-9a08-a67f7dd67cbf for instance 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 on nch2-master-1 Sep 17 21:00:13.260468 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-f299a8e4-7e8a-433b-bba7-e4e2b3008c36 req-0fccf17c-7fa9-46ce-a734-804d00163b75 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088582 Sep 17 21:00:13.261891 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1164/2398] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:13.267724 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8a60aa05-e9ca-48b4-be12-831432198f40 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:13.275868 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8a60aa05-e9ca-48b4-be12-831432198f40 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.012125 Sep 17 21:00:13.286468 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1165/2399] 10.222.0.26 () {58 vars in 1189 bytes} [Sat Sep 17 21:00:13 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:00:13.304623 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3e0a6670-a443-430b-9137-6c74ebbf5fca tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:13.314917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3e0a6670-a443-430b-9137-6c74ebbf5fca tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 04b100b4-eb98-4ee9-8897-6d25697d2d71] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:13.341763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3e0a6670-a443-430b-9137-6c74ebbf5fca tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:13.342632 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3e0a6670-a443-430b-9137-6c74ebbf5fca tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:13.343369 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3e0a6670-a443-430b-9137-6c74ebbf5fca tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:13.344340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3e0a6670-a443-430b-9137-6c74ebbf5fca tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:13.345023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3e0a6670-a443-430b-9137-6c74ebbf5fca tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:13.345717 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3e0a6670-a443-430b-9137-6c74ebbf5fca tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:13.802885 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.multi_cell_list [None req-406ce3cc-cfd0-476b-a22b-6dc66c4b6342 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140524) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 21:00:13.945327 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-406ce3cc-cfd0-476b-a22b-6dc66c4b6342 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers?name=-539837767" status: 200 len: 345 microversion: 2.1 time: 1.023422 Sep 17 21:00:13.948728 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1235/2400] 10.222.0.26 () {58 vars in 1156 bytes} [Sat Sep 17 21:00:12 2022] GET /compute/v2.1/servers?name=-539837767 => generated 345 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:13.958634 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9ad6a615-2058-4059-87a0-4586b37e85fb tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:13.960939 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9ad6a615-2058-4059-87a0-4586b37e85fb tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:13.978570 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ad6a615-2058-4059-87a0-4586b37e85fb tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:13.979071 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ad6a615-2058-4059-87a0-4586b37e85fb tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:13.979558 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ad6a615-2058-4059-87a0-4586b37e85fb tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:13.980285 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ad6a615-2058-4059-87a0-4586b37e85fb tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:13.980748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ad6a615-2058-4059-87a0-4586b37e85fb tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:13.981171 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ad6a615-2058-4059-87a0-4586b37e85fb tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:13.991067 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3e0a6670-a443-430b-9137-6c74ebbf5fca tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:14.008029 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3e0a6670-a443-430b-9137-6c74ebbf5fca tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71" status: 200 len: 1317 microversion: 2.1 time: 0.718124 Sep 17 21:00:14.008972 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1166/2401] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:13 2022] GET /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71 => generated 1317 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:14.014842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-798c2240-56df-4dd4-83e8-10583989aa2f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:14.016316 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-798c2240-56df-4dd4-83e8-10583989aa2f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:14.026724 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-798c2240-56df-4dd4-83e8-10583989aa2f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:14.027355 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-798c2240-56df-4dd4-83e8-10583989aa2f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:14.027800 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-798c2240-56df-4dd4-83e8-10583989aa2f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:14.028537 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-798c2240-56df-4dd4-83e8-10583989aa2f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:14.029012 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-798c2240-56df-4dd4-83e8-10583989aa2f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:14.029666 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-798c2240-56df-4dd4-83e8-10583989aa2f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:14.203344 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9ad6a615-2058-4059-87a0-4586b37e85fb tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e/action" status: 202 len: 0 microversion: 2.1 time: 0.253385 Sep 17 21:00:14.207129 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1236/2402] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:00:13 2022] POST /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:00:14.219394 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5544424e-e05b-4386-9f81-719f424c190a tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:14.239912 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5544424e-e05b-4386-9f81-719f424c190a tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:14.240703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5544424e-e05b-4386-9f81-719f424c190a tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898'} {{(pid=140524) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:00:14.260889 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5544424e-e05b-4386-9f81-719f424c190a tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:14.260889 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5544424e-e05b-4386-9f81-719f424c190a tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:14.260889 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5544424e-e05b-4386-9f81-719f424c190a tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:14.261285 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5544424e-e05b-4386-9f81-719f424c190a tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:14.261486 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5544424e-e05b-4386-9f81-719f424c190a tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:14.271007 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5544424e-e05b-4386-9f81-719f424c190a tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:14.312428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-798c2240-56df-4dd4-83e8-10583989aa2f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:14.323104 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-798c2240-56df-4dd4-83e8-10583989aa2f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1524 microversion: 2.1 time: 0.312922 Sep 17 21:00:14.323936 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1167/2403] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:14 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1524 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:14.334109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9f869844-d294-4e47-a0de-516befae76f3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:14.338193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9f869844-d294-4e47-a0de-516befae76f3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:14.351067 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f869844-d294-4e47-a0de-516befae76f3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:14.354831 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f869844-d294-4e47-a0de-516befae76f3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:14.357790 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f869844-d294-4e47-a0de-516befae76f3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:14.359489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f869844-d294-4e47-a0de-516befae76f3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:14.361166 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f869844-d294-4e47-a0de-516befae76f3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:14.362677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f869844-d294-4e47-a0de-516befae76f3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:14.490530 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.multi_cell_list [None req-5544424e-e05b-4386-9f81-719f424c190a tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=140524) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 21:00:14.517773 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=94,nova_cell1:DELETE=1,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:14.600571 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5544424e-e05b-4386-9f81-719f424c190a tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.386031 Sep 17 21:00:14.600571 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1237/2404] 10.222.0.26 () {58 vars in 1154 bytes} [Sat Sep 17 21:00:14 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:14.617796 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-45554fca-43c6-46eb-a0e8-51da487f0617 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:14.630126 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-45554fca-43c6-46eb-a0e8-51da487f0617 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:14.634155 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-45554fca-43c6-46eb-a0e8-51da487f0617 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365'} {{(pid=140524) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:00:14.656920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45554fca-43c6-46eb-a0e8-51da487f0617 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:14.657625 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45554fca-43c6-46eb-a0e8-51da487f0617 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:14.658195 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45554fca-43c6-46eb-a0e8-51da487f0617 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:14.659274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45554fca-43c6-46eb-a0e8-51da487f0617 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:14.659824 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45554fca-43c6-46eb-a0e8-51da487f0617 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:14.661782 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45554fca-43c6-46eb-a0e8-51da487f0617 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:14.734378 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9f869844-d294-4e47-a0de-516befae76f3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:14.747077 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9f869844-d294-4e47-a0de-516befae76f3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1" status: 200 len: 1325 microversion: 2.1 time: 0.417787 Sep 17 21:00:14.750768 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1168/2405] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:14 2022] GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 => generated 1325 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:14.763595 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-96c59230-75f5-48a0-87bc-cb48b06bc7a8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:14.783387 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-96c59230-75f5-48a0-87bc-cb48b06bc7a8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:14.795849 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-96c59230-75f5-48a0-87bc-cb48b06bc7a8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-53983776', 'deleted': False, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898'} {{(pid=140523) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:00:14.807443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-96c59230-75f5-48a0-87bc-cb48b06bc7a8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:14.808447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-96c59230-75f5-48a0-87bc-cb48b06bc7a8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:14.809103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-96c59230-75f5-48a0-87bc-cb48b06bc7a8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:14.810142 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-96c59230-75f5-48a0-87bc-cb48b06bc7a8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:14.810834 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-96c59230-75f5-48a0-87bc-cb48b06bc7a8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:14.812083 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-96c59230-75f5-48a0-87bc-cb48b06bc7a8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:15.036925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.multi_cell_list [None req-45554fca-43c6-46eb-a0e8-51da487f0617 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140524) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 21:00:15.130896 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.multi_cell_list [None req-96c59230-75f5-48a0-87bc-cb48b06bc7a8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140523) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 21:00:15.197509 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-45554fca-43c6-46eb-a0e8-51da487f0617 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.596489 Sep 17 21:00:15.216945 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1238/2406] 10.222.0.26 () {58 vars in 1150 bytes} [Sat Sep 17 21:00:14 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:15.238369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b9498c99-bedd-457c-a9a7-11ddc2225279 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:15.243233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b9498c99-bedd-457c-a9a7-11ddc2225279 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 04b100b4-eb98-4ee9-8897-6d25697d2d71] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:15.261229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9498c99-bedd-457c-a9a7-11ddc2225279 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:15.264549 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9498c99-bedd-457c-a9a7-11ddc2225279 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:15.265102 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9498c99-bedd-457c-a9a7-11ddc2225279 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:15.266028 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9498c99-bedd-457c-a9a7-11ddc2225279 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:15.266557 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9498c99-bedd-457c-a9a7-11ddc2225279 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:15.275287 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9498c99-bedd-457c-a9a7-11ddc2225279 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:15.319310 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-96c59230-75f5-48a0-87bc-cb48b06bc7a8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-53983776" status: 200 len: 345 microversion: 2.1 time: 0.564303 Sep 17 21:00:15.322804 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1169/2407] 10.222.0.26 () {58 vars in 1226 bytes} [Sat Sep 17 21:00:14 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-53983776 => generated 345 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:15.335477 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-12f28ad9-bb6a-46a7-a120-1a713e630759 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:15.339509 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-12f28ad9-bb6a-46a7-a120-1a713e630759 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:15.366251 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12f28ad9-bb6a-46a7-a120-1a713e630759 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:15.366786 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12f28ad9-bb6a-46a7-a120-1a713e630759 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:15.367266 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12f28ad9-bb6a-46a7-a120-1a713e630759 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:15.367965 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12f28ad9-bb6a-46a7-a120-1a713e630759 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:15.368418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12f28ad9-bb6a-46a7-a120-1a713e630759 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:15.368854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12f28ad9-bb6a-46a7-a120-1a713e630759 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:15.538564 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-12f28ad9-bb6a-46a7-a120-1a713e630759 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e/action" status: 202 len: 0 microversion: 2.1 time: 0.214381 Sep 17 21:00:15.542084 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1170/2408] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:00:15 2022] POST /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:00:15.545551 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-d07be71b-1b24-42e0-bd49-4a4c3c9663a5 req-825cb996-b8db-426d-ab41-e345b9c652c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b100b4-eb98-4ee9-8897-6d25697d2d71", "name": "network-vif-plugged", "status": "completed", "tag": "24a034e1-4979-4b12-83a1-24ba4387e5b8"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:15.567535 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d07be71b-1b24-42e0-bd49-4a4c3c9663a5 req-825cb996-b8db-426d-ab41-e345b9c652c1 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:15.568023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d07be71b-1b24-42e0-bd49-4a4c3c9663a5 req-825cb996-b8db-426d-ab41-e345b9c652c1 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:15.568460 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d07be71b-1b24-42e0-bd49-4a4c3c9663a5 req-825cb996-b8db-426d-ab41-e345b9c652c1 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:15.602475 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-d07be71b-1b24-42e0-bd49-4a4c3c9663a5 req-825cb996-b8db-426d-ab41-e345b9c652c1 service nova] Creating event network-vif-plugged:24a034e1-4979-4b12-83a1-24ba4387e5b8 for instance 04b100b4-eb98-4ee9-8897-6d25697d2d71 on nch1-master-1 Sep 17 21:00:15.611267 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-d07be71b-1b24-42e0-bd49-4a4c3c9663a5 req-825cb996-b8db-426d-ab41-e345b9c652c1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069626 Sep 17 21:00:15.613646 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1171/2409] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:15.627429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2ae7a3bc-a79d-4be1-8e90-d9383f36e345 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:15.628064 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2ae7a3bc-a79d-4be1-8e90-d9383f36e345 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 563a230c-e153-4283-9d88-9e853f63574a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:15.647459 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ae7a3bc-a79d-4be1-8e90-d9383f36e345 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:15.648003 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ae7a3bc-a79d-4be1-8e90-d9383f36e345 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:15.648454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ae7a3bc-a79d-4be1-8e90-d9383f36e345 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:15.649253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ae7a3bc-a79d-4be1-8e90-d9383f36e345 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:15.649730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ae7a3bc-a79d-4be1-8e90-d9383f36e345 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:15.650324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ae7a3bc-a79d-4be1-8e90-d9383f36e345 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:15.699417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:15.737788 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2ae7a3bc-a79d-4be1-8e90-d9383f36e345 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 563a230c-e153-4283-9d88-9e853f63574a] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:00:15.963634 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2ae7a3bc-a79d-4be1-8e90-d9383f36e345 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "DELETE /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a" status: 204 len: 0 microversion: 2.1 time: 0.348186 Sep 17 21:00:15.965052 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1172/2410] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:00:15 2022] DELETE /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:00:15.972874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-942ab90f-e5a0-4ee7-b17b-0c0a12bcc2e9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:15.973885 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-942ab90f-e5a0-4ee7-b17b-0c0a12bcc2e9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:15.982388 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-942ab90f-e5a0-4ee7-b17b-0c0a12bcc2e9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:15.983145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-942ab90f-e5a0-4ee7-b17b-0c0a12bcc2e9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:15.983807 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-942ab90f-e5a0-4ee7-b17b-0c0a12bcc2e9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:15.987418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-942ab90f-e5a0-4ee7-b17b-0c0a12bcc2e9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:15.987418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-942ab90f-e5a0-4ee7-b17b-0c0a12bcc2e9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:15.987418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-942ab90f-e5a0-4ee7-b17b-0c0a12bcc2e9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:16.019185 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b9498c99-bedd-457c-a9a7-11ddc2225279 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:16.031992 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b9498c99-bedd-457c-a9a7-11ddc2225279 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71" status: 200 len: 1317 microversion: 2.1 time: 0.812977 Sep 17 21:00:16.046087 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1239/2411] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:15 2022] GET /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71 => generated 1317 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:16.055595 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-599be3d3-1bed-477d-8d9d-c9e8bee51f08 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:16.064569 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-599be3d3-1bed-477d-8d9d-c9e8bee51f08 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:16.071136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-599be3d3-1bed-477d-8d9d-c9e8bee51f08 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:16.071485 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-599be3d3-1bed-477d-8d9d-c9e8bee51f08 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:16.071954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-599be3d3-1bed-477d-8d9d-c9e8bee51f08 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:16.072890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-599be3d3-1bed-477d-8d9d-c9e8bee51f08 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:16.073665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-599be3d3-1bed-477d-8d9d-c9e8bee51f08 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:16.074245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-599be3d3-1bed-477d-8d9d-c9e8bee51f08 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:16.715917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-942ab90f-e5a0-4ee7-b17b-0c0a12bcc2e9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:16.727580 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-942ab90f-e5a0-4ee7-b17b-0c0a12bcc2e9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1524 microversion: 2.1 time: 0.760995 Sep 17 21:00:16.736020 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1173/2412] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:15 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1524 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:16.740936 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-547bf6b6-ae21-4543-8032-f3cea51996b5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:16.745913 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-547bf6b6-ae21-4543-8032-f3cea51996b5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:16.755719 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-547bf6b6-ae21-4543-8032-f3cea51996b5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:16.756259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-547bf6b6-ae21-4543-8032-f3cea51996b5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:16.756700 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-547bf6b6-ae21-4543-8032-f3cea51996b5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:16.757408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-547bf6b6-ae21-4543-8032-f3cea51996b5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:16.762100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-547bf6b6-ae21-4543-8032-f3cea51996b5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:16.763491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-547bf6b6-ae21-4543-8032-f3cea51996b5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:16.785888 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-599be3d3-1bed-477d-8d9d-c9e8bee51f08 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1614 microversion: 2.1 time: 0.733349 Sep 17 21:00:16.786752 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1240/2413] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:16 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1614 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:16.812330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cd9b02bd-bca3-4e3b-b1cb-d04f6acb4ccd tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:16.813117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cd9b02bd-bca3-4e3b-b1cb-d04f6acb4ccd tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 563a230c-e153-4283-9d88-9e853f63574a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:16.820356 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd9b02bd-bca3-4e3b-b1cb-d04f6acb4ccd tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:16.820869 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd9b02bd-bca3-4e3b-b1cb-d04f6acb4ccd tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:16.821307 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd9b02bd-bca3-4e3b-b1cb-d04f6acb4ccd tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:16.822094 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd9b02bd-bca3-4e3b-b1cb-d04f6acb4ccd tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:16.823532 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd9b02bd-bca3-4e3b-b1cb-d04f6acb4ccd tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:16.826202 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd9b02bd-bca3-4e3b-b1cb-d04f6acb4ccd tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:17.189509 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-547bf6b6-ae21-4543-8032-f3cea51996b5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:17.202073 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-547bf6b6-ae21-4543-8032-f3cea51996b5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1" status: 200 len: 1325 microversion: 2.1 time: 0.463300 Sep 17 21:00:17.203999 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1174/2414] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:16 2022] GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 => generated 1325 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:17.227069 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-82c1b139-a246-4bc0-8201-4e46e1c98a84 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:17.227853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-82c1b139-a246-4bc0-8201-4e46e1c98a84 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:17.245723 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82c1b139-a246-4bc0-8201-4e46e1c98a84 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:17.245723 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82c1b139-a246-4bc0-8201-4e46e1c98a84 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:17.245723 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82c1b139-a246-4bc0-8201-4e46e1c98a84 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:17.245723 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82c1b139-a246-4bc0-8201-4e46e1c98a84 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:17.245723 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82c1b139-a246-4bc0-8201-4e46e1c98a84 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:17.245723 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82c1b139-a246-4bc0-8201-4e46e1c98a84 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:17.458989 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cd9b02bd-bca3-4e3b-b1cb-d04f6acb4ccd tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:17.471582 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cd9b02bd-bca3-4e3b-b1cb-d04f6acb4ccd tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a" status: 200 len: 1519 microversion: 2.1 time: 0.667527 Sep 17 21:00:17.474235 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1241/2415] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:16 2022] GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a => generated 1519 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:17.479987 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-26a247c5-1335-40fa-bb08-28b24afbd2a1 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:17.480756 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-26a247c5-1335-40fa-bb08-28b24afbd2a1 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 04b100b4-eb98-4ee9-8897-6d25697d2d71] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:17.492763 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26a247c5-1335-40fa-bb08-28b24afbd2a1 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:17.493757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26a247c5-1335-40fa-bb08-28b24afbd2a1 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:17.494659 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26a247c5-1335-40fa-bb08-28b24afbd2a1 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:17.495607 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26a247c5-1335-40fa-bb08-28b24afbd2a1 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:17.496484 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26a247c5-1335-40fa-bb08-28b24afbd2a1 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:17.497218 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26a247c5-1335-40fa-bb08-28b24afbd2a1 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:17.715579 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-82c1b139-a246-4bc0-8201-4e46e1c98a84 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1614 microversion: 2.1 time: 0.506674 Sep 17 21:00:17.729085 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1175/2416] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:17 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1614 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:17.784073 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-26a247c5-1335-40fa-bb08-28b24afbd2a1 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:17.804901 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-26a247c5-1335-40fa-bb08-28b24afbd2a1 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71" status: 200 len: 1317 microversion: 2.1 time: 0.321095 Sep 17 21:00:17.805604 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1242/2417] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:17 2022] GET /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71 => generated 1317 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:17.825219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1a4f2d05-4265-409d-8fe4-c2258dbd4486 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:17.838535 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1a4f2d05-4265-409d-8fe4-c2258dbd4486 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Searching by: {'host': 'nch1-master-1', 'deleted': False} {{(pid=140524) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:00:17.845355 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a4f2d05-4265-409d-8fe4-c2258dbd4486 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:17.846196 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a4f2d05-4265-409d-8fe4-c2258dbd4486 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:17.846813 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a4f2d05-4265-409d-8fe4-c2258dbd4486 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:17.847744 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a4f2d05-4265-409d-8fe4-c2258dbd4486 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:17.848417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a4f2d05-4265-409d-8fe4-c2258dbd4486 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:17.849138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a4f2d05-4265-409d-8fe4-c2258dbd4486 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:17.929636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0c8f6474-ac7f-4f74-8945-f58c99e90b82 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Action: 'create', calling method: .version_select at 0x7f25a510b430>, body: {"keypair": {"name": "tempest-keypair-73518827", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhDEnuiQREqITxbwSzu17RbcvKlpZfrIeiWfTDfkDrx7C1cMM8xCOD8USSlsQGDE6Fni7o2O/dWaY0Y5HjeT2SbEaeEbwZoiztJB4nGuNZ7zg0rIEmmIeULKQVR7Pertg=="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:17.959093 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-0c8f6474-ac7f-4f74-8945-f58c99e90b82 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Getting quotas for project f8813aaee4604882b4cd7a2a8df58077. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:00:17.975246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-0c8f6474-ac7f-4f74-8945-f58c99e90b82 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Getting quotas for user da5d41f7e95d44d3898f6306bb093ed7 and project f8813aaee4604882b4cd7a2a8df58077. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:00:18.043416 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0c8f6474-ac7f-4f74-8945-f58c99e90b82 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.312699 Sep 17 21:00:18.050303 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1176/2418] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:00:17 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:18.050303 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c9e67ae8-536d-4903-bc00-3c458de5dad5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:18.050303 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c9e67ae8-536d-4903-bc00-3c458de5dad5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:18.079478 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c9e67ae8-536d-4903-bc00-3c458de5dad5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:18.079968 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c9e67ae8-536d-4903-bc00-3c458de5dad5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:18.086267 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c9e67ae8-536d-4903-bc00-3c458de5dad5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:18.087074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c9e67ae8-536d-4903-bc00-3c458de5dad5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:18.087603 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c9e67ae8-536d-4903-bc00-3c458de5dad5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:18.087977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c9e67ae8-536d-4903-bc00-3c458de5dad5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:18.114800 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.multi_cell_list [None req-1a4f2d05-4265-409d-8fe4-c2258dbd4486 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Listed batch of 9 results from cell out of 1000 limit. Returned 9 total so far. {{(pid=140524) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 21:00:18.199670 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1a4f2d05-4265-409d-8fe4-c2258dbd4486 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] 10.222.0.26 "GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1" status: 200 len: 2969 microversion: 2.1 time: 0.378013 Sep 17 21:00:18.203083 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1243/2419] 10.222.0.26 () {58 vars in 1190 bytes} [Sat Sep 17 21:00:17 2022] GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1 => generated 2969 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:18.217560 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-276a408e-534d-44b3-a4f6-b22d985750ac tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:18.225012 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-276a408e-534d-44b3-a4f6-b22d985750ac tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=140524) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:00:18.227708 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=8 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:18.231688 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-276a408e-534d-44b3-a4f6-b22d985750ac tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:18.232449 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-276a408e-534d-44b3-a4f6-b22d985750ac tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:18.233086 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-276a408e-534d-44b3-a4f6-b22d985750ac tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:18.234071 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-276a408e-534d-44b3-a4f6-b22d985750ac tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:18.234880 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-276a408e-534d-44b3-a4f6-b22d985750ac tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:18.235546 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-276a408e-534d-44b3-a4f6-b22d985750ac tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:18.271405 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-276a408e-534d-44b3-a4f6-b22d985750ac tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] 10.222.0.26 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.058369 Sep 17 21:00:18.279900 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1244/2420] 10.222.0.26 () {58 vars in 1196 bytes} [Sat Sep 17 21:00:18 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:00:18.283905 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-dba1d993-8eeb-41a8-9c02-62f8a700e66f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:18.284679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-dba1d993-8eeb-41a8-9c02-62f8a700e66f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:18.295571 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dba1d993-8eeb-41a8-9c02-62f8a700e66f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:18.296070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dba1d993-8eeb-41a8-9c02-62f8a700e66f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:18.296515 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dba1d993-8eeb-41a8-9c02-62f8a700e66f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:18.297231 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dba1d993-8eeb-41a8-9c02-62f8a700e66f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:18.297744 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dba1d993-8eeb-41a8-9c02-62f8a700e66f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:18.298162 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dba1d993-8eeb-41a8-9c02-62f8a700e66f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:19.213393 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c9e67ae8-536d-4903-bc00-3c458de5dad5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:19.250034 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c9e67ae8-536d-4903-bc00-3c458de5dad5 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1524 microversion: 2.1 time: 1.204335 Sep 17 21:00:19.253679 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1177/2421] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:18 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1524 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:19.264974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-07ea341b-92ae-4b46-b77d-1812a0815baa tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:19.275215 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-07ea341b-92ae-4b46-b77d-1812a0815baa tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:19.294736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-07ea341b-92ae-4b46-b77d-1812a0815baa tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:19.295955 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-07ea341b-92ae-4b46-b77d-1812a0815baa tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:19.297113 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-07ea341b-92ae-4b46-b77d-1812a0815baa tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:19.299238 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-07ea341b-92ae-4b46-b77d-1812a0815baa tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:19.300014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-07ea341b-92ae-4b46-b77d-1812a0815baa tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:19.300768 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-07ea341b-92ae-4b46-b77d-1812a0815baa tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:19.333292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-dba1d993-8eeb-41a8-9c02-62f8a700e66f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:19.343856 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-dba1d993-8eeb-41a8-9c02-62f8a700e66f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1" status: 200 len: 1325 microversion: 2.1 time: 1.063724 Sep 17 21:00:19.350971 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1245/2422] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:18 2022] GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 => generated 1325 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:19.362555 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2b46e1d8-c640-4358-86f8-865550a634f3 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:19.363399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2b46e1d8-c640-4358-86f8-865550a634f3 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 563a230c-e153-4283-9d88-9e853f63574a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:19.375084 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b46e1d8-c640-4358-86f8-865550a634f3 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:19.376135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b46e1d8-c640-4358-86f8-865550a634f3 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:19.377251 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b46e1d8-c640-4358-86f8-865550a634f3 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:19.385883 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b46e1d8-c640-4358-86f8-865550a634f3 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:19.389255 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b46e1d8-c640-4358-86f8-865550a634f3 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:19.390068 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b46e1d8-c640-4358-86f8-865550a634f3 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:19.478716 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-07ea341b-92ae-4b46-b77d-1812a0815baa tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e/action" status: 202 len: 0 microversion: 2.1 time: 0.223453 Sep 17 21:00:19.479369 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1178/2423] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:00:19 2022] POST /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:00:19.484841 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-2fa9f7ee-403a-49d4-8e23-ad4e9f1860a8 req-e4571514-6ff8-4f53-a135-ff99ddcf6ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1", "name": "network-vif-plugged", "status": "completed", "tag": "144ada83-ad9c-4eae-9a08-a67f7dd67cbf"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:19.494819 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2fa9f7ee-403a-49d4-8e23-ad4e9f1860a8 req-e4571514-6ff8-4f53-a135-ff99ddcf6ff2 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:19.495685 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2fa9f7ee-403a-49d4-8e23-ad4e9f1860a8 req-e4571514-6ff8-4f53-a135-ff99ddcf6ff2 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:19.496318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2fa9f7ee-403a-49d4-8e23-ad4e9f1860a8 req-e4571514-6ff8-4f53-a135-ff99ddcf6ff2 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:19.510000 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-2fa9f7ee-403a-49d4-8e23-ad4e9f1860a8 req-e4571514-6ff8-4f53-a135-ff99ddcf6ff2 service nova] Creating event network-vif-plugged:144ada83-ad9c-4eae-9a08-a67f7dd67cbf for instance 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 on nch2-master-1 Sep 17 21:00:19.517119 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-2fa9f7ee-403a-49d4-8e23-ad4e9f1860a8 req-e4571514-6ff8-4f53-a135-ff99ddcf6ff2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036120 Sep 17 21:00:19.518556 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1179/2424] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:19.537506 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b755e18b-c85d-4591-a0af-2049d7ba6a61 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:19.539968 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b755e18b-c85d-4591-a0af-2049d7ba6a61 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 04b100b4-eb98-4ee9-8897-6d25697d2d71] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:19.574954 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b755e18b-c85d-4591-a0af-2049d7ba6a61 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:19.575820 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b755e18b-c85d-4591-a0af-2049d7ba6a61 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:19.576379 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b755e18b-c85d-4591-a0af-2049d7ba6a61 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:19.581161 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b755e18b-c85d-4591-a0af-2049d7ba6a61 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:19.586080 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b755e18b-c85d-4591-a0af-2049d7ba6a61 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:19.589763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b755e18b-c85d-4591-a0af-2049d7ba6a61 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:19.966737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2b46e1d8-c640-4358-86f8-865550a634f3 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:19.975373 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2b46e1d8-c640-4358-86f8-865550a634f3 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a" status: 200 len: 1519 microversion: 2.1 time: 0.622895 Sep 17 21:00:19.991570 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1246/2425] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:19 2022] GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a => generated 1519 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:20.004730 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-76fc5dee-550b-4231-a10d-94b0289fe11f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:20.010060 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-76fc5dee-550b-4231-a10d-94b0289fe11f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:20.045981 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76fc5dee-550b-4231-a10d-94b0289fe11f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:20.047012 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76fc5dee-550b-4231-a10d-94b0289fe11f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:20.047685 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76fc5dee-550b-4231-a10d-94b0289fe11f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:20.048659 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76fc5dee-550b-4231-a10d-94b0289fe11f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:20.049996 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76fc5dee-550b-4231-a10d-94b0289fe11f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:20.051256 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76fc5dee-550b-4231-a10d-94b0289fe11f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:20.176363 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b755e18b-c85d-4591-a0af-2049d7ba6a61 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:20.188114 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b755e18b-c85d-4591-a0af-2049d7ba6a61 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71" status: 200 len: 1466 microversion: 2.1 time: 0.668058 Sep 17 21:00:20.196815 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-76fc5dee-550b-4231-a10d-94b0289fe11f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:00:20.197243 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-76fc5dee-550b-4231-a10d-94b0289fe11f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:00:20.197724 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-76fc5dee-550b-4231-a10d-94b0289fe11f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:00:20.202101 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-76fc5dee-550b-4231-a10d-94b0289fe11f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:00:20.202485 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1180/2426] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:19 2022] GET /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71 => generated 1466 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:20.202942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-76fc5dee-550b-4231-a10d-94b0289fe11f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:00:20.217291 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0b2ae96d-5248-48c3-9261-8989c86f2ef4 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:20.228552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0b2ae96d-5248-48c3-9261-8989c86f2ef4 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] [instance: 04b100b4-eb98-4ee9-8897-6d25697d2d71] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:20.245634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0b2ae96d-5248-48c3-9261-8989c86f2ef4 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:20.246143 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0b2ae96d-5248-48c3-9261-8989c86f2ef4 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:20.246597 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0b2ae96d-5248-48c3-9261-8989c86f2ef4 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:20.247326 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0b2ae96d-5248-48c3-9261-8989c86f2ef4 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:20.247793 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0b2ae96d-5248-48c3-9261-8989c86f2ef4 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:20.248228 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0b2ae96d-5248-48c3-9261-8989c86f2ef4 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:20.340092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-76fc5dee-550b-4231-a10d-94b0289fe11f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:20.368026 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76fc5dee-550b-4231-a10d-94b0289fe11f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:20.368799 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76fc5dee-550b-4231-a10d-94b0289fe11f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:20.372140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76fc5dee-550b-4231-a10d-94b0289fe11f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:20.375991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76fc5dee-550b-4231-a10d-94b0289fe11f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:20.382934 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76fc5dee-550b-4231-a10d-94b0289fe11f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:20.384314 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76fc5dee-550b-4231-a10d-94b0289fe11f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:20.447991 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-76fc5dee-550b-4231-a10d-94b0289fe11f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "POST /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e/action" status: 202 len: 1067 microversion: 2.1 time: 0.454853 Sep 17 21:00:20.449133 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1247/2427] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:00:19 2022] POST /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e/action => generated 1067 bytes in 457 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 17 21:00:20.453956 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9ac579ee-a566-471b-a972-2f4c1e37e7f4 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:20.460058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9ac579ee-a566-471b-a972-2f4c1e37e7f4 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:20.472164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ac579ee-a566-471b-a972-2f4c1e37e7f4 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:20.472986 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ac579ee-a566-471b-a972-2f4c1e37e7f4 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:20.474000 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ac579ee-a566-471b-a972-2f4c1e37e7f4 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:20.475919 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ac579ee-a566-471b-a972-2f4c1e37e7f4 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:20.478185 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ac579ee-a566-471b-a972-2f4c1e37e7f4 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:20.478860 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ac579ee-a566-471b-a972-2f4c1e37e7f4 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:20.659939 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0b2ae96d-5248-48c3-9261-8989c86f2ef4 tempest-ServersOnMultiNodesTest-1453005879 tempest-ServersOnMultiNodesTest-1453005879-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71" status: 200 len: 1617 microversion: 2.1 time: 0.446410 Sep 17 21:00:20.661677 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1181/2428] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:20 2022] GET /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71 => generated 1617 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:00:20.674361 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-f2806077-bf54-4125-af58-1616771e29bf req-4e0cb438-6610-4608-80b7-14ef9d4b7189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "563a230c-e153-4283-9d88-9e853f63574a", "name": "network-vif-deleted", "tag": "8bbe7d40-e648-45cd-bb92-6c833bfc9aca"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:20.705504 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:20.707497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f2806077-bf54-4125-af58-1616771e29bf req-4e0cb438-6610-4608-80b7-14ef9d4b7189 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:20.708002 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f2806077-bf54-4125-af58-1616771e29bf req-4e0cb438-6610-4608-80b7-14ef9d4b7189 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:20.708512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f2806077-bf54-4125-af58-1616771e29bf req-4e0cb438-6610-4608-80b7-14ef9d4b7189 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:20.752322 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-f2806077-bf54-4125-af58-1616771e29bf req-4e0cb438-6610-4608-80b7-14ef9d4b7189 service nova] Creating event network-vif-deleted:8bbe7d40-e648-45cd-bb92-6c833bfc9aca for instance 563a230c-e153-4283-9d88-9e853f63574a on nch1-master-1 Sep 17 21:00:20.767584 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-f2806077-bf54-4125-af58-1616771e29bf req-4e0cb438-6610-4608-80b7-14ef9d4b7189 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104246 Sep 17 21:00:20.777880 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1182/2429] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:20.788193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5515e06b-5851-4ccb-8f82-5ebce9d6258a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:20.790482 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5515e06b-5851-4ccb-8f82-5ebce9d6258a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:20.799291 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5515e06b-5851-4ccb-8f82-5ebce9d6258a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:20.800312 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5515e06b-5851-4ccb-8f82-5ebce9d6258a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:20.801135 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5515e06b-5851-4ccb-8f82-5ebce9d6258a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:20.802158 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5515e06b-5851-4ccb-8f82-5ebce9d6258a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:20.802853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5515e06b-5851-4ccb-8f82-5ebce9d6258a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:20.803703 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5515e06b-5851-4ccb-8f82-5ebce9d6258a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:21.129263 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9ac579ee-a566-471b-a972-2f4c1e37e7f4 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:21.144615 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9ac579ee-a566-471b-a972-2f4c1e37e7f4 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1524 microversion: 2.1 time: 0.689738 Sep 17 21:00:21.162237 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1248/2430] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:20 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1524 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:21.176401 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-82be1446-807c-431a-9690-603d402c48e0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:21.177331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-82be1446-807c-431a-9690-603d402c48e0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:21.200056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-82be1446-807c-431a-9690-603d402c48e0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:21.200822 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-82be1446-807c-431a-9690-603d402c48e0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:21.201447 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-82be1446-807c-431a-9690-603d402c48e0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:21.202354 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-82be1446-807c-431a-9690-603d402c48e0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:21.203131 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-82be1446-807c-431a-9690-603d402c48e0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:21.203702 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-82be1446-807c-431a-9690-603d402c48e0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:21.374933 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5515e06b-5851-4ccb-8f82-5ebce9d6258a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:21.384450 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5515e06b-5851-4ccb-8f82-5ebce9d6258a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1" status: 200 len: 1325 microversion: 2.1 time: 0.604754 Sep 17 21:00:21.389049 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1183/2431] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:20 2022] GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 => generated 1325 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:21.400632 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0b00c2f3-b974-4193-b231-494ae11bac8f tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:21.405974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0b00c2f3-b974-4193-b231-494ae11bac8f tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 04b100b4-eb98-4ee9-8897-6d25697d2d71] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:21.421625 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0b00c2f3-b974-4193-b231-494ae11bac8f tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:21.424668 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0b00c2f3-b974-4193-b231-494ae11bac8f tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:21.425442 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0b00c2f3-b974-4193-b231-494ae11bac8f tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:21.429507 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0b00c2f3-b974-4193-b231-494ae11bac8f tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:21.431881 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0b00c2f3-b974-4193-b231-494ae11bac8f tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:21.437275 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0b00c2f3-b974-4193-b231-494ae11bac8f tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:21.514383 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0b00c2f3-b974-4193-b231-494ae11bac8f tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 04b100b4-eb98-4ee9-8897-6d25697d2d71] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:00:21.577297 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-82be1446-807c-431a-9690-603d402c48e0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:21.589643 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-82be1446-807c-431a-9690-603d402c48e0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1471 microversion: 2.1 time: 0.424759 Sep 17 21:00:21.605511 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1249/2432] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:21 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1471 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:21.605511 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c0e9a8b3-a905-40d2-a606-e12668785f7e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:21.606351 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c0e9a8b3-a905-40d2-a606-e12668785f7e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 563a230c-e153-4283-9d88-9e853f63574a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:21.624858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0e9a8b3-a905-40d2-a606-e12668785f7e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:21.625425 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0e9a8b3-a905-40d2-a606-e12668785f7e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:21.625845 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0e9a8b3-a905-40d2-a606-e12668785f7e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:21.626758 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0e9a8b3-a905-40d2-a606-e12668785f7e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:21.627223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0e9a8b3-a905-40d2-a606-e12668785f7e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:21.627661 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0e9a8b3-a905-40d2-a606-e12668785f7e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:21.696820 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0b00c2f3-b974-4193-b231-494ae11bac8f tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "DELETE /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71" status: 204 len: 0 microversion: 2.1 time: 0.305675 Sep 17 21:00:21.704767 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1184/2433] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:00:21 2022] DELETE /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:00:21.735886 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c973174c-ee51-4885-b24f-874c69fc6d98 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:21.739203 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c973174c-ee51-4885-b24f-874c69fc6d98 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 04b100b4-eb98-4ee9-8897-6d25697d2d71] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:21.749079 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:21.754610 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0e9a8b3-a905-40d2-a606-e12668785f7e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:21.755109 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0e9a8b3-a905-40d2-a606-e12668785f7e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:21.756887 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0e9a8b3-a905-40d2-a606-e12668785f7e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:21.757363 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-c0e9a8b3-a905-40d2-a606-e12668785f7e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lazy-loading 'fault' on Instance uuid 563a230c-e153-4283-9d88-9e853f63574a {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:00:21.763960 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c973174c-ee51-4885-b24f-874c69fc6d98 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:21.767570 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c973174c-ee51-4885-b24f-874c69fc6d98 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:21.767570 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c973174c-ee51-4885-b24f-874c69fc6d98 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:21.767570 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c973174c-ee51-4885-b24f-874c69fc6d98 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:21.767570 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c973174c-ee51-4885-b24f-874c69fc6d98 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:21.767570 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c973174c-ee51-4885-b24f-874c69fc6d98 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:21.822645 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c0e9a8b3-a905-40d2-a606-e12668785f7e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:21.838727 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c0e9a8b3-a905-40d2-a606-e12668785f7e tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a" status: 200 len: 1311 microversion: 2.1 time: 0.244715 Sep 17 21:00:21.839351 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1250/2434] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:21 2022] GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a => generated 1311 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:22.027519 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c973174c-ee51-4885-b24f-874c69fc6d98 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:22.038786 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c973174c-ee51-4885-b24f-874c69fc6d98 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71" status: 200 len: 1472 microversion: 2.1 time: 0.321645 Sep 17 21:00:22.040495 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1185/2435] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:21 2022] GET /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71 => generated 1472 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:22.171195 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5d1654f0-0b8b-4de9-958f-ba7076bf1973 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:22.171966 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5d1654f0-0b8b-4de9-958f-ba7076bf1973 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:22.188435 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d1654f0-0b8b-4de9-958f-ba7076bf1973 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:22.193433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d1654f0-0b8b-4de9-958f-ba7076bf1973 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:22.195370 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d1654f0-0b8b-4de9-958f-ba7076bf1973 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:22.196395 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d1654f0-0b8b-4de9-958f-ba7076bf1973 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:22.197039 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d1654f0-0b8b-4de9-958f-ba7076bf1973 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:22.197732 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d1654f0-0b8b-4de9-958f-ba7076bf1973 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:22.374004 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5d1654f0-0b8b-4de9-958f-ba7076bf1973 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:22.384012 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5d1654f0-0b8b-4de9-958f-ba7076bf1973 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1524 microversion: 2.1 time: 0.216418 Sep 17 21:00:22.385708 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1251/2436] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:22 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1524 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:22.403839 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bbfd54eb-9650-49ce-bde1-426214c7482e tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-322844196", "imageRef": "21f7bde8-2738-4eaa-a1b7-af82ff9b59f7", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "cc82eefa-64c6-4350-9d93-335753133c2e"}], "security_groups": [{"name": "tempest-securitygroup--643231824"}], "key_name": "tempest-keypair-73518827", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:22.422279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4689f434-bf61-4ec9-a384-285093e25924 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:22.425247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4689f434-bf61-4ec9-a384-285093e25924 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:22.438462 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4689f434-bf61-4ec9-a384-285093e25924 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:22.439149 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4689f434-bf61-4ec9-a384-285093e25924 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:22.440799 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4689f434-bf61-4ec9-a384-285093e25924 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:22.442839 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4689f434-bf61-4ec9-a384-285093e25924 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:22.443462 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4689f434-bf61-4ec9-a384-285093e25924 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:22.445064 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4689f434-bf61-4ec9-a384-285093e25924 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:22.479446 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:22.620446 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-bbfd54eb-9650-49ce-bde1-426214c7482e tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] validate_networks() for [('cc82eefa-64c6-4350-9d93-335753133c2e', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:00:22.666687 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4689f434-bf61-4ec9-a384-285093e25924 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:22.679446 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4689f434-bf61-4ec9-a384-285093e25924 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1" status: 200 len: 1520 microversion: 2.1 time: 0.269579 Sep 17 21:00:22.680497 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1252/2437] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:22 2022] GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 => generated 1520 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:22.687351 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-26a6676b-ad91-47f4-a3b7-68b2d454f84e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:22.693932 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-26a6676b-ad91-47f4-a3b7-68b2d454f84e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:22.707196 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26a6676b-ad91-47f4-a3b7-68b2d454f84e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:22.708111 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26a6676b-ad91-47f4-a3b7-68b2d454f84e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:22.708593 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26a6676b-ad91-47f4-a3b7-68b2d454f84e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:22.709381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26a6676b-ad91-47f4-a3b7-68b2d454f84e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:22.709980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26a6676b-ad91-47f4-a3b7-68b2d454f84e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:22.710421 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26a6676b-ad91-47f4-a3b7-68b2d454f84e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:22.956099 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-26a6676b-ad91-47f4-a3b7-68b2d454f84e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:22.969709 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-26a6676b-ad91-47f4-a3b7-68b2d454f84e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1471 microversion: 2.1 time: 0.284517 Sep 17 21:00:22.972135 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1253/2438] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:22 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1471 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:22.983716 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-68ac2a91-90ff-4890-b063-a3d52da1d4b1 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:22.984656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-68ac2a91-90ff-4890-b063-a3d52da1d4b1 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:22.992194 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68ac2a91-90ff-4890-b063-a3d52da1d4b1 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:22.993190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68ac2a91-90ff-4890-b063-a3d52da1d4b1 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:22.993852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68ac2a91-90ff-4890-b063-a3d52da1d4b1 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:22.994721 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68ac2a91-90ff-4890-b063-a3d52da1d4b1 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:22.995454 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68ac2a91-90ff-4890-b063-a3d52da1d4b1 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:22.996832 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68ac2a91-90ff-4890-b063-a3d52da1d4b1 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:23.522792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-bbfd54eb-9650-49ce-bde1-426214c7482e tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:00:23.523981 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-bbfd54eb-9650-49ce-bde1-426214c7482e tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:00:23.524683 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-bbfd54eb-9650-49ce-bde1-426214c7482e tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:00:23.525308 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-bbfd54eb-9650-49ce-bde1-426214c7482e tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:00:23.526023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-bbfd54eb-9650-49ce-bde1-426214c7482e tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:00:23.544277 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-68ac2a91-90ff-4890-b063-a3d52da1d4b1 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:23.554186 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-68ac2a91-90ff-4890-b063-a3d52da1d4b1 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1" status: 200 len: 1520 microversion: 2.1 time: 0.580757 Sep 17 21:00:23.556984 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bbfd54eb-9650-49ce-bde1-426214c7482e tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:23.558093 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bbfd54eb-9650-49ce-bde1-426214c7482e tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:23.558783 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bbfd54eb-9650-49ce-bde1-426214c7482e tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:23.563393 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1254/2439] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:22 2022] GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 => generated 1520 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:23.568636 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-68f2eedb-245d-46c8-91ec-f897d90c2cc2 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:23.569264 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bbfd54eb-9650-49ce-bde1-426214c7482e tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:23.569947 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bbfd54eb-9650-49ce-bde1-426214c7482e tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:23.570607 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bbfd54eb-9650-49ce-bde1-426214c7482e tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:23.581702 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-68f2eedb-245d-46c8-91ec-f897d90c2cc2 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 563a230c-e153-4283-9d88-9e853f63574a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:23.593344 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68f2eedb-245d-46c8-91ec-f897d90c2cc2 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:23.593873 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68f2eedb-245d-46c8-91ec-f897d90c2cc2 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:23.599604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68f2eedb-245d-46c8-91ec-f897d90c2cc2 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:23.600389 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68f2eedb-245d-46c8-91ec-f897d90c2cc2 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:23.601383 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68f2eedb-245d-46c8-91ec-f897d90c2cc2 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:23.603340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68f2eedb-245d-46c8-91ec-f897d90c2cc2 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:23.618233 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=21 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:23.619379 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-bbfd54eb-9650-49ce-bde1-426214c7482e tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Getting quotas for project f8813aaee4604882b4cd7a2a8df58077. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:00:23.631469 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-bbfd54eb-9650-49ce-bde1-426214c7482e tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Getting quotas for user da5d41f7e95d44d3898f6306bb093ed7 and project f8813aaee4604882b4cd7a2a8df58077. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:00:23.647310 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-68f2eedb-245d-46c8-91ec-f897d90c2cc2 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] HTTP exception thrown: Instance 563a230c-e153-4283-9d88-9e853f63574a could not be found. Sep 17 21:00:23.650682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bbfd54eb-9650-49ce-bde1-426214c7482e tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-68f2eedb-245d-46c8-91ec-f897d90c2cc2 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Request method failure captured: Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a HTTP/1.1 Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjUK0KzWxa6mSjj_pP0fjXEoyN5kHVg36NJGDq68fw96nXPym5syYmWHEDYs4_vWu9WgbinhrbnZ0CmVnOeG6ib6KDdv84fVlBoUPMQT0jKQnH3fbXjRr86MdhZdwMUQQwSNNNb92Rx_HXnlFtOHRa3ZmggHyvxsObnUDwWcVfTg3Rw Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 9b45a150f2db4c2bb4871cd1d1cab898 Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ListServerFiltersTestJSON-1137993684 Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b45a150f2db4c2bb4871cd1d1cab898"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9b45a150f2db4c2bb4871cd1d1cab898"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b45a150f2db4c2bb4871cd1d1cab898"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9b45a150f2db4c2bb4871cd1d1cab898", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ListServerFiltersTestJSON-1137993684 Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 9b45a150f2db4c2bb4871cd1d1cab898 Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1137993684 Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ListServerFiltersTestJSON-1137993684-project Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: da76bbe04c22456f957be0675892359d Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ListServerFiltersTestJSON-1137993684-project Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 563a230c-e153-4283-9d88-9e853f63574a could not be found. Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '563a230c-e153-4283-9d88-9e853f63574a'} Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 563a230c-e153-4283-9d88-9e853f63574a could not be found. Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 563a230c-e153-4283-9d88-9e853f63574a could not be found. Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:00:23.652127 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:23.656967 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:23.656967 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:00:23.656967 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:00:23.656967 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:00:23.656967 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:00:23.656967 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 563a230c-e153-4283-9d88-9e853f63574a could not be found. Sep 17 21:00:23.656967 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:23.657538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bbfd54eb-9650-49ce-bde1-426214c7482e tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='21f7bde8-2738-4eaa-a1b7-af82ff9b59f7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:00:23.660400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-68f2eedb-245d-46c8-91ec-f897d90c2cc2 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Returning 404 to user: Instance 563a230c-e153-4283-9d88-9e853f63574a could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:00:23.662239 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-68f2eedb-245d-46c8-91ec-f897d90c2cc2 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a" status: 404 len: 111 microversion: 2.1 time: 0.097064 Sep 17 21:00:23.673015 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1255/2440] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:23 2022] GET /compute/v2.1/servers/563a230c-e153-4283-9d88-9e853f63574a => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:00:23.679820 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f697a7e2-9453-4bcc-a0bc-66e53bf7b68c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:23.680797 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f697a7e2-9453-4bcc-a0bc-66e53bf7b68c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 04b100b4-eb98-4ee9-8897-6d25697d2d71] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:23.689776 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f697a7e2-9453-4bcc-a0bc-66e53bf7b68c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:23.690639 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f697a7e2-9453-4bcc-a0bc-66e53bf7b68c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:23.691339 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f697a7e2-9453-4bcc-a0bc-66e53bf7b68c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:23.694627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f697a7e2-9453-4bcc-a0bc-66e53bf7b68c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:23.695394 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f697a7e2-9453-4bcc-a0bc-66e53bf7b68c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:23.696055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f697a7e2-9453-4bcc-a0bc-66e53bf7b68c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:23.746868 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bbfd54eb-9650-49ce-bde1-426214c7482e tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.347608 Sep 17 21:00:23.753920 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1186/2441] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:00:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 1355 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:00:23.759094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-870d9c78-b812-41a6-830a-7fe37d78d166 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:23.759715 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-870d9c78-b812-41a6-830a-7fe37d78d166 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:23.774553 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-870d9c78-b812-41a6-830a-7fe37d78d166 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:23.775065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-870d9c78-b812-41a6-830a-7fe37d78d166 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:23.775515 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-870d9c78-b812-41a6-830a-7fe37d78d166 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:23.777288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-870d9c78-b812-41a6-830a-7fe37d78d166 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:23.777943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-870d9c78-b812-41a6-830a-7fe37d78d166 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:23.778510 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-870d9c78-b812-41a6-830a-7fe37d78d166 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:23.807760 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:24.235833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f697a7e2-9453-4bcc-a0bc-66e53bf7b68c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:24.254076 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f697a7e2-9453-4bcc-a0bc-66e53bf7b68c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71" status: 200 len: 1472 microversion: 2.1 time: 0.572178 Sep 17 21:00:24.255342 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1256/2442] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:23 2022] GET /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71 => generated 1472 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:24.272707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-272e725e-e42e-49bd-b037-f9d9d9770da1 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-139850145", "metadata": {"": ""}}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-272e725e-e42e-49bd-b037-f9d9d9770da1 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Request method failure captured: Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1/action HTTP/1.1 Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 106 Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjVSncfbAtgCIyToozPzw5wAkwJ8A5Pq3oENCAdqUUIYA48iSRlVG7zkjE71pODQ7Vq39Whu62dN5SwPbwvIXMyuqDiapFCgUkVVyC-O5o-Rbhev8SZVJvwjqio0qc_eiz6AU5vzIes11QJweqLBoCqKJfa2-0GqtVV9pkib7fT-OL0 Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 004f77fba4b14080bca4ae36c857add3 Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_004f77fba4b14080bca4ae36c857add3", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 004f77fba4b14080bca4ae36c857add3 Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ImagesOneServerNegativeTestJSON-622753367-project Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 22306a93c9404db393b92a267d6258d4 Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-622753367-project Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-139850145", "metadata": {"": ""}}} Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-139850145', 'metadata': {'': ''}}}} Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise error Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi {'': ''} Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:00:24.311126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 21:00:24.315732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 21:00:24.315732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 21:00:24.315732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 21:00:24.315732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 21:00:24.315732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 21:00:24.315732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 17 21:00:24.315732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:24.315732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:00:24.315732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:24.315732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:24.315732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:00:24.315732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:00:24.315732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 21:00:24.315732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 21:00:24.315732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 17 21:00:24.315732 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:24.315732 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-272e725e-e42e-49bd-b037-f9d9d9770da1 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:00:24.315732 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-272e725e-e42e-49bd-b037-f9d9d9770da1 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "POST /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1/action" status: 400 len: 170 microversion: 2.1 time: 0.055447 Sep 17 21:00:24.317058 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1257/2443] 10.222.0.26 () {60 vars in 1279 bytes} [Sat Sep 17 21:00:24 2022] POST /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1/action => generated 170 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:00:24.321526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9547d047-1d8f-47a1-a798-43183aacef1c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:24.322039 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9547d047-1d8f-47a1-a798-43183aacef1c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 526330e7-cd66-44c3-9453-ea80479469a8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:24.343466 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9547d047-1d8f-47a1-a798-43183aacef1c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:24.344234 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9547d047-1d8f-47a1-a798-43183aacef1c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:24.344860 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9547d047-1d8f-47a1-a798-43183aacef1c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:24.346469 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9547d047-1d8f-47a1-a798-43183aacef1c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:24.347093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9547d047-1d8f-47a1-a798-43183aacef1c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:24.347679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9547d047-1d8f-47a1-a798-43183aacef1c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:24.412902 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9547d047-1d8f-47a1-a798-43183aacef1c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 526330e7-cd66-44c3-9453-ea80479469a8] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:00:24.434070 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-870d9c78-b812-41a6-830a-7fe37d78d166 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:24.446424 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-870d9c78-b812-41a6-830a-7fe37d78d166 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1524 microversion: 2.1 time: 0.689797 Sep 17 21:00:24.448772 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1187/2444] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:23 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1524 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:24.459014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f802dc3c-a3a9-4714-96f9-2c741661479a tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:24.462870 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f802dc3c-a3a9-4714-96f9-2c741661479a tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:24.602868 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9547d047-1d8f-47a1-a798-43183aacef1c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "DELETE /compute/v2.1/servers/526330e7-cd66-44c3-9453-ea80479469a8" status: 204 len: 0 microversion: 2.1 time: 0.284740 Sep 17 21:00:24.604447 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1258/2445] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:00:24 2022] DELETE /compute/v2.1/servers/526330e7-cd66-44c3-9453-ea80479469a8 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:00:24.621329 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-09096675-0256-4313-9af5-5f7ddeea7d95 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:24.622467 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-09096675-0256-4313-9af5-5f7ddeea7d95 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:24.641079 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09096675-0256-4313-9af5-5f7ddeea7d95 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:24.642042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09096675-0256-4313-9af5-5f7ddeea7d95 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:24.642730 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09096675-0256-4313-9af5-5f7ddeea7d95 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:24.643635 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09096675-0256-4313-9af5-5f7ddeea7d95 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:24.643815 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f802dc3c-a3a9-4714-96f9-2c741661479a tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5d41f7e95d44d3898f6306bb093ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8813aaee4604882b4cd7a2a8df58077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:24.644869 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09096675-0256-4313-9af5-5f7ddeea7d95 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:24.645481 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09096675-0256-4313-9af5-5f7ddeea7d95 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:24.653504 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f802dc3c-a3a9-4714-96f9-2c741661479a tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297" status: 200 len: 1243 microversion: 2.1 time: 0.203281 Sep 17 21:00:24.654089 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1188/2446] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:24 2022] GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297 => generated 1243 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:24.660670 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ea16bd96-1ad1-4bfd-8488-55c0626b1ccb tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:24.661558 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ea16bd96-1ad1-4bfd-8488-55c0626b1ccb tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:24.696604 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea16bd96-1ad1-4bfd-8488-55c0626b1ccb tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:24.696604 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea16bd96-1ad1-4bfd-8488-55c0626b1ccb tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:24.696604 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea16bd96-1ad1-4bfd-8488-55c0626b1ccb tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:24.698091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea16bd96-1ad1-4bfd-8488-55c0626b1ccb tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:24.699034 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea16bd96-1ad1-4bfd-8488-55c0626b1ccb tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:24.702200 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea16bd96-1ad1-4bfd-8488-55c0626b1ccb tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:25.077889 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-09096675-0256-4313-9af5-5f7ddeea7d95 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:25.087443 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-09096675-0256-4313-9af5-5f7ddeea7d95 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1471 microversion: 2.1 time: 0.478590 Sep 17 21:00:25.101631 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1259/2447] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:24 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1471 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:25.116016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4ccd28a9-bfe4-4819-b09e-0692933dee7b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:25.117584 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4ccd28a9-bfe4-4819-b09e-0692933dee7b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 526330e7-cd66-44c3-9453-ea80479469a8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:25.118874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ea16bd96-1ad1-4bfd-8488-55c0626b1ccb tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:25.127636 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ccd28a9-bfe4-4819-b09e-0692933dee7b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:25.128662 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ea16bd96-1ad1-4bfd-8488-55c0626b1ccb tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1" status: 200 len: 1520 microversion: 2.1 time: 0.473337 Sep 17 21:00:25.129540 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ccd28a9-bfe4-4819-b09e-0692933dee7b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:25.131537 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ccd28a9-bfe4-4819-b09e-0692933dee7b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:25.132455 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ccd28a9-bfe4-4819-b09e-0692933dee7b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:25.133057 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ccd28a9-bfe4-4819-b09e-0692933dee7b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:25.133697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ccd28a9-bfe4-4819-b09e-0692933dee7b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:25.137010 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1189/2448] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:24 2022] GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 => generated 1520 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:25.156321 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-da9ea6b4-6ca7-430f-a4b5-cba970f6e54f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:25.156974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-da9ea6b4-6ca7-430f-a4b5-cba970f6e54f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:25.178804 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da9ea6b4-6ca7-430f-a4b5-cba970f6e54f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:25.179345 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da9ea6b4-6ca7-430f-a4b5-cba970f6e54f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:25.179784 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da9ea6b4-6ca7-430f-a4b5-cba970f6e54f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:25.180513 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da9ea6b4-6ca7-430f-a4b5-cba970f6e54f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:25.180962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da9ea6b4-6ca7-430f-a4b5-cba970f6e54f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:25.181393 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da9ea6b4-6ca7-430f-a4b5-cba970f6e54f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:25.528760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4ccd28a9-bfe4-4819-b09e-0692933dee7b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:25.544439 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4ccd28a9-bfe4-4819-b09e-0692933dee7b tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/526330e7-cd66-44c3-9453-ea80479469a8" status: 200 len: 1518 microversion: 2.1 time: 0.440111 Sep 17 21:00:25.545770 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1260/2449] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:25 2022] GET /compute/v2.1/servers/526330e7-cd66-44c3-9453-ea80479469a8 => generated 1518 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:25.550929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-610c4b3e-92ba-4623-82a0-b1bac5666a73 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:25.558273 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-610c4b3e-92ba-4623-82a0-b1bac5666a73 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 04b100b4-eb98-4ee9-8897-6d25697d2d71] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:25.567386 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-610c4b3e-92ba-4623-82a0-b1bac5666a73 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:25.571648 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-610c4b3e-92ba-4623-82a0-b1bac5666a73 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:25.572364 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-610c4b3e-92ba-4623-82a0-b1bac5666a73 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:25.573398 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-610c4b3e-92ba-4623-82a0-b1bac5666a73 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:25.577550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-610c4b3e-92ba-4623-82a0-b1bac5666a73 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:25.578226 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-610c4b3e-92ba-4623-82a0-b1bac5666a73 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:25.660278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-da9ea6b4-6ca7-430f-a4b5-cba970f6e54f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:25.671453 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-da9ea6b4-6ca7-430f-a4b5-cba970f6e54f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1" status: 200 len: 1520 microversion: 2.1 time: 0.517265 Sep 17 21:00:25.685493 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1190/2450] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:25 2022] GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 => generated 1520 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:25.690786 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c79877a7-41ad-4f2a-9afa-21a66de4bb7e tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:25.691765 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c79877a7-41ad-4f2a-9afa-21a66de4bb7e tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:25.703669 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c79877a7-41ad-4f2a-9afa-21a66de4bb7e tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:25.704488 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c79877a7-41ad-4f2a-9afa-21a66de4bb7e tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:25.705364 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c79877a7-41ad-4f2a-9afa-21a66de4bb7e tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:25.706418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c79877a7-41ad-4f2a-9afa-21a66de4bb7e tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:25.707095 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c79877a7-41ad-4f2a-9afa-21a66de4bb7e tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:25.707833 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c79877a7-41ad-4f2a-9afa-21a66de4bb7e tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:25.748278 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-610c4b3e-92ba-4623-82a0-b1bac5666a73 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:25.757692 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-610c4b3e-92ba-4623-82a0-b1bac5666a73 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71" status: 200 len: 1430 microversion: 2.1 time: 0.210315 Sep 17 21:00:25.758885 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1261/2451] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:25 2022] GET /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71 => generated 1430 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:25.772777 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-8ab54020-2ed8-455a-8448-2af40fa30b47 req-29e28fe5-30ff-4bb1-a25e-f96066c88092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04b100b4-eb98-4ee9-8897-6d25697d2d71", "name": "network-vif-deleted", "tag": "24a034e1-4979-4b12-83a1-24ba4387e5b8"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:25.812498 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8ab54020-2ed8-455a-8448-2af40fa30b47 req-29e28fe5-30ff-4bb1-a25e-f96066c88092 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:25.814148 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8ab54020-2ed8-455a-8448-2af40fa30b47 req-29e28fe5-30ff-4bb1-a25e-f96066c88092 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:25.814666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8ab54020-2ed8-455a-8448-2af40fa30b47 req-29e28fe5-30ff-4bb1-a25e-f96066c88092 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:25.845264 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-8ab54020-2ed8-455a-8448-2af40fa30b47 req-29e28fe5-30ff-4bb1-a25e-f96066c88092 service nova] Creating event network-vif-deleted:24a034e1-4979-4b12-83a1-24ba4387e5b8 for instance 04b100b4-eb98-4ee9-8897-6d25697d2d71 on nch1-master-1 Sep 17 21:00:25.858355 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-8ab54020-2ed8-455a-8448-2af40fa30b47 req-29e28fe5-30ff-4bb1-a25e-f96066c88092 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095719 Sep 17 21:00:25.861500 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1262/2452] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:25.874834 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c3fa1303-e465-43e9-b860-4e410a52ebf7 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:25.878866 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c3fa1303-e465-43e9-b860-4e410a52ebf7 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:25.888541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3fa1303-e465-43e9-b860-4e410a52ebf7 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:25.889078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3fa1303-e465-43e9-b860-4e410a52ebf7 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:25.889614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3fa1303-e465-43e9-b860-4e410a52ebf7 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:25.890617 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3fa1303-e465-43e9-b860-4e410a52ebf7 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:25.890956 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3fa1303-e465-43e9-b860-4e410a52ebf7 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:25.891450 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3fa1303-e465-43e9-b860-4e410a52ebf7 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:26.052369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c3fa1303-e465-43e9-b860-4e410a52ebf7 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5d41f7e95d44d3898f6306bb093ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8813aaee4604882b4cd7a2a8df58077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:26.065230 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c3fa1303-e465-43e9-b860-4e410a52ebf7 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297" status: 200 len: 1247 microversion: 2.1 time: 0.203101 Sep 17 21:00:26.077496 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1263/2453] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:25 2022] GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297 => generated 1247 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:26.086771 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3ba19087-98c9-4c5b-879d-3c2aa8540513 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1520644067", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3ba19087-98c9-4c5b-879d-3c2aa8540513 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Request method failure captured: Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1/action HTTP/1.1 Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 619 Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjVSncfbAtgCIyToozPzw5wAkwJ8A5Pq3oENCAdqUUIYA48iSRlVG7zkjE71pODQ7Vq39Whu62dN5SwPbwvIXMyuqDiapFCgUkVVyC-O5o-Rbhev8SZVJvwjqio0qc_eiz6AU5vzIes11QJweqLBoCqKJfa2-0GqtVV9pkib7fT-OL0 Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 004f77fba4b14080bca4ae36c857add3 Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_004f77fba4b14080bca4ae36c857add3", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 004f77fba4b14080bca4ae36c857add3 Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ImagesOneServerNegativeTestJSON-622753367-project Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 22306a93c9404db393b92a267d6258d4 Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-622753367-project Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1520644067", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1520644067', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 21:00:26.092036 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise error Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 17 21:00:26.099957 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:26.102314 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3ba19087-98c9-4c5b-879d-3c2aa8540513 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:00:26.102314 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3ba19087-98c9-4c5b-879d-3c2aa8540513 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "POST /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1/action" status: 400 len: 938 microversion: 2.1 time: 0.023870 Sep 17 21:00:26.106434 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1264/2454] 10.222.0.26 () {60 vars in 1279 bytes} [Sat Sep 17 21:00:26 2022] POST /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1/action => generated 938 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:00:26.284031 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c79877a7-41ad-4f2a-9afa-21a66de4bb7e tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:26.323549 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c79877a7-41ad-4f2a-9afa-21a66de4bb7e tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1524 microversion: 2.1 time: 0.644855 Sep 17 21:00:26.324918 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1191/2455] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:25 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1524 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:26.342970 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-06c064ac-456f-4fad-8caf-c63185bd1835 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:26.348472 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-06c064ac-456f-4fad-8caf-c63185bd1835 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:26.362551 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06c064ac-456f-4fad-8caf-c63185bd1835 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:26.364528 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06c064ac-456f-4fad-8caf-c63185bd1835 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:26.365391 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06c064ac-456f-4fad-8caf-c63185bd1835 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:26.367438 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06c064ac-456f-4fad-8caf-c63185bd1835 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:26.368353 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06c064ac-456f-4fad-8caf-c63185bd1835 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:26.369253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06c064ac-456f-4fad-8caf-c63185bd1835 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:26.588019 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-98c80d17-bbd8-45f1-a875-518656b85c2a tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:26.588875 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-98c80d17-bbd8-45f1-a875-518656b85c2a tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:26.605181 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-98c80d17-bbd8-45f1-a875-518656b85c2a tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:26.605621 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-98c80d17-bbd8-45f1-a875-518656b85c2a tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:26.606065 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-98c80d17-bbd8-45f1-a875-518656b85c2a tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:26.606795 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-98c80d17-bbd8-45f1-a875-518656b85c2a tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:26.607255 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-98c80d17-bbd8-45f1-a875-518656b85c2a tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:26.614933 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-98c80d17-bbd8-45f1-a875-518656b85c2a tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:26.703581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-98c80d17-bbd8-45f1-a875-518656b85c2a tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:00:26.922942 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-98c80d17-bbd8-45f1-a875-518656b85c2a tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "DELETE /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 204 len: 0 microversion: 2.32 time: 0.818643 Sep 17 21:00:26.928630 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1265/2456] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 17 21:00:26 2022] DELETE /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 0 bytes in 822 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 21:00:26.934284 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-70c68f27-e773-4d8a-b6be-560a3c9a8bbc tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:26.935007 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-70c68f27-e773-4d8a-b6be-560a3c9a8bbc tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:26.976978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-70c68f27-e773-4d8a-b6be-560a3c9a8bbc tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:26.977565 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-70c68f27-e773-4d8a-b6be-560a3c9a8bbc tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:26.978970 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-70c68f27-e773-4d8a-b6be-560a3c9a8bbc tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:26.978970 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-70c68f27-e773-4d8a-b6be-560a3c9a8bbc tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:26.979697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-70c68f27-e773-4d8a-b6be-560a3c9a8bbc tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:26.989956 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-70c68f27-e773-4d8a-b6be-560a3c9a8bbc tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:27.169953 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-06c064ac-456f-4fad-8caf-c63185bd1835 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:27.211307 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-06c064ac-456f-4fad-8caf-c63185bd1835 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1" status: 200 len: 1520 microversion: 2.1 time: 0.861298 Sep 17 21:00:27.212017 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1192/2457] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:26 2022] GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 => generated 1520 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:27.228488 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c2b9aab0-cf07-48a1-b9e2-cdaf27f6b340 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:27.229107 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c2b9aab0-cf07-48a1-b9e2-cdaf27f6b340 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 526330e7-cd66-44c3-9453-ea80479469a8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:27.274854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c2b9aab0-cf07-48a1-b9e2-cdaf27f6b340 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:27.281756 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c2b9aab0-cf07-48a1-b9e2-cdaf27f6b340 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:27.282227 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c2b9aab0-cf07-48a1-b9e2-cdaf27f6b340 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:27.286395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c2b9aab0-cf07-48a1-b9e2-cdaf27f6b340 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:27.286889 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c2b9aab0-cf07-48a1-b9e2-cdaf27f6b340 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:27.287331 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c2b9aab0-cf07-48a1-b9e2-cdaf27f6b340 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:27.364936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-70c68f27-e773-4d8a-b6be-560a3c9a8bbc tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:27.380192 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-70c68f27-e773-4d8a-b6be-560a3c9a8bbc tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1471 microversion: 2.1 time: 0.450157 Sep 17 21:00:27.380966 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1266/2458] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:26 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1471 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:27.391451 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7af5d61f-90af-45cf-bc48-d19e016ef15d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:27.392456 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7af5d61f-90af-45cf-bc48-d19e016ef15d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 04b100b4-eb98-4ee9-8897-6d25697d2d71] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:27.407011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7af5d61f-90af-45cf-bc48-d19e016ef15d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:27.409120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7af5d61f-90af-45cf-bc48-d19e016ef15d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:27.409837 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7af5d61f-90af-45cf-bc48-d19e016ef15d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:27.410800 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7af5d61f-90af-45cf-bc48-d19e016ef15d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:27.411474 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7af5d61f-90af-45cf-bc48-d19e016ef15d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:27.412136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7af5d61f-90af-45cf-bc48-d19e016ef15d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:27.442005 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-7af5d61f-90af-45cf-bc48-d19e016ef15d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] HTTP exception thrown: Instance 04b100b4-eb98-4ee9-8897-6d25697d2d71 could not be found. Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7af5d61f-90af-45cf-bc48-d19e016ef15d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Request method failure captured: Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71 HTTP/1.1 Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjS1i9XeXSkLU6roIN5-V3M30sbhgULjb8tr8aqExkSAIyZY9VKN0LPVRHnETO5tqunffII5qByrOP0geSwUSYjLFCPdfmPpZzaRnm983vzvqA4kLyBsVXOUYx3Hwv-cKGIwQNFiYUDPza0sBrWpmIqLZCr0r7WnWtNySplD0X_QBe4 Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 3515123097e744ef855ef1129fb59cf1 Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersOnMultiNodesTest-277737609 Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3515123097e744ef855ef1129fb59cf1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3515123097e744ef855ef1129fb59cf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3515123097e744ef855ef1129fb59cf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3515123097e744ef855ef1129fb59cf1", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersOnMultiNodesTest-277737609 Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 3515123097e744ef855ef1129fb59cf1 Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-277737609 Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersOnMultiNodesTest-277737609-project Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 0d48260054d84784b89a52d9b766d7c1 Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersOnMultiNodesTest-277737609-project Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 04b100b4-eb98-4ee9-8897-6d25697d2d71 could not be found. Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '04b100b4-eb98-4ee9-8897-6d25697d2d71'} Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04b100b4-eb98-4ee9-8897-6d25697d2d71 could not be found. Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04b100b4-eb98-4ee9-8897-6d25697d2d71 could not be found. Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:00:27.444316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:27.450441 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:27.450441 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:00:27.450441 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:00:27.450441 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:00:27.450441 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:00:27.450441 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04b100b4-eb98-4ee9-8897-6d25697d2d71 could not be found. Sep 17 21:00:27.450441 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:27.452270 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7af5d61f-90af-45cf-bc48-d19e016ef15d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Returning 404 to user: Instance 04b100b4-eb98-4ee9-8897-6d25697d2d71 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:00:27.453360 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7af5d61f-90af-45cf-bc48-d19e016ef15d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71" status: 404 len: 111 microversion: 2.1 time: 0.071181 Sep 17 21:00:27.454335 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1267/2459] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:27 2022] GET /compute/v2.1/servers/04b100b4-eb98-4ee9-8897-6d25697d2d71 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:00:27.459327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-14a35b0f-bb6d-453d-b690-9ca885130b9b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:27.460302 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-14a35b0f-bb6d-453d-b690-9ca885130b9b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:27.472021 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14a35b0f-bb6d-453d-b690-9ca885130b9b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:27.472768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14a35b0f-bb6d-453d-b690-9ca885130b9b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:27.473417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14a35b0f-bb6d-453d-b690-9ca885130b9b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:27.475695 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14a35b0f-bb6d-453d-b690-9ca885130b9b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:27.476457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14a35b0f-bb6d-453d-b690-9ca885130b9b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:27.477101 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14a35b0f-bb6d-453d-b690-9ca885130b9b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:27.621249 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c2b9aab0-cf07-48a1-b9e2-cdaf27f6b340 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:27.632127 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c2b9aab0-cf07-48a1-b9e2-cdaf27f6b340 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/526330e7-cd66-44c3-9453-ea80479469a8" status: 200 len: 1518 microversion: 2.1 time: 0.419001 Sep 17 21:00:27.632727 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1193/2460] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:27 2022] GET /compute/v2.1/servers/526330e7-cd66-44c3-9453-ea80479469a8 => generated 1518 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:27.655290 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8154d30e-d60a-4d9a-87ca-309554d2c25e tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:27.656172 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8154d30e-d60a-4d9a-87ca-309554d2c25e tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:27.667411 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8154d30e-d60a-4d9a-87ca-309554d2c25e tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:27.668264 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8154d30e-d60a-4d9a-87ca-309554d2c25e tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:27.668921 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8154d30e-d60a-4d9a-87ca-309554d2c25e tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:27.669928 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8154d30e-d60a-4d9a-87ca-309554d2c25e tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:27.670598 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8154d30e-d60a-4d9a-87ca-309554d2c25e tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:27.671376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8154d30e-d60a-4d9a-87ca-309554d2c25e tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:27.838766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8154d30e-d60a-4d9a-87ca-309554d2c25e tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5d41f7e95d44d3898f6306bb093ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8813aaee4604882b4cd7a2a8df58077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:27.848321 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8154d30e-d60a-4d9a-87ca-309554d2c25e tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297" status: 200 len: 1295 microversion: 2.1 time: 0.196921 Sep 17 21:00:27.849039 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1194/2461] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:27 2022] GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297 => generated 1295 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:27.858614 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5b552eb8-86a3-47ce-9d07-7a3aafaf2cd3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:27.859320 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5b552eb8-86a3-47ce-9d07-7a3aafaf2cd3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:27.866021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b552eb8-86a3-47ce-9d07-7a3aafaf2cd3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:27.867367 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b552eb8-86a3-47ce-9d07-7a3aafaf2cd3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:27.868091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b552eb8-86a3-47ce-9d07-7a3aafaf2cd3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:27.869078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b552eb8-86a3-47ce-9d07-7a3aafaf2cd3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:27.872418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b552eb8-86a3-47ce-9d07-7a3aafaf2cd3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:27.872937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b552eb8-86a3-47ce-9d07-7a3aafaf2cd3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:27.980857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-14a35b0f-bb6d-453d-b690-9ca885130b9b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:27.992110 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-14a35b0f-bb6d-453d-b690-9ca885130b9b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:28.008383 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-14a35b0f-bb6d-453d-b690-9ca885130b9b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:28.015303 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-14a35b0f-bb6d-453d-b690-9ca885130b9b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 2956 microversion: 2.32 time: 0.554817 Sep 17 21:00:28.016411 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1268/2462] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:00:27 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 2956 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:00:28.032429 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-430e0298-13b0-4636-95ec-34f80d471baa tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:28.037045 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-430e0298-13b0-4636-95ec-34f80d471baa tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:28.064670 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-430e0298-13b0-4636-95ec-34f80d471baa tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:28.066702 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-430e0298-13b0-4636-95ec-34f80d471baa tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:28.067368 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-430e0298-13b0-4636-95ec-34f80d471baa tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:28.068321 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-430e0298-13b0-4636-95ec-34f80d471baa tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:28.070054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-430e0298-13b0-4636-95ec-34f80d471baa tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:28.071902 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-430e0298-13b0-4636-95ec-34f80d471baa tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:28.156547 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:28.253949 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=22 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:28.418021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5b552eb8-86a3-47ce-9d07-7a3aafaf2cd3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:28.434371 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5b552eb8-86a3-47ce-9d07-7a3aafaf2cd3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1" status: 200 len: 1520 microversion: 2.1 time: 0.583684 Sep 17 21:00:28.434910 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1195/2463] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:27 2022] GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 => generated 1520 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:28.459448 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8ae372a2-a93a-4a9f-84b6-71a494ba1ee2 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:28.468083 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8ae372a2-a93a-4a9f-84b6-71a494ba1ee2 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 1d44abe5-d50f-4f59-83fd-65376778153a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:28.505602 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ae372a2-a93a-4a9f-84b6-71a494ba1ee2 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:28.508068 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ae372a2-a93a-4a9f-84b6-71a494ba1ee2 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:28.511663 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ae372a2-a93a-4a9f-84b6-71a494ba1ee2 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:28.513392 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ae372a2-a93a-4a9f-84b6-71a494ba1ee2 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:28.522983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ae372a2-a93a-4a9f-84b6-71a494ba1ee2 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:28.523448 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ae372a2-a93a-4a9f-84b6-71a494ba1ee2 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:28.524787 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-430e0298-13b0-4636-95ec-34f80d471baa tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:28.536702 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-430e0298-13b0-4636-95ec-34f80d471baa tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1524 microversion: 2.1 time: 0.519059 Sep 17 21:00:28.558538 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1269/2464] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:28 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1524 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:28.566385 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-f65df248-6448-4734-bfb5-0fffe01af419 req-7a25c26c-a61a-498d-a3bd-73f3ca8ffa3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "526330e7-cd66-44c3-9453-ea80479469a8", "name": "network-vif-deleted", "tag": "c93203a9-6cc3-4130-9503-a63df25cd048"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:28.581385 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8ae372a2-a93a-4a9f-84b6-71a494ba1ee2 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 1d44abe5-d50f-4f59-83fd-65376778153a] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:00:28.640652 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f65df248-6448-4734-bfb5-0fffe01af419 req-7a25c26c-a61a-498d-a3bd-73f3ca8ffa3f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:28.641250 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f65df248-6448-4734-bfb5-0fffe01af419 req-7a25c26c-a61a-498d-a3bd-73f3ca8ffa3f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:28.642428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f65df248-6448-4734-bfb5-0fffe01af419 req-7a25c26c-a61a-498d-a3bd-73f3ca8ffa3f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:28.678177 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-f65df248-6448-4734-bfb5-0fffe01af419 req-7a25c26c-a61a-498d-a3bd-73f3ca8ffa3f service nova] Creating event network-vif-deleted:c93203a9-6cc3-4130-9503-a63df25cd048 for instance 526330e7-cd66-44c3-9453-ea80479469a8 on nch2-master-1 Sep 17 21:00:28.708261 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-f65df248-6448-4734-bfb5-0fffe01af419 req-7a25c26c-a61a-498d-a3bd-73f3ca8ffa3f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151395 Sep 17 21:00:28.712716 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8ae372a2-a93a-4a9f-84b6-71a494ba1ee2 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a" status: 204 len: 0 microversion: 2.1 time: 0.259997 Sep 17 21:00:28.716050 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1196/2465] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:00:28 2022] DELETE /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:00:28.718020 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1270/2466] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:28.732953 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-80541d31-ab0d-453b-9db4-099174fce08a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:28.735799 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-80541d31-ab0d-453b-9db4-099174fce08a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:28.739134 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8482e739-3487-46f9-ac06-58aa5a81f607 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8482e739-3487-46f9-ac06-58aa5a81f607 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Request method failure captured: Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1/action HTTP/1.1 Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 285 Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjVSncfbAtgCIyToozPzw5wAkwJ8A5Pq3oENCAdqUUIYA48iSRlVG7zkjE71pODQ7Vq39Whu62dN5SwPbwvIXMyuqDiapFCgUkVVyC-O5o-Rbhev8SZVJvwjqio0qc_eiz6AU5vzIes11QJweqLBoCqKJfa2-0GqtVV9pkib7fT-OL0 Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 004f77fba4b14080bca4ae36c857add3 Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_004f77fba4b14080bca4ae36c857add3", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 004f77fba4b14080bca4ae36c857add3 Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ImagesOneServerNegativeTestJSON-622753367-project Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 22306a93c9404db393b92a267d6258d4 Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-622753367-project Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise error Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:28.743499 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:28.746614 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:00:28.746614 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:00:28.746614 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:00:28.746614 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:00:28.746614 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:00:28.746614 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:00:28.746614 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:00:28.746614 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:00:28.746614 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 21:00:28.746614 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 21:00:28.746614 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 21:00:28.746614 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 21:00:28.746614 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 21:00:28.746614 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 21:00:28.746614 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 17 21:00:28.746614 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:28.746614 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:00:28.746614 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:28.746614 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:28.746614 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:00:28.746614 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:00:28.746614 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 21:00:28.746614 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 21:00:28.746614 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 17 21:00:28.746614 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:28.749645 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-80541d31-ab0d-453b-9db4-099174fce08a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:28.750211 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-80541d31-ab0d-453b-9db4-099174fce08a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:28.750667 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-80541d31-ab0d-453b-9db4-099174fce08a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:28.751405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-80541d31-ab0d-453b-9db4-099174fce08a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:28.751870 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-80541d31-ab0d-453b-9db4-099174fce08a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:28.754588 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-80541d31-ab0d-453b-9db4-099174fce08a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:28.762202 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8482e739-3487-46f9-ac06-58aa5a81f607 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:00:28.763821 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8482e739-3487-46f9-ac06-58aa5a81f607 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "POST /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1/action" status: 400 len: 619 microversion: 2.1 time: 0.042634 Sep 17 21:00:28.765034 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1271/2467] 10.222.0.26 () {60 vars in 1279 bytes} [Sat Sep 17 21:00:28 2022] POST /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1/action => generated 619 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:00:28.782618 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-dafd6ff6-1f58-4e5e-af6a-1dc452dfda31 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:28.784083 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-dafd6ff6-1f58-4e5e-af6a-1dc452dfda31 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 526330e7-cd66-44c3-9453-ea80479469a8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:28.802915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dafd6ff6-1f58-4e5e-af6a-1dc452dfda31 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:28.803836 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dafd6ff6-1f58-4e5e-af6a-1dc452dfda31 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:28.804656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dafd6ff6-1f58-4e5e-af6a-1dc452dfda31 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:28.805697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dafd6ff6-1f58-4e5e-af6a-1dc452dfda31 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:28.806616 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dafd6ff6-1f58-4e5e-af6a-1dc452dfda31 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:28.807329 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dafd6ff6-1f58-4e5e-af6a-1dc452dfda31 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:28.999484 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-dafd6ff6-1f58-4e5e-af6a-1dc452dfda31 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:29.015910 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-dafd6ff6-1f58-4e5e-af6a-1dc452dfda31 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/526330e7-cd66-44c3-9453-ea80479469a8" status: 200 len: 1476 microversion: 2.1 time: 0.248337 Sep 17 21:00:29.018434 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1272/2468] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:28 2022] GET /compute/v2.1/servers/526330e7-cd66-44c3-9453-ea80479469a8 => generated 1476 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:29.030573 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-483cda78-e13b-44c1-b9db-f8d3933c433e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:29.033577 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-483cda78-e13b-44c1-b9db-f8d3933c433e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 1d44abe5-d50f-4f59-83fd-65376778153a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:29.047582 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-80541d31-ab0d-453b-9db4-099174fce08a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:29.050997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-483cda78-e13b-44c1-b9db-f8d3933c433e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:29.051518 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-483cda78-e13b-44c1-b9db-f8d3933c433e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:29.053124 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-483cda78-e13b-44c1-b9db-f8d3933c433e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:29.056968 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-483cda78-e13b-44c1-b9db-f8d3933c433e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:29.058240 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-483cda78-e13b-44c1-b9db-f8d3933c433e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:29.061858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-483cda78-e13b-44c1-b9db-f8d3933c433e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:29.062664 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-80541d31-ab0d-453b-9db4-099174fce08a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1471 microversion: 2.1 time: 0.342933 Sep 17 21:00:29.074045 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1197/2469] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:28 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1471 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:29.084762 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d9e76108-3173-4cc7-8735-44a7286d11cd tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:29.091720 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d9e76108-3173-4cc7-8735-44a7286d11cd tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:29.105752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d9e76108-3173-4cc7-8735-44a7286d11cd tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:29.106621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d9e76108-3173-4cc7-8735-44a7286d11cd tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:29.107286 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d9e76108-3173-4cc7-8735-44a7286d11cd tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:29.114576 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d9e76108-3173-4cc7-8735-44a7286d11cd tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:29.115456 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d9e76108-3173-4cc7-8735-44a7286d11cd tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:29.116279 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d9e76108-3173-4cc7-8735-44a7286d11cd tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:29.473563 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-483cda78-e13b-44c1-b9db-f8d3933c433e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:29.485197 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-483cda78-e13b-44c1-b9db-f8d3933c433e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a" status: 200 len: 1472 microversion: 2.1 time: 0.464864 Sep 17 21:00:29.486016 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1273/2470] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:29 2022] GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a => generated 1472 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:29.495990 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6cbe1775-0b3c-40d5-8005-18ec6beac5bd tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:29.496508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6cbe1775-0b3c-40d5-8005-18ec6beac5bd tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:29.516058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6cbe1775-0b3c-40d5-8005-18ec6beac5bd tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:29.516744 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6cbe1775-0b3c-40d5-8005-18ec6beac5bd tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:29.518201 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6cbe1775-0b3c-40d5-8005-18ec6beac5bd tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:29.521596 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6cbe1775-0b3c-40d5-8005-18ec6beac5bd tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:29.522097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6cbe1775-0b3c-40d5-8005-18ec6beac5bd tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:29.522779 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6cbe1775-0b3c-40d5-8005-18ec6beac5bd tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:29.535635 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d9e76108-3173-4cc7-8735-44a7286d11cd tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:29.544741 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d9e76108-3173-4cc7-8735-44a7286d11cd tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1" status: 200 len: 1520 microversion: 2.1 time: 0.469256 Sep 17 21:00:29.545669 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1198/2471] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:29 2022] GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 => generated 1520 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:29.550370 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d026b1c9-538b-4253-960b-c65f8d416be8 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:29.551708 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d026b1c9-538b-4253-960b-c65f8d416be8 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:29.562566 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d026b1c9-538b-4253-960b-c65f8d416be8 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:29.562566 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d026b1c9-538b-4253-960b-c65f8d416be8 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:29.562830 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d026b1c9-538b-4253-960b-c65f8d416be8 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:29.563446 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d026b1c9-538b-4253-960b-c65f8d416be8 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:29.563975 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d026b1c9-538b-4253-960b-c65f8d416be8 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:29.564404 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d026b1c9-538b-4253-960b-c65f8d416be8 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:29.658619 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6cbe1775-0b3c-40d5-8005-18ec6beac5bd tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5d41f7e95d44d3898f6306bb093ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8813aaee4604882b4cd7a2a8df58077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:29.666770 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6cbe1775-0b3c-40d5-8005-18ec6beac5bd tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297" status: 200 len: 1295 microversion: 2.1 time: 0.179816 Sep 17 21:00:29.682815 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1274/2472] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:29 2022] GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297 => generated 1295 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:29.693172 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1c92462e-c45c-4ca8-af91-049ba98bfa69 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:29.693930 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1c92462e-c45c-4ca8-af91-049ba98bfa69 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:29.702330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c92462e-c45c-4ca8-af91-049ba98bfa69 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:29.703476 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c92462e-c45c-4ca8-af91-049ba98bfa69 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:29.703932 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c92462e-c45c-4ca8-af91-049ba98bfa69 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:29.704684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c92462e-c45c-4ca8-af91-049ba98bfa69 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:29.705112 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c92462e-c45c-4ca8-af91-049ba98bfa69 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:29.705577 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c92462e-c45c-4ca8-af91-049ba98bfa69 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:29.937851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d026b1c9-538b-4253-960b-c65f8d416be8 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:29.949392 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d026b1c9-538b-4253-960b-c65f8d416be8 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:29.951645 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d026b1c9-538b-4253-960b-c65f8d416be8 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:29.956549 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1c92462e-c45c-4ca8-af91-049ba98bfa69 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:29.965712 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d026b1c9-538b-4253-960b-c65f8d416be8 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 2956 microversion: 2.32 time: 0.418785 Sep 17 21:00:29.971725 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1199/2473] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:00:29 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 2956 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:00:29.973351 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1c92462e-c45c-4ca8-af91-049ba98bfa69 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1524 microversion: 2.1 time: 0.284280 Sep 17 21:00:29.992370 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1275/2474] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:29 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1524 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:29.995167 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2911f292-7c5d-4ee0-b951-049253475ad3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:29.995888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2911f292-7c5d-4ee0-b951-049253475ad3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:30.003048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2911f292-7c5d-4ee0-b951-049253475ad3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:30.003574 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2911f292-7c5d-4ee0-b951-049253475ad3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:30.004021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2911f292-7c5d-4ee0-b951-049253475ad3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:30.004758 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2911f292-7c5d-4ee0-b951-049253475ad3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:30.005215 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2911f292-7c5d-4ee0-b951-049253475ad3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:30.005700 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2911f292-7c5d-4ee0-b951-049253475ad3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:30.040828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3a21469d-9816-44d2-b2c5-e2702c16f1eb tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:30.041582 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3a21469d-9816-44d2-b2c5-e2702c16f1eb tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 526330e7-cd66-44c3-9453-ea80479469a8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:30.058803 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a21469d-9816-44d2-b2c5-e2702c16f1eb tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:30.059411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a21469d-9816-44d2-b2c5-e2702c16f1eb tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:30.060074 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a21469d-9816-44d2-b2c5-e2702c16f1eb tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:30.060879 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a21469d-9816-44d2-b2c5-e2702c16f1eb tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:30.061496 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a21469d-9816-44d2-b2c5-e2702c16f1eb tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:30.062000 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a21469d-9816-44d2-b2c5-e2702c16f1eb tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:30.179261 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3a21469d-9816-44d2-b2c5-e2702c16f1eb tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:30.187349 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3a21469d-9816-44d2-b2c5-e2702c16f1eb tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/526330e7-cd66-44c3-9453-ea80479469a8" status: 200 len: 1305 microversion: 2.1 time: 0.150632 Sep 17 21:00:30.201726 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1276/2475] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:30 2022] GET /compute/v2.1/servers/526330e7-cd66-44c3-9453-ea80479469a8 => generated 1305 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:30.201726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-12ee3759-773d-418f-8cfd-806037cd031a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:30.206720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-12ee3759-773d-418f-8cfd-806037cd031a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:30.221327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12ee3759-773d-418f-8cfd-806037cd031a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:30.222202 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12ee3759-773d-418f-8cfd-806037cd031a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:30.222679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12ee3759-773d-418f-8cfd-806037cd031a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:30.223553 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12ee3759-773d-418f-8cfd-806037cd031a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:30.224042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12ee3759-773d-418f-8cfd-806037cd031a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:30.224500 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12ee3759-773d-418f-8cfd-806037cd031a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:30.323881 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2911f292-7c5d-4ee0-b951-049253475ad3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:30.341916 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2911f292-7c5d-4ee0-b951-049253475ad3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1" status: 200 len: 1520 microversion: 2.1 time: 0.369115 Sep 17 21:00:30.344178 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1200/2476] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:29 2022] GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 => generated 1520 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:30.368988 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a5ffaaea-5a40-4341-8f00-6517f5347911 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-451753171"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:30.372361 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a5ffaaea-5a40-4341-8f00-6517f5347911 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:30.391519 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a5ffaaea-5a40-4341-8f00-6517f5347911 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:30.392301 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a5ffaaea-5a40-4341-8f00-6517f5347911 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:30.392924 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a5ffaaea-5a40-4341-8f00-6517f5347911 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:30.393909 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a5ffaaea-5a40-4341-8f00-6517f5347911 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:30.398779 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a5ffaaea-5a40-4341-8f00-6517f5347911 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:30.399483 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a5ffaaea-5a40-4341-8f00-6517f5347911 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:30.707683 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:30.736534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-12ee3759-773d-418f-8cfd-806037cd031a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:30.737345 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a5ffaaea-5a40-4341-8f00-6517f5347911 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "POST /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1/action" status: 202 len: 0 microversion: 2.1 time: 0.372654 Sep 17 21:00:30.738739 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1201/2477] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:00:30 2022] POST /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 17 21:00:30.746237 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-971a0b63-dbad-4d81-a3bd-fadc829a8e70 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:30.746425 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-12ee3759-773d-418f-8cfd-806037cd031a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1471 microversion: 2.1 time: 0.554169 Sep 17 21:00:30.747380 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-971a0b63-dbad-4d81-a3bd-fadc829a8e70 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 1d44abe5-d50f-4f59-83fd-65376778153a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:30.754504 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1277/2478] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:30 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1471 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:30.761277 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7a469214-5ddd-4ce5-a62a-279de6b0a80d tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:30.763719 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-971a0b63-dbad-4d81-a3bd-fadc829a8e70 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:30.766079 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-971a0b63-dbad-4d81-a3bd-fadc829a8e70 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:30.766543 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-971a0b63-dbad-4d81-a3bd-fadc829a8e70 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:30.767369 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-971a0b63-dbad-4d81-a3bd-fadc829a8e70 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:30.768082 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-971a0b63-dbad-4d81-a3bd-fadc829a8e70 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:30.768521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-971a0b63-dbad-4d81-a3bd-fadc829a8e70 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:30.779633 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7a469214-5ddd-4ce5-a62a-279de6b0a80d tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:30.792674 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a469214-5ddd-4ce5-a62a-279de6b0a80d tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:30.793186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a469214-5ddd-4ce5-a62a-279de6b0a80d tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:30.793672 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a469214-5ddd-4ce5-a62a-279de6b0a80d tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:30.794411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a469214-5ddd-4ce5-a62a-279de6b0a80d tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:30.801132 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a469214-5ddd-4ce5-a62a-279de6b0a80d tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:30.801706 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a469214-5ddd-4ce5-a62a-279de6b0a80d tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:30.902641 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7a469214-5ddd-4ce5-a62a-279de6b0a80d tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5d41f7e95d44d3898f6306bb093ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8813aaee4604882b4cd7a2a8df58077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:30.913692 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7a469214-5ddd-4ce5-a62a-279de6b0a80d tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297" status: 200 len: 1295 microversion: 2.1 time: 0.157576 Sep 17 21:00:30.915332 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1278/2479] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:30 2022] GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297 => generated 1295 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:30.922022 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e71f60b2-af65-4079-9377-b5e70114d5f5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1324440690"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:30.924542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e71f60b2-af65-4079-9377-b5e70114d5f5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:30.951399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e71f60b2-af65-4079-9377-b5e70114d5f5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:30.951900 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e71f60b2-af65-4079-9377-b5e70114d5f5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:30.952538 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e71f60b2-af65-4079-9377-b5e70114d5f5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:30.953280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e71f60b2-af65-4079-9377-b5e70114d5f5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:30.953868 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e71f60b2-af65-4079-9377-b5e70114d5f5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:30.954301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e71f60b2-af65-4079-9377-b5e70114d5f5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:30.996314 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-e71f60b2-af65-4079-9377-b5e70114d5f5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] HTTP exception thrown: Cannot 'createImage' instance 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 while it is in task_state image_snapshot_pending Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e71f60b2-af65-4079-9377-b5e70114d5f5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Request method failure captured: Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1/action HTTP/1.1 Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 85 Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjVSncfbAtgCIyToozPzw5wAkwJ8A5Pq3oENCAdqUUIYA48iSRlVG7zkjE71pODQ7Vq39Whu62dN5SwPbwvIXMyuqDiapFCgUkVVyC-O5o-Rbhev8SZVJvwjqio0qc_eiz6AU5vzIes11QJweqLBoCqKJfa2-0GqtVV9pkib7fT-OL0 Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 004f77fba4b14080bca4ae36c857add3 Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_004f77fba4b14080bca4ae36c857add3", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 004f77fba4b14080bca4ae36c857add3 Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ImagesOneServerNegativeTestJSON-622753367-project Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 22306a93c9404db393b92a267d6258d4 Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-622753367-project Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1324440690"}} Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: exception: Cannot 'createImage' instance 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 while it is in task_state image_snapshot_pending Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1324440690'}}} Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 17 21:00:31.000505 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 17 21:00:31.004738 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 while it is in task_state image_snapshot_pending Sep 17 21:00:31.004738 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:31.004738 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:00:31.004738 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:31.004738 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:31.004738 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:00:31.004738 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:00:31.004738 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:00:31.004738 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:00:31.004738 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 while it is in task_state image_snapshot_pending Sep 17 21:00:31.004738 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:31.006317 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e71f60b2-af65-4079-9377-b5e70114d5f5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Returning 409 to user: Cannot 'createImage' instance 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 while it is in task_state image_snapshot_pending {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:00:31.008745 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e71f60b2-af65-4079-9377-b5e70114d5f5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "POST /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1/action" status: 409 len: 167 microversion: 2.1 time: 0.090680 Sep 17 21:00:31.010782 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1279/2480] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:00:30 2022] POST /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1/action => generated 167 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 17 21:00:31.016017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-971a0b63-dbad-4d81-a3bd-fadc829a8e70 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:31.019494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-46939eeb-ccfa-414a-8803-1869624065e4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:31.024822 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-46939eeb-ccfa-414a-8803-1869624065e4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:31.032225 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-971a0b63-dbad-4d81-a3bd-fadc829a8e70 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a" status: 200 len: 1472 microversion: 2.1 time: 0.287948 Sep 17 21:00:31.045589 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1202/2481] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:30 2022] GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a => generated 1472 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:31.047200 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46939eeb-ccfa-414a-8803-1869624065e4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:31.047477 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-17277a1d-16d7-464a-8010-3bfb19a0ef95 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:31.050645 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46939eeb-ccfa-414a-8803-1869624065e4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:31.050645 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46939eeb-ccfa-414a-8803-1869624065e4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:31.050645 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46939eeb-ccfa-414a-8803-1869624065e4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:31.051665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46939eeb-ccfa-414a-8803-1869624065e4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:31.051665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46939eeb-ccfa-414a-8803-1869624065e4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:31.054419 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-17277a1d-16d7-464a-8010-3bfb19a0ef95 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:31.068660 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17277a1d-16d7-464a-8010-3bfb19a0ef95 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:31.069829 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17277a1d-16d7-464a-8010-3bfb19a0ef95 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:31.070478 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17277a1d-16d7-464a-8010-3bfb19a0ef95 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:31.071487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17277a1d-16d7-464a-8010-3bfb19a0ef95 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:31.072140 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17277a1d-16d7-464a-8010-3bfb19a0ef95 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:31.075004 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17277a1d-16d7-464a-8010-3bfb19a0ef95 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:31.781749 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-17277a1d-16d7-464a-8010-3bfb19a0ef95 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:31.791360 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-17277a1d-16d7-464a-8010-3bfb19a0ef95 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1506 microversion: 2.1 time: 0.754772 Sep 17 21:00:31.801854 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1203/2482] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:31 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1506 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:31.806190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-46939eeb-ccfa-414a-8803-1869624065e4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:31.808692 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-93dc8261-f662-4b7b-9d7b-391032e517c0 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '.version_select at 0x7f25a48d59d0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:31.818497 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-46939eeb-ccfa-414a-8803-1869624065e4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:31.820976 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-46939eeb-ccfa-414a-8803-1869624065e4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:31.822697 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-46939eeb-ccfa-414a-8803-1869624065e4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 2956 microversion: 2.32 time: 0.807657 Sep 17 21:00:31.860518 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1280/2483] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:00:31 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 2956 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:00:31.872373 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b42d87a4-3f42-485f-9ca1-47802f467c7f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:31.876158 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b42d87a4-3f42-485f-9ca1-47802f467c7f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 526330e7-cd66-44c3-9453-ea80479469a8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:31.890751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b42d87a4-3f42-485f-9ca1-47802f467c7f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:31.891740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b42d87a4-3f42-485f-9ca1-47802f467c7f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:31.892437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b42d87a4-3f42-485f-9ca1-47802f467c7f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:31.896202 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b42d87a4-3f42-485f-9ca1-47802f467c7f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:31.896946 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b42d87a4-3f42-485f-9ca1-47802f467c7f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:31.898909 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b42d87a4-3f42-485f-9ca1-47802f467c7f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:31.986085 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b42d87a4-3f42-485f-9ca1-47802f467c7f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:31.987122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b42d87a4-3f42-485f-9ca1-47802f467c7f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:31.989606 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b42d87a4-3f42-485f-9ca1-47802f467c7f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:31.991456 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-b42d87a4-3f42-485f-9ca1-47802f467c7f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lazy-loading 'fault' on Instance uuid 526330e7-cd66-44c3-9453-ea80479469a8 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:00:32.127492 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-93dc8261-f662-4b7b-9d7b-391032e517c0 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "DELETE /compute/v2.1/images/ae4642d4-1ac8-44fd-8a6f-1411934e28a2" status: 204 len: 0 microversion: 2.1 time: 0.322232 Sep 17 21:00:32.136709 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1204/2484] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:31 2022] DELETE /compute/v2.1/images/ae4642d4-1ac8-44fd-8a6f-1411934e28a2 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:00:32.142745 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b42d87a4-3f42-485f-9ca1-47802f467c7f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:32.156908 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-3076908e-9363-4c5c-8190-bee05b385e2b req-0ba75c56-8479-416d-ac23-aacbebe4a382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d44abe5-d50f-4f59-83fd-65376778153a", "name": "network-vif-unplugged", "status": "completed", "tag": "4ed5e734-5b30-4dff-a533-9bccd03f22ae"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:32.178529 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b42d87a4-3f42-485f-9ca1-47802f467c7f tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/526330e7-cd66-44c3-9453-ea80479469a8" status: 200 len: 1310 microversion: 2.1 time: 0.307628 Sep 17 21:00:32.181557 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1281/2485] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:31 2022] GET /compute/v2.1/servers/526330e7-cd66-44c3-9453-ea80479469a8 => generated 1310 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:32.248780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-08e4704b-86d0-476d-b476-f3666036121d tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:32.252861 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-08e4704b-86d0-476d-b476-f3666036121d tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:32.253501 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-3076908e-9363-4c5c-8190-bee05b385e2b req-0ba75c56-8479-416d-ac23-aacbebe4a382 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:32.258428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-3076908e-9363-4c5c-8190-bee05b385e2b req-0ba75c56-8479-416d-ac23-aacbebe4a382 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:32.260066 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-3076908e-9363-4c5c-8190-bee05b385e2b req-0ba75c56-8479-416d-ac23-aacbebe4a382 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:32.282159 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-08e4704b-86d0-476d-b476-f3666036121d tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:32.288995 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-08e4704b-86d0-476d-b476-f3666036121d tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:32.291210 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-08e4704b-86d0-476d-b476-f3666036121d tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:32.299946 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-08e4704b-86d0-476d-b476-f3666036121d tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:32.300864 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-08e4704b-86d0-476d-b476-f3666036121d tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:32.303751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-08e4704b-86d0-476d-b476-f3666036121d tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:32.323313 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-3076908e-9363-4c5c-8190-bee05b385e2b req-0ba75c56-8479-416d-ac23-aacbebe4a382 service nova] Creating event network-vif-unplugged:4ed5e734-5b30-4dff-a533-9bccd03f22ae for instance 1d44abe5-d50f-4f59-83fd-65376778153a on nch2-master-1 Sep 17 21:00:32.335789 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-3076908e-9363-4c5c-8190-bee05b385e2b req-0ba75c56-8479-416d-ac23-aacbebe4a382 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.190142 Sep 17 21:00:32.339055 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1205/2486] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:32.349316 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-112d624e-31e6-401f-8b16-e3fd452ff96b tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:32.359335 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-112d624e-31e6-401f-8b16-e3fd452ff96b tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:32.375365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-112d624e-31e6-401f-8b16-e3fd452ff96b tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:32.377288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-112d624e-31e6-401f-8b16-e3fd452ff96b tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:32.380472 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-112d624e-31e6-401f-8b16-e3fd452ff96b tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:32.381074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-112d624e-31e6-401f-8b16-e3fd452ff96b tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:32.381590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-112d624e-31e6-401f-8b16-e3fd452ff96b tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:32.382041 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-112d624e-31e6-401f-8b16-e3fd452ff96b tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:32.722235 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-112d624e-31e6-401f-8b16-e3fd452ff96b tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5d41f7e95d44d3898f6306bb093ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8813aaee4604882b4cd7a2a8df58077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:32.735698 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-112d624e-31e6-401f-8b16-e3fd452ff96b tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297" status: 200 len: 1301 microversion: 2.1 time: 0.395095 Sep 17 21:00:32.738907 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1206/2487] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:32 2022] GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297 => generated 1301 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:32.751863 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cbb6d1a7-beb1-4862-8c83-73f17dda7721 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:32.755198 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cbb6d1a7-beb1-4862-8c83-73f17dda7721 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 1d44abe5-d50f-4f59-83fd-65376778153a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:32.770468 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbb6d1a7-beb1-4862-8c83-73f17dda7721 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:32.771265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbb6d1a7-beb1-4862-8c83-73f17dda7721 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:32.774050 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbb6d1a7-beb1-4862-8c83-73f17dda7721 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:32.775942 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbb6d1a7-beb1-4862-8c83-73f17dda7721 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:32.778728 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbb6d1a7-beb1-4862-8c83-73f17dda7721 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:32.779415 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbb6d1a7-beb1-4862-8c83-73f17dda7721 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:33.596134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=18 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:33.708902 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cbb6d1a7-beb1-4862-8c83-73f17dda7721 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:33.717241 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cbb6d1a7-beb1-4862-8c83-73f17dda7721 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a" status: 200 len: 1430 microversion: 2.1 time: 0.977178 Sep 17 21:00:33.717839 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1207/2488] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:32 2022] GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a => generated 1430 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:33.731387 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-01e18a3a-26a8-469e-9ec4-68e56bb2c56d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:33.734433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-01e18a3a-26a8-469e-9ec4-68e56bb2c56d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:33.747158 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01e18a3a-26a8-469e-9ec4-68e56bb2c56d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:33.749994 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01e18a3a-26a8-469e-9ec4-68e56bb2c56d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:33.756961 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01e18a3a-26a8-469e-9ec4-68e56bb2c56d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:33.759855 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01e18a3a-26a8-469e-9ec4-68e56bb2c56d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:33.760590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01e18a3a-26a8-469e-9ec4-68e56bb2c56d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:33.764685 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01e18a3a-26a8-469e-9ec4-68e56bb2c56d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:33.803281 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-08e4704b-86d0-476d-b476-f3666036121d tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:33.812473 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-08e4704b-86d0-476d-b476-f3666036121d tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1471 microversion: 2.1 time: 1.629195 Sep 17 21:00:33.814932 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1282/2489] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:32 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1471 bytes in 1632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:33.820026 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-63e94bc5-5817-44b0-b836-ddcda9e4863f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:33.828436 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-63e94bc5-5817-44b0-b836-ddcda9e4863f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:33.841182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-63e94bc5-5817-44b0-b836-ddcda9e4863f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:33.845378 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-63e94bc5-5817-44b0-b836-ddcda9e4863f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:33.846042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-63e94bc5-5817-44b0-b836-ddcda9e4863f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:33.849367 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-63e94bc5-5817-44b0-b836-ddcda9e4863f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:33.850931 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-63e94bc5-5817-44b0-b836-ddcda9e4863f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:33.851564 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-63e94bc5-5817-44b0-b836-ddcda9e4863f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:34.270592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-63e94bc5-5817-44b0-b836-ddcda9e4863f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:34.279541 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-63e94bc5-5817-44b0-b836-ddcda9e4863f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1506 microversion: 2.1 time: 0.463184 Sep 17 21:00:34.280171 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1283/2490] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:33 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1506 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:34.312673 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-95c194d4-ba99-4b3e-b3b5-be0a371deb83 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:34.326486 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-95c194d4-ba99-4b3e-b3b5-be0a371deb83 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:34.351739 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-95c194d4-ba99-4b3e-b3b5-be0a371deb83 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:34.352261 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-95c194d4-ba99-4b3e-b3b5-be0a371deb83 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:34.352712 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-95c194d4-ba99-4b3e-b3b5-be0a371deb83 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:34.353439 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-95c194d4-ba99-4b3e-b3b5-be0a371deb83 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:34.353966 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-95c194d4-ba99-4b3e-b3b5-be0a371deb83 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:34.354405 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-95c194d4-ba99-4b3e-b3b5-be0a371deb83 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:34.369979 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-01e18a3a-26a8-469e-9ec4-68e56bb2c56d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:34.384907 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-01e18a3a-26a8-469e-9ec4-68e56bb2c56d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1" status: 200 len: 1538 microversion: 2.1 time: 0.660308 Sep 17 21:00:34.421234 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1208/2491] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:33 2022] GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 => generated 1538 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:34.436668 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b5803fdf-2ed4-4254-ac96-96eaa917a631 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:34.439848 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b5803fdf-2ed4-4254-ac96-96eaa917a631 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: 526330e7-cd66-44c3-9453-ea80479469a8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:34.449189 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b5803fdf-2ed4-4254-ac96-96eaa917a631 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:34.449958 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b5803fdf-2ed4-4254-ac96-96eaa917a631 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:34.450644 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b5803fdf-2ed4-4254-ac96-96eaa917a631 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:34.451879 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b5803fdf-2ed4-4254-ac96-96eaa917a631 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:34.452760 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b5803fdf-2ed4-4254-ac96-96eaa917a631 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:34.453440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b5803fdf-2ed4-4254-ac96-96eaa917a631 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:34.476382 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-b5803fdf-2ed4-4254-ac96-96eaa917a631 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] HTTP exception thrown: Instance 526330e7-cd66-44c3-9453-ea80479469a8 could not be found. Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b5803fdf-2ed4-4254-ac96-96eaa917a631 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Request method failure captured: Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/526330e7-cd66-44c3-9453-ea80479469a8 HTTP/1.1 Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjUK0KzWxa6mSjj_pP0fjXEoyN5kHVg36NJGDq68fw96nXPym5syYmWHEDYs4_vWu9WgbinhrbnZ0CmVnOeG6ib6KDdv84fVlBoUPMQT0jKQnH3fbXjRr86MdhZdwMUQQwSNNNb92Rx_HXnlFtOHRa3ZmggHyvxsObnUDwWcVfTg3Rw Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 9b45a150f2db4c2bb4871cd1d1cab898 Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ListServerFiltersTestJSON-1137993684 Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b45a150f2db4c2bb4871cd1d1cab898"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9b45a150f2db4c2bb4871cd1d1cab898"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b45a150f2db4c2bb4871cd1d1cab898"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9b45a150f2db4c2bb4871cd1d1cab898", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ListServerFiltersTestJSON-1137993684 Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 9b45a150f2db4c2bb4871cd1d1cab898 Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1137993684 Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ListServerFiltersTestJSON-1137993684-project Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: da76bbe04c22456f957be0675892359d Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ListServerFiltersTestJSON-1137993684-project Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 526330e7-cd66-44c3-9453-ea80479469a8 could not be found. Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '526330e7-cd66-44c3-9453-ea80479469a8'} Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 526330e7-cd66-44c3-9453-ea80479469a8 could not be found. Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 526330e7-cd66-44c3-9453-ea80479469a8 could not be found. Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:00:34.479565 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:00:34.483912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:34.483912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:00:34.483912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:00:34.483912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:00:34.483912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:00:34.483912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 526330e7-cd66-44c3-9453-ea80479469a8 could not be found. Sep 17 21:00:34.483912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:00:34.485444 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b5803fdf-2ed4-4254-ac96-96eaa917a631 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Returning 404 to user: Instance 526330e7-cd66-44c3-9453-ea80479469a8 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:00:34.486579 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b5803fdf-2ed4-4254-ac96-96eaa917a631 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/526330e7-cd66-44c3-9453-ea80479469a8" status: 404 len: 111 microversion: 2.1 time: 0.058013 Sep 17 21:00:34.487645 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1209/2492] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:34 2022] GET /compute/v2.1/servers/526330e7-cd66-44c3-9453-ea80479469a8 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:00:34.499881 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-832d9542-fdea-4528-b074-1d655a5ffef9 req-7831a8fb-44ec-4ab5-abd4-634d46cf1c9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d44abe5-d50f-4f59-83fd-65376778153a", "name": "network-vif-deleted", "tag": "4ed5e734-5b30-4dff-a533-9bccd03f22ae"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:34.515468 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-832d9542-fdea-4528-b074-1d655a5ffef9 req-7831a8fb-44ec-4ab5-abd4-634d46cf1c9e service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:34.516245 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-832d9542-fdea-4528-b074-1d655a5ffef9 req-7831a8fb-44ec-4ab5-abd4-634d46cf1c9e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:34.516830 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-832d9542-fdea-4528-b074-1d655a5ffef9 req-7831a8fb-44ec-4ab5-abd4-634d46cf1c9e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:34.568197 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-832d9542-fdea-4528-b074-1d655a5ffef9 req-7831a8fb-44ec-4ab5-abd4-634d46cf1c9e service nova] Creating event network-vif-deleted:4ed5e734-5b30-4dff-a533-9bccd03f22ae for instance 1d44abe5-d50f-4f59-83fd-65376778153a on nch2-master-1 Sep 17 21:00:34.576735 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-832d9542-fdea-4528-b074-1d655a5ffef9 req-7831a8fb-44ec-4ab5-abd4-634d46cf1c9e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086355 Sep 17 21:00:34.577778 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1210/2493] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:34.588221 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bc941519-de9b-44b8-ad12-0febb3b97bbd tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:34.589322 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bc941519-de9b-44b8-ad12-0febb3b97bbd tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:34.607764 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bc941519-de9b-44b8-ad12-0febb3b97bbd tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:34.609102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bc941519-de9b-44b8-ad12-0febb3b97bbd tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:34.609816 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bc941519-de9b-44b8-ad12-0febb3b97bbd tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:34.611205 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bc941519-de9b-44b8-ad12-0febb3b97bbd tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:34.611693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bc941519-de9b-44b8-ad12-0febb3b97bbd tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:34.612121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bc941519-de9b-44b8-ad12-0febb3b97bbd tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:34.649359 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=5 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:34.856691 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bc941519-de9b-44b8-ad12-0febb3b97bbd tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5d41f7e95d44d3898f6306bb093ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8813aaee4604882b4cd7a2a8df58077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:34.881575 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bc941519-de9b-44b8-ad12-0febb3b97bbd tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297" status: 200 len: 1301 microversion: 2.1 time: 0.300408 Sep 17 21:00:34.883911 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1211/2494] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:34 2022] GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297 => generated 1301 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:34.893005 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-83c9c306-2aeb-4707-96de-f8f12c9188e4 req-e06e36fd-8a4c-4ebf-95a9-7720c1f0f19f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b13c98-aea4-497c-a213-142393b2758c", "name": "network-vif-unplugged", "status": "completed", "tag": "fac0a530-6799-4e5d-bb72-c716e7db5b00"}, {"server_uuid": "126bfb0a-a567-407a-becb-4f5a814da7c6", "name": "network-vif-unplugged", "status": "completed", "tag": "6804739c-1745-41d6-b864-b17b1ed8921d"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:34.966573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-83c9c306-2aeb-4707-96de-f8f12c9188e4 req-e06e36fd-8a4c-4ebf-95a9-7720c1f0f19f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:34.967663 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-83c9c306-2aeb-4707-96de-f8f12c9188e4 req-e06e36fd-8a4c-4ebf-95a9-7720c1f0f19f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:34.968532 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-83c9c306-2aeb-4707-96de-f8f12c9188e4 req-e06e36fd-8a4c-4ebf-95a9-7720c1f0f19f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:35.012838 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-83c9c306-2aeb-4707-96de-f8f12c9188e4 req-e06e36fd-8a4c-4ebf-95a9-7720c1f0f19f service nova] Creating event network-vif-unplugged:fac0a530-6799-4e5d-bb72-c716e7db5b00 for instance 22b13c98-aea4-497c-a213-142393b2758c on nch2-master-1 Sep 17 21:00:35.013834 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-83c9c306-2aeb-4707-96de-f8f12c9188e4 req-e06e36fd-8a4c-4ebf-95a9-7720c1f0f19f service nova] Creating event network-vif-unplugged:6804739c-1745-41d6-b864-b17b1ed8921d for instance 126bfb0a-a567-407a-becb-4f5a814da7c6 on nch1-master-1 Sep 17 21:00:35.027949 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-95c194d4-ba99-4b3e-b3b5-be0a371deb83 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:35.033899 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-83c9c306-2aeb-4707-96de-f8f12c9188e4 req-e06e36fd-8a4c-4ebf-95a9-7720c1f0f19f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.148436 Sep 17 21:00:35.035802 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1212/2495] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:35.042625 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-95c194d4-ba99-4b3e-b3b5-be0a371deb83 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:35.043128 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-df6959cd-ddbf-4372-ba19-c070a1d1b5ca tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:35.043861 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-df6959cd-ddbf-4372-ba19-c070a1d1b5ca tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:35.044055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-95c194d4-ba99-4b3e-b3b5-be0a371deb83 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:35.045390 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-95c194d4-ba99-4b3e-b3b5-be0a371deb83 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 2935 microversion: 2.32 time: 0.747223 Sep 17 21:00:35.062497 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1284/2496] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:00:34 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 2935 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:00:35.065822 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e6cb02a8-7c9b-4243-8097-da7cb5f52616 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:35.079511 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e6cb02a8-7c9b-4243-8097-da7cb5f52616 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 1d44abe5-d50f-4f59-83fd-65376778153a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:35.080864 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df6959cd-ddbf-4372-ba19-c070a1d1b5ca tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:35.088759 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df6959cd-ddbf-4372-ba19-c070a1d1b5ca tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:35.089517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df6959cd-ddbf-4372-ba19-c070a1d1b5ca tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:35.090435 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df6959cd-ddbf-4372-ba19-c070a1d1b5ca tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:35.091057 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df6959cd-ddbf-4372-ba19-c070a1d1b5ca tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:35.091666 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df6959cd-ddbf-4372-ba19-c070a1d1b5ca tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:35.104470 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6cb02a8-7c9b-4243-8097-da7cb5f52616 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:35.107135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6cb02a8-7c9b-4243-8097-da7cb5f52616 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:35.107861 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6cb02a8-7c9b-4243-8097-da7cb5f52616 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:35.110208 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6cb02a8-7c9b-4243-8097-da7cb5f52616 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:35.110689 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6cb02a8-7c9b-4243-8097-da7cb5f52616 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:35.113454 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6cb02a8-7c9b-4243-8097-da7cb5f52616 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:35.153998 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-df6959cd-ddbf-4372-ba19-c070a1d1b5ca tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:00:35.217124 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6cb02a8-7c9b-4243-8097-da7cb5f52616 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:35.217663 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6cb02a8-7c9b-4243-8097-da7cb5f52616 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:35.218202 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6cb02a8-7c9b-4243-8097-da7cb5f52616 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:35.221358 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-e6cb02a8-7c9b-4243-8097-da7cb5f52616 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lazy-loading 'fault' on Instance uuid 1d44abe5-d50f-4f59-83fd-65376778153a {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:00:35.326907 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e6cb02a8-7c9b-4243-8097-da7cb5f52616 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:35.340451 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-df6959cd-ddbf-4372-ba19-c070a1d1b5ca tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "DELETE /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5" status: 204 len: 0 microversion: 2.1 time: 0.302950 Sep 17 21:00:35.341253 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1213/2497] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:00:35 2022] DELETE /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:00:35.342686 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e6cb02a8-7c9b-4243-8097-da7cb5f52616 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a" status: 200 len: 1306 microversion: 2.1 time: 0.280674 Sep 17 21:00:35.343283 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1285/2498] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:35 2022] GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a => generated 1306 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:35.346563 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-32f4c555-e46d-4666-8248-aaa416980bd2 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:35.347547 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-32f4c555-e46d-4666-8248-aaa416980bd2 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:35.352526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0e7bbef3-e450-4dc1-bd78-cdf14684741e tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:35.360032 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0e7bbef3-e450-4dc1-bd78-cdf14684741e tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:35.363539 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32f4c555-e46d-4666-8248-aaa416980bd2 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:35.364053 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32f4c555-e46d-4666-8248-aaa416980bd2 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:35.364487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32f4c555-e46d-4666-8248-aaa416980bd2 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:35.365205 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32f4c555-e46d-4666-8248-aaa416980bd2 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:35.365693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32f4c555-e46d-4666-8248-aaa416980bd2 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:35.366117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32f4c555-e46d-4666-8248-aaa416980bd2 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:35.373704 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0e7bbef3-e450-4dc1-bd78-cdf14684741e tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:35.374204 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0e7bbef3-e450-4dc1-bd78-cdf14684741e tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:35.374648 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0e7bbef3-e450-4dc1-bd78-cdf14684741e tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:35.379066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0e7bbef3-e450-4dc1-bd78-cdf14684741e tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:35.379569 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0e7bbef3-e450-4dc1-bd78-cdf14684741e tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:35.380576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0e7bbef3-e450-4dc1-bd78-cdf14684741e tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:35.697363 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0e7bbef3-e450-4dc1-bd78-cdf14684741e tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:35.707673 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0e7bbef3-e450-4dc1-bd78-cdf14684741e tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1506 microversion: 2.1 time: 0.357060 Sep 17 21:00:35.708295 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1286/2499] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:35 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1506 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:35.714226 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-32f4c555-e46d-4666-8248-aaa416980bd2 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:35.724545 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-32f4c555-e46d-4666-8248-aaa416980bd2 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1471 microversion: 2.1 time: 0.381927 Sep 17 21:00:35.743619 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1214/2500] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:35 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1471 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:35.754357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1b97405d-c621-443c-9401-6810c7ea2242 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:35.755351 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1b97405d-c621-443c-9401-6810c7ea2242 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:35.757187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a6e48378-2024-4fd4-8f46-80877dbfa8c8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:35.758279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a6e48378-2024-4fd4-8f46-80877dbfa8c8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:35.769373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:35.773842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b97405d-c621-443c-9401-6810c7ea2242 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:35.775405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b97405d-c621-443c-9401-6810c7ea2242 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:35.777208 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b97405d-c621-443c-9401-6810c7ea2242 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:35.778390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b97405d-c621-443c-9401-6810c7ea2242 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:35.779757 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b97405d-c621-443c-9401-6810c7ea2242 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:35.781500 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b97405d-c621-443c-9401-6810c7ea2242 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:35.793242 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6e48378-2024-4fd4-8f46-80877dbfa8c8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:35.794247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6e48378-2024-4fd4-8f46-80877dbfa8c8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:35.794936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6e48378-2024-4fd4-8f46-80877dbfa8c8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:35.796008 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6e48378-2024-4fd4-8f46-80877dbfa8c8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:35.796803 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6e48378-2024-4fd4-8f46-80877dbfa8c8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:35.806646 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6e48378-2024-4fd4-8f46-80877dbfa8c8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:35.810604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:36.262966 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1b97405d-c621-443c-9401-6810c7ea2242 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:36.283307 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1b97405d-c621-443c-9401-6810c7ea2242 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1" status: 200 len: 1520 microversion: 2.1 time: 0.538047 Sep 17 21:00:36.285687 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1215/2501] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:35 2022] GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 => generated 1520 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:36.309522 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9f371a15-482a-490d-9152-f7fbb19280c1 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:36.313843 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9f371a15-482a-490d-9152-f7fbb19280c1 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:36.340792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f371a15-482a-490d-9152-f7fbb19280c1 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:36.343936 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f371a15-482a-490d-9152-f7fbb19280c1 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:36.345722 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f371a15-482a-490d-9152-f7fbb19280c1 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:36.354818 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f371a15-482a-490d-9152-f7fbb19280c1 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:36.357450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f371a15-482a-490d-9152-f7fbb19280c1 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:36.358854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f371a15-482a-490d-9152-f7fbb19280c1 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:36.403684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a6e48378-2024-4fd4-8f46-80877dbfa8c8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:36.418302 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a6e48378-2024-4fd4-8f46-80877dbfa8c8 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5" status: 200 len: 1517 microversion: 2.1 time: 0.689227 Sep 17 21:00:36.422995 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1287/2502] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:35 2022] GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 => generated 1517 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:36.443387 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-97526680-badb-429d-828c-23c5adaf36c4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:36.450708 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-97526680-badb-429d-828c-23c5adaf36c4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:36.479767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97526680-badb-429d-828c-23c5adaf36c4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:36.483168 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97526680-badb-429d-828c-23c5adaf36c4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:36.483653 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97526680-badb-429d-828c-23c5adaf36c4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:36.487767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97526680-badb-429d-828c-23c5adaf36c4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:36.491048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97526680-badb-429d-828c-23c5adaf36c4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:36.492855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97526680-badb-429d-828c-23c5adaf36c4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:36.932944 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9f371a15-482a-490d-9152-f7fbb19280c1 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5d41f7e95d44d3898f6306bb093ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8813aaee4604882b4cd7a2a8df58077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:36.948897 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9f371a15-482a-490d-9152-f7fbb19280c1 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297" status: 200 len: 1368 microversion: 2.1 time: 0.654368 Sep 17 21:00:36.952595 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1216/2503] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:36 2022] GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297 => generated 1368 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:36.970880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f9a75423-fdfe-45de-accd-5d603b45e451 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:36.974708 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f9a75423-fdfe-45de-accd-5d603b45e451 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:36.996198 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f9a75423-fdfe-45de-accd-5d603b45e451 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:36.996718 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f9a75423-fdfe-45de-accd-5d603b45e451 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:36.998802 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f9a75423-fdfe-45de-accd-5d603b45e451 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:37.001735 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f9a75423-fdfe-45de-accd-5d603b45e451 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:37.002302 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f9a75423-fdfe-45de-accd-5d603b45e451 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:37.002768 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f9a75423-fdfe-45de-accd-5d603b45e451 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:37.074539 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-97526680-badb-429d-828c-23c5adaf36c4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:37.090249 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-97526680-badb-429d-828c-23c5adaf36c4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:37.092235 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-97526680-badb-429d-828c-23c5adaf36c4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:37.093613 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-97526680-badb-429d-828c-23c5adaf36c4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 2935 microversion: 2.32 time: 0.669026 Sep 17 21:00:37.105144 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f9a75423-fdfe-45de-accd-5d603b45e451 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:00:37.106695 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1288/2504] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:00:36 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 2935 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:00:37.121258 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0921b2d0-b6eb-4169-9e62-fccc06843728 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:37.122586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0921b2d0-b6eb-4169-9e62-fccc06843728 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 1d44abe5-d50f-4f59-83fd-65376778153a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:37.130337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0921b2d0-b6eb-4169-9e62-fccc06843728 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:37.130846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0921b2d0-b6eb-4169-9e62-fccc06843728 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:37.131291 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0921b2d0-b6eb-4169-9e62-fccc06843728 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:37.132014 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0921b2d0-b6eb-4169-9e62-fccc06843728 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:37.132529 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0921b2d0-b6eb-4169-9e62-fccc06843728 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:37.132968 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0921b2d0-b6eb-4169-9e62-fccc06843728 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:37.186510 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0921b2d0-b6eb-4169-9e62-fccc06843728 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:37.187026 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0921b2d0-b6eb-4169-9e62-fccc06843728 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:37.188534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0921b2d0-b6eb-4169-9e62-fccc06843728 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:37.189008 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-0921b2d0-b6eb-4169-9e62-fccc06843728 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lazy-loading 'fault' on Instance uuid 1d44abe5-d50f-4f59-83fd-65376778153a {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:00:37.272325 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0921b2d0-b6eb-4169-9e62-fccc06843728 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:37.285665 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0921b2d0-b6eb-4169-9e62-fccc06843728 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a" status: 200 len: 1306 microversion: 2.1 time: 0.177373 Sep 17 21:00:37.286853 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1289/2505] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:37 2022] GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a => generated 1306 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:37.361446 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f9a75423-fdfe-45de-accd-5d603b45e451 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1" status: 204 len: 0 microversion: 2.1 time: 0.402444 Sep 17 21:00:37.362984 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1217/2506] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:00:36 2022] DELETE /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:00:37.380726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5c06dcaf-9ac0-4b62-b786-c41a90649b9e tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:37.383202 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5c06dcaf-9ac0-4b62-b786-c41a90649b9e tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:37.390247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f3d25c78-8345-414b-9f7a-7e6b6660db9f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1830847588", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "dc0ab76b-95f3-4f0a-beab-7465ea19ce7a"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:37.397730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c06dcaf-9ac0-4b62-b786-c41a90649b9e tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:37.397730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c06dcaf-9ac0-4b62-b786-c41a90649b9e tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:37.400431 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c06dcaf-9ac0-4b62-b786-c41a90649b9e tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:37.401489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c06dcaf-9ac0-4b62-b786-c41a90649b9e tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:37.402087 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c06dcaf-9ac0-4b62-b786-c41a90649b9e tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:37.403142 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c06dcaf-9ac0-4b62-b786-c41a90649b9e tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:37.499859 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-f3d25c78-8345-414b-9f7a-7e6b6660db9f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] validate_networks() for [('dc0ab76b-95f3-4f0a-beab-7465ea19ce7a', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:00:37.694719 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5c06dcaf-9ac0-4b62-b786-c41a90649b9e tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:37.698447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:37.704376 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5c06dcaf-9ac0-4b62-b786-c41a90649b9e tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1506 microversion: 2.1 time: 0.339418 Sep 17 21:00:37.720280 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1218/2507] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:37 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1506 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:37.725174 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-32092c45-b394-4fb6-a59e-27d9932aedd0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:37.725839 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-32092c45-b394-4fb6-a59e-27d9932aedd0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:37.732694 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32092c45-b394-4fb6-a59e-27d9932aedd0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:37.733197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32092c45-b394-4fb6-a59e-27d9932aedd0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:37.733906 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32092c45-b394-4fb6-a59e-27d9932aedd0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:37.734644 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32092c45-b394-4fb6-a59e-27d9932aedd0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:37.741792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32092c45-b394-4fb6-a59e-27d9932aedd0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:37.742291 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32092c45-b394-4fb6-a59e-27d9932aedd0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:38.008531 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-32092c45-b394-4fb6-a59e-27d9932aedd0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:38.016901 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-32092c45-b394-4fb6-a59e-27d9932aedd0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1471 microversion: 2.1 time: 0.295465 Sep 17 21:00:38.033116 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1219/2508] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:37 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1471 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:38.038201 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-390bc07a-2bf1-4e9a-8bd8-fef0e6f41662 req-852a479e-39ef-4e96-8d71-e5dd5218f672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b13c98-aea4-497c-a213-142393b2758c", "name": "network-vif-unplugged", "status": "completed", "tag": "f1f9bbb6-1fce-45e9-b23b-60319ea313bb"}, {"server_uuid": "22b13c98-aea4-497c-a213-142393b2758c", "name": "network-vif-unplugged", "status": "completed", "tag": "2adbeae0-ecea-4ae6-bf73-c7bf555f5367"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:38.049605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-390bc07a-2bf1-4e9a-8bd8-fef0e6f41662 req-852a479e-39ef-4e96-8d71-e5dd5218f672 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:38.050440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-390bc07a-2bf1-4e9a-8bd8-fef0e6f41662 req-852a479e-39ef-4e96-8d71-e5dd5218f672 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:38.051156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-390bc07a-2bf1-4e9a-8bd8-fef0e6f41662 req-852a479e-39ef-4e96-8d71-e5dd5218f672 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:38.070040 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-390bc07a-2bf1-4e9a-8bd8-fef0e6f41662 req-852a479e-39ef-4e96-8d71-e5dd5218f672 service nova] Creating event network-vif-unplugged:f1f9bbb6-1fce-45e9-b23b-60319ea313bb for instance 22b13c98-aea4-497c-a213-142393b2758c on nch2-master-1 Sep 17 21:00:38.070963 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-390bc07a-2bf1-4e9a-8bd8-fef0e6f41662 req-852a479e-39ef-4e96-8d71-e5dd5218f672 service nova] Creating event network-vif-unplugged:2adbeae0-ecea-4ae6-bf73-c7bf555f5367 for instance 22b13c98-aea4-497c-a213-142393b2758c on nch2-master-1 Sep 17 21:00:38.078074 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-390bc07a-2bf1-4e9a-8bd8-fef0e6f41662 req-852a479e-39ef-4e96-8d71-e5dd5218f672 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.043250 Sep 17 21:00:38.078967 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1220/2509] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:38.087516 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b3c9785b-efbe-450e-9bd1-cf3f0fe832a9 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:38.090323 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b3c9785b-efbe-450e-9bd1-cf3f0fe832a9 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:38.105226 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3c9785b-efbe-450e-9bd1-cf3f0fe832a9 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:38.106095 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3c9785b-efbe-450e-9bd1-cf3f0fe832a9 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:38.106923 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3c9785b-efbe-450e-9bd1-cf3f0fe832a9 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:38.107858 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3c9785b-efbe-450e-9bd1-cf3f0fe832a9 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:38.108521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3c9785b-efbe-450e-9bd1-cf3f0fe832a9 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:38.109158 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3c9785b-efbe-450e-9bd1-cf3f0fe832a9 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:38.208399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-f3d25c78-8345-414b-9f7a-7e6b6660db9f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:00:38.208823 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-f3d25c78-8345-414b-9f7a-7e6b6660db9f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:00:38.209301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-f3d25c78-8345-414b-9f7a-7e6b6660db9f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:00:38.209762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-f3d25c78-8345-414b-9f7a-7e6b6660db9f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:00:38.210160 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-f3d25c78-8345-414b-9f7a-7e6b6660db9f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:00:38.228043 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3d25c78-8345-414b-9f7a-7e6b6660db9f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:38.228542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3d25c78-8345-414b-9f7a-7e6b6660db9f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:38.229089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3d25c78-8345-414b-9f7a-7e6b6660db9f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:38.229868 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3d25c78-8345-414b-9f7a-7e6b6660db9f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:38.230327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3d25c78-8345-414b-9f7a-7e6b6660db9f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:38.230763 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3d25c78-8345-414b-9f7a-7e6b6660db9f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:38.279011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-f3d25c78-8345-414b-9f7a-7e6b6660db9f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Getting quotas for project 36ce01157eec446dbcc93b2948b4be90. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:00:38.290710 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-f3d25c78-8345-414b-9f7a-7e6b6660db9f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Getting quotas for user 33fa2d463884464fbe90666c98da0fd7 and project 36ce01157eec446dbcc93b2948b4be90. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:00:38.294759 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:38.306792 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f3d25c78-8345-414b-9f7a-7e6b6660db9f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:00:38.310133 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f3d25c78-8345-414b-9f7a-7e6b6660db9f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:00:38.409673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b3c9785b-efbe-450e-9bd1-cf3f0fe832a9 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:38.418982 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b3c9785b-efbe-450e-9bd1-cf3f0fe832a9 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1" status: 200 len: 1526 microversion: 2.1 time: 0.338562 Sep 17 21:00:38.420024 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1221/2510] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:38 2022] GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 => generated 1526 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:38.425412 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8aaf4f7d-703a-4268-9acf-1ea3883f76be tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:38.426055 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8aaf4f7d-703a-4268-9acf-1ea3883f76be tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:38.432442 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8aaf4f7d-703a-4268-9acf-1ea3883f76be tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:38.433012 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8aaf4f7d-703a-4268-9acf-1ea3883f76be tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:38.433537 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8aaf4f7d-703a-4268-9acf-1ea3883f76be tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:38.434866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8aaf4f7d-703a-4268-9acf-1ea3883f76be tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:38.435409 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8aaf4f7d-703a-4268-9acf-1ea3883f76be tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:38.439795 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f3d25c78-8345-414b-9f7a-7e6b6660db9f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.151517 Sep 17 21:00:38.444061 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1290/2511] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:00:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:00:38.448144 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8aaf4f7d-703a-4268-9acf-1ea3883f76be tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:38.451374 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c8ad0e8c-4eed-4e63-853b-8f238eb38725 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:38.452213 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c8ad0e8c-4eed-4e63-853b-8f238eb38725 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:38.460335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8ad0e8c-4eed-4e63-853b-8f238eb38725 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:38.461235 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8ad0e8c-4eed-4e63-853b-8f238eb38725 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:38.461980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8ad0e8c-4eed-4e63-853b-8f238eb38725 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:38.462885 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8ad0e8c-4eed-4e63-853b-8f238eb38725 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:38.463592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8ad0e8c-4eed-4e63-853b-8f238eb38725 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:38.464388 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8ad0e8c-4eed-4e63-853b-8f238eb38725 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:38.990834 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8aaf4f7d-703a-4268-9acf-1ea3883f76be tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:38.999956 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8aaf4f7d-703a-4268-9acf-1ea3883f76be tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5" status: 200 len: 1517 microversion: 2.1 time: 0.578613 Sep 17 21:00:39.000520 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1222/2512] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:38 2022] GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 => generated 1517 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:39.022139 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-95f2eaf7-1d34-4c44-b23d-83fe646eb6a6 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:39.024681 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-95f2eaf7-1d34-4c44-b23d-83fe646eb6a6 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:39.027435 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c8ad0e8c-4eed-4e63-853b-8f238eb38725 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5d41f7e95d44d3898f6306bb093ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8813aaee4604882b4cd7a2a8df58077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:39.046895 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c8ad0e8c-4eed-4e63-853b-8f238eb38725 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297" status: 200 len: 1368 microversion: 2.1 time: 0.600090 Sep 17 21:00:39.057987 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1291/2513] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:38 2022] GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297 => generated 1368 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:39.058155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95f2eaf7-1d34-4c44-b23d-83fe646eb6a6 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:39.058155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95f2eaf7-1d34-4c44-b23d-83fe646eb6a6 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:39.058155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95f2eaf7-1d34-4c44-b23d-83fe646eb6a6 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:39.058155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95f2eaf7-1d34-4c44-b23d-83fe646eb6a6 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:39.058155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95f2eaf7-1d34-4c44-b23d-83fe646eb6a6 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:39.058155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95f2eaf7-1d34-4c44-b23d-83fe646eb6a6 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:39.070510 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6181215e-75c1-4cc0-a701-97620d46b225 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:39.073488 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6181215e-75c1-4cc0-a701-97620d46b225 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 1d44abe5-d50f-4f59-83fd-65376778153a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:39.090363 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6181215e-75c1-4cc0-a701-97620d46b225 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:39.092117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6181215e-75c1-4cc0-a701-97620d46b225 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:39.093718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6181215e-75c1-4cc0-a701-97620d46b225 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:39.094486 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6181215e-75c1-4cc0-a701-97620d46b225 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:39.094964 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6181215e-75c1-4cc0-a701-97620d46b225 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:39.095392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6181215e-75c1-4cc0-a701-97620d46b225 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:39.177832 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6181215e-75c1-4cc0-a701-97620d46b225 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:39.178335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6181215e-75c1-4cc0-a701-97620d46b225 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:39.178783 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6181215e-75c1-4cc0-a701-97620d46b225 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:39.179247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-6181215e-75c1-4cc0-a701-97620d46b225 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lazy-loading 'fault' on Instance uuid 1d44abe5-d50f-4f59-83fd-65376778153a {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:00:39.257057 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6181215e-75c1-4cc0-a701-97620d46b225 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:39.276601 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6181215e-75c1-4cc0-a701-97620d46b225 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a" status: 200 len: 1306 microversion: 2.1 time: 0.226042 Sep 17 21:00:39.277505 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1292/2514] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:39 2022] GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a => generated 1306 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:39.300986 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a07cf205-28f2-41ad-96cd-8052b03fc915 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:39.301619 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a07cf205-28f2-41ad-96cd-8052b03fc915 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:39.430533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a07cf205-28f2-41ad-96cd-8052b03fc915 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:39.435692 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-95f2eaf7-1d34-4c44-b23d-83fe646eb6a6 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:39.441430 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a07cf205-28f2-41ad-96cd-8052b03fc915 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1217 microversion: 2.1 time: 0.144267 Sep 17 21:00:39.442735 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1293/2515] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:39 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1217 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:39.464300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bd926e4f-832f-4eca-a6e0-44e18e7c9691 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:39.465222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bd926e4f-832f-4eca-a6e0-44e18e7c9691 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:39.468606 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-95f2eaf7-1d34-4c44-b23d-83fe646eb6a6 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:39.470314 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-95f2eaf7-1d34-4c44-b23d-83fe646eb6a6 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:39.471917 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-95f2eaf7-1d34-4c44-b23d-83fe646eb6a6 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 2914 microversion: 2.32 time: 0.470378 Sep 17 21:00:39.473187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd926e4f-832f-4eca-a6e0-44e18e7c9691 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:39.473500 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1223/2516] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:00:39 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 2914 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:00:39.474136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd926e4f-832f-4eca-a6e0-44e18e7c9691 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:39.474679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd926e4f-832f-4eca-a6e0-44e18e7c9691 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:39.475521 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd926e4f-832f-4eca-a6e0-44e18e7c9691 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:39.480591 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9a8c5a6d-4605-422e-ada6-6ef2c82d7594 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:39.481449 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd926e4f-832f-4eca-a6e0-44e18e7c9691 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:39.481796 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9a8c5a6d-4605-422e-ada6-6ef2c82d7594 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:39.482231 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd926e4f-832f-4eca-a6e0-44e18e7c9691 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:39.498557 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9a8c5a6d-4605-422e-ada6-6ef2c82d7594 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:39.500098 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9a8c5a6d-4605-422e-ada6-6ef2c82d7594 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:39.500801 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9a8c5a6d-4605-422e-ada6-6ef2c82d7594 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:39.502658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9a8c5a6d-4605-422e-ada6-6ef2c82d7594 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:39.503818 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9a8c5a6d-4605-422e-ada6-6ef2c82d7594 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:39.504506 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9a8c5a6d-4605-422e-ada6-6ef2c82d7594 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:39.748833 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9a8c5a6d-4605-422e-ada6-6ef2c82d7594 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:39.757548 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9a8c5a6d-4605-422e-ada6-6ef2c82d7594 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1477 microversion: 2.1 time: 0.282551 Sep 17 21:00:39.763263 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bd926e4f-832f-4eca-a6e0-44e18e7c9691 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:39.772464 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bd926e4f-832f-4eca-a6e0-44e18e7c9691 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 200 len: 1509 microversion: 2.1 time: 0.326235 Sep 17 21:00:39.774704 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1224/2517] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:39 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1477 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:39.782612 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7c3a36d1-f1b8-4df4-8ab0-42e00ea6025a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:39.783592 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7c3a36d1-f1b8-4df4-8ab0-42e00ea6025a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:39.785050 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1294/2518] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:39 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 1509 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:39.790493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c3a36d1-f1b8-4df4-8ab0-42e00ea6025a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:39.791293 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c3a36d1-f1b8-4df4-8ab0-42e00ea6025a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:39.791983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c3a36d1-f1b8-4df4-8ab0-42e00ea6025a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:39.792997 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c3a36d1-f1b8-4df4-8ab0-42e00ea6025a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:39.793696 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c3a36d1-f1b8-4df4-8ab0-42e00ea6025a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:39.794317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c3a36d1-f1b8-4df4-8ab0-42e00ea6025a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:39.796158 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-92398456-88ae-4db9-b42d-a71d676fa9ff tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:39.796737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-92398456-88ae-4db9-b42d-a71d676fa9ff tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:39.805763 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92398456-88ae-4db9-b42d-a71d676fa9ff tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:39.806362 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92398456-88ae-4db9-b42d-a71d676fa9ff tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:39.806911 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92398456-88ae-4db9-b42d-a71d676fa9ff tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:39.807719 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92398456-88ae-4db9-b42d-a71d676fa9ff tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:39.808254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92398456-88ae-4db9-b42d-a71d676fa9ff tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:39.808753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92398456-88ae-4db9-b42d-a71d676fa9ff tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:39.847547 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-92398456-88ae-4db9-b42d-a71d676fa9ff tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:00:39.856618 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.compute.api [None req-92398456-88ae-4db9-b42d-a71d676fa9ff tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Working on deleting snapshot 11709463-2e99-4bea-adca-ad53fbb22518 from shelved instance... Sep 17 21:00:40.080060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7c3a36d1-f1b8-4df4-8ab0-42e00ea6025a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:40.093350 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7c3a36d1-f1b8-4df4-8ab0-42e00ea6025a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1" status: 200 len: 1526 microversion: 2.1 time: 0.317111 Sep 17 21:00:40.120560 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1225/2519] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:39 2022] GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 => generated 1526 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:40.125772 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bb7c7ad1-8de6-4353-ab93-ca00a14f694c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:40.126661 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bb7c7ad1-8de6-4353-ab93-ca00a14f694c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:40.134344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bb7c7ad1-8de6-4353-ab93-ca00a14f694c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:40.135432 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bb7c7ad1-8de6-4353-ab93-ca00a14f694c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:40.137979 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bb7c7ad1-8de6-4353-ab93-ca00a14f694c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:40.139395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bb7c7ad1-8de6-4353-ab93-ca00a14f694c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:40.140240 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bb7c7ad1-8de6-4353-ab93-ca00a14f694c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:40.141556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bb7c7ad1-8de6-4353-ab93-ca00a14f694c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:40.329082 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bb7c7ad1-8de6-4353-ab93-ca00a14f694c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da76bbe04c22456f957be0675892359d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b45a150f2db4c2bb4871cd1d1cab898', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:40.340559 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bb7c7ad1-8de6-4353-ab93-ca00a14f694c tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5" status: 200 len: 1517 microversion: 2.1 time: 0.218273 Sep 17 21:00:40.341817 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1226/2520] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:40 2022] GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 => generated 1517 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:40.346677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-de6686e2-c8d8-4df7-bebe-7ac4dd5f5e08 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:40.351554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-de6686e2-c8d8-4df7-bebe-7ac4dd5f5e08 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:40.359540 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de6686e2-c8d8-4df7-bebe-7ac4dd5f5e08 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:40.360291 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de6686e2-c8d8-4df7-bebe-7ac4dd5f5e08 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:40.360951 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de6686e2-c8d8-4df7-bebe-7ac4dd5f5e08 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:40.361934 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de6686e2-c8d8-4df7-bebe-7ac4dd5f5e08 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:40.362782 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de6686e2-c8d8-4df7-bebe-7ac4dd5f5e08 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:40.363845 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de6686e2-c8d8-4df7-bebe-7ac4dd5f5e08 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:40.701088 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-de6686e2-c8d8-4df7-bebe-7ac4dd5f5e08 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5d41f7e95d44d3898f6306bb093ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8813aaee4604882b4cd7a2a8df58077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:40.709936 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-de6686e2-c8d8-4df7-bebe-7ac4dd5f5e08 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297" status: 200 len: 1368 microversion: 2.1 time: 0.366766 Sep 17 21:00:40.710532 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1227/2521] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:40 2022] GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297 => generated 1368 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:40.726091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-d7351313-21ce-4a46-bf71-ecd9010f2e5b req-b7a8ba54-8789-4683-96e1-73e44a3d300f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b13c98-aea4-497c-a213-142393b2758c", "name": "network-vif-unplugged", "status": "completed", "tag": "7c3cbfdf-d88c-428e-969f-2451f881cc2b"}, {"server_uuid": "22b13c98-aea4-497c-a213-142393b2758c", "name": "network-vif-unplugged", "status": "completed", "tag": "e15c3f2b-0cbb-44da-8610-207b8c1ec7bc"}, {"server_uuid": "caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5", "name": "network-vif-unplugged", "status": "completed", "tag": "b672db1d-cb3f-4522-94a2-b7c9c48b98d9"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:40.770181 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d7351313-21ce-4a46-bf71-ecd9010f2e5b req-b7a8ba54-8789-4683-96e1-73e44a3d300f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:40.771779 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d7351313-21ce-4a46-bf71-ecd9010f2e5b req-b7a8ba54-8789-4683-96e1-73e44a3d300f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:40.772256 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d7351313-21ce-4a46-bf71-ecd9010f2e5b req-b7a8ba54-8789-4683-96e1-73e44a3d300f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:40.807830 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-d7351313-21ce-4a46-bf71-ecd9010f2e5b req-b7a8ba54-8789-4683-96e1-73e44a3d300f service nova] Creating event network-vif-unplugged:7c3cbfdf-d88c-428e-969f-2451f881cc2b for instance 22b13c98-aea4-497c-a213-142393b2758c on nch2-master-1 Sep 17 21:00:40.808355 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-d7351313-21ce-4a46-bf71-ecd9010f2e5b req-b7a8ba54-8789-4683-96e1-73e44a3d300f service nova] Creating event network-vif-unplugged:e15c3f2b-0cbb-44da-8610-207b8c1ec7bc for instance 22b13c98-aea4-497c-a213-142393b2758c on nch2-master-1 Sep 17 21:00:40.810050 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-d7351313-21ce-4a46-bf71-ecd9010f2e5b req-b7a8ba54-8789-4683-96e1-73e44a3d300f service nova] Creating event network-vif-unplugged:b672db1d-cb3f-4522-94a2-b7c9c48b98d9 for instance caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 on nch1-master-1 Sep 17 21:00:40.832247 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-d7351313-21ce-4a46-bf71-ecd9010f2e5b req-b7a8ba54-8789-4683-96e1-73e44a3d300f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.120458 Sep 17 21:00:40.832852 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1228/2522] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:40.845435 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-92398456-88ae-4db9-b42d-a71d676fa9ff tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Doing local delete in cell 056db90a-cdd9-42b2-a8c3-cd5ab36662a4(cell1) {{(pid=140524) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 17 21:00:40.846769 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2391f08e-c5bd-495e-92cd-a2f2ec5be171 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:40.847745 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2391f08e-c5bd-495e-92cd-a2f2ec5be171 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 1d44abe5-d50f-4f59-83fd-65376778153a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:40.848706 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92398456-88ae-4db9-b42d-a71d676fa9ff tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:40.852282 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92398456-88ae-4db9-b42d-a71d676fa9ff tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:40.852970 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92398456-88ae-4db9-b42d-a71d676fa9ff tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:40.853634 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.compute.api [None req-92398456-88ae-4db9-b42d-a71d676fa9ff tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 17 21:00:40.860570 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2391f08e-c5bd-495e-92cd-a2f2ec5be171 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:40.861916 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2391f08e-c5bd-495e-92cd-a2f2ec5be171 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:40.863330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-92398456-88ae-4db9-b42d-a71d676fa9ff tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] deallocate_for_instance() {{(pid=140524) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 17 21:00:40.868023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2391f08e-c5bd-495e-92cd-a2f2ec5be171 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:40.869094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2391f08e-c5bd-495e-92cd-a2f2ec5be171 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:40.872684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2391f08e-c5bd-495e-92cd-a2f2ec5be171 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:40.873439 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2391f08e-c5bd-495e-92cd-a2f2ec5be171 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:40.931513 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2391f08e-c5bd-495e-92cd-a2f2ec5be171 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:40.932386 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2391f08e-c5bd-495e-92cd-a2f2ec5be171 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:40.933024 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2391f08e-c5bd-495e-92cd-a2f2ec5be171 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:40.933767 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-2391f08e-c5bd-495e-92cd-a2f2ec5be171 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lazy-loading 'fault' on Instance uuid 1d44abe5-d50f-4f59-83fd-65376778153a {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:00:41.077629 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2391f08e-c5bd-495e-92cd-a2f2ec5be171 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:41.138418 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2391f08e-c5bd-495e-92cd-a2f2ec5be171 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a" status: 200 len: 1306 microversion: 2.1 time: 0.302519 Sep 17 21:00:41.145985 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1229/2523] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:40 2022] GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a => generated 1306 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:41.199444 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d881f522-e4ec-4e75-897e-e6aa731fe886 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:41.202682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d881f522-e4ec-4e75-897e-e6aa731fe886 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:41.244838 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d881f522-e4ec-4e75-897e-e6aa731fe886 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:41.248536 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d881f522-e4ec-4e75-897e-e6aa731fe886 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:41.250675 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d881f522-e4ec-4e75-897e-e6aa731fe886 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:41.252454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d881f522-e4ec-4e75-897e-e6aa731fe886 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:41.255255 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d881f522-e4ec-4e75-897e-e6aa731fe886 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:41.258814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d881f522-e4ec-4e75-897e-e6aa731fe886 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:41.725145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d881f522-e4ec-4e75-897e-e6aa731fe886 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:41.744721 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d881f522-e4ec-4e75-897e-e6aa731fe886 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1269 microversion: 2.1 time: 0.579190 Sep 17 21:00:41.747832 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1230/2524] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:41 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1269 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:41.772196 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-82f89f5f-7ef9-44dd-b07e-7e78b93e72bf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:41.773020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-82f89f5f-7ef9-44dd-b07e-7e78b93e72bf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:41.786970 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82f89f5f-7ef9-44dd-b07e-7e78b93e72bf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:41.788277 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82f89f5f-7ef9-44dd-b07e-7e78b93e72bf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:41.789845 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82f89f5f-7ef9-44dd-b07e-7e78b93e72bf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:41.791016 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82f89f5f-7ef9-44dd-b07e-7e78b93e72bf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:41.791698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82f89f5f-7ef9-44dd-b07e-7e78b93e72bf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:41.792340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82f89f5f-7ef9-44dd-b07e-7e78b93e72bf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:42.333193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-82f89f5f-7ef9-44dd-b07e-7e78b93e72bf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:42.347501 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-82f89f5f-7ef9-44dd-b07e-7e78b93e72bf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:42.355583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-82f89f5f-7ef9-44dd-b07e-7e78b93e72bf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:42.357187 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-82f89f5f-7ef9-44dd-b07e-7e78b93e72bf tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 2867 microversion: 2.32 time: 0.589329 Sep 17 21:00:42.364266 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1231/2525] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:00:41 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 2867 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:00:42.371977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-3e15a205-aa15-445b-9aba-7ab7b788ca74 req-f6e8ef0a-d518-4ece-9a83-196516b84186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5", "name": "network-vif-deleted", "tag": "b672db1d-cb3f-4522-94a2-b7c9c48b98d9"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:42.401064 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-3e15a205-aa15-445b-9aba-7ab7b788ca74 req-f6e8ef0a-d518-4ece-9a83-196516b84186 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:42.401566 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-3e15a205-aa15-445b-9aba-7ab7b788ca74 req-f6e8ef0a-d518-4ece-9a83-196516b84186 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:42.414237 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-3e15a205-aa15-445b-9aba-7ab7b788ca74 req-f6e8ef0a-d518-4ece-9a83-196516b84186 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:42.429999 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-3e15a205-aa15-445b-9aba-7ab7b788ca74 req-f6e8ef0a-d518-4ece-9a83-196516b84186 service nova] Creating event network-vif-deleted:b672db1d-cb3f-4522-94a2-b7c9c48b98d9 for instance caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 on nch1-master-1 Sep 17 21:00:42.447369 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-3e15a205-aa15-445b-9aba-7ab7b788ca74 req-f6e8ef0a-d518-4ece-9a83-196516b84186 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079200 Sep 17 21:00:42.452624 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1232/2526] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:42.466713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8ad2b952-3eb7-4f63-a818-22d222d4e97c tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:42.468071 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8ad2b952-3eb7-4f63-a818-22d222d4e97c tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:42.476033 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ad2b952-3eb7-4f63-a818-22d222d4e97c tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:42.476903 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ad2b952-3eb7-4f63-a818-22d222d4e97c tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:42.477826 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ad2b952-3eb7-4f63-a818-22d222d4e97c tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:42.478927 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ad2b952-3eb7-4f63-a818-22d222d4e97c tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:42.480092 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ad2b952-3eb7-4f63-a818-22d222d4e97c tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:42.482841 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ad2b952-3eb7-4f63-a818-22d222d4e97c tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:42.997946 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8ad2b952-3eb7-4f63-a818-22d222d4e97c tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:43.010266 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8ad2b952-3eb7-4f63-a818-22d222d4e97c tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1477 microversion: 2.1 time: 0.554918 Sep 17 21:00:43.025101 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1233/2527] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:42 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1477 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:43.036376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7764fd05-0c0a-4880-bc81-db5bd472a49f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:43.046139 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7764fd05-0c0a-4880-bc81-db5bd472a49f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:43.059341 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7764fd05-0c0a-4880-bc81-db5bd472a49f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:43.059876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7764fd05-0c0a-4880-bc81-db5bd472a49f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:43.060340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7764fd05-0c0a-4880-bc81-db5bd472a49f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:43.062468 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7764fd05-0c0a-4880-bc81-db5bd472a49f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:43.063130 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7764fd05-0c0a-4880-bc81-db5bd472a49f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:43.063722 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7764fd05-0c0a-4880-bc81-db5bd472a49f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:43.740184 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7764fd05-0c0a-4880-bc81-db5bd472a49f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:43.771653 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7764fd05-0c0a-4880-bc81-db5bd472a49f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1" status: 200 len: 1526 microversion: 2.1 time: 0.745313 Sep 17 21:00:43.772254 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1234/2528] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:43 2022] GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 => generated 1526 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:43.791743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-10ba46da-1e70-47eb-9822-f3219f04bcc0 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:43.812055 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-10ba46da-1e70-47eb-9822-f3219f04bcc0 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] [instance: caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:43.848864 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10ba46da-1e70-47eb-9822-f3219f04bcc0 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:43.868614 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10ba46da-1e70-47eb-9822-f3219f04bcc0 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:43.869040 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10ba46da-1e70-47eb-9822-f3219f04bcc0 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:43.873238 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-92398456-88ae-4db9-b42d-a71d676fa9ff tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Updating instance_info_cache with network_info: [] {{(pid=140524) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 17 21:00:43.877270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10ba46da-1e70-47eb-9822-f3219f04bcc0 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:43.880660 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10ba46da-1e70-47eb-9822-f3219f04bcc0 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:43.883624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10ba46da-1e70-47eb-9822-f3219f04bcc0 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:43.962109 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-10ba46da-1e70-47eb-9822-f3219f04bcc0 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] HTTP exception thrown: Instance caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 could not be found. Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-10ba46da-1e70-47eb-9822-f3219f04bcc0 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Request method failure captured: Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 HTTP/1.1 Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjUK0KzWxa6mSjj_pP0fjXEoyN5kHVg36NJGDq68fw96nXPym5syYmWHEDYs4_vWu9WgbinhrbnZ0CmVnOeG6ib6KDdv84fVlBoUPMQT0jKQnH3fbXjRr86MdhZdwMUQQwSNNNb92Rx_HXnlFtOHRa3ZmggHyvxsObnUDwWcVfTg3Rw Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 9b45a150f2db4c2bb4871cd1d1cab898 Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ListServerFiltersTestJSON-1137993684 Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b45a150f2db4c2bb4871cd1d1cab898"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9b45a150f2db4c2bb4871cd1d1cab898"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9b45a150f2db4c2bb4871cd1d1cab898"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9b45a150f2db4c2bb4871cd1d1cab898", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ListServerFiltersTestJSON-1137993684 Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 9b45a150f2db4c2bb4871cd1d1cab898 Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1137993684 Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ListServerFiltersTestJSON-1137993684-project Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: da76bbe04c22456f957be0675892359d Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ListServerFiltersTestJSON-1137993684-project Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 could not be found. Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5'} Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 could not be found. Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 could not be found. Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:00:43.967763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:00:43.975254 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:43.975254 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:00:43.975254 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:00:43.975254 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:00:43.975254 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:00:43.975254 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 could not be found. Sep 17 21:00:43.975254 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:00:43.979056 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-10ba46da-1e70-47eb-9822-f3219f04bcc0 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] Returning 404 to user: Instance caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:00:43.982680 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-10ba46da-1e70-47eb-9822-f3219f04bcc0 tempest-ListServerFiltersTestJSON-1137993684 tempest-ListServerFiltersTestJSON-1137993684-project] 10.222.0.26 "GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5" status: 404 len: 111 microversion: 2.1 time: 0.205322 Sep 17 21:00:43.985558 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1235/2529] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:43 2022] GET /compute/v2.1/servers/caa33ce3-d0dd-4b0e-87f2-b7e8f7b068d5 => generated 111 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:00:44.017030 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-817af8d3-e9cd-4aef-8fa5-8b90e29a9a8f tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:44.017706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-817af8d3-e9cd-4aef-8fa5-8b90e29a9a8f tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:44.043501 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-817af8d3-e9cd-4aef-8fa5-8b90e29a9a8f tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:44.045054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-817af8d3-e9cd-4aef-8fa5-8b90e29a9a8f tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:44.048387 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-817af8d3-e9cd-4aef-8fa5-8b90e29a9a8f tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:44.049577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-817af8d3-e9cd-4aef-8fa5-8b90e29a9a8f tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:44.050356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-817af8d3-e9cd-4aef-8fa5-8b90e29a9a8f tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:44.051018 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-817af8d3-e9cd-4aef-8fa5-8b90e29a9a8f tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:44.482412 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-817af8d3-e9cd-4aef-8fa5-8b90e29a9a8f tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5d41f7e95d44d3898f6306bb093ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8813aaee4604882b4cd7a2a8df58077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:44.494535 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-817af8d3-e9cd-4aef-8fa5-8b90e29a9a8f tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297" status: 200 len: 1368 microversion: 2.1 time: 0.506775 Sep 17 21:00:44.505812 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1236/2530] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:43 2022] GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297 => generated 1368 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:44.514698 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-92398456-88ae-4db9-b42d-a71d676fa9ff tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "DELETE /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 204 len: 0 microversion: 2.1 time: 4.721000 Sep 17 21:00:44.516536 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1295/2531] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:00:39 2022] DELETE /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 0 bytes in 4725 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 17 21:00:44.530649 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a98bc8c4-b339-4cb5-b1a6-ccf897d70d1f tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:44.537272 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a98bc8c4-b339-4cb5-b1a6-ccf897d70d1f tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 1d44abe5-d50f-4f59-83fd-65376778153a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:44.543385 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c3614cd3-3acb-4e4b-a72c-11711620f884 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:44.546833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c3614cd3-3acb-4e4b-a72c-11711620f884 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:44.558373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a98bc8c4-b339-4cb5-b1a6-ccf897d70d1f tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:44.562901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a98bc8c4-b339-4cb5-b1a6-ccf897d70d1f tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:44.566426 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3614cd3-3acb-4e4b-a72c-11711620f884 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:44.567178 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a98bc8c4-b339-4cb5-b1a6-ccf897d70d1f tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:44.568314 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a98bc8c4-b339-4cb5-b1a6-ccf897d70d1f tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:44.569785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3614cd3-3acb-4e4b-a72c-11711620f884 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:44.570300 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a98bc8c4-b339-4cb5-b1a6-ccf897d70d1f tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:44.571038 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a98bc8c4-b339-4cb5-b1a6-ccf897d70d1f tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:44.571772 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3614cd3-3acb-4e4b-a72c-11711620f884 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:44.575453 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3614cd3-3acb-4e4b-a72c-11711620f884 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:44.576232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3614cd3-3acb-4e4b-a72c-11711620f884 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:44.576938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3614cd3-3acb-4e4b-a72c-11711620f884 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:44.613294 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-a98bc8c4-b339-4cb5-b1a6-ccf897d70d1f tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] HTTP exception thrown: Instance 1d44abe5-d50f-4f59-83fd-65376778153a could not be found. Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a98bc8c4-b339-4cb5-b1a6-ccf897d70d1f tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Request method failure captured: Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a HTTP/1.1 Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjS1i9XeXSkLU6roIN5-V3M30sbhgULjb8tr8aqExkSAIyZY9VKN0LPVRHnETO5tqunffII5qByrOP0geSwUSYjLFCPdfmPpZzaRnm983vzvqA4kLyBsVXOUYx3Hwv-cKGIwQNFiYUDPza0sBrWpmIqLZCr0r7WnWtNySplD0X_QBe4 Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 3515123097e744ef855ef1129fb59cf1 Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersOnMultiNodesTest-277737609 Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3515123097e744ef855ef1129fb59cf1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3515123097e744ef855ef1129fb59cf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3515123097e744ef855ef1129fb59cf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3515123097e744ef855ef1129fb59cf1", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersOnMultiNodesTest-277737609 Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 3515123097e744ef855ef1129fb59cf1 Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-277737609 Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersOnMultiNodesTest-277737609-project Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 0d48260054d84784b89a52d9b766d7c1 Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersOnMultiNodesTest-277737609-project Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 1d44abe5-d50f-4f59-83fd-65376778153a could not be found. Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '1d44abe5-d50f-4f59-83fd-65376778153a'} Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d44abe5-d50f-4f59-83fd-65376778153a could not be found. Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d44abe5-d50f-4f59-83fd-65376778153a could not be found. Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:00:44.615089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:00:44.619599 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:44.619599 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:00:44.619599 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:00:44.619599 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:00:44.619599 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:00:44.619599 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d44abe5-d50f-4f59-83fd-65376778153a could not be found. Sep 17 21:00:44.619599 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:00:44.621249 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a98bc8c4-b339-4cb5-b1a6-ccf897d70d1f tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Returning 404 to user: Instance 1d44abe5-d50f-4f59-83fd-65376778153a could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:00:44.627001 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a98bc8c4-b339-4cb5-b1a6-ccf897d70d1f tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a" status: 404 len: 111 microversion: 2.1 time: 0.118399 Sep 17 21:00:44.628058 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1237/2532] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:44 2022] GET /compute/v2.1/servers/1d44abe5-d50f-4f59-83fd-65376778153a => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:00:44.638757 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-3b0abc85-f81f-4924-94b7-db9416b3d05b req-c0442b74-9d99-4984-bac9-96b3bf3b4b93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cbeb946-182e-4489-b637-556194f5722e", "name": "network-vif-unplugged", "status": "completed", "tag": "37410e23-230b-4735-b847-6de46f2c7ac9"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:44.665197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-3b0abc85-f81f-4924-94b7-db9416b3d05b req-c0442b74-9d99-4984-bac9-96b3bf3b4b93 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:44.665967 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-3b0abc85-f81f-4924-94b7-db9416b3d05b req-c0442b74-9d99-4984-bac9-96b3bf3b4b93 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:44.666835 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-3b0abc85-f81f-4924-94b7-db9416b3d05b req-c0442b74-9d99-4984-bac9-96b3bf3b4b93 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:44.680992 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-3b0abc85-f81f-4924-94b7-db9416b3d05b req-c0442b74-9d99-4984-bac9-96b3bf3b4b93 service nova] Creating event network-vif-unplugged:37410e23-230b-4735-b847-6de46f2c7ac9 for instance 8cbeb946-182e-4489-b637-556194f5722e on nch1-master-1 Sep 17 21:00:44.699101 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-3b0abc85-f81f-4924-94b7-db9416b3d05b req-c0442b74-9d99-4984-bac9-96b3bf3b4b93 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068980 Sep 17 21:00:44.700709 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1238/2533] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:44.708392 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-980e3304-43e8-47d8-8688-8848df7830a4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:44.713207 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c3614cd3-3acb-4e4b-a72c-11711620f884 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:44.726086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-980e3304-43e8-47d8-8688-8848df7830a4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:44.732886 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c3614cd3-3acb-4e4b-a72c-11711620f884 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1275 microversion: 2.1 time: 0.210063 Sep 17 21:00:44.734941 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1296/2534] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:44 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1275 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:44.745718 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-980e3304-43e8-47d8-8688-8848df7830a4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:44.746263 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-980e3304-43e8-47d8-8688-8848df7830a4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:44.746661 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-980e3304-43e8-47d8-8688-8848df7830a4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:44.747437 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-980e3304-43e8-47d8-8688-8848df7830a4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:44.748022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-980e3304-43e8-47d8-8688-8848df7830a4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:44.748369 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-980e3304-43e8-47d8-8688-8848df7830a4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:44.753303 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:44.754934 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-86feacba-8aef-4855-92bd-b8946ef26ec6 req-0eecc115-e533-4055-a50d-4b8a194bfae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1", "name": "network-vif-deleted", "tag": "144ada83-ad9c-4eae-9a08-a67f7dd67cbf"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:44.773600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-86feacba-8aef-4855-92bd-b8946ef26ec6 req-0eecc115-e533-4055-a50d-4b8a194bfae7 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:44.774455 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-86feacba-8aef-4855-92bd-b8946ef26ec6 req-0eecc115-e533-4055-a50d-4b8a194bfae7 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:44.775091 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-86feacba-8aef-4855-92bd-b8946ef26ec6 req-0eecc115-e533-4055-a50d-4b8a194bfae7 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:44.793355 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-86feacba-8aef-4855-92bd-b8946ef26ec6 req-0eecc115-e533-4055-a50d-4b8a194bfae7 service nova] Creating event network-vif-deleted:144ada83-ad9c-4eae-9a08-a67f7dd67cbf for instance 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 on nch2-master-1 Sep 17 21:00:44.800068 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-86feacba-8aef-4855-92bd-b8946ef26ec6 req-0eecc115-e533-4055-a50d-4b8a194bfae7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060766 Sep 17 21:00:44.801309 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1297/2535] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:44.811048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cfc0a7f1-2a34-4360-824b-a5193c5d8076 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:44.812091 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cfc0a7f1-2a34-4360-824b-a5193c5d8076 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:44.818772 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cfc0a7f1-2a34-4360-824b-a5193c5d8076 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:44.819567 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cfc0a7f1-2a34-4360-824b-a5193c5d8076 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:44.820246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cfc0a7f1-2a34-4360-824b-a5193c5d8076 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:44.821316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cfc0a7f1-2a34-4360-824b-a5193c5d8076 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:44.822108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cfc0a7f1-2a34-4360-824b-a5193c5d8076 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:44.822798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cfc0a7f1-2a34-4360-824b-a5193c5d8076 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:45.143904 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cfc0a7f1-2a34-4360-824b-a5193c5d8076 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:45.147716 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-980e3304-43e8-47d8-8688-8848df7830a4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:45.162490 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-980e3304-43e8-47d8-8688-8848df7830a4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:45.163947 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-980e3304-43e8-47d8-8688-8848df7830a4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:45.169139 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-980e3304-43e8-47d8-8688-8848df7830a4 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 2820 microversion: 2.32 time: 0.463098 Sep 17 21:00:45.190149 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1239/2536] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:00:44 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 2820 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:00:45.195682 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cfc0a7f1-2a34-4360-824b-a5193c5d8076 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1477 microversion: 2.1 time: 0.392158 Sep 17 21:00:45.207896 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1298/2537] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:44 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1477 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:45.210350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-2a158b9c-6172-46fc-9e58-cc0a2e5c8b2d req-34ac4b63-cf26-4433-b1a2-0f31e6b1bc61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b13c98-aea4-497c-a213-142393b2758c", "name": "network-vif-deleted", "tag": "f1f9bbb6-1fce-45e9-b23b-60319ea313bb"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:45.220882 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ce715d60-cebf-47a7-a0ae-72c087a7f648 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:45.221557 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ce715d60-cebf-47a7-a0ae-72c087a7f648 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:45.223432 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2a158b9c-6172-46fc-9e58-cc0a2e5c8b2d req-34ac4b63-cf26-4433-b1a2-0f31e6b1bc61 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:45.223953 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2a158b9c-6172-46fc-9e58-cc0a2e5c8b2d req-34ac4b63-cf26-4433-b1a2-0f31e6b1bc61 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:45.224446 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2a158b9c-6172-46fc-9e58-cc0a2e5c8b2d req-34ac4b63-cf26-4433-b1a2-0f31e6b1bc61 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:45.244159 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce715d60-cebf-47a7-a0ae-72c087a7f648 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:45.246564 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce715d60-cebf-47a7-a0ae-72c087a7f648 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:45.247029 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce715d60-cebf-47a7-a0ae-72c087a7f648 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:45.250844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce715d60-cebf-47a7-a0ae-72c087a7f648 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:45.251420 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce715d60-cebf-47a7-a0ae-72c087a7f648 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:45.251856 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce715d60-cebf-47a7-a0ae-72c087a7f648 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:45.260598 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-2a158b9c-6172-46fc-9e58-cc0a2e5c8b2d req-34ac4b63-cf26-4433-b1a2-0f31e6b1bc61 service nova] Creating event network-vif-deleted:f1f9bbb6-1fce-45e9-b23b-60319ea313bb for instance 22b13c98-aea4-497c-a213-142393b2758c on nch2-master-1 Sep 17 21:00:45.266922 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:45.279916 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-2a158b9c-6172-46fc-9e58-cc0a2e5c8b2d req-34ac4b63-cf26-4433-b1a2-0f31e6b1bc61 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088240 Sep 17 21:00:45.280988 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1240/2538] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:45.286107 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6f5d65a2-be3b-4082-b6e4-09c3e962f29d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:45.286717 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6f5d65a2-be3b-4082-b6e4-09c3e962f29d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 71d2c783-2772-442d-b38c-920fcf895b77] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:45.307712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6f5d65a2-be3b-4082-b6e4-09c3e962f29d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:45.308187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6f5d65a2-be3b-4082-b6e4-09c3e962f29d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:45.308553 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6f5d65a2-be3b-4082-b6e4-09c3e962f29d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:45.309500 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6f5d65a2-be3b-4082-b6e4-09c3e962f29d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:45.309979 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6f5d65a2-be3b-4082-b6e4-09c3e962f29d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:45.310416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6f5d65a2-be3b-4082-b6e4-09c3e962f29d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:45.310854 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-ce715d60-cebf-47a7-a0ae-72c087a7f648 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] HTTP exception thrown: Instance 126bfb0a-a567-407a-becb-4f5a814da7c6 could not be found. Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ce715d60-cebf-47a7-a0ae-72c087a7f648 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Request method failure captured: Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 HTTP/1.1 Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjSr4eYJ5iRC0BESTxyEYBHr6fTKXAfzmSKRijJd1-Dg4_6zeDPSLMVKcn7Va4xyX_oACpKQBdCcihzycrxxeD9gtcf6rUAIbBHhHnQZK1W2woTj604P1AONqCzsshMWFY41NR-lshpdEXKwYePjmUqN1wZWN-nWEva1tUOKD4iFshs Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89b46ae7347d4f2daf02f627e41a4847", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-DeleteServersTestJSON-583053734 Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 3009c5feb1ef43a08b07996d8f63bf11 Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 126bfb0a-a567-407a-becb-4f5a814da7c6 could not be found. Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '126bfb0a-a567-407a-becb-4f5a814da7c6'} Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 126bfb0a-a567-407a-becb-4f5a814da7c6 could not be found. Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 126bfb0a-a567-407a-becb-4f5a814da7c6 could not be found. Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:00:45.317818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:45.322693 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:45.322693 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:00:45.322693 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:00:45.322693 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:00:45.322693 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:00:45.322693 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 126bfb0a-a567-407a-becb-4f5a814da7c6 could not be found. Sep 17 21:00:45.322693 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:45.322693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ce715d60-cebf-47a7-a0ae-72c087a7f648 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Returning 404 to user: Instance 126bfb0a-a567-407a-becb-4f5a814da7c6 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:00:45.327854 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ce715d60-cebf-47a7-a0ae-72c087a7f648 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 404 len: 111 microversion: 2.1 time: 0.117262 Sep 17 21:00:45.330485 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1299/2539] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:45 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:00:45.345726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cbac1f73-3e0b-4aa9-82b3-ef7440862c5a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:45.345726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cbac1f73-3e0b-4aa9-82b3-ef7440862c5a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:45.370473 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6f5d65a2-be3b-4082-b6e4-09c3e962f29d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 71d2c783-2772-442d-b38c-920fcf895b77] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:00:45.374150 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbac1f73-3e0b-4aa9-82b3-ef7440862c5a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:45.376010 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbac1f73-3e0b-4aa9-82b3-ef7440862c5a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:45.397184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbac1f73-3e0b-4aa9-82b3-ef7440862c5a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:45.398278 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbac1f73-3e0b-4aa9-82b3-ef7440862c5a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:45.398765 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbac1f73-3e0b-4aa9-82b3-ef7440862c5a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:45.399203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbac1f73-3e0b-4aa9-82b3-ef7440862c5a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:45.553632 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbac1f73-3e0b-4aa9-82b3-ef7440862c5a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:45.555613 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbac1f73-3e0b-4aa9-82b3-ef7440862c5a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:45.558058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbac1f73-3e0b-4aa9-82b3-ef7440862c5a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:45.560707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-cbac1f73-3e0b-4aa9-82b3-ef7440862c5a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lazy-loading 'fault' on Instance uuid 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:00:45.574837 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6f5d65a2-be3b-4082-b6e4-09c3e962f29d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "DELETE /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77" status: 204 len: 0 microversion: 2.1 time: 0.292481 Sep 17 21:00:45.575626 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1241/2540] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:00:45 2022] DELETE /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:00:45.601593 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6d07566b-a632-45b0-bef9-da8afafbe7dc tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:45.609243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6d07566b-a632-45b0-bef9-da8afafbe7dc tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:45.623739 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d07566b-a632-45b0-bef9-da8afafbe7dc tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:45.630179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d07566b-a632-45b0-bef9-da8afafbe7dc tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:45.630639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d07566b-a632-45b0-bef9-da8afafbe7dc tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:45.631599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d07566b-a632-45b0-bef9-da8afafbe7dc tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:45.632101 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d07566b-a632-45b0-bef9-da8afafbe7dc tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:45.632927 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d07566b-a632-45b0-bef9-da8afafbe7dc tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:45.662458 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cbac1f73-3e0b-4aa9-82b3-ef7440862c5a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:45.677528 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cbac1f73-3e0b-4aa9-82b3-ef7440862c5a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1" status: 200 len: 1315 microversion: 2.1 time: 0.344742 Sep 17 21:00:45.679405 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1300/2541] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:45 2022] GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:45.694423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e65e8576-d5a2-45a4-8c46-76410c1697aa tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:45.699433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e65e8576-d5a2-45a4-8c46-76410c1697aa tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 71d2c783-2772-442d-b38c-920fcf895b77] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:45.712833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e65e8576-d5a2-45a4-8c46-76410c1697aa tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:45.713447 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e65e8576-d5a2-45a4-8c46-76410c1697aa tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:45.713918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e65e8576-d5a2-45a4-8c46-76410c1697aa tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:45.720515 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e65e8576-d5a2-45a4-8c46-76410c1697aa tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:45.721419 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e65e8576-d5a2-45a4-8c46-76410c1697aa tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:45.722048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e65e8576-d5a2-45a4-8c46-76410c1697aa tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:46.169644 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6d07566b-a632-45b0-bef9-da8afafbe7dc tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5d41f7e95d44d3898f6306bb093ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8813aaee4604882b4cd7a2a8df58077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:46.177494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e65e8576-d5a2-45a4-8c46-76410c1697aa tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:46.181031 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6d07566b-a632-45b0-bef9-da8afafbe7dc tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297" status: 200 len: 1368 microversion: 2.1 time: 0.598304 Sep 17 21:00:46.182554 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1242/2542] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:45 2022] GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297 => generated 1368 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:46.188856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bcead1fc-3731-41d9-a7c8-50c28b906adf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2073612096", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "25526ef3-eaa2-4f18-ac44-bfbbfae855ea"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:46.197154 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e65e8576-d5a2-45a4-8c46-76410c1697aa tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77" status: 200 len: 1472 microversion: 2.1 time: 0.514177 Sep 17 21:00:46.210569 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1301/2543] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:45 2022] GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77 => generated 1472 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:46.219686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7bf726c8-158c-4daa-8c99-c663e2b90ab6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:46.220542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7bf726c8-158c-4daa-8c99-c663e2b90ab6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:46.226835 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7bf726c8-158c-4daa-8c99-c663e2b90ab6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:46.227414 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7bf726c8-158c-4daa-8c99-c663e2b90ab6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:46.227988 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7bf726c8-158c-4daa-8c99-c663e2b90ab6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:46.228963 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7bf726c8-158c-4daa-8c99-c663e2b90ab6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:46.230873 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7bf726c8-158c-4daa-8c99-c663e2b90ab6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:46.230873 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7bf726c8-158c-4daa-8c99-c663e2b90ab6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:46.302160 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-bcead1fc-3731-41d9-a7c8-50c28b906adf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] validate_networks() for [('25526ef3-eaa2-4f18-ac44-bfbbfae855ea', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:00:46.903864 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7bf726c8-158c-4daa-8c99-c663e2b90ab6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:46.917666 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7bf726c8-158c-4daa-8c99-c663e2b90ab6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1317 microversion: 2.1 time: 0.705665 Sep 17 21:00:46.918896 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1302/2544] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:46 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1317 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:46.933722 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4b0fe66f-ca4b-471d-85ec-4accc1fcbefa tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:46.935745 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4b0fe66f-ca4b-471d-85ec-4accc1fcbefa tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:46.944622 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b0fe66f-ca4b-471d-85ec-4accc1fcbefa tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:46.945134 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b0fe66f-ca4b-471d-85ec-4accc1fcbefa tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:46.945592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b0fe66f-ca4b-471d-85ec-4accc1fcbefa tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:46.946490 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b0fe66f-ca4b-471d-85ec-4accc1fcbefa tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:46.947183 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b0fe66f-ca4b-471d-85ec-4accc1fcbefa tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:46.947658 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b0fe66f-ca4b-471d-85ec-4accc1fcbefa tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:47.347785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4b0fe66f-ca4b-471d-85ec-4accc1fcbefa tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:47.358971 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4b0fe66f-ca4b-471d-85ec-4accc1fcbefa tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:47.361350 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4b0fe66f-ca4b-471d-85ec-4accc1fcbefa tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:47.362768 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4b0fe66f-ca4b-471d-85ec-4accc1fcbefa tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 2706 microversion: 2.32 time: 0.442672 Sep 17 21:00:47.365601 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1303/2545] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:00:46 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 2706 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:00:47.371207 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c0c348fb-7731-4219-8278-6a73749c6d2f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:47.372077 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c0c348fb-7731-4219-8278-6a73749c6d2f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:47.380233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0c348fb-7731-4219-8278-6a73749c6d2f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:47.381117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0c348fb-7731-4219-8278-6a73749c6d2f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:47.382248 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0c348fb-7731-4219-8278-6a73749c6d2f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:47.383759 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0c348fb-7731-4219-8278-6a73749c6d2f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:47.384443 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0c348fb-7731-4219-8278-6a73749c6d2f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:47.385686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0c348fb-7731-4219-8278-6a73749c6d2f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:47.640420 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-bcead1fc-3731-41d9-a7c8-50c28b906adf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:00:47.642699 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-bcead1fc-3731-41d9-a7c8-50c28b906adf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:00:47.645339 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-bcead1fc-3731-41d9-a7c8-50c28b906adf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:00:47.646353 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-bcead1fc-3731-41d9-a7c8-50c28b906adf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:00:47.646797 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-bcead1fc-3731-41d9-a7c8-50c28b906adf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:00:47.660223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c0c348fb-7731-4219-8278-6a73749c6d2f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:47.678132 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c0c348fb-7731-4219-8278-6a73749c6d2f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1477 microversion: 2.1 time: 0.312723 Sep 17 21:00:47.678785 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1304/2546] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:47 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1477 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:47.682327 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bcead1fc-3731-41d9-a7c8-50c28b906adf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:47.686495 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bcead1fc-3731-41d9-a7c8-50c28b906adf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:47.689321 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bcead1fc-3731-41d9-a7c8-50c28b906adf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:47.690377 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bcead1fc-3731-41d9-a7c8-50c28b906adf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:47.691002 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bcead1fc-3731-41d9-a7c8-50c28b906adf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:47.692606 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-52e9791a-6923-4bf9-b46d-7508904d8323 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:47.693209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bcead1fc-3731-41d9-a7c8-50c28b906adf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:47.696550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-52e9791a-6923-4bf9-b46d-7508904d8323 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:47.718936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-52e9791a-6923-4bf9-b46d-7508904d8323 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:47.719871 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-52e9791a-6923-4bf9-b46d-7508904d8323 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:47.720688 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-52e9791a-6923-4bf9-b46d-7508904d8323 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:47.721099 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-52e9791a-6923-4bf9-b46d-7508904d8323 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:47.721613 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-52e9791a-6923-4bf9-b46d-7508904d8323 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:47.722049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-52e9791a-6923-4bf9-b46d-7508904d8323 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:47.750978 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-bcead1fc-3731-41d9-a7c8-50c28b906adf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Getting quotas for project 89b46ae7347d4f2daf02f627e41a4847. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:00:47.760221 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-52e9791a-6923-4bf9-b46d-7508904d8323 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] HTTP exception thrown: Instance 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 could not be found. Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-52e9791a-6923-4bf9-b46d-7508904d8323 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Request method failure captured: Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 HTTP/1.1 Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjVSncfbAtgCIyToozPzw5wAkwJ8A5Pq3oENCAdqUUIYA48iSRlVG7zkjE71pODQ7Vq39Whu62dN5SwPbwvIXMyuqDiapFCgUkVVyC-O5o-Rbhev8SZVJvwjqio0qc_eiz6AU5vzIes11QJweqLBoCqKJfa2-0GqtVV9pkib7fT-OL0 Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 004f77fba4b14080bca4ae36c857add3 Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_004f77fba4b14080bca4ae36c857add3", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 004f77fba4b14080bca4ae36c857add3 Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ImagesOneServerNegativeTestJSON-622753367-project Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 22306a93c9404db393b92a267d6258d4 Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-622753367-project Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 could not be found. Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1'} Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 could not be found. Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 could not be found. Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:47.762628 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:00:47.778530 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:47.778530 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:47.778530 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:00:47.778530 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:00:47.778530 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:00:47.778530 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:00:47.778530 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 could not be found. Sep 17 21:00:47.778530 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:47.778530 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-52e9791a-6923-4bf9-b46d-7508904d8323 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Returning 404 to user: Instance 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:00:47.778530 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-52e9791a-6923-4bf9-b46d-7508904d8323 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1" status: 404 len: 111 microversion: 2.1 time: 0.080462 Sep 17 21:00:47.778530 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1305/2547] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:47 2022] GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:00:47.778530 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-5f419a59-5f2b-4f75-adf4-81fa133b6060 req-3d508900-04b1-4d80-87f4-06e183350f4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cbeb946-182e-4489-b637-556194f5722e", "name": "network-vif-plugged", "status": "completed", "tag": "37410e23-230b-4735-b847-6de46f2c7ac9"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:47.780381 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-bcead1fc-3731-41d9-a7c8-50c28b906adf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Getting quotas for user 3009c5feb1ef43a08b07996d8f63bf11 and project 89b46ae7347d4f2daf02f627e41a4847. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:00:47.783400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-5f419a59-5f2b-4f75-adf4-81fa133b6060 req-3d508900-04b1-4d80-87f4-06e183350f4e service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:47.783901 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-5f419a59-5f2b-4f75-adf4-81fa133b6060 req-3d508900-04b1-4d80-87f4-06e183350f4e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:47.784364 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-5f419a59-5f2b-4f75-adf4-81fa133b6060 req-3d508900-04b1-4d80-87f4-06e183350f4e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:47.804467 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bcead1fc-3731-41d9-a7c8-50c28b906adf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:00:47.811895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bcead1fc-3731-41d9-a7c8-50c28b906adf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:00:47.819982 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-5f419a59-5f2b-4f75-adf4-81fa133b6060 req-3d508900-04b1-4d80-87f4-06e183350f4e service nova] Creating event network-vif-plugged:37410e23-230b-4735-b847-6de46f2c7ac9 for instance 8cbeb946-182e-4489-b637-556194f5722e on nch1-master-1 Sep 17 21:00:47.831244 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-5f419a59-5f2b-4f75-adf4-81fa133b6060 req-3d508900-04b1-4d80-87f4-06e183350f4e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065200 Sep 17 21:00:47.834515 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1306/2548] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:47.862437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-6dfe6589-883c-43a5-9721-41b13b62dc97 req-f45b466f-1771-4c7b-a3c7-f9b2393d23fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "126bfb0a-a567-407a-becb-4f5a814da7c6", "name": "network-vif-deleted", "tag": "6804739c-1745-41d6-b864-b17b1ed8921d"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:47.906706 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6dfe6589-883c-43a5-9721-41b13b62dc97 req-f45b466f-1771-4c7b-a3c7-f9b2393d23fe service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:47.907208 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6dfe6589-883c-43a5-9721-41b13b62dc97 req-f45b466f-1771-4c7b-a3c7-f9b2393d23fe service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:47.907635 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6dfe6589-883c-43a5-9721-41b13b62dc97 req-f45b466f-1771-4c7b-a3c7-f9b2393d23fe service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:47.915464 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bcead1fc-3731-41d9-a7c8-50c28b906adf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.730179 Sep 17 21:00:47.922237 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1243/2549] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:00:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:00:47.926645 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6fb8dc30-6018-47e1-bcde-33aff2bc55f6 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:47.927264 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6fb8dc30-6018-47e1-bcde-33aff2bc55f6 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:47.938148 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.compute.server_external_events [req-6dfe6589-883c-43a5-9721-41b13b62dc97 req-f45b466f-1771-4c7b-a3c7-f9b2393d23fe service nova] Unable to find a host for instance 126bfb0a-a567-407a-becb-4f5a814da7c6. Dropping event network-vif-deleted {{(pid=140524) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 17 21:00:47.939079 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-6dfe6589-883c-43a5-9721-41b13b62dc97 req-f45b466f-1771-4c7b-a3c7-f9b2393d23fe service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.101426 Sep 17 21:00:47.941231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fb8dc30-6018-47e1-bcde-33aff2bc55f6 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:47.941757 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fb8dc30-6018-47e1-bcde-33aff2bc55f6 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:47.942193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fb8dc30-6018-47e1-bcde-33aff2bc55f6 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:47.942897 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fb8dc30-6018-47e1-bcde-33aff2bc55f6 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:47.943344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fb8dc30-6018-47e1-bcde-33aff2bc55f6 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:47.943766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fb8dc30-6018-47e1-bcde-33aff2bc55f6 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:47.948627 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1307/2550] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 113 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 17 21:00:47.956774 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fc676e8f-52d3-4992-bd42-92084f5a4f11 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:47.958738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fc676e8f-52d3-4992-bd42-92084f5a4f11 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 71d2c783-2772-442d-b38c-920fcf895b77] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:47.970970 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc676e8f-52d3-4992-bd42-92084f5a4f11 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:47.987320 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc676e8f-52d3-4992-bd42-92084f5a4f11 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:47.988066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc676e8f-52d3-4992-bd42-92084f5a4f11 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:47.989572 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc676e8f-52d3-4992-bd42-92084f5a4f11 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:47.994243 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc676e8f-52d3-4992-bd42-92084f5a4f11 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:47.994696 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc676e8f-52d3-4992-bd42-92084f5a4f11 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:48.127446 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fc676e8f-52d3-4992-bd42-92084f5a4f11 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:48.136733 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fc676e8f-52d3-4992-bd42-92084f5a4f11 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77" status: 200 len: 1430 microversion: 2.1 time: 0.186807 Sep 17 21:00:48.137731 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1308/2551] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:47 2022] GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77 => generated 1430 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:48.255169 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:48.453823 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6fb8dc30-6018-47e1-bcde-33aff2bc55f6 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5d41f7e95d44d3898f6306bb093ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8813aaee4604882b4cd7a2a8df58077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:48.457929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-7089e228-32dc-4ca8-b997-710f8b5940c8 req-6ae49b14-3b28-462b-9f18-58cc9f11c8c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a1dbfb5-be75-451c-8ca8-a71949ac2297", "tag": "bb1dd815-ecd5-488c-93a4-3f015b5427ae"}, {"server_uuid": "22b13c98-aea4-497c-a213-142393b2758c", "name": "network-vif-deleted", "tag": "7c3cbfdf-d88c-428e-969f-2451f881cc2b"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:48.474304 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6fb8dc30-6018-47e1-bcde-33aff2bc55f6 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297" status: 200 len: 1368 microversion: 2.1 time: 0.553274 Sep 17 21:00:48.481618 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1244/2552] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:47 2022] GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297 => generated 1368 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:48.493566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7089e228-32dc-4ca8-b997-710f8b5940c8 req-6ae49b14-3b28-462b-9f18-58cc9f11c8c2 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:48.496473 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-820f9c0b-3b3c-41bb-ae81-7d3ecfddcf6d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Action: 'create', calling method: .version_select at 0x7f25a4897f70>, body: {"keypair": {"name": "tempest-keypair-2111745744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeaBRbWeG3Mn8dHTI9rH8eEA+fiDwFgTzi/KxvilVqFy2zq2Xgxry9CTpevXB7tYSOwYY+lHgU+9PwTxy00cLEasI0emu6rO7qRyOHD2WX0fckLY+yIfDtbpUFFeBtFfA=="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:48.497259 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7089e228-32dc-4ca8-b997-710f8b5940c8 req-6ae49b14-3b28-462b-9f18-58cc9f11c8c2 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:48.499539 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7089e228-32dc-4ca8-b997-710f8b5940c8 req-6ae49b14-3b28-462b-9f18-58cc9f11c8c2 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:48.542417 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-7089e228-32dc-4ca8-b997-710f8b5940c8 req-6ae49b14-3b28-462b-9f18-58cc9f11c8c2 service nova] Creating event network-changed:bb1dd815-ecd5-488c-93a4-3f015b5427ae for instance 6a1dbfb5-be75-451c-8ca8-a71949ac2297 on nch2-master-1 Sep 17 21:00:48.545303 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-820f9c0b-3b3c-41bb-ae81-7d3ecfddcf6d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Getting quotas for project 004f77fba4b14080bca4ae36c857add3. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:00:48.546724 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-7089e228-32dc-4ca8-b997-710f8b5940c8 req-6ae49b14-3b28-462b-9f18-58cc9f11c8c2 service nova] Creating event network-vif-deleted:7c3cbfdf-d88c-428e-969f-2451f881cc2b for instance 22b13c98-aea4-497c-a213-142393b2758c on nch2-master-1 Sep 17 21:00:48.571702 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-820f9c0b-3b3c-41bb-ae81-7d3ecfddcf6d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Getting quotas for user 22306a93c9404db393b92a267d6258d4 and project 004f77fba4b14080bca4ae36c857add3. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:00:48.573739 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-7089e228-32dc-4ca8-b997-710f8b5940c8 req-6ae49b14-3b28-462b-9f18-58cc9f11c8c2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.431922 Sep 17 21:00:48.574380 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1309/2553] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:48.589699 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cd7437c0-1d0c-4049-b24a-c5655637fda3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:48.594167 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cd7437c0-1d0c-4049-b24a-c5655637fda3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:48.642361 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-820f9c0b-3b3c-41bb-ae81-7d3ecfddcf6d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.157957 Sep 17 21:00:48.644053 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1245/2554] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:00:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:48.654418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cc653831-c89d-47ac-9d67-25a00c35a88a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:48.656371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cc653831-c89d-47ac-9d67-25a00c35a88a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:48.674121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:48.676426 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc653831-c89d-47ac-9d67-25a00c35a88a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:48.677424 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc653831-c89d-47ac-9d67-25a00c35a88a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:48.678452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc653831-c89d-47ac-9d67-25a00c35a88a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:48.679430 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc653831-c89d-47ac-9d67-25a00c35a88a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:48.680113 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc653831-c89d-47ac-9d67-25a00c35a88a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:48.680763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc653831-c89d-47ac-9d67-25a00c35a88a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:48.889165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cd7437c0-1d0c-4049-b24a-c5655637fda3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:48.912851 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cd7437c0-1d0c-4049-b24a-c5655637fda3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 200 len: 1215 microversion: 2.1 time: 0.320086 Sep 17 21:00:48.918425 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1310/2555] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:48 2022] GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 1215 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:48.935378 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ef7b1204-67ed-4e74-94f9-84ca49d76344 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:48.937712 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ef7b1204-67ed-4e74-94f9-84ca49d76344 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:48.957279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef7b1204-67ed-4e74-94f9-84ca49d76344 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:48.961043 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef7b1204-67ed-4e74-94f9-84ca49d76344 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:48.961807 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef7b1204-67ed-4e74-94f9-84ca49d76344 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:48.968108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef7b1204-67ed-4e74-94f9-84ca49d76344 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:48.969199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef7b1204-67ed-4e74-94f9-84ca49d76344 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:48.972748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef7b1204-67ed-4e74-94f9-84ca49d76344 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:49.192059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cc653831-c89d-47ac-9d67-25a00c35a88a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:49.202186 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cc653831-c89d-47ac-9d67-25a00c35a88a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1317 microversion: 2.1 time: 0.556870 Sep 17 21:00:49.217445 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1246/2556] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:48 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1317 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:49.223483 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4f5cbc3e-4b68-4623-9ca4-7d1e50b88ed3 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:49.224328 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4f5cbc3e-4b68-4623-9ca4-7d1e50b88ed3 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:49.232201 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f5cbc3e-4b68-4623-9ca4-7d1e50b88ed3 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:49.232727 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f5cbc3e-4b68-4623-9ca4-7d1e50b88ed3 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:49.233192 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f5cbc3e-4b68-4623-9ca4-7d1e50b88ed3 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:49.234567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f5cbc3e-4b68-4623-9ca4-7d1e50b88ed3 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:49.235049 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f5cbc3e-4b68-4623-9ca4-7d1e50b88ed3 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:49.235488 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f5cbc3e-4b68-4623-9ca4-7d1e50b88ed3 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:49.401279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ef7b1204-67ed-4e74-94f9-84ca49d76344 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:49.414688 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ef7b1204-67ed-4e74-94f9-84ca49d76344 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:49.416178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ef7b1204-67ed-4e74-94f9-84ca49d76344 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:49.427142 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ef7b1204-67ed-4e74-94f9-84ca49d76344 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 2659 microversion: 2.32 time: 0.506912 Sep 17 21:00:49.428509 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1311/2557] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:00:48 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 2659 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:00:49.439018 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ffdbc0da-f8e4-4fdc-9a08-bfe879f0ffb0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:49.439858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ffdbc0da-f8e4-4fdc-9a08-bfe879f0ffb0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 71d2c783-2772-442d-b38c-920fcf895b77] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:49.449657 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ffdbc0da-f8e4-4fdc-9a08-bfe879f0ffb0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:49.450434 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ffdbc0da-f8e4-4fdc-9a08-bfe879f0ffb0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:49.451091 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ffdbc0da-f8e4-4fdc-9a08-bfe879f0ffb0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:49.451982 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ffdbc0da-f8e4-4fdc-9a08-bfe879f0ffb0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:49.452675 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ffdbc0da-f8e4-4fdc-9a08-bfe879f0ffb0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:49.453876 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ffdbc0da-f8e4-4fdc-9a08-bfe879f0ffb0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:49.496227 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ffdbc0da-f8e4-4fdc-9a08-bfe879f0ffb0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:49.497603 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ffdbc0da-f8e4-4fdc-9a08-bfe879f0ffb0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:49.498189 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ffdbc0da-f8e4-4fdc-9a08-bfe879f0ffb0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:49.498791 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-ffdbc0da-f8e4-4fdc-9a08-bfe879f0ffb0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lazy-loading 'fault' on Instance uuid 71d2c783-2772-442d-b38c-920fcf895b77 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:00:49.525210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4f5cbc3e-4b68-4623-9ca4-7d1e50b88ed3 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:49.538628 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4f5cbc3e-4b68-4623-9ca4-7d1e50b88ed3 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1477 microversion: 2.1 time: 0.319673 Sep 17 21:00:49.539764 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1247/2558] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:49 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1477 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:49.544852 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b3c62a68-253e-4077-8734-2fc3427c6520 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:49.545699 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b3c62a68-253e-4077-8734-2fc3427c6520 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:49.561718 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3c62a68-253e-4077-8734-2fc3427c6520 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:49.562397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3c62a68-253e-4077-8734-2fc3427c6520 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:49.563159 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3c62a68-253e-4077-8734-2fc3427c6520 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:49.563902 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3c62a68-253e-4077-8734-2fc3427c6520 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:49.564571 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3c62a68-253e-4077-8734-2fc3427c6520 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:49.564878 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ffdbc0da-f8e4-4fdc-9a08-bfe879f0ffb0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:49.565005 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3c62a68-253e-4077-8734-2fc3427c6520 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:49.580988 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ffdbc0da-f8e4-4fdc-9a08-bfe879f0ffb0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77" status: 200 len: 1306 microversion: 2.1 time: 0.151131 Sep 17 21:00:49.582456 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1312/2559] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:49 2022] GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77 => generated 1306 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:49.852859 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b3c62a68-253e-4077-8734-2fc3427c6520 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5d41f7e95d44d3898f6306bb093ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8813aaee4604882b4cd7a2a8df58077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:49.861314 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b3c62a68-253e-4077-8734-2fc3427c6520 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297" status: 200 len: 1368 microversion: 2.1 time: 0.320328 Sep 17 21:00:49.873730 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1248/2560] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:49 2022] GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297 => generated 1368 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:49.943292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-effa8bdb-20b2-4c8d-bec8-8b8d25bc68a7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:49.944631 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-effa8bdb-20b2-4c8d-bec8-8b8d25bc68a7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:49.953426 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-effa8bdb-20b2-4c8d-bec8-8b8d25bc68a7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:49.953921 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-effa8bdb-20b2-4c8d-bec8-8b8d25bc68a7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:49.954382 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-effa8bdb-20b2-4c8d-bec8-8b8d25bc68a7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:49.955199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-effa8bdb-20b2-4c8d-bec8-8b8d25bc68a7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:49.955978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-effa8bdb-20b2-4c8d-bec8-8b8d25bc68a7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:49.957266 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-effa8bdb-20b2-4c8d-bec8-8b8d25bc68a7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:49.982334 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-ce4dc0ac-a80d-4adb-b09f-d5e440f2031c req-5a1ce5ad-6b42-47e0-88bd-af99806fe2e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71d2c783-2772-442d-b38c-920fcf895b77", "name": "network-vif-deleted", "tag": "ea7793b0-9fda-46af-b315-de942d1003d2"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:50.002662 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-ce4dc0ac-a80d-4adb-b09f-d5e440f2031c req-5a1ce5ad-6b42-47e0-88bd-af99806fe2e5 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:50.003583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-ce4dc0ac-a80d-4adb-b09f-d5e440f2031c req-5a1ce5ad-6b42-47e0-88bd-af99806fe2e5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:50.004163 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-ce4dc0ac-a80d-4adb-b09f-d5e440f2031c req-5a1ce5ad-6b42-47e0-88bd-af99806fe2e5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:50.035613 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-ce4dc0ac-a80d-4adb-b09f-d5e440f2031c req-5a1ce5ad-6b42-47e0-88bd-af99806fe2e5 service nova] Creating event network-vif-deleted:ea7793b0-9fda-46af-b315-de942d1003d2 for instance 71d2c783-2772-442d-b38c-920fcf895b77 on nch2-master-1 Sep 17 21:00:50.042946 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-ce4dc0ac-a80d-4adb-b09f-d5e440f2031c req-5a1ce5ad-6b42-47e0-88bd-af99806fe2e5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065712 Sep 17 21:00:50.049196 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1249/2561] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:50.162953 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-effa8bdb-20b2-4c8d-bec8-8b8d25bc68a7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:50.172745 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-effa8bdb-20b2-4c8d-bec8-8b8d25bc68a7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 200 len: 1267 microversion: 2.1 time: 0.235057 Sep 17 21:00:50.175482 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1313/2562] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:49 2022] GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 1267 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:50.227791 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6c47b3bd-b808-4737-9685-12f2531cd151 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:50.228790 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6c47b3bd-b808-4737-9685-12f2531cd151 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:50.243171 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6c47b3bd-b808-4737-9685-12f2531cd151 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:50.244707 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6c47b3bd-b808-4737-9685-12f2531cd151 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:50.245929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6c47b3bd-b808-4737-9685-12f2531cd151 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:50.250221 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6c47b3bd-b808-4737-9685-12f2531cd151 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:50.250917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6c47b3bd-b808-4737-9685-12f2531cd151 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:50.251556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6c47b3bd-b808-4737-9685-12f2531cd151 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:50.457966 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-82d27228-8129-43d6-b4f1-906d8067d644 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:50.458815 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-82d27228-8129-43d6-b4f1-906d8067d644 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:50.472205 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-82d27228-8129-43d6-b4f1-906d8067d644 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:50.472691 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-82d27228-8129-43d6-b4f1-906d8067d644 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:50.480149 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-82d27228-8129-43d6-b4f1-906d8067d644 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:50.481201 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-82d27228-8129-43d6-b4f1-906d8067d644 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:50.481868 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-82d27228-8129-43d6-b4f1-906d8067d644 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:50.482477 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-82d27228-8129-43d6-b4f1-906d8067d644 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:50.750824 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-82d27228-8129-43d6-b4f1-906d8067d644 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:50.778171 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-82d27228-8129-43d6-b4f1-906d8067d644 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:50.779979 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-82d27228-8129-43d6-b4f1-906d8067d644 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:50.781332 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-82d27228-8129-43d6-b4f1-906d8067d644 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 2258 microversion: 2.32 time: 0.328643 Sep 17 21:00:50.789408 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1314/2563] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:00:50 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 2258 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:00:50.804212 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2a148781-3d7a-4876-b2a6-f08787ecfccf tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:50.804909 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2a148781-3d7a-4876-b2a6-f08787ecfccf tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:50.817972 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a148781-3d7a-4876-b2a6-f08787ecfccf tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:50.822371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a148781-3d7a-4876-b2a6-f08787ecfccf tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:50.823279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a148781-3d7a-4876-b2a6-f08787ecfccf tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:50.824050 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a148781-3d7a-4876-b2a6-f08787ecfccf tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:50.825155 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a148781-3d7a-4876-b2a6-f08787ecfccf tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:50.825789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a148781-3d7a-4876-b2a6-f08787ecfccf tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:50.859721 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6c47b3bd-b808-4737-9685-12f2531cd151 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:50.869423 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6c47b3bd-b808-4737-9685-12f2531cd151 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1317 microversion: 2.1 time: 0.648574 Sep 17 21:00:50.873606 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1250/2564] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:50 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1317 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:50.885107 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-eee88b23-b6bb-42a7-93ca-00fa1d2ee540 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:50.886051 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-eee88b23-b6bb-42a7-93ca-00fa1d2ee540 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 71d2c783-2772-442d-b38c-920fcf895b77] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:50.902514 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eee88b23-b6bb-42a7-93ca-00fa1d2ee540 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:50.903019 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eee88b23-b6bb-42a7-93ca-00fa1d2ee540 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:50.904717 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eee88b23-b6bb-42a7-93ca-00fa1d2ee540 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:50.904717 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eee88b23-b6bb-42a7-93ca-00fa1d2ee540 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:50.904717 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eee88b23-b6bb-42a7-93ca-00fa1d2ee540 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:50.905027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eee88b23-b6bb-42a7-93ca-00fa1d2ee540 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:50.937294 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-eee88b23-b6bb-42a7-93ca-00fa1d2ee540 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] HTTP exception thrown: Instance 71d2c783-2772-442d-b38c-920fcf895b77 could not be found. Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-eee88b23-b6bb-42a7-93ca-00fa1d2ee540 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Request method failure captured: Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77 HTTP/1.1 Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjS1i9XeXSkLU6roIN5-V3M30sbhgULjb8tr8aqExkSAIyZY9VKN0LPVRHnETO5tqunffII5qByrOP0geSwUSYjLFCPdfmPpZzaRnm983vzvqA4kLyBsVXOUYx3Hwv-cKGIwQNFiYUDPza0sBrWpmIqLZCr0r7WnWtNySplD0X_QBe4 Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 3515123097e744ef855ef1129fb59cf1 Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersOnMultiNodesTest-277737609 Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3515123097e744ef855ef1129fb59cf1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3515123097e744ef855ef1129fb59cf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3515123097e744ef855ef1129fb59cf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3515123097e744ef855ef1129fb59cf1", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersOnMultiNodesTest-277737609 Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 3515123097e744ef855ef1129fb59cf1 Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-277737609 Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersOnMultiNodesTest-277737609-project Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 0d48260054d84784b89a52d9b766d7c1 Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersOnMultiNodesTest-277737609-project Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 71d2c783-2772-442d-b38c-920fcf895b77 could not be found. Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '71d2c783-2772-442d-b38c-920fcf895b77'} Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71d2c783-2772-442d-b38c-920fcf895b77 could not be found. Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71d2c783-2772-442d-b38c-920fcf895b77 could not be found. Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:00:50.949907 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:00:50.953610 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:50.953610 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:00:50.953610 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:00:50.953610 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:00:50.953610 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:00:50.953610 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71d2c783-2772-442d-b38c-920fcf895b77 could not be found. Sep 17 21:00:50.953610 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:00:50.953610 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-eee88b23-b6bb-42a7-93ca-00fa1d2ee540 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Returning 404 to user: Instance 71d2c783-2772-442d-b38c-920fcf895b77 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:00:50.953610 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-eee88b23-b6bb-42a7-93ca-00fa1d2ee540 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77" status: 404 len: 111 microversion: 2.1 time: 0.076797 Sep 17 21:00:50.955471 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1251/2565] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:50 2022] GET /compute/v2.1/servers/71d2c783-2772-442d-b38c-920fcf895b77 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:00:50.960325 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-581fc630-2cc2-40dc-8bd3-c95ca66fa55d req-af8fe498-9072-4914-86ab-d6f47fadd781 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b986fa2-07ea-4418-adf2-0a5fa127e84a", "tag": "f698d869-5f6d-4d34-95fa-00bb9569ec58"}, {"server_uuid": "22b13c98-aea4-497c-a213-142393b2758c", "name": "network-vif-deleted", "tag": "fac0a530-6799-4e5d-bb72-c716e7db5b00"}, {"server_uuid": "22b13c98-aea4-497c-a213-142393b2758c", "name": "network-vif-deleted", "tag": "2adbeae0-ecea-4ae6-bf73-c7bf555f5367"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:50.992250 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-581fc630-2cc2-40dc-8bd3-c95ca66fa55d req-af8fe498-9072-4914-86ab-d6f47fadd781 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:50.992743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-581fc630-2cc2-40dc-8bd3-c95ca66fa55d req-af8fe498-9072-4914-86ab-d6f47fadd781 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:50.993376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-581fc630-2cc2-40dc-8bd3-c95ca66fa55d req-af8fe498-9072-4914-86ab-d6f47fadd781 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:51.019273 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-581fc630-2cc2-40dc-8bd3-c95ca66fa55d req-af8fe498-9072-4914-86ab-d6f47fadd781 service nova] Creating event network-changed:f698d869-5f6d-4d34-95fa-00bb9569ec58 for instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a on nch1-master-1 Sep 17 21:00:51.019799 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-581fc630-2cc2-40dc-8bd3-c95ca66fa55d req-af8fe498-9072-4914-86ab-d6f47fadd781 service nova] Creating event network-vif-deleted:fac0a530-6799-4e5d-bb72-c716e7db5b00 for instance 22b13c98-aea4-497c-a213-142393b2758c on nch2-master-1 Sep 17 21:00:51.020310 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-581fc630-2cc2-40dc-8bd3-c95ca66fa55d req-af8fe498-9072-4914-86ab-d6f47fadd781 service nova] Creating event network-vif-deleted:2adbeae0-ecea-4ae6-bf73-c7bf555f5367 for instance 22b13c98-aea4-497c-a213-142393b2758c on nch2-master-1 Sep 17 21:00:51.035290 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-581fc630-2cc2-40dc-8bd3-c95ca66fa55d req-af8fe498-9072-4914-86ab-d6f47fadd781 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.078510 Sep 17 21:00:51.044422 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1252/2566] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:51.050834 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-899c4d9d-ad1d-4f01-a764-b536646320b6 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:51.053843 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-899c4d9d-ad1d-4f01-a764-b536646320b6 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:51.068730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-899c4d9d-ad1d-4f01-a764-b536646320b6 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:51.069583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-899c4d9d-ad1d-4f01-a764-b536646320b6 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:51.071414 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-899c4d9d-ad1d-4f01-a764-b536646320b6 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:51.078423 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-899c4d9d-ad1d-4f01-a764-b536646320b6 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:51.079269 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-899c4d9d-ad1d-4f01-a764-b536646320b6 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:51.079933 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-899c4d9d-ad1d-4f01-a764-b536646320b6 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:51.468018 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2a148781-3d7a-4876-b2a6-f08787ecfccf tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:51.477177 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2a148781-3d7a-4876-b2a6-f08787ecfccf tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1463 microversion: 2.1 time: 0.686619 Sep 17 21:00:51.478235 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1315/2567] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:50 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1463 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:51.500255 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3f734c02-9fbf-4d88-be6c-19e0eb8c7234 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:51.500762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3f734c02-9fbf-4d88-be6c-19e0eb8c7234 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: e16ee697-bc81-4c87-a419-9485374a111a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:51.507175 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f734c02-9fbf-4d88-be6c-19e0eb8c7234 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:51.507870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f734c02-9fbf-4d88-be6c-19e0eb8c7234 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:51.508456 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f734c02-9fbf-4d88-be6c-19e0eb8c7234 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:51.509342 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f734c02-9fbf-4d88-be6c-19e0eb8c7234 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:51.509998 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f734c02-9fbf-4d88-be6c-19e0eb8c7234 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:51.510665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f734c02-9fbf-4d88-be6c-19e0eb8c7234 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:51.540645 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3f734c02-9fbf-4d88-be6c-19e0eb8c7234 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: e16ee697-bc81-4c87-a419-9485374a111a] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:00:51.600479 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-899c4d9d-ad1d-4f01-a764-b536646320b6 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5d41f7e95d44d3898f6306bb093ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8813aaee4604882b4cd7a2a8df58077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:51.615946 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-899c4d9d-ad1d-4f01-a764-b536646320b6 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297" status: 200 len: 1368 microversion: 2.1 time: 0.567368 Sep 17 21:00:51.618094 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1253/2568] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:51 2022] GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297 => generated 1368 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:51.627166 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5002e05c-d937-489c-b623-2f1810b5a16c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:51.628858 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5002e05c-d937-489c-b623-2f1810b5a16c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:51.658931 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5002e05c-d937-489c-b623-2f1810b5a16c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:51.662524 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5002e05c-d937-489c-b623-2f1810b5a16c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:51.663381 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5002e05c-d937-489c-b623-2f1810b5a16c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:51.667113 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5002e05c-d937-489c-b623-2f1810b5a16c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:51.667953 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5002e05c-d937-489c-b623-2f1810b5a16c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:51.668949 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5002e05c-d937-489c-b623-2f1810b5a16c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:51.673487 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3f734c02-9fbf-4d88-be6c-19e0eb8c7234 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e16ee697-bc81-4c87-a419-9485374a111a" status: 204 len: 0 microversion: 2.1 time: 0.178114 Sep 17 21:00:51.674922 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1316/2569] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:00:51 2022] DELETE /compute/v2.1/servers/e16ee697-bc81-4c87-a419-9485374a111a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:00:51.681875 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-55600ef0-4803-4d3a-8c9c-f4de3be05a82 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:51.682843 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-55600ef0-4803-4d3a-8c9c-f4de3be05a82 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:51.692538 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55600ef0-4803-4d3a-8c9c-f4de3be05a82 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:51.693314 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55600ef0-4803-4d3a-8c9c-f4de3be05a82 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:51.695244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55600ef0-4803-4d3a-8c9c-f4de3be05a82 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:51.696130 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55600ef0-4803-4d3a-8c9c-f4de3be05a82 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:51.696747 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55600ef0-4803-4d3a-8c9c-f4de3be05a82 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:51.697432 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55600ef0-4803-4d3a-8c9c-f4de3be05a82 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:51.895227 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5002e05c-d937-489c-b623-2f1810b5a16c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:51.911495 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5002e05c-d937-489c-b623-2f1810b5a16c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 200 len: 1273 microversion: 2.1 time: 0.290441 Sep 17 21:00:51.929917 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1254/2570] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:51 2022] GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 1273 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:51.936052 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-77530011-2753-4619-9c60-98b5e36a9435 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:51.936784 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-77530011-2753-4619-9c60-98b5e36a9435 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 7b07abb3-f10d-4b65-9a52-28bb33b47567] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:51.944607 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-77530011-2753-4619-9c60-98b5e36a9435 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:51.945405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-77530011-2753-4619-9c60-98b5e36a9435 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:51.946067 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-77530011-2753-4619-9c60-98b5e36a9435 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:51.946977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-77530011-2753-4619-9c60-98b5e36a9435 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:51.947708 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-77530011-2753-4619-9c60-98b5e36a9435 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:51.948328 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-77530011-2753-4619-9c60-98b5e36a9435 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:51.980517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-77530011-2753-4619-9c60-98b5e36a9435 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 7b07abb3-f10d-4b65-9a52-28bb33b47567] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:00:52.048857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-55600ef0-4803-4d3a-8c9c-f4de3be05a82 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:52.052122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:52.065057 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-55600ef0-4803-4d3a-8c9c-f4de3be05a82 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1463 microversion: 2.1 time: 0.388613 Sep 17 21:00:52.066296 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1317/2571] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:51 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1463 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:52.083353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e2087cc5-b99b-4da3-b09e-52344c06eeb0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:52.083968 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e2087cc5-b99b-4da3-b09e-52344c06eeb0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:52.114944 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2087cc5-b99b-4da3-b09e-52344c06eeb0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:52.115277 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2087cc5-b99b-4da3-b09e-52344c06eeb0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:52.115722 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2087cc5-b99b-4da3-b09e-52344c06eeb0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:52.116792 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2087cc5-b99b-4da3-b09e-52344c06eeb0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:52.117255 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2087cc5-b99b-4da3-b09e-52344c06eeb0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:52.117779 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2087cc5-b99b-4da3-b09e-52344c06eeb0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:52.133222 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-77530011-2753-4619-9c60-98b5e36a9435 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567" status: 204 len: 0 microversion: 2.1 time: 0.201519 Sep 17 21:00:52.133869 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1255/2572] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:00:51 2022] DELETE /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:00:52.141504 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-436392df-ca79-489f-aff2-ba1722fbbeb1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:52.142202 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-436392df-ca79-489f-aff2-ba1722fbbeb1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:52.163126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-436392df-ca79-489f-aff2-ba1722fbbeb1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:52.163986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-436392df-ca79-489f-aff2-ba1722fbbeb1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:52.164630 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-436392df-ca79-489f-aff2-ba1722fbbeb1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:52.166695 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-436392df-ca79-489f-aff2-ba1722fbbeb1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:52.167392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2087cc5-b99b-4da3-b09e-52344c06eeb0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:52.168063 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2087cc5-b99b-4da3-b09e-52344c06eeb0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:52.168336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-436392df-ca79-489f-aff2-ba1722fbbeb1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:52.168795 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-436392df-ca79-489f-aff2-ba1722fbbeb1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:52.170238 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2087cc5-b99b-4da3-b09e-52344c06eeb0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:52.170901 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-e2087cc5-b99b-4da3-b09e-52344c06eeb0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lazy-loading 'fault' on Instance uuid 22b13c98-aea4-497c-a213-142393b2758c {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:00:52.270754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e2087cc5-b99b-4da3-b09e-52344c06eeb0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:52.298872 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e2087cc5-b99b-4da3-b09e-52344c06eeb0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:52.300525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e2087cc5-b99b-4da3-b09e-52344c06eeb0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55e8e491f8844f7696f93d8ec5a7171b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '822801d3963d45c1b4176259fb5c5b19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:52.301826 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e2087cc5-b99b-4da3-b09e-52344c06eeb0 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 200 len: 1610 microversion: 2.32 time: 0.231427 Sep 17 21:00:52.307097 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1318/2573] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:00:52 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 1610 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:00:52.312883 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-90418cd8-1566-4720-8c57-a4a0f18b5927 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:52.323908 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-90418cd8-1566-4720-8c57-a4a0f18b5927 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:52.332836 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90418cd8-1566-4720-8c57-a4a0f18b5927 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:52.333679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90418cd8-1566-4720-8c57-a4a0f18b5927 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:52.334359 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90418cd8-1566-4720-8c57-a4a0f18b5927 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:52.335954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90418cd8-1566-4720-8c57-a4a0f18b5927 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:52.336660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90418cd8-1566-4720-8c57-a4a0f18b5927 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:52.338223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90418cd8-1566-4720-8c57-a4a0f18b5927 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:52.478274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-90418cd8-1566-4720-8c57-a4a0f18b5927 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:00:52.479035 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-90418cd8-1566-4720-8c57-a4a0f18b5927 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:00:52.479738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-90418cd8-1566-4720-8c57-a4a0f18b5927 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:00:52.481812 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-90418cd8-1566-4720-8c57-a4a0f18b5927 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:00:52.482534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-90418cd8-1566-4720-8c57-a4a0f18b5927 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:00:52.592098 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-436392df-ca79-489f-aff2-ba1722fbbeb1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:52.595715 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:52.600534 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-436392df-ca79-489f-aff2-ba1722fbbeb1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1317 microversion: 2.1 time: 0.465502 Sep 17 21:00:52.601036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-90418cd8-1566-4720-8c57-a4a0f18b5927 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:52.605837 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1256/2574] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:52 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1317 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:52.612800 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-657b43d4-4140-4452-91b3-6e1cb402e11a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:52.614113 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-657b43d4-4140-4452-91b3-6e1cb402e11a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: e16ee697-bc81-4c87-a419-9485374a111a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:52.621680 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90418cd8-1566-4720-8c57-a4a0f18b5927 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:52.622126 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90418cd8-1566-4720-8c57-a4a0f18b5927 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:52.622578 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90418cd8-1566-4720-8c57-a4a0f18b5927 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:52.623315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90418cd8-1566-4720-8c57-a4a0f18b5927 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:52.624141 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90418cd8-1566-4720-8c57-a4a0f18b5927 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:52.627151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90418cd8-1566-4720-8c57-a4a0f18b5927 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:52.633093 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-657b43d4-4140-4452-91b3-6e1cb402e11a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:52.633877 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-657b43d4-4140-4452-91b3-6e1cb402e11a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:52.634505 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-657b43d4-4140-4452-91b3-6e1cb402e11a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:52.636325 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-657b43d4-4140-4452-91b3-6e1cb402e11a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:52.638249 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-657b43d4-4140-4452-91b3-6e1cb402e11a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:52.638903 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-657b43d4-4140-4452-91b3-6e1cb402e11a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:52.700692 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-90418cd8-1566-4720-8c57-a4a0f18b5927 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "POST /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e/action" status: 202 len: 1067 microversion: 2.1 time: 0.392412 Sep 17 21:00:52.709295 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1319/2575] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:00:52 2022] POST /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e/action => generated 1067 bytes in 401 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 17 21:00:52.717255 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-05bfbcad-30ec-4192-8982-8edd4559ebad req-0b307cb5-72e9-4692-9148-f39f77ce9934 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a1dbfb5-be75-451c-8ca8-a71949ac2297", "name": "network-vif-plugged", "status": "completed", "tag": "bb1dd815-ecd5-488c-93a4-3f015b5427ae"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:52.746011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-05bfbcad-30ec-4192-8982-8edd4559ebad req-0b307cb5-72e9-4692-9148-f39f77ce9934 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:52.746756 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-05bfbcad-30ec-4192-8982-8edd4559ebad req-0b307cb5-72e9-4692-9148-f39f77ce9934 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:52.747472 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-05bfbcad-30ec-4192-8982-8edd4559ebad req-0b307cb5-72e9-4692-9148-f39f77ce9934 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:52.763605 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-05bfbcad-30ec-4192-8982-8edd4559ebad req-0b307cb5-72e9-4692-9148-f39f77ce9934 service nova] Creating event network-vif-plugged:bb1dd815-ecd5-488c-93a4-3f015b5427ae for instance 6a1dbfb5-be75-451c-8ca8-a71949ac2297 on nch2-master-1 Sep 17 21:00:52.770401 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-05bfbcad-30ec-4192-8982-8edd4559ebad req-0b307cb5-72e9-4692-9148-f39f77ce9934 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059631 Sep 17 21:00:52.771481 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1320/2576] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:52.780964 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-85764238-3343-4495-8500-fcd3f5a699b1 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:52.784361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-85764238-3343-4495-8500-fcd3f5a699b1 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:52.795418 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85764238-3343-4495-8500-fcd3f5a699b1 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:52.796729 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85764238-3343-4495-8500-fcd3f5a699b1 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:52.797361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85764238-3343-4495-8500-fcd3f5a699b1 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:52.798683 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85764238-3343-4495-8500-fcd3f5a699b1 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:52.799332 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85764238-3343-4495-8500-fcd3f5a699b1 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:52.799983 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85764238-3343-4495-8500-fcd3f5a699b1 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:53.056750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-657b43d4-4140-4452-91b3-6e1cb402e11a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:53.058026 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-85764238-3343-4495-8500-fcd3f5a699b1 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5d41f7e95d44d3898f6306bb093ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8813aaee4604882b4cd7a2a8df58077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:53.067591 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-85764238-3343-4495-8500-fcd3f5a699b1 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297" status: 200 len: 1368 microversion: 2.1 time: 0.294363 Sep 17 21:00:53.068360 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1321/2577] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:52 2022] GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297 => generated 1368 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:53.077874 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-23d49d33-153a-4cf3-92e4-a65593a980af tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:53.078497 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-657b43d4-4140-4452-91b3-6e1cb402e11a tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/e16ee697-bc81-4c87-a419-9485374a111a" status: 200 len: 1475 microversion: 2.1 time: 0.469134 Sep 17 21:00:53.079098 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1257/2578] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:52 2022] GET /compute/v2.1/servers/e16ee697-bc81-4c87-a419-9485374a111a => generated 1475 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:53.094413 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-23d49d33-153a-4cf3-92e4-a65593a980af tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:53.096820 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:53.100440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c73c7dc4-b4c3-4834-9eb3-71a1832c6b1b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:53.101911 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c73c7dc4-b4c3-4834-9eb3-71a1832c6b1b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:53.103439 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23d49d33-153a-4cf3-92e4-a65593a980af tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:53.103948 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23d49d33-153a-4cf3-92e4-a65593a980af tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:53.104388 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23d49d33-153a-4cf3-92e4-a65593a980af tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:53.105097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23d49d33-153a-4cf3-92e4-a65593a980af tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:53.105572 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23d49d33-153a-4cf3-92e4-a65593a980af tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:53.105999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23d49d33-153a-4cf3-92e4-a65593a980af tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:53.110802 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c73c7dc4-b4c3-4834-9eb3-71a1832c6b1b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:53.111865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c73c7dc4-b4c3-4834-9eb3-71a1832c6b1b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:53.112683 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c73c7dc4-b4c3-4834-9eb3-71a1832c6b1b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:53.114298 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c73c7dc4-b4c3-4834-9eb3-71a1832c6b1b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:53.114820 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c73c7dc4-b4c3-4834-9eb3-71a1832c6b1b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:53.118081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c73c7dc4-b4c3-4834-9eb3-71a1832c6b1b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:53.453871 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c73c7dc4-b4c3-4834-9eb3-71a1832c6b1b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:53.464140 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c73c7dc4-b4c3-4834-9eb3-71a1832c6b1b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 200 len: 1315 microversion: 2.1 time: 0.369222 Sep 17 21:00:53.477528 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1258/2579] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:53 2022] GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:53.505381 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f5f3fbda-6a5d-4add-bc4e-1047dc380a7b tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-705995668", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:53.598341 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-23d49d33-153a-4cf3-92e4-a65593a980af tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:53.602699 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-f5f3fbda-6a5d-4add-bc4e-1047dc380a7b tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] validate_networks() for [('44a79b47-4be7-467a-8a8c-21d428a823c4', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:00:53.624059 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-23d49d33-153a-4cf3-92e4-a65593a980af tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1472 microversion: 2.1 time: 0.554595 Sep 17 21:00:53.624659 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1322/2580] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:53 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1472 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:53.633307 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-05176a3d-166a-4558-93d0-f1104afd3445 req-18e56907-78ac-4b07-af2a-db8c7457c92d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b13c98-aea4-497c-a213-142393b2758c", "name": "network-vif-deleted", "tag": "e15c3f2b-0cbb-44da-8610-207b8c1ec7bc"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:53.644260 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-05176a3d-166a-4558-93d0-f1104afd3445 req-18e56907-78ac-4b07-af2a-db8c7457c92d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:53.645106 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-05176a3d-166a-4558-93d0-f1104afd3445 req-18e56907-78ac-4b07-af2a-db8c7457c92d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:53.645754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-05176a3d-166a-4558-93d0-f1104afd3445 req-18e56907-78ac-4b07-af2a-db8c7457c92d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:53.659191 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-05176a3d-166a-4558-93d0-f1104afd3445 req-18e56907-78ac-4b07-af2a-db8c7457c92d service nova] Creating event network-vif-deleted:e15c3f2b-0cbb-44da-8610-207b8c1ec7bc for instance 22b13c98-aea4-497c-a213-142393b2758c on nch2-master-1 Sep 17 21:00:53.665785 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-05176a3d-166a-4558-93d0-f1104afd3445 req-18e56907-78ac-4b07-af2a-db8c7457c92d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039613 Sep 17 21:00:53.673492 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1323/2581] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:53.675514 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8c2aa2ac-c415-4cdf-86ec-ebee0c874e68 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:53.676228 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8c2aa2ac-c415-4cdf-86ec-ebee0c874e68 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:53.700626 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c2aa2ac-c415-4cdf-86ec-ebee0c874e68 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:53.701147 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c2aa2ac-c415-4cdf-86ec-ebee0c874e68 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:53.701620 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c2aa2ac-c415-4cdf-86ec-ebee0c874e68 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:53.702340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c2aa2ac-c415-4cdf-86ec-ebee0c874e68 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:53.702797 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c2aa2ac-c415-4cdf-86ec-ebee0c874e68 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:53.703224 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c2aa2ac-c415-4cdf-86ec-ebee0c874e68 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:53.725400 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-8c2aa2ac-c415-4cdf-86ec-ebee0c874e68 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] HTTP exception thrown: Instance 22b13c98-aea4-497c-a213-142393b2758c could not be found. Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8c2aa2ac-c415-4cdf-86ec-ebee0c874e68 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Request method failure captured: Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c HTTP/1.1 Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjQTKLEBZbFTsks6u0BzNF1e048KULnAYR8xgDyvmv9WQoit97-R16XS32jBYO2oPbfBmF0D66e52_MbizQvHUEh6nSUzOftn_URw6K08VaCKPxYaGgn-w4uZXzhAkYUJdjpAZ4xmN6ceNU2iSIhx8duX6LxzyWDOTr5K0Ou-PqmRxo Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: X-Openstack-Nova-Api-Version: 2.32 Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 822801d3963d45c1b4176259fb5c5b19 Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-TaggedBootDevicesTest-356253908 Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/822801d3963d45c1b4176259fb5c5b19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/822801d3963d45c1b4176259fb5c5b19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/822801d3963d45c1b4176259fb5c5b19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_822801d3963d45c1b4176259fb5c5b19", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-TaggedBootDevicesTest-356253908 Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 822801d3963d45c1b4176259fb5c5b19 Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-TaggedBootDevicesTest-356253908 Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-TaggedBootDevicesTest-356253908-project Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 55e8e491f8844f7696f93d8ec5a7171b Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-TaggedBootDevicesTest-356253908-project Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 22b13c98-aea4-497c-a213-142393b2758c could not be found. Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '22b13c98-aea4-497c-a213-142393b2758c'} Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22b13c98-aea4-497c-a213-142393b2758c could not be found. Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22b13c98-aea4-497c-a213-142393b2758c could not be found. Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:00:53.727458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:53.731388 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:53.731388 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:00:53.731388 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:00:53.731388 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:00:53.731388 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:00:53.731388 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22b13c98-aea4-497c-a213-142393b2758c could not be found. Sep 17 21:00:53.731388 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:53.736135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8c2aa2ac-c415-4cdf-86ec-ebee0c874e68 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Returning 404 to user: Instance 22b13c98-aea4-497c-a213-142393b2758c could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:00:53.737227 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8c2aa2ac-c415-4cdf-86ec-ebee0c874e68 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 404 len: 111 microversion: 2.32 time: 0.066072 Sep 17 21:00:53.741205 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1324/2582] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:00:53 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:00:53.743522 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fd40e313-c3d4-454e-ba9f-47c2e438d7c4 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:53.744267 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fd40e313-c3d4-454e-ba9f-47c2e438d7c4 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:53.751025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fd40e313-c3d4-454e-ba9f-47c2e438d7c4 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:53.751524 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fd40e313-c3d4-454e-ba9f-47c2e438d7c4 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:53.751966 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fd40e313-c3d4-454e-ba9f-47c2e438d7c4 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:53.752698 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fd40e313-c3d4-454e-ba9f-47c2e438d7c4 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:53.753154 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fd40e313-c3d4-454e-ba9f-47c2e438d7c4 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:53.753848 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fd40e313-c3d4-454e-ba9f-47c2e438d7c4 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:54.147816 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fd40e313-c3d4-454e-ba9f-47c2e438d7c4 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:54.164135 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fd40e313-c3d4-454e-ba9f-47c2e438d7c4 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1317 microversion: 2.1 time: 0.423085 Sep 17 21:00:54.167536 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1325/2583] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:53 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1317 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:54.175002 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e7d16437-40f0-485d-804b-159238be7729 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '.version_select at 0x7f25a4ce60d0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:54.217382 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e7d16437-40f0-485d-804b-159238be7729 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1111928329" status: 204 len: 0 microversion: 2.32 time: 0.048372 Sep 17 21:00:54.219576 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1326/2584] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Sep 17 21:00:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1111928329 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 21:00:54.229012 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-dd215176-2794-4ab4-acf0-259f8700ed13 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:54.229920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-dd215176-2794-4ab4-acf0-259f8700ed13 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:54.238823 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd215176-2794-4ab4-acf0-259f8700ed13 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:54.239647 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd215176-2794-4ab4-acf0-259f8700ed13 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:54.240311 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd215176-2794-4ab4-acf0-259f8700ed13 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:54.241245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd215176-2794-4ab4-acf0-259f8700ed13 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:54.242533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd215176-2794-4ab4-acf0-259f8700ed13 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:54.244581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd215176-2794-4ab4-acf0-259f8700ed13 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:55.228833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-dd215176-2794-4ab4-acf0-259f8700ed13 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5d41f7e95d44d3898f6306bb093ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8813aaee4604882b4cd7a2a8df58077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:55.254679 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-dd215176-2794-4ab4-acf0-259f8700ed13 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297" status: 200 len: 1368 microversion: 2.1 time: 1.030513 Sep 17 21:00:55.258140 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1327/2585] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:54 2022] GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297 => generated 1368 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:55.273873 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a1e4f879-be53-4c09-adaf-5b17f9b028fe tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:55.275935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a1e4f879-be53-4c09-adaf-5b17f9b028fe tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: e16ee697-bc81-4c87-a419-9485374a111a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:55.311814 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a1e4f879-be53-4c09-adaf-5b17f9b028fe tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:55.313119 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a1e4f879-be53-4c09-adaf-5b17f9b028fe tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:55.314372 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a1e4f879-be53-4c09-adaf-5b17f9b028fe tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:55.316906 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a1e4f879-be53-4c09-adaf-5b17f9b028fe tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:55.318246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a1e4f879-be53-4c09-adaf-5b17f9b028fe tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:55.319426 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a1e4f879-be53-4c09-adaf-5b17f9b028fe tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:55.324111 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-f5f3fbda-6a5d-4add-bc4e-1047dc380a7b tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:00:55.329453 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-f5f3fbda-6a5d-4add-bc4e-1047dc380a7b tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:00:55.337941 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-f5f3fbda-6a5d-4add-bc4e-1047dc380a7b tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:00:55.341758 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-f5f3fbda-6a5d-4add-bc4e-1047dc380a7b tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:00:55.345226 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-f5f3fbda-6a5d-4add-bc4e-1047dc380a7b tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:00:55.363765 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f5f3fbda-6a5d-4add-bc4e-1047dc380a7b tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:55.366452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f5f3fbda-6a5d-4add-bc4e-1047dc380a7b tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:55.381909 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f5f3fbda-6a5d-4add-bc4e-1047dc380a7b tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:55.383262 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f5f3fbda-6a5d-4add-bc4e-1047dc380a7b tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:55.389895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f5f3fbda-6a5d-4add-bc4e-1047dc380a7b tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:55.398639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f5f3fbda-6a5d-4add-bc4e-1047dc380a7b tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:55.437433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a1e4f879-be53-4c09-adaf-5b17f9b028fe tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:55.438606 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a1e4f879-be53-4c09-adaf-5b17f9b028fe tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:55.439726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a1e4f879-be53-4c09-adaf-5b17f9b028fe tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:55.441105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-a1e4f879-be53-4c09-adaf-5b17f9b028fe tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lazy-loading 'fault' on Instance uuid e16ee697-bc81-4c87-a419-9485374a111a {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:00:55.442518 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-f5f3fbda-6a5d-4add-bc4e-1047dc380a7b tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Getting quotas for project 004f77fba4b14080bca4ae36c857add3. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:00:55.462222 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-f5f3fbda-6a5d-4add-bc4e-1047dc380a7b tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Getting quotas for user 22306a93c9404db393b92a267d6258d4 and project 004f77fba4b14080bca4ae36c857add3. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:00:55.523402 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f5f3fbda-6a5d-4add-bc4e-1047dc380a7b tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:00:55.531393 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f5f3fbda-6a5d-4add-bc4e-1047dc380a7b tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 7750732c-19bc-4c5a-8637-af3a08c3af5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:00:55.615817 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a1e4f879-be53-4c09-adaf-5b17f9b028fe tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:55.626508 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a1e4f879-be53-4c09-adaf-5b17f9b028fe tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/e16ee697-bc81-4c87-a419-9485374a111a" status: 200 len: 1309 microversion: 2.1 time: 0.366064 Sep 17 21:00:55.627750 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1328/2586] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:55 2022] GET /compute/v2.1/servers/e16ee697-bc81-4c87-a419-9485374a111a => generated 1309 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:55.647389 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5d8b20a9-f040-4b7b-9339-018123d4fc96 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:55.649112 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5d8b20a9-f040-4b7b-9339-018123d4fc96 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:55.676403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d8b20a9-f040-4b7b-9339-018123d4fc96 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:55.676911 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d8b20a9-f040-4b7b-9339-018123d4fc96 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:55.677352 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d8b20a9-f040-4b7b-9339-018123d4fc96 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:55.678112 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d8b20a9-f040-4b7b-9339-018123d4fc96 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:55.678568 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d8b20a9-f040-4b7b-9339-018123d4fc96 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:55.678980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d8b20a9-f040-4b7b-9339-018123d4fc96 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:55.704793 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f5f3fbda-6a5d-4add-bc4e-1047dc380a7b tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.223017 Sep 17 21:00:55.706068 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1259/2587] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:00:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 2228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:00:55.711330 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-816bbb44-cc8a-452d-8587-a8c8723a0c61 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:55.712346 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-816bbb44-cc8a-452d-8587-a8c8723a0c61 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:55.720173 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-816bbb44-cc8a-452d-8587-a8c8723a0c61 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:55.720850 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-816bbb44-cc8a-452d-8587-a8c8723a0c61 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:55.721486 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-816bbb44-cc8a-452d-8587-a8c8723a0c61 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:55.722412 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-816bbb44-cc8a-452d-8587-a8c8723a0c61 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:55.723054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-816bbb44-cc8a-452d-8587-a8c8723a0c61 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:55.723861 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-816bbb44-cc8a-452d-8587-a8c8723a0c61 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:55.985407 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5d8b20a9-f040-4b7b-9339-018123d4fc96 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:56.002729 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5d8b20a9-f040-4b7b-9339-018123d4fc96 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 200 len: 1315 microversion: 2.1 time: 0.373574 Sep 17 21:00:56.017491 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1329/2588] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:55 2022] GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:56.017491 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-6d302df5-d2d3-48f5-bfba-8f3b9b53d13c req-a0e2a193-ee28-4bcb-a445-8637bd14954b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b986fa2-07ea-4418-adf2-0a5fa127e84a", "name": "network-vif-plugged", "status": "completed", "tag": "f698d869-5f6d-4d34-95fa-00bb9569ec58"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:56.041413 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6d302df5-d2d3-48f5-bfba-8f3b9b53d13c req-a0e2a193-ee28-4bcb-a445-8637bd14954b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:56.041932 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6d302df5-d2d3-48f5-bfba-8f3b9b53d13c req-a0e2a193-ee28-4bcb-a445-8637bd14954b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:56.042362 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6d302df5-d2d3-48f5-bfba-8f3b9b53d13c req-a0e2a193-ee28-4bcb-a445-8637bd14954b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:56.068348 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-6d302df5-d2d3-48f5-bfba-8f3b9b53d13c req-a0e2a193-ee28-4bcb-a445-8637bd14954b service nova] Creating event network-vif-plugged:f698d869-5f6d-4d34-95fa-00bb9569ec58 for instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a on nch1-master-1 Sep 17 21:00:56.079836 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-6d302df5-d2d3-48f5-bfba-8f3b9b53d13c req-a0e2a193-ee28-4bcb-a445-8637bd14954b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074875 Sep 17 21:00:56.088269 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1330/2589] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:56.093703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-846c161d-16be-42ff-8b87-06ad5f6a2f76 req-85cd2233-03e4-424b-9618-d678e0c5680b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e16ee697-bc81-4c87-a419-9485374a111a", "name": "network-vif-deleted", "tag": "9a3df8b6-f94c-4f97-8b6f-ec09d9194b52"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:56.120657 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-846c161d-16be-42ff-8b87-06ad5f6a2f76 req-85cd2233-03e4-424b-9618-d678e0c5680b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:56.122050 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-846c161d-16be-42ff-8b87-06ad5f6a2f76 req-85cd2233-03e4-424b-9618-d678e0c5680b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:56.122741 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-846c161d-16be-42ff-8b87-06ad5f6a2f76 req-85cd2233-03e4-424b-9618-d678e0c5680b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:56.159944 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-846c161d-16be-42ff-8b87-06ad5f6a2f76 req-85cd2233-03e4-424b-9618-d678e0c5680b service nova] Creating event network-vif-deleted:9a3df8b6-f94c-4f97-8b6f-ec09d9194b52 for instance e16ee697-bc81-4c87-a419-9485374a111a on nch2-master-1 Sep 17 21:00:56.166641 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-846c161d-16be-42ff-8b87-06ad5f6a2f76 req-85cd2233-03e4-424b-9618-d678e0c5680b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076288 Sep 17 21:00:56.167803 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1331/2590] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:56.180238 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5e872a4f-d0f5-4464-b3a7-e589e61cc768 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:56.182282 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5e872a4f-d0f5-4464-b3a7-e589e61cc768 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:56.205826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e872a4f-d0f5-4464-b3a7-e589e61cc768 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:56.206914 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e872a4f-d0f5-4464-b3a7-e589e61cc768 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:56.208138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e872a4f-d0f5-4464-b3a7-e589e61cc768 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:56.212322 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e872a4f-d0f5-4464-b3a7-e589e61cc768 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:56.213287 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e872a4f-d0f5-4464-b3a7-e589e61cc768 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:56.213994 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e872a4f-d0f5-4464-b3a7-e589e61cc768 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:56.376010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-816bbb44-cc8a-452d-8587-a8c8723a0c61 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:56.392402 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-816bbb44-cc8a-452d-8587-a8c8723a0c61 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1472 microversion: 2.1 time: 0.683126 Sep 17 21:00:56.417103 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1260/2591] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:55 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1472 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:56.437334 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9ca4b357-85bf-4df3-a037-c5b8b1844506 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:56.439648 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9ca4b357-85bf-4df3-a037-c5b8b1844506 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 7750732c-19bc-4c5a-8637-af3a08c3af5d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:56.580989 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9ca4b357-85bf-4df3-a037-c5b8b1844506 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:56.590071 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9ca4b357-85bf-4df3-a037-c5b8b1844506 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d" status: 200 len: 1224 microversion: 2.1 time: 0.168746 Sep 17 21:00:56.606525 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1261/2592] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:56 2022] GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d => generated 1224 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:56.615405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-8f9f537d-5995-48fb-a2d1-1593bc0b4de6 req-03b93657-e57f-4d41-b87d-3108376cf8b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b07abb3-f10d-4b65-9a52-28bb33b47567", "name": "network-vif-deleted", "tag": "dc17c9e2-7720-4027-baf7-177d28086374"}, {"name": "network-changed", "server_uuid": "b37a20c2-7329-4a0e-8b31-d0a7c39344b3", "tag": "2c69be81-79b1-494f-8f9b-4d4b69580fb8"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:56.628621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8f9f537d-5995-48fb-a2d1-1593bc0b4de6 req-03b93657-e57f-4d41-b87d-3108376cf8b8 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:56.629092 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8f9f537d-5995-48fb-a2d1-1593bc0b4de6 req-03b93657-e57f-4d41-b87d-3108376cf8b8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:56.629722 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8f9f537d-5995-48fb-a2d1-1593bc0b4de6 req-03b93657-e57f-4d41-b87d-3108376cf8b8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:56.645607 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-8f9f537d-5995-48fb-a2d1-1593bc0b4de6 req-03b93657-e57f-4d41-b87d-3108376cf8b8 service nova] Creating event network-vif-deleted:dc17c9e2-7720-4027-baf7-177d28086374 for instance 7b07abb3-f10d-4b65-9a52-28bb33b47567 on nch1-master-1 Sep 17 21:00:56.646564 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-8f9f537d-5995-48fb-a2d1-1593bc0b4de6 req-03b93657-e57f-4d41-b87d-3108376cf8b8 service nova] Creating event network-changed:2c69be81-79b1-494f-8f9b-4d4b69580fb8 for instance b37a20c2-7329-4a0e-8b31-d0a7c39344b3 on nch2-master-1 Sep 17 21:00:56.659865 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-8f9f537d-5995-48fb-a2d1-1593bc0b4de6 req-03b93657-e57f-4d41-b87d-3108376cf8b8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.051504 Sep 17 21:00:56.661098 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1262/2593] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:56.667270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a4f07bd4-89f7-454d-bc69-50c228285b49 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:56.668484 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a4f07bd4-89f7-454d-bc69-50c228285b49 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:56.691110 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4f07bd4-89f7-454d-bc69-50c228285b49 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:56.691879 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4f07bd4-89f7-454d-bc69-50c228285b49 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:56.692497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4f07bd4-89f7-454d-bc69-50c228285b49 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:56.693435 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4f07bd4-89f7-454d-bc69-50c228285b49 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:56.694734 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4f07bd4-89f7-454d-bc69-50c228285b49 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:56.697269 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4f07bd4-89f7-454d-bc69-50c228285b49 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:56.863199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5e872a4f-d0f5-4464-b3a7-e589e61cc768 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:56.876819 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5e872a4f-d0f5-4464-b3a7-e589e61cc768 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1317 microversion: 2.1 time: 0.706237 Sep 17 21:00:56.897678 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1332/2594] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:56 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1317 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:56.912874 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a1df9206-2bdb-41e3-a73b-4bc0537cdf81 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:56.914921 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a1df9206-2bdb-41e3-a73b-4bc0537cdf81 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: e16ee697-bc81-4c87-a419-9485374a111a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:56.926295 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a1df9206-2bdb-41e3-a73b-4bc0537cdf81 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:56.929168 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a1df9206-2bdb-41e3-a73b-4bc0537cdf81 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:56.930059 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a1df9206-2bdb-41e3-a73b-4bc0537cdf81 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:56.931889 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a1df9206-2bdb-41e3-a73b-4bc0537cdf81 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:56.932586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a1df9206-2bdb-41e3-a73b-4bc0537cdf81 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:56.933932 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a1df9206-2bdb-41e3-a73b-4bc0537cdf81 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:56.960191 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-a1df9206-2bdb-41e3-a73b-4bc0537cdf81 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] HTTP exception thrown: Instance e16ee697-bc81-4c87-a419-9485374a111a could not be found. Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a1df9206-2bdb-41e3-a73b-4bc0537cdf81 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Request method failure captured: Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/e16ee697-bc81-4c87-a419-9485374a111a HTTP/1.1 Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjS1i9XeXSkLU6roIN5-V3M30sbhgULjb8tr8aqExkSAIyZY9VKN0LPVRHnETO5tqunffII5qByrOP0geSwUSYjLFCPdfmPpZzaRnm983vzvqA4kLyBsVXOUYx3Hwv-cKGIwQNFiYUDPza0sBrWpmIqLZCr0r7WnWtNySplD0X_QBe4 Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 3515123097e744ef855ef1129fb59cf1 Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersOnMultiNodesTest-277737609 Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3515123097e744ef855ef1129fb59cf1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3515123097e744ef855ef1129fb59cf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3515123097e744ef855ef1129fb59cf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3515123097e744ef855ef1129fb59cf1", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersOnMultiNodesTest-277737609 Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 3515123097e744ef855ef1129fb59cf1 Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-277737609 Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersOnMultiNodesTest-277737609-project Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 0d48260054d84784b89a52d9b766d7c1 Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersOnMultiNodesTest-277737609-project Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance e16ee697-bc81-4c87-a419-9485374a111a could not be found. Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'e16ee697-bc81-4c87-a419-9485374a111a'} Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e16ee697-bc81-4c87-a419-9485374a111a could not be found. Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e16ee697-bc81-4c87-a419-9485374a111a could not be found. Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:00:56.962109 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:56.966607 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:56.966607 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:00:56.966607 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:00:56.966607 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:00:56.966607 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:00:56.966607 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e16ee697-bc81-4c87-a419-9485374a111a could not be found. Sep 17 21:00:56.966607 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:56.969336 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a1df9206-2bdb-41e3-a73b-4bc0537cdf81 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Returning 404 to user: Instance e16ee697-bc81-4c87-a419-9485374a111a could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:00:56.970988 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a1df9206-2bdb-41e3-a73b-4bc0537cdf81 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/e16ee697-bc81-4c87-a419-9485374a111a" status: 404 len: 111 microversion: 2.1 time: 0.068559 Sep 17 21:00:56.971916 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1333/2595] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:56 2022] GET /compute/v2.1/servers/e16ee697-bc81-4c87-a419-9485374a111a => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:00:56.982013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-87aaae4e-2160-489f-9bbf-92b475b978f7 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:56.982940 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-87aaae4e-2160-489f-9bbf-92b475b978f7 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 7b07abb3-f10d-4b65-9a52-28bb33b47567] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:56.991837 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87aaae4e-2160-489f-9bbf-92b475b978f7 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:56.992803 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87aaae4e-2160-489f-9bbf-92b475b978f7 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:57.006280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87aaae4e-2160-489f-9bbf-92b475b978f7 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:57.008004 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87aaae4e-2160-489f-9bbf-92b475b978f7 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:57.013235 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87aaae4e-2160-489f-9bbf-92b475b978f7 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:57.014002 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87aaae4e-2160-489f-9bbf-92b475b978f7 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:57.028715 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a4f07bd4-89f7-454d-bc69-50c228285b49 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5d41f7e95d44d3898f6306bb093ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8813aaee4604882b4cd7a2a8df58077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:57.039850 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a4f07bd4-89f7-454d-bc69-50c228285b49 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297" status: 200 len: 1555 microversion: 2.1 time: 0.377358 Sep 17 21:00:57.040447 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1263/2596] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:56 2022] GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297 => generated 1555 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:57.047868 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1d145d0d-52ef-49b6-8c22-1f148bb3c912 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:57.048706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1d145d0d-52ef-49b6-8c22-1f148bb3c912 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:57.061637 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1d145d0d-52ef-49b6-8c22-1f148bb3c912 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:57.064487 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-87aaae4e-2160-489f-9bbf-92b475b978f7 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] HTTP exception thrown: Instance 7b07abb3-f10d-4b65-9a52-28bb33b47567 could not be found. Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-87aaae4e-2160-489f-9bbf-92b475b978f7 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Request method failure captured: Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567 HTTP/1.1 Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjS1i9XeXSkLU6roIN5-V3M30sbhgULjb8tr8aqExkSAIyZY9VKN0LPVRHnETO5tqunffII5qByrOP0geSwUSYjLFCPdfmPpZzaRnm983vzvqA4kLyBsVXOUYx3Hwv-cKGIwQNFiYUDPza0sBrWpmIqLZCr0r7WnWtNySplD0X_QBe4 Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 3515123097e744ef855ef1129fb59cf1 Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersOnMultiNodesTest-277737609 Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3515123097e744ef855ef1129fb59cf1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3515123097e744ef855ef1129fb59cf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3515123097e744ef855ef1129fb59cf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3515123097e744ef855ef1129fb59cf1", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersOnMultiNodesTest-277737609 Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 3515123097e744ef855ef1129fb59cf1 Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-277737609 Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersOnMultiNodesTest-277737609-project Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 0d48260054d84784b89a52d9b766d7c1 Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersOnMultiNodesTest-277737609-project Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 7b07abb3-f10d-4b65-9a52-28bb33b47567 could not be found. Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '7b07abb3-f10d-4b65-9a52-28bb33b47567'} Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b07abb3-f10d-4b65-9a52-28bb33b47567 could not be found. Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b07abb3-f10d-4b65-9a52-28bb33b47567 could not be found. Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:00:57.066501 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:57.070456 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:00:57.070456 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:00:57.070456 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:00:57.070456 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:00:57.070456 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:00:57.070456 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b07abb3-f10d-4b65-9a52-28bb33b47567 could not be found. Sep 17 21:00:57.070456 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:00:57.071352 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1d145d0d-52ef-49b6-8c22-1f148bb3c912 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:57.072707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-87aaae4e-2160-489f-9bbf-92b475b978f7 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Returning 404 to user: Instance 7b07abb3-f10d-4b65-9a52-28bb33b47567 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:00:57.073851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1d145d0d-52ef-49b6-8c22-1f148bb3c912 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:57.074116 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-87aaae4e-2160-489f-9bbf-92b475b978f7 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567" status: 404 len: 111 microversion: 2.1 time: 0.097603 Sep 17 21:00:57.074643 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1d145d0d-52ef-49b6-8c22-1f148bb3c912 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:57.078207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1d145d0d-52ef-49b6-8c22-1f148bb3c912 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:57.078350 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1334/2597] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:56 2022] GET /compute/v2.1/servers/7b07abb3-f10d-4b65-9a52-28bb33b47567 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 21:00:57.082131 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2202bf53-7476-4cc2-ba81-ad649cd3f369 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:57.082441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1d145d0d-52ef-49b6-8c22-1f148bb3c912 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:57.083396 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2202bf53-7476-4cc2-ba81-ad649cd3f369 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:57.092492 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2202bf53-7476-4cc2-ba81-ad649cd3f369 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:57.093469 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2202bf53-7476-4cc2-ba81-ad649cd3f369 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:57.094122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2202bf53-7476-4cc2-ba81-ad649cd3f369 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:57.095111 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2202bf53-7476-4cc2-ba81-ad649cd3f369 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:57.095681 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2202bf53-7476-4cc2-ba81-ad649cd3f369 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:57.096349 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2202bf53-7476-4cc2-ba81-ad649cd3f369 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:57.300132 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2202bf53-7476-4cc2-ba81-ad649cd3f369 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.223527 Sep 17 21:00:57.301395 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1335/2598] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Sep 17 21:00:57 2022] GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297/os-interface => generated 285 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:00:57.319336 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5ca565d2-79ae-4cb2-b5ad-7fce3443035b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:57.362601 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5ca565d2-79ae-4cb2-b5ad-7fce3443035b tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/3ec7ae95-2707-4480-b831-a65a9b35cb03" status: 204 len: 0 microversion: 2.1 time: 0.048598 Sep 17 21:00:57.364013 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1336/2599] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Sep 17 21:00:57 2022] DELETE /compute/v2.1/os-server-groups/3ec7ae95-2707-4480-b831-a65a9b35cb03 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:00:57.375434 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a6ef764c-6e17-4a6a-b93e-98e1e14fe9f0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:57.376495 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a6ef764c-6e17-4a6a-b93e-98e1e14fe9f0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: faba011e-8cd7-4120-9e2d-8e98112899b3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:57.387733 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6ef764c-6e17-4a6a-b93e-98e1e14fe9f0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:57.388684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6ef764c-6e17-4a6a-b93e-98e1e14fe9f0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:57.389502 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6ef764c-6e17-4a6a-b93e-98e1e14fe9f0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:57.390544 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6ef764c-6e17-4a6a-b93e-98e1e14fe9f0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:57.391817 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6ef764c-6e17-4a6a-b93e-98e1e14fe9f0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:57.393306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6ef764c-6e17-4a6a-b93e-98e1e14fe9f0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:57.427883 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a6ef764c-6e17-4a6a-b93e-98e1e14fe9f0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: faba011e-8cd7-4120-9e2d-8e98112899b3] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:00:57.469803 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:57.502102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1d145d0d-52ef-49b6-8c22-1f148bb3c912 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:57.512377 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1d145d0d-52ef-49b6-8c22-1f148bb3c912 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 200 len: 1315 microversion: 2.1 time: 0.470270 Sep 17 21:00:57.526993 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1264/2600] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:57 2022] GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:57.538546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6ea9a998-141a-4429-9b3b-4ad481cdbce4 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:57.539474 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6ea9a998-141a-4429-9b3b-4ad481cdbce4 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:57.548516 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6ea9a998-141a-4429-9b3b-4ad481cdbce4 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:57.549331 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6ea9a998-141a-4429-9b3b-4ad481cdbce4 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:57.549961 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6ea9a998-141a-4429-9b3b-4ad481cdbce4 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:57.550844 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6ea9a998-141a-4429-9b3b-4ad481cdbce4 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:57.551609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6ea9a998-141a-4429-9b3b-4ad481cdbce4 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:57.552200 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6ea9a998-141a-4429-9b3b-4ad481cdbce4 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:57.576938 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a6ef764c-6e17-4a6a-b93e-98e1e14fe9f0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "DELETE /compute/v2.1/servers/faba011e-8cd7-4120-9e2d-8e98112899b3" status: 204 len: 0 microversion: 2.1 time: 0.206957 Sep 17 21:00:57.580955 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1337/2601] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:00:57 2022] DELETE /compute/v2.1/servers/faba011e-8cd7-4120-9e2d-8e98112899b3 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:00:57.590825 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-085fb55d-32fb-4c32-8d89-e3866dd644c3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:57.593345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-085fb55d-32fb-4c32-8d89-e3866dd644c3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: e8e78e88-e04b-497b-bef8-c4b57aff1d1d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:57.602105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-085fb55d-32fb-4c32-8d89-e3866dd644c3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:57.602840 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-085fb55d-32fb-4c32-8d89-e3866dd644c3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:57.603499 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-085fb55d-32fb-4c32-8d89-e3866dd644c3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:57.604362 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-085fb55d-32fb-4c32-8d89-e3866dd644c3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:57.604979 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-085fb55d-32fb-4c32-8d89-e3866dd644c3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:57.605629 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-085fb55d-32fb-4c32-8d89-e3866dd644c3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:57.647098 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-085fb55d-32fb-4c32-8d89-e3866dd644c3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: e8e78e88-e04b-497b-bef8-c4b57aff1d1d] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:00:57.791182 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-085fb55d-32fb-4c32-8d89-e3866dd644c3 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d" status: 204 len: 0 microversion: 2.1 time: 0.207664 Sep 17 21:00:57.795855 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1338/2602] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:00:57 2022] DELETE /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 17 21:00:57.803749 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-53f44e27-49cf-40f6-9668-99752eca1666 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:57.805775 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-53f44e27-49cf-40f6-9668-99752eca1666 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 7750732c-19bc-4c5a-8637-af3a08c3af5d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:57.820158 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53f44e27-49cf-40f6-9668-99752eca1666 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:57.820859 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53f44e27-49cf-40f6-9668-99752eca1666 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:57.821798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53f44e27-49cf-40f6-9668-99752eca1666 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:57.822790 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53f44e27-49cf-40f6-9668-99752eca1666 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:57.824593 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53f44e27-49cf-40f6-9668-99752eca1666 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:57.825123 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53f44e27-49cf-40f6-9668-99752eca1666 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:58.000552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6ea9a998-141a-4429-9b3b-4ad481cdbce4 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:58.016106 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6ea9a998-141a-4429-9b3b-4ad481cdbce4 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1472 microversion: 2.1 time: 0.487251 Sep 17 21:00:58.016729 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1265/2603] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:57 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1472 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:58.037109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bae4fe40-744e-4d9a-aa9c-cc208155b2e0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:58.037779 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bae4fe40-744e-4d9a-aa9c-cc208155b2e0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: faba011e-8cd7-4120-9e2d-8e98112899b3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:58.055321 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bae4fe40-744e-4d9a-aa9c-cc208155b2e0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:58.059731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bae4fe40-744e-4d9a-aa9c-cc208155b2e0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:58.060429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bae4fe40-744e-4d9a-aa9c-cc208155b2e0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:58.061311 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bae4fe40-744e-4d9a-aa9c-cc208155b2e0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:58.061593 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bae4fe40-744e-4d9a-aa9c-cc208155b2e0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:58.066152 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bae4fe40-744e-4d9a-aa9c-cc208155b2e0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:58.095464 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-53f44e27-49cf-40f6-9668-99752eca1666 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:58.105439 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-53f44e27-49cf-40f6-9668-99752eca1666 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d" status: 200 len: 1276 microversion: 2.1 time: 0.310697 Sep 17 21:00:58.117339 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1339/2604] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:57 2022] GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d => generated 1276 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:58.132733 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-39739e24-8493-4a11-a734-8348f972e25a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:58.133960 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-39739e24-8493-4a11-a734-8348f972e25a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:58.148526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39739e24-8493-4a11-a734-8348f972e25a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:58.150416 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39739e24-8493-4a11-a734-8348f972e25a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:58.151696 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39739e24-8493-4a11-a734-8348f972e25a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:58.152540 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39739e24-8493-4a11-a734-8348f972e25a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:58.153055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39739e24-8493-4a11-a734-8348f972e25a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:58.153585 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39739e24-8493-4a11-a734-8348f972e25a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:58.562517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bae4fe40-744e-4d9a-aa9c-cc208155b2e0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:58.577699 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bae4fe40-744e-4d9a-aa9c-cc208155b2e0 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/faba011e-8cd7-4120-9e2d-8e98112899b3" status: 200 len: 1474 microversion: 2.1 time: 0.544168 Sep 17 21:00:58.578942 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1266/2605] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:58 2022] GET /compute/v2.1/servers/faba011e-8cd7-4120-9e2d-8e98112899b3 => generated 1474 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:58.596429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-98ab2850-83da-4a4d-8443-d5b8205965e0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:58.597416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-98ab2850-83da-4a4d-8443-d5b8205965e0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:58.605986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98ab2850-83da-4a4d-8443-d5b8205965e0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:58.606749 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98ab2850-83da-4a4d-8443-d5b8205965e0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:58.607432 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98ab2850-83da-4a4d-8443-d5b8205965e0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:58.608390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98ab2850-83da-4a4d-8443-d5b8205965e0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:58.609074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98ab2850-83da-4a4d-8443-d5b8205965e0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:58.609766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98ab2850-83da-4a4d-8443-d5b8205965e0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:58.687606 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-39739e24-8493-4a11-a734-8348f972e25a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:58.713172 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-39739e24-8493-4a11-a734-8348f972e25a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.594287 Sep 17 21:00:58.714041 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1340/2606] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:58 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:58.874222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-96256b2d-8567-4648-a66a-0e8443891288 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1075976077", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "dc0ab76b-95f3-4f0a-beab-7465ea19ce7a"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:00:58.895652 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=10 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:00:58.945825 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-96256b2d-8567-4648-a66a-0e8443891288 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] validate_networks() for [('dc0ab76b-95f3-4f0a-beab-7465ea19ce7a', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:00:59.044955 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-98ab2850-83da-4a4d-8443-d5b8205965e0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:59.114758 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-98ab2850-83da-4a4d-8443-d5b8205965e0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 200 len: 1315 microversion: 2.1 time: 0.534429 Sep 17 21:00:59.117251 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1267/2607] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:58 2022] GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 1315 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:00:59.123454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ee693534-c772-4c13-8e3a-86937b683403 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:00:59.124347 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ee693534-c772-4c13-8e3a-86937b683403 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:00:59.132257 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee693534-c772-4c13-8e3a-86937b683403 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:59.133741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee693534-c772-4c13-8e3a-86937b683403 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:59.134579 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee693534-c772-4c13-8e3a-86937b683403 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:59.137310 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee693534-c772-4c13-8e3a-86937b683403 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:00:59.138119 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee693534-c772-4c13-8e3a-86937b683403 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:00:59.138829 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee693534-c772-4c13-8e3a-86937b683403 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:00:59.980786 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ee693534-c772-4c13-8e3a-86937b683403 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:00:59.991391 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ee693534-c772-4c13-8e3a-86937b683403 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1472 microversion: 2.1 time: 0.872741 Sep 17 21:01:00.009710 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1268/2608] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:00:59 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1472 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:00.016729 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dbe2cb4b-4437-4aa6-96a4-c7f91f217c60 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:00.016729 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dbe2cb4b-4437-4aa6-96a4-c7f91f217c60 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 7750732c-19bc-4c5a-8637-af3a08c3af5d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:00.024317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dbe2cb4b-4437-4aa6-96a4-c7f91f217c60 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:00.025040 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dbe2cb4b-4437-4aa6-96a4-c7f91f217c60 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:00.025598 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dbe2cb4b-4437-4aa6-96a4-c7f91f217c60 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:00.026256 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dbe2cb4b-4437-4aa6-96a4-c7f91f217c60 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:00.026746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dbe2cb4b-4437-4aa6-96a4-c7f91f217c60 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:00.027163 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dbe2cb4b-4437-4aa6-96a4-c7f91f217c60 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:00.169998 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dbe2cb4b-4437-4aa6-96a4-c7f91f217c60 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:00.180363 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dbe2cb4b-4437-4aa6-96a4-c7f91f217c60 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d" status: 200 len: 1276 microversion: 2.1 time: 0.167810 Sep 17 21:01:00.195797 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1269/2609] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:00 2022] GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d => generated 1276 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:00.206137 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ffb4b008-e67a-4f53-96d4-c0029c2c5a45 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:00.207643 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ffb4b008-e67a-4f53-96d4-c0029c2c5a45 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: faba011e-8cd7-4120-9e2d-8e98112899b3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:00.214808 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ffb4b008-e67a-4f53-96d4-c0029c2c5a45 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:00.215300 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ffb4b008-e67a-4f53-96d4-c0029c2c5a45 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:00.216260 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ffb4b008-e67a-4f53-96d4-c0029c2c5a45 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:00.216978 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ffb4b008-e67a-4f53-96d4-c0029c2c5a45 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:00.217430 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ffb4b008-e67a-4f53-96d4-c0029c2c5a45 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:00.219695 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ffb4b008-e67a-4f53-96d4-c0029c2c5a45 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:00.683562 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ffb4b008-e67a-4f53-96d4-c0029c2c5a45 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:00.704883 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ffb4b008-e67a-4f53-96d4-c0029c2c5a45 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/faba011e-8cd7-4120-9e2d-8e98112899b3" status: 200 len: 1474 microversion: 2.1 time: 0.507050 Sep 17 21:01:00.706844 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1270/2610] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:00 2022] GET /compute/v2.1/servers/faba011e-8cd7-4120-9e2d-8e98112899b3 => generated 1474 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:00.757489 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-96256b2d-8567-4648-a66a-0e8443891288 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:01:00.758137 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-96256b2d-8567-4648-a66a-0e8443891288 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:01:00.758791 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-96256b2d-8567-4648-a66a-0e8443891288 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:01:00.759254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-96256b2d-8567-4648-a66a-0e8443891288 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:01:00.759765 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-96256b2d-8567-4648-a66a-0e8443891288 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:01:00.787167 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-96256b2d-8567-4648-a66a-0e8443891288 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:00.787672 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-96256b2d-8567-4648-a66a-0e8443891288 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:00.788121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-96256b2d-8567-4648-a66a-0e8443891288 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:00.788867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-96256b2d-8567-4648-a66a-0e8443891288 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:00.789327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-96256b2d-8567-4648-a66a-0e8443891288 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:00.789788 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-96256b2d-8567-4648-a66a-0e8443891288 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:00.844647 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-96256b2d-8567-4648-a66a-0e8443891288 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Getting quotas for project 36ce01157eec446dbcc93b2948b4be90. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:01:00.850986 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-96256b2d-8567-4648-a66a-0e8443891288 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Getting quotas for user 33fa2d463884464fbe90666c98da0fd7 and project 36ce01157eec446dbcc93b2948b4be90. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:01:00.888222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-96256b2d-8567-4648-a66a-0e8443891288 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:01:00.891119 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-96256b2d-8567-4648-a66a-0e8443891288 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 6beb0759-caaa-4644-b0d6-1d77d21b7e0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:01:00.988762 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-481a3fbb-8847-488c-bd46-b9d361460a4a tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1355969937", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "190e9a46-0fb5-475c-8907-3be5f72a2c2b"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:00.999830 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-96256b2d-8567-4648-a66a-0e8443891288 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.129675 Sep 17 21:01:01.001065 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1341/2611] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:00:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:01:01.005824 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-af9c0d70-c786-4834-8e33-82a207a24676 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:01.006457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-af9c0d70-c786-4834-8e33-82a207a24676 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:01.033974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af9c0d70-c786-4834-8e33-82a207a24676 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:01.034538 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af9c0d70-c786-4834-8e33-82a207a24676 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:01.060073 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af9c0d70-c786-4834-8e33-82a207a24676 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:01.060883 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af9c0d70-c786-4834-8e33-82a207a24676 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:01.061379 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af9c0d70-c786-4834-8e33-82a207a24676 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:01.065929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af9c0d70-c786-4834-8e33-82a207a24676 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:01.097053 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-481a3fbb-8847-488c-bd46-b9d361460a4a tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] validate_networks() for [('190e9a46-0fb5-475c-8907-3be5f72a2c2b', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:01:01.903466 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-af9c0d70-c786-4834-8e33-82a207a24676 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:01.915686 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-af9c0d70-c786-4834-8e33-82a207a24676 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 200 len: 1315 microversion: 2.1 time: 0.913523 Sep 17 21:01:01.944686 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1342/2612] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:01 2022] GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 1315 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:01.952608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-f2a2453a-78bb-4664-9606-d8016352bf19 req-14820ddc-a2d5-4bc4-a3c0-b8dcb83a3c2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a1dbfb5-be75-451c-8ca8-a71949ac2297", "tag": "bb1dd815-ecd5-488c-93a4-3f015b5427ae"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:01.969528 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f2a2453a-78bb-4664-9606-d8016352bf19 req-14820ddc-a2d5-4bc4-a3c0-b8dcb83a3c2f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:01.970290 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f2a2453a-78bb-4664-9606-d8016352bf19 req-14820ddc-a2d5-4bc4-a3c0-b8dcb83a3c2f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:01.971083 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f2a2453a-78bb-4664-9606-d8016352bf19 req-14820ddc-a2d5-4bc4-a3c0-b8dcb83a3c2f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:01.986128 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-f2a2453a-78bb-4664-9606-d8016352bf19 req-14820ddc-a2d5-4bc4-a3c0-b8dcb83a3c2f service nova] Creating event network-changed:bb1dd815-ecd5-488c-93a4-3f015b5427ae for instance 6a1dbfb5-be75-451c-8ca8-a71949ac2297 on nch2-master-1 Sep 17 21:01:02.008849 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-f2a2453a-78bb-4664-9606-d8016352bf19 req-14820ddc-a2d5-4bc4-a3c0-b8dcb83a3c2f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059192 Sep 17 21:01:02.011218 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1343/2613] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:02.039433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8c96b366-5aef-4d28-9068-2fbcf64f5002 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:02.040436 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8c96b366-5aef-4d28-9068-2fbcf64f5002 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 6beb0759-caaa-4644-b0d6-1d77d21b7e0b] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:02.054748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c96b366-5aef-4d28-9068-2fbcf64f5002 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:02.056999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c96b366-5aef-4d28-9068-2fbcf64f5002 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:02.057657 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c96b366-5aef-4d28-9068-2fbcf64f5002 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:02.058850 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c96b366-5aef-4d28-9068-2fbcf64f5002 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:02.060451 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c96b366-5aef-4d28-9068-2fbcf64f5002 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:02.063003 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c96b366-5aef-4d28-9068-2fbcf64f5002 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:02.370501 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8c96b366-5aef-4d28-9068-2fbcf64f5002 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:02.382085 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8c96b366-5aef-4d28-9068-2fbcf64f5002 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b" status: 200 len: 1221 microversion: 2.1 time: 0.367610 Sep 17 21:01:02.382457 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1344/2614] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:02 2022] GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b => generated 1221 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:02.396910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8f2e5c4d-90d3-4ac1-b344-bbd5b8d8abd5 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:02.400159 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8f2e5c4d-90d3-4ac1-b344-bbd5b8d8abd5 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:02.410507 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f2e5c4d-90d3-4ac1-b344-bbd5b8d8abd5 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:02.411010 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f2e5c4d-90d3-4ac1-b344-bbd5b8d8abd5 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:02.417404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f2e5c4d-90d3-4ac1-b344-bbd5b8d8abd5 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:02.418044 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f2e5c4d-90d3-4ac1-b344-bbd5b8d8abd5 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:02.418530 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f2e5c4d-90d3-4ac1-b344-bbd5b8d8abd5 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:02.419063 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f2e5c4d-90d3-4ac1-b344-bbd5b8d8abd5 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:02.839165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-481a3fbb-8847-488c-bd46-b9d361460a4a tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:01:02.840400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-481a3fbb-8847-488c-bd46-b9d361460a4a tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:01:02.841134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-481a3fbb-8847-488c-bd46-b9d361460a4a tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:01:02.841993 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-481a3fbb-8847-488c-bd46-b9d361460a4a tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:01:02.842647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-481a3fbb-8847-488c-bd46-b9d361460a4a tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:01:02.863157 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-481a3fbb-8847-488c-bd46-b9d361460a4a tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:02.864022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-481a3fbb-8847-488c-bd46-b9d361460a4a tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:02.864715 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-481a3fbb-8847-488c-bd46-b9d361460a4a tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:02.871576 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-481a3fbb-8847-488c-bd46-b9d361460a4a tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:02.872308 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-481a3fbb-8847-488c-bd46-b9d361460a4a tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:02.873086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-481a3fbb-8847-488c-bd46-b9d361460a4a tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:02.918556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-481a3fbb-8847-488c-bd46-b9d361460a4a tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Getting quotas for project 77e4ba38e25a4143adfe864a8408c524. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:01:02.956588 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-481a3fbb-8847-488c-bd46-b9d361460a4a tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Getting quotas for user d1bc1e85c16e49c695f073f2a7b40a52 and project 77e4ba38e25a4143adfe864a8408c524. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:01:03.014868 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-481a3fbb-8847-488c-bd46-b9d361460a4a tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:01:03.021748 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-481a3fbb-8847-488c-bd46-b9d361460a4a tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] [instance: a599ed2a-d78f-46e8-a23c-17e9eee0a037] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:01:03.156092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8f2e5c4d-90d3-4ac1-b344-bbd5b8d8abd5 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:03.179614 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8f2e5c4d-90d3-4ac1-b344-bbd5b8d8abd5 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1472 microversion: 2.1 time: 0.793189 Sep 17 21:01:03.181856 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-481a3fbb-8847-488c-bd46-b9d361460a4a tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.472862 Sep 17 21:01:03.182768 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1345/2615] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:02 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1472 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:03.184451 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1271/2616] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:01:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:01:03.206757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e235b550-8446-414b-b3ab-5d5f3f816be3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:03.207326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e235b550-8446-414b-b3ab-5d5f3f816be3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 7750732c-19bc-4c5a-8637-af3a08c3af5d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:03.215943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a9b488c6-e2e0-4328-ada5-2a336d1ab8b8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:03.216816 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a9b488c6-e2e0-4328-ada5-2a336d1ab8b8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: faba011e-8cd7-4120-9e2d-8e98112899b3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:03.231875 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a9b488c6-e2e0-4328-ada5-2a336d1ab8b8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:03.232440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a9b488c6-e2e0-4328-ada5-2a336d1ab8b8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:03.236013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e235b550-8446-414b-b3ab-5d5f3f816be3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:03.236594 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a9b488c6-e2e0-4328-ada5-2a336d1ab8b8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:03.237283 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e235b550-8446-414b-b3ab-5d5f3f816be3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:03.237555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a9b488c6-e2e0-4328-ada5-2a336d1ab8b8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:03.238102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a9b488c6-e2e0-4328-ada5-2a336d1ab8b8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:03.238787 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a9b488c6-e2e0-4328-ada5-2a336d1ab8b8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:03.242120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e235b550-8446-414b-b3ab-5d5f3f816be3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:03.243098 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e235b550-8446-414b-b3ab-5d5f3f816be3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:03.243871 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e235b550-8446-414b-b3ab-5d5f3f816be3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:03.244669 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e235b550-8446-414b-b3ab-5d5f3f816be3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:03.368073 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a9b488c6-e2e0-4328-ada5-2a336d1ab8b8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:03.376959 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a9b488c6-e2e0-4328-ada5-2a336d1ab8b8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:03.378051 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a9b488c6-e2e0-4328-ada5-2a336d1ab8b8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:03.379605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-a9b488c6-e2e0-4328-ada5-2a336d1ab8b8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lazy-loading 'fault' on Instance uuid faba011e-8cd7-4120-9e2d-8e98112899b3 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:01:03.424086 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e235b550-8446-414b-b3ab-5d5f3f816be3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:03.442000 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e235b550-8446-414b-b3ab-5d5f3f816be3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d" status: 200 len: 1282 microversion: 2.1 time: 0.239791 Sep 17 21:01:03.443135 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1346/2617] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:03 2022] GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d => generated 1282 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:03.455698 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3f6e1f59-0ccd-4fa1-bc04-2eb3741157a3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:03.457002 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3f6e1f59-0ccd-4fa1-bc04-2eb3741157a3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:03.496274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f6e1f59-0ccd-4fa1-bc04-2eb3741157a3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:03.498086 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f6e1f59-0ccd-4fa1-bc04-2eb3741157a3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:03.498909 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f6e1f59-0ccd-4fa1-bc04-2eb3741157a3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:03.512048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f6e1f59-0ccd-4fa1-bc04-2eb3741157a3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:03.512680 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f6e1f59-0ccd-4fa1-bc04-2eb3741157a3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:03.513225 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f6e1f59-0ccd-4fa1-bc04-2eb3741157a3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:03.643631 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a9b488c6-e2e0-4328-ada5-2a336d1ab8b8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:03.665269 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a9b488c6-e2e0-4328-ada5-2a336d1ab8b8 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/faba011e-8cd7-4120-9e2d-8e98112899b3" status: 200 len: 1308 microversion: 2.1 time: 0.456668 Sep 17 21:01:03.683759 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1272/2618] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:03 2022] GET /compute/v2.1/servers/faba011e-8cd7-4120-9e2d-8e98112899b3 => generated 1308 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:03.703058 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-458fc63b-6530-43b4-838d-97f79502a927 req-1115e3a0-22ad-48d8-a1d4-2509fee52ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faba011e-8cd7-4120-9e2d-8e98112899b3", "name": "network-vif-deleted", "tag": "1dc51fd9-35d7-4713-b096-63b7f248f58f"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:03.722788 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-458fc63b-6530-43b4-838d-97f79502a927 req-1115e3a0-22ad-48d8-a1d4-2509fee52ab7 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:03.723900 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-458fc63b-6530-43b4-838d-97f79502a927 req-1115e3a0-22ad-48d8-a1d4-2509fee52ab7 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:03.725049 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-458fc63b-6530-43b4-838d-97f79502a927 req-1115e3a0-22ad-48d8-a1d4-2509fee52ab7 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:03.771360 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-458fc63b-6530-43b4-838d-97f79502a927 req-1115e3a0-22ad-48d8-a1d4-2509fee52ab7 service nova] Creating event network-vif-deleted:1dc51fd9-35d7-4713-b096-63b7f248f58f for instance faba011e-8cd7-4120-9e2d-8e98112899b3 on nch2-master-1 Sep 17 21:01:03.792666 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-458fc63b-6530-43b4-838d-97f79502a927 req-1115e3a0-22ad-48d8-a1d4-2509fee52ab7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103620 Sep 17 21:01:03.793581 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1273/2619] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:03.800084 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ad2e2c0e-6a87-4121-ae58-c947f8544698 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:03.801120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ad2e2c0e-6a87-4121-ae58-c947f8544698 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] [instance: a599ed2a-d78f-46e8-a23c-17e9eee0a037] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:03.911935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ad2e2c0e-6a87-4121-ae58-c947f8544698 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bc1e85c16e49c695f073f2a7b40a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4ba38e25a4143adfe864a8408c524', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:03.933863 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ad2e2c0e-6a87-4121-ae58-c947f8544698 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] 10.222.0.26 "GET /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037" status: 200 len: 1216 microversion: 2.1 time: 0.132723 Sep 17 21:01:03.951954 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1274/2620] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:03 2022] GET /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037 => generated 1216 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:03.959851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ec26e97a-e0d3-49c5-a0be-f64fd8e97954 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:03.964210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ec26e97a-e0d3-49c5-a0be-f64fd8e97954 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 6beb0759-caaa-4644-b0d6-1d77d21b7e0b] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:03.976004 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec26e97a-e0d3-49c5-a0be-f64fd8e97954 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:03.977149 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec26e97a-e0d3-49c5-a0be-f64fd8e97954 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:03.977825 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec26e97a-e0d3-49c5-a0be-f64fd8e97954 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:03.979036 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec26e97a-e0d3-49c5-a0be-f64fd8e97954 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:03.979691 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec26e97a-e0d3-49c5-a0be-f64fd8e97954 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:03.980422 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec26e97a-e0d3-49c5-a0be-f64fd8e97954 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:03.999789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3f6e1f59-0ccd-4fa1-bc04-2eb3741157a3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:04.015112 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3f6e1f59-0ccd-4fa1-bc04-2eb3741157a3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 200 len: 1315 microversion: 2.1 time: 0.569795 Sep 17 21:01:04.029925 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1347/2621] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:03 2022] GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 1315 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:04.208104 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-43bec20d-1b0d-48ab-9e8f-849e44fc1034 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:04.208870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-43bec20d-1b0d-48ab-9e8f-849e44fc1034 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:04.224843 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43bec20d-1b0d-48ab-9e8f-849e44fc1034 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:04.225350 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43bec20d-1b0d-48ab-9e8f-849e44fc1034 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:04.236309 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43bec20d-1b0d-48ab-9e8f-849e44fc1034 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:04.237853 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43bec20d-1b0d-48ab-9e8f-849e44fc1034 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:04.238683 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43bec20d-1b0d-48ab-9e8f-849e44fc1034 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:04.238961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43bec20d-1b0d-48ab-9e8f-849e44fc1034 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:04.262695 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ec26e97a-e0d3-49c5-a0be-f64fd8e97954 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:04.277132 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ec26e97a-e0d3-49c5-a0be-f64fd8e97954 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b" status: 200 len: 1275 microversion: 2.1 time: 0.323784 Sep 17 21:01:04.281795 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1275/2622] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:03 2022] GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b => generated 1275 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:04.331613 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-154a1fe7-1d36-4b88-84d8-4a0bb0c5446b req-ffe117b0-cc76-4c6b-af90-14417f14a432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8e78e88-e04b-497b-bef8-c4b57aff1d1d", "name": "network-vif-deleted", "tag": "20742609-eb1b-4058-800c-a0a66327aa5c"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:04.343165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:04.363861 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-154a1fe7-1d36-4b88-84d8-4a0bb0c5446b req-ffe117b0-cc76-4c6b-af90-14417f14a432 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:04.365121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-154a1fe7-1d36-4b88-84d8-4a0bb0c5446b req-ffe117b0-cc76-4c6b-af90-14417f14a432 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:04.365657 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-154a1fe7-1d36-4b88-84d8-4a0bb0c5446b req-ffe117b0-cc76-4c6b-af90-14417f14a432 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:04.416948 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-154a1fe7-1d36-4b88-84d8-4a0bb0c5446b req-ffe117b0-cc76-4c6b-af90-14417f14a432 service nova] Creating event network-vif-deleted:20742609-eb1b-4058-800c-a0a66327aa5c for instance e8e78e88-e04b-497b-bef8-c4b57aff1d1d on nch2-master-1 Sep 17 21:01:04.432086 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-154a1fe7-1d36-4b88-84d8-4a0bb0c5446b req-ffe117b0-cc76-4c6b-af90-14417f14a432 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102071 Sep 17 21:01:04.432768 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1276/2623] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:01:04.471540 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f85feb27-6686-4508-831d-a296a73153c3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:04.472254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f85feb27-6686-4508-831d-a296a73153c3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 7750732c-19bc-4c5a-8637-af3a08c3af5d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:04.484876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f85feb27-6686-4508-831d-a296a73153c3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:04.485357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f85feb27-6686-4508-831d-a296a73153c3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:04.495500 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f85feb27-6686-4508-831d-a296a73153c3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:04.498524 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f85feb27-6686-4508-831d-a296a73153c3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:04.499195 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f85feb27-6686-4508-831d-a296a73153c3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:04.501235 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f85feb27-6686-4508-831d-a296a73153c3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:05.640932 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-43bec20d-1b0d-48ab-9e8f-849e44fc1034 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:05.656527 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-43bec20d-1b0d-48ab-9e8f-849e44fc1034 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1472 microversion: 2.1 time: 1.452705 Sep 17 21:01:05.660625 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1348/2624] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:04 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1472 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:01:05.666406 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-d2589f08-76ab-461b-b0a7-e09460fc59e9 req-368cdd6a-2410-458c-b581-49f35e066918 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b37a20c2-7329-4a0e-8b31-d0a7c39344b3", "name": "network-vif-plugged", "status": "completed", "tag": "2c69be81-79b1-494f-8f9b-4d4b69580fb8"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:05.707352 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d2589f08-76ab-461b-b0a7-e09460fc59e9 req-368cdd6a-2410-458c-b581-49f35e066918 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:05.707847 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d2589f08-76ab-461b-b0a7-e09460fc59e9 req-368cdd6a-2410-458c-b581-49f35e066918 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:05.714526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d2589f08-76ab-461b-b0a7-e09460fc59e9 req-368cdd6a-2410-458c-b581-49f35e066918 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:05.733317 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-d2589f08-76ab-461b-b0a7-e09460fc59e9 req-368cdd6a-2410-458c-b581-49f35e066918 service nova] Creating event network-vif-plugged:2c69be81-79b1-494f-8f9b-4d4b69580fb8 for instance b37a20c2-7329-4a0e-8b31-d0a7c39344b3 on nch2-master-1 Sep 17 21:01:05.745103 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-d2589f08-76ab-461b-b0a7-e09460fc59e9 req-368cdd6a-2410-458c-b581-49f35e066918 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081026 Sep 17 21:01:05.747417 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1349/2625] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:05.756072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-91f2f2aa-1895-4ad7-aceb-d3e9df33cd2e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:05.756966 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-91f2f2aa-1895-4ad7-aceb-d3e9df33cd2e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: faba011e-8cd7-4120-9e2d-8e98112899b3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:05.775298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-91f2f2aa-1895-4ad7-aceb-d3e9df33cd2e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:05.776265 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-91f2f2aa-1895-4ad7-aceb-d3e9df33cd2e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:05.776961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-91f2f2aa-1895-4ad7-aceb-d3e9df33cd2e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:05.778025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-91f2f2aa-1895-4ad7-aceb-d3e9df33cd2e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:05.778642 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-91f2f2aa-1895-4ad7-aceb-d3e9df33cd2e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:05.781422 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-91f2f2aa-1895-4ad7-aceb-d3e9df33cd2e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:05.812296 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-91f2f2aa-1895-4ad7-aceb-d3e9df33cd2e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] HTTP exception thrown: Instance faba011e-8cd7-4120-9e2d-8e98112899b3 could not be found. Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-91f2f2aa-1895-4ad7-aceb-d3e9df33cd2e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Request method failure captured: Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/faba011e-8cd7-4120-9e2d-8e98112899b3 HTTP/1.1 Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjS1i9XeXSkLU6roIN5-V3M30sbhgULjb8tr8aqExkSAIyZY9VKN0LPVRHnETO5tqunffII5qByrOP0geSwUSYjLFCPdfmPpZzaRnm983vzvqA4kLyBsVXOUYx3Hwv-cKGIwQNFiYUDPza0sBrWpmIqLZCr0r7WnWtNySplD0X_QBe4 Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 3515123097e744ef855ef1129fb59cf1 Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersOnMultiNodesTest-277737609 Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3515123097e744ef855ef1129fb59cf1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3515123097e744ef855ef1129fb59cf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3515123097e744ef855ef1129fb59cf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3515123097e744ef855ef1129fb59cf1", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersOnMultiNodesTest-277737609 Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 3515123097e744ef855ef1129fb59cf1 Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-277737609 Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersOnMultiNodesTest-277737609-project Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 0d48260054d84784b89a52d9b766d7c1 Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersOnMultiNodesTest-277737609-project Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance faba011e-8cd7-4120-9e2d-8e98112899b3 could not be found. Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'faba011e-8cd7-4120-9e2d-8e98112899b3'} Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance faba011e-8cd7-4120-9e2d-8e98112899b3 could not be found. Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance faba011e-8cd7-4120-9e2d-8e98112899b3 could not be found. Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:05.815144 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:05.830378 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:05.830378 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:05.830378 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:05.830378 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:01:05.830378 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:01:05.830378 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance faba011e-8cd7-4120-9e2d-8e98112899b3 could not be found. Sep 17 21:01:05.830378 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:05.833703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-91f2f2aa-1895-4ad7-aceb-d3e9df33cd2e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Returning 404 to user: Instance faba011e-8cd7-4120-9e2d-8e98112899b3 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:01:05.833703 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-91f2f2aa-1895-4ad7-aceb-d3e9df33cd2e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/faba011e-8cd7-4120-9e2d-8e98112899b3" status: 404 len: 111 microversion: 2.1 time: 0.083565 Sep 17 21:01:05.833703 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1350/2626] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:05 2022] GET /compute/v2.1/servers/faba011e-8cd7-4120-9e2d-8e98112899b3 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:01:05.843650 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ef957f55-1830-44ff-a4e4-684b4e043b51 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:05.844284 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ef957f55-1830-44ff-a4e4-684b4e043b51 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] [instance: a599ed2a-d78f-46e8-a23c-17e9eee0a037] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:05.851672 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef957f55-1830-44ff-a4e4-684b4e043b51 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:05.852175 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef957f55-1830-44ff-a4e4-684b4e043b51 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:05.852609 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef957f55-1830-44ff-a4e4-684b4e043b51 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:05.854219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef957f55-1830-44ff-a4e4-684b4e043b51 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:05.854817 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef957f55-1830-44ff-a4e4-684b4e043b51 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:05.855586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef957f55-1830-44ff-a4e4-684b4e043b51 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:06.043647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f85feb27-6686-4508-831d-a296a73153c3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:06.054989 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ef957f55-1830-44ff-a4e4-684b4e043b51 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bc1e85c16e49c695f073f2a7b40a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4ba38e25a4143adfe864a8408c524', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:06.060872 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f85feb27-6686-4508-831d-a296a73153c3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d" status: 200 len: 1324 microversion: 2.1 time: 1.593703 Sep 17 21:01:06.065759 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ef957f55-1830-44ff-a4e4-684b4e043b51 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] 10.222.0.26 "GET /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037" status: 200 len: 1286 microversion: 2.1 time: 0.231485 Sep 17 21:01:06.066738 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1277/2627] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:04 2022] GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d => generated 1324 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:01:06.086942 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7191529f-f3c9-4569-886b-866ae54e784c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:06.087557 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1351/2628] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:05 2022] GET /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037 => generated 1286 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:06.092573 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-afd8f211-ca1e-432b-a8bc-9138b81f0dd6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:06.093592 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7191529f-f3c9-4569-886b-866ae54e784c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:06.097779 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-afd8f211-ca1e-432b-a8bc-9138b81f0dd6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 6beb0759-caaa-4644-b0d6-1d77d21b7e0b] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:06.106179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7191529f-f3c9-4569-886b-866ae54e784c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:06.108228 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-afd8f211-ca1e-432b-a8bc-9138b81f0dd6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:06.108934 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7191529f-f3c9-4569-886b-866ae54e784c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:06.109560 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7191529f-f3c9-4569-886b-866ae54e784c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:06.110235 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-afd8f211-ca1e-432b-a8bc-9138b81f0dd6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:06.111147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7191529f-f3c9-4569-886b-866ae54e784c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:06.111772 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-afd8f211-ca1e-432b-a8bc-9138b81f0dd6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:06.112724 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7191529f-f3c9-4569-886b-866ae54e784c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:06.113451 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-afd8f211-ca1e-432b-a8bc-9138b81f0dd6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:06.114061 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7191529f-f3c9-4569-886b-866ae54e784c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:06.114715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-afd8f211-ca1e-432b-a8bc-9138b81f0dd6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:06.120012 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-afd8f211-ca1e-432b-a8bc-9138b81f0dd6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:06.155868 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:06.605574 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7191529f-f3c9-4569-886b-866ae54e784c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:06.616113 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7191529f-f3c9-4569-886b-866ae54e784c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 200 len: 1315 microversion: 2.1 time: 0.547662 Sep 17 21:01:06.632314 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1278/2629] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:06 2022] GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 1315 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:06.632314 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-49488e79-7efc-43a8-bb95-4c108bf25814 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:06.632314 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-49488e79-7efc-43a8-bb95-4c108bf25814 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: e8e78e88-e04b-497b-bef8-c4b57aff1d1d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:06.638526 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49488e79-7efc-43a8-bb95-4c108bf25814 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:06.638883 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-afd8f211-ca1e-432b-a8bc-9138b81f0dd6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:06.639567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49488e79-7efc-43a8-bb95-4c108bf25814 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:06.640081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49488e79-7efc-43a8-bb95-4c108bf25814 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:06.640870 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49488e79-7efc-43a8-bb95-4c108bf25814 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:06.641394 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49488e79-7efc-43a8-bb95-4c108bf25814 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:06.643169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49488e79-7efc-43a8-bb95-4c108bf25814 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:06.651821 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-afd8f211-ca1e-432b-a8bc-9138b81f0dd6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b" status: 200 len: 1317 microversion: 2.1 time: 0.562621 Sep 17 21:01:06.653790 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1352/2630] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:06 2022] GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b => generated 1317 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:06.661245 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-49488e79-7efc-43a8-bb95-4c108bf25814 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] HTTP exception thrown: Instance e8e78e88-e04b-497b-bef8-c4b57aff1d1d could not be found. Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-49488e79-7efc-43a8-bb95-4c108bf25814 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Request method failure captured: Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d HTTP/1.1 Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjS1i9XeXSkLU6roIN5-V3M30sbhgULjb8tr8aqExkSAIyZY9VKN0LPVRHnETO5tqunffII5qByrOP0geSwUSYjLFCPdfmPpZzaRnm983vzvqA4kLyBsVXOUYx3Hwv-cKGIwQNFiYUDPza0sBrWpmIqLZCr0r7WnWtNySplD0X_QBe4 Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 3515123097e744ef855ef1129fb59cf1 Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersOnMultiNodesTest-277737609 Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3515123097e744ef855ef1129fb59cf1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3515123097e744ef855ef1129fb59cf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3515123097e744ef855ef1129fb59cf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3515123097e744ef855ef1129fb59cf1", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersOnMultiNodesTest-277737609 Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 3515123097e744ef855ef1129fb59cf1 Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-277737609 Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersOnMultiNodesTest-277737609-project Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 0d48260054d84784b89a52d9b766d7c1 Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersOnMultiNodesTest-277737609-project Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance e8e78e88-e04b-497b-bef8-c4b57aff1d1d could not be found. Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'e8e78e88-e04b-497b-bef8-c4b57aff1d1d'} Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8e78e88-e04b-497b-bef8-c4b57aff1d1d could not be found. Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8e78e88-e04b-497b-bef8-c4b57aff1d1d could not be found. Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:06.663103 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:06.667789 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:06.667789 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:06.667789 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:06.667789 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:01:06.667789 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:01:06.667789 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8e78e88-e04b-497b-bef8-c4b57aff1d1d could not be found. Sep 17 21:01:06.667789 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:06.667789 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-49488e79-7efc-43a8-bb95-4c108bf25814 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Returning 404 to user: Instance e8e78e88-e04b-497b-bef8-c4b57aff1d1d could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:01:06.667789 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-49488e79-7efc-43a8-bb95-4c108bf25814 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d" status: 404 len: 111 microversion: 2.1 time: 0.046048 Sep 17 21:01:06.667789 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1279/2631] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:06 2022] GET /compute/v2.1/servers/e8e78e88-e04b-497b-bef8-c4b57aff1d1d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:01:06.673323 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9629780d-3117-4e25-babd-5802d63baab4 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:06.688342 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e237ce88-6b02-4bd8-ac33-b0751c6e1264 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:06.689147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e237ce88-6b02-4bd8-ac33-b0751c6e1264 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:06.695538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e237ce88-6b02-4bd8-ac33-b0751c6e1264 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:06.696952 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e237ce88-6b02-4bd8-ac33-b0751c6e1264 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:06.697688 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e237ce88-6b02-4bd8-ac33-b0751c6e1264 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:06.698696 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e237ce88-6b02-4bd8-ac33-b0751c6e1264 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:06.699267 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e237ce88-6b02-4bd8-ac33-b0751c6e1264 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:06.699808 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e237ce88-6b02-4bd8-ac33-b0751c6e1264 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:06.705412 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=4,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:06.721122 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9629780d-3117-4e25-babd-5802d63baab4 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/51946a10-f884-4d05-8e1f-9dbf3dee88ef" status: 204 len: 0 microversion: 2.1 time: 0.051582 Sep 17 21:01:06.723989 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1353/2632] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Sep 17 21:01:06 2022] DELETE /compute/v2.1/os-server-groups/51946a10-f884-4d05-8e1f-9dbf3dee88ef => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:01:06.731109 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-979c245d-e90d-4232-b3cc-e30c69ab096d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:06.731992 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-979c245d-e90d-4232-b3cc-e30c69ab096d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 8f0929b7-f8de-4896-a0de-a2388fef54f3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:06.741608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-979c245d-e90d-4232-b3cc-e30c69ab096d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:06.742362 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-979c245d-e90d-4232-b3cc-e30c69ab096d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:06.743000 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-979c245d-e90d-4232-b3cc-e30c69ab096d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:06.743889 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-979c245d-e90d-4232-b3cc-e30c69ab096d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:06.744478 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-979c245d-e90d-4232-b3cc-e30c69ab096d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:06.745037 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-979c245d-e90d-4232-b3cc-e30c69ab096d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:06.775964 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-979c245d-e90d-4232-b3cc-e30c69ab096d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 8f0929b7-f8de-4896-a0de-a2388fef54f3] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:01:06.820101 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:06.920824 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-979c245d-e90d-4232-b3cc-e30c69ab096d tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3" status: 204 len: 0 microversion: 2.1 time: 0.188931 Sep 17 21:01:06.922357 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1354/2633] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:01:06 2022] DELETE /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 17 21:01:06.937357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2483bcf7-58ae-468d-9184-e71102b81088 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:06.938386 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2483bcf7-58ae-468d-9184-e71102b81088 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 8f0929b7-f8de-4896-a0de-a2388fef54f3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:06.945624 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2483bcf7-58ae-468d-9184-e71102b81088 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:06.946361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2483bcf7-58ae-468d-9184-e71102b81088 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:06.947129 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2483bcf7-58ae-468d-9184-e71102b81088 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:06.948016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2483bcf7-58ae-468d-9184-e71102b81088 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:06.949003 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2483bcf7-58ae-468d-9184-e71102b81088 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:06.952168 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2483bcf7-58ae-468d-9184-e71102b81088 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:07.012294 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e237ce88-6b02-4bd8-ac33-b0751c6e1264 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:07.021640 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e237ce88-6b02-4bd8-ac33-b0751c6e1264 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1472 microversion: 2.1 time: 0.338396 Sep 17 21:01:07.022672 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1280/2634] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:06 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1472 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:07.102437 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-595f0347-f2cc-49e4-b608-b3ff4052a74f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:07.103259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-595f0347-f2cc-49e4-b608-b3ff4052a74f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 7750732c-19bc-4c5a-8637-af3a08c3af5d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:07.121492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-595f0347-f2cc-49e4-b608-b3ff4052a74f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:07.122136 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-595f0347-f2cc-49e4-b608-b3ff4052a74f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:07.122853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-595f0347-f2cc-49e4-b608-b3ff4052a74f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:07.123716 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-595f0347-f2cc-49e4-b608-b3ff4052a74f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:07.124274 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-595f0347-f2cc-49e4-b608-b3ff4052a74f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:07.124821 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-595f0347-f2cc-49e4-b608-b3ff4052a74f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:07.189487 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2483bcf7-58ae-468d-9184-e71102b81088 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:07.200140 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2483bcf7-58ae-468d-9184-e71102b81088 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3" status: 200 len: 1472 microversion: 2.1 time: 0.273267 Sep 17 21:01:07.214272 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1355/2635] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:06 2022] GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3 => generated 1472 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:07.223373 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-34618a9d-7e7f-4b58-bd37-5da9a3c247e7 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:07.224762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-34618a9d-7e7f-4b58-bd37-5da9a3c247e7 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] [instance: a599ed2a-d78f-46e8-a23c-17e9eee0a037] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:07.231457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-34618a9d-7e7f-4b58-bd37-5da9a3c247e7 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:07.232200 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-34618a9d-7e7f-4b58-bd37-5da9a3c247e7 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:07.232810 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-34618a9d-7e7f-4b58-bd37-5da9a3c247e7 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:07.233754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-34618a9d-7e7f-4b58-bd37-5da9a3c247e7 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:07.234810 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-34618a9d-7e7f-4b58-bd37-5da9a3c247e7 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:07.235395 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-34618a9d-7e7f-4b58-bd37-5da9a3c247e7 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:07.341303 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-34618a9d-7e7f-4b58-bd37-5da9a3c247e7 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bc1e85c16e49c695f073f2a7b40a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4ba38e25a4143adfe864a8408c524', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:07.354734 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-34618a9d-7e7f-4b58-bd37-5da9a3c247e7 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] 10.222.0.26 "GET /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037" status: 200 len: 1274 microversion: 2.1 time: 0.138989 Sep 17 21:01:07.355933 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1356/2636] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:07 2022] GET /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037 => generated 1274 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:07.376767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bf1a07c6-9d8f-46bc-ab72-d1a77312bbc5 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:07.377509 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bf1a07c6-9d8f-46bc-ab72-d1a77312bbc5 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:07.386762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf1a07c6-9d8f-46bc-ab72-d1a77312bbc5 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:07.387299 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf1a07c6-9d8f-46bc-ab72-d1a77312bbc5 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:07.387746 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf1a07c6-9d8f-46bc-ab72-d1a77312bbc5 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:07.388581 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-595f0347-f2cc-49e4-b608-b3ff4052a74f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:07.389351 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf1a07c6-9d8f-46bc-ab72-d1a77312bbc5 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:07.389934 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf1a07c6-9d8f-46bc-ab72-d1a77312bbc5 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:07.390334 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf1a07c6-9d8f-46bc-ab72-d1a77312bbc5 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:07.404142 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-595f0347-f2cc-49e4-b608-b3ff4052a74f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d" status: 200 len: 1324 microversion: 2.1 time: 0.304078 Sep 17 21:01:07.407036 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-bf1a07c6-9d8f-46bc-ab72-d1a77312bbc5 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] HTTP exception thrown: Instance 22b13c98-aea4-497c-a213-142393b2758c could not be found. Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bf1a07c6-9d8f-46bc-ab72-d1a77312bbc5 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Request method failure captured: Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c HTTP/1.1 Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjQTKLEBZbFTsks6u0BzNF1e048KULnAYR8xgDyvmv9WQoit97-R16XS32jBYO2oPbfBmF0D66e52_MbizQvHUEh6nSUzOftn_URw6K08VaCKPxYaGgn-w4uZXzhAkYUJdjpAZ4xmN6ceNU2iSIhx8duX6LxzyWDOTr5K0Ou-PqmRxo Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: X-Openstack-Nova-Api-Version: 2.32 Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 822801d3963d45c1b4176259fb5c5b19 Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-TaggedBootDevicesTest-356253908 Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/822801d3963d45c1b4176259fb5c5b19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/822801d3963d45c1b4176259fb5c5b19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/822801d3963d45c1b4176259fb5c5b19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_822801d3963d45c1b4176259fb5c5b19", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-TaggedBootDevicesTest-356253908 Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 822801d3963d45c1b4176259fb5c5b19 Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-TaggedBootDevicesTest-356253908 Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-TaggedBootDevicesTest-356253908-project Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 55e8e491f8844f7696f93d8ec5a7171b Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-TaggedBootDevicesTest-356253908-project Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 22b13c98-aea4-497c-a213-142393b2758c could not be found. Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '22b13c98-aea4-497c-a213-142393b2758c'} Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22b13c98-aea4-497c-a213-142393b2758c could not be found. Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:01:07.415314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:01:07.424120 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22b13c98-aea4-497c-a213-142393b2758c could not be found. Sep 17 21:01:07.424120 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:07.424120 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:07.424120 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:07.424120 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:07.424120 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:07.424120 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:07.424120 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:01:07.424120 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:01:07.424120 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22b13c98-aea4-497c-a213-142393b2758c could not be found. Sep 17 21:01:07.424120 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:07.424120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bf1a07c6-9d8f-46bc-ab72-d1a77312bbc5 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Returning 404 to user: Instance 22b13c98-aea4-497c-a213-142393b2758c could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:01:07.424120 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bf1a07c6-9d8f-46bc-ab72-d1a77312bbc5 tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "DELETE /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 404 len: 111 microversion: 2.32 time: 0.045086 Sep 17 21:01:07.424120 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1357/2637] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 17 21:01:07 2022] DELETE /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 17 21:01:07.433663 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1281/2638] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:07 2022] GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d => generated 1324 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:07.433829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-e4702146-d236-40e2-b1a0-bc89c6228b92 req-6cc0c8e5-37f9-4099-9f62-240bb2583110 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7750732c-19bc-4c5a-8637-af3a08c3af5d", "tag": "c0574c06-40f2-449c-a082-5faa99b18540"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:07.443074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1e2f5d30-a0e8-4767-92d0-7946a2bf843b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:07.444060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1e2f5d30-a0e8-4767-92d0-7946a2bf843b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] [instance: 22b13c98-aea4-497c-a213-142393b2758c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:07.450978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e4702146-d236-40e2-b1a0-bc89c6228b92 req-6cc0c8e5-37f9-4099-9f62-240bb2583110 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:07.452109 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e4702146-d236-40e2-b1a0-bc89c6228b92 req-6cc0c8e5-37f9-4099-9f62-240bb2583110 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:07.453154 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e4702146-d236-40e2-b1a0-bc89c6228b92 req-6cc0c8e5-37f9-4099-9f62-240bb2583110 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:07.456565 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1e2f5d30-a0e8-4767-92d0-7946a2bf843b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:07.458206 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1e2f5d30-a0e8-4767-92d0-7946a2bf843b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:07.461383 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1e2f5d30-a0e8-4767-92d0-7946a2bf843b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:07.463584 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1e2f5d30-a0e8-4767-92d0-7946a2bf843b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:07.465038 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1e2f5d30-a0e8-4767-92d0-7946a2bf843b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:07.467950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1e2f5d30-a0e8-4767-92d0-7946a2bf843b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:07.469291 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-e4702146-d236-40e2-b1a0-bc89c6228b92 req-6cc0c8e5-37f9-4099-9f62-240bb2583110 service nova] Creating event network-changed:c0574c06-40f2-449c-a082-5faa99b18540 for instance 7750732c-19bc-4c5a-8637-af3a08c3af5d on nch2-master-1 Sep 17 21:01:07.476205 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-e4702146-d236-40e2-b1a0-bc89c6228b92 req-6cc0c8e5-37f9-4099-9f62-240bb2583110 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055088 Sep 17 21:01:07.477117 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1358/2639] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:07.495662 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-1e2f5d30-a0e8-4767-92d0-7946a2bf843b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] HTTP exception thrown: Instance 22b13c98-aea4-497c-a213-142393b2758c could not be found. Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1e2f5d30-a0e8-4767-92d0-7946a2bf843b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Request method failure captured: Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c HTTP/1.1 Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjQTKLEBZbFTsks6u0BzNF1e048KULnAYR8xgDyvmv9WQoit97-R16XS32jBYO2oPbfBmF0D66e52_MbizQvHUEh6nSUzOftn_URw6K08VaCKPxYaGgn-w4uZXzhAkYUJdjpAZ4xmN6ceNU2iSIhx8duX6LxzyWDOTr5K0Ou-PqmRxo Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: X-Openstack-Nova-Api-Version: 2.32 Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 822801d3963d45c1b4176259fb5c5b19 Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-TaggedBootDevicesTest-356253908 Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/822801d3963d45c1b4176259fb5c5b19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/822801d3963d45c1b4176259fb5c5b19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/822801d3963d45c1b4176259fb5c5b19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_822801d3963d45c1b4176259fb5c5b19", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-TaggedBootDevicesTest-356253908 Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 822801d3963d45c1b4176259fb5c5b19 Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-TaggedBootDevicesTest-356253908 Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-TaggedBootDevicesTest-356253908-project Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 55e8e491f8844f7696f93d8ec5a7171b Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-TaggedBootDevicesTest-356253908-project Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 22b13c98-aea4-497c-a213-142393b2758c could not be found. Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '22b13c98-aea4-497c-a213-142393b2758c'} Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22b13c98-aea4-497c-a213-142393b2758c could not be found. Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22b13c98-aea4-497c-a213-142393b2758c could not be found. Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:07.498178 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:07.502463 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:07.502463 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:07.502463 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:07.502463 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:01:07.502463 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:01:07.502463 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22b13c98-aea4-497c-a213-142393b2758c could not be found. Sep 17 21:01:07.502463 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:07.503346 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1e2f5d30-a0e8-4767-92d0-7946a2bf843b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] Returning 404 to user: Instance 22b13c98-aea4-497c-a213-142393b2758c could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:01:07.504534 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1e2f5d30-a0e8-4767-92d0-7946a2bf843b tempest-TaggedBootDevicesTest-356253908 tempest-TaggedBootDevicesTest-356253908-project] 10.222.0.26 "GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c" status: 404 len: 111 microversion: 2.32 time: 0.076844 Sep 17 21:01:07.505714 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1282/2640] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:01:07 2022] GET /compute/v2.1/servers/22b13c98-aea4-497c-a213-142393b2758c => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:01:07.647062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8920f67b-8068-41c0-9ee7-9c4970bf3dc1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:07.648650 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8920f67b-8068-41c0-9ee7-9c4970bf3dc1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:07.657203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8920f67b-8068-41c0-9ee7-9c4970bf3dc1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:07.658403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8920f67b-8068-41c0-9ee7-9c4970bf3dc1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:07.659072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8920f67b-8068-41c0-9ee7-9c4970bf3dc1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:07.660165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8920f67b-8068-41c0-9ee7-9c4970bf3dc1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:07.661121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8920f67b-8068-41c0-9ee7-9c4970bf3dc1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:07.663832 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8920f67b-8068-41c0-9ee7-9c4970bf3dc1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:07.684568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7ca8e1e3-3af6-4ede-89f0-bbb2ae7f51cf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:07.685196 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7ca8e1e3-3af6-4ede-89f0-bbb2ae7f51cf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 6beb0759-caaa-4644-b0d6-1d77d21b7e0b] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:07.704526 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ca8e1e3-3af6-4ede-89f0-bbb2ae7f51cf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:07.705379 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ca8e1e3-3af6-4ede-89f0-bbb2ae7f51cf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:07.708853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ca8e1e3-3af6-4ede-89f0-bbb2ae7f51cf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:07.709654 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ca8e1e3-3af6-4ede-89f0-bbb2ae7f51cf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:07.710117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ca8e1e3-3af6-4ede-89f0-bbb2ae7f51cf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:07.710562 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ca8e1e3-3af6-4ede-89f0-bbb2ae7f51cf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:08.036080 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7ca8e1e3-3af6-4ede-89f0-bbb2ae7f51cf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:08.044781 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7ca8e1e3-3af6-4ede-89f0-bbb2ae7f51cf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b" status: 200 len: 1317 microversion: 2.1 time: 0.364313 Sep 17 21:01:08.045380 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1283/2641] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:07 2022] GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b => generated 1317 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:08.058758 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dda9ff9f-cacc-4015-a86b-906d6e0be495 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:08.062459 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dda9ff9f-cacc-4015-a86b-906d6e0be495 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:08.076377 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dda9ff9f-cacc-4015-a86b-906d6e0be495 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:08.076886 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dda9ff9f-cacc-4015-a86b-906d6e0be495 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:08.077339 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dda9ff9f-cacc-4015-a86b-906d6e0be495 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:08.078098 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dda9ff9f-cacc-4015-a86b-906d6e0be495 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:08.078736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dda9ff9f-cacc-4015-a86b-906d6e0be495 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:08.079326 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dda9ff9f-cacc-4015-a86b-906d6e0be495 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:08.131573 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8920f67b-8068-41c0-9ee7-9c4970bf3dc1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:08.144420 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8920f67b-8068-41c0-9ee7-9c4970bf3dc1 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 200 len: 1502 microversion: 2.1 time: 0.508000 Sep 17 21:01:08.146881 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1359/2642] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:07 2022] GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 1502 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:08.170624 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c3a1a6be-8d14-4f07-8b29-090c685e542c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:08.178104 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3a1a6be-8d14-4f07-8b29-090c685e542c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:08.178850 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3a1a6be-8d14-4f07-8b29-090c685e542c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:08.179479 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3a1a6be-8d14-4f07-8b29-090c685e542c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:08.223094 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c3a1a6be-8d14-4f07-8b29-090c685e542c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Going to try to stop instance {{(pid=140524) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 17 21:01:08.284407 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c3a1a6be-8d14-4f07-8b29-090c685e542c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "POST /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3/action" status: 202 len: 0 microversion: 2.1 time: 0.116132 Sep 17 21:01:08.285439 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1360/2643] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:01:08 2022] POST /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 17 21:01:08.295253 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-6ec91fef-d33c-406a-8a8c-48226999be4d req-230e958d-e84f-4dcc-8988-be7da836d75b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6beb0759-caaa-4644-b0d6-1d77d21b7e0b", "tag": "10cbd0fe-ed39-47c4-8c48-636b6e3ddd4f"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:08.308368 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6ec91fef-d33c-406a-8a8c-48226999be4d req-230e958d-e84f-4dcc-8988-be7da836d75b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:08.309048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6ec91fef-d33c-406a-8a8c-48226999be4d req-230e958d-e84f-4dcc-8988-be7da836d75b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:08.309903 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6ec91fef-d33c-406a-8a8c-48226999be4d req-230e958d-e84f-4dcc-8988-be7da836d75b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:08.339172 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-6ec91fef-d33c-406a-8a8c-48226999be4d req-230e958d-e84f-4dcc-8988-be7da836d75b service nova] Creating event network-changed:10cbd0fe-ed39-47c4-8c48-636b6e3ddd4f for instance 6beb0759-caaa-4644-b0d6-1d77d21b7e0b on nch1-master-1 Sep 17 21:01:08.344463 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-6ec91fef-d33c-406a-8a8c-48226999be4d req-230e958d-e84f-4dcc-8988-be7da836d75b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054011 Sep 17 21:01:08.345288 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1361/2644] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:08.350996 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-311f5530-ccf5-4211-84f7-04736429ea0e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:08.351905 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-311f5530-ccf5-4211-84f7-04736429ea0e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 8f0929b7-f8de-4896-a0de-a2388fef54f3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:08.359452 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-311f5530-ccf5-4211-84f7-04736429ea0e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:08.360173 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-311f5530-ccf5-4211-84f7-04736429ea0e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:08.360787 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-311f5530-ccf5-4211-84f7-04736429ea0e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:08.361717 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-311f5530-ccf5-4211-84f7-04736429ea0e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:08.362620 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-311f5530-ccf5-4211-84f7-04736429ea0e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:08.363384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-311f5530-ccf5-4211-84f7-04736429ea0e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:08.559362 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dda9ff9f-cacc-4015-a86b-906d6e0be495 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:08.576897 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dda9ff9f-cacc-4015-a86b-906d6e0be495 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1472 microversion: 2.1 time: 0.526042 Sep 17 21:01:08.578416 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1284/2645] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:08 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1472 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:08.602458 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-522c6ccf-ca6d-4d97-b402-3d7703d7947f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:08.603089 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-522c6ccf-ca6d-4d97-b402-3d7703d7947f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:08.610031 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-522c6ccf-ca6d-4d97-b402-3d7703d7947f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:08.610565 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-522c6ccf-ca6d-4d97-b402-3d7703d7947f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:08.611008 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-522c6ccf-ca6d-4d97-b402-3d7703d7947f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:08.611792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-522c6ccf-ca6d-4d97-b402-3d7703d7947f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:08.612304 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-522c6ccf-ca6d-4d97-b402-3d7703d7947f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:08.612740 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-522c6ccf-ca6d-4d97-b402-3d7703d7947f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:08.770395 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-311f5530-ccf5-4211-84f7-04736429ea0e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:08.780809 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-311f5530-ccf5-4211-84f7-04736429ea0e tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3" status: 200 len: 1472 microversion: 2.1 time: 0.434093 Sep 17 21:01:08.783157 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1362/2646] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:08 2022] GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3 => generated 1472 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:08.797663 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-78c89fbe-6468-4bf5-981f-484b2f1dc73c tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:08.797663 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-78c89fbe-6468-4bf5-981f-484b2f1dc73c tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] [instance: a599ed2a-d78f-46e8-a23c-17e9eee0a037] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:08.813111 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-78c89fbe-6468-4bf5-981f-484b2f1dc73c tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:08.814079 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-78c89fbe-6468-4bf5-981f-484b2f1dc73c tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:08.814928 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-78c89fbe-6468-4bf5-981f-484b2f1dc73c tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:08.819030 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-78c89fbe-6468-4bf5-981f-484b2f1dc73c tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:08.820198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-78c89fbe-6468-4bf5-981f-484b2f1dc73c tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:08.820198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-78c89fbe-6468-4bf5-981f-484b2f1dc73c tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:08.971472 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-522c6ccf-ca6d-4d97-b402-3d7703d7947f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:08.985381 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-522c6ccf-ca6d-4d97-b402-3d7703d7947f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 200 len: 1512 microversion: 2.1 time: 0.389262 Sep 17 21:01:08.989392 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1285/2647] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:08 2022] GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 1512 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:08.995070 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-48b31c1e-bfa5-4e5e-a9ec-54b1d303c92e tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:08.996010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-48b31c1e-bfa5-4e5e-a9ec-54b1d303c92e tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 7750732c-19bc-4c5a-8637-af3a08c3af5d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:09.003695 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-48b31c1e-bfa5-4e5e-a9ec-54b1d303c92e tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:09.004653 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-48b31c1e-bfa5-4e5e-a9ec-54b1d303c92e tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:09.005337 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-48b31c1e-bfa5-4e5e-a9ec-54b1d303c92e tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:09.006317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-48b31c1e-bfa5-4e5e-a9ec-54b1d303c92e tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:09.006991 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-48b31c1e-bfa5-4e5e-a9ec-54b1d303c92e tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:09.008384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-48b31c1e-bfa5-4e5e-a9ec-54b1d303c92e tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:09.302306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-78c89fbe-6468-4bf5-981f-484b2f1dc73c tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bc1e85c16e49c695f073f2a7b40a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4ba38e25a4143adfe864a8408c524', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:09.317252 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-78c89fbe-6468-4bf5-981f-484b2f1dc73c tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] 10.222.0.26 "GET /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037" status: 200 len: 1316 microversion: 2.1 time: 0.529574 Sep 17 21:01:09.330285 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1363/2648] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:08 2022] GET /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037 => generated 1316 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:09.330285 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-001c9ba0-7302-4d50-becd-4aa0410f0c67 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:09.330285 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-001c9ba0-7302-4d50-becd-4aa0410f0c67 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 6beb0759-caaa-4644-b0d6-1d77d21b7e0b] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:09.338431 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-001c9ba0-7302-4d50-becd-4aa0410f0c67 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:09.340021 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-001c9ba0-7302-4d50-becd-4aa0410f0c67 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:09.340654 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-001c9ba0-7302-4d50-becd-4aa0410f0c67 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:09.342153 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-001c9ba0-7302-4d50-becd-4aa0410f0c67 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:09.343315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-001c9ba0-7302-4d50-becd-4aa0410f0c67 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:09.344306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-001c9ba0-7302-4d50-becd-4aa0410f0c67 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:09.347037 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-48b31c1e-bfa5-4e5e-a9ec-54b1d303c92e tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:09.358066 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-48b31c1e-bfa5-4e5e-a9ec-54b1d303c92e tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d" status: 200 len: 1324 microversion: 2.1 time: 0.366819 Sep 17 21:01:09.371080 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1286/2649] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:08 2022] GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d => generated 1324 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:09.504105 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-060d9480-3aa7-45ae-8360-30724ce35d5f req-e2fc7cf4-f8b4-40f7-a7bf-dfbe702ed006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f0929b7-f8de-4896-a0de-a2388fef54f3", "name": "network-vif-deleted", "tag": "875360ee-4e0d-4125-98cf-746e7cb35373"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:09.520907 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-060d9480-3aa7-45ae-8360-30724ce35d5f req-e2fc7cf4-f8b4-40f7-a7bf-dfbe702ed006 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:09.521560 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-060d9480-3aa7-45ae-8360-30724ce35d5f req-e2fc7cf4-f8b4-40f7-a7bf-dfbe702ed006 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:09.522069 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-060d9480-3aa7-45ae-8360-30724ce35d5f req-e2fc7cf4-f8b4-40f7-a7bf-dfbe702ed006 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:09.537353 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-060d9480-3aa7-45ae-8360-30724ce35d5f req-e2fc7cf4-f8b4-40f7-a7bf-dfbe702ed006 service nova] Creating event network-vif-deleted:875360ee-4e0d-4125-98cf-746e7cb35373 for instance 8f0929b7-f8de-4896-a0de-a2388fef54f3 on nch1-master-1 Sep 17 21:01:09.545910 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-060d9480-3aa7-45ae-8360-30724ce35d5f req-e2fc7cf4-f8b4-40f7-a7bf-dfbe702ed006 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046134 Sep 17 21:01:09.547397 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1287/2650] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:01:09.585421 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-001c9ba0-7302-4d50-becd-4aa0410f0c67 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:09.594054 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-001c9ba0-7302-4d50-becd-4aa0410f0c67 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b" status: 200 len: 1317 microversion: 2.1 time: 0.275094 Sep 17 21:01:09.603083 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1364/2651] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:09 2022] GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:09.608220 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b6f0d1bd-f402-447d-b8cf-7db2cf18ec69 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:09.608939 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b6f0d1bd-f402-447d-b8cf-7db2cf18ec69 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:09.615709 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6f0d1bd-f402-447d-b8cf-7db2cf18ec69 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:09.616243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6f0d1bd-f402-447d-b8cf-7db2cf18ec69 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:09.616680 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6f0d1bd-f402-447d-b8cf-7db2cf18ec69 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:09.617383 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6f0d1bd-f402-447d-b8cf-7db2cf18ec69 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:09.618556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6f0d1bd-f402-447d-b8cf-7db2cf18ec69 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:09.618556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6f0d1bd-f402-447d-b8cf-7db2cf18ec69 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:09.806948 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-424a7b35-f61f-4765-9456-f45776697e06 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:09.808269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-424a7b35-f61f-4765-9456-f45776697e06 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 8f0929b7-f8de-4896-a0de-a2388fef54f3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:09.815161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-424a7b35-f61f-4765-9456-f45776697e06 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:09.815935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-424a7b35-f61f-4765-9456-f45776697e06 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:09.816545 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-424a7b35-f61f-4765-9456-f45776697e06 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:09.817280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-424a7b35-f61f-4765-9456-f45776697e06 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:09.817753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-424a7b35-f61f-4765-9456-f45776697e06 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:09.818260 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-424a7b35-f61f-4765-9456-f45776697e06 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:09.872774 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b6f0d1bd-f402-447d-b8cf-7db2cf18ec69 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:09.884952 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b6f0d1bd-f402-447d-b8cf-7db2cf18ec69 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1472 microversion: 2.1 time: 0.282636 Sep 17 21:01:09.886022 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1288/2652] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:09 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1472 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:09.910376 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-424a7b35-f61f-4765-9456-f45776697e06 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d48260054d84784b89a52d9b766d7c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3515123097e744ef855ef1129fb59cf1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:09.923189 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-424a7b35-f61f-4765-9456-f45776697e06 tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3" status: 200 len: 1430 microversion: 2.1 time: 0.120026 Sep 17 21:01:09.936082 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1365/2653] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:09 2022] GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3 => generated 1430 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:10.019244 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d4d3382b-748d-422d-8a1b-ca001ce94b6c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:10.020156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d4d3382b-748d-422d-8a1b-ca001ce94b6c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:10.027137 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d4d3382b-748d-422d-8a1b-ca001ce94b6c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:10.028126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d4d3382b-748d-422d-8a1b-ca001ce94b6c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:10.028809 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d4d3382b-748d-422d-8a1b-ca001ce94b6c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:10.030093 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d4d3382b-748d-422d-8a1b-ca001ce94b6c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:10.030792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d4d3382b-748d-422d-8a1b-ca001ce94b6c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:10.031373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d4d3382b-748d-422d-8a1b-ca001ce94b6c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:10.315699 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d4d3382b-748d-422d-8a1b-ca001ce94b6c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:10.329207 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d4d3382b-748d-422d-8a1b-ca001ce94b6c tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 200 len: 1512 microversion: 2.1 time: 0.314314 Sep 17 21:01:10.330508 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1289/2654] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:10 2022] GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 1512 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:10.342703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-68bebfc1-7832-48eb-af25-0c03a29f86ac tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:10.343317 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-68bebfc1-7832-48eb-af25-0c03a29f86ac tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] [instance: a599ed2a-d78f-46e8-a23c-17e9eee0a037] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:10.362845 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68bebfc1-7832-48eb-af25-0c03a29f86ac tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:10.363353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68bebfc1-7832-48eb-af25-0c03a29f86ac tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:10.363795 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68bebfc1-7832-48eb-af25-0c03a29f86ac tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:10.364679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68bebfc1-7832-48eb-af25-0c03a29f86ac tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:10.365520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68bebfc1-7832-48eb-af25-0c03a29f86ac tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:10.366414 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68bebfc1-7832-48eb-af25-0c03a29f86ac tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:10.383969 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bdc8ce09-2e56-4764-9aba-183f3477e9b3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:10.384629 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bdc8ce09-2e56-4764-9aba-183f3477e9b3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 7750732c-19bc-4c5a-8637-af3a08c3af5d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:10.394989 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bdc8ce09-2e56-4764-9aba-183f3477e9b3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:10.398220 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bdc8ce09-2e56-4764-9aba-183f3477e9b3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:10.399179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bdc8ce09-2e56-4764-9aba-183f3477e9b3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:10.401395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bdc8ce09-2e56-4764-9aba-183f3477e9b3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:10.402080 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bdc8ce09-2e56-4764-9aba-183f3477e9b3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:10.402923 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bdc8ce09-2e56-4764-9aba-183f3477e9b3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:10.691889 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bdc8ce09-2e56-4764-9aba-183f3477e9b3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:10.695546 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-68bebfc1-7832-48eb-af25-0c03a29f86ac tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bc1e85c16e49c695f073f2a7b40a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4ba38e25a4143adfe864a8408c524', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:10.698063 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bdc8ce09-2e56-4764-9aba-183f3477e9b3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d" status: 200 len: 1324 microversion: 2.1 time: 0.318315 Sep 17 21:01:10.699350 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1290/2655] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:10 2022] GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d => generated 1324 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:01:10.705732 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-a2f7a8d6-cb1a-47ec-8f25-fb9365052442 req-6e7a63ef-bf4f-465c-a7f8-a5e9f70bf4d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a599ed2a-d78f-46e8-a23c-17e9eee0a037", "tag": "daf6ab9a-717f-4757-88b8-a24346b0618c"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:10.706695 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-68bebfc1-7832-48eb-af25-0c03a29f86ac tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] 10.222.0.26 "GET /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037" status: 200 len: 1316 microversion: 2.1 time: 0.368097 Sep 17 21:01:10.707308 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1366/2656] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:10 2022] GET /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037 => generated 1316 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:01:10.717948 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d25cc96d-f0ab-4e49-bd03-c4dcd4012884 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:10.718466 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d25cc96d-f0ab-4e49-bd03-c4dcd4012884 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 6beb0759-caaa-4644-b0d6-1d77d21b7e0b] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:10.720174 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-a2f7a8d6-cb1a-47ec-8f25-fb9365052442 req-6e7a63ef-bf4f-465c-a7f8-a5e9f70bf4d9 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:10.720883 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-a2f7a8d6-cb1a-47ec-8f25-fb9365052442 req-6e7a63ef-bf4f-465c-a7f8-a5e9f70bf4d9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:10.721509 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-a2f7a8d6-cb1a-47ec-8f25-fb9365052442 req-6e7a63ef-bf4f-465c-a7f8-a5e9f70bf4d9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:10.725527 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d25cc96d-f0ab-4e49-bd03-c4dcd4012884 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:10.726020 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d25cc96d-f0ab-4e49-bd03-c4dcd4012884 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:10.726462 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d25cc96d-f0ab-4e49-bd03-c4dcd4012884 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:10.727161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d25cc96d-f0ab-4e49-bd03-c4dcd4012884 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:10.727617 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d25cc96d-f0ab-4e49-bd03-c4dcd4012884 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:10.728117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d25cc96d-f0ab-4e49-bd03-c4dcd4012884 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:10.733587 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-a2f7a8d6-cb1a-47ec-8f25-fb9365052442 req-6e7a63ef-bf4f-465c-a7f8-a5e9f70bf4d9 service nova] Creating event network-changed:daf6ab9a-717f-4757-88b8-a24346b0618c for instance a599ed2a-d78f-46e8-a23c-17e9eee0a037 on nch2-master-1 Sep 17 21:01:10.738445 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-a2f7a8d6-cb1a-47ec-8f25-fb9365052442 req-6e7a63ef-bf4f-465c-a7f8-a5e9f70bf4d9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037653 Sep 17 21:01:10.739077 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1291/2657] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:10.801248 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:10.872960 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=6 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:10.909829 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a3429d0e-e7d8-4593-ae18-16c5afdd4374 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:10.910793 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a3429d0e-e7d8-4593-ae18-16c5afdd4374 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:10.922386 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3429d0e-e7d8-4593-ae18-16c5afdd4374 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:10.923180 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3429d0e-e7d8-4593-ae18-16c5afdd4374 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:10.923864 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3429d0e-e7d8-4593-ae18-16c5afdd4374 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:10.924801 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3429d0e-e7d8-4593-ae18-16c5afdd4374 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:10.925483 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3429d0e-e7d8-4593-ae18-16c5afdd4374 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:10.926137 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3429d0e-e7d8-4593-ae18-16c5afdd4374 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:10.975546 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d25cc96d-f0ab-4e49-bd03-c4dcd4012884 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:10.988258 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d25cc96d-f0ab-4e49-bd03-c4dcd4012884 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b" status: 200 len: 1317 microversion: 2.1 time: 0.271244 Sep 17 21:01:10.989254 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1367/2658] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:10 2022] GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b => generated 1317 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:10.994440 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b7031884-19b5-4f46-991a-1c849f6fb98c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:10.995068 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b7031884-19b5-4f46-991a-1c849f6fb98c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] [instance: 8f0929b7-f8de-4896-a0de-a2388fef54f3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:11.006373 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b7031884-19b5-4f46-991a-1c849f6fb98c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:11.006922 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b7031884-19b5-4f46-991a-1c849f6fb98c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:11.007568 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b7031884-19b5-4f46-991a-1c849f6fb98c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:11.008660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b7031884-19b5-4f46-991a-1c849f6fb98c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:11.009575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b7031884-19b5-4f46-991a-1c849f6fb98c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:11.010265 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b7031884-19b5-4f46-991a-1c849f6fb98c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:11.031908 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-b7031884-19b5-4f46-991a-1c849f6fb98c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] HTTP exception thrown: Instance 8f0929b7-f8de-4896-a0de-a2388fef54f3 could not be found. Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b7031884-19b5-4f46-991a-1c849f6fb98c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Request method failure captured: Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3 HTTP/1.1 Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjS1i9XeXSkLU6roIN5-V3M30sbhgULjb8tr8aqExkSAIyZY9VKN0LPVRHnETO5tqunffII5qByrOP0geSwUSYjLFCPdfmPpZzaRnm983vzvqA4kLyBsVXOUYx3Hwv-cKGIwQNFiYUDPza0sBrWpmIqLZCr0r7WnWtNySplD0X_QBe4 Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 3515123097e744ef855ef1129fb59cf1 Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersOnMultiNodesTest-277737609 Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3515123097e744ef855ef1129fb59cf1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3515123097e744ef855ef1129fb59cf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3515123097e744ef855ef1129fb59cf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3515123097e744ef855ef1129fb59cf1", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersOnMultiNodesTest-277737609 Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 3515123097e744ef855ef1129fb59cf1 Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-277737609 Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersOnMultiNodesTest-277737609-project Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 0d48260054d84784b89a52d9b766d7c1 Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersOnMultiNodesTest-277737609-project Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 8f0929b7-f8de-4896-a0de-a2388fef54f3 could not be found. Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '8f0929b7-f8de-4896-a0de-a2388fef54f3'} Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f0929b7-f8de-4896-a0de-a2388fef54f3 could not be found. Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f0929b7-f8de-4896-a0de-a2388fef54f3 could not be found. Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:11.034197 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:11.040038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:11.040038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:11.040038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:11.040038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:01:11.040038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:01:11.040038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f0929b7-f8de-4896-a0de-a2388fef54f3 could not be found. Sep 17 21:01:11.040038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:11.043271 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b7031884-19b5-4f46-991a-1c849f6fb98c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] Returning 404 to user: Instance 8f0929b7-f8de-4896-a0de-a2388fef54f3 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:01:11.044364 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b7031884-19b5-4f46-991a-1c849f6fb98c tempest-ServersOnMultiNodesTest-277737609 tempest-ServersOnMultiNodesTest-277737609-project] 10.222.0.26 "GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3" status: 404 len: 111 microversion: 2.1 time: 0.053726 Sep 17 21:01:11.044931 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1368/2659] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:10 2022] GET /compute/v2.1/servers/8f0929b7-f8de-4896-a0de-a2388fef54f3 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:01:11.178547 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a3429d0e-e7d8-4593-ae18-16c5afdd4374 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:11.193450 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a3429d0e-e7d8-4593-ae18-16c5afdd4374 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1472 microversion: 2.1 time: 0.282876 Sep 17 21:01:11.195528 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1292/2660] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:10 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1472 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:01:11.356427 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-57aeb7ce-cb95-4b23-aa41-e770f875e854 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:11.357755 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-57aeb7ce-cb95-4b23-aa41-e770f875e854 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:11.371909 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57aeb7ce-cb95-4b23-aa41-e770f875e854 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:11.372699 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57aeb7ce-cb95-4b23-aa41-e770f875e854 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:11.373318 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57aeb7ce-cb95-4b23-aa41-e770f875e854 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:11.374482 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57aeb7ce-cb95-4b23-aa41-e770f875e854 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:11.375212 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57aeb7ce-cb95-4b23-aa41-e770f875e854 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:11.375806 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57aeb7ce-cb95-4b23-aa41-e770f875e854 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:11.622554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-57aeb7ce-cb95-4b23-aa41-e770f875e854 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:11.630279 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-57aeb7ce-cb95-4b23-aa41-e770f875e854 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 200 len: 1512 microversion: 2.1 time: 0.279387 Sep 17 21:01:11.630868 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1369/2661] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:11 2022] GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 1512 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:11.722151 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d3800352-b3be-403a-bd16-e265bb40970a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:11.723453 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d3800352-b3be-403a-bd16-e265bb40970a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 7750732c-19bc-4c5a-8637-af3a08c3af5d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:11.729305 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3815a97f-9845-4dc1-b9d5-aa8153de690f tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:11.730243 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3815a97f-9845-4dc1-b9d5-aa8153de690f tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] [instance: a599ed2a-d78f-46e8-a23c-17e9eee0a037] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:11.742610 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d3800352-b3be-403a-bd16-e265bb40970a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:11.744638 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3815a97f-9845-4dc1-b9d5-aa8153de690f tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:11.745361 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d3800352-b3be-403a-bd16-e265bb40970a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:11.746046 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3815a97f-9845-4dc1-b9d5-aa8153de690f tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:11.746636 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3815a97f-9845-4dc1-b9d5-aa8153de690f tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:11.747252 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d3800352-b3be-403a-bd16-e265bb40970a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:11.748157 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3815a97f-9845-4dc1-b9d5-aa8153de690f tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:11.749319 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d3800352-b3be-403a-bd16-e265bb40970a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:11.749970 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3815a97f-9845-4dc1-b9d5-aa8153de690f tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:11.750585 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d3800352-b3be-403a-bd16-e265bb40970a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:11.751173 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3815a97f-9845-4dc1-b9d5-aa8153de690f tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:11.751744 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d3800352-b3be-403a-bd16-e265bb40970a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:12.459236 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3815a97f-9845-4dc1-b9d5-aa8153de690f tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bc1e85c16e49c695f073f2a7b40a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4ba38e25a4143adfe864a8408c524', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:12.476021 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3815a97f-9845-4dc1-b9d5-aa8153de690f tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] 10.222.0.26 "GET /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037" status: 200 len: 1316 microversion: 2.1 time: 0.750426 Sep 17 21:01:12.490653 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d3800352-b3be-403a-bd16-e265bb40970a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:12.491884 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1370/2662] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:11 2022] GET /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037 => generated 1316 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:12.494534 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d3800352-b3be-403a-bd16-e265bb40970a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d" status: 200 len: 1324 microversion: 2.1 time: 0.776061 Sep 17 21:01:12.500724 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1293/2663] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:11 2022] GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d => generated 1324 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:12.502052 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-027da594-fd0a-4f66-97b3-42b6f8941667 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:12.502783 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-027da594-fd0a-4f66-97b3-42b6f8941667 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 6beb0759-caaa-4644-b0d6-1d77d21b7e0b] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:12.506929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e65a7569-567d-41d1-8cb2-d30fd573a202 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:12.509943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e65a7569-567d-41d1-8cb2-d30fd573a202 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:12.532664 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e65a7569-567d-41d1-8cb2-d30fd573a202 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:12.534139 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e65a7569-567d-41d1-8cb2-d30fd573a202 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:12.535141 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e65a7569-567d-41d1-8cb2-d30fd573a202 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:12.536727 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e65a7569-567d-41d1-8cb2-d30fd573a202 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:12.537777 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e65a7569-567d-41d1-8cb2-d30fd573a202 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:12.542279 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e65a7569-567d-41d1-8cb2-d30fd573a202 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:12.547101 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-027da594-fd0a-4f66-97b3-42b6f8941667 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:12.547101 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-027da594-fd0a-4f66-97b3-42b6f8941667 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:12.547936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-027da594-fd0a-4f66-97b3-42b6f8941667 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:12.560888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-027da594-fd0a-4f66-97b3-42b6f8941667 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:12.560888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-027da594-fd0a-4f66-97b3-42b6f8941667 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:12.560888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-027da594-fd0a-4f66-97b3-42b6f8941667 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:12.900376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:12.946848 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e65a7569-567d-41d1-8cb2-d30fd573a202 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:12.961340 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e65a7569-567d-41d1-8cb2-d30fd573a202 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1472 microversion: 2.1 time: 0.459170 Sep 17 21:01:12.963010 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1294/2664] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:12 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1472 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:12.978774 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d05c64c0-1dcc-4702-a583-4f1565e01548 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:12.979643 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d05c64c0-1dcc-4702-a583-4f1565e01548 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:12.982251 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-027da594-fd0a-4f66-97b3-42b6f8941667 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:12.987303 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d05c64c0-1dcc-4702-a583-4f1565e01548 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:12.988451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d05c64c0-1dcc-4702-a583-4f1565e01548 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:12.988907 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d05c64c0-1dcc-4702-a583-4f1565e01548 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:12.989658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d05c64c0-1dcc-4702-a583-4f1565e01548 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:12.990280 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d05c64c0-1dcc-4702-a583-4f1565e01548 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:12.990894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d05c64c0-1dcc-4702-a583-4f1565e01548 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:12.992688 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-027da594-fd0a-4f66-97b3-42b6f8941667 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b" status: 200 len: 1317 microversion: 2.1 time: 0.499312 Sep 17 21:01:13.008726 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1371/2665] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:12 2022] GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b => generated 1317 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:13.193863 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d05c64c0-1dcc-4702-a583-4f1565e01548 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:13.205424 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d05c64c0-1dcc-4702-a583-4f1565e01548 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 200 len: 1512 microversion: 2.1 time: 0.241004 Sep 17 21:01:13.206174 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1295/2666] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:12 2022] GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 1512 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:13.342047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-b096d17e-ff1a-4343-b0a9-0e296383c01b req-5237a6f2-afd5-4ea2-9ae0-7b334cdee682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7750732c-19bc-4c5a-8637-af3a08c3af5d", "name": "network-vif-plugged", "status": "completed", "tag": "c0574c06-40f2-449c-a082-5faa99b18540"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:13.363095 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b096d17e-ff1a-4343-b0a9-0e296383c01b req-5237a6f2-afd5-4ea2-9ae0-7b334cdee682 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:13.365032 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b096d17e-ff1a-4343-b0a9-0e296383c01b req-5237a6f2-afd5-4ea2-9ae0-7b334cdee682 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:13.365520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b096d17e-ff1a-4343-b0a9-0e296383c01b req-5237a6f2-afd5-4ea2-9ae0-7b334cdee682 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:13.399313 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-b096d17e-ff1a-4343-b0a9-0e296383c01b req-5237a6f2-afd5-4ea2-9ae0-7b334cdee682 service nova] Creating event network-vif-plugged:c0574c06-40f2-449c-a082-5faa99b18540 for instance 7750732c-19bc-4c5a-8637-af3a08c3af5d on nch2-master-1 Sep 17 21:01:13.415566 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-b096d17e-ff1a-4343-b0a9-0e296383c01b req-5237a6f2-afd5-4ea2-9ae0-7b334cdee682 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.405036 Sep 17 21:01:13.416516 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1372/2667] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:13.507392 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-68c4c02d-910a-43fa-81c8-abb0b91b899f tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:13.508109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-68c4c02d-910a-43fa-81c8-abb0b91b899f tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] [instance: a599ed2a-d78f-46e8-a23c-17e9eee0a037] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:13.535707 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68c4c02d-910a-43fa-81c8-abb0b91b899f tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:13.538760 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68c4c02d-910a-43fa-81c8-abb0b91b899f tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:13.539200 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cad164c0-3abe-4f03-a8af-8a301d602508 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:13.540747 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cad164c0-3abe-4f03-a8af-8a301d602508 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 7750732c-19bc-4c5a-8637-af3a08c3af5d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:13.544336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68c4c02d-910a-43fa-81c8-abb0b91b899f tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:13.545121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68c4c02d-910a-43fa-81c8-abb0b91b899f tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:13.545628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68c4c02d-910a-43fa-81c8-abb0b91b899f tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:13.547133 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68c4c02d-910a-43fa-81c8-abb0b91b899f tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:13.561355 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cad164c0-3abe-4f03-a8af-8a301d602508 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:13.562830 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cad164c0-3abe-4f03-a8af-8a301d602508 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:13.563464 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cad164c0-3abe-4f03-a8af-8a301d602508 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:13.564835 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cad164c0-3abe-4f03-a8af-8a301d602508 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:13.565311 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cad164c0-3abe-4f03-a8af-8a301d602508 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:13.565989 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cad164c0-3abe-4f03-a8af-8a301d602508 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:13.572532 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:13.857701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-68c4c02d-910a-43fa-81c8-abb0b91b899f tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bc1e85c16e49c695f073f2a7b40a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4ba38e25a4143adfe864a8408c524', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:13.868877 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cad164c0-3abe-4f03-a8af-8a301d602508 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:13.870323 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-68c4c02d-910a-43fa-81c8-abb0b91b899f tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] 10.222.0.26 "GET /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037" status: 200 len: 1316 microversion: 2.1 time: 0.369721 Sep 17 21:01:13.870925 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1296/2668] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:13 2022] GET /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037 => generated 1316 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:13.888338 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cad164c0-3abe-4f03-a8af-8a301d602508 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d" status: 200 len: 1324 microversion: 2.1 time: 0.354718 Sep 17 21:01:13.891101 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1373/2669] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:13 2022] GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d => generated 1324 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:13.988146 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-056c91bd-111b-493b-a47b-1a402a0c0027 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:13.988659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-056c91bd-111b-493b-a47b-1a402a0c0027 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:13.994886 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=26 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:13.996399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-056c91bd-111b-493b-a47b-1a402a0c0027 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:13.996873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-056c91bd-111b-493b-a47b-1a402a0c0027 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:13.997682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-056c91bd-111b-493b-a47b-1a402a0c0027 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:13.998577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-056c91bd-111b-493b-a47b-1a402a0c0027 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:13.999029 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-056c91bd-111b-493b-a47b-1a402a0c0027 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:13.999801 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-056c91bd-111b-493b-a47b-1a402a0c0027 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:14.022435 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ff991a3c-751f-4fb3-a396-660e81c14a2d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:14.023330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ff991a3c-751f-4fb3-a396-660e81c14a2d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 6beb0759-caaa-4644-b0d6-1d77d21b7e0b] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:14.031589 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff991a3c-751f-4fb3-a396-660e81c14a2d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:14.032260 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff991a3c-751f-4fb3-a396-660e81c14a2d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:14.032876 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff991a3c-751f-4fb3-a396-660e81c14a2d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:14.033737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff991a3c-751f-4fb3-a396-660e81c14a2d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:14.034629 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff991a3c-751f-4fb3-a396-660e81c14a2d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:14.035377 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff991a3c-751f-4fb3-a396-660e81c14a2d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:14.267550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ff991a3c-751f-4fb3-a396-660e81c14a2d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:14.279651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-056c91bd-111b-493b-a47b-1a402a0c0027 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:14.280194 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ff991a3c-751f-4fb3-a396-660e81c14a2d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b" status: 200 len: 1317 microversion: 2.1 time: 0.262450 Sep 17 21:01:14.281183 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1374/2670] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:14 2022] GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b => generated 1317 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:14.300497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:14.303100 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1ee083d5-5d30-461a-98eb-d21057d06eae tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:14.304657 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1ee083d5-5d30-461a-98eb-d21057d06eae tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:14.314283 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-056c91bd-111b-493b-a47b-1a402a0c0027 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1472 microversion: 2.1 time: 0.329918 Sep 17 21:01:14.315832 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1297/2671] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:13 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1472 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:14.326973 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1ee083d5-5d30-461a-98eb-d21057d06eae tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:14.329247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1ee083d5-5d30-461a-98eb-d21057d06eae tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:14.329801 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1ee083d5-5d30-461a-98eb-d21057d06eae tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:14.330542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1ee083d5-5d30-461a-98eb-d21057d06eae tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:14.331009 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1ee083d5-5d30-461a-98eb-d21057d06eae tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:14.331444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1ee083d5-5d30-461a-98eb-d21057d06eae tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:14.530574 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1ee083d5-5d30-461a-98eb-d21057d06eae tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:14.540456 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1ee083d5-5d30-461a-98eb-d21057d06eae tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 200 len: 1512 microversion: 2.1 time: 0.249713 Sep 17 21:01:14.541073 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1375/2672] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:14 2022] GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 1512 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:14.912054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-04dd1617-2eab-4cb5-addf-17cb52dd41c6 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:14.914324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-04dd1617-2eab-4cb5-addf-17cb52dd41c6 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] [instance: a599ed2a-d78f-46e8-a23c-17e9eee0a037] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:14.915277 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-308735ae-6898-4be2-8354-88b9714deaa4 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:14.916224 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-308735ae-6898-4be2-8354-88b9714deaa4 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 7750732c-19bc-4c5a-8637-af3a08c3af5d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:14.930102 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-308735ae-6898-4be2-8354-88b9714deaa4 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:14.932920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-308735ae-6898-4be2-8354-88b9714deaa4 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:14.934249 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-308735ae-6898-4be2-8354-88b9714deaa4 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:14.940968 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04dd1617-2eab-4cb5-addf-17cb52dd41c6 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:14.941500 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04dd1617-2eab-4cb5-addf-17cb52dd41c6 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:14.942129 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04dd1617-2eab-4cb5-addf-17cb52dd41c6 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:14.942658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04dd1617-2eab-4cb5-addf-17cb52dd41c6 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:14.942780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-308735ae-6898-4be2-8354-88b9714deaa4 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:14.943118 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04dd1617-2eab-4cb5-addf-17cb52dd41c6 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:14.943544 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04dd1617-2eab-4cb5-addf-17cb52dd41c6 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:14.943928 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-308735ae-6898-4be2-8354-88b9714deaa4 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:14.945449 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-308735ae-6898-4be2-8354-88b9714deaa4 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:15.205436 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-308735ae-6898-4be2-8354-88b9714deaa4 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:15.209310 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-04dd1617-2eab-4cb5-addf-17cb52dd41c6 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bc1e85c16e49c695f073f2a7b40a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4ba38e25a4143adfe864a8408c524', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:15.214527 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-308735ae-6898-4be2-8354-88b9714deaa4 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d" status: 200 len: 1324 microversion: 2.1 time: 0.303464 Sep 17 21:01:15.227320 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1376/2673] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:14 2022] GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d => generated 1324 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:01:15.230410 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-04dd1617-2eab-4cb5-addf-17cb52dd41c6 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] 10.222.0.26 "GET /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037" status: 200 len: 1316 microversion: 2.1 time: 0.337959 Sep 17 21:01:15.231199 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1298/2674] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:14 2022] GET /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037 => generated 1316 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:15.303817 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e266226f-7147-4638-aade-e5192fc5a644 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:15.304504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e266226f-7147-4638-aade-e5192fc5a644 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 6beb0759-caaa-4644-b0d6-1d77d21b7e0b] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:15.311651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e266226f-7147-4638-aade-e5192fc5a644 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:15.312432 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e266226f-7147-4638-aade-e5192fc5a644 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:15.312945 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e266226f-7147-4638-aade-e5192fc5a644 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:15.313761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e266226f-7147-4638-aade-e5192fc5a644 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:15.314286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e266226f-7147-4638-aade-e5192fc5a644 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:15.314795 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e266226f-7147-4638-aade-e5192fc5a644 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:15.341638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f2c6d211-c04f-4e50-8f9a-d3a37474dfc1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:15.342796 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f2c6d211-c04f-4e50-8f9a-d3a37474dfc1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:15.349617 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2c6d211-c04f-4e50-8f9a-d3a37474dfc1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:15.350448 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2c6d211-c04f-4e50-8f9a-d3a37474dfc1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:15.351113 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2c6d211-c04f-4e50-8f9a-d3a37474dfc1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:15.352062 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2c6d211-c04f-4e50-8f9a-d3a37474dfc1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:15.352735 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2c6d211-c04f-4e50-8f9a-d3a37474dfc1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:15.357922 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2c6d211-c04f-4e50-8f9a-d3a37474dfc1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:15.533953 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e266226f-7147-4638-aade-e5192fc5a644 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:15.549208 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e266226f-7147-4638-aade-e5192fc5a644 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b" status: 200 len: 1317 microversion: 2.1 time: 0.249114 Sep 17 21:01:15.551181 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1377/2675] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:15 2022] GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:15.556180 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-bb07f2f0-6981-404f-a648-97efae05916a req-8a690fe8-a522-4895-9737-5afce0af4217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6beb0759-caaa-4644-b0d6-1d77d21b7e0b", "name": "network-vif-plugged", "status": "completed", "tag": "10cbd0fe-ed39-47c4-8c48-636b6e3ddd4f"}, {"server_uuid": "a599ed2a-d78f-46e8-a23c-17e9eee0a037", "name": "network-vif-plugged", "status": "completed", "tag": "daf6ab9a-717f-4757-88b8-a24346b0618c"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:15.568764 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-bb07f2f0-6981-404f-a648-97efae05916a req-8a690fe8-a522-4895-9737-5afce0af4217 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:15.569532 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-bb07f2f0-6981-404f-a648-97efae05916a req-8a690fe8-a522-4895-9737-5afce0af4217 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:15.570191 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-bb07f2f0-6981-404f-a648-97efae05916a req-8a690fe8-a522-4895-9737-5afce0af4217 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:15.572350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f2c6d211-c04f-4e50-8f9a-d3a37474dfc1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:15.584075 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f2c6d211-c04f-4e50-8f9a-d3a37474dfc1 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1472 microversion: 2.1 time: 0.245729 Sep 17 21:01:15.584680 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1299/2676] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:15 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1472 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:01:15.586650 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-bb07f2f0-6981-404f-a648-97efae05916a req-8a690fe8-a522-4895-9737-5afce0af4217 service nova] Creating event network-vif-plugged:10cbd0fe-ed39-47c4-8c48-636b6e3ddd4f for instance 6beb0759-caaa-4644-b0d6-1d77d21b7e0b on nch1-master-1 Sep 17 21:01:15.587450 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-bb07f2f0-6981-404f-a648-97efae05916a req-8a690fe8-a522-4895-9737-5afce0af4217 service nova] Creating event network-vif-plugged:daf6ab9a-717f-4757-88b8-a24346b0618c for instance a599ed2a-d78f-46e8-a23c-17e9eee0a037 on nch2-master-1 Sep 17 21:01:15.596767 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-bb07f2f0-6981-404f-a648-97efae05916a req-8a690fe8-a522-4895-9737-5afce0af4217 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044215 Sep 17 21:01:15.598449 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1378/2677] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:15.617880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-519adbee-dbb3-4b75-a18c-f495833e4c14 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:15.622553 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-519adbee-dbb3-4b75-a18c-f495833e4c14 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:15.638598 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-519adbee-dbb3-4b75-a18c-f495833e4c14 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:15.639306 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-519adbee-dbb3-4b75-a18c-f495833e4c14 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:15.640069 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-519adbee-dbb3-4b75-a18c-f495833e4c14 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:15.641206 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-519adbee-dbb3-4b75-a18c-f495833e4c14 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:15.641878 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-519adbee-dbb3-4b75-a18c-f495833e4c14 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:15.642322 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-519adbee-dbb3-4b75-a18c-f495833e4c14 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:15.902362 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-519adbee-dbb3-4b75-a18c-f495833e4c14 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:15.911270 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-519adbee-dbb3-4b75-a18c-f495833e4c14 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 200 len: 1512 microversion: 2.1 time: 0.325393 Sep 17 21:01:15.911853 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1300/2678] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:15 2022] GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 1512 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:16.239207 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3bee565f-c357-48fa-98b2-9fcc9e59940b tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:16.240305 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3bee565f-c357-48fa-98b2-9fcc9e59940b tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 7750732c-19bc-4c5a-8637-af3a08c3af5d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:16.248647 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3bee565f-c357-48fa-98b2-9fcc9e59940b tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:16.249345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3bee565f-c357-48fa-98b2-9fcc9e59940b tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:16.250041 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3bee565f-c357-48fa-98b2-9fcc9e59940b tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:16.251083 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3bee565f-c357-48fa-98b2-9fcc9e59940b tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:16.252167 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3bee565f-c357-48fa-98b2-9fcc9e59940b tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:16.253535 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3bee565f-c357-48fa-98b2-9fcc9e59940b tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:16.282724 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-60b30c0b-e12b-4bba-a1c0-4fc28b5cf462 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:16.283489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-60b30c0b-e12b-4bba-a1c0-4fc28b5cf462 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] [instance: a599ed2a-d78f-46e8-a23c-17e9eee0a037] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:16.292321 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60b30c0b-e12b-4bba-a1c0-4fc28b5cf462 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:16.292816 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60b30c0b-e12b-4bba-a1c0-4fc28b5cf462 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:16.293254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60b30c0b-e12b-4bba-a1c0-4fc28b5cf462 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:16.294012 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60b30c0b-e12b-4bba-a1c0-4fc28b5cf462 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:16.294464 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60b30c0b-e12b-4bba-a1c0-4fc28b5cf462 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:16.294885 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60b30c0b-e12b-4bba-a1c0-4fc28b5cf462 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:16.449033 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3bee565f-c357-48fa-98b2-9fcc9e59940b tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:16.458224 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3bee565f-c357-48fa-98b2-9fcc9e59940b tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d" status: 200 len: 1520 microversion: 2.1 time: 0.223837 Sep 17 21:01:16.458931 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1379/2679] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:16 2022] GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:16.475287 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-60b30c0b-e12b-4bba-a1c0-4fc28b5cf462 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bc1e85c16e49c695f073f2a7b40a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4ba38e25a4143adfe864a8408c524', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:16.479675 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-23d99fed-c246-44ae-ac4f-71e85cc28d68 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a4c91820>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:16.486336 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-60b30c0b-e12b-4bba-a1c0-4fc28b5cf462 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] 10.222.0.26 "GET /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037" status: 200 len: 1316 microversion: 2.1 time: 0.235904 Sep 17 21:01:16.493977 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1301/2680] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:16 2022] GET /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037 => generated 1316 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:16.505648 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6412fad7-b93e-4319-b8ca-170ccdbedc79 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:16.506276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6412fad7-b93e-4319-b8ca-170ccdbedc79 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 7750732c-19bc-4c5a-8637-af3a08c3af5d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:16.515366 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6412fad7-b93e-4319-b8ca-170ccdbedc79 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:16.515991 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6412fad7-b93e-4319-b8ca-170ccdbedc79 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:16.516372 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6412fad7-b93e-4319-b8ca-170ccdbedc79 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:16.517259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6412fad7-b93e-4319-b8ca-170ccdbedc79 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:16.517708 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6412fad7-b93e-4319-b8ca-170ccdbedc79 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:16.518141 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6412fad7-b93e-4319-b8ca-170ccdbedc79 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:16.530470 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-23d99fed-c246-44ae-ac4f-71e85cc28d68 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/0deb8c1c-237c-4a78-b0ef-50661bfef36d" status: 200 len: 662 microversion: 2.1 time: 0.054998 Sep 17 21:01:16.531345 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1380/2681] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:01:16 2022] GET /compute/v2.1/images/0deb8c1c-237c-4a78-b0ef-50661bfef36d => generated 662 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:16.546405 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7041ef27-9a75-4a44-8d7a-7a449c82d3cb tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a4c918b0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:16.590671 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7041ef27-9a75-4a44-8d7a-7a449c82d3cb tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/0deb8c1c-237c-4a78-b0ef-50661bfef36d" status: 200 len: 662 microversion: 2.1 time: 0.048409 Sep 17 21:01:16.592115 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1381/2682] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:01:16 2022] GET /compute/v2.1/images/0deb8c1c-237c-4a78-b0ef-50661bfef36d => generated 662 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:01:16.596405 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2a490d00-d313-4aae-81ad-2a5ed2711c8c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:16.596856 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2a490d00-d313-4aae-81ad-2a5ed2711c8c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 6beb0759-caaa-4644-b0d6-1d77d21b7e0b] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:16.607734 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a490d00-d313-4aae-81ad-2a5ed2711c8c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:16.608231 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a490d00-d313-4aae-81ad-2a5ed2711c8c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:16.608864 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a490d00-d313-4aae-81ad-2a5ed2711c8c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:16.609764 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a490d00-d313-4aae-81ad-2a5ed2711c8c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:16.611753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a490d00-d313-4aae-81ad-2a5ed2711c8c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:16.612360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a490d00-d313-4aae-81ad-2a5ed2711c8c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:16.800744 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6412fad7-b93e-4319-b8ca-170ccdbedc79 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:16.814176 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6412fad7-b93e-4319-b8ca-170ccdbedc79 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d" status: 200 len: 1520 microversion: 2.1 time: 0.314241 Sep 17 21:01:16.814870 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1302/2683] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:16 2022] GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d => generated 1520 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:16.825812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d1a28d74-3d64-4114-be95-a53757d7b18a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:16.825812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d1a28d74-3d64-4114-be95-a53757d7b18a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:16.838174 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1a28d74-3d64-4114-be95-a53757d7b18a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:16.839450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1a28d74-3d64-4114-be95-a53757d7b18a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:16.840160 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1a28d74-3d64-4114-be95-a53757d7b18a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:16.841111 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1a28d74-3d64-4114-be95-a53757d7b18a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:16.841939 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1a28d74-3d64-4114-be95-a53757d7b18a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:16.851008 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1a28d74-3d64-4114-be95-a53757d7b18a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:16.880075 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2a490d00-d313-4aae-81ad-2a5ed2711c8c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:16.892126 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2a490d00-d313-4aae-81ad-2a5ed2711c8c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b" status: 200 len: 1317 microversion: 2.1 time: 0.299327 Sep 17 21:01:16.897945 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1382/2684] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:16 2022] GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:16.905873 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7c0afd3a-6eb3-48ce-8f33-cd810f6c3ef2 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-667275412"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:16.908198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7c0afd3a-6eb3-48ce-8f33-cd810f6c3ef2 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 7750732c-19bc-4c5a-8637-af3a08c3af5d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:16.923818 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7c0afd3a-6eb3-48ce-8f33-cd810f6c3ef2 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:16.924332 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7c0afd3a-6eb3-48ce-8f33-cd810f6c3ef2 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:16.925562 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7c0afd3a-6eb3-48ce-8f33-cd810f6c3ef2 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:16.926533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7c0afd3a-6eb3-48ce-8f33-cd810f6c3ef2 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:16.935205 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7c0afd3a-6eb3-48ce-8f33-cd810f6c3ef2 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:16.935727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7c0afd3a-6eb3-48ce-8f33-cd810f6c3ef2 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:17.088072 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d1a28d74-3d64-4114-be95-a53757d7b18a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:17.102515 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d1a28d74-3d64-4114-be95-a53757d7b18a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1472 microversion: 2.1 time: 0.286515 Sep 17 21:01:17.104305 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1303/2685] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:16 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1472 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:17.110433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ea83e1d4-4a95-49ef-8ad6-5e3ed2d67714 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:17.111408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ea83e1d4-4a95-49ef-8ad6-5e3ed2d67714 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:17.123228 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea83e1d4-4a95-49ef-8ad6-5e3ed2d67714 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:17.125034 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea83e1d4-4a95-49ef-8ad6-5e3ed2d67714 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:17.126121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea83e1d4-4a95-49ef-8ad6-5e3ed2d67714 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:17.128717 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea83e1d4-4a95-49ef-8ad6-5e3ed2d67714 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:17.129356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea83e1d4-4a95-49ef-8ad6-5e3ed2d67714 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:17.130782 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea83e1d4-4a95-49ef-8ad6-5e3ed2d67714 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:17.279155 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7c0afd3a-6eb3-48ce-8f33-cd810f6c3ef2 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "POST /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d/action" status: 202 len: 0 microversion: 2.1 time: 0.377116 Sep 17 21:01:17.279824 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1383/2686] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:01:16 2022] POST /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 17 21:01:17.297572 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9ebb8553-13b0-4a1c-b91d-e765cc2445c9 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '.version_select at 0x7f25a53b8ee0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:17.414308 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ea83e1d4-4a95-49ef-8ad6-5e3ed2d67714 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:17.422945 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ea83e1d4-4a95-49ef-8ad6-5e3ed2d67714 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 200 len: 1512 microversion: 2.1 time: 0.317296 Sep 17 21:01:17.423535 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1304/2687] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:17 2022] GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 1512 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:17.510762 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-936e0a19-b719-413f-900d-f10a0a2275ff tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:17.512261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-936e0a19-b719-413f-900d-f10a0a2275ff tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] [instance: a599ed2a-d78f-46e8-a23c-17e9eee0a037] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:17.520249 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9ebb8553-13b0-4a1c-b91d-e765cc2445c9 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "DELETE /compute/v2.1/images/bd37f33c-b70a-4b63-b7ff-32a5d32b061b" status: 204 len: 0 microversion: 2.1 time: 0.229929 Sep 17 21:01:17.521164 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1384/2688] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:17 2022] DELETE /compute/v2.1/images/bd37f33c-b70a-4b63-b7ff-32a5d32b061b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 17 21:01:17.530218 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f5928e21-a5d0-4f42-aa97-3e928e0e5db9 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '.version_select at 0x7f25a52ee9d0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:17.533732 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-936e0a19-b719-413f-900d-f10a0a2275ff tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:17.534649 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-936e0a19-b719-413f-900d-f10a0a2275ff tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:17.535464 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-936e0a19-b719-413f-900d-f10a0a2275ff tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:17.537245 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-936e0a19-b719-413f-900d-f10a0a2275ff tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:17.538093 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-936e0a19-b719-413f-900d-f10a0a2275ff tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:17.539669 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-936e0a19-b719-413f-900d-f10a0a2275ff tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:17.566599 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-f5928e21-a5d0-4f42-aa97-3e928e0e5db9 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] HTTP exception thrown: Image not found. Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f5928e21-a5d0-4f42-aa97-3e928e0e5db9 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Request method failure captured: Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/images/bd37f33c-b70a-4b63-b7ff-32a5d32b061b HTTP/1.1 Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjVSncfbAtgCIyToozPzw5wAkwJ8A5Pq3oENCAdqUUIYA48iSRlVG7zkjE71pODQ7Vq39Whu62dN5SwPbwvIXMyuqDiapFCgUkVVyC-O5o-Rbhev8SZVJvwjqio0qc_eiz6AU5vzIes11QJweqLBoCqKJfa2-0GqtVV9pkib7fT-OL0 Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 004f77fba4b14080bca4ae36c857add3 Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_004f77fba4b14080bca4ae36c857add3", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 004f77fba4b14080bca4ae36c857add3 Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ImagesOneServerNegativeTestJSON-622753367-project Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 22306a93c9404db393b92a267d6258d4 Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-622753367-project Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: exception: Image not found. Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'bd37f33c-b70a-4b63-b7ff-32a5d32b061b'} Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID bd37f33c-b70a-4b63-b7ff-32a5d32b061b Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 17 21:01:17.578667 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bd37f33c-b70a-4b63-b7ff-32a5d32b061b could not be found. Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f5928e21-a5d0-4f42-aa97-3e928e0e5db9 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Returning 404 to user: Image not found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f5928e21-a5d0-4f42-aa97-3e928e0e5db9 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/images/bd37f33c-b70a-4b63-b7ff-32a5d32b061b" status: 404 len: 62 microversion: 2.1 time: 0.057153 Sep 17 21:01:17.583992 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1385/2689] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:01:17 2022] GET /compute/v2.1/images/bd37f33c-b70a-4b63-b7ff-32a5d32b061b => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 17 21:01:17.595746 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a2b39777-f0d9-4215-951b-cf8dea50e5b0 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:17.596542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a2b39777-f0d9-4215-951b-cf8dea50e5b0 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 7750732c-19bc-4c5a-8637-af3a08c3af5d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:17.605685 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a2b39777-f0d9-4215-951b-cf8dea50e5b0 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:17.606177 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a2b39777-f0d9-4215-951b-cf8dea50e5b0 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:17.606922 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a2b39777-f0d9-4215-951b-cf8dea50e5b0 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:17.607808 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a2b39777-f0d9-4215-951b-cf8dea50e5b0 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:17.608466 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a2b39777-f0d9-4215-951b-cf8dea50e5b0 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:17.608895 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a2b39777-f0d9-4215-951b-cf8dea50e5b0 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:17.861835 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-936e0a19-b719-413f-900d-f10a0a2275ff tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bc1e85c16e49c695f073f2a7b40a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4ba38e25a4143adfe864a8408c524', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:17.880631 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-936e0a19-b719-413f-900d-f10a0a2275ff tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] 10.222.0.26 "GET /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037" status: 200 len: 1504 microversion: 2.1 time: 0.374438 Sep 17 21:01:17.881880 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1305/2690] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:17 2022] GET /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037 => generated 1504 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:01:17.904681 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fc80bafa-fd23-4a63-a3f1-a407edde1262 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:17.905260 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fc80bafa-fd23-4a63-a3f1-a407edde1262 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] [instance: a599ed2a-d78f-46e8-a23c-17e9eee0a037] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:17.918294 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc80bafa-fd23-4a63-a3f1-a407edde1262 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:17.919060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc80bafa-fd23-4a63-a3f1-a407edde1262 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:17.921027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc80bafa-fd23-4a63-a3f1-a407edde1262 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:17.923675 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc80bafa-fd23-4a63-a3f1-a407edde1262 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:17.925721 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc80bafa-fd23-4a63-a3f1-a407edde1262 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:17.926855 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc80bafa-fd23-4a63-a3f1-a407edde1262 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:18.091681 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a2b39777-f0d9-4215-951b-cf8dea50e5b0 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:18.105308 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a2b39777-f0d9-4215-951b-cf8dea50e5b0 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d" status: 200 len: 1532 microversion: 2.1 time: 0.515565 Sep 17 21:01:18.106826 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1386/2691] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:17 2022] GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d => generated 1532 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:01:18.113625 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-07856c4a-1840-4bb1-855e-0324ef980f34 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:18.114309 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fc80bafa-fd23-4a63-a3f1-a407edde1262 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.213699 Sep 17 21:01:18.114842 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-07856c4a-1840-4bb1-855e-0324ef980f34 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 6beb0759-caaa-4644-b0d6-1d77d21b7e0b] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:18.115115 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1306/2692] 10.222.0.26 () {58 vars in 1296 bytes} [Sat Sep 17 21:01:17 2022] DELETE /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037/os-server-password => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 17 21:01:18.126123 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-07856c4a-1840-4bb1-855e-0324ef980f34 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:18.126365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c8f5b6f2-3ad5-4eaa-89cc-e08521d93a52 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:18.126898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c8f5b6f2-3ad5-4eaa-89cc-e08521d93a52 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] [instance: a599ed2a-d78f-46e8-a23c-17e9eee0a037] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:18.127313 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-07856c4a-1840-4bb1-855e-0324ef980f34 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:18.128071 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-07856c4a-1840-4bb1-855e-0324ef980f34 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:18.129006 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-07856c4a-1840-4bb1-855e-0324ef980f34 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:18.129988 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-07856c4a-1840-4bb1-855e-0324ef980f34 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:18.130601 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-07856c4a-1840-4bb1-855e-0324ef980f34 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:18.147089 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8f5b6f2-3ad5-4eaa-89cc-e08521d93a52 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:18.147711 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8f5b6f2-3ad5-4eaa-89cc-e08521d93a52 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:18.148249 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8f5b6f2-3ad5-4eaa-89cc-e08521d93a52 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:18.148985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8f5b6f2-3ad5-4eaa-89cc-e08521d93a52 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:18.149568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8f5b6f2-3ad5-4eaa-89cc-e08521d93a52 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:18.151877 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8f5b6f2-3ad5-4eaa-89cc-e08521d93a52 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:18.191434 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c8f5b6f2-3ad5-4eaa-89cc-e08521d93a52 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] 10.222.0.26 "GET /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.071291 Sep 17 21:01:18.193093 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1307/2693] 10.222.0.26 () {58 vars in 1293 bytes} [Sat Sep 17 21:01:18 2022] GET /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037/os-server-password => generated 16 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 17 21:01:18.212049 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c8bab204-351a-4034-be89-002d5f693b4e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:18.213169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c8bab204-351a-4034-be89-002d5f693b4e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:18.227666 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8bab204-351a-4034-be89-002d5f693b4e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:18.228250 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8bab204-351a-4034-be89-002d5f693b4e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:18.229480 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8bab204-351a-4034-be89-002d5f693b4e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:18.230239 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8bab204-351a-4034-be89-002d5f693b4e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:18.230746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8bab204-351a-4034-be89-002d5f693b4e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:18.231312 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8bab204-351a-4034-be89-002d5f693b4e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:18.397379 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-07856c4a-1840-4bb1-855e-0324ef980f34 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:18.410784 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-07856c4a-1840-4bb1-855e-0324ef980f34 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b" status: 200 len: 1506 microversion: 2.1 time: 0.302525 Sep 17 21:01:18.411487 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1387/2694] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:18 2022] GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b => generated 1506 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:18.416894 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1fac99a1-5562-4eb3-8220-682f83c4338b tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:18.417498 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1fac99a1-5562-4eb3-8220-682f83c4338b tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] [instance: a599ed2a-d78f-46e8-a23c-17e9eee0a037] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:18.423952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1fac99a1-5562-4eb3-8220-682f83c4338b tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:18.424709 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1fac99a1-5562-4eb3-8220-682f83c4338b tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:18.425772 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1fac99a1-5562-4eb3-8220-682f83c4338b tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:18.426978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1fac99a1-5562-4eb3-8220-682f83c4338b tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:18.427737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1fac99a1-5562-4eb3-8220-682f83c4338b tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:18.428377 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1fac99a1-5562-4eb3-8220-682f83c4338b tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:18.452778 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c8bab204-351a-4034-be89-002d5f693b4e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:18.457318 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1fac99a1-5562-4eb3-8220-682f83c4338b tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] [instance: a599ed2a-d78f-46e8-a23c-17e9eee0a037] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:01:18.471764 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c8bab204-351a-4034-be89-002d5f693b4e tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1472 microversion: 2.1 time: 0.277472 Sep 17 21:01:18.477090 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1308/2695] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:18 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1472 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:18.487279 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2d4c12c3-6ca1-4929-aeff-0941fe2aa981 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a48b3d30>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:18.554383 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1fac99a1-5562-4eb3-8220-682f83c4338b tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037" status: 204 len: 0 microversion: 2.1 time: 0.141297 Sep 17 21:01:18.555410 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1388/2696] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:01:18 2022] DELETE /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:01:18.565341 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7e3121cb-2383-4118-aa1b-a96766063d1e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:18.565926 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2d4c12c3-6ca1-4929-aeff-0941fe2aa981 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/bcdfea62-ad77-4071-9028-52d71b2b6f9c" status: 200 len: 662 microversion: 2.1 time: 0.087416 Sep 17 21:01:18.566065 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7e3121cb-2383-4118-aa1b-a96766063d1e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 6beb0759-caaa-4644-b0d6-1d77d21b7e0b] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:18.567601 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1309/2697] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:01:18 2022] GET /compute/v2.1/images/bcdfea62-ad77-4071-9028-52d71b2b6f9c => generated 662 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:18.572885 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e3121cb-2383-4118-aa1b-a96766063d1e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:18.573747 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e3121cb-2383-4118-aa1b-a96766063d1e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:18.573881 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1a848077-1e12-40a5-9037-11bd27bf8ea2 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:18.573973 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e3121cb-2383-4118-aa1b-a96766063d1e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:18.574247 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1a848077-1e12-40a5-9037-11bd27bf8ea2 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:18.574708 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e3121cb-2383-4118-aa1b-a96766063d1e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:18.575260 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e3121cb-2383-4118-aa1b-a96766063d1e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:18.575757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e3121cb-2383-4118-aa1b-a96766063d1e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:18.592766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a848077-1e12-40a5-9037-11bd27bf8ea2 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:18.593371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a848077-1e12-40a5-9037-11bd27bf8ea2 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:18.593928 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a848077-1e12-40a5-9037-11bd27bf8ea2 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:18.594708 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a848077-1e12-40a5-9037-11bd27bf8ea2 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:18.595234 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a848077-1e12-40a5-9037-11bd27bf8ea2 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:18.595729 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a848077-1e12-40a5-9037-11bd27bf8ea2 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:18.612067 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7e3121cb-2383-4118-aa1b-a96766063d1e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 6beb0759-caaa-4644-b0d6-1d77d21b7e0b] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:01:18.680801 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:18.722529 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7e3121cb-2383-4118-aa1b-a96766063d1e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b" status: 204 len: 0 microversion: 2.1 time: 0.160871 Sep 17 21:01:18.727175 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1389/2698] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:01:18 2022] DELETE /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:01:18.733748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cf100ab1-1b78-4223-9c28-99b815f15cb9 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:18.734413 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cf100ab1-1b78-4223-9c28-99b815f15cb9 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] [instance: a599ed2a-d78f-46e8-a23c-17e9eee0a037] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:18.742104 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cf100ab1-1b78-4223-9c28-99b815f15cb9 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:18.742604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cf100ab1-1b78-4223-9c28-99b815f15cb9 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:18.743051 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cf100ab1-1b78-4223-9c28-99b815f15cb9 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:18.744003 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cf100ab1-1b78-4223-9c28-99b815f15cb9 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:18.744557 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cf100ab1-1b78-4223-9c28-99b815f15cb9 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:18.745072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cf100ab1-1b78-4223-9c28-99b815f15cb9 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:18.776427 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1a848077-1e12-40a5-9037-11bd27bf8ea2 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:18.786436 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1a848077-1e12-40a5-9037-11bd27bf8ea2 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 200 len: 1512 microversion: 2.1 time: 0.217333 Sep 17 21:01:18.797701 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1310/2699] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:18 2022] GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 1512 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:18.797701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c851ab5a-9b81-4ef2-9691-80d5ca6804e3 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a48eb310>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:18.860119 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c851ab5a-9b81-4ef2-9691-80d5ca6804e3 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/bcdfea62-ad77-4071-9028-52d71b2b6f9c" status: 200 len: 662 microversion: 2.1 time: 0.071076 Sep 17 21:01:18.860775 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1311/2700] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:01:18 2022] GET /compute/v2.1/images/bcdfea62-ad77-4071-9028-52d71b2b6f9c => generated 662 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:18.869454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-09c16f8b-ce40-43ed-a8af-6af23a5a98fd tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:18.869454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-09c16f8b-ce40-43ed-a8af-6af23a5a98fd tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 6beb0759-caaa-4644-b0d6-1d77d21b7e0b] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:18.881910 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09c16f8b-ce40-43ed-a8af-6af23a5a98fd tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:18.882677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09c16f8b-ce40-43ed-a8af-6af23a5a98fd tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:18.883123 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09c16f8b-ce40-43ed-a8af-6af23a5a98fd tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:18.883837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09c16f8b-ce40-43ed-a8af-6af23a5a98fd tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:18.888540 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09c16f8b-ce40-43ed-a8af-6af23a5a98fd tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:18.889053 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09c16f8b-ce40-43ed-a8af-6af23a5a98fd tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:18.939978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cf100ab1-1b78-4223-9c28-99b815f15cb9 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bc1e85c16e49c695f073f2a7b40a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4ba38e25a4143adfe864a8408c524', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:18.949469 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cf100ab1-1b78-4223-9c28-99b815f15cb9 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] 10.222.0.26 "GET /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037" status: 200 len: 1510 microversion: 2.1 time: 0.219507 Sep 17 21:01:18.950083 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1390/2701] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:18 2022] GET /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037 => generated 1510 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:19.061623 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-09c16f8b-ce40-43ed-a8af-6af23a5a98fd tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:19.069679 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-09c16f8b-ce40-43ed-a8af-6af23a5a98fd tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b" status: 200 len: 1512 microversion: 2.1 time: 0.207835 Sep 17 21:01:19.070511 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1312/2702] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:18 2022] GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b => generated 1512 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:19.133097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4ecee55d-0834-4480-a14e-1bc3b26c1075 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:19.133753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4ecee55d-0834-4480-a14e-1bc3b26c1075 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 7750732c-19bc-4c5a-8637-af3a08c3af5d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:19.146272 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ecee55d-0834-4480-a14e-1bc3b26c1075 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:19.146780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ecee55d-0834-4480-a14e-1bc3b26c1075 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:19.147274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ecee55d-0834-4480-a14e-1bc3b26c1075 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:19.147999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ecee55d-0834-4480-a14e-1bc3b26c1075 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:19.148464 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ecee55d-0834-4480-a14e-1bc3b26c1075 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:19.149029 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ecee55d-0834-4480-a14e-1bc3b26c1075 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:19.327585 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4ecee55d-0834-4480-a14e-1bc3b26c1075 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:19.337447 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4ecee55d-0834-4480-a14e-1bc3b26c1075 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d" status: 200 len: 1538 microversion: 2.1 time: 0.209661 Sep 17 21:01:19.338966 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1391/2703] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:19 2022] GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d => generated 1538 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:19.499513 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b4fe8330-9c58-400a-bb00-80fd0a254d1f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:19.500138 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b4fe8330-9c58-400a-bb00-80fd0a254d1f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:19.508041 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b4fe8330-9c58-400a-bb00-80fd0a254d1f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:19.508537 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b4fe8330-9c58-400a-bb00-80fd0a254d1f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:19.509050 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b4fe8330-9c58-400a-bb00-80fd0a254d1f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:19.509805 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b4fe8330-9c58-400a-bb00-80fd0a254d1f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:19.510374 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b4fe8330-9c58-400a-bb00-80fd0a254d1f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:19.510812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b4fe8330-9c58-400a-bb00-80fd0a254d1f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:19.647775 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b4fe8330-9c58-400a-bb00-80fd0a254d1f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:19.655987 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b4fe8330-9c58-400a-bb00-80fd0a254d1f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1472 microversion: 2.1 time: 0.160313 Sep 17 21:01:19.656570 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1313/2704] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:19 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1472 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:19.815148 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bff081af-5ab1-48f4-bf1f-1aa2dbcfe95a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:19.815953 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bff081af-5ab1-48f4-bf1f-1aa2dbcfe95a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:19.825274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bff081af-5ab1-48f4-bf1f-1aa2dbcfe95a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:19.826158 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bff081af-5ab1-48f4-bf1f-1aa2dbcfe95a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:19.826934 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bff081af-5ab1-48f4-bf1f-1aa2dbcfe95a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:19.828288 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bff081af-5ab1-48f4-bf1f-1aa2dbcfe95a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:19.829111 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bff081af-5ab1-48f4-bf1f-1aa2dbcfe95a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:19.830234 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bff081af-5ab1-48f4-bf1f-1aa2dbcfe95a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:19.970781 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bff081af-5ab1-48f4-bf1f-1aa2dbcfe95a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:19.973307 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e398bad7-2141-4f28-bbc8-11e0a5715df1 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:19.974379 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e398bad7-2141-4f28-bbc8-11e0a5715df1 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] [instance: a599ed2a-d78f-46e8-a23c-17e9eee0a037] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:19.979442 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bff081af-5ab1-48f4-bf1f-1aa2dbcfe95a tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 200 len: 1512 microversion: 2.1 time: 0.168439 Sep 17 21:01:19.980333 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1392/2705] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:19 2022] GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:19.981713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e398bad7-2141-4f28-bbc8-11e0a5715df1 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:19.982467 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e398bad7-2141-4f28-bbc8-11e0a5715df1 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:19.982975 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e398bad7-2141-4f28-bbc8-11e0a5715df1 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:19.983751 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e398bad7-2141-4f28-bbc8-11e0a5715df1 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:19.984283 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e398bad7-2141-4f28-bbc8-11e0a5715df1 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:19.984984 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e398bad7-2141-4f28-bbc8-11e0a5715df1 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:20.097751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6036a688-2238-4d3d-b529-6ed81485d3cd tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:20.098702 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6036a688-2238-4d3d-b529-6ed81485d3cd tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 6beb0759-caaa-4644-b0d6-1d77d21b7e0b] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:20.112877 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6036a688-2238-4d3d-b529-6ed81485d3cd tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:20.113488 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6036a688-2238-4d3d-b529-6ed81485d3cd tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:20.115340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6036a688-2238-4d3d-b529-6ed81485d3cd tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:20.117879 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6036a688-2238-4d3d-b529-6ed81485d3cd tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:20.119219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6036a688-2238-4d3d-b529-6ed81485d3cd tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:20.120628 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6036a688-2238-4d3d-b529-6ed81485d3cd tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:20.155638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e398bad7-2141-4f28-bbc8-11e0a5715df1 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bc1e85c16e49c695f073f2a7b40a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4ba38e25a4143adfe864a8408c524', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:20.168342 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e398bad7-2141-4f28-bbc8-11e0a5715df1 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] 10.222.0.26 "GET /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037" status: 200 len: 1510 microversion: 2.1 time: 0.196231 Sep 17 21:01:20.168342 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1314/2706] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:19 2022] GET /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037 => generated 1510 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:01:20.364523 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6036a688-2238-4d3d-b529-6ed81485d3cd tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:20.365967 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b0502bdb-b464-446f-afc4-a85a5dc02967 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:20.366674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b0502bdb-b464-446f-afc4-a85a5dc02967 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 7750732c-19bc-4c5a-8637-af3a08c3af5d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:20.375174 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6036a688-2238-4d3d-b529-6ed81485d3cd tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b" status: 200 len: 1512 microversion: 2.1 time: 0.284490 Sep 17 21:01:20.377099 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1393/2707] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:20 2022] GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b => generated 1512 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:20.383281 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0502bdb-b464-446f-afc4-a85a5dc02967 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:20.384290 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0502bdb-b464-446f-afc4-a85a5dc02967 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:20.389150 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0502bdb-b464-446f-afc4-a85a5dc02967 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:20.389150 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0502bdb-b464-446f-afc4-a85a5dc02967 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:20.389150 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0502bdb-b464-446f-afc4-a85a5dc02967 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:20.389150 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0502bdb-b464-446f-afc4-a85a5dc02967 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:20.432153 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=4 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:20.587529 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-05142bd2-2b34-4b40-a561-aa54c74e9659 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a9f30f70>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:20.648863 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-05142bd2-2b34-4b40-a561-aa54c74e9659 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/4e9929ff-1c72-43aa-bec6-410abc6e0698" status: 200 len: 661 microversion: 2.1 time: 0.065845 Sep 17 21:01:20.651280 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1394/2708] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:01:20 2022] GET /compute/v2.1/images/4e9929ff-1c72-43aa-bec6-410abc6e0698 => generated 661 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:20.664841 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b0502bdb-b464-446f-afc4-a85a5dc02967 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:20.671570 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e348c991-99c4-4efb-ab66-5af7c052f156 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a4ceb280>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:20.683047 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b0502bdb-b464-446f-afc4-a85a5dc02967 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d" status: 200 len: 1538 microversion: 2.1 time: 0.325000 Sep 17 21:01:20.684455 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1315/2709] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:20 2022] GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d => generated 1538 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:01:20.708536 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b137cfc9-9b03-489e-bbf9-4c0c86d93ee4 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:20.710086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b137cfc9-9b03-489e-bbf9-4c0c86d93ee4 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:20.733248 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b137cfc9-9b03-489e-bbf9-4c0c86d93ee4 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:20.734235 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b137cfc9-9b03-489e-bbf9-4c0c86d93ee4 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:20.734880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b137cfc9-9b03-489e-bbf9-4c0c86d93ee4 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:20.736164 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b137cfc9-9b03-489e-bbf9-4c0c86d93ee4 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:20.737138 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b137cfc9-9b03-489e-bbf9-4c0c86d93ee4 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:20.737814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b137cfc9-9b03-489e-bbf9-4c0c86d93ee4 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:20.737956 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e348c991-99c4-4efb-ab66-5af7c052f156 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/4e9929ff-1c72-43aa-bec6-410abc6e0698" status: 200 len: 661 microversion: 2.1 time: 0.073771 Sep 17 21:01:20.738768 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1395/2710] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:01:20 2022] GET /compute/v2.1/images/4e9929ff-1c72-43aa-bec6-410abc6e0698 => generated 661 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:20.879160 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ec55b354-ecde-41ca-b0c2-8e885133afb5 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-677445076", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:20.986402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-ec55b354-ecde-41ca-b0c2-8e885133afb5 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] validate_networks() for None {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:01:21.060719 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b137cfc9-9b03-489e-bbf9-4c0c86d93ee4 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:21.076680 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b137cfc9-9b03-489e-bbf9-4c0c86d93ee4 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1472 microversion: 2.1 time: 0.390858 Sep 17 21:01:21.077910 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1316/2711] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:20 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1472 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:21.086529 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-87067f53-a393-4958-8c14-8479a99729ec tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:21.087375 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-87067f53-a393-4958-8c14-8479a99729ec tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:21.095311 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87067f53-a393-4958-8c14-8479a99729ec tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:21.096249 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87067f53-a393-4958-8c14-8479a99729ec tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:21.096917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87067f53-a393-4958-8c14-8479a99729ec tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:21.097935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87067f53-a393-4958-8c14-8479a99729ec tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:21.099001 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87067f53-a393-4958-8c14-8479a99729ec tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:21.099984 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87067f53-a393-4958-8c14-8479a99729ec tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:21.433366 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-87067f53-a393-4958-8c14-8479a99729ec tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:21.443632 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-87067f53-a393-4958-8c14-8479a99729ec tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 200 len: 1512 microversion: 2.1 time: 0.364137 Sep 17 21:01:21.444344 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1317/2712] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:21 2022] GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 1512 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:21.449476 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-c4d5c590-5b23-4ede-bac6-c5c63928594e req-c5b542ba-7a18-49fb-ae6e-755d0fdf285d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a599ed2a-d78f-46e8-a23c-17e9eee0a037", "name": "network-vif-deleted", "tag": "daf6ab9a-717f-4757-88b8-a24346b0618c"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:21.459406 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-c4d5c590-5b23-4ede-bac6-c5c63928594e req-c5b542ba-7a18-49fb-ae6e-755d0fdf285d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:21.460182 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-c4d5c590-5b23-4ede-bac6-c5c63928594e req-c5b542ba-7a18-49fb-ae6e-755d0fdf285d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:21.460774 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-c4d5c590-5b23-4ede-bac6-c5c63928594e req-c5b542ba-7a18-49fb-ae6e-755d0fdf285d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:21.475622 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-c4d5c590-5b23-4ede-bac6-c5c63928594e req-c5b542ba-7a18-49fb-ae6e-755d0fdf285d service nova] Creating event network-vif-deleted:daf6ab9a-717f-4757-88b8-a24346b0618c for instance a599ed2a-d78f-46e8-a23c-17e9eee0a037 on nch2-master-1 Sep 17 21:01:21.477376 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-ec55b354-ecde-41ca-b0c2-8e885133afb5 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:01:21.477910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-ec55b354-ecde-41ca-b0c2-8e885133afb5 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:01:21.478374 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-ec55b354-ecde-41ca-b0c2-8e885133afb5 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:01:21.478784 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-ec55b354-ecde-41ca-b0c2-8e885133afb5 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:01:21.479199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-ec55b354-ecde-41ca-b0c2-8e885133afb5 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:01:21.480827 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-c4d5c590-5b23-4ede-bac6-c5c63928594e req-c5b542ba-7a18-49fb-ae6e-755d0fdf285d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034950 Sep 17 21:01:21.481824 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1318/2713] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:21.488169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c6830935-1f19-4158-8a0a-0b981f8da05e tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:21.488872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c6830935-1f19-4158-8a0a-0b981f8da05e tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] [instance: a599ed2a-d78f-46e8-a23c-17e9eee0a037] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:21.495226 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ec55b354-ecde-41ca-b0c2-8e885133afb5 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:21.495849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ec55b354-ecde-41ca-b0c2-8e885133afb5 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:21.496294 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ec55b354-ecde-41ca-b0c2-8e885133afb5 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:21.497081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c6830935-1f19-4158-8a0a-0b981f8da05e tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:21.497211 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ec55b354-ecde-41ca-b0c2-8e885133afb5 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:21.497624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c6830935-1f19-4158-8a0a-0b981f8da05e tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:21.497735 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ec55b354-ecde-41ca-b0c2-8e885133afb5 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:21.498245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ec55b354-ecde-41ca-b0c2-8e885133afb5 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:21.498347 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c6830935-1f19-4158-8a0a-0b981f8da05e tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:21.499150 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c6830935-1f19-4158-8a0a-0b981f8da05e tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:21.499613 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c6830935-1f19-4158-8a0a-0b981f8da05e tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:21.500041 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c6830935-1f19-4158-8a0a-0b981f8da05e tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:21.513391 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:UPDATE=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:21.522593 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-ec55b354-ecde-41ca-b0c2-8e885133afb5 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Getting quotas for project 0d42cba2664646f6adb4202574b7fa5a. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:01:21.529964 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-ec55b354-ecde-41ca-b0c2-8e885133afb5 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Getting quotas for user 7fc9559a966444d98e54edb4f948ae1a and project 0d42cba2664646f6adb4202574b7fa5a. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:01:21.538344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c6830935-1f19-4158-8a0a-0b981f8da05e tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:21.538839 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c6830935-1f19-4158-8a0a-0b981f8da05e tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:21.539276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c6830935-1f19-4158-8a0a-0b981f8da05e tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:21.539727 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-c6830935-1f19-4158-8a0a-0b981f8da05e tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lazy-loading 'fault' on Instance uuid a599ed2a-d78f-46e8-a23c-17e9eee0a037 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:01:21.561163 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ec55b354-ecde-41ca-b0c2-8e885133afb5 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:01:21.565607 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ec55b354-ecde-41ca-b0c2-8e885133afb5 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:01:21.590142 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c6830935-1f19-4158-8a0a-0b981f8da05e tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1bc1e85c16e49c695f073f2a7b40a52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e4ba38e25a4143adfe864a8408c524', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:21.599175 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c6830935-1f19-4158-8a0a-0b981f8da05e tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] 10.222.0.26 "GET /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037" status: 200 len: 1306 microversion: 2.1 time: 0.115543 Sep 17 21:01:21.599755 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1319/2714] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:21 2022] GET /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037 => generated 1306 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:21.605420 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-52a4b4a3-df05-49d1-9145-9a79e23e2aa6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:21.606274 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-52a4b4a3-df05-49d1-9145-9a79e23e2aa6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 6beb0759-caaa-4644-b0d6-1d77d21b7e0b] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:21.613743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-52a4b4a3-df05-49d1-9145-9a79e23e2aa6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:21.615993 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-52a4b4a3-df05-49d1-9145-9a79e23e2aa6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:21.616424 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-52a4b4a3-df05-49d1-9145-9a79e23e2aa6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:21.617330 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-52a4b4a3-df05-49d1-9145-9a79e23e2aa6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:21.617894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-52a4b4a3-df05-49d1-9145-9a79e23e2aa6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:21.618242 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-52a4b4a3-df05-49d1-9145-9a79e23e2aa6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:21.638460 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ec55b354-ecde-41ca-b0c2-8e885133afb5 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.766180 Sep 17 21:01:21.651954 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1396/2715] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:01:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:01:21.708986 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2db6a191-221f-4d32-a782-545f2b793b2d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:21.709713 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2db6a191-221f-4d32-a782-545f2b793b2d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 7750732c-19bc-4c5a-8637-af3a08c3af5d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:21.718193 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2db6a191-221f-4d32-a782-545f2b793b2d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:21.718694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2db6a191-221f-4d32-a782-545f2b793b2d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:21.719139 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2db6a191-221f-4d32-a782-545f2b793b2d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:21.719856 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2db6a191-221f-4d32-a782-545f2b793b2d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:21.720316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2db6a191-221f-4d32-a782-545f2b793b2d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:21.720748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2db6a191-221f-4d32-a782-545f2b793b2d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:21.806845 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-52a4b4a3-df05-49d1-9145-9a79e23e2aa6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:21.814784 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-52a4b4a3-df05-49d1-9145-9a79e23e2aa6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b" status: 200 len: 1512 microversion: 2.1 time: 0.213757 Sep 17 21:01:21.825878 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1320/2716] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:21 2022] GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b => generated 1512 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:21.835213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ae2271bb-04c4-4988-82d0-bbdfef524376 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1474516794", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:21.907360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-ae2271bb-04c4-4988-82d0-bbdfef524376 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] validate_networks() for None {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:01:22.000003 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2db6a191-221f-4d32-a782-545f2b793b2d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:22.010531 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2db6a191-221f-4d32-a782-545f2b793b2d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d" status: 200 len: 1538 microversion: 2.1 time: 0.306472 Sep 17 21:01:22.017526 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1397/2717] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:21 2022] GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d => generated 1538 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:01:22.100581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f4686d2a-7990-4a2a-bfe1-4195a65a623b tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:22.101591 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f4686d2a-7990-4a2a-bfe1-4195a65a623b tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:22.114245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4686d2a-7990-4a2a-bfe1-4195a65a623b tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:22.116369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4686d2a-7990-4a2a-bfe1-4195a65a623b tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:22.118102 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4686d2a-7990-4a2a-bfe1-4195a65a623b tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:22.119381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4686d2a-7990-4a2a-bfe1-4195a65a623b tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:22.120224 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4686d2a-7990-4a2a-bfe1-4195a65a623b tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:22.120833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4686d2a-7990-4a2a-bfe1-4195a65a623b tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:22.292834 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-ae2271bb-04c4-4988-82d0-bbdfef524376 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:01:22.295108 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-ae2271bb-04c4-4988-82d0-bbdfef524376 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:01:22.295887 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-ae2271bb-04c4-4988-82d0-bbdfef524376 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:01:22.307499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-ae2271bb-04c4-4988-82d0-bbdfef524376 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:01:22.310085 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-ae2271bb-04c4-4988-82d0-bbdfef524376 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:01:22.322256 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ae2271bb-04c4-4988-82d0-bbdfef524376 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:22.322745 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ae2271bb-04c4-4988-82d0-bbdfef524376 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:22.323186 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ae2271bb-04c4-4988-82d0-bbdfef524376 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:22.323939 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ae2271bb-04c4-4988-82d0-bbdfef524376 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:22.324392 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ae2271bb-04c4-4988-82d0-bbdfef524376 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:22.324819 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ae2271bb-04c4-4988-82d0-bbdfef524376 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:22.345235 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-ae2271bb-04c4-4988-82d0-bbdfef524376 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Getting quotas for project 0d42cba2664646f6adb4202574b7fa5a. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:01:22.351164 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-ae2271bb-04c4-4988-82d0-bbdfef524376 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Getting quotas for user 7fc9559a966444d98e54edb4f948ae1a and project 0d42cba2664646f6adb4202574b7fa5a. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:01:22.364915 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ae2271bb-04c4-4988-82d0-bbdfef524376 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:01:22.367705 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ae2271bb-04c4-4988-82d0-bbdfef524376 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 66779798-999a-4a63-98dd-bf7fa71ce4b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:01:22.380778 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:22.425408 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ae2271bb-04c4-4988-82d0-bbdfef524376 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598121 Sep 17 21:01:22.426799 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1321/2718] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:01:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:01:22.444950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bc19d198-1ef1-4236-8b17-5a31f867dd7f tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:22.448175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bc19d198-1ef1-4236-8b17-5a31f867dd7f tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 66779798-999a-4a63-98dd-bf7fa71ce4b1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:22.491821 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f4686d2a-7990-4a2a-bfe1-4195a65a623b tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:22.504767 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f4686d2a-7990-4a2a-bfe1-4195a65a623b tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1478 microversion: 2.1 time: 0.408177 Sep 17 21:01:22.506874 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1398/2719] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:22 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1478 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:22.519016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-315fe6e2-66da-423a-b18b-7cb262fda07b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:22.522152 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-315fe6e2-66da-423a-b18b-7cb262fda07b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:22.535170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-315fe6e2-66da-423a-b18b-7cb262fda07b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:22.535999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-315fe6e2-66da-423a-b18b-7cb262fda07b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:22.536983 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-315fe6e2-66da-423a-b18b-7cb262fda07b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:22.541872 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-315fe6e2-66da-423a-b18b-7cb262fda07b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:22.542784 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-315fe6e2-66da-423a-b18b-7cb262fda07b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:22.543538 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-315fe6e2-66da-423a-b18b-7cb262fda07b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:22.606634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bc19d198-1ef1-4236-8b17-5a31f867dd7f tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc9559a966444d98e54edb4f948ae1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d42cba2664646f6adb4202574b7fa5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:22.620125 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bc19d198-1ef1-4236-8b17-5a31f867dd7f tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1" status: 200 len: 1218 microversion: 2.1 time: 0.186413 Sep 17 21:01:22.622693 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1322/2720] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:22 2022] GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1 => generated 1218 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:22.628245 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2a8d1923-da35-429f-adfb-fa898c3242c7 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:22.628952 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2a8d1923-da35-429f-adfb-fa898c3242c7 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] [instance: a599ed2a-d78f-46e8-a23c-17e9eee0a037] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:22.636553 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2a8d1923-da35-429f-adfb-fa898c3242c7 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:22.637563 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2a8d1923-da35-429f-adfb-fa898c3242c7 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:22.638118 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2a8d1923-da35-429f-adfb-fa898c3242c7 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:22.638926 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2a8d1923-da35-429f-adfb-fa898c3242c7 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:22.639741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2a8d1923-da35-429f-adfb-fa898c3242c7 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:22.640338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2a8d1923-da35-429f-adfb-fa898c3242c7 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:22.659687 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-2a8d1923-da35-429f-adfb-fa898c3242c7 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] HTTP exception thrown: Instance a599ed2a-d78f-46e8-a23c-17e9eee0a037 could not be found. Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2a8d1923-da35-429f-adfb-fa898c3242c7 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Request method failure captured: Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037 HTTP/1.1 Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjWLyHra2M2ixevDj89opP9F1vZRVPTq_64-S0-pCIH8mgcCRE9MCakqhgu3D-C5E0a5GP6akWnZQdFzr3xvGE5fJ6mZuCRh8EkpvRqtj6vonIzTXd-_bcMAyZ9LgSNFnKZOepyPQ3mPbqmwExscn2eHfVWpKTGfZhMv70_71pCP2QY Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 77e4ba38e25a4143adfe864a8408c524 Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerPasswordTestJSON-945410513 Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/77e4ba38e25a4143adfe864a8408c524"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/77e4ba38e25a4143adfe864a8408c524"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/77e4ba38e25a4143adfe864a8408c524"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_77e4ba38e25a4143adfe864a8408c524", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerPasswordTestJSON-945410513 Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 77e4ba38e25a4143adfe864a8408c524 Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerPasswordTestJSON-945410513 Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerPasswordTestJSON-945410513-project Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: d1bc1e85c16e49c695f073f2a7b40a52 Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerPasswordTestJSON-945410513-project Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance a599ed2a-d78f-46e8-a23c-17e9eee0a037 could not be found. Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'a599ed2a-d78f-46e8-a23c-17e9eee0a037'} Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a599ed2a-d78f-46e8-a23c-17e9eee0a037 could not be found. Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a599ed2a-d78f-46e8-a23c-17e9eee0a037 could not be found. Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:22.661828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:22.666790 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:22.666790 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:22.666790 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:22.666790 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:01:22.666790 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:01:22.666790 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a599ed2a-d78f-46e8-a23c-17e9eee0a037 could not be found. Sep 17 21:01:22.666790 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:22.666790 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2a8d1923-da35-429f-adfb-fa898c3242c7 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] Returning 404 to user: Instance a599ed2a-d78f-46e8-a23c-17e9eee0a037 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:01:22.675815 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2a8d1923-da35-429f-adfb-fa898c3242c7 tempest-ServerPasswordTestJSON-945410513 tempest-ServerPasswordTestJSON-945410513-project] 10.222.0.26 "GET /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037" status: 404 len: 111 microversion: 2.1 time: 0.044489 Sep 17 21:01:22.676936 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1323/2721] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:22 2022] GET /compute/v2.1/servers/a599ed2a-d78f-46e8-a23c-17e9eee0a037 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:01:22.839784 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5bee3eb3-f4bd-4bbc-a759-53c1e723552a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:22.840954 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5bee3eb3-f4bd-4bbc-a759-53c1e723552a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 6beb0759-caaa-4644-b0d6-1d77d21b7e0b] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:22.856206 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5bee3eb3-f4bd-4bbc-a759-53c1e723552a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:22.856733 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5bee3eb3-f4bd-4bbc-a759-53c1e723552a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:22.857183 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5bee3eb3-f4bd-4bbc-a759-53c1e723552a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:22.860491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5bee3eb3-f4bd-4bbc-a759-53c1e723552a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:22.861005 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5bee3eb3-f4bd-4bbc-a759-53c1e723552a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:22.863821 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5bee3eb3-f4bd-4bbc-a759-53c1e723552a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:23.327231 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-315fe6e2-66da-423a-b18b-7cb262fda07b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:23.342499 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-315fe6e2-66da-423a-b18b-7cb262fda07b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 200 len: 1512 microversion: 2.1 time: 0.832587 Sep 17 21:01:23.343116 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1399/2722] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:22 2022] GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 1512 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:23.347754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-a4309987-6dbc-429f-98b8-59b370734fdc req-eeda08cc-8ea9-428f-bd52-a3998e50dcf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7750732c-19bc-4c5a-8637-af3a08c3af5d", "name": "network-vif-plugged", "status": "completed", "tag": "c0574c06-40f2-449c-a082-5faa99b18540"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:23.373645 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a4309987-6dbc-429f-98b8-59b370734fdc req-eeda08cc-8ea9-428f-bd52-a3998e50dcf6 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:23.374137 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a4309987-6dbc-429f-98b8-59b370734fdc req-eeda08cc-8ea9-428f-bd52-a3998e50dcf6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:23.374568 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a4309987-6dbc-429f-98b8-59b370734fdc req-eeda08cc-8ea9-428f-bd52-a3998e50dcf6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:23.388823 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-a4309987-6dbc-429f-98b8-59b370734fdc req-eeda08cc-8ea9-428f-bd52-a3998e50dcf6 service nova] Creating event network-vif-plugged:c0574c06-40f2-449c-a082-5faa99b18540 for instance 7750732c-19bc-4c5a-8637-af3a08c3af5d on nch2-master-1 Sep 17 21:01:23.398202 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-a4309987-6dbc-429f-98b8-59b370734fdc req-eeda08cc-8ea9-428f-bd52-a3998e50dcf6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050866 Sep 17 21:01:23.400203 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1400/2723] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:23.409200 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1cc6c733-d555-4936-9e16-ea6ca8f90aed tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:23.410568 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1cc6c733-d555-4936-9e16-ea6ca8f90aed tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 7750732c-19bc-4c5a-8637-af3a08c3af5d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:23.420049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1cc6c733-d555-4936-9e16-ea6ca8f90aed tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:23.421131 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1cc6c733-d555-4936-9e16-ea6ca8f90aed tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:23.421857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1cc6c733-d555-4936-9e16-ea6ca8f90aed tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:23.422748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1cc6c733-d555-4936-9e16-ea6ca8f90aed tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:23.423411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1cc6c733-d555-4936-9e16-ea6ca8f90aed tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:23.424039 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1cc6c733-d555-4936-9e16-ea6ca8f90aed tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:23.652375 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5bee3eb3-f4bd-4bbc-a759-53c1e723552a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:23.667196 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5bee3eb3-f4bd-4bbc-a759-53c1e723552a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b" status: 200 len: 1512 microversion: 2.1 time: 0.831691 Sep 17 21:01:23.683908 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1324/2724] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:22 2022] GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b => generated 1512 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:23.705521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-69f2fb41-612b-469a-b9ba-b910c0b53ec0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:23.707471 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-69f2fb41-612b-469a-b9ba-b910c0b53ec0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:23.723302 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69f2fb41-612b-469a-b9ba-b910c0b53ec0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:23.726848 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69f2fb41-612b-469a-b9ba-b910c0b53ec0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:23.727917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69f2fb41-612b-469a-b9ba-b910c0b53ec0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:23.728762 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69f2fb41-612b-469a-b9ba-b910c0b53ec0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:23.731188 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69f2fb41-612b-469a-b9ba-b910c0b53ec0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:23.731830 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69f2fb41-612b-469a-b9ba-b910c0b53ec0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:24.492279 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-69f2fb41-612b-469a-b9ba-b910c0b53ec0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:24.506833 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-69f2fb41-612b-469a-b9ba-b910c0b53ec0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1478 microversion: 2.1 time: 0.818379 Sep 17 21:01:24.507459 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1325/2725] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:23 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1478 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:24.518136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1cc6c733-d555-4936-9e16-ea6ca8f90aed tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:24.519088 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-aefa27ae-0f35-4613-9dbe-93e2e451bee2 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:24.519758 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-aefa27ae-0f35-4613-9dbe-93e2e451bee2 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 66779798-999a-4a63-98dd-bf7fa71ce4b1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:24.534890 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1cc6c733-d555-4936-9e16-ea6ca8f90aed tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d" status: 200 len: 1520 microversion: 2.1 time: 1.130831 Sep 17 21:01:24.536587 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1401/2726] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:23 2022] GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d => generated 1520 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:24.550548 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aefa27ae-0f35-4613-9dbe-93e2e451bee2 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:24.550800 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aefa27ae-0f35-4613-9dbe-93e2e451bee2 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:24.551046 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aefa27ae-0f35-4613-9dbe-93e2e451bee2 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:24.553244 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aefa27ae-0f35-4613-9dbe-93e2e451bee2 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:24.553923 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aefa27ae-0f35-4613-9dbe-93e2e451bee2 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:24.558374 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-84805f0d-a93a-45d0-93a3-b28eab47733e req-1bbec36e-8735-4514-8969-b097cb570bef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6beb0759-caaa-4644-b0d6-1d77d21b7e0b", "name": "network-vif-deleted", "tag": "10cbd0fe-ed39-47c4-8c48-636b6e3ddd4f"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:24.559528 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aefa27ae-0f35-4613-9dbe-93e2e451bee2 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:24.599585 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-84805f0d-a93a-45d0-93a3-b28eab47733e req-1bbec36e-8735-4514-8969-b097cb570bef service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:24.602470 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-84805f0d-a93a-45d0-93a3-b28eab47733e req-1bbec36e-8735-4514-8969-b097cb570bef service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:24.605095 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-84805f0d-a93a-45d0-93a3-b28eab47733e req-1bbec36e-8735-4514-8969-b097cb570bef service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:24.645804 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-84805f0d-a93a-45d0-93a3-b28eab47733e req-1bbec36e-8735-4514-8969-b097cb570bef service nova] Creating event network-vif-deleted:10cbd0fe-ed39-47c4-8c48-636b6e3ddd4f for instance 6beb0759-caaa-4644-b0d6-1d77d21b7e0b on nch1-master-1 Sep 17 21:01:24.651943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-aefa27ae-0f35-4613-9dbe-93e2e451bee2 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc9559a966444d98e54edb4f948ae1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d42cba2664646f6adb4202574b7fa5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:24.661937 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-84805f0d-a93a-45d0-93a3-b28eab47733e req-1bbec36e-8735-4514-8969-b097cb570bef service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120307 Sep 17 21:01:24.663309 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1402/2727] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:24.664416 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-aefa27ae-0f35-4613-9dbe-93e2e451bee2 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1" status: 200 len: 1270 microversion: 2.1 time: 0.153763 Sep 17 21:01:24.669625 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1326/2728] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:24 2022] GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1 => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:24.672463 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7a6f0965-86e2-4102-8d03-ab4e0d8bf032 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:24.673371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7a6f0965-86e2-4102-8d03-ab4e0d8bf032 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:24.680954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a6f0965-86e2-4102-8d03-ab4e0d8bf032 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:24.681755 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a6f0965-86e2-4102-8d03-ab4e0d8bf032 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:24.682397 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a6f0965-86e2-4102-8d03-ab4e0d8bf032 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:24.682720 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c9f5123f-c69a-423f-8e51-fc6f8eb28e70 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:24.683679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a6f0965-86e2-4102-8d03-ab4e0d8bf032 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:24.684365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c9f5123f-c69a-423f-8e51-fc6f8eb28e70 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 7750732c-19bc-4c5a-8637-af3a08c3af5d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:24.684557 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a6f0965-86e2-4102-8d03-ab4e0d8bf032 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:24.685300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a6f0965-86e2-4102-8d03-ab4e0d8bf032 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:24.698683 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c9f5123f-c69a-423f-8e51-fc6f8eb28e70 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:24.700545 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c9f5123f-c69a-423f-8e51-fc6f8eb28e70 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:24.702393 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c9f5123f-c69a-423f-8e51-fc6f8eb28e70 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:24.703975 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c9f5123f-c69a-423f-8e51-fc6f8eb28e70 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:24.705649 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c9f5123f-c69a-423f-8e51-fc6f8eb28e70 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:24.707596 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c9f5123f-c69a-423f-8e51-fc6f8eb28e70 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:24.771645 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c9f5123f-c69a-423f-8e51-fc6f8eb28e70 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 7750732c-19bc-4c5a-8637-af3a08c3af5d] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:01:24.961917 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c9f5123f-c69a-423f-8e51-fc6f8eb28e70 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d" status: 204 len: 0 microversion: 2.1 time: 0.291998 Sep 17 21:01:24.966884 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1327/2729] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:01:24 2022] DELETE /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:01:24.973943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b326d7af-6502-4bfb-a0a6-4eb206023e20 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:24.974767 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b326d7af-6502-4bfb-a0a6-4eb206023e20 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 6beb0759-caaa-4644-b0d6-1d77d21b7e0b] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:24.981927 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b326d7af-6502-4bfb-a0a6-4eb206023e20 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:24.982430 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b326d7af-6502-4bfb-a0a6-4eb206023e20 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:24.982982 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b326d7af-6502-4bfb-a0a6-4eb206023e20 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:24.983797 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b326d7af-6502-4bfb-a0a6-4eb206023e20 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:24.984260 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b326d7af-6502-4bfb-a0a6-4eb206023e20 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:24.984690 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b326d7af-6502-4bfb-a0a6-4eb206023e20 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:25.022534 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b326d7af-6502-4bfb-a0a6-4eb206023e20 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:25.022977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b326d7af-6502-4bfb-a0a6-4eb206023e20 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:25.023480 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b326d7af-6502-4bfb-a0a6-4eb206023e20 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:25.023874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-b326d7af-6502-4bfb-a0a6-4eb206023e20 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lazy-loading 'fault' on Instance uuid 6beb0759-caaa-4644-b0d6-1d77d21b7e0b {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:01:25.197516 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b326d7af-6502-4bfb-a0a6-4eb206023e20 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:25.205771 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b326d7af-6502-4bfb-a0a6-4eb206023e20 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b" status: 200 len: 1307 microversion: 2.1 time: 0.236970 Sep 17 21:01:25.206677 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1328/2730] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:24 2022] GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b => generated 1307 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:25.211927 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-16b68459-bacb-417d-b25a-11d55fbc7306 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:25.213411 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-16b68459-bacb-417d-b25a-11d55fbc7306 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 7750732c-19bc-4c5a-8637-af3a08c3af5d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:25.220396 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-16b68459-bacb-417d-b25a-11d55fbc7306 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:25.220396 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-16b68459-bacb-417d-b25a-11d55fbc7306 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:25.220396 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-16b68459-bacb-417d-b25a-11d55fbc7306 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:25.220758 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-16b68459-bacb-417d-b25a-11d55fbc7306 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:25.221139 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-16b68459-bacb-417d-b25a-11d55fbc7306 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:25.221650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-16b68459-bacb-417d-b25a-11d55fbc7306 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:25.293103 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7a6f0965-86e2-4102-8d03-ab4e0d8bf032 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:25.302659 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7a6f0965-86e2-4102-8d03-ab4e0d8bf032 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 200 len: 1512 microversion: 2.1 time: 0.637779 Sep 17 21:01:25.303464 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1403/2731] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:24 2022] GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 1512 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:25.535782 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f8d9a4a2-a58c-4355-a15b-867835a9f4be tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:25.536806 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f8d9a4a2-a58c-4355-a15b-867835a9f4be tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:25.555410 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8d9a4a2-a58c-4355-a15b-867835a9f4be tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:25.558725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8d9a4a2-a58c-4355-a15b-867835a9f4be tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:25.559578 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8d9a4a2-a58c-4355-a15b-867835a9f4be tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:25.563375 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8d9a4a2-a58c-4355-a15b-867835a9f4be tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:25.565864 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8d9a4a2-a58c-4355-a15b-867835a9f4be tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:25.566929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8d9a4a2-a58c-4355-a15b-867835a9f4be tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:25.811536 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-16b68459-bacb-417d-b25a-11d55fbc7306 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:25.824297 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-16b68459-bacb-417d-b25a-11d55fbc7306 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d" status: 200 len: 1526 microversion: 2.1 time: 0.616449 Sep 17 21:01:25.825007 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1329/2732] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:25 2022] GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d => generated 1526 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:25.838966 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-8dfeabff-7876-4c9b-80ed-01202d7ef796 req-50316cfe-6c2e-4e66-bb13-d727228414c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cbeb946-182e-4489-b637-556194f5722e", "name": "network-vif-plugged", "status": "completed", "tag": "37410e23-230b-4735-b847-6de46f2c7ac9"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:25.863207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8dfeabff-7876-4c9b-80ed-01202d7ef796 req-50316cfe-6c2e-4e66-bb13-d727228414c9 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:25.863893 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8dfeabff-7876-4c9b-80ed-01202d7ef796 req-50316cfe-6c2e-4e66-bb13-d727228414c9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:25.864468 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8dfeabff-7876-4c9b-80ed-01202d7ef796 req-50316cfe-6c2e-4e66-bb13-d727228414c9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:25.879340 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-8dfeabff-7876-4c9b-80ed-01202d7ef796 req-50316cfe-6c2e-4e66-bb13-d727228414c9 service nova] Creating event network-vif-plugged:37410e23-230b-4735-b847-6de46f2c7ac9 for instance 8cbeb946-182e-4489-b637-556194f5722e on nch1-master-1 Sep 17 21:01:25.885809 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-8dfeabff-7876-4c9b-80ed-01202d7ef796 req-50316cfe-6c2e-4e66-bb13-d727228414c9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054121 Sep 17 21:01:25.887220 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1330/2733] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:25.893398 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c26838ce-9c5e-46dd-aa33-5f139faa4738 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:25.894284 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c26838ce-9c5e-46dd-aa33-5f139faa4738 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 66779798-999a-4a63-98dd-bf7fa71ce4b1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:25.903022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c26838ce-9c5e-46dd-aa33-5f139faa4738 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:25.903425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c26838ce-9c5e-46dd-aa33-5f139faa4738 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:25.903970 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c26838ce-9c5e-46dd-aa33-5f139faa4738 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:25.904996 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c26838ce-9c5e-46dd-aa33-5f139faa4738 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:25.905601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c26838ce-9c5e-46dd-aa33-5f139faa4738 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:25.906245 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c26838ce-9c5e-46dd-aa33-5f139faa4738 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:26.053392 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c26838ce-9c5e-46dd-aa33-5f139faa4738 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc9559a966444d98e54edb4f948ae1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d42cba2664646f6adb4202574b7fa5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:26.067644 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c26838ce-9c5e-46dd-aa33-5f139faa4738 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1" status: 200 len: 1276 microversion: 2.1 time: 0.175520 Sep 17 21:01:26.068653 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1331/2734] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:25 2022] GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1 => generated 1276 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:26.089673 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f8d9a4a2-a58c-4355-a15b-867835a9f4be tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:26.102176 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f8d9a4a2-a58c-4355-a15b-867835a9f4be tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1478 microversion: 2.1 time: 0.574528 Sep 17 21:01:26.103457 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1404/2735] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:25 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1478 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:01:26.228363 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-83bbd6da-c3f4-49e5-b516-db79d724dc68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:26.228985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-83bbd6da-c3f4-49e5-b516-db79d724dc68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 6beb0759-caaa-4644-b0d6-1d77d21b7e0b] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:26.248736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-83bbd6da-c3f4-49e5-b516-db79d724dc68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:26.249267 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-83bbd6da-c3f4-49e5-b516-db79d724dc68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:26.249731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-83bbd6da-c3f4-49e5-b516-db79d724dc68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:26.250456 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-83bbd6da-c3f4-49e5-b516-db79d724dc68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:26.250918 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-83bbd6da-c3f4-49e5-b516-db79d724dc68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:26.251555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-83bbd6da-c3f4-49e5-b516-db79d724dc68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:26.279293 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-83bbd6da-c3f4-49e5-b516-db79d724dc68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Instance 6beb0759-caaa-4644-b0d6-1d77d21b7e0b could not be found. Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-83bbd6da-c3f4-49e5-b516-db79d724dc68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b HTTP/1.1 Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 6beb0759-caaa-4644-b0d6-1d77d21b7e0b could not be found. Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '6beb0759-caaa-4644-b0d6-1d77d21b7e0b'} Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6beb0759-caaa-4644-b0d6-1d77d21b7e0b could not be found. Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6beb0759-caaa-4644-b0d6-1d77d21b7e0b could not be found. Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:26.280987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:26.285145 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:26.285145 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:26.285145 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:26.285145 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:01:26.285145 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:01:26.285145 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6beb0759-caaa-4644-b0d6-1d77d21b7e0b could not be found. Sep 17 21:01:26.285145 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:26.285145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-83bbd6da-c3f4-49e5-b516-db79d724dc68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 404 to user: Instance 6beb0759-caaa-4644-b0d6-1d77d21b7e0b could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:01:26.285145 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-83bbd6da-c3f4-49e5-b516-db79d724dc68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b" status: 404 len: 111 microversion: 2.1 time: 0.058156 Sep 17 21:01:26.292021 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9c95ccca-22bc-4e1e-9e71-d4ef9183a495 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:26.292661 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9c95ccca-22bc-4e1e-9e71-d4ef9183a495 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:26.298236 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1332/2736] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:26 2022] GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:01:26.305504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9c95ccca-22bc-4e1e-9e71-d4ef9183a495 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:26.306069 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9c95ccca-22bc-4e1e-9e71-d4ef9183a495 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:26.306532 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9c95ccca-22bc-4e1e-9e71-d4ef9183a495 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:26.307275 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9c95ccca-22bc-4e1e-9e71-d4ef9183a495 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:26.307743 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9c95ccca-22bc-4e1e-9e71-d4ef9183a495 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:26.308189 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9c95ccca-22bc-4e1e-9e71-d4ef9183a495 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:26.326796 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3206308f-55bc-43bc-9998-a80a8f8df711 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:26.327441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3206308f-55bc-43bc-9998-a80a8f8df711 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:26.337742 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3206308f-55bc-43bc-9998-a80a8f8df711 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:26.338245 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3206308f-55bc-43bc-9998-a80a8f8df711 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:26.338697 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3206308f-55bc-43bc-9998-a80a8f8df711 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:26.339475 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3206308f-55bc-43bc-9998-a80a8f8df711 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:26.339874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3206308f-55bc-43bc-9998-a80a8f8df711 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:26.340292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3206308f-55bc-43bc-9998-a80a8f8df711 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:26.826376 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9c95ccca-22bc-4e1e-9e71-d4ef9183a495 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:26.845015 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9c95ccca-22bc-4e1e-9e71-d4ef9183a495 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.556464 Sep 17 21:01:26.845807 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1405/2737] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:26 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:01:26.850632 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3206308f-55bc-43bc-9998-a80a8f8df711 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:26.859285 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3206308f-55bc-43bc-9998-a80a8f8df711 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 200 len: 1512 microversion: 2.1 time: 0.536376 Sep 17 21:01:26.859852 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1333/2738] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:26 2022] GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 1512 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:26.888909 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bd98deb9-69ae-4d89-9827-1d4cdfb486df tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:26.889585 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bd98deb9-69ae-4d89-9827-1d4cdfb486df tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 7750732c-19bc-4c5a-8637-af3a08c3af5d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:26.916892 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd98deb9-69ae-4d89-9827-1d4cdfb486df tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:26.917425 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd98deb9-69ae-4d89-9827-1d4cdfb486df tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:26.922224 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd98deb9-69ae-4d89-9827-1d4cdfb486df tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:26.924285 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd98deb9-69ae-4d89-9827-1d4cdfb486df tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:26.924813 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd98deb9-69ae-4d89-9827-1d4cdfb486df tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:26.930070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd98deb9-69ae-4d89-9827-1d4cdfb486df tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:27.067288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-459f6bab-8521-4a96-b019-ef3830e0e275 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "dc0ab76b-95f3-4f0a-beab-7465ea19ce7a"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-459f6bab-8521-4a96-b019-ef3830e0e275 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 163 Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: {"server": {"name": 12345, "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "dc0ab76b-95f3-4f0a-beab-7465ea19ce7a"}]}} Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4', 'flavorRef': '452', 'networks': [{'uuid': 'dc0ab76b-95f3-4f0a-beab-7465ea19ce7a'}]}}} Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise error Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi 12345 Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 21:01:27.080140 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 21:01:27.087555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 21:01:27.087555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 17 21:01:27.087555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:27.087555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:27.087555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:27.087555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:27.087555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:27.087555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:27.087555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 21:01:27.087555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 21:01:27.087555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 17 21:01:27.087555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:27.087555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-459f6bab-8521-4a96-b019-ef3830e0e275 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:01:27.087555 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-459f6bab-8521-4a96-b019-ef3830e0e275 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.018826 Sep 17 21:01:27.087555 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1334/2739] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:01:27 2022] POST /compute/v2.1/servers => generated 127 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 17 21:01:27.093688 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-adcbe55e-35c0-4225-b7b5-ae0fad041186 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:27.095044 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-adcbe55e-35c0-4225-b7b5-ae0fad041186 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:27.123639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-adcbe55e-35c0-4225-b7b5-ae0fad041186 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:27.124577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-adcbe55e-35c0-4225-b7b5-ae0fad041186 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:27.125257 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-adcbe55e-35c0-4225-b7b5-ae0fad041186 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:27.126233 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-adcbe55e-35c0-4225-b7b5-ae0fad041186 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:27.126896 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-adcbe55e-35c0-4225-b7b5-ae0fad041186 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:27.127531 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-adcbe55e-35c0-4225-b7b5-ae0fad041186 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:27.166943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:27.397637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bd98deb9-69ae-4d89-9827-1d4cdfb486df tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:27.412045 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bd98deb9-69ae-4d89-9827-1d4cdfb486df tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d" status: 200 len: 1526 microversion: 2.1 time: 0.563942 Sep 17 21:01:27.416253 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1406/2740] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:26 2022] GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d => generated 1526 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:27.428706 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4c4c8042-e5b8-4c2b-af0b-e89e4bdc95db tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:27.429721 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4c4c8042-e5b8-4c2b-af0b-e89e4bdc95db tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 66779798-999a-4a63-98dd-bf7fa71ce4b1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:27.438591 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c4c8042-e5b8-4c2b-af0b-e89e4bdc95db tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:27.439767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c4c8042-e5b8-4c2b-af0b-e89e4bdc95db tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:27.440724 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c4c8042-e5b8-4c2b-af0b-e89e4bdc95db tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:27.441872 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c4c8042-e5b8-4c2b-af0b-e89e4bdc95db tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:27.442559 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c4c8042-e5b8-4c2b-af0b-e89e4bdc95db tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:27.443330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c4c8042-e5b8-4c2b-af0b-e89e4bdc95db tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:27.544429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-adcbe55e-35c0-4225-b7b5-ae0fad041186 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:27.573561 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-adcbe55e-35c0-4225-b7b5-ae0fad041186 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.483658 Sep 17 21:01:27.577590 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1335/2741] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:27 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:27.582678 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3a419142-09ac-4f0e-b723-71a34209f995 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:27.583498 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3a419142-09ac-4f0e-b723-71a34209f995 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:27.593131 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3a419142-09ac-4f0e-b723-71a34209f995 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:27.594730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3a419142-09ac-4f0e-b723-71a34209f995 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:27.595372 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3a419142-09ac-4f0e-b723-71a34209f995 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:27.596265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3a419142-09ac-4f0e-b723-71a34209f995 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:27.596724 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3a419142-09ac-4f0e-b723-71a34209f995 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:27.597154 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3a419142-09ac-4f0e-b723-71a34209f995 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:27.945649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4c4c8042-e5b8-4c2b-af0b-e89e4bdc95db tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc9559a966444d98e54edb4f948ae1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d42cba2664646f6adb4202574b7fa5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:27.958763 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4c4c8042-e5b8-4c2b-af0b-e89e4bdc95db tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1" status: 200 len: 1318 microversion: 2.1 time: 0.540735 Sep 17 21:01:27.959781 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1407/2742] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:27 2022] GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1 => generated 1318 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:27.966576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-42c603e1-6236-4d5e-97d5-3702eb5b641c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:27.968027 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-42c603e1-6236-4d5e-97d5-3702eb5b641c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:27.975838 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42c603e1-6236-4d5e-97d5-3702eb5b641c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:27.976836 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42c603e1-6236-4d5e-97d5-3702eb5b641c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:27.977532 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42c603e1-6236-4d5e-97d5-3702eb5b641c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:27.978439 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42c603e1-6236-4d5e-97d5-3702eb5b641c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:27.979199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42c603e1-6236-4d5e-97d5-3702eb5b641c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:27.979866 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42c603e1-6236-4d5e-97d5-3702eb5b641c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:28.059736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3a419142-09ac-4f0e-b723-71a34209f995 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:28.069002 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3a419142-09ac-4f0e-b723-71a34209f995 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1478 microversion: 2.1 time: 0.490137 Sep 17 21:01:28.073814 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1336/2743] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:27 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1478 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:28.091471 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1f477a25-50f9-44dd-bde5-a78da7e53118 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:28.091471 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1f477a25-50f9-44dd-bde5-a78da7e53118 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:28.100884 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1f477a25-50f9-44dd-bde5-a78da7e53118 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:28.103397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1f477a25-50f9-44dd-bde5-a78da7e53118 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:28.105684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1f477a25-50f9-44dd-bde5-a78da7e53118 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:28.107283 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1f477a25-50f9-44dd-bde5-a78da7e53118 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:28.107762 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1f477a25-50f9-44dd-bde5-a78da7e53118 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:28.108201 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1f477a25-50f9-44dd-bde5-a78da7e53118 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:28.460138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-42c603e1-6236-4d5e-97d5-3702eb5b641c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:28.469014 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-42c603e1-6236-4d5e-97d5-3702eb5b641c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.507551 Sep 17 21:01:28.469996 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1408/2744] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:27 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:28.493666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-e8634585-a445-45ae-88b0-a7e9cbf593e1 req-06f07d76-4a42-4765-ab1f-87d5ea7c2cdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7750732c-19bc-4c5a-8637-af3a08c3af5d", "name": "network-vif-unplugged", "status": "completed", "tag": "c0574c06-40f2-449c-a082-5faa99b18540"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:28.496801 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1f477a25-50f9-44dd-bde5-a78da7e53118 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:28.506749 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e8634585-a445-45ae-88b0-a7e9cbf593e1 req-06f07d76-4a42-4765-ab1f-87d5ea7c2cdf service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:28.507547 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e8634585-a445-45ae-88b0-a7e9cbf593e1 req-06f07d76-4a42-4765-ab1f-87d5ea7c2cdf service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:28.508914 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e8634585-a445-45ae-88b0-a7e9cbf593e1 req-06f07d76-4a42-4765-ab1f-87d5ea7c2cdf service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:28.512247 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1f477a25-50f9-44dd-bde5-a78da7e53118 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 200 len: 1512 microversion: 2.1 time: 0.437317 Sep 17 21:01:28.513213 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1337/2745] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:28 2022] GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 1512 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:28.525093 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-30feab6b-efa1-480d-960e-69b7cfaf93f0 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:28.525999 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-30feab6b-efa1-480d-960e-69b7cfaf93f0 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 7750732c-19bc-4c5a-8637-af3a08c3af5d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:28.532669 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30feab6b-efa1-480d-960e-69b7cfaf93f0 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:28.538196 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30feab6b-efa1-480d-960e-69b7cfaf93f0 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:28.539040 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30feab6b-efa1-480d-960e-69b7cfaf93f0 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:28.540108 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30feab6b-efa1-480d-960e-69b7cfaf93f0 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:28.540659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30feab6b-efa1-480d-960e-69b7cfaf93f0 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:28.543977 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-e8634585-a445-45ae-88b0-a7e9cbf593e1 req-06f07d76-4a42-4765-ab1f-87d5ea7c2cdf service nova] Creating event network-vif-unplugged:c0574c06-40f2-449c-a082-5faa99b18540 for instance 7750732c-19bc-4c5a-8637-af3a08c3af5d on nch2-master-1 Sep 17 21:01:28.545243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30feab6b-efa1-480d-960e-69b7cfaf93f0 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:28.556462 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-e8634585-a445-45ae-88b0-a7e9cbf593e1 req-06f07d76-4a42-4765-ab1f-87d5ea7c2cdf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084566 Sep 17 21:01:28.561191 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1409/2746] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:28.992261 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-39a368c6-a0c2-4ff3-b2f7-a370a8d06110 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:28.993298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-39a368c6-a0c2-4ff3-b2f7-a370a8d06110 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 66779798-999a-4a63-98dd-bf7fa71ce4b1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:29.025338 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39a368c6-a0c2-4ff3-b2f7-a370a8d06110 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:29.025975 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39a368c6-a0c2-4ff3-b2f7-a370a8d06110 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:29.030552 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39a368c6-a0c2-4ff3-b2f7-a370a8d06110 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:29.032035 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39a368c6-a0c2-4ff3-b2f7-a370a8d06110 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:29.032980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39a368c6-a0c2-4ff3-b2f7-a370a8d06110 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:29.034523 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39a368c6-a0c2-4ff3-b2f7-a370a8d06110 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:29.639532 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-30feab6b-efa1-480d-960e-69b7cfaf93f0 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:29.647978 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-30feab6b-efa1-480d-960e-69b7cfaf93f0 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d" status: 200 len: 1526 microversion: 2.1 time: 1.133612 Sep 17 21:01:29.648562 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1338/2747] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:28 2022] GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d => generated 1526 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:29.659682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a5cce7e6-9a87-4765-adeb-270cbe73c48a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:29.660299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a5cce7e6-9a87-4765-adeb-270cbe73c48a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:29.688962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a5cce7e6-9a87-4765-adeb-270cbe73c48a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:29.689485 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a5cce7e6-9a87-4765-adeb-270cbe73c48a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:29.690168 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a5cce7e6-9a87-4765-adeb-270cbe73c48a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:29.690633 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a5cce7e6-9a87-4765-adeb-270cbe73c48a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:29.691086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a5cce7e6-9a87-4765-adeb-270cbe73c48a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:29.691817 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a5cce7e6-9a87-4765-adeb-270cbe73c48a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:29.836794 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-39a368c6-a0c2-4ff3-b2f7-a370a8d06110 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc9559a966444d98e54edb4f948ae1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d42cba2664646f6adb4202574b7fa5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:29.846461 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-39a368c6-a0c2-4ff3-b2f7-a370a8d06110 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1" status: 200 len: 1318 microversion: 2.1 time: 0.863651 Sep 17 21:01:29.851383 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1410/2748] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:28 2022] GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1 => generated 1318 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:29.857331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-ab311370-68d9-4c72-89cb-307460b615c0 req-ea0b47e2-1587-450b-8630-21e419463111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7750732c-19bc-4c5a-8637-af3a08c3af5d", "name": "network-vif-deleted", "tag": "c0574c06-40f2-449c-a082-5faa99b18540"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:29.878549 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-ab311370-68d9-4c72-89cb-307460b615c0 req-ea0b47e2-1587-450b-8630-21e419463111 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:29.879438 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-ab311370-68d9-4c72-89cb-307460b615c0 req-ea0b47e2-1587-450b-8630-21e419463111 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:29.880134 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-ab311370-68d9-4c72-89cb-307460b615c0 req-ea0b47e2-1587-450b-8630-21e419463111 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:29.883880 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:29.895515 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-ab311370-68d9-4c72-89cb-307460b615c0 req-ea0b47e2-1587-450b-8630-21e419463111 service nova] Creating event network-vif-deleted:c0574c06-40f2-449c-a082-5faa99b18540 for instance 7750732c-19bc-4c5a-8637-af3a08c3af5d on nch2-master-1 Sep 17 21:01:29.915907 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-ab311370-68d9-4c72-89cb-307460b615c0 req-ea0b47e2-1587-450b-8630-21e419463111 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062794 Sep 17 21:01:29.932726 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1411/2749] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:29.952851 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ef9cf4f8-9c02-4772-bc3c-670cedba6e9d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:29.953874 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ef9cf4f8-9c02-4772-bc3c-670cedba6e9d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:29.960702 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef9cf4f8-9c02-4772-bc3c-670cedba6e9d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:29.961406 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef9cf4f8-9c02-4772-bc3c-670cedba6e9d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:29.962098 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef9cf4f8-9c02-4772-bc3c-670cedba6e9d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:29.962975 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef9cf4f8-9c02-4772-bc3c-670cedba6e9d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:29.963721 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef9cf4f8-9c02-4772-bc3c-670cedba6e9d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:29.964305 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef9cf4f8-9c02-4772-bc3c-670cedba6e9d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:30.093609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a5cce7e6-9a87-4765-adeb-270cbe73c48a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:30.107460 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a5cce7e6-9a87-4765-adeb-270cbe73c48a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1463 microversion: 2.1 time: 0.455370 Sep 17 21:01:30.112094 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1339/2750] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:29 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1463 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:30.126041 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-22c13f70-179c-4bbd-8637-ac95c976df77 req-0bc48ff9-b8d4-4614-a552-45dc40e88822 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f", "tag": "5273e052-362a-499b-8afd-752c94502a05"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:30.152891 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-22c13f70-179c-4bbd-8637-ac95c976df77 req-0bc48ff9-b8d4-4614-a552-45dc40e88822 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:30.153390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-22c13f70-179c-4bbd-8637-ac95c976df77 req-0bc48ff9-b8d4-4614-a552-45dc40e88822 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:30.153948 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-22c13f70-179c-4bbd-8637-ac95c976df77 req-0bc48ff9-b8d4-4614-a552-45dc40e88822 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:30.170058 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-22c13f70-179c-4bbd-8637-ac95c976df77 req-0bc48ff9-b8d4-4614-a552-45dc40e88822 service nova] Creating event network-changed:5273e052-362a-499b-8afd-752c94502a05 for instance 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f on nch2-master-1 Sep 17 21:01:30.176779 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-22c13f70-179c-4bbd-8637-ac95c976df77 req-0bc48ff9-b8d4-4614-a552-45dc40e88822 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062888 Sep 17 21:01:30.177771 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1340/2751] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:30.191394 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4560fca7-5fb2-4a31-9baf-b5c8056532e0 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:30.195426 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4560fca7-5fb2-4a31-9baf-b5c8056532e0 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:30.202693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4560fca7-5fb2-4a31-9baf-b5c8056532e0 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:30.203467 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4560fca7-5fb2-4a31-9baf-b5c8056532e0 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:30.204125 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4560fca7-5fb2-4a31-9baf-b5c8056532e0 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:30.205028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4560fca7-5fb2-4a31-9baf-b5c8056532e0 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:30.205686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4560fca7-5fb2-4a31-9baf-b5c8056532e0 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:30.206360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4560fca7-5fb2-4a31-9baf-b5c8056532e0 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:30.312630 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4560fca7-5fb2-4a31-9baf-b5c8056532e0 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e/action" status: 202 len: 0 microversion: 2.1 time: 0.132951 Sep 17 21:01:30.313972 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1341/2752] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:01:30 2022] POST /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:01:30.323213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-158883a9-ef97-4fe0-bbbf-7f575d390d7f tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:30.324119 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-158883a9-ef97-4fe0-bbbf-7f575d390d7f tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:30.331439 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-158883a9-ef97-4fe0-bbbf-7f575d390d7f tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:30.332190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-158883a9-ef97-4fe0-bbbf-7f575d390d7f tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:30.332782 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-158883a9-ef97-4fe0-bbbf-7f575d390d7f tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:30.333693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-158883a9-ef97-4fe0-bbbf-7f575d390d7f tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:30.334331 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-158883a9-ef97-4fe0-bbbf-7f575d390d7f tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:30.334963 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-158883a9-ef97-4fe0-bbbf-7f575d390d7f tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:30.381005 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-158883a9-ef97-4fe0-bbbf-7f575d390d7f tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:30.382191 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-158883a9-ef97-4fe0-bbbf-7f575d390d7f tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:30.382814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-158883a9-ef97-4fe0-bbbf-7f575d390d7f tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:30.383422 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-158883a9-ef97-4fe0-bbbf-7f575d390d7f tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lazy-loading 'fault' on Instance uuid 8cbeb946-182e-4489-b637-556194f5722e {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:01:30.785448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ef9cf4f8-9c02-4772-bc3c-670cedba6e9d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:30.797824 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ef9cf4f8-9c02-4772-bc3c-670cedba6e9d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 200 len: 1512 microversion: 2.1 time: 0.857714 Sep 17 21:01:30.812139 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1412/2753] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:29 2022] GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 1512 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:30.812139 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c654154b-27a5-4e06-8082-4e599ce03b3e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1863583363", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "7e34ad5d-40f7-4099-97d8-4a4e3ba019d8", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "dc0ab76b-95f3-4f0a-beab-7465ea19ce7a"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:30.904462 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-158883a9-ef97-4fe0-bbbf-7f575d390d7f tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1597 microversion: 2.1 time: 0.584587 Sep 17 21:01:30.906848 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1342/2754] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:30 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1597 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:30.915525 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bd6e9c6f-08b3-44cf-85d3-fa16e7e5ff54 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:30.922766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bd6e9c6f-08b3-44cf-85d3-fa16e7e5ff54 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 7750732c-19bc-4c5a-8637-af3a08c3af5d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:30.924349 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-c654154b-27a5-4e06-8082-4e599ce03b3e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Block Device 7e34ad5d-40f7-4099-97d8-4a4e3ba019d8 is not bootable. Sep 17 21:01:30.937344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd6e9c6f-08b3-44cf-85d3-fa16e7e5ff54 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:30.938265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd6e9c6f-08b3-44cf-85d3-fa16e7e5ff54 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:30.938950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd6e9c6f-08b3-44cf-85d3-fa16e7e5ff54 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:30.940214 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd6e9c6f-08b3-44cf-85d3-fa16e7e5ff54 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:30.940995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd6e9c6f-08b3-44cf-85d3-fa16e7e5ff54 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:30.941832 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd6e9c6f-08b3-44cf-85d3-fa16e7e5ff54 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c654154b-27a5-4e06-8082-4e599ce03b3e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 358 Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1863583363", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "7e34ad5d-40f7-4099-97d8-4a4e3ba019d8", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "dc0ab76b-95f3-4f0a-beab-7465ea19ce7a"}]}} Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: exception: Block Device 7e34ad5d-40f7-4099-97d8-4a4e3ba019d8 is not bootable. Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1863583363', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '7e34ad5d-40f7-4099-97d8-4a4e3ba019d8'}], 'networks': [{'uuid': 'dc0ab76b-95f3-4f0a-beab-7465ea19ce7a'}]}}} Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 7e34ad5d-40f7-4099-97d8-4a4e3ba019d8 is not bootable. Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:01:30.954829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:01:30.958588 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:01:30.958588 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:01:30.958588 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:01:30.958588 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 17 21:01:30.958588 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 17 21:01:30.958588 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 17 21:01:30.958588 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 7e34ad5d-40f7-4099-97d8-4a4e3ba019d8 is not bootable. Sep 17 21:01:30.958588 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:30.958588 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:30.958588 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:30.958588 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:30.958588 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:30.958588 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:30.958588 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:01:30.958588 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:01:30.958588 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 7e34ad5d-40f7-4099-97d8-4a4e3ba019d8 is not bootable. Sep 17 21:01:30.958588 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:30.958588 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c654154b-27a5-4e06-8082-4e599ce03b3e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 400 to user: Block Device 7e34ad5d-40f7-4099-97d8-4a4e3ba019d8 is not bootable. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:01:30.958588 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c654154b-27a5-4e06-8082-4e599ce03b3e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.156973 Sep 17 21:01:30.958588 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1413/2755] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:01:30 2022] POST /compute/v2.1/servers => generated 110 bytes in 158 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:01:30.965890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-168a19be-0b7c-43fb-9234-51d8675ca1c0 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:30.967622 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-168a19be-0b7c-43fb-9234-51d8675ca1c0 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 66779798-999a-4a63-98dd-bf7fa71ce4b1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:30.982056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-168a19be-0b7c-43fb-9234-51d8675ca1c0 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:30.986989 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-168a19be-0b7c-43fb-9234-51d8675ca1c0 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:30.987525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-168a19be-0b7c-43fb-9234-51d8675ca1c0 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:30.988408 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-bd6e9c6f-08b3-44cf-85d3-fa16e7e5ff54 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] HTTP exception thrown: Instance 7750732c-19bc-4c5a-8637-af3a08c3af5d could not be found. Sep 17 21:01:30.989678 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-168a19be-0b7c-43fb-9234-51d8675ca1c0 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:30.990169 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-168a19be-0b7c-43fb-9234-51d8675ca1c0 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:30.990610 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-168a19be-0b7c-43fb-9234-51d8675ca1c0 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bd6e9c6f-08b3-44cf-85d3-fa16e7e5ff54 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Request method failure captured: Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d HTTP/1.1 Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjVSncfbAtgCIyToozPzw5wAkwJ8A5Pq3oENCAdqUUIYA48iSRlVG7zkjE71pODQ7Vq39Whu62dN5SwPbwvIXMyuqDiapFCgUkVVyC-O5o-Rbhev8SZVJvwjqio0qc_eiz6AU5vzIes11QJweqLBoCqKJfa2-0GqtVV9pkib7fT-OL0 Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 004f77fba4b14080bca4ae36c857add3 Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_004f77fba4b14080bca4ae36c857add3", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 004f77fba4b14080bca4ae36c857add3 Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ImagesOneServerNegativeTestJSON-622753367-project Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 22306a93c9404db393b92a267d6258d4 Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-622753367-project Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 7750732c-19bc-4c5a-8637-af3a08c3af5d could not be found. Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '7750732c-19bc-4c5a-8637-af3a08c3af5d'} Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7750732c-19bc-4c5a-8637-af3a08c3af5d could not be found. Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7750732c-19bc-4c5a-8637-af3a08c3af5d could not be found. Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:30.991284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:30.997075 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:30.997075 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:30.997075 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:30.997075 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:30.997075 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:01:30.997075 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:01:30.997075 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7750732c-19bc-4c5a-8637-af3a08c3af5d could not be found. Sep 17 21:01:30.997075 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:30.999261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bd6e9c6f-08b3-44cf-85d3-fa16e7e5ff54 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Returning 404 to user: Instance 7750732c-19bc-4c5a-8637-af3a08c3af5d could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:01:31.000055 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bd6e9c6f-08b3-44cf-85d3-fa16e7e5ff54 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d" status: 404 len: 111 microversion: 2.1 time: 0.090839 Sep 17 21:01:31.001371 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1343/2756] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:30 2022] GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:01:31.022715 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-14d9d4dd-426f-4945-9df4-05acae38d3d7 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:31.029756 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-14d9d4dd-426f-4945-9df4-05acae38d3d7 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:31.056048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-14d9d4dd-426f-4945-9df4-05acae38d3d7 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:31.058207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-14d9d4dd-426f-4945-9df4-05acae38d3d7 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:31.060154 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-14d9d4dd-426f-4945-9df4-05acae38d3d7 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:31.063323 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-14d9d4dd-426f-4945-9df4-05acae38d3d7 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:31.066152 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-14d9d4dd-426f-4945-9df4-05acae38d3d7 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:31.066702 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-14d9d4dd-426f-4945-9df4-05acae38d3d7 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:31.223742 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-14d9d4dd-426f-4945-9df4-05acae38d3d7 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e/action" status: 202 len: 0 microversion: 2.1 time: 0.218629 Sep 17 21:01:31.224659 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1344/2757] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:01:31 2022] POST /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:01:31.233907 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9a200a71-0675-4ae2-96c5-755d7faf3c97 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:31.234891 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9a200a71-0675-4ae2-96c5-755d7faf3c97 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:31.246514 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9a200a71-0675-4ae2-96c5-755d7faf3c97 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:31.247444 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9a200a71-0675-4ae2-96c5-755d7faf3c97 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:31.248888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9a200a71-0675-4ae2-96c5-755d7faf3c97 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:31.249854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9a200a71-0675-4ae2-96c5-755d7faf3c97 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:31.250483 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9a200a71-0675-4ae2-96c5-755d7faf3c97 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:31.251285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9a200a71-0675-4ae2-96c5-755d7faf3c97 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:31.512598 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:31.540878 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=6 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:31.628189 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-168a19be-0b7c-43fb-9234-51d8675ca1c0 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc9559a966444d98e54edb4f948ae1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d42cba2664646f6adb4202574b7fa5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:31.640124 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-168a19be-0b7c-43fb-9234-51d8675ca1c0 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1" status: 200 len: 1318 microversion: 2.1 time: 0.681352 Sep 17 21:01:31.654896 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1414/2758] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:30 2022] GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1 => generated 1318 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:31.676377 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e8d55637-a8be-4bc9-a007-42816db3fc23 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-595757850", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:31.759999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-e8d55637-a8be-4bc9-a007-42816db3fc23 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] validate_networks() for [('44a79b47-4be7-467a-8a8c-21d428a823c4', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:01:31.910168 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9a200a71-0675-4ae2-96c5-755d7faf3c97 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:31.924032 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9a200a71-0675-4ae2-96c5-755d7faf3c97 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.698100 Sep 17 21:01:31.924637 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1345/2759] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:31 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:31.934266 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b53e93aa-b694-4881-abd3-7944faf48782 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:31.935091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b53e93aa-b694-4881-abd3-7944faf48782 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:31.941616 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b53e93aa-b694-4881-abd3-7944faf48782 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:31.942792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b53e93aa-b694-4881-abd3-7944faf48782 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:31.943245 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b53e93aa-b694-4881-abd3-7944faf48782 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:31.949612 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b53e93aa-b694-4881-abd3-7944faf48782 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:31.950300 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b53e93aa-b694-4881-abd3-7944faf48782 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:31.950936 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b53e93aa-b694-4881-abd3-7944faf48782 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:32.333596 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:32.388984 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b53e93aa-b694-4881-abd3-7944faf48782 tempest-ServersAdminTestJSON-1936914805 tempest-ServersAdminTestJSON-1936914805-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1614 microversion: 2.1 time: 0.463249 Sep 17 21:01:32.394440 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1346/2760] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:31 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1614 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:32.406803 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e2cf1a54-06a7-4c70-92fd-5fd7449e0a25 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:32.407443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e2cf1a54-06a7-4c70-92fd-5fd7449e0a25 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:32.423929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2cf1a54-06a7-4c70-92fd-5fd7449e0a25 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:32.424627 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2cf1a54-06a7-4c70-92fd-5fd7449e0a25 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:32.425217 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2cf1a54-06a7-4c70-92fd-5fd7449e0a25 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:32.426096 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2cf1a54-06a7-4c70-92fd-5fd7449e0a25 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:32.426699 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2cf1a54-06a7-4c70-92fd-5fd7449e0a25 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:32.427292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2cf1a54-06a7-4c70-92fd-5fd7449e0a25 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:32.619261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=8 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:32.850368 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e2cf1a54-06a7-4c70-92fd-5fd7449e0a25 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:32.859619 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e2cf1a54-06a7-4c70-92fd-5fd7449e0a25 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 200 len: 1512 microversion: 2.1 time: 0.461272 Sep 17 21:01:32.860215 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1347/2761] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:32 2022] GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 1512 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:32.878385 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a79c794b-a2f2-43d1-8fc3-61777686fcbc tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:32.879022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a79c794b-a2f2-43d1-8fc3-61777686fcbc tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:32.903566 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a79c794b-a2f2-43d1-8fc3-61777686fcbc tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:32.903837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a79c794b-a2f2-43d1-8fc3-61777686fcbc tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:32.904370 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a79c794b-a2f2-43d1-8fc3-61777686fcbc tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:32.904992 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a79c794b-a2f2-43d1-8fc3-61777686fcbc tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:32.905590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a79c794b-a2f2-43d1-8fc3-61777686fcbc tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:32.905887 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a79c794b-a2f2-43d1-8fc3-61777686fcbc tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:33.612849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-e8d55637-a8be-4bc9-a007-42816db3fc23 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:01:33.613628 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-e8d55637-a8be-4bc9-a007-42816db3fc23 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:01:33.614324 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-e8d55637-a8be-4bc9-a007-42816db3fc23 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:01:33.615570 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-e8d55637-a8be-4bc9-a007-42816db3fc23 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:01:33.616179 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-e8d55637-a8be-4bc9-a007-42816db3fc23 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:01:33.646320 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8d55637-a8be-4bc9-a007-42816db3fc23 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:33.646814 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8d55637-a8be-4bc9-a007-42816db3fc23 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:33.647821 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8d55637-a8be-4bc9-a007-42816db3fc23 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:33.650886 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8d55637-a8be-4bc9-a007-42816db3fc23 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:33.651359 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8d55637-a8be-4bc9-a007-42816db3fc23 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:33.651800 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8d55637-a8be-4bc9-a007-42816db3fc23 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:33.680772 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a79c794b-a2f2-43d1-8fc3-61777686fcbc tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:33.683425 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-e8d55637-a8be-4bc9-a007-42816db3fc23 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Getting quotas for project 004f77fba4b14080bca4ae36c857add3. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:01:33.691990 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-e8d55637-a8be-4bc9-a007-42816db3fc23 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Getting quotas for user 22306a93c9404db393b92a267d6258d4 and project 004f77fba4b14080bca4ae36c857add3. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:01:33.697593 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a79c794b-a2f2-43d1-8fc3-61777686fcbc tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.835233 Sep 17 21:01:33.698826 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1348/2762] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:32 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:33.705223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-e6c21c56-34d4-40d4-9423-25d3476380bc req-0c7cbd93-e6aa-41d9-82bb-b41bf5e46f5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66779798-999a-4a63-98dd-bf7fa71ce4b1", "tag": "4056825c-1c74-40d2-846c-e4886adca6ee"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:33.714614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e8d55637-a8be-4bc9-a007-42816db3fc23 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:01:33.754378 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e8d55637-a8be-4bc9-a007-42816db3fc23 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: e2ed2483-1241-4242-83e3-3345fffcbe30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:01:33.755789 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-e6c21c56-34d4-40d4-9423-25d3476380bc req-0c7cbd93-e6aa-41d9-82bb-b41bf5e46f5f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:33.755789 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-e6c21c56-34d4-40d4-9423-25d3476380bc req-0c7cbd93-e6aa-41d9-82bb-b41bf5e46f5f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:33.755789 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-e6c21c56-34d4-40d4-9423-25d3476380bc req-0c7cbd93-e6aa-41d9-82bb-b41bf5e46f5f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:33.776155 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-e6c21c56-34d4-40d4-9423-25d3476380bc req-0c7cbd93-e6aa-41d9-82bb-b41bf5e46f5f service nova] Creating event network-changed:4056825c-1c74-40d2-846c-e4886adca6ee for instance 66779798-999a-4a63-98dd-bf7fa71ce4b1 on nch1-master-1 Sep 17 21:01:33.788548 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-e6c21c56-34d4-40d4-9423-25d3476380bc req-0c7cbd93-e6aa-41d9-82bb-b41bf5e46f5f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086627 Sep 17 21:01:33.789792 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1349/2763] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:33.803984 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f08b657a-8094-4f67-b3c0-c0cf28dbafcc tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:33.804697 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f08b657a-8094-4f67-b3c0-c0cf28dbafcc tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 40199006-23db-454e-8f31-47dc0532b119] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:33.819412 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f08b657a-8094-4f67-b3c0-c0cf28dbafcc tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:33.819913 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f08b657a-8094-4f67-b3c0-c0cf28dbafcc tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:33.820393 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f08b657a-8094-4f67-b3c0-c0cf28dbafcc tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:33.821186 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f08b657a-8094-4f67-b3c0-c0cf28dbafcc tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:33.822023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f08b657a-8094-4f67-b3c0-c0cf28dbafcc tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:33.822481 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f08b657a-8094-4f67-b3c0-c0cf28dbafcc tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:33.835199 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e8d55637-a8be-4bc9-a007-42816db3fc23 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.178787 Sep 17 21:01:33.835870 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1415/2764] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:01:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 2180 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:01:33.854065 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7648e608-cf45-4c99-b04e-d02ce3bd52d6 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:33.855016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7648e608-cf45-4c99-b04e-d02ce3bd52d6 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 66779798-999a-4a63-98dd-bf7fa71ce4b1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:33.857181 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:33.864859 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7648e608-cf45-4c99-b04e-d02ce3bd52d6 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:33.865614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7648e608-cf45-4c99-b04e-d02ce3bd52d6 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:33.865901 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7648e608-cf45-4c99-b04e-d02ce3bd52d6 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:33.866428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f08b657a-8094-4f67-b3c0-c0cf28dbafcc tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 40199006-23db-454e-8f31-47dc0532b119] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:01:33.866718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7648e608-cf45-4c99-b04e-d02ce3bd52d6 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:33.867181 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7648e608-cf45-4c99-b04e-d02ce3bd52d6 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:33.867653 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7648e608-cf45-4c99-b04e-d02ce3bd52d6 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:34.038717 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f08b657a-8094-4f67-b3c0-c0cf28dbafcc tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "DELETE /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119" status: 204 len: 0 microversion: 2.1 time: 0.247266 Sep 17 21:01:34.040929 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1350/2765] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:01:33 2022] DELETE /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:01:34.237163 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7648e608-cf45-4c99-b04e-d02ce3bd52d6 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc9559a966444d98e54edb4f948ae1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d42cba2664646f6adb4202574b7fa5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:34.248963 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7648e608-cf45-4c99-b04e-d02ce3bd52d6 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1" status: 200 len: 1318 microversion: 2.1 time: 0.405853 Sep 17 21:01:34.249860 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1416/2766] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:33 2022] GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1 => generated 1318 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:34.266054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d64b8940-655b-415f-b770-15e9c12be612 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:34.266614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d64b8940-655b-415f-b770-15e9c12be612 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: e2ed2483-1241-4242-83e3-3345fffcbe30] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:34.394579 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d64b8940-655b-415f-b770-15e9c12be612 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:34.406295 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d64b8940-655b-415f-b770-15e9c12be612 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ed2483-1241-4242-83e3-3345fffcbe30" status: 200 len: 1224 microversion: 2.1 time: 0.151271 Sep 17 21:01:34.409722 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1417/2767] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:34 2022] GET /compute/v2.1/servers/e2ed2483-1241-4242-83e3-3345fffcbe30 => generated 1224 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:34.420772 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-349b3ef7-a71a-40ff-9c9e-674c839accae tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:34.432248 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-349b3ef7-a71a-40ff-9c9e-674c839accae tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:34.453186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-349b3ef7-a71a-40ff-9c9e-674c839accae tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:34.458944 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-349b3ef7-a71a-40ff-9c9e-674c839accae tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:34.459527 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-349b3ef7-a71a-40ff-9c9e-674c839accae tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:34.460305 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-349b3ef7-a71a-40ff-9c9e-674c839accae tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:34.460792 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-349b3ef7-a71a-40ff-9c9e-674c839accae tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:34.461238 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-349b3ef7-a71a-40ff-9c9e-674c839accae tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:34.675739 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-321b236f-4625-43fd-9f5e-fe82611075c2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'create', calling method: .version_select at 0x7f25a48091f0>, body: {"keypair": {"name": "tempest-keypair-1659946339", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoQOxuBnI9AemiIQU+CHC5SzZ7V5GKgKjWUTwUM9Mz10pP+x5gVjW/bimZLucXmcFcBYIrkKlxHjso+DWtqO9o+bOi/GamEi+W70Lv4gnO4l69frR7idUEFbzrSQ1Jqwg=="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:34.700407 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-349b3ef7-a71a-40ff-9c9e-674c839accae tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:34.711630 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-349b3ef7-a71a-40ff-9c9e-674c839accae tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 200 len: 1489 microversion: 2.1 time: 0.297047 Sep 17 21:01:34.714235 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1418/2768] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:34 2022] GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 1489 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:34.728189 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-321b236f-4625-43fd-9f5e-fe82611075c2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Getting quotas for project 3e48e3c2f7f74636a75679fdf10ef33a. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:01:34.731278 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0533a254-0127-4fd4-9e58-11e8c0ce827d tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:34.732084 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0533a254-0127-4fd4-9e58-11e8c0ce827d tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 40199006-23db-454e-8f31-47dc0532b119] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:34.740856 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0533a254-0127-4fd4-9e58-11e8c0ce827d tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:34.741677 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0533a254-0127-4fd4-9e58-11e8c0ce827d tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:34.743010 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0533a254-0127-4fd4-9e58-11e8c0ce827d tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:34.743994 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-321b236f-4625-43fd-9f5e-fe82611075c2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Getting quotas for user 2ef547e071fd43ec96c745c26eca119f and project 3e48e3c2f7f74636a75679fdf10ef33a. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:01:34.744633 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0533a254-0127-4fd4-9e58-11e8c0ce827d tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:34.745572 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0533a254-0127-4fd4-9e58-11e8c0ce827d tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:34.747450 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0533a254-0127-4fd4-9e58-11e8c0ce827d tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:34.793865 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-321b236f-4625-43fd-9f5e-fe82611075c2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.748821 Sep 17 21:01:34.793865 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1351/2769] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:01:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:34.820706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0a3cd3c5-e64f-44c7-9666-21c071006db0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:34.821986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0a3cd3c5-e64f-44c7-9666-21c071006db0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:34.840747 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0a3cd3c5-e64f-44c7-9666-21c071006db0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:34.843309 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0a3cd3c5-e64f-44c7-9666-21c071006db0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:34.843938 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0a3cd3c5-e64f-44c7-9666-21c071006db0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:34.846592 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0a3cd3c5-e64f-44c7-9666-21c071006db0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:34.848291 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0a3cd3c5-e64f-44c7-9666-21c071006db0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:34.850131 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0a3cd3c5-e64f-44c7-9666-21c071006db0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:34.932209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0a3cd3c5-e64f-44c7-9666-21c071006db0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:01:34.986927 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0533a254-0127-4fd4-9e58-11e8c0ce827d tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:35.006426 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0533a254-0127-4fd4-9e58-11e8c0ce827d tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119" status: 200 len: 1469 microversion: 2.1 time: 0.290837 Sep 17 21:01:35.011864 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1419/2770] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:34 2022] GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119 => generated 1469 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:35.171072 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0a3cd3c5-e64f-44c7-9666-21c071006db0 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 204 len: 0 microversion: 2.1 time: 0.375052 Sep 17 21:01:35.190320 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1352/2771] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:01:34 2022] DELETE /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:01:35.206090 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e1403ff2-9001-47aa-a835-3980147202e4 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:35.210029 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e1403ff2-9001-47aa-a835-3980147202e4 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:35.222942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1403ff2-9001-47aa-a835-3980147202e4 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:35.228298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1403ff2-9001-47aa-a835-3980147202e4 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:35.228979 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1403ff2-9001-47aa-a835-3980147202e4 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:35.230266 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1403ff2-9001-47aa-a835-3980147202e4 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:35.230890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1403ff2-9001-47aa-a835-3980147202e4 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:35.231495 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1403ff2-9001-47aa-a835-3980147202e4 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:35.275087 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0e3bf408-fd57-4846-b224-1d1d4d19ab49 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:35.276357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0e3bf408-fd57-4846-b224-1d1d4d19ab49 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 66779798-999a-4a63-98dd-bf7fa71ce4b1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:35.289968 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e3bf408-fd57-4846-b224-1d1d4d19ab49 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:35.293064 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e3bf408-fd57-4846-b224-1d1d4d19ab49 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:35.294280 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e3bf408-fd57-4846-b224-1d1d4d19ab49 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:35.297716 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e3bf408-fd57-4846-b224-1d1d4d19ab49 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:35.299275 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e3bf408-fd57-4846-b224-1d1d4d19ab49 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:35.300669 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e3bf408-fd57-4846-b224-1d1d4d19ab49 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:35.540865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e1403ff2-9001-47aa-a835-3980147202e4 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:35.555302 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e1403ff2-9001-47aa-a835-3980147202e4 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 200 len: 1495 microversion: 2.1 time: 0.356584 Sep 17 21:01:35.558273 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1420/2772] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:35 2022] GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 1495 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:35.568918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e57f488c-97a4-460a-9796-317371f5eb83 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:35.571412 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e57f488c-97a4-460a-9796-317371f5eb83 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: e2ed2483-1241-4242-83e3-3345fffcbe30] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:35.590818 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e57f488c-97a4-460a-9796-317371f5eb83 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:35.593489 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e57f488c-97a4-460a-9796-317371f5eb83 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:35.593942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e57f488c-97a4-460a-9796-317371f5eb83 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:35.594681 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e57f488c-97a4-460a-9796-317371f5eb83 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:35.598294 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e57f488c-97a4-460a-9796-317371f5eb83 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:35.598760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e57f488c-97a4-460a-9796-317371f5eb83 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:35.833719 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0e3bf408-fd57-4846-b224-1d1d4d19ab49 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc9559a966444d98e54edb4f948ae1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d42cba2664646f6adb4202574b7fa5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:35.848231 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0e3bf408-fd57-4846-b224-1d1d4d19ab49 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1" status: 200 len: 1318 microversion: 2.1 time: 0.578300 Sep 17 21:01:35.849345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e57f488c-97a4-460a-9796-317371f5eb83 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:35.850372 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1353/2773] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:35 2022] GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1 => generated 1318 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:35.855196 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-29854368-9be0-40a8-9c7b-8848a97e9570 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-782687104", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "destination_type": "local"}, {"source_type": "volume", "uuid": "cca364ab-72d2-4b09-8ddb-85f1ec1d6b4f", "destination_type": "invalid"}], "networks": [{"uuid": "dc0ab76b-95f3-4f0a-beab-7465ea19ce7a"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-29854368-9be0-40a8-9c7b-8848a97e9570 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 494 Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-782687104", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "destination_type": "local"}, {"source_type": "volume", "uuid": "cca364ab-72d2-4b09-8ddb-85f1ec1d6b4f", "destination_type": "invalid"}], "networks": [{"uuid": "dc0ab76b-95f3-4f0a-beab-7465ea19ce7a"}]}} Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-782687104', 'imageRef': '1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'cca364ab-72d2-4b09-8ddb-85f1ec1d6b4f', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'dc0ab76b-95f3-4f0a-beab-7465ea19ce7a'}]}}} Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise error Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi 'invalid' Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:01:35.859745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:01:35.865422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:01:35.865422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:01:35.865422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 21:01:35.865422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 21:01:35.865422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 21:01:35.865422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 21:01:35.865422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 21:01:35.865422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 21:01:35.865422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 17 21:01:35.865422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:35.865422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:35.865422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:35.865422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:35.865422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:35.865422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:35.865422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 21:01:35.865422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 21:01:35.865422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 17 21:01:35.865422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:35.865422 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-29854368-9be0-40a8-9c7b-8848a97e9570 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:01:35.873478 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e57f488c-97a4-460a-9796-317371f5eb83 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ed2483-1241-4242-83e3-3345fffcbe30" status: 200 len: 1220 microversion: 2.1 time: 0.313550 Sep 17 21:01:35.879821 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1421/2774] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:35 2022] GET /compute/v2.1/servers/e2ed2483-1241-4242-83e3-3345fffcbe30 => generated 1220 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:35.887538 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-29854368-9be0-40a8-9c7b-8848a97e9570 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.031819 Sep 17 21:01:35.888435 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1354/2775] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:01:35 2022] POST /compute/v2.1/servers => generated 155 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:01:35.902917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f7923028-4064-43a5-964c-443a1516b61d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:35.904083 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f7923028-4064-43a5-964c-443a1516b61d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:35.919379 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7923028-4064-43a5-964c-443a1516b61d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:35.920235 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7923028-4064-43a5-964c-443a1516b61d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:35.921141 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7923028-4064-43a5-964c-443a1516b61d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:35.922142 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7923028-4064-43a5-964c-443a1516b61d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:35.922932 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7923028-4064-43a5-964c-443a1516b61d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:35.923536 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7923028-4064-43a5-964c-443a1516b61d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:36.036934 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-35f03379-dcba-433c-9bb4-001358898e2d tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:36.037960 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-35f03379-dcba-433c-9bb4-001358898e2d tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 40199006-23db-454e-8f31-47dc0532b119] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:36.048113 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=94,nova_api:UPDATE=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:36.053090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35f03379-dcba-433c-9bb4-001358898e2d tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:36.053664 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35f03379-dcba-433c-9bb4-001358898e2d tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:36.055643 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35f03379-dcba-433c-9bb4-001358898e2d tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:36.056561 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35f03379-dcba-433c-9bb4-001358898e2d tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:36.058072 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35f03379-dcba-433c-9bb4-001358898e2d tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:36.060834 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35f03379-dcba-433c-9bb4-001358898e2d tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:36.565889 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f7923028-4064-43a5-964c-443a1516b61d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:36.575760 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f7923028-4064-43a5-964c-443a1516b61d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.680310 Sep 17 21:01:36.596059 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1422/2776] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:35 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:36.618138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2888f158-2c3f-4c81-9d03-d91a4dd986a3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:36.619094 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2888f158-2c3f-4c81-9d03-d91a4dd986a3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:36.638623 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2888f158-2c3f-4c81-9d03-d91a4dd986a3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:36.640313 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2888f158-2c3f-4c81-9d03-d91a4dd986a3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:36.643059 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2888f158-2c3f-4c81-9d03-d91a4dd986a3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:36.644088 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2888f158-2c3f-4c81-9d03-d91a4dd986a3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:36.646254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2888f158-2c3f-4c81-9d03-d91a4dd986a3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:36.647360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2888f158-2c3f-4c81-9d03-d91a4dd986a3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:36.761174 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-35f03379-dcba-433c-9bb4-001358898e2d tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:36.780900 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-35f03379-dcba-433c-9bb4-001358898e2d tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119" status: 200 len: 1469 microversion: 2.1 time: 0.747899 Sep 17 21:01:36.791679 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1355/2777] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:36 2022] GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119 => generated 1469 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:01:36.805260 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-80e2d084-e212-4d7b-ad23-44101f08c0b3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:36.807557 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-80e2d084-e212-4d7b-ad23-44101f08c0b3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:36.824076 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-80e2d084-e212-4d7b-ad23-44101f08c0b3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:36.826679 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-80e2d084-e212-4d7b-ad23-44101f08c0b3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:36.827364 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-80e2d084-e212-4d7b-ad23-44101f08c0b3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:36.830030 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-80e2d084-e212-4d7b-ad23-44101f08c0b3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:36.832752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-80e2d084-e212-4d7b-ad23-44101f08c0b3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:36.834412 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-80e2d084-e212-4d7b-ad23-44101f08c0b3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:37.388963 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-80e2d084-e212-4d7b-ad23-44101f08c0b3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:37.406980 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-80e2d084-e212-4d7b-ad23-44101f08c0b3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.612363 Sep 17 21:01:37.408115 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1356/2778] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:36 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:37.421400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-89251b45-3b7e-4fb3-b0f4-4576e6736a38 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:37.425416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-89251b45-3b7e-4fb3-b0f4-4576e6736a38 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 66779798-999a-4a63-98dd-bf7fa71ce4b1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:37.465318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89251b45-3b7e-4fb3-b0f4-4576e6736a38 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:37.474839 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89251b45-3b7e-4fb3-b0f4-4576e6736a38 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:37.477592 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89251b45-3b7e-4fb3-b0f4-4576e6736a38 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:37.478950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89251b45-3b7e-4fb3-b0f4-4576e6736a38 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:37.479666 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89251b45-3b7e-4fb3-b0f4-4576e6736a38 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:37.481321 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89251b45-3b7e-4fb3-b0f4-4576e6736a38 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:37.560508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2888f158-2c3f-4c81-9d03-d91a4dd986a3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:37.571506 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2888f158-2c3f-4c81-9d03-d91a4dd986a3 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 200 len: 1495 microversion: 2.1 time: 0.974136 Sep 17 21:01:37.574209 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1423/2779] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:36 2022] GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 1495 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:37.588116 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8b115d18-8693-4ff9-873a-ffe1055dacf0 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:37.589047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8b115d18-8693-4ff9-873a-ffe1055dacf0 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: e2ed2483-1241-4242-83e3-3345fffcbe30] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:37.601903 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8b115d18-8693-4ff9-873a-ffe1055dacf0 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:37.603436 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8b115d18-8693-4ff9-873a-ffe1055dacf0 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:37.606977 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8b115d18-8693-4ff9-873a-ffe1055dacf0 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:37.608046 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8b115d18-8693-4ff9-873a-ffe1055dacf0 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:37.608741 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8b115d18-8693-4ff9-873a-ffe1055dacf0 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:37.609727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8b115d18-8693-4ff9-873a-ffe1055dacf0 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:38.127331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8b115d18-8693-4ff9-873a-ffe1055dacf0 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:38.139212 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8b115d18-8693-4ff9-873a-ffe1055dacf0 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ed2483-1241-4242-83e3-3345fffcbe30" status: 200 len: 1282 microversion: 2.1 time: 0.562548 Sep 17 21:01:38.139820 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1424/2780] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:37 2022] GET /compute/v2.1/servers/e2ed2483-1241-4242-83e3-3345fffcbe30 => generated 1282 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:38.163470 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-369a05fb-f7af-4774-9675-7f75a7fa0d27 req-4673b852-2bb1-4997-8185-e0643feeea68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f", "name": "network-vif-plugged", "status": "completed", "tag": "5273e052-362a-499b-8afd-752c94502a05"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:38.188182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-369a05fb-f7af-4774-9675-7f75a7fa0d27 req-4673b852-2bb1-4997-8185-e0643feeea68 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:38.188671 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-369a05fb-f7af-4774-9675-7f75a7fa0d27 req-4673b852-2bb1-4997-8185-e0643feeea68 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:38.189112 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-369a05fb-f7af-4774-9675-7f75a7fa0d27 req-4673b852-2bb1-4997-8185-e0643feeea68 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:38.213563 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-369a05fb-f7af-4774-9675-7f75a7fa0d27 req-4673b852-2bb1-4997-8185-e0643feeea68 service nova] Creating event network-vif-plugged:5273e052-362a-499b-8afd-752c94502a05 for instance 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f on nch2-master-1 Sep 17 21:01:38.228097 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-369a05fb-f7af-4774-9675-7f75a7fa0d27 req-4673b852-2bb1-4997-8185-e0643feeea68 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086974 Sep 17 21:01:38.229049 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1425/2781] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:38.234913 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-0ca690cb-f2f4-494b-b4bd-a77b9bd92256 req-fa51d19a-2598-4492-a25f-0bfc872589e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40199006-23db-454e-8f31-47dc0532b119", "name": "network-vif-deleted", "tag": "5ffd676b-d079-4fa9-b950-637c46640d96"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:38.255349 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-0ca690cb-f2f4-494b-b4bd-a77b9bd92256 req-fa51d19a-2598-4492-a25f-0bfc872589e3 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:38.255850 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-0ca690cb-f2f4-494b-b4bd-a77b9bd92256 req-fa51d19a-2598-4492-a25f-0bfc872589e3 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:38.256284 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-0ca690cb-f2f4-494b-b4bd-a77b9bd92256 req-fa51d19a-2598-4492-a25f-0bfc872589e3 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:38.283669 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-0ca690cb-f2f4-494b-b4bd-a77b9bd92256 req-fa51d19a-2598-4492-a25f-0bfc872589e3 service nova] Creating event network-vif-deleted:5ffd676b-d079-4fa9-b950-637c46640d96 for instance 40199006-23db-454e-8f31-47dc0532b119 on nch1-master-1 Sep 17 21:01:38.299669 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-0ca690cb-f2f4-494b-b4bd-a77b9bd92256 req-fa51d19a-2598-4492-a25f-0bfc872589e3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068624 Sep 17 21:01:38.300617 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1426/2782] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:38.306177 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-659ea23f-7956-4674-9729-e3d2f6ea6437 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "25a02b63-f7d3-40d4-8373-cc437ceef99e"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:38.315691 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-659ea23f-7956-4674-9729-e3d2f6ea6437 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:38.332094 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-659ea23f-7956-4674-9729-e3d2f6ea6437 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:38.332623 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-659ea23f-7956-4674-9729-e3d2f6ea6437 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:38.333082 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-659ea23f-7956-4674-9729-e3d2f6ea6437 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:38.333861 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-659ea23f-7956-4674-9729-e3d2f6ea6437 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:38.334502 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-659ea23f-7956-4674-9729-e3d2f6ea6437 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:38.336089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-659ea23f-7956-4674-9729-e3d2f6ea6437 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:38.638529 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-89251b45-3b7e-4fb3-b0f4-4576e6736a38 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc9559a966444d98e54edb4f948ae1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d42cba2664646f6adb4202574b7fa5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:38.652069 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-89251b45-3b7e-4fb3-b0f4-4576e6736a38 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1" status: 200 len: 1318 microversion: 2.1 time: 1.242630 Sep 17 21:01:38.659834 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1357/2783] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:37 2022] GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1 => generated 1318 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:38.675260 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-659ea23f-7956-4674-9729-e3d2f6ea6437 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "POST /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.370962 Sep 17 21:01:38.675260 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1427/2784] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 17 21:01:38 2022] POST /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297/os-volume_attachments => generated 194 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:38.682480 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-865ca10e-fb1d-427d-a868-36fde1f2bf72 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1969510410", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "dc0ab76b-95f3-4f0a-beab-7465ea19ce7a"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:38.682712 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9da645cb-5892-4996-9d34-2dfe74c19e74 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:38.683641 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9da645cb-5892-4996-9d34-2dfe74c19e74 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 40199006-23db-454e-8f31-47dc0532b119] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-865ca10e-fb1d-427d-a868-36fde1f2bf72 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 492 Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1969510410", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "dc0ab76b-95f3-4f0a-beab-7465ea19ce7a"}]}} Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1969510410', 'imageRef': '1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'dc0ab76b-95f3-4f0a-beab-7465ea19ce7a'}]}}} Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise error Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:38.702653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Sep 17 21:01:38.706639 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Sep 17 21:01:38.706639 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:38.706639 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:38.706639 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:38.706639 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:38.706639 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:38.706639 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:38.706639 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:01:38.706639 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:01:38.706639 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:01:38.706639 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:01:38.706639 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:01:38.706639 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:01:38.706639 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 21:01:38.706639 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 21:01:38.706639 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 21:01:38.706639 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 21:01:38.706639 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 21:01:38.706639 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 21:01:38.706639 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 17 21:01:38.706639 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:38.706639 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:38.706639 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:38.706639 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:38.706639 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:38.706639 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:38.706639 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 21:01:38.706639 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 21:01:38.706639 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 17 21:01:38.706639 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:38.706639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-865ca10e-fb1d-427d-a868-36fde1f2bf72 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:01:38.706639 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-865ca10e-fb1d-427d-a868-36fde1f2bf72 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.038566 Sep 17 21:01:38.706639 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1358/2785] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:01:38 2022] POST /compute/v2.1/servers => generated 624 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:01:38.722511 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9da645cb-5892-4996-9d34-2dfe74c19e74 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:38.722713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-75708b15-c7da-4648-a48b-4ea73f39aedf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:38.725638 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9da645cb-5892-4996-9d34-2dfe74c19e74 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:38.726339 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9da645cb-5892-4996-9d34-2dfe74c19e74 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:38.727299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-75708b15-c7da-4648-a48b-4ea73f39aedf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:38.730221 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9da645cb-5892-4996-9d34-2dfe74c19e74 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:38.731466 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9da645cb-5892-4996-9d34-2dfe74c19e74 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:38.733107 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9da645cb-5892-4996-9d34-2dfe74c19e74 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:38.758769 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75708b15-c7da-4648-a48b-4ea73f39aedf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:38.759368 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75708b15-c7da-4648-a48b-4ea73f39aedf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:38.759820 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75708b15-c7da-4648-a48b-4ea73f39aedf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:38.760884 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75708b15-c7da-4648-a48b-4ea73f39aedf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:38.761348 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75708b15-c7da-4648-a48b-4ea73f39aedf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:38.761809 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75708b15-c7da-4648-a48b-4ea73f39aedf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:38.771951 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-9da645cb-5892-4996-9d34-2dfe74c19e74 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] HTTP exception thrown: Instance 40199006-23db-454e-8f31-47dc0532b119 could not be found. Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9da645cb-5892-4996-9d34-2dfe74c19e74 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Request method failure captured: Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119 HTTP/1.1 Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjUZCcfqWYQHjeu0EoKgBCtDWrCfo8uQ_TiE9mGv0sk76_eAsFjjzkwhVlzRs8RNjGK925n3-XSkuzNq7reJIA0_tJTccmw-0VCxFcV2wp1Vfo6dUWaNyLxeBa3ok0b3mLImUT2vR0g0z1jqHjL-UKSqtwkz0BcygSuLNEFkd37E12U Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: a0c2cdfddf5b4d35a0ca3c7554271365 Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersAdminTestJSON-871444303 Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a0c2cdfddf5b4d35a0ca3c7554271365"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a0c2cdfddf5b4d35a0ca3c7554271365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a0c2cdfddf5b4d35a0ca3c7554271365"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a0c2cdfddf5b4d35a0ca3c7554271365", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersAdminTestJSON-871444303 Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: a0c2cdfddf5b4d35a0ca3c7554271365 Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersAdminTestJSON-871444303 Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersAdminTestJSON-871444303-project Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 1fff4805e6fb45a0b7c8b4dc08c4dedb Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersAdminTestJSON-871444303-project Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 40199006-23db-454e-8f31-47dc0532b119 could not be found. Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '40199006-23db-454e-8f31-47dc0532b119'} Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40199006-23db-454e-8f31-47dc0532b119 could not be found. Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40199006-23db-454e-8f31-47dc0532b119 could not be found. Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:38.777180 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:38.782212 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:38.782212 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:38.782212 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:38.782212 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:01:38.782212 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:01:38.782212 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40199006-23db-454e-8f31-47dc0532b119 could not be found. Sep 17 21:01:38.782212 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:38.785170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9da645cb-5892-4996-9d34-2dfe74c19e74 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Returning 404 to user: Instance 40199006-23db-454e-8f31-47dc0532b119 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:01:38.790342 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9da645cb-5892-4996-9d34-2dfe74c19e74 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119" status: 404 len: 111 microversion: 2.1 time: 0.114362 Sep 17 21:01:38.797881 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1428/2786] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:38 2022] GET /compute/v2.1/servers/40199006-23db-454e-8f31-47dc0532b119 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:01:38.808064 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-271af3be-bb27-45e1-8d30-b874918e4b20 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:38.813422 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-271af3be-bb27-45e1-8d30-b874918e4b20 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:38.827587 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-271af3be-bb27-45e1-8d30-b874918e4b20 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:38.828441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-271af3be-bb27-45e1-8d30-b874918e4b20 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:38.829047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-271af3be-bb27-45e1-8d30-b874918e4b20 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:38.829966 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-271af3be-bb27-45e1-8d30-b874918e4b20 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:38.830575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-271af3be-bb27-45e1-8d30-b874918e4b20 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:38.831768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-271af3be-bb27-45e1-8d30-b874918e4b20 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:39.338052 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-271af3be-bb27-45e1-8d30-b874918e4b20 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:39.347117 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-271af3be-bb27-45e1-8d30-b874918e4b20 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.547268 Sep 17 21:01:39.356527 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1429/2787] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:38 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:39.366242 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7100b0c1-9a8a-4d08-9453-32ef8f769ea0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:39.366762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7100b0c1-9a8a-4d08-9453-32ef8f769ea0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 67aeba5b-d1f8-4487-be79-97da63c34fc5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:39.381546 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7100b0c1-9a8a-4d08-9453-32ef8f769ea0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:39.382297 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7100b0c1-9a8a-4d08-9453-32ef8f769ea0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:39.382745 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7100b0c1-9a8a-4d08-9453-32ef8f769ea0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:39.383509 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7100b0c1-9a8a-4d08-9453-32ef8f769ea0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:39.384028 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7100b0c1-9a8a-4d08-9453-32ef8f769ea0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:39.384458 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7100b0c1-9a8a-4d08-9453-32ef8f769ea0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:39.441799 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7100b0c1-9a8a-4d08-9453-32ef8f769ea0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 67aeba5b-d1f8-4487-be79-97da63c34fc5] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:01:39.509018 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-75708b15-c7da-4648-a48b-4ea73f39aedf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:39.540144 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-75708b15-c7da-4648-a48b-4ea73f39aedf tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 200 len: 1495 microversion: 2.1 time: 0.824414 Sep 17 21:01:39.543261 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1359/2788] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:38 2022] GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 1495 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:39.550285 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:39.555242 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7744fd56-2adc-4957-bb86-2ad3bd9efeb8 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:39.575039 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7744fd56-2adc-4957-bb86-2ad3bd9efeb8 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: e2ed2483-1241-4242-83e3-3345fffcbe30] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:39.596635 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7744fd56-2adc-4957-bb86-2ad3bd9efeb8 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:39.597809 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7744fd56-2adc-4957-bb86-2ad3bd9efeb8 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:39.598486 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7744fd56-2adc-4957-bb86-2ad3bd9efeb8 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:39.599510 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7744fd56-2adc-4957-bb86-2ad3bd9efeb8 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:39.600152 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7744fd56-2adc-4957-bb86-2ad3bd9efeb8 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:39.600768 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7744fd56-2adc-4957-bb86-2ad3bd9efeb8 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:39.669445 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:39.699995 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7100b0c1-9a8a-4d08-9453-32ef8f769ea0 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "DELETE /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5" status: 204 len: 0 microversion: 2.1 time: 0.340862 Sep 17 21:01:39.703146 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1430/2789] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:01:39 2022] DELETE /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:01:39.712438 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b5a69bb4-cd2b-4cfb-8bfa-d84e7c047641 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:39.716178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b5a69bb4-cd2b-4cfb-8bfa-d84e7c047641 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:39.733749 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b5a69bb4-cd2b-4cfb-8bfa-d84e7c047641 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:39.734582 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b5a69bb4-cd2b-4cfb-8bfa-d84e7c047641 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:39.738136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b5a69bb4-cd2b-4cfb-8bfa-d84e7c047641 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:39.739180 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b5a69bb4-cd2b-4cfb-8bfa-d84e7c047641 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:39.739817 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b5a69bb4-cd2b-4cfb-8bfa-d84e7c047641 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:39.741219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b5a69bb4-cd2b-4cfb-8bfa-d84e7c047641 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:40.062907 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7744fd56-2adc-4957-bb86-2ad3bd9efeb8 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:40.071817 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7744fd56-2adc-4957-bb86-2ad3bd9efeb8 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ed2483-1241-4242-83e3-3345fffcbe30" status: 200 len: 1324 microversion: 2.1 time: 0.525112 Sep 17 21:01:40.082853 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1360/2790] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:39 2022] GET /compute/v2.1/servers/e2ed2483-1241-4242-83e3-3345fffcbe30 => generated 1324 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:40.088041 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-f5577dd8-0989-421c-bf4d-5a35e1173736 req-4c315000-7015-4897-b817-fdf76a726524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b37a20c2-7329-4a0e-8b31-d0a7c39344b3", "name": "network-vif-deleted", "tag": "2c69be81-79b1-494f-8f9b-4d4b69580fb8"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:40.099030 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f5577dd8-0989-421c-bf4d-5a35e1173736 req-4c315000-7015-4897-b817-fdf76a726524 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:40.099771 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f5577dd8-0989-421c-bf4d-5a35e1173736 req-4c315000-7015-4897-b817-fdf76a726524 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:40.100446 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f5577dd8-0989-421c-bf4d-5a35e1173736 req-4c315000-7015-4897-b817-fdf76a726524 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:40.119247 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-f5577dd8-0989-421c-bf4d-5a35e1173736 req-4c315000-7015-4897-b817-fdf76a726524 service nova] Creating event network-vif-deleted:2c69be81-79b1-494f-8f9b-4d4b69580fb8 for instance b37a20c2-7329-4a0e-8b31-d0a7c39344b3 on nch2-master-1 Sep 17 21:01:40.140230 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-f5577dd8-0989-421c-bf4d-5a35e1173736 req-4c315000-7015-4897-b817-fdf76a726524 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055693 Sep 17 21:01:40.141567 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1361/2791] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:40.155473 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4753fdf7-fa93-4504-b728-251e9f926cb9 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:40.156464 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4753fdf7-fa93-4504-b728-251e9f926cb9 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 66779798-999a-4a63-98dd-bf7fa71ce4b1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:40.169396 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4753fdf7-fa93-4504-b728-251e9f926cb9 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:40.170197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4753fdf7-fa93-4504-b728-251e9f926cb9 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:40.170794 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4753fdf7-fa93-4504-b728-251e9f926cb9 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:40.171665 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4753fdf7-fa93-4504-b728-251e9f926cb9 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:40.172275 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4753fdf7-fa93-4504-b728-251e9f926cb9 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:40.172867 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4753fdf7-fa93-4504-b728-251e9f926cb9 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:40.226164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b5a69bb4-cd2b-4cfb-8bfa-d84e7c047641 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:40.237102 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b5a69bb4-cd2b-4cfb-8bfa-d84e7c047641 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.532320 Sep 17 21:01:40.238227 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1431/2792] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:39 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:40.269996 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a6094969-066f-4f5d-ac66-88ca1bd6c523 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:40.271675 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a6094969-066f-4f5d-ac66-88ca1bd6c523 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 67aeba5b-d1f8-4487-be79-97da63c34fc5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:40.290422 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6094969-066f-4f5d-ac66-88ca1bd6c523 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:40.291302 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6094969-066f-4f5d-ac66-88ca1bd6c523 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:40.291985 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6094969-066f-4f5d-ac66-88ca1bd6c523 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:40.293901 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6094969-066f-4f5d-ac66-88ca1bd6c523 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:40.294767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6094969-066f-4f5d-ac66-88ca1bd6c523 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:40.295406 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6094969-066f-4f5d-ac66-88ca1bd6c523 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:41.185956 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4753fdf7-fa93-4504-b728-251e9f926cb9 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc9559a966444d98e54edb4f948ae1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d42cba2664646f6adb4202574b7fa5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:41.198098 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4753fdf7-fa93-4504-b728-251e9f926cb9 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1" status: 200 len: 1318 microversion: 2.1 time: 1.054507 Sep 17 21:01:41.199009 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1362/2793] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:40 2022] GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1 => generated 1318 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:41.204131 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-23c50c0f-6b96-4809-a658-6e43b82ec599 req-139c6ea1-6b8d-4537-8003-ea6f63ccfde0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66779798-999a-4a63-98dd-bf7fa71ce4b1", "name": "network-vif-plugged", "status": "completed", "tag": "4056825c-1c74-40d2-846c-e4886adca6ee"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:41.215559 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-23c50c0f-6b96-4809-a658-6e43b82ec599 req-139c6ea1-6b8d-4537-8003-ea6f63ccfde0 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:41.216469 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-23c50c0f-6b96-4809-a658-6e43b82ec599 req-139c6ea1-6b8d-4537-8003-ea6f63ccfde0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:41.217342 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-23c50c0f-6b96-4809-a658-6e43b82ec599 req-139c6ea1-6b8d-4537-8003-ea6f63ccfde0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:41.226809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a6094969-066f-4f5d-ac66-88ca1bd6c523 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:41.235496 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a6094969-066f-4f5d-ac66-88ca1bd6c523 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5" status: 200 len: 1469 microversion: 2.1 time: 0.981014 Sep 17 21:01:41.238604 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1432/2794] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:40 2022] GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5 => generated 1469 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:41.244001 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1d496671-51ac-4577-9c94-369c989e123c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "dc0ab76b-95f3-4f0a-beab-7465ea19ce7a"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1d496671-51ac-4577-9c94-369c989e123c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 416 Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "dc0ab76b-95f3-4f0a-beab-7465ea19ce7a"}]}} Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4', 'flavorRef': '452', 'networks': [{'uuid': 'dc0ab76b-95f3-4f0a-beab-7465ea19ce7a'}]}}} Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise error Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:41.248365 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:41.252295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:41.252295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:41.252295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:41.252295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:41.252295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:01:41.252295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:01:41.252295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:01:41.252295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:01:41.252295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:01:41.252295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:01:41.252295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 21:01:41.252295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 21:01:41.252295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 21:01:41.252295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 21:01:41.252295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 21:01:41.252295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 21:01:41.252295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 17 21:01:41.252295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:41.252295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:41.252295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:41.252295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:41.252295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:41.252295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:41.252295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 21:01:41.252295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 21:01:41.252295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 17 21:01:41.252295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:41.252295 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1d496671-51ac-4577-9c94-369c989e123c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:01:41.256064 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1d496671-51ac-4577-9c94-369c989e123c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.012804 Sep 17 21:01:41.258654 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1433/2795] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:01:41 2022] POST /compute/v2.1/servers => generated 619 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:01:41.264608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-cdad0dd8-b59d-4562-ba0c-1b814609280b req-144cfebd-5a1d-4147-b884-53c29f689d5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2ed2483-1241-4242-83e3-3345fffcbe30", "tag": "8dc19aab-491e-4cba-9e9b-1f02d19a112b"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:41.264911 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-23c50c0f-6b96-4809-a658-6e43b82ec599 req-139c6ea1-6b8d-4537-8003-ea6f63ccfde0 service nova] Creating event network-vif-plugged:4056825c-1c74-40d2-846c-e4886adca6ee for instance 66779798-999a-4a63-98dd-bf7fa71ce4b1 on nch1-master-1 Sep 17 21:01:41.270022 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-23c50c0f-6b96-4809-a658-6e43b82ec599 req-139c6ea1-6b8d-4537-8003-ea6f63ccfde0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069522 Sep 17 21:01:41.270641 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1363/2796] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:41.276890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-58471aa4-096b-49fc-aab9-8d79de414ef9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:41.278004 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-58471aa4-096b-49fc-aab9-8d79de414ef9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:41.306358 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-cdad0dd8-b59d-4562-ba0c-1b814609280b req-144cfebd-5a1d-4147-b884-53c29f689d5b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:41.307149 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-cdad0dd8-b59d-4562-ba0c-1b814609280b req-144cfebd-5a1d-4147-b884-53c29f689d5b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:41.308015 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-cdad0dd8-b59d-4562-ba0c-1b814609280b req-144cfebd-5a1d-4147-b884-53c29f689d5b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:41.311780 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58471aa4-096b-49fc-aab9-8d79de414ef9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:41.314240 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58471aa4-096b-49fc-aab9-8d79de414ef9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:41.314855 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58471aa4-096b-49fc-aab9-8d79de414ef9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:41.315817 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58471aa4-096b-49fc-aab9-8d79de414ef9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:41.316459 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58471aa4-096b-49fc-aab9-8d79de414ef9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:41.316910 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58471aa4-096b-49fc-aab9-8d79de414ef9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:41.336905 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-cdad0dd8-b59d-4562-ba0c-1b814609280b req-144cfebd-5a1d-4147-b884-53c29f689d5b service nova] Creating event network-changed:8dc19aab-491e-4cba-9e9b-1f02d19a112b for instance e2ed2483-1241-4242-83e3-3345fffcbe30 on nch2-master-1 Sep 17 21:01:41.340850 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-58471aa4-096b-49fc-aab9-8d79de414ef9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] HTTP exception thrown: Instance b37a20c2-7329-4a0e-8b31-d0a7c39344b3 could not be found. Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-58471aa4-096b-49fc-aab9-8d79de414ef9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Request method failure captured: Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 HTTP/1.1 Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjSr4eYJ5iRC0BESTxyEYBHr6fTKXAfzmSKRijJd1-Dg4_6zeDPSLMVKcn7Va4xyX_oACpKQBdCcihzycrxxeD9gtcf6rUAIbBHhHnQZK1W2woTj604P1AONqCzsshMWFY41NR-lshpdEXKwYePjmUqN1wZWN-nWEva1tUOKD4iFshs Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89b46ae7347d4f2daf02f627e41a4847", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-DeleteServersTestJSON-583053734 Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 3009c5feb1ef43a08b07996d8f63bf11 Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance b37a20c2-7329-4a0e-8b31-d0a7c39344b3 could not be found. Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'b37a20c2-7329-4a0e-8b31-d0a7c39344b3'} Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b37a20c2-7329-4a0e-8b31-d0a7c39344b3 could not be found. Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b37a20c2-7329-4a0e-8b31-d0a7c39344b3 could not be found. Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:41.343392 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:41.359365 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:41.359365 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:41.359365 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:41.359365 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:01:41.359365 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:01:41.359365 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b37a20c2-7329-4a0e-8b31-d0a7c39344b3 could not be found. Sep 17 21:01:41.359365 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:41.359365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-58471aa4-096b-49fc-aab9-8d79de414ef9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Returning 404 to user: Instance b37a20c2-7329-4a0e-8b31-d0a7c39344b3 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:01:41.359365 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-58471aa4-096b-49fc-aab9-8d79de414ef9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 404 len: 111 microversion: 2.1 time: 0.074255 Sep 17 21:01:41.359365 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1364/2797] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:41 2022] GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:01:41.360116 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-cdad0dd8-b59d-4562-ba0c-1b814609280b req-144cfebd-5a1d-4147-b884-53c29f689d5b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085542 Sep 17 21:01:41.360116 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1434/2798] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:41.364594 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-602046c3-ffe7-442f-82de-a43da5b80417 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:41.365077 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-602046c3-ffe7-442f-82de-a43da5b80417 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: e2ed2483-1241-4242-83e3-3345fffcbe30] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:41.372564 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-602046c3-ffe7-442f-82de-a43da5b80417 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:41.373059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-602046c3-ffe7-442f-82de-a43da5b80417 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:41.373701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-602046c3-ffe7-442f-82de-a43da5b80417 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:41.374234 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-602046c3-ffe7-442f-82de-a43da5b80417 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:41.374687 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-602046c3-ffe7-442f-82de-a43da5b80417 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:41.375102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-602046c3-ffe7-442f-82de-a43da5b80417 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:41.379558 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a1aa3500-1e78-4687-a693-6ef2cfd9b615 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:41.380372 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a1aa3500-1e78-4687-a693-6ef2cfd9b615 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:41.400410 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a1aa3500-1e78-4687-a693-6ef2cfd9b615 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:41.403127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a1aa3500-1e78-4687-a693-6ef2cfd9b615 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:41.403612 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a1aa3500-1e78-4687-a693-6ef2cfd9b615 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:41.404375 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a1aa3500-1e78-4687-a693-6ef2cfd9b615 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:41.404864 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a1aa3500-1e78-4687-a693-6ef2cfd9b615 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:41.405303 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a1aa3500-1e78-4687-a693-6ef2cfd9b615 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:41.658518 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-602046c3-ffe7-442f-82de-a43da5b80417 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:41.668369 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-602046c3-ffe7-442f-82de-a43da5b80417 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ed2483-1241-4242-83e3-3345fffcbe30" status: 200 len: 1324 microversion: 2.1 time: 0.319774 Sep 17 21:01:41.681496 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1365/2799] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:41 2022] GET /compute/v2.1/servers/e2ed2483-1241-4242-83e3-3345fffcbe30 => generated 1324 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:41.681496 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-79e029a4-62da-4826-96f0-3e3b1392f4b5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1136452212", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fd58f898-7287-41a8-bd5b-faf66186e8ef"}], "security_groups": [{"name": "tempest-securitygroup--1642240739"}], "key_name": "tempest-keypair-1659946339", "user_data": "}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:41.699906 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a1aa3500-1e78-4687-a693-6ef2cfd9b615 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:41.708753 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a1aa3500-1e78-4687-a693-6ef2cfd9b615 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.349869 Sep 17 21:01:41.709445 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1435/2800] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:41 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:41.715636 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fe655892-38aa-4a97-bd1d-e073f9be9584 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-89500132", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "25526ef3-eaa2-4f18-ac44-bfbbfae855ea"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:41.797507 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-fe655892-38aa-4a97-bd1d-e073f9be9584 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] validate_networks() for [('25526ef3-eaa2-4f18-ac44-bfbbfae855ea', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:01:41.875646 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-79e029a4-62da-4826-96f0-3e3b1392f4b5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] validate_networks() for [('fd58f898-7287-41a8-bd5b-faf66186e8ef', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:01:42.657742 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-fe655892-38aa-4a97-bd1d-e073f9be9584 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:01:42.659176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-fe655892-38aa-4a97-bd1d-e073f9be9584 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:01:42.659919 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-fe655892-38aa-4a97-bd1d-e073f9be9584 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:01:42.660574 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-fe655892-38aa-4a97-bd1d-e073f9be9584 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:01:42.661194 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-fe655892-38aa-4a97-bd1d-e073f9be9584 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:01:42.681553 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe655892-38aa-4a97-bd1d-e073f9be9584 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:42.682556 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe655892-38aa-4a97-bd1d-e073f9be9584 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:42.683234 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe655892-38aa-4a97-bd1d-e073f9be9584 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:42.684186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe655892-38aa-4a97-bd1d-e073f9be9584 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:42.685632 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe655892-38aa-4a97-bd1d-e073f9be9584 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:42.686224 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe655892-38aa-4a97-bd1d-e073f9be9584 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:42.709046 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-fe655892-38aa-4a97-bd1d-e073f9be9584 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Getting quotas for project 89b46ae7347d4f2daf02f627e41a4847. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:01:42.716356 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-fe655892-38aa-4a97-bd1d-e073f9be9584 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Getting quotas for user 3009c5feb1ef43a08b07996d8f63bf11 and project 89b46ae7347d4f2daf02f627e41a4847. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:01:42.733319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fe655892-38aa-4a97-bd1d-e073f9be9584 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:01:42.736310 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fe655892-38aa-4a97-bd1d-e073f9be9584 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:01:42.752543 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-79e029a4-62da-4826-96f0-3e3b1392f4b5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:01:42.753208 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-79e029a4-62da-4826-96f0-3e3b1392f4b5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:01:42.753834 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-79e029a4-62da-4826-96f0-3e3b1392f4b5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:01:42.754247 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-79e029a4-62da-4826-96f0-3e3b1392f4b5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:01:42.754720 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-79e029a4-62da-4826-96f0-3e3b1392f4b5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:01:42.768606 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79e029a4-62da-4826-96f0-3e3b1392f4b5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:42.769095 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79e029a4-62da-4826-96f0-3e3b1392f4b5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:42.769593 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79e029a4-62da-4826-96f0-3e3b1392f4b5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:42.770368 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79e029a4-62da-4826-96f0-3e3b1392f4b5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:42.770872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79e029a4-62da-4826-96f0-3e3b1392f4b5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:42.771378 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79e029a4-62da-4826-96f0-3e3b1392f4b5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:42.820847 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-79e029a4-62da-4826-96f0-3e3b1392f4b5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Getting quotas for project 3e48e3c2f7f74636a75679fdf10ef33a. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:01:42.832197 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fe655892-38aa-4a97-bd1d-e073f9be9584 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.121367 Sep 17 21:01:42.838988 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-79e029a4-62da-4826-96f0-3e3b1392f4b5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Getting quotas for user 2ef547e071fd43ec96c745c26eca119f and project 3e48e3c2f7f74636a75679fdf10ef33a. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:01:42.839165 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1436/2801] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:01:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:01:42.846549 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8140dfe0-754e-4654-b11f-b8537954422e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:42.847354 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8140dfe0-754e-4654-b11f-b8537954422e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:42.854780 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-79e029a4-62da-4826-96f0-3e3b1392f4b5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:01:42.859676 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-79e029a4-62da-4826-96f0-3e3b1392f4b5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:01:42.880526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8140dfe0-754e-4654-b11f-b8537954422e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:42.902793 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8140dfe0-754e-4654-b11f-b8537954422e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:42.903269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8140dfe0-754e-4654-b11f-b8537954422e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:42.904047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8140dfe0-754e-4654-b11f-b8537954422e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:42.904520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8140dfe0-754e-4654-b11f-b8537954422e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:42.909208 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8140dfe0-754e-4654-b11f-b8537954422e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:42.945114 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-79e029a4-62da-4826-96f0-3e3b1392f4b5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.274194 Sep 17 21:01:42.946007 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1366/2802] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:01:41 2022] POST /compute/v2.1/servers => generated 409 bytes in 1276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:01:42.954885 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f1fc242f-fac1-470f-89c7-034b80858a0e tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:42.955778 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f1fc242f-fac1-470f-89c7-034b80858a0e tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 66779798-999a-4a63-98dd-bf7fa71ce4b1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:42.964537 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1fc242f-fac1-470f-89c7-034b80858a0e tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:42.965271 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1fc242f-fac1-470f-89c7-034b80858a0e tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:42.965996 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1fc242f-fac1-470f-89c7-034b80858a0e tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:42.966896 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1fc242f-fac1-470f-89c7-034b80858a0e tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:42.967489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1fc242f-fac1-470f-89c7-034b80858a0e tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:42.968071 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1fc242f-fac1-470f-89c7-034b80858a0e tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:43.423969 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8140dfe0-754e-4654-b11f-b8537954422e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:43.439155 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8140dfe0-754e-4654-b11f-b8537954422e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.599708 Sep 17 21:01:43.442009 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1437/2803] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:42 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:43.456047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f1fc242f-fac1-470f-89c7-034b80858a0e tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc9559a966444d98e54edb4f948ae1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d42cba2664646f6adb4202574b7fa5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:43.464817 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-afb50170-ac49-4a41-86d6-5afce908b003 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:43.465491 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-afb50170-ac49-4a41-86d6-5afce908b003 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 67aeba5b-d1f8-4487-be79-97da63c34fc5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:43.467742 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f1fc242f-fac1-470f-89c7-034b80858a0e tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1" status: 200 len: 1318 microversion: 2.1 time: 0.520386 Sep 17 21:01:43.478377 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1367/2804] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:42 2022] GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1 => generated 1318 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:43.529246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-936646b3-0f61-4cfb-b7e0-d472adbaacef tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:43.530736 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-afb50170-ac49-4a41-86d6-5afce908b003 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:43.531569 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-936646b3-0f61-4cfb-b7e0-d472adbaacef tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: e2ed2483-1241-4242-83e3-3345fffcbe30] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:43.532229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-afb50170-ac49-4a41-86d6-5afce908b003 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:43.535792 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-afb50170-ac49-4a41-86d6-5afce908b003 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:43.536849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-afb50170-ac49-4a41-86d6-5afce908b003 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:43.537571 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-afb50170-ac49-4a41-86d6-5afce908b003 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:43.538320 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-afb50170-ac49-4a41-86d6-5afce908b003 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:43.547397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-936646b3-0f61-4cfb-b7e0-d472adbaacef tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:43.548267 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-936646b3-0f61-4cfb-b7e0-d472adbaacef tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:43.549606 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-936646b3-0f61-4cfb-b7e0-d472adbaacef tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:43.550580 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-936646b3-0f61-4cfb-b7e0-d472adbaacef tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:43.563916 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-936646b3-0f61-4cfb-b7e0-d472adbaacef tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:43.564766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-936646b3-0f61-4cfb-b7e0-d472adbaacef tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:43.628965 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-afb50170-ac49-4a41-86d6-5afce908b003 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:43.632284 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-afb50170-ac49-4a41-86d6-5afce908b003 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:43.633138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-afb50170-ac49-4a41-86d6-5afce908b003 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:43.637241 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-afb50170-ac49-4a41-86d6-5afce908b003 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lazy-loading 'fault' on Instance uuid 67aeba5b-d1f8-4487-be79-97da63c34fc5 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:01:43.743616 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-afb50170-ac49-4a41-86d6-5afce908b003 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:43.757271 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-afb50170-ac49-4a41-86d6-5afce908b003 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5" status: 200 len: 1304 microversion: 2.1 time: 0.314055 Sep 17 21:01:43.758198 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1438/2805] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:43 2022] GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5 => generated 1304 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:43.769045 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6eb39362-abe5-458e-95b6-6086a226debd tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:43.769724 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6eb39362-abe5-458e-95b6-6086a226debd tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:43.913191 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6eb39362-abe5-458e-95b6-6086a226debd tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:43.927957 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6eb39362-abe5-458e-95b6-6086a226debd tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed" status: 200 len: 1213 microversion: 2.1 time: 0.162277 Sep 17 21:01:43.928835 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1439/2806] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:43 2022] GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed => generated 1213 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:43.934816 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9335d61f-0eb5-443f-b8ed-0752bede3a06 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:43.935780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9335d61f-0eb5-443f-b8ed-0752bede3a06 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:44.071431 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9335d61f-0eb5-443f-b8ed-0752bede3a06 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:44.080192 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9335d61f-0eb5-443f-b8ed-0752bede3a06 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1239 microversion: 2.1 time: 0.149490 Sep 17 21:01:44.080796 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1440/2807] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:43 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1239 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:44.099164 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-936646b3-0f61-4cfb-b7e0-d472adbaacef tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:44.109286 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-936646b3-0f61-4cfb-b7e0-d472adbaacef tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ed2483-1241-4242-83e3-3345fffcbe30" status: 200 len: 1324 microversion: 2.1 time: 0.605073 Sep 17 21:01:44.113038 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-34ec7c74-ed0a-4643-81a5-e1b6fad0f74f req-c9d806b5-1495-4349-a64f-5bbcd2d0adf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67aeba5b-d1f8-4487-be79-97da63c34fc5", "name": "network-vif-deleted", "tag": "1058d1b5-6690-4868-b306-534692f06487"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:44.118578 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1368/2808] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:43 2022] GET /compute/v2.1/servers/e2ed2483-1241-4242-83e3-3345fffcbe30 => generated 1324 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:44.137307 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-06ff9efd-e423-47f7-bf46-023a9c608f18 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:44.151206 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-06ff9efd-e423-47f7-bf46-023a9c608f18 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:44.155147 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-34ec7c74-ed0a-4643-81a5-e1b6fad0f74f req-c9d806b5-1495-4349-a64f-5bbcd2d0adf0 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:44.155728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-34ec7c74-ed0a-4643-81a5-e1b6fad0f74f req-c9d806b5-1495-4349-a64f-5bbcd2d0adf0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:44.162997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-34ec7c74-ed0a-4643-81a5-e1b6fad0f74f req-c9d806b5-1495-4349-a64f-5bbcd2d0adf0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:44.171511 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06ff9efd-e423-47f7-bf46-023a9c608f18 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:44.174457 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06ff9efd-e423-47f7-bf46-023a9c608f18 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:44.176792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06ff9efd-e423-47f7-bf46-023a9c608f18 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:44.178192 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06ff9efd-e423-47f7-bf46-023a9c608f18 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:44.178678 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06ff9efd-e423-47f7-bf46-023a9c608f18 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:44.179115 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06ff9efd-e423-47f7-bf46-023a9c608f18 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:44.198907 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-34ec7c74-ed0a-4643-81a5-e1b6fad0f74f req-c9d806b5-1495-4349-a64f-5bbcd2d0adf0 service nova] Creating event network-vif-deleted:1058d1b5-6690-4868-b306-534692f06487 for instance 67aeba5b-d1f8-4487-be79-97da63c34fc5 on nch1-master-1 Sep 17 21:01:44.222319 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-34ec7c74-ed0a-4643-81a5-e1b6fad0f74f req-c9d806b5-1495-4349-a64f-5bbcd2d0adf0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136400 Sep 17 21:01:44.224214 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1441/2809] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:44.224584 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:44.232597 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-846f723d-76f9-419d-a383-1be8ea2b58d8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-775045067", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": -1, "networks": [{"uuid": "dc0ab76b-95f3-4f0a-beab-7465ea19ce7a"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:44.250123 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-06ff9efd-e423-47f7-bf46-023a9c608f18 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127215 Sep 17 21:01:44.251151 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-846f723d-76f9-419d-a383-1be8ea2b58d8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Flavor -1 could not be found. Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-846f723d-76f9-419d-a383-1be8ea2b58d8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 205 Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-775045067", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": -1, "networks": [{"uuid": "dc0ab76b-95f3-4f0a-beab-7465ea19ce7a"}]}} Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: exception: Flavor -1 could not be found. Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-775045067', 'imageRef': '1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4', 'flavorRef': -1, 'networks': [{'uuid': 'dc0ab76b-95f3-4f0a-beab-7465ea19ce7a'}]}}} Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:01:44.253366 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:01:44.257353 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:01:44.257353 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:01:44.257353 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:01:44.257353 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:01:44.257353 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 17 21:01:44.257353 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 17 21:01:44.257353 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 17 21:01:44.257353 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Sep 17 21:01:44.257353 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:44.257353 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:44.257353 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:44.257353 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:44.257353 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:44.257353 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:44.257353 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:01:44.257353 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:01:44.257353 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Sep 17 21:01:44.257353 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:44.259653 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1369/2810] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 17 21:01:44 2022] GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:44.261997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-846f723d-76f9-419d-a383-1be8ea2b58d8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:01:44.263745 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-846f723d-76f9-419d-a383-1be8ea2b58d8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.037974 Sep 17 21:01:44.264834 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1442/2811] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:01:44 2022] POST /compute/v2.1/servers => generated 73 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 17 21:01:44.278140 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8af78b65-f12b-4283-8e24-a73f3088ab7c tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:44.278997 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8af78b65-f12b-4283-8e24-a73f3088ab7c tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:44.281573 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fefd1618-802a-468a-bdc9-52285d031d24 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:44.283832 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fefd1618-802a-468a-bdc9-52285d031d24 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:44.294895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8af78b65-f12b-4283-8e24-a73f3088ab7c tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:44.297336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8af78b65-f12b-4283-8e24-a73f3088ab7c tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:44.299312 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fefd1618-802a-468a-bdc9-52285d031d24 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:44.300252 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8af78b65-f12b-4283-8e24-a73f3088ab7c tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:44.301331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fefd1618-802a-468a-bdc9-52285d031d24 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:44.301878 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8af78b65-f12b-4283-8e24-a73f3088ab7c tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:44.302470 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fefd1618-802a-468a-bdc9-52285d031d24 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:44.303306 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8af78b65-f12b-4283-8e24-a73f3088ab7c tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:44.304240 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fefd1618-802a-468a-bdc9-52285d031d24 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:44.304765 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8af78b65-f12b-4283-8e24-a73f3088ab7c tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:44.306545 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fefd1618-802a-468a-bdc9-52285d031d24 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:44.307219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fefd1618-802a-468a-bdc9-52285d031d24 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:44.435738 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-8af78b65-f12b-4283-8e24-a73f3088ab7c tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lazy-loading 'services' on Instance uuid 6a1dbfb5-be75-451c-8ca8-a71949ac2297 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:01:44.549630 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8af78b65-f12b-4283-8e24-a73f3088ab7c tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297/os-volume_attachments/25a02b63-f7d3-40d4-8373-cc437ceef99e" status: 202 len: 0 microversion: 2.1 time: 0.288505 Sep 17 21:01:44.554993 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1370/2812] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Sep 17 21:01:44 2022] DELETE /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297/os-volume_attachments/25a02b63-f7d3-40d4-8373-cc437ceef99e => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:01:44.568134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3f9b9ab6-ab03-4e87-8673-e3decb37a767 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:44.569132 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3f9b9ab6-ab03-4e87-8673-e3decb37a767 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 66779798-999a-4a63-98dd-bf7fa71ce4b1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:44.576969 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f9b9ab6-ab03-4e87-8673-e3decb37a767 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:44.577779 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f9b9ab6-ab03-4e87-8673-e3decb37a767 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:44.578407 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f9b9ab6-ab03-4e87-8673-e3decb37a767 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:44.579953 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f9b9ab6-ab03-4e87-8673-e3decb37a767 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:44.580623 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f9b9ab6-ab03-4e87-8673-e3decb37a767 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:44.581239 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f9b9ab6-ab03-4e87-8673-e3decb37a767 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:44.684905 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fefd1618-802a-468a-bdc9-52285d031d24 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:44.697402 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fefd1618-802a-468a-bdc9-52285d031d24 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.425961 Sep 17 21:01:44.713754 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1443/2813] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:44 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:44.721939 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7d4fa90e-34dd-40da-a664-4549af738ef8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:44.723058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7d4fa90e-34dd-40da-a664-4549af738ef8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:44.728749 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d4fa90e-34dd-40da-a664-4549af738ef8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:44.729481 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d4fa90e-34dd-40da-a664-4549af738ef8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:44.729928 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d4fa90e-34dd-40da-a664-4549af738ef8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:44.730844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d4fa90e-34dd-40da-a664-4549af738ef8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:44.731484 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d4fa90e-34dd-40da-a664-4549af738ef8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:44.732091 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d4fa90e-34dd-40da-a664-4549af738ef8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:44.891635 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3f9b9ab6-ab03-4e87-8673-e3decb37a767 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc9559a966444d98e54edb4f948ae1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d42cba2664646f6adb4202574b7fa5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:44.913026 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3f9b9ab6-ab03-4e87-8673-e3decb37a767 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1" status: 200 len: 1468 microversion: 2.1 time: 0.348522 Sep 17 21:01:44.925618 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1371/2814] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:44 2022] GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1 => generated 1468 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:44.925618 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7c907157-afab-4903-a61e-6d8f5635cc8a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:44.925618 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7c907157-afab-4903-a61e-6d8f5635cc8a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 67aeba5b-d1f8-4487-be79-97da63c34fc5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:44.935193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c907157-afab-4903-a61e-6d8f5635cc8a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:44.935938 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c907157-afab-4903-a61e-6d8f5635cc8a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:44.937369 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c907157-afab-4903-a61e-6d8f5635cc8a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:44.938558 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c907157-afab-4903-a61e-6d8f5635cc8a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:44.939182 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c907157-afab-4903-a61e-6d8f5635cc8a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:44.939900 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c907157-afab-4903-a61e-6d8f5635cc8a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:44.958131 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-7c907157-afab-4903-a61e-6d8f5635cc8a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] HTTP exception thrown: Instance 67aeba5b-d1f8-4487-be79-97da63c34fc5 could not be found. Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7c907157-afab-4903-a61e-6d8f5635cc8a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Request method failure captured: Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5 HTTP/1.1 Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjUZCcfqWYQHjeu0EoKgBCtDWrCfo8uQ_TiE9mGv0sk76_eAsFjjzkwhVlzRs8RNjGK925n3-XSkuzNq7reJIA0_tJTccmw-0VCxFcV2wp1Vfo6dUWaNyLxeBa3ok0b3mLImUT2vR0g0z1jqHjL-UKSqtwkz0BcygSuLNEFkd37E12U Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: a0c2cdfddf5b4d35a0ca3c7554271365 Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersAdminTestJSON-871444303 Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a0c2cdfddf5b4d35a0ca3c7554271365"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a0c2cdfddf5b4d35a0ca3c7554271365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a0c2cdfddf5b4d35a0ca3c7554271365"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a0c2cdfddf5b4d35a0ca3c7554271365", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersAdminTestJSON-871444303 Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: a0c2cdfddf5b4d35a0ca3c7554271365 Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersAdminTestJSON-871444303 Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersAdminTestJSON-871444303-project Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 1fff4805e6fb45a0b7c8b4dc08c4dedb Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersAdminTestJSON-871444303-project Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 67aeba5b-d1f8-4487-be79-97da63c34fc5 could not be found. Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '67aeba5b-d1f8-4487-be79-97da63c34fc5'} Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67aeba5b-d1f8-4487-be79-97da63c34fc5 could not be found. Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67aeba5b-d1f8-4487-be79-97da63c34fc5 could not be found. Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:44.959828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:44.963837 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:44.963837 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:44.963837 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:44.963837 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:01:44.963837 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:01:44.963837 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67aeba5b-d1f8-4487-be79-97da63c34fc5 could not be found. Sep 17 21:01:44.963837 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:44.963837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7c907157-afab-4903-a61e-6d8f5635cc8a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Returning 404 to user: Instance 67aeba5b-d1f8-4487-be79-97da63c34fc5 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:01:44.971169 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7c907157-afab-4903-a61e-6d8f5635cc8a tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5" status: 404 len: 111 microversion: 2.1 time: 0.055628 Sep 17 21:01:44.971789 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1372/2815] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:44 2022] GET /compute/v2.1/servers/67aeba5b-d1f8-4487-be79-97da63c34fc5 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:01:44.981790 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1e813445-042b-40a3-9b1e-a558cfcf675e tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:44.982421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1e813445-042b-40a3-9b1e-a558cfcf675e tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:44.999608 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1e813445-042b-40a3-9b1e-a558cfcf675e tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:45.000111 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1e813445-042b-40a3-9b1e-a558cfcf675e tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:45.000557 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1e813445-042b-40a3-9b1e-a558cfcf675e tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:45.001279 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1e813445-042b-40a3-9b1e-a558cfcf675e tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:45.003682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1e813445-042b-40a3-9b1e-a558cfcf675e tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:45.004143 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1e813445-042b-40a3-9b1e-a558cfcf675e tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:45.239507 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7d4fa90e-34dd-40da-a664-4549af738ef8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:45.279837 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7d4fa90e-34dd-40da-a664-4549af738ef8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.561667 Sep 17 21:01:45.286753 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1444/2816] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:44 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:01:45.302023 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e5c5297a-3e7c-49dc-a1f4-953f0eb2d353 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:45.304356 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e5c5297a-3e7c-49dc-a1f4-953f0eb2d353 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:45.322051 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5c5297a-3e7c-49dc-a1f4-953f0eb2d353 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:45.323563 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5c5297a-3e7c-49dc-a1f4-953f0eb2d353 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:45.324827 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5c5297a-3e7c-49dc-a1f4-953f0eb2d353 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:45.326582 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5c5297a-3e7c-49dc-a1f4-953f0eb2d353 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:45.327380 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5c5297a-3e7c-49dc-a1f4-953f0eb2d353 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:45.328147 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5c5297a-3e7c-49dc-a1f4-953f0eb2d353 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:45.445036 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1e813445-042b-40a3-9b1e-a558cfcf675e tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc9559a966444d98e54edb4f948ae1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d42cba2664646f6adb4202574b7fa5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:45.468340 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1e813445-042b-40a3-9b1e-a558cfcf675e tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/servers/0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f" status: 200 len: 1466 microversion: 2.1 time: 0.489294 Sep 17 21:01:45.482891 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1373/2817] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:44 2022] GET /compute/v2.1/servers/0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f => generated 1466 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:45.483175 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e5c5297a-3e7c-49dc-a1f4-953f0eb2d353 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:45.483300 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-272b1994-03ea-4567-9945-dc1f2ff572df tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:45.483300 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-272b1994-03ea-4567-9945-dc1f2ff572df tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:45.489654 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e5c5297a-3e7c-49dc-a1f4-953f0eb2d353 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed" status: 200 len: 1271 microversion: 2.1 time: 0.201401 Sep 17 21:01:45.495362 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1445/2818] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:45 2022] GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed => generated 1271 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:45.496091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-272b1994-03ea-4567-9945-dc1f2ff572df tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:45.497777 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-272b1994-03ea-4567-9945-dc1f2ff572df tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:45.498502 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-272b1994-03ea-4567-9945-dc1f2ff572df tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:45.500550 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-272b1994-03ea-4567-9945-dc1f2ff572df tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:45.501577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-272b1994-03ea-4567-9945-dc1f2ff572df tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:45.503741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-272b1994-03ea-4567-9945-dc1f2ff572df tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:45.507661 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9caa9373-f6a5-445a-9631-dac4c84b2733 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:45.508590 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9caa9373-f6a5-445a-9631-dac4c84b2733 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:45.529201 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9caa9373-f6a5-445a-9631-dac4c84b2733 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:45.532242 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9caa9373-f6a5-445a-9631-dac4c84b2733 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:45.533379 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9caa9373-f6a5-445a-9631-dac4c84b2733 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:45.538517 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9caa9373-f6a5-445a-9631-dac4c84b2733 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:45.539541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9caa9373-f6a5-445a-9631-dac4c84b2733 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:45.540506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9caa9373-f6a5-445a-9631-dac4c84b2733 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:45.561243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-272b1994-03ea-4567-9945-dc1f2ff572df tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:01:45.749048 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-272b1994-03ea-4567-9945-dc1f2ff572df tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 204 len: 0 microversion: 2.1 time: 0.277363 Sep 17 21:01:45.750176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9caa9373-f6a5-445a-9631-dac4c84b2733 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:45.750436 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1374/2819] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:01:45 2022] DELETE /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:01:45.765789 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-35a8e101-bd44-4b21-9256-9c7a1c9bcb5d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:45.768082 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-35a8e101-bd44-4b21-9256-9c7a1c9bcb5d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: e2ed2483-1241-4242-83e3-3345fffcbe30] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:45.769058 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9caa9373-f6a5-445a-9631-dac4c84b2733 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1291 microversion: 2.1 time: 0.267824 Sep 17 21:01:45.770121 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1446/2820] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:45 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1291 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:45.783588 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-93651e94-6f4e-4f7a-a99c-5d99b81541ec tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-726161646", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "dc0ab76b-95f3-4f0a-beab-7465ea19ce7a"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:45.784515 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35a8e101-bd44-4b21-9256-9c7a1c9bcb5d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:45.785434 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35a8e101-bd44-4b21-9256-9c7a1c9bcb5d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:45.786763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35a8e101-bd44-4b21-9256-9c7a1c9bcb5d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:45.791647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35a8e101-bd44-4b21-9256-9c7a1c9bcb5d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:45.792349 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35a8e101-bd44-4b21-9256-9c7a1c9bcb5d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:45.793449 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35a8e101-bd44-4b21-9256-9c7a1c9bcb5d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-93651e94-6f4e-4f7a-a99c-5d99b81541ec tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 172 Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-726161646", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "dc0ab76b-95f3-4f0a-beab-7465ea19ce7a"}]}} Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-726161646', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'dc0ab76b-95f3-4f0a-beab-7465ea19ce7a'}]}}} Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise error Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi -1 Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 21:01:45.812542 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 21:01:45.817518 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 21:01:45.817518 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 21:01:45.817518 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 17 21:01:45.817518 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:45.817518 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:45.817518 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:45.817518 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:45.817518 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:45.817518 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:45.817518 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 21:01:45.817518 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 21:01:45.817518 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 17 21:01:45.817518 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:45.820434 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-93651e94-6f4e-4f7a-a99c-5d99b81541ec tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:01:45.823700 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-93651e94-6f4e-4f7a-a99c-5d99b81541ec tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.052309 Sep 17 21:01:45.828284 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1447/2821] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:01:45 2022] POST /compute/v2.1/servers => generated 145 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:01:45.838060 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-68bb475a-0b8a-41cb-aaee-2f5e82aefd4c tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-721775890"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:45.843300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-68bb475a-0b8a-41cb-aaee-2f5e82aefd4c tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:45.861745 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68bb475a-0b8a-41cb-aaee-2f5e82aefd4c tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:45.863648 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68bb475a-0b8a-41cb-aaee-2f5e82aefd4c tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:45.866458 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68bb475a-0b8a-41cb-aaee-2f5e82aefd4c tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:45.867682 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68bb475a-0b8a-41cb-aaee-2f5e82aefd4c tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:45.868373 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68bb475a-0b8a-41cb-aaee-2f5e82aefd4c tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:45.869026 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68bb475a-0b8a-41cb-aaee-2f5e82aefd4c tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:46.253736 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-68bb475a-0b8a-41cb-aaee-2f5e82aefd4c tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "POST /compute/v2.1/servers/0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f/action" status: 202 len: 0 microversion: 2.1 time: 0.423466 Sep 17 21:01:46.255990 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1448/2822] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:01:45 2022] POST /compute/v2.1/servers/0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f/action => generated 0 bytes in 427 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 17 21:01:46.266534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-03dc6c54-a10c-4cb5-9c2b-943116830058 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:46.267655 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-03dc6c54-a10c-4cb5-9c2b-943116830058 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:46.277190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03dc6c54-a10c-4cb5-9c2b-943116830058 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:46.277988 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03dc6c54-a10c-4cb5-9c2b-943116830058 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:46.278560 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03dc6c54-a10c-4cb5-9c2b-943116830058 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:46.279684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03dc6c54-a10c-4cb5-9c2b-943116830058 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:46.280475 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03dc6c54-a10c-4cb5-9c2b-943116830058 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:46.281588 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03dc6c54-a10c-4cb5-9c2b-943116830058 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:46.447663 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-35a8e101-bd44-4b21-9256-9c7a1c9bcb5d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:46.473750 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-35a8e101-bd44-4b21-9256-9c7a1c9bcb5d tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ed2483-1241-4242-83e3-3345fffcbe30" status: 200 len: 1324 microversion: 2.1 time: 0.717209 Sep 17 21:01:46.482591 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1375/2823] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:45 2022] GET /compute/v2.1/servers/e2ed2483-1241-4242-83e3-3345fffcbe30 => generated 1324 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:46.491616 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0eb16c53-bdb0-40bb-9887-327ba956da02 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:46.496268 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0eb16c53-bdb0-40bb-9887-327ba956da02 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:46.503983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0eb16c53-bdb0-40bb-9887-327ba956da02 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:46.504935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0eb16c53-bdb0-40bb-9887-327ba956da02 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:46.505308 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0eb16c53-bdb0-40bb-9887-327ba956da02 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:46.506156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0eb16c53-bdb0-40bb-9887-327ba956da02 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:46.506687 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0eb16c53-bdb0-40bb-9887-327ba956da02 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:46.507098 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0eb16c53-bdb0-40bb-9887-327ba956da02 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:46.540161 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0eb16c53-bdb0-40bb-9887-327ba956da02 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054730 Sep 17 21:01:46.541362 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1376/2824] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 17 21:01:46 2022] GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:01:46.545632 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bce02f5f-805e-492b-8f94-06f40576d6a2 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:46.546836 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bce02f5f-805e-492b-8f94-06f40576d6a2 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:46.554046 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bce02f5f-805e-492b-8f94-06f40576d6a2 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:46.554809 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bce02f5f-805e-492b-8f94-06f40576d6a2 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:46.555653 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bce02f5f-805e-492b-8f94-06f40576d6a2 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:46.556778 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bce02f5f-805e-492b-8f94-06f40576d6a2 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:46.557391 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bce02f5f-805e-492b-8f94-06f40576d6a2 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:46.558037 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bce02f5f-805e-492b-8f94-06f40576d6a2 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:46.610938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-03dc6c54-a10c-4cb5-9c2b-943116830058 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:46.620179 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-03dc6c54-a10c-4cb5-9c2b-943116830058 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1469 microversion: 2.1 time: 0.362679 Sep 17 21:01:46.621028 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1449/2825] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:46 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1469 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:46.626311 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8f7487c1-830e-43bc-ac30-7a5a1e4e0b6c tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a4d505e0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:46.678630 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8f7487c1-830e-43bc-ac30-7a5a1e4e0b6c tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57" status: 200 len: 1452 microversion: 2.1 time: 0.056299 Sep 17 21:01:46.679780 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1450/2826] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:01:46 2022] GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57 => generated 1452 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:46.684666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f745def0-df15-42be-850e-d358ef636cd7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:46.685292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f745def0-df15-42be-850e-d358ef636cd7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:46.691889 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f745def0-df15-42be-850e-d358ef636cd7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:46.692402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f745def0-df15-42be-850e-d358ef636cd7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:46.692852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f745def0-df15-42be-850e-d358ef636cd7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:46.693800 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f745def0-df15-42be-850e-d358ef636cd7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:46.694289 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f745def0-df15-42be-850e-d358ef636cd7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:46.695014 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f745def0-df15-42be-850e-d358ef636cd7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:46.814800 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bce02f5f-805e-492b-8f94-06f40576d6a2 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:46.825380 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bce02f5f-805e-492b-8f94-06f40576d6a2 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.281068 Sep 17 21:01:46.826356 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1377/2827] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:46 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:46.831666 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5fa0246b-ef80-4cec-9f90-80a84adb45e5 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:46.834247 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5fa0246b-ef80-4cec-9f90-80a84adb45e5 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:46.864000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5fa0246b-ef80-4cec-9f90-80a84adb45e5 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:46.864503 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5fa0246b-ef80-4cec-9f90-80a84adb45e5 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:46.864944 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5fa0246b-ef80-4cec-9f90-80a84adb45e5 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:46.865692 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5fa0246b-ef80-4cec-9f90-80a84adb45e5 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:46.866153 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5fa0246b-ef80-4cec-9f90-80a84adb45e5 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:46.871036 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5fa0246b-ef80-4cec-9f90-80a84adb45e5 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:46.937728 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5fa0246b-ef80-4cec-9f90-80a84adb45e5 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.109890 Sep 17 21:01:46.938269 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1378/2828] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 17 21:01:46 2022] GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297/os-volume_attachments => generated 25 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:01:46.951044 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ff711622-4ab4-427e-b100-2c367c2ca1f1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:46.951678 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ff711622-4ab4-427e-b100-2c367c2ca1f1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:46.972877 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff711622-4ab4-427e-b100-2c367c2ca1f1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:46.973391 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff711622-4ab4-427e-b100-2c367c2ca1f1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:46.973872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff711622-4ab4-427e-b100-2c367c2ca1f1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:46.974605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff711622-4ab4-427e-b100-2c367c2ca1f1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:46.975071 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff711622-4ab4-427e-b100-2c367c2ca1f1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:46.976107 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff711622-4ab4-427e-b100-2c367c2ca1f1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:47.161649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f745def0-df15-42be-850e-d358ef636cd7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:47.173976 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f745def0-df15-42be-850e-d358ef636cd7 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed" status: 200 len: 1313 microversion: 2.1 time: 0.490118 Sep 17 21:01:47.174909 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1451/2829] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:46 2022] GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed => generated 1313 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:47.185251 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ff711622-4ab4-427e-b100-2c367c2ca1f1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:47.197062 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ff711622-4ab4-427e-b100-2c367c2ca1f1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1297 microversion: 2.1 time: 0.254466 Sep 17 21:01:47.200559 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1379/2830] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:46 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1297 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:47.201605 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7a54a134-10a7-4618-8bf8-311359d6ef31 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:47.202245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7a54a134-10a7-4618-8bf8-311359d6ef31 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:47.218384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-425b1243-2bcc-40c9-94a0-a9a66fb9fcb3 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:47.219191 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-425b1243-2bcc-40c9-94a0-a9a66fb9fcb3 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:47.226715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a54a134-10a7-4618-8bf8-311359d6ef31 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:47.227766 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a54a134-10a7-4618-8bf8-311359d6ef31 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:47.237534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a54a134-10a7-4618-8bf8-311359d6ef31 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:47.238601 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a54a134-10a7-4618-8bf8-311359d6ef31 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:47.241480 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a54a134-10a7-4618-8bf8-311359d6ef31 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:47.242118 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a54a134-10a7-4618-8bf8-311359d6ef31 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:47.246212 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-425b1243-2bcc-40c9-94a0-a9a66fb9fcb3 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:47.247258 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-425b1243-2bcc-40c9-94a0-a9a66fb9fcb3 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:47.249280 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-425b1243-2bcc-40c9-94a0-a9a66fb9fcb3 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:47.250210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-425b1243-2bcc-40c9-94a0-a9a66fb9fcb3 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:47.252253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-425b1243-2bcc-40c9-94a0-a9a66fb9fcb3 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:47.252896 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-425b1243-2bcc-40c9-94a0-a9a66fb9fcb3 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:47.320628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-425b1243-2bcc-40c9-94a0-a9a66fb9fcb3 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:01:47.543991 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-425b1243-2bcc-40c9-94a0-a9a66fb9fcb3 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297" status: 204 len: 0 microversion: 2.1 time: 0.338338 Sep 17 21:01:47.545754 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1380/2831] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:01:47 2022] DELETE /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:01:47.555224 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b7d0faf5-622c-48fd-a651-e9b7d29276b3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:47.556259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b7d0faf5-622c-48fd-a651-e9b7d29276b3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: e2ed2483-1241-4242-83e3-3345fffcbe30] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:47.563126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b7d0faf5-622c-48fd-a651-e9b7d29276b3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:47.563917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b7d0faf5-622c-48fd-a651-e9b7d29276b3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:47.565216 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b7d0faf5-622c-48fd-a651-e9b7d29276b3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:47.566170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b7d0faf5-622c-48fd-a651-e9b7d29276b3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:47.566796 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b7d0faf5-622c-48fd-a651-e9b7d29276b3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:47.567390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b7d0faf5-622c-48fd-a651-e9b7d29276b3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:48.069646 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7a54a134-10a7-4618-8bf8-311359d6ef31 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:48.079724 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7a54a134-10a7-4618-8bf8-311359d6ef31 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.901020 Sep 17 21:01:48.080921 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1452/2832] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:47 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:48.087000 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-191c1cb4-0117-4151-bd1b-077f58dc9e28 req-bec34688-9809-401c-87f4-63e09cc5258c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2ed2483-1241-4242-83e3-3345fffcbe30", "name": "network-vif-plugged", "status": "completed", "tag": "8dc19aab-491e-4cba-9e9b-1f02d19a112b"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:48.101035 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-191c1cb4-0117-4151-bd1b-077f58dc9e28 req-bec34688-9809-401c-87f4-63e09cc5258c service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:48.101973 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-191c1cb4-0117-4151-bd1b-077f58dc9e28 req-bec34688-9809-401c-87f4-63e09cc5258c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:48.102689 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-191c1cb4-0117-4151-bd1b-077f58dc9e28 req-bec34688-9809-401c-87f4-63e09cc5258c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:48.128790 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:48.131254 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-191c1cb4-0117-4151-bd1b-077f58dc9e28 req-bec34688-9809-401c-87f4-63e09cc5258c service nova] Creating event network-vif-plugged:8dc19aab-491e-4cba-9e9b-1f02d19a112b for instance e2ed2483-1241-4242-83e3-3345fffcbe30 on nch2-master-1 Sep 17 21:01:48.138967 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-191c1cb4-0117-4151-bd1b-077f58dc9e28 req-bec34688-9809-401c-87f4-63e09cc5258c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056213 Sep 17 21:01:48.140281 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1453/2833] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:48.147653 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d723b4a0-5d6e-4536-86ba-c996c33c3e2c tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:48.149100 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d723b4a0-5d6e-4536-86ba-c996c33c3e2c tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:48.157757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d723b4a0-5d6e-4536-86ba-c996c33c3e2c tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:48.158265 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d723b4a0-5d6e-4536-86ba-c996c33c3e2c tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:48.158707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d723b4a0-5d6e-4536-86ba-c996c33c3e2c tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:48.159576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d723b4a0-5d6e-4536-86ba-c996c33c3e2c tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:48.160038 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d723b4a0-5d6e-4536-86ba-c996c33c3e2c tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:48.160458 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d723b4a0-5d6e-4536-86ba-c996c33c3e2c tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:48.188224 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b7d0faf5-622c-48fd-a651-e9b7d29276b3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:48.201725 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b7d0faf5-622c-48fd-a651-e9b7d29276b3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ed2483-1241-4242-83e3-3345fffcbe30" status: 200 len: 1324 microversion: 2.1 time: 0.653949 Sep 17 21:01:48.202909 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1381/2834] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:47 2022] GET /compute/v2.1/servers/e2ed2483-1241-4242-83e3-3345fffcbe30 => generated 1324 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:48.207895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1ecac791-575c-400b-b59f-57218a9e0c8f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:48.208713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1ecac791-575c-400b-b59f-57218a9e0c8f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:48.223535 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ecac791-575c-400b-b59f-57218a9e0c8f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:48.224054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ecac791-575c-400b-b59f-57218a9e0c8f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:48.224490 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ecac791-575c-400b-b59f-57218a9e0c8f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:48.225549 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ecac791-575c-400b-b59f-57218a9e0c8f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:48.225718 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ecac791-575c-400b-b59f-57218a9e0c8f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:48.226136 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ecac791-575c-400b-b59f-57218a9e0c8f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:48.426097 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1ecac791-575c-400b-b59f-57218a9e0c8f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fff4805e6fb45a0b7c8b4dc08c4dedb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c2cdfddf5b4d35a0ca3c7554271365', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:48.434943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:48.444551 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1ecac791-575c-400b-b59f-57218a9e0c8f tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 200 len: 1427 microversion: 2.1 time: 0.240758 Sep 17 21:01:48.452434 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1382/2835] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:48 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 1427 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:48.461288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-61ace006-8860-4b47-87d5-71e67687e2a1 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a481daf0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:48.537873 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-61ace006-8860-4b47-87d5-71e67687e2a1 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57" status: 200 len: 1452 microversion: 2.1 time: 0.083160 Sep 17 21:01:48.546489 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1383/2836] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:01:48 2022] GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57 => generated 1452 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:48.559739 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6d24adc7-e120-4bef-bacd-6a1a0af0fcf9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2002022253", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:48.570450 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-6d24adc7-e120-4bef-bacd-6a1a0af0fcf9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6d24adc7-e120-4bef-bacd-6a1a0af0fcf9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 216 Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2002022253", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2002022253', 'imageRef': '1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._validate_network_id( Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:48.572352 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:48.577377 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:48.577377 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:48.577377 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:48.577377 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:01:48.577377 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:01:48.577377 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 17 21:01:48.577377 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:48.577377 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6d24adc7-e120-4bef-bacd-6a1a0af0fcf9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:01:48.577377 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6d24adc7-e120-4bef-bacd-6a1a0af0fcf9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.023571 Sep 17 21:01:48.586955 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1384/2837] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:01:48 2022] POST /compute/v2.1/servers => generated 123 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:01:48.594557 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ee24439b-a5c0-490c-9031-af689bc44c85 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:48.595452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ee24439b-a5c0-490c-9031-af689bc44c85 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:48.602935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee24439b-a5c0-490c-9031-af689bc44c85 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:48.603464 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee24439b-a5c0-490c-9031-af689bc44c85 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:48.603902 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee24439b-a5c0-490c-9031-af689bc44c85 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:48.604605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee24439b-a5c0-490c-9031-af689bc44c85 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:48.605365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee24439b-a5c0-490c-9031-af689bc44c85 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:48.605819 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee24439b-a5c0-490c-9031-af689bc44c85 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:48.621301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d723b4a0-5d6e-4536-86ba-c996c33c3e2c tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5d41f7e95d44d3898f6306bb093ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8813aaee4604882b4cd7a2a8df58077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:48.641196 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d723b4a0-5d6e-4536-86ba-c996c33c3e2c tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297" status: 200 len: 1679 microversion: 2.1 time: 0.497225 Sep 17 21:01:48.643272 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1454/2838] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:48 2022] GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297 => generated 1679 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:48.653670 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1458aa91-ce55-4298-be78-11b0dadd1464 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:48.654690 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1458aa91-ce55-4298-be78-11b0dadd1464 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:48.665846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1458aa91-ce55-4298-be78-11b0dadd1464 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:48.666610 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1458aa91-ce55-4298-be78-11b0dadd1464 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:48.667220 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1458aa91-ce55-4298-be78-11b0dadd1464 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:48.668112 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1458aa91-ce55-4298-be78-11b0dadd1464 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:48.668737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1458aa91-ce55-4298-be78-11b0dadd1464 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:48.669327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1458aa91-ce55-4298-be78-11b0dadd1464 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:48.800724 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1458aa91-ce55-4298-be78-11b0dadd1464 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:48.811397 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1458aa91-ce55-4298-be78-11b0dadd1464 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1297 microversion: 2.1 time: 0.166584 Sep 17 21:01:48.828780 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1455/2839] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:48 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1297 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:48.834159 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-fd990de7-c661-4f7e-b4d0-78581406f53c req-e141b9fd-1775-405d-9a58-d7f5e4a9bac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cbeb946-182e-4489-b637-556194f5722e", "name": "network-vif-deleted", "tag": "37410e23-230b-4735-b847-6de46f2c7ac9"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:48.846243 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-fd990de7-c661-4f7e-b4d0-78581406f53c req-e141b9fd-1775-405d-9a58-d7f5e4a9bac4 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:48.846922 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-fd990de7-c661-4f7e-b4d0-78581406f53c req-e141b9fd-1775-405d-9a58-d7f5e4a9bac4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:48.847343 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-fd990de7-c661-4f7e-b4d0-78581406f53c req-e141b9fd-1775-405d-9a58-d7f5e4a9bac4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:48.862917 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-fd990de7-c661-4f7e-b4d0-78581406f53c req-e141b9fd-1775-405d-9a58-d7f5e4a9bac4 service nova] Creating event network-vif-deleted:37410e23-230b-4735-b847-6de46f2c7ac9 for instance 8cbeb946-182e-4489-b637-556194f5722e on nch1-master-1 Sep 17 21:01:48.868947 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-fd990de7-c661-4f7e-b4d0-78581406f53c req-e141b9fd-1775-405d-9a58-d7f5e4a9bac4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038844 Sep 17 21:01:48.870908 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1456/2840] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:48.879134 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b3141c45-697c-48c7-9582-084c4d482cd1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:48.884129 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b3141c45-697c-48c7-9582-084c4d482cd1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:48.895767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3141c45-697c-48c7-9582-084c4d482cd1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:48.897063 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3141c45-697c-48c7-9582-084c4d482cd1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:48.898121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3141c45-697c-48c7-9582-084c4d482cd1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:48.899357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3141c45-697c-48c7-9582-084c4d482cd1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:48.899983 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3141c45-697c-48c7-9582-084c4d482cd1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:48.900563 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3141c45-697c-48c7-9582-084c4d482cd1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:49.148129 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ee24439b-a5c0-490c-9031-af689bc44c85 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:49.189381 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ee24439b-a5c0-490c-9031-af689bc44c85 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed" status: 200 len: 1313 microversion: 2.1 time: 0.582091 Sep 17 21:01:49.207542 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1385/2841] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:48 2022] GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed => generated 1313 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:49.215406 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ee24439b-a5c0-490c-9031-af689bc44c85 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:49.221565 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ee24439b-a5c0-490c-9031-af689bc44c85 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute//" status: 200 len: 377 microversion: - time: 0.009438 Sep 17 21:01:49.222000 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1386/2842] 10.222.0.26 () {56 vars in 886 bytes} [Sat Sep 17 21:01:49 2022] GET /compute/ => generated 377 bytes in 14 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 17 21:01:49.247047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5ddac047-b149-423d-9502-6ef11f621eb5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:49.247988 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5ddac047-b149-423d-9502-6ef11f621eb5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: e2ed2483-1241-4242-83e3-3345fffcbe30] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:49.259028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ddac047-b149-423d-9502-6ef11f621eb5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:49.260165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ddac047-b149-423d-9502-6ef11f621eb5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:49.263821 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ddac047-b149-423d-9502-6ef11f621eb5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:49.265530 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ddac047-b149-423d-9502-6ef11f621eb5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:49.266181 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ddac047-b149-423d-9502-6ef11f621eb5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:49.267700 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ddac047-b149-423d-9502-6ef11f621eb5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:49.729297 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b3141c45-697c-48c7-9582-084c4d482cd1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:49.739336 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b3141c45-697c-48c7-9582-084c4d482cd1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.866995 Sep 17 21:01:49.739932 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1457/2843] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:48 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:49.745150 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bb230efa-6b10-429c-bbfe-5f6fc95fc340 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:49.746093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bb230efa-6b10-429c-bbfe-5f6fc95fc340 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] [instance: 8cbeb946-182e-4489-b637-556194f5722e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:49.753440 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bb230efa-6b10-429c-bbfe-5f6fc95fc340 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:49.754258 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bb230efa-6b10-429c-bbfe-5f6fc95fc340 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:49.754862 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bb230efa-6b10-429c-bbfe-5f6fc95fc340 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:49.755953 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bb230efa-6b10-429c-bbfe-5f6fc95fc340 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:49.756844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bb230efa-6b10-429c-bbfe-5f6fc95fc340 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:49.757424 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bb230efa-6b10-429c-bbfe-5f6fc95fc340 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:49.774806 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-bb230efa-6b10-429c-bbfe-5f6fc95fc340 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] HTTP exception thrown: Instance 8cbeb946-182e-4489-b637-556194f5722e could not be found. Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bb230efa-6b10-429c-bbfe-5f6fc95fc340 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Request method failure captured: Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e HTTP/1.1 Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjUZCcfqWYQHjeu0EoKgBCtDWrCfo8uQ_TiE9mGv0sk76_eAsFjjzkwhVlzRs8RNjGK925n3-XSkuzNq7reJIA0_tJTccmw-0VCxFcV2wp1Vfo6dUWaNyLxeBa3ok0b3mLImUT2vR0g0z1jqHjL-UKSqtwkz0BcygSuLNEFkd37E12U Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: a0c2cdfddf5b4d35a0ca3c7554271365 Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersAdminTestJSON-871444303 Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a0c2cdfddf5b4d35a0ca3c7554271365"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a0c2cdfddf5b4d35a0ca3c7554271365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a0c2cdfddf5b4d35a0ca3c7554271365"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a0c2cdfddf5b4d35a0ca3c7554271365", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersAdminTestJSON-871444303 Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: a0c2cdfddf5b4d35a0ca3c7554271365 Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersAdminTestJSON-871444303 Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersAdminTestJSON-871444303-project Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 1fff4805e6fb45a0b7c8b4dc08c4dedb Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersAdminTestJSON-871444303-project Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 8cbeb946-182e-4489-b637-556194f5722e could not be found. Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '8cbeb946-182e-4489-b637-556194f5722e'} Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cbeb946-182e-4489-b637-556194f5722e could not be found. Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cbeb946-182e-4489-b637-556194f5722e could not be found. Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:49.776362 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:49.781090 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:49.781090 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:49.781090 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:49.781090 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:01:49.781090 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:01:49.781090 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cbeb946-182e-4489-b637-556194f5722e could not be found. Sep 17 21:01:49.781090 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:49.781090 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bb230efa-6b10-429c-bbfe-5f6fc95fc340 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] Returning 404 to user: Instance 8cbeb946-182e-4489-b637-556194f5722e could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:01:49.781090 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bb230efa-6b10-429c-bbfe-5f6fc95fc340 tempest-ServersAdminTestJSON-871444303 tempest-ServersAdminTestJSON-871444303-project] 10.222.0.26 "GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e" status: 404 len: 111 microversion: 2.1 time: 0.036738 Sep 17 21:01:49.781090 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1458/2844] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:49 2022] GET /compute/v2.1/servers/8cbeb946-182e-4489-b637-556194f5722e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:01:49.787778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c0c8477c-b7dd-4a6a-abb7-22aa67b67d50 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a4310940>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:49.844166 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c0c8477c-b7dd-4a6a-abb7-22aa67b67d50 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57" status: 200 len: 1452 microversion: 2.1 time: 0.064236 Sep 17 21:01:49.844974 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1459/2845] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:01:49 2022] GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57 => generated 1452 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:49.851217 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0c6cede8-aa0a-4489-af6a-d4f225519c56 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:49.851902 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0c6cede8-aa0a-4489-af6a-d4f225519c56 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:49.861128 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c6cede8-aa0a-4489-af6a-d4f225519c56 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:49.862084 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c6cede8-aa0a-4489-af6a-d4f225519c56 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:49.862844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c6cede8-aa0a-4489-af6a-d4f225519c56 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:49.864049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c6cede8-aa0a-4489-af6a-d4f225519c56 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:49.864714 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c6cede8-aa0a-4489-af6a-d4f225519c56 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:49.865379 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c6cede8-aa0a-4489-af6a-d4f225519c56 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:50.137766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5ddac047-b149-423d-9502-6ef11f621eb5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:50.147213 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5ddac047-b149-423d-9502-6ef11f621eb5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ed2483-1241-4242-83e3-3345fffcbe30" status: 200 len: 1324 microversion: 2.1 time: 0.914043 Sep 17 21:01:50.147788 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1387/2846] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:49 2022] GET /compute/v2.1/servers/e2ed2483-1241-4242-83e3-3345fffcbe30 => generated 1324 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:50.157044 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-18902507-564b-42d1-94c1-1c4f7bfd1eb8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:50.157684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-18902507-564b-42d1-94c1-1c4f7bfd1eb8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:50.170399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-18902507-564b-42d1-94c1-1c4f7bfd1eb8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:50.171689 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-18902507-564b-42d1-94c1-1c4f7bfd1eb8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:50.172134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-18902507-564b-42d1-94c1-1c4f7bfd1eb8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:50.172854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-18902507-564b-42d1-94c1-1c4f7bfd1eb8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:50.173492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-18902507-564b-42d1-94c1-1c4f7bfd1eb8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:50.174083 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-18902507-564b-42d1-94c1-1c4f7bfd1eb8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:50.338595 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0c6cede8-aa0a-4489-af6a-d4f225519c56 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5d41f7e95d44d3898f6306bb093ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8813aaee4604882b4cd7a2a8df58077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:50.355628 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0c6cede8-aa0a-4489-af6a-d4f225519c56 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297" status: 200 len: 1679 microversion: 2.1 time: 0.509441 Sep 17 21:01:50.356635 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1460/2847] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:49 2022] GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297 => generated 1679 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:50.362522 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1a5d151a-0e74-4d40-9d3b-86cb3ca02de3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:50.363746 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1a5d151a-0e74-4d40-9d3b-86cb3ca02de3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:50.380231 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a5d151a-0e74-4d40-9d3b-86cb3ca02de3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:50.380981 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a5d151a-0e74-4d40-9d3b-86cb3ca02de3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:50.381784 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a5d151a-0e74-4d40-9d3b-86cb3ca02de3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:50.382988 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a5d151a-0e74-4d40-9d3b-86cb3ca02de3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:50.384427 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a5d151a-0e74-4d40-9d3b-86cb3ca02de3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:50.384981 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a5d151a-0e74-4d40-9d3b-86cb3ca02de3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:50.813886 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-18902507-564b-42d1-94c1-1c4f7bfd1eb8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:50.857171 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-18902507-564b-42d1-94c1-1c4f7bfd1eb8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.706947 Sep 17 21:01:50.877907 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1388/2848] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:50 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:50.894203 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0e4002f4-3fc6-4fc1-b0f3-9969e8eae59b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:50.895616 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0e4002f4-3fc6-4fc1-b0f3-9969e8eae59b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:50.903467 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e4002f4-3fc6-4fc1-b0f3-9969e8eae59b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:50.904205 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e4002f4-3fc6-4fc1-b0f3-9969e8eae59b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:50.905288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e4002f4-3fc6-4fc1-b0f3-9969e8eae59b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:50.906315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e4002f4-3fc6-4fc1-b0f3-9969e8eae59b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:50.906950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e4002f4-3fc6-4fc1-b0f3-9969e8eae59b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:50.907566 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e4002f4-3fc6-4fc1-b0f3-9969e8eae59b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:51.851479 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1a5d151a-0e74-4d40-9d3b-86cb3ca02de3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:51.871212 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1a5d151a-0e74-4d40-9d3b-86cb3ca02de3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1365 microversion: 2.1 time: 1.513068 Sep 17 21:01:51.894072 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1461/2849] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:50 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1365 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:51.916671 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-62b89c4f-9cd5-461a-bd1a-0041ff6a2bb2 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a54f0670>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:52.026898 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-62b89c4f-9cd5-461a-bd1a-0041ff6a2bb2 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57" status: 200 len: 1452 microversion: 2.1 time: 0.130482 Sep 17 21:01:52.028640 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1462/2850] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:01:51 2022] GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57 => generated 1452 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:52.039955 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d9fd9449-5189-4e3d-982a-3e7b59e8b187 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:52.040991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d9fd9449-5189-4e3d-982a-3e7b59e8b187 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: e2ed2483-1241-4242-83e3-3345fffcbe30] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:52.050120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d9fd9449-5189-4e3d-982a-3e7b59e8b187 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:52.050974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d9fd9449-5189-4e3d-982a-3e7b59e8b187 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:52.051721 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d9fd9449-5189-4e3d-982a-3e7b59e8b187 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:52.052725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d9fd9449-5189-4e3d-982a-3e7b59e8b187 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:52.053475 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d9fd9449-5189-4e3d-982a-3e7b59e8b187 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:52.054173 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d9fd9449-5189-4e3d-982a-3e7b59e8b187 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:52.509315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0e4002f4-3fc6-4fc1-b0f3-9969e8eae59b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:52.522648 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0e4002f4-3fc6-4fc1-b0f3-9969e8eae59b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed" status: 200 len: 1313 microversion: 2.1 time: 1.643464 Sep 17 21:01:52.539097 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1389/2851] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:50 2022] GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed => generated 1313 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:52.560320 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8633cbe6-fe44-4f25-8307-35fab1272f8c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1603091689", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "key_name": "tempest-key-1247980205", "networks": [{"uuid": "dc0ab76b-95f3-4f0a-beab-7465ea19ce7a"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:52.664304 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-8633cbe6-fe44-4f25-8307-35fab1272f8c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] validate_networks() for [('dc0ab76b-95f3-4f0a-beab-7465ea19ce7a', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:01:52.698544 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=4 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:52.797340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:52.845864 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=10 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:53.100668 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d9fd9449-5189-4e3d-982a-3e7b59e8b187 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:53.112716 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d9fd9449-5189-4e3d-982a-3e7b59e8b187 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ed2483-1241-4242-83e3-3345fffcbe30" status: 200 len: 1519 microversion: 2.1 time: 1.082478 Sep 17 21:01:53.129750 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1463/2852] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:52 2022] GET /compute/v2.1/servers/e2ed2483-1241-4242-83e3-3345fffcbe30 => generated 1519 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:53.146459 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6563d16c-546b-4281-8be1-abf3f2a84b9a tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:53.147140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6563d16c-546b-4281-8be1-abf3f2a84b9a tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:53.174277 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6563d16c-546b-4281-8be1-abf3f2a84b9a tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:53.175044 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6563d16c-546b-4281-8be1-abf3f2a84b9a tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:53.175509 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6563d16c-546b-4281-8be1-abf3f2a84b9a tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:53.176289 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6563d16c-546b-4281-8be1-abf3f2a84b9a tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:53.176744 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6563d16c-546b-4281-8be1-abf3f2a84b9a tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:53.182475 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6563d16c-546b-4281-8be1-abf3f2a84b9a tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:53.519513 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6563d16c-546b-4281-8be1-abf3f2a84b9a tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5d41f7e95d44d3898f6306bb093ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8813aaee4604882b4cd7a2a8df58077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:53.534428 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-8633cbe6-fe44-4f25-8307-35fab1272f8c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Invalid key_name provided. Sep 17 21:01:53.537229 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6563d16c-546b-4281-8be1-abf3f2a84b9a tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297" status: 200 len: 1612 microversion: 2.1 time: 0.413048 Sep 17 21:01:53.538097 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1464/2853] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:53 2022] GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297 => generated 1612 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8633cbe6-fe44-4f25-8307-35fab1272f8c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 247 Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1603091689", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "key_name": "tempest-key-1247980205", "networks": [{"uuid": "dc0ab76b-95f3-4f0a-beab-7465ea19ce7a"}]}} Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: exception: Invalid key_name provided. Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1603091689', 'imageRef': '1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4', 'flavorRef': '452', 'key_name': 'tempest-key-1247980205', 'networks': [{'uuid': 'dc0ab76b-95f3-4f0a-beab-7465ea19ce7a'}]}}} Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1247980205 not found for user 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:53.545763 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:53.553756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:53.553756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:01:53.553756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:01:53.553756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:01:53.553756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:01:53.553756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:01:53.553756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:01:53.553756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:01:53.553756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:01:53.553756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:01:53.553756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:01:53.553756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 17 21:01:53.553756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Sep 17 21:01:53.553756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 17 21:01:53.553756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Sep 17 21:01:53.553756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:53.553756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:53.553756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:53.553756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:53.553756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:53.553756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:53.553756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:01:53.553756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:01:53.553756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Sep 17 21:01:53.553756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:53.553756 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8633cbe6-fe44-4f25-8307-35fab1272f8c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 400 to user: Invalid key_name provided. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:01:53.553756 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8633cbe6-fe44-4f25-8307-35fab1272f8c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.999597 Sep 17 21:01:53.553756 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1390/2854] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:01:52 2022] POST /compute/v2.1/servers => generated 70 bytes in 1008 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 17 21:01:53.559626 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-1d68e5d1-73a9-4a8a-b478-2188afcc7c2e req-e6bcd660-2fff-440f-b183-ed74b142ee83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed", "tag": "c50dd621-0204-45a5-877f-f63e4b02207a"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:53.560941 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-fd93ffb4-f5f1-4c74-adc8-9032c59cfc63 req-f6417d09-db89-404b-b4c6-06cc130b6352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f", "name": "network-vif-plugged", "status": "completed", "tag": "5273e052-362a-499b-8afd-752c94502a05"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:53.590474 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-fd93ffb4-f5f1-4c74-adc8-9032c59cfc63 req-f6417d09-db89-404b-b4c6-06cc130b6352 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:53.590961 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-fd93ffb4-f5f1-4c74-adc8-9032c59cfc63 req-f6417d09-db89-404b-b4c6-06cc130b6352 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:53.591399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-fd93ffb4-f5f1-4c74-adc8-9032c59cfc63 req-f6417d09-db89-404b-b4c6-06cc130b6352 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:53.593083 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-1d68e5d1-73a9-4a8a-b478-2188afcc7c2e req-e6bcd660-2fff-440f-b183-ed74b142ee83 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:53.596062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-1d68e5d1-73a9-4a8a-b478-2188afcc7c2e req-e6bcd660-2fff-440f-b183-ed74b142ee83 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:53.596643 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-1d68e5d1-73a9-4a8a-b478-2188afcc7c2e req-e6bcd660-2fff-440f-b183-ed74b142ee83 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:53.623907 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-fd93ffb4-f5f1-4c74-adc8-9032c59cfc63 req-f6417d09-db89-404b-b4c6-06cc130b6352 service nova] Creating event network-vif-plugged:5273e052-362a-499b-8afd-752c94502a05 for instance 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f on nch2-master-1 Sep 17 21:01:53.631143 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-fd93ffb4-f5f1-4c74-adc8-9032c59cfc63 req-f6417d09-db89-404b-b4c6-06cc130b6352 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081195 Sep 17 21:01:53.637727 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1391/2855] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:53.644125 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2129a055-ea9a-4e27-927d-2cc8173fc442 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:53.645111 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2129a055-ea9a-4e27-927d-2cc8173fc442 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:53.657099 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-1d68e5d1-73a9-4a8a-b478-2188afcc7c2e req-e6bcd660-2fff-440f-b183-ed74b142ee83 service nova] Creating event network-changed:c50dd621-0204-45a5-877f-f63e4b02207a for instance 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed on nch1-master-1 Sep 17 21:01:53.658974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2129a055-ea9a-4e27-927d-2cc8173fc442 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:53.659726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2129a055-ea9a-4e27-927d-2cc8173fc442 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:53.660346 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2129a055-ea9a-4e27-927d-2cc8173fc442 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:53.661239 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2129a055-ea9a-4e27-927d-2cc8173fc442 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:53.662121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2129a055-ea9a-4e27-927d-2cc8173fc442 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:53.666738 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2129a055-ea9a-4e27-927d-2cc8173fc442 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:53.699298 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-1d68e5d1-73a9-4a8a-b478-2188afcc7c2e req-e6bcd660-2fff-440f-b183-ed74b142ee83 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157661 Sep 17 21:01:53.708273 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1465/2856] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:53.726954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-68d99378-cde5-4376-ad77-974d57734131 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a42f2ca0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:53.829710 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-68d99378-cde5-4376-ad77-974d57734131 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57" status: 200 len: 1452 microversion: 2.1 time: 0.120264 Sep 17 21:01:53.832818 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1466/2857] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:01:53 2022] GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57 => generated 1452 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:53.839274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-09805758-d234-417a-ba48-f3e1ad4f9701 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:53.849025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-09805758-d234-417a-ba48-f3e1ad4f9701 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: e2ed2483-1241-4242-83e3-3345fffcbe30] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:53.876326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09805758-d234-417a-ba48-f3e1ad4f9701 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:53.882330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09805758-d234-417a-ba48-f3e1ad4f9701 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:53.885746 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09805758-d234-417a-ba48-f3e1ad4f9701 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:53.888256 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09805758-d234-417a-ba48-f3e1ad4f9701 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:53.893391 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09805758-d234-417a-ba48-f3e1ad4f9701 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:53.894028 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09805758-d234-417a-ba48-f3e1ad4f9701 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:54.000256 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-09805758-d234-417a-ba48-f3e1ad4f9701 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: e2ed2483-1241-4242-83e3-3345fffcbe30] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:01:54.089883 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=18 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:54.203685 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-09805758-d234-417a-ba48-f3e1ad4f9701 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e2ed2483-1241-4242-83e3-3345fffcbe30" status: 204 len: 0 microversion: 2.1 time: 0.368560 Sep 17 21:01:54.209065 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1467/2858] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:01:53 2022] DELETE /compute/v2.1/servers/e2ed2483-1241-4242-83e3-3345fffcbe30 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:01:54.222085 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fe48d884-84c3-42a5-8f11-97d1ad1c835d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:54.222816 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fe48d884-84c3-42a5-8f11-97d1ad1c835d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:54.234879 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe48d884-84c3-42a5-8f11-97d1ad1c835d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:54.236077 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe48d884-84c3-42a5-8f11-97d1ad1c835d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:54.236634 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe48d884-84c3-42a5-8f11-97d1ad1c835d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:54.237379 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe48d884-84c3-42a5-8f11-97d1ad1c835d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:54.237894 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe48d884-84c3-42a5-8f11-97d1ad1c835d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:54.238371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe48d884-84c3-42a5-8f11-97d1ad1c835d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:54.420922 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2129a055-ea9a-4e27-927d-2cc8173fc442 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:54.433522 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2129a055-ea9a-4e27-927d-2cc8173fc442 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1365 microversion: 2.1 time: 0.793691 Sep 17 21:01:54.437287 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1392/2859] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:53 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1365 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:54.464157 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-273caf4c-4775-4905-865c-530202ef769a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:54.478747 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-273caf4c-4775-4905-865c-530202ef769a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:54.491530 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-273caf4c-4775-4905-865c-530202ef769a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:54.492440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-273caf4c-4775-4905-865c-530202ef769a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:54.497288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-273caf4c-4775-4905-865c-530202ef769a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:54.498299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-273caf4c-4775-4905-865c-530202ef769a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:54.500354 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-273caf4c-4775-4905-865c-530202ef769a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:54.502283 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-273caf4c-4775-4905-865c-530202ef769a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:54.749032 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fe48d884-84c3-42a5-8f11-97d1ad1c835d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:54.766303 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fe48d884-84c3-42a5-8f11-97d1ad1c835d tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed" status: 200 len: 1313 microversion: 2.1 time: 0.553429 Sep 17 21:01:54.767482 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1468/2860] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:54 2022] GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed => generated 1313 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:54.774276 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f6251586-297f-4328-8968-1528373c7dfa tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:54.775118 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f6251586-297f-4328-8968-1528373c7dfa tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: e2ed2483-1241-4242-83e3-3345fffcbe30] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:54.789433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6251586-297f-4328-8968-1528373c7dfa tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:54.791837 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6251586-297f-4328-8968-1528373c7dfa tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:54.792464 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6251586-297f-4328-8968-1528373c7dfa tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:54.793384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6251586-297f-4328-8968-1528373c7dfa tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:54.794049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6251586-297f-4328-8968-1528373c7dfa tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:54.794641 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6251586-297f-4328-8968-1528373c7dfa tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:55.214657 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-273caf4c-4775-4905-865c-530202ef769a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:55.224510 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-273caf4c-4775-4905-865c-530202ef769a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.785179 Sep 17 21:01:55.230364 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1393/2861] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:54 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:55.243475 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c3a46dbc-2ec1-4c6d-91c0-94b0fb3decf4 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:55.244393 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c3a46dbc-2ec1-4c6d-91c0-94b0fb3decf4 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:55.250554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:55.264990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3a46dbc-2ec1-4c6d-91c0-94b0fb3decf4 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:55.268925 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3a46dbc-2ec1-4c6d-91c0-94b0fb3decf4 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:55.269611 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3a46dbc-2ec1-4c6d-91c0-94b0fb3decf4 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:55.270426 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3a46dbc-2ec1-4c6d-91c0-94b0fb3decf4 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:55.270838 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3a46dbc-2ec1-4c6d-91c0-94b0fb3decf4 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:55.271278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3a46dbc-2ec1-4c6d-91c0-94b0fb3decf4 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:55.346929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f6251586-297f-4328-8968-1528373c7dfa tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:55.363403 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f6251586-297f-4328-8968-1528373c7dfa tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ed2483-1241-4242-83e3-3345fffcbe30" status: 200 len: 1525 microversion: 2.1 time: 0.594646 Sep 17 21:01:55.364009 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1469/2862] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:54 2022] GET /compute/v2.1/servers/e2ed2483-1241-4242-83e3-3345fffcbe30 => generated 1525 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:55.447096 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c3a46dbc-2ec1-4c6d-91c0-94b0fb3decf4 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da5d41f7e95d44d3898f6306bb093ed7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8813aaee4604882b4cd7a2a8df58077', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:55.459829 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c3a46dbc-2ec1-4c6d-91c0-94b0fb3decf4 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297" status: 200 len: 1612 microversion: 2.1 time: 0.226712 Sep 17 21:01:55.476667 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1394/2863] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:55 2022] GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297 => generated 1612 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:55.485751 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-79eed387-d8b1-4b23-a0cb-b979b42eb615 req-cea82652-47a6-45b7-b613-141ecb8be45a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41393a54-9105-4da5-ae65-3167427ddae8", "tag": "4d47e229-8239-4215-8c5c-b5133bcfb47b"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:55.498697 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-79eed387-d8b1-4b23-a0cb-b979b42eb615 req-cea82652-47a6-45b7-b613-141ecb8be45a service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:55.499445 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-79eed387-d8b1-4b23-a0cb-b979b42eb615 req-cea82652-47a6-45b7-b613-141ecb8be45a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:55.502277 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-79eed387-d8b1-4b23-a0cb-b979b42eb615 req-cea82652-47a6-45b7-b613-141ecb8be45a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:55.538739 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-79eed387-d8b1-4b23-a0cb-b979b42eb615 req-cea82652-47a6-45b7-b613-141ecb8be45a service nova] Creating event network-changed:4d47e229-8239-4215-8c5c-b5133bcfb47b for instance 41393a54-9105-4da5-ae65-3167427ddae8 on nch1-master-1 Sep 17 21:01:55.550552 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-79eed387-d8b1-4b23-a0cb-b979b42eb615 req-cea82652-47a6-45b7-b613-141ecb8be45a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067501 Sep 17 21:01:55.553212 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1395/2864] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:55.567708 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5ff5dcd8-f0a0-4183-9606-778fbd770ad9 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a47d24c0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:55.586944 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c0b4a297-004f-4bf9-a9a6-37b6c56b0f22 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-634089461", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": "none"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:55.643249 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5ff5dcd8-f0a0-4183-9606-778fbd770ad9 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57" status: 200 len: 1452 microversion: 2.1 time: 0.088714 Sep 17 21:01:55.646540 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1396/2865] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:01:55 2022] GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57 => generated 1452 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:55.657753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-872536ba-ee97-45ff-868f-e38fefdb3370 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:55.660595 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-872536ba-ee97-45ff-868f-e38fefdb3370 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:55.690492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-872536ba-ee97-45ff-868f-e38fefdb3370 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:55.691021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-872536ba-ee97-45ff-868f-e38fefdb3370 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:55.693872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-872536ba-ee97-45ff-868f-e38fefdb3370 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:55.696076 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-872536ba-ee97-45ff-868f-e38fefdb3370 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:55.698165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-872536ba-ee97-45ff-868f-e38fefdb3370 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:55.698821 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-872536ba-ee97-45ff-868f-e38fefdb3370 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:55.719119 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-c0b4a297-004f-4bf9-a9a6-37b6c56b0f22 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:01:55.719552 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-c0b4a297-004f-4bf9-a9a6-37b6c56b0f22 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:01:55.720031 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-c0b4a297-004f-4bf9-a9a6-37b6c56b0f22 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:01:55.720452 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-c0b4a297-004f-4bf9-a9a6-37b6c56b0f22 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:01:55.720869 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-c0b4a297-004f-4bf9-a9a6-37b6c56b0f22 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:01:55.751973 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0b4a297-004f-4bf9-a9a6-37b6c56b0f22 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:55.752476 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0b4a297-004f-4bf9-a9a6-37b6c56b0f22 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:55.752921 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0b4a297-004f-4bf9-a9a6-37b6c56b0f22 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:55.753687 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0b4a297-004f-4bf9-a9a6-37b6c56b0f22 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:55.754336 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0b4a297-004f-4bf9-a9a6-37b6c56b0f22 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:55.754770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0b4a297-004f-4bf9-a9a6-37b6c56b0f22 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:55.774253 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-c0b4a297-004f-4bf9-a9a6-37b6c56b0f22 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Getting quotas for project 1894770a3dfd4dd2aaa4a2b02f9a7f36. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:01:55.780650 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:55.782131 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-c0b4a297-004f-4bf9-a9a6-37b6c56b0f22 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Getting quotas for user e570c2dfca474a089d281ac21a859e98 and project 1894770a3dfd4dd2aaa4a2b02f9a7f36. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:01:55.798220 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c0b4a297-004f-4bf9-a9a6-37b6c56b0f22 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:01:55.800857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c0b4a297-004f-4bf9-a9a6-37b6c56b0f22 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:01:55.864920 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c0b4a297-004f-4bf9-a9a6-37b6c56b0f22 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.489843 Sep 17 21:01:55.872606 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1470/2866] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Sep 17 21:01:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 17 21:01:55.880595 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8fd5ebcd-8cec-4dfb-b639-eeebbc0def90 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:55.881580 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8fd5ebcd-8cec-4dfb-b639-eeebbc0def90 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:55.896040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8fd5ebcd-8cec-4dfb-b639-eeebbc0def90 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:55.899881 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8fd5ebcd-8cec-4dfb-b639-eeebbc0def90 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:55.901191 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8fd5ebcd-8cec-4dfb-b639-eeebbc0def90 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:55.904680 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8fd5ebcd-8cec-4dfb-b639-eeebbc0def90 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:55.905759 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8fd5ebcd-8cec-4dfb-b639-eeebbc0def90 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:55.906618 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8fd5ebcd-8cec-4dfb-b639-eeebbc0def90 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:56.858350 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8fd5ebcd-8cec-4dfb-b639-eeebbc0def90 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:56.870097 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8fd5ebcd-8cec-4dfb-b639-eeebbc0def90 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1365 microversion: 2.1 time: 0.996005 Sep 17 21:01:56.883137 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-872536ba-ee97-45ff-868f-e38fefdb3370 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:56.888581 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1471/2867] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:55 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1365 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:56.895499 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-8b86ff3d-1d5b-4c54-b5a0-94080b08bed7 req-4d8332eb-e73a-4df9-bb2a-708bf35f9fbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a1dbfb5-be75-451c-8ca8-a71949ac2297", "name": "network-vif-unplugged", "status": "completed", "tag": "bb1dd815-ecd5-488c-93a4-3f015b5427ae"}, {"server_uuid": "19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed", "name": "network-vif-plugged", "status": "completed", "tag": "c50dd621-0204-45a5-877f-f63e4b02207a"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:56.900007 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-872536ba-ee97-45ff-868f-e38fefdb3370 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 1.248411 Sep 17 21:01:56.901052 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1397/2868] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:55 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:56.917199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f3b7d849-4086-4a89-bfb5-fb529d12badb tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:56.918711 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f3b7d849-4086-4a89-bfb5-fb529d12badb tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:56.939607 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f3b7d849-4086-4a89-bfb5-fb529d12badb tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:56.941310 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f3b7d849-4086-4a89-bfb5-fb529d12badb tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:56.943775 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f3b7d849-4086-4a89-bfb5-fb529d12badb tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:56.944701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f3b7d849-4086-4a89-bfb5-fb529d12badb tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:56.946772 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f3b7d849-4086-4a89-bfb5-fb529d12badb tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:56.950228 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f3b7d849-4086-4a89-bfb5-fb529d12badb tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:56.955670 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8b86ff3d-1d5b-4c54-b5a0-94080b08bed7 req-4d8332eb-e73a-4df9-bb2a-708bf35f9fbc service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:56.959437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8b86ff3d-1d5b-4c54-b5a0-94080b08bed7 req-4d8332eb-e73a-4df9-bb2a-708bf35f9fbc service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:56.960526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8b86ff3d-1d5b-4c54-b5a0-94080b08bed7 req-4d8332eb-e73a-4df9-bb2a-708bf35f9fbc service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:56.985192 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-8b86ff3d-1d5b-4c54-b5a0-94080b08bed7 req-4d8332eb-e73a-4df9-bb2a-708bf35f9fbc service nova] Creating event network-vif-unplugged:bb1dd815-ecd5-488c-93a4-3f015b5427ae for instance 6a1dbfb5-be75-451c-8ca8-a71949ac2297 on nch2-master-1 Sep 17 21:01:56.986041 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-8b86ff3d-1d5b-4c54-b5a0-94080b08bed7 req-4d8332eb-e73a-4df9-bb2a-708bf35f9fbc service nova] Creating event network-vif-plugged:c50dd621-0204-45a5-877f-f63e4b02207a for instance 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed on nch1-master-1 Sep 17 21:01:56.995631 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-8b86ff3d-1d5b-4c54-b5a0-94080b08bed7 req-4d8332eb-e73a-4df9-bb2a-708bf35f9fbc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.105416 Sep 17 21:01:56.996626 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1472/2869] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:57.005426 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f7a4bcfe-6483-4f9d-b0d4-b23292cf3521 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:57.006560 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f7a4bcfe-6483-4f9d-b0d4-b23292cf3521 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:57.014491 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7a4bcfe-6483-4f9d-b0d4-b23292cf3521 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:57.015395 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7a4bcfe-6483-4f9d-b0d4-b23292cf3521 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:57.016182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7a4bcfe-6483-4f9d-b0d4-b23292cf3521 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:57.017163 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7a4bcfe-6483-4f9d-b0d4-b23292cf3521 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:57.025057 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7a4bcfe-6483-4f9d-b0d4-b23292cf3521 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:57.025796 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7a4bcfe-6483-4f9d-b0d4-b23292cf3521 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:57.248604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f7a4bcfe-6483-4f9d-b0d4-b23292cf3521 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:57.258845 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f7a4bcfe-6483-4f9d-b0d4-b23292cf3521 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:57.261729 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f7a4bcfe-6483-4f9d-b0d4-b23292cf3521 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:57.266954 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f7a4bcfe-6483-4f9d-b0d4-b23292cf3521 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1504 microversion: 2.91 time: 0.268531 Sep 17 21:01:57.273522 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1473/2870] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:01:56 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1504 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:01:57.286162 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ade099dd-4ded-4e6f-aa0a-fea2d53dfd4f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:57.287555 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ade099dd-4ded-4e6f-aa0a-fea2d53dfd4f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: e2ed2483-1241-4242-83e3-3345fffcbe30] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:57.296959 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ade099dd-4ded-4e6f-aa0a-fea2d53dfd4f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:57.297552 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ade099dd-4ded-4e6f-aa0a-fea2d53dfd4f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:57.297992 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ade099dd-4ded-4e6f-aa0a-fea2d53dfd4f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:57.298697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ade099dd-4ded-4e6f-aa0a-fea2d53dfd4f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:57.299448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ade099dd-4ded-4e6f-aa0a-fea2d53dfd4f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:57.299753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ade099dd-4ded-4e6f-aa0a-fea2d53dfd4f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:57.481371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f3b7d849-4086-4a89-bfb5-fb529d12badb tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:57.497853 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f3b7d849-4086-4a89-bfb5-fb529d12badb tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed" status: 200 len: 1313 microversion: 2.1 time: 0.589580 Sep 17 21:01:57.508793 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1398/2871] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:56 2022] GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed => generated 1313 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:57.526376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6fc14286-39e5-43ed-8cc1-95e52654b447 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:57.527306 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6fc14286-39e5-43ed-8cc1-95e52654b447 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:57.552268 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fc14286-39e5-43ed-8cc1-95e52654b447 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:57.553168 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fc14286-39e5-43ed-8cc1-95e52654b447 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:57.553871 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fc14286-39e5-43ed-8cc1-95e52654b447 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:57.554936 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fc14286-39e5-43ed-8cc1-95e52654b447 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:57.558261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fc14286-39e5-43ed-8cc1-95e52654b447 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:57.559303 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fc14286-39e5-43ed-8cc1-95e52654b447 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:57.580315 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-6fc14286-39e5-43ed-8cc1-95e52654b447 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] HTTP exception thrown: Instance 6a1dbfb5-be75-451c-8ca8-a71949ac2297 could not be found. Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6fc14286-39e5-43ed-8cc1-95e52654b447 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Request method failure captured: Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297 HTTP/1.1 Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjUy248RU2v-XZp6hvI1gYczz9jQ0ysKnRWpYxm0dSmcyL_kzqqrYQpPkPyuJ8nOBGH2VXr-sfMeMn7YHBsw9RkvBEz6ryyZaYpxLkbtXeXGjziMJeTl-Dekz4DihZuPyeWnFJVt05ufh9E6yYDJI6l2T_43J8u6fzTL4Na10vSCYUc Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: f8813aaee4604882b4cd7a2a8df58077 Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2060044451 Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8813aaee4604882b4cd7a2a8df58077"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f8813aaee4604882b4cd7a2a8df58077"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8813aaee4604882b4cd7a2a8df58077"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f8813aaee4604882b4cd7a2a8df58077", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2060044451 Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: f8813aaee4604882b4cd7a2a8df58077 Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2060044451 Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-AttachSCSIVolumeTestJSON-2060044451-project Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: da5d41f7e95d44d3898f6306bb093ed7 Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2060044451-project Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 6a1dbfb5-be75-451c-8ca8-a71949ac2297 could not be found. Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '6a1dbfb5-be75-451c-8ca8-a71949ac2297'} Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a1dbfb5-be75-451c-8ca8-a71949ac2297 could not be found. Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a1dbfb5-be75-451c-8ca8-a71949ac2297 could not be found. Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:57.583128 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:57.587460 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:57.587460 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:57.587460 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:57.587460 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:01:57.587460 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:01:57.587460 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a1dbfb5-be75-451c-8ca8-a71949ac2297 could not be found. Sep 17 21:01:57.587460 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:57.588584 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6fc14286-39e5-43ed-8cc1-95e52654b447 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Returning 404 to user: Instance 6a1dbfb5-be75-451c-8ca8-a71949ac2297 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:01:57.589538 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6fc14286-39e5-43ed-8cc1-95e52654b447 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297" status: 404 len: 111 microversion: 2.1 time: 0.079222 Sep 17 21:01:57.590590 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1399/2872] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:57 2022] GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:01:57.614328 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8e250879-997a-461b-9442-59781af71f09 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a483bca0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:57.672541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ade099dd-4ded-4e6f-aa0a-fea2d53dfd4f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:57.690940 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ade099dd-4ded-4e6f-aa0a-fea2d53dfd4f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ed2483-1241-4242-83e3-3345fffcbe30" status: 200 len: 1525 microversion: 2.1 time: 0.417029 Sep 17 21:01:57.692373 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8e250879-997a-461b-9442-59781af71f09 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57" status: 200 len: 1452 microversion: 2.1 time: 0.100371 Sep 17 21:01:57.692813 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1474/2873] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:57 2022] GET /compute/v2.1/servers/e2ed2483-1241-4242-83e3-3345fffcbe30 => generated 1525 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:57.693493 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1400/2874] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:01:57 2022] GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57 => generated 1452 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:57.713383 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d0a385bf-5860-4f22-b0d0-0d300d6633b6 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Calling method '.version_select at 0x7f25a481af70>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:57.732591 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7a09e810-f1b5-4c2d-8b4a-d01ed210c443 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1819068338", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "dc0ab76b-95f3-4f0a-beab-7465ea19ce7a"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:57.802578 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d0a385bf-5860-4f22-b0d0-0d300d6633b6 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-73518827" status: 202 len: 0 microversion: 2.1 time: 0.107626 Sep 17 21:01:57.806582 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1401/2875] 10.222.0.26 () {58 vars in 1215 bytes} [Sat Sep 17 21:01:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-73518827 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:01:57.818116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-381a059c-80ef-4dbf-9024-2c508444f0b0 req-ba045707-b7eb-41ff-9879-c2df08ce8a5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a1dbfb5-be75-451c-8ca8-a71949ac2297", "name": "network-vif-deleted", "tag": "bb1dd815-ecd5-488c-93a4-3f015b5427ae"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:01:57.872163 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-381a059c-80ef-4dbf-9024-2c508444f0b0 req-ba045707-b7eb-41ff-9879-c2df08ce8a5c service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:57.878237 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-381a059c-80ef-4dbf-9024-2c508444f0b0 req-ba045707-b7eb-41ff-9879-c2df08ce8a5c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:57.886832 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-381a059c-80ef-4dbf-9024-2c508444f0b0 req-ba045707-b7eb-41ff-9879-c2df08ce8a5c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:57.927920 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-381a059c-80ef-4dbf-9024-2c508444f0b0 req-ba045707-b7eb-41ff-9879-c2df08ce8a5c service nova] Creating event network-vif-deleted:bb1dd815-ecd5-488c-93a4-3f015b5427ae for instance 6a1dbfb5-be75-451c-8ca8-a71949ac2297 on nch2-master-1 Sep 17 21:01:57.969394 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-381a059c-80ef-4dbf-9024-2c508444f0b0 req-ba045707-b7eb-41ff-9879-c2df08ce8a5c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163007 Sep 17 21:01:57.972234 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1402/2876] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:01:57.983567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2238793a-2dd8-470e-812a-6164661c28eb tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:57.995161 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2238793a-2dd8-470e-812a-6164661c28eb tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:58.014695 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2238793a-2dd8-470e-812a-6164661c28eb tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:58.015564 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2238793a-2dd8-470e-812a-6164661c28eb tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:58.016775 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2238793a-2dd8-470e-812a-6164661c28eb tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:58.019900 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2238793a-2dd8-470e-812a-6164661c28eb tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:58.020615 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2238793a-2dd8-470e-812a-6164661c28eb tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:58.021773 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2238793a-2dd8-470e-812a-6164661c28eb tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:58.120661 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.security_group_api [None req-7a09e810-f1b5-4c2d-8b4a-d01ed210c443 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Neutron security group does_not_exist not found {{(pid=140524) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Sep 17 21:01:58.121264 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-7a09e810-f1b5-4c2d-8b4a-d01ed210c443 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7a09e810-f1b5-4c2d-8b4a-d01ed210c443 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 258 Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1819068338", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "dc0ab76b-95f3-4f0a-beab-7465ea19ce7a"}]}} Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: exception: Unable to find security_group with name or id 'does_not_exist' Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1819068338', 'imageRef': '1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'dc0ab76b-95f3-4f0a-beab-7465ea19ce7a'}]}}} Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Sep 17 21:01:58.175000 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:01:58.179785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7a09e810-f1b5-4c2d-8b4a-d01ed210c443 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:01:58.184374 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7a09e810-f1b5-4c2d-8b4a-d01ed210c443 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.482293 Sep 17 21:01:58.184374 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1475/2877] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:01:57 2022] POST /compute/v2.1/servers => generated 106 bytes in 487 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:01:58.192562 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8b6170bf-b182-43b0-9751-d27be6261add tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:58.195348 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8b6170bf-b182-43b0-9751-d27be6261add tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:58.215668 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8b6170bf-b182-43b0-9751-d27be6261add tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:58.216189 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8b6170bf-b182-43b0-9751-d27be6261add tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:58.216629 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8b6170bf-b182-43b0-9751-d27be6261add tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:58.217369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8b6170bf-b182-43b0-9751-d27be6261add tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:58.217867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8b6170bf-b182-43b0-9751-d27be6261add tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:58.218301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8b6170bf-b182-43b0-9751-d27be6261add tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:58.243739 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:01:58.617699 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2238793a-2dd8-470e-812a-6164661c28eb tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:58.625685 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8b6170bf-b182-43b0-9751-d27be6261add tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:58.636173 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2238793a-2dd8-470e-812a-6164661c28eb tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1365 microversion: 2.1 time: 0.659176 Sep 17 21:01:58.638364 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1403/2878] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:57 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1365 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:58.642889 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8b6170bf-b182-43b0-9751-d27be6261add tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.460241 Sep 17 21:01:58.644625 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1476/2879] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:58 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:58.653802 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d03a9a0a-2b9a-4f28-ab5a-057fa7a6a302 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:58.654525 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d03a9a0a-2b9a-4f28-ab5a-057fa7a6a302 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:58.661357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-864b7f0c-d79c-4455-962e-59b9daba4f0b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:58.662041 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-864b7f0c-d79c-4455-962e-59b9daba4f0b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:58.667965 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d03a9a0a-2b9a-4f28-ab5a-057fa7a6a302 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:58.668695 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d03a9a0a-2b9a-4f28-ab5a-057fa7a6a302 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:58.678775 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d03a9a0a-2b9a-4f28-ab5a-057fa7a6a302 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:58.680148 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d03a9a0a-2b9a-4f28-ab5a-057fa7a6a302 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:58.680812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d03a9a0a-2b9a-4f28-ab5a-057fa7a6a302 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:58.682343 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d03a9a0a-2b9a-4f28-ab5a-057fa7a6a302 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:58.698028 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-864b7f0c-d79c-4455-962e-59b9daba4f0b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:58.698660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-864b7f0c-d79c-4455-962e-59b9daba4f0b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:58.700630 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-864b7f0c-d79c-4455-962e-59b9daba4f0b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:58.701423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-864b7f0c-d79c-4455-962e-59b9daba4f0b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:58.704830 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-864b7f0c-d79c-4455-962e-59b9daba4f0b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:58.705297 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-864b7f0c-d79c-4455-962e-59b9daba4f0b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:58.910793 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d03a9a0a-2b9a-4f28-ab5a-057fa7a6a302 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:58.923519 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d03a9a0a-2b9a-4f28-ab5a-057fa7a6a302 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:58.927830 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d03a9a0a-2b9a-4f28-ab5a-057fa7a6a302 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:58.942810 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d03a9a0a-2b9a-4f28-ab5a-057fa7a6a302 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1510 microversion: 2.91 time: 0.302318 Sep 17 21:01:58.944851 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1404/2880] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:01:58 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1510 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:01:58.962233 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5edefa58-54a5-417c-b2a1-8468ca319c63 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:58.962863 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5edefa58-54a5-417c-b2a1-8468ca319c63 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:58.986744 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5edefa58-54a5-417c-b2a1-8468ca319c63 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:58.990687 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5edefa58-54a5-417c-b2a1-8468ca319c63 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:58.991132 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5edefa58-54a5-417c-b2a1-8468ca319c63 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:58.991880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5edefa58-54a5-417c-b2a1-8468ca319c63 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:58.992456 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5edefa58-54a5-417c-b2a1-8468ca319c63 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:58.992894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5edefa58-54a5-417c-b2a1-8468ca319c63 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:59.222862 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-864b7f0c-d79c-4455-962e-59b9daba4f0b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:59.233376 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-864b7f0c-d79c-4455-962e-59b9daba4f0b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed" status: 200 len: 1313 microversion: 2.1 time: 0.586323 Sep 17 21:01:59.241427 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1477/2881] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:58 2022] GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed => generated 1313 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:59.253383 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5b347cdb-bd88-488f-80fd-d4e8af6039f2 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a436f550>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:59.321566 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5b347cdb-bd88-488f-80fd-d4e8af6039f2 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57" status: 200 len: 1452 microversion: 2.1 time: 0.078637 Sep 17 21:01:59.338005 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1478/2882] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:01:59 2022] GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57 => generated 1452 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:59.357346 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ff4bd72b-3ab5-4992-93d9-bd4126a5010a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:59.358502 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ff4bd72b-3ab5-4992-93d9-bd4126a5010a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: e2ed2483-1241-4242-83e3-3345fffcbe30] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:59.374801 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff4bd72b-3ab5-4992-93d9-bd4126a5010a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:59.375766 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff4bd72b-3ab5-4992-93d9-bd4126a5010a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:59.376483 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff4bd72b-3ab5-4992-93d9-bd4126a5010a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:59.378448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff4bd72b-3ab5-4992-93d9-bd4126a5010a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:59.379125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff4bd72b-3ab5-4992-93d9-bd4126a5010a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:59.384893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff4bd72b-3ab5-4992-93d9-bd4126a5010a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:59.470319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff4bd72b-3ab5-4992-93d9-bd4126a5010a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:59.471362 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff4bd72b-3ab5-4992-93d9-bd4126a5010a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:59.473901 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff4bd72b-3ab5-4992-93d9-bd4126a5010a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:59.475559 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-ff4bd72b-3ab5-4992-93d9-bd4126a5010a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lazy-loading 'fault' on Instance uuid e2ed2483-1241-4242-83e3-3345fffcbe30 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:01:59.580806 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5edefa58-54a5-417c-b2a1-8468ca319c63 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:59.597400 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5edefa58-54a5-417c-b2a1-8468ca319c63 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.646059 Sep 17 21:01:59.600923 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1405/2883] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:58 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:59.625541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c4fc4a18-00e1-4519-b50f-c3623d7c88d7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:59.626311 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c4fc4a18-00e1-4519-b50f-c3623d7c88d7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 8640b0db-f6a2-4544-b127-6ea09df07063] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:59.639672 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-c4fc4a18-00e1-4519-b50f-c3623d7c88d7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Instance 8640b0db-f6a2-4544-b127-6ea09df07063 could not be found. Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c4fc4a18-00e1-4519-b50f-c3623d7c88d7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/8640b0db-f6a2-4544-b127-6ea09df07063 HTTP/1.1 Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 8640b0db-f6a2-4544-b127-6ea09df07063 could not be found. Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '8640b0db-f6a2-4544-b127-6ea09df07063'} Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8640b0db-f6a2-4544-b127-6ea09df07063 could not be found. Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8640b0db-f6a2-4544-b127-6ea09df07063 could not be found. Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:59.642437 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:01:59.648211 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:59.648211 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:01:59.648211 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:01:59.648211 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:01:59.648211 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:01:59.648211 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:01:59.648211 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8640b0db-f6a2-4544-b127-6ea09df07063 could not be found. Sep 17 21:01:59.648211 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:01:59.651170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c4fc4a18-00e1-4519-b50f-c3623d7c88d7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 404 to user: Instance 8640b0db-f6a2-4544-b127-6ea09df07063 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:01:59.656190 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c4fc4a18-00e1-4519-b50f-c3623d7c88d7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8640b0db-f6a2-4544-b127-6ea09df07063" status: 404 len: 111 microversion: 2.1 time: 0.036437 Sep 17 21:01:59.656977 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1406/2884] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:01:59 2022] DELETE /compute/v2.1/servers/8640b0db-f6a2-4544-b127-6ea09df07063 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:01:59.666042 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4187a676-d748-486a-9575-92fe2517df8d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:59.678447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4187a676-d748-486a-9575-92fe2517df8d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:59.702506 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4187a676-d748-486a-9575-92fe2517df8d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:59.705771 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4187a676-d748-486a-9575-92fe2517df8d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:59.706392 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4187a676-d748-486a-9575-92fe2517df8d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:59.707285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4187a676-d748-486a-9575-92fe2517df8d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:59.708856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4187a676-d748-486a-9575-92fe2517df8d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:59.709298 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4187a676-d748-486a-9575-92fe2517df8d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:59.723466 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ff4bd72b-3ab5-4992-93d9-bd4126a5010a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22306a93c9404db393b92a267d6258d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '004f77fba4b14080bca4ae36c857add3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:01:59.731946 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ff4bd72b-3ab5-4992-93d9-bd4126a5010a tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ed2483-1241-4242-83e3-3345fffcbe30" status: 200 len: 1314 microversion: 2.1 time: 0.383771 Sep 17 21:01:59.742218 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1479/2885] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:59 2022] GET /compute/v2.1/servers/e2ed2483-1241-4242-83e3-3345fffcbe30 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:01:59.763334 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ac7854b5-da46-460f-999a-32a01c5380f6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:01:59.765944 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ac7854b5-da46-460f-999a-32a01c5380f6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:01:59.790468 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac7854b5-da46-460f-999a-32a01c5380f6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:59.791052 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac7854b5-da46-460f-999a-32a01c5380f6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:59.791506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac7854b5-da46-460f-999a-32a01c5380f6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:01:59.792255 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac7854b5-da46-460f-999a-32a01c5380f6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:01:59.792711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac7854b5-da46-460f-999a-32a01c5380f6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:01:59.793137 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac7854b5-da46-460f-999a-32a01c5380f6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:00.174013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ac7854b5-da46-460f-999a-32a01c5380f6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:00.183584 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ac7854b5-da46-460f-999a-32a01c5380f6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.439928 Sep 17 21:02:00.189161 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1480/2886] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:59 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:00.200317 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-af873b79-fd79-4367-b04a-2a0578c90bdb tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:00.201206 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-af873b79-fd79-4367-b04a-2a0578c90bdb tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:00.216273 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af873b79-fd79-4367-b04a-2a0578c90bdb tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:00.218053 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af873b79-fd79-4367-b04a-2a0578c90bdb tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:00.220245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af873b79-fd79-4367-b04a-2a0578c90bdb tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:00.223924 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af873b79-fd79-4367-b04a-2a0578c90bdb tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:00.225082 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af873b79-fd79-4367-b04a-2a0578c90bdb tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:00.226174 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af873b79-fd79-4367-b04a-2a0578c90bdb tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:00.229700 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4187a676-d748-486a-9575-92fe2517df8d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:00.244172 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4187a676-d748-486a-9575-92fe2517df8d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1365 microversion: 2.1 time: 0.581433 Sep 17 21:02:00.245842 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1407/2887] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:01:59 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1365 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:00.261995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-178c84a6-0fd5-4d1d-a9d0-d3bb864f21f0 req-8d178ffe-271c-4464-8abb-5d837d19f7f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2ed2483-1241-4242-83e3-3345fffcbe30", "name": "network-vif-deleted", "tag": "8dc19aab-491e-4cba-9e9b-1f02d19a112b"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:00.285557 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-178c84a6-0fd5-4d1d-a9d0-d3bb864f21f0 req-8d178ffe-271c-4464-8abb-5d837d19f7f6 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:00.286144 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-178c84a6-0fd5-4d1d-a9d0-d3bb864f21f0 req-8d178ffe-271c-4464-8abb-5d837d19f7f6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:00.286471 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-178c84a6-0fd5-4d1d-a9d0-d3bb864f21f0 req-8d178ffe-271c-4464-8abb-5d837d19f7f6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:00.303089 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-178c84a6-0fd5-4d1d-a9d0-d3bb864f21f0 req-8d178ffe-271c-4464-8abb-5d837d19f7f6 service nova] Creating event network-vif-deleted:8dc19aab-491e-4cba-9e9b-1f02d19a112b for instance e2ed2483-1241-4242-83e3-3345fffcbe30 on nch2-master-1 Sep 17 21:02:00.318634 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-178c84a6-0fd5-4d1d-a9d0-d3bb864f21f0 req-8d178ffe-271c-4464-8abb-5d837d19f7f6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070116 Sep 17 21:02:00.319935 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1408/2888] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:02:00.325259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-17d916bc-adcd-4566-bc31-0c4fd6bd5bb5 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:00.326181 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-17d916bc-adcd-4566-bc31-0c4fd6bd5bb5 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:00.333946 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17d916bc-adcd-4566-bc31-0c4fd6bd5bb5 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:00.334592 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17d916bc-adcd-4566-bc31-0c4fd6bd5bb5 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:00.335202 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17d916bc-adcd-4566-bc31-0c4fd6bd5bb5 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:00.336273 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17d916bc-adcd-4566-bc31-0c4fd6bd5bb5 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:00.337028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17d916bc-adcd-4566-bc31-0c4fd6bd5bb5 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:00.337641 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17d916bc-adcd-4566-bc31-0c4fd6bd5bb5 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:00.388459 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-af873b79-fd79-4367-b04a-2a0578c90bdb tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:00.397851 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-af873b79-fd79-4367-b04a-2a0578c90bdb tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:00.399414 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-af873b79-fd79-4367-b04a-2a0578c90bdb tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:00.420409 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-af873b79-fd79-4367-b04a-2a0578c90bdb tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1510 microversion: 2.91 time: 0.229588 Sep 17 21:02:00.426444 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1481/2889] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:00 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1510 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:00.433932 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ca8e018e-90cd-45e3-819b-9fee21e67358 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:00.434820 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ca8e018e-90cd-45e3-819b-9fee21e67358 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:00.448442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca8e018e-90cd-45e3-819b-9fee21e67358 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:00.453893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca8e018e-90cd-45e3-819b-9fee21e67358 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:00.454575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca8e018e-90cd-45e3-819b-9fee21e67358 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:00.455496 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca8e018e-90cd-45e3-819b-9fee21e67358 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:00.456129 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca8e018e-90cd-45e3-819b-9fee21e67358 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:00.459428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca8e018e-90cd-45e3-819b-9fee21e67358 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:00.875970 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ca8e018e-90cd-45e3-819b-9fee21e67358 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:00.893476 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ca8e018e-90cd-45e3-819b-9fee21e67358 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed" status: 200 len: 1501 microversion: 2.1 time: 0.465445 Sep 17 21:02:00.894327 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1482/2890] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:00 2022] GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed => generated 1501 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:00.905672 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-17d916bc-adcd-4566-bc31-0c4fd6bd5bb5 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:00.913631 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-17d916bc-adcd-4566-bc31-0c4fd6bd5bb5 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.592221 Sep 17 21:02:00.920101 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1409/2891] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:00 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:00.924433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0ad63edf-c5fe-42c4-827a-78a5a7ddf033 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a42fc0d0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:00.938322 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6782d288-d53d-4f3b-82b5-0e8da290d364 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:00.941391 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6782d288-d53d-4f3b-82b5-0e8da290d364 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: e2ed2483-1241-4242-83e3-3345fffcbe30] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:00.959717 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6782d288-d53d-4f3b-82b5-0e8da290d364 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:00.960225 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6782d288-d53d-4f3b-82b5-0e8da290d364 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:00.963029 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6782d288-d53d-4f3b-82b5-0e8da290d364 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:00.963791 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6782d288-d53d-4f3b-82b5-0e8da290d364 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:00.964261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6782d288-d53d-4f3b-82b5-0e8da290d364 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:00.967495 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6782d288-d53d-4f3b-82b5-0e8da290d364 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:01.024826 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-6782d288-d53d-4f3b-82b5-0e8da290d364 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] HTTP exception thrown: Instance e2ed2483-1241-4242-83e3-3345fffcbe30 could not be found. Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6782d288-d53d-4f3b-82b5-0e8da290d364 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Request method failure captured: Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/e2ed2483-1241-4242-83e3-3345fffcbe30 HTTP/1.1 Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjVSncfbAtgCIyToozPzw5wAkwJ8A5Pq3oENCAdqUUIYA48iSRlVG7zkjE71pODQ7Vq39Whu62dN5SwPbwvIXMyuqDiapFCgUkVVyC-O5o-Rbhev8SZVJvwjqio0qc_eiz6AU5vzIes11QJweqLBoCqKJfa2-0GqtVV9pkib7fT-OL0 Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 004f77fba4b14080bca4ae36c857add3 Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_004f77fba4b14080bca4ae36c857add3", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 004f77fba4b14080bca4ae36c857add3 Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ImagesOneServerNegativeTestJSON-622753367-project Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 22306a93c9404db393b92a267d6258d4 Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-622753367-project Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance e2ed2483-1241-4242-83e3-3345fffcbe30 could not be found. Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'e2ed2483-1241-4242-83e3-3345fffcbe30'} Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2ed2483-1241-4242-83e3-3345fffcbe30 could not be found. Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2ed2483-1241-4242-83e3-3345fffcbe30 could not be found. Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:01.027054 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:01.032279 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:01.032279 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:01.032279 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:01.032279 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:01.032279 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:01.032279 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:01.032279 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2ed2483-1241-4242-83e3-3345fffcbe30 could not be found. Sep 17 21:02:01.032279 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:01.035021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6782d288-d53d-4f3b-82b5-0e8da290d364 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Returning 404 to user: Instance e2ed2483-1241-4242-83e3-3345fffcbe30 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:01.035021 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6782d288-d53d-4f3b-82b5-0e8da290d364 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/e2ed2483-1241-4242-83e3-3345fffcbe30" status: 404 len: 111 microversion: 2.1 time: 0.113853 Sep 17 21:02:01.035521 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1410/2892] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:00 2022] GET /compute/v2.1/servers/e2ed2483-1241-4242-83e3-3345fffcbe30 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:02:01.043886 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3b3adccc-87e0-46ff-9f30-7ea1e6611f88 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:01.044425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3b3adccc-87e0-46ff-9f30-7ea1e6611f88 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:01.061083 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3b3adccc-87e0-46ff-9f30-7ea1e6611f88 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:01.061877 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3b3adccc-87e0-46ff-9f30-7ea1e6611f88 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:01.066151 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3b3adccc-87e0-46ff-9f30-7ea1e6611f88 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:01.067107 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3b3adccc-87e0-46ff-9f30-7ea1e6611f88 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:01.067737 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3b3adccc-87e0-46ff-9f30-7ea1e6611f88 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:01.068343 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3b3adccc-87e0-46ff-9f30-7ea1e6611f88 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:01.116213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:02:01.124109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-3b3adccc-87e0-46ff-9f30-7ea1e6611f88 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lazy-loading 'flavor' on Instance uuid 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:02:01.316933 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3b3adccc-87e0-46ff-9f30-7ea1e6611f88 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "POST /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed/action" status: 202 len: 0 microversion: 2.1 time: 0.279111 Sep 17 21:02:01.318532 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1411/2893] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:02:01 2022] POST /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:02:01.341141 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8ace71d4-ac2e-4ee2-a056-5adf7dcbdd60 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:01.341706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8ace71d4-ac2e-4ee2-a056-5adf7dcbdd60 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Failed to fetch instance by id 9223372036854775808 {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 17 21:02:01.344855 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-8ace71d4-ac2e-4ee2-a056-5adf7dcbdd60 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8ace71d4-ac2e-4ee2-a056-5adf7dcbdd60 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 9223372036854775808 could not be found. Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '9223372036854775808'} Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:01.348147 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:01.355481 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:01.355481 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:01.355481 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:01.355481 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Sep 17 21:02:01.355481 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:01.355481 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8ace71d4-ac2e-4ee2-a056-5adf7dcbdd60 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:01.355481 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8ace71d4-ac2e-4ee2-a056-5adf7dcbdd60 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.029237 Sep 17 21:02:01.355481 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1412/2894] 10.222.0.26 () {58 vars in 1188 bytes} [Sat Sep 17 21:02:01 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 21:02:01.359629 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-30b5025b-efaf-4ddf-9cf7-6c24c504a7f3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '.version_select at 0x7f25a48090d0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:01.726563 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-30b5025b-efaf-4ddf-9cf7-6c24c504a7f3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] HTTP exception thrown: Image not found. Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-30b5025b-efaf-4ddf-9cf7-6c24c504a7f3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Request method failure captured: Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/images/bd37f33c-b70a-4b63-b7ff-32a5d32b061b HTTP/1.1 Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjVSncfbAtgCIyToozPzw5wAkwJ8A5Pq3oENCAdqUUIYA48iSRlVG7zkjE71pODQ7Vq39Whu62dN5SwPbwvIXMyuqDiapFCgUkVVyC-O5o-Rbhev8SZVJvwjqio0qc_eiz6AU5vzIes11QJweqLBoCqKJfa2-0GqtVV9pkib7fT-OL0 Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 004f77fba4b14080bca4ae36c857add3 Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_004f77fba4b14080bca4ae36c857add3", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 004f77fba4b14080bca4ae36c857add3 Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ImagesOneServerNegativeTestJSON-622753367-project Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 22306a93c9404db393b92a267d6258d4 Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-622753367-project Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: exception: Image not found. Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'bd37f33c-b70a-4b63-b7ff-32a5d32b061b'} Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image bd37f33c-b70a-4b63-b7ff-32a5d32b061b to delete Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bd37f33c-b70a-4b63-b7ff-32a5d32b061b could not be found. Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:01.729542 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:01.736833 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:01.736833 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:01.736833 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:01.736833 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:01.736833 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:01.736833 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:02:01.736833 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:02:01.736833 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:01.736833 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:01.736833 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 17 21:02:01.736833 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 17 21:02:01.736833 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 17 21:02:01.736833 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:01.736833 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:01.736833 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:01.736833 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:01.736833 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:01.736833 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:01.736833 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:01.736833 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:01.736833 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 17 21:02:01.736833 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:01.740521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-30b5025b-efaf-4ddf-9cf7-6c24c504a7f3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Returning 404 to user: Image not found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:01.741707 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-30b5025b-efaf-4ddf-9cf7-6c24c504a7f3 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "DELETE /compute/v2.1/images/bd37f33c-b70a-4b63-b7ff-32a5d32b061b" status: 404 len: 62 microversion: 2.1 time: 0.387264 Sep 17 21:02:01.742467 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1413/2895] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:01 2022] DELETE /compute/v2.1/images/bd37f33c-b70a-4b63-b7ff-32a5d32b061b => generated 62 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 21:02:01.765976 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0ad63edf-c5fe-42c4-827a-78a5a7ddf033 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57" status: 200 len: 1452 microversion: 2.1 time: 0.847058 Sep 17 21:02:01.767776 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1483/2896] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:00 2022] GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57 => generated 1452 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:01.773000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e8323865-8c6d-4842-a20c-77de41616439 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:01.778314 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e8323865-8c6d-4842-a20c-77de41616439 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:01.787939 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8323865-8c6d-4842-a20c-77de41616439 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:01.789754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fe2d2e22-86ef-4d9f-8730-c51d5d7dcb82 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:01.790541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fe2d2e22-86ef-4d9f-8730-c51d5d7dcb82 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:01.791857 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8323865-8c6d-4842-a20c-77de41616439 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:01.792477 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8323865-8c6d-4842-a20c-77de41616439 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:01.796880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8323865-8c6d-4842-a20c-77de41616439 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:01.797422 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8323865-8c6d-4842-a20c-77de41616439 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:01.797947 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8323865-8c6d-4842-a20c-77de41616439 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:01.811786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe2d2e22-86ef-4d9f-8730-c51d5d7dcb82 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:01.812302 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe2d2e22-86ef-4d9f-8730-c51d5d7dcb82 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:01.812753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe2d2e22-86ef-4d9f-8730-c51d5d7dcb82 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:01.813505 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe2d2e22-86ef-4d9f-8730-c51d5d7dcb82 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:01.813973 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe2d2e22-86ef-4d9f-8730-c51d5d7dcb82 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:01.814405 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe2d2e22-86ef-4d9f-8730-c51d5d7dcb82 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:02.221206 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fe2d2e22-86ef-4d9f-8730-c51d5d7dcb82 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:02.225731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e8323865-8c6d-4842-a20c-77de41616439 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:02.236478 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e8323865-8c6d-4842-a20c-77de41616439 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1365 microversion: 2.1 time: 0.492746 Sep 17 21:02:02.237340 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1414/2897] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:01 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1365 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:02.252399 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fe2d2e22-86ef-4d9f-8730-c51d5d7dcb82 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed" status: 200 len: 1509 microversion: 2.1 time: 0.473663 Sep 17 21:02:02.253662 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1484/2898] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:01 2022] GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed => generated 1509 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:02.264766 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f4285e59-5c1e-4794-b39c-44647319c5b6 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:02.265389 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f4285e59-5c1e-4794-b39c-44647319c5b6 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:02.267452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-84739fd3-c8b5-44e6-8682-9cb5519e523c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:02.269300 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-84739fd3-c8b5-44e6-8682-9cb5519e523c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:02.274171 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4285e59-5c1e-4794-b39c-44647319c5b6 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:02.274973 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4285e59-5c1e-4794-b39c-44647319c5b6 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:02.275444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4285e59-5c1e-4794-b39c-44647319c5b6 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:02.276369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4285e59-5c1e-4794-b39c-44647319c5b6 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:02.277044 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4285e59-5c1e-4794-b39c-44647319c5b6 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:02.277688 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4285e59-5c1e-4794-b39c-44647319c5b6 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:02.281257 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84739fd3-c8b5-44e6-8682-9cb5519e523c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:02.282111 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84739fd3-c8b5-44e6-8682-9cb5519e523c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:02.282843 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84739fd3-c8b5-44e6-8682-9cb5519e523c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:02.283749 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84739fd3-c8b5-44e6-8682-9cb5519e523c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:02.284360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84739fd3-c8b5-44e6-8682-9cb5519e523c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:02.284949 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84739fd3-c8b5-44e6-8682-9cb5519e523c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:02.420826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f4285e59-5c1e-4794-b39c-44647319c5b6 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:02.435865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f4285e59-5c1e-4794-b39c-44647319c5b6 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:02.440184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f4285e59-5c1e-4794-b39c-44647319c5b6 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:02.448179 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f4285e59-5c1e-4794-b39c-44647319c5b6 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1531 microversion: 2.91 time: 0.193275 Sep 17 21:02:02.448800 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1485/2899] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:02 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1531 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:02.470256 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-96894683-b91b-4f60-9c6a-dbc59a3bdb53 req-4e9099eb-d470-4c6c-8723-117665ebca0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41393a54-9105-4da5-ae65-3167427ddae8", "name": "network-vif-plugged", "status": "completed", "tag": "4d47e229-8239-4215-8c5c-b5133bcfb47b"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:02.486819 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-96894683-b91b-4f60-9c6a-dbc59a3bdb53 req-4e9099eb-d470-4c6c-8723-117665ebca0d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:02.488028 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-96894683-b91b-4f60-9c6a-dbc59a3bdb53 req-4e9099eb-d470-4c6c-8723-117665ebca0d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:02.488864 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-96894683-b91b-4f60-9c6a-dbc59a3bdb53 req-4e9099eb-d470-4c6c-8723-117665ebca0d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:02.501509 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-96894683-b91b-4f60-9c6a-dbc59a3bdb53 req-4e9099eb-d470-4c6c-8723-117665ebca0d service nova] Creating event network-vif-plugged:4d47e229-8239-4215-8c5c-b5133bcfb47b for instance 41393a54-9105-4da5-ae65-3167427ddae8 on nch1-master-1 Sep 17 21:02:02.507973 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-84739fd3-c8b5-44e6-8682-9cb5519e523c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:02.509328 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-96894683-b91b-4f60-9c6a-dbc59a3bdb53 req-4e9099eb-d470-4c6c-8723-117665ebca0d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057944 Sep 17 21:02:02.510877 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1486/2900] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:02:02.517421 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-84739fd3-c8b5-44e6-8682-9cb5519e523c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.263639 Sep 17 21:02:02.518545 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1415/2901] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:02 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:02.537145 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-531a11e9-4fc7-4f5b-9f47-94cd648e3790 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:02.542846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-531a11e9-4fc7-4f5b-9f47-94cd648e3790 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 7750732c-19bc-4c5a-8637-af3a08c3af5d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:02.570631 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-531a11e9-4fc7-4f5b-9f47-94cd648e3790 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:02.571628 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-531a11e9-4fc7-4f5b-9f47-94cd648e3790 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:02.573265 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-531a11e9-4fc7-4f5b-9f47-94cd648e3790 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:02.574377 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-531a11e9-4fc7-4f5b-9f47-94cd648e3790 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:02.575453 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-531a11e9-4fc7-4f5b-9f47-94cd648e3790 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:02.576552 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-531a11e9-4fc7-4f5b-9f47-94cd648e3790 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:02.598421 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-531a11e9-4fc7-4f5b-9f47-94cd648e3790 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] HTTP exception thrown: Instance 7750732c-19bc-4c5a-8637-af3a08c3af5d could not be found. Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-531a11e9-4fc7-4f5b-9f47-94cd648e3790 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Request method failure captured: Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d HTTP/1.1 Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjVSncfbAtgCIyToozPzw5wAkwJ8A5Pq3oENCAdqUUIYA48iSRlVG7zkjE71pODQ7Vq39Whu62dN5SwPbwvIXMyuqDiapFCgUkVVyC-O5o-Rbhev8SZVJvwjqio0qc_eiz6AU5vzIes11QJweqLBoCqKJfa2-0GqtVV9pkib7fT-OL0 Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 004f77fba4b14080bca4ae36c857add3 Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_004f77fba4b14080bca4ae36c857add3", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 004f77fba4b14080bca4ae36c857add3 Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ImagesOneServerNegativeTestJSON-622753367-project Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 22306a93c9404db393b92a267d6258d4 Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-622753367-project Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 7750732c-19bc-4c5a-8637-af3a08c3af5d could not be found. Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '7750732c-19bc-4c5a-8637-af3a08c3af5d'} Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7750732c-19bc-4c5a-8637-af3a08c3af5d could not be found. Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:02.601440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:02.607637 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7750732c-19bc-4c5a-8637-af3a08c3af5d could not be found. Sep 17 21:02:02.607637 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:02.607637 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:02.607637 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:02.607637 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:02.607637 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:02.607637 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:02.607637 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:02.607637 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:02.607637 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7750732c-19bc-4c5a-8637-af3a08c3af5d could not be found. Sep 17 21:02:02.607637 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:02.610352 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-531a11e9-4fc7-4f5b-9f47-94cd648e3790 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Returning 404 to user: Instance 7750732c-19bc-4c5a-8637-af3a08c3af5d could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:02.611243 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-531a11e9-4fc7-4f5b-9f47-94cd648e3790 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d" status: 404 len: 111 microversion: 2.1 time: 0.099075 Sep 17 21:02:02.626283 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1487/2902] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:02:02 2022] DELETE /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:02:02.646317 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f49eb166-2088-47bf-aae4-0abe151dd916 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:02.651515 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f49eb166-2088-47bf-aae4-0abe151dd916 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:02.681179 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f49eb166-2088-47bf-aae4-0abe151dd916 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:02.682909 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f49eb166-2088-47bf-aae4-0abe151dd916 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:02.698118 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f49eb166-2088-47bf-aae4-0abe151dd916 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:02.698532 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f49eb166-2088-47bf-aae4-0abe151dd916 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:02.702988 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f49eb166-2088-47bf-aae4-0abe151dd916 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:02.703456 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f49eb166-2088-47bf-aae4-0abe151dd916 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:03.005181 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f49eb166-2088-47bf-aae4-0abe151dd916 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:03.014880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7c657516-f6d9-4794-92f1-44645477662f tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:03.015498 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7c657516-f6d9-4794-92f1-44645477662f tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:03.016690 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f49eb166-2088-47bf-aae4-0abe151dd916 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.389219 Sep 17 21:02:03.021992 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1488/2903] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:02 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:03.032880 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-37c71b94-9c05-4a22-8ded-68473784abf1 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:03.033530 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-37c71b94-9c05-4a22-8ded-68473784abf1 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 7750732c-19bc-4c5a-8637-af3a08c3af5d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:03.042307 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-37c71b94-9c05-4a22-8ded-68473784abf1 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:03.042788 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c657516-f6d9-4794-92f1-44645477662f tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:03.043007 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-37c71b94-9c05-4a22-8ded-68473784abf1 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:03.043604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-37c71b94-9c05-4a22-8ded-68473784abf1 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:03.043755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c657516-f6d9-4794-92f1-44645477662f tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:03.045137 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-37c71b94-9c05-4a22-8ded-68473784abf1 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:03.045748 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c657516-f6d9-4794-92f1-44645477662f tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:03.046296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c657516-f6d9-4794-92f1-44645477662f tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:03.046967 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c657516-f6d9-4794-92f1-44645477662f tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:03.047084 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-37c71b94-9c05-4a22-8ded-68473784abf1 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:03.047497 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-37c71b94-9c05-4a22-8ded-68473784abf1 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:03.048041 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c657516-f6d9-4794-92f1-44645477662f tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:03.071756 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-37c71b94-9c05-4a22-8ded-68473784abf1 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] HTTP exception thrown: Instance 7750732c-19bc-4c5a-8637-af3a08c3af5d could not be found. Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-37c71b94-9c05-4a22-8ded-68473784abf1 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Request method failure captured: Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d HTTP/1.1 Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjVSncfbAtgCIyToozPzw5wAkwJ8A5Pq3oENCAdqUUIYA48iSRlVG7zkjE71pODQ7Vq39Whu62dN5SwPbwvIXMyuqDiapFCgUkVVyC-O5o-Rbhev8SZVJvwjqio0qc_eiz6AU5vzIes11QJweqLBoCqKJfa2-0GqtVV9pkib7fT-OL0 Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 004f77fba4b14080bca4ae36c857add3 Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_004f77fba4b14080bca4ae36c857add3", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 004f77fba4b14080bca4ae36c857add3 Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ImagesOneServerNegativeTestJSON-622753367-project Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 22306a93c9404db393b92a267d6258d4 Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-622753367-project Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 7750732c-19bc-4c5a-8637-af3a08c3af5d could not be found. Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '7750732c-19bc-4c5a-8637-af3a08c3af5d'} Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7750732c-19bc-4c5a-8637-af3a08c3af5d could not be found. Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7750732c-19bc-4c5a-8637-af3a08c3af5d could not be found. Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:03.073361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:03.078083 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:03.078083 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:03.078083 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:03.078083 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:03.078083 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:03.078083 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:03.078083 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7750732c-19bc-4c5a-8637-af3a08c3af5d could not be found. Sep 17 21:02:03.078083 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:03.079347 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-37c71b94-9c05-4a22-8ded-68473784abf1 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Returning 404 to user: Instance 7750732c-19bc-4c5a-8637-af3a08c3af5d could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:03.080360 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-37c71b94-9c05-4a22-8ded-68473784abf1 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d" status: 404 len: 111 microversion: 2.1 time: 0.055446 Sep 17 21:02:03.081899 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1489/2904] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:03 2022] GET /compute/v2.1/servers/7750732c-19bc-4c5a-8637-af3a08c3af5d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:02:03.088331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e3e2698b-e745-437f-a41f-ecf3824419de tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a4310ca0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:03.149178 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-7c657516-f6d9-4794-92f1-44645477662f tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Lazy-loading 'services' on Instance uuid 5b354b73-703b-4577-b7e5-f137385b9c36 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:02:03.151989 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e3e2698b-e745-437f-a41f-ecf3824419de tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57" status: 200 len: 1452 microversion: 2.1 time: 0.062534 Sep 17 21:02:03.152806 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1490/2905] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:03 2022] GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57 => generated 1452 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:03.166930 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e4bc222e-b2d7-4ceb-89dd-653744ee9c84 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:03.168539 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e4bc222e-b2d7-4ceb-89dd-653744ee9c84 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:03.182593 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7c657516-f6d9-4794-92f1-44645477662f tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1936 microversion: 2.91 time: 0.662306 Sep 17 21:02:03.185153 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e4bc222e-b2d7-4ceb-89dd-653744ee9c84 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:03.185509 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e4bc222e-b2d7-4ceb-89dd-653744ee9c84 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:03.186017 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e4bc222e-b2d7-4ceb-89dd-653744ee9c84 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:03.187395 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e4bc222e-b2d7-4ceb-89dd-653744ee9c84 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:03.187929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e4bc222e-b2d7-4ceb-89dd-653744ee9c84 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:03.188596 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e4bc222e-b2d7-4ceb-89dd-653744ee9c84 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:03.198510 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1416/2906] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:02 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1936 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:03.210704 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-420c5131-f85d-44b8-af57-82e09761ed6b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:03.211529 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-420c5131-f85d-44b8-af57-82e09761ed6b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Failed to fetch instance by id -1 {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 17 21:02:03.212321 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-e4bc222e-b2d7-4ceb-89dd-653744ee9c84 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] HTTP exception thrown: Instance 6a1dbfb5-be75-451c-8ca8-a71949ac2297 could not be found. Sep 17 21:02:03.212701 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-420c5131-f85d-44b8-af57-82e09761ed6b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Instance -1 could not be found. Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-420c5131-f85d-44b8-af57-82e09761ed6b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance -1 could not be found. Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '-1'} Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:03.214438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:03.219236 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:03.219236 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:03.219236 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Sep 17 21:02:03.219236 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e4bc222e-b2d7-4ceb-89dd-653744ee9c84 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Request method failure captured: Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297 HTTP/1.1 Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjUy248RU2v-XZp6hvI1gYczz9jQ0ysKnRWpYxm0dSmcyL_kzqqrYQpPkPyuJ8nOBGH2VXr-sfMeMn7YHBsw9RkvBEz6ryyZaYpxLkbtXeXGjziMJeTl-Dekz4DihZuPyeWnFJVt05ufh9E6yYDJI6l2T_43J8u6fzTL4Na10vSCYUc Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: f8813aaee4604882b4cd7a2a8df58077 Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2060044451 Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8813aaee4604882b4cd7a2a8df58077"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f8813aaee4604882b4cd7a2a8df58077"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8813aaee4604882b4cd7a2a8df58077"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f8813aaee4604882b4cd7a2a8df58077", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2060044451 Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: f8813aaee4604882b4cd7a2a8df58077 Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2060044451 Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-AttachSCSIVolumeTestJSON-2060044451-project Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: da5d41f7e95d44d3898f6306bb093ed7 Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2060044451-project Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 6a1dbfb5-be75-451c-8ca8-a71949ac2297 could not be found. Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '6a1dbfb5-be75-451c-8ca8-a71949ac2297'} Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a1dbfb5-be75-451c-8ca8-a71949ac2297 could not be found. Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:03.219549 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:03.234157 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a1dbfb5-be75-451c-8ca8-a71949ac2297 could not be found. Sep 17 21:02:03.234157 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:03.234157 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:03.234157 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:03.234157 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:03.234157 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:03.234157 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:03.234157 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:03.234157 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:03.234157 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a1dbfb5-be75-451c-8ca8-a71949ac2297 could not be found. Sep 17 21:02:03.234157 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:03.234157 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e4bc222e-b2d7-4ceb-89dd-653744ee9c84 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Returning 404 to user: Instance 6a1dbfb5-be75-451c-8ca8-a71949ac2297 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:03.236867 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-420c5131-f85d-44b8-af57-82e09761ed6b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 404 to user: Instance -1 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:03.237034 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e4bc222e-b2d7-4ceb-89dd-653744ee9c84 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297" status: 404 len: 111 microversion: 2.1 time: 0.066401 Sep 17 21:02:03.237034 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1491/2907] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:02:03 2022] DELETE /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:02:03.237326 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-420c5131-f85d-44b8-af57-82e09761ed6b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.023760 Sep 17 21:02:03.237326 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1417/2908] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Sep 17 21:02:03 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 21:02:03.237726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5da4f67f-8086-48cf-8ae5-2306542d05e5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '.version_select at 0x7f25a4331310>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:03.237874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d92d7858-deb5-4516-9682-af3b0441ec37 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:03.237874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d92d7858-deb5-4516-9682-af3b0441ec37 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:03.256743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d92d7858-deb5-4516-9682-af3b0441ec37 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:03.257125 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d92d7858-deb5-4516-9682-af3b0441ec37 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:03.258788 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5da4f67f-8086-48cf-8ae5-2306542d05e5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2111745744" status: 202 len: 0 microversion: 2.1 time: 0.033939 Sep 17 21:02:03.259541 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1492/2909] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Sep 17 21:02:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2111745744 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:02:03.264848 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d92d7858-deb5-4516-9682-af3b0441ec37 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:03.266327 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d92d7858-deb5-4516-9682-af3b0441ec37 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:03.266814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d92d7858-deb5-4516-9682-af3b0441ec37 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:03.267263 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d92d7858-deb5-4516-9682-af3b0441ec37 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:03.271257 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b27fda2e-795e-4f78-8070-9b8666b764e0 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:03.271630 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b27fda2e-795e-4f78-8070-9b8666b764e0 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] [instance: 6a1dbfb5-be75-451c-8ca8-a71949ac2297] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:03.291533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b27fda2e-795e-4f78-8070-9b8666b764e0 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:03.292061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b27fda2e-795e-4f78-8070-9b8666b764e0 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:03.292522 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b27fda2e-795e-4f78-8070-9b8666b764e0 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:03.293280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b27fda2e-795e-4f78-8070-9b8666b764e0 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:03.293828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b27fda2e-795e-4f78-8070-9b8666b764e0 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:03.294259 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b27fda2e-795e-4f78-8070-9b8666b764e0 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:03.338740 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-b27fda2e-795e-4f78-8070-9b8666b764e0 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] HTTP exception thrown: Instance 6a1dbfb5-be75-451c-8ca8-a71949ac2297 could not be found. Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b27fda2e-795e-4f78-8070-9b8666b764e0 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Request method failure captured: Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297 HTTP/1.1 Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjUy248RU2v-XZp6hvI1gYczz9jQ0ysKnRWpYxm0dSmcyL_kzqqrYQpPkPyuJ8nOBGH2VXr-sfMeMn7YHBsw9RkvBEz6ryyZaYpxLkbtXeXGjziMJeTl-Dekz4DihZuPyeWnFJVt05ufh9E6yYDJI6l2T_43J8u6fzTL4Na10vSCYUc Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: f8813aaee4604882b4cd7a2a8df58077 Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-2060044451 Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8813aaee4604882b4cd7a2a8df58077"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f8813aaee4604882b4cd7a2a8df58077"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8813aaee4604882b4cd7a2a8df58077"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f8813aaee4604882b4cd7a2a8df58077", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-2060044451 Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: f8813aaee4604882b4cd7a2a8df58077 Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-2060044451 Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-AttachSCSIVolumeTestJSON-2060044451-project Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: da5d41f7e95d44d3898f6306bb093ed7 Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-2060044451-project Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 6a1dbfb5-be75-451c-8ca8-a71949ac2297 could not be found. Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '6a1dbfb5-be75-451c-8ca8-a71949ac2297'} Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a1dbfb5-be75-451c-8ca8-a71949ac2297 could not be found. Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a1dbfb5-be75-451c-8ca8-a71949ac2297 could not be found. Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:03.340840 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:03.347844 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:03.347844 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:03.347844 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:03.347844 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:03.347844 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:03.347844 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a1dbfb5-be75-451c-8ca8-a71949ac2297 could not be found. Sep 17 21:02:03.347844 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:03.350350 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b27fda2e-795e-4f78-8070-9b8666b764e0 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] Returning 404 to user: Instance 6a1dbfb5-be75-451c-8ca8-a71949ac2297 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:03.351405 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b27fda2e-795e-4f78-8070-9b8666b764e0 tempest-AttachSCSIVolumeTestJSON-2060044451 tempest-AttachSCSIVolumeTestJSON-2060044451-project] 10.222.0.26 "GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297" status: 404 len: 111 microversion: 2.1 time: 0.087658 Sep 17 21:02:03.352611 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1493/2910] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:03 2022] GET /compute/v2.1/servers/6a1dbfb5-be75-451c-8ca8-a71949ac2297 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:02:03.358423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-50ad504a-11b2-4579-8201-6484c6fdf976 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:03.360715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-50ad504a-11b2-4579-8201-6484c6fdf976 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:03.367808 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50ad504a-11b2-4579-8201-6484c6fdf976 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:03.368690 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50ad504a-11b2-4579-8201-6484c6fdf976 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:03.369283 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50ad504a-11b2-4579-8201-6484c6fdf976 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:03.370507 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50ad504a-11b2-4579-8201-6484c6fdf976 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:03.371370 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50ad504a-11b2-4579-8201-6484c6fdf976 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:03.371970 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50ad504a-11b2-4579-8201-6484c6fdf976 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:03.450043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-d92d7858-deb5-4516-9682-af3b0441ec37 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Lazy-loading 'services' on Instance uuid 5b354b73-703b-4577-b7e5-f137385b9c36 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:02:03.494579 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d92d7858-deb5-4516-9682-af3b0441ec37 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1936 microversion: 2.91 time: 0.266115 Sep 17 21:02:03.511494 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1418/2911] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:03 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1936 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:03.542432 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-95a14826-0d65-4e5b-b5bf-54b17c4c6624 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:03.543503 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-95a14826-0d65-4e5b-b5bf-54b17c4c6624 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:03.555917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95a14826-0d65-4e5b-b5bf-54b17c4c6624 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:03.556705 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95a14826-0d65-4e5b-b5bf-54b17c4c6624 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:03.558358 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95a14826-0d65-4e5b-b5bf-54b17c4c6624 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:03.559538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95a14826-0d65-4e5b-b5bf-54b17c4c6624 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:03.560985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95a14826-0d65-4e5b-b5bf-54b17c4c6624 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:03.562490 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95a14826-0d65-4e5b-b5bf-54b17c4c6624 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:03.720831 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-50ad504a-11b2-4579-8201-6484c6fdf976 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:03.732158 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-50ad504a-11b2-4579-8201-6484c6fdf976 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.375719 Sep 17 21:02:03.737021 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1494/2912] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:03 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:03.746991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e6d9a8c4-b994-48b2-8664-af4dfcf06ae9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:03.750810 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e6d9a8c4-b994-48b2-8664-af4dfcf06ae9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:03.799417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6d9a8c4-b994-48b2-8664-af4dfcf06ae9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:03.799943 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6d9a8c4-b994-48b2-8664-af4dfcf06ae9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:03.800398 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6d9a8c4-b994-48b2-8664-af4dfcf06ae9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:03.810562 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6d9a8c4-b994-48b2-8664-af4dfcf06ae9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:03.811135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6d9a8c4-b994-48b2-8664-af4dfcf06ae9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:03.811602 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6d9a8c4-b994-48b2-8664-af4dfcf06ae9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:04.079866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-95a14826-0d65-4e5b-b5bf-54b17c4c6624 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:04.090778 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-95a14826-0d65-4e5b-b5bf-54b17c4c6624 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1365 microversion: 2.1 time: 0.568889 Sep 17 21:02:04.091628 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1419/2913] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:03 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1365 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:04.099833 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-248c239c-6706-4d56-899e-3772f936dce1 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:04.107646 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-248c239c-6706-4d56-899e-3772f936dce1 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:04.108358 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-248c239c-6706-4d56-899e-3772f936dce1 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:04.108965 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-248c239c-6706-4d56-899e-3772f936dce1 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:04.109759 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-248c239c-6706-4d56-899e-3772f936dce1 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:04.110413 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-248c239c-6706-4d56-899e-3772f936dce1 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:04.111020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-248c239c-6706-4d56-899e-3772f936dce1 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:04.147997 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-248c239c-6706-4d56-899e-3772f936dce1 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.051654 Sep 17 21:02:04.158094 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1420/2914] 10.222.0.26 () {60 vars in 1217 bytes} [Sat Sep 17 21:02:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:02:04.161551 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c3b36911-bdfb-42ae-81f7-17294b679589 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:04.162186 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c3b36911-bdfb-42ae-81f7-17294b679589 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:04.174632 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3b36911-bdfb-42ae-81f7-17294b679589 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:04.175144 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3b36911-bdfb-42ae-81f7-17294b679589 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:04.175764 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3b36911-bdfb-42ae-81f7-17294b679589 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:04.176670 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3b36911-bdfb-42ae-81f7-17294b679589 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:04.177292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3b36911-bdfb-42ae-81f7-17294b679589 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:04.178433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3b36911-bdfb-42ae-81f7-17294b679589 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:04.184984 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e6d9a8c4-b994-48b2-8664-af4dfcf06ae9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:04.197374 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e6d9a8c4-b994-48b2-8664-af4dfcf06ae9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed" status: 200 len: 1492 microversion: 2.1 time: 0.458902 Sep 17 21:02:04.198026 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1495/2915] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:03 2022] GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed => generated 1492 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:04.417540 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3434f7b5-0adc-4332-8b11-17075bb0acc4 tempest-ExtensionsTest-1807219625 tempest-ExtensionsTest-1807219625-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:04.419403 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3434f7b5-0adc-4332-8b11-17075bb0acc4 tempest-ExtensionsTest-1807219625 tempest-ExtensionsTest-1807219625-project] 10.222.0.26 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.200020 Sep 17 21:02:04.424587 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1496/2916] 10.222.0.26 () {58 vars in 1170 bytes} [Sat Sep 17 21:02:04 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:02:04.436369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7d1e538b-934e-436e-831e-c6e7eda49ac7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:04.438988 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7d1e538b-934e-436e-831e-c6e7eda49ac7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:04.449751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d1e538b-934e-436e-831e-c6e7eda49ac7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:04.450808 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d1e538b-934e-436e-831e-c6e7eda49ac7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:04.451453 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d1e538b-934e-436e-831e-c6e7eda49ac7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:04.452345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d1e538b-934e-436e-831e-c6e7eda49ac7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:04.452955 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d1e538b-934e-436e-831e-c6e7eda49ac7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:04.453561 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d1e538b-934e-436e-831e-c6e7eda49ac7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:04.463567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c3b36911-bdfb-42ae-81f7-17294b679589 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:04.475767 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c3b36911-bdfb-42ae-81f7-17294b679589 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.325975 Sep 17 21:02:04.480168 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1421/2917] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:04 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:04.496727 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b2abfb9c-1e65-41b0-a3b0-a9a1e8c9ef6c tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a486df70>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:04.505271 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-7d1e538b-934e-436e-831e-c6e7eda49ac7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lazy-loading 'flavor' on Instance uuid 5b354b73-703b-4577-b7e5-f137385b9c36 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:02:04.592236 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b2abfb9c-1e65-41b0-a3b0-a9a1e8c9ef6c tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57" status: 200 len: 1452 microversion: 2.1 time: 0.110581 Sep 17 21:02:04.593554 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1422/2918] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:04 2022] GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57 => generated 1452 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:04.598752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f38097c0-b5fa-4701-849f-d3cb1e9c4016 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:04.599448 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f38097c0-b5fa-4701-849f-d3cb1e9c4016 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:04.615550 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f38097c0-b5fa-4701-849f-d3cb1e9c4016 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:04.616425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f38097c0-b5fa-4701-849f-d3cb1e9c4016 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:04.617392 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f38097c0-b5fa-4701-849f-d3cb1e9c4016 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:04.618361 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f38097c0-b5fa-4701-849f-d3cb1e9c4016 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:04.619028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f38097c0-b5fa-4701-849f-d3cb1e9c4016 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:04.620165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f38097c0-b5fa-4701-849f-d3cb1e9c4016 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:04.682577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f38097c0-b5fa-4701-849f-d3cb1e9c4016 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:02:04.793116 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f38097c0-b5fa-4701-849f-d3cb1e9c4016 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "DELETE /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed" status: 204 len: 0 microversion: 2.1 time: 0.192510 Sep 17 21:02:04.795273 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1423/2919] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:02:04 2022] DELETE /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:02:04.806624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-60d971d9-95bc-4012-89ed-ae8a2f00d52f tempest-ExtensionsTest-1807219625 tempest-ExtensionsTest-1807219625-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:04.808681 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-60d971d9-95bc-4012-89ed-ae8a2f00d52f tempest-ExtensionsTest-1807219625 tempest-ExtensionsTest-1807219625-project] 10.222.0.26 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.012157 Sep 17 21:02:04.809802 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1424/2920] 10.222.0.26 () {58 vars in 1134 bytes} [Sat Sep 17 21:02:04 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:02:04.814927 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ece2642b-9728-4fb8-882a-8669aadfe383 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:04.815836 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ece2642b-9728-4fb8-882a-8669aadfe383 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: e55cdb17-9a9b-4415-ac44-30a98116c5c4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:04.822026 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-ece2642b-9728-4fb8-882a-8669aadfe383 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Instance e55cdb17-9a9b-4415-ac44-30a98116c5c4 could not be found. Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ece2642b-9728-4fb8-882a-8669aadfe383 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers/e55cdb17-9a9b-4415-ac44-30a98116c5c4/action HTTP/1.1 Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 19 Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: {"forceDelete": {}} Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance e55cdb17-9a9b-4415-ac44-30a98116c5c4 could not be found. Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'e55cdb17-9a9b-4415-ac44-30a98116c5c4', 'body': {'forceDelete': {}}} Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e55cdb17-9a9b-4415-ac44-30a98116c5c4 could not be found. Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e55cdb17-9a9b-4415-ac44-30a98116c5c4 could not be found. Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:04.844101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:04.849065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:04.849065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:04.849065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e55cdb17-9a9b-4415-ac44-30a98116c5c4 could not be found. Sep 17 21:02:04.849065 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:04.849065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ece2642b-9728-4fb8-882a-8669aadfe383 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 404 to user: Instance e55cdb17-9a9b-4415-ac44-30a98116c5c4 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:04.849797 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ece2642b-9728-4fb8-882a-8669aadfe383 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers/e55cdb17-9a9b-4415-ac44-30a98116c5c4/action" status: 404 len: 111 microversion: 2.1 time: 0.038735 Sep 17 21:02:04.861191 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1425/2921] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:02:04 2022] POST /compute/v2.1/servers/e55cdb17-9a9b-4415-ac44-30a98116c5c4/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:02:04.878653 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7d1e538b-934e-436e-831e-c6e7eda49ac7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "POST /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36/action" status: 202 len: 0 microversion: 2.91 time: 0.452191 Sep 17 21:02:04.880603 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1497/2922] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Sep 17 21:02:04 2022] POST /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36/action => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:02:04.894611 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-047356dc-ae80-4f0e-a23c-50a4bdc79e1c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:04.895567 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-047356dc-ae80-4f0e-a23c-50a4bdc79e1c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:04.899735 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4e3813df-7378-4ce1-8f05-e57acd8ba4aa tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:04.903228 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-047356dc-ae80-4f0e-a23c-50a4bdc79e1c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:04.904300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-047356dc-ae80-4f0e-a23c-50a4bdc79e1c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:04.904901 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-047356dc-ae80-4f0e-a23c-50a4bdc79e1c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:04.905899 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-047356dc-ae80-4f0e-a23c-50a4bdc79e1c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:04.906667 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-047356dc-ae80-4f0e-a23c-50a4bdc79e1c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:04.907914 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4e3813df-7378-4ce1-8f05-e57acd8ba4aa tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:04.908402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-047356dc-ae80-4f0e-a23c-50a4bdc79e1c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:04.943328 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e3813df-7378-4ce1-8f05-e57acd8ba4aa tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:04.947300 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e3813df-7378-4ce1-8f05-e57acd8ba4aa tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:04.949393 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e3813df-7378-4ce1-8f05-e57acd8ba4aa tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:04.952959 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e3813df-7378-4ce1-8f05-e57acd8ba4aa tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:04.954270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e3813df-7378-4ce1-8f05-e57acd8ba4aa tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:04.956881 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e3813df-7378-4ce1-8f05-e57acd8ba4aa tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:05.217325 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-047356dc-ae80-4f0e-a23c-50a4bdc79e1c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:05.219719 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:02:05.231133 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-047356dc-ae80-4f0e-a23c-50a4bdc79e1c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.348513 Sep 17 21:02:05.231969 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1498/2923] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:04 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:05.243292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d981fdd6-464a-4328-8706-45d4fb4e7efc tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:05.243540 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d981fdd6-464a-4328-8706-45d4fb4e7efc tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:05.265768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d981fdd6-464a-4328-8706-45d4fb4e7efc tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:05.266956 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d981fdd6-464a-4328-8706-45d4fb4e7efc tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:05.267467 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d981fdd6-464a-4328-8706-45d4fb4e7efc tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:05.268450 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d981fdd6-464a-4328-8706-45d4fb4e7efc tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:05.269107 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d981fdd6-464a-4328-8706-45d4fb4e7efc tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:05.269575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d981fdd6-464a-4328-8706-45d4fb4e7efc tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:05.276055 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4e3813df-7378-4ce1-8f05-e57acd8ba4aa tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:05.288535 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4e3813df-7378-4ce1-8f05-e57acd8ba4aa tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed" status: 200 len: 1498 microversion: 2.1 time: 0.424784 Sep 17 21:02:05.292931 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1426/2924] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:04 2022] GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed => generated 1498 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:05.303325 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-087b0006-2789-4e1b-9c8d-e80fa2b468db tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '.version_select at 0x7f25a4820670>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:05.360092 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-087b0006-2789-4e1b-9c8d-e80fa2b468db tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] HTTP exception thrown: Image not found. Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-087b0006-2789-4e1b-9c8d-e80fa2b468db tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Request method failure captured: Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/images/ae4642d4-1ac8-44fd-8a6f-1411934e28a2 HTTP/1.1 Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjVSncfbAtgCIyToozPzw5wAkwJ8A5Pq3oENCAdqUUIYA48iSRlVG7zkjE71pODQ7Vq39Whu62dN5SwPbwvIXMyuqDiapFCgUkVVyC-O5o-Rbhev8SZVJvwjqio0qc_eiz6AU5vzIes11QJweqLBoCqKJfa2-0GqtVV9pkib7fT-OL0 Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 004f77fba4b14080bca4ae36c857add3 Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_004f77fba4b14080bca4ae36c857add3", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 004f77fba4b14080bca4ae36c857add3 Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ImagesOneServerNegativeTestJSON-622753367-project Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 22306a93c9404db393b92a267d6258d4 Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-622753367-project Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: exception: Image not found. Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'ae4642d4-1ac8-44fd-8a6f-1411934e28a2'} Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ae4642d4-1ac8-44fd-8a6f-1411934e28a2 to delete Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ae4642d4-1ac8-44fd-8a6f-1411934e28a2 could not be found. Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:05.362109 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:05.366885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:05.366885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:05.366885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:05.366885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:05.366885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:05.366885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:02:05.366885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:02:05.366885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:05.366885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:05.366885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 17 21:02:05.366885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 17 21:02:05.366885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 17 21:02:05.366885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:05.366885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:05.366885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:05.366885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:05.366885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:05.366885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:05.366885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:05.366885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:05.366885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 17 21:02:05.366885 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:05.366885 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-087b0006-2789-4e1b-9c8d-e80fa2b468db tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Returning 404 to user: Image not found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:05.366885 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-087b0006-2789-4e1b-9c8d-e80fa2b468db tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "DELETE /compute/v2.1/images/ae4642d4-1ac8-44fd-8a6f-1411934e28a2" status: 404 len: 62 microversion: 2.1 time: 0.069596 Sep 17 21:02:05.366885 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1427/2925] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:05 2022] DELETE /compute/v2.1/images/ae4642d4-1ac8-44fd-8a6f-1411934e28a2 => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 21:02:05.369490 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0b45c273-e64d-4cca-ba2b-b40abba89670 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:05.370064 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0b45c273-e64d-4cca-ba2b-b40abba89670 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:05.377858 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0b45c273-e64d-4cca-ba2b-b40abba89670 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:05.378355 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0b45c273-e64d-4cca-ba2b-b40abba89670 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:05.378794 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0b45c273-e64d-4cca-ba2b-b40abba89670 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:05.379510 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0b45c273-e64d-4cca-ba2b-b40abba89670 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:05.379957 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0b45c273-e64d-4cca-ba2b-b40abba89670 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:05.380382 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0b45c273-e64d-4cca-ba2b-b40abba89670 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:05.421542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d981fdd6-464a-4328-8706-45d4fb4e7efc tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:05.436843 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d981fdd6-464a-4328-8706-45d4fb4e7efc tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:05.440750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d981fdd6-464a-4328-8706-45d4fb4e7efc tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:05.452548 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d981fdd6-464a-4328-8706-45d4fb4e7efc tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1537 microversion: 2.91 time: 0.214329 Sep 17 21:02:05.460778 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1499/2926] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:05 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1537 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:05.469147 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-74d394f6-ec8c-4ece-957b-59a147dc9cca tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:05.471738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-74d394f6-ec8c-4ece-957b-59a147dc9cca tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:05.483289 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-74d394f6-ec8c-4ece-957b-59a147dc9cca tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:05.484270 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-74d394f6-ec8c-4ece-957b-59a147dc9cca tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:05.489629 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-74d394f6-ec8c-4ece-957b-59a147dc9cca tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:05.493236 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-74d394f6-ec8c-4ece-957b-59a147dc9cca tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:05.494011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-74d394f6-ec8c-4ece-957b-59a147dc9cca tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:05.495595 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-74d394f6-ec8c-4ece-957b-59a147dc9cca tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:05.659813 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0b45c273-e64d-4cca-ba2b-b40abba89670 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:05.670901 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0b45c273-e64d-4cca-ba2b-b40abba89670 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1552 microversion: 2.1 time: 0.305049 Sep 17 21:02:05.689289 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1428/2927] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:05 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1552 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:05.694599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bd567c13-284e-4a1b-949f-2858193fb99f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:05.695622 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bd567c13-284e-4a1b-949f-2858193fb99f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:05.702759 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd567c13-284e-4a1b-949f-2858193fb99f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:05.703261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd567c13-284e-4a1b-949f-2858193fb99f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:05.703690 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd567c13-284e-4a1b-949f-2858193fb99f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:05.704410 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd567c13-284e-4a1b-949f-2858193fb99f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:05.705146 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd567c13-284e-4a1b-949f-2858193fb99f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:05.705604 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd567c13-284e-4a1b-949f-2858193fb99f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:05.725657 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-bd567c13-284e-4a1b-949f-2858193fb99f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] HTTP exception thrown: Instance 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 could not be found. Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bd567c13-284e-4a1b-949f-2858193fb99f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Request method failure captured: Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 HTTP/1.1 Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjVSncfbAtgCIyToozPzw5wAkwJ8A5Pq3oENCAdqUUIYA48iSRlVG7zkjE71pODQ7Vq39Whu62dN5SwPbwvIXMyuqDiapFCgUkVVyC-O5o-Rbhev8SZVJvwjqio0qc_eiz6AU5vzIes11QJweqLBoCqKJfa2-0GqtVV9pkib7fT-OL0 Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 004f77fba4b14080bca4ae36c857add3 Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_004f77fba4b14080bca4ae36c857add3", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 004f77fba4b14080bca4ae36c857add3 Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ImagesOneServerNegativeTestJSON-622753367-project Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 22306a93c9404db393b92a267d6258d4 Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-622753367-project Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 could not be found. Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1'} Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 could not be found. Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:05.727288 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:05.731148 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 could not be found. Sep 17 21:02:05.731148 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:05.731148 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:05.731148 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:05.731148 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:05.731148 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:05.731148 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:05.731148 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:05.731148 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:05.731148 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 could not be found. Sep 17 21:02:05.731148 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:05.731148 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bd567c13-284e-4a1b-949f-2858193fb99f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Returning 404 to user: Instance 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:05.731148 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bd567c13-284e-4a1b-949f-2858193fb99f tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1" status: 404 len: 111 microversion: 2.1 time: 0.038483 Sep 17 21:02:05.731148 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1429/2928] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:02:05 2022] DELETE /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:02:05.734579 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-edad59e2-3e13-41ad-ad25-3cfcf7533244 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a486d670>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:05.767433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:02:05.787710 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-edad59e2-3e13-41ad-ad25-3cfcf7533244 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57" status: 200 len: 1452 microversion: 2.1 time: 0.056557 Sep 17 21:02:05.788791 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1430/2929] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:05 2022] GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57 => generated 1452 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:05.793177 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=6 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:02:05.804291 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-74d394f6-ec8c-4ece-957b-59a147dc9cca tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:05.815228 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-261377b9-eeb4-4c88-86f3-757c942322a3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:05.817652 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-261377b9-eeb4-4c88-86f3-757c942322a3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:05.821567 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-74d394f6-ec8c-4ece-957b-59a147dc9cca tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.359291 Sep 17 21:02:05.822362 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1500/2930] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:05 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:05.843429 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3b7e60d4-3c4b-4a3a-9b23-22ac7ae3cad5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:05.848232 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-261377b9-eeb4-4c88-86f3-757c942322a3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:05.848694 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-261377b9-eeb4-4c88-86f3-757c942322a3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:05.849140 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-261377b9-eeb4-4c88-86f3-757c942322a3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:05.850361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3b7e60d4-3c4b-4a3a-9b23-22ac7ae3cad5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] [instance: 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:05.850956 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-261377b9-eeb4-4c88-86f3-757c942322a3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:05.851433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-261377b9-eeb4-4c88-86f3-757c942322a3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:05.851896 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-261377b9-eeb4-4c88-86f3-757c942322a3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:05.863868 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b7e60d4-3c4b-4a3a-9b23-22ac7ae3cad5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:05.865243 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b7e60d4-3c4b-4a3a-9b23-22ac7ae3cad5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:05.866526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b7e60d4-3c4b-4a3a-9b23-22ac7ae3cad5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:05.867596 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b7e60d4-3c4b-4a3a-9b23-22ac7ae3cad5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:05.868215 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b7e60d4-3c4b-4a3a-9b23-22ac7ae3cad5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:05.868865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b7e60d4-3c4b-4a3a-9b23-22ac7ae3cad5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:05.890309 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-3b7e60d4-3c4b-4a3a-9b23-22ac7ae3cad5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] HTTP exception thrown: Instance 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 could not be found. Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3b7e60d4-3c4b-4a3a-9b23-22ac7ae3cad5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Request method failure captured: Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 HTTP/1.1 Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjVSncfbAtgCIyToozPzw5wAkwJ8A5Pq3oENCAdqUUIYA48iSRlVG7zkjE71pODQ7Vq39Whu62dN5SwPbwvIXMyuqDiapFCgUkVVyC-O5o-Rbhev8SZVJvwjqio0qc_eiz6AU5vzIes11QJweqLBoCqKJfa2-0GqtVV9pkib7fT-OL0 Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 004f77fba4b14080bca4ae36c857add3 Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/004f77fba4b14080bca4ae36c857add3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_004f77fba4b14080bca4ae36c857add3", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 004f77fba4b14080bca4ae36c857add3 Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-622753367 Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ImagesOneServerNegativeTestJSON-622753367-project Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 22306a93c9404db393b92a267d6258d4 Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-622753367-project Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 could not be found. Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1'} Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 could not be found. Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 could not be found. Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:05.892381 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:05.897140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:05.897140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:05.897140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:05.897140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:05.897140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:05.897140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:05.897140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 could not be found. Sep 17 21:02:05.897140 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:05.899924 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3b7e60d4-3c4b-4a3a-9b23-22ac7ae3cad5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] Returning 404 to user: Instance 1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:05.901719 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3b7e60d4-3c4b-4a3a-9b23-22ac7ae3cad5 tempest-ImagesOneServerNegativeTestJSON-622753367 tempest-ImagesOneServerNegativeTestJSON-622753367-project] 10.222.0.26 "GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1" status: 404 len: 111 microversion: 2.1 time: 0.068988 Sep 17 21:02:05.902535 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1501/2931] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:05 2022] GET /compute/v2.1/servers/1c26a8d6-a04b-4d2a-bc9f-a0b9cda921a1 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:02:05.908122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0549c86b-c1fd-40f8-b0e3-f3ffe9dd962a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:05.911407 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0549c86b-c1fd-40f8-b0e3-f3ffe9dd962a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 69a7a7d0-992d-42c0-9708-0d0c9256be68] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:05.918043 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-0549c86b-c1fd-40f8-b0e3-f3ffe9dd962a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Instance 69a7a7d0-992d-42c0-9708-0d0c9256be68 could not be found. Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0549c86b-c1fd-40f8-b0e3-f3ffe9dd962a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers/69a7a7d0-992d-42c0-9708-0d0c9256be68/action HTTP/1.1 Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 39 Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: {"os-getConsoleOutput": {"length": 10}} Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 69a7a7d0-992d-42c0-9708-0d0c9256be68 could not be found. Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '69a7a7d0-992d-42c0-9708-0d0c9256be68', 'body': {'os-getConsoleOutput': {'length': 10}}} Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69a7a7d0-992d-42c0-9708-0d0c9256be68 could not be found. Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69a7a7d0-992d-42c0-9708-0d0c9256be68 could not be found. Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:05.927709 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:05.934074 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:05.934074 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:05.934074 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:05.934074 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:05.934074 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69a7a7d0-992d-42c0-9708-0d0c9256be68 could not be found. Sep 17 21:02:05.934074 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:05.935781 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0549c86b-c1fd-40f8-b0e3-f3ffe9dd962a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 404 to user: Instance 69a7a7d0-992d-42c0-9708-0d0c9256be68 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:05.937234 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0549c86b-c1fd-40f8-b0e3-f3ffe9dd962a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers/69a7a7d0-992d-42c0-9708-0d0c9256be68/action" status: 404 len: 111 microversion: 2.1 time: 0.032909 Sep 17 21:02:05.942131 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1502/2932] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:02:05 2022] POST /compute/v2.1/servers/69a7a7d0-992d-42c0-9708-0d0c9256be68/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:02:05.948288 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-26d52b8c-8c73-4d40-bad9-4b94d8b54f37 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:05.949644 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-26d52b8c-8c73-4d40-bad9-4b94d8b54f37 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:05.959505 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26d52b8c-8c73-4d40-bad9-4b94d8b54f37 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:05.960404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26d52b8c-8c73-4d40-bad9-4b94d8b54f37 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:05.961291 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26d52b8c-8c73-4d40-bad9-4b94d8b54f37 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:05.962268 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26d52b8c-8c73-4d40-bad9-4b94d8b54f37 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:05.963034 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26d52b8c-8c73-4d40-bad9-4b94d8b54f37 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:05.964369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26d52b8c-8c73-4d40-bad9-4b94d8b54f37 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:06.028244 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-261377b9-eeb4-4c88-86f3-757c942322a3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.237331 Sep 17 21:02:06.028832 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1431/2933] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Sep 17 21:02:05 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/os-interface => generated 285 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:02:06.235674 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-26d52b8c-8c73-4d40-bad9-4b94d8b54f37 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:06.246180 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-26d52b8c-8c73-4d40-bad9-4b94d8b54f37 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.302486 Sep 17 21:02:06.247682 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1503/2934] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:05 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:06.275755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a870a0ee-a735-41a9-abab-98e278b46bc3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:06.276375 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a870a0ee-a735-41a9-abab-98e278b46bc3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:06.295204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a870a0ee-a735-41a9-abab-98e278b46bc3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:06.296807 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a870a0ee-a735-41a9-abab-98e278b46bc3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:06.297706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a870a0ee-a735-41a9-abab-98e278b46bc3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:06.298731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a870a0ee-a735-41a9-abab-98e278b46bc3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:06.299911 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a870a0ee-a735-41a9-abab-98e278b46bc3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:06.300573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a870a0ee-a735-41a9-abab-98e278b46bc3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:06.316847 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-caa9adde-ca6e-4105-b36d-e2f1c781d44b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:06.317528 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-caa9adde-ca6e-4105-b36d-e2f1c781d44b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:06.323916 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-caa9adde-ca6e-4105-b36d-e2f1c781d44b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:06.324416 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-caa9adde-ca6e-4105-b36d-e2f1c781d44b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:06.324864 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-caa9adde-ca6e-4105-b36d-e2f1c781d44b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:06.326190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-caa9adde-ca6e-4105-b36d-e2f1c781d44b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:06.327338 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-caa9adde-ca6e-4105-b36d-e2f1c781d44b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:06.327748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-caa9adde-ca6e-4105-b36d-e2f1c781d44b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:07.102196 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a870a0ee-a735-41a9-abab-98e278b46bc3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:07.111524 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a870a0ee-a735-41a9-abab-98e278b46bc3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.840645 Sep 17 21:02:07.115888 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1432/2935] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:06 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:07.121306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-caa9adde-ca6e-4105-b36d-e2f1c781d44b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:07.142442 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-caa9adde-ca6e-4105-b36d-e2f1c781d44b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed" status: 200 len: 1498 microversion: 2.1 time: 0.829466 Sep 17 21:02:07.144927 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-53df580d-1f77-4c41-bbdb-786f2fdddfdf tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:07.146036 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1504/2936] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:06 2022] GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed => generated 1498 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:02:07.150879 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b57f622d-d0c4-4d6c-a524-80f076e53f4d tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a4331310>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:07.151789 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-53df580d-1f77-4c41-bbdb-786f2fdddfdf tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:07.166095 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53df580d-1f77-4c41-bbdb-786f2fdddfdf tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:07.166756 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53df580d-1f77-4c41-bbdb-786f2fdddfdf tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:07.167373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53df580d-1f77-4c41-bbdb-786f2fdddfdf tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:07.168247 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53df580d-1f77-4c41-bbdb-786f2fdddfdf tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:07.168854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53df580d-1f77-4c41-bbdb-786f2fdddfdf tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:07.169493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53df580d-1f77-4c41-bbdb-786f2fdddfdf tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:07.239840 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b57f622d-d0c4-4d6c-a524-80f076e53f4d tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57" status: 200 len: 1452 microversion: 2.1 time: 0.092033 Sep 17 21:02:07.241116 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1505/2937] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:07 2022] GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57 => generated 1452 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:07.261242 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ea601955-5e05-4bd5-ac80-2ac139127fe8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:07.265814 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ea601955-5e05-4bd5-ac80-2ac139127fe8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 64987b52-45ce-4f17-a807-060945d8578b] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:07.279627 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-ea601955-5e05-4bd5-ac80-2ac139127fe8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Instance 64987b52-45ce-4f17-a807-060945d8578b could not be found. Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ea601955-5e05-4bd5-ac80-2ac139127fe8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/64987b52-45ce-4f17-a807-060945d8578b HTTP/1.1 Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 64987b52-45ce-4f17-a807-060945d8578b could not be found. Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '64987b52-45ce-4f17-a807-060945d8578b'} Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64987b52-45ce-4f17-a807-060945d8578b could not be found. Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64987b52-45ce-4f17-a807-060945d8578b could not be found. Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:07.284019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:07.288857 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:07.288857 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:07.288857 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:07.288857 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64987b52-45ce-4f17-a807-060945d8578b could not be found. Sep 17 21:02:07.288857 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:07.288857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ea601955-5e05-4bd5-ac80-2ac139127fe8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 404 to user: Instance 64987b52-45ce-4f17-a807-060945d8578b could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:07.288857 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ea601955-5e05-4bd5-ac80-2ac139127fe8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/64987b52-45ce-4f17-a807-060945d8578b" status: 404 len: 111 microversion: 2.1 time: 0.046514 Sep 17 21:02:07.289853 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1506/2938] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:07 2022] GET /compute/v2.1/servers/64987b52-45ce-4f17-a807-060945d8578b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:02:07.304812 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4801d311-069a-4d04-b513-dbbaea17103f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:07.309266 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4801d311-069a-4d04-b513-dbbaea17103f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:07.326245 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-53df580d-1f77-4c41-bbdb-786f2fdddfdf tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:07.331136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4801d311-069a-4d04-b513-dbbaea17103f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:07.334169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:02:07.337554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4801d311-069a-4d04-b513-dbbaea17103f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:07.339269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4801d311-069a-4d04-b513-dbbaea17103f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:07.341283 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4801d311-069a-4d04-b513-dbbaea17103f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:07.342288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-53df580d-1f77-4c41-bbdb-786f2fdddfdf tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:07.343689 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4801d311-069a-4d04-b513-dbbaea17103f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:07.344144 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4801d311-069a-4d04-b513-dbbaea17103f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:07.344605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-53df580d-1f77-4c41-bbdb-786f2fdddfdf tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:07.359574 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-53df580d-1f77-4c41-bbdb-786f2fdddfdf tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1537 microversion: 2.91 time: 0.242158 Sep 17 21:02:07.361248 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1433/2939] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:07 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1537 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:07.536415 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4801d311-069a-4d04-b513-dbbaea17103f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:07.547268 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4801d311-069a-4d04-b513-dbbaea17103f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.248162 Sep 17 21:02:07.548419 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1507/2940] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:07 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:07.589623 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-55151f1f-1d0f-41e8-a376-a9a667e7d36c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:07.590244 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-55151f1f-1d0f-41e8-a376-a9a667e7d36c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:07.629163 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55151f1f-1d0f-41e8-a376-a9a667e7d36c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:07.637927 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55151f1f-1d0f-41e8-a376-a9a667e7d36c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:07.637927 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55151f1f-1d0f-41e8-a376-a9a667e7d36c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:07.637927 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55151f1f-1d0f-41e8-a376-a9a667e7d36c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:07.639325 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55151f1f-1d0f-41e8-a376-a9a667e7d36c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:07.641582 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55151f1f-1d0f-41e8-a376-a9a667e7d36c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:07.787820 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-01d30cf2-c823-4623-a9f2-295056537d49 tempest-QuotasTestJSON-1488837861 tempest-QuotasTestJSON-1488837861-project] Calling method '.version_select at 0x7f25a4331af0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:07.882975 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-01d30cf2-c823-4623-a9f2-295056537d49 tempest-QuotasTestJSON-1488837861 tempest-QuotasTestJSON-1488837861-project] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/79c766c4e65e4af69d9f096d5d5c73be/defaults" status: 200 len: 371 microversion: 2.1 time: 0.268076 Sep 17 21:02:07.883750 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1508/2941] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Sep 17 21:02:07 2022] GET /compute/v2.1/os-quota-sets/79c766c4e65e4af69d9f096d5d5c73be/defaults => generated 371 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:02:07.896719 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1f69cbee-15e7-41ba-a7b8-cf1cc3a10fe2 tempest-QuotasTestJSON-1488837861 tempest-QuotasTestJSON-1488837861-project] Calling method '.version_select at 0x7f25a42cf670>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:07.993008 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1f69cbee-15e7-41ba-a7b8-cf1cc3a10fe2 tempest-QuotasTestJSON-1488837861 tempest-QuotasTestJSON-1488837861-project] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/79c766c4e65e4af69d9f096d5d5c73be" status: 200 len: 371 microversion: 2.1 time: 0.100034 Sep 17 21:02:08.003200 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1509/2942] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Sep 17 21:02:07 2022] GET /compute/v2.1/os-quota-sets/79c766c4e65e4af69d9f096d5d5c73be => generated 371 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:02:08.012045 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5d1ee5fb-f842-40b6-916b-cae505da9989 tempest-QuotasTestJSON-1488837861 tempest-QuotasTestJSON-1488837861-project] Calling method '.version_select at 0x7f25a4265670>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:08.095306 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5d1ee5fb-f842-40b6-916b-cae505da9989 tempest-QuotasTestJSON-1488837861 tempest-QuotasTestJSON-1488837861-project] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/79c766c4e65e4af69d9f096d5d5c73be/defaults" status: 200 len: 371 microversion: 2.1 time: 0.089883 Sep 17 21:02:08.096706 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1510/2943] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Sep 17 21:02:08 2022] GET /compute/v2.1/os-quota-sets/79c766c4e65e4af69d9f096d5d5c73be/defaults => generated 371 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:02:08.112402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-543ac28b-935b-4ba5-9fd7-8afcb1883e86 tempest-QuotasTestJSON-1488837861 tempest-QuotasTestJSON-1488837861-project] Calling method '.version_select at 0x7f25a43314c0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:08.243571 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-543ac28b-935b-4ba5-9fd7-8afcb1883e86 tempest-QuotasTestJSON-1488837861 tempest-QuotasTestJSON-1488837861-project] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/79c766c4e65e4af69d9f096d5d5c73be" status: 200 len: 371 microversion: 2.1 time: 0.136709 Sep 17 21:02:08.244257 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1511/2944] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Sep 17 21:02:08 2022] GET /compute/v2.1/os-quota-sets/79c766c4e65e4af69d9f096d5d5c73be => generated 371 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:02:08.249009 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e1755582-fa87-4d01-9957-45014b3755af tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:08.249624 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e1755582-fa87-4d01-9957-45014b3755af tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:08.269731 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1755582-fa87-4d01-9957-45014b3755af tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:08.271042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1755582-fa87-4d01-9957-45014b3755af tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:08.272514 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1755582-fa87-4d01-9957-45014b3755af tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:08.275263 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1755582-fa87-4d01-9957-45014b3755af tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:08.302563 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1755582-fa87-4d01-9957-45014b3755af tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:08.303629 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1755582-fa87-4d01-9957-45014b3755af tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:08.392058 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-55151f1f-1d0f-41e8-a376-a9a667e7d36c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:08.404520 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-55151f1f-1d0f-41e8-a376-a9a667e7d36c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.833081 Sep 17 21:02:08.411329 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1434/2945] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:07 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:08.424860 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e12f8bd7-b17a-407c-9107-ee5d6e4bc0e0 tempest-QuotasTestJSON-1488837861 tempest-QuotasTestJSON-1488837861-project] Calling method '.version_select at 0x7f25a47e23a0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:08.544390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e1755582-fa87-4d01-9957-45014b3755af tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:08.557822 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e1755582-fa87-4d01-9957-45014b3755af tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed" status: 200 len: 1498 microversion: 2.1 time: 0.311075 Sep 17 21:02:08.558725 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1512/2946] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:08 2022] GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed => generated 1498 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:08.564089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-99ae1df4-67f3-41c9-92cb-b36123d5bfe9 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a425b5e0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:08.644217 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-99ae1df4-67f3-41c9-92cb-b36123d5bfe9 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57" status: 200 len: 1452 microversion: 2.1 time: 0.084128 Sep 17 21:02:08.645058 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1513/2947] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:08 2022] GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57 => generated 1452 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:08.645918 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e12f8bd7-b17a-407c-9107-ee5d6e4bc0e0 tempest-QuotasTestJSON-1488837861 tempest-QuotasTestJSON-1488837861-project] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/79c766c4e65e4af69d9f096d5d5c73be?user_id=5efa7e46d0004e72abf5b53994dfcfb9" status: 200 len: 371 microversion: 2.1 time: 0.216617 Sep 17 21:02:08.648089 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1435/2948] 10.222.0.26 () {58 vars in 1323 bytes} [Sat Sep 17 21:02:08 2022] GET /compute/v2.1/os-quota-sets/79c766c4e65e4af69d9f096d5d5c73be?user_id=5efa7e46d0004e72abf5b53994dfcfb9 => generated 371 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:02:08.659291 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f20f1733-3362-436c-b5e8-0d4d88195d1b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:08.663602 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f20f1733-3362-436c-b5e8-0d4d88195d1b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:08.669278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-79624f4d-c253-446e-a101-8dee090b3f48 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1486353541", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "dc0ab76b-95f3-4f0a-beab-7465ea19ce7a"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:08.675319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:02:08.690441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f20f1733-3362-436c-b5e8-0d4d88195d1b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:08.691192 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f20f1733-3362-436c-b5e8-0d4d88195d1b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:08.691940 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f20f1733-3362-436c-b5e8-0d4d88195d1b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:08.695800 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f20f1733-3362-436c-b5e8-0d4d88195d1b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:08.696456 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f20f1733-3362-436c-b5e8-0d4d88195d1b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:08.697221 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f20f1733-3362-436c-b5e8-0d4d88195d1b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-79624f4d-c253-446e-a101-8dee090b3f48 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 238 Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1486353541", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "dc0ab76b-95f3-4f0a-beab-7465ea19ce7a"}]}} Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1486353541', 'imageRef': '1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'dc0ab76b-95f3-4f0a-beab-7465ea19ce7a'}]}}} Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise error Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:08.712587 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:08.719127 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:08.719127 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:08.719127 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:08.719127 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:08.719127 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:08.719127 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:08.719127 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:02:08.719127 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:02:08.719127 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 21:02:08.719127 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 21:02:08.719127 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 21:02:08.719127 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 21:02:08.719127 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 21:02:08.719127 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 21:02:08.719127 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 17 21:02:08.719127 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:08.719127 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:08.719127 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:08.719127 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:08.719127 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:08.719127 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:08.719127 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 21:02:08.719127 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 21:02:08.719127 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 17 21:02:08.719127 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:08.719127 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-79624f4d-c253-446e-a101-8dee090b3f48 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:08.719127 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-79624f4d-c253-446e-a101-8dee090b3f48 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.068376 Sep 17 21:02:08.721503 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1436/2949] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:02:08 2022] POST /compute/v2.1/servers => generated 139 bytes in 70 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:02:08.730525 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fc0c0798-c579-4399-a59a-3e1ea9229d7d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:08.732774 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fc0c0798-c579-4399-a59a-3e1ea9229d7d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:08.749009 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc0c0798-c579-4399-a59a-3e1ea9229d7d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:08.752769 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc0c0798-c579-4399-a59a-3e1ea9229d7d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:08.754475 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc0c0798-c579-4399-a59a-3e1ea9229d7d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:08.755482 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc0c0798-c579-4399-a59a-3e1ea9229d7d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:08.756237 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc0c0798-c579-4399-a59a-3e1ea9229d7d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:08.756870 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc0c0798-c579-4399-a59a-3e1ea9229d7d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:08.969802 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f20f1733-3362-436c-b5e8-0d4d88195d1b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:08.984661 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f20f1733-3362-436c-b5e8-0d4d88195d1b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:08.986600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f20f1733-3362-436c-b5e8-0d4d88195d1b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:09.000769 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f20f1733-3362-436c-b5e8-0d4d88195d1b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1537 microversion: 2.91 time: 0.353352 Sep 17 21:02:09.001374 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1514/2950] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:08 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1537 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:09.081386 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fc0c0798-c579-4399-a59a-3e1ea9229d7d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:09.095764 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fc0c0798-c579-4399-a59a-3e1ea9229d7d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.372157 Sep 17 21:02:09.096726 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1437/2951] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:08 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:09.122830 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-49bdaa77-c525-47c4-927c-0f993ee423c0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:09.123727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-49bdaa77-c525-47c4-927c-0f993ee423c0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:09.133208 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49bdaa77-c525-47c4-927c-0f993ee423c0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:09.133750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49bdaa77-c525-47c4-927c-0f993ee423c0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:09.134199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49bdaa77-c525-47c4-927c-0f993ee423c0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:09.135295 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49bdaa77-c525-47c4-927c-0f993ee423c0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:09.135753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49bdaa77-c525-47c4-927c-0f993ee423c0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:09.136185 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49bdaa77-c525-47c4-927c-0f993ee423c0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:09.366885 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-49bdaa77-c525-47c4-927c-0f993ee423c0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:09.385996 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-49bdaa77-c525-47c4-927c-0f993ee423c0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.267104 Sep 17 21:02:09.398663 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1515/2952] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:09 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:09.584041 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-37a99040-591d-45f5-8fb0-82ce7cdabc00 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-319301619", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "dc0ab76b-95f3-4f0a-beab-7465ea19ce7a"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:09.585003 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f8b9572d-9eca-4d51-a798-e469095a507f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:09.585665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f8b9572d-9eca-4d51-a798-e469095a507f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:09.595271 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8b9572d-9eca-4d51-a798-e469095a507f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:09.595701 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8b9572d-9eca-4d51-a798-e469095a507f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:09.596144 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8b9572d-9eca-4d51-a798-e469095a507f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-37a99040-591d-45f5-8fb0-82ce7cdabc00 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 234 Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-319301619", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "dc0ab76b-95f3-4f0a-beab-7465ea19ce7a"}]}} Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-319301619', 'imageRef': '1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'dc0ab76b-95f3-4f0a-beab-7465ea19ce7a'}]}}} Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise error Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi 'notvalid' Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:09.596589 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:09.602555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:09.602555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:09.602555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:09.602555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:09.602555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:09.602555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:09.602555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:02:09.602555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:02:09.602555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 21:02:09.602555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 21:02:09.602555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 21:02:09.602555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 21:02:09.602555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 21:02:09.602555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 21:02:09.602555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 17 21:02:09.602555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:09.602555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:09.602555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:09.602555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:09.602555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:09.602555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:09.602555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 21:02:09.602555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 21:02:09.602555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 17 21:02:09.602555 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:09.604051 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8b9572d-9eca-4d51-a798-e469095a507f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:09.604135 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-37a99040-591d-45f5-8fb0-82ce7cdabc00 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:09.604220 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8b9572d-9eca-4d51-a798-e469095a507f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:09.604220 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8b9572d-9eca-4d51-a798-e469095a507f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:09.604360 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-37a99040-591d-45f5-8fb0-82ce7cdabc00 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.025306 Sep 17 21:02:09.604360 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1438/2953] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:02:09 2022] POST /compute/v2.1/servers => generated 133 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 17 21:02:09.611346 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d8a88bd5-6a5e-400a-99eb-0627295c15ec tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:09.613283 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d8a88bd5-6a5e-400a-99eb-0627295c15ec tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:09.643786 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8a88bd5-6a5e-400a-99eb-0627295c15ec tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:09.644783 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8a88bd5-6a5e-400a-99eb-0627295c15ec tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:09.645475 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8a88bd5-6a5e-400a-99eb-0627295c15ec tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:09.646814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8a88bd5-6a5e-400a-99eb-0627295c15ec tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:09.648043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8a88bd5-6a5e-400a-99eb-0627295c15ec tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:09.648931 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8a88bd5-6a5e-400a-99eb-0627295c15ec tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:09.834131 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f8b9572d-9eca-4d51-a798-e469095a507f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3009c5feb1ef43a08b07996d8f63bf11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89b46ae7347d4f2daf02f627e41a4847', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:09.849852 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f8b9572d-9eca-4d51-a798-e469095a507f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed" status: 200 len: 1456 microversion: 2.1 time: 0.268487 Sep 17 21:02:09.851106 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1516/2954] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:09 2022] GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed => generated 1456 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:09.925890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8d3e7ab2-e2ee-40c3-b4b0-7215ed15f986 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a425baf0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:10.029299 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8d3e7ab2-e2ee-40c3-b4b0-7215ed15f986 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57" status: 200 len: 1452 microversion: 2.1 time: 0.171416 Sep 17 21:02:10.030315 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1517/2955] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:09 2022] GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57 => generated 1452 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:10.042573 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-80611c59-4457-4d32-9598-5450bad535a8 req-09d095db-31a6-455c-900c-ba26c4435a2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed", "name": "network-vif-deleted", "tag": "c50dd621-0204-45a5-877f-f63e4b02207a"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:10.061916 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-80611c59-4457-4d32-9598-5450bad535a8 req-09d095db-31a6-455c-900c-ba26c4435a2f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:10.062408 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-80611c59-4457-4d32-9598-5450bad535a8 req-09d095db-31a6-455c-900c-ba26c4435a2f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:10.062848 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-80611c59-4457-4d32-9598-5450bad535a8 req-09d095db-31a6-455c-900c-ba26c4435a2f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:10.080986 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-80611c59-4457-4d32-9598-5450bad535a8 req-09d095db-31a6-455c-900c-ba26c4435a2f service nova] Creating event network-vif-deleted:c50dd621-0204-45a5-877f-f63e4b02207a for instance 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed on nch1-master-1 Sep 17 21:02:10.090679 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-80611c59-4457-4d32-9598-5450bad535a8 req-09d095db-31a6-455c-900c-ba26c4435a2f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058301 Sep 17 21:02:10.091926 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1518/2956] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:02:10.099212 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-06572821-c1a6-4626-8beb-f36d6ea870e2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:10.100358 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-06572821-c1a6-4626-8beb-f36d6ea870e2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:10.108504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06572821-c1a6-4626-8beb-f36d6ea870e2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:10.109406 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06572821-c1a6-4626-8beb-f36d6ea870e2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:10.111303 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06572821-c1a6-4626-8beb-f36d6ea870e2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:10.111825 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06572821-c1a6-4626-8beb-f36d6ea870e2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:10.112299 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06572821-c1a6-4626-8beb-f36d6ea870e2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:10.112907 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06572821-c1a6-4626-8beb-f36d6ea870e2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:10.161838 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d8a88bd5-6a5e-400a-99eb-0627295c15ec tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:10.186003 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d8a88bd5-6a5e-400a-99eb-0627295c15ec tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.579290 Sep 17 21:02:10.193942 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1439/2957] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:09 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:10.221986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4c34f061-87a2-4a09-827f-f8be090c28b8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:10.222703 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4c34f061-87a2-4a09-827f-f8be090c28b8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:10.235459 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c34f061-87a2-4a09-827f-f8be090c28b8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:10.236423 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c34f061-87a2-4a09-827f-f8be090c28b8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:10.237024 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c34f061-87a2-4a09-827f-f8be090c28b8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:10.238584 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c34f061-87a2-4a09-827f-f8be090c28b8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:10.239226 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c34f061-87a2-4a09-827f-f8be090c28b8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:10.242766 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-06572821-c1a6-4626-8beb-f36d6ea870e2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:10.248632 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c34f061-87a2-4a09-827f-f8be090c28b8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:10.256130 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-06572821-c1a6-4626-8beb-f36d6ea870e2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:10.260989 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-06572821-c1a6-4626-8beb-f36d6ea870e2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:10.276256 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-06572821-c1a6-4626-8beb-f36d6ea870e2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1537 microversion: 2.91 time: 0.182527 Sep 17 21:02:10.293527 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1519/2958] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:10 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1537 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:10.429212 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4c34f061-87a2-4a09-827f-f8be090c28b8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:10.439462 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4c34f061-87a2-4a09-827f-f8be090c28b8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.228018 Sep 17 21:02:10.440358 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1440/2959] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:10 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:10.462846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-78621445-e777-434d-aaa8-650937ee6a20 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:10.463409 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-78621445-e777-434d-aaa8-650937ee6a20 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 5d80d60d-4df9-4e29-a5ad-08e23d748719] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:10.469199 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-78621445-e777-434d-aaa8-650937ee6a20 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Instance 5d80d60d-4df9-4e29-a5ad-08e23d748719 could not be found. Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-78621445-e777-434d-aaa8-650937ee6a20 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers/5d80d60d-4df9-4e29-a5ad-08e23d748719/action HTTP/1.1 Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 13 Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: {"pause": {}} Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 5d80d60d-4df9-4e29-a5ad-08e23d748719 could not be found. Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '5d80d60d-4df9-4e29-a5ad-08e23d748719', 'body': {'pause': {}}} Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d80d60d-4df9-4e29-a5ad-08e23d748719 could not be found. Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d80d60d-4df9-4e29-a5ad-08e23d748719 could not be found. Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:10.477913 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:10.482024 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:10.482024 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:10.482024 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d80d60d-4df9-4e29-a5ad-08e23d748719 could not be found. Sep 17 21:02:10.482024 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:10.482024 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-78621445-e777-434d-aaa8-650937ee6a20 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 404 to user: Instance 5d80d60d-4df9-4e29-a5ad-08e23d748719 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:10.482024 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-78621445-e777-434d-aaa8-650937ee6a20 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers/5d80d60d-4df9-4e29-a5ad-08e23d748719/action" status: 404 len: 111 microversion: 2.1 time: 0.021678 Sep 17 21:02:10.482024 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1520/2960] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:02:10 2022] POST /compute/v2.1/servers/5d80d60d-4df9-4e29-a5ad-08e23d748719/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 21:02:10.488553 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-67061956-a473-4ce9-ace3-82b3e654409a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:10.489191 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-67061956-a473-4ce9-ace3-82b3e654409a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:10.497228 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67061956-a473-4ce9-ace3-82b3e654409a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:10.497800 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67061956-a473-4ce9-ace3-82b3e654409a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:10.498254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67061956-a473-4ce9-ace3-82b3e654409a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:10.499130 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67061956-a473-4ce9-ace3-82b3e654409a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:10.499601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67061956-a473-4ce9-ace3-82b3e654409a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:10.500035 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67061956-a473-4ce9-ace3-82b3e654409a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:10.667179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-67061956-a473-4ce9-ace3-82b3e654409a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:10.684364 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-67061956-a473-4ce9-ace3-82b3e654409a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.199372 Sep 17 21:02:10.686462 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1441/2961] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:10 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:10.713603 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-45abbb45-3d01-4445-b3cf-5e786cba76c4 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:10.715108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-45abbb45-3d01-4445-b3cf-5e786cba76c4 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:10.747749 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45abbb45-3d01-4445-b3cf-5e786cba76c4 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:10.747749 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45abbb45-3d01-4445-b3cf-5e786cba76c4 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:10.747749 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45abbb45-3d01-4445-b3cf-5e786cba76c4 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:10.747749 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45abbb45-3d01-4445-b3cf-5e786cba76c4 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:10.747749 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45abbb45-3d01-4445-b3cf-5e786cba76c4 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:10.747749 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45abbb45-3d01-4445-b3cf-5e786cba76c4 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:10.886902 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-68cb31ec-d5ce-4558-bcd1-a8f84419c968 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:10.888446 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-68cb31ec-d5ce-4558-bcd1-a8f84419c968 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:10.899567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68cb31ec-d5ce-4558-bcd1-a8f84419c968 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:10.900865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68cb31ec-d5ce-4558-bcd1-a8f84419c968 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:10.902038 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68cb31ec-d5ce-4558-bcd1-a8f84419c968 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:10.903568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68cb31ec-d5ce-4558-bcd1-a8f84419c968 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:10.904838 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68cb31ec-d5ce-4558-bcd1-a8f84419c968 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:10.906211 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68cb31ec-d5ce-4558-bcd1-a8f84419c968 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:10.909489 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-45abbb45-3d01-4445-b3cf-5e786cba76c4 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:10.920475 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-45abbb45-3d01-4445-b3cf-5e786cba76c4 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.211159 Sep 17 21:02:10.921219 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1521/2962] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:10 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-68cb31ec-d5ce-4558-bcd1-a8f84419c968 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] HTTP exception thrown: Instance 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed could not be found. Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-68cb31ec-d5ce-4558-bcd1-a8f84419c968 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Request method failure captured: Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed HTTP/1.1 Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjSr4eYJ5iRC0BESTxyEYBHr6fTKXAfzmSKRijJd1-Dg4_6zeDPSLMVKcn7Va4xyX_oACpKQBdCcihzycrxxeD9gtcf6rUAIbBHhHnQZK1W2woTj604P1AONqCzsshMWFY41NR-lshpdEXKwYePjmUqN1wZWN-nWEva1tUOKD4iFshs Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89b46ae7347d4f2daf02f627e41a4847", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 3009c5feb1ef43a08b07996d8f63bf11 Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed could not be found. Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed'} Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed could not be found. Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:10.933918 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:10.942722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed could not be found. Sep 17 21:02:10.942722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:10.942722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:10.942722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:10.942722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:10.942722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:10.942722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:10.942722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:10.942722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:10.942722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed could not be found. Sep 17 21:02:10.942722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:10.942722 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-68cb31ec-d5ce-4558-bcd1-a8f84419c968 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Returning 404 to user: Instance 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:10.942722 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-68cb31ec-d5ce-4558-bcd1-a8f84419c968 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed" status: 404 len: 111 microversion: 2.1 time: 0.052148 Sep 17 21:02:10.942722 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1442/2963] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:10 2022] GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:02:10.951977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-78b0b1c8-2220-4a1d-aa72-08fc333d7787 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:10.953092 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-78b0b1c8-2220-4a1d-aa72-08fc333d7787 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:10.956184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b9159b72-4d23-4bee-b0a8-6d8d423caabc tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:10.963245 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-78b0b1c8-2220-4a1d-aa72-08fc333d7787 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:10.963245 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-78b0b1c8-2220-4a1d-aa72-08fc333d7787 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:10.963663 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-78b0b1c8-2220-4a1d-aa72-08fc333d7787 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:10.964537 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-78b0b1c8-2220-4a1d-aa72-08fc333d7787 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:10.965112 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-78b0b1c8-2220-4a1d-aa72-08fc333d7787 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:10.965705 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-78b0b1c8-2220-4a1d-aa72-08fc333d7787 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:10.973315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b9159b72-4d23-4bee-b0a8-6d8d423caabc tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:10.980796 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9159b72-4d23-4bee-b0a8-6d8d423caabc tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:10.981705 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9159b72-4d23-4bee-b0a8-6d8d423caabc tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:10.982409 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9159b72-4d23-4bee-b0a8-6d8d423caabc tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:10.983394 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9159b72-4d23-4bee-b0a8-6d8d423caabc tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:10.984104 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9159b72-4d23-4bee-b0a8-6d8d423caabc tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:10.984775 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9159b72-4d23-4bee-b0a8-6d8d423caabc tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:11.001224 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-b9159b72-4d23-4bee-b0a8-6d8d423caabc tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] HTTP exception thrown: Instance 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed could not be found. Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b9159b72-4d23-4bee-b0a8-6d8d423caabc tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Request method failure captured: Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed HTTP/1.1 Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjSr4eYJ5iRC0BESTxyEYBHr6fTKXAfzmSKRijJd1-Dg4_6zeDPSLMVKcn7Va4xyX_oACpKQBdCcihzycrxxeD9gtcf6rUAIbBHhHnQZK1W2woTj604P1AONqCzsshMWFY41NR-lshpdEXKwYePjmUqN1wZWN-nWEva1tUOKD4iFshs Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89b46ae7347d4f2daf02f627e41a4847", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 3009c5feb1ef43a08b07996d8f63bf11 Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed could not be found. Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed'} Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed could not be found. Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:11.003562 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:11.007584 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed could not be found. Sep 17 21:02:11.007584 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.007584 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:11.007584 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.007584 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:11.007584 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:11.007584 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:11.007584 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:11.007584 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:11.007584 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed could not be found. Sep 17 21:02:11.007584 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.010304 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b9159b72-4d23-4bee-b0a8-6d8d423caabc tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Returning 404 to user: Instance 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:11.011440 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b9159b72-4d23-4bee-b0a8-6d8d423caabc tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "DELETE /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed" status: 404 len: 111 microversion: 2.1 time: 0.065064 Sep 17 21:02:11.015393 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1522/2964] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:02:10 2022] DELETE /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:02:11.021651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b0ccf333-0987-4cb9-8636-68917424707f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:11.022541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b0ccf333-0987-4cb9-8636-68917424707f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:11.031012 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b0ccf333-0987-4cb9-8636-68917424707f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:11.031857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b0ccf333-0987-4cb9-8636-68917424707f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:11.032510 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b0ccf333-0987-4cb9-8636-68917424707f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:11.033435 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b0ccf333-0987-4cb9-8636-68917424707f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:11.034184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b0ccf333-0987-4cb9-8636-68917424707f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:11.034839 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b0ccf333-0987-4cb9-8636-68917424707f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:11.058352 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-b0ccf333-0987-4cb9-8636-68917424707f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] HTTP exception thrown: Instance 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed could not be found. Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b0ccf333-0987-4cb9-8636-68917424707f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Request method failure captured: Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed HTTP/1.1 Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjSr4eYJ5iRC0BESTxyEYBHr6fTKXAfzmSKRijJd1-Dg4_6zeDPSLMVKcn7Va4xyX_oACpKQBdCcihzycrxxeD9gtcf6rUAIbBHhHnQZK1W2woTj604P1AONqCzsshMWFY41NR-lshpdEXKwYePjmUqN1wZWN-nWEva1tUOKD4iFshs Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89b46ae7347d4f2daf02f627e41a4847", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 3009c5feb1ef43a08b07996d8f63bf11 Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed could not be found. Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed'} Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed could not be found. Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed could not be found. Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:11.060605 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.064706 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:11.064706 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:11.064706 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:11.064706 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:11.064706 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:11.064706 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed could not be found. Sep 17 21:02:11.064706 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.064706 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b0ccf333-0987-4cb9-8636-68917424707f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Returning 404 to user: Instance 19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:11.065928 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b0ccf333-0987-4cb9-8636-68917424707f tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed" status: 404 len: 111 microversion: 2.1 time: 0.046972 Sep 17 21:02:11.069664 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1523/2965] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:11 2022] GET /compute/v2.1/servers/19edb4f4-7b53-4e16-8e1b-ee2a19b7a5ed => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:02:11.075315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-38a24917-b65f-4aa3-aabe-47ac01cd3918 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a42f5dc0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:11.134347 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-78b0b1c8-2220-4a1d-aa72-08fc333d7787 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a/action" status: 202 len: 0 microversion: 2.1 time: 0.186813 Sep 17 21:02:11.138985 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1443/2966] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:02:10 2022] POST /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 17 21:02:11.165977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-efd299cd-e848-4c84-9cd3-589e70a5a234 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:11.166812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-efd299cd-e848-4c84-9cd3-589e70a5a234 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:11.168944 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-38a24917-b65f-4aa3-aabe-47ac01cd3918 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57" status: 200 len: 1461 microversion: 2.1 time: 0.100032 Sep 17 21:02:11.170928 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1524/2967] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:11 2022] GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57 => generated 1461 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:11.182448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6d91bf13-ec96-4226-9eb3-3486002a4a69 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:11.184443 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6d91bf13-ec96-4226-9eb3-3486002a4a69 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:11.198895 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6d91bf13-ec96-4226-9eb3-3486002a4a69 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:11.199763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:02:11.202790 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6d91bf13-ec96-4226-9eb3-3486002a4a69 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:11.205576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6d91bf13-ec96-4226-9eb3-3486002a4a69 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:11.205807 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-efd299cd-e848-4c84-9cd3-589e70a5a234 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:11.206704 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6d91bf13-ec96-4226-9eb3-3486002a4a69 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:11.207549 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-efd299cd-e848-4c84-9cd3-589e70a5a234 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:11.208047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-efd299cd-e848-4c84-9cd3-589e70a5a234 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:11.209578 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6d91bf13-ec96-4226-9eb3-3486002a4a69 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:11.210284 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6d91bf13-ec96-4226-9eb3-3486002a4a69 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:11.212175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-efd299cd-e848-4c84-9cd3-589e70a5a234 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:11.212663 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-efd299cd-e848-4c84-9cd3-589e70a5a234 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:11.213106 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-efd299cd-e848-4c84-9cd3-589e70a5a234 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:11.235724 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-efd299cd-e848-4c84-9cd3-589e70a5a234 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] HTTP exception thrown: Instance b37a20c2-7329-4a0e-8b31-d0a7c39344b3 could not be found. Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-efd299cd-e848-4c84-9cd3-589e70a5a234 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Request method failure captured: Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 HTTP/1.1 Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjSr4eYJ5iRC0BESTxyEYBHr6fTKXAfzmSKRijJd1-Dg4_6zeDPSLMVKcn7Va4xyX_oACpKQBdCcihzycrxxeD9gtcf6rUAIbBHhHnQZK1W2woTj604P1AONqCzsshMWFY41NR-lshpdEXKwYePjmUqN1wZWN-nWEva1tUOKD4iFshs Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89b46ae7347d4f2daf02f627e41a4847", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 3009c5feb1ef43a08b07996d8f63bf11 Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance b37a20c2-7329-4a0e-8b31-d0a7c39344b3 could not be found. Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'b37a20c2-7329-4a0e-8b31-d0a7c39344b3'} Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b37a20c2-7329-4a0e-8b31-d0a7c39344b3 could not be found. Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:11.237418 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:11.244228 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b37a20c2-7329-4a0e-8b31-d0a7c39344b3 could not be found. Sep 17 21:02:11.244228 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.244228 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:11.244228 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.244228 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:11.244228 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:11.244228 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:11.244228 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:11.244228 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:11.244228 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b37a20c2-7329-4a0e-8b31-d0a7c39344b3 could not be found. Sep 17 21:02:11.244228 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.250945 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-efd299cd-e848-4c84-9cd3-589e70a5a234 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Returning 404 to user: Instance b37a20c2-7329-4a0e-8b31-d0a7c39344b3 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:11.253107 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-efd299cd-e848-4c84-9cd3-589e70a5a234 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 404 len: 111 microversion: 2.1 time: 0.110909 Sep 17 21:02:11.253906 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1444/2968] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:02:11 2022] DELETE /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:02:11.262129 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c382eb15-99f5-46d9-b1c9-0c83aa9e151c tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a47fa310>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:11.366385 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c382eb15-99f5-46d9-b1c9-0c83aa9e151c tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57" status: 200 len: 1461 microversion: 2.1 time: 0.111070 Sep 17 21:02:11.375367 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1445/2969] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:11 2022] GET /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57 => generated 1461 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:11.377848 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f758cab5-d6f1-4bbe-ac27-766bc7ea1d73 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:11.379328 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f758cab5-d6f1-4bbe-ac27-766bc7ea1d73 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: b37a20c2-7329-4a0e-8b31-d0a7c39344b3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:11.397976 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f758cab5-d6f1-4bbe-ac27-766bc7ea1d73 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:11.398532 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f758cab5-d6f1-4bbe-ac27-766bc7ea1d73 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:11.398979 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f758cab5-d6f1-4bbe-ac27-766bc7ea1d73 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:11.399696 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f758cab5-d6f1-4bbe-ac27-766bc7ea1d73 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:11.400155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f758cab5-d6f1-4bbe-ac27-766bc7ea1d73 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:11.400591 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f758cab5-d6f1-4bbe-ac27-766bc7ea1d73 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:11.430726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6d91bf13-ec96-4226-9eb3-3486002a4a69 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:11.435828 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-f758cab5-d6f1-4bbe-ac27-766bc7ea1d73 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] HTTP exception thrown: Instance b37a20c2-7329-4a0e-8b31-d0a7c39344b3 could not be found. Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f758cab5-d6f1-4bbe-ac27-766bc7ea1d73 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Request method failure captured: Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 HTTP/1.1 Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjSr4eYJ5iRC0BESTxyEYBHr6fTKXAfzmSKRijJd1-Dg4_6zeDPSLMVKcn7Va4xyX_oACpKQBdCcihzycrxxeD9gtcf6rUAIbBHhHnQZK1W2woTj604P1AONqCzsshMWFY41NR-lshpdEXKwYePjmUqN1wZWN-nWEva1tUOKD4iFshs Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89b46ae7347d4f2daf02f627e41a4847", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 3009c5feb1ef43a08b07996d8f63bf11 Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance b37a20c2-7329-4a0e-8b31-d0a7c39344b3 could not be found. Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'b37a20c2-7329-4a0e-8b31-d0a7c39344b3'} Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b37a20c2-7329-4a0e-8b31-d0a7c39344b3 could not be found. Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b37a20c2-7329-4a0e-8b31-d0a7c39344b3 could not be found. Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:11.437343 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.444873 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:11.444873 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:11.444873 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:11.444873 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:11.444873 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:11.444873 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b37a20c2-7329-4a0e-8b31-d0a7c39344b3 could not be found. Sep 17 21:02:11.444873 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.444873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f758cab5-d6f1-4bbe-ac27-766bc7ea1d73 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Returning 404 to user: Instance b37a20c2-7329-4a0e-8b31-d0a7c39344b3 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:11.444873 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f758cab5-d6f1-4bbe-ac27-766bc7ea1d73 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3" status: 404 len: 111 microversion: 2.1 time: 0.069685 Sep 17 21:02:11.444873 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1446/2970] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:11 2022] GET /compute/v2.1/servers/b37a20c2-7329-4a0e-8b31-d0a7c39344b3 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:02:11.453781 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bc802c59-5561-4495-9ef1-334640829420 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:11.455640 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bc802c59-5561-4495-9ef1-334640829420 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:11.463530 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bc802c59-5561-4495-9ef1-334640829420 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:11.464034 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bc802c59-5561-4495-9ef1-334640829420 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:11.464479 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bc802c59-5561-4495-9ef1-334640829420 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:11.465204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bc802c59-5561-4495-9ef1-334640829420 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:11.466296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bc802c59-5561-4495-9ef1-334640829420 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:11.466740 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bc802c59-5561-4495-9ef1-334640829420 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:11.467966 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6d91bf13-ec96-4226-9eb3-3486002a4a69 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1510 microversion: 2.1 time: 0.295651 Sep 17 21:02:11.470995 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1525/2971] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:11 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1510 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:11.480319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ae2d5bc8-3a54-4e34-aadb-58910d832f9f tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:11.481258 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ae2d5bc8-3a54-4e34-aadb-58910d832f9f tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:11.492844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae2d5bc8-3a54-4e34-aadb-58910d832f9f tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:11.493696 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae2d5bc8-3a54-4e34-aadb-58910d832f9f tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:11.494045 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae2d5bc8-3a54-4e34-aadb-58910d832f9f tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:11.494804 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae2d5bc8-3a54-4e34-aadb-58910d832f9f tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:11.495461 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae2d5bc8-3a54-4e34-aadb-58910d832f9f tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:11.496037 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae2d5bc8-3a54-4e34-aadb-58910d832f9f tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:11.568321 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bc802c59-5561-4495-9ef1-334640829420 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:11.577932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bc802c59-5561-4495-9ef1-334640829420 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:11.583831 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bc802c59-5561-4495-9ef1-334640829420 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:11.595363 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bc802c59-5561-4495-9ef1-334640829420 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1537 microversion: 2.91 time: 0.151448 Sep 17 21:02:11.616052 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1447/2972] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:11 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1537 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:11.621336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f53a74ab-f0d9-4285-808c-0c35dc9d6631 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:11.621887 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f53a74ab-f0d9-4285-808c-0c35dc9d6631 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:11.628867 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f53a74ab-f0d9-4285-808c-0c35dc9d6631 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:11.629384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f53a74ab-f0d9-4285-808c-0c35dc9d6631 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:11.629854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f53a74ab-f0d9-4285-808c-0c35dc9d6631 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:11.630587 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f53a74ab-f0d9-4285-808c-0c35dc9d6631 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:11.631060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f53a74ab-f0d9-4285-808c-0c35dc9d6631 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:11.631493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f53a74ab-f0d9-4285-808c-0c35dc9d6631 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:11.650811 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-f53a74ab-f0d9-4285-808c-0c35dc9d6631 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] HTTP exception thrown: Instance 126bfb0a-a567-407a-becb-4f5a814da7c6 could not be found. Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f53a74ab-f0d9-4285-808c-0c35dc9d6631 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Request method failure captured: Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 HTTP/1.1 Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjSr4eYJ5iRC0BESTxyEYBHr6fTKXAfzmSKRijJd1-Dg4_6zeDPSLMVKcn7Va4xyX_oACpKQBdCcihzycrxxeD9gtcf6rUAIbBHhHnQZK1W2woTj604P1AONqCzsshMWFY41NR-lshpdEXKwYePjmUqN1wZWN-nWEva1tUOKD4iFshs Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89b46ae7347d4f2daf02f627e41a4847", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 3009c5feb1ef43a08b07996d8f63bf11 Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 126bfb0a-a567-407a-becb-4f5a814da7c6 could not be found. Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '126bfb0a-a567-407a-becb-4f5a814da7c6'} Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 126bfb0a-a567-407a-becb-4f5a814da7c6 could not be found. Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:11.653791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:11.657876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 126bfb0a-a567-407a-becb-4f5a814da7c6 could not be found. Sep 17 21:02:11.657876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.657876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:11.657876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.657876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:11.657876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:11.657876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:11.657876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:11.657876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:11.657876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 126bfb0a-a567-407a-becb-4f5a814da7c6 could not be found. Sep 17 21:02:11.657876 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.659787 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f53a74ab-f0d9-4285-808c-0c35dc9d6631 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Returning 404 to user: Instance 126bfb0a-a567-407a-becb-4f5a814da7c6 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:11.660678 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f53a74ab-f0d9-4285-808c-0c35dc9d6631 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "DELETE /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 404 len: 111 microversion: 2.1 time: 0.043433 Sep 17 21:02:11.661576 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1448/2973] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:02:11 2022] DELETE /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:02:11.670045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e4317231-88f5-44fc-b490-5c80d07489ef tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:11.672079 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e4317231-88f5-44fc-b490-5c80d07489ef tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 126bfb0a-a567-407a-becb-4f5a814da7c6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:11.679173 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e4317231-88f5-44fc-b490-5c80d07489ef tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:11.680007 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e4317231-88f5-44fc-b490-5c80d07489ef tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:11.680607 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e4317231-88f5-44fc-b490-5c80d07489ef tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:11.681847 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e4317231-88f5-44fc-b490-5c80d07489ef tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:11.682502 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e4317231-88f5-44fc-b490-5c80d07489ef tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:11.683099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e4317231-88f5-44fc-b490-5c80d07489ef tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:11.704301 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-e4317231-88f5-44fc-b490-5c80d07489ef tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] HTTP exception thrown: Instance 126bfb0a-a567-407a-becb-4f5a814da7c6 could not be found. Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e4317231-88f5-44fc-b490-5c80d07489ef tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Request method failure captured: Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 HTTP/1.1 Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjSr4eYJ5iRC0BESTxyEYBHr6fTKXAfzmSKRijJd1-Dg4_6zeDPSLMVKcn7Va4xyX_oACpKQBdCcihzycrxxeD9gtcf6rUAIbBHhHnQZK1W2woTj604P1AONqCzsshMWFY41NR-lshpdEXKwYePjmUqN1wZWN-nWEva1tUOKD4iFshs Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89b46ae7347d4f2daf02f627e41a4847", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 3009c5feb1ef43a08b07996d8f63bf11 Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 126bfb0a-a567-407a-becb-4f5a814da7c6 could not be found. Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '126bfb0a-a567-407a-becb-4f5a814da7c6'} Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 126bfb0a-a567-407a-becb-4f5a814da7c6 could not be found. Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 126bfb0a-a567-407a-becb-4f5a814da7c6 could not be found. Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:11.706130 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.710142 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:11.710142 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:11.710142 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:11.710142 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:11.710142 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:11.710142 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 126bfb0a-a567-407a-becb-4f5a814da7c6 could not be found. Sep 17 21:02:11.710142 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.711962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e4317231-88f5-44fc-b490-5c80d07489ef tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Returning 404 to user: Instance 126bfb0a-a567-407a-becb-4f5a814da7c6 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:11.713084 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e4317231-88f5-44fc-b490-5c80d07489ef tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6" status: 404 len: 111 microversion: 2.1 time: 0.047447 Sep 17 21:02:11.713719 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1449/2974] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:11 2022] GET /compute/v2.1/servers/126bfb0a-a567-407a-becb-4f5a814da7c6 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 21:02:11.724579 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-49446594-9ebf-4e1c-94c3-1fe361cd644b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:11.725222 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-49446594-9ebf-4e1c-94c3-1fe361cd644b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 1170d308-122b-4c9e-abf1-5d206d3b75f1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:11.731759 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49446594-9ebf-4e1c-94c3-1fe361cd644b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:11.732363 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49446594-9ebf-4e1c-94c3-1fe361cd644b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:11.732880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49446594-9ebf-4e1c-94c3-1fe361cd644b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:11.734018 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49446594-9ebf-4e1c-94c3-1fe361cd644b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:11.734556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49446594-9ebf-4e1c-94c3-1fe361cd644b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:11.735062 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49446594-9ebf-4e1c-94c3-1fe361cd644b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:11.752429 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-49446594-9ebf-4e1c-94c3-1fe361cd644b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] HTTP exception thrown: Instance 1170d308-122b-4c9e-abf1-5d206d3b75f1 could not be found. Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-49446594-9ebf-4e1c-94c3-1fe361cd644b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Request method failure captured: Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1 HTTP/1.1 Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjSr4eYJ5iRC0BESTxyEYBHr6fTKXAfzmSKRijJd1-Dg4_6zeDPSLMVKcn7Va4xyX_oACpKQBdCcihzycrxxeD9gtcf6rUAIbBHhHnQZK1W2woTj604P1AONqCzsshMWFY41NR-lshpdEXKwYePjmUqN1wZWN-nWEva1tUOKD4iFshs Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89b46ae7347d4f2daf02f627e41a4847", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 3009c5feb1ef43a08b07996d8f63bf11 Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 1170d308-122b-4c9e-abf1-5d206d3b75f1 could not be found. Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '1170d308-122b-4c9e-abf1-5d206d3b75f1'} Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1170d308-122b-4c9e-abf1-5d206d3b75f1 could not be found. Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:11.755912 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:11.762539 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1170d308-122b-4c9e-abf1-5d206d3b75f1 could not be found. Sep 17 21:02:11.762539 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.762539 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:11.762539 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.762539 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:11.762539 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:11.762539 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:11.762539 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:11.762539 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:11.762539 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1170d308-122b-4c9e-abf1-5d206d3b75f1 could not be found. Sep 17 21:02:11.762539 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.764409 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ae2d5bc8-3a54-4e34-aadb-58910d832f9f tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc9559a966444d98e54edb4f948ae1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d42cba2664646f6adb4202574b7fa5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:11.766839 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-49446594-9ebf-4e1c-94c3-1fe361cd644b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Returning 404 to user: Instance 1170d308-122b-4c9e-abf1-5d206d3b75f1 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:11.768365 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-49446594-9ebf-4e1c-94c3-1fe361cd644b tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1" status: 404 len: 111 microversion: 2.1 time: 0.047616 Sep 17 21:02:11.769505 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1450/2975] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:02:11 2022] DELETE /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 21:02:11.777991 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ae2d5bc8-3a54-4e34-aadb-58910d832f9f tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/servers/0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f" status: 200 len: 1466 microversion: 2.1 time: 0.302919 Sep 17 21:02:11.778884 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-37befeac-93d2-4a14-aaa9-181d052681ce tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:11.779812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-37befeac-93d2-4a14-aaa9-181d052681ce tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 1170d308-122b-4c9e-abf1-5d206d3b75f1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:11.780796 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1526/2976] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:11 2022] GET /compute/v2.1/servers/0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f => generated 1466 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:11.800895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-37befeac-93d2-4a14-aaa9-181d052681ce tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:11.801842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-37befeac-93d2-4a14-aaa9-181d052681ce tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:11.802415 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2e2a9626-0307-4cbf-91df-046a5ce1898f tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1998119757"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:11.803048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-37befeac-93d2-4a14-aaa9-181d052681ce tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:11.803913 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-37befeac-93d2-4a14-aaa9-181d052681ce tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:11.804963 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-37befeac-93d2-4a14-aaa9-181d052681ce tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:11.805901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-37befeac-93d2-4a14-aaa9-181d052681ce tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:11.806026 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2e2a9626-0307-4cbf-91df-046a5ce1898f tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 66779798-999a-4a63-98dd-bf7fa71ce4b1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:11.816391 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e2a9626-0307-4cbf-91df-046a5ce1898f tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:11.817160 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e2a9626-0307-4cbf-91df-046a5ce1898f tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:11.817814 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e2a9626-0307-4cbf-91df-046a5ce1898f tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:11.818726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e2a9626-0307-4cbf-91df-046a5ce1898f tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:11.819885 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e2a9626-0307-4cbf-91df-046a5ce1898f tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:11.820544 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e2a9626-0307-4cbf-91df-046a5ce1898f tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:11.839853 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-37befeac-93d2-4a14-aaa9-181d052681ce tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] HTTP exception thrown: Instance 1170d308-122b-4c9e-abf1-5d206d3b75f1 could not be found. Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-37befeac-93d2-4a14-aaa9-181d052681ce tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Request method failure captured: Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1 HTTP/1.1 Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjSr4eYJ5iRC0BESTxyEYBHr6fTKXAfzmSKRijJd1-Dg4_6zeDPSLMVKcn7Va4xyX_oACpKQBdCcihzycrxxeD9gtcf6rUAIbBHhHnQZK1W2woTj604P1AONqCzsshMWFY41NR-lshpdEXKwYePjmUqN1wZWN-nWEva1tUOKD4iFshs Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89b46ae7347d4f2daf02f627e41a4847", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 3009c5feb1ef43a08b07996d8f63bf11 Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 1170d308-122b-4c9e-abf1-5d206d3b75f1 could not be found. Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '1170d308-122b-4c9e-abf1-5d206d3b75f1'} Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1170d308-122b-4c9e-abf1-5d206d3b75f1 could not be found. Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1170d308-122b-4c9e-abf1-5d206d3b75f1 could not be found. Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:11.844442 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.848529 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:11.848529 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:11.848529 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:11.848529 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:11.848529 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:11.848529 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1170d308-122b-4c9e-abf1-5d206d3b75f1 could not be found. Sep 17 21:02:11.848529 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.848529 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-37befeac-93d2-4a14-aaa9-181d052681ce tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Returning 404 to user: Instance 1170d308-122b-4c9e-abf1-5d206d3b75f1 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:11.848529 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-37befeac-93d2-4a14-aaa9-181d052681ce tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1" status: 404 len: 111 microversion: 2.1 time: 0.074805 Sep 17 21:02:11.853675 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1451/2977] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:11 2022] GET /compute/v2.1/servers/1170d308-122b-4c9e-abf1-5d206d3b75f1 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:02:11.864338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-51409c98-bc42-4be3-9e75-a913c74893b2 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:11.864864 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-51409c98-bc42-4be3-9e75-a913c74893b2 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: fe3b5d5c-7a30-4126-bea8-39665108391b] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:11.890111 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-51409c98-bc42-4be3-9e75-a913c74893b2 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] HTTP exception thrown: Instance fe3b5d5c-7a30-4126-bea8-39665108391b could not be found. Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-51409c98-bc42-4be3-9e75-a913c74893b2 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Request method failure captured: Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/fe3b5d5c-7a30-4126-bea8-39665108391b HTTP/1.1 Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjSr4eYJ5iRC0BESTxyEYBHr6fTKXAfzmSKRijJd1-Dg4_6zeDPSLMVKcn7Va4xyX_oACpKQBdCcihzycrxxeD9gtcf6rUAIbBHhHnQZK1W2woTj604P1AONqCzsshMWFY41NR-lshpdEXKwYePjmUqN1wZWN-nWEva1tUOKD4iFshs Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89b46ae7347d4f2daf02f627e41a4847", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 3009c5feb1ef43a08b07996d8f63bf11 Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance fe3b5d5c-7a30-4126-bea8-39665108391b could not be found. Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'fe3b5d5c-7a30-4126-bea8-39665108391b'} Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe3b5d5c-7a30-4126-bea8-39665108391b could not be found. Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe3b5d5c-7a30-4126-bea8-39665108391b could not be found. Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:11.891716 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.895854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:11.895854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:11.895854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:11.895854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:11.895854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:11.895854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe3b5d5c-7a30-4126-bea8-39665108391b could not be found. Sep 17 21:02:11.895854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.895854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-51409c98-bc42-4be3-9e75-a913c74893b2 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Returning 404 to user: Instance fe3b5d5c-7a30-4126-bea8-39665108391b could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:11.895854 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-51409c98-bc42-4be3-9e75-a913c74893b2 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fe3b5d5c-7a30-4126-bea8-39665108391b" status: 404 len: 111 microversion: 2.1 time: 0.038817 Sep 17 21:02:11.906065 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1452/2978] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:02:11 2022] DELETE /compute/v2.1/servers/fe3b5d5c-7a30-4126-bea8-39665108391b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:02:11.911253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7b98083c-8777-4cd0-8444-87c19b0c32e8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:11.912052 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7b98083c-8777-4cd0-8444-87c19b0c32e8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: fe3b5d5c-7a30-4126-bea8-39665108391b] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:11.919103 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-7b98083c-8777-4cd0-8444-87c19b0c32e8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] HTTP exception thrown: Instance fe3b5d5c-7a30-4126-bea8-39665108391b could not be found. Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7b98083c-8777-4cd0-8444-87c19b0c32e8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Request method failure captured: Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/fe3b5d5c-7a30-4126-bea8-39665108391b HTTP/1.1 Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjSr4eYJ5iRC0BESTxyEYBHr6fTKXAfzmSKRijJd1-Dg4_6zeDPSLMVKcn7Va4xyX_oACpKQBdCcihzycrxxeD9gtcf6rUAIbBHhHnQZK1W2woTj604P1AONqCzsshMWFY41NR-lshpdEXKwYePjmUqN1wZWN-nWEva1tUOKD4iFshs Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89b46ae7347d4f2daf02f627e41a4847", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 3009c5feb1ef43a08b07996d8f63bf11 Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance fe3b5d5c-7a30-4126-bea8-39665108391b could not be found. Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'fe3b5d5c-7a30-4126-bea8-39665108391b'} Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe3b5d5c-7a30-4126-bea8-39665108391b could not be found. Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe3b5d5c-7a30-4126-bea8-39665108391b could not be found. Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:11.921020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:11.925044 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:11.925044 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:11.925044 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:11.925044 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe3b5d5c-7a30-4126-bea8-39665108391b could not be found. Sep 17 21:02:11.925044 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:11.929699 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7b98083c-8777-4cd0-8444-87c19b0c32e8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Returning 404 to user: Instance fe3b5d5c-7a30-4126-bea8-39665108391b could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:11.935459 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7b98083c-8777-4cd0-8444-87c19b0c32e8 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/fe3b5d5c-7a30-4126-bea8-39665108391b" status: 404 len: 111 microversion: 2.1 time: 0.023615 Sep 17 21:02:11.936103 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1453/2979] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:11 2022] GET /compute/v2.1/servers/fe3b5d5c-7a30-4126-bea8-39665108391b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:02:12.130565 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:02:12.156235 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2e2a9626-0307-4cbf-91df-046a5ce1898f tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "POST /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1/action" status: 202 len: 0 microversion: 2.1 time: 0.357360 Sep 17 21:02:12.162587 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1527/2980] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:02:11 2022] POST /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 17 21:02:12.172387 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4e82c617-31a6-4555-87e3-b4cebf300632 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a47ea700>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:12.189316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-40933886-adea-4f74-81d3-6b3674093e6c req-b69f594f-73aa-4235-a4d5-a418b999bdf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41393a54-9105-4da5-ae65-3167427ddae8", "tag": "4d47e229-8239-4215-8c5c-b5133bcfb47b"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:12.217780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-40933886-adea-4f74-81d3-6b3674093e6c req-b69f594f-73aa-4235-a4d5-a418b999bdf6 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:12.218479 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-40933886-adea-4f74-81d3-6b3674093e6c req-b69f594f-73aa-4235-a4d5-a418b999bdf6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:12.219099 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-40933886-adea-4f74-81d3-6b3674093e6c req-b69f594f-73aa-4235-a4d5-a418b999bdf6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:12.246989 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4e82c617-31a6-4555-87e3-b4cebf300632 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29" status: 200 len: 1453 microversion: 2.1 time: 0.082831 Sep 17 21:02:12.248740 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1454/2981] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:12 2022] GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29 => generated 1453 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:12.285918 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-40933886-adea-4f74-81d3-6b3674093e6c req-b69f594f-73aa-4235-a4d5-a418b999bdf6 service nova] Creating event network-changed:4d47e229-8239-4215-8c5c-b5133bcfb47b for instance 41393a54-9105-4da5-ae65-3167427ddae8 on nch1-master-1 Sep 17 21:02:12.294318 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-40933886-adea-4f74-81d3-6b3674093e6c req-b69f594f-73aa-4235-a4d5-a418b999bdf6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116338 Sep 17 21:02:12.295706 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1528/2982] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:02:12.498027 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-01713e66-f18b-471f-8473-4dcf815ab68d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:12.499641 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-01713e66-f18b-471f-8473-4dcf815ab68d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:12.533983 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-01713e66-f18b-471f-8473-4dcf815ab68d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:12.537619 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-01713e66-f18b-471f-8473-4dcf815ab68d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:12.540140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-01713e66-f18b-471f-8473-4dcf815ab68d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:12.542533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-01713e66-f18b-471f-8473-4dcf815ab68d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:12.545866 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-01713e66-f18b-471f-8473-4dcf815ab68d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:12.547072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-01713e66-f18b-471f-8473-4dcf815ab68d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:12.710225 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-33b71ced-2d46-49dd-8691-fad95ac57b95 tempest-VolumesGetTestJSON-1283102623 tempest-VolumesGetTestJSON-1283102623-project] Action: 'create', calling method: .version_select at 0x7f25a481d040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1499371743", "metadata": {"Type": "work"}}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:13.028079 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-01713e66-f18b-471f-8473-4dcf815ab68d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:13.059605 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-01713e66-f18b-471f-8473-4dcf815ab68d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1490 microversion: 2.1 time: 0.564033 Sep 17 21:02:13.060342 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1529/2983] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:12 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1490 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:13.092020 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d8055895-0d3a-4d25-b300-ec5d02ab17d8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:13.092708 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d8055895-0d3a-4d25-b300-ec5d02ab17d8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:13.106081 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d8055895-0d3a-4d25-b300-ec5d02ab17d8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:13.106594 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d8055895-0d3a-4d25-b300-ec5d02ab17d8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:13.107044 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d8055895-0d3a-4d25-b300-ec5d02ab17d8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:13.112168 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d8055895-0d3a-4d25-b300-ec5d02ab17d8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:13.112734 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d8055895-0d3a-4d25-b300-ec5d02ab17d8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:13.113188 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d8055895-0d3a-4d25-b300-ec5d02ab17d8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:13.311351 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d8055895-0d3a-4d25-b300-ec5d02ab17d8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:13.325585 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d8055895-0d3a-4d25-b300-ec5d02ab17d8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:13.328265 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d8055895-0d3a-4d25-b300-ec5d02ab17d8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:13.335377 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d8055895-0d3a-4d25-b300-ec5d02ab17d8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1537 microversion: 2.91 time: 0.252963 Sep 17 21:02:13.336542 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1530/2984] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:13 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1537 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:13.343659 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-21afff5a-c229-4918-a22b-022a2d637d44 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:13.345042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-21afff5a-c229-4918-a22b-022a2d637d44 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:13.352501 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-21afff5a-c229-4918-a22b-022a2d637d44 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:13.353340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-21afff5a-c229-4918-a22b-022a2d637d44 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:13.354130 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-21afff5a-c229-4918-a22b-022a2d637d44 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:13.354970 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-21afff5a-c229-4918-a22b-022a2d637d44 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:13.355649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-21afff5a-c229-4918-a22b-022a2d637d44 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:13.356109 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-21afff5a-c229-4918-a22b-022a2d637d44 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:13.389042 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-21afff5a-c229-4918-a22b-022a2d637d44 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Cannot 'pause' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state paused Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-21afff5a-c229-4918-a22b-022a2d637d44 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a/action HTTP/1.1 Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 13 Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: {"pause": {}} Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: exception: Cannot 'pause' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state paused Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '9b986fa2-07ea-4418-adf2-0a5fa127e84a', 'body': {'pause': {}}} Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a in vm_state paused. Cannot pause while the instance is in this state. Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state paused Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:13.391046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:13.396936 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:13.396936 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:13.396936 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:13.396936 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state paused Sep 17 21:02:13.396936 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:13.396936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-21afff5a-c229-4918-a22b-022a2d637d44 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 409 to user: Cannot 'pause' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state paused {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:13.396936 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-21afff5a-c229-4918-a22b-022a2d637d44 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a/action" status: 409 len: 143 microversion: 2.1 time: 0.053843 Sep 17 21:02:13.396936 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1531/2985] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:02:13 2022] POST /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a/action => generated 143 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 17 21:02:13.404473 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8f6e00da-e72e-4386-81b7-634801145001 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:13.405267 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8f6e00da-e72e-4386-81b7-634801145001 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: c9fe0176-1bcf-4719-a87f-17b0e0c41b6c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:13.412020 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f6e00da-e72e-4386-81b7-634801145001 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:13.412787 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f6e00da-e72e-4386-81b7-634801145001 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:13.413446 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f6e00da-e72e-4386-81b7-634801145001 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:13.414539 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f6e00da-e72e-4386-81b7-634801145001 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:13.415205 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f6e00da-e72e-4386-81b7-634801145001 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:13.415859 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f6e00da-e72e-4386-81b7-634801145001 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:13.433021 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-8f6e00da-e72e-4386-81b7-634801145001 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] HTTP exception thrown: Instance c9fe0176-1bcf-4719-a87f-17b0e0c41b6c could not be found. Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8f6e00da-e72e-4386-81b7-634801145001 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Request method failure captured: Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c HTTP/1.1 Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjSr4eYJ5iRC0BESTxyEYBHr6fTKXAfzmSKRijJd1-Dg4_6zeDPSLMVKcn7Va4xyX_oACpKQBdCcihzycrxxeD9gtcf6rUAIbBHhHnQZK1W2woTj604P1AONqCzsshMWFY41NR-lshpdEXKwYePjmUqN1wZWN-nWEva1tUOKD4iFshs Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89b46ae7347d4f2daf02f627e41a4847", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 3009c5feb1ef43a08b07996d8f63bf11 Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance c9fe0176-1bcf-4719-a87f-17b0e0c41b6c could not be found. Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'c9fe0176-1bcf-4719-a87f-17b0e0c41b6c'} Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9fe0176-1bcf-4719-a87f-17b0e0c41b6c could not be found. Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:13.435126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:13.438905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9fe0176-1bcf-4719-a87f-17b0e0c41b6c could not be found. Sep 17 21:02:13.438905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:13.438905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:13.438905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:13.438905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:13.438905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:13.438905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:13.438905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:13.438905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:13.438905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9fe0176-1bcf-4719-a87f-17b0e0c41b6c could not be found. Sep 17 21:02:13.438905 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:13.441300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8f6e00da-e72e-4386-81b7-634801145001 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Returning 404 to user: Instance c9fe0176-1bcf-4719-a87f-17b0e0c41b6c could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:13.442651 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8f6e00da-e72e-4386-81b7-634801145001 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c" status: 404 len: 111 microversion: 2.1 time: 0.045979 Sep 17 21:02:13.443669 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1532/2986] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:02:13 2022] DELETE /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:02:13.451905 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a577a347-4cb2-426f-8c34-aa7f104aaca4 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a4331430>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:13.513878 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-33b71ced-2d46-49dd-8691-fad95ac57b95 tempest-VolumesGetTestJSON-1283102623 tempest-VolumesGetTestJSON-1283102623-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 346 microversion: 2.1 time: 1.059188 Sep 17 21:02:13.515441 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1455/2987] 10.222.0.26 () {60 vars in 1156 bytes} [Sat Sep 17 21:02:12 2022] POST /compute/v2.1/os-volumes => generated 346 bytes in 1068 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 17 21:02:13.528352 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-34c53d0a-2f9f-489b-936a-06825c4d794e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:13.529165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-34c53d0a-2f9f-489b-936a-06825c4d794e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:13.531221 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a577a347-4cb2-426f-8c34-aa7f104aaca4 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29" status: 200 len: 1453 microversion: 2.1 time: 0.083148 Sep 17 21:02:13.532133 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1533/2988] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:13 2022] GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29 => generated 1453 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:13.539403 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34c53d0a-2f9f-489b-936a-06825c4d794e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:13.540081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34c53d0a-2f9f-489b-936a-06825c4d794e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:13.541155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34c53d0a-2f9f-489b-936a-06825c4d794e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:13.543037 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34c53d0a-2f9f-489b-936a-06825c4d794e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:13.543664 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34c53d0a-2f9f-489b-936a-06825c4d794e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:13.544250 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34c53d0a-2f9f-489b-936a-06825c4d794e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:13.545493 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9913b70b-4c34-46d1-b3a1-82e3b02ef0c9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:13.547580 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9913b70b-4c34-46d1-b3a1-82e3b02ef0c9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: c9fe0176-1bcf-4719-a87f-17b0e0c41b6c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:13.566099 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9913b70b-4c34-46d1-b3a1-82e3b02ef0c9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:13.566738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9913b70b-4c34-46d1-b3a1-82e3b02ef0c9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:13.567391 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9913b70b-4c34-46d1-b3a1-82e3b02ef0c9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:13.569164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9913b70b-4c34-46d1-b3a1-82e3b02ef0c9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:13.570840 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9913b70b-4c34-46d1-b3a1-82e3b02ef0c9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:13.571386 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9913b70b-4c34-46d1-b3a1-82e3b02ef0c9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:13.620453 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-9913b70b-4c34-46d1-b3a1-82e3b02ef0c9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] HTTP exception thrown: Instance c9fe0176-1bcf-4719-a87f-17b0e0c41b6c could not be found. Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9913b70b-4c34-46d1-b3a1-82e3b02ef0c9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Request method failure captured: Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c HTTP/1.1 Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjSr4eYJ5iRC0BESTxyEYBHr6fTKXAfzmSKRijJd1-Dg4_6zeDPSLMVKcn7Va4xyX_oACpKQBdCcihzycrxxeD9gtcf6rUAIbBHhHnQZK1W2woTj604P1AONqCzsshMWFY41NR-lshpdEXKwYePjmUqN1wZWN-nWEva1tUOKD4iFshs Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89b46ae7347d4f2daf02f627e41a4847", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 3009c5feb1ef43a08b07996d8f63bf11 Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance c9fe0176-1bcf-4719-a87f-17b0e0c41b6c could not be found. Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'c9fe0176-1bcf-4719-a87f-17b0e0c41b6c'} Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9fe0176-1bcf-4719-a87f-17b0e0c41b6c could not be found. Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9fe0176-1bcf-4719-a87f-17b0e0c41b6c could not be found. Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:13.628129 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:13.632172 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:13.632172 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:13.632172 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:13.632172 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:13.632172 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:13.632172 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9fe0176-1bcf-4719-a87f-17b0e0c41b6c could not be found. Sep 17 21:02:13.632172 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:13.634683 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9913b70b-4c34-46d1-b3a1-82e3b02ef0c9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Returning 404 to user: Instance c9fe0176-1bcf-4719-a87f-17b0e0c41b6c could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:13.636162 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9913b70b-4c34-46d1-b3a1-82e3b02ef0c9 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c" status: 404 len: 111 microversion: 2.1 time: 0.102297 Sep 17 21:02:13.640324 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1534/2989] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:13 2022] GET /compute/v2.1/servers/c9fe0176-1bcf-4719-a87f-17b0e0c41b6c => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:02:13.646335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0501ec95-7cef-4fab-a721-33960f70b07a tempest-VolumesGetTestJSON-1283102623 tempest-VolumesGetTestJSON-1283102623-project] Calling method '.version_select at 0x7f25a427a700>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:13.674060 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-34c53d0a-2f9f-489b-936a-06825c4d794e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a/action" status: 202 len: 0 microversion: 2.1 time: 0.154068 Sep 17 21:02:13.675124 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1456/2990] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:02:13 2022] POST /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:02:13.686327 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d74e6409-0bef-4858-a466-4db73c363f47 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:13.691447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d74e6409-0bef-4858-a466-4db73c363f47 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 39ba6ff9-97dd-4923-90d0-58479fb25bb6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:13.724326 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d74e6409-0bef-4858-a466-4db73c363f47 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:13.725064 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d74e6409-0bef-4858-a466-4db73c363f47 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:13.725433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d74e6409-0bef-4858-a466-4db73c363f47 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:13.726199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d74e6409-0bef-4858-a466-4db73c363f47 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:13.726769 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d74e6409-0bef-4858-a466-4db73c363f47 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:13.727386 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d74e6409-0bef-4858-a466-4db73c363f47 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:13.762845 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-d74e6409-0bef-4858-a466-4db73c363f47 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] HTTP exception thrown: Instance 39ba6ff9-97dd-4923-90d0-58479fb25bb6 could not be found. Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d74e6409-0bef-4858-a466-4db73c363f47 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Request method failure captured: Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6 HTTP/1.1 Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjSr4eYJ5iRC0BESTxyEYBHr6fTKXAfzmSKRijJd1-Dg4_6zeDPSLMVKcn7Va4xyX_oACpKQBdCcihzycrxxeD9gtcf6rUAIbBHhHnQZK1W2woTj604P1AONqCzsshMWFY41NR-lshpdEXKwYePjmUqN1wZWN-nWEva1tUOKD4iFshs Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89b46ae7347d4f2daf02f627e41a4847", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 3009c5feb1ef43a08b07996d8f63bf11 Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 39ba6ff9-97dd-4923-90d0-58479fb25bb6 could not be found. Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '39ba6ff9-97dd-4923-90d0-58479fb25bb6'} Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39ba6ff9-97dd-4923-90d0-58479fb25bb6 could not be found. Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:13.775200 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:13.781844 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39ba6ff9-97dd-4923-90d0-58479fb25bb6 could not be found. Sep 17 21:02:13.781844 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:13.781844 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:13.781844 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:13.781844 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:13.781844 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:13.781844 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:13.781844 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:13.781844 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:13.781844 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39ba6ff9-97dd-4923-90d0-58479fb25bb6 could not be found. Sep 17 21:02:13.781844 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:13.781844 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d74e6409-0bef-4858-a466-4db73c363f47 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Returning 404 to user: Instance 39ba6ff9-97dd-4923-90d0-58479fb25bb6 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:13.781844 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d74e6409-0bef-4858-a466-4db73c363f47 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "DELETE /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6" status: 404 len: 111 microversion: 2.1 time: 0.100661 Sep 17 21:02:13.781844 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1457/2991] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:02:13 2022] DELETE /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:02:13.785575 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0501ec95-7cef-4fab-a721-33960f70b07a tempest-VolumesGetTestJSON-1283102623 tempest-VolumesGetTestJSON-1283102623-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/f9d7ea0f-64db-480f-b2ac-a18ec144ee2b" status: 200 len: 346 microversion: 2.1 time: 0.143276 Sep 17 21:02:13.786300 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1535/2992] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Sep 17 21:02:13 2022] GET /compute/v2.1/os-volumes/f9d7ea0f-64db-480f-b2ac-a18ec144ee2b => generated 346 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:02:13.786867 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-287dec8c-0c32-44ff-bf11-8075ff3e5af3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:13.789849 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-287dec8c-0c32-44ff-bf11-8075ff3e5af3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:13.791910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-64ea83b7-dd88-4eab-b85c-54a0b8dd0331 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:13.792768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-64ea83b7-dd88-4eab-b85c-54a0b8dd0331 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] [instance: 39ba6ff9-97dd-4923-90d0-58479fb25bb6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:13.806569 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-287dec8c-0c32-44ff-bf11-8075ff3e5af3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:13.807106 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64ea83b7-dd88-4eab-b85c-54a0b8dd0331 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:13.807303 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-287dec8c-0c32-44ff-bf11-8075ff3e5af3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:13.807767 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-287dec8c-0c32-44ff-bf11-8075ff3e5af3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:13.807886 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64ea83b7-dd88-4eab-b85c-54a0b8dd0331 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:13.808441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64ea83b7-dd88-4eab-b85c-54a0b8dd0331 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:13.808537 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-287dec8c-0c32-44ff-bf11-8075ff3e5af3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:13.808966 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-287dec8c-0c32-44ff-bf11-8075ff3e5af3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:13.809398 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-287dec8c-0c32-44ff-bf11-8075ff3e5af3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:13.809544 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64ea83b7-dd88-4eab-b85c-54a0b8dd0331 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:13.810098 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64ea83b7-dd88-4eab-b85c-54a0b8dd0331 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:13.810770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64ea83b7-dd88-4eab-b85c-54a0b8dd0331 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:13.826135 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-64ea83b7-dd88-4eab-b85c-54a0b8dd0331 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] HTTP exception thrown: Instance 39ba6ff9-97dd-4923-90d0-58479fb25bb6 could not be found. Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-64ea83b7-dd88-4eab-b85c-54a0b8dd0331 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Request method failure captured: Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6 HTTP/1.1 Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjSr4eYJ5iRC0BESTxyEYBHr6fTKXAfzmSKRijJd1-Dg4_6zeDPSLMVKcn7Va4xyX_oACpKQBdCcihzycrxxeD9gtcf6rUAIbBHhHnQZK1W2woTj604P1AONqCzsshMWFY41NR-lshpdEXKwYePjmUqN1wZWN-nWEva1tUOKD4iFshs Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89b46ae7347d4f2daf02f627e41a4847"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89b46ae7347d4f2daf02f627e41a4847", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 89b46ae7347d4f2daf02f627e41a4847 Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-DeleteServersTestJSON-583053734 Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 3009c5feb1ef43a08b07996d8f63bf11 Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-DeleteServersTestJSON-583053734-project Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 39ba6ff9-97dd-4923-90d0-58479fb25bb6 could not be found. Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '39ba6ff9-97dd-4923-90d0-58479fb25bb6'} Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39ba6ff9-97dd-4923-90d0-58479fb25bb6 could not be found. Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39ba6ff9-97dd-4923-90d0-58479fb25bb6 could not be found. Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:13.827929 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:13.832835 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:13.832835 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:13.832835 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:13.832835 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:13.832835 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:13.832835 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39ba6ff9-97dd-4923-90d0-58479fb25bb6 could not be found. Sep 17 21:02:13.832835 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:13.834406 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-64ea83b7-dd88-4eab-b85c-54a0b8dd0331 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] Returning 404 to user: Instance 39ba6ff9-97dd-4923-90d0-58479fb25bb6 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:13.835797 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-64ea83b7-dd88-4eab-b85c-54a0b8dd0331 tempest-DeleteServersTestJSON-583053734 tempest-DeleteServersTestJSON-583053734-project] 10.222.0.26 "GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6" status: 404 len: 111 microversion: 2.1 time: 0.047688 Sep 17 21:02:13.836486 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1536/2993] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:13 2022] GET /compute/v2.1/servers/39ba6ff9-97dd-4923-90d0-58479fb25bb6 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:02:14.048843 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-287dec8c-0c32-44ff-bf11-8075ff3e5af3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:14.058857 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-287dec8c-0c32-44ff-bf11-8075ff3e5af3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1497 microversion: 2.1 time: 0.280039 Sep 17 21:02:14.079580 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1458/2994] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:13 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1497 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:14.368467 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8328726c-25f6-4228-af82-a7c90e650d5c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:14.369086 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8328726c-25f6-4228-af82-a7c90e650d5c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:14.377523 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8328726c-25f6-4228-af82-a7c90e650d5c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:14.378205 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8328726c-25f6-4228-af82-a7c90e650d5c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:14.378776 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8328726c-25f6-4228-af82-a7c90e650d5c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:14.379637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8328726c-25f6-4228-af82-a7c90e650d5c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:14.380391 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8328726c-25f6-4228-af82-a7c90e650d5c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:14.381438 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8328726c-25f6-4228-af82-a7c90e650d5c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:14.497162 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8328726c-25f6-4228-af82-a7c90e650d5c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:14.507257 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8328726c-25f6-4228-af82-a7c90e650d5c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:14.508954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8328726c-25f6-4228-af82-a7c90e650d5c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:14.514967 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8328726c-25f6-4228-af82-a7c90e650d5c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1537 microversion: 2.91 time: 0.151860 Sep 17 21:02:14.515839 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1537/2995] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:14 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1537 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:14.547246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cf3d07ae-21ac-43a8-85ce-29d1ecde6bb6 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a488d790>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:14.554174 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:02:14.614579 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cf3d07ae-21ac-43a8-85ce-29d1ecde6bb6 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29" status: 200 len: 1453 microversion: 2.1 time: 0.071387 Sep 17 21:02:14.615527 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1459/2996] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:14 2022] GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29 => generated 1453 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:14.800954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-befafdda-046e-4d09-91a0-62b063c808ac tempest-VolumesGetTestJSON-1283102623 tempest-VolumesGetTestJSON-1283102623-project] Calling method '.version_select at 0x7f25a4270820>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:14.863729 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-befafdda-046e-4d09-91a0-62b063c808ac tempest-VolumesGetTestJSON-1283102623 tempest-VolumesGetTestJSON-1283102623-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/f9d7ea0f-64db-480f-b2ac-a18ec144ee2b" status: 200 len: 347 microversion: 2.1 time: 0.067147 Sep 17 21:02:14.865012 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1538/2997] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Sep 17 21:02:14 2022] GET /compute/v2.1/os-volumes/f9d7ea0f-64db-480f-b2ac-a18ec144ee2b => generated 347 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:02:14.882690 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e031277c-beca-4381-81c2-6cb3dd00d572 tempest-VolumesGetTestJSON-1283102623 tempest-VolumesGetTestJSON-1283102623-project] Calling method '.version_select at 0x7f25a47e2dc0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:14.951616 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e031277c-beca-4381-81c2-6cb3dd00d572 tempest-VolumesGetTestJSON-1283102623 tempest-VolumesGetTestJSON-1283102623-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/f9d7ea0f-64db-480f-b2ac-a18ec144ee2b" status: 200 len: 347 microversion: 2.1 time: 0.074358 Sep 17 21:02:14.953241 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1460/2998] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Sep 17 21:02:14 2022] GET /compute/v2.1/os-volumes/f9d7ea0f-64db-480f-b2ac-a18ec144ee2b => generated 347 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:02:14.967662 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3d33a3cb-61d5-4ed3-9ee8-df45cb70f2a4 tempest-VolumesGetTestJSON-1283102623 tempest-VolumesGetTestJSON-1283102623-project] Calling method '.version_select at 0x7f25a43310d0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:15.086549 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-230c1195-0291-410a-9393-2543913099ba tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:15.087170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-230c1195-0291-410a-9393-2543913099ba tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:15.095500 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3d33a3cb-61d5-4ed3-9ee8-df45cb70f2a4 tempest-VolumesGetTestJSON-1283102623 tempest-VolumesGetTestJSON-1283102623-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/f9d7ea0f-64db-480f-b2ac-a18ec144ee2b" status: 202 len: 0 microversion: 2.1 time: 0.131872 Sep 17 21:02:15.096079 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1539/2999] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Sep 17 21:02:14 2022] DELETE /compute/v2.1/os-volumes/f9d7ea0f-64db-480f-b2ac-a18ec144ee2b => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 17 21:02:15.104851 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-055aae3d-1c73-4685-b556-d55f6e94d2b7 tempest-VolumesGetTestJSON-1283102623 tempest-VolumesGetTestJSON-1283102623-project] Calling method '.version_select at 0x7f25a4213e50>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:15.123061 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-230c1195-0291-410a-9393-2543913099ba tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:15.123572 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-230c1195-0291-410a-9393-2543913099ba tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:15.124013 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-230c1195-0291-410a-9393-2543913099ba tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:15.124738 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-230c1195-0291-410a-9393-2543913099ba tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:15.125194 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-230c1195-0291-410a-9393-2543913099ba tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:15.125650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-230c1195-0291-410a-9393-2543913099ba tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:15.212668 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-055aae3d-1c73-4685-b556-d55f6e94d2b7 tempest-VolumesGetTestJSON-1283102623 tempest-VolumesGetTestJSON-1283102623-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/f9d7ea0f-64db-480f-b2ac-a18ec144ee2b" status: 200 len: 346 microversion: 2.1 time: 0.112204 Sep 17 21:02:15.213534 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1540/3000] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Sep 17 21:02:15 2022] GET /compute/v2.1/os-volumes/f9d7ea0f-64db-480f-b2ac-a18ec144ee2b => generated 346 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:02:15.278469 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-746b19ba-7c4d-4dbc-a45a-31be55118ad6 req-ed17fcf6-9d97-4b66-aaeb-aef509c9d9ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f", "name": "network-vif-unplugged", "status": "completed", "tag": "5273e052-362a-499b-8afd-752c94502a05"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:15.291308 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-746b19ba-7c4d-4dbc-a45a-31be55118ad6 req-ed17fcf6-9d97-4b66-aaeb-aef509c9d9ab service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:15.291991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-746b19ba-7c4d-4dbc-a45a-31be55118ad6 req-ed17fcf6-9d97-4b66-aaeb-aef509c9d9ab service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:15.292630 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-746b19ba-7c4d-4dbc-a45a-31be55118ad6 req-ed17fcf6-9d97-4b66-aaeb-aef509c9d9ab service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:15.313803 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-746b19ba-7c4d-4dbc-a45a-31be55118ad6 req-ed17fcf6-9d97-4b66-aaeb-aef509c9d9ab service nova] Creating event network-vif-unplugged:5273e052-362a-499b-8afd-752c94502a05 for instance 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f on nch2-master-1 Sep 17 21:02:15.323955 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-746b19ba-7c4d-4dbc-a45a-31be55118ad6 req-ed17fcf6-9d97-4b66-aaeb-aef509c9d9ab service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049223 Sep 17 21:02:15.326025 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1541/3001] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:02:15.553647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-230c1195-0291-410a-9393-2543913099ba tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:15.559768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-425e0699-ae95-4596-8758-44030a4235a3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:15.561725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-425e0699-ae95-4596-8758-44030a4235a3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:15.564751 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-230c1195-0291-410a-9393-2543913099ba tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.482846 Sep 17 21:02:15.571225 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-425e0699-ae95-4596-8758-44030a4235a3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:15.572018 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-425e0699-ae95-4596-8758-44030a4235a3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:15.572854 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-425e0699-ae95-4596-8758-44030a4235a3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:15.573962 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-425e0699-ae95-4596-8758-44030a4235a3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:15.574670 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-425e0699-ae95-4596-8758-44030a4235a3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:15.575472 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-425e0699-ae95-4596-8758-44030a4235a3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:15.577845 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1461/3002] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:15 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:02:15.594179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fd69725c-920e-49bb-a77f-004efa49d926 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:15.594826 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fd69725c-920e-49bb-a77f-004efa49d926 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:15.605146 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd69725c-920e-49bb-a77f-004efa49d926 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:15.605693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd69725c-920e-49bb-a77f-004efa49d926 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:15.606197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd69725c-920e-49bb-a77f-004efa49d926 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:15.606924 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd69725c-920e-49bb-a77f-004efa49d926 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:15.607391 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd69725c-920e-49bb-a77f-004efa49d926 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:15.607823 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd69725c-920e-49bb-a77f-004efa49d926 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:15.795516 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-425e0699-ae95-4596-8758-44030a4235a3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:15.805701 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-425e0699-ae95-4596-8758-44030a4235a3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:15.817226 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-425e0699-ae95-4596-8758-44030a4235a3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:15.827349 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-425e0699-ae95-4596-8758-44030a4235a3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1537 microversion: 2.91 time: 0.279809 Sep 17 21:02:15.828441 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1542/3003] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:15 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1537 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:15.840509 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1f646a16-3c8e-4747-b019-c3eb018d5b92 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a4265310>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:15.901597 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1f646a16-3c8e-4747-b019-c3eb018d5b92 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29" status: 200 len: 1453 microversion: 2.1 time: 0.070120 Sep 17 21:02:15.902559 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1543/3004] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:15 2022] GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29 => generated 1453 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:15.979689 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fd69725c-920e-49bb-a77f-004efa49d926 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:16.003915 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fd69725c-920e-49bb-a77f-004efa49d926 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.413308 Sep 17 21:02:16.005415 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1462/3005] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:15 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:02:16.032076 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-65a7d289-7d33-44ff-a9f6-23767d090b68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:16.034486 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-65a7d289-7d33-44ff-a9f6-23767d090b68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 6beb0759-caaa-4644-b0d6-1d77d21b7e0b] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:16.050590 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-65a7d289-7d33-44ff-a9f6-23767d090b68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:16.051360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-65a7d289-7d33-44ff-a9f6-23767d090b68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:16.051959 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-65a7d289-7d33-44ff-a9f6-23767d090b68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:16.052899 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-65a7d289-7d33-44ff-a9f6-23767d090b68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:16.053563 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-65a7d289-7d33-44ff-a9f6-23767d090b68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:16.054231 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-65a7d289-7d33-44ff-a9f6-23767d090b68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:16.073546 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-65a7d289-7d33-44ff-a9f6-23767d090b68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Instance 6beb0759-caaa-4644-b0d6-1d77d21b7e0b could not be found. Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-65a7d289-7d33-44ff-a9f6-23767d090b68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b/action HTTP/1.1 Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 28 Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: {"reboot": {"type": "SOFT"}} Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 6beb0759-caaa-4644-b0d6-1d77d21b7e0b could not be found. Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '6beb0759-caaa-4644-b0d6-1d77d21b7e0b', 'body': {'reboot': {'type': 'SOFT'}}} Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6beb0759-caaa-4644-b0d6-1d77d21b7e0b could not be found. Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:16.079326 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:16.084377 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6beb0759-caaa-4644-b0d6-1d77d21b7e0b could not be found. Sep 17 21:02:16.084377 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:16.084377 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:16.084377 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:16.084377 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:16.084377 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:16.084377 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:16.084377 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:16.084377 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:16.084377 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6beb0759-caaa-4644-b0d6-1d77d21b7e0b could not be found. Sep 17 21:02:16.084377 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:16.087062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-65a7d289-7d33-44ff-a9f6-23767d090b68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 404 to user: Instance 6beb0759-caaa-4644-b0d6-1d77d21b7e0b could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:16.088451 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-65a7d289-7d33-44ff-a9f6-23767d090b68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b/action" status: 404 len: 111 microversion: 2.1 time: 0.062426 Sep 17 21:02:16.092404 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1544/3006] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:02:16 2022] POST /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b/action => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:02:16.102551 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7aff9e30-3f3c-4531-8b2f-780f855cc20e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:16.103552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7aff9e30-3f3c-4531-8b2f-780f855cc20e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:16.113556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7aff9e30-3f3c-4531-8b2f-780f855cc20e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:16.114517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7aff9e30-3f3c-4531-8b2f-780f855cc20e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:16.115433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7aff9e30-3f3c-4531-8b2f-780f855cc20e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:16.116383 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7aff9e30-3f3c-4531-8b2f-780f855cc20e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:16.117419 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7aff9e30-3f3c-4531-8b2f-780f855cc20e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:16.118217 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7aff9e30-3f3c-4531-8b2f-780f855cc20e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:16.230121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9164d634-bc30-4a3d-8862-c344ab225179 tempest-VolumesGetTestJSON-1283102623 tempest-VolumesGetTestJSON-1283102623-project] Calling method '.version_select at 0x7f25a42650d0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:16.281083 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-9164d634-bc30-4a3d-8862-c344ab225179 tempest-VolumesGetTestJSON-1283102623 tempest-VolumesGetTestJSON-1283102623-project] HTTP exception thrown: Volume f9d7ea0f-64db-480f-b2ac-a18ec144ee2b could not be found. Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9164d634-bc30-4a3d-8862-c344ab225179 tempest-VolumesGetTestJSON-1283102623 tempest-VolumesGetTestJSON-1283102623-project] Request method failure captured: Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/os-volumes/f9d7ea0f-64db-480f-b2ac-a18ec144ee2b HTTP/1.1 Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjXUrpQxcYmDpq2unM-Ra2b8l_ALmK_76oI-iW3d10sC_PE0mLHQnOt4D5NSdHsGi-OjpKh0QsPtCNsGuBSOZBw_uQ2EXenlhmZrh1pF1JQn66_eIIvwiJRRL5S6NaT4wCIzLKQSQYjYyBVYetEQqcRguUdcZhGJL2fbxVmh3CgHSqU Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 2b777025c44a4535bea435d55f8cb1e3 Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-VolumesGetTestJSON-1283102623 Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2b777025c44a4535bea435d55f8cb1e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2b777025c44a4535bea435d55f8cb1e3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2b777025c44a4535bea435d55f8cb1e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2b777025c44a4535bea435d55f8cb1e3", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-VolumesGetTestJSON-1283102623 Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 2b777025c44a4535bea435d55f8cb1e3 Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-VolumesGetTestJSON-1283102623 Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-VolumesGetTestJSON-1283102623-project Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: fe663342df9f495d8203d8bb817868ec Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-VolumesGetTestJSON-1283102623-project Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: exception: Volume f9d7ea0f-64db-480f-b2ac-a18ec144ee2b could not be found. Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'f9d7ea0f-64db-480f-b2ac-a18ec144ee2b'} Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f9d7ea0f-64db-480f-b2ac-a18ec144ee2b could not be found. (HTTP 404) (Request-ID: req-261455f5-d077-458b-b720-59124b8b0c58) Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 17 21:02:16.342796 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f9d7ea0f-64db-480f-b2ac-a18ec144ee2b could not be found. Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f9d7ea0f-64db-480f-b2ac-a18ec144ee2b could not be found. Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f9d7ea0f-64db-480f-b2ac-a18ec144ee2b could not be found. Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9164d634-bc30-4a3d-8862-c344ab225179 tempest-VolumesGetTestJSON-1283102623 tempest-VolumesGetTestJSON-1283102623-project] Returning 404 to user: Volume f9d7ea0f-64db-480f-b2ac-a18ec144ee2b could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9164d634-bc30-4a3d-8862-c344ab225179 tempest-VolumesGetTestJSON-1283102623 tempest-VolumesGetTestJSON-1283102623-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/f9d7ea0f-64db-480f-b2ac-a18ec144ee2b" status: 404 len: 109 microversion: 2.1 time: 0.121942 Sep 17 21:02:16.348477 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1545/3007] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Sep 17 21:02:16 2022] GET /compute/v2.1/os-volumes/f9d7ea0f-64db-480f-b2ac-a18ec144ee2b => generated 109 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 21:02:16.536932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7aff9e30-3f3c-4531-8b2f-780f855cc20e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:16.542233 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:02:16.551227 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7aff9e30-3f3c-4531-8b2f-780f855cc20e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.454074 Sep 17 21:02:16.551832 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1463/3008] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:16 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:16.583520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ca437e37-f7d2-47b0-9fb9-40e2235643b9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:16.587426 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ca437e37-f7d2-47b0-9fb9-40e2235643b9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:16.610305 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca437e37-f7d2-47b0-9fb9-40e2235643b9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:16.611184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca437e37-f7d2-47b0-9fb9-40e2235643b9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:16.611834 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca437e37-f7d2-47b0-9fb9-40e2235643b9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:16.612728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca437e37-f7d2-47b0-9fb9-40e2235643b9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:16.613525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca437e37-f7d2-47b0-9fb9-40e2235643b9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:16.614117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca437e37-f7d2-47b0-9fb9-40e2235643b9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:16.866559 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2ab40382-930e-4257-baf0-5bab9b8a2a02 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:16.867376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2ab40382-930e-4257-baf0-5bab9b8a2a02 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:16.896903 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ab40382-930e-4257-baf0-5bab9b8a2a02 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:16.897445 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ab40382-930e-4257-baf0-5bab9b8a2a02 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:16.897944 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ab40382-930e-4257-baf0-5bab9b8a2a02 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:16.907177 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ab40382-930e-4257-baf0-5bab9b8a2a02 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:16.909193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ab40382-930e-4257-baf0-5bab9b8a2a02 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:16.912759 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ab40382-930e-4257-baf0-5bab9b8a2a02 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:16.988502 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ca437e37-f7d2-47b0-9fb9-40e2235643b9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:17.004772 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ca437e37-f7d2-47b0-9fb9-40e2235643b9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.428618 Sep 17 21:02:17.006304 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1546/3009] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:16 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:17.039880 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f425c914-742e-4971-88c6-e02d15e86275 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a436faf0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:17.106663 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2ab40382-930e-4257-baf0-5bab9b8a2a02 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:17.116386 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2ab40382-930e-4257-baf0-5bab9b8a2a02 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:17.118027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2ab40382-930e-4257-baf0-5bab9b8a2a02 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:17.135875 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2ab40382-930e-4257-baf0-5bab9b8a2a02 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1537 microversion: 2.91 time: 0.273129 Sep 17 21:02:17.148637 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f425c914-742e-4971-88c6-e02d15e86275 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29" status: 200 len: 1453 microversion: 2.1 time: 0.139861 Sep 17 21:02:17.149442 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1547/3010] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:17 2022] GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29 => generated 1453 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:17.159795 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1464/3011] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:16 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1537 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:17.163979 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-892f013d-0382-4b8d-9f40-212eab733e63 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:17.166713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-892f013d-0382-4b8d-9f40-212eab733e63 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 4e2155ec-4fc1-477a-9744-288e5deb8f18] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:17.173361 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-892f013d-0382-4b8d-9f40-212eab733e63 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Instance 4e2155ec-4fc1-477a-9744-288e5deb8f18 could not be found. Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-892f013d-0382-4b8d-9f40-212eab733e63 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers/4e2155ec-4fc1-477a-9744-288e5deb8f18/action HTTP/1.1 Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 28 Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: {"reboot": {"type": "SOFT"}} Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 4e2155ec-4fc1-477a-9744-288e5deb8f18 could not be found. Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '4e2155ec-4fc1-477a-9744-288e5deb8f18', 'body': {'reboot': {'type': 'SOFT'}}} Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e2155ec-4fc1-477a-9744-288e5deb8f18 could not be found. Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e2155ec-4fc1-477a-9744-288e5deb8f18 could not be found. Sep 17 21:02:17.175281 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:17.180259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:17.180259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:17.180259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:17.180259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:17.180259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:17.180259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:17.180259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:17.180259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e2155ec-4fc1-477a-9744-288e5deb8f18 could not be found. Sep 17 21:02:17.180259 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:17.182020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-892f013d-0382-4b8d-9f40-212eab733e63 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 404 to user: Instance 4e2155ec-4fc1-477a-9744-288e5deb8f18 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:17.183120 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-892f013d-0382-4b8d-9f40-212eab733e63 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers/4e2155ec-4fc1-477a-9744-288e5deb8f18/action" status: 404 len: 111 microversion: 2.1 time: 0.027159 Sep 17 21:02:17.187378 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1465/3012] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:02:17 2022] POST /compute/v2.1/servers/4e2155ec-4fc1-477a-9744-288e5deb8f18/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:02:17.192415 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8535b83a-0f38-41d5-8709-cd8d88fda4f0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:17.194361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8535b83a-0f38-41d5-8709-cd8d88fda4f0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:17.204259 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8535b83a-0f38-41d5-8709-cd8d88fda4f0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:17.205706 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8535b83a-0f38-41d5-8709-cd8d88fda4f0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:17.208228 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8535b83a-0f38-41d5-8709-cd8d88fda4f0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:17.209419 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8535b83a-0f38-41d5-8709-cd8d88fda4f0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:17.210143 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8535b83a-0f38-41d5-8709-cd8d88fda4f0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:17.210805 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8535b83a-0f38-41d5-8709-cd8d88fda4f0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:17.449019 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8535b83a-0f38-41d5-8709-cd8d88fda4f0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:17.457374 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8535b83a-0f38-41d5-8709-cd8d88fda4f0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.268891 Sep 17 21:02:17.461114 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1548/3013] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:17 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:17.489106 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1233c405-428c-4102-a30b-136462eb365c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:17.490059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1233c405-428c-4102-a30b-136462eb365c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:17.505334 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1233c405-428c-4102-a30b-136462eb365c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:17.510723 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1233c405-428c-4102-a30b-136462eb365c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:17.511386 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1233c405-428c-4102-a30b-136462eb365c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:17.512322 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1233c405-428c-4102-a30b-136462eb365c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:17.513814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1233c405-428c-4102-a30b-136462eb365c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:17.514681 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1233c405-428c-4102-a30b-136462eb365c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:17.682650 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-87e29ded-15c7-4266-b982-8a88dd6cfeb4 req-b04e6f20-9585-4509-b1a2-b5feb38a0383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66779798-999a-4a63-98dd-bf7fa71ce4b1", "name": "network-vif-plugged", "status": "completed", "tag": "4056825c-1c74-40d2-846c-e4886adca6ee"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:17.701286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-87e29ded-15c7-4266-b982-8a88dd6cfeb4 req-b04e6f20-9585-4509-b1a2-b5feb38a0383 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:17.702135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-87e29ded-15c7-4266-b982-8a88dd6cfeb4 req-b04e6f20-9585-4509-b1a2-b5feb38a0383 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:17.702843 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-87e29ded-15c7-4266-b982-8a88dd6cfeb4 req-b04e6f20-9585-4509-b1a2-b5feb38a0383 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:17.720685 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-87e29ded-15c7-4266-b982-8a88dd6cfeb4 req-b04e6f20-9585-4509-b1a2-b5feb38a0383 service nova] Creating event network-vif-plugged:4056825c-1c74-40d2-846c-e4886adca6ee for instance 66779798-999a-4a63-98dd-bf7fa71ce4b1 on nch1-master-1 Sep 17 21:02:17.728910 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-87e29ded-15c7-4266-b982-8a88dd6cfeb4 req-b04e6f20-9585-4509-b1a2-b5feb38a0383 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050974 Sep 17 21:02:17.736899 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1549/3014] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:02:18.020385 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1233c405-428c-4102-a30b-136462eb365c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:18.029512 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1233c405-428c-4102-a30b-136462eb365c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.546982 Sep 17 21:02:18.053658 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1466/3015] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:17 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:18.057200 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-68f8e50e-3257-497c-b108-8c6daf7c0b26 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:18.060248 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-68f8e50e-3257-497c-b108-8c6daf7c0b26 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 6beb0759-caaa-4644-b0d6-1d77d21b7e0b] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:18.076576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68f8e50e-3257-497c-b108-8c6daf7c0b26 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:18.077089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68f8e50e-3257-497c-b108-8c6daf7c0b26 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:18.077565 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68f8e50e-3257-497c-b108-8c6daf7c0b26 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:18.078303 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68f8e50e-3257-497c-b108-8c6daf7c0b26 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:18.078766 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68f8e50e-3257-497c-b108-8c6daf7c0b26 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:18.079199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68f8e50e-3257-497c-b108-8c6daf7c0b26 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:18.119706 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-68f8e50e-3257-497c-b108-8c6daf7c0b26 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Instance 6beb0759-caaa-4644-b0d6-1d77d21b7e0b could not be found. Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-68f8e50e-3257-497c-b108-8c6daf7c0b26 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b/action HTTP/1.1 Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 65 Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: {"rebuild": {"imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4"}} Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 6beb0759-caaa-4644-b0d6-1d77d21b7e0b could not be found. Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '6beb0759-caaa-4644-b0d6-1d77d21b7e0b', 'body': {'rebuild': {'imageRef': '1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4'}}} Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6beb0759-caaa-4644-b0d6-1d77d21b7e0b could not be found. Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 17 21:02:18.122078 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 17 21:02:18.127602 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 17 21:02:18.127602 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:02:18.127602 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:02:18.127602 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:18.127602 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:18.127602 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6beb0759-caaa-4644-b0d6-1d77d21b7e0b could not be found. Sep 17 21:02:18.127602 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:18.127602 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:18.127602 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:18.127602 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:18.127602 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:18.127602 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:18.127602 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:18.127602 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:18.127602 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6beb0759-caaa-4644-b0d6-1d77d21b7e0b could not be found. Sep 17 21:02:18.127602 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:18.133333 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-68f8e50e-3257-497c-b108-8c6daf7c0b26 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 404 to user: Instance 6beb0759-caaa-4644-b0d6-1d77d21b7e0b could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:18.134262 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-68f8e50e-3257-497c-b108-8c6daf7c0b26 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b/action" status: 404 len: 111 microversion: 2.1 time: 0.084243 Sep 17 21:02:18.135657 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1550/3016] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:02:18 2022] POST /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b/action => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:02:18.143675 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1667a5f3-97ff-42ed-ad46-8a577814a710 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:18.144294 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1667a5f3-97ff-42ed-ad46-8a577814a710 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:18.152612 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1667a5f3-97ff-42ed-ad46-8a577814a710 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:18.155332 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1667a5f3-97ff-42ed-ad46-8a577814a710 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:18.157206 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1667a5f3-97ff-42ed-ad46-8a577814a710 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:18.161574 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1667a5f3-97ff-42ed-ad46-8a577814a710 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:18.162478 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1667a5f3-97ff-42ed-ad46-8a577814a710 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:18.164896 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1667a5f3-97ff-42ed-ad46-8a577814a710 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:18.167735 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d945f7ea-0c5e-472b-acc5-920a17e9d022 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a42f5700>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:18.226514 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=4 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:02:18.257218 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d945f7ea-0c5e-472b-acc5-920a17e9d022 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29" status: 200 len: 1453 microversion: 2.1 time: 0.094514 Sep 17 21:02:18.258545 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1551/3017] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:18 2022] GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29 => generated 1453 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:18.263920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-62d88e2d-5e58-408c-9d13-e36487d55131 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:18.264722 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-62d88e2d-5e58-408c-9d13-e36487d55131 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:18.275721 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62d88e2d-5e58-408c-9d13-e36487d55131 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:18.276398 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62d88e2d-5e58-408c-9d13-e36487d55131 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:18.277810 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62d88e2d-5e58-408c-9d13-e36487d55131 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:18.278703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62d88e2d-5e58-408c-9d13-e36487d55131 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:18.279427 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62d88e2d-5e58-408c-9d13-e36487d55131 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:18.280028 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62d88e2d-5e58-408c-9d13-e36487d55131 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:18.603752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=4 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:02:18.788480 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-62d88e2d-5e58-408c-9d13-e36487d55131 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:18.799135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-62d88e2d-5e58-408c-9d13-e36487d55131 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:18.807779 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-62d88e2d-5e58-408c-9d13-e36487d55131 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:18.830495 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-62d88e2d-5e58-408c-9d13-e36487d55131 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1537 microversion: 2.91 time: 0.569399 Sep 17 21:02:18.834080 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1552/3018] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:18 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1537 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:18.869366 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1667a5f3-97ff-42ed-ad46-8a577814a710 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:18.882762 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1667a5f3-97ff-42ed-ad46-8a577814a710 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.742688 Sep 17 21:02:18.883481 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1467/3019] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:18 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:18.915840 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0355fd9f-e158-48d7-8900-4af3fe060a52 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:18.916784 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0355fd9f-e158-48d7-8900-4af3fe060a52 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:18.928303 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0355fd9f-e158-48d7-8900-4af3fe060a52 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:18.931230 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0355fd9f-e158-48d7-8900-4af3fe060a52 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:18.932249 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0355fd9f-e158-48d7-8900-4af3fe060a52 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:18.934767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0355fd9f-e158-48d7-8900-4af3fe060a52 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:18.937260 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0355fd9f-e158-48d7-8900-4af3fe060a52 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:18.937898 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0355fd9f-e158-48d7-8900-4af3fe060a52 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:19.275315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c6ebc232-907f-437f-a717-504be9e02ff2 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a48e0c10>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:19.357431 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c6ebc232-907f-437f-a717-504be9e02ff2 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29" status: 200 len: 1453 microversion: 2.1 time: 0.087561 Sep 17 21:02:19.372847 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1468/3020] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:19 2022] GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29 => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:19.581625 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0355fd9f-e158-48d7-8900-4af3fe060a52 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:19.592644 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0355fd9f-e158-48d7-8900-4af3fe060a52 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.689461 Sep 17 21:02:19.594511 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1553/3021] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:18 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:19.622392 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9bf8cf33-b049-4a9f-acbe-9af3ad3a0ee0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:19.626073 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9bf8cf33-b049-4a9f-acbe-9af3ad3a0ee0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: e41db2df-5772-4ddb-96d9-7ddb555bfad5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:19.648281 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-9bf8cf33-b049-4a9f-acbe-9af3ad3a0ee0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Instance e41db2df-5772-4ddb-96d9-7ddb555bfad5 could not be found. Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9bf8cf33-b049-4a9f-acbe-9af3ad3a0ee0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers/e41db2df-5772-4ddb-96d9-7ddb555bfad5/action HTTP/1.1 Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 65 Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: {"rebuild": {"imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4"}} Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance e41db2df-5772-4ddb-96d9-7ddb555bfad5 could not be found. Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'e41db2df-5772-4ddb-96d9-7ddb555bfad5', 'body': {'rebuild': {'imageRef': '1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4'}}} Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e41db2df-5772-4ddb-96d9-7ddb555bfad5 could not be found. Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 17 21:02:19.654056 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:02:19.658709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:02:19.658709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:19.658709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:19.658709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e41db2df-5772-4ddb-96d9-7ddb555bfad5 could not be found. Sep 17 21:02:19.658709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:19.658709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:19.658709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:19.658709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:19.658709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:19.658709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:19.658709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:19.658709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:19.658709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e41db2df-5772-4ddb-96d9-7ddb555bfad5 could not be found. Sep 17 21:02:19.658709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:19.661288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9bf8cf33-b049-4a9f-acbe-9af3ad3a0ee0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 404 to user: Instance e41db2df-5772-4ddb-96d9-7ddb555bfad5 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:19.664478 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9bf8cf33-b049-4a9f-acbe-9af3ad3a0ee0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers/e41db2df-5772-4ddb-96d9-7ddb555bfad5/action" status: 404 len: 111 microversion: 2.1 time: 0.046582 Sep 17 21:02:19.665406 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1469/3022] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:02:19 2022] POST /compute/v2.1/servers/e41db2df-5772-4ddb-96d9-7ddb555bfad5/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:02:19.677826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d5ab7e07-4400-471d-9735-3da03b33a646 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:19.678769 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d5ab7e07-4400-471d-9735-3da03b33a646 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:19.694862 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5ab7e07-4400-471d-9735-3da03b33a646 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:19.696568 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5ab7e07-4400-471d-9735-3da03b33a646 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:19.701498 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5ab7e07-4400-471d-9735-3da03b33a646 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:19.704648 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5ab7e07-4400-471d-9735-3da03b33a646 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:19.705353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5ab7e07-4400-471d-9735-3da03b33a646 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:19.706858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5ab7e07-4400-471d-9735-3da03b33a646 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:19.867339 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e59435f9-fbfa-470b-ac5c-5a13bf918704 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:19.867860 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e59435f9-fbfa-470b-ac5c-5a13bf918704 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:19.875357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e59435f9-fbfa-470b-ac5c-5a13bf918704 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:19.875858 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e59435f9-fbfa-470b-ac5c-5a13bf918704 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:19.876299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e59435f9-fbfa-470b-ac5c-5a13bf918704 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:19.877020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e59435f9-fbfa-470b-ac5c-5a13bf918704 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:19.877499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e59435f9-fbfa-470b-ac5c-5a13bf918704 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:19.877930 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e59435f9-fbfa-470b-ac5c-5a13bf918704 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:20.147949 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e59435f9-fbfa-470b-ac5c-5a13bf918704 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:20.168815 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e59435f9-fbfa-470b-ac5c-5a13bf918704 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:20.172265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e59435f9-fbfa-470b-ac5c-5a13bf918704 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:20.191836 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e59435f9-fbfa-470b-ac5c-5a13bf918704 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1537 microversion: 2.91 time: 0.326585 Sep 17 21:02:20.194459 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1470/3023] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:19 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1537 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:20.202464 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d5ab7e07-4400-471d-9735-3da03b33a646 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:20.212055 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d5ab7e07-4400-471d-9735-3da03b33a646 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.541245 Sep 17 21:02:20.218583 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1554/3024] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:19 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:20.246128 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6955f02e-5a85-418f-82f3-c803573a547f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:20.246972 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6955f02e-5a85-418f-82f3-c803573a547f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:20.266404 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6955f02e-5a85-418f-82f3-c803573a547f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:20.266404 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6955f02e-5a85-418f-82f3-c803573a547f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:20.266611 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6955f02e-5a85-418f-82f3-c803573a547f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:20.267320 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6955f02e-5a85-418f-82f3-c803573a547f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:20.267785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6955f02e-5a85-418f-82f3-c803573a547f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:20.281043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6955f02e-5a85-418f-82f3-c803573a547f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:20.373105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3337eff8-ab30-4cc2-946a-0fa0054682d8 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a41e60d0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:20.497046 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3337eff8-ab30-4cc2-946a-0fa0054682d8 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29" status: 200 len: 1453 microversion: 2.1 time: 0.127921 Sep 17 21:02:20.498342 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1555/3025] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:20 2022] GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29 => generated 1453 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:20.765363 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6955f02e-5a85-418f-82f3-c803573a547f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:20.786342 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6955f02e-5a85-418f-82f3-c803573a547f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.542138 Sep 17 21:02:20.786991 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1471/3026] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:20 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:20.813995 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7e9e411c-7385-403b-b9fd-6e95cbb8c508 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:20.815806 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7e9e411c-7385-403b-b9fd-6e95cbb8c508 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: b136dd22-39d7-4c29-aff1-81663c9a0f9e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:20.826664 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-7e9e411c-7385-403b-b9fd-6e95cbb8c508 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Instance b136dd22-39d7-4c29-aff1-81663c9a0f9e could not be found. Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7e9e411c-7385-403b-b9fd-6e95cbb8c508 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers/b136dd22-39d7-4c29-aff1-81663c9a0f9e/action HTTP/1.1 Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 15 Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: {"restore": {}} Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance b136dd22-39d7-4c29-aff1-81663c9a0f9e could not be found. Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'b136dd22-39d7-4c29-aff1-81663c9a0f9e', 'body': {'restore': {}}} Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b136dd22-39d7-4c29-aff1-81663c9a0f9e could not be found. Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b136dd22-39d7-4c29-aff1-81663c9a0f9e could not be found. Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:20.828779 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:20.833009 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:20.833009 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:20.833009 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b136dd22-39d7-4c29-aff1-81663c9a0f9e could not be found. Sep 17 21:02:20.833009 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:20.836309 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7e9e411c-7385-403b-b9fd-6e95cbb8c508 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 404 to user: Instance b136dd22-39d7-4c29-aff1-81663c9a0f9e could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:20.837520 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7e9e411c-7385-403b-b9fd-6e95cbb8c508 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers/b136dd22-39d7-4c29-aff1-81663c9a0f9e/action" status: 404 len: 111 microversion: 2.1 time: 0.028181 Sep 17 21:02:20.839152 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1556/3027] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:02:20 2022] POST /compute/v2.1/servers/b136dd22-39d7-4c29-aff1-81663c9a0f9e/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:02:20.848784 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3e9a665b-9c23-488c-9857-4549ed160e23 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:20.849776 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3e9a665b-9c23-488c-9857-4549ed160e23 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:20.862937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3e9a665b-9c23-488c-9857-4549ed160e23 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:20.872394 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3e9a665b-9c23-488c-9857-4549ed160e23 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:20.874882 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3e9a665b-9c23-488c-9857-4549ed160e23 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:20.875912 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3e9a665b-9c23-488c-9857-4549ed160e23 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:20.880764 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3e9a665b-9c23-488c-9857-4549ed160e23 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:20.882026 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3e9a665b-9c23-488c-9857-4549ed160e23 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:21.246165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3e9a665b-9c23-488c-9857-4549ed160e23 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:21.256692 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3e9a665b-9c23-488c-9857-4549ed160e23 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.412972 Sep 17 21:02:21.258387 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1472/3028] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:20 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:21.275873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6435eb05-2108-4193-ae91-1f137dc189f4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:21.282368 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6435eb05-2108-4193-ae91-1f137dc189f4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:21.309047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6435eb05-2108-4193-ae91-1f137dc189f4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:21.314128 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6435eb05-2108-4193-ae91-1f137dc189f4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:21.320797 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6435eb05-2108-4193-ae91-1f137dc189f4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:21.326031 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6435eb05-2108-4193-ae91-1f137dc189f4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:21.326274 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6435eb05-2108-4193-ae91-1f137dc189f4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:21.326915 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6435eb05-2108-4193-ae91-1f137dc189f4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:21.455484 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6435eb05-2108-4193-ae91-1f137dc189f4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:21.466873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6435eb05-2108-4193-ae91-1f137dc189f4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:21.468349 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6435eb05-2108-4193-ae91-1f137dc189f4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:21.492858 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6435eb05-2108-4193-ae91-1f137dc189f4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1537 microversion: 2.91 time: 0.232282 Sep 17 21:02:21.493859 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1473/3029] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:21 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1537 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:21.511286 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1569076f-5a5f-49cc-9474-b43b9c9d526e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:21.512672 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1569076f-5a5f-49cc-9474-b43b9c9d526e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:21.532798 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1569076f-5a5f-49cc-9474-b43b9c9d526e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:21.544061 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1569076f-5a5f-49cc-9474-b43b9c9d526e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:21.544906 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1569076f-5a5f-49cc-9474-b43b9c9d526e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:21.545904 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1569076f-5a5f-49cc-9474-b43b9c9d526e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:21.546625 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1569076f-5a5f-49cc-9474-b43b9c9d526e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:21.547326 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1569076f-5a5f-49cc-9474-b43b9c9d526e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:21.765446 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fdd82e6f-b0bb-4f95-975f-1b2fcaaef88f tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] Action: 'create', calling method: .version_select at 0x7f25a427a3a0>, body: {"keypair": {"name": "tempest-keypair-211827589", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA62lHD0giXobHl4o3AR3FlECI+388ZNmeIE0lF6AAdjDrxOSzX6qmrNYsiJmjLOmkkXmKbbfCC7GxLW3RJKn8Jd7vfNWgqmaUfHwc4koCHlJuszBlB7Mk/AfqDcR9sBDw=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:21.833296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1569076f-5a5f-49cc-9474-b43b9c9d526e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:21.842488 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1569076f-5a5f-49cc-9474-b43b9c9d526e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.347436 Sep 17 21:02:21.845102 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-fdd82e6f-b0bb-4f95-975f-1b2fcaaef88f tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] Getting quotas for project 36f50dceeb7e46f0a1b3482f0c82d7c3. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:02:21.848839 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1474/3030] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:21 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:21.856046 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-fdd82e6f-b0bb-4f95-975f-1b2fcaaef88f tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] Getting quotas for user 6ad16040f3e64b46beca7fc88d724173 and project 36f50dceeb7e46f0a1b3482f0c82d7c3. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:02:21.861449 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4bb341fe-e2ee-44be-b092-216dd4d71c61 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a5071550>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:21.927362 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fdd82e6f-b0bb-4f95-975f-1b2fcaaef88f tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.831252 Sep 17 21:02:21.935949 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1557/3031] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:02:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:02:21.964179 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1983fcc1-077b-4ff2-97b3-17826dacbe25 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:21.964733 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1983fcc1-077b-4ff2-97b3-17826dacbe25 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:21.965029 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4bb341fe-e2ee-44be-b092-216dd4d71c61 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29" status: 200 len: 1453 microversion: 2.1 time: 0.110908 Sep 17 21:02:21.973327 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1475/3032] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:21 2022] GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29 => generated 1453 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:21.985740 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fe7d692d-6ba2-459f-9dcd-19488f81c893 tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] Calling method '.version_select at 0x7f25a4849670>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:21.990360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1983fcc1-077b-4ff2-97b3-17826dacbe25 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:21.990769 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1983fcc1-077b-4ff2-97b3-17826dacbe25 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:21.995126 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1983fcc1-077b-4ff2-97b3-17826dacbe25 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:21.995894 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1983fcc1-077b-4ff2-97b3-17826dacbe25 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:22.000312 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1983fcc1-077b-4ff2-97b3-17826dacbe25 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:22.000753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1983fcc1-077b-4ff2-97b3-17826dacbe25 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:22.030007 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fe7d692d-6ba2-459f-9dcd-19488f81c893 tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs/tempest-keypair-211827589" status: 200 len: 497 microversion: 2.1 time: 0.061649 Sep 17 21:02:22.038663 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1476/3033] 10.222.0.26 () {58 vars in 1215 bytes} [Sat Sep 17 21:02:21 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-211827589 => generated 497 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:02:22.050489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4850c120-c89d-4fb1-b0d0-5a9db3732328 tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] Calling method '.version_select at 0x7f25a481a940>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:22.099067 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-1983fcc1-077b-4ff2-97b3-17826dacbe25 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Cannot 'restore' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state active Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1983fcc1-077b-4ff2-97b3-17826dacbe25 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a/action HTTP/1.1 Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 15 Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: {"restore": {}} Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: exception: Cannot 'restore' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state active Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '9b986fa2-07ea-4418-adf2-0a5fa127e84a', 'body': {'restore': {}}} Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a in vm_state active. Cannot restore while the instance is in this state. Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state active Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:22.102711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:22.108425 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:22.108425 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:22.108425 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:22.108425 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state active Sep 17 21:02:22.108425 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:22.111680 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1983fcc1-077b-4ff2-97b3-17826dacbe25 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 409 to user: Cannot 'restore' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state active {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:22.112774 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1983fcc1-077b-4ff2-97b3-17826dacbe25 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a/action" status: 409 len: 145 microversion: 2.1 time: 0.174945 Sep 17 21:02:22.118468 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4850c120-c89d-4fb1-b0d0-5a9db3732328 tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-211827589" status: 202 len: 0 microversion: 2.1 time: 0.071991 Sep 17 21:02:22.118962 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1558/3034] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:02:21 2022] POST /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a/action => generated 145 bytes in 182 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 17 21:02:22.123573 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1477/3035] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Sep 17 21:02:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-211827589 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:02:22.129324 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-85449b5f-7ed7-4927-8511-7bb0ca125dc3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:22.130737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-85449b5f-7ed7-4927-8511-7bb0ca125dc3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:22.139960 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85449b5f-7ed7-4927-8511-7bb0ca125dc3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:22.141205 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2c1341c7-c737-43cb-a7e1-eeae2209c222 tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] Action: 'create', calling method: .version_select at 0x7f25a488d5e0>, body: {"keypair": {"name": "tempest-keypair-1672973271", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAdnn5D1XLJ0t3uT1xEpoBzHeR46I3i5+IVwiWEk2o0wkvrt9zvQK+ar2ry5Ze+c94fWfG0sxFAF99pNEi1ry788JU6Tn07wj40Xxl1HViMOngB7Q535tGaWrlvg90SEw=="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:22.145922 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85449b5f-7ed7-4927-8511-7bb0ca125dc3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:22.146566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85449b5f-7ed7-4927-8511-7bb0ca125dc3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:22.148284 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85449b5f-7ed7-4927-8511-7bb0ca125dc3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:22.149220 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85449b5f-7ed7-4927-8511-7bb0ca125dc3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:22.149873 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85449b5f-7ed7-4927-8511-7bb0ca125dc3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:22.187599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-2c1341c7-c737-43cb-a7e1-eeae2209c222 tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] Getting quotas for project 36f50dceeb7e46f0a1b3482f0c82d7c3. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:02:22.205439 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-2c1341c7-c737-43cb-a7e1-eeae2209c222 tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] Getting quotas for user 6ad16040f3e64b46beca7fc88d724173 and project 36f50dceeb7e46f0a1b3482f0c82d7c3. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:02:22.269170 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2c1341c7-c737-43cb-a7e1-eeae2209c222 tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.135171 Sep 17 21:02:22.270842 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1478/3036] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:02:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:02:22.282814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1f727271-371e-4ded-ac1a-63ba23935e40 tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] Calling method '.version_select at 0x7f25a5071dc0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:22.343053 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1f727271-371e-4ded-ac1a-63ba23935e40 tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1672973271" status: 202 len: 0 microversion: 2.1 time: 0.064724 Sep 17 21:02:22.344510 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1479/3037] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Sep 17 21:02:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1672973271 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:02:22.352997 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dcbbf2f1-cd25-4dda-92e3-c0e3071e126c tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] Action: 'create', calling method: .version_select at 0x7f25a481d550>, body: {"keypair": {"name": "tempest-keypair-1416970302", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:22.400350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-dcbbf2f1-cd25-4dda-92e3-c0e3071e126c tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] Getting quotas for project 36f50dceeb7e46f0a1b3482f0c82d7c3. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:02:22.411421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-dcbbf2f1-cd25-4dda-92e3-c0e3071e126c tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] Getting quotas for user 6ad16040f3e64b46beca7fc88d724173 and project 36f50dceeb7e46f0a1b3482f0c82d7c3. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:02:22.428296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-85449b5f-7ed7-4927-8511-7bb0ca125dc3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:22.445207 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-85449b5f-7ed7-4927-8511-7bb0ca125dc3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.323519 Sep 17 21:02:22.445887 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1559/3038] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:22 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:22.473390 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dcbbf2f1-cd25-4dda-92e3-c0e3071e126c tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.124305 Sep 17 21:02:22.474711 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1480/3039] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:02:22 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:02:22.480933 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-29b7d283-f91c-4623-9f33-f890118cd144 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:22.482817 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-29b7d283-f91c-4623-9f33-f890118cd144 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:22.487233 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-84a8f6b4-dbb0-4b99-970c-ca0726b34112 tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] Calling method '.version_select at 0x7f25a48eb550>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:22.505120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-29b7d283-f91c-4623-9f33-f890118cd144 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:22.505664 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-29b7d283-f91c-4623-9f33-f890118cd144 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:22.506116 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-29b7d283-f91c-4623-9f33-f890118cd144 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:22.506844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-29b7d283-f91c-4623-9f33-f890118cd144 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:22.507383 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-29b7d283-f91c-4623-9f33-f890118cd144 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:22.507845 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-29b7d283-f91c-4623-9f33-f890118cd144 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:22.516962 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-84a8f6b4-dbb0-4b99-970c-ca0726b34112 tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1416970302" status: 202 len: 0 microversion: 2.1 time: 0.035686 Sep 17 21:02:22.519735 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1481/3040] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Sep 17 21:02:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1416970302 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:02:22.537767 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-51aba982-b3bc-43e3-b76a-7e983736f019 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:22.538501 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-51aba982-b3bc-43e3-b76a-7e983736f019 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:22.551679 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-51aba982-b3bc-43e3-b76a-7e983736f019 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:22.552207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-51aba982-b3bc-43e3-b76a-7e983736f019 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:22.552637 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-51aba982-b3bc-43e3-b76a-7e983736f019 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:22.553369 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-51aba982-b3bc-43e3-b76a-7e983736f019 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:22.553863 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-51aba982-b3bc-43e3-b76a-7e983736f019 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:22.554821 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-51aba982-b3bc-43e3-b76a-7e983736f019 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:22.641373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-51aba982-b3bc-43e3-b76a-7e983736f019 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:22.668421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-51aba982-b3bc-43e3-b76a-7e983736f019 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:22.675995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-51aba982-b3bc-43e3-b76a-7e983736f019 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:22.701175 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-51aba982-b3bc-43e3-b76a-7e983736f019 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1537 microversion: 2.91 time: 0.176217 Sep 17 21:02:22.702437 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1482/3041] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:22 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1537 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:02:22.707878 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a6626d34-2daf-4f90-b88a-6342ede0ba7d tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] Action: 'create', calling method: .version_select at 0x7f25a5071b80>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-950118108", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN81gtj7Viv5/9OFcW9l2+0GAxXoglbuO0UZ+EtGUJ4QO7mPvSAKlMSe27LlXeYhfiFDZ7BX4gNH+dNTxPVWJvsVDGRwx/QBGCX2lX7ujHMt0lay1CMPbJhSD+7OspdtuA=="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:22.715630 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:INSERT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:02:22.743704 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-a6626d34-2daf-4f90-b88a-6342ede0ba7d tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] Getting quotas for project 36f50dceeb7e46f0a1b3482f0c82d7c3. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:02:22.750480 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-a6626d34-2daf-4f90-b88a-6342ede0ba7d tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] Getting quotas for user 6ad16040f3e64b46beca7fc88d724173 and project 36f50dceeb7e46f0a1b3482f0c82d7c3. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:02:22.791046 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a6626d34-2daf-4f90-b88a-6342ede0ba7d tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.087441 Sep 17 21:02:22.801116 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1483/3042] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:02:22 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:02:22.807390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-af49edc8-c454-44d1-ae80-a9f8c9e3b14d tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] Action: 'create', calling method: .version_select at 0x7f25a48e0790>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-924617081", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdoIzGrODIEWPTMTrSQ7rEzvBNLSuVf6Q+RSkJAdHh9afKfmMnAksQGJ1ngwBO/SEyqwuj3+2V/9uYzPjfyawkZK/uA9WEsy+BXM2Pbo/q6s7PcdC+DutoMOqcr3YnwXQ=="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:22.916785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-af49edc8-c454-44d1-ae80-a9f8c9e3b14d tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] Getting quotas for project 36f50dceeb7e46f0a1b3482f0c82d7c3. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:02:22.944945 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-af49edc8-c454-44d1-ae80-a9f8c9e3b14d tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] Getting quotas for user 6ad16040f3e64b46beca7fc88d724173 and project 36f50dceeb7e46f0a1b3482f0c82d7c3. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:02:23.008663 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-29b7d283-f91c-4623-9f33-f890118cd144 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:23.026048 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-29b7d283-f91c-4623-9f33-f890118cd144 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.547873 Sep 17 21:02:23.026965 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1560/3043] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:22 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:23.037586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7b23b171-b9dd-432e-96d7-048d9913fa35 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a427a790>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:23.043667 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-af49edc8-c454-44d1-ae80-a9f8c9e3b14d tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.240788 Sep 17 21:02:23.051893 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1484/3044] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:02:22 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:02:23.057263 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-11ed98a2-0640-422a-92b0-f62ef85c251d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:23.057955 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-11ed98a2-0640-422a-92b0-f62ef85c251d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: e4a70c09-2e18-463c-9c65-36bb6f4b7518] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:23.064259 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-11ed98a2-0640-422a-92b0-f62ef85c251d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Instance e4a70c09-2e18-463c-9c65-36bb6f4b7518 could not be found. Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-11ed98a2-0640-422a-92b0-f62ef85c251d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers/e4a70c09-2e18-463c-9c65-36bb6f4b7518/action HTTP/1.1 Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 14 Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: {"resume": {}} Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance e4a70c09-2e18-463c-9c65-36bb6f4b7518 could not be found. Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'e4a70c09-2e18-463c-9c65-36bb6f4b7518', 'body': {'resume': {}}} Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4a70c09-2e18-463c-9c65-36bb6f4b7518 could not be found. Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4a70c09-2e18-463c-9c65-36bb6f4b7518 could not be found. Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:23.072084 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:23.078216 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:23.078216 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:23.078216 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4a70c09-2e18-463c-9c65-36bb6f4b7518 could not be found. Sep 17 21:02:23.078216 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:23.078216 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-11ed98a2-0640-422a-92b0-f62ef85c251d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 404 to user: Instance e4a70c09-2e18-463c-9c65-36bb6f4b7518 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:23.084499 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-11ed98a2-0640-422a-92b0-f62ef85c251d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers/e4a70c09-2e18-463c-9c65-36bb6f4b7518/action" status: 404 len: 111 microversion: 2.1 time: 0.030103 Sep 17 21:02:23.086335 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1485/3045] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:02:23 2022] POST /compute/v2.1/servers/e4a70c09-2e18-463c-9c65-36bb6f4b7518/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:02:23.105724 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-67997b1d-66e4-406e-a707-da016f3dd760 tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] Action: 'create', calling method: .version_select at 0x7f25a48eb790>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1096154913", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAlgEc9OrEMBHLAPmoeEFxyGCleVSjFM+SqEL/rUZdk3A+S/wY3W6J7gG1RZv1TIauk2iHLwrhoXphyw4HYw9ueW9lCKJBDavLj0AA4dxgE8r7QKhw7R7CcQyW5I2kGvw=="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:23.139862 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7b23b171-b9dd-432e-96d7-048d9913fa35 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29" status: 200 len: 1453 microversion: 2.1 time: 0.109791 Sep 17 21:02:23.140219 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-67997b1d-66e4-406e-a707-da016f3dd760 tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] Getting quotas for project 36f50dceeb7e46f0a1b3482f0c82d7c3. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:02:23.142757 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1561/3046] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:23 2022] GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29 => generated 1453 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:23.150677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-67997b1d-66e4-406e-a707-da016f3dd760 tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] Getting quotas for user 6ad16040f3e64b46beca7fc88d724173 and project 36f50dceeb7e46f0a1b3482f0c82d7c3. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:02:23.157169 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-71125bf3-da60-4bc2-ac62-c29b9e218504 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:23.163782 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-71125bf3-da60-4bc2-ac62-c29b9e218504 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:23.183249 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71125bf3-da60-4bc2-ac62-c29b9e218504 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:23.183771 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71125bf3-da60-4bc2-ac62-c29b9e218504 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:23.184217 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71125bf3-da60-4bc2-ac62-c29b9e218504 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:23.185574 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71125bf3-da60-4bc2-ac62-c29b9e218504 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:23.187056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71125bf3-da60-4bc2-ac62-c29b9e218504 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:23.187903 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71125bf3-da60-4bc2-ac62-c29b9e218504 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:23.229009 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-67997b1d-66e4-406e-a707-da016f3dd760 tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.135308 Sep 17 21:02:23.238205 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1486/3047] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:02:23 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:02:23.250362 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-577719fb-4bef-487a-a99e-2088f3829db7 tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] Calling method '.version_select at 0x7f25a47eaee0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:23.261927 ncdv-master-1 devstack@n-api.service[140523]: WARNING oslo_db.sqlalchemy.utils [None req-577719fb-4bef-487a-a99e-2088f3829db7 tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 17 21:02:23.272268 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-577719fb-4bef-487a-a99e-2088f3829db7 tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.032216 Sep 17 21:02:23.280873 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1487/3048] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Sep 17 21:02:23 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:23.299005 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1105bc7d-94a8-4a58-9da4-8fe0e652d544 tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] Calling method '.version_select at 0x7f25a4849af0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:23.348667 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1105bc7d-94a8-4a58-9da4-8fe0e652d544 tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1096154913" status: 202 len: 0 microversion: 2.1 time: 0.057900 Sep 17 21:02:23.354254 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1488/3049] 10.222.0.26 () {58 vars in 1278 bytes} [Sat Sep 17 21:02:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1096154913 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:02:23.363207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d2f487ed-8b65-47e0-ac4c-6e9430118f8c tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] Calling method '.version_select at 0x7f25a48493a0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:23.426452 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d2f487ed-8b65-47e0-ac4c-6e9430118f8c tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-924617081" status: 202 len: 0 microversion: 2.1 time: 0.069842 Sep 17 21:02:23.431081 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1489/3050] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Sep 17 21:02:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-924617081 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:02:23.437079 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f2348eae-be6a-41e6-8d3e-8c1affb058cb tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] Calling method '.version_select at 0x7f25a48e0670>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:23.443235 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-71125bf3-da60-4bc2-ac62-c29b9e218504 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:23.456763 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-71125bf3-da60-4bc2-ac62-c29b9e218504 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.303211 Sep 17 21:02:23.458349 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1562/3051] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:23 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:23.487077 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f2348eae-be6a-41e6-8d3e-8c1affb058cb tempest-KeyPairsV2TestJSON-209752237 tempest-KeyPairsV2TestJSON-209752237-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-950118108" status: 202 len: 0 microversion: 2.1 time: 0.053725 Sep 17 21:02:23.493589 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1490/3052] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Sep 17 21:02:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-950118108 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:02:23.498368 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-eeb8e2aa-12a4-4cb0-ac37-a740f8078515 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:23.500545 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-eeb8e2aa-12a4-4cb0-ac37-a740f8078515 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:23.511233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eeb8e2aa-12a4-4cb0-ac37-a740f8078515 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:23.512074 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eeb8e2aa-12a4-4cb0-ac37-a740f8078515 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:23.512806 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eeb8e2aa-12a4-4cb0-ac37-a740f8078515 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:23.514509 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eeb8e2aa-12a4-4cb0-ac37-a740f8078515 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:23.515256 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eeb8e2aa-12a4-4cb0-ac37-a740f8078515 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:23.516418 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eeb8e2aa-12a4-4cb0-ac37-a740f8078515 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:23.546979 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:02:23.737179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ca981df3-b014-4646-9c62-492481235b9b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:23.737790 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ca981df3-b014-4646-9c62-492481235b9b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:23.758876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ca981df3-b014-4646-9c62-492481235b9b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:23.761310 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-eeb8e2aa-12a4-4cb0-ac37-a740f8078515 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:23.761982 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ca981df3-b014-4646-9c62-492481235b9b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:23.762658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ca981df3-b014-4646-9c62-492481235b9b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:23.769024 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ca981df3-b014-4646-9c62-492481235b9b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:23.772726 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-eeb8e2aa-12a4-4cb0-ac37-a740f8078515 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.294266 Sep 17 21:02:23.773625 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1563/3053] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:23 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:02:23.775568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ca981df3-b014-4646-9c62-492481235b9b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:23.776221 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ca981df3-b014-4646-9c62-492481235b9b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:23.798515 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1b977ec1-371a-44d6-8c85-f60f33ebe2bc tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:23.799293 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1b977ec1-371a-44d6-8c85-f60f33ebe2bc tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:23.811508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1b977ec1-371a-44d6-8c85-f60f33ebe2bc tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:23.812379 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1b977ec1-371a-44d6-8c85-f60f33ebe2bc tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:23.813186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1b977ec1-371a-44d6-8c85-f60f33ebe2bc tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:23.814159 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1b977ec1-371a-44d6-8c85-f60f33ebe2bc tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:23.814846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1b977ec1-371a-44d6-8c85-f60f33ebe2bc tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:23.815369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1b977ec1-371a-44d6-8c85-f60f33ebe2bc tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:23.905662 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ca981df3-b014-4646-9c62-492481235b9b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:23.914014 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-1b977ec1-371a-44d6-8c85-f60f33ebe2bc tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Cannot 'resume' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state active Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1b977ec1-371a-44d6-8c85-f60f33ebe2bc tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a/action HTTP/1.1 Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 14 Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: {"resume": {}} Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: exception: Cannot 'resume' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state active Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '9b986fa2-07ea-4418-adf2-0a5fa127e84a', 'body': {'resume': {}}} Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a in vm_state active. Cannot resume while the instance is in this state. Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state active Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:23.926689 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:23.931894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:23.931894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:23.931894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:23.931894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:23.931894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:23.931894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state active Sep 17 21:02:23.931894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:23.935159 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1b977ec1-371a-44d6-8c85-f60f33ebe2bc tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 409 to user: Cannot 'resume' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state active {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:23.935652 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ca981df3-b014-4646-9c62-492481235b9b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:23.936853 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1b977ec1-371a-44d6-8c85-f60f33ebe2bc tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a/action" status: 409 len: 144 microversion: 2.1 time: 0.143469 Sep 17 21:02:23.937114 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ca981df3-b014-4646-9c62-492481235b9b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:23.938591 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1564/3054] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:02:23 2022] POST /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a/action => generated 144 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 17 21:02:23.944050 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ca981df3-b014-4646-9c62-492481235b9b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1537 microversion: 2.91 time: 0.213099 Sep 17 21:02:23.948298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f7391dd0-da7f-4885-a462-be260a4d68b9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:23.949092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f7391dd0-da7f-4885-a462-be260a4d68b9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:23.958194 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1491/3055] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:23 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1537 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:23.962004 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7391dd0-da7f-4885-a462-be260a4d68b9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:23.962743 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7391dd0-da7f-4885-a462-be260a4d68b9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:23.963982 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7391dd0-da7f-4885-a462-be260a4d68b9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:23.964885 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7391dd0-da7f-4885-a462-be260a4d68b9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:23.965525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7391dd0-da7f-4885-a462-be260a4d68b9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:23.966150 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7391dd0-da7f-4885-a462-be260a4d68b9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:24.175496 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ad9783fd-ae2d-48a6-90f4-54db2f51acbd tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a49de310>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:24.238134 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f7391dd0-da7f-4885-a462-be260a4d68b9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:24.255066 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f7391dd0-da7f-4885-a462-be260a4d68b9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.312410 Sep 17 21:02:24.285033 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1565/3056] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:23 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:24.291173 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4a64758f-f003-4455-92f1-9d78e9b7224c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:24.292119 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4a64758f-f003-4455-92f1-9d78e9b7224c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:24.294471 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:02:24.300539 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a64758f-f003-4455-92f1-9d78e9b7224c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:24.301353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a64758f-f003-4455-92f1-9d78e9b7224c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:24.302066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a64758f-f003-4455-92f1-9d78e9b7224c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:24.303325 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a64758f-f003-4455-92f1-9d78e9b7224c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:24.304023 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a64758f-f003-4455-92f1-9d78e9b7224c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:24.304766 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a64758f-f003-4455-92f1-9d78e9b7224c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:24.307682 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ad9783fd-ae2d-48a6-90f4-54db2f51acbd tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29" status: 200 len: 1453 microversion: 2.1 time: 0.142621 Sep 17 21:02:24.308372 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1492/3057] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:24 2022] GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:24.575618 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4a64758f-f003-4455-92f1-9d78e9b7224c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:24.587011 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4a64758f-f003-4455-92f1-9d78e9b7224c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.300435 Sep 17 21:02:24.587967 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1566/3058] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:24 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:24.973726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e4b1e43f-0704-4102-b0c4-3ee678cd8c41 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:24.974365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e4b1e43f-0704-4102-b0c4-3ee678cd8c41 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:24.990227 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e4b1e43f-0704-4102-b0c4-3ee678cd8c41 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:24.992086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e4b1e43f-0704-4102-b0c4-3ee678cd8c41 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:24.993689 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e4b1e43f-0704-4102-b0c4-3ee678cd8c41 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:24.994513 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e4b1e43f-0704-4102-b0c4-3ee678cd8c41 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:24.995925 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e4b1e43f-0704-4102-b0c4-3ee678cd8c41 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:24.996375 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e4b1e43f-0704-4102-b0c4-3ee678cd8c41 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:25.154432 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e4b1e43f-0704-4102-b0c4-3ee678cd8c41 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:25.168889 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e4b1e43f-0704-4102-b0c4-3ee678cd8c41 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:25.173159 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e4b1e43f-0704-4102-b0c4-3ee678cd8c41 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:25.183319 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e4b1e43f-0704-4102-b0c4-3ee678cd8c41 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1537 microversion: 2.91 time: 0.214684 Sep 17 21:02:25.212887 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1493/3059] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:24 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1537 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:25.219392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7782e0b3-14cc-4203-a9db-876a2092f02d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "dc0ab76b-95f3-4f0a-beab-7465ea19ce7a"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7782e0b3-14cc-4203-a9db-876a2092f02d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 160 Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: {"server": {"name": "", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "dc0ab76b-95f3-4f0a-beab-7465ea19ce7a"}]}} Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'body': {'server': {'name': '', 'imageRef': '1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4', 'flavorRef': '452', 'networks': [{'uuid': 'dc0ab76b-95f3-4f0a-beab-7465ea19ce7a'}]}}} Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise error Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi '' Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 21:02:25.227841 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 21:02:25.234866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 21:02:25.234866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 17 21:02:25.234866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:25.234866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:25.234866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:25.234866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:25.234866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:25.234866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:25.234866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 21:02:25.234866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 21:02:25.234866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 17 21:02:25.234866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:25.237851 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7782e0b3-14cc-4203-a9db-876a2092f02d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:25.238949 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7782e0b3-14cc-4203-a9db-876a2092f02d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.024426 Sep 17 21:02:25.250597 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f737e3f8-d2c2-459c-8ec2-8b82bbe695bf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:25.251236 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f737e3f8-d2c2-459c-8ec2-8b82bbe695bf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:25.252292 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1567/3060] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:02:25 2022] POST /compute/v2.1/servers => generated 108 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 17 21:02:25.264912 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f737e3f8-d2c2-459c-8ec2-8b82bbe695bf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:25.264912 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f737e3f8-d2c2-459c-8ec2-8b82bbe695bf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:25.264912 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f737e3f8-d2c2-459c-8ec2-8b82bbe695bf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:25.265279 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f737e3f8-d2c2-459c-8ec2-8b82bbe695bf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:25.265958 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f737e3f8-d2c2-459c-8ec2-8b82bbe695bf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:25.270025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f737e3f8-d2c2-459c-8ec2-8b82bbe695bf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:25.324516 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-76c92314-289b-4c52-ae41-6ba9983564f7 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a41e61f0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:25.475337 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-76c92314-289b-4c52-ae41-6ba9983564f7 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29" status: 200 len: 1453 microversion: 2.1 time: 0.156064 Sep 17 21:02:25.477317 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1568/3061] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:25 2022] GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:25.681586 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f737e3f8-d2c2-459c-8ec2-8b82bbe695bf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:25.707431 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f737e3f8-d2c2-459c-8ec2-8b82bbe695bf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.461715 Sep 17 21:02:25.708036 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1494/3062] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:25 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:25.734019 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e062525c-d3fa-46b7-835d-544893fe508d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:25.734646 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e062525c-d3fa-46b7-835d-544893fe508d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:25.745819 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e062525c-d3fa-46b7-835d-544893fe508d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:25.746333 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e062525c-d3fa-46b7-835d-544893fe508d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:25.746797 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e062525c-d3fa-46b7-835d-544893fe508d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:25.747518 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e062525c-d3fa-46b7-835d-544893fe508d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:25.747982 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e062525c-d3fa-46b7-835d-544893fe508d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:25.748422 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e062525c-d3fa-46b7-835d-544893fe508d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:26.068940 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e062525c-d3fa-46b7-835d-544893fe508d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:26.082347 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e062525c-d3fa-46b7-835d-544893fe508d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.352256 Sep 17 21:02:26.083293 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1569/3063] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:25 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:26.105449 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fa36f5d6-2251-49e2-9d37-c583a82eb41b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:26.106097 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fa36f5d6-2251-49e2-9d37-c583a82eb41b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9e668994-ec80-4195-a64d-b2e249198e9a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:26.113937 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-fa36f5d6-2251-49e2-9d37-c583a82eb41b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Instance 9e668994-ec80-4195-a64d-b2e249198e9a could not be found. Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fa36f5d6-2251-49e2-9d37-c583a82eb41b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers/9e668994-ec80-4195-a64d-b2e249198e9a/action HTTP/1.1 Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 14 Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: {"shelve": {}} Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 9e668994-ec80-4195-a64d-b2e249198e9a could not be found. Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '9e668994-ec80-4195-a64d-b2e249198e9a', 'body': {'shelve': {}}} Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e668994-ec80-4195-a64d-b2e249198e9a could not be found. Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e668994-ec80-4195-a64d-b2e249198e9a could not be found. Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:26.116503 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:26.121388 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:26.121388 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:26.121388 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e668994-ec80-4195-a64d-b2e249198e9a could not be found. Sep 17 21:02:26.121388 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:26.122666 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fa36f5d6-2251-49e2-9d37-c583a82eb41b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 404 to user: Instance 9e668994-ec80-4195-a64d-b2e249198e9a could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:26.124635 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fa36f5d6-2251-49e2-9d37-c583a82eb41b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers/9e668994-ec80-4195-a64d-b2e249198e9a/action" status: 404 len: 111 microversion: 2.1 time: 0.022480 Sep 17 21:02:26.129179 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1495/3064] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:02:26 2022] POST /compute/v2.1/servers/9e668994-ec80-4195-a64d-b2e249198e9a/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:02:26.135633 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-39b7a496-bce6-4150-a89e-4e16a48b4d7e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:26.136403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-39b7a496-bce6-4150-a89e-4e16a48b4d7e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:26.148235 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39b7a496-bce6-4150-a89e-4e16a48b4d7e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:26.149011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39b7a496-bce6-4150-a89e-4e16a48b4d7e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:26.149679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39b7a496-bce6-4150-a89e-4e16a48b4d7e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:26.150730 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39b7a496-bce6-4150-a89e-4e16a48b4d7e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:26.151345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39b7a496-bce6-4150-a89e-4e16a48b4d7e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:26.151929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39b7a496-bce6-4150-a89e-4e16a48b4d7e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:26.221454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a9807e28-dd23-494a-96fe-15215b9345ab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:26.222226 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a9807e28-dd23-494a-96fe-15215b9345ab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:26.240078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a9807e28-dd23-494a-96fe-15215b9345ab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:26.241658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a9807e28-dd23-494a-96fe-15215b9345ab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:26.242125 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a9807e28-dd23-494a-96fe-15215b9345ab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:26.242897 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a9807e28-dd23-494a-96fe-15215b9345ab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:26.243368 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a9807e28-dd23-494a-96fe-15215b9345ab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:26.248033 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a9807e28-dd23-494a-96fe-15215b9345ab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:26.401908 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a9807e28-dd23-494a-96fe-15215b9345ab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:26.414204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a9807e28-dd23-494a-96fe-15215b9345ab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:26.427063 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a9807e28-dd23-494a-96fe-15215b9345ab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:26.447814 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a9807e28-dd23-494a-96fe-15215b9345ab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1537 microversion: 2.91 time: 0.229729 Sep 17 21:02:26.451520 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1496/3065] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:26 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1537 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:26.485420 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-39b7a496-bce6-4150-a89e-4e16a48b4d7e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:26.505309 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b3fbb914-4a3a-4232-9257-8fe72c1620aa tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a488d700>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:26.509078 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-39b7a496-bce6-4150-a89e-4e16a48b4d7e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.378581 Sep 17 21:02:26.512171 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1570/3066] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:26 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:26.548790 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8ee08b6a-9766-470a-94fe-7241dfe58bd5 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:26.559442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8ee08b6a-9766-470a-94fe-7241dfe58bd5 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:26.577870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8ee08b6a-9766-470a-94fe-7241dfe58bd5 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:26.579711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8ee08b6a-9766-470a-94fe-7241dfe58bd5 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:26.589881 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b3fbb914-4a3a-4232-9257-8fe72c1620aa tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29" status: 200 len: 1453 microversion: 2.1 time: 0.089285 Sep 17 21:02:26.591005 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1497/3067] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:26 2022] GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29 => generated 1453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:26.592539 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8ee08b6a-9766-470a-94fe-7241dfe58bd5 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:26.593690 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8ee08b6a-9766-470a-94fe-7241dfe58bd5 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:26.594756 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8ee08b6a-9766-470a-94fe-7241dfe58bd5 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:26.596512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8ee08b6a-9766-470a-94fe-7241dfe58bd5 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:26.816981 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8ee08b6a-9766-470a-94fe-7241dfe58bd5 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:26.826047 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8ee08b6a-9766-470a-94fe-7241dfe58bd5 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.286356 Sep 17 21:02:26.827161 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1571/3068] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:26 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:26.850981 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4088bb9c-9c8a-4c3a-909c-643980463498 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:26.852466 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4088bb9c-9c8a-4c3a-909c-643980463498 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:26.861832 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4088bb9c-9c8a-4c3a-909c-643980463498 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:26.862901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4088bb9c-9c8a-4c3a-909c-643980463498 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:26.863573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4088bb9c-9c8a-4c3a-909c-643980463498 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:26.873089 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4088bb9c-9c8a-4c3a-909c-643980463498 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:26.874337 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4088bb9c-9c8a-4c3a-909c-643980463498 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:26.875985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4088bb9c-9c8a-4c3a-909c-643980463498 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:26.915973 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-4088bb9c-9c8a-4c3a-909c-643980463498 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lazy-loading 'flavor' on Instance uuid 9b986fa2-07ea-4418-adf2-0a5fa127e84a {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:02:27.195469 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4088bb9c-9c8a-4c3a-909c-643980463498 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a/action" status: 202 len: 0 microversion: 2.1 time: 0.349488 Sep 17 21:02:27.200581 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1498/3069] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:02:26 2022] POST /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:02:27.205785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5812b506-a5af-431e-9b08-e3b0ca12e49a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:27.206646 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5812b506-a5af-431e-9b08-e3b0ca12e49a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:27.224281 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5812b506-a5af-431e-9b08-e3b0ca12e49a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:27.224794 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5812b506-a5af-431e-9b08-e3b0ca12e49a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:27.227128 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5812b506-a5af-431e-9b08-e3b0ca12e49a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:27.228811 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5812b506-a5af-431e-9b08-e3b0ca12e49a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:27.231012 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5812b506-a5af-431e-9b08-e3b0ca12e49a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:27.231639 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5812b506-a5af-431e-9b08-e3b0ca12e49a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:27.481024 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e90f38df-52c6-4554-8a9c-a2b7f3367d0f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:27.481786 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e90f38df-52c6-4554-8a9c-a2b7f3367d0f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:27.499560 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e90f38df-52c6-4554-8a9c-a2b7f3367d0f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:27.502112 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e90f38df-52c6-4554-8a9c-a2b7f3367d0f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:27.505259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e90f38df-52c6-4554-8a9c-a2b7f3367d0f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:27.506311 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e90f38df-52c6-4554-8a9c-a2b7f3367d0f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:27.509842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e90f38df-52c6-4554-8a9c-a2b7f3367d0f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:27.512903 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e90f38df-52c6-4554-8a9c-a2b7f3367d0f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:27.572236 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:02:27.572912 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5812b506-a5af-431e-9b08-e3b0ca12e49a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:27.586231 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5812b506-a5af-431e-9b08-e3b0ca12e49a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1511 microversion: 2.1 time: 0.384940 Sep 17 21:02:27.588523 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1572/3070] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:27 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1511 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:02:27.609145 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1bc20282-c876-4820-812e-d44df3662ae0 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a41f2f70>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:27.652920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e90f38df-52c6-4554-8a9c-a2b7f3367d0f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:27.666314 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e90f38df-52c6-4554-8a9c-a2b7f3367d0f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:27.671500 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e90f38df-52c6-4554-8a9c-a2b7f3367d0f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:27.690136 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1bc20282-c876-4820-812e-d44df3662ae0 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29" status: 200 len: 1453 microversion: 2.1 time: 0.085098 Sep 17 21:02:27.690729 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1573/3071] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:27 2022] GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29 => generated 1453 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:02:27.694895 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e90f38df-52c6-4554-8a9c-a2b7f3367d0f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1537 microversion: 2.91 time: 0.217187 Sep 17 21:02:27.695785 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1499/3072] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:27 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1537 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:02:28.760159 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5188844c-b2cf-4dbf-91ea-3e70b31ff7a9 tempest-MultipleCreateNegativeTestJSON-414781294 tempest-MultipleCreateNegativeTestJSON-414781294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-975420107", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:28.763587 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-5188844c-b2cf-4dbf-91ea-3e70b31ff7a9 tempest-MultipleCreateNegativeTestJSON-414781294 tempest-MultipleCreateNegativeTestJSON-414781294-project] HTTP exception thrown: min_count must be <= max_count Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5188844c-b2cf-4dbf-91ea-3e70b31ff7a9 tempest-MultipleCreateNegativeTestJSON-414781294 tempest-MultipleCreateNegativeTestJSON-414781294-project] Request method failure captured: Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 183 Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjXjFLAf38j88cw0Vi1vMU5RTbQclSarX9qCd1AZJe2-vssbAtmX2lltK-f07iuX7Jdzdjy5r81NY_wLPL3JlWL99owbyFkcYdXbxBlPGz5J6aLMYahpSgNcEvRGrK83QyKdIJE4G00asI_naE-4XBFCM4h40t4LShaSsDZ3L0AydmM Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 985f1a6b63a1461ebf46b655825d90a3 Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-414781294 Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/985f1a6b63a1461ebf46b655825d90a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/985f1a6b63a1461ebf46b655825d90a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/985f1a6b63a1461ebf46b655825d90a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_985f1a6b63a1461ebf46b655825d90a3", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-414781294 Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 985f1a6b63a1461ebf46b655825d90a3 Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-414781294 Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-MultipleCreateNegativeTestJSON-414781294-project Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 742e9cf3a45c4c2c9a5a315122c8a6d5 Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-414781294-project Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-975420107", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "min_count": 3, "max_count": 2}} Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: exception: min_count must be <= max_count Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-975420107', 'imageRef': '1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Sep 17 21:02:28.766486 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:28.782714 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5188844c-b2cf-4dbf-91ea-3e70b31ff7a9 tempest-MultipleCreateNegativeTestJSON-414781294 tempest-MultipleCreateNegativeTestJSON-414781294-project] Returning 400 to user: min_count must be <= max_count {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:28.782714 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5188844c-b2cf-4dbf-91ea-3e70b31ff7a9 tempest-MultipleCreateNegativeTestJSON-414781294 tempest-MultipleCreateNegativeTestJSON-414781294-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.519991 Sep 17 21:02:28.782714 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1574/3073] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:02:28 2022] POST /compute/v2.1/servers => generated 74 bytes in 525 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 17 21:02:28.784925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3afc8934-5426-416a-a257-17c78aad398a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:28.785578 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3afc8934-5426-416a-a257-17c78aad398a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:28.804602 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3afc8934-5426-416a-a257-17c78aad398a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:28.805120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3afc8934-5426-416a-a257-17c78aad398a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:28.805899 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3afc8934-5426-416a-a257-17c78aad398a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:28.806324 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3afc8934-5426-416a-a257-17c78aad398a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:28.806786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3afc8934-5426-416a-a257-17c78aad398a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:28.807221 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3afc8934-5426-416a-a257-17c78aad398a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:28.877987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7c8287ea-f484-4e1c-b789-d145eea0cdc8 tempest-AbsoluteLimitsTestJSON-1353184985 tempest-AbsoluteLimitsTestJSON-1353184985-project] Calling method '.version_select at 0x7f25a49f3670>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:28.897248 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c8287ea-f484-4e1c-b789-d145eea0cdc8 tempest-AbsoluteLimitsTestJSON-1353184985 tempest-AbsoluteLimitsTestJSON-1353184985-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:28.897822 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c8287ea-f484-4e1c-b789-d145eea0cdc8 tempest-AbsoluteLimitsTestJSON-1353184985 tempest-AbsoluteLimitsTestJSON-1353184985-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:28.898302 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c8287ea-f484-4e1c-b789-d145eea0cdc8 tempest-AbsoluteLimitsTestJSON-1353184985 tempest-AbsoluteLimitsTestJSON-1353184985-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:28.899028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c8287ea-f484-4e1c-b789-d145eea0cdc8 tempest-AbsoluteLimitsTestJSON-1353184985 tempest-AbsoluteLimitsTestJSON-1353184985-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:28.899479 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c8287ea-f484-4e1c-b789-d145eea0cdc8 tempest-AbsoluteLimitsTestJSON-1353184985 tempest-AbsoluteLimitsTestJSON-1353184985-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:28.900086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c8287ea-f484-4e1c-b789-d145eea0cdc8 tempest-AbsoluteLimitsTestJSON-1353184985 tempest-AbsoluteLimitsTestJSON-1353184985-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:28.926644 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7c8287ea-f484-4e1c-b789-d145eea0cdc8 tempest-AbsoluteLimitsTestJSON-1353184985 tempest-AbsoluteLimitsTestJSON-1353184985-project] 10.222.0.26 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.432995 Sep 17 21:02:28.928502 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1500/3074] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 17 21:02:28 2022] GET /compute/v2.1/limits => generated 511 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:02:29.023154 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3afc8934-5426-416a-a257-17c78aad398a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:29.037491 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3afc8934-5426-416a-a257-17c78aad398a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1511 microversion: 2.1 time: 0.256701 Sep 17 21:02:29.039077 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1575/3075] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:28 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1511 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:29.045594 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4ef83a56-6ae0-4009-935d-e3977c48926a tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a42650d0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:29.097516 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4ef83a56-6ae0-4009-935d-e3977c48926a tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29" status: 200 len: 1453 microversion: 2.1 time: 0.056539 Sep 17 21:02:29.098279 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1576/3076] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:29 2022] GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29 => generated 1453 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:29.112188 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-17341a9c-957d-4b8f-a0fa-1fa945c9b604 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:29.113232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-17341a9c-957d-4b8f-a0fa-1fa945c9b604 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:29.121024 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17341a9c-957d-4b8f-a0fa-1fa945c9b604 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:29.121809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17341a9c-957d-4b8f-a0fa-1fa945c9b604 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:29.122496 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17341a9c-957d-4b8f-a0fa-1fa945c9b604 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:29.123370 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17341a9c-957d-4b8f-a0fa-1fa945c9b604 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:29.124026 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17341a9c-957d-4b8f-a0fa-1fa945c9b604 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:29.124608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17341a9c-957d-4b8f-a0fa-1fa945c9b604 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:29.233876 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-17341a9c-957d-4b8f-a0fa-1fa945c9b604 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:29.247578 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-17341a9c-957d-4b8f-a0fa-1fa945c9b604 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:29.249400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-17341a9c-957d-4b8f-a0fa-1fa945c9b604 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:29.255043 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-17341a9c-957d-4b8f-a0fa-1fa945c9b604 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1537 microversion: 2.91 time: 0.147974 Sep 17 21:02:29.256358 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1577/3077] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:29 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1537 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:29.277095 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0451f240-f8fb-42ac-a000-c952206d0acf tempest-MultipleCreateNegativeTestJSON-414781294 tempest-MultipleCreateNegativeTestJSON-414781294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1984423470", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "max_count": 0}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0451f240-f8fb-42ac-a000-c952206d0acf tempest-MultipleCreateNegativeTestJSON-414781294 tempest-MultipleCreateNegativeTestJSON-414781294-project] Request method failure captured: Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 168 Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjXjFLAf38j88cw0Vi1vMU5RTbQclSarX9qCd1AZJe2-vssbAtmX2lltK-f07iuX7Jdzdjy5r81NY_wLPL3JlWL99owbyFkcYdXbxBlPGz5J6aLMYahpSgNcEvRGrK83QyKdIJE4G00asI_naE-4XBFCM4h40t4LShaSsDZ3L0AydmM Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 985f1a6b63a1461ebf46b655825d90a3 Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-414781294 Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/985f1a6b63a1461ebf46b655825d90a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/985f1a6b63a1461ebf46b655825d90a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/985f1a6b63a1461ebf46b655825d90a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_985f1a6b63a1461ebf46b655825d90a3", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-414781294 Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 985f1a6b63a1461ebf46b655825d90a3 Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-414781294 Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-MultipleCreateNegativeTestJSON-414781294-project Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 742e9cf3a45c4c2c9a5a315122c8a6d5 Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-414781294-project Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1984423470", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "max_count": 0}} Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1984423470', 'imageRef': '1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4', 'flavorRef': '452', 'max_count': 0}}} Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise error Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 0 Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 21:02:29.288327 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 21:02:29.292618 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 21:02:29.292618 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 21:02:29.292618 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 21:02:29.292618 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 21:02:29.292618 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 17 21:02:29.292618 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.292618 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:29.292618 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.292618 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:29.292618 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:29.292618 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:29.292618 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 21:02:29.292618 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 21:02:29.292618 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 17 21:02:29.292618 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.292618 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0451f240-f8fb-42ac-a000-c952206d0acf tempest-MultipleCreateNegativeTestJSON-414781294 tempest-MultipleCreateNegativeTestJSON-414781294-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:29.292618 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0451f240-f8fb-42ac-a000-c952206d0acf tempest-MultipleCreateNegativeTestJSON-414781294 tempest-MultipleCreateNegativeTestJSON-414781294-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.032175 Sep 17 21:02:29.292618 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1578/3078] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:02:29 2022] POST /compute/v2.1/servers => generated 130 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:02:29.531074 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9eb2495e-cfbd-4c6e-baed-4a0e284a393f tempest-ImagesDeleteNegativeTestJSON-43028277 tempest-ImagesDeleteNegativeTestJSON-43028277-project] 10.222.0.26 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.600483 Sep 17 21:02:29.531751 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1501/3079] 10.222.0.26 () {58 vars in 1128 bytes} [Sat Sep 17 21:02:28 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 603 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 17 21:02:29.550422 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-24e66513-73ee-4f3a-828c-fdbbad0b201c tempest-ImagesDeleteNegativeTestJSON-43028277 tempest-ImagesDeleteNegativeTestJSON-43028277-project] Calling method '.version_select at 0x7f25a41f90d0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:29.573096 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d0e50604-2b43-4b22-b3ab-4a5966b70389 tempest-MultipleCreateNegativeTestJSON-414781294 tempest-MultipleCreateNegativeTestJSON-414781294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1064133175", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "max_count": 2.5}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d0e50604-2b43-4b22-b3ab-4a5966b70389 tempest-MultipleCreateNegativeTestJSON-414781294 tempest-MultipleCreateNegativeTestJSON-414781294-project] Request method failure captured: Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 170 Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjXjFLAf38j88cw0Vi1vMU5RTbQclSarX9qCd1AZJe2-vssbAtmX2lltK-f07iuX7Jdzdjy5r81NY_wLPL3JlWL99owbyFkcYdXbxBlPGz5J6aLMYahpSgNcEvRGrK83QyKdIJE4G00asI_naE-4XBFCM4h40t4LShaSsDZ3L0AydmM Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 985f1a6b63a1461ebf46b655825d90a3 Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-414781294 Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/985f1a6b63a1461ebf46b655825d90a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/985f1a6b63a1461ebf46b655825d90a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/985f1a6b63a1461ebf46b655825d90a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_985f1a6b63a1461ebf46b655825d90a3", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-414781294 Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 985f1a6b63a1461ebf46b655825d90a3 Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-414781294 Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-MultipleCreateNegativeTestJSON-414781294-project Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 742e9cf3a45c4c2c9a5a315122c8a6d5 Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-414781294-project Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1064133175", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "max_count": 2.5}} Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1064133175', 'imageRef': '1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4', 'flavorRef': '452', 'max_count': 2.5}}} Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise error Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi 2.5 Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 21:02:29.578301 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 21:02:29.582756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 21:02:29.582756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 21:02:29.582756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 21:02:29.582756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 21:02:29.582756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 17 21:02:29.582756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.582756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:29.582756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.582756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:29.582756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:29.582756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:29.582756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 21:02:29.582756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 21:02:29.582756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 17 21:02:29.582756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-24e66513-73ee-4f3a-828c-fdbbad0b201c tempest-ImagesDeleteNegativeTestJSON-43028277 tempest-ImagesDeleteNegativeTestJSON-43028277-project] HTTP exception thrown: Image not found. Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-24e66513-73ee-4f3a-828c-fdbbad0b201c tempest-ImagesDeleteNegativeTestJSON-43028277 tempest-ImagesDeleteNegativeTestJSON-43028277-project] Request method failure captured: Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjXkk-sIv3rcYRQ8Zkm9Vqyczo1mcUY3gi5UInUl8LE-m-sO9mYTK2P_nszCUHoeqWjI14SRxcjD27IfTZiNx2qpBA80dsO1aiHq8y-TYFnlbA8VOeOnGt0DmTZpnZBn2w3pz6MDnbBDXdIS8bVKRtPUaP4Hhzz5eMsN83SqkoJJjXc Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: a46b32cda9764580a17254358cda6f27 Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-43028277 Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a46b32cda9764580a17254358cda6f27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a46b32cda9764580a17254358cda6f27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a46b32cda9764580a17254358cda6f27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a46b32cda9764580a17254358cda6f27", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-43028277 Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: a46b32cda9764580a17254358cda6f27 Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-43028277 Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ImagesDeleteNegativeTestJSON-43028277-project Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: d91dcfd497a94654ad913f11d302ae49 Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-43028277-project Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: exception: Image not found. Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '-1'} Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Sep 17 21:02:29.583668 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.597272 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:29.597272 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.597272 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:29.597272 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:29.597272 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:29.597272 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:29.597272 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:29.597272 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:02:29.597272 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:02:29.597272 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:29.597272 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:29.597272 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 17 21:02:29.597272 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 17 21:02:29.597272 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 17 21:02:29.597272 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.597272 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:29.597272 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.597272 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:29.597272 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:29.597272 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:29.597272 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:29.597272 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:29.597272 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 17 21:02:29.597272 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.597272 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-24e66513-73ee-4f3a-828c-fdbbad0b201c tempest-ImagesDeleteNegativeTestJSON-43028277 tempest-ImagesDeleteNegativeTestJSON-43028277-project] Returning 404 to user: Image not found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:29.597272 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-24e66513-73ee-4f3a-828c-fdbbad0b201c tempest-ImagesDeleteNegativeTestJSON-43028277 tempest-ImagesDeleteNegativeTestJSON-43028277-project] 10.222.0.26 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.046832 Sep 17 21:02:29.597272 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1579/3080] 10.222.0.26 () {58 vars in 1134 bytes} [Sat Sep 17 21:02:29 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 21:02:29.601175 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6cb4c80f-aa0f-4978-ab36-c7eedd4b564f tempest-ImagesDeleteNegativeTestJSON-43028277 tempest-ImagesDeleteNegativeTestJSON-43028277-project] Calling method '.version_select at 0x7f25a4211f70>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:29.602436 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d0e50604-2b43-4b22-b3ab-4a5966b70389 tempest-MultipleCreateNegativeTestJSON-414781294 tempest-MultipleCreateNegativeTestJSON-414781294-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:29.604021 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d0e50604-2b43-4b22-b3ab-4a5966b70389 tempest-MultipleCreateNegativeTestJSON-414781294 tempest-MultipleCreateNegativeTestJSON-414781294-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.035995 Sep 17 21:02:29.616482 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1502/3081] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:02:29 2022] POST /compute/v2.1/servers => generated 139 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:02:29.638989 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-6cb4c80f-aa0f-4978-ab36-c7eedd4b564f tempest-ImagesDeleteNegativeTestJSON-43028277 tempest-ImagesDeleteNegativeTestJSON-43028277-project] HTTP exception thrown: Image not found. Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6cb4c80f-aa0f-4978-ab36-c7eedd4b564f tempest-ImagesDeleteNegativeTestJSON-43028277 tempest-ImagesDeleteNegativeTestJSON-43028277-project] Request method failure captured: Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/images/a364e492-84e0-40c5-8c23-e18f1e0cfcej HTTP/1.1 Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjXkk-sIv3rcYRQ8Zkm9Vqyczo1mcUY3gi5UInUl8LE-m-sO9mYTK2P_nszCUHoeqWjI14SRxcjD27IfTZiNx2qpBA80dsO1aiHq8y-TYFnlbA8VOeOnGt0DmTZpnZBn2w3pz6MDnbBDXdIS8bVKRtPUaP4Hhzz5eMsN83SqkoJJjXc Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: a46b32cda9764580a17254358cda6f27 Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-43028277 Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a46b32cda9764580a17254358cda6f27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a46b32cda9764580a17254358cda6f27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a46b32cda9764580a17254358cda6f27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a46b32cda9764580a17254358cda6f27", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-43028277 Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: a46b32cda9764580a17254358cda6f27 Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-43028277 Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ImagesDeleteNegativeTestJSON-43028277-project Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: d91dcfd497a94654ad913f11d302ae49 Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-43028277-project Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: exception: Image not found. Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'a364e492-84e0-40c5-8c23-e18f1e0cfcej'} Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a364e492-84e0-40c5-8c23-e18f1e0cfcej to delete Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a364e492-84e0-40c5-8c23-e18f1e0cfcej could not be found. Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:29.642685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.647066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:29.647066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:29.647066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:29.647066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:29.647066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:29.647066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:02:29.647066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:02:29.647066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:29.647066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:29.647066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 17 21:02:29.647066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 17 21:02:29.647066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 17 21:02:29.647066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.647066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:29.647066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.647066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:29.647066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:29.647066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:29.647066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:29.647066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:29.647066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 17 21:02:29.647066 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.651937 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6cb4c80f-aa0f-4978-ab36-c7eedd4b564f tempest-ImagesDeleteNegativeTestJSON-43028277 tempest-ImagesDeleteNegativeTestJSON-43028277-project] Returning 404 to user: Image not found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:29.653007 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6cb4c80f-aa0f-4978-ab36-c7eedd4b564f tempest-ImagesDeleteNegativeTestJSON-43028277 tempest-ImagesDeleteNegativeTestJSON-43028277-project] 10.222.0.26 "DELETE /compute/v2.1/images/a364e492-84e0-40c5-8c23-e18f1e0cfcej" status: 404 len: 62 microversion: 2.1 time: 0.062135 Sep 17 21:02:29.659872 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1580/3082] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:29 2022] DELETE /compute/v2.1/images/a364e492-84e0-40c5-8c23-e18f1e0cfcej => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 21:02:29.665098 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e34609cf-a406-49f6-b5ba-805724e5f149 tempest-ImagesDeleteNegativeTestJSON-43028277 tempest-ImagesDeleteNegativeTestJSON-43028277-project] Calling method '.version_select at 0x7f25a481a310>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:29.699828 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-e34609cf-a406-49f6-b5ba-805724e5f149 tempest-ImagesDeleteNegativeTestJSON-43028277 tempest-ImagesDeleteNegativeTestJSON-43028277-project] HTTP exception thrown: Image not found. Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e34609cf-a406-49f6-b5ba-805724e5f149 tempest-ImagesDeleteNegativeTestJSON-43028277 tempest-ImagesDeleteNegativeTestJSON-43028277-project] Request method failure captured: Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/images/a32e4812-c7c8-4f5f-9b29-607a4c89f0f51 HTTP/1.1 Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjXkk-sIv3rcYRQ8Zkm9Vqyczo1mcUY3gi5UInUl8LE-m-sO9mYTK2P_nszCUHoeqWjI14SRxcjD27IfTZiNx2qpBA80dsO1aiHq8y-TYFnlbA8VOeOnGt0DmTZpnZBn2w3pz6MDnbBDXdIS8bVKRtPUaP4Hhzz5eMsN83SqkoJJjXc Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: a46b32cda9764580a17254358cda6f27 Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-43028277 Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a46b32cda9764580a17254358cda6f27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a46b32cda9764580a17254358cda6f27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a46b32cda9764580a17254358cda6f27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a46b32cda9764580a17254358cda6f27", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-43028277 Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: a46b32cda9764580a17254358cda6f27 Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-43028277 Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ImagesDeleteNegativeTestJSON-43028277-project Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: d91dcfd497a94654ad913f11d302ae49 Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-43028277-project Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: exception: Image not found. Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'a32e4812-c7c8-4f5f-9b29-607a4c89f0f51'} Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a32e4812-c7c8-4f5f-9b29-607a4c89f0f51 to delete Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a32e4812-c7c8-4f5f-9b29-607a4c89f0f51 could not be found. Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:29.702717 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.707417 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:29.707417 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:29.707417 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:29.707417 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:29.707417 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:29.707417 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:02:29.707417 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:02:29.707417 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:29.707417 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:29.707417 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 17 21:02:29.707417 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 17 21:02:29.707417 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 17 21:02:29.707417 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.707417 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:29.707417 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.707417 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:29.707417 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:29.707417 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:29.707417 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:29.707417 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:29.707417 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 17 21:02:29.707417 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.707417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e34609cf-a406-49f6-b5ba-805724e5f149 tempest-ImagesDeleteNegativeTestJSON-43028277 tempest-ImagesDeleteNegativeTestJSON-43028277-project] Returning 404 to user: Image not found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:29.707417 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e34609cf-a406-49f6-b5ba-805724e5f149 tempest-ImagesDeleteNegativeTestJSON-43028277 tempest-ImagesDeleteNegativeTestJSON-43028277-project] 10.222.0.26 "DELETE /compute/v2.1/images/a32e4812-c7c8-4f5f-9b29-607a4c89f0f51" status: 404 len: 62 microversion: 2.1 time: 0.044719 Sep 17 21:02:29.707417 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1503/3083] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:02:29 2022] DELETE /compute/v2.1/images/a32e4812-c7c8-4f5f-9b29-607a4c89f0f51 => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 21:02:29.727853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c033b076-30a9-43db-a91a-6b55d58bdff2 tempest-MultipleCreateNegativeTestJSON-414781294 tempest-MultipleCreateNegativeTestJSON-414781294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1493898507", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "min_count": 0}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:29.728670 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0ab83bf1-dd19-4e01-98f0-5e8d613dec9e tempest-ImagesDeleteNegativeTestJSON-43028277 tempest-ImagesDeleteNegativeTestJSON-43028277-project] Calling method '.version_select at 0x7f25a42f5820>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c033b076-30a9-43db-a91a-6b55d58bdff2 tempest-MultipleCreateNegativeTestJSON-414781294 tempest-MultipleCreateNegativeTestJSON-414781294-project] Request method failure captured: Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 168 Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjXjFLAf38j88cw0Vi1vMU5RTbQclSarX9qCd1AZJe2-vssbAtmX2lltK-f07iuX7Jdzdjy5r81NY_wLPL3JlWL99owbyFkcYdXbxBlPGz5J6aLMYahpSgNcEvRGrK83QyKdIJE4G00asI_naE-4XBFCM4h40t4LShaSsDZ3L0AydmM Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 985f1a6b63a1461ebf46b655825d90a3 Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-414781294 Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/985f1a6b63a1461ebf46b655825d90a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/985f1a6b63a1461ebf46b655825d90a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/985f1a6b63a1461ebf46b655825d90a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_985f1a6b63a1461ebf46b655825d90a3", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-414781294 Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 985f1a6b63a1461ebf46b655825d90a3 Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-414781294 Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-MultipleCreateNegativeTestJSON-414781294-project Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 742e9cf3a45c4c2c9a5a315122c8a6d5 Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-414781294-project Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1493898507", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "min_count": 0}} Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1493898507', 'imageRef': '1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4', 'flavorRef': '452', 'min_count': 0}}} Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise error Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi 0 Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 21:02:29.739497 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 21:02:29.744002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 21:02:29.744002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 21:02:29.744002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 21:02:29.744002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 21:02:29.744002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 17 21:02:29.744002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.744002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:29.744002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.744002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:29.744002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:29.744002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:29.744002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 21:02:29.744002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 21:02:29.744002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 17 21:02:29.744002 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.744002 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c033b076-30a9-43db-a91a-6b55d58bdff2 tempest-MultipleCreateNegativeTestJSON-414781294 tempest-MultipleCreateNegativeTestJSON-414781294-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:29.752217 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c033b076-30a9-43db-a91a-6b55d58bdff2 tempest-MultipleCreateNegativeTestJSON-414781294 tempest-MultipleCreateNegativeTestJSON-414781294-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.018705 Sep 17 21:02:29.754675 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1504/3084] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:02:29 2022] POST /compute/v2.1/servers => generated 130 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:02:29.765118 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-0ab83bf1-dd19-4e01-98f0-5e8d613dec9e tempest-ImagesDeleteNegativeTestJSON-43028277 tempest-ImagesDeleteNegativeTestJSON-43028277-project] HTTP exception thrown: Image not found. Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0ab83bf1-dd19-4e01-98f0-5e8d613dec9e tempest-ImagesDeleteNegativeTestJSON-43028277 tempest-ImagesDeleteNegativeTestJSON-43028277-project] Request method failure captured: Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/images/tempest-invalid-2078641113 HTTP/1.1 Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjXkk-sIv3rcYRQ8Zkm9Vqyczo1mcUY3gi5UInUl8LE-m-sO9mYTK2P_nszCUHoeqWjI14SRxcjD27IfTZiNx2qpBA80dsO1aiHq8y-TYFnlbA8VOeOnGt0DmTZpnZBn2w3pz6MDnbBDXdIS8bVKRtPUaP4Hhzz5eMsN83SqkoJJjXc Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: a46b32cda9764580a17254358cda6f27 Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-43028277 Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a46b32cda9764580a17254358cda6f27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a46b32cda9764580a17254358cda6f27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a46b32cda9764580a17254358cda6f27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a46b32cda9764580a17254358cda6f27", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-43028277 Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: a46b32cda9764580a17254358cda6f27 Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-43028277 Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ImagesDeleteNegativeTestJSON-43028277-project Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: d91dcfd497a94654ad913f11d302ae49 Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-43028277-project Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: exception: Image not found. Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'tempest-invalid-2078641113'} Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-2078641113 to delete Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-2078641113 could not be found. Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.766970 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:29.772061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:29.772061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:29.772061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:29.772061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:29.772061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:02:29.772061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:02:29.772061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:29.772061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:29.772061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 17 21:02:29.772061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 17 21:02:29.772061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 17 21:02:29.772061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.772061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:29.772061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.772061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:29.772061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:29.772061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:29.772061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:29.772061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:29.772061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 17 21:02:29.772061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.772061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0ab83bf1-dd19-4e01-98f0-5e8d613dec9e tempest-ImagesDeleteNegativeTestJSON-43028277 tempest-ImagesDeleteNegativeTestJSON-43028277-project] Returning 404 to user: Image not found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:29.772061 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0ab83bf1-dd19-4e01-98f0-5e8d613dec9e tempest-ImagesDeleteNegativeTestJSON-43028277 tempest-ImagesDeleteNegativeTestJSON-43028277-project] 10.222.0.26 "DELETE /compute/v2.1/images/tempest-invalid-2078641113" status: 404 len: 62 microversion: 2.1 time: 0.056830 Sep 17 21:02:29.772061 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1581/3085] 10.222.0.26 () {58 vars in 1206 bytes} [Sat Sep 17 21:02:29 2022] DELETE /compute/v2.1/images/tempest-invalid-2078641113 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 21:02:29.780003 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-63c57d1e-b397-4a3e-9418-7634080e1887 tempest-ImagesDeleteNegativeTestJSON-43028277 tempest-ImagesDeleteNegativeTestJSON-43028277-project] Calling method '.version_select at 0x7f25a49de1f0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:29.809690 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-63c57d1e-b397-4a3e-9418-7634080e1887 tempest-ImagesDeleteNegativeTestJSON-43028277 tempest-ImagesDeleteNegativeTestJSON-43028277-project] HTTP exception thrown: Image not found. Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-63c57d1e-b397-4a3e-9418-7634080e1887 tempest-ImagesDeleteNegativeTestJSON-43028277 tempest-ImagesDeleteNegativeTestJSON-43028277-project] Request method failure captured: Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/images/d60f64ab-c216-45e0-8582-c78b4affb90c HTTP/1.1 Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjXkk-sIv3rcYRQ8Zkm9Vqyczo1mcUY3gi5UInUl8LE-m-sO9mYTK2P_nszCUHoeqWjI14SRxcjD27IfTZiNx2qpBA80dsO1aiHq8y-TYFnlbA8VOeOnGt0DmTZpnZBn2w3pz6MDnbBDXdIS8bVKRtPUaP4Hhzz5eMsN83SqkoJJjXc Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: a46b32cda9764580a17254358cda6f27 Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-43028277 Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a46b32cda9764580a17254358cda6f27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a46b32cda9764580a17254358cda6f27"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a46b32cda9764580a17254358cda6f27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a46b32cda9764580a17254358cda6f27", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-43028277 Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: a46b32cda9764580a17254358cda6f27 Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-43028277 Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ImagesDeleteNegativeTestJSON-43028277-project Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: d91dcfd497a94654ad913f11d302ae49 Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-43028277-project Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: exception: Image not found. Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'd60f64ab-c216-45e0-8582-c78b4affb90c'} Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d60f64ab-c216-45e0-8582-c78b4affb90c to delete Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d60f64ab-c216-45e0-8582-c78b4affb90c could not be found. Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:29.811771 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.816874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:29.816874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:29.816874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:29.816874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:29.816874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:29.816874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:02:29.816874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:02:29.816874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:29.816874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:29.816874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 17 21:02:29.816874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 17 21:02:29.816874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 17 21:02:29.816874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.816874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:29.816874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.816874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:29.816874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:29.816874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:29.816874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:29.816874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:29.816874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 17 21:02:29.816874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:02:29.819701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-63c57d1e-b397-4a3e-9418-7634080e1887 tempest-ImagesDeleteNegativeTestJSON-43028277 tempest-ImagesDeleteNegativeTestJSON-43028277-project] Returning 404 to user: Image not found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:29.820779 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-63c57d1e-b397-4a3e-9418-7634080e1887 tempest-ImagesDeleteNegativeTestJSON-43028277 tempest-ImagesDeleteNegativeTestJSON-43028277-project] 10.222.0.26 "DELETE /compute/v2.1/images/d60f64ab-c216-45e0-8582-c78b4affb90c" status: 404 len: 62 microversion: 2.1 time: 0.045627 Sep 17 21:02:29.822033 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1505/3086] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:29 2022] DELETE /compute/v2.1/images/d60f64ab-c216-45e0-8582-c78b4affb90c => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 21:02:30.006416 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2f3e060c-6d39-4b23-b9d8-524fa0e0b62e tempest-MultipleCreateNegativeTestJSON-414781294 tempest-MultipleCreateNegativeTestJSON-414781294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1148405551", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "min_count": 2.5}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2f3e060c-6d39-4b23-b9d8-524fa0e0b62e tempest-MultipleCreateNegativeTestJSON-414781294 tempest-MultipleCreateNegativeTestJSON-414781294-project] Request method failure captured: Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 170 Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjXjFLAf38j88cw0Vi1vMU5RTbQclSarX9qCd1AZJe2-vssbAtmX2lltK-f07iuX7Jdzdjy5r81NY_wLPL3JlWL99owbyFkcYdXbxBlPGz5J6aLMYahpSgNcEvRGrK83QyKdIJE4G00asI_naE-4XBFCM4h40t4LShaSsDZ3L0AydmM Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 985f1a6b63a1461ebf46b655825d90a3 Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-414781294 Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/985f1a6b63a1461ebf46b655825d90a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/985f1a6b63a1461ebf46b655825d90a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/985f1a6b63a1461ebf46b655825d90a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_985f1a6b63a1461ebf46b655825d90a3", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-414781294 Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 985f1a6b63a1461ebf46b655825d90a3 Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-414781294 Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-MultipleCreateNegativeTestJSON-414781294-project Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 742e9cf3a45c4c2c9a5a315122c8a6d5 Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-414781294-project Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1148405551", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "min_count": 2.5}} Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1148405551', 'imageRef': '1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4', 'flavorRef': '452', 'min_count': 2.5}}} Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise error Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 2.5 Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 21:02:30.028406 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 21:02:30.033203 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 21:02:30.033203 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 21:02:30.033203 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 21:02:30.033203 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 21:02:30.033203 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 17 21:02:30.033203 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:30.033203 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:30.033203 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:30.033203 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:30.033203 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:30.033203 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:30.033203 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 21:02:30.033203 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 21:02:30.033203 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 17 21:02:30.033203 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:30.033203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2f3e060c-6d39-4b23-b9d8-524fa0e0b62e tempest-MultipleCreateNegativeTestJSON-414781294 tempest-MultipleCreateNegativeTestJSON-414781294-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:30.033203 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2f3e060c-6d39-4b23-b9d8-524fa0e0b62e tempest-MultipleCreateNegativeTestJSON-414781294 tempest-MultipleCreateNegativeTestJSON-414781294-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.048343 Sep 17 21:02:30.038227 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1582/3087] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:02:29 2022] POST /compute/v2.1/servers => generated 139 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 17 21:02:30.078384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-97eaffa5-d57c-421a-82f3-71f824e06b3d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:30.079156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-97eaffa5-d57c-421a-82f3-71f824e06b3d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:30.100796 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-97eaffa5-d57c-421a-82f3-71f824e06b3d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:30.101388 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-97eaffa5-d57c-421a-82f3-71f824e06b3d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:30.101881 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-97eaffa5-d57c-421a-82f3-71f824e06b3d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:30.102634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-97eaffa5-d57c-421a-82f3-71f824e06b3d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:30.103104 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-97eaffa5-d57c-421a-82f3-71f824e06b3d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:30.108596 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-97eaffa5-d57c-421a-82f3-71f824e06b3d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:30.167010 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-488c364a-793a-4069-afe0-9c80feaf359c tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a41e6280>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:30.261243 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-488c364a-793a-4069-afe0-9c80feaf359c tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29" status: 200 len: 1453 microversion: 2.1 time: 0.127636 Sep 17 21:02:30.261902 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1583/3088] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:30 2022] GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29 => generated 1453 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:30.285526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-aafdccbd-c121-4016-8af0-0490e232c9ef tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:30.286198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-aafdccbd-c121-4016-8af0-0490e232c9ef tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:30.298385 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aafdccbd-c121-4016-8af0-0490e232c9ef tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:30.299831 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aafdccbd-c121-4016-8af0-0490e232c9ef tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:30.301964 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aafdccbd-c121-4016-8af0-0490e232c9ef tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:30.303761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aafdccbd-c121-4016-8af0-0490e232c9ef tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:30.304567 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aafdccbd-c121-4016-8af0-0490e232c9ef tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:30.305650 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aafdccbd-c121-4016-8af0-0490e232c9ef tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:30.500108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-aafdccbd-c121-4016-8af0-0490e232c9ef tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:30.516412 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-aafdccbd-c121-4016-8af0-0490e232c9ef tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:30.532280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-aafdccbd-c121-4016-8af0-0490e232c9ef tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:30.551260 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-97eaffa5-d57c-421a-82f3-71f824e06b3d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:30.566386 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-97eaffa5-d57c-421a-82f3-71f824e06b3d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1511 microversion: 2.1 time: 0.503883 Sep 17 21:02:30.567282 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1506/3089] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:30 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1511 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:30.567509 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-aafdccbd-c121-4016-8af0-0490e232c9ef tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1537 microversion: 2.91 time: 0.280206 Sep 17 21:02:30.583208 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1584/3090] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:30 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1537 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:31.277161 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cf1664eb-0951-4223-88aa-e80b36f0b1af tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a510b550>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:31.373541 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cf1664eb-0951-4223-88aa-e80b36f0b1af tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29" status: 200 len: 1453 microversion: 2.1 time: 0.096838 Sep 17 21:02:31.378155 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1507/3091] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:31 2022] GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29 => generated 1453 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:31.596839 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d983d44a-bd3f-4152-a68b-e6112c9af4a8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:31.598002 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d983d44a-bd3f-4152-a68b-e6112c9af4a8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:31.607815 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5370fffa-1c0e-4f08-b201-706197c24b47 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:31.611963 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d983d44a-bd3f-4152-a68b-e6112c9af4a8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:31.611963 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d983d44a-bd3f-4152-a68b-e6112c9af4a8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:31.614913 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5370fffa-1c0e-4f08-b201-706197c24b47 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:31.616425 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d983d44a-bd3f-4152-a68b-e6112c9af4a8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:31.617793 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d983d44a-bd3f-4152-a68b-e6112c9af4a8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:31.618334 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d983d44a-bd3f-4152-a68b-e6112c9af4a8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:31.618821 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d983d44a-bd3f-4152-a68b-e6112c9af4a8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:31.631173 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5370fffa-1c0e-4f08-b201-706197c24b47 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:31.634919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5370fffa-1c0e-4f08-b201-706197c24b47 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:31.635637 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5370fffa-1c0e-4f08-b201-706197c24b47 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:31.640799 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5370fffa-1c0e-4f08-b201-706197c24b47 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:31.643893 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5370fffa-1c0e-4f08-b201-706197c24b47 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:31.645582 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5370fffa-1c0e-4f08-b201-706197c24b47 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:31.837537 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5370fffa-1c0e-4f08-b201-706197c24b47 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:31.847164 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5370fffa-1c0e-4f08-b201-706197c24b47 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:31.853902 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5370fffa-1c0e-4f08-b201-706197c24b47 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:31.864320 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5370fffa-1c0e-4f08-b201-706197c24b47 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1558 microversion: 2.91 time: 0.263620 Sep 17 21:02:31.888298 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1508/3092] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:31 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1558 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:02:31.889484 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=4 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:02:32.010954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d983d44a-bd3f-4152-a68b-e6112c9af4a8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:32.025744 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d983d44a-bd3f-4152-a68b-e6112c9af4a8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1511 microversion: 2.1 time: 0.435796 Sep 17 21:02:32.042020 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1585/3093] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:31 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1511 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:32.393372 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c4fc0f5b-238a-42c7-ad42-54f05670e096 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a510b550>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:32.481354 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c4fc0f5b-238a-42c7-ad42-54f05670e096 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29" status: 200 len: 1453 microversion: 2.1 time: 0.094919 Sep 17 21:02:32.489602 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1509/3094] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:32 2022] GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29 => generated 1453 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:32.894870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-afb130b1-eae9-4cca-a90c-ad3ffdb23061 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:32.896122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-afb130b1-eae9-4cca-a90c-ad3ffdb23061 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:32.916891 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-afb130b1-eae9-4cca-a90c-ad3ffdb23061 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:32.919255 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-afb130b1-eae9-4cca-a90c-ad3ffdb23061 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:32.920449 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-afb130b1-eae9-4cca-a90c-ad3ffdb23061 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:32.923298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-afb130b1-eae9-4cca-a90c-ad3ffdb23061 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:32.924113 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-afb130b1-eae9-4cca-a90c-ad3ffdb23061 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:32.926636 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-afb130b1-eae9-4cca-a90c-ad3ffdb23061 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:33.053781 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e07f3d12-d2c8-471e-86fb-3acdeed2446a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:33.054476 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e07f3d12-d2c8-471e-86fb-3acdeed2446a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:33.074792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e07f3d12-d2c8-471e-86fb-3acdeed2446a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:33.077912 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e07f3d12-d2c8-471e-86fb-3acdeed2446a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:33.078988 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e07f3d12-d2c8-471e-86fb-3acdeed2446a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:33.085782 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e07f3d12-d2c8-471e-86fb-3acdeed2446a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:33.086188 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e07f3d12-d2c8-471e-86fb-3acdeed2446a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:33.086648 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e07f3d12-d2c8-471e-86fb-3acdeed2446a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:33.098543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-afb130b1-eae9-4cca-a90c-ad3ffdb23061 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:33.113945 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-afb130b1-eae9-4cca-a90c-ad3ffdb23061 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:33.115726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-afb130b1-eae9-4cca-a90c-ad3ffdb23061 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:33.123288 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-afb130b1-eae9-4cca-a90c-ad3ffdb23061 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1553 microversion: 2.91 time: 0.232354 Sep 17 21:02:33.124469 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1586/3095] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:32 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1553 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:02:33.376903 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e07f3d12-d2c8-471e-86fb-3acdeed2446a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:33.385940 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e07f3d12-d2c8-471e-86fb-3acdeed2446a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1511 microversion: 2.1 time: 0.336143 Sep 17 21:02:33.388679 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1510/3096] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:33 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1511 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:33.499707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a7397049-d2cf-46cd-af80-9cb7548493a0 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a41e63a0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:34.158997 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-47f8dc49-9acb-4c27-be1d-813b918356c2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:34.160301 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-47f8dc49-9acb-4c27-be1d-813b918356c2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:34.171599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47f8dc49-9acb-4c27-be1d-813b918356c2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:34.174972 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47f8dc49-9acb-4c27-be1d-813b918356c2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:34.175653 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47f8dc49-9acb-4c27-be1d-813b918356c2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:34.176742 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47f8dc49-9acb-4c27-be1d-813b918356c2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:34.177373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47f8dc49-9acb-4c27-be1d-813b918356c2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:34.183129 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47f8dc49-9acb-4c27-be1d-813b918356c2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:34.410820 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-47f8dc49-9acb-4c27-be1d-813b918356c2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:34.423201 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-47f8dc49-9acb-4c27-be1d-813b918356c2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:34.424689 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-47f8dc49-9acb-4c27-be1d-813b918356c2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:34.443960 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-47f8dc49-9acb-4c27-be1d-813b918356c2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1553 microversion: 2.91 time: 0.292959 Sep 17 21:02:34.447615 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1511/3097] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:34 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1553 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:02:34.453027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-247c2b64-eba4-48a9-933b-3a491c67e97e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:34.460562 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-247c2b64-eba4-48a9-933b-3a491c67e97e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:34.478757 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-247c2b64-eba4-48a9-933b-3a491c67e97e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:34.479560 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-247c2b64-eba4-48a9-933b-3a491c67e97e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:34.480391 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-247c2b64-eba4-48a9-933b-3a491c67e97e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:34.481923 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-247c2b64-eba4-48a9-933b-3a491c67e97e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:34.482621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-247c2b64-eba4-48a9-933b-3a491c67e97e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:34.527339 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-247c2b64-eba4-48a9-933b-3a491c67e97e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.044s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:34.917137 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-247c2b64-eba4-48a9-933b-3a491c67e97e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:34.933028 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-247c2b64-eba4-48a9-933b-3a491c67e97e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1511 microversion: 2.1 time: 0.480666 Sep 17 21:02:34.935433 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1512/3098] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:34 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1511 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:36.030684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a6d2fb71-6c33-4ff4-b7fe-3a463d6dc824 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1946762619", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": "none"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:37.032428 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a7397049-d2cf-46cd-af80-9cb7548493a0 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29" status: 200 len: 1462 microversion: 2.1 time: 3.538649 Sep 17 21:02:37.033027 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1587/3099] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:33 2022] GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29 => generated 1462 bytes in 3541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:37.063045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a6d2fb71-6c33-4ff4-b7fe-3a463d6dc824 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:02:37.064275 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a6d2fb71-6c33-4ff4-b7fe-3a463d6dc824 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:02:37.064913 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a6d2fb71-6c33-4ff4-b7fe-3a463d6dc824 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:02:37.065961 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a6d2fb71-6c33-4ff4-b7fe-3a463d6dc824 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:02:37.066541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a6d2fb71-6c33-4ff4-b7fe-3a463d6dc824 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:02:37.070580 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-10f5d0b4-f4f5-4100-9a2e-22015ad06312 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:37.073680 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-10f5d0b4-f4f5-4100-9a2e-22015ad06312 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:37.100220 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6d2fb71-6c33-4ff4-b7fe-3a463d6dc824 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:37.102485 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6d2fb71-6c33-4ff4-b7fe-3a463d6dc824 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:37.104025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6d2fb71-6c33-4ff4-b7fe-3a463d6dc824 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:37.106161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10f5d0b4-f4f5-4100-9a2e-22015ad06312 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:37.106985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6d2fb71-6c33-4ff4-b7fe-3a463d6dc824 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:37.109885 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6d2fb71-6c33-4ff4-b7fe-3a463d6dc824 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:37.110521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6d2fb71-6c33-4ff4-b7fe-3a463d6dc824 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:37.118904 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10f5d0b4-f4f5-4100-9a2e-22015ad06312 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:37.120446 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10f5d0b4-f4f5-4100-9a2e-22015ad06312 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:37.123339 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10f5d0b4-f4f5-4100-9a2e-22015ad06312 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:37.124040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10f5d0b4-f4f5-4100-9a2e-22015ad06312 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:37.124499 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10f5d0b4-f4f5-4100-9a2e-22015ad06312 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:37.170545 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-a6d2fb71-6c33-4ff4-b7fe-3a463d6dc824 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Getting quotas for project 575b0ac677234f6ba9c5b9715cc02f63. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:02:37.177646 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:02:37.180084 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-a6d2fb71-6c33-4ff4-b7fe-3a463d6dc824 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Getting quotas for user 11f65cdf47c1489f905d517a7a4fdea5 and project 575b0ac677234f6ba9c5b9715cc02f63. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:02:37.209606 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a6d2fb71-6c33-4ff4-b7fe-3a463d6dc824 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:02:37.217328 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a6d2fb71-6c33-4ff4-b7fe-3a463d6dc824 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] [instance: 95e9502b-6c82-4775-bfaf-d9940240eff3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:02:37.340785 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a6d2fb71-6c33-4ff4-b7fe-3a463d6dc824 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 2.224443 Sep 17 21:02:37.342193 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-10f5d0b4-f4f5-4100-9a2e-22015ad06312 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:37.348691 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1513/3100] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Sep 17 21:02:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2233 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 17 21:02:37.363585 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-10f5d0b4-f4f5-4100-9a2e-22015ad06312 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:37.371878 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-10f5d0b4-f4f5-4100-9a2e-22015ad06312 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:37.372150 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-68954cb1-453c-41aa-a644-999dcab0a73b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:37.376127 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-68954cb1-453c-41aa-a644-999dcab0a73b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:37.403889 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-10f5d0b4-f4f5-4100-9a2e-22015ad06312 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1553 microversion: 2.91 time: 0.361561 Sep 17 21:02:37.422163 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68954cb1-453c-41aa-a644-999dcab0a73b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:37.423723 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68954cb1-453c-41aa-a644-999dcab0a73b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:37.425352 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1588/3101] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:37 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1553 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:37.430713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68954cb1-453c-41aa-a644-999dcab0a73b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:37.431021 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8a9ba583-6fd5-4aa1-ae29-12d3ae1c4e0b tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a42131f0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:37.435170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68954cb1-453c-41aa-a644-999dcab0a73b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:37.435810 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68954cb1-453c-41aa-a644-999dcab0a73b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:37.437939 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68954cb1-453c-41aa-a644-999dcab0a73b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:37.549947 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8a9ba583-6fd5-4aa1-ae29-12d3ae1c4e0b tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29" status: 200 len: 1462 microversion: 2.1 time: 0.121789 Sep 17 21:02:37.552429 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1589/3102] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:37 2022] GET /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29 => generated 1462 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:37.572598 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ed50e81c-f394-4281-82e9-79b21341a802 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:37.572832 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ed50e81c-f394-4281-82e9-79b21341a802 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] [instance: 95e9502b-6c82-4775-bfaf-d9940240eff3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:37.957018 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ed50e81c-f394-4281-82e9-79b21341a802 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f65cdf47c1489f905d517a7a4fdea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575b0ac677234f6ba9c5b9715cc02f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:37.977884 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ed50e81c-f394-4281-82e9-79b21341a802 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11f65cdf47c1489f905d517a7a4fdea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575b0ac677234f6ba9c5b9715cc02f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:37.979668 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ed50e81c-f394-4281-82e9-79b21341a802 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11f65cdf47c1489f905d517a7a4fdea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575b0ac677234f6ba9c5b9715cc02f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:37.981084 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ed50e81c-f394-4281-82e9-79b21341a802 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] 10.222.0.26 "GET /compute/v2.1/servers/95e9502b-6c82-4775-bfaf-d9940240eff3" status: 200 len: 1281 microversion: 2.47 time: 0.425377 Sep 17 21:02:37.982141 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1590/3103] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:37 2022] GET /compute/v2.1/servers/95e9502b-6c82-4775-bfaf-d9940240eff3 => generated 1281 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:38.000476 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fdbff72a-8e0b-4d04-8837-d2b81e1fa715 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:38.001351 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fdbff72a-8e0b-4d04-8837-d2b81e1fa715 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 66779798-999a-4a63-98dd-bf7fa71ce4b1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:38.011437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fdbff72a-8e0b-4d04-8837-d2b81e1fa715 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:38.011936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fdbff72a-8e0b-4d04-8837-d2b81e1fa715 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:38.014530 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fdbff72a-8e0b-4d04-8837-d2b81e1fa715 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:38.015330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fdbff72a-8e0b-4d04-8837-d2b81e1fa715 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:38.015820 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fdbff72a-8e0b-4d04-8837-d2b81e1fa715 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:38.019264 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fdbff72a-8e0b-4d04-8837-d2b81e1fa715 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:38.177235 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-68954cb1-453c-41aa-a644-999dcab0a73b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:38.196931 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-68954cb1-453c-41aa-a644-999dcab0a73b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1511 microversion: 2.1 time: 0.840880 Sep 17 21:02:38.201268 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1514/3104] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:37 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1511 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:38.438855 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7a0d3c39-d0e7-4d70-9343-23bd5d72d0e0 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:38.439848 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7a0d3c39-d0e7-4d70-9343-23bd5d72d0e0 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:38.473028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a0d3c39-d0e7-4d70-9343-23bd5d72d0e0 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:38.479817 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a0d3c39-d0e7-4d70-9343-23bd5d72d0e0 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:38.486437 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a0d3c39-d0e7-4d70-9343-23bd5d72d0e0 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:38.487594 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a0d3c39-d0e7-4d70-9343-23bd5d72d0e0 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:38.490583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a0d3c39-d0e7-4d70-9343-23bd5d72d0e0 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:38.492735 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a0d3c39-d0e7-4d70-9343-23bd5d72d0e0 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:38.839994 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7a0d3c39-d0e7-4d70-9343-23bd5d72d0e0 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:38.866782 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7a0d3c39-d0e7-4d70-9343-23bd5d72d0e0 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:38.872546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7a0d3c39-d0e7-4d70-9343-23bd5d72d0e0 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:38.883922 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fdbff72a-8e0b-4d04-8837-d2b81e1fa715 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc9559a966444d98e54edb4f948ae1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d42cba2664646f6adb4202574b7fa5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:38.906503 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fdbff72a-8e0b-4d04-8837-d2b81e1fa715 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1" status: 200 len: 1468 microversion: 2.1 time: 0.921922 Sep 17 21:02:38.922949 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1591/3105] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:37 2022] GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1 => generated 1468 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:38.925182 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7a0d3c39-d0e7-4d70-9343-23bd5d72d0e0 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1553 microversion: 2.91 time: 0.495622 Sep 17 21:02:38.941655 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1515/3106] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:38 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1553 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:38.956813 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6c912822-3d62-41a1-abf8-314f0738d330 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1392913710"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:38.970746 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6c912822-3d62-41a1-abf8-314f0738d330 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:39.007785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6c912822-3d62-41a1-abf8-314f0738d330 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:39.008286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6c912822-3d62-41a1-abf8-314f0738d330 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:39.010515 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6c912822-3d62-41a1-abf8-314f0738d330 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:39.013780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6c912822-3d62-41a1-abf8-314f0738d330 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:39.014162 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-25c47139-e03e-4031-8bd8-99e02292b621 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:39.014934 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-25c47139-e03e-4031-8bd8-99e02292b621 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] [instance: 95e9502b-6c82-4775-bfaf-d9940240eff3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:39.015585 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6c912822-3d62-41a1-abf8-314f0738d330 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:39.016194 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6c912822-3d62-41a1-abf8-314f0738d330 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:39.026027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25c47139-e03e-4031-8bd8-99e02292b621 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:39.030646 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25c47139-e03e-4031-8bd8-99e02292b621 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:39.032554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25c47139-e03e-4031-8bd8-99e02292b621 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:39.033623 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25c47139-e03e-4031-8bd8-99e02292b621 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:39.034493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25c47139-e03e-4031-8bd8-99e02292b621 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:39.037563 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25c47139-e03e-4031-8bd8-99e02292b621 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:39.271352 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-25c47139-e03e-4031-8bd8-99e02292b621 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f65cdf47c1489f905d517a7a4fdea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575b0ac677234f6ba9c5b9715cc02f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:39.289837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-25c47139-e03e-4031-8bd8-99e02292b621 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11f65cdf47c1489f905d517a7a4fdea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575b0ac677234f6ba9c5b9715cc02f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:39.292873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-25c47139-e03e-4031-8bd8-99e02292b621 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11f65cdf47c1489f905d517a7a4fdea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575b0ac677234f6ba9c5b9715cc02f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:39.296841 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-25c47139-e03e-4031-8bd8-99e02292b621 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] 10.222.0.26 "GET /compute/v2.1/servers/95e9502b-6c82-4775-bfaf-d9940240eff3" status: 200 len: 1333 microversion: 2.47 time: 0.287779 Sep 17 21:02:39.299699 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1516/3107] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:39 2022] GET /compute/v2.1/servers/95e9502b-6c82-4775-bfaf-d9940240eff3 => generated 1333 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:39.310010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6e98bf1e-1098-4f6a-9873-ddfbc36fceaf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:39.314772 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6e98bf1e-1098-4f6a-9873-ddfbc36fceaf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:39.331620 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6e98bf1e-1098-4f6a-9873-ddfbc36fceaf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:39.333025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6e98bf1e-1098-4f6a-9873-ddfbc36fceaf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:39.337709 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6e98bf1e-1098-4f6a-9873-ddfbc36fceaf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:39.341518 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6e98bf1e-1098-4f6a-9873-ddfbc36fceaf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:39.342397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6e98bf1e-1098-4f6a-9873-ddfbc36fceaf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:39.343497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6e98bf1e-1098-4f6a-9873-ddfbc36fceaf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:39.614007 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6c912822-3d62-41a1-abf8-314f0738d330 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "POST /compute/v2.1/servers/0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f/action" status: 202 len: 0 microversion: 2.1 time: 0.677172 Sep 17 21:02:39.623036 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1592/3108] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:02:38 2022] POST /compute/v2.1/servers/0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f/action => generated 0 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 17 21:02:39.640421 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e0940fd9-73b7-4523-8250-ad3d5584045c tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a4211940>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:39.778910 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e0940fd9-73b7-4523-8250-ad3d5584045c tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/42ec7c80-ffce-4465-b7b6-d3b416e2913d" status: 200 len: 1453 microversion: 2.1 time: 0.152894 Sep 17 21:02:39.789540 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1593/3109] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:39 2022] GET /compute/v2.1/images/42ec7c80-ffce-4465-b7b6-d3b416e2913d => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:39.983410 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-18f41c55-4a17-4a64-b6de-82106bd194bf tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:39.987181 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-18f41c55-4a17-4a64-b6de-82106bd194bf tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:40.008809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18f41c55-4a17-4a64-b6de-82106bd194bf tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:40.010360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18f41c55-4a17-4a64-b6de-82106bd194bf tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:40.012306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18f41c55-4a17-4a64-b6de-82106bd194bf tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:40.014276 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18f41c55-4a17-4a64-b6de-82106bd194bf tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:40.016072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18f41c55-4a17-4a64-b6de-82106bd194bf tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:40.016750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18f41c55-4a17-4a64-b6de-82106bd194bf tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:40.039435 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:02:40.078563 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6e98bf1e-1098-4f6a-9873-ddfbc36fceaf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:40.091873 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6e98bf1e-1098-4f6a-9873-ddfbc36fceaf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1511 microversion: 2.1 time: 0.786049 Sep 17 21:02:40.094359 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1517/3110] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:39 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1511 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:40.211096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-18f41c55-4a17-4a64-b6de-82106bd194bf tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:40.223169 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-18f41c55-4a17-4a64-b6de-82106bd194bf tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:40.228644 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-18f41c55-4a17-4a64-b6de-82106bd194bf tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:40.244497 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-18f41c55-4a17-4a64-b6de-82106bd194bf tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1553 microversion: 2.91 time: 0.271848 Sep 17 21:02:40.247225 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1594/3111] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:39 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1553 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:02:40.334201 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-58afadcf-e374-4687-8a0a-1e2666600c3e tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:40.334962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-58afadcf-e374-4687-8a0a-1e2666600c3e tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] [instance: 95e9502b-6c82-4775-bfaf-d9940240eff3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:40.356119 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58afadcf-e374-4687-8a0a-1e2666600c3e tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:40.357123 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58afadcf-e374-4687-8a0a-1e2666600c3e tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:40.357820 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58afadcf-e374-4687-8a0a-1e2666600c3e tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:40.358718 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58afadcf-e374-4687-8a0a-1e2666600c3e tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:40.359285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58afadcf-e374-4687-8a0a-1e2666600c3e tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:40.360300 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58afadcf-e374-4687-8a0a-1e2666600c3e tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:40.534921 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-58afadcf-e374-4687-8a0a-1e2666600c3e tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f65cdf47c1489f905d517a7a4fdea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575b0ac677234f6ba9c5b9715cc02f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:40.545439 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-58afadcf-e374-4687-8a0a-1e2666600c3e tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11f65cdf47c1489f905d517a7a4fdea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575b0ac677234f6ba9c5b9715cc02f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:40.546815 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-58afadcf-e374-4687-8a0a-1e2666600c3e tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11f65cdf47c1489f905d517a7a4fdea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575b0ac677234f6ba9c5b9715cc02f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:40.547970 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-58afadcf-e374-4687-8a0a-1e2666600c3e tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] 10.222.0.26 "GET /compute/v2.1/servers/95e9502b-6c82-4775-bfaf-d9940240eff3" status: 200 len: 1339 microversion: 2.47 time: 0.221381 Sep 17 21:02:40.561417 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1518/3112] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:40 2022] GET /compute/v2.1/servers/95e9502b-6c82-4775-bfaf-d9940240eff3 => generated 1339 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:40.797541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a847ff35-246f-4db1-9cee-35003db8ca30 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a4211af0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:40.904876 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a847ff35-246f-4db1-9cee-35003db8ca30 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/42ec7c80-ffce-4465-b7b6-d3b416e2913d" status: 200 len: 1453 microversion: 2.1 time: 0.105501 Sep 17 21:02:40.906414 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1595/3113] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:40 2022] GET /compute/v2.1/images/42ec7c80-ffce-4465-b7b6-d3b416e2913d => generated 1453 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:41.117211 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e8619ba0-c49c-4318-832d-307d64d71b9a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:41.117911 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e8619ba0-c49c-4318-832d-307d64d71b9a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:41.134494 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8619ba0-c49c-4318-832d-307d64d71b9a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:41.135014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8619ba0-c49c-4318-832d-307d64d71b9a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:41.135464 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8619ba0-c49c-4318-832d-307d64d71b9a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:41.136207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8619ba0-c49c-4318-832d-307d64d71b9a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:41.136670 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8619ba0-c49c-4318-832d-307d64d71b9a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:41.137105 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8619ba0-c49c-4318-832d-307d64d71b9a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:41.276764 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4fad2171-1d41-435c-942a-8d38ae1222fa tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:41.277382 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4fad2171-1d41-435c-942a-8d38ae1222fa tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:41.309101 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4fad2171-1d41-435c-942a-8d38ae1222fa tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:41.309674 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4fad2171-1d41-435c-942a-8d38ae1222fa tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:41.310131 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4fad2171-1d41-435c-942a-8d38ae1222fa tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:41.316101 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4fad2171-1d41-435c-942a-8d38ae1222fa tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:41.316886 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4fad2171-1d41-435c-942a-8d38ae1222fa tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:41.317591 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4fad2171-1d41-435c-942a-8d38ae1222fa tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:41.888581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4fad2171-1d41-435c-942a-8d38ae1222fa tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:41.924847 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4fad2171-1d41-435c-942a-8d38ae1222fa tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:41.936091 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4fad2171-1d41-435c-942a-8d38ae1222fa tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:41.951876 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4fad2171-1d41-435c-942a-8d38ae1222fa tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1553 microversion: 2.91 time: 0.680240 Sep 17 21:02:41.952659 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1596/3114] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:41 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1553 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:41.969150 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fc612fa5-043f-4c09-b748-3daa9e79b330 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:41.973763 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fc612fa5-043f-4c09-b748-3daa9e79b330 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] [instance: 95e9502b-6c82-4775-bfaf-d9940240eff3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:41.988745 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc612fa5-043f-4c09-b748-3daa9e79b330 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:41.990012 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc612fa5-043f-4c09-b748-3daa9e79b330 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:41.990834 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc612fa5-043f-4c09-b748-3daa9e79b330 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:41.992052 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc612fa5-043f-4c09-b748-3daa9e79b330 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:41.995110 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc612fa5-043f-4c09-b748-3daa9e79b330 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:41.996829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc612fa5-043f-4c09-b748-3daa9e79b330 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:42.448718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fc612fa5-043f-4c09-b748-3daa9e79b330 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f65cdf47c1489f905d517a7a4fdea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575b0ac677234f6ba9c5b9715cc02f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:42.464799 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fc612fa5-043f-4c09-b748-3daa9e79b330 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11f65cdf47c1489f905d517a7a4fdea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575b0ac677234f6ba9c5b9715cc02f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:42.467023 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fc612fa5-043f-4c09-b748-3daa9e79b330 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11f65cdf47c1489f905d517a7a4fdea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575b0ac677234f6ba9c5b9715cc02f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:42.471085 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fc612fa5-043f-4c09-b748-3daa9e79b330 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] 10.222.0.26 "GET /compute/v2.1/servers/95e9502b-6c82-4775-bfaf-d9940240eff3" status: 200 len: 1339 microversion: 2.47 time: 0.517307 Sep 17 21:02:42.473769 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1597/3115] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:41 2022] GET /compute/v2.1/servers/95e9502b-6c82-4775-bfaf-d9940240eff3 => generated 1339 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:42.488648 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-679c77c7-9de4-45a4-82e5-b09fedd01e6e req-229c334d-1369-4d42-9fae-3c568959c639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66779798-999a-4a63-98dd-bf7fa71ce4b1", "name": "network-vif-unplugged", "status": "completed", "tag": "4056825c-1c74-40d2-846c-e4886adca6ee"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:42.548681 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-679c77c7-9de4-45a4-82e5-b09fedd01e6e req-229c334d-1369-4d42-9fae-3c568959c639 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:42.573648 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-679c77c7-9de4-45a4-82e5-b09fedd01e6e req-229c334d-1369-4d42-9fae-3c568959c639 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:42.573894 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-679c77c7-9de4-45a4-82e5-b09fedd01e6e req-229c334d-1369-4d42-9fae-3c568959c639 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:42.607836 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-679c77c7-9de4-45a4-82e5-b09fedd01e6e req-229c334d-1369-4d42-9fae-3c568959c639 service nova] Creating event network-vif-unplugged:4056825c-1c74-40d2-846c-e4886adca6ee for instance 66779798-999a-4a63-98dd-bf7fa71ce4b1 on nch1-master-1 Sep 17 21:02:42.633842 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-679c77c7-9de4-45a4-82e5-b09fedd01e6e req-229c334d-1369-4d42-9fae-3c568959c639 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.157710 Sep 17 21:02:42.638666 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1598/3116] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:02:42.661156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e8619ba0-c49c-4318-832d-307d64d71b9a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:42.680417 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e8619ba0-c49c-4318-832d-307d64d71b9a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1511 microversion: 2.1 time: 1.567712 Sep 17 21:02:42.680692 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-eece551d-1593-482a-bbc0-ae2eabdf06ae tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a42110d0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:42.683842 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1519/3117] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:41 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1511 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:42.811501 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-eece551d-1593-482a-bbc0-ae2eabdf06ae tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/42ec7c80-ffce-4465-b7b6-d3b416e2913d" status: 200 len: 1453 microversion: 2.1 time: 0.169433 Sep 17 21:02:42.812630 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1599/3118] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:42 2022] GET /compute/v2.1/images/42ec7c80-ffce-4465-b7b6-d3b416e2913d => generated 1453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:42.987298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-95c592b1-ab88-494b-aac9-156dad723a73 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:42.988493 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-95c592b1-ab88-494b-aac9-156dad723a73 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:43.037138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-95c592b1-ab88-494b-aac9-156dad723a73 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:43.054885 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-95c592b1-ab88-494b-aac9-156dad723a73 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:43.056912 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-95c592b1-ab88-494b-aac9-156dad723a73 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:43.061915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-95c592b1-ab88-494b-aac9-156dad723a73 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:43.070864 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-95c592b1-ab88-494b-aac9-156dad723a73 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:43.077430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-95c592b1-ab88-494b-aac9-156dad723a73 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:43.295604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-95c592b1-ab88-494b-aac9-156dad723a73 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:43.315794 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-95c592b1-ab88-494b-aac9-156dad723a73 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:43.324342 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-95c592b1-ab88-494b-aac9-156dad723a73 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:43.338232 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-95c592b1-ab88-494b-aac9-156dad723a73 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1553 microversion: 2.91 time: 0.358081 Sep 17 21:02:43.341920 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1600/3119] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:42 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1553 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:02:43.450149 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-56d698dc-3a68-487b-8524-fd8970c148c5 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Action: 'create', calling method: .version_select at 0x7f25a49f3a60>, body: {"keypair": {"name": "tempest-keypair-1368218421", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFYZpWuu5KOP4tCIFlBWYNvUoQ0O6iNfDjDI8sbZ4RPkBdQeD1POoKehIa9ZoI+5aZ8l0U6zVUfE8O5O5m7ev/uFOqbyFFq+lynWnmthsb2Wed56MkTIRzVMKP48O8jsA=="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:43.474919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-56d698dc-3a68-487b-8524-fd8970c148c5 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Getting quotas for project b33b687e3d75472bb38e672e90871a0b. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:02:43.485494 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-56d698dc-3a68-487b-8524-fd8970c148c5 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Getting quotas for user 00e4ba59294f4529ba188e07cfc6681a and project b33b687e3d75472bb38e672e90871a0b. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:02:43.500658 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-54b8ebb5-b3b7-45f0-8015-08d456ffbfcc tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:43.510788 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-54b8ebb5-b3b7-45f0-8015-08d456ffbfcc tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] [instance: 95e9502b-6c82-4775-bfaf-d9940240eff3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:43.526555 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-54b8ebb5-b3b7-45f0-8015-08d456ffbfcc tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:43.527339 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-54b8ebb5-b3b7-45f0-8015-08d456ffbfcc tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:43.528157 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-54b8ebb5-b3b7-45f0-8015-08d456ffbfcc tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:43.528860 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-54b8ebb5-b3b7-45f0-8015-08d456ffbfcc tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:43.531001 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-54b8ebb5-b3b7-45f0-8015-08d456ffbfcc tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:43.532409 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-54b8ebb5-b3b7-45f0-8015-08d456ffbfcc tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:43.537847 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-56d698dc-3a68-487b-8524-fd8970c148c5 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.715091 Sep 17 21:02:43.541785 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1520/3120] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:02:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:02:43.706744 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-54b8ebb5-b3b7-45f0-8015-08d456ffbfcc tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f65cdf47c1489f905d517a7a4fdea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575b0ac677234f6ba9c5b9715cc02f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:43.715523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-19aec6b7-6bb8-4b67-ad8f-3c3156e41384 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:43.717866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-19aec6b7-6bb8-4b67-ad8f-3c3156e41384 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:43.752421 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-54b8ebb5-b3b7-45f0-8015-08d456ffbfcc tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11f65cdf47c1489f905d517a7a4fdea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575b0ac677234f6ba9c5b9715cc02f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:43.756426 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-19aec6b7-6bb8-4b67-ad8f-3c3156e41384 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:43.760596 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-19aec6b7-6bb8-4b67-ad8f-3c3156e41384 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:43.765829 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-19aec6b7-6bb8-4b67-ad8f-3c3156e41384 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:43.767230 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-54b8ebb5-b3b7-45f0-8015-08d456ffbfcc tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11f65cdf47c1489f905d517a7a4fdea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575b0ac677234f6ba9c5b9715cc02f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:43.771885 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-19aec6b7-6bb8-4b67-ad8f-3c3156e41384 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:43.772421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-19aec6b7-6bb8-4b67-ad8f-3c3156e41384 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:43.774696 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-54b8ebb5-b3b7-45f0-8015-08d456ffbfcc tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] 10.222.0.26 "GET /compute/v2.1/servers/95e9502b-6c82-4775-bfaf-d9940240eff3" status: 200 len: 1360 microversion: 2.47 time: 0.273207 Sep 17 21:02:43.790065 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1601/3121] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:43 2022] GET /compute/v2.1/servers/95e9502b-6c82-4775-bfaf-d9940240eff3 => generated 1360 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:02:43.792093 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-19aec6b7-6bb8-4b67-ad8f-3c3156e41384 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:43.819567 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f3db5083-5b6b-421c-b64f-93b18cea741d tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1567525206"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:43.834608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f3db5083-5b6b-421c-b64f-93b18cea741d tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] [instance: 95e9502b-6c82-4775-bfaf-d9940240eff3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:43.850306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3db5083-5b6b-421c-b64f-93b18cea741d tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:43.850892 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3db5083-5b6b-421c-b64f-93b18cea741d tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:43.851339 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3db5083-5b6b-421c-b64f-93b18cea741d tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:43.852060 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3db5083-5b6b-421c-b64f-93b18cea741d tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:43.852522 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3db5083-5b6b-421c-b64f-93b18cea741d tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:43.852949 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3db5083-5b6b-421c-b64f-93b18cea741d tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:44.233929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-19aec6b7-6bb8-4b67-ad8f-3c3156e41384 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:44.270906 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-19aec6b7-6bb8-4b67-ad8f-3c3156e41384 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1511 microversion: 2.1 time: 0.566036 Sep 17 21:02:44.273970 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1521/3122] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:43 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1511 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:44.298447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b3fc3ecf-bcc0-47f6-8ddf-ad81c8b61ad7 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a48eb670>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:44.374005 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f3db5083-5b6b-421c-b64f-93b18cea741d tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] 10.222.0.26 "POST /compute/v2.1/servers/95e9502b-6c82-4775-bfaf-d9940240eff3/action" status: 202 len: 52 microversion: 2.47 time: 0.566869 Sep 17 21:02:44.383448 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1602/3123] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Sep 17 21:02:43 2022] POST /compute/v2.1/servers/95e9502b-6c82-4775-bfaf-d9940240eff3/action => generated 52 bytes in 582 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Sep 17 21:02:44.403249 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8d617ea7-8f5f-4a25-b427-86bc37953f11 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:44.406213 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8d617ea7-8f5f-4a25-b427-86bc37953f11 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:44.430991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d617ea7-8f5f-4a25-b427-86bc37953f11 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:44.435368 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d617ea7-8f5f-4a25-b427-86bc37953f11 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:44.436278 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d617ea7-8f5f-4a25-b427-86bc37953f11 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:44.437351 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d617ea7-8f5f-4a25-b427-86bc37953f11 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:44.441108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d617ea7-8f5f-4a25-b427-86bc37953f11 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:44.442099 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d617ea7-8f5f-4a25-b427-86bc37953f11 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:44.450661 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b3fc3ecf-bcc0-47f6-8ddf-ad81c8b61ad7 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/42ec7c80-ffce-4465-b7b6-d3b416e2913d" status: 200 len: 1453 microversion: 2.1 time: 0.171654 Sep 17 21:02:44.452112 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1522/3124] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:44 2022] GET /compute/v2.1/images/42ec7c80-ffce-4465-b7b6-d3b416e2913d => generated 1453 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:44.466200 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-58bdcba3-4c99-406c-ad17-5b24155b8a60 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:44.469439 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-58bdcba3-4c99-406c-ad17-5b24155b8a60 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] [instance: 95e9502b-6c82-4775-bfaf-d9940240eff3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:44.494464 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58bdcba3-4c99-406c-ad17-5b24155b8a60 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:44.496406 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58bdcba3-4c99-406c-ad17-5b24155b8a60 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:44.497058 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58bdcba3-4c99-406c-ad17-5b24155b8a60 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:44.501707 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58bdcba3-4c99-406c-ad17-5b24155b8a60 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:44.502506 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58bdcba3-4c99-406c-ad17-5b24155b8a60 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:44.504045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58bdcba3-4c99-406c-ad17-5b24155b8a60 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:44.592489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-58bdcba3-4c99-406c-ad17-5b24155b8a60 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] [instance: 95e9502b-6c82-4775-bfaf-d9940240eff3] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:02:44.663968 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8d617ea7-8f5f-4a25-b427-86bc37953f11 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:44.705022 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8d617ea7-8f5f-4a25-b427-86bc37953f11 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:44.706637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8d617ea7-8f5f-4a25-b427-86bc37953f11 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:44.726740 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8d617ea7-8f5f-4a25-b427-86bc37953f11 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1553 microversion: 2.91 time: 0.339804 Sep 17 21:02:44.741823 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1603/3125] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:44 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1553 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:44.848652 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-58bdcba3-4c99-406c-ad17-5b24155b8a60 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] 10.222.0.26 "DELETE /compute/v2.1/servers/95e9502b-6c82-4775-bfaf-d9940240eff3" status: 204 len: 0 microversion: 2.47 time: 0.391835 Sep 17 21:02:44.850869 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1523/3126] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 17 21:02:44 2022] DELETE /compute/v2.1/servers/95e9502b-6c82-4775-bfaf-d9940240eff3 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 21:02:44.859679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ff9b5675-4c0e-4fcd-b325-b6edb997b030 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:44.860414 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ff9b5675-4c0e-4fcd-b325-b6edb997b030 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] [instance: 95e9502b-6c82-4775-bfaf-d9940240eff3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:44.882174 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff9b5675-4c0e-4fcd-b325-b6edb997b030 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:44.885796 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff9b5675-4c0e-4fcd-b325-b6edb997b030 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:44.890141 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff9b5675-4c0e-4fcd-b325-b6edb997b030 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:44.891272 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff9b5675-4c0e-4fcd-b325-b6edb997b030 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:44.894862 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff9b5675-4c0e-4fcd-b325-b6edb997b030 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:44.897665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff9b5675-4c0e-4fcd-b325-b6edb997b030 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:45.298016 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-39dc8743-70cf-43c0-855f-63ea1dbce15f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:45.299009 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-39dc8743-70cf-43c0-855f-63ea1dbce15f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:45.304872 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ff9b5675-4c0e-4fcd-b325-b6edb997b030 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f65cdf47c1489f905d517a7a4fdea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575b0ac677234f6ba9c5b9715cc02f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:45.318149 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ff9b5675-4c0e-4fcd-b325-b6edb997b030 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11f65cdf47c1489f905d517a7a4fdea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575b0ac677234f6ba9c5b9715cc02f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:45.330386 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ff9b5675-4c0e-4fcd-b325-b6edb997b030 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11f65cdf47c1489f905d517a7a4fdea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575b0ac677234f6ba9c5b9715cc02f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:45.342372 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ff9b5675-4c0e-4fcd-b325-b6edb997b030 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] 10.222.0.26 "GET /compute/v2.1/servers/95e9502b-6c82-4775-bfaf-d9940240eff3" status: 200 len: 1366 microversion: 2.47 time: 0.487425 Sep 17 21:02:45.349805 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-39dc8743-70cf-43c0-855f-63ea1dbce15f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:45.350689 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-39dc8743-70cf-43c0-855f-63ea1dbce15f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:45.356106 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-39dc8743-70cf-43c0-855f-63ea1dbce15f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:45.356648 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1604/3127] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:44 2022] GET /compute/v2.1/servers/95e9502b-6c82-4775-bfaf-d9940240eff3 => generated 1366 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:45.363414 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ce2b7256-f5a5-47b4-9961-34d2fd8ff0e1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:45.364506 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-39dc8743-70cf-43c0-855f-63ea1dbce15f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:45.368466 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-39dc8743-70cf-43c0-855f-63ea1dbce15f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:45.374009 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-39dc8743-70cf-43c0-855f-63ea1dbce15f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:45.386698 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ce2b7256-f5a5-47b4-9961-34d2fd8ff0e1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:45.422126 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce2b7256-f5a5-47b4-9961-34d2fd8ff0e1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:45.427272 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce2b7256-f5a5-47b4-9961-34d2fd8ff0e1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:45.427637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce2b7256-f5a5-47b4-9961-34d2fd8ff0e1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:45.428424 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce2b7256-f5a5-47b4-9961-34d2fd8ff0e1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:45.428925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce2b7256-f5a5-47b4-9961-34d2fd8ff0e1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:45.429375 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce2b7256-f5a5-47b4-9961-34d2fd8ff0e1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:46.105360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ce2b7256-f5a5-47b4-9961-34d2fd8ff0e1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:46.118465 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ce2b7256-f5a5-47b4-9961-34d2fd8ff0e1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.756337 Sep 17 21:02:46.120353 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1605/3128] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:45 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:46.131224 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-38813484-fd7c-4dd8-9f24-c2012c791a0a tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a41f6d30>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:46.219918 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-39dc8743-70cf-43c0-855f-63ea1dbce15f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:46.224330 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:02:46.236867 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-39dc8743-70cf-43c0-855f-63ea1dbce15f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1511 microversion: 2.1 time: 0.944388 Sep 17 21:02:46.238214 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1524/3129] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:45 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1511 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:02:46.257425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e9612792-9296-430e-a281-4fcf6503362d tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:46.259667 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e9612792-9296-430e-a281-4fcf6503362d tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:46.287627 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9612792-9296-430e-a281-4fcf6503362d tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:46.288583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9612792-9296-430e-a281-4fcf6503362d tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:46.289482 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9612792-9296-430e-a281-4fcf6503362d tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:46.292398 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9612792-9296-430e-a281-4fcf6503362d tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:46.293736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9612792-9296-430e-a281-4fcf6503362d tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:46.297086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9612792-9296-430e-a281-4fcf6503362d tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:46.480670 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e9612792-9296-430e-a281-4fcf6503362d tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:46.495316 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e9612792-9296-430e-a281-4fcf6503362d tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:46.499547 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e9612792-9296-430e-a281-4fcf6503362d tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:46.514207 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e9612792-9296-430e-a281-4fcf6503362d tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1553 microversion: 2.91 time: 0.274553 Sep 17 21:02:46.516400 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1525/3130] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:46 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1553 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:46.540743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-96c7670c-73cf-4d09-9a6d-dd3e98cf2e49 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:46.541556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-96c7670c-73cf-4d09-9a6d-dd3e98cf2e49 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:46.552328 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-96c7670c-73cf-4d09-9a6d-dd3e98cf2e49 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:46.552846 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-96c7670c-73cf-4d09-9a6d-dd3e98cf2e49 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:46.553295 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-96c7670c-73cf-4d09-9a6d-dd3e98cf2e49 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:46.556134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-96c7670c-73cf-4d09-9a6d-dd3e98cf2e49 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:46.556605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-96c7670c-73cf-4d09-9a6d-dd3e98cf2e49 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:46.559414 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-96c7670c-73cf-4d09-9a6d-dd3e98cf2e49 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:47.000507 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-96c7670c-73cf-4d09-9a6d-dd3e98cf2e49 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:47.018204 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-96c7670c-73cf-4d09-9a6d-dd3e98cf2e49 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.500445 Sep 17 21:02:47.020245 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1526/3131] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:46 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:47.033743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c8767dda-5b44-4ac0-b587-05c6d5215b3e tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:47.034741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c8767dda-5b44-4ac0-b587-05c6d5215b3e tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] [instance: 95e9502b-6c82-4775-bfaf-d9940240eff3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:47.052954 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8767dda-5b44-4ac0-b587-05c6d5215b3e tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:47.055190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8767dda-5b44-4ac0-b587-05c6d5215b3e tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:47.056396 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8767dda-5b44-4ac0-b587-05c6d5215b3e tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:47.060930 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8767dda-5b44-4ac0-b587-05c6d5215b3e tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:47.061704 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8767dda-5b44-4ac0-b587-05c6d5215b3e tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:47.062675 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8767dda-5b44-4ac0-b587-05c6d5215b3e tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:47.137790 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=4 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:02:47.311015 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c8767dda-5b44-4ac0-b587-05c6d5215b3e tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11f65cdf47c1489f905d517a7a4fdea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575b0ac677234f6ba9c5b9715cc02f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:47.334711 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c8767dda-5b44-4ac0-b587-05c6d5215b3e tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '11f65cdf47c1489f905d517a7a4fdea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575b0ac677234f6ba9c5b9715cc02f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:47.338801 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c8767dda-5b44-4ac0-b587-05c6d5215b3e tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '11f65cdf47c1489f905d517a7a4fdea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575b0ac677234f6ba9c5b9715cc02f63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:47.347882 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c8767dda-5b44-4ac0-b587-05c6d5215b3e tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] 10.222.0.26 "GET /compute/v2.1/servers/95e9502b-6c82-4775-bfaf-d9940240eff3" status: 200 len: 1366 microversion: 2.47 time: 0.323024 Sep 17 21:02:47.351140 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1527/3132] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:47 2022] GET /compute/v2.1/servers/95e9502b-6c82-4775-bfaf-d9940240eff3 => generated 1366 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:47.362652 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5e50f11a-a20c-4bb0-bbf2-0466637cc947 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:47.366600 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5e50f11a-a20c-4bb0-bbf2-0466637cc947 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:47.391978 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e50f11a-a20c-4bb0-bbf2-0466637cc947 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:47.392482 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e50f11a-a20c-4bb0-bbf2-0466637cc947 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:47.392925 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e50f11a-a20c-4bb0-bbf2-0466637cc947 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:47.404850 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e50f11a-a20c-4bb0-bbf2-0466637cc947 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:47.405349 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e50f11a-a20c-4bb0-bbf2-0466637cc947 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:47.410363 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e50f11a-a20c-4bb0-bbf2-0466637cc947 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:47.854024 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5e50f11a-a20c-4bb0-bbf2-0466637cc947 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:47.869204 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5e50f11a-a20c-4bb0-bbf2-0466637cc947 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.514873 Sep 17 21:02:47.871414 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1528/3133] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:47 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:47.882154 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7b95f860-6629-43f2-8bca-4ec68c40694a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:47.884470 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7b95f860-6629-43f2-8bca-4ec68c40694a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:47.903121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7b95f860-6629-43f2-8bca-4ec68c40694a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:47.906837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7b95f860-6629-43f2-8bca-4ec68c40694a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:47.907116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7b95f860-6629-43f2-8bca-4ec68c40694a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:47.918881 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7b95f860-6629-43f2-8bca-4ec68c40694a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:47.920232 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7b95f860-6629-43f2-8bca-4ec68c40694a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:47.922183 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7b95f860-6629-43f2-8bca-4ec68c40694a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:47.962353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:02:48.521048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7b95f860-6629-43f2-8bca-4ec68c40694a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:48.534285 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7b95f860-6629-43f2-8bca-4ec68c40694a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1532 microversion: 2.1 time: 0.662218 Sep 17 21:02:48.555132 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1529/3134] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:47 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1532 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:48.565036 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e8f941ab-4804-450e-9c67-7cd4c39f5529 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:48.565898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e8f941ab-4804-450e-9c67-7cd4c39f5529 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:48.581065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8f941ab-4804-450e-9c67-7cd4c39f5529 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:48.581895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8f941ab-4804-450e-9c67-7cd4c39f5529 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:48.582507 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8f941ab-4804-450e-9c67-7cd4c39f5529 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:48.583547 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8f941ab-4804-450e-9c67-7cd4c39f5529 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:48.584169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8f941ab-4804-450e-9c67-7cd4c39f5529 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:48.584762 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8f941ab-4804-450e-9c67-7cd4c39f5529 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:48.696935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e8f941ab-4804-450e-9c67-7cd4c39f5529 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:48.715950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e8f941ab-4804-450e-9c67-7cd4c39f5529 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:48.720847 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e8f941ab-4804-450e-9c67-7cd4c39f5529 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:48.751516 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e8f941ab-4804-450e-9c67-7cd4c39f5529 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1553 microversion: 2.91 time: 0.189553 Sep 17 21:02:48.754326 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1530/3135] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:48 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1553 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:48.772386 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-524a68e3-4c13-4d80-a038-997ecbc876ba tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1987873012"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:48.784701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-524a68e3-4c13-4d80-a038-997ecbc876ba tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:48.834837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-524a68e3-4c13-4d80-a038-997ecbc876ba tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:48.835536 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-524a68e3-4c13-4d80-a038-997ecbc876ba tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:48.836004 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-524a68e3-4c13-4d80-a038-997ecbc876ba tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:48.836774 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-524a68e3-4c13-4d80-a038-997ecbc876ba tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:48.842324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-524a68e3-4c13-4d80-a038-997ecbc876ba tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:48.843020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-524a68e3-4c13-4d80-a038-997ecbc876ba tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:53.493441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=32 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:02:55.405051 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=65 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:02:56.110252 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:02:56.635283 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-38813484-fd7c-4dd8-9f24-c2012c791a0a tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/42ec7c80-ffce-4465-b7b6-d3b416e2913d" status: 200 len: 1453 microversion: 2.1 time: 10.513823 Sep 17 21:02:56.638962 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1606/3136] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:46 2022] GET /compute/v2.1/images/42ec7c80-ffce-4465-b7b6-d3b416e2913d => generated 1453 bytes in 10518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:56.644244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-27e3d708-5498-47f4-837b-af3ac67e0f69 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:56.647754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-27e3d708-5498-47f4-837b-af3ac67e0f69 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] [instance: 95e9502b-6c82-4775-bfaf-d9940240eff3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:56.661018 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27e3d708-5498-47f4-837b-af3ac67e0f69 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:56.665609 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27e3d708-5498-47f4-837b-af3ac67e0f69 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:56.667791 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27e3d708-5498-47f4-837b-af3ac67e0f69 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:56.669256 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27e3d708-5498-47f4-837b-af3ac67e0f69 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:56.671912 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27e3d708-5498-47f4-837b-af3ac67e0f69 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:56.674294 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27e3d708-5498-47f4-837b-af3ac67e0f69 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:56.708538 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-27e3d708-5498-47f4-837b-af3ac67e0f69 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] HTTP exception thrown: Instance 95e9502b-6c82-4775-bfaf-d9940240eff3 could not be found. Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-27e3d708-5498-47f4-837b-af3ac67e0f69 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Request method failure captured: Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/95e9502b-6c82-4775-bfaf-d9940240eff3 HTTP/1.1 Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjXqqDF8X7Kjvjw1gnEiMS5pk2TF5dhqwLFkM8XX6rg5cJxNHuBz3Lx6egXlL2O5zPJe8wcK-RoP5WS8IYrcUkBIBh4WIHDbf2SxWNuReZr4uJJeij6E7ZeBSwlUnCe6TJuJGVqKx5_B1Odzi6dDKtwhh_AHhrZepn2j_cC_Dgo5zLo Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: X-Openstack-Nova-Api-Version: 2.47 Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 575b0ac677234f6ba9c5b9715cc02f63 Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersAaction247Test-1659092255 Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/575b0ac677234f6ba9c5b9715cc02f63"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/575b0ac677234f6ba9c5b9715cc02f63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/575b0ac677234f6ba9c5b9715cc02f63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_575b0ac677234f6ba9c5b9715cc02f63", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersAaction247Test-1659092255 Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 575b0ac677234f6ba9c5b9715cc02f63 Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersAaction247Test-1659092255 Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersAaction247Test-1659092255-project Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 11f65cdf47c1489f905d517a7a4fdea5 Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersAaction247Test-1659092255-project Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 95e9502b-6c82-4775-bfaf-d9940240eff3 could not be found. Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '95e9502b-6c82-4775-bfaf-d9940240eff3'} Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95e9502b-6c82-4775-bfaf-d9940240eff3 could not be found. Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95e9502b-6c82-4775-bfaf-d9940240eff3 could not be found. Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:56.710766 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:02:56.715200 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:56.715200 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:02:56.715200 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:02:56.715200 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:02:56.715200 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:02:56.715200 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:02:56.715200 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95e9502b-6c82-4775-bfaf-d9940240eff3 could not be found. Sep 17 21:02:56.715200 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:02:56.715200 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-27e3d708-5498-47f4-837b-af3ac67e0f69 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] Returning 404 to user: Instance 95e9502b-6c82-4775-bfaf-d9940240eff3 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:02:56.719172 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-27e3d708-5498-47f4-837b-af3ac67e0f69 tempest-ServersAaction247Test-1659092255 tempest-ServersAaction247Test-1659092255-project] 10.222.0.26 "GET /compute/v2.1/servers/95e9502b-6c82-4775-bfaf-d9940240eff3" status: 404 len: 111 microversion: 2.47 time: 0.078798 Sep 17 21:02:56.722903 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1607/3137] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:56 2022] GET /compute/v2.1/servers/95e9502b-6c82-4775-bfaf-d9940240eff3 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:02:56.729755 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-156b7966-7d90-43a3-8c78-51d3eb4e7025 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:56.731157 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-156b7966-7d90-43a3-8c78-51d3eb4e7025 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:56.745285 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-156b7966-7d90-43a3-8c78-51d3eb4e7025 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:56.749898 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-156b7966-7d90-43a3-8c78-51d3eb4e7025 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:56.751128 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-156b7966-7d90-43a3-8c78-51d3eb4e7025 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:56.751990 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-156b7966-7d90-43a3-8c78-51d3eb4e7025 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:56.752574 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-156b7966-7d90-43a3-8c78-51d3eb4e7025 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:56.753715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-156b7966-7d90-43a3-8c78-51d3eb4e7025 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:56.991720 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-524a68e3-4c13-4d80-a038-997ecbc876ba tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action" status: 202 len: 0 microversion: 2.1 time: 8.230980 Sep 17 21:02:56.999093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-156b7966-7d90-43a3-8c78-51d3eb4e7025 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:57.002538 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1531/3138] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:02:48 2022] POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action => generated 0 bytes in 8247 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 17 21:02:57.016175 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-156b7966-7d90-43a3-8c78-51d3eb4e7025 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1527 microversion: 2.1 time: 0.294597 Sep 17 21:02:57.016574 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-06edead1-7d39-46c4-8eaa-8e5d2bafb860 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:02:57.017486 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1608/3139] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:02:56 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1527 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:02:57.026360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-a2e5210b-30f2-4498-b4a7-52e74c9071f9 req-94d4f758-a3fb-40e4-8fd3-fdbf1605b8b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f", "name": "network-vif-plugged", "status": "completed", "tag": "5273e052-362a-499b-8afd-752c94502a05"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:57.043038 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a2e5210b-30f2-4498-b4a7-52e74c9071f9 req-94d4f758-a3fb-40e4-8fd3-fdbf1605b8b5 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:57.043781 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a2e5210b-30f2-4498-b4a7-52e74c9071f9 req-94d4f758-a3fb-40e4-8fd3-fdbf1605b8b5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:57.054265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-06edead1-7d39-46c4-8eaa-8e5d2bafb860 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:02:57.059152 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a2e5210b-30f2-4498-b4a7-52e74c9071f9 req-94d4f758-a3fb-40e4-8fd3-fdbf1605b8b5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:57.088030 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06edead1-7d39-46c4-8eaa-8e5d2bafb860 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:57.088548 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06edead1-7d39-46c4-8eaa-8e5d2bafb860 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:57.089000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06edead1-7d39-46c4-8eaa-8e5d2bafb860 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:57.092335 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-a2e5210b-30f2-4498-b4a7-52e74c9071f9 req-94d4f758-a3fb-40e4-8fd3-fdbf1605b8b5 service nova] Creating event network-vif-plugged:5273e052-362a-499b-8afd-752c94502a05 for instance 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f on nch2-master-1 Sep 17 21:02:57.103034 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06edead1-7d39-46c4-8eaa-8e5d2bafb860 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:57.104730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06edead1-7d39-46c4-8eaa-8e5d2bafb860 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:57.106291 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06edead1-7d39-46c4-8eaa-8e5d2bafb860 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:57.115963 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-a2e5210b-30f2-4498-b4a7-52e74c9071f9 req-94d4f758-a3fb-40e4-8fd3-fdbf1605b8b5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094876 Sep 17 21:02:57.123217 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1609/3140] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:02:57.246277 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-06edead1-7d39-46c4-8eaa-8e5d2bafb860 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:57.260880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-06edead1-7d39-46c4-8eaa-8e5d2bafb860 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:57.265127 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-06edead1-7d39-46c4-8eaa-8e5d2bafb860 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:02:57.280699 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-06edead1-7d39-46c4-8eaa-8e5d2bafb860 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1553 microversion: 2.91 time: 0.276160 Sep 17 21:02:57.298842 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1532/3141] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:02:57 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1553 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:02:57.312574 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cb40b87c-8052-4d92-9cb2-f2ed75e65350 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "6fd75397-b2af-4798-9257-96e09b745efc"}], "security_groups": [{"name": "tempest-securitygroup--132271311"}], "key_name": "tempest-keypair-1368218421", "user_data": "}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:57.555528 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a8fbf049-ba5a-4cc8-9ff8-77b2c33a5a8c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-559217167", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "27ed43ec-38ac-4bfa-97b0-cc80a9a8e28c"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:02:57.858690 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-cb40b87c-8052-4d92-9cb2-f2ed75e65350 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] validate_networks() for [('6fd75397-b2af-4798-9257-96e09b745efc', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:02:58.687429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-cb40b87c-8052-4d92-9cb2-f2ed75e65350 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:02:58.688168 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-cb40b87c-8052-4d92-9cb2-f2ed75e65350 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:02:58.689045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-cb40b87c-8052-4d92-9cb2-f2ed75e65350 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:02:58.689594 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-cb40b87c-8052-4d92-9cb2-f2ed75e65350 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:02:58.690114 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-cb40b87c-8052-4d92-9cb2-f2ed75e65350 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:02:58.703084 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb40b87c-8052-4d92-9cb2-f2ed75e65350 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:58.703750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb40b87c-8052-4d92-9cb2-f2ed75e65350 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:58.704281 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb40b87c-8052-4d92-9cb2-f2ed75e65350 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:58.705141 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb40b87c-8052-4d92-9cb2-f2ed75e65350 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:02:58.705883 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb40b87c-8052-4d92-9cb2-f2ed75e65350 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:02:58.706627 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb40b87c-8052-4d92-9cb2-f2ed75e65350 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:02:58.764634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-cb40b87c-8052-4d92-9cb2-f2ed75e65350 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Getting quotas for project b33b687e3d75472bb38e672e90871a0b. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:02:58.773630 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-cb40b87c-8052-4d92-9cb2-f2ed75e65350 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Getting quotas for user 00e4ba59294f4529ba188e07cfc6681a and project b33b687e3d75472bb38e672e90871a0b. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:02:58.811588 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cb40b87c-8052-4d92-9cb2-f2ed75e65350 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:02:58.815181 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cb40b87c-8052-4d92-9cb2-f2ed75e65350 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] [instance: 2b665d60-71ad-42ef-b99f-e87bc951ee62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:02:58.941398 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cb40b87c-8052-4d92-9cb2-f2ed75e65350 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.633993 Sep 17 21:02:58.942126 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1533/3142] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:02:57 2022] POST /compute/v2.1/servers => generated 408 bytes in 1642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:02:58.971193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c9b315d5-c27e-4734-aafc-0d248c269a4e tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a51ee4c0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:05.904748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-a8fbf049-ba5a-4cc8-9ff8-77b2c33a5a8c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] validate_networks() for [('27ed43ec-38ac-4bfa-97b0-cc80a9a8e28c', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:03:05.923824 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c9b315d5-c27e-4734-aafc-0d248c269a4e tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/42ec7c80-ffce-4465-b7b6-d3b416e2913d" status: 200 len: 1462 microversion: 2.1 time: 6.973920 Sep 17 21:03:05.924897 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1534/3143] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:02:58 2022] GET /compute/v2.1/images/42ec7c80-ffce-4465-b7b6-d3b416e2913d => generated 1462 bytes in 6982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:05.930533 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c3fdbb63-df55-493e-96ad-8becb888ade1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:05.930760 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c3fdbb63-df55-493e-96ad-8becb888ade1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:05.938506 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3fdbb63-df55-493e-96ad-8becb888ade1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:05.939783 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3fdbb63-df55-493e-96ad-8becb888ade1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:05.941528 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3fdbb63-df55-493e-96ad-8becb888ade1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:05.942664 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3fdbb63-df55-493e-96ad-8becb888ade1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:05.943314 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3fdbb63-df55-493e-96ad-8becb888ade1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:05.944014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3fdbb63-df55-493e-96ad-8becb888ade1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:06.422039 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c3fdbb63-df55-493e-96ad-8becb888ade1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:06.433789 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c3fdbb63-df55-493e-96ad-8becb888ade1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1527 microversion: 2.1 time: 0.507570 Sep 17 21:03:06.435289 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1535/3144] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:05 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1527 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:06.443254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e6dcf19a-da15-4976-89d6-1ec4734585ee tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:06.444233 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e6dcf19a-da15-4976-89d6-1ec4734585ee tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:06.473505 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6dcf19a-da15-4976-89d6-1ec4734585ee tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:06.476801 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6dcf19a-da15-4976-89d6-1ec4734585ee tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:06.477311 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6dcf19a-da15-4976-89d6-1ec4734585ee tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:06.478107 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6dcf19a-da15-4976-89d6-1ec4734585ee tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:06.478584 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6dcf19a-da15-4976-89d6-1ec4734585ee tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:06.482898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6dcf19a-da15-4976-89d6-1ec4734585ee tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:06.760824 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e6dcf19a-da15-4976-89d6-1ec4734585ee tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:06.792626 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e6dcf19a-da15-4976-89d6-1ec4734585ee tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:06.794747 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e6dcf19a-da15-4976-89d6-1ec4734585ee tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:06.801914 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e6dcf19a-da15-4976-89d6-1ec4734585ee tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1478 microversion: 2.91 time: 0.364955 Sep 17 21:03:06.802762 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1536/3145] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:03:06 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1478 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:03:06.808128 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7f81e845-3a17-49ce-9cc2-1e2efca95ea5 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:06.808963 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7f81e845-3a17-49ce-9cc2-1e2efca95ea5 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] [instance: 2b665d60-71ad-42ef-b99f-e87bc951ee62] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:06.815512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7f81e845-3a17-49ce-9cc2-1e2efca95ea5 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:06.816416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7f81e845-3a17-49ce-9cc2-1e2efca95ea5 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:06.817139 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7f81e845-3a17-49ce-9cc2-1e2efca95ea5 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:06.818073 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7f81e845-3a17-49ce-9cc2-1e2efca95ea5 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:06.818702 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7f81e845-3a17-49ce-9cc2-1e2efca95ea5 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:06.819373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7f81e845-3a17-49ce-9cc2-1e2efca95ea5 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:07.088510 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=10 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:07.334461 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7f81e845-3a17-49ce-9cc2-1e2efca95ea5 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e4ba59294f4529ba188e07cfc6681a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b687e3d75472bb38e672e90871a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:07.342788 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7f81e845-3a17-49ce-9cc2-1e2efca95ea5 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] 10.222.0.26 "GET /compute/v2.1/servers/2b665d60-71ad-42ef-b99f-e87bc951ee62" status: 200 len: 1351 microversion: 2.1 time: 0.538514 Sep 17 21:03:07.357835 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1537/3146] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:06 2022] GET /compute/v2.1/servers/2b665d60-71ad-42ef-b99f-e87bc951ee62 => generated 1351 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:07.357835 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-cd6847b0-f4c8-4fe7-972f-4922db5416f4 req-1f8fe170-d827-468c-a03a-414a06887afb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b986fa2-07ea-4418-adf2-0a5fa127e84a", "name": "network-vif-plugged", "status": "completed", "tag": "f698d869-5f6d-4d34-95fa-00bb9569ec58"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:07.374203 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:07.376187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-cd6847b0-f4c8-4fe7-972f-4922db5416f4 req-1f8fe170-d827-468c-a03a-414a06887afb service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:07.376674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-cd6847b0-f4c8-4fe7-972f-4922db5416f4 req-1f8fe170-d827-468c-a03a-414a06887afb service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:07.377155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-cd6847b0-f4c8-4fe7-972f-4922db5416f4 req-1f8fe170-d827-468c-a03a-414a06887afb service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:07.412568 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-cd6847b0-f4c8-4fe7-972f-4922db5416f4 req-1f8fe170-d827-468c-a03a-414a06887afb service nova] Creating event network-vif-plugged:f698d869-5f6d-4d34-95fa-00bb9569ec58 for instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a on nch1-master-1 Sep 17 21:03:07.418350 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-cd6847b0-f4c8-4fe7-972f-4922db5416f4 req-1f8fe170-d827-468c-a03a-414a06887afb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064424 Sep 17 21:03:07.419018 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1538/3147] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:07.439142 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dedb43bb-bf6d-4107-bcac-3736f52a0791 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a9fe0280>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:07.625664 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=8 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:07.637617 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-a8fbf049-ba5a-4cc8-9ff8-77b2c33a5a8c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:03:07.638047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-a8fbf049-ba5a-4cc8-9ff8-77b2c33a5a8c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:03:07.638536 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-a8fbf049-ba5a-4cc8-9ff8-77b2c33a5a8c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:03:07.638953 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-a8fbf049-ba5a-4cc8-9ff8-77b2c33a5a8c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:03:07.639368 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-a8fbf049-ba5a-4cc8-9ff8-77b2c33a5a8c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:03:07.664494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8fbf049-ba5a-4cc8-9ff8-77b2c33a5a8c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:07.664996 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8fbf049-ba5a-4cc8-9ff8-77b2c33a5a8c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:07.665906 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8fbf049-ba5a-4cc8-9ff8-77b2c33a5a8c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:07.666186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8fbf049-ba5a-4cc8-9ff8-77b2c33a5a8c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:07.666652 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8fbf049-ba5a-4cc8-9ff8-77b2c33a5a8c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:07.668285 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8fbf049-ba5a-4cc8-9ff8-77b2c33a5a8c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:07.703155 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-a8fbf049-ba5a-4cc8-9ff8-77b2c33a5a8c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Getting quotas for project 9f9877108f734092be1197672d500334. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:03:07.723319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-a8fbf049-ba5a-4cc8-9ff8-77b2c33a5a8c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Getting quotas for user 128155ce2ea242bd9d59ec188c57c34b and project 9f9877108f734092be1197672d500334. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:03:07.746729 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a8fbf049-ba5a-4cc8-9ff8-77b2c33a5a8c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:03:07.749485 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a8fbf049-ba5a-4cc8-9ff8-77b2c33a5a8c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] [instance: a4ae0d78-1feb-462a-8eba-03a345099219] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:03:07.868801 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a8fbf049-ba5a-4cc8-9ff8-77b2c33a5a8c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 10.743669 Sep 17 21:03:07.897559 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1610/3148] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:02:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 10762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:03:07.908748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b43c3d56-639c-4813-847a-46d90739fbe7 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "nch2-master-1"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:07.915102 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b43c3d56-639c-4813-847a-46d90739fbe7 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:07.924663 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b43c3d56-639c-4813-847a-46d90739fbe7 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:07.925232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b43c3d56-639c-4813-847a-46d90739fbe7 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:07.925781 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b43c3d56-639c-4813-847a-46d90739fbe7 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:07.926570 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b43c3d56-639c-4813-847a-46d90739fbe7 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:07.927117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b43c3d56-639c-4813-847a-46d90739fbe7 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:07.927590 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b43c3d56-639c-4813-847a-46d90739fbe7 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:08.068556 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b43c3d56-639c-4813-847a-46d90739fbe7 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "nch2-master-1". {{(pid=140524) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 17 21:03:08.360603 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b43c3d56-639c-4813-847a-46d90739fbe7 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36/action" status: 202 len: 0 microversion: 2.91 time: 0.458238 Sep 17 21:03:08.369713 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1611/3149] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Sep 17 21:03:07 2022] POST /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:03:08.384448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a5118374-d9ab-4e9b-b44e-81c55f280dde tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:08.394308 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a5118374-d9ab-4e9b-b44e-81c55f280dde tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:08.416072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5118374-d9ab-4e9b-b44e-81c55f280dde tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:08.416586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5118374-d9ab-4e9b-b44e-81c55f280dde tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:08.417027 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5118374-d9ab-4e9b-b44e-81c55f280dde tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:08.425380 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5118374-d9ab-4e9b-b44e-81c55f280dde tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:08.426210 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5118374-d9ab-4e9b-b44e-81c55f280dde tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:08.427578 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5118374-d9ab-4e9b-b44e-81c55f280dde tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:08.740689 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:08.796107 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:08.978167 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a5118374-d9ab-4e9b-b44e-81c55f280dde tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:08.989860 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a5118374-d9ab-4e9b-b44e-81c55f280dde tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1527 microversion: 2.1 time: 0.614988 Sep 17 21:03:08.990706 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1612/3150] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:08 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1527 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:09.017810 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-5d0913a6-69b0-406d-8097-9aa3c3c70444 req-7c7dbdf3-f198-49c5-8058-1b75d29c5270 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b665d60-71ad-42ef-b99f-e87bc951ee62", "tag": "61bbacbc-0b60-4739-bc1b-37474f73a3e4"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:09.041987 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-5d0913a6-69b0-406d-8097-9aa3c3c70444 req-7c7dbdf3-f198-49c5-8058-1b75d29c5270 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:09.044406 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-5d0913a6-69b0-406d-8097-9aa3c3c70444 req-7c7dbdf3-f198-49c5-8058-1b75d29c5270 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:09.045030 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-5d0913a6-69b0-406d-8097-9aa3c3c70444 req-7c7dbdf3-f198-49c5-8058-1b75d29c5270 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:09.123799 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-5d0913a6-69b0-406d-8097-9aa3c3c70444 req-7c7dbdf3-f198-49c5-8058-1b75d29c5270 service nova] Creating event network-changed:61bbacbc-0b60-4739-bc1b-37474f73a3e4 for instance 2b665d60-71ad-42ef-b99f-e87bc951ee62 on nch2-master-1 Sep 17 21:03:09.141936 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-5d0913a6-69b0-406d-8097-9aa3c3c70444 req-7c7dbdf3-f198-49c5-8058-1b75d29c5270 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134243 Sep 17 21:03:09.156786 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1613/3151] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:09.207081 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0d2cbe3e-9bf2-4780-86bb-768a1b9fa92b tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:09.220021 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0d2cbe3e-9bf2-4780-86bb-768a1b9fa92b tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] [instance: a4ae0d78-1feb-462a-8eba-03a345099219] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:09.354065 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0d2cbe3e-9bf2-4780-86bb-768a1b9fa92b tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:09.354594 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0d2cbe3e-9bf2-4780-86bb-768a1b9fa92b tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:09.355057 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0d2cbe3e-9bf2-4780-86bb-768a1b9fa92b tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:09.355822 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0d2cbe3e-9bf2-4780-86bb-768a1b9fa92b tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:09.356287 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0d2cbe3e-9bf2-4780-86bb-768a1b9fa92b tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:09.356730 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0d2cbe3e-9bf2-4780-86bb-768a1b9fa92b tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:09.506893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0d2cbe3e-9bf2-4780-86bb-768a1b9fa92b tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128155ce2ea242bd9d59ec188c57c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9877108f734092be1197672d500334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:09.520667 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0d2cbe3e-9bf2-4780-86bb-768a1b9fa92b tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219" status: 200 len: 1219 microversion: 2.1 time: 0.360609 Sep 17 21:03:09.523462 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1614/3152] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:09 2022] GET /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219 => generated 1219 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:09.535453 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4aaead9b-9126-43de-9dad-04148163cb59 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:09.536561 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4aaead9b-9126-43de-9dad-04148163cb59 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] [instance: 2b665d60-71ad-42ef-b99f-e87bc951ee62] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:09.567810 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4aaead9b-9126-43de-9dad-04148163cb59 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:09.574232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4aaead9b-9126-43de-9dad-04148163cb59 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:09.575922 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4aaead9b-9126-43de-9dad-04148163cb59 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:09.577972 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4aaead9b-9126-43de-9dad-04148163cb59 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:09.580788 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4aaead9b-9126-43de-9dad-04148163cb59 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:09.582693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4aaead9b-9126-43de-9dad-04148163cb59 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:10.262003 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4aaead9b-9126-43de-9dad-04148163cb59 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e4ba59294f4529ba188e07cfc6681a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b687e3d75472bb38e672e90871a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:10.283899 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4aaead9b-9126-43de-9dad-04148163cb59 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] 10.222.0.26 "GET /compute/v2.1/servers/2b665d60-71ad-42ef-b99f-e87bc951ee62" status: 200 len: 1351 microversion: 2.1 time: 0.757983 Sep 17 21:03:10.287548 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1615/3153] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:09 2022] GET /compute/v2.1/servers/2b665d60-71ad-42ef-b99f-e87bc951ee62 => generated 1351 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:10.298390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4b6dd086-d710-4ad2-a2f7-c22e9da822c7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:10.302782 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4b6dd086-d710-4ad2-a2f7-c22e9da822c7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:10.346105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b6dd086-d710-4ad2-a2f7-c22e9da822c7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:10.347018 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b6dd086-d710-4ad2-a2f7-c22e9da822c7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:10.347621 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b6dd086-d710-4ad2-a2f7-c22e9da822c7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:10.348994 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b6dd086-d710-4ad2-a2f7-c22e9da822c7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:10.350613 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b6dd086-d710-4ad2-a2f7-c22e9da822c7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:10.351534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b6dd086-d710-4ad2-a2f7-c22e9da822c7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:10.740421 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4b6dd086-d710-4ad2-a2f7-c22e9da822c7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:10.756351 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4b6dd086-d710-4ad2-a2f7-c22e9da822c7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:10.758273 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4b6dd086-d710-4ad2-a2f7-c22e9da822c7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:10.773910 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4b6dd086-d710-4ad2-a2f7-c22e9da822c7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1486 microversion: 2.91 time: 0.484803 Sep 17 21:03:10.778485 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1616/3154] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:03:10 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1486 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:03:10.783532 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-b7d425d4-a0fa-43c4-b4c9-ec0e9bd65080 req-a8b1b32b-4847-40b5-90af-6cabbee8beb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41393a54-9105-4da5-ae65-3167427ddae8", "name": "network-vif-plugged", "status": "completed", "tag": "4d47e229-8239-4215-8c5c-b5133bcfb47b"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:10.831790 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b7d425d4-a0fa-43c4-b4c9-ec0e9bd65080 req-a8b1b32b-4847-40b5-90af-6cabbee8beb3 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:10.832597 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b7d425d4-a0fa-43c4-b4c9-ec0e9bd65080 req-a8b1b32b-4847-40b5-90af-6cabbee8beb3 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:10.833188 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b7d425d4-a0fa-43c4-b4c9-ec0e9bd65080 req-a8b1b32b-4847-40b5-90af-6cabbee8beb3 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:10.869550 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-b7d425d4-a0fa-43c4-b4c9-ec0e9bd65080 req-a8b1b32b-4847-40b5-90af-6cabbee8beb3 service nova] Creating event network-vif-plugged:4d47e229-8239-4215-8c5c-b5133bcfb47b for instance 41393a54-9105-4da5-ae65-3167427ddae8 on nch1-master-1 Sep 17 21:03:10.875014 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-b7d425d4-a0fa-43c4-b4c9-ec0e9bd65080 req-a8b1b32b-4847-40b5-90af-6cabbee8beb3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095122 Sep 17 21:03:10.878175 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1617/3155] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:10.886562 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-917f7132-db69-4716-b407-592d0ddbbbc0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:10.897890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-917f7132-db69-4716-b407-592d0ddbbbc0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:10.910963 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-917f7132-db69-4716-b407-592d0ddbbbc0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:10.913129 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-917f7132-db69-4716-b407-592d0ddbbbc0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:10.914839 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-917f7132-db69-4716-b407-592d0ddbbbc0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:10.916572 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-917f7132-db69-4716-b407-592d0ddbbbc0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:10.917038 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-917f7132-db69-4716-b407-592d0ddbbbc0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:10.917488 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-917f7132-db69-4716-b407-592d0ddbbbc0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:11.244422 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-917f7132-db69-4716-b407-592d0ddbbbc0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:11.267861 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-917f7132-db69-4716-b407-592d0ddbbbc0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1527 microversion: 2.1 time: 0.388122 Sep 17 21:03:11.278570 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1618/3156] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:10 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1527 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:11.292344 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-09b28a4d-2fab-4419-8e4a-4a8b9d21ea1e tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:11.293264 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-09b28a4d-2fab-4419-8e4a-4a8b9d21ea1e tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] [instance: a4ae0d78-1feb-462a-8eba-03a345099219] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:11.309984 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09b28a4d-2fab-4419-8e4a-4a8b9d21ea1e tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:11.314196 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09b28a4d-2fab-4419-8e4a-4a8b9d21ea1e tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:11.314847 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09b28a4d-2fab-4419-8e4a-4a8b9d21ea1e tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:11.316004 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09b28a4d-2fab-4419-8e4a-4a8b9d21ea1e tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:11.319866 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09b28a4d-2fab-4419-8e4a-4a8b9d21ea1e tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:11.321522 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09b28a4d-2fab-4419-8e4a-4a8b9d21ea1e tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:11.537220 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-09b28a4d-2fab-4419-8e4a-4a8b9d21ea1e tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128155ce2ea242bd9d59ec188c57c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9877108f734092be1197672d500334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:11.551947 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-09b28a4d-2fab-4419-8e4a-4a8b9d21ea1e tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219" status: 200 len: 1273 microversion: 2.1 time: 0.265278 Sep 17 21:03:11.556889 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1619/3157] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:11 2022] GET /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219 => generated 1273 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:11.568950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d79e759e-ec98-4314-80ae-8ae405fb4288 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:11.569811 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d79e759e-ec98-4314-80ae-8ae405fb4288 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] [instance: 2b665d60-71ad-42ef-b99f-e87bc951ee62] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:11.587330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d79e759e-ec98-4314-80ae-8ae405fb4288 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:11.590206 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d79e759e-ec98-4314-80ae-8ae405fb4288 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:11.590450 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d79e759e-ec98-4314-80ae-8ae405fb4288 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:11.591522 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d79e759e-ec98-4314-80ae-8ae405fb4288 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:11.593015 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d79e759e-ec98-4314-80ae-8ae405fb4288 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:11.593582 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d79e759e-ec98-4314-80ae-8ae405fb4288 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:12.911958 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d79e759e-ec98-4314-80ae-8ae405fb4288 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e4ba59294f4529ba188e07cfc6681a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b687e3d75472bb38e672e90871a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:12.928472 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d79e759e-ec98-4314-80ae-8ae405fb4288 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] 10.222.0.26 "GET /compute/v2.1/servers/2b665d60-71ad-42ef-b99f-e87bc951ee62" status: 200 len: 1351 microversion: 2.1 time: 1.368191 Sep 17 21:03:12.929766 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1620/3158] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:11 2022] GET /compute/v2.1/servers/2b665d60-71ad-42ef-b99f-e87bc951ee62 => generated 1351 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:12.934665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7877850e-3707-4356-b397-126cfd71d75e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:12.940050 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7877850e-3707-4356-b397-126cfd71d75e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:12.954539 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7877850e-3707-4356-b397-126cfd71d75e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:12.955301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7877850e-3707-4356-b397-126cfd71d75e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:12.956035 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7877850e-3707-4356-b397-126cfd71d75e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:12.956799 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7877850e-3707-4356-b397-126cfd71d75e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:12.957217 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7877850e-3707-4356-b397-126cfd71d75e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:12.957684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7877850e-3707-4356-b397-126cfd71d75e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:13.075620 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7877850e-3707-4356-b397-126cfd71d75e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:13.085135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7877850e-3707-4356-b397-126cfd71d75e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:13.086746 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7877850e-3707-4356-b397-126cfd71d75e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:13.108274 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7877850e-3707-4356-b397-126cfd71d75e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1486 microversion: 2.91 time: 0.170069 Sep 17 21:03:13.108274 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1621/3159] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:03:12 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1486 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:03:13.109691 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4f9f35c9-e498-4d3a-b112-ba269489683a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:13.110512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4f9f35c9-e498-4d3a-b112-ba269489683a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:13.138290 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f9f35c9-e498-4d3a-b112-ba269489683a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:13.147542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f9f35c9-e498-4d3a-b112-ba269489683a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:13.148392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f9f35c9-e498-4d3a-b112-ba269489683a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:13.153024 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f9f35c9-e498-4d3a-b112-ba269489683a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:13.153763 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f9f35c9-e498-4d3a-b112-ba269489683a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:13.154494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f9f35c9-e498-4d3a-b112-ba269489683a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:13.496281 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4f9f35c9-e498-4d3a-b112-ba269489683a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:13.507895 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4f9f35c9-e498-4d3a-b112-ba269489683a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1527 microversion: 2.1 time: 0.403629 Sep 17 21:03:13.509200 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1622/3160] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:13 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1527 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:13.520319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7984ed92-c5ca-4bc7-97df-c5d393d20f9c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:13.520810 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7984ed92-c5ca-4bc7-97df-c5d393d20f9c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] [instance: a4ae0d78-1feb-462a-8eba-03a345099219] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:13.551724 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7984ed92-c5ca-4bc7-97df-c5d393d20f9c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:13.553207 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7984ed92-c5ca-4bc7-97df-c5d393d20f9c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:13.553207 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7984ed92-c5ca-4bc7-97df-c5d393d20f9c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:13.554120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7984ed92-c5ca-4bc7-97df-c5d393d20f9c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:13.554614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7984ed92-c5ca-4bc7-97df-c5d393d20f9c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:13.555051 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7984ed92-c5ca-4bc7-97df-c5d393d20f9c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:13.683847 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7984ed92-c5ca-4bc7-97df-c5d393d20f9c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128155ce2ea242bd9d59ec188c57c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9877108f734092be1197672d500334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:13.692240 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7984ed92-c5ca-4bc7-97df-c5d393d20f9c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219" status: 200 len: 1273 microversion: 2.1 time: 0.180689 Sep 17 21:03:13.695297 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1623/3161] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:13 2022] GET /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219 => generated 1273 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:13.700624 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-95d751e5-7b7f-45fc-bbe4-d50a1cfe0075 req-d118eff4-8e5a-4743-8fe7-f3bd62638d5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f", "name": "network-vif-unplugged", "status": "completed", "tag": "5273e052-362a-499b-8afd-752c94502a05"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:13.711154 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-95d751e5-7b7f-45fc-bbe4-d50a1cfe0075 req-d118eff4-8e5a-4743-8fe7-f3bd62638d5d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:13.711894 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-95d751e5-7b7f-45fc-bbe4-d50a1cfe0075 req-d118eff4-8e5a-4743-8fe7-f3bd62638d5d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:13.712516 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-95d751e5-7b7f-45fc-bbe4-d50a1cfe0075 req-d118eff4-8e5a-4743-8fe7-f3bd62638d5d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:13.725322 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-95d751e5-7b7f-45fc-bbe4-d50a1cfe0075 req-d118eff4-8e5a-4743-8fe7-f3bd62638d5d service nova] Creating event network-vif-unplugged:5273e052-362a-499b-8afd-752c94502a05 for instance 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f on nch2-master-1 Sep 17 21:03:13.733196 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-95d751e5-7b7f-45fc-bbe4-d50a1cfe0075 req-d118eff4-8e5a-4743-8fe7-f3bd62638d5d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036306 Sep 17 21:03:13.737348 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1624/3162] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:13.960313 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-220aeb2c-ad05-4a88-b4bd-61c20adccac1 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:13.961841 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-220aeb2c-ad05-4a88-b4bd-61c20adccac1 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] [instance: 2b665d60-71ad-42ef-b99f-e87bc951ee62] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:13.975463 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-220aeb2c-ad05-4a88-b4bd-61c20adccac1 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:13.978829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-220aeb2c-ad05-4a88-b4bd-61c20adccac1 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:13.979517 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-220aeb2c-ad05-4a88-b4bd-61c20adccac1 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:13.980454 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-220aeb2c-ad05-4a88-b4bd-61c20adccac1 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:13.982800 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-220aeb2c-ad05-4a88-b4bd-61c20adccac1 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:13.984045 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-220aeb2c-ad05-4a88-b4bd-61c20adccac1 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:14.324510 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-220aeb2c-ad05-4a88-b4bd-61c20adccac1 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e4ba59294f4529ba188e07cfc6681a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b687e3d75472bb38e672e90871a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:14.334128 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-220aeb2c-ad05-4a88-b4bd-61c20adccac1 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] 10.222.0.26 "GET /compute/v2.1/servers/2b665d60-71ad-42ef-b99f-e87bc951ee62" status: 200 len: 1351 microversion: 2.1 time: 0.380341 Sep 17 21:03:14.341651 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1625/3163] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:13 2022] GET /compute/v2.1/servers/2b665d60-71ad-42ef-b99f-e87bc951ee62 => generated 1351 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:14.346880 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f911c53c-d6fc-4363-befe-fba68ffec4b7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:14.358198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f911c53c-d6fc-4363-befe-fba68ffec4b7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:14.388596 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f911c53c-d6fc-4363-befe-fba68ffec4b7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:14.390453 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f911c53c-d6fc-4363-befe-fba68ffec4b7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:14.390917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f911c53c-d6fc-4363-befe-fba68ffec4b7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:14.391669 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f911c53c-d6fc-4363-befe-fba68ffec4b7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:14.392140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f911c53c-d6fc-4363-befe-fba68ffec4b7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:14.392583 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f911c53c-d6fc-4363-befe-fba68ffec4b7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:14.514846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f911c53c-d6fc-4363-befe-fba68ffec4b7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:14.524776 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f911c53c-d6fc-4363-befe-fba68ffec4b7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:14.528726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f911c53c-d6fc-4363-befe-fba68ffec4b7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:14.558204 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f911c53c-d6fc-4363-befe-fba68ffec4b7 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1486 microversion: 2.91 time: 0.215093 Sep 17 21:03:14.559328 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1626/3164] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:03:14 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1486 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:03:14.846952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-92ce4d37-a9b3-4998-9395-a33366339e0b tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Action: 'create', calling method: .version_select at 0x7f25a414ec10>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-668325648", "policies": ["affinity"]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:14.893425 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-92ce4d37-a9b3-4998-9395-a33366339e0b tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Getting quotas for project d9024c27866542428191da960659ac2e. Resources: {'server_groups'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:03:14.904527 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-92ce4d37-a9b3-4998-9395-a33366339e0b tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Getting quotas for user 43e3adea586f4772b39b62323b1cc911 and project d9024c27866542428191da960659ac2e. Resources: {'server_groups'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:03:14.985062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-92ce4d37-a9b3-4998-9395-a33366339e0b tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Getting quotas for project d9024c27866542428191da960659ac2e. Resources: {'server_groups'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:03:14.991704 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-92ce4d37-a9b3-4998-9395-a33366339e0b tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Getting quotas for user 43e3adea586f4772b39b62323b1cc911 and project d9024c27866542428191da960659ac2e. Resources: {'server_groups'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:03:15.006482 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-92ce4d37-a9b3-4998-9395-a33366339e0b tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.445355 Sep 17 21:03:15.007840 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1627/3165] 10.222.0.26 () {60 vars in 1174 bytes} [Sat Sep 17 21:03:14 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:15.013417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4ea531fa-123a-4162-8fa8-35e3bc611986 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:15.014392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4ea531fa-123a-4162-8fa8-35e3bc611986 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:15.024010 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ea531fa-123a-4162-8fa8-35e3bc611986 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:15.024897 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ea531fa-123a-4162-8fa8-35e3bc611986 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:15.025616 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ea531fa-123a-4162-8fa8-35e3bc611986 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:15.026581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ea531fa-123a-4162-8fa8-35e3bc611986 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:15.027459 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ea531fa-123a-4162-8fa8-35e3bc611986 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:15.028252 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ea531fa-123a-4162-8fa8-35e3bc611986 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:15.265441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4ea531fa-123a-4162-8fa8-35e3bc611986 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:15.273042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:15.275441 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4ea531fa-123a-4162-8fa8-35e3bc611986 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1527 microversion: 2.1 time: 0.265957 Sep 17 21:03:15.276150 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1628/3166] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:15 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1527 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:15.303239 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8a6ef070-87f4-440b-95db-dcf5bdc84a5c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:15.304480 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8a6ef070-87f4-440b-95db-dcf5bdc84a5c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] [instance: a4ae0d78-1feb-462a-8eba-03a345099219] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:15.319398 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a6ef070-87f4-440b-95db-dcf5bdc84a5c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:15.319973 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a6ef070-87f4-440b-95db-dcf5bdc84a5c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:15.321345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a6ef070-87f4-440b-95db-dcf5bdc84a5c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:15.321345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a6ef070-87f4-440b-95db-dcf5bdc84a5c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:15.321734 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a6ef070-87f4-440b-95db-dcf5bdc84a5c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:15.322375 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a6ef070-87f4-440b-95db-dcf5bdc84a5c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:15.533196 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8a6ef070-87f4-440b-95db-dcf5bdc84a5c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128155ce2ea242bd9d59ec188c57c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9877108f734092be1197672d500334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:15.546952 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8a6ef070-87f4-440b-95db-dcf5bdc84a5c tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219" status: 200 len: 1315 microversion: 2.1 time: 0.269644 Sep 17 21:03:15.547848 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1629/3167] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:15 2022] GET /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:15.554114 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-05d2984f-c898-4f29-b67e-3ba8c77bc7e5 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Action: 'create', calling method: .version_select at 0x7f25a41a1790>, body: {"server_group": {"name": "tempest-server-group-679569615", "policies": ["affinity"]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:15.576136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-05d2984f-c898-4f29-b67e-3ba8c77bc7e5 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Getting quotas for project d9024c27866542428191da960659ac2e. Resources: {'server_groups'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:03:15.583839 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-05d2984f-c898-4f29-b67e-3ba8c77bc7e5 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Getting quotas for user 43e3adea586f4772b39b62323b1cc911 and project d9024c27866542428191da960659ac2e. Resources: {'server_groups'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:03:15.588837 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:15.659889 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-05d2984f-c898-4f29-b67e-3ba8c77bc7e5 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Getting quotas for project d9024c27866542428191da960659ac2e. Resources: {'server_groups'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:03:15.672717 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-05d2984f-c898-4f29-b67e-3ba8c77bc7e5 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Getting quotas for user 43e3adea586f4772b39b62323b1cc911 and project d9024c27866542428191da960659ac2e. Resources: {'server_groups'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:03:15.707750 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-05d2984f-c898-4f29-b67e-3ba8c77bc7e5 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.158238 Sep 17 21:03:15.710356 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1630/3168] 10.222.0.26 () {60 vars in 1173 bytes} [Sat Sep 17 21:03:15 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:15.721858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-aa36cc90-8b3e-4641-91c0-eb8fa588793b tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:15.722998 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-aa36cc90-8b3e-4641-91c0-eb8fa588793b tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] [instance: 2b665d60-71ad-42ef-b99f-e87bc951ee62] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:15.737741 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa36cc90-8b3e-4641-91c0-eb8fa588793b tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:15.741066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa36cc90-8b3e-4641-91c0-eb8fa588793b tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:15.741809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa36cc90-8b3e-4641-91c0-eb8fa588793b tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:15.742939 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa36cc90-8b3e-4641-91c0-eb8fa588793b tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:15.743625 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa36cc90-8b3e-4641-91c0-eb8fa588793b tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:15.745193 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa36cc90-8b3e-4641-91c0-eb8fa588793b tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:16.039193 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-aa36cc90-8b3e-4641-91c0-eb8fa588793b tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e4ba59294f4529ba188e07cfc6681a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b687e3d75472bb38e672e90871a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:16.048449 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-aa36cc90-8b3e-4641-91c0-eb8fa588793b tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] 10.222.0.26 "GET /compute/v2.1/servers/2b665d60-71ad-42ef-b99f-e87bc951ee62" status: 200 len: 1351 microversion: 2.1 time: 0.335822 Sep 17 21:03:16.058017 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1631/3169] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:15 2022] GET /compute/v2.1/servers/2b665d60-71ad-42ef-b99f-e87bc951ee62 => generated 1351 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:16.063818 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d5b9f05b-6a3a-40e5-b2cb-1bc9695178c5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:16.066172 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d5b9f05b-6a3a-40e5-b2cb-1bc9695178c5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:16.082884 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5b9f05b-6a3a-40e5-b2cb-1bc9695178c5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:16.083811 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5b9f05b-6a3a-40e5-b2cb-1bc9695178c5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:16.084553 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5b9f05b-6a3a-40e5-b2cb-1bc9695178c5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:16.085564 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5b9f05b-6a3a-40e5-b2cb-1bc9695178c5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:16.086253 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5b9f05b-6a3a-40e5-b2cb-1bc9695178c5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:16.086909 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5b9f05b-6a3a-40e5-b2cb-1bc9695178c5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:16.230358 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d5b9f05b-6a3a-40e5-b2cb-1bc9695178c5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:16.243121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d5b9f05b-6a3a-40e5-b2cb-1bc9695178c5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:16.250854 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d5b9f05b-6a3a-40e5-b2cb-1bc9695178c5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:16.266737 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d5b9f05b-6a3a-40e5-b2cb-1bc9695178c5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1486 microversion: 2.91 time: 0.207107 Sep 17 21:03:16.272267 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1632/3170] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:03:16 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1486 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:03:16.277448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-093923f6-c8ae-46ac-a151-67b1c819357f tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Action: 'create', calling method: .version_select at 0x7f25a41f1790>, body: {"server_group": {"name": "tempest-server-group-679569615", "policies": ["affinity"]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:16.323942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-093923f6-c8ae-46ac-a151-67b1c819357f tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Getting quotas for project d9024c27866542428191da960659ac2e. Resources: {'server_groups'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:03:16.337663 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-093923f6-c8ae-46ac-a151-67b1c819357f tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Getting quotas for user 43e3adea586f4772b39b62323b1cc911 and project d9024c27866542428191da960659ac2e. Resources: {'server_groups'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:03:16.638938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-093923f6-c8ae-46ac-a151-67b1c819357f tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Getting quotas for project d9024c27866542428191da960659ac2e. Resources: {'server_groups'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:03:16.654773 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-093923f6-c8ae-46ac-a151-67b1c819357f tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Getting quotas for user 43e3adea586f4772b39b62323b1cc911 and project d9024c27866542428191da960659ac2e. Resources: {'server_groups'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:03:16.716279 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-093923f6-c8ae-46ac-a151-67b1c819357f tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.443051 Sep 17 21:03:16.716901 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1633/3171] 10.222.0.26 () {60 vars in 1173 bytes} [Sat Sep 17 21:03:16 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:16.736156 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-0f870e7b-2942-4a4a-9d19-97c4d318efda req-01f2a192-aa81-4589-8c68-cff6876cadba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b665d60-71ad-42ef-b99f-e87bc951ee62", "name": "network-vif-plugged", "status": "completed", "tag": "61bbacbc-0b60-4739-bc1b-37474f73a3e4"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:16.755763 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-0f870e7b-2942-4a4a-9d19-97c4d318efda req-01f2a192-aa81-4589-8c68-cff6876cadba service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:16.756329 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-0f870e7b-2942-4a4a-9d19-97c4d318efda req-01f2a192-aa81-4589-8c68-cff6876cadba service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:16.756771 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-0f870e7b-2942-4a4a-9d19-97c4d318efda req-01f2a192-aa81-4589-8c68-cff6876cadba service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:16.774994 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-0f870e7b-2942-4a4a-9d19-97c4d318efda req-01f2a192-aa81-4589-8c68-cff6876cadba service nova] Creating event network-vif-plugged:61bbacbc-0b60-4739-bc1b-37474f73a3e4 for instance 2b665d60-71ad-42ef-b99f-e87bc951ee62 on nch2-master-1 Sep 17 21:03:16.792205 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-0f870e7b-2942-4a4a-9d19-97c4d318efda req-01f2a192-aa81-4589-8c68-cff6876cadba service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059883 Sep 17 21:03:16.795333 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1634/3172] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:16.821298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-0a66ad42-2cfb-4681-8f63-e5f4547a336b req-7949462c-b4ab-429f-ba0e-3870ef9438db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4ae0d78-1feb-462a-8eba-03a345099219", "tag": "d54cdb25-5384-4cca-ab82-3c54e65b0c39"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:16.850504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-0a66ad42-2cfb-4681-8f63-e5f4547a336b req-7949462c-b4ab-429f-ba0e-3870ef9438db service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:16.858203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-0a66ad42-2cfb-4681-8f63-e5f4547a336b req-7949462c-b4ab-429f-ba0e-3870ef9438db service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:16.858739 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-0a66ad42-2cfb-4681-8f63-e5f4547a336b req-7949462c-b4ab-429f-ba0e-3870ef9438db service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:16.873637 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-0a66ad42-2cfb-4681-8f63-e5f4547a336b req-7949462c-b4ab-429f-ba0e-3870ef9438db service nova] Creating event network-changed:d54cdb25-5384-4cca-ab82-3c54e65b0c39 for instance a4ae0d78-1feb-462a-8eba-03a345099219 on nch1-master-1 Sep 17 21:03:16.888169 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-0a66ad42-2cfb-4681-8f63-e5f4547a336b req-7949462c-b4ab-429f-ba0e-3870ef9438db service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091191 Sep 17 21:03:16.896974 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1635/3173] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:16.896974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-491db9d5-ad2a-49a5-9f96-98f325364280 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:16.896974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-491db9d5-ad2a-49a5-9f96-98f325364280 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:16.907834 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-491db9d5-ad2a-49a5-9f96-98f325364280 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:16.913629 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-491db9d5-ad2a-49a5-9f96-98f325364280 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:16.914230 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-491db9d5-ad2a-49a5-9f96-98f325364280 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:16.918006 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-491db9d5-ad2a-49a5-9f96-98f325364280 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:16.918512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-491db9d5-ad2a-49a5-9f96-98f325364280 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:16.920269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-491db9d5-ad2a-49a5-9f96-98f325364280 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:17.279859 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-491db9d5-ad2a-49a5-9f96-98f325364280 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:17.299282 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-491db9d5-ad2a-49a5-9f96-98f325364280 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1527 microversion: 2.1 time: 0.406704 Sep 17 21:03:17.301154 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1636/3174] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:16 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1527 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:17.326432 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-008aa14f-4f8b-4c52-aa8e-8a02207e2335 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:17.327423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-008aa14f-4f8b-4c52-aa8e-8a02207e2335 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] [instance: a4ae0d78-1feb-462a-8eba-03a345099219] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:17.336678 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-008aa14f-4f8b-4c52-aa8e-8a02207e2335 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:17.337586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-008aa14f-4f8b-4c52-aa8e-8a02207e2335 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:17.338256 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-008aa14f-4f8b-4c52-aa8e-8a02207e2335 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:17.339651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-008aa14f-4f8b-4c52-aa8e-8a02207e2335 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:17.340393 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-008aa14f-4f8b-4c52-aa8e-8a02207e2335 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:17.340975 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-008aa14f-4f8b-4c52-aa8e-8a02207e2335 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:17.411749 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:17.486793 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:17.642659 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-008aa14f-4f8b-4c52-aa8e-8a02207e2335 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128155ce2ea242bd9d59ec188c57c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9877108f734092be1197672d500334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:17.651358 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-008aa14f-4f8b-4c52-aa8e-8a02207e2335 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219" status: 200 len: 1315 microversion: 2.1 time: 0.330069 Sep 17 21:03:17.658934 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1637/3175] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:17 2022] GET /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219 => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:17.683056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-04f8c81e-a24a-4787-924d-7ab46c547e91 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:17.698008 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:17.742656 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-04f8c81e-a24a-4787-924d-7ab46c547e91 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/397dd2a9-9639-4662-9154-700739a5b2fb" status: 204 len: 0 microversion: 2.1 time: 0.070136 Sep 17 21:03:17.743473 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1638/3176] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Sep 17 21:03:17 2022] DELETE /compute/v2.1/os-server-groups/397dd2a9-9639-4662-9154-700739a5b2fb => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:03:17.758142 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b4aaf82b-5077-4043-8955-c42e47ebc519 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:17.758741 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b4aaf82b-5077-4043-8955-c42e47ebc519 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] [instance: 2b665d60-71ad-42ef-b99f-e87bc951ee62] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:17.771358 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b4aaf82b-5077-4043-8955-c42e47ebc519 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:17.777778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b4aaf82b-5077-4043-8955-c42e47ebc519 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:17.778579 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b4aaf82b-5077-4043-8955-c42e47ebc519 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:17.779466 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b4aaf82b-5077-4043-8955-c42e47ebc519 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:17.780042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b4aaf82b-5077-4043-8955-c42e47ebc519 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:17.780569 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b4aaf82b-5077-4043-8955-c42e47ebc519 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:18.093315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b4aaf82b-5077-4043-8955-c42e47ebc519 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e4ba59294f4529ba188e07cfc6681a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b687e3d75472bb38e672e90871a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:18.103474 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b4aaf82b-5077-4043-8955-c42e47ebc519 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] 10.222.0.26 "GET /compute/v2.1/servers/2b665d60-71ad-42ef-b99f-e87bc951ee62" status: 200 len: 1351 microversion: 2.1 time: 0.358726 Sep 17 21:03:18.113495 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1639/3177] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:17 2022] GET /compute/v2.1/servers/2b665d60-71ad-42ef-b99f-e87bc951ee62 => generated 1351 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:18.114032 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ff9a13e2-592c-4a5a-8e88-772568adb7a8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:18.114572 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ff9a13e2-592c-4a5a-8e88-772568adb7a8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:18.146278 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff9a13e2-592c-4a5a-8e88-772568adb7a8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:18.157161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff9a13e2-592c-4a5a-8e88-772568adb7a8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:18.162316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff9a13e2-592c-4a5a-8e88-772568adb7a8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:18.163340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff9a13e2-592c-4a5a-8e88-772568adb7a8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:18.164062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff9a13e2-592c-4a5a-8e88-772568adb7a8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:18.164912 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff9a13e2-592c-4a5a-8e88-772568adb7a8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:18.466488 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ff9a13e2-592c-4a5a-8e88-772568adb7a8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:18.486974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ff9a13e2-592c-4a5a-8e88-772568adb7a8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:18.495174 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ff9a13e2-592c-4a5a-8e88-772568adb7a8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:18.508741 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ff9a13e2-592c-4a5a-8e88-772568adb7a8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1486 microversion: 2.91 time: 0.402482 Sep 17 21:03:18.509940 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1640/3178] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:03:18 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1486 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:03:18.522361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-daaca418-bae9-409c-b49f-731bba9802a1 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:18.624247 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-daaca418-bae9-409c-b49f-731bba9802a1 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.112709 Sep 17 21:03:18.631116 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1641/3179] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Sep 17 21:03:18 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:18.636701 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ccde1109-3c90-4bc9-acde-5035c9e5507a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:18.638548 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ccde1109-3c90-4bc9-acde-5035c9e5507a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:18.654777 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ccde1109-3c90-4bc9-acde-5035c9e5507a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:18.662308 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ccde1109-3c90-4bc9-acde-5035c9e5507a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:18.662836 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ccde1109-3c90-4bc9-acde-5035c9e5507a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:18.663650 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ccde1109-3c90-4bc9-acde-5035c9e5507a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:18.664124 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ccde1109-3c90-4bc9-acde-5035c9e5507a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:18.664557 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ccde1109-3c90-4bc9-acde-5035c9e5507a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:19.188727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ccde1109-3c90-4bc9-acde-5035c9e5507a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:19.207576 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ccde1109-3c90-4bc9-acde-5035c9e5507a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1527 microversion: 2.1 time: 0.575022 Sep 17 21:03:19.208543 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1642/3180] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:18 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1527 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:19.220465 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bae4914c-285e-420f-9444-3d7c48d2f04d tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:19.310387 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bae4914c-285e-420f-9444-3d7c48d2f04d tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/1eac4460-e929-4251-a88d-3d7bbb4fb5a1" status: 204 len: 0 microversion: 2.1 time: 0.100368 Sep 17 21:03:19.314161 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1643/3181] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Sep 17 21:03:19 2022] DELETE /compute/v2.1/os-server-groups/1eac4460-e929-4251-a88d-3d7bbb4fb5a1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:03:19.326151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cfcb7d54-383b-45e3-aa18-fb48dac7f10d tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:19.334718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cfcb7d54-383b-45e3-aa18-fb48dac7f10d tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] [instance: a4ae0d78-1feb-462a-8eba-03a345099219] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:19.403067 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cfcb7d54-383b-45e3-aa18-fb48dac7f10d tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:19.403666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cfcb7d54-383b-45e3-aa18-fb48dac7f10d tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:19.408786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cfcb7d54-383b-45e3-aa18-fb48dac7f10d tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:19.412824 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cfcb7d54-383b-45e3-aa18-fb48dac7f10d tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:19.414145 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cfcb7d54-383b-45e3-aa18-fb48dac7f10d tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:19.414627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cfcb7d54-383b-45e3-aa18-fb48dac7f10d tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:19.822494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cfcb7d54-383b-45e3-aa18-fb48dac7f10d tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128155ce2ea242bd9d59ec188c57c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9877108f734092be1197672d500334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:19.830378 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cfcb7d54-383b-45e3-aa18-fb48dac7f10d tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219" status: 200 len: 1315 microversion: 2.1 time: 0.515017 Sep 17 21:03:19.830954 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1644/3182] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:19 2022] GET /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219 => generated 1315 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:19.850645 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-82366993-ed0a-4ea6-bcb4-898a9b3ae2d5 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:19.851524 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-82366993-ed0a-4ea6-bcb4-898a9b3ae2d5 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] [instance: 2b665d60-71ad-42ef-b99f-e87bc951ee62] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:19.857993 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-82366993-ed0a-4ea6-bcb4-898a9b3ae2d5 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:19.858715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-82366993-ed0a-4ea6-bcb4-898a9b3ae2d5 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:19.859325 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-82366993-ed0a-4ea6-bcb4-898a9b3ae2d5 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:19.860214 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-82366993-ed0a-4ea6-bcb4-898a9b3ae2d5 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:19.860825 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-82366993-ed0a-4ea6-bcb4-898a9b3ae2d5 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:19.861420 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-82366993-ed0a-4ea6-bcb4-898a9b3ae2d5 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:20.049718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-82366993-ed0a-4ea6-bcb4-898a9b3ae2d5 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e4ba59294f4529ba188e07cfc6681a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b687e3d75472bb38e672e90871a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:20.060309 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-82366993-ed0a-4ea6-bcb4-898a9b3ae2d5 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] 10.222.0.26 "GET /compute/v2.1/servers/2b665d60-71ad-42ef-b99f-e87bc951ee62" status: 200 len: 1542 microversion: 2.1 time: 0.213325 Sep 17 21:03:20.077841 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1645/3183] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:19 2022] GET /compute/v2.1/servers/2b665d60-71ad-42ef-b99f-e87bc951ee62 => generated 1542 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:20.090687 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-dc750df2-1db3-4375-aba5-2beb31d6e80b tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:20.117184 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-dc750df2-1db3-4375-aba5-2beb31d6e80b tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.040196 Sep 17 21:03:20.127767 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1646/3184] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Sep 17 21:03:20 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:20.150797 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ed4eff78-1ba7-48f4-bcfd-55262c0c249e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:20.157534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ed4eff78-1ba7-48f4-bcfd-55262c0c249e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:20.173326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed4eff78-1ba7-48f4-bcfd-55262c0c249e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:20.174234 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed4eff78-1ba7-48f4-bcfd-55262c0c249e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:20.174887 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed4eff78-1ba7-48f4-bcfd-55262c0c249e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:20.175720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed4eff78-1ba7-48f4-bcfd-55262c0c249e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:20.176465 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed4eff78-1ba7-48f4-bcfd-55262c0c249e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:20.177687 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed4eff78-1ba7-48f4-bcfd-55262c0c249e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:20.275964 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ed4eff78-1ba7-48f4-bcfd-55262c0c249e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:20.289082 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ed4eff78-1ba7-48f4-bcfd-55262c0c249e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:20.289483 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ed4eff78-1ba7-48f4-bcfd-55262c0c249e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:20.298117 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ed4eff78-1ba7-48f4-bcfd-55262c0c249e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1486 microversion: 2.91 time: 0.168490 Sep 17 21:03:20.310550 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1647/3185] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:03:20 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1486 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:03:20.321429 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d99aa1b1-3e60-419f-915b-c21358bc8a1e tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:20.321982 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d99aa1b1-3e60-419f-915b-c21358bc8a1e tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] [instance: 2b665d60-71ad-42ef-b99f-e87bc951ee62] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:20.329388 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d99aa1b1-3e60-419f-915b-c21358bc8a1e tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:20.329944 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d99aa1b1-3e60-419f-915b-c21358bc8a1e tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:20.330374 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d99aa1b1-3e60-419f-915b-c21358bc8a1e tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:20.331087 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d99aa1b1-3e60-419f-915b-c21358bc8a1e tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:20.331545 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d99aa1b1-3e60-419f-915b-c21358bc8a1e tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:20.331979 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d99aa1b1-3e60-419f-915b-c21358bc8a1e tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:20.447316 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d99aa1b1-3e60-419f-915b-c21358bc8a1e tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] 10.222.0.26 "GET /compute/v2.1/servers/2b665d60-71ad-42ef-b99f-e87bc951ee62/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.135533 Sep 17 21:03:20.448214 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1648/3186] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Sep 17 21:03:20 2022] GET /compute/v2.1/servers/2b665d60-71ad-42ef-b99f-e87bc951ee62/os-interface => generated 285 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:20.454065 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c7961499-30a5-42a9-adb7-eed4ae63d9c2 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Action: 'create', calling method: .version_select at 0x7f25a41f18b0>, body: {"server_group": {"name": "tempest-server-group-1415197937", "policies": ["affinity"]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:20.472010 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:20.503484 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-c7961499-30a5-42a9-adb7-eed4ae63d9c2 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Getting quotas for project d9024c27866542428191da960659ac2e. Resources: {'server_groups'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:03:20.536725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-c7961499-30a5-42a9-adb7-eed4ae63d9c2 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Getting quotas for user 43e3adea586f4772b39b62323b1cc911 and project d9024c27866542428191da960659ac2e. Resources: {'server_groups'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:03:20.685251 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-c7961499-30a5-42a9-adb7-eed4ae63d9c2 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Getting quotas for project d9024c27866542428191da960659ac2e. Resources: {'server_groups'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:03:20.712476 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-c7961499-30a5-42a9-adb7-eed4ae63d9c2 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Getting quotas for user 43e3adea586f4772b39b62323b1cc911 and project d9024c27866542428191da960659ac2e. Resources: {'server_groups'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:03:20.750949 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c7961499-30a5-42a9-adb7-eed4ae63d9c2 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.301451 Sep 17 21:03:20.752490 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1649/3187] 10.222.0.26 () {60 vars in 1173 bytes} [Sat Sep 17 21:03:20 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:20.758693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a7162da3-2902-41a4-a166-cb6013d9f5da tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:20.759624 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a7162da3-2902-41a4-a166-cb6013d9f5da tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:20.778127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7162da3-2902-41a4-a166-cb6013d9f5da tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:20.779012 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7162da3-2902-41a4-a166-cb6013d9f5da tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:20.784382 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7162da3-2902-41a4-a166-cb6013d9f5da tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:20.785856 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7162da3-2902-41a4-a166-cb6013d9f5da tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:20.787222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7162da3-2902-41a4-a166-cb6013d9f5da tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:20.788428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7162da3-2902-41a4-a166-cb6013d9f5da tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:20.813909 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dedb43bb-bf6d-4107-bcac-3736f52a0791 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/42ec7c80-ffce-4465-b7b6-d3b416e2913d" status: 200 len: 1462 microversion: 2.1 time: 13.378180 Sep 17 21:03:20.813909 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1539/3188] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:03:07 2022] GET /compute/v2.1/images/42ec7c80-ffce-4465-b7b6-d3b416e2913d => generated 1462 bytes in 13394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:20.832217 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8361e9d7-ee58-4337-906b-77a799bc87b2 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:20.935363 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8361e9d7-ee58-4337-906b-77a799bc87b2 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/faf0e7cb-376f-4672-bcd4-9c36565cf6a1" status: 204 len: 0 microversion: 2.1 time: 0.119784 Sep 17 21:03:20.939234 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1540/3189] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Sep 17 21:03:20 2022] DELETE /compute/v2.1/os-server-groups/faf0e7cb-376f-4672-bcd4-9c36565cf6a1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:03:20.951474 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7376b657-43b1-4f21-a59e-64f29e45e85f tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:20.954231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7376b657-43b1-4f21-a59e-64f29e45e85f tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:20.967652 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7376b657-43b1-4f21-a59e-64f29e45e85f tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:20.977694 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7376b657-43b1-4f21-a59e-64f29e45e85f tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:20.978417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7376b657-43b1-4f21-a59e-64f29e45e85f tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:20.979960 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7376b657-43b1-4f21-a59e-64f29e45e85f tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:20.981529 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7376b657-43b1-4f21-a59e-64f29e45e85f tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:20.982187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7376b657-43b1-4f21-a59e-64f29e45e85f tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:21.273794 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a7162da3-2902-41a4-a166-cb6013d9f5da tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:21.286428 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a7162da3-2902-41a4-a166-cb6013d9f5da tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1527 microversion: 2.1 time: 0.532587 Sep 17 21:03:21.289619 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1650/3190] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:20 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1527 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:21.305052 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-75683b6a-8926-4d37-b654-eaa8c0571735 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:21.311224 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-75683b6a-8926-4d37-b654-eaa8c0571735 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] [instance: a4ae0d78-1feb-462a-8eba-03a345099219] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:21.353110 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75683b6a-8926-4d37-b654-eaa8c0571735 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:21.359092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75683b6a-8926-4d37-b654-eaa8c0571735 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:21.359822 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75683b6a-8926-4d37-b654-eaa8c0571735 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:21.364060 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75683b6a-8926-4d37-b654-eaa8c0571735 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:21.367098 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75683b6a-8926-4d37-b654-eaa8c0571735 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:21.367786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75683b6a-8926-4d37-b654-eaa8c0571735 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:21.506012 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7376b657-43b1-4f21-a59e-64f29e45e85f tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc9559a966444d98e54edb4f948ae1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d42cba2664646f6adb4202574b7fa5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:21.517780 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7376b657-43b1-4f21-a59e-64f29e45e85f tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/servers/0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f" status: 200 len: 1466 microversion: 2.1 time: 0.576978 Sep 17 21:03:21.521440 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1541/3191] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:20 2022] GET /compute/v2.1/servers/0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f => generated 1466 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:21.527604 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-12c91b6f-53c8-44e3-80ed-fd8fda1f6495 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:21.546993 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-12c91b6f-53c8-44e3-80ed-fd8fda1f6495 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.023130 Sep 17 21:03:21.556249 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1542/3192] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Sep 17 21:03:21 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:21.563130 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4502d303-4ff4-4425-bbdf-98afcfbbaf01 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:21.564075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4502d303-4ff4-4425-bbdf-98afcfbbaf01 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:21.577411 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4502d303-4ff4-4425-bbdf-98afcfbbaf01 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:21.578214 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4502d303-4ff4-4425-bbdf-98afcfbbaf01 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:21.578855 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4502d303-4ff4-4425-bbdf-98afcfbbaf01 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:21.579902 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4502d303-4ff4-4425-bbdf-98afcfbbaf01 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:21.581138 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4502d303-4ff4-4425-bbdf-98afcfbbaf01 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:21.581953 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4502d303-4ff4-4425-bbdf-98afcfbbaf01 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:21.768155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4502d303-4ff4-4425-bbdf-98afcfbbaf01 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:21.785185 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4502d303-4ff4-4425-bbdf-98afcfbbaf01 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:21.790948 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4502d303-4ff4-4425-bbdf-98afcfbbaf01 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:21.813223 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4502d303-4ff4-4425-bbdf-98afcfbbaf01 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1486 microversion: 2.91 time: 0.255276 Sep 17 21:03:21.818955 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1543/3193] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:03:21 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1486 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:03:21.836388 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9f4cbcd3-993f-4cb9-b22f-0195887b60da tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a481de50>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:21.897351 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-75683b6a-8926-4d37-b654-eaa8c0571735 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128155ce2ea242bd9d59ec188c57c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9877108f734092be1197672d500334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:21.922797 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-75683b6a-8926-4d37-b654-eaa8c0571735 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219" status: 200 len: 1315 microversion: 2.1 time: 0.624490 Sep 17 21:03:21.926324 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1651/3194] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:21 2022] GET /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219 => generated 1315 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:21.952794 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9c1b4846-be4b-4326-b8fa-bff3ff07a232 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Action: 'create', calling method: .version_select at 0x7f25a4213820>, body: {"server_group": {"name": "tempest-server-group-70061206", "policies": ["anti-affinity"]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:21.975088 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-9c1b4846-be4b-4326-b8fa-bff3ff07a232 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Getting quotas for project d9024c27866542428191da960659ac2e. Resources: {'server_groups'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:03:21.987370 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-9c1b4846-be4b-4326-b8fa-bff3ff07a232 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Getting quotas for user 43e3adea586f4772b39b62323b1cc911 and project d9024c27866542428191da960659ac2e. Resources: {'server_groups'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:03:22.079094 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-9c1b4846-be4b-4326-b8fa-bff3ff07a232 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Getting quotas for project d9024c27866542428191da960659ac2e. Resources: {'server_groups'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:03:22.091906 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-9c1b4846-be4b-4326-b8fa-bff3ff07a232 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Getting quotas for user 43e3adea586f4772b39b62323b1cc911 and project d9024c27866542428191da960659ac2e. Resources: {'server_groups'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:03:22.113583 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9c1b4846-be4b-4326-b8fa-bff3ff07a232 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 167 microversion: 2.1 time: 0.174759 Sep 17 21:03:22.116995 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1652/3195] 10.222.0.26 () {60 vars in 1173 bytes} [Sat Sep 17 21:03:21 2022] POST /compute/v2.1/os-server-groups => generated 167 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:22.128616 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1c116740-fdf0-4efd-8190-c14c3e07ec7d tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:22.172592 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1c116740-fdf0-4efd-8190-c14c3e07ec7d tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/7fd361cc-8070-4bdf-bc8b-c85b29cd013d" status: 204 len: 0 microversion: 2.1 time: 0.048468 Sep 17 21:03:22.173190 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1653/3196] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Sep 17 21:03:22 2022] DELETE /compute/v2.1/os-server-groups/7fd361cc-8070-4bdf-bc8b-c85b29cd013d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 17 21:03:22.182764 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-876ee5be-d65f-4277-962e-9004b94ec0a9 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:22.201982 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9f4cbcd3-993f-4cb9-b22f-0195887b60da tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images?changes-since=2022-09-17T21%3A01%3A19Z" status: 200 len: 1902 microversion: 2.1 time: 0.380294 Sep 17 21:03:22.202204 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-876ee5be-d65f-4277-962e-9004b94ec0a9 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.024397 Sep 17 21:03:22.202586 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1544/3197] 10.222.0.26 () {58 vars in 1199 bytes} [Sat Sep 17 21:03:21 2022] GET /compute/v2.1/images?changes-since=2022-09-17T21%3A01%3A19Z => generated 1902 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:22.214483 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1654/3198] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Sep 17 21:03:22 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:03:22.227339 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f2a9b176-a102-4da4-b43f-b9e5942d89c0 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a5207af0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:22.275326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-48138eb1-afa8-4b73-b52f-881e668f8d4e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-275540234", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "04b99429-908e-4384-81d4-c258d0b7883a"}]}, "os:scheduler_hints": {"group": "60bdd01e-fc73-4ec5-9949-73c31be90c18"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:22.599801 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f2a9b176-a102-4da4-b43f-b9e5942d89c0 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1576536647" status: 200 len: 485 microversion: 2.1 time: 0.386118 Sep 17 21:03:22.603376 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1545/3199] 10.222.0.26 () {58 vars in 1231 bytes} [Sat Sep 17 21:03:22 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1576536647 => generated 485 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:22.615560 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-21f8d832-4fa0-48b4-9476-c5f6aa1fc6a9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:22.617559 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-21f8d832-4fa0-48b4-9476-c5f6aa1fc6a9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:22.631493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21f8d832-4fa0-48b4-9476-c5f6aa1fc6a9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:22.635523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21f8d832-4fa0-48b4-9476-c5f6aa1fc6a9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:22.637593 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21f8d832-4fa0-48b4-9476-c5f6aa1fc6a9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:22.639151 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21f8d832-4fa0-48b4-9476-c5f6aa1fc6a9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:22.640377 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21f8d832-4fa0-48b4-9476-c5f6aa1fc6a9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:22.640984 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21f8d832-4fa0-48b4-9476-c5f6aa1fc6a9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:22.744636 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-48138eb1-afa8-4b73-b52f-881e668f8d4e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] validate_networks() for [('04b99429-908e-4384-81d4-c258d0b7883a', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:03:23.261870 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-21f8d832-4fa0-48b4-9476-c5f6aa1fc6a9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:23.273497 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-21f8d832-4fa0-48b4-9476-c5f6aa1fc6a9 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1509 microversion: 2.1 time: 0.667367 Sep 17 21:03:23.274396 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1546/3200] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:22 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1509 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:23.282295 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0596f674-5595-4bcc-9d04-72ae33b714f5 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a49deca0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:23.536962 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0596f674-5595-4bcc-9d04-72ae33b714f5 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images?server=0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f" status: 200 len: 957 microversion: 2.1 time: 0.261240 Sep 17 21:03:23.549216 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1547/3201] 10.222.0.26 () {58 vars in 1209 bytes} [Sat Sep 17 21:03:23 2022] GET /compute/v2.1/images?server=0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f => generated 957 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:23.575040 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-8a9faca6-1028-42fa-877f-96e3e0b25953 req-90d09b49-1954-44b9-a56a-22f3c4958aeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4ae0d78-1feb-462a-8eba-03a345099219", "name": "network-vif-plugged", "status": "completed", "tag": "d54cdb25-5384-4cca-ab82-3c54e65b0c39"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:23.603578 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8a9faca6-1028-42fa-877f-96e3e0b25953 req-90d09b49-1954-44b9-a56a-22f3c4958aeb service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:23.608768 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8a9faca6-1028-42fa-877f-96e3e0b25953 req-90d09b49-1954-44b9-a56a-22f3c4958aeb service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:23.613053 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8a9faca6-1028-42fa-877f-96e3e0b25953 req-90d09b49-1954-44b9-a56a-22f3c4958aeb service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:23.615267 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-48138eb1-afa8-4b73-b52f-881e668f8d4e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:03:23.616590 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-48138eb1-afa8-4b73-b52f-881e668f8d4e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:03:23.617857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-48138eb1-afa8-4b73-b52f-881e668f8d4e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:03:23.618959 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-48138eb1-afa8-4b73-b52f-881e668f8d4e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:03:23.619554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-48138eb1-afa8-4b73-b52f-881e668f8d4e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:03:23.638188 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-8a9faca6-1028-42fa-877f-96e3e0b25953 req-90d09b49-1954-44b9-a56a-22f3c4958aeb service nova] Creating event network-vif-plugged:d54cdb25-5384-4cca-ab82-3c54e65b0c39 for instance a4ae0d78-1feb-462a-8eba-03a345099219 on nch1-master-1 Sep 17 21:03:23.644330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-48138eb1-afa8-4b73-b52f-881e668f8d4e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:23.645078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-48138eb1-afa8-4b73-b52f-881e668f8d4e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:23.647206 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-48138eb1-afa8-4b73-b52f-881e668f8d4e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:23.651142 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-8a9faca6-1028-42fa-877f-96e3e0b25953 req-90d09b49-1954-44b9-a56a-22f3c4958aeb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088320 Sep 17 21:03:23.652063 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1548/3202] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:23.653358 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-48138eb1-afa8-4b73-b52f-881e668f8d4e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:23.657080 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-48138eb1-afa8-4b73-b52f-881e668f8d4e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:23.657781 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-48138eb1-afa8-4b73-b52f-881e668f8d4e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:23.663130 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-75186823-8f4c-4837-9f41-b7fed2940aed tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:23.665739 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-75186823-8f4c-4837-9f41-b7fed2940aed tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:23.675531 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75186823-8f4c-4837-9f41-b7fed2940aed tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:23.682424 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-48138eb1-afa8-4b73-b52f-881e668f8d4e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Getting quotas for project d9024c27866542428191da960659ac2e. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:03:23.685650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75186823-8f4c-4837-9f41-b7fed2940aed tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:23.687917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75186823-8f4c-4837-9f41-b7fed2940aed tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:23.690702 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75186823-8f4c-4837-9f41-b7fed2940aed tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:23.692955 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75186823-8f4c-4837-9f41-b7fed2940aed tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:23.695917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75186823-8f4c-4837-9f41-b7fed2940aed tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:23.696827 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-48138eb1-afa8-4b73-b52f-881e668f8d4e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Getting quotas for user 43e3adea586f4772b39b62323b1cc911 and project d9024c27866542428191da960659ac2e. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:03:23.712534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-48138eb1-afa8-4b73-b52f-881e668f8d4e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:03:23.715330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-48138eb1-afa8-4b73-b52f-881e668f8d4e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] [instance: c7fa190d-89fe-4b34-b3a5-955cd2ece041] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:03:23.769241 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-48138eb1-afa8-4b73-b52f-881e668f8d4e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=140524) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 17 21:03:23.805850 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-48138eb1-afa8-4b73-b52f-881e668f8d4e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Getting quotas for project d9024c27866542428191da960659ac2e. Resources: {'server_group_members'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:03:23.813576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-48138eb1-afa8-4b73-b52f-881e668f8d4e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Getting quotas for user 43e3adea586f4772b39b62323b1cc911 and project d9024c27866542428191da960659ac2e. Resources: {'server_group_members'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:03:23.848780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8,nova_api:DELETE=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:23.852288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-75186823-8f4c-4837-9f41-b7fed2940aed tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:23.861857 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-75186823-8f4c-4837-9f41-b7fed2940aed tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:23.864130 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-75186823-8f4c-4837-9f41-b7fed2940aed tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:23.884746 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-48138eb1-afa8-4b73-b52f-881e668f8d4e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Getting quotas for project d9024c27866542428191da960659ac2e. Resources: {'server_group_members'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:03:23.885193 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-75186823-8f4c-4837-9f41-b7fed2940aed tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1544 microversion: 2.91 time: 0.230912 Sep 17 21:03:23.897768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-48138eb1-afa8-4b73-b52f-881e668f8d4e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Getting quotas for user 43e3adea586f4772b39b62323b1cc911 and project d9024c27866542428191da960659ac2e. Resources: {'server_group_members'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:03:23.898576 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1549/3203] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:03:23 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1544 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:03:23.914176 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e80eda04-2c7c-4de5-9e1d-78036ab7fca4 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:23.915029 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e80eda04-2c7c-4de5-9e1d-78036ab7fca4 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] [instance: a4ae0d78-1feb-462a-8eba-03a345099219] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:23.921389 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e80eda04-2c7c-4de5-9e1d-78036ab7fca4 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:23.922166 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e80eda04-2c7c-4de5-9e1d-78036ab7fca4 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:23.922785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e80eda04-2c7c-4de5-9e1d-78036ab7fca4 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:23.923640 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e80eda04-2c7c-4de5-9e1d-78036ab7fca4 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:23.924241 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e80eda04-2c7c-4de5-9e1d-78036ab7fca4 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:23.924831 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e80eda04-2c7c-4de5-9e1d-78036ab7fca4 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:23.963571 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-48138eb1-afa8-4b73-b52f-881e668f8d4e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.693270 Sep 17 21:03:23.964326 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1655/3204] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:03:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:03:23.975718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f5a772a2-0f7c-462c-8fac-ca920215b370 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a414e9d0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:24.174686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e80eda04-2c7c-4de5-9e1d-78036ab7fca4 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128155ce2ea242bd9d59ec188c57c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9877108f734092be1197672d500334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:24.203537 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e80eda04-2c7c-4de5-9e1d-78036ab7fca4 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219" status: 200 len: 1315 microversion: 2.1 time: 0.298022 Sep 17 21:03:24.204174 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1550/3205] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:23 2022] GET /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:24.232330 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-53d85868-de5f-4b3f-acb3-674e40413306 req-24ab4167-a406-4350-b9e2-84a42cdd8771 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b665d60-71ad-42ef-b99f-e87bc951ee62", "tag": "61bbacbc-0b60-4739-bc1b-37474f73a3e4"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:24.249941 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-53d85868-de5f-4b3f-acb3-674e40413306 req-24ab4167-a406-4350-b9e2-84a42cdd8771 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:24.250821 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-53d85868-de5f-4b3f-acb3-674e40413306 req-24ab4167-a406-4350-b9e2-84a42cdd8771 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:24.253025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-53d85868-de5f-4b3f-acb3-674e40413306 req-24ab4167-a406-4350-b9e2-84a42cdd8771 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:24.280218 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-53d85868-de5f-4b3f-acb3-674e40413306 req-24ab4167-a406-4350-b9e2-84a42cdd8771 service nova] Creating event network-changed:61bbacbc-0b60-4739-bc1b-37474f73a3e4 for instance 2b665d60-71ad-42ef-b99f-e87bc951ee62 on nch2-master-1 Sep 17 21:03:24.286379 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-53d85868-de5f-4b3f-acb3-674e40413306 req-24ab4167-a406-4350-b9e2-84a42cdd8771 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063232 Sep 17 21:03:24.291577 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1551/3206] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:24.300099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1b4195e8-a432-4aca-81b8-87244059ba45 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:24.301043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1b4195e8-a432-4aca-81b8-87244059ba45 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] [instance: c7fa190d-89fe-4b34-b3a5-955cd2ece041] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:24.504881 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1b4195e8-a432-4aca-81b8-87244059ba45 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e3adea586f4772b39b62323b1cc911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9024c27866542428191da960659ac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:24.517863 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1b4195e8-a432-4aca-81b8-87244059ba45 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041" status: 200 len: 1212 microversion: 2.1 time: 0.224357 Sep 17 21:03:24.529639 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1552/3207] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:24 2022] GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041 => generated 1212 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:24.558708 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-da706a20-2079-4ec4-ad3e-b6d37761eace tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:24.559914 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-da706a20-2079-4ec4-ad3e-b6d37761eace tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:24.587959 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da706a20-2079-4ec4-ad3e-b6d37761eace tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:24.594306 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da706a20-2079-4ec4-ad3e-b6d37761eace tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:24.595013 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da706a20-2079-4ec4-ad3e-b6d37761eace tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:24.600388 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da706a20-2079-4ec4-ad3e-b6d37761eace tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:24.601202 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da706a20-2079-4ec4-ad3e-b6d37761eace tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:24.612225 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da706a20-2079-4ec4-ad3e-b6d37761eace tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:25.617767 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-da706a20-2079-4ec4-ad3e-b6d37761eace tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:25.647258 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-da706a20-2079-4ec4-ad3e-b6d37761eace tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1509 microversion: 2.1 time: 1.104139 Sep 17 21:03:25.648305 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1553/3208] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:24 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1509 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:25.663413 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e177960c-dad1-4c5d-ab72-f22f87135df8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:25.664678 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e177960c-dad1-4c5d-ab72-f22f87135df8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:25.699828 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e177960c-dad1-4c5d-ab72-f22f87135df8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:25.715321 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e177960c-dad1-4c5d-ab72-f22f87135df8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:25.716938 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e177960c-dad1-4c5d-ab72-f22f87135df8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:25.723110 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e177960c-dad1-4c5d-ab72-f22f87135df8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:25.727162 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e177960c-dad1-4c5d-ab72-f22f87135df8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:25.731136 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e177960c-dad1-4c5d-ab72-f22f87135df8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:25.938400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e177960c-dad1-4c5d-ab72-f22f87135df8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:25.949333 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e177960c-dad1-4c5d-ab72-f22f87135df8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:25.953584 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e177960c-dad1-4c5d-ab72-f22f87135df8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:25.975648 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e177960c-dad1-4c5d-ab72-f22f87135df8 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1544 microversion: 2.91 time: 0.325345 Sep 17 21:03:25.999241 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1554/3209] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:03:25 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1544 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:03:26.004693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-586aa072-58cb-4507-a57f-c3ac0e8d91f4 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:26.005640 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-586aa072-58cb-4507-a57f-c3ac0e8d91f4 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] [instance: a4ae0d78-1feb-462a-8eba-03a345099219] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:26.012610 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-586aa072-58cb-4507-a57f-c3ac0e8d91f4 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:26.013787 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-586aa072-58cb-4507-a57f-c3ac0e8d91f4 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:26.014611 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-586aa072-58cb-4507-a57f-c3ac0e8d91f4 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:26.015788 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-586aa072-58cb-4507-a57f-c3ac0e8d91f4 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:26.016488 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-586aa072-58cb-4507-a57f-c3ac0e8d91f4 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:26.017155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-586aa072-58cb-4507-a57f-c3ac0e8d91f4 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:26.387453 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-586aa072-58cb-4507-a57f-c3ac0e8d91f4 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128155ce2ea242bd9d59ec188c57c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9877108f734092be1197672d500334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:26.400054 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-586aa072-58cb-4507-a57f-c3ac0e8d91f4 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219" status: 200 len: 1315 microversion: 2.1 time: 0.399380 Sep 17 21:03:26.423012 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1555/3210] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:25 2022] GET /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219 => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:26.429243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dba470fe-4724-4f42-bdd7-bdb6b1cace4e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:26.430835 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dba470fe-4724-4f42-bdd7-bdb6b1cace4e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] [instance: c7fa190d-89fe-4b34-b3a5-955cd2ece041] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:26.452726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dba470fe-4724-4f42-bdd7-bdb6b1cace4e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:26.454423 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dba470fe-4724-4f42-bdd7-bdb6b1cace4e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:26.455171 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dba470fe-4724-4f42-bdd7-bdb6b1cace4e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:26.456115 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dba470fe-4724-4f42-bdd7-bdb6b1cace4e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:26.456817 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dba470fe-4724-4f42-bdd7-bdb6b1cace4e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:26.457479 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dba470fe-4724-4f42-bdd7-bdb6b1cace4e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:26.651997 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dba470fe-4724-4f42-bdd7-bdb6b1cace4e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e3adea586f4772b39b62323b1cc911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9024c27866542428191da960659ac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:26.662234 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dba470fe-4724-4f42-bdd7-bdb6b1cace4e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041" status: 200 len: 1208 microversion: 2.1 time: 0.237073 Sep 17 21:03:26.663103 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1556/3211] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:26 2022] GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041 => generated 1208 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:26.681720 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-80dd3005-5d68-4b81-86af-30ff2863bfd4 req-25229ccc-9bb3-4381-a3af-eb02127aa786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b986fa2-07ea-4418-adf2-0a5fa127e84a", "name": "network-vif-unplugged", "status": "completed", "tag": "f698d869-5f6d-4d34-95fa-00bb9569ec58"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:26.702747 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-80dd3005-5d68-4b81-86af-30ff2863bfd4 req-25229ccc-9bb3-4381-a3af-eb02127aa786 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:26.703614 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-80dd3005-5d68-4b81-86af-30ff2863bfd4 req-25229ccc-9bb3-4381-a3af-eb02127aa786 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:26.704144 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-80dd3005-5d68-4b81-86af-30ff2863bfd4 req-25229ccc-9bb3-4381-a3af-eb02127aa786 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:26.722097 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-80dd3005-5d68-4b81-86af-30ff2863bfd4 req-25229ccc-9bb3-4381-a3af-eb02127aa786 service nova] Creating event network-vif-unplugged:f698d869-5f6d-4d34-95fa-00bb9569ec58 for instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a on nch1-master-1 Sep 17 21:03:26.727587 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-80dd3005-5d68-4b81-86af-30ff2863bfd4 req-25229ccc-9bb3-4381-a3af-eb02127aa786 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062952 Sep 17 21:03:26.728940 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1557/3212] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:26.736369 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cd782287-bab7-4731-85b6-db1aa0a001bb tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:26.737867 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cd782287-bab7-4731-85b6-db1aa0a001bb tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:26.746267 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd782287-bab7-4731-85b6-db1aa0a001bb tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:26.747252 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd782287-bab7-4731-85b6-db1aa0a001bb tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:26.748041 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd782287-bab7-4731-85b6-db1aa0a001bb tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:26.749168 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd782287-bab7-4731-85b6-db1aa0a001bb tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:26.749940 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd782287-bab7-4731-85b6-db1aa0a001bb tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:26.750924 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd782287-bab7-4731-85b6-db1aa0a001bb tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:26.964825 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cd782287-bab7-4731-85b6-db1aa0a001bb tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:27.006777 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cd782287-bab7-4731-85b6-db1aa0a001bb tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1512 microversion: 2.1 time: 0.276146 Sep 17 21:03:27.009968 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1558/3213] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:26 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1512 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:27.015922 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b3d195d6-e130-4a1d-b658-2c0ab207b639 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:27.017035 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b3d195d6-e130-4a1d-b658-2c0ab207b639 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:27.026853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3d195d6-e130-4a1d-b658-2c0ab207b639 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:27.027985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3d195d6-e130-4a1d-b658-2c0ab207b639 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:27.028693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3d195d6-e130-4a1d-b658-2c0ab207b639 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:27.029923 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3d195d6-e130-4a1d-b658-2c0ab207b639 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:27.030669 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3d195d6-e130-4a1d-b658-2c0ab207b639 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:27.031398 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3d195d6-e130-4a1d-b658-2c0ab207b639 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:27.211687 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b3d195d6-e130-4a1d-b658-2c0ab207b639 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:27.224864 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b3d195d6-e130-4a1d-b658-2c0ab207b639 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:27.227867 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b3d195d6-e130-4a1d-b658-2c0ab207b639 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:27.235796 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b3d195d6-e130-4a1d-b658-2c0ab207b639 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1544 microversion: 2.91 time: 0.224507 Sep 17 21:03:27.238193 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1559/3214] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:03:27 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1544 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:03:27.256863 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9b2781f7-b82c-43d2-b671-dc95a97d5056 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:27.258516 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9b2781f7-b82c-43d2-b671-dc95a97d5056 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:27.273244 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b2781f7-b82c-43d2-b671-dc95a97d5056 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:27.274099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b2781f7-b82c-43d2-b671-dc95a97d5056 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:27.276741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b2781f7-b82c-43d2-b671-dc95a97d5056 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:27.279536 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b2781f7-b82c-43d2-b671-dc95a97d5056 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:27.280448 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b2781f7-b82c-43d2-b671-dc95a97d5056 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:27.283443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b2781f7-b82c-43d2-b671-dc95a97d5056 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:27.540356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9b2781f7-b82c-43d2-b671-dc95a97d5056 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:27.553596 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9b2781f7-b82c-43d2-b671-dc95a97d5056 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1512 microversion: 2.1 time: 0.313886 Sep 17 21:03:27.574684 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1560/3215] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:27 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1512 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:27.590569 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e94e8886-a443-4503-a538-98807153876d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:27.591242 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e94e8886-a443-4503-a538-98807153876d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:27.603403 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e94e8886-a443-4503-a538-98807153876d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:27.603871 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e94e8886-a443-4503-a538-98807153876d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:27.604346 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e94e8886-a443-4503-a538-98807153876d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:27.606198 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e94e8886-a443-4503-a538-98807153876d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:27.607012 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e94e8886-a443-4503-a538-98807153876d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:27.607647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e94e8886-a443-4503-a538-98807153876d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:27.820287 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e94e8886-a443-4503-a538-98807153876d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:27.832323 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e94e8886-a443-4503-a538-98807153876d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1684 microversion: 2.1 time: 0.256123 Sep 17 21:03:27.832842 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1561/3216] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:27 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1684 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:27.846336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-30fcca92-d4db-46bd-b113-ff778409f5e2 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:27.846990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-30fcca92-d4db-46bd-b113-ff778409f5e2 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] [instance: a4ae0d78-1feb-462a-8eba-03a345099219] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:27.865218 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30fcca92-d4db-46bd-b113-ff778409f5e2 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:27.870128 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30fcca92-d4db-46bd-b113-ff778409f5e2 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:27.871710 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30fcca92-d4db-46bd-b113-ff778409f5e2 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:27.875304 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30fcca92-d4db-46bd-b113-ff778409f5e2 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:27.877631 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30fcca92-d4db-46bd-b113-ff778409f5e2 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:27.878276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30fcca92-d4db-46bd-b113-ff778409f5e2 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:28.068917 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f5a772a2-0f7c-462c-8fac-ca920215b370 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fv2.1%2Fservers%2F66779798-999a-4a63-98dd-bf7fa71ce4b1" status: 200 len: 485 microversion: 2.1 time: 4.101455 Sep 17 21:03:28.070859 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1656/3217] 10.222.0.26 () {58 vars in 1317 bytes} [Sat Sep 17 21:03:23 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fv2.1%2Fservers%2F66779798-999a-4a63-98dd-bf7fa71ce4b1 => generated 485 bytes in 4106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:28.094253 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-48ccc372-cf3d-4f5d-b113-b158032a82f2 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:28.096170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-48ccc372-cf3d-4f5d-b113-b158032a82f2 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] [instance: c7fa190d-89fe-4b34-b3a5-955cd2ece041] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:28.120065 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-48ccc372-cf3d-4f5d-b113-b158032a82f2 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:28.122448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-48ccc372-cf3d-4f5d-b113-b158032a82f2 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:28.125592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-48ccc372-cf3d-4f5d-b113-b158032a82f2 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:28.127633 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-48ccc372-cf3d-4f5d-b113-b158032a82f2 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:28.130424 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-48ccc372-cf3d-4f5d-b113-b158032a82f2 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:28.132727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-48ccc372-cf3d-4f5d-b113-b158032a82f2 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:28.196549 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-30fcca92-d4db-46bd-b113-ff778409f5e2 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128155ce2ea242bd9d59ec188c57c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9877108f734092be1197672d500334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:28.207139 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-30fcca92-d4db-46bd-b113-ff778409f5e2 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219" status: 200 len: 1503 microversion: 2.1 time: 0.373021 Sep 17 21:03:28.207741 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1562/3218] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:27 2022] GET /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219 => generated 1503 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:28.238774 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-67830f30-eaad-4b25-a512-a60835b28f1c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:28.241330 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-67830f30-eaad-4b25-a512-a60835b28f1c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:28.273752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67830f30-eaad-4b25-a512-a60835b28f1c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:28.275903 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67830f30-eaad-4b25-a512-a60835b28f1c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:28.277179 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-48ccc372-cf3d-4f5d-b113-b158032a82f2 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e3adea586f4772b39b62323b1cc911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9024c27866542428191da960659ac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:28.279984 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67830f30-eaad-4b25-a512-a60835b28f1c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:28.281160 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67830f30-eaad-4b25-a512-a60835b28f1c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:28.282338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67830f30-eaad-4b25-a512-a60835b28f1c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:28.283314 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67830f30-eaad-4b25-a512-a60835b28f1c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:28.288973 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-48ccc372-cf3d-4f5d-b113-b158032a82f2 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041" status: 200 len: 1264 microversion: 2.1 time: 0.214499 Sep 17 21:03:28.324702 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1657/3219] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:28 2022] GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041 => generated 1264 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:28.344063 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e8350b02-150e-4319-97f8-ebc82ff5257b tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a418c700>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:28.355458 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-67830f30-eaad-4b25-a512-a60835b28f1c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lazy-loading 'flavor' on Instance uuid 9b986fa2-07ea-4418-adf2-0a5fa127e84a {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:03:28.392025 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-67830f30-eaad-4b25-a512-a60835b28f1c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Cannot 'shelve' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state shelved_offloaded Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-67830f30-eaad-4b25-a512-a60835b28f1c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a/action HTTP/1.1 Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 14 Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: {"shelve": {}} Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: exception: Cannot 'shelve' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state shelved_offloaded Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '9b986fa2-07ea-4418-adf2-0a5fa127e84a', 'body': {'shelve': {}}} Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 17 21:03:28.397194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 17 21:03:28.402398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state shelved_offloaded Sep 17 21:03:28.402398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:03:28.402398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:03:28.402398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:03:28.402398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:03:28.402398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:03:28.402398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:03:28.402398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:03:28.402398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:03:28.402398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state shelved_offloaded Sep 17 21:03:28.402398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:03:28.407628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-67830f30-eaad-4b25-a512-a60835b28f1c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 409 to user: Cannot 'shelve' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state shelved_offloaded {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:03:28.409508 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-67830f30-eaad-4b25-a512-a60835b28f1c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a/action" status: 409 len: 155 microversion: 2.1 time: 0.176868 Sep 17 21:03:28.416421 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1563/3220] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:03:28 2022] POST /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a/action => generated 155 bytes in 191 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 17 21:03:28.429964 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2b7d92cc-c740-4063-a950-3dfcab8da134 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:28.441501 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2b7d92cc-c740-4063-a950-3dfcab8da134 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] [instance: a4ae0d78-1feb-462a-8eba-03a345099219] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:28.455866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b7d92cc-c740-4063-a950-3dfcab8da134 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:28.460139 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b7d92cc-c740-4063-a950-3dfcab8da134 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:28.460610 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b7d92cc-c740-4063-a950-3dfcab8da134 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:28.461758 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b7d92cc-c740-4063-a950-3dfcab8da134 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:28.462236 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b7d92cc-c740-4063-a950-3dfcab8da134 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:28.462666 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b7d92cc-c740-4063-a950-3dfcab8da134 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:28.504911 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:28.515705 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2b7d92cc-c740-4063-a950-3dfcab8da134 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] [instance: a4ae0d78-1feb-462a-8eba-03a345099219] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:03:28.600704 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e8350b02-150e-4319-97f8-ebc82ff5257b tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fservers%2F66779798-999a-4a63-98dd-bf7fa71ce4b1" status: 200 len: 485 microversion: 2.1 time: 0.271129 Sep 17 21:03:28.607607 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1658/3221] 10.222.0.26 () {58 vars in 1303 bytes} [Sat Sep 17 21:03:28 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fservers%2F66779798-999a-4a63-98dd-bf7fa71ce4b1 => generated 485 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:28.638510 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d6f42990-ba90-496d-bd2f-871eda796e3a tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:28.644221 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d6f42990-ba90-496d-bd2f-871eda796e3a tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:28.672121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d6f42990-ba90-496d-bd2f-871eda796e3a tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:28.675412 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d6f42990-ba90-496d-bd2f-871eda796e3a tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:28.679094 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d6f42990-ba90-496d-bd2f-871eda796e3a tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:28.680174 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d6f42990-ba90-496d-bd2f-871eda796e3a tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:28.681703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d6f42990-ba90-496d-bd2f-871eda796e3a tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:28.685860 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d6f42990-ba90-496d-bd2f-871eda796e3a tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:28.773264 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2b7d92cc-c740-4063-a950-3dfcab8da134 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219" status: 204 len: 0 microversion: 2.1 time: 0.353711 Sep 17 21:03:28.777113 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1564/3222] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:03:28 2022] DELETE /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:03:28.812667 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-01160273-97fb-48d0-9f6b-d1fc13a25365 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:28.817901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-01160273-97fb-48d0-9f6b-d1fc13a25365 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:28.831339 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01160273-97fb-48d0-9f6b-d1fc13a25365 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:28.832657 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01160273-97fb-48d0-9f6b-d1fc13a25365 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:28.834689 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01160273-97fb-48d0-9f6b-d1fc13a25365 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:28.835751 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01160273-97fb-48d0-9f6b-d1fc13a25365 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:28.836223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01160273-97fb-48d0-9f6b-d1fc13a25365 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:28.836657 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01160273-97fb-48d0-9f6b-d1fc13a25365 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:28.857297 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d6f42990-ba90-496d-bd2f-871eda796e3a tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:28.865790 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:28.873667 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d6f42990-ba90-496d-bd2f-871eda796e3a tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:28.877301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d6f42990-ba90-496d-bd2f-871eda796e3a tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:28.894290 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d6f42990-ba90-496d-bd2f-871eda796e3a tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1544 microversion: 2.91 time: 0.272983 Sep 17 21:03:28.897871 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1659/3223] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:03:28 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1544 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:03:28.902805 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-05497c80-a837-427c-8bb5-035168e86cfb tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a415d700>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:28.928395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-01160273-97fb-48d0-9f6b-d1fc13a25365 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=140523) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 17 21:03:29.094688 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-01160273-97fb-48d0-9f6b-d1fc13a25365 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a/action" status: 202 len: 0 microversion: 2.1 time: 0.313189 Sep 17 21:03:29.095680 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1565/3224] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:03:28 2022] POST /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:03:29.106847 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6f522f00-2a4e-40ba-8fb7-379abe54feb0 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:29.108518 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-05497c80-a837-427c-8bb5-035168e86cfb tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.209133 Sep 17 21:03:29.109015 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6f522f00-2a4e-40ba-8fb7-379abe54feb0 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] [instance: a4ae0d78-1feb-462a-8eba-03a345099219] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:29.109815 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1660/3225] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Sep 17 21:03:28 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:29.121301 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6f522f00-2a4e-40ba-8fb7-379abe54feb0 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:29.121844 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6f522f00-2a4e-40ba-8fb7-379abe54feb0 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:29.122449 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6f522f00-2a4e-40ba-8fb7-379abe54feb0 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:29.123187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6f522f00-2a4e-40ba-8fb7-379abe54feb0 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:29.124007 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6f522f00-2a4e-40ba-8fb7-379abe54feb0 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:29.124454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6f522f00-2a4e-40ba-8fb7-379abe54feb0 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:29.126631 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-42a32d51-53a1-463c-b30b-107e186063ff tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:29.127263 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-42a32d51-53a1-463c-b30b-107e186063ff tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:29.142666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42a32d51-53a1-463c-b30b-107e186063ff tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:29.143547 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42a32d51-53a1-463c-b30b-107e186063ff tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:29.144441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42a32d51-53a1-463c-b30b-107e186063ff tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:29.145621 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42a32d51-53a1-463c-b30b-107e186063ff tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:29.146399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42a32d51-53a1-463c-b30b-107e186063ff tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:29.153879 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42a32d51-53a1-463c-b30b-107e186063ff tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:29.474310 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6f522f00-2a4e-40ba-8fb7-379abe54feb0 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128155ce2ea242bd9d59ec188c57c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9877108f734092be1197672d500334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:29.489692 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6f522f00-2a4e-40ba-8fb7-379abe54feb0 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219" status: 200 len: 1509 microversion: 2.1 time: 0.392796 Sep 17 21:03:29.497563 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1566/3226] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:29 2022] GET /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219 => generated 1509 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:29.512836 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-17e225f2-bb41-4714-bcf3-2adde3b77186 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:29.513991 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-17e225f2-bb41-4714-bcf3-2adde3b77186 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:29.525000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17e225f2-bb41-4714-bcf3-2adde3b77186 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:29.525924 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17e225f2-bb41-4714-bcf3-2adde3b77186 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:29.526523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17e225f2-bb41-4714-bcf3-2adde3b77186 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:29.527417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17e225f2-bb41-4714-bcf3-2adde3b77186 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:29.528147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17e225f2-bb41-4714-bcf3-2adde3b77186 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:29.528729 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17e225f2-bb41-4714-bcf3-2adde3b77186 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:29.538256 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-42a32d51-53a1-463c-b30b-107e186063ff tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:29.554525 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-42a32d51-53a1-463c-b30b-107e186063ff tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.443464 Sep 17 21:03:29.555357 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1661/3227] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:29 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:29.567293 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a301b055-c525-4867-9cb6-db630db4f5ec tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a41b48b0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:29.735530 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a301b055-c525-4867-9cb6-db630db4f5ec tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.157797 Sep 17 21:03:29.750709 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1662/3228] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Sep 17 21:03:29 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:29.766116 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e1fca665-bed2-4ffd-aa1a-72bdcfe91b8f tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:29.766908 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e1fca665-bed2-4ffd-aa1a-72bdcfe91b8f tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] [instance: c7fa190d-89fe-4b34-b3a5-955cd2ece041] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:29.777828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1fca665-bed2-4ffd-aa1a-72bdcfe91b8f tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:29.778500 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1fca665-bed2-4ffd-aa1a-72bdcfe91b8f tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:29.779312 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1fca665-bed2-4ffd-aa1a-72bdcfe91b8f tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:29.780210 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1fca665-bed2-4ffd-aa1a-72bdcfe91b8f tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:29.781025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1fca665-bed2-4ffd-aa1a-72bdcfe91b8f tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:29.781722 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1fca665-bed2-4ffd-aa1a-72bdcfe91b8f tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:29.848783 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-17e225f2-bb41-4714-bcf3-2adde3b77186 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:29.863866 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-17e225f2-bb41-4714-bcf3-2adde3b77186 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1460 microversion: 2.1 time: 0.371611 Sep 17 21:03:29.878153 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1567/3229] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:29 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1460 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:29.878928 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7cab80ec-c75e-433a-b125-347746f8aaab tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1461690823"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:29.887244 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7cab80ec-c75e-433a-b125-347746f8aaab tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:29.908432 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cab80ec-c75e-433a-b125-347746f8aaab tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:29.910420 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cab80ec-c75e-433a-b125-347746f8aaab tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:29.910984 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cab80ec-c75e-433a-b125-347746f8aaab tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:29.914262 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cab80ec-c75e-433a-b125-347746f8aaab tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:29.916061 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cab80ec-c75e-433a-b125-347746f8aaab tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:29.918946 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cab80ec-c75e-433a-b125-347746f8aaab tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:29.957950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e1fca665-bed2-4ffd-aa1a-72bdcfe91b8f tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e3adea586f4772b39b62323b1cc911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9024c27866542428191da960659ac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:30.000758 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e1fca665-bed2-4ffd-aa1a-72bdcfe91b8f tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041" status: 200 len: 1264 microversion: 2.1 time: 0.226052 Sep 17 21:03:30.001558 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1663/3230] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:29 2022] GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041 => generated 1264 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:30.034616 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f79f27ec-b473-4a6c-8b55-6c4989449b58 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a431d5e0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:30.426186 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f79f27ec-b473-4a6c-8b55-6c4989449b58 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.407662 Sep 17 21:03:30.428675 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1664/3231] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Sep 17 21:03:30 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:30.450225 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-77bc3d6d-5ff4-4c63-a2e2-8bfa0a4a916c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:30.453047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-77bc3d6d-5ff4-4c63-a2e2-8bfa0a4a916c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:30.454395 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7cab80ec-c75e-433a-b125-347746f8aaab tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action" status: 202 len: 0 microversion: 2.1 time: 0.585708 Sep 17 21:03:30.456736 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1568/3232] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:03:29 2022] POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action => generated 0 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 17 21:03:30.473698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f59b7a77-d6e9-4ab0-9205-2bd713bb9697 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a48ebca0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:30.487184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-77bc3d6d-5ff4-4c63-a2e2-8bfa0a4a916c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:30.489800 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-77bc3d6d-5ff4-4c63-a2e2-8bfa0a4a916c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:30.490711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-77bc3d6d-5ff4-4c63-a2e2-8bfa0a4a916c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:30.493622 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-77bc3d6d-5ff4-4c63-a2e2-8bfa0a4a916c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:30.497408 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-77bc3d6d-5ff4-4c63-a2e2-8bfa0a4a916c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:30.499631 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-77bc3d6d-5ff4-4c63-a2e2-8bfa0a4a916c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:30.723325 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-77bc3d6d-5ff4-4c63-a2e2-8bfa0a4a916c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:30.742395 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-77bc3d6d-5ff4-4c63-a2e2-8bfa0a4a916c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:30.744293 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-77bc3d6d-5ff4-4c63-a2e2-8bfa0a4a916c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:30.769163 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f59b7a77-d6e9-4ab0-9205-2bd713bb9697 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/detail?changes-since=2022-09-17T21%3A01%3A15Z" status: 200 len: 6328 microversion: 2.1 time: 0.310050 Sep 17 21:03:30.774428 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-77bc3d6d-5ff4-4c63-a2e2-8bfa0a4a916c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1544 microversion: 2.91 time: 0.341985 Sep 17 21:03:30.778119 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1665/3233] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:03:30 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1544 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:03:30.783011 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1569/3234] 10.222.0.26 () {58 vars in 1220 bytes} [Sat Sep 17 21:03:30 2022] GET /compute/v2.1/images/detail?changes-since=2022-09-17T21%3A01%3A15Z => generated 6328 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:30.793923 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ba8ee3be-9d61-4b6a-9a86-0a5427a4f77c tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a51eeee0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:30.809949 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e0aa39e0-03a1-40dd-bf6d-b8db7a36e07e tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:30.810882 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e0aa39e0-03a1-40dd-bf6d-b8db7a36e07e tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] [instance: a4ae0d78-1feb-462a-8eba-03a345099219] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:30.829663 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e0aa39e0-03a1-40dd-bf6d-b8db7a36e07e tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:30.830254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e0aa39e0-03a1-40dd-bf6d-b8db7a36e07e tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:30.831612 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e0aa39e0-03a1-40dd-bf6d-b8db7a36e07e tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:30.832961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e0aa39e0-03a1-40dd-bf6d-b8db7a36e07e tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:30.833872 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e0aa39e0-03a1-40dd-bf6d-b8db7a36e07e tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:30.834519 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e0aa39e0-03a1-40dd-bf6d-b8db7a36e07e tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:30.891410 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ba8ee3be-9d61-4b6a-9a86-0a5427a4f77c tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1576536647" status: 200 len: 665 microversion: 2.1 time: 0.103084 Sep 17 21:03:30.902236 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1570/3235] 10.222.0.26 () {58 vars in 1252 bytes} [Sat Sep 17 21:03:30 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1576536647 => generated 665 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:30.913236 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b6084a47-667b-4492-b138-47da31be7a2c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:30.914281 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b6084a47-667b-4492-b138-47da31be7a2c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:30.921424 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6084a47-667b-4492-b138-47da31be7a2c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:30.922180 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6084a47-667b-4492-b138-47da31be7a2c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:30.922785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6084a47-667b-4492-b138-47da31be7a2c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:30.923683 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6084a47-667b-4492-b138-47da31be7a2c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:30.924309 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6084a47-667b-4492-b138-47da31be7a2c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:30.924891 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6084a47-667b-4492-b138-47da31be7a2c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:31.488856 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e0aa39e0-03a1-40dd-bf6d-b8db7a36e07e tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128155ce2ea242bd9d59ec188c57c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9877108f734092be1197672d500334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:31.500359 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e0aa39e0-03a1-40dd-bf6d-b8db7a36e07e tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219" status: 200 len: 1509 microversion: 2.1 time: 0.716055 Sep 17 21:03:31.500960 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1666/3236] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:30 2022] GET /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219 => generated 1509 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:31.534614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d1fd4bbd-2c56-4c3f-b6fd-9cce308bfd3a tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a4375e50>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:31.561535 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b6084a47-667b-4492-b138-47da31be7a2c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:31.569866 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b6084a47-667b-4492-b138-47da31be7a2c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1460 microversion: 2.1 time: 0.665584 Sep 17 21:03:31.579659 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1571/3237] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:30 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1460 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:31.603152 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cc3f83ae-b49f-4e79-af9e-f4a967c55d0e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:31.611049 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cc3f83ae-b49f-4e79-af9e-f4a967c55d0e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] [instance: c7fa190d-89fe-4b34-b3a5-955cd2ece041] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:31.618831 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc3f83ae-b49f-4e79-af9e-f4a967c55d0e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:31.619719 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc3f83ae-b49f-4e79-af9e-f4a967c55d0e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:31.620504 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc3f83ae-b49f-4e79-af9e-f4a967c55d0e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:31.624748 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc3f83ae-b49f-4e79-af9e-f4a967c55d0e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:31.625793 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc3f83ae-b49f-4e79-af9e-f4a967c55d0e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:31.626391 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc3f83ae-b49f-4e79-af9e-f4a967c55d0e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:31.706546 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d1fd4bbd-2c56-4c3f-b6fd-9cce308bfd3a tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fv2.1%2Fservers%2F66779798-999a-4a63-98dd-bf7fa71ce4b1" status: 200 len: 1465 microversion: 2.1 time: 0.185030 Sep 17 21:03:31.718117 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1667/3238] 10.222.0.26 () {58 vars in 1338 bytes} [Sat Sep 17 21:03:31 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fv2.1%2Fservers%2F66779798-999a-4a63-98dd-bf7fa71ce4b1 => generated 1465 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:31.730701 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ba148abe-bac8-47bc-8bd9-e833a1534d0e tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a41a13a0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:31.842381 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ba148abe-bac8-47bc-8bd9-e833a1534d0e tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fservers%2F66779798-999a-4a63-98dd-bf7fa71ce4b1" status: 200 len: 1465 microversion: 2.1 time: 0.122808 Sep 17 21:03:31.842974 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1668/3239] 10.222.0.26 () {58 vars in 1324 bytes} [Sat Sep 17 21:03:31 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fservers%2F66779798-999a-4a63-98dd-bf7fa71ce4b1 => generated 1465 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:31.851498 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f4b1976d-5d21-4081-8301-7b0aee35aa3e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:31.856655 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cc3f83ae-b49f-4e79-af9e-f4a967c55d0e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e3adea586f4772b39b62323b1cc911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9024c27866542428191da960659ac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:31.866682 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f4b1976d-5d21-4081-8301-7b0aee35aa3e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:31.870469 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cc3f83ae-b49f-4e79-af9e-f4a967c55d0e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041" status: 200 len: 1270 microversion: 2.1 time: 0.274325 Sep 17 21:03:31.872405 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1572/3240] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:31 2022] GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041 => generated 1270 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:31.882730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fda97fd8-e892-49b8-bdaf-eb1e7b457990 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a9fc1af0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:31.899656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4b1976d-5d21-4081-8301-7b0aee35aa3e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:31.901230 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4b1976d-5d21-4081-8301-7b0aee35aa3e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:31.902770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4b1976d-5d21-4081-8301-7b0aee35aa3e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:31.904485 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4b1976d-5d21-4081-8301-7b0aee35aa3e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:31.906595 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4b1976d-5d21-4081-8301-7b0aee35aa3e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:31.916497 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4b1976d-5d21-4081-8301-7b0aee35aa3e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:32.117659 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fda97fd8-e892-49b8-bdaf-eb1e7b457990 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7103 microversion: 2.1 time: 0.243840 Sep 17 21:03:32.127470 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1573/3241] 10.222.0.26 () {58 vars in 1170 bytes} [Sat Sep 17 21:03:31 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7103 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:32.198261 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f4b1976d-5d21-4081-8301-7b0aee35aa3e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:32.208611 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f4b1976d-5d21-4081-8301-7b0aee35aa3e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:32.210739 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f4b1976d-5d21-4081-8301-7b0aee35aa3e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:32.216905 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f4b1976d-5d21-4081-8301-7b0aee35aa3e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1544 microversion: 2.91 time: 0.371068 Sep 17 21:03:32.218215 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1669/3242] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:03:31 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1544 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:03:32.224668 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1a452d63-f035-4539-9780-1c64bf68e0be tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a411ed30>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:32.366778 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1a452d63-f035-4539-9780-1c64bf68e0be tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4370 microversion: 2.1 time: 0.147098 Sep 17 21:03:32.374041 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1670/3243] 10.222.0.26 () {58 vars in 1170 bytes} [Sat Sep 17 21:03:32 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:32.388322 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7bef3d8e-0297-4376-9b11-2fd6acf8dd54 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a418c0d0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:32.470663 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7bef3d8e-0297-4376-9b11-2fd6acf8dd54 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4" status: 200 len: 784 microversion: 2.1 time: 0.087675 Sep 17 21:03:32.485901 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1671/3244] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:03:32 2022] GET /compute/v2.1/images/1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4 => generated 784 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:32.491035 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3b8cf7d9-1366-42ad-b476-cf3db8c983e0 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a411e3a0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:32.516600 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-c312658e-a20a-45d0-8f52-a273a812ff3e req-c049568a-889d-491c-b70e-70d474277722 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4ae0d78-1feb-462a-8eba-03a345099219", "name": "network-vif-deleted", "tag": "d54cdb25-5384-4cca-ab82-3c54e65b0c39"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:32.538092 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-c312658e-a20a-45d0-8f52-a273a812ff3e req-c049568a-889d-491c-b70e-70d474277722 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:32.541448 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-c312658e-a20a-45d0-8f52-a273a812ff3e req-c049568a-889d-491c-b70e-70d474277722 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:32.543487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-c312658e-a20a-45d0-8f52-a273a812ff3e req-c049568a-889d-491c-b70e-70d474277722 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:32.573653 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-c312658e-a20a-45d0-8f52-a273a812ff3e req-c049568a-889d-491c-b70e-70d474277722 service nova] Creating event network-vif-deleted:d54cdb25-5384-4cca-ab82-3c54e65b0c39 for instance a4ae0d78-1feb-462a-8eba-03a345099219 on nch1-master-1 Sep 17 21:03:32.587457 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-c312658e-a20a-45d0-8f52-a273a812ff3e req-c049568a-889d-491c-b70e-70d474277722 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.457296 Sep 17 21:03:32.591396 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1574/3245] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:32.599616 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-606351e4-d8eb-4e6f-a013-15ec48aa3a6b tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:32.606924 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-606351e4-d8eb-4e6f-a013-15ec48aa3a6b tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] [instance: a4ae0d78-1feb-462a-8eba-03a345099219] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:32.615741 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3b8cf7d9-1366-42ad-b476-cf3db8c983e0 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.128626 Sep 17 21:03:32.629019 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1672/3246] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Sep 17 21:03:32 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:32.653656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4c766396-0e06-4b47-b312-a0ed6f18f879 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:32.654281 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4c766396-0e06-4b47-b312-a0ed6f18f879 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:32.680745 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-606351e4-d8eb-4e6f-a013-15ec48aa3a6b tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:32.682771 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-606351e4-d8eb-4e6f-a013-15ec48aa3a6b tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:32.683220 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-606351e4-d8eb-4e6f-a013-15ec48aa3a6b tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:32.683958 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-606351e4-d8eb-4e6f-a013-15ec48aa3a6b tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:32.684416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-606351e4-d8eb-4e6f-a013-15ec48aa3a6b tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:32.684847 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-606351e4-d8eb-4e6f-a013-15ec48aa3a6b tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:32.694806 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c766396-0e06-4b47-b312-a0ed6f18f879 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:32.695286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c766396-0e06-4b47-b312-a0ed6f18f879 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:32.695727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c766396-0e06-4b47-b312-a0ed6f18f879 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:32.696435 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c766396-0e06-4b47-b312-a0ed6f18f879 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:32.706382 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c766396-0e06-4b47-b312-a0ed6f18f879 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:32.711064 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c766396-0e06-4b47-b312-a0ed6f18f879 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:32.792657 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-606351e4-d8eb-4e6f-a013-15ec48aa3a6b tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:32.796200 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-606351e4-d8eb-4e6f-a013-15ec48aa3a6b tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:32.796874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-606351e4-d8eb-4e6f-a013-15ec48aa3a6b tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:32.797536 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-606351e4-d8eb-4e6f-a013-15ec48aa3a6b tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lazy-loading 'fault' on Instance uuid a4ae0d78-1feb-462a-8eba-03a345099219 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:03:33.067063 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-606351e4-d8eb-4e6f-a013-15ec48aa3a6b tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '128155ce2ea242bd9d59ec188c57c34b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f9877108f734092be1197672d500334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:33.082145 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-606351e4-d8eb-4e6f-a013-15ec48aa3a6b tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219" status: 200 len: 1305 microversion: 2.1 time: 0.488317 Sep 17 21:03:33.102051 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1575/3247] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:32 2022] GET /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219 => generated 1305 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:33.108098 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1c017c33-2a29-40e8-b253-665873bd2a11 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a48e0700>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:33.669621 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:33.853222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4c766396-0e06-4b47-b312-a0ed6f18f879 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:33.877422 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4c766396-0e06-4b47-b312-a0ed6f18f879 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1518 microversion: 2.1 time: 1.245355 Sep 17 21:03:33.882835 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1673/3248] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:32 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1518 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:33.903787 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-c7e9994d-5de8-4b4f-8322-bee02e69bcc6 req-fc50c636-9036-4814-ab26-7c6a696e0e34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41393a54-9105-4da5-ae65-3167427ddae8", "name": "network-vif-unplugged", "status": "completed", "tag": "4d47e229-8239-4215-8c5c-b5133bcfb47b"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:33.916855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=60 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:33.932262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c7e9994d-5de8-4b4f-8322-bee02e69bcc6 req-fc50c636-9036-4814-ab26-7c6a696e0e34 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:33.933744 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c7e9994d-5de8-4b4f-8322-bee02e69bcc6 req-fc50c636-9036-4814-ab26-7c6a696e0e34 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:33.935645 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c7e9994d-5de8-4b4f-8322-bee02e69bcc6 req-fc50c636-9036-4814-ab26-7c6a696e0e34 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:33.970939 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-c7e9994d-5de8-4b4f-8322-bee02e69bcc6 req-fc50c636-9036-4814-ab26-7c6a696e0e34 service nova] Creating event network-vif-unplugged:4d47e229-8239-4215-8c5c-b5133bcfb47b for instance 41393a54-9105-4da5-ae65-3167427ddae8 on nch1-master-1 Sep 17 21:03:33.982218 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-c7e9994d-5de8-4b4f-8322-bee02e69bcc6 req-fc50c636-9036-4814-ab26-7c6a696e0e34 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095294 Sep 17 21:03:33.987334 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1674/3249] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:33.994878 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5b203849-3446-4e1f-a227-81c551c9f5a3 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:33.995945 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5b203849-3446-4e1f-a227-81c551c9f5a3 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] [instance: c7fa190d-89fe-4b34-b3a5-955cd2ece041] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:34.005797 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b203849-3446-4e1f-a227-81c551c9f5a3 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:34.006899 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b203849-3446-4e1f-a227-81c551c9f5a3 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:34.007562 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b203849-3446-4e1f-a227-81c551c9f5a3 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:34.008899 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b203849-3446-4e1f-a227-81c551c9f5a3 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:34.009680 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b203849-3446-4e1f-a227-81c551c9f5a3 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:34.010387 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b203849-3446-4e1f-a227-81c551c9f5a3 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:34.362898 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5b203849-3446-4e1f-a227-81c551c9f5a3 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e3adea586f4772b39b62323b1cc911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9024c27866542428191da960659ac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:34.384914 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5b203849-3446-4e1f-a227-81c551c9f5a3 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041" status: 200 len: 1312 microversion: 2.1 time: 0.396018 Sep 17 21:03:34.388489 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1675/3250] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:33 2022] GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041 => generated 1312 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:34.398427 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e2b03d89-1dbf-458a-816c-40f454b88603 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:34.401849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e2b03d89-1dbf-458a-816c-40f454b88603 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:34.414488 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2b03d89-1dbf-458a-816c-40f454b88603 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:34.415507 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2b03d89-1dbf-458a-816c-40f454b88603 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:34.416192 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2b03d89-1dbf-458a-816c-40f454b88603 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:34.417705 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2b03d89-1dbf-458a-816c-40f454b88603 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:34.418585 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2b03d89-1dbf-458a-816c-40f454b88603 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:34.419503 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2b03d89-1dbf-458a-816c-40f454b88603 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:34.516085 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:34.680397 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e2b03d89-1dbf-458a-816c-40f454b88603 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:34.698019 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e2b03d89-1dbf-458a-816c-40f454b88603 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:34.707340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e2b03d89-1dbf-458a-816c-40f454b88603 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:34.728808 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e2b03d89-1dbf-458a-816c-40f454b88603 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1544 microversion: 2.91 time: 0.337791 Sep 17 21:03:34.734611 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1676/3251] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:03:34 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1544 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:03:34.749614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2ca48c16-98cf-476f-af24-ad5dab9a5ab3 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:34.752455 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2ca48c16-98cf-476f-af24-ad5dab9a5ab3 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] [instance: a4ae0d78-1feb-462a-8eba-03a345099219] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:34.773083 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ca48c16-98cf-476f-af24-ad5dab9a5ab3 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:34.779109 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ca48c16-98cf-476f-af24-ad5dab9a5ab3 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:34.781967 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ca48c16-98cf-476f-af24-ad5dab9a5ab3 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:34.782985 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ca48c16-98cf-476f-af24-ad5dab9a5ab3 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:34.800888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ca48c16-98cf-476f-af24-ad5dab9a5ab3 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:34.802996 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ca48c16-98cf-476f-af24-ad5dab9a5ab3 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:34.849768 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1c017c33-2a29-40e8-b253-665873bd2a11 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "DELETE /compute/v2.1/images/42ec7c80-ffce-4465-b7b6-d3b416e2913d" status: 204 len: 0 microversion: 2.1 time: 1.745492 Sep 17 21:03:34.854224 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1576/3252] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:33 2022] DELETE /compute/v2.1/images/42ec7c80-ffce-4465-b7b6-d3b416e2913d => generated 0 bytes in 1748 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:03:34.860935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-01bc1a4b-5bb1-448d-9c54-4122deb2ba43 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a4fc4310>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:34.878723 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-2ca48c16-98cf-476f-af24-ad5dab9a5ab3 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] HTTP exception thrown: Instance a4ae0d78-1feb-462a-8eba-03a345099219 could not be found. Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2ca48c16-98cf-476f-af24-ad5dab9a5ab3 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Request method failure captured: Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219 HTTP/1.1 Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjX6XmioWMKaR5xXm1vbQHSM7o90Yao2uj6GxeTvYgpgSMkhpvp56aB7VQk_nR-shBIcYbzqub4vwtVZhtYb9FaOsICYVbeO2tB214vyNFBvGq3OeVU7M4om21OeOnEjDvyrU4lNkWWD1-P0FEd00LLIGFZ8KTVbfDbiKNTqc_DEdlM Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 9f9877108f734092be1197672d500334 Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ImagesNegativeTestJSON-1975880637 Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f9877108f734092be1197672d500334"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9f9877108f734092be1197672d500334"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f9877108f734092be1197672d500334"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9f9877108f734092be1197672d500334", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ImagesNegativeTestJSON-1975880637 Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 9f9877108f734092be1197672d500334 Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1975880637 Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ImagesNegativeTestJSON-1975880637-project Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 128155ce2ea242bd9d59ec188c57c34b Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ImagesNegativeTestJSON-1975880637-project Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance a4ae0d78-1feb-462a-8eba-03a345099219 could not be found. Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'a4ae0d78-1feb-462a-8eba-03a345099219'} Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4ae0d78-1feb-462a-8eba-03a345099219 could not be found. Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4ae0d78-1feb-462a-8eba-03a345099219 could not be found. Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:03:34.886711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:34.894920 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:03:34.894920 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:03:34.894920 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:03:34.894920 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:03:34.894920 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:03:34.894920 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4ae0d78-1feb-462a-8eba-03a345099219 could not be found. Sep 17 21:03:34.894920 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:34.894920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2ca48c16-98cf-476f-af24-ad5dab9a5ab3 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Returning 404 to user: Instance a4ae0d78-1feb-462a-8eba-03a345099219 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:03:34.900436 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2ca48c16-98cf-476f-af24-ad5dab9a5ab3 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219" status: 404 len: 111 microversion: 2.1 time: 0.162269 Sep 17 21:03:34.902083 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1677/3253] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:34 2022] GET /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219 => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:03:34.919292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1fe2b2f7-345b-45c0-aa4b-72163046ee26 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:34.922158 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1fe2b2f7-345b-45c0-aa4b-72163046ee26 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:34.936864 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1fe2b2f7-345b-45c0-aa4b-72163046ee26 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:34.937597 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1fe2b2f7-345b-45c0-aa4b-72163046ee26 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:34.938073 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1fe2b2f7-345b-45c0-aa4b-72163046ee26 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:34.938791 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1fe2b2f7-345b-45c0-aa4b-72163046ee26 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:34.941604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1fe2b2f7-345b-45c0-aa4b-72163046ee26 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:34.942709 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1fe2b2f7-345b-45c0-aa4b-72163046ee26 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:35.369102 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1fe2b2f7-345b-45c0-aa4b-72163046ee26 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:35.380187 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1fe2b2f7-345b-45c0-aa4b-72163046ee26 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1518 microversion: 2.1 time: 0.473469 Sep 17 21:03:35.381186 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1678/3254] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:34 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1518 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:35.409303 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bfaa4c99-f147-4ea0-9394-5180a04e37e9 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-326157523", "metadata": {"image_type": "test"}}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:35.416823 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bfaa4c99-f147-4ea0-9394-5180a04e37e9 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] [instance: a4ae0d78-1feb-462a-8eba-03a345099219] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:35.432011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bfaa4c99-f147-4ea0-9394-5180a04e37e9 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:35.433823 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bfaa4c99-f147-4ea0-9394-5180a04e37e9 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:35.437047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bfaa4c99-f147-4ea0-9394-5180a04e37e9 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:35.437996 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bfaa4c99-f147-4ea0-9394-5180a04e37e9 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:35.438721 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bfaa4c99-f147-4ea0-9394-5180a04e37e9 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:35.439386 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bfaa4c99-f147-4ea0-9394-5180a04e37e9 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:35.478057 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-bfaa4c99-f147-4ea0-9394-5180a04e37e9 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] HTTP exception thrown: Instance a4ae0d78-1feb-462a-8eba-03a345099219 could not be found. Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bfaa4c99-f147-4ea0-9394-5180a04e37e9 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Request method failure captured: Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219/action HTTP/1.1 Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 111 Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjX6XmioWMKaR5xXm1vbQHSM7o90Yao2uj6GxeTvYgpgSMkhpvp56aB7VQk_nR-shBIcYbzqub4vwtVZhtYb9FaOsICYVbeO2tB214vyNFBvGq3OeVU7M4om21OeOnEjDvyrU4lNkWWD1-P0FEd00LLIGFZ8KTVbfDbiKNTqc_DEdlM Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 9f9877108f734092be1197672d500334 Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ImagesNegativeTestJSON-1975880637 Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f9877108f734092be1197672d500334"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9f9877108f734092be1197672d500334"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f9877108f734092be1197672d500334"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9f9877108f734092be1197672d500334", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ImagesNegativeTestJSON-1975880637 Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 9f9877108f734092be1197672d500334 Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1975880637 Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ImagesNegativeTestJSON-1975880637-project Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 128155ce2ea242bd9d59ec188c57c34b Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ImagesNegativeTestJSON-1975880637-project Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-326157523", "metadata": {"image_type": "test"}}} Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance a4ae0d78-1feb-462a-8eba-03a345099219 could not be found. Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'a4ae0d78-1feb-462a-8eba-03a345099219', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-326157523', 'metadata': {'image_type': 'test'}}}} Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4ae0d78-1feb-462a-8eba-03a345099219 could not be found. Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 17 21:03:35.480155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 17 21:03:35.484231 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:03:35.484231 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:03:35.484231 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:03:35.484231 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:03:35.484231 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4ae0d78-1feb-462a-8eba-03a345099219 could not be found. Sep 17 21:03:35.484231 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:35.484231 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:03:35.484231 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:35.484231 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:03:35.484231 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:03:35.484231 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:03:35.484231 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:03:35.484231 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:03:35.484231 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4ae0d78-1feb-462a-8eba-03a345099219 could not be found. Sep 17 21:03:35.484231 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:35.486677 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bfaa4c99-f147-4ea0-9394-5180a04e37e9 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Returning 404 to user: Instance a4ae0d78-1feb-462a-8eba-03a345099219 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:03:35.490375 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bfaa4c99-f147-4ea0-9394-5180a04e37e9 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] 10.222.0.26 "POST /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219/action" status: 404 len: 111 microversion: 2.1 time: 0.090874 Sep 17 21:03:35.491530 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1679/3255] 10.222.0.26 () {60 vars in 1279 bytes} [Sat Sep 17 21:03:35 2022] POST /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219/action => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:03:35.509578 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f7ba7d98-f3da-41c2-a762-45d5f91da6bc tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:35.510593 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f7ba7d98-f3da-41c2-a762-45d5f91da6bc tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] [instance: c7fa190d-89fe-4b34-b3a5-955cd2ece041] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:35.521880 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7ba7d98-f3da-41c2-a762-45d5f91da6bc tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:35.529200 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7ba7d98-f3da-41c2-a762-45d5f91da6bc tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:35.530035 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7ba7d98-f3da-41c2-a762-45d5f91da6bc tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:35.531036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7ba7d98-f3da-41c2-a762-45d5f91da6bc tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:35.531712 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7ba7d98-f3da-41c2-a762-45d5f91da6bc tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:35.532368 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7ba7d98-f3da-41c2-a762-45d5f91da6bc tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:35.934985 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f7ba7d98-f3da-41c2-a762-45d5f91da6bc tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e3adea586f4772b39b62323b1cc911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9024c27866542428191da960659ac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:35.945912 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f7ba7d98-f3da-41c2-a762-45d5f91da6bc tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041" status: 200 len: 1312 microversion: 2.1 time: 0.453027 Sep 17 21:03:35.946966 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1680/3256] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:35 2022] GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041 => generated 1312 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:35.951983 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-decb2ce6-fa48-4524-9a5c-dabb8062328e tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-877283624", "metadata": {"image_type": "test"}}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:35.954783 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-decb2ce6-fa48-4524-9a5c-dabb8062328e tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Failed to fetch instance by id tempest-invalid-1231588088 {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 17 21:03:35.955561 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-decb2ce6-fa48-4524-9a5c-dabb8062328e tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] HTTP exception thrown: Instance tempest-invalid-1231588088 could not be found. Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-decb2ce6-fa48-4524-9a5c-dabb8062328e tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Request method failure captured: Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers/tempest-invalid-1231588088/action HTTP/1.1 Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 111 Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjX6XmioWMKaR5xXm1vbQHSM7o90Yao2uj6GxeTvYgpgSMkhpvp56aB7VQk_nR-shBIcYbzqub4vwtVZhtYb9FaOsICYVbeO2tB214vyNFBvGq3OeVU7M4om21OeOnEjDvyrU4lNkWWD1-P0FEd00LLIGFZ8KTVbfDbiKNTqc_DEdlM Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 9f9877108f734092be1197672d500334 Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ImagesNegativeTestJSON-1975880637 Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f9877108f734092be1197672d500334"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9f9877108f734092be1197672d500334"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f9877108f734092be1197672d500334"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9f9877108f734092be1197672d500334", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ImagesNegativeTestJSON-1975880637 Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 9f9877108f734092be1197672d500334 Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1975880637 Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ImagesNegativeTestJSON-1975880637-project Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 128155ce2ea242bd9d59ec188c57c34b Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ImagesNegativeTestJSON-1975880637-project Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-877283624", "metadata": {"image_type": "test"}}} Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance tempest-invalid-1231588088 could not be found. Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'tempest-invalid-1231588088', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-877283624', 'metadata': {'image_type': 'test'}}}} Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1231588088 could not be found. Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:03:35.957163 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1231588088 could not be found. Sep 17 21:03:35.961513 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:35.961513 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:03:35.961513 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:35.961513 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:03:35.961513 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:03:35.961513 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:03:35.961513 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:03:35.961513 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:03:35.961513 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1231588088 could not be found. Sep 17 21:03:35.961513 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:35.963405 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-decb2ce6-fa48-4524-9a5c-dabb8062328e tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Returning 404 to user: Instance tempest-invalid-1231588088 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:03:35.965213 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-decb2ce6-fa48-4524-9a5c-dabb8062328e tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] 10.222.0.26 "POST /compute/v2.1/servers/tempest-invalid-1231588088/action" status: 404 len: 101 microversion: 2.1 time: 0.017048 Sep 17 21:03:35.966279 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1681/3257] 10.222.0.26 () {60 vars in 1249 bytes} [Sat Sep 17 21:03:35 2022] POST /compute/v2.1/servers/tempest-invalid-1231588088/action => generated 101 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:03:35.981725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-3376feb7-0fab-47de-88f9-0f26eb6aca17 req-f3d3b626-f2bd-427a-8299-625476c5749e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b986fa2-07ea-4418-adf2-0a5fa127e84a", "tag": "f698d869-5f6d-4d34-95fa-00bb9569ec58"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:35.996102 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-3376feb7-0fab-47de-88f9-0f26eb6aca17 req-f3d3b626-f2bd-427a-8299-625476c5749e service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:35.996600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-3376feb7-0fab-47de-88f9-0f26eb6aca17 req-f3d3b626-f2bd-427a-8299-625476c5749e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:35.997054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-3376feb7-0fab-47de-88f9-0f26eb6aca17 req-f3d3b626-f2bd-427a-8299-625476c5749e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:36.022116 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-3376feb7-0fab-47de-88f9-0f26eb6aca17 req-f3d3b626-f2bd-427a-8299-625476c5749e service nova] Creating event network-changed:f698d869-5f6d-4d34-95fa-00bb9569ec58 for instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a on nch2-master-1 Sep 17 21:03:36.028566 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-3376feb7-0fab-47de-88f9-0f26eb6aca17 req-f3d3b626-f2bd-427a-8299-625476c5749e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060817 Sep 17 21:03:36.029552 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1682/3258] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:36.035181 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d0299677-ad89-480e-a1cb-321b0dea46f4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:36.036211 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d0299677-ad89-480e-a1cb-321b0dea46f4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:36.044242 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d0299677-ad89-480e-a1cb-321b0dea46f4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:36.044890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d0299677-ad89-480e-a1cb-321b0dea46f4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:36.045711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d0299677-ad89-480e-a1cb-321b0dea46f4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:36.046371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d0299677-ad89-480e-a1cb-321b0dea46f4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:36.046845 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d0299677-ad89-480e-a1cb-321b0dea46f4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:36.050664 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d0299677-ad89-480e-a1cb-321b0dea46f4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:36.191656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d0299677-ad89-480e-a1cb-321b0dea46f4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:36.218168 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d0299677-ad89-480e-a1cb-321b0dea46f4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:36.220982 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d0299677-ad89-480e-a1cb-321b0dea46f4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:36.233510 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d0299677-ad89-480e-a1cb-321b0dea46f4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1544 microversion: 2.91 time: 0.202674 Sep 17 21:03:36.242906 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1683/3259] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:03:36 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1544 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:03:36.248002 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1e7b8f1e-85f0-40d7-b141-188165602fe1 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1544056232"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:36.250338 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1e7b8f1e-85f0-40d7-b141-188165602fe1 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 17 21:03:36.252705 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-1e7b8f1e-85f0-40d7-b141-188165602fe1 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1e7b8f1e-85f0-40d7-b141-188165602fe1 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Request method failure captured: Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 57 Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjX6XmioWMKaR5xXm1vbQHSM7o90Yao2uj6GxeTvYgpgSMkhpvp56aB7VQk_nR-shBIcYbzqub4vwtVZhtYb9FaOsICYVbeO2tB214vyNFBvGq3OeVU7M4om21OeOnEjDvyrU4lNkWWD1-P0FEd00LLIGFZ8KTVbfDbiKNTqc_DEdlM Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 9f9877108f734092be1197672d500334 Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ImagesNegativeTestJSON-1975880637 Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f9877108f734092be1197672d500334"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9f9877108f734092be1197672d500334"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f9877108f734092be1197672d500334"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9f9877108f734092be1197672d500334", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ImagesNegativeTestJSON-1975880637 Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 9f9877108f734092be1197672d500334 Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1975880637 Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ImagesNegativeTestJSON-1975880637-project Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 128155ce2ea242bd9d59ec188c57c34b Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ImagesNegativeTestJSON-1975880637-project Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: {"createImage": {"name": "tempest-test-snap-1544056232"}} Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1544056232'}}} Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 17 21:03:36.254451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:36.260891 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:03:36.260891 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:36.260891 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:03:36.260891 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:03:36.260891 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:03:36.260891 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:03:36.260891 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:03:36.260891 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 17 21:03:36.260891 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:36.260891 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1e7b8f1e-85f0-40d7-b141-188165602fe1 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:03:36.260891 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1e7b8f1e-85f0-40d7-b141-188165602fe1 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] 10.222.0.26 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.011920 Sep 17 21:03:36.266164 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1684/3260] 10.222.0.26 () {60 vars in 1275 bytes} [Sat Sep 17 21:03:36 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:03:36.287122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-70b36ca0-f08f-441a-b4c3-6acec780571e req-c2c438c1-2edd-4018-9645-3e54f628174c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7fa190d-89fe-4b34-b3a5-955cd2ece041", "tag": "a891294e-6466-4306-9bec-bc7bea066042"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:36.304321 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-70b36ca0-f08f-441a-b4c3-6acec780571e req-c2c438c1-2edd-4018-9645-3e54f628174c service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:36.304817 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-70b36ca0-f08f-441a-b4c3-6acec780571e req-c2c438c1-2edd-4018-9645-3e54f628174c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:36.305490 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-70b36ca0-f08f-441a-b4c3-6acec780571e req-c2c438c1-2edd-4018-9645-3e54f628174c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:36.326381 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-70b36ca0-f08f-441a-b4c3-6acec780571e req-c2c438c1-2edd-4018-9645-3e54f628174c service nova] Creating event network-changed:a891294e-6466-4306-9bec-bc7bea066042 for instance c7fa190d-89fe-4b34-b3a5-955cd2ece041 on nch2-master-1 Sep 17 21:03:36.336880 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-70b36ca0-f08f-441a-b4c3-6acec780571e req-c2c438c1-2edd-4018-9645-3e54f628174c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066585 Sep 17 21:03:36.338911 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1685/3261] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:36.357097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-64c7b6f6-d6f0-4373-aaa3-28c388544897 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1499547831"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:36.358113 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-01bc1a4b-5bb1-448d-9c54-4122deb2ba43 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "DELETE /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29" status: 204 len: 0 microversion: 2.1 time: 1.501626 Sep 17 21:03:36.359608 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1577/3262] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:34 2022] DELETE /compute/v2.1/images/f5b7a24a-718b-479f-8da2-1b6750f03c29 => generated 0 bytes in 1504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:03:36.366744 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-64c7b6f6-d6f0-4373-aaa3-28c388544897 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 17 21:03:36.368330 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9602e7e0-37d1-49e0-aea0-766340e0017e tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a4f95d30>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:36.370258 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-64c7b6f6-d6f0-4373-aaa3-28c388544897 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-64c7b6f6-d6f0-4373-aaa3-28c388544897 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Request method failure captured: Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 57 Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjX6XmioWMKaR5xXm1vbQHSM7o90Yao2uj6GxeTvYgpgSMkhpvp56aB7VQk_nR-shBIcYbzqub4vwtVZhtYb9FaOsICYVbeO2tB214vyNFBvGq3OeVU7M4om21OeOnEjDvyrU4lNkWWD1-P0FEd00LLIGFZ8KTVbfDbiKNTqc_DEdlM Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 9f9877108f734092be1197672d500334 Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ImagesNegativeTestJSON-1975880637 Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f9877108f734092be1197672d500334"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9f9877108f734092be1197672d500334"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f9877108f734092be1197672d500334"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9f9877108f734092be1197672d500334", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ImagesNegativeTestJSON-1975880637 Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 9f9877108f734092be1197672d500334 Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1975880637 Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ImagesNegativeTestJSON-1975880637-project Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 128155ce2ea242bd9d59ec188c57c34b Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ImagesNegativeTestJSON-1975880637-project Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: {"createImage": {"name": "tempest-test-snap-1499547831"}} Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1499547831'}}} Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 17 21:03:36.375842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:36.381282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:03:36.381282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:36.381282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:03:36.381282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:03:36.381282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:03:36.381282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:03:36.381282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:03:36.381282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 17 21:03:36.381282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:36.383594 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-64c7b6f6-d6f0-4373-aaa3-28c388544897 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:03:36.385886 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-64c7b6f6-d6f0-4373-aaa3-28c388544897 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] 10.222.0.26 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.045315 Sep 17 21:03:36.387559 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1686/3263] 10.222.0.26 () {60 vars in 1281 bytes} [Sat Sep 17 21:03:36 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:03:36.400945 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-744ef0fc-0713-45e0-a555-0b25a1099186 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:36.404467 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-744ef0fc-0713-45e0-a555-0b25a1099186 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] [instance: a4ae0d78-1feb-462a-8eba-03a345099219] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:36.418718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-744ef0fc-0713-45e0-a555-0b25a1099186 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:36.419342 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-744ef0fc-0713-45e0-a555-0b25a1099186 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:36.419926 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-744ef0fc-0713-45e0-a555-0b25a1099186 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:36.420770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-744ef0fc-0713-45e0-a555-0b25a1099186 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:36.421423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-744ef0fc-0713-45e0-a555-0b25a1099186 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:36.421903 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-744ef0fc-0713-45e0-a555-0b25a1099186 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:36.453804 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-744ef0fc-0713-45e0-a555-0b25a1099186 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] HTTP exception thrown: Instance a4ae0d78-1feb-462a-8eba-03a345099219 could not be found. Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-744ef0fc-0713-45e0-a555-0b25a1099186 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Request method failure captured: Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219 HTTP/1.1 Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjX6XmioWMKaR5xXm1vbQHSM7o90Yao2uj6GxeTvYgpgSMkhpvp56aB7VQk_nR-shBIcYbzqub4vwtVZhtYb9FaOsICYVbeO2tB214vyNFBvGq3OeVU7M4om21OeOnEjDvyrU4lNkWWD1-P0FEd00LLIGFZ8KTVbfDbiKNTqc_DEdlM Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 9f9877108f734092be1197672d500334 Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ImagesNegativeTestJSON-1975880637 Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f9877108f734092be1197672d500334"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9f9877108f734092be1197672d500334"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f9877108f734092be1197672d500334"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9f9877108f734092be1197672d500334", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ImagesNegativeTestJSON-1975880637 Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 9f9877108f734092be1197672d500334 Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1975880637 Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ImagesNegativeTestJSON-1975880637-project Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 128155ce2ea242bd9d59ec188c57c34b Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ImagesNegativeTestJSON-1975880637-project Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance a4ae0d78-1feb-462a-8eba-03a345099219 could not be found. Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'a4ae0d78-1feb-462a-8eba-03a345099219'} Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4ae0d78-1feb-462a-8eba-03a345099219 could not be found. Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:03:36.455375 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:03:36.459932 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4ae0d78-1feb-462a-8eba-03a345099219 could not be found. Sep 17 21:03:36.459932 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:36.459932 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:03:36.459932 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:36.459932 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:03:36.459932 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:03:36.459932 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:03:36.459932 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:03:36.459932 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:03:36.459932 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4ae0d78-1feb-462a-8eba-03a345099219 could not be found. Sep 17 21:03:36.459932 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:36.459932 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-744ef0fc-0713-45e0-a555-0b25a1099186 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Returning 404 to user: Instance a4ae0d78-1feb-462a-8eba-03a345099219 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:03:36.459932 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-744ef0fc-0713-45e0-a555-0b25a1099186 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219" status: 404 len: 111 microversion: 2.1 time: 0.064708 Sep 17 21:03:36.462108 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1687/3264] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:03:36 2022] DELETE /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:03:36.465997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-244f0152-fcf5-49b7-9660-9eb875e67253 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:36.466614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-244f0152-fcf5-49b7-9660-9eb875e67253 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:36.473384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-244f0152-fcf5-49b7-9660-9eb875e67253 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:36.474367 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-244f0152-fcf5-49b7-9660-9eb875e67253 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:36.474367 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-244f0152-fcf5-49b7-9660-9eb875e67253 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:36.475092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-244f0152-fcf5-49b7-9660-9eb875e67253 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:36.475551 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-244f0152-fcf5-49b7-9660-9eb875e67253 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:36.475978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-244f0152-fcf5-49b7-9660-9eb875e67253 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:36.662073 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-244f0152-fcf5-49b7-9660-9eb875e67253 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:36.673097 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-244f0152-fcf5-49b7-9660-9eb875e67253 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1518 microversion: 2.1 time: 0.210784 Sep 17 21:03:36.673978 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1688/3265] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:36 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1518 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:36.695447 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-32d8bcdf-5c15-4c99-bccb-73882592a9e4 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:36.695837 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-32d8bcdf-5c15-4c99-bccb-73882592a9e4 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] [instance: a4ae0d78-1feb-462a-8eba-03a345099219] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:36.718754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32d8bcdf-5c15-4c99-bccb-73882592a9e4 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:36.719249 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32d8bcdf-5c15-4c99-bccb-73882592a9e4 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:36.719691 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32d8bcdf-5c15-4c99-bccb-73882592a9e4 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:36.720409 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32d8bcdf-5c15-4c99-bccb-73882592a9e4 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:36.720870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32d8bcdf-5c15-4c99-bccb-73882592a9e4 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:36.721310 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32d8bcdf-5c15-4c99-bccb-73882592a9e4 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:36.742829 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-32d8bcdf-5c15-4c99-bccb-73882592a9e4 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] HTTP exception thrown: Instance a4ae0d78-1feb-462a-8eba-03a345099219 could not be found. Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-32d8bcdf-5c15-4c99-bccb-73882592a9e4 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Request method failure captured: Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219 HTTP/1.1 Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjX6XmioWMKaR5xXm1vbQHSM7o90Yao2uj6GxeTvYgpgSMkhpvp56aB7VQk_nR-shBIcYbzqub4vwtVZhtYb9FaOsICYVbeO2tB214vyNFBvGq3OeVU7M4om21OeOnEjDvyrU4lNkWWD1-P0FEd00LLIGFZ8KTVbfDbiKNTqc_DEdlM Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 9f9877108f734092be1197672d500334 Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ImagesNegativeTestJSON-1975880637 Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f9877108f734092be1197672d500334"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9f9877108f734092be1197672d500334"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f9877108f734092be1197672d500334"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9f9877108f734092be1197672d500334", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ImagesNegativeTestJSON-1975880637 Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 9f9877108f734092be1197672d500334 Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-1975880637 Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ImagesNegativeTestJSON-1975880637-project Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 128155ce2ea242bd9d59ec188c57c34b Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ImagesNegativeTestJSON-1975880637-project Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance a4ae0d78-1feb-462a-8eba-03a345099219 could not be found. Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'a4ae0d78-1feb-462a-8eba-03a345099219'} Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4ae0d78-1feb-462a-8eba-03a345099219 could not be found. Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4ae0d78-1feb-462a-8eba-03a345099219 could not be found. Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:03:36.744790 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:36.749408 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:03:36.749408 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:03:36.749408 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:03:36.749408 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:03:36.749408 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:03:36.749408 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4ae0d78-1feb-462a-8eba-03a345099219 could not be found. Sep 17 21:03:36.749408 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:03:36.749408 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-32d8bcdf-5c15-4c99-bccb-73882592a9e4 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] Returning 404 to user: Instance a4ae0d78-1feb-462a-8eba-03a345099219 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:03:36.749408 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-32d8bcdf-5c15-4c99-bccb-73882592a9e4 tempest-ImagesNegativeTestJSON-1975880637 tempest-ImagesNegativeTestJSON-1975880637-project] 10.222.0.26 "GET /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219" status: 404 len: 111 microversion: 2.1 time: 0.055484 Sep 17 21:03:36.757595 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1689/3266] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:36 2022] GET /compute/v2.1/servers/a4ae0d78-1feb-462a-8eba-03a345099219 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:03:36.767441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-cedbe4de-4dd2-4570-a482-dc96b3dc8fcd req-b3c7439c-6263-463c-93ef-7f89bdc6fd15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41393a54-9105-4da5-ae65-3167427ddae8", "name": "network-vif-plugged", "status": "completed", "tag": "4d47e229-8239-4215-8c5c-b5133bcfb47b"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:36.786544 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-cedbe4de-4dd2-4570-a482-dc96b3dc8fcd req-b3c7439c-6263-463c-93ef-7f89bdc6fd15 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:36.787153 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-cedbe4de-4dd2-4570-a482-dc96b3dc8fcd req-b3c7439c-6263-463c-93ef-7f89bdc6fd15 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:36.788178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-cedbe4de-4dd2-4570-a482-dc96b3dc8fcd req-b3c7439c-6263-463c-93ef-7f89bdc6fd15 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:36.800701 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-cedbe4de-4dd2-4570-a482-dc96b3dc8fcd req-b3c7439c-6263-463c-93ef-7f89bdc6fd15 service nova] Creating event network-vif-plugged:4d47e229-8239-4215-8c5c-b5133bcfb47b for instance 41393a54-9105-4da5-ae65-3167427ddae8 on nch1-master-1 Sep 17 21:03:36.816984 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-cedbe4de-4dd2-4570-a482-dc96b3dc8fcd req-b3c7439c-6263-463c-93ef-7f89bdc6fd15 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057607 Sep 17 21:03:36.817856 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1690/3267] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:36.972632 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b14f3fb1-6f7e-4be0-b90b-6454683630a7 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:36.973317 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b14f3fb1-6f7e-4be0-b90b-6454683630a7 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] [instance: c7fa190d-89fe-4b34-b3a5-955cd2ece041] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:36.990268 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b14f3fb1-6f7e-4be0-b90b-6454683630a7 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:36.991164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b14f3fb1-6f7e-4be0-b90b-6454683630a7 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:36.991971 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b14f3fb1-6f7e-4be0-b90b-6454683630a7 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:36.993033 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b14f3fb1-6f7e-4be0-b90b-6454683630a7 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:36.993684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b14f3fb1-6f7e-4be0-b90b-6454683630a7 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:36.994272 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b14f3fb1-6f7e-4be0-b90b-6454683630a7 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:37.548654 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b14f3fb1-6f7e-4be0-b90b-6454683630a7 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e3adea586f4772b39b62323b1cc911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9024c27866542428191da960659ac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:37.559190 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b14f3fb1-6f7e-4be0-b90b-6454683630a7 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041" status: 200 len: 1312 microversion: 2.1 time: 0.591717 Sep 17 21:03:37.562912 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1691/3268] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:36 2022] GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041 => generated 1312 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:03:37.571902 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3a97ebf5-9649-4060-b4ab-28f23b6bbcab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:37.572785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3a97ebf5-9649-4060-b4ab-28f23b6bbcab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:37.578526 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9602e7e0-37d1-49e0-aea0-766340e0017e tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "DELETE /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57" status: 204 len: 0 microversion: 2.1 time: 1.214562 Sep 17 21:03:37.580729 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1578/3269] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:36 2022] DELETE /compute/v2.1/images/15e64495-f604-4f17-b1da-236a7e76aa57 => generated 0 bytes in 1216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 17 21:03:37.591803 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-91a3b3c0-3b48-4337-8972-809f5fd7af38 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:37.591803 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-91a3b3c0-3b48-4337-8972-809f5fd7af38 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 66779798-999a-4a63-98dd-bf7fa71ce4b1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:37.593190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a97ebf5-9649-4060-b4ab-28f23b6bbcab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:37.598666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a97ebf5-9649-4060-b4ab-28f23b6bbcab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:37.599457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a97ebf5-9649-4060-b4ab-28f23b6bbcab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:37.600411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a97ebf5-9649-4060-b4ab-28f23b6bbcab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:37.601079 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a97ebf5-9649-4060-b4ab-28f23b6bbcab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:37.601748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a97ebf5-9649-4060-b4ab-28f23b6bbcab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:37.607701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-91a3b3c0-3b48-4337-8972-809f5fd7af38 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:37.611918 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-91a3b3c0-3b48-4337-8972-809f5fd7af38 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:37.612665 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-91a3b3c0-3b48-4337-8972-809f5fd7af38 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:37.616031 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-91a3b3c0-3b48-4337-8972-809f5fd7af38 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:37.618902 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-91a3b3c0-3b48-4337-8972-809f5fd7af38 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:37.620170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-91a3b3c0-3b48-4337-8972-809f5fd7af38 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:37.717333 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-91a3b3c0-3b48-4337-8972-809f5fd7af38 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 66779798-999a-4a63-98dd-bf7fa71ce4b1] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:03:37.736762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3a97ebf5-9649-4060-b4ab-28f23b6bbcab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:37.741909 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:37.759478 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3a97ebf5-9649-4060-b4ab-28f23b6bbcab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:37.767320 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3a97ebf5-9649-4060-b4ab-28f23b6bbcab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:37.778271 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3a97ebf5-9649-4060-b4ab-28f23b6bbcab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1544 microversion: 2.91 time: 0.211925 Sep 17 21:03:37.793493 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1692/3270] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:03:37 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1544 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:03:37.810780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a120e9ac-5b88-4621-9e7b-fa11877e6d96 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:37.812027 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a120e9ac-5b88-4621-9e7b-fa11877e6d96 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:37.823198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a120e9ac-5b88-4621-9e7b-fa11877e6d96 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:37.824647 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a120e9ac-5b88-4621-9e7b-fa11877e6d96 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:37.825980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a120e9ac-5b88-4621-9e7b-fa11877e6d96 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:37.828211 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a120e9ac-5b88-4621-9e7b-fa11877e6d96 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:37.828889 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a120e9ac-5b88-4621-9e7b-fa11877e6d96 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:37.829592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a120e9ac-5b88-4621-9e7b-fa11877e6d96 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:37.893800 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-91a3b3c0-3b48-4337-8972-809f5fd7af38 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "DELETE /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1" status: 204 len: 0 microversion: 2.1 time: 0.306882 Sep 17 21:03:37.894788 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1579/3271] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:03:37 2022] DELETE /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 17 21:03:37.904353 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d7877439-1ac0-4393-b048-8fd9b44fb2d1 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:37.905532 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d7877439-1ac0-4393-b048-8fd9b44fb2d1 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 66779798-999a-4a63-98dd-bf7fa71ce4b1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:37.913151 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d7877439-1ac0-4393-b048-8fd9b44fb2d1 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:37.914625 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d7877439-1ac0-4393-b048-8fd9b44fb2d1 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:37.915294 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d7877439-1ac0-4393-b048-8fd9b44fb2d1 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:37.916265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d7877439-1ac0-4393-b048-8fd9b44fb2d1 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:37.916865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d7877439-1ac0-4393-b048-8fd9b44fb2d1 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:37.917393 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d7877439-1ac0-4393-b048-8fd9b44fb2d1 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:38.260081 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a120e9ac-5b88-4621-9e7b-fa11877e6d96 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:38.280371 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a120e9ac-5b88-4621-9e7b-fa11877e6d96 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1518 microversion: 2.1 time: 0.481615 Sep 17 21:03:38.281861 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1693/3272] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:37 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1518 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:38.355153 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d7877439-1ac0-4393-b048-8fd9b44fb2d1 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc9559a966444d98e54edb4f948ae1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d42cba2664646f6adb4202574b7fa5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:38.368228 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d7877439-1ac0-4393-b048-8fd9b44fb2d1 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1" status: 200 len: 1474 microversion: 2.1 time: 0.469161 Sep 17 21:03:38.370017 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1580/3273] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:37 2022] GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1 => generated 1474 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:38.599084 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-89afce00-08cd-475d-ba12-97fc1472db1d tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:38.602305 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-89afce00-08cd-475d-ba12-97fc1472db1d tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] [instance: c7fa190d-89fe-4b34-b3a5-955cd2ece041] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:38.631263 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-89afce00-08cd-475d-ba12-97fc1472db1d tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:38.631802 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-89afce00-08cd-475d-ba12-97fc1472db1d tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:38.632438 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-89afce00-08cd-475d-ba12-97fc1472db1d tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:38.639443 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-89afce00-08cd-475d-ba12-97fc1472db1d tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:38.642995 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-89afce00-08cd-475d-ba12-97fc1472db1d tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:38.643482 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-89afce00-08cd-475d-ba12-97fc1472db1d tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:38.814261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-acec2ccc-0a17-40fc-9557-aebd925136e4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:38.825916 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-acec2ccc-0a17-40fc-9557-aebd925136e4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:38.835478 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:UPDATE=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:38.865417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-acec2ccc-0a17-40fc-9557-aebd925136e4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:38.865704 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-acec2ccc-0a17-40fc-9557-aebd925136e4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:38.866298 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-acec2ccc-0a17-40fc-9557-aebd925136e4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:38.867059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-acec2ccc-0a17-40fc-9557-aebd925136e4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:38.867519 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-acec2ccc-0a17-40fc-9557-aebd925136e4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:38.868516 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-acec2ccc-0a17-40fc-9557-aebd925136e4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:38.925025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-89afce00-08cd-475d-ba12-97fc1472db1d tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e3adea586f4772b39b62323b1cc911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9024c27866542428191da960659ac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:38.936552 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-89afce00-08cd-475d-ba12-97fc1472db1d tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041" status: 200 len: 1312 microversion: 2.1 time: 0.344135 Sep 17 21:03:38.939577 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1694/3274] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:38 2022] GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041 => generated 1312 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:39.028109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-acec2ccc-0a17-40fc-9557-aebd925136e4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:39.031782 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:39.044736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-acec2ccc-0a17-40fc-9557-aebd925136e4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:39.046134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-acec2ccc-0a17-40fc-9557-aebd925136e4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:39.060194 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-acec2ccc-0a17-40fc-9557-aebd925136e4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1544 microversion: 2.91 time: 0.249175 Sep 17 21:03:39.061710 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1581/3275] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:03:38 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1544 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:03:39.304592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e2033894-4900-4da4-9bde-2173475541e7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:39.305994 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e2033894-4900-4da4-9bde-2173475541e7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:39.316017 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2033894-4900-4da4-9bde-2173475541e7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:39.320325 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2033894-4900-4da4-9bde-2173475541e7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:39.322096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2033894-4900-4da4-9bde-2173475541e7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:39.325259 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2033894-4900-4da4-9bde-2173475541e7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:39.325780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2033894-4900-4da4-9bde-2173475541e7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:39.326227 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2033894-4900-4da4-9bde-2173475541e7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:39.396297 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ea7ec3c8-c1e8-4baa-b7bf-9e03f0939b5b tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:39.402938 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ea7ec3c8-c1e8-4baa-b7bf-9e03f0939b5b tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 66779798-999a-4a63-98dd-bf7fa71ce4b1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:39.432359 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea7ec3c8-c1e8-4baa-b7bf-9e03f0939b5b tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:39.432950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea7ec3c8-c1e8-4baa-b7bf-9e03f0939b5b tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:39.433411 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea7ec3c8-c1e8-4baa-b7bf-9e03f0939b5b tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:39.434241 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea7ec3c8-c1e8-4baa-b7bf-9e03f0939b5b tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:39.449674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea7ec3c8-c1e8-4baa-b7bf-9e03f0939b5b tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:39.450879 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea7ec3c8-c1e8-4baa-b7bf-9e03f0939b5b tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:40.518029 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e2033894-4900-4da4-9bde-2173475541e7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:40.534930 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e2033894-4900-4da4-9bde-2173475541e7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1518 microversion: 2.1 time: 1.232723 Sep 17 21:03:40.536221 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1695/3276] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:39 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1518 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:40.544727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0baddf6a-f47e-4eae-9834-910985adc274 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:40.547759 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0baddf6a-f47e-4eae-9834-910985adc274 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] [instance: c7fa190d-89fe-4b34-b3a5-955cd2ece041] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:40.571098 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0baddf6a-f47e-4eae-9834-910985adc274 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:40.571916 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0baddf6a-f47e-4eae-9834-910985adc274 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:40.573967 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0baddf6a-f47e-4eae-9834-910985adc274 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:40.576350 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0baddf6a-f47e-4eae-9834-910985adc274 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:40.576930 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0baddf6a-f47e-4eae-9834-910985adc274 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:40.580187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0baddf6a-f47e-4eae-9834-910985adc274 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:40.678099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ea7ec3c8-c1e8-4baa-b7bf-9e03f0939b5b tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc9559a966444d98e54edb4f948ae1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d42cba2664646f6adb4202574b7fa5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:40.697316 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ea7ec3c8-c1e8-4baa-b7bf-9e03f0939b5b tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1" status: 200 len: 1474 microversion: 2.1 time: 1.310006 Sep 17 21:03:40.701256 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1582/3277] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:39 2022] GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1 => generated 1474 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:40.724764 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0fb2ba9f-4f07-4982-bcdb-bf08a449288b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:40.725958 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0fb2ba9f-4f07-4982-bcdb-bf08a449288b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:40.732841 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0fb2ba9f-4f07-4982-bcdb-bf08a449288b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:40.733713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0fb2ba9f-4f07-4982-bcdb-bf08a449288b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:40.741487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0fb2ba9f-4f07-4982-bcdb-bf08a449288b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:40.742591 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0fb2ba9f-4f07-4982-bcdb-bf08a449288b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:40.743567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0fb2ba9f-4f07-4982-bcdb-bf08a449288b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:40.744232 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0fb2ba9f-4f07-4982-bcdb-bf08a449288b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:41.211933 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0baddf6a-f47e-4eae-9834-910985adc274 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e3adea586f4772b39b62323b1cc911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9024c27866542428191da960659ac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:41.227987 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0baddf6a-f47e-4eae-9834-910985adc274 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041" status: 200 len: 1312 microversion: 2.1 time: 0.689004 Sep 17 21:03:41.237571 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1696/3278] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:40 2022] GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041 => generated 1312 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:41.250615 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0fb2ba9f-4f07-4982-bcdb-bf08a449288b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:41.264424 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0fb2ba9f-4f07-4982-bcdb-bf08a449288b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:41.267725 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0fb2ba9f-4f07-4982-bcdb-bf08a449288b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:41.275550 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0fb2ba9f-4f07-4982-bcdb-bf08a449288b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1531 microversion: 2.91 time: 0.569171 Sep 17 21:03:41.298712 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1583/3279] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:03:40 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1531 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:03:41.307708 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a080a1da-fb6e-47ed-aefd-c280ff0e7e5f tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:41.308865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a080a1da-fb6e-47ed-aefd-c280ff0e7e5f tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:41.319607 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a080a1da-fb6e-47ed-aefd-c280ff0e7e5f tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:41.321355 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a080a1da-fb6e-47ed-aefd-c280ff0e7e5f tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:41.325315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a080a1da-fb6e-47ed-aefd-c280ff0e7e5f tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:41.326713 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a080a1da-fb6e-47ed-aefd-c280ff0e7e5f tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:41.327349 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a080a1da-fb6e-47ed-aefd-c280ff0e7e5f tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:41.331058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a080a1da-fb6e-47ed-aefd-c280ff0e7e5f tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:41.516547 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-a080a1da-fb6e-47ed-aefd-c280ff0e7e5f tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Lazy-loading 'services' on Instance uuid 5b354b73-703b-4577-b7e5-f137385b9c36 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:03:41.554031 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a080a1da-fb6e-47ed-aefd-c280ff0e7e5f tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1936 microversion: 2.91 time: 0.251055 Sep 17 21:03:41.555794 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1697/3280] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:03:41 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1936 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:03:41.585092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-220a1593-1e0b-4f3b-a2a5-f3a35b1045d1 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:41.587157 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-220a1593-1e0b-4f3b-a2a5-f3a35b1045d1 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:41.594346 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-220a1593-1e0b-4f3b-a2a5-f3a35b1045d1 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:41.595218 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-220a1593-1e0b-4f3b-a2a5-f3a35b1045d1 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:41.595915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-220a1593-1e0b-4f3b-a2a5-f3a35b1045d1 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:41.597226 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-220a1593-1e0b-4f3b-a2a5-f3a35b1045d1 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:41.597961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-220a1593-1e0b-4f3b-a2a5-f3a35b1045d1 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:41.598611 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-220a1593-1e0b-4f3b-a2a5-f3a35b1045d1 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:41.625636 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-220a1593-1e0b-4f3b-a2a5-f3a35b1045d1 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lazy-loading 'flavor' on Instance uuid 5b354b73-703b-4577-b7e5-f137385b9c36 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:03:41.636455 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cb0de68f-0678-4993-a774-85bc1d401808 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:41.637090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cb0de68f-0678-4993-a774-85bc1d401808 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:41.649672 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb0de68f-0678-4993-a774-85bc1d401808 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:41.650359 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb0de68f-0678-4993-a774-85bc1d401808 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:41.654723 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb0de68f-0678-4993-a774-85bc1d401808 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:41.684934 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb0de68f-0678-4993-a774-85bc1d401808 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:41.702983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb0de68f-0678-4993-a774-85bc1d401808 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:41.703450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb0de68f-0678-4993-a774-85bc1d401808 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:42.389817 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cb0de68f-0678-4993-a774-85bc1d401808 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:42.398962 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cb0de68f-0678-4993-a774-85bc1d401808 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1518 microversion: 2.1 time: 0.832295 Sep 17 21:03:42.417850 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1584/3281] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:41 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1518 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:42.422947 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-249b5bca-54f7-493a-a739-52d2a1140c63 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:42.423581 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-249b5bca-54f7-493a-a739-52d2a1140c63 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 66779798-999a-4a63-98dd-bf7fa71ce4b1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:42.449412 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-249b5bca-54f7-493a-a739-52d2a1140c63 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:42.451940 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-249b5bca-54f7-493a-a739-52d2a1140c63 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:42.452597 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-249b5bca-54f7-493a-a739-52d2a1140c63 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:42.466176 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-249b5bca-54f7-493a-a739-52d2a1140c63 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:42.466674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-249b5bca-54f7-493a-a739-52d2a1140c63 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:42.467116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-249b5bca-54f7-493a-a739-52d2a1140c63 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:43.512259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-249b5bca-54f7-493a-a739-52d2a1140c63 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc9559a966444d98e54edb4f948ae1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d42cba2664646f6adb4202574b7fa5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:43.521175 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-249b5bca-54f7-493a-a739-52d2a1140c63 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1" status: 200 len: 1474 microversion: 2.1 time: 1.102077 Sep 17 21:03:43.534056 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1585/3282] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:42 2022] GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1 => generated 1474 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:43.553627 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a0b19f2f-73a7-4286-af5b-122480c7ba09 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:43.554428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a0b19f2f-73a7-4286-af5b-122480c7ba09 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] [instance: c7fa190d-89fe-4b34-b3a5-955cd2ece041] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:43.565117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0b19f2f-73a7-4286-af5b-122480c7ba09 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:43.565772 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0b19f2f-73a7-4286-af5b-122480c7ba09 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:43.566227 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0b19f2f-73a7-4286-af5b-122480c7ba09 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:43.567076 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0b19f2f-73a7-4286-af5b-122480c7ba09 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:43.568709 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0b19f2f-73a7-4286-af5b-122480c7ba09 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:43.569516 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0b19f2f-73a7-4286-af5b-122480c7ba09 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:44.028748 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a0b19f2f-73a7-4286-af5b-122480c7ba09 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e3adea586f4772b39b62323b1cc911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9024c27866542428191da960659ac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:44.040902 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a0b19f2f-73a7-4286-af5b-122480c7ba09 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041" status: 200 len: 1312 microversion: 2.1 time: 0.505533 Sep 17 21:03:44.045027 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1586/3283] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:43 2022] GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041 => generated 1312 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:44.063567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-472d9787-b2cd-4a34-aa14-57a3afa4ed94 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:44.068638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-472d9787-b2cd-4a34-aa14-57a3afa4ed94 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:44.093436 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-472d9787-b2cd-4a34-aa14-57a3afa4ed94 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:44.095441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-472d9787-b2cd-4a34-aa14-57a3afa4ed94 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:44.100985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-472d9787-b2cd-4a34-aa14-57a3afa4ed94 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:44.103344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-472d9787-b2cd-4a34-aa14-57a3afa4ed94 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:44.107114 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-472d9787-b2cd-4a34-aa14-57a3afa4ed94 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:44.108187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-472d9787-b2cd-4a34-aa14-57a3afa4ed94 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:44.456950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-472d9787-b2cd-4a34-aa14-57a3afa4ed94 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:44.472654 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-472d9787-b2cd-4a34-aa14-57a3afa4ed94 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1518 microversion: 2.1 time: 0.424786 Sep 17 21:03:44.474418 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1587/3284] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:44 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1518 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:44.483786 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-69bcc0dd-671d-416c-8ff2-dae25e87284d req-e26001cd-db1a-4fdf-baf7-c947b48aa7d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66779798-999a-4a63-98dd-bf7fa71ce4b1", "name": "network-vif-deleted", "tag": "4056825c-1c74-40d2-846c-e4886adca6ee"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:44.496202 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-69bcc0dd-671d-416c-8ff2-dae25e87284d req-e26001cd-db1a-4fdf-baf7-c947b48aa7d4 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:44.497069 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-69bcc0dd-671d-416c-8ff2-dae25e87284d req-e26001cd-db1a-4fdf-baf7-c947b48aa7d4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:44.497288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-69bcc0dd-671d-416c-8ff2-dae25e87284d req-e26001cd-db1a-4fdf-baf7-c947b48aa7d4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:44.513898 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-69bcc0dd-671d-416c-8ff2-dae25e87284d req-e26001cd-db1a-4fdf-baf7-c947b48aa7d4 service nova] Creating event network-vif-deleted:4056825c-1c74-40d2-846c-e4886adca6ee for instance 66779798-999a-4a63-98dd-bf7fa71ce4b1 on nch1-master-1 Sep 17 21:03:44.522834 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-69bcc0dd-671d-416c-8ff2-dae25e87284d req-e26001cd-db1a-4fdf-baf7-c947b48aa7d4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046299 Sep 17 21:03:44.528724 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1588/3285] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:44.534947 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-35b692d6-154a-490f-be77-606c5a2f4c85 req-0c579d74-a13e-4f40-ad99-96d213ec150f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7fa190d-89fe-4b34-b3a5-955cd2ece041", "name": "network-vif-plugged", "status": "completed", "tag": "a891294e-6466-4306-9bec-bc7bea066042"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:44.546503 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-35b692d6-154a-490f-be77-606c5a2f4c85 req-0c579d74-a13e-4f40-ad99-96d213ec150f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:44.547283 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-35b692d6-154a-490f-be77-606c5a2f4c85 req-0c579d74-a13e-4f40-ad99-96d213ec150f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:44.547920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-35b692d6-154a-490f-be77-606c5a2f4c85 req-0c579d74-a13e-4f40-ad99-96d213ec150f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:44.564738 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-35b692d6-154a-490f-be77-606c5a2f4c85 req-0c579d74-a13e-4f40-ad99-96d213ec150f service nova] Creating event network-vif-plugged:a891294e-6466-4306-9bec-bc7bea066042 for instance c7fa190d-89fe-4b34-b3a5-955cd2ece041 on nch2-master-1 Sep 17 21:03:44.571991 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-35b692d6-154a-490f-be77-606c5a2f4c85 req-0c579d74-a13e-4f40-ad99-96d213ec150f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040871 Sep 17 21:03:44.573352 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1589/3286] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:44.581361 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6b3d756b-636d-4d14-ba71-58c265fc6cc0 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:44.582841 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6b3d756b-636d-4d14-ba71-58c265fc6cc0 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 66779798-999a-4a63-98dd-bf7fa71ce4b1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:44.591771 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6b3d756b-636d-4d14-ba71-58c265fc6cc0 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:44.592548 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6b3d756b-636d-4d14-ba71-58c265fc6cc0 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:44.593547 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6b3d756b-636d-4d14-ba71-58c265fc6cc0 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:44.594457 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6b3d756b-636d-4d14-ba71-58c265fc6cc0 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:44.595083 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6b3d756b-636d-4d14-ba71-58c265fc6cc0 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:44.595687 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6b3d756b-636d-4d14-ba71-58c265fc6cc0 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:44.623316 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-6b3d756b-636d-4d14-ba71-58c265fc6cc0 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] HTTP exception thrown: Instance 66779798-999a-4a63-98dd-bf7fa71ce4b1 could not be found. Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6b3d756b-636d-4d14-ba71-58c265fc6cc0 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Request method failure captured: Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1 HTTP/1.1 Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjWamZvnwuKMNkq5Z383UIAt_2q9CFXQdWNCMBOs1EJ9YpV02vhZTDOeZndmE_qUMI_7iGHJ0doLRd8CUEWKvgMCGFLZI2rQDb14GuakcS3JPh2UzOaB0IthuXshKbrDZ75pZz-E3206fTW1LgMFCMOOWWnYAqLvJfmW8cbORh_fdNE Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 0d42cba2664646f6adb4202574b7fa5a Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ListImageFiltersTestJSON-988406394 Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0d42cba2664646f6adb4202574b7fa5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0d42cba2664646f6adb4202574b7fa5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0d42cba2664646f6adb4202574b7fa5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0d42cba2664646f6adb4202574b7fa5a", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ListImageFiltersTestJSON-988406394 Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 0d42cba2664646f6adb4202574b7fa5a Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-988406394 Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ListImageFiltersTestJSON-988406394-project Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 7fc9559a966444d98e54edb4f948ae1a Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ListImageFiltersTestJSON-988406394-project Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 66779798-999a-4a63-98dd-bf7fa71ce4b1 could not be found. Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '66779798-999a-4a63-98dd-bf7fa71ce4b1'} Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66779798-999a-4a63-98dd-bf7fa71ce4b1 could not be found. Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66779798-999a-4a63-98dd-bf7fa71ce4b1 could not be found. Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:03:44.624978 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:03:44.630298 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:03:44.630298 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:03:44.630298 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:03:44.630298 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:03:44.630298 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:03:44.630298 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66779798-999a-4a63-98dd-bf7fa71ce4b1 could not be found. Sep 17 21:03:44.630298 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:03:44.630298 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6b3d756b-636d-4d14-ba71-58c265fc6cc0 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Returning 404 to user: Instance 66779798-999a-4a63-98dd-bf7fa71ce4b1 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:03:44.631676 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6b3d756b-636d-4d14-ba71-58c265fc6cc0 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1" status: 404 len: 111 microversion: 2.1 time: 0.056066 Sep 17 21:03:44.635154 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1590/3287] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:44 2022] GET /compute/v2.1/servers/66779798-999a-4a63-98dd-bf7fa71ce4b1 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:03:44.646890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d953098d-5de5-4920-9b60-9ae83c45b069 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:44.647412 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d953098d-5de5-4920-9b60-9ae83c45b069 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:44.660894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d953098d-5de5-4920-9b60-9ae83c45b069 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:44.661307 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d953098d-5de5-4920-9b60-9ae83c45b069 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:44.671441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d953098d-5de5-4920-9b60-9ae83c45b069 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:44.673715 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d953098d-5de5-4920-9b60-9ae83c45b069 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:44.675135 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d953098d-5de5-4920-9b60-9ae83c45b069 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:44.676530 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d953098d-5de5-4920-9b60-9ae83c45b069 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:44.754477 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d953098d-5de5-4920-9b60-9ae83c45b069 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:03:44.944883 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d953098d-5de5-4920-9b60-9ae83c45b069 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f" status: 204 len: 0 microversion: 2.1 time: 0.305280 Sep 17 21:03:44.953189 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1591/3288] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:03:44 2022] DELETE /compute/v2.1/servers/0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:03:44.961341 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d91d3eb5-f130-4cfe-9c0b-77a30cc8018a tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:44.969544 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d91d3eb5-f130-4cfe-9c0b-77a30cc8018a tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:44.983865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d91d3eb5-f130-4cfe-9c0b-77a30cc8018a tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:44.984580 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d91d3eb5-f130-4cfe-9c0b-77a30cc8018a tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:44.985141 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d91d3eb5-f130-4cfe-9c0b-77a30cc8018a tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:44.986134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d91d3eb5-f130-4cfe-9c0b-77a30cc8018a tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:44.986879 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d91d3eb5-f130-4cfe-9c0b-77a30cc8018a tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:44.987546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d91d3eb5-f130-4cfe-9c0b-77a30cc8018a tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:45.288583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d91d3eb5-f130-4cfe-9c0b-77a30cc8018a tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc9559a966444d98e54edb4f948ae1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d42cba2664646f6adb4202574b7fa5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:45.298558 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d91d3eb5-f130-4cfe-9c0b-77a30cc8018a tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/servers/0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f" status: 200 len: 1472 microversion: 2.1 time: 0.343783 Sep 17 21:03:45.303255 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1592/3289] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:44 2022] GET /compute/v2.1/servers/0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f => generated 1472 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:45.317965 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a6c52eee-242f-4cb2-8125-6e38b206d537 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:45.318828 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a6c52eee-242f-4cb2-8125-6e38b206d537 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] [instance: c7fa190d-89fe-4b34-b3a5-955cd2ece041] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:45.331014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6c52eee-242f-4cb2-8125-6e38b206d537 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:45.331844 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6c52eee-242f-4cb2-8125-6e38b206d537 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:45.332513 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6c52eee-242f-4cb2-8125-6e38b206d537 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:45.336124 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6c52eee-242f-4cb2-8125-6e38b206d537 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:45.336722 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6c52eee-242f-4cb2-8125-6e38b206d537 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:45.337247 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6c52eee-242f-4cb2-8125-6e38b206d537 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:45.720930 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a6c52eee-242f-4cb2-8125-6e38b206d537 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e3adea586f4772b39b62323b1cc911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9024c27866542428191da960659ac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:45.753851 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a6c52eee-242f-4cb2-8125-6e38b206d537 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041" status: 200 len: 1312 microversion: 2.1 time: 0.445010 Sep 17 21:03:45.755617 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1593/3290] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:45 2022] GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041 => generated 1312 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:45.771394 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fb081740-7c2a-4fa8-9e38-58d088a5ab6b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:45.772002 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fb081740-7c2a-4fa8-9e38-58d088a5ab6b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:45.797253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb081740-7c2a-4fa8-9e38-58d088a5ab6b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:45.797790 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb081740-7c2a-4fa8-9e38-58d088a5ab6b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:45.798252 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb081740-7c2a-4fa8-9e38-58d088a5ab6b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:45.802479 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb081740-7c2a-4fa8-9e38-58d088a5ab6b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:45.802969 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb081740-7c2a-4fa8-9e38-58d088a5ab6b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:45.803417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb081740-7c2a-4fa8-9e38-58d088a5ab6b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:46.045615 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fb081740-7c2a-4fa8-9e38-58d088a5ab6b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:46.058811 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fb081740-7c2a-4fa8-9e38-58d088a5ab6b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1518 microversion: 2.1 time: 0.302061 Sep 17 21:03:46.074150 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1594/3291] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:45 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1518 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:46.325338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-26bba244-bf1e-4177-953a-c22060218949 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:46.325993 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-26bba244-bf1e-4177-953a-c22060218949 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:46.332137 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26bba244-bf1e-4177-953a-c22060218949 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:46.332629 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26bba244-bf1e-4177-953a-c22060218949 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:46.333068 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26bba244-bf1e-4177-953a-c22060218949 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:46.333883 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26bba244-bf1e-4177-953a-c22060218949 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:46.334338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26bba244-bf1e-4177-953a-c22060218949 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:46.334778 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26bba244-bf1e-4177-953a-c22060218949 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:46.563120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-26bba244-bf1e-4177-953a-c22060218949 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc9559a966444d98e54edb4f948ae1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d42cba2664646f6adb4202574b7fa5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:46.573334 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-26bba244-bf1e-4177-953a-c22060218949 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/servers/0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f" status: 200 len: 1472 microversion: 2.1 time: 0.251681 Sep 17 21:03:46.574570 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1595/3292] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:46 2022] GET /compute/v2.1/servers/0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f => generated 1472 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:46.787890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0dbc876f-84cd-4e12-adae-ad815c9d3335 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:46.788544 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0dbc876f-84cd-4e12-adae-ad815c9d3335 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] [instance: c7fa190d-89fe-4b34-b3a5-955cd2ece041] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:46.817872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0dbc876f-84cd-4e12-adae-ad815c9d3335 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:46.818660 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0dbc876f-84cd-4e12-adae-ad815c9d3335 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:46.819070 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0dbc876f-84cd-4e12-adae-ad815c9d3335 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:46.829766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0dbc876f-84cd-4e12-adae-ad815c9d3335 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:46.830442 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0dbc876f-84cd-4e12-adae-ad815c9d3335 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:46.830911 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0dbc876f-84cd-4e12-adae-ad815c9d3335 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:47.269395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0dbc876f-84cd-4e12-adae-ad815c9d3335 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e3adea586f4772b39b62323b1cc911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9024c27866542428191da960659ac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:47.282871 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0dbc876f-84cd-4e12-adae-ad815c9d3335 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041" status: 200 len: 1312 microversion: 2.1 time: 0.498577 Sep 17 21:03:47.284169 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1596/3293] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:46 2022] GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041 => generated 1312 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:03:47.289516 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b2654abe-1808-43c3-9cbf-2cb081c8546c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:47.290394 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b2654abe-1808-43c3-9cbf-2cb081c8546c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:47.300127 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b2654abe-1808-43c3-9cbf-2cb081c8546c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:47.301475 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b2654abe-1808-43c3-9cbf-2cb081c8546c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:47.302213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b2654abe-1808-43c3-9cbf-2cb081c8546c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:47.303466 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b2654abe-1808-43c3-9cbf-2cb081c8546c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:47.304150 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b2654abe-1808-43c3-9cbf-2cb081c8546c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:47.304796 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b2654abe-1808-43c3-9cbf-2cb081c8546c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:47.690243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b2654abe-1808-43c3-9cbf-2cb081c8546c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:47.709146 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b2654abe-1808-43c3-9cbf-2cb081c8546c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1518 microversion: 2.1 time: 0.423568 Sep 17 21:03:47.710033 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1597/3294] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:47 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1518 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:47.715873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0ee1b689-da92-4237-8079-bc8ff864f685 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:47.716715 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0ee1b689-da92-4237-8079-bc8ff864f685 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:47.743409 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ee1b689-da92-4237-8079-bc8ff864f685 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:47.745426 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ee1b689-da92-4237-8079-bc8ff864f685 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:47.749615 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ee1b689-da92-4237-8079-bc8ff864f685 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:47.751525 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ee1b689-da92-4237-8079-bc8ff864f685 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:47.752305 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ee1b689-da92-4237-8079-bc8ff864f685 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:47.754707 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ee1b689-da92-4237-8079-bc8ff864f685 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:48.115091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0ee1b689-da92-4237-8079-bc8ff864f685 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc9559a966444d98e54edb4f948ae1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d42cba2664646f6adb4202574b7fa5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:48.119987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:48.127640 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0ee1b689-da92-4237-8079-bc8ff864f685 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/servers/0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f" status: 200 len: 1472 microversion: 2.1 time: 0.416387 Sep 17 21:03:48.136523 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1598/3295] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:47 2022] GET /compute/v2.1/servers/0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f => generated 1472 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:48.507333 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-733a0d9c-21d4-4945-8174-d469f04d9ab5 tempest-ListImagesTestJSON-1137065226 tempest-ListImagesTestJSON-1137065226-project] Calling method '.version_select at 0x7f25a9fc1af0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:51.594694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=84 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:51.834493 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:52.584256 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-733a0d9c-21d4-4945-8174-d469f04d9ab5 tempest-ListImagesTestJSON-1137065226 tempest-ListImagesTestJSON-1137065226-project] 10.222.0.26 "GET /compute/v2.1/images/1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4" status: 200 len: 784 microversion: 2.1 time: 4.323490 Sep 17 21:03:52.584851 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-220a1593-1e0b-4f3b-a2a5-f3a35b1045d1 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "POST /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36/action" status: 202 len: 0 microversion: 2.91 time: 11.003243 Sep 17 21:03:52.588360 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1698/3296] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Sep 17 21:03:41 2022] POST /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36/action => generated 0 bytes in 11005 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:03:52.589786 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1599/3297] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:03:48 2022] GET /compute/v2.1/images/1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4 => generated 784 bytes in 4330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:03:52.601049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-240cc4a5-0868-4ffc-a90f-b89a2e0789f4 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:52.602495 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-240cc4a5-0868-4ffc-a90f-b89a2e0789f4 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] [instance: c7fa190d-89fe-4b34-b3a5-955cd2ece041] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:52.603138 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-17f10cfa-47bb-48fe-92c9-748791e2f247 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:52.603938 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-17f10cfa-47bb-48fe-92c9-748791e2f247 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:52.611478 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-240cc4a5-0868-4ffc-a90f-b89a2e0789f4 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:52.612250 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-240cc4a5-0868-4ffc-a90f-b89a2e0789f4 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:52.613473 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-240cc4a5-0868-4ffc-a90f-b89a2e0789f4 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:52.614388 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-240cc4a5-0868-4ffc-a90f-b89a2e0789f4 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:52.615122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-240cc4a5-0868-4ffc-a90f-b89a2e0789f4 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:52.615746 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-240cc4a5-0868-4ffc-a90f-b89a2e0789f4 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:52.621025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17f10cfa-47bb-48fe-92c9-748791e2f247 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:52.621555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17f10cfa-47bb-48fe-92c9-748791e2f247 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:52.622203 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17f10cfa-47bb-48fe-92c9-748791e2f247 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:52.622927 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17f10cfa-47bb-48fe-92c9-748791e2f247 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:52.623381 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17f10cfa-47bb-48fe-92c9-748791e2f247 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:52.626047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17f10cfa-47bb-48fe-92c9-748791e2f247 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:52.898070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-240cc4a5-0868-4ffc-a90f-b89a2e0789f4 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e3adea586f4772b39b62323b1cc911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9024c27866542428191da960659ac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:52.900824 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-17f10cfa-47bb-48fe-92c9-748791e2f247 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:52.910665 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-240cc4a5-0868-4ffc-a90f-b89a2e0789f4 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041" status: 200 len: 1498 microversion: 2.1 time: 0.324027 Sep 17 21:03:52.911654 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-17f10cfa-47bb-48fe-92c9-748791e2f247 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1518 microversion: 2.1 time: 0.320536 Sep 17 21:03:52.912292 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1600/3298] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:52 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1518 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:52.922416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-de28f7bb-93f9-41ea-97f4-46d57a57f780 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:52.927030 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-de28f7bb-93f9-41ea-97f4-46d57a57f780 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:52.935198 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de28f7bb-93f9-41ea-97f4-46d57a57f780 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:52.935806 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1699/3299] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:52 2022] GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041 => generated 1498 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:52.938153 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de28f7bb-93f9-41ea-97f4-46d57a57f780 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:52.939084 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de28f7bb-93f9-41ea-97f4-46d57a57f780 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:52.940129 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de28f7bb-93f9-41ea-97f4-46d57a57f780 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:52.940820 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de28f7bb-93f9-41ea-97f4-46d57a57f780 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:52.941727 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de28f7bb-93f9-41ea-97f4-46d57a57f780 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:52.944182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-09dc4961-7393-4416-b0f8-766a1a00e133 req-647a09ca-094e-4a82-82db-ef18d6eb2919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f", "name": "network-vif-deleted", "tag": "5273e052-362a-499b-8afd-752c94502a05"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:52.973074 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-09dc4961-7393-4416-b0f8-766a1a00e133 req-647a09ca-094e-4a82-82db-ef18d6eb2919 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:52.974055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-09dc4961-7393-4416-b0f8-766a1a00e133 req-647a09ca-094e-4a82-82db-ef18d6eb2919 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:52.977040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-09dc4961-7393-4416-b0f8-766a1a00e133 req-647a09ca-094e-4a82-82db-ef18d6eb2919 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:52.991147 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-09dc4961-7393-4416-b0f8-766a1a00e133 req-647a09ca-094e-4a82-82db-ef18d6eb2919 service nova] Creating event network-vif-deleted:5273e052-362a-499b-8afd-752c94502a05 for instance 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f on nch2-master-1 Sep 17 21:03:52.992815 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de28f7bb-93f9-41ea-97f4-46d57a57f780 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:52.994914 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de28f7bb-93f9-41ea-97f4-46d57a57f780 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:52.995393 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de28f7bb-93f9-41ea-97f4-46d57a57f780 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:52.996006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-de28f7bb-93f9-41ea-97f4-46d57a57f780 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lazy-loading 'fault' on Instance uuid 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:03:52.997709 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-09dc4961-7393-4416-b0f8-766a1a00e133 req-647a09ca-094e-4a82-82db-ef18d6eb2919 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059772 Sep 17 21:03:53.002587 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1700/3300] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:53.010090 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-43f9d82c-c960-43a5-bcbb-dbe9b7a26ab0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:53.011131 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-43f9d82c-c960-43a5-bcbb-dbe9b7a26ab0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:53.048256 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43f9d82c-c960-43a5-bcbb-dbe9b7a26ab0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:53.049208 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43f9d82c-c960-43a5-bcbb-dbe9b7a26ab0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:53.051083 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-de28f7bb-93f9-41ea-97f4-46d57a57f780 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc9559a966444d98e54edb4f948ae1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d42cba2664646f6adb4202574b7fa5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:53.051649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43f9d82c-c960-43a5-bcbb-dbe9b7a26ab0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:53.055963 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43f9d82c-c960-43a5-bcbb-dbe9b7a26ab0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:53.055963 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43f9d82c-c960-43a5-bcbb-dbe9b7a26ab0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:53.055963 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43f9d82c-c960-43a5-bcbb-dbe9b7a26ab0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:53.070271 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-de28f7bb-93f9-41ea-97f4-46d57a57f780 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/servers/0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f" status: 200 len: 1307 microversion: 2.1 time: 0.147008 Sep 17 21:03:53.070271 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1601/3301] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:52 2022] GET /compute/v2.1/servers/0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f => generated 1307 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:53.082075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1ea2be29-4ec3-40f0-84e4-8d5e739ed39b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:53.082944 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1ea2be29-4ec3-40f0-84e4-8d5e739ed39b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:53.092350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ea2be29-4ec3-40f0-84e4-8d5e739ed39b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:53.093292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ea2be29-4ec3-40f0-84e4-8d5e739ed39b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:53.094220 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ea2be29-4ec3-40f0-84e4-8d5e739ed39b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:53.095226 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ea2be29-4ec3-40f0-84e4-8d5e739ed39b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:53.096292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ea2be29-4ec3-40f0-84e4-8d5e739ed39b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:53.097811 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ea2be29-4ec3-40f0-84e4-8d5e739ed39b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:53.199478 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1ea2be29-4ec3-40f0-84e4-8d5e739ed39b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:53.209550 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1ea2be29-4ec3-40f0-84e4-8d5e739ed39b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:53.211339 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1ea2be29-4ec3-40f0-84e4-8d5e739ed39b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:53.218118 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1ea2be29-4ec3-40f0-84e4-8d5e739ed39b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1537 microversion: 2.91 time: 0.151175 Sep 17 21:03:53.219295 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1602/3302] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:03:53 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1537 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:03:53.224467 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4bea66de-fa3d-4f15-be9c-d65c05d0997b tempest-ListImagesTestJSON-1137065226 tempest-ListImagesTestJSON-1137065226-project] Calling method '.version_select at 0x7f25a47e2790>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:53.292560 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4bea66de-fa3d-4f15-be9c-d65c05d0997b tempest-ListImagesTestJSON-1137065226 tempest-ListImagesTestJSON-1137065226-project] 10.222.0.26 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.071744 Sep 17 21:03:53.301975 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1603/3303] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 17 21:03:53 2022] GET /compute/v2.1/images => generated 445 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:53.304819 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-43f9d82c-c960-43a5-bcbb-dbe9b7a26ab0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:53.308602 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-60c79e50-7725-470b-86c3-c49281d1d7d1 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:53.318266 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-43f9d82c-c960-43a5-bcbb-dbe9b7a26ab0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.313434 Sep 17 21:03:53.320146 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1701/3304] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:53 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:53.326188 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.compute.server_groups [None req-60c79e50-7725-470b-86c3-c49281d1d7d1 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Querying cell 056db90a-cdd9-42b2-a8c3-cd5ab36662a4(cell1) for 1 instances {{(pid=140523) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 17 21:03:53.327223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60c79e50-7725-470b-86c3-c49281d1d7d1 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:53.327908 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60c79e50-7725-470b-86c3-c49281d1d7d1 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:53.329863 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60c79e50-7725-470b-86c3-c49281d1d7d1 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:53.331500 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ee558225-527a-4723-823d-3d4f6f38cfab tempest-ListImagesTestJSON-1137065226 tempest-ListImagesTestJSON-1137065226-project] Calling method '.version_select at 0x7f25a4124700>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:53.371369 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-60c79e50-7725-470b-86c3-c49281d1d7d1 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups/60bdd01e-fc73-4ec5-9949-73c31be90c18" status: 200 len: 221 microversion: 2.1 time: 0.067881 Sep 17 21:03:53.378185 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1604/3305] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Sep 17 21:03:53 2022] GET /compute/v2.1/os-server-groups/60bdd01e-fc73-4ec5-9949-73c31be90c18 => generated 221 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:53.384112 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-508e8008-0955-4be4-ae99-d4c9795e6764 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-2136901753"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:53.392746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-508e8008-0955-4be4-ae99-d4c9795e6764 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:53.408020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-508e8008-0955-4be4-ae99-d4c9795e6764 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:53.408557 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-508e8008-0955-4be4-ae99-d4c9795e6764 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:53.409093 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-508e8008-0955-4be4-ae99-d4c9795e6764 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:53.410100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-508e8008-0955-4be4-ae99-d4c9795e6764 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:53.410771 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-508e8008-0955-4be4-ae99-d4c9795e6764 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:53.411406 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-508e8008-0955-4be4-ae99-d4c9795e6764 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:53.415527 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ee558225-527a-4723-823d-3d4f6f38cfab tempest-ListImagesTestJSON-1137065226 tempest-ListImagesTestJSON-1137065226-project] 10.222.0.26 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.092945 Sep 17 21:03:53.417507 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1702/3306] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Sep 17 21:03:53 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:53.420929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c286fb64-5f5d-43bf-a474-dc9fbbf81aa0 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:53.421427 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c286fb64-5f5d-43bf-a474-dc9fbbf81aa0 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] [instance: c7fa190d-89fe-4b34-b3a5-955cd2ece041] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:53.428093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c286fb64-5f5d-43bf-a474-dc9fbbf81aa0 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:53.428515 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c286fb64-5f5d-43bf-a474-dc9fbbf81aa0 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:53.428958 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c286fb64-5f5d-43bf-a474-dc9fbbf81aa0 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:53.429697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c286fb64-5f5d-43bf-a474-dc9fbbf81aa0 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:53.430153 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c286fb64-5f5d-43bf-a474-dc9fbbf81aa0 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:53.430574 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c286fb64-5f5d-43bf-a474-dc9fbbf81aa0 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:53.471463 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c286fb64-5f5d-43bf-a474-dc9fbbf81aa0 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] [instance: c7fa190d-89fe-4b34-b3a5-955cd2ece041] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:03:53.659029 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c286fb64-5f5d-43bf-a474-dc9fbbf81aa0 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041" status: 204 len: 0 microversion: 2.1 time: 0.241402 Sep 17 21:03:53.666079 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1703/3307] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:03:53 2022] DELETE /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:03:53.675815 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5e73e6e3-756c-4200-9d97-2744a75b2842 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:53.677312 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5e73e6e3-756c-4200-9d97-2744a75b2842 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] [instance: c7fa190d-89fe-4b34-b3a5-955cd2ece041] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:53.684004 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e73e6e3-756c-4200-9d97-2744a75b2842 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:53.684915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e73e6e3-756c-4200-9d97-2744a75b2842 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:53.687384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e73e6e3-756c-4200-9d97-2744a75b2842 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:53.688406 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e73e6e3-756c-4200-9d97-2744a75b2842 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:53.689099 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e73e6e3-756c-4200-9d97-2744a75b2842 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:53.689817 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e73e6e3-756c-4200-9d97-2744a75b2842 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:53.784859 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-508e8008-0955-4be4-ae99-d4c9795e6764 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action" status: 202 len: 0 microversion: 2.1 time: 0.404870 Sep 17 21:03:53.787422 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1605/3308] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:03:53 2022] POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action => generated 0 bytes in 408 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 17 21:03:53.798556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2e1bd803-02d9-47b6-81d5-6f70d1b76331 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:53.799584 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2e1bd803-02d9-47b6-81d5-6f70d1b76331 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:53.819268 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e1bd803-02d9-47b6-81d5-6f70d1b76331 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:53.822336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e1bd803-02d9-47b6-81d5-6f70d1b76331 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:53.823047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e1bd803-02d9-47b6-81d5-6f70d1b76331 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:53.824044 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e1bd803-02d9-47b6-81d5-6f70d1b76331 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:53.825405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e1bd803-02d9-47b6-81d5-6f70d1b76331 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:53.827305 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e1bd803-02d9-47b6-81d5-6f70d1b76331 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:54.045974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5e73e6e3-756c-4200-9d97-2744a75b2842 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e3adea586f4772b39b62323b1cc911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9024c27866542428191da960659ac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:54.059062 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5e73e6e3-756c-4200-9d97-2744a75b2842 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041" status: 200 len: 1504 microversion: 2.1 time: 0.388162 Sep 17 21:03:54.061088 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1704/3309] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:53 2022] GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041 => generated 1504 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:54.066710 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f1991283-72f5-4375-b1e0-a15d89486d49 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:54.076379 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f1991283-72f5-4375-b1e0-a15d89486d49 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:54.100995 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f1991283-72f5-4375-b1e0-a15d89486d49 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:54.107750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f1991283-72f5-4375-b1e0-a15d89486d49 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:54.108223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f1991283-72f5-4375-b1e0-a15d89486d49 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:54.109071 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f1991283-72f5-4375-b1e0-a15d89486d49 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:54.109578 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f1991283-72f5-4375-b1e0-a15d89486d49 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:54.112169 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f1991283-72f5-4375-b1e0-a15d89486d49 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:54.163947 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2e1bd803-02d9-47b6-81d5-6f70d1b76331 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:54.173980 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2e1bd803-02d9-47b6-81d5-6f70d1b76331 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1681 microversion: 2.1 time: 0.382036 Sep 17 21:03:54.181777 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1606/3310] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:53 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1681 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:54.207777 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6fafef10-d60d-42f7-9cd1-5cc750d9bd21 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:54.208734 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6fafef10-d60d-42f7-9cd1-5cc750d9bd21 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:54.228955 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fafef10-d60d-42f7-9cd1-5cc750d9bd21 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:54.229498 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fafef10-d60d-42f7-9cd1-5cc750d9bd21 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:54.230038 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fafef10-d60d-42f7-9cd1-5cc750d9bd21 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:54.230920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fafef10-d60d-42f7-9cd1-5cc750d9bd21 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:54.231390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fafef10-d60d-42f7-9cd1-5cc750d9bd21 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:54.232126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fafef10-d60d-42f7-9cd1-5cc750d9bd21 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:54.270613 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fafef10-d60d-42f7-9cd1-5cc750d9bd21 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:54.271160 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fafef10-d60d-42f7-9cd1-5cc750d9bd21 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:54.271620 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fafef10-d60d-42f7-9cd1-5cc750d9bd21 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:54.272279 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-6fafef10-d60d-42f7-9cd1-5cc750d9bd21 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lazy-loading 'fault' on Instance uuid 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:03:54.388604 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6fafef10-d60d-42f7-9cd1-5cc750d9bd21 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc9559a966444d98e54edb4f948ae1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d42cba2664646f6adb4202574b7fa5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:54.413494 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6fafef10-d60d-42f7-9cd1-5cc750d9bd21 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/servers/0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f" status: 200 len: 1307 microversion: 2.1 time: 0.217938 Sep 17 21:03:54.416598 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1607/3311] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:54 2022] GET /compute/v2.1/servers/0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f => generated 1307 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:54.428969 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e8ab0303-0210-49c2-b2a9-5d646a0147d4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:54.429643 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e8ab0303-0210-49c2-b2a9-5d646a0147d4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:54.453313 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8ab0303-0210-49c2-b2a9-5d646a0147d4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:54.453987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8ab0303-0210-49c2-b2a9-5d646a0147d4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:54.454519 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8ab0303-0210-49c2-b2a9-5d646a0147d4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:54.455338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8ab0303-0210-49c2-b2a9-5d646a0147d4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:54.455890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8ab0303-0210-49c2-b2a9-5d646a0147d4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:54.456330 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8ab0303-0210-49c2-b2a9-5d646a0147d4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:54.527055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f1991283-72f5-4375-b1e0-a15d89486d49 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:54.542207 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f1991283-72f5-4375-b1e0-a15d89486d49 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1518 microversion: 2.1 time: 0.477736 Sep 17 21:03:54.543934 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1705/3312] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:54 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1518 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:54.597763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e8ab0303-0210-49c2-b2a9-5d646a0147d4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:54.613828 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e8ab0303-0210-49c2-b2a9-5d646a0147d4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:54.622201 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e8ab0303-0210-49c2-b2a9-5d646a0147d4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:54.633746 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e8ab0303-0210-49c2-b2a9-5d646a0147d4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1537 microversion: 2.91 time: 0.213988 Sep 17 21:03:54.647139 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1608/3313] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:03:54 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1537 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:03:55.084332 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c4e6f1a0-2485-42c6-8334-b1640ddf2268 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:55.085033 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c4e6f1a0-2485-42c6-8334-b1640ddf2268 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] [instance: c7fa190d-89fe-4b34-b3a5-955cd2ece041] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:55.093665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4e6f1a0-2485-42c6-8334-b1640ddf2268 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:55.094420 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4e6f1a0-2485-42c6-8334-b1640ddf2268 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:55.095032 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4e6f1a0-2485-42c6-8334-b1640ddf2268 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:55.095743 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4e6f1a0-2485-42c6-8334-b1640ddf2268 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:55.096358 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4e6f1a0-2485-42c6-8334-b1640ddf2268 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:55.096786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4e6f1a0-2485-42c6-8334-b1640ddf2268 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:55.211405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b550b5e1-d566-42b1-a706-f13b4411ec2d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:55.212044 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b550b5e1-d566-42b1-a706-f13b4411ec2d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:55.224658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b550b5e1-d566-42b1-a706-f13b4411ec2d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:55.225319 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b550b5e1-d566-42b1-a706-f13b4411ec2d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:55.229147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b550b5e1-d566-42b1-a706-f13b4411ec2d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:55.229147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b550b5e1-d566-42b1-a706-f13b4411ec2d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:55.230901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b550b5e1-d566-42b1-a706-f13b4411ec2d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:55.231459 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b550b5e1-d566-42b1-a706-f13b4411ec2d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:55.279611 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c4e6f1a0-2485-42c6-8334-b1640ddf2268 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e3adea586f4772b39b62323b1cc911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9024c27866542428191da960659ac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:55.296020 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c4e6f1a0-2485-42c6-8334-b1640ddf2268 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041" status: 200 len: 1504 microversion: 2.1 time: 0.215643 Sep 17 21:03:55.297146 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1706/3314] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:55 2022] GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041 => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:55.384965 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b550b5e1-d566-42b1-a706-f13b4411ec2d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:55.393060 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b550b5e1-d566-42b1-a706-f13b4411ec2d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1689 microversion: 2.1 time: 0.188350 Sep 17 21:03:55.393822 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1609/3315] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:55 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1689 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:55.442563 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a6fd6650-5962-499d-9def-d666bfc8a859 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:55.443234 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a6fd6650-5962-499d-9def-d666bfc8a859 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:55.449748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6fd6650-5962-499d-9def-d666bfc8a859 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:55.450243 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6fd6650-5962-499d-9def-d666bfc8a859 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:55.450689 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6fd6650-5962-499d-9def-d666bfc8a859 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:55.451732 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6fd6650-5962-499d-9def-d666bfc8a859 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:55.452370 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6fd6650-5962-499d-9def-d666bfc8a859 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:55.453386 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6fd6650-5962-499d-9def-d666bfc8a859 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:55.489306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6fd6650-5962-499d-9def-d666bfc8a859 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:55.489876 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6fd6650-5962-499d-9def-d666bfc8a859 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:55.490314 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6fd6650-5962-499d-9def-d666bfc8a859 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:55.490976 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-a6fd6650-5962-499d-9def-d666bfc8a859 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lazy-loading 'fault' on Instance uuid 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:03:55.546777 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a6fd6650-5962-499d-9def-d666bfc8a859 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc9559a966444d98e54edb4f948ae1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d42cba2664646f6adb4202574b7fa5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:55.562696 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a6fd6650-5962-499d-9def-d666bfc8a859 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/servers/0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f" status: 200 len: 1307 microversion: 2.1 time: 0.117455 Sep 17 21:03:55.577638 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1707/3316] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:55 2022] GET /compute/v2.1/servers/0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f => generated 1307 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:55.581189 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4a6f7aff-274d-4aed-8aae-ea8f6c13448d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:55.582192 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4a6f7aff-274d-4aed-8aae-ea8f6c13448d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:55.592959 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a6f7aff-274d-4aed-8aae-ea8f6c13448d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:55.593865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a6f7aff-274d-4aed-8aae-ea8f6c13448d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:55.594748 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a6f7aff-274d-4aed-8aae-ea8f6c13448d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:55.595891 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a6f7aff-274d-4aed-8aae-ea8f6c13448d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:55.596571 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a6f7aff-274d-4aed-8aae-ea8f6c13448d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:55.597066 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a6f7aff-274d-4aed-8aae-ea8f6c13448d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:55.664542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-29cafd12-3da7-4f13-9056-7d41cb1ec32b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:55.665848 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-29cafd12-3da7-4f13-9056-7d41cb1ec32b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:55.676621 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-29cafd12-3da7-4f13-9056-7d41cb1ec32b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:55.677762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-29cafd12-3da7-4f13-9056-7d41cb1ec32b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:55.678452 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-29cafd12-3da7-4f13-9056-7d41cb1ec32b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:55.679465 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-29cafd12-3da7-4f13-9056-7d41cb1ec32b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:55.680182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-29cafd12-3da7-4f13-9056-7d41cb1ec32b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:55.680867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-29cafd12-3da7-4f13-9056-7d41cb1ec32b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:55.777659 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-29cafd12-3da7-4f13-9056-7d41cb1ec32b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:55.795818 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-29cafd12-3da7-4f13-9056-7d41cb1ec32b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:55.798100 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-29cafd12-3da7-4f13-9056-7d41cb1ec32b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:55.804782 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-29cafd12-3da7-4f13-9056-7d41cb1ec32b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1537 microversion: 2.91 time: 0.144354 Sep 17 21:03:55.805391 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1708/3317] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:03:55 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1537 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:03:55.811869 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4a6f7aff-274d-4aed-8aae-ea8f6c13448d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:55.823681 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4a6f7aff-274d-4aed-8aae-ea8f6c13448d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1518 microversion: 2.1 time: 0.248616 Sep 17 21:03:55.824724 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1610/3318] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:55 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1518 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:55.936779 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8acde574-7ce4-4d7c-8f71-177a14a9ba19 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Action: 'create', calling method: .version_select at 0x7f25a427a820>, body: {"keypair": {"name": "tempest-keypair-280449374", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPynjI3tOOO29aR2ZnP5QVZtyUTUjEFyUmgR+8K7QMDb/GMZb8XUCLLBTei1nMxJdA0qarSV38B5gnPh6UyKOOracMcOIL5EdwtpX+MDEYM/XLFQFvrmEFPEMFC0Eujrbw=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:55.952583 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-8acde574-7ce4-4d7c-8f71-177a14a9ba19 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Getting quotas for project 6fd077de53b249ba95f26480a1786123. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:03:55.958113 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-8acde574-7ce4-4d7c-8f71-177a14a9ba19 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Getting quotas for user 636ed74dc08c44dfaa1496a8016c3839 and project 6fd077de53b249ba95f26480a1786123. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:03:55.986307 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8acde574-7ce4-4d7c-8f71-177a14a9ba19 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.179615 Sep 17 21:03:55.986974 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1709/3319] 10.222.0.26 () {62 vars in 1199 bytes} [Sat Sep 17 21:03:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 181 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 17 21:03:55.998108 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d6f0311a-4501-40e9-85dd-f37ab728008a tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Calling method '.version_select at 0x7f25a5ad0ca0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:56.006989 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d6f0311a-4501-40e9-85dd-f37ab728008a tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs/tempest-keypair-280449374" status: 200 len: 512 microversion: 2.2 time: 0.012775 Sep 17 21:03:56.008140 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1611/3320] 10.222.0.26 () {60 vars in 1255 bytes} [Sat Sep 17 21:03:55 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-280449374 => generated 512 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:56.021980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ee1c77f5-f59a-48c6-8ea9-dc14d3ac0f60 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Calling method '.version_select at 0x7f25a414e940>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:56.055527 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ee1c77f5-f59a-48c6-8ea9-dc14d3ac0f60 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-280449374" status: 204 len: 0 microversion: 2.2 time: 0.038926 Sep 17 21:03:56.056408 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1710/3321] 10.222.0.26 () {60 vars in 1258 bytes} [Sat Sep 17 21:03:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-280449374 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:03:56.071049 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e18b88b8-3bfc-4942-9189-0e75641d7b0e tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Action: 'create', calling method: .version_select at 0x7f25a5967c10>, body: {"keypair": {"name": "tempest-keypair-1365942901", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjE9Cg3Px6wqSEpCXmftElli/1TCeTuZddjkImg/AOe+3z1te0CbP05hokAEVa7D+hXgqc46caHYEo70FAjVnPPTVdoWKwcJWTeHLV1oWD39Z5a19WMYw6ZI2/dr/UbXg=="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:56.092821 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-e18b88b8-3bfc-4942-9189-0e75641d7b0e tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Getting quotas for project 6fd077de53b249ba95f26480a1786123. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:03:56.099941 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-e18b88b8-3bfc-4942-9189-0e75641d7b0e tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Getting quotas for user 636ed74dc08c44dfaa1496a8016c3839 and project 6fd077de53b249ba95f26480a1786123. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:03:56.128537 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e18b88b8-3bfc-4942-9189-0e75641d7b0e tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.061750 Sep 17 21:03:56.129230 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1612/3322] 10.222.0.26 () {62 vars in 1199 bytes} [Sat Sep 17 21:03:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 63 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 17 21:03:56.143187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4d6fdf2a-6ccd-4ead-a4f6-56e57d4a7cf4 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Calling method '.version_select at 0x7f25a4128f70>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:56.165340 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4d6fdf2a-6ccd-4ead-a4f6-56e57d4a7cf4 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1365942901" status: 204 len: 0 microversion: 2.2 time: 0.026850 Sep 17 21:03:56.165998 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1711/3323] 10.222.0.26 () {60 vars in 1261 bytes} [Sat Sep 17 21:03:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1365942901 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:03:56.175418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0209412a-1ae8-4817-b47b-fb927711094a tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Action: 'create', calling method: .version_select at 0x7f25a4ed0430>, body: {"keypair": {"name": "tempest-keypair-1835478443", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:56.192829 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-0209412a-1ae8-4817-b47b-fb927711094a tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Getting quotas for project 6fd077de53b249ba95f26480a1786123. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:03:56.198696 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-0209412a-1ae8-4817-b47b-fb927711094a tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Getting quotas for user 636ed74dc08c44dfaa1496a8016c3839 and project 6fd077de53b249ba95f26480a1786123. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:03:56.229891 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:56.238573 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0209412a-1ae8-4817-b47b-fb927711094a tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.067199 Sep 17 21:03:56.239521 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1613/3324] 10.222.0.26 () {62 vars in 1199 bytes} [Sat Sep 17 21:03:56 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 69 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 17 21:03:56.250251 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2fb9404e-45a5-415b-9fa9-910b68e5d821 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Calling method '.version_select at 0x7f25a41a10d0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:56.271009 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2fb9404e-45a5-415b-9fa9-910b68e5d821 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1835478443" status: 204 len: 0 microversion: 2.2 time: 0.024710 Sep 17 21:03:56.271927 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1712/3325] 10.222.0.26 () {60 vars in 1261 bytes} [Sat Sep 17 21:03:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1835478443 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:03:56.284315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-87fb722e-f163-4ed6-b44b-9d95fa26cce3 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Action: 'create', calling method: .version_select at 0x7f25a50b1550>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-729065347", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM6gBbpeHC8sRr8h6curyHZHLiVRMIQJtOV0NX3HmZS75jnJVx5N4fA/1K9BG0m0fO6u5787kFmjieOh452r9GTaGckwfrmVkLMBthn2YmhPhov03VOmppa4Y2r0HfIQug=="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:56.301684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-87fb722e-f163-4ed6-b44b-9d95fa26cce3 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Getting quotas for project 6fd077de53b249ba95f26480a1786123. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:03:56.307063 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-87fb722e-f163-4ed6-b44b-9d95fa26cce3 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Getting quotas for user 636ed74dc08c44dfaa1496a8016c3839 and project 6fd077de53b249ba95f26480a1786123. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:03:56.320952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-85eb50e4-017b-40ad-800c-3b9feed6c068 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:56.321925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-85eb50e4-017b-40ad-800c-3b9feed6c068 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] [instance: c7fa190d-89fe-4b34-b3a5-955cd2ece041] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:56.331755 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85eb50e4-017b-40ad-800c-3b9feed6c068 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:56.332267 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85eb50e4-017b-40ad-800c-3b9feed6c068 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:56.332690 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85eb50e4-017b-40ad-800c-3b9feed6c068 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:56.333437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85eb50e4-017b-40ad-800c-3b9feed6c068 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:56.333930 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85eb50e4-017b-40ad-800c-3b9feed6c068 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:56.334357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85eb50e4-017b-40ad-800c-3b9feed6c068 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:56.334560 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-87fb722e-f163-4ed6-b44b-9d95fa26cce3 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.054477 Sep 17 21:03:56.335269 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1614/3326] 10.222.0.26 () {62 vars in 1199 bytes} [Sat Sep 17 21:03:56 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 56 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 17 21:03:56.349114 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d942e552-d4a9-484a-a7a0-396fa8d760e4 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Action: 'create', calling method: .version_select at 0x7f25a4fc4040>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-918639393", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxlzsMTUlWpT7rxFcZZKr/OoLkwHZxhKYaruKsGhNJRjfBqGfEKOApxAcxrS5Yg6ONHgPqvA5FGpPYzowy8V8QsGoba1EwyyaRA0ZaR6zdwCmdZU8tuqPI6V8E9m8ZhAg=="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:56.365420 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-d942e552-d4a9-484a-a7a0-396fa8d760e4 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Getting quotas for project 6fd077de53b249ba95f26480a1786123. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:03:56.370615 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-d942e552-d4a9-484a-a7a0-396fa8d760e4 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Getting quotas for user 636ed74dc08c44dfaa1496a8016c3839 and project 6fd077de53b249ba95f26480a1786123. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:03:56.394961 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d942e552-d4a9-484a-a7a0-396fa8d760e4 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.050243 Sep 17 21:03:56.395571 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1615/3327] 10.222.0.26 () {62 vars in 1199 bytes} [Sat Sep 17 21:03:56 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 17 21:03:56.408755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-24dde092-4bd2-4ea5-a01c-d6995d80823f tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Action: 'create', calling method: .version_select at 0x7f25a9fc13a0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-711193774", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGn4OjR9TiCQRnOvYPX9R+jJlzEerSqQgbzAAuZlxZx5GilWvfJ882gCNOg0UXppeYl4Q8f9t7YdEGzoK/rtFXa7tvbHXxyvft1BucLtDKQDQN6sFaQroz7JC3PwdF4swg=="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:56.424389 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-24dde092-4bd2-4ea5-a01c-d6995d80823f tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Getting quotas for project 6fd077de53b249ba95f26480a1786123. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:03:56.432094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-24dde092-4bd2-4ea5-a01c-d6995d80823f tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Getting quotas for user 636ed74dc08c44dfaa1496a8016c3839 and project 6fd077de53b249ba95f26480a1786123. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:03:56.473640 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-24dde092-4bd2-4ea5-a01c-d6995d80823f tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.068602 Sep 17 21:03:56.474953 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1616/3328] 10.222.0.26 () {62 vars in 1199 bytes} [Sat Sep 17 21:03:56 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 71 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Sep 17 21:03:56.484762 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-94ede84f-a506-4fd9-8d9c-fb9c95ab4bc2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:56.485392 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-94ede84f-a506-4fd9-8d9c-fb9c95ab4bc2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:56.491711 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-94ede84f-a506-4fd9-8d9c-fb9c95ab4bc2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:56.492634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-94ede84f-a506-4fd9-8d9c-fb9c95ab4bc2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:56.493232 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-94ede84f-a506-4fd9-8d9c-fb9c95ab4bc2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:56.494237 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-94ede84f-a506-4fd9-8d9c-fb9c95ab4bc2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:56.494866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-94ede84f-a506-4fd9-8d9c-fb9c95ab4bc2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:56.495457 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-94ede84f-a506-4fd9-8d9c-fb9c95ab4bc2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:56.529667 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-85eb50e4-017b-40ad-800c-3b9feed6c068 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e3adea586f4772b39b62323b1cc911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9024c27866542428191da960659ac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:56.538190 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-85eb50e4-017b-40ad-800c-3b9feed6c068 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041" status: 200 len: 1504 microversion: 2.1 time: 0.221895 Sep 17 21:03:56.539118 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1713/3329] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:56 2022] GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041 => generated 1504 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:03:56.557719 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-423baf96-ed99-44f7-974f-98b7a89a3c2d tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Calling method '.version_select at 0x7f25a40d40d0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:56.562405 ncdv-master-1 devstack@n-api.service[140524]: WARNING oslo_db.sqlalchemy.utils [None req-423baf96-ed99-44f7-974f-98b7a89a3c2d tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 17 21:03:56.571587 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-423baf96-ed99-44f7-974f-98b7a89a3c2d tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs" status: 200 len: 1139 microversion: 2.2 time: 0.030662 Sep 17 21:03:56.572973 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1714/3330] 10.222.0.26 () {60 vars in 1177 bytes} [Sat Sep 17 21:03:56 2022] GET /compute/v2.1/os-keypairs => generated 1139 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:56.585931 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4e60084b-ae67-465f-8bbc-9c5740c982c5 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Calling method '.version_select at 0x7f25a4128d30>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:56.613829 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4e60084b-ae67-465f-8bbc-9c5740c982c5 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-711193774" status: 204 len: 0 microversion: 2.2 time: 0.033343 Sep 17 21:03:56.614844 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1715/3331] 10.222.0.26 () {60 vars in 1318 bytes} [Sat Sep 17 21:03:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-711193774 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 17 21:03:56.622371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-abc9156d-379b-42b3-bf55-56d1d71d8e36 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:56.623282 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-abc9156d-379b-42b3-bf55-56d1d71d8e36 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:56.636504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abc9156d-379b-42b3-bf55-56d1d71d8e36 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:56.637546 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abc9156d-379b-42b3-bf55-56d1d71d8e36 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:56.638921 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abc9156d-379b-42b3-bf55-56d1d71d8e36 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:56.640123 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abc9156d-379b-42b3-bf55-56d1d71d8e36 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:56.640839 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abc9156d-379b-42b3-bf55-56d1d71d8e36 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:56.641438 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abc9156d-379b-42b3-bf55-56d1d71d8e36 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:56.668553 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-94ede84f-a506-4fd9-8d9c-fb9c95ab4bc2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:56.681758 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-94ede84f-a506-4fd9-8d9c-fb9c95ab4bc2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1689 microversion: 2.1 time: 0.204210 Sep 17 21:03:56.683139 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1617/3332] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:56 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1689 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:56.699293 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-87a19c97-6e46-4393-8a7e-61c1d7106021 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Calling method '.version_select at 0x7f25a5842820>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:56.712115 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abc9156d-379b-42b3-bf55-56d1d71d8e36 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:56.712755 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abc9156d-379b-42b3-bf55-56d1d71d8e36 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:56.714082 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abc9156d-379b-42b3-bf55-56d1d71d8e36 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:56.715303 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-abc9156d-379b-42b3-bf55-56d1d71d8e36 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lazy-loading 'fault' on Instance uuid 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:03:56.725302 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-87a19c97-6e46-4393-8a7e-61c1d7106021 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-918639393" status: 204 len: 0 microversion: 2.2 time: 0.039306 Sep 17 21:03:56.727270 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1618/3333] 10.222.0.26 () {60 vars in 1318 bytes} [Sat Sep 17 21:03:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-918639393 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:03:56.737980 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-184ac94a-087a-40e9-ad1c-9d1ab60484cf tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Calling method '.version_select at 0x7f25a4ed00d0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:56.764855 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-184ac94a-087a-40e9-ad1c-9d1ab60484cf tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-729065347" status: 204 len: 0 microversion: 2.2 time: 0.032150 Sep 17 21:03:56.766333 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1619/3334] 10.222.0.26 () {60 vars in 1318 bytes} [Sat Sep 17 21:03:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-729065347 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:03:56.771684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-dfb63dec-fbca-48da-8bae-b9a9a9f371d4 req-277a2ddb-e3e7-4926-b8e2-0dfb3f2c2ec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41393a54-9105-4da5-ae65-3167427ddae8", "name": "network-vif-unplugged", "status": "completed", "tag": "4d47e229-8239-4215-8c5c-b5133bcfb47b"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:56.779332 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-abc9156d-379b-42b3-bf55-56d1d71d8e36 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc9559a966444d98e54edb4f948ae1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d42cba2664646f6adb4202574b7fa5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:56.788100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-dfb63dec-fbca-48da-8bae-b9a9a9f371d4 req-277a2ddb-e3e7-4926-b8e2-0dfb3f2c2ec0 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:56.788823 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-abc9156d-379b-42b3-bf55-56d1d71d8e36 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/servers/0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f" status: 200 len: 1307 microversion: 2.1 time: 0.172462 Sep 17 21:03:56.789187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-dfb63dec-fbca-48da-8bae-b9a9a9f371d4 req-277a2ddb-e3e7-4926-b8e2-0dfb3f2c2ec0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:56.790096 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1716/3335] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:56 2022] GET /compute/v2.1/servers/0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f => generated 1307 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:56.791031 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-dfb63dec-fbca-48da-8bae-b9a9a9f371d4 req-277a2ddb-e3e7-4926-b8e2-0dfb3f2c2ec0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:56.795883 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-da17a05d-a4b5-4349-8cc9-58a59933285c tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Action: 'create', calling method: .version_select at 0x7f25a41354c0>, body: {"keypair": {"name": "tempest-keypair-1981842594", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJzSb8d+qPKEbIvFAFBsh+UvVmwzWMHWWzH406d1GUbR9KJkGKPRlPT+V1MwW4w280/pcOoI0paolg1516FsPfOStHsND7dtkWWLkEPVg1sOBwaGD1NoOOyj+pvhXQEA9w=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:56.804588 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-dfb63dec-fbca-48da-8bae-b9a9a9f371d4 req-277a2ddb-e3e7-4926-b8e2-0dfb3f2c2ec0 service nova] Creating event network-vif-unplugged:4d47e229-8239-4215-8c5c-b5133bcfb47b for instance 41393a54-9105-4da5-ae65-3167427ddae8 on nch1-master-1 Sep 17 21:03:56.811091 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-dfb63dec-fbca-48da-8bae-b9a9a9f371d4 req-277a2ddb-e3e7-4926-b8e2-0dfb3f2c2ec0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042695 Sep 17 21:03:56.814141 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1620/3336] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:56.819068 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-da17a05d-a4b5-4349-8cc9-58a59933285c tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Getting quotas for project 6fd077de53b249ba95f26480a1786123. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:03:56.824813 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-da17a05d-a4b5-4349-8cc9-58a59933285c tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Getting quotas for user 636ed74dc08c44dfaa1496a8016c3839 and project 6fd077de53b249ba95f26480a1786123. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:03:56.852130 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d7975fe2-a941-403a-bf07-6e9d6349bff4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:56.853076 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d7975fe2-a941-403a-bf07-6e9d6349bff4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:56.870947 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-da17a05d-a4b5-4349-8cc9-58a59933285c tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.079376 Sep 17 21:03:56.871766 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1717/3337] 10.222.0.26 () {62 vars in 1199 bytes} [Sat Sep 17 21:03:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 81 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 17 21:03:56.875226 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d7975fe2-a941-403a-bf07-6e9d6349bff4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:56.880484 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d7975fe2-a941-403a-bf07-6e9d6349bff4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:56.881133 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d7975fe2-a941-403a-bf07-6e9d6349bff4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:56.883282 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d7975fe2-a941-403a-bf07-6e9d6349bff4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:56.884351 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d7975fe2-a941-403a-bf07-6e9d6349bff4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:56.884351 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d7975fe2-a941-403a-bf07-6e9d6349bff4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:56.885493 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bc171299-5531-4a74-8d20-ecaee7bbe019 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:56.886225 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bc171299-5531-4a74-8d20-ecaee7bbe019 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:56.897973 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc171299-5531-4a74-8d20-ecaee7bbe019 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:56.900091 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc171299-5531-4a74-8d20-ecaee7bbe019 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:56.900901 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc171299-5531-4a74-8d20-ecaee7bbe019 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:56.901840 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc171299-5531-4a74-8d20-ecaee7bbe019 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:56.902440 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc171299-5531-4a74-8d20-ecaee7bbe019 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:56.917153 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc171299-5531-4a74-8d20-ecaee7bbe019 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:56.985713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d7975fe2-a941-403a-bf07-6e9d6349bff4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:56.993692 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d7975fe2-a941-403a-bf07-6e9d6349bff4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:56.995121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d7975fe2-a941-403a-bf07-6e9d6349bff4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:57.000656 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d7975fe2-a941-403a-bf07-6e9d6349bff4 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1537 microversion: 2.91 time: 0.154171 Sep 17 21:03:57.001242 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1621/3338] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:03:56 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1537 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:03:57.006810 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-84a4444c-d04a-466a-8fe5-5d33ac9a530d tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Calling method '.version_select at 0x7f25a4ed0160>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:57.034516 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-84a4444c-d04a-466a-8fe5-5d33ac9a530d tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs/tempest-keypair-1981842594" status: 200 len: 513 microversion: 2.2 time: 0.031777 Sep 17 21:03:57.036061 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1622/3339] 10.222.0.26 () {60 vars in 1258 bytes} [Sat Sep 17 21:03:57 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1981842594 => generated 513 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:03:57.048282 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-388347f5-c2a6-4cdb-b420-801539135dcc tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Calling method '.version_select at 0x7f25a4e95310>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:57.053680 ncdv-master-1 devstack@n-api.service[140523]: WARNING oslo_db.sqlalchemy.utils [None req-388347f5-c2a6-4cdb-b420-801539135dcc tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 17 21:03:57.059616 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-388347f5-c2a6-4cdb-b420-801539135dcc tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.015546 Sep 17 21:03:57.060448 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1623/3340] 10.222.0.26 () {60 vars in 1177 bytes} [Sat Sep 17 21:03:57 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:03:57.074279 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f70c5b89-d662-4982-9c47-2ac6e22e850d tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Calling method '.version_select at 0x7f25a4fc4430>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:57.103006 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f70c5b89-d662-4982-9c47-2ac6e22e850d tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1981842594" status: 204 len: 0 microversion: 2.2 time: 0.033528 Sep 17 21:03:57.105573 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1624/3341] 10.222.0.26 () {60 vars in 1261 bytes} [Sat Sep 17 21:03:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1981842594 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 17 21:03:57.115238 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4fd463fa-ef8d-4e72-83cd-c6c0d0ac0158 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Action: 'create', calling method: .version_select at 0x7f25a4c8d940>, body: {"keypair": {"name": "tempest-keypair-1090277368", "type": "x509"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:57.135719 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-4fd463fa-ef8d-4e72-83cd-c6c0d0ac0158 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Getting quotas for project 6fd077de53b249ba95f26480a1786123. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:03:57.142730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-4fd463fa-ef8d-4e72-83cd-c6c0d0ac0158 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Getting quotas for user 636ed74dc08c44dfaa1496a8016c3839 and project 6fd077de53b249ba95f26480a1786123. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:03:57.183457 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.processutils [None req-4fd463fa-ef8d-4e72-83cd-c6c0d0ac0158 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp3jwc3d30/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp3jwc3d30/temp.key -subj /CN=636ed74dc08c44dfaa1496a8016c3839 -extensions v3_req_client {{(pid=140523) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 17 21:03:57.351434 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.processutils [None req-4fd463fa-ef8d-4e72-83cd-c6c0d0ac0158 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp3jwc3d30/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp3jwc3d30/temp.key -subj /CN=636ed74dc08c44dfaa1496a8016c3839 -extensions v3_req_client" returned: 0 in 0.168s {{(pid=140523) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 17 21:03:57.352472 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.processutils [None req-4fd463fa-ef8d-4e72-83cd-c6c0d0ac0158 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp3jwc3d30/temp.key -password pass: {{(pid=140523) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 17 21:03:57.379451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.processutils [None req-4fd463fa-ef8d-4e72-83cd-c6c0d0ac0158 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp3jwc3d30/temp.key -password pass:" returned: 0 in 0.026s {{(pid=140523) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 17 21:03:57.454729 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-4fd463fa-ef8d-4e72-83cd-c6c0d0ac0158 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Getting quotas for project 6fd077de53b249ba95f26480a1786123. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:03:57.462210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-4fd463fa-ef8d-4e72-83cd-c6c0d0ac0158 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Getting quotas for user 636ed74dc08c44dfaa1496a8016c3839 and project 6fd077de53b249ba95f26480a1786123. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:03:57.483714 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4fd463fa-ef8d-4e72-83cd-c6c0d0ac0158 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.372772 Sep 17 21:03:57.490681 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1625/3342] 10.222.0.26 () {62 vars in 1198 bytes} [Sat Sep 17 21:03:57 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 375 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:03:57.499512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c6905861-0911-4a4f-ade4-c596e68c0fe3 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Calling method '.version_select at 0x7f25a4f95790>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:57.511817 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c6905861-0911-4a4f-ade4-c596e68c0fe3 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs/tempest-keypair-1090277368" status: 200 len: 1534 microversion: 2.2 time: 0.018840 Sep 17 21:03:57.512991 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1626/3343] 10.222.0.26 () {60 vars in 1258 bytes} [Sat Sep 17 21:03:57 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1090277368 => generated 1534 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:57.525935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f9c7f8eb-5987-45b5-9743-7efb088133ae tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Calling method '.version_select at 0x7f25a4c8dc10>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:57.534570 ncdv-master-1 devstack@n-api.service[140523]: WARNING oslo_db.sqlalchemy.utils [None req-f9c7f8eb-5987-45b5-9743-7efb088133ae tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 17 21:03:57.535042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bc171299-5531-4a74-8d20-ecaee7bbe019 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:57.541517 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f9c7f8eb-5987-45b5-9743-7efb088133ae tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.020481 Sep 17 21:03:57.542498 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1627/3344] 10.222.0.26 () {60 vars in 1177 bytes} [Sat Sep 17 21:03:57 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:03:57.555465 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-08387e96-0ccd-413f-b2c7-8d08d66f8647 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] Calling method '.version_select at 0x7f25a51ee700>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:57.559952 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bc171299-5531-4a74-8d20-ecaee7bbe019 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1518 microversion: 2.1 time: 0.686486 Sep 17 21:03:57.577495 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1718/3345] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:56 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1518 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:57.577495 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2efc7c42-23ae-4010-bbe1-e7d965f85b3d tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:57.578268 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2efc7c42-23ae-4010-bbe1-e7d965f85b3d tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] [instance: c7fa190d-89fe-4b34-b3a5-955cd2ece041] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:57.590634 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2efc7c42-23ae-4010-bbe1-e7d965f85b3d tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:57.591320 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2efc7c42-23ae-4010-bbe1-e7d965f85b3d tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:57.591746 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2efc7c42-23ae-4010-bbe1-e7d965f85b3d tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:57.592469 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2efc7c42-23ae-4010-bbe1-e7d965f85b3d tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:57.592966 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2efc7c42-23ae-4010-bbe1-e7d965f85b3d tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:57.593647 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2efc7c42-23ae-4010-bbe1-e7d965f85b3d tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:57.604462 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-08387e96-0ccd-413f-b2c7-8d08d66f8647 tempest-KeyPairsV22TestJSON-346577936 tempest-KeyPairsV22TestJSON-346577936-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1090277368" status: 204 len: 0 microversion: 2.2 time: 0.054856 Sep 17 21:03:57.610313 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1628/3346] 10.222.0.26 () {60 vars in 1261 bytes} [Sat Sep 17 21:03:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1090277368 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 17 21:03:57.707126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-be805e86-4026-4442-85c6-60a04e5efd27 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:57.707916 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-be805e86-4026-4442-85c6-60a04e5efd27 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:57.716643 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be805e86-4026-4442-85c6-60a04e5efd27 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:57.717503 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be805e86-4026-4442-85c6-60a04e5efd27 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:57.718198 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be805e86-4026-4442-85c6-60a04e5efd27 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:57.719231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be805e86-4026-4442-85c6-60a04e5efd27 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:57.719899 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be805e86-4026-4442-85c6-60a04e5efd27 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:57.720529 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be805e86-4026-4442-85c6-60a04e5efd27 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:57.868189 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2efc7c42-23ae-4010-bbe1-e7d965f85b3d tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e3adea586f4772b39b62323b1cc911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9024c27866542428191da960659ac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:57.885812 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2efc7c42-23ae-4010-bbe1-e7d965f85b3d tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041" status: 200 len: 1504 microversion: 2.1 time: 0.320709 Sep 17 21:03:57.887310 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1719/3347] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:57 2022] GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041 => generated 1504 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:57.892015 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-11405872-8674-45c3-a5ff-c6a6cf0da3fe tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:57.892763 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-11405872-8674-45c3-a5ff-c6a6cf0da3fe tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:57.899172 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-11405872-8674-45c3-a5ff-c6a6cf0da3fe tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:57.899901 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-11405872-8674-45c3-a5ff-c6a6cf0da3fe tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:57.900561 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-11405872-8674-45c3-a5ff-c6a6cf0da3fe tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:57.902025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-11405872-8674-45c3-a5ff-c6a6cf0da3fe tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:57.902737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-11405872-8674-45c3-a5ff-c6a6cf0da3fe tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:57.903404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-11405872-8674-45c3-a5ff-c6a6cf0da3fe tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:57.986234 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-11405872-8674-45c3-a5ff-c6a6cf0da3fe tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:57.986234 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-11405872-8674-45c3-a5ff-c6a6cf0da3fe tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:57.986651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-11405872-8674-45c3-a5ff-c6a6cf0da3fe tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:57.987108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-11405872-8674-45c3-a5ff-c6a6cf0da3fe tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lazy-loading 'fault' on Instance uuid 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:03:58.018546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-be805e86-4026-4442-85c6-60a04e5efd27 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:58.037209 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-be805e86-4026-4442-85c6-60a04e5efd27 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1684 microversion: 2.1 time: 0.334473 Sep 17 21:03:58.055084 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1629/3348] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:57 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1684 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:03:58.063816 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-36e2f3fa-d8d4-4b65-97ab-b2f3d83927b2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:58.066508 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-36e2f3fa-d8d4-4b65-97ab-b2f3d83927b2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:58.082880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36e2f3fa-d8d4-4b65-97ab-b2f3d83927b2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:58.086152 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36e2f3fa-d8d4-4b65-97ab-b2f3d83927b2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:58.086879 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36e2f3fa-d8d4-4b65-97ab-b2f3d83927b2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:58.087630 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36e2f3fa-d8d4-4b65-97ab-b2f3d83927b2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:58.088098 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36e2f3fa-d8d4-4b65-97ab-b2f3d83927b2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:58.088533 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36e2f3fa-d8d4-4b65-97ab-b2f3d83927b2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:58.178578 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-11405872-8674-45c3-a5ff-c6a6cf0da3fe tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fc9559a966444d98e54edb4f948ae1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d42cba2664646f6adb4202574b7fa5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:58.195159 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-11405872-8674-45c3-a5ff-c6a6cf0da3fe tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/servers/0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f" status: 200 len: 1307 microversion: 2.1 time: 0.306459 Sep 17 21:03:58.195750 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1720/3349] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:57 2022] GET /compute/v2.1/servers/0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f => generated 1307 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:58.249086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-36e2f3fa-d8d4-4b65-97ab-b2f3d83927b2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:58.266200 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-36e2f3fa-d8d4-4b65-97ab-b2f3d83927b2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:58.268315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-36e2f3fa-d8d4-4b65-97ab-b2f3d83927b2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:58.282011 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-36e2f3fa-d8d4-4b65-97ab-b2f3d83927b2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1537 microversion: 2.91 time: 0.224869 Sep 17 21:03:58.283797 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1630/3350] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:03:58 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1537 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:03:58.590584 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6eaa420f-e229-4936-b7b8-2b4e7222b68d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:58.591325 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6eaa420f-e229-4936-b7b8-2b4e7222b68d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:58.608510 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6eaa420f-e229-4936-b7b8-2b4e7222b68d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:58.612714 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6eaa420f-e229-4936-b7b8-2b4e7222b68d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:58.613413 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6eaa420f-e229-4936-b7b8-2b4e7222b68d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:58.614230 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6eaa420f-e229-4936-b7b8-2b4e7222b68d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:58.616731 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6eaa420f-e229-4936-b7b8-2b4e7222b68d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:58.617398 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6eaa420f-e229-4936-b7b8-2b4e7222b68d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:58.715609 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:58.886980 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-efaa2f46-b605-4b4d-b820-8c0d898779af req-b5ce4562-473b-43ba-8adf-3f26d68bb6d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41393a54-9105-4da5-ae65-3167427ddae8", "name": "network-vif-plugged", "status": "completed", "tag": "4d47e229-8239-4215-8c5c-b5133bcfb47b"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:03:58.909336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-efaa2f46-b605-4b4d-b820-8c0d898779af req-b5ce4562-473b-43ba-8adf-3f26d68bb6d3 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:58.912370 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-efaa2f46-b605-4b4d-b820-8c0d898779af req-b5ce4562-473b-43ba-8adf-3f26d68bb6d3 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:58.914642 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-efaa2f46-b605-4b4d-b820-8c0d898779af req-b5ce4562-473b-43ba-8adf-3f26d68bb6d3 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:58.947247 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-efaa2f46-b605-4b4d-b820-8c0d898779af req-b5ce4562-473b-43ba-8adf-3f26d68bb6d3 service nova] Creating event network-vif-plugged:4d47e229-8239-4215-8c5c-b5133bcfb47b for instance 41393a54-9105-4da5-ae65-3167427ddae8 on nch1-master-1 Sep 17 21:03:58.967510 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-efaa2f46-b605-4b4d-b820-8c0d898779af req-b5ce4562-473b-43ba-8adf-3f26d68bb6d3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084471 Sep 17 21:03:58.968196 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1631/3351] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:03:58.975336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-47270f08-f385-4268-a135-06041402e5e7 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:58.988818 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-47270f08-f385-4268-a135-06041402e5e7 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] [instance: c7fa190d-89fe-4b34-b3a5-955cd2ece041] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:58.993382 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=91,nova_api:DELETE=4 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:59.008033 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47270f08-f385-4268-a135-06041402e5e7 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:59.014346 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47270f08-f385-4268-a135-06041402e5e7 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:59.018455 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47270f08-f385-4268-a135-06041402e5e7 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:59.021107 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47270f08-f385-4268-a135-06041402e5e7 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:59.033810 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47270f08-f385-4268-a135-06041402e5e7 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:59.034435 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47270f08-f385-4268-a135-06041402e5e7 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:59.039868 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:03:59.090737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6eaa420f-e229-4936-b7b8-2b4e7222b68d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:59.103276 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6eaa420f-e229-4936-b7b8-2b4e7222b68d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1518 microversion: 2.1 time: 0.516876 Sep 17 21:03:59.104165 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1721/3352] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:58 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1518 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:03:59.115827 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d45cce29-cfb8-4970-9e1a-da4c58616113 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:59.116788 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d45cce29-cfb8-4970-9e1a-da4c58616113 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:59.134257 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d45cce29-cfb8-4970-9e1a-da4c58616113 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:59.134964 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d45cce29-cfb8-4970-9e1a-da4c58616113 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:59.135412 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d45cce29-cfb8-4970-9e1a-da4c58616113 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:59.136143 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d45cce29-cfb8-4970-9e1a-da4c58616113 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:59.136604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d45cce29-cfb8-4970-9e1a-da4c58616113 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:59.137035 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d45cce29-cfb8-4970-9e1a-da4c58616113 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:59.581512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-47270f08-f385-4268-a135-06041402e5e7 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e3adea586f4772b39b62323b1cc911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9024c27866542428191da960659ac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:59.607639 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-47270f08-f385-4268-a135-06041402e5e7 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041" status: 200 len: 1504 microversion: 2.1 time: 0.638007 Sep 17 21:03:59.608855 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1632/3353] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:58 2022] GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041 => generated 1504 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:59.625761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-418b214f-7abf-4050-81f9-63ea090d519a tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:59.626704 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-418b214f-7abf-4050-81f9-63ea090d519a tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] [instance: 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:59.641231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-418b214f-7abf-4050-81f9-63ea090d519a tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:59.642077 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-418b214f-7abf-4050-81f9-63ea090d519a tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:59.642704 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-418b214f-7abf-4050-81f9-63ea090d519a tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:59.643919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-418b214f-7abf-4050-81f9-63ea090d519a tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:59.644552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-418b214f-7abf-4050-81f9-63ea090d519a tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:59.645151 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-418b214f-7abf-4050-81f9-63ea090d519a tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:59.669837 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-418b214f-7abf-4050-81f9-63ea090d519a tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] HTTP exception thrown: Instance 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f could not be found. Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-418b214f-7abf-4050-81f9-63ea090d519a tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Request method failure captured: Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f HTTP/1.1 Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjWamZvnwuKMNkq5Z383UIAt_2q9CFXQdWNCMBOs1EJ9YpV02vhZTDOeZndmE_qUMI_7iGHJ0doLRd8CUEWKvgMCGFLZI2rQDb14GuakcS3JPh2UzOaB0IthuXshKbrDZ75pZz-E3206fTW1LgMFCMOOWWnYAqLvJfmW8cbORh_fdNE Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 0d42cba2664646f6adb4202574b7fa5a Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ListImageFiltersTestJSON-988406394 Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0d42cba2664646f6adb4202574b7fa5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0d42cba2664646f6adb4202574b7fa5a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0d42cba2664646f6adb4202574b7fa5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0d42cba2664646f6adb4202574b7fa5a", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ListImageFiltersTestJSON-988406394 Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 0d42cba2664646f6adb4202574b7fa5a Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-988406394 Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ListImageFiltersTestJSON-988406394-project Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 7fc9559a966444d98e54edb4f948ae1a Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ListImageFiltersTestJSON-988406394-project Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f could not be found. Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f'} Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f could not be found. Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f could not be found. Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:03:59.682604 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:03:59.688101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:03:59.688101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:03:59.688101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:03:59.688101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:03:59.688101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:03:59.688101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f could not be found. Sep 17 21:03:59.688101 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:03:59.696283 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d45cce29-cfb8-4970-9e1a-da4c58616113 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:03:59.703808 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-418b214f-7abf-4050-81f9-63ea090d519a tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Returning 404 to user: Instance 0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:03:59.706529 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-418b214f-7abf-4050-81f9-63ea090d519a tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "GET /compute/v2.1/servers/0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f" status: 404 len: 111 microversion: 2.1 time: 0.096354 Sep 17 21:03:59.708592 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1633/3354] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:59 2022] GET /compute/v2.1/servers/0ace2c05-c5fe-4cd3-b0b7-0158eac1db1f => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:03:59.718302 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d45cce29-cfb8-4970-9e1a-da4c58616113 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1684 microversion: 2.1 time: 0.612840 Sep 17 21:03:59.729882 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1722/3355] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:03:59 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1684 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:03:59.733871 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2f052482-0ae7-4238-8813-5730b50c341a tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:59.734892 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-72e5e8b2-bb85-4e9a-8be6-962a0a6dad7b tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:03:59.735317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2f052482-0ae7-4238-8813-5730b50c341a tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:59.735460 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-72e5e8b2-bb85-4e9a-8be6-962a0a6dad7b tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] [instance: 2b665d60-71ad-42ef-b99f-e87bc951ee62] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:03:59.749808 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72e5e8b2-bb85-4e9a-8be6-962a0a6dad7b tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:59.750350 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72e5e8b2-bb85-4e9a-8be6-962a0a6dad7b tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:59.750818 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72e5e8b2-bb85-4e9a-8be6-962a0a6dad7b tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:59.751561 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72e5e8b2-bb85-4e9a-8be6-962a0a6dad7b tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:59.752042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72e5e8b2-bb85-4e9a-8be6-962a0a6dad7b tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:59.752471 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72e5e8b2-bb85-4e9a-8be6-962a0a6dad7b tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:59.759045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f052482-0ae7-4238-8813-5730b50c341a tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:59.761761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f052482-0ae7-4238-8813-5730b50c341a tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:59.763916 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f052482-0ae7-4238-8813-5730b50c341a tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:59.765655 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f052482-0ae7-4238-8813-5730b50c341a tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:03:59.767547 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f052482-0ae7-4238-8813-5730b50c341a tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:03:59.768169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f052482-0ae7-4238-8813-5730b50c341a tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:03:59.824637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-72e5e8b2-bb85-4e9a-8be6-962a0a6dad7b tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] [instance: 2b665d60-71ad-42ef-b99f-e87bc951ee62] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:04:00.034618 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2f052482-0ae7-4238-8813-5730b50c341a tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:00.047110 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2f052482-0ae7-4238-8813-5730b50c341a tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:00.053453 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2f052482-0ae7-4238-8813-5730b50c341a tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:00.073958 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2f052482-0ae7-4238-8813-5730b50c341a tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1537 microversion: 2.91 time: 0.363257 Sep 17 21:04:00.079153 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1634/3356] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:03:59 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1537 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:04:00.100477 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d2303376-8c7f-43d2-ab3c-151b45576ed3 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a5050940>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:00.111013 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-72e5e8b2-bb85-4e9a-8be6-962a0a6dad7b tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2b665d60-71ad-42ef-b99f-e87bc951ee62" status: 204 len: 0 microversion: 2.1 time: 0.376897 Sep 17 21:04:00.119674 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1723/3357] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:03:59 2022] DELETE /compute/v2.1/servers/2b665d60-71ad-42ef-b99f-e87bc951ee62 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:04:00.138830 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-be12d0a6-cbf3-428d-abfc-407529e36bf3 req-353cc82f-26ca-4cf1-b038-657678647dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7fa190d-89fe-4b34-b3a5-955cd2ece041", "name": "network-vif-deleted", "tag": "a891294e-6466-4306-9bec-bc7bea066042"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:00.149242 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-be12d0a6-cbf3-428d-abfc-407529e36bf3 req-353cc82f-26ca-4cf1-b038-657678647dc4 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:00.150120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-be12d0a6-cbf3-428d-abfc-407529e36bf3 req-353cc82f-26ca-4cf1-b038-657678647dc4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:00.151900 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-be12d0a6-cbf3-428d-abfc-407529e36bf3 req-353cc82f-26ca-4cf1-b038-657678647dc4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:00.180882 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-be12d0a6-cbf3-428d-abfc-407529e36bf3 req-353cc82f-26ca-4cf1-b038-657678647dc4 service nova] Creating event network-vif-deleted:a891294e-6466-4306-9bec-bc7bea066042 for instance c7fa190d-89fe-4b34-b3a5-955cd2ece041 on nch2-master-1 Sep 17 21:04:00.187118 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-be12d0a6-cbf3-428d-abfc-407529e36bf3 req-353cc82f-26ca-4cf1-b038-657678647dc4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065592 Sep 17 21:04:00.187884 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1724/3358] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:04:00.194340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7e48dd99-12ca-4c22-b385-9c03e72f4b03 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:00.195164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7e48dd99-12ca-4c22-b385-9c03e72f4b03 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] [instance: 2b665d60-71ad-42ef-b99f-e87bc951ee62] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:00.202063 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=2,nova_api:DELETE=4 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:04:00.203991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e48dd99-12ca-4c22-b385-9c03e72f4b03 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:00.204642 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e48dd99-12ca-4c22-b385-9c03e72f4b03 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:00.205174 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e48dd99-12ca-4c22-b385-9c03e72f4b03 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:00.206353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e48dd99-12ca-4c22-b385-9c03e72f4b03 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:00.207055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e48dd99-12ca-4c22-b385-9c03e72f4b03 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:00.207794 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e48dd99-12ca-4c22-b385-9c03e72f4b03 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:00.492249 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7e48dd99-12ca-4c22-b385-9c03e72f4b03 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e4ba59294f4529ba188e07cfc6681a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b687e3d75472bb38e672e90871a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:00.504666 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7e48dd99-12ca-4c22-b385-9c03e72f4b03 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] 10.222.0.26 "GET /compute/v2.1/servers/2b665d60-71ad-42ef-b99f-e87bc951ee62" status: 200 len: 1667 microversion: 2.1 time: 0.313683 Sep 17 21:04:00.507002 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1725/3359] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:00 2022] GET /compute/v2.1/servers/2b665d60-71ad-42ef-b99f-e87bc951ee62 => generated 1667 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:00.524178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7d59b92a-f7bc-40b2-b1d3-0a4c845e8d50 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:00.526423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7d59b92a-f7bc-40b2-b1d3-0a4c845e8d50 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:00.556492 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d59b92a-f7bc-40b2-b1d3-0a4c845e8d50 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:00.559347 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d59b92a-f7bc-40b2-b1d3-0a4c845e8d50 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:00.559971 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d59b92a-f7bc-40b2-b1d3-0a4c845e8d50 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:00.560798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d59b92a-f7bc-40b2-b1d3-0a4c845e8d50 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:00.561285 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d59b92a-f7bc-40b2-b1d3-0a4c845e8d50 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:00.565392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d59b92a-f7bc-40b2-b1d3-0a4c845e8d50 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:00.615869 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d2303376-8c7f-43d2-ab3c-151b45576ed3 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "DELETE /compute/v2.1/images/4e9929ff-1c72-43aa-bec6-410abc6e0698" status: 204 len: 0 microversion: 2.1 time: 0.535435 Sep 17 21:04:00.616970 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1635/3360] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:00 2022] DELETE /compute/v2.1/images/4e9929ff-1c72-43aa-bec6-410abc6e0698 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:04:00.626219 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b2c526e4-885e-4b7a-9c7d-095bbe5932de tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a4f35940>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:00.852000 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7d59b92a-f7bc-40b2-b1d3-0a4c845e8d50 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:00.861744 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7d59b92a-f7bc-40b2-b1d3-0a4c845e8d50 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1518 microversion: 2.1 time: 0.352882 Sep 17 21:04:00.865574 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1726/3361] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:00 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1518 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:00.870474 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8a1ad1e1-5764-4c00-a7f3-a3788e9d8987 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:00.882768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8a1ad1e1-5764-4c00-a7f3-a3788e9d8987 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] [instance: c7fa190d-89fe-4b34-b3a5-955cd2ece041] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:00.897616 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a1ad1e1-5764-4c00-a7f3-a3788e9d8987 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:00.898387 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a1ad1e1-5764-4c00-a7f3-a3788e9d8987 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:00.899016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a1ad1e1-5764-4c00-a7f3-a3788e9d8987 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:00.900001 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a1ad1e1-5764-4c00-a7f3-a3788e9d8987 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:00.900929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a1ad1e1-5764-4c00-a7f3-a3788e9d8987 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:00.901611 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a1ad1e1-5764-4c00-a7f3-a3788e9d8987 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:00.958143 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a1ad1e1-5764-4c00-a7f3-a3788e9d8987 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:00.961743 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a1ad1e1-5764-4c00-a7f3-a3788e9d8987 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:00.962459 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a1ad1e1-5764-4c00-a7f3-a3788e9d8987 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:00.963809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-8a1ad1e1-5764-4c00-a7f3-a3788e9d8987 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lazy-loading 'fault' on Instance uuid c7fa190d-89fe-4b34-b3a5-955cd2ece041 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:04:01.055055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8a1ad1e1-5764-4c00-a7f3-a3788e9d8987 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43e3adea586f4772b39b62323b1cc911', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9024c27866542428191da960659ac2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:01.071627 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8a1ad1e1-5764-4c00-a7f3-a3788e9d8987 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041" status: 200 len: 1302 microversion: 2.1 time: 0.204614 Sep 17 21:04:01.072752 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1727/3362] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:00 2022] GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041 => generated 1302 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:01.078848 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2ca1d1b3-155a-4cbb-81f1-0e5df560097a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:01.079495 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2ca1d1b3-155a-4cbb-81f1-0e5df560097a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:01.107628 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ca1d1b3-155a-4cbb-81f1-0e5df560097a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:01.107628 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ca1d1b3-155a-4cbb-81f1-0e5df560097a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:01.107628 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ca1d1b3-155a-4cbb-81f1-0e5df560097a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:01.113898 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ca1d1b3-155a-4cbb-81f1-0e5df560097a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:01.115907 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ca1d1b3-155a-4cbb-81f1-0e5df560097a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:01.119589 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ca1d1b3-155a-4cbb-81f1-0e5df560097a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:01.680451 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2ca1d1b3-155a-4cbb-81f1-0e5df560097a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:01.696317 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2ca1d1b3-155a-4cbb-81f1-0e5df560097a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1684 microversion: 2.1 time: 0.621101 Sep 17 21:04:01.697683 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1728/3363] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:01 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1684 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:01.713908 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-136c65c1-c44d-4d8c-9d33-ce43d21dc077 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:01.714910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-136c65c1-c44d-4d8c-9d33-ce43d21dc077 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:01.733820 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-136c65c1-c44d-4d8c-9d33-ce43d21dc077 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:01.735485 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-136c65c1-c44d-4d8c-9d33-ce43d21dc077 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:01.736117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-136c65c1-c44d-4d8c-9d33-ce43d21dc077 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:01.741216 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-136c65c1-c44d-4d8c-9d33-ce43d21dc077 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:01.742082 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-136c65c1-c44d-4d8c-9d33-ce43d21dc077 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:01.744887 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-136c65c1-c44d-4d8c-9d33-ce43d21dc077 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:01.910023 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-136c65c1-c44d-4d8c-9d33-ce43d21dc077 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:01.929125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-136c65c1-c44d-4d8c-9d33-ce43d21dc077 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:01.934156 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-136c65c1-c44d-4d8c-9d33-ce43d21dc077 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:01.954111 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-136c65c1-c44d-4d8c-9d33-ce43d21dc077 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1537 microversion: 2.91 time: 0.252851 Sep 17 21:04:01.970104 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1729/3364] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:04:01 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1537 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:04:01.975348 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-366c64c4-fa9f-4429-812c-064d699c93f0 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:01.976432 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-366c64c4-fa9f-4429-812c-064d699c93f0 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] [instance: 2b665d60-71ad-42ef-b99f-e87bc951ee62] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:02.000810 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-366c64c4-fa9f-4429-812c-064d699c93f0 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:02.001348 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-366c64c4-fa9f-4429-812c-064d699c93f0 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:02.001826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-366c64c4-fa9f-4429-812c-064d699c93f0 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:02.002549 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-366c64c4-fa9f-4429-812c-064d699c93f0 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:02.003009 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-366c64c4-fa9f-4429-812c-064d699c93f0 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:02.006578 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-366c64c4-fa9f-4429-812c-064d699c93f0 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:02.112383 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b2c526e4-885e-4b7a-9c7d-095bbe5932de tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "DELETE /compute/v2.1/images/bcdfea62-ad77-4071-9028-52d71b2b6f9c" status: 204 len: 0 microversion: 2.1 time: 1.488124 Sep 17 21:04:02.114159 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1636/3365] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:00 2022] DELETE /compute/v2.1/images/bcdfea62-ad77-4071-9028-52d71b2b6f9c => generated 0 bytes in 1493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:04:02.123683 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d5a5e353-ce49-456d-8a9e-8c38d5acd16e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:02.124589 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d5a5e353-ce49-456d-8a9e-8c38d5acd16e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:02.136257 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5a5e353-ce49-456d-8a9e-8c38d5acd16e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:02.138980 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5a5e353-ce49-456d-8a9e-8c38d5acd16e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:02.142919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5a5e353-ce49-456d-8a9e-8c38d5acd16e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:02.144172 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5a5e353-ce49-456d-8a9e-8c38d5acd16e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:02.145239 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5a5e353-ce49-456d-8a9e-8c38d5acd16e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:02.146060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5a5e353-ce49-456d-8a9e-8c38d5acd16e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:02.444776 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-366c64c4-fa9f-4429-812c-064d699c93f0 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e4ba59294f4529ba188e07cfc6681a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b687e3d75472bb38e672e90871a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:02.461138 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-366c64c4-fa9f-4429-812c-064d699c93f0 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] 10.222.0.26 "GET /compute/v2.1/servers/2b665d60-71ad-42ef-b99f-e87bc951ee62" status: 200 len: 1667 microversion: 2.1 time: 0.490792 Sep 17 21:04:02.464897 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1730/3366] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:01 2022] GET /compute/v2.1/servers/2b665d60-71ad-42ef-b99f-e87bc951ee62 => generated 1667 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:02.486376 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2d7a468d-c866-4c5c-b7fd-84a1f0d1c88e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:02.489050 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2d7a468d-c866-4c5c-b7fd-84a1f0d1c88e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] [instance: c7fa190d-89fe-4b34-b3a5-955cd2ece041] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:02.514451 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2d7a468d-c866-4c5c-b7fd-84a1f0d1c88e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:02.521032 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2d7a468d-c866-4c5c-b7fd-84a1f0d1c88e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:02.524581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2d7a468d-c866-4c5c-b7fd-84a1f0d1c88e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:02.526169 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2d7a468d-c866-4c5c-b7fd-84a1f0d1c88e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:02.532203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2d7a468d-c866-4c5c-b7fd-84a1f0d1c88e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:02.533070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2d7a468d-c866-4c5c-b7fd-84a1f0d1c88e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:02.578197 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-2d7a468d-c866-4c5c-b7fd-84a1f0d1c88e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] HTTP exception thrown: Instance c7fa190d-89fe-4b34-b3a5-955cd2ece041 could not be found. Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2d7a468d-c866-4c5c-b7fd-84a1f0d1c88e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Request method failure captured: Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041 HTTP/1.1 Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjYSeUuZH5Fl0WytI-5Ma4vQxv2VVpIJm6y8l0wiFyWrALqQlzgf0ULlTRY8-RNRa1uhPZBD4CkpMDPg6U7LVmd0SbsXYdQsrMS-XMtZK1o6AQKOPIpg3bz81j6SqPHBz3sN-Uh9Ro2LierkqAkYUKpSv91X_FScST4JqYBn-lhWmhU Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: d9024c27866542428191da960659ac2e Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerGroupTestJSON-483272068 Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d9024c27866542428191da960659ac2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d9024c27866542428191da960659ac2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d9024c27866542428191da960659ac2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d9024c27866542428191da960659ac2e", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerGroupTestJSON-483272068 Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: d9024c27866542428191da960659ac2e Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerGroupTestJSON-483272068 Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerGroupTestJSON-483272068-project Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 43e3adea586f4772b39b62323b1cc911 Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerGroupTestJSON-483272068-project Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance c7fa190d-89fe-4b34-b3a5-955cd2ece041 could not be found. Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'c7fa190d-89fe-4b34-b3a5-955cd2ece041'} Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7fa190d-89fe-4b34-b3a5-955cd2ece041 could not be found. Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7fa190d-89fe-4b34-b3a5-955cd2ece041 could not be found. Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:02.580329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:02.584809 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:02.584809 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:02.584809 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:02.584809 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:04:02.584809 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:04:02.584809 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7fa190d-89fe-4b34-b3a5-955cd2ece041 could not be found. Sep 17 21:04:02.584809 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:02.595848 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2d7a468d-c866-4c5c-b7fd-84a1f0d1c88e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Returning 404 to user: Instance c7fa190d-89fe-4b34-b3a5-955cd2ece041 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:04:02.598231 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2d7a468d-c866-4c5c-b7fd-84a1f0d1c88e tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041" status: 404 len: 111 microversion: 2.1 time: 0.129419 Sep 17 21:04:02.615065 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1731/3367] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:02 2022] GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:04:02.621377 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8af8cc8a-ddad-40cb-aecd-5b945de12f22 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] Calling method '.version_select at 0x7f25a40d43a0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:02.780584 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d5a5e353-ce49-456d-8a9e-8c38d5acd16e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:02.795030 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d5a5e353-ce49-456d-8a9e-8c38d5acd16e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1518 microversion: 2.1 time: 0.674016 Sep 17 21:04:02.809969 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1637/3368] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:02 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1518 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:03.085874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fe55f0b1-7e42-4e41-85bd-7c43f7e854da tempest-AbsoluteLimitsNegativeTestJSON-678920612 tempest-AbsoluteLimitsNegativeTestJSON-678920612-project] Calling method '.version_select at 0x7f25a5207af0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:03.113442 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fe55f0b1-7e42-4e41-85bd-7c43f7e854da tempest-AbsoluteLimitsNegativeTestJSON-678920612 tempest-AbsoluteLimitsNegativeTestJSON-678920612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:03.114099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fe55f0b1-7e42-4e41-85bd-7c43f7e854da tempest-AbsoluteLimitsNegativeTestJSON-678920612 tempest-AbsoluteLimitsNegativeTestJSON-678920612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:03.114480 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fe55f0b1-7e42-4e41-85bd-7c43f7e854da tempest-AbsoluteLimitsNegativeTestJSON-678920612 tempest-AbsoluteLimitsNegativeTestJSON-678920612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:03.115272 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fe55f0b1-7e42-4e41-85bd-7c43f7e854da tempest-AbsoluteLimitsNegativeTestJSON-678920612 tempest-AbsoluteLimitsNegativeTestJSON-678920612-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:03.115741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fe55f0b1-7e42-4e41-85bd-7c43f7e854da tempest-AbsoluteLimitsNegativeTestJSON-678920612 tempest-AbsoluteLimitsNegativeTestJSON-678920612-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:03.116243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fe55f0b1-7e42-4e41-85bd-7c43f7e854da tempest-AbsoluteLimitsNegativeTestJSON-678920612 tempest-AbsoluteLimitsNegativeTestJSON-678920612-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:03.192509 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fe55f0b1-7e42-4e41-85bd-7c43f7e854da tempest-AbsoluteLimitsNegativeTestJSON-678920612 tempest-AbsoluteLimitsNegativeTestJSON-678920612-project] 10.222.0.26 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.381012 Sep 17 21:04:03.208405 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1638/3369] 10.222.0.26 () {58 vars in 1122 bytes} [Sat Sep 17 21:04:02 2022] GET /compute/v2.1/limits => generated 511 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:04:03.238951 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f07503e9-c1e8-4b47-9f99-8499140130fc tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:03.318219 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.compute.server_groups [None req-f07503e9-c1e8-4b47-9f99-8499140130fc tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Querying cell 056db90a-cdd9-42b2-a8c3-cd5ab36662a4(cell1) for 1 instances {{(pid=140523) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 17 21:04:03.318735 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f07503e9-c1e8-4b47-9f99-8499140130fc tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:03.319230 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f07503e9-c1e8-4b47-9f99-8499140130fc tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:03.319677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f07503e9-c1e8-4b47-9f99-8499140130fc tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:03.336941 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f07503e9-c1e8-4b47-9f99-8499140130fc tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.126934 Sep 17 21:04:03.338079 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1639/3370] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Sep 17 21:04:03 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:04:03.358527 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-587f364f-70cf-4323-a988-cb99f31679bf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:03.367913 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-587f364f-70cf-4323-a988-cb99f31679bf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:03.400614 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-587f364f-70cf-4323-a988-cb99f31679bf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:03.403426 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-587f364f-70cf-4323-a988-cb99f31679bf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:03.404645 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-587f364f-70cf-4323-a988-cb99f31679bf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:03.409395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-587f364f-70cf-4323-a988-cb99f31679bf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:03.411953 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-587f364f-70cf-4323-a988-cb99f31679bf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:03.414540 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-587f364f-70cf-4323-a988-cb99f31679bf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:03.545927 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8af8cc8a-ddad-40cb-aecd-5b945de12f22 tempest-ListImageFiltersTestJSON-988406394 tempest-ListImageFiltersTestJSON-988406394-project] 10.222.0.26 "DELETE /compute/v2.1/images/0deb8c1c-237c-4a78-b0ef-50661bfef36d" status: 204 len: 0 microversion: 2.1 time: 0.929103 Sep 17 21:04:03.548978 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1732/3371] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:02 2022] DELETE /compute/v2.1/images/0deb8c1c-237c-4a78-b0ef-50661bfef36d => generated 0 bytes in 931 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:04:03.560830 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ec13e80d-a598-48e7-9b9f-85e2c2ef490c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:03.561722 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ec13e80d-a598-48e7-9b9f-85e2c2ef490c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:03.577268 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ec13e80d-a598-48e7-9b9f-85e2c2ef490c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:03.578274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ec13e80d-a598-48e7-9b9f-85e2c2ef490c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:03.578997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ec13e80d-a598-48e7-9b9f-85e2c2ef490c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:03.582152 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ec13e80d-a598-48e7-9b9f-85e2c2ef490c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:03.582902 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ec13e80d-a598-48e7-9b9f-85e2c2ef490c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:03.593780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ec13e80d-a598-48e7-9b9f-85e2c2ef490c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:03.947229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ec13e80d-a598-48e7-9b9f-85e2c2ef490c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:03.963154 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ec13e80d-a598-48e7-9b9f-85e2c2ef490c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:03.966931 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ec13e80d-a598-48e7-9b9f-85e2c2ef490c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:03.995261 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ec13e80d-a598-48e7-9b9f-85e2c2ef490c tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1537 microversion: 2.91 time: 0.436051 Sep 17 21:04:03.997075 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1733/3372] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:04:03 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1537 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:04:04.011212 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-49ae4657-e7db-4ed0-b6d8-24eb8ddaeeca tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:04.053090 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.compute.server_groups [None req-49ae4657-e7db-4ed0-b6d8-24eb8ddaeeca tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Querying cell 056db90a-cdd9-42b2-a8c3-cd5ab36662a4(cell1) for 1 instances {{(pid=140524) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 17 21:04:04.055759 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49ae4657-e7db-4ed0-b6d8-24eb8ddaeeca tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:04.057411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49ae4657-e7db-4ed0-b6d8-24eb8ddaeeca tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:04.060330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49ae4657-e7db-4ed0-b6d8-24eb8ddaeeca tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:04.086360 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-49ae4657-e7db-4ed0-b6d8-24eb8ddaeeca tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups/60bdd01e-fc73-4ec5-9949-73c31be90c18" status: 200 len: 183 microversion: 2.1 time: 0.085123 Sep 17 21:04:04.087257 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1734/3373] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Sep 17 21:04:03 2022] GET /compute/v2.1/os-server-groups/60bdd01e-fc73-4ec5-9949-73c31be90c18 => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:04:04.103704 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4a2702a1-da87-47df-92bc-32c6632615d1 tempest-AbsoluteLimitsNegativeTestJSON-678920612 tempest-AbsoluteLimitsNegativeTestJSON-678920612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-232708679", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:04.223554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-4a2702a1-da87-47df-92bc-32c6632615d1 tempest-AbsoluteLimitsNegativeTestJSON-678920612 tempest-AbsoluteLimitsNegativeTestJSON-678920612-project] validate_networks() for None {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:04:04.438609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-587f364f-70cf-4323-a988-cb99f31679bf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:04.450173 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-587f364f-70cf-4323-a988-cb99f31679bf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1684 microversion: 2.1 time: 1.110378 Sep 17 21:04:04.451079 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1640/3374] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:03 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1684 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:04.456785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b64b2d6d-6bca-440c-8255-7d595cf691af tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:04.457647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b64b2d6d-6bca-440c-8255-7d595cf691af tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] [instance: 2b665d60-71ad-42ef-b99f-e87bc951ee62] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:04.464461 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b64b2d6d-6bca-440c-8255-7d595cf691af tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:04.470091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b64b2d6d-6bca-440c-8255-7d595cf691af tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:04.470900 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b64b2d6d-6bca-440c-8255-7d595cf691af tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:04.471832 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b64b2d6d-6bca-440c-8255-7d595cf691af tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:04.472553 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b64b2d6d-6bca-440c-8255-7d595cf691af tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:04.473174 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b64b2d6d-6bca-440c-8255-7d595cf691af tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:04.540493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b64b2d6d-6bca-440c-8255-7d595cf691af tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:04.541574 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b64b2d6d-6bca-440c-8255-7d595cf691af tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:04.542316 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b64b2d6d-6bca-440c-8255-7d595cf691af tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:04.543206 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-b64b2d6d-6bca-440c-8255-7d595cf691af tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lazy-loading 'fault' on Instance uuid 2b665d60-71ad-42ef-b99f-e87bc951ee62 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:04:04.989651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b64b2d6d-6bca-440c-8255-7d595cf691af tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00e4ba59294f4529ba188e07cfc6681a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b33b687e3d75472bb38e672e90871a0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:05.008775 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b64b2d6d-6bca-440c-8255-7d595cf691af tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] 10.222.0.26 "GET /compute/v2.1/servers/2b665d60-71ad-42ef-b99f-e87bc951ee62" status: 200 len: 1316 microversion: 2.1 time: 0.556434 Sep 17 21:04:05.027506 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1641/3375] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:04 2022] GET /compute/v2.1/servers/2b665d60-71ad-42ef-b99f-e87bc951ee62 => generated 1316 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:05.033189 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ab488621-e1be-4d31-9811-a372bc6d5cec tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:05.033835 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ab488621-e1be-4d31-9811-a372bc6d5cec tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:05.041118 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab488621-e1be-4d31-9811-a372bc6d5cec tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:05.041650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab488621-e1be-4d31-9811-a372bc6d5cec tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:05.042092 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab488621-e1be-4d31-9811-a372bc6d5cec tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:05.042887 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab488621-e1be-4d31-9811-a372bc6d5cec tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:05.043485 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab488621-e1be-4d31-9811-a372bc6d5cec tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:05.043915 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab488621-e1be-4d31-9811-a372bc6d5cec tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:05.101719 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-4a2702a1-da87-47df-92bc-32c6632615d1 tempest-AbsoluteLimitsNegativeTestJSON-678920612 tempest-AbsoluteLimitsNegativeTestJSON-678920612-project] Getting quotas for project 651b69d82def44e9b63b45e9dccb9ce4. Resources: dict_keys(['metadata_items']) {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:04:05.140067 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-4a2702a1-da87-47df-92bc-32c6632615d1 tempest-AbsoluteLimitsNegativeTestJSON-678920612 tempest-AbsoluteLimitsNegativeTestJSON-678920612-project] Getting quotas for user ff8b3ef6725c4e3b8947604fe1867889 and project 651b69d82def44e9b63b45e9dccb9ce4. Resources: dict_keys(['metadata_items']) {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:04:05.205978 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-4a2702a1-da87-47df-92bc-32c6632615d1 tempest-AbsoluteLimitsNegativeTestJSON-678920612 tempest-AbsoluteLimitsNegativeTestJSON-678920612-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4a2702a1-da87-47df-92bc-32c6632615d1 tempest-AbsoluteLimitsNegativeTestJSON-678920612 tempest-AbsoluteLimitsNegativeTestJSON-678920612-project] Request method failure captured: Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 1751 Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjZC05i7rZVEFTFxzAtynVbFPIvAYTT_UUjHesBWTPDb4iCOJe_w0scMmcQqbC9R15PAHCssZVpwfkCg3gKuJg9-k_-zg6E2fOenxXsQ7UYFZIH0f0nJqARxmBqTfMe-7tNAHWtEnYp1zUCdH7KrfX949nBgdd1MFnlK9hQWziFj-qE Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 651b69d82def44e9b63b45e9dccb9ce4 Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-678920612 Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/651b69d82def44e9b63b45e9dccb9ce4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/651b69d82def44e9b63b45e9dccb9ce4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/651b69d82def44e9b63b45e9dccb9ce4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_651b69d82def44e9b63b45e9dccb9ce4", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-678920612 Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 651b69d82def44e9b63b45e9dccb9ce4 Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-678920612 Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-678920612-project Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: ff8b3ef6725c4e3b8947604fe1867889 Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-678920612-project Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-232708679", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:04:05.215631 ncdv-master-1 devstack@n-api.service[140524]: exception: Maximum number of metadata items exceeds 128 Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-232708679', 'imageRef': '1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:04:05.218028 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:04:05.220911 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:04:05.220911 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 17 21:04:05.220911 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 17 21:04:05.220911 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 17 21:04:05.220911 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Sep 17 21:04:05.220911 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.220911 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:05.220911 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.220911 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:05.220911 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:05.220911 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:05.220911 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:04:05.220911 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:04:05.220911 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Sep 17 21:04:05.220911 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.220911 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4a2702a1-da87-47df-92bc-32c6632615d1 tempest-AbsoluteLimitsNegativeTestJSON-678920612 tempest-AbsoluteLimitsNegativeTestJSON-678920612-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:04:05.223965 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4a2702a1-da87-47df-92bc-32c6632615d1 tempest-AbsoluteLimitsNegativeTestJSON-678920612 tempest-AbsoluteLimitsNegativeTestJSON-678920612-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.130710 Sep 17 21:04:05.223965 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1735/3376] 10.222.0.26 () {60 vars in 1148 bytes} [Sat Sep 17 21:04:04 2022] POST /compute/v2.1/servers => generated 87 bytes in 1132 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Sep 17 21:04:05.285554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3d3fe6ca-ff5b-4114-b370-957190459e02 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:05.289322 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3d3fe6ca-ff5b-4114-b370-957190459e02 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] [instance: c7fa190d-89fe-4b34-b3a5-955cd2ece041] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:05.317509 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d3fe6ca-ff5b-4114-b370-957190459e02 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:05.318111 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d3fe6ca-ff5b-4114-b370-957190459e02 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:05.318483 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d3fe6ca-ff5b-4114-b370-957190459e02 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:05.319205 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d3fe6ca-ff5b-4114-b370-957190459e02 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:05.319677 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d3fe6ca-ff5b-4114-b370-957190459e02 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:05.320109 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d3fe6ca-ff5b-4114-b370-957190459e02 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:05.355817 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-3d3fe6ca-ff5b-4114-b370-957190459e02 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] HTTP exception thrown: Instance c7fa190d-89fe-4b34-b3a5-955cd2ece041 could not be found. Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3d3fe6ca-ff5b-4114-b370-957190459e02 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Request method failure captured: Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041 HTTP/1.1 Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjYSeUuZH5Fl0WytI-5Ma4vQxv2VVpIJm6y8l0wiFyWrALqQlzgf0ULlTRY8-RNRa1uhPZBD4CkpMDPg6U7LVmd0SbsXYdQsrMS-XMtZK1o6AQKOPIpg3bz81j6SqPHBz3sN-Uh9Ro2LierkqAkYUKpSv91X_FScST4JqYBn-lhWmhU Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: d9024c27866542428191da960659ac2e Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerGroupTestJSON-483272068 Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d9024c27866542428191da960659ac2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d9024c27866542428191da960659ac2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d9024c27866542428191da960659ac2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d9024c27866542428191da960659ac2e", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerGroupTestJSON-483272068 Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: d9024c27866542428191da960659ac2e Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerGroupTestJSON-483272068 Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerGroupTestJSON-483272068-project Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 43e3adea586f4772b39b62323b1cc911 Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerGroupTestJSON-483272068-project Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance c7fa190d-89fe-4b34-b3a5-955cd2ece041 could not be found. Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'c7fa190d-89fe-4b34-b3a5-955cd2ece041'} Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7fa190d-89fe-4b34-b3a5-955cd2ece041 could not be found. Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:04:05.364300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:04:05.368729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7fa190d-89fe-4b34-b3a5-955cd2ece041 could not be found. Sep 17 21:04:05.368729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.368729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:05.368729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.368729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:05.368729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:05.368729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:05.368729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:04:05.368729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:04:05.368729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7fa190d-89fe-4b34-b3a5-955cd2ece041 could not be found. Sep 17 21:04:05.368729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.368729 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3d3fe6ca-ff5b-4114-b370-957190459e02 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Returning 404 to user: Instance c7fa190d-89fe-4b34-b3a5-955cd2ece041 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:04:05.368729 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3d3fe6ca-ff5b-4114-b370-957190459e02 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041" status: 404 len: 111 microversion: 2.1 time: 0.142828 Sep 17 21:04:05.370851 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1736/3377] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:04:05 2022] DELETE /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:04:05.379497 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-47758abe-21f9-4a7c-8f59-ce790598beaf req-67a5e703-fb06-4f35-bee9-ddfdd1495da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b665d60-71ad-42ef-b99f-e87bc951ee62", "name": "network-vif-deleted", "tag": "61bbacbc-0b60-4739-bc1b-37474f73a3e4"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:05.404359 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-47758abe-21f9-4a7c-8f59-ce790598beaf req-67a5e703-fb06-4f35-bee9-ddfdd1495da3 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:05.404988 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-47758abe-21f9-4a7c-8f59-ce790598beaf req-67a5e703-fb06-4f35-bee9-ddfdd1495da3 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:05.405691 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-47758abe-21f9-4a7c-8f59-ce790598beaf req-67a5e703-fb06-4f35-bee9-ddfdd1495da3 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:05.433882 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-47758abe-21f9-4a7c-8f59-ce790598beaf req-67a5e703-fb06-4f35-bee9-ddfdd1495da3 service nova] Creating event network-vif-deleted:61bbacbc-0b60-4739-bc1b-37474f73a3e4 for instance 2b665d60-71ad-42ef-b99f-e87bc951ee62 on nch2-master-1 Sep 17 21:04:05.443179 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-47758abe-21f9-4a7c-8f59-ce790598beaf req-67a5e703-fb06-4f35-bee9-ddfdd1495da3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072796 Sep 17 21:04:05.450202 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1737/3378] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:04:05.467029 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c8620f01-c3ac-40bc-ab9f-8fdc7f64e534 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:05.469697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c8620f01-c3ac-40bc-ab9f-8fdc7f64e534 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:05.475851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ab488621-e1be-4d31-9811-a372bc6d5cec tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:05.487087 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8620f01-c3ac-40bc-ab9f-8fdc7f64e534 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:05.489121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8620f01-c3ac-40bc-ab9f-8fdc7f64e534 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:05.489337 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ab488621-e1be-4d31-9811-a372bc6d5cec tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1518 microversion: 2.1 time: 0.460352 Sep 17 21:04:05.489987 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8620f01-c3ac-40bc-ab9f-8fdc7f64e534 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:05.492293 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8620f01-c3ac-40bc-ab9f-8fdc7f64e534 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:05.494800 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8620f01-c3ac-40bc-ab9f-8fdc7f64e534 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:05.496542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8620f01-c3ac-40bc-ab9f-8fdc7f64e534 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:05.502043 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1642/3379] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:05 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1518 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:05.511579 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ec41d54c-01d5-440f-911f-9b839d1284a1 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:05.512597 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ec41d54c-01d5-440f-911f-9b839d1284a1 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] [instance: c7fa190d-89fe-4b34-b3a5-955cd2ece041] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:05.521941 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec41d54c-01d5-440f-911f-9b839d1284a1 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:05.522815 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec41d54c-01d5-440f-911f-9b839d1284a1 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:05.523458 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec41d54c-01d5-440f-911f-9b839d1284a1 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:05.524353 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec41d54c-01d5-440f-911f-9b839d1284a1 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:05.524980 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec41d54c-01d5-440f-911f-9b839d1284a1 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:05.525601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec41d54c-01d5-440f-911f-9b839d1284a1 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:05.546336 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-ec41d54c-01d5-440f-911f-9b839d1284a1 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] HTTP exception thrown: Instance c7fa190d-89fe-4b34-b3a5-955cd2ece041 could not be found. Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ec41d54c-01d5-440f-911f-9b839d1284a1 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Request method failure captured: Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041 HTTP/1.1 Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjYSeUuZH5Fl0WytI-5Ma4vQxv2VVpIJm6y8l0wiFyWrALqQlzgf0ULlTRY8-RNRa1uhPZBD4CkpMDPg6U7LVmd0SbsXYdQsrMS-XMtZK1o6AQKOPIpg3bz81j6SqPHBz3sN-Uh9Ro2LierkqAkYUKpSv91X_FScST4JqYBn-lhWmhU Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: d9024c27866542428191da960659ac2e Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerGroupTestJSON-483272068 Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d9024c27866542428191da960659ac2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d9024c27866542428191da960659ac2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d9024c27866542428191da960659ac2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d9024c27866542428191da960659ac2e", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerGroupTestJSON-483272068 Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: d9024c27866542428191da960659ac2e Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerGroupTestJSON-483272068 Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerGroupTestJSON-483272068-project Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 43e3adea586f4772b39b62323b1cc911 Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerGroupTestJSON-483272068-project Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance c7fa190d-89fe-4b34-b3a5-955cd2ece041 could not be found. Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'c7fa190d-89fe-4b34-b3a5-955cd2ece041'} Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7fa190d-89fe-4b34-b3a5-955cd2ece041 could not be found. Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7fa190d-89fe-4b34-b3a5-955cd2ece041 could not be found. Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:05.548433 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.553345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:05.553345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:05.553345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:05.553345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:04:05.553345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:04:05.553345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7fa190d-89fe-4b34-b3a5-955cd2ece041 could not be found. Sep 17 21:04:05.553345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.555089 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ec41d54c-01d5-440f-911f-9b839d1284a1 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Returning 404 to user: Instance c7fa190d-89fe-4b34-b3a5-955cd2ece041 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:04:05.556377 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ec41d54c-01d5-440f-911f-9b839d1284a1 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041" status: 404 len: 111 microversion: 2.1 time: 0.053035 Sep 17 21:04:05.557547 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1643/3380] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:05 2022] GET /compute/v2.1/servers/c7fa190d-89fe-4b34-b3a5-955cd2ece041 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:04:05.567319 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-430840b5-620d-4275-91e7-b4b2e5385aef tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:05.568326 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-430840b5-620d-4275-91e7-b4b2e5385aef tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:05.575186 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-430840b5-620d-4275-91e7-b4b2e5385aef tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:05.576041 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-430840b5-620d-4275-91e7-b4b2e5385aef tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:05.576664 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-430840b5-620d-4275-91e7-b4b2e5385aef tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:05.577713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-430840b5-620d-4275-91e7-b4b2e5385aef tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:05.578388 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-430840b5-620d-4275-91e7-b4b2e5385aef tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:05.579086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-430840b5-620d-4275-91e7-b4b2e5385aef tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:05.756463 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c8620f01-c3ac-40bc-ab9f-8fdc7f64e534 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:05.768106 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c8620f01-c3ac-40bc-ab9f-8fdc7f64e534 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:05.776814 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c8620f01-c3ac-40bc-ab9f-8fdc7f64e534 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:05.797240 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c8620f01-c3ac-40bc-ab9f-8fdc7f64e534 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1537 microversion: 2.91 time: 0.340610 Sep 17 21:04:05.800963 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1738/3381] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:04:05 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1537 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:04:05.806326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-85dd6d67-2fa8-4722-bc62-808f159f74c2 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:05.834634 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-85dd6d67-2fa8-4722-bc62-808f159f74c2 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] HTTP exception thrown: Instance group 7fd361cc-8070-4bdf-bc8b-c85b29cd013d could not be found. Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-85dd6d67-2fa8-4722-bc62-808f159f74c2 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Request method failure captured: Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/os-server-groups/7fd361cc-8070-4bdf-bc8b-c85b29cd013d HTTP/1.1 Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjYSeUuZH5Fl0WytI-5Ma4vQxv2VVpIJm6y8l0wiFyWrALqQlzgf0ULlTRY8-RNRa1uhPZBD4CkpMDPg6U7LVmd0SbsXYdQsrMS-XMtZK1o6AQKOPIpg3bz81j6SqPHBz3sN-Uh9Ro2LierkqAkYUKpSv91X_FScST4JqYBn-lhWmhU Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: d9024c27866542428191da960659ac2e Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerGroupTestJSON-483272068 Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d9024c27866542428191da960659ac2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d9024c27866542428191da960659ac2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d9024c27866542428191da960659ac2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d9024c27866542428191da960659ac2e", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerGroupTestJSON-483272068 Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: d9024c27866542428191da960659ac2e Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerGroupTestJSON-483272068 Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerGroupTestJSON-483272068-project Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 43e3adea586f4772b39b62323b1cc911 Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerGroupTestJSON-483272068-project Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance group 7fd361cc-8070-4bdf-bc8b-c85b29cd013d could not be found. Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '7fd361cc-8070-4bdf-bc8b-c85b29cd013d'} Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 7fd361cc-8070-4bdf-bc8b-c85b29cd013d could not be found. Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 7fd361cc-8070-4bdf-bc8b-c85b29cd013d could not be found. Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.856376 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:05.860664 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:05.860664 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:05.860664 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:04:05.860664 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:04:05.860664 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 7fd361cc-8070-4bdf-bc8b-c85b29cd013d could not be found. Sep 17 21:04:05.860664 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.860664 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-85dd6d67-2fa8-4722-bc62-808f159f74c2 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Returning 404 to user: Instance group 7fd361cc-8070-4bdf-bc8b-c85b29cd013d could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:04:05.862799 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-85dd6d67-2fa8-4722-bc62-808f159f74c2 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/7fd361cc-8070-4bdf-bc8b-c85b29cd013d" status: 404 len: 117 microversion: 2.1 time: 0.060178 Sep 17 21:04:05.873134 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1739/3382] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Sep 17 21:04:05 2022] DELETE /compute/v2.1/os-server-groups/7fd361cc-8070-4bdf-bc8b-c85b29cd013d => generated 117 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:04:05.894436 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-de88b055-1923-4580-a874-c56500f86d5b tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:05.903906 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-de88b055-1923-4580-a874-c56500f86d5b tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] HTTP exception thrown: Instance group faf0e7cb-376f-4672-bcd4-9c36565cf6a1 could not be found. Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-de88b055-1923-4580-a874-c56500f86d5b tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Request method failure captured: Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/os-server-groups/faf0e7cb-376f-4672-bcd4-9c36565cf6a1 HTTP/1.1 Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjYSeUuZH5Fl0WytI-5Ma4vQxv2VVpIJm6y8l0wiFyWrALqQlzgf0ULlTRY8-RNRa1uhPZBD4CkpMDPg6U7LVmd0SbsXYdQsrMS-XMtZK1o6AQKOPIpg3bz81j6SqPHBz3sN-Uh9Ro2LierkqAkYUKpSv91X_FScST4JqYBn-lhWmhU Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: d9024c27866542428191da960659ac2e Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerGroupTestJSON-483272068 Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d9024c27866542428191da960659ac2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d9024c27866542428191da960659ac2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d9024c27866542428191da960659ac2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d9024c27866542428191da960659ac2e", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerGroupTestJSON-483272068 Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: d9024c27866542428191da960659ac2e Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerGroupTestJSON-483272068 Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerGroupTestJSON-483272068-project Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 43e3adea586f4772b39b62323b1cc911 Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerGroupTestJSON-483272068-project Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance group faf0e7cb-376f-4672-bcd4-9c36565cf6a1 could not be found. Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'faf0e7cb-376f-4672-bcd4-9c36565cf6a1'} Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group faf0e7cb-376f-4672-bcd4-9c36565cf6a1 could not be found. Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group faf0e7cb-376f-4672-bcd4-9c36565cf6a1 could not be found. Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.906740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:05.912061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:05.912061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:05.912061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:04:05.912061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:04:05.912061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group faf0e7cb-376f-4672-bcd4-9c36565cf6a1 could not be found. Sep 17 21:04:05.912061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.914406 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-de88b055-1923-4580-a874-c56500f86d5b tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Returning 404 to user: Instance group faf0e7cb-376f-4672-bcd4-9c36565cf6a1 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:04:05.915540 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-de88b055-1923-4580-a874-c56500f86d5b tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/faf0e7cb-376f-4672-bcd4-9c36565cf6a1" status: 404 len: 117 microversion: 2.1 time: 0.041322 Sep 17 21:04:05.921085 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1740/3383] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Sep 17 21:04:05 2022] DELETE /compute/v2.1/os-server-groups/faf0e7cb-376f-4672-bcd4-9c36565cf6a1 => generated 117 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:04:05.928727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3c68681f-7cba-4a49-a59b-e358b59e2d81 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:05.937975 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-3c68681f-7cba-4a49-a59b-e358b59e2d81 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] HTTP exception thrown: Instance group 1eac4460-e929-4251-a88d-3d7bbb4fb5a1 could not be found. Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3c68681f-7cba-4a49-a59b-e358b59e2d81 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Request method failure captured: Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/os-server-groups/1eac4460-e929-4251-a88d-3d7bbb4fb5a1 HTTP/1.1 Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjYSeUuZH5Fl0WytI-5Ma4vQxv2VVpIJm6y8l0wiFyWrALqQlzgf0ULlTRY8-RNRa1uhPZBD4CkpMDPg6U7LVmd0SbsXYdQsrMS-XMtZK1o6AQKOPIpg3bz81j6SqPHBz3sN-Uh9Ro2LierkqAkYUKpSv91X_FScST4JqYBn-lhWmhU Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: d9024c27866542428191da960659ac2e Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerGroupTestJSON-483272068 Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d9024c27866542428191da960659ac2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d9024c27866542428191da960659ac2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d9024c27866542428191da960659ac2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d9024c27866542428191da960659ac2e", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerGroupTestJSON-483272068 Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: d9024c27866542428191da960659ac2e Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerGroupTestJSON-483272068 Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerGroupTestJSON-483272068-project Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 43e3adea586f4772b39b62323b1cc911 Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerGroupTestJSON-483272068-project Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance group 1eac4460-e929-4251-a88d-3d7bbb4fb5a1 could not be found. Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '1eac4460-e929-4251-a88d-3d7bbb4fb5a1'} Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 1eac4460-e929-4251-a88d-3d7bbb4fb5a1 could not be found. Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 1eac4460-e929-4251-a88d-3d7bbb4fb5a1 could not be found. Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.939975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:05.945868 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:05.945868 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:05.945868 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:04:05.945868 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:04:05.945868 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 1eac4460-e929-4251-a88d-3d7bbb4fb5a1 could not be found. Sep 17 21:04:05.945868 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.945868 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3c68681f-7cba-4a49-a59b-e358b59e2d81 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Returning 404 to user: Instance group 1eac4460-e929-4251-a88d-3d7bbb4fb5a1 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:04:05.948588 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3c68681f-7cba-4a49-a59b-e358b59e2d81 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/1eac4460-e929-4251-a88d-3d7bbb4fb5a1" status: 404 len: 117 microversion: 2.1 time: 0.026043 Sep 17 21:04:05.953070 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1741/3384] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Sep 17 21:04:05 2022] DELETE /compute/v2.1/os-server-groups/1eac4460-e929-4251-a88d-3d7bbb4fb5a1 => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:04:05.961746 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b70a9044-39f0-4c2e-9768-4285a443d93d tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:05.975046 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-b70a9044-39f0-4c2e-9768-4285a443d93d tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] HTTP exception thrown: Instance group 397dd2a9-9639-4662-9154-700739a5b2fb could not be found. Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b70a9044-39f0-4c2e-9768-4285a443d93d tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Request method failure captured: Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/os-server-groups/397dd2a9-9639-4662-9154-700739a5b2fb HTTP/1.1 Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjYSeUuZH5Fl0WytI-5Ma4vQxv2VVpIJm6y8l0wiFyWrALqQlzgf0ULlTRY8-RNRa1uhPZBD4CkpMDPg6U7LVmd0SbsXYdQsrMS-XMtZK1o6AQKOPIpg3bz81j6SqPHBz3sN-Uh9Ro2LierkqAkYUKpSv91X_FScST4JqYBn-lhWmhU Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: d9024c27866542428191da960659ac2e Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerGroupTestJSON-483272068 Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d9024c27866542428191da960659ac2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d9024c27866542428191da960659ac2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d9024c27866542428191da960659ac2e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d9024c27866542428191da960659ac2e", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerGroupTestJSON-483272068 Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: d9024c27866542428191da960659ac2e Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerGroupTestJSON-483272068 Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerGroupTestJSON-483272068-project Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 43e3adea586f4772b39b62323b1cc911 Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerGroupTestJSON-483272068-project Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance group 397dd2a9-9639-4662-9154-700739a5b2fb could not be found. Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '397dd2a9-9639-4662-9154-700739a5b2fb'} Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 397dd2a9-9639-4662-9154-700739a5b2fb could not be found. Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 397dd2a9-9639-4662-9154-700739a5b2fb could not be found. Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.979748 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:05.984964 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:05.984964 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:05.984964 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:04:05.984964 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:04:05.984964 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 397dd2a9-9639-4662-9154-700739a5b2fb could not be found. Sep 17 21:04:05.984964 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:05.986362 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b70a9044-39f0-4c2e-9768-4285a443d93d tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Returning 404 to user: Instance group 397dd2a9-9639-4662-9154-700739a5b2fb could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:04:05.987460 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b70a9044-39f0-4c2e-9768-4285a443d93d tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/397dd2a9-9639-4662-9154-700739a5b2fb" status: 404 len: 117 microversion: 2.1 time: 0.032957 Sep 17 21:04:05.988312 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1742/3385] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Sep 17 21:04:05 2022] DELETE /compute/v2.1/os-server-groups/397dd2a9-9639-4662-9154-700739a5b2fb => generated 117 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:04:06.001512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9b9ceba5-0bb6-4be2-9e1b-4040fd73c534 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:06.059534 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9b9ceba5-0bb6-4be2-9e1b-4040fd73c534 tempest-ServerGroupTestJSON-483272068 tempest-ServerGroupTestJSON-483272068-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/60bdd01e-fc73-4ec5-9949-73c31be90c18" status: 204 len: 0 microversion: 2.1 time: 0.060884 Sep 17 21:04:06.062681 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1743/3386] 10.222.0.26 () {58 vars in 1266 bytes} [Sat Sep 17 21:04:05 2022] DELETE /compute/v2.1/os-server-groups/60bdd01e-fc73-4ec5-9949-73c31be90c18 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:04:06.083965 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-26af7e99-e541-4c49-827a-c147653d2edd tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:06.085262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-26af7e99-e541-4c49-827a-c147653d2edd tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] [instance: 2b665d60-71ad-42ef-b99f-e87bc951ee62] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:06.093591 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26af7e99-e541-4c49-827a-c147653d2edd tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:06.094487 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26af7e99-e541-4c49-827a-c147653d2edd tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:06.095802 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26af7e99-e541-4c49-827a-c147653d2edd tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:06.097564 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26af7e99-e541-4c49-827a-c147653d2edd tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:06.098468 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26af7e99-e541-4c49-827a-c147653d2edd tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:06.099811 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26af7e99-e541-4c49-827a-c147653d2edd tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:06.121568 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-26af7e99-e541-4c49-827a-c147653d2edd tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] HTTP exception thrown: Instance 2b665d60-71ad-42ef-b99f-e87bc951ee62 could not be found. Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-26af7e99-e541-4c49-827a-c147653d2edd tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Request method failure captured: Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/2b665d60-71ad-42ef-b99f-e87bc951ee62 HTTP/1.1 Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjXyvrlv42liHi109DwfTAk7xYy6XbrEL7_MZZgkBV_y3S8S61lGw6War6MX25K8Y71SN8hPI2761kuLSdGrj79DU6-HzanNmEFgfzeXDw-tPFGzwnqBrTD-XoF-MZU63Wp3S3gZyc8R-qSwJD1gVRTQEPbQQRR0KiiV03PCwx7i3CA Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: b33b687e3d75472bb38e672e90871a0b Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersTestFqdnHostnames-1811295839 Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b33b687e3d75472bb38e672e90871a0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b33b687e3d75472bb38e672e90871a0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b33b687e3d75472bb38e672e90871a0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b33b687e3d75472bb38e672e90871a0b", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersTestFqdnHostnames-1811295839 Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: b33b687e3d75472bb38e672e90871a0b Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1811295839 Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersTestFqdnHostnames-1811295839-project Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 00e4ba59294f4529ba188e07cfc6681a Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersTestFqdnHostnames-1811295839-project Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 2b665d60-71ad-42ef-b99f-e87bc951ee62 could not be found. Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '2b665d60-71ad-42ef-b99f-e87bc951ee62'} Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b665d60-71ad-42ef-b99f-e87bc951ee62 could not be found. Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b665d60-71ad-42ef-b99f-e87bc951ee62 could not be found. Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:06.125282 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:06.134494 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:06.134494 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:06.134494 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:06.134494 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:04:06.134494 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:04:06.134494 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b665d60-71ad-42ef-b99f-e87bc951ee62 could not be found. Sep 17 21:04:06.134494 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:06.139104 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-26af7e99-e541-4c49-827a-c147653d2edd tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Returning 404 to user: Instance 2b665d60-71ad-42ef-b99f-e87bc951ee62 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:04:06.140379 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-26af7e99-e541-4c49-827a-c147653d2edd tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] 10.222.0.26 "GET /compute/v2.1/servers/2b665d60-71ad-42ef-b99f-e87bc951ee62" status: 404 len: 111 microversion: 2.1 time: 0.076133 Sep 17 21:04:06.141269 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1744/3387] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:06 2022] GET /compute/v2.1/servers/2b665d60-71ad-42ef-b99f-e87bc951ee62 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:04:06.160282 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0c021888-d8d4-4933-8506-df815a87afd3 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] Calling method '.version_select at 0x7f25a41011f0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:06.204217 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0c021888-d8d4-4933-8506-df815a87afd3 tempest-ServersTestFqdnHostnames-1811295839 tempest-ServersTestFqdnHostnames-1811295839-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1368218421" status: 202 len: 0 microversion: 2.1 time: 0.058183 Sep 17 21:04:06.204823 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1745/3388] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Sep 17 21:04:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1368218421 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:04:06.432630 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-430840b5-620d-4275-91e7-b4b2e5385aef tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:06.482614 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-430840b5-620d-4275-91e7-b4b2e5385aef tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1684 microversion: 2.1 time: 0.923683 Sep 17 21:04:06.486874 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1644/3389] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:05 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1684 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:06.518293 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e3bf50a1-a6c8-40c3-93ef-fa2920e02e65 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:06.519080 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e3bf50a1-a6c8-40c3-93ef-fa2920e02e65 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:06.527768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e3bf50a1-a6c8-40c3-93ef-fa2920e02e65 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:06.528512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e3bf50a1-a6c8-40c3-93ef-fa2920e02e65 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:06.529117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e3bf50a1-a6c8-40c3-93ef-fa2920e02e65 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:06.530075 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e3bf50a1-a6c8-40c3-93ef-fa2920e02e65 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:06.530789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e3bf50a1-a6c8-40c3-93ef-fa2920e02e65 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:06.531524 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e3bf50a1-a6c8-40c3-93ef-fa2920e02e65 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:06.831006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-db774122-7f3d-4189-89ba-cb565c285df5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:06.831990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-db774122-7f3d-4189-89ba-cb565c285df5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:06.840806 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db774122-7f3d-4189-89ba-cb565c285df5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:06.841315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db774122-7f3d-4189-89ba-cb565c285df5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:06.841796 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db774122-7f3d-4189-89ba-cb565c285df5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:06.842520 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db774122-7f3d-4189-89ba-cb565c285df5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:06.842983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db774122-7f3d-4189-89ba-cb565c285df5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:06.843417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db774122-7f3d-4189-89ba-cb565c285df5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:07.163210 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e3bf50a1-a6c8-40c3-93ef-fa2920e02e65 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:07.180643 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e3bf50a1-a6c8-40c3-93ef-fa2920e02e65 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1518 microversion: 2.1 time: 0.665036 Sep 17 21:04:07.195088 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1746/3390] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:06 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1518 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:07.228681 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-db774122-7f3d-4189-89ba-cb565c285df5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:07.243954 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-db774122-7f3d-4189-89ba-cb565c285df5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:07.246059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-db774122-7f3d-4189-89ba-cb565c285df5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:07.294803 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-db774122-7f3d-4189-89ba-cb565c285df5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1537 microversion: 2.91 time: 0.463799 Sep 17 21:04:07.296373 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1645/3391] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:04:06 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1537 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:04:07.498388 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-597409ce-83ec-4222-9643-3db628c27b7d req-319bba1d-7912-4dc8-8c53-892b4a8926c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b986fa2-07ea-4418-adf2-0a5fa127e84a", "name": "network-vif-plugged", "status": "completed", "tag": "f698d869-5f6d-4d34-95fa-00bb9569ec58"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:07.518381 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-90abedac-e396-49d4-9682-0276bd51ba57 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:07.520193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-90abedac-e396-49d4-9682-0276bd51ba57 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:07.531763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90abedac-e396-49d4-9682-0276bd51ba57 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:07.532281 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90abedac-e396-49d4-9682-0276bd51ba57 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:07.532731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90abedac-e396-49d4-9682-0276bd51ba57 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:07.533772 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90abedac-e396-49d4-9682-0276bd51ba57 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:07.538873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90abedac-e396-49d4-9682-0276bd51ba57 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:07.540736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90abedac-e396-49d4-9682-0276bd51ba57 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:07.545957 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-597409ce-83ec-4222-9643-3db628c27b7d req-319bba1d-7912-4dc8-8c53-892b4a8926c4 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:07.551864 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-597409ce-83ec-4222-9643-3db628c27b7d req-319bba1d-7912-4dc8-8c53-892b4a8926c4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:07.558231 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-597409ce-83ec-4222-9643-3db628c27b7d req-319bba1d-7912-4dc8-8c53-892b4a8926c4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:07.673186 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-597409ce-83ec-4222-9643-3db628c27b7d req-319bba1d-7912-4dc8-8c53-892b4a8926c4 service nova] Creating event network-vif-plugged:f698d869-5f6d-4d34-95fa-00bb9569ec58 for instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a on nch2-master-1 Sep 17 21:04:07.699601 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-597409ce-83ec-4222-9643-3db628c27b7d req-319bba1d-7912-4dc8-8c53-892b4a8926c4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206655 Sep 17 21:04:07.700234 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1747/3392] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:04:08.213915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9cb3ee66-9281-4f9d-906d-67a953a10a68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:08.214640 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9cb3ee66-9281-4f9d-906d-67a953a10a68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:08.232658 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9cb3ee66-9281-4f9d-906d-67a953a10a68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:08.233255 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9cb3ee66-9281-4f9d-906d-67a953a10a68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:08.235332 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9cb3ee66-9281-4f9d-906d-67a953a10a68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:08.237416 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9cb3ee66-9281-4f9d-906d-67a953a10a68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:08.238740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9cb3ee66-9281-4f9d-906d-67a953a10a68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:08.240476 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9cb3ee66-9281-4f9d-906d-67a953a10a68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:09.332264 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9cb3ee66-9281-4f9d-906d-67a953a10a68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:09.339514 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:04:09.352251 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9cb3ee66-9281-4f9d-906d-67a953a10a68 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1518 microversion: 2.1 time: 1.144466 Sep 17 21:04:09.356362 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1748/3393] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:08 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1518 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:04:09.372636 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-88181feb-bb06-433a-8f0b-c46d53020bd5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:09.374001 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-88181feb-bb06-433a-8f0b-c46d53020bd5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:09.400056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-88181feb-bb06-433a-8f0b-c46d53020bd5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:09.400889 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-88181feb-bb06-433a-8f0b-c46d53020bd5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:09.401610 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-88181feb-bb06-433a-8f0b-c46d53020bd5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:09.402599 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-88181feb-bb06-433a-8f0b-c46d53020bd5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:09.404297 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-88181feb-bb06-433a-8f0b-c46d53020bd5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:09.405721 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-88181feb-bb06-433a-8f0b-c46d53020bd5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:09.600064 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-90abedac-e396-49d4-9682-0276bd51ba57 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:09.607855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-88181feb-bb06-433a-8f0b-c46d53020bd5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:09.626906 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-88181feb-bb06-433a-8f0b-c46d53020bd5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:09.630095 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-90abedac-e396-49d4-9682-0276bd51ba57 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1684 microversion: 2.1 time: 2.114542 Sep 17 21:04:09.635029 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1646/3394] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:07 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1684 bytes in 2126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:04:09.635230 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-88181feb-bb06-433a-8f0b-c46d53020bd5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:09.642892 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-88181feb-bb06-433a-8f0b-c46d53020bd5 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1553 microversion: 2.91 time: 0.284573 Sep 17 21:04:09.644117 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1749/3395] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:04:09 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1553 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:04:10.383030 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-67089c7f-2c1a-476a-862c-3451e39dd8c7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:10.384108 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-67089c7f-2c1a-476a-862c-3451e39dd8c7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:10.397975 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67089c7f-2c1a-476a-862c-3451e39dd8c7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:10.398478 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67089c7f-2c1a-476a-862c-3451e39dd8c7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:10.398926 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67089c7f-2c1a-476a-862c-3451e39dd8c7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:10.405115 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67089c7f-2c1a-476a-862c-3451e39dd8c7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:10.407767 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67089c7f-2c1a-476a-862c-3451e39dd8c7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:10.411155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67089c7f-2c1a-476a-862c-3451e39dd8c7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:10.664442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5ec10cc7-8236-442e-a92c-cd04588cdcce tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:10.665951 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5ec10cc7-8236-442e-a92c-cd04588cdcce tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:10.678209 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5ec10cc7-8236-442e-a92c-cd04588cdcce tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:10.678989 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5ec10cc7-8236-442e-a92c-cd04588cdcce tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:10.680048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5ec10cc7-8236-442e-a92c-cd04588cdcce tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:10.683815 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5ec10cc7-8236-442e-a92c-cd04588cdcce tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:10.684408 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5ec10cc7-8236-442e-a92c-cd04588cdcce tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:10.684877 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5ec10cc7-8236-442e-a92c-cd04588cdcce tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:11.094489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-67089c7f-2c1a-476a-862c-3451e39dd8c7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:11.114095 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-67089c7f-2c1a-476a-862c-3451e39dd8c7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1518 microversion: 2.1 time: 0.736432 Sep 17 21:04:11.115340 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1647/3396] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:10 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1518 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:11.120328 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7c779a2b-6b95-4106-8969-fcf97b0ad8a2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:11.130142 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7c779a2b-6b95-4106-8969-fcf97b0ad8a2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:11.151602 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c779a2b-6b95-4106-8969-fcf97b0ad8a2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:11.152158 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c779a2b-6b95-4106-8969-fcf97b0ad8a2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:11.152686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c779a2b-6b95-4106-8969-fcf97b0ad8a2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:11.153421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c779a2b-6b95-4106-8969-fcf97b0ad8a2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:11.153961 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c779a2b-6b95-4106-8969-fcf97b0ad8a2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:11.154413 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c779a2b-6b95-4106-8969-fcf97b0ad8a2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:11.323243 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5ec10cc7-8236-442e-a92c-cd04588cdcce tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:11.336723 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5ec10cc7-8236-442e-a92c-cd04588cdcce tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1684 microversion: 2.1 time: 0.679860 Sep 17 21:04:11.337563 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1750/3397] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:10 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1684 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:11.421757 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7c779a2b-6b95-4106-8969-fcf97b0ad8a2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:11.438230 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7c779a2b-6b95-4106-8969-fcf97b0ad8a2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:11.441883 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7c779a2b-6b95-4106-8969-fcf97b0ad8a2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:11.459753 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7c779a2b-6b95-4106-8969-fcf97b0ad8a2 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1553 microversion: 2.91 time: 0.342512 Sep 17 21:04:11.461989 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1648/3398] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:04:11 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1553 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:04:12.142515 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f51f33cc-a2b8-4331-b2ab-dec045f0e341 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:12.143466 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f51f33cc-a2b8-4331-b2ab-dec045f0e341 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:12.168014 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f51f33cc-a2b8-4331-b2ab-dec045f0e341 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:12.168527 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f51f33cc-a2b8-4331-b2ab-dec045f0e341 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:12.168983 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f51f33cc-a2b8-4331-b2ab-dec045f0e341 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:12.169807 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f51f33cc-a2b8-4331-b2ab-dec045f0e341 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:12.170448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f51f33cc-a2b8-4331-b2ab-dec045f0e341 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:12.171034 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f51f33cc-a2b8-4331-b2ab-dec045f0e341 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:12.363666 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4cd55b10-98da-46cb-ae5d-e5407ff7c954 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:12.365967 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4cd55b10-98da-46cb-ae5d-e5407ff7c954 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:12.380233 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4cd55b10-98da-46cb-ae5d-e5407ff7c954 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:12.382729 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4cd55b10-98da-46cb-ae5d-e5407ff7c954 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:12.385343 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4cd55b10-98da-46cb-ae5d-e5407ff7c954 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:12.386343 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4cd55b10-98da-46cb-ae5d-e5407ff7c954 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:12.390414 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4cd55b10-98da-46cb-ae5d-e5407ff7c954 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:12.391145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4cd55b10-98da-46cb-ae5d-e5407ff7c954 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:13.105657 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=30 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:04:13.156882 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:04:13.827528 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f51f33cc-a2b8-4331-b2ab-dec045f0e341 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:13.836785 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f51f33cc-a2b8-4331-b2ab-dec045f0e341 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1518 microversion: 2.1 time: 1.698532 Sep 17 21:04:13.850741 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1751/3399] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:12 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1518 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:13.885442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f8115066-c25c-41fb-8e77-217050bc5edd tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:13.886358 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f8115066-c25c-41fb-8e77-217050bc5edd tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:13.902596 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8115066-c25c-41fb-8e77-217050bc5edd tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:13.903534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8115066-c25c-41fb-8e77-217050bc5edd tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:13.908158 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8115066-c25c-41fb-8e77-217050bc5edd tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:13.909703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8115066-c25c-41fb-8e77-217050bc5edd tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:13.926969 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8115066-c25c-41fb-8e77-217050bc5edd tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:13.928211 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8115066-c25c-41fb-8e77-217050bc5edd tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:14.394179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4cd55b10-98da-46cb-ae5d-e5407ff7c954 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:14.414825 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4cd55b10-98da-46cb-ae5d-e5407ff7c954 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1684 microversion: 2.1 time: 2.055022 Sep 17 21:04:14.438612 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1649/3400] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:12 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1684 bytes in 2079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:04:14.758400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f8115066-c25c-41fb-8e77-217050bc5edd tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:14.786077 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f8115066-c25c-41fb-8e77-217050bc5edd tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:14.791959 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f8115066-c25c-41fb-8e77-217050bc5edd tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:14.804566 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f8115066-c25c-41fb-8e77-217050bc5edd tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1553 microversion: 2.91 time: 0.932444 Sep 17 21:04:14.807079 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1752/3401] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:04:13 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1553 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:04:14.877929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7a4fa026-6f62-4fd5-9461-67ce9c145f07 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:14.878937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7a4fa026-6f62-4fd5-9461-67ce9c145f07 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:14.888642 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a4fa026-6f62-4fd5-9461-67ce9c145f07 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:14.900109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a4fa026-6f62-4fd5-9461-67ce9c145f07 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:14.901113 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a4fa026-6f62-4fd5-9461-67ce9c145f07 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:14.902142 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a4fa026-6f62-4fd5-9461-67ce9c145f07 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:14.904994 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a4fa026-6f62-4fd5-9461-67ce9c145f07 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:14.908176 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a4fa026-6f62-4fd5-9461-67ce9c145f07 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:15.440024 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=12 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:04:15.490993 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d6611fb9-7d69-49e7-8556-88663fc74e43 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:15.492072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d6611fb9-7d69-49e7-8556-88663fc74e43 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:15.514364 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d6611fb9-7d69-49e7-8556-88663fc74e43 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:15.518800 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d6611fb9-7d69-49e7-8556-88663fc74e43 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:15.520184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d6611fb9-7d69-49e7-8556-88663fc74e43 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:15.524309 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d6611fb9-7d69-49e7-8556-88663fc74e43 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:15.529132 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d6611fb9-7d69-49e7-8556-88663fc74e43 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:15.532694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d6611fb9-7d69-49e7-8556-88663fc74e43 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:16.370312 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d6611fb9-7d69-49e7-8556-88663fc74e43 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:16.386139 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d6611fb9-7d69-49e7-8556-88663fc74e43 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1684 microversion: 2.1 time: 0.946875 Sep 17 21:04:16.397695 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1753/3402] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:15 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1684 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:16.406711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-673dc637-ff4d-4459-bf4b-b9da5cbfafab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:16.413191 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-673dc637-ff4d-4459-bf4b-b9da5cbfafab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:16.432761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-673dc637-ff4d-4459-bf4b-b9da5cbfafab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:16.438856 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-673dc637-ff4d-4459-bf4b-b9da5cbfafab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:16.439459 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-673dc637-ff4d-4459-bf4b-b9da5cbfafab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:16.444165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-673dc637-ff4d-4459-bf4b-b9da5cbfafab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:16.446268 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-673dc637-ff4d-4459-bf4b-b9da5cbfafab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:16.450619 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-673dc637-ff4d-4459-bf4b-b9da5cbfafab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:17.517110 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7a4fa026-6f62-4fd5-9461-67ce9c145f07 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:17.547883 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7a4fa026-6f62-4fd5-9461-67ce9c145f07 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1518 microversion: 2.1 time: 2.673811 Sep 17 21:04:17.552642 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1650/3403] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:14 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1518 bytes in 2679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:17.570006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-60a6214b-6b47-4c24-ad1b-a62b0e198081 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:17.574993 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-60a6214b-6b47-4c24-ad1b-a62b0e198081 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:17.597057 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60a6214b-6b47-4c24-ad1b-a62b0e198081 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:17.597694 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60a6214b-6b47-4c24-ad1b-a62b0e198081 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:17.599198 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60a6214b-6b47-4c24-ad1b-a62b0e198081 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:17.599985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60a6214b-6b47-4c24-ad1b-a62b0e198081 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:17.600464 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60a6214b-6b47-4c24-ad1b-a62b0e198081 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:17.604284 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60a6214b-6b47-4c24-ad1b-a62b0e198081 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:18.157038 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-673dc637-ff4d-4459-bf4b-b9da5cbfafab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:18.183679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-673dc637-ff4d-4459-bf4b-b9da5cbfafab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:18.195121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-673dc637-ff4d-4459-bf4b-b9da5cbfafab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:18.235909 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-673dc637-ff4d-4459-bf4b-b9da5cbfafab tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1553 microversion: 2.91 time: 1.840299 Sep 17 21:04:18.246048 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1754/3404] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:04:16 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1553 bytes in 1859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:04:18.578339 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5eaad14c-01a3-404d-8ee0-76564d3941b2 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:18.579344 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5eaad14c-01a3-404d-8ee0-76564d3941b2 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:18.597694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5eaad14c-01a3-404d-8ee0-76564d3941b2 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:18.600361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5eaad14c-01a3-404d-8ee0-76564d3941b2 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:18.603071 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5eaad14c-01a3-404d-8ee0-76564d3941b2 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:18.604048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5eaad14c-01a3-404d-8ee0-76564d3941b2 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:18.606372 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5eaad14c-01a3-404d-8ee0-76564d3941b2 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:18.608170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5eaad14c-01a3-404d-8ee0-76564d3941b2 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:19.222694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5eaad14c-01a3-404d-8ee0-76564d3941b2 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:19.226986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-60a6214b-6b47-4c24-ad1b-a62b0e198081 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:19.244231 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-60a6214b-6b47-4c24-ad1b-a62b0e198081 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1684 microversion: 2.1 time: 1.677270 Sep 17 21:04:19.246210 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1651/3405] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:17 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1684 bytes in 1692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:19.273971 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5eaad14c-01a3-404d-8ee0-76564d3941b2 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1518 microversion: 2.1 time: 0.694133 Sep 17 21:04:19.281139 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1755/3406] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:18 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1518 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:04:19.286068 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9444d6a4-4dcc-46ee-ac68-002db7dd6018 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:19.287696 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9444d6a4-4dcc-46ee-ac68-002db7dd6018 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:19.307036 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9444d6a4-4dcc-46ee-ac68-002db7dd6018 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:19.308485 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9444d6a4-4dcc-46ee-ac68-002db7dd6018 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:19.309184 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9444d6a4-4dcc-46ee-ac68-002db7dd6018 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:19.312495 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9444d6a4-4dcc-46ee-ac68-002db7dd6018 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:19.312992 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9444d6a4-4dcc-46ee-ac68-002db7dd6018 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:19.314185 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9444d6a4-4dcc-46ee-ac68-002db7dd6018 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:19.781238 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9444d6a4-4dcc-46ee-ac68-002db7dd6018 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:19.829357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9444d6a4-4dcc-46ee-ac68-002db7dd6018 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:19.834079 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9444d6a4-4dcc-46ee-ac68-002db7dd6018 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:19.861256 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9444d6a4-4dcc-46ee-ac68-002db7dd6018 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1553 microversion: 2.91 time: 0.583033 Sep 17 21:04:19.864546 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1652/3407] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:04:19 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1553 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:04:20.276689 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c17e98c6-1088-408d-9ce8-653c75aaeb84 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:20.278196 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c17e98c6-1088-408d-9ce8-653c75aaeb84 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:20.300514 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ceab2c54-0b3e-46b2-a518-247db144d48d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:20.301134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ceab2c54-0b3e-46b2-a518-247db144d48d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:20.332460 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c17e98c6-1088-408d-9ce8-653c75aaeb84 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:20.334279 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ceab2c54-0b3e-46b2-a518-247db144d48d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:20.335002 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ceab2c54-0b3e-46b2-a518-247db144d48d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:20.335458 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ceab2c54-0b3e-46b2-a518-247db144d48d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:20.341150 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c17e98c6-1088-408d-9ce8-653c75aaeb84 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:20.341853 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c17e98c6-1088-408d-9ce8-653c75aaeb84 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:20.343061 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ceab2c54-0b3e-46b2-a518-247db144d48d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:20.343586 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ceab2c54-0b3e-46b2-a518-247db144d48d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:20.344047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ceab2c54-0b3e-46b2-a518-247db144d48d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:20.344901 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c17e98c6-1088-408d-9ce8-653c75aaeb84 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:20.346163 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c17e98c6-1088-408d-9ce8-653c75aaeb84 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:20.346867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c17e98c6-1088-408d-9ce8-653c75aaeb84 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:20.359583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:04:22.603410 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ceab2c54-0b3e-46b2-a518-247db144d48d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:22.618013 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ceab2c54-0b3e-46b2-a518-247db144d48d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1518 microversion: 2.1 time: 2.319312 Sep 17 21:04:22.633489 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1653/3408] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:20 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1518 bytes in 2326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:22.633489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-244d457f-34a5-458c-ad6b-e44d3a8e41bc tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:22.634453 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-244d457f-34a5-458c-ad6b-e44d3a8e41bc tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:22.659574 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-244d457f-34a5-458c-ad6b-e44d3a8e41bc tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:22.660864 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-244d457f-34a5-458c-ad6b-e44d3a8e41bc tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:22.664981 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-244d457f-34a5-458c-ad6b-e44d3a8e41bc tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:22.667172 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-244d457f-34a5-458c-ad6b-e44d3a8e41bc tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:22.671912 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-244d457f-34a5-458c-ad6b-e44d3a8e41bc tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:22.675082 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-244d457f-34a5-458c-ad6b-e44d3a8e41bc tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:22.861503 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-244d457f-34a5-458c-ad6b-e44d3a8e41bc tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:22.896932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-244d457f-34a5-458c-ad6b-e44d3a8e41bc tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:22.899165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-244d457f-34a5-458c-ad6b-e44d3a8e41bc tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:22.925864 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-244d457f-34a5-458c-ad6b-e44d3a8e41bc tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1553 microversion: 2.91 time: 0.302966 Sep 17 21:04:22.928856 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1654/3409] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:04:22 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1553 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:04:23.495688 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c17e98c6-1088-408d-9ce8-653c75aaeb84 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:23.508113 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c17e98c6-1088-408d-9ce8-653c75aaeb84 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1684 microversion: 2.1 time: 3.242600 Sep 17 21:04:23.523046 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1756/3410] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:20 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1684 bytes in 3258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:23.648182 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7296586d-495b-44a3-a623-b52608200f00 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:23.649006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7296586d-495b-44a3-a623-b52608200f00 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:23.688938 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7296586d-495b-44a3-a623-b52608200f00 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:23.689506 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7296586d-495b-44a3-a623-b52608200f00 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:23.698566 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7296586d-495b-44a3-a623-b52608200f00 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:23.699371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7296586d-495b-44a3-a623-b52608200f00 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:23.708478 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7296586d-495b-44a3-a623-b52608200f00 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:23.716547 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7296586d-495b-44a3-a623-b52608200f00 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:23.963856 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f7a71346-6f49-4b08-ab53-584ced2284d9 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:23.965850 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f7a71346-6f49-4b08-ab53-584ced2284d9 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:23.990101 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7a71346-6f49-4b08-ab53-584ced2284d9 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:23.991156 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7a71346-6f49-4b08-ab53-584ced2284d9 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:23.991609 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7a71346-6f49-4b08-ab53-584ced2284d9 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:24.002173 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7a71346-6f49-4b08-ab53-584ced2284d9 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:24.002628 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7a71346-6f49-4b08-ab53-584ced2284d9 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:24.003357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7a71346-6f49-4b08-ab53-584ced2284d9 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:24.605262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f7a71346-6f49-4b08-ab53-584ced2284d9 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:24.621613 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f7a71346-6f49-4b08-ab53-584ced2284d9 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:24.637789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f7a71346-6f49-4b08-ab53-584ced2284d9 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:24.650150 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f7a71346-6f49-4b08-ab53-584ced2284d9 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1553 microversion: 2.91 time: 0.693870 Sep 17 21:04:24.654314 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1757/3411] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:04:23 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1553 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:04:24.683885 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-58f51152-bf75-445a-856f-e6019506ae64 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:24.696544 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-58f51152-bf75-445a-856f-e6019506ae64 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:24.712567 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58f51152-bf75-445a-856f-e6019506ae64 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:24.713698 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58f51152-bf75-445a-856f-e6019506ae64 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:24.727216 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58f51152-bf75-445a-856f-e6019506ae64 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:24.730298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58f51152-bf75-445a-856f-e6019506ae64 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:24.731042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58f51152-bf75-445a-856f-e6019506ae64 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:24.733670 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58f51152-bf75-445a-856f-e6019506ae64 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:24.991756 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7296586d-495b-44a3-a623-b52608200f00 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:25.007712 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7296586d-495b-44a3-a623-b52608200f00 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1518 microversion: 2.1 time: 1.361735 Sep 17 21:04:25.025087 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1655/3412] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:23 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1518 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:25.507576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-58f51152-bf75-445a-856f-e6019506ae64 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:25.537051 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-58f51152-bf75-445a-856f-e6019506ae64 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1684 microversion: 2.1 time: 0.881258 Sep 17 21:04:25.540448 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1758/3413] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:24 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1684 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:25.686449 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6ec7917a-1e48-4e5d-b3a2-be6228c51467 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:25.689713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6ec7917a-1e48-4e5d-b3a2-be6228c51467 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:25.710807 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6ec7917a-1e48-4e5d-b3a2-be6228c51467 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:25.719629 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6ec7917a-1e48-4e5d-b3a2-be6228c51467 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:25.722067 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6ec7917a-1e48-4e5d-b3a2-be6228c51467 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:25.723018 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6ec7917a-1e48-4e5d-b3a2-be6228c51467 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:25.724359 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6ec7917a-1e48-4e5d-b3a2-be6228c51467 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:25.731029 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6ec7917a-1e48-4e5d-b3a2-be6228c51467 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:26.039278 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d912916e-4e70-4255-beda-91b400b0c901 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:26.039904 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d912916e-4e70-4255-beda-91b400b0c901 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:26.046772 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=4 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:04:26.050516 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6ec7917a-1e48-4e5d-b3a2-be6228c51467 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:26.059921 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d912916e-4e70-4255-beda-91b400b0c901 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:26.063988 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d912916e-4e70-4255-beda-91b400b0c901 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:26.064805 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d912916e-4e70-4255-beda-91b400b0c901 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:26.066977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6ec7917a-1e48-4e5d-b3a2-be6228c51467 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:26.068127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d912916e-4e70-4255-beda-91b400b0c901 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:26.068893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d912916e-4e70-4255-beda-91b400b0c901 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:26.069040 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6ec7917a-1e48-4e5d-b3a2-be6228c51467 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:26.069735 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d912916e-4e70-4255-beda-91b400b0c901 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:26.093075 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6ec7917a-1e48-4e5d-b3a2-be6228c51467 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1553 microversion: 2.91 time: 0.409956 Sep 17 21:04:26.094393 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1656/3414] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:04:25 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1553 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:04:26.567660 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f24e6041-cf6c-407b-b55c-096705f0645a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:26.568397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f24e6041-cf6c-407b-b55c-096705f0645a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:26.589131 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f24e6041-cf6c-407b-b55c-096705f0645a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:26.589840 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f24e6041-cf6c-407b-b55c-096705f0645a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:26.590310 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f24e6041-cf6c-407b-b55c-096705f0645a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:26.595846 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f24e6041-cf6c-407b-b55c-096705f0645a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:26.596365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f24e6041-cf6c-407b-b55c-096705f0645a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:26.596882 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f24e6041-cf6c-407b-b55c-096705f0645a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:26.916300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d912916e-4e70-4255-beda-91b400b0c901 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:26.929726 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d912916e-4e70-4255-beda-91b400b0c901 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1518 microversion: 2.1 time: 0.894458 Sep 17 21:04:26.930335 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1759/3415] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:26 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1518 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:27.124815 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-714c4157-accf-4582-ba0d-4f3c3f8cd083 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:27.126325 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-714c4157-accf-4582-ba0d-4f3c3f8cd083 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:27.133343 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-714c4157-accf-4582-ba0d-4f3c3f8cd083 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:27.134263 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-714c4157-accf-4582-ba0d-4f3c3f8cd083 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:27.134922 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-714c4157-accf-4582-ba0d-4f3c3f8cd083 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:27.135846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-714c4157-accf-4582-ba0d-4f3c3f8cd083 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:27.136522 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-714c4157-accf-4582-ba0d-4f3c3f8cd083 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:27.137147 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-714c4157-accf-4582-ba0d-4f3c3f8cd083 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:27.524364 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-714c4157-accf-4582-ba0d-4f3c3f8cd083 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:27.538327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-714c4157-accf-4582-ba0d-4f3c3f8cd083 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:27.555044 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-714c4157-accf-4582-ba0d-4f3c3f8cd083 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:27.607361 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-714c4157-accf-4582-ba0d-4f3c3f8cd083 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1553 microversion: 2.91 time: 0.486437 Sep 17 21:04:27.613390 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1760/3416] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:04:27 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1553 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:04:27.684268 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f24e6041-cf6c-407b-b55c-096705f0645a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:27.693389 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f24e6041-cf6c-407b-b55c-096705f0645a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1684 microversion: 2.1 time: 1.133349 Sep 17 21:04:27.700170 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1657/3417] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:26 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1684 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:27.958578 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7fa67a43-eb29-4659-99b7-75c05c188804 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:27.959238 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7fa67a43-eb29-4659-99b7-75c05c188804 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:27.982305 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7fa67a43-eb29-4659-99b7-75c05c188804 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:27.983751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7fa67a43-eb29-4659-99b7-75c05c188804 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:27.987056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7fa67a43-eb29-4659-99b7-75c05c188804 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:27.990519 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7fa67a43-eb29-4659-99b7-75c05c188804 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:27.992396 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7fa67a43-eb29-4659-99b7-75c05c188804 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:28.000432 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7fa67a43-eb29-4659-99b7-75c05c188804 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:28.645301 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ea7e2067-6de9-4658-8d8d-0fb061f3750e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:28.645949 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ea7e2067-6de9-4658-8d8d-0fb061f3750e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:28.660617 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea7e2067-6de9-4658-8d8d-0fb061f3750e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:28.661336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea7e2067-6de9-4658-8d8d-0fb061f3750e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:28.661817 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea7e2067-6de9-4658-8d8d-0fb061f3750e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:28.662567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea7e2067-6de9-4658-8d8d-0fb061f3750e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:28.663022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea7e2067-6de9-4658-8d8d-0fb061f3750e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:28.666761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea7e2067-6de9-4658-8d8d-0fb061f3750e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:28.990409 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ea7e2067-6de9-4658-8d8d-0fb061f3750e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:29.007633 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ea7e2067-6de9-4658-8d8d-0fb061f3750e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:29.017977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ea7e2067-6de9-4658-8d8d-0fb061f3750e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:29.024523 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ea7e2067-6de9-4658-8d8d-0fb061f3750e tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1553 microversion: 2.91 time: 0.383437 Sep 17 21:04:29.028399 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1658/3418] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:04:28 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1553 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:04:29.039832 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1b38ea2f-61c9-48d1-96d2-ca5189ba7eb9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:29.040600 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1b38ea2f-61c9-48d1-96d2-ca5189ba7eb9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:29.053418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b38ea2f-61c9-48d1-96d2-ca5189ba7eb9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:29.056645 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b38ea2f-61c9-48d1-96d2-ca5189ba7eb9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:29.057217 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b38ea2f-61c9-48d1-96d2-ca5189ba7eb9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:29.058756 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b38ea2f-61c9-48d1-96d2-ca5189ba7eb9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:29.060620 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b38ea2f-61c9-48d1-96d2-ca5189ba7eb9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:29.061162 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b38ea2f-61c9-48d1-96d2-ca5189ba7eb9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:29.606771 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7fa67a43-eb29-4659-99b7-75c05c188804 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:29.640067 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7fa67a43-eb29-4659-99b7-75c05c188804 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 1.687402 Sep 17 21:04:29.669492 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1761/3419] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:27 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:29.690663 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e2773ef2-2002-47bc-a56d-f170d73765cf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:29.691306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e2773ef2-2002-47bc-a56d-f170d73765cf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:29.706480 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2773ef2-2002-47bc-a56d-f170d73765cf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:29.710113 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2773ef2-2002-47bc-a56d-f170d73765cf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:29.710621 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2773ef2-2002-47bc-a56d-f170d73765cf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:29.711418 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2773ef2-2002-47bc-a56d-f170d73765cf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:29.711884 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2773ef2-2002-47bc-a56d-f170d73765cf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:29.712321 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2773ef2-2002-47bc-a56d-f170d73765cf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:29.760207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1b38ea2f-61c9-48d1-96d2-ca5189ba7eb9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:29.776177 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1b38ea2f-61c9-48d1-96d2-ca5189ba7eb9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.744295 Sep 17 21:04:29.783360 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1659/3420] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:29 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:29.926019 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-79c6a85d-9ecb-4020-a93a-606c0aefe7fb req-57709487-1af2-4470-8b0f-4c4cdd16dad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41393a54-9105-4da5-ae65-3167427ddae8", "name": "network-vif-unplugged", "status": "completed", "tag": "4d47e229-8239-4215-8c5c-b5133bcfb47b"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:29.931891 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=74 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:04:29.952907 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-79c6a85d-9ecb-4020-a93a-606c0aefe7fb req-57709487-1af2-4470-8b0f-4c4cdd16dad1 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:29.953399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-79c6a85d-9ecb-4020-a93a-606c0aefe7fb req-57709487-1af2-4470-8b0f-4c4cdd16dad1 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:29.953978 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-79c6a85d-9ecb-4020-a93a-606c0aefe7fb req-57709487-1af2-4470-8b0f-4c4cdd16dad1 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:30.009712 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-79c6a85d-9ecb-4020-a93a-606c0aefe7fb req-57709487-1af2-4470-8b0f-4c4cdd16dad1 service nova] Creating event network-vif-unplugged:4d47e229-8239-4215-8c5c-b5133bcfb47b for instance 41393a54-9105-4da5-ae65-3167427ddae8 on nch1-master-1 Sep 17 21:04:30.021334 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-79c6a85d-9ecb-4020-a93a-606c0aefe7fb req-57709487-1af2-4470-8b0f-4c4cdd16dad1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098943 Sep 17 21:04:30.023785 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1660/3421] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:04:30.034781 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2d2443aa-1bb3-4a57-bd39-d38401396f78 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:30.040161 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2d2443aa-1bb3-4a57-bd39-d38401396f78 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:30.057583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d2443aa-1bb3-4a57-bd39-d38401396f78 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:30.058100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d2443aa-1bb3-4a57-bd39-d38401396f78 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:30.058558 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d2443aa-1bb3-4a57-bd39-d38401396f78 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:30.059283 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d2443aa-1bb3-4a57-bd39-d38401396f78 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:30.066144 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d2443aa-1bb3-4a57-bd39-d38401396f78 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:30.067145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d2443aa-1bb3-4a57-bd39-d38401396f78 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:30.594499 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e2773ef2-2002-47bc-a56d-f170d73765cf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:30.604043 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e2773ef2-2002-47bc-a56d-f170d73765cf tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.925060 Sep 17 21:04:30.610669 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1762/3422] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:29 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:30.663372 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-da0091a6-41bc-455c-9d35-10fc4f5efa42 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:30.667637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-da0091a6-41bc-455c-9d35-10fc4f5efa42 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:30.692769 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-da0091a6-41bc-455c-9d35-10fc4f5efa42 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:30.693957 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-da0091a6-41bc-455c-9d35-10fc4f5efa42 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:30.695378 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-da0091a6-41bc-455c-9d35-10fc4f5efa42 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:30.697034 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-da0091a6-41bc-455c-9d35-10fc4f5efa42 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:30.697873 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-da0091a6-41bc-455c-9d35-10fc4f5efa42 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:30.698728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-da0091a6-41bc-455c-9d35-10fc4f5efa42 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:30.743607 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2d2443aa-1bb3-4a57-bd39-d38401396f78 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:30.754985 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2d2443aa-1bb3-4a57-bd39-d38401396f78 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.729580 Sep 17 21:04:30.755826 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1661/3423] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:30 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:30.761451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ad4dbdfc-ccf1-4472-a668-55f9729b8876 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:30.762261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ad4dbdfc-ccf1-4472-a668-55f9729b8876 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:30.770388 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad4dbdfc-ccf1-4472-a668-55f9729b8876 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:30.771078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad4dbdfc-ccf1-4472-a668-55f9729b8876 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:30.771682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad4dbdfc-ccf1-4472-a668-55f9729b8876 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:30.772574 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad4dbdfc-ccf1-4472-a668-55f9729b8876 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:30.773214 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad4dbdfc-ccf1-4472-a668-55f9729b8876 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:30.773833 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad4dbdfc-ccf1-4472-a668-55f9729b8876 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:30.918471 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-da0091a6-41bc-455c-9d35-10fc4f5efa42 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:30.941771 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-da0091a6-41bc-455c-9d35-10fc4f5efa42 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:30.943387 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-da0091a6-41bc-455c-9d35-10fc4f5efa42 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:30.953407 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-da0091a6-41bc-455c-9d35-10fc4f5efa42 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1553 microversion: 2.91 time: 0.324256 Sep 17 21:04:30.954372 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1763/3424] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:04:30 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1553 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:04:31.931294 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ad4dbdfc-ccf1-4472-a668-55f9729b8876 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:31.947629 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ad4dbdfc-ccf1-4472-a668-55f9729b8876 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 1.190247 Sep 17 21:04:31.950045 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1662/3425] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:30 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:31.982995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-51a8835a-920d-4631-81c1-cede3e4466ec tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:31.983729 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-adf9ba85-2a0d-46a0-a801-06575ff2312d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:31.984786 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-51a8835a-920d-4631-81c1-cede3e4466ec tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:32.002209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-51a8835a-920d-4631-81c1-cede3e4466ec tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:32.010255 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-51a8835a-920d-4631-81c1-cede3e4466ec tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:32.011026 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-51a8835a-920d-4631-81c1-cede3e4466ec tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:32.013011 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-adf9ba85-2a0d-46a0-a801-06575ff2312d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Instance ab2634fd-fb38-4cf0-8800-f05aedd766fc has no mapping to a cell. Sep 17 21:04:32.016575 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-51a8835a-920d-4631-81c1-cede3e4466ec tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:32.017290 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-51a8835a-920d-4631-81c1-cede3e4466ec tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:32.017817 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-51a8835a-920d-4631-81c1-cede3e4466ec tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-adf9ba85-2a0d-46a0-a801-06575ff2312d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers/ab2634fd-fb38-4cf0-8800-f05aedd766fc/action HTTP/1.1 Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 15 Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: {"os-stop": {}} Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance ab2634fd-fb38-4cf0-8800-f05aedd766fc has no mapping to a cell. Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'ab2634fd-fb38-4cf0-8800-f05aedd766fc', 'body': {'os-stop': {}}} Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance ab2634fd-fb38-4cf0-8800-f05aedd766fc has no mapping to a cell. Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:04:32.029205 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab2634fd-fb38-4cf0-8800-f05aedd766fc has no mapping to a cell. Sep 17 21:04:32.035891 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:32.035891 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:32.035891 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:32.035891 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:32.035891 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:32.035891 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:32.035891 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:04:32.035891 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:04:32.035891 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab2634fd-fb38-4cf0-8800-f05aedd766fc has no mapping to a cell. Sep 17 21:04:32.035891 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:04:32.038419 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-adf9ba85-2a0d-46a0-a801-06575ff2312d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 404 to user: Instance ab2634fd-fb38-4cf0-8800-f05aedd766fc has no mapping to a cell. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:04:32.040067 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-adf9ba85-2a0d-46a0-a801-06575ff2312d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers/ab2634fd-fb38-4cf0-8800-f05aedd766fc/action" status: 404 len: 117 microversion: 2.1 time: 0.068256 Sep 17 21:04:32.041438 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1764/3426] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:04:31 2022] POST /compute/v2.1/servers/ab2634fd-fb38-4cf0-8800-f05aedd766fc/action => generated 117 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:04:32.058509 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f86e47c8-05db-412f-9180-e189e1161425 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:32.060422 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f86e47c8-05db-412f-9180-e189e1161425 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:32.076765 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f86e47c8-05db-412f-9180-e189e1161425 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:32.078206 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f86e47c8-05db-412f-9180-e189e1161425 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:32.079437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f86e47c8-05db-412f-9180-e189e1161425 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:32.080942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f86e47c8-05db-412f-9180-e189e1161425 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:32.082209 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f86e47c8-05db-412f-9180-e189e1161425 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:32.083782 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f86e47c8-05db-412f-9180-e189e1161425 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:32.472504 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-51a8835a-920d-4631-81c1-cede3e4466ec tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:32.508510 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-51a8835a-920d-4631-81c1-cede3e4466ec tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:32.521374 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-51a8835a-920d-4631-81c1-cede3e4466ec tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:32.528441 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-51a8835a-920d-4631-81c1-cede3e4466ec tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1553 microversion: 2.91 time: 0.549426 Sep 17 21:04:32.529043 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1663/3427] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:04:31 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1553 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:04:32.978269 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-48f82aad-ceb6-4e20-a37e-ee792b74f8d9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:32.980031 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-48f82aad-ceb6-4e20-a37e-ee792b74f8d9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:32.996278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-48f82aad-ceb6-4e20-a37e-ee792b74f8d9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:33.000079 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-48f82aad-ceb6-4e20-a37e-ee792b74f8d9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:33.002221 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-48f82aad-ceb6-4e20-a37e-ee792b74f8d9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:33.003239 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-48f82aad-ceb6-4e20-a37e-ee792b74f8d9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:33.010509 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-48f82aad-ceb6-4e20-a37e-ee792b74f8d9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:33.011355 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-48f82aad-ceb6-4e20-a37e-ee792b74f8d9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:33.575162 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f86e47c8-05db-412f-9180-e189e1161425 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:33.602670 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f86e47c8-05db-412f-9180-e189e1161425 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 1.557102 Sep 17 21:04:33.606025 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1765/3428] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:32 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:33.616925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-99e891f6-e763-4132-a2b9-735006bd3393 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:33.618672 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-99e891f6-e763-4132-a2b9-735006bd3393 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:33.638190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-99e891f6-e763-4132-a2b9-735006bd3393 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:33.639754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-99e891f6-e763-4132-a2b9-735006bd3393 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:33.640306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-99e891f6-e763-4132-a2b9-735006bd3393 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:33.644497 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-99e891f6-e763-4132-a2b9-735006bd3393 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:33.645206 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-99e891f6-e763-4132-a2b9-735006bd3393 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:33.646986 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-99e891f6-e763-4132-a2b9-735006bd3393 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:33.714567 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:04:34.115175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-48f82aad-ceb6-4e20-a37e-ee792b74f8d9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:34.124845 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-48f82aad-ceb6-4e20-a37e-ee792b74f8d9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 1.150275 Sep 17 21:04:34.141536 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1664/3429] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:32 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:34.185229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-99e891f6-e763-4132-a2b9-735006bd3393 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:34.198909 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-99e891f6-e763-4132-a2b9-735006bd3393 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:34.200385 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-99e891f6-e763-4132-a2b9-735006bd3393 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:34.218755 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-99e891f6-e763-4132-a2b9-735006bd3393 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1535 microversion: 2.91 time: 0.611007 Sep 17 21:04:34.222219 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1766/3430] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:04:33 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1535 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:04:34.234964 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-944340b1-40a7-4299-8781-f49c3e6edca8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:34.235916 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-944340b1-40a7-4299-8781-f49c3e6edca8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:34.250575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-944340b1-40a7-4299-8781-f49c3e6edca8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:34.251404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-944340b1-40a7-4299-8781-f49c3e6edca8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:34.252057 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-944340b1-40a7-4299-8781-f49c3e6edca8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:34.253038 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-944340b1-40a7-4299-8781-f49c3e6edca8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:34.254371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-944340b1-40a7-4299-8781-f49c3e6edca8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:34.255338 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-944340b1-40a7-4299-8781-f49c3e6edca8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:34.412244 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cc66c5cb-2b69-4bae-b4d7-0b5654bfa759 tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] Action: 'create', calling method: .version_select at 0x7f25a4f7eee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1513281113", "description": "tempest-description-1624363712"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:34.765525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-944340b1-40a7-4299-8781-f49c3e6edca8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:34.776134 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-944340b1-40a7-4299-8781-f49c3e6edca8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.552442 Sep 17 21:04:34.786958 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1767/3431] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:34 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:34.802161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d3b6551c-a1dd-4770-a731-76b6dac093ad tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:34.802855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d3b6551c-a1dd-4770-a731-76b6dac093ad tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:34.809840 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3b6551c-a1dd-4770-a731-76b6dac093ad tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:34.810350 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3b6551c-a1dd-4770-a731-76b6dac093ad tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:34.818075 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3b6551c-a1dd-4770-a731-76b6dac093ad tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:34.818942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3b6551c-a1dd-4770-a731-76b6dac093ad tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:34.819443 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3b6551c-a1dd-4770-a731-76b6dac093ad tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:34.819893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3b6551c-a1dd-4770-a731-76b6dac093ad tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:35.136382 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cc66c5cb-2b69-4bae-b4d7-0b5654bfa759 tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.998201 Sep 17 21:04:35.138465 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1665/3432] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Sep 17 21:04:34 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:04:35.147035 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-75071f95-1d46-4569-9eaf-fd870b5690e6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:35.148600 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-75071f95-1d46-4569-9eaf-fd870b5690e6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: d2d68a1c-717c-41a7-b31b-838b4672c4e8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:35.170867 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-75071f95-1d46-4569-9eaf-fd870b5690e6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Instance d2d68a1c-717c-41a7-b31b-838b4672c4e8 could not be found. Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-75071f95-1d46-4569-9eaf-fd870b5690e6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers/d2d68a1c-717c-41a7-b31b-838b4672c4e8/action HTTP/1.1 Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 15 Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: {"suspend": {}} Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance d2d68a1c-717c-41a7-b31b-838b4672c4e8 could not be found. Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'd2d68a1c-717c-41a7-b31b-838b4672c4e8', 'body': {'suspend': {}}} Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2d68a1c-717c-41a7-b31b-838b4672c4e8 could not be found. Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2d68a1c-717c-41a7-b31b-838b4672c4e8 could not be found. Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:35.173742 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:35.179873 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:04:35.179873 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:04:35.179873 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2d68a1c-717c-41a7-b31b-838b4672c4e8 could not be found. Sep 17 21:04:35.179873 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:04:35.179873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-75071f95-1d46-4569-9eaf-fd870b5690e6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 404 to user: Instance d2d68a1c-717c-41a7-b31b-838b4672c4e8 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:04:35.179873 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-75071f95-1d46-4569-9eaf-fd870b5690e6 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers/d2d68a1c-717c-41a7-b31b-838b4672c4e8/action" status: 404 len: 111 microversion: 2.1 time: 0.040053 Sep 17 21:04:35.181085 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1666/3433] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:04:35 2022] POST /compute/v2.1/servers/d2d68a1c-717c-41a7-b31b-838b4672c4e8/action => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:04:35.187222 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-352b8f01-fd59-4701-ab6f-81e65171ba46 tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] Action: 'create', calling method: .version_select at 0x7f25a4cd3820>, body: {"security_group_rule": {"parent_group_id": "3d0af82d-3353-483e-92d5-08b8df5fae75", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:35.301109 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d3b6551c-a1dd-4770-a731-76b6dac093ad tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:35.316178 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d3b6551c-a1dd-4770-a731-76b6dac093ad tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.525394 Sep 17 21:04:35.317611 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1768/3434] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:34 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:35.324849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3fcc8eff-f936-4b95-baef-1511b4479f46 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:35.325798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3fcc8eff-f936-4b95-baef-1511b4479f46 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:35.364204 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3fcc8eff-f936-4b95-baef-1511b4479f46 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:35.370305 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3fcc8eff-f936-4b95-baef-1511b4479f46 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:35.370959 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3fcc8eff-f936-4b95-baef-1511b4479f46 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:35.371865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3fcc8eff-f936-4b95-baef-1511b4479f46 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:35.372481 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3fcc8eff-f936-4b95-baef-1511b4479f46 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:35.373093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3fcc8eff-f936-4b95-baef-1511b4479f46 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:35.763390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3fcc8eff-f936-4b95-baef-1511b4479f46 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:35.782986 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3fcc8eff-f936-4b95-baef-1511b4479f46 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.463190 Sep 17 21:04:35.796575 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1769/3435] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:35 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:35.801896 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a7a0d7ea-3b15-4a4f-8a11-b47c3480ea94 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:35.814068 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a7a0d7ea-3b15-4a4f-8a11-b47c3480ea94 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:35.835360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7a0d7ea-3b15-4a4f-8a11-b47c3480ea94 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:35.836142 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7a0d7ea-3b15-4a4f-8a11-b47c3480ea94 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:35.836763 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7a0d7ea-3b15-4a4f-8a11-b47c3480ea94 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:35.837686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7a0d7ea-3b15-4a4f-8a11-b47c3480ea94 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:35.843069 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7a0d7ea-3b15-4a4f-8a11-b47c3480ea94 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:35.843743 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7a0d7ea-3b15-4a4f-8a11-b47c3480ea94 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:36.048973 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a7a0d7ea-3b15-4a4f-8a11-b47c3480ea94 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:36.063087 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a7a0d7ea-3b15-4a4f-8a11-b47c3480ea94 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:36.065762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a7a0d7ea-3b15-4a4f-8a11-b47c3480ea94 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:36.079827 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a7a0d7ea-3b15-4a4f-8a11-b47c3480ea94 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1535 microversion: 2.91 time: 0.281838 Sep 17 21:04:36.084942 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1770/3436] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:04:35 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1535 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:04:36.090590 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a683c3e8-d803-4c32-938e-66c0285e747e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:36.102720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a683c3e8-d803-4c32-938e-66c0285e747e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:36.120878 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a683c3e8-d803-4c32-938e-66c0285e747e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:36.123865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a683c3e8-d803-4c32-938e-66c0285e747e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:36.125107 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a683c3e8-d803-4c32-938e-66c0285e747e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:36.126797 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a683c3e8-d803-4c32-938e-66c0285e747e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:36.128107 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a683c3e8-d803-4c32-938e-66c0285e747e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:36.133428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a683c3e8-d803-4c32-938e-66c0285e747e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:36.300380 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-352b8f01-fd59-4701-ab6f-81e65171ba46 tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.117693 Sep 17 21:04:36.303045 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1667/3437] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Sep 17 21:04:35 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:04:36.309887 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3a92b4ba-872a-401d-b28a-af5f11a72435 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:36.311313 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3a92b4ba-872a-401d-b28a-af5f11a72435 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:36.329304 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3a92b4ba-872a-401d-b28a-af5f11a72435 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:36.329871 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3a92b4ba-872a-401d-b28a-af5f11a72435 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:36.331682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3a92b4ba-872a-401d-b28a-af5f11a72435 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:36.335284 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3a92b4ba-872a-401d-b28a-af5f11a72435 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:36.354393 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3a92b4ba-872a-401d-b28a-af5f11a72435 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:36.360953 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3a92b4ba-872a-401d-b28a-af5f11a72435 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:36.747279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a683c3e8-d803-4c32-938e-66c0285e747e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:36.761779 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a683c3e8-d803-4c32-938e-66c0285e747e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.669784 Sep 17 21:04:36.764218 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1771/3438] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:36 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:36.776335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9d96779b-227e-4185-bf10-0a7e1e4e8026 tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] Action: 'create', calling method: .version_select at 0x7f25a418cca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-78065537", "description": "tempest-description-1035577005"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:36.924915 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3a92b4ba-872a-401d-b28a-af5f11a72435 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:36.940430 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3a92b4ba-872a-401d-b28a-af5f11a72435 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.635850 Sep 17 21:04:36.941373 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1668/3439] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:36 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:36.955686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0460ce3b-f67c-4bd7-be37-f41dd93846d7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:36.958737 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0460ce3b-f67c-4bd7-be37-f41dd93846d7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:36.967777 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0460ce3b-f67c-4bd7-be37-f41dd93846d7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:36.980922 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0460ce3b-f67c-4bd7-be37-f41dd93846d7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:36.982857 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0460ce3b-f67c-4bd7-be37-f41dd93846d7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:36.988432 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0460ce3b-f67c-4bd7-be37-f41dd93846d7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:36.989191 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0460ce3b-f67c-4bd7-be37-f41dd93846d7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:36.989781 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0460ce3b-f67c-4bd7-be37-f41dd93846d7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:37.210722 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0460ce3b-f67c-4bd7-be37-f41dd93846d7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action" status: 202 len: 0 microversion: 2.1 time: 0.267113 Sep 17 21:04:37.214614 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1669/3440] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:04:36 2022] POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:04:37.235949 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e0e8897f-5830-413f-a478-bde26c53a3ae tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:37.237152 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e0e8897f-5830-413f-a478-bde26c53a3ae tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:37.267295 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0e8897f-5830-413f-a478-bde26c53a3ae tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:37.267830 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0e8897f-5830-413f-a478-bde26c53a3ae tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:37.268288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0e8897f-5830-413f-a478-bde26c53a3ae tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:37.269053 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0e8897f-5830-413f-a478-bde26c53a3ae tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:37.269566 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0e8897f-5830-413f-a478-bde26c53a3ae tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:37.272999 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0e8897f-5830-413f-a478-bde26c53a3ae tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:37.366630 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-e0e8897f-5830-413f-a478-bde26c53a3ae tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lazy-loading 'flavor' on Instance uuid 9b986fa2-07ea-4418-adf2-0a5fa127e84a {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:04:37.482079 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:04:37.511891 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e0e8897f-5830-413f-a478-bde26c53a3ae tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a/action" status: 202 len: 0 microversion: 2.1 time: 0.282595 Sep 17 21:04:37.513764 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1670/3441] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:04:37 2022] POST /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:04:37.541725 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a743779b-83bb-4114-9603-59f90af74b9f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:37.543666 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a743779b-83bb-4114-9603-59f90af74b9f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:37.554400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a743779b-83bb-4114-9603-59f90af74b9f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:37.555704 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a743779b-83bb-4114-9603-59f90af74b9f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:37.556380 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a743779b-83bb-4114-9603-59f90af74b9f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:37.566242 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a743779b-83bb-4114-9603-59f90af74b9f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:37.567346 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a743779b-83bb-4114-9603-59f90af74b9f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:37.568376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a743779b-83bb-4114-9603-59f90af74b9f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:37.864032 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9d96779b-227e-4185-bf10-0a7e1e4e8026 tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.098263 Sep 17 21:04:37.864662 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1772/3442] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Sep 17 21:04:36 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:04:37.869920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-82a97613-2b54-40ce-96b2-5ddf05afee1f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:37.870543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-82a97613-2b54-40ce-96b2-5ddf05afee1f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:37.884524 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-82a97613-2b54-40ce-96b2-5ddf05afee1f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:37.884951 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-82a97613-2b54-40ce-96b2-5ddf05afee1f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:37.885399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-82a97613-2b54-40ce-96b2-5ddf05afee1f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:37.886155 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-82a97613-2b54-40ce-96b2-5ddf05afee1f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:37.896166 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-82a97613-2b54-40ce-96b2-5ddf05afee1f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:37.897135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-82a97613-2b54-40ce-96b2-5ddf05afee1f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:38.042011 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a743779b-83bb-4114-9603-59f90af74b9f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:38.055179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a743779b-83bb-4114-9603-59f90af74b9f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:38.061101 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a743779b-83bb-4114-9603-59f90af74b9f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:38.075417 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a743779b-83bb-4114-9603-59f90af74b9f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1478 microversion: 2.91 time: 0.547538 Sep 17 21:04:38.080213 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1671/3443] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:04:37 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1478 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:04:38.089890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8585e462-1f67-4d5c-81df-585e91914eef tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:38.090574 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8585e462-1f67-4d5c-81df-585e91914eef tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:38.112338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8585e462-1f67-4d5c-81df-585e91914eef tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:38.112883 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8585e462-1f67-4d5c-81df-585e91914eef tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:38.113343 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8585e462-1f67-4d5c-81df-585e91914eef tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:38.114454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8585e462-1f67-4d5c-81df-585e91914eef tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:38.115393 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8585e462-1f67-4d5c-81df-585e91914eef tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:38.115826 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8585e462-1f67-4d5c-81df-585e91914eef tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:39.220195 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8585e462-1f67-4d5c-81df-585e91914eef tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:39.252724 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8585e462-1f67-4d5c-81df-585e91914eef tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1513 microversion: 2.1 time: 1.170910 Sep 17 21:04:39.257222 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1672/3444] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:38 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1513 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:39.267247 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-60cc1fa6-dcbf-4abf-b48c-e84792548846 tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] Action: 'create', calling method: .version_select at 0x7f25a4c56160>, body: {"security_group_rule": {"parent_group_id": "5179e8cb-c111-4c60-986f-12279a03d337", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:39.378555 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-82a97613-2b54-40ce-96b2-5ddf05afee1f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:39.426331 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-82a97613-2b54-40ce-96b2-5ddf05afee1f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1673 microversion: 2.1 time: 1.560365 Sep 17 21:04:39.445031 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1773/3445] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:37 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1673 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:39.499322 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f36f0b1f-afb7-422b-8245-53d5f5c251b6 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "nch1-master-1"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:39.517543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f36f0b1f-afb7-422b-8245-53d5f5c251b6 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:39.546099 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f36f0b1f-afb7-422b-8245-53d5f5c251b6 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:39.547267 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f36f0b1f-afb7-422b-8245-53d5f5c251b6 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:39.548033 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f36f0b1f-afb7-422b-8245-53d5f5c251b6 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:39.549066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f36f0b1f-afb7-422b-8245-53d5f5c251b6 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:39.553795 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f36f0b1f-afb7-422b-8245-53d5f5c251b6 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:39.554664 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f36f0b1f-afb7-422b-8245-53d5f5c251b6 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:39.663473 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f36f0b1f-afb7-422b-8245-53d5f5c251b6 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "nch1-master-1". {{(pid=140524) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 17 21:04:39.820137 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f36f0b1f-afb7-422b-8245-53d5f5c251b6 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36/action" status: 202 len: 0 microversion: 2.91 time: 0.373686 Sep 17 21:04:39.821781 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1774/3446] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Sep 17 21:04:39 2022] POST /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:04:39.844654 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-abc9f92f-b17c-4ea5-b4d3-323f39457096 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:39.845712 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-abc9f92f-b17c-4ea5-b4d3-323f39457096 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:39.857881 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abc9f92f-b17c-4ea5-b4d3-323f39457096 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:39.858834 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abc9f92f-b17c-4ea5-b4d3-323f39457096 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:39.859541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abc9f92f-b17c-4ea5-b4d3-323f39457096 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:39.863976 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abc9f92f-b17c-4ea5-b4d3-323f39457096 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:39.864895 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abc9f92f-b17c-4ea5-b4d3-323f39457096 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:39.865807 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abc9f92f-b17c-4ea5-b4d3-323f39457096 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:40.250892 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-abc9f92f-b17c-4ea5-b4d3-323f39457096 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:40.269407 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-abc9f92f-b17c-4ea5-b4d3-323f39457096 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:40.275332 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-abc9f92f-b17c-4ea5-b4d3-323f39457096 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:40.305668 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-abc9f92f-b17c-4ea5-b4d3-323f39457096 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1486 microversion: 2.91 time: 0.478718 Sep 17 21:04:40.310044 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1775/3447] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:04:39 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1486 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:04:40.324304 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-20f539a2-0551-4d4f-b4f9-de5860c6ec8f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:40.325768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-20f539a2-0551-4d4f-b4f9-de5860c6ec8f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:40.334287 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-20f539a2-0551-4d4f-b4f9-de5860c6ec8f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:40.335219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-20f539a2-0551-4d4f-b4f9-de5860c6ec8f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:40.336204 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-20f539a2-0551-4d4f-b4f9-de5860c6ec8f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:40.337423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-20f539a2-0551-4d4f-b4f9-de5860c6ec8f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:40.338737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-20f539a2-0551-4d4f-b4f9-de5860c6ec8f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:40.339411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-20f539a2-0551-4d4f-b4f9-de5860c6ec8f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:41.285859 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-20f539a2-0551-4d4f-b4f9-de5860c6ec8f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:41.299486 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-20f539a2-0551-4d4f-b4f9-de5860c6ec8f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1496 microversion: 2.1 time: 0.983533 Sep 17 21:04:41.300606 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1776/3448] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:40 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1496 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:41.313846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-81cb019f-8cd0-41b7-ae21-c1948333a039 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:41.316749 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-81cb019f-8cd0-41b7-ae21-c1948333a039 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:41.337571 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-81cb019f-8cd0-41b7-ae21-c1948333a039 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:41.338190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-81cb019f-8cd0-41b7-ae21-c1948333a039 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:41.338778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-81cb019f-8cd0-41b7-ae21-c1948333a039 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:41.342093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-81cb019f-8cd0-41b7-ae21-c1948333a039 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:41.342558 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-81cb019f-8cd0-41b7-ae21-c1948333a039 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:41.342925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-81cb019f-8cd0-41b7-ae21-c1948333a039 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:41.571668 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-60cc1fa6-dcbf-4abf-b48c-e84792548846 tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 2.310796 Sep 17 21:04:41.573040 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1673/3449] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Sep 17 21:04:39 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 2315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:04:41.579067 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-83421e0c-5ce0-43f1-aa37-be2c61d5d243 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:41.579994 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-83421e0c-5ce0-43f1-aa37-be2c61d5d243 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:41.598440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-83421e0c-5ce0-43f1-aa37-be2c61d5d243 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:41.600485 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-83421e0c-5ce0-43f1-aa37-be2c61d5d243 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:41.603171 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-83421e0c-5ce0-43f1-aa37-be2c61d5d243 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:41.605541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-83421e0c-5ce0-43f1-aa37-be2c61d5d243 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:41.608350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-83421e0c-5ce0-43f1-aa37-be2c61d5d243 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:41.609085 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-83421e0c-5ce0-43f1-aa37-be2c61d5d243 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:41.644334 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-83421e0c-5ce0-43f1-aa37-be2c61d5d243 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lazy-loading 'flavor' on Instance uuid 9b986fa2-07ea-4418-adf2-0a5fa127e84a {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:04:41.680167 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-83421e0c-5ce0-43f1-aa37-be2c61d5d243 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Cannot 'suspend' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state suspended Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-83421e0c-5ce0-43f1-aa37-be2c61d5d243 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a/action HTTP/1.1 Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 15 Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: {"suspend": {}} Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: exception: Cannot 'suspend' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state suspended Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '9b986fa2-07ea-4418-adf2-0a5fa127e84a', 'body': {'suspend': {}}} Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a in vm_state suspended. Cannot suspend while the instance is in this state. Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Sep 17 21:04:41.711273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 17 21:04:41.716138 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 17 21:04:41.716138 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 17 21:04:41.716138 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state suspended Sep 17 21:04:41.716138 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:04:41.716138 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:41.716138 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:04:41.716138 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:41.716138 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:41.716138 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:41.716138 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:04:41.716138 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:04:41.716138 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state suspended Sep 17 21:04:41.716138 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:04:41.722710 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-83421e0c-5ce0-43f1-aa37-be2c61d5d243 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 409 to user: Cannot 'suspend' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state suspended {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:04:41.723849 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-83421e0c-5ce0-43f1-aa37-be2c61d5d243 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a/action" status: 409 len: 148 microversion: 2.1 time: 0.149566 Sep 17 21:04:41.731267 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1674/3450] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:04:41 2022] POST /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a/action => generated 148 bytes in 157 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 17 21:04:41.739049 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-687237e1-8ef2-4be3-a4bb-9dd9c639ece6 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:41.744542 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-687237e1-8ef2-4be3-a4bb-9dd9c639ece6 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:41.762793 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-687237e1-8ef2-4be3-a4bb-9dd9c639ece6 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:41.765556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-687237e1-8ef2-4be3-a4bb-9dd9c639ece6 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:41.766062 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-687237e1-8ef2-4be3-a4bb-9dd9c639ece6 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:41.767792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-687237e1-8ef2-4be3-a4bb-9dd9c639ece6 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:41.768308 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-687237e1-8ef2-4be3-a4bb-9dd9c639ece6 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:41.768830 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-687237e1-8ef2-4be3-a4bb-9dd9c639ece6 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:41.824011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-81cb019f-8cd0-41b7-ae21-c1948333a039 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:41.853038 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-81cb019f-8cd0-41b7-ae21-c1948333a039 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1678 microversion: 2.1 time: 0.550387 Sep 17 21:04:41.855989 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1777/3451] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:41 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1678 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:41.878554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6e95b07b-1ede-449d-ac46-65d7b77b7d82 tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] Action: 'create', calling method: .version_select at 0x7f25a42701f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-875258953", "description": "tempest-description-208587125"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:42.030162 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-687237e1-8ef2-4be3-a4bb-9dd9c639ece6 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:42.043731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-687237e1-8ef2-4be3-a4bb-9dd9c639ece6 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:42.045264 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-687237e1-8ef2-4be3-a4bb-9dd9c639ece6 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:42.069883 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-687237e1-8ef2-4be3-a4bb-9dd9c639ece6 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1486 microversion: 2.91 time: 0.337280 Sep 17 21:04:42.088422 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1675/3452] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:04:41 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1486 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:04:42.226118 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-823fa921-79a6-4fe3-84ca-6131805cc4d7 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Action: 'create', calling method: .version_select at 0x7f25a4c7c3a0>, body: {"keypair": {"name": "tempest-keypair-2050442800", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEkL5cc9wX9zs/i3Qafbhi2uKLRvFzR/yeCDZyv9U88Tz4DUIZH9t1nkDBXxFDfguXTy/mT4DZx93Xke8XirR+HWKov6IRS4wo4lk4zvO/1ubEwEK/XYIdotrzqk1uZMhQ=="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:42.284150 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-823fa921-79a6-4fe3-84ca-6131805cc4d7 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Getting quotas for project 130f997fde494ab887281d866d6aec31. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:04:42.298035 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-823fa921-79a6-4fe3-84ca-6131805cc4d7 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Getting quotas for user cd454c25ddef46d993ff15440a64a438 and project 130f997fde494ab887281d866d6aec31. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:04:42.382206 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-823fa921-79a6-4fe3-84ca-6131805cc4d7 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.291776 Sep 17 21:04:42.383195 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1676/3453] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:04:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:04:42.391384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-68fe5fd2-ed94-45c5-b32d-d18456811ffc tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:42.392436 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-68fe5fd2-ed94-45c5-b32d-d18456811ffc tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:42.403591 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68fe5fd2-ed94-45c5-b32d-d18456811ffc tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:42.404849 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68fe5fd2-ed94-45c5-b32d-d18456811ffc tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:42.406361 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68fe5fd2-ed94-45c5-b32d-d18456811ffc tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:42.424809 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68fe5fd2-ed94-45c5-b32d-d18456811ffc tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:42.426115 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68fe5fd2-ed94-45c5-b32d-d18456811ffc tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:42.427527 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68fe5fd2-ed94-45c5-b32d-d18456811ffc tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:42.533840 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-68fe5fd2-ed94-45c5-b32d-d18456811ffc tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a/action" status: 202 len: 0 microversion: 2.1 time: 0.148776 Sep 17 21:04:42.535556 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1677/3454] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:04:42 2022] POST /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:04:42.563168 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a34f62c7-3888-4de7-a947-808ba10e77c0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:42.564384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a34f62c7-3888-4de7-a947-808ba10e77c0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:42.592185 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a34f62c7-3888-4de7-a947-808ba10e77c0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:42.594163 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a34f62c7-3888-4de7-a947-808ba10e77c0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:42.594639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a34f62c7-3888-4de7-a947-808ba10e77c0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:42.595399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a34f62c7-3888-4de7-a947-808ba10e77c0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:42.596270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a34f62c7-3888-4de7-a947-808ba10e77c0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:42.606652 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6e95b07b-1ede-449d-ac46-65d7b77b7d82 tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.747893 Sep 17 21:04:42.607270 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1778/3455] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Sep 17 21:04:41 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:04:42.613036 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a34f62c7-3888-4de7-a947-808ba10e77c0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:42.620685 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7fe89deb-d32a-4e37-a6c5-87dce8a0e63d tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] Action: 'create', calling method: .version_select at 0x7f25a414ee50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-507667668", "description": "tempest-description-1636501484"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:44.018554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a34f62c7-3888-4de7-a947-808ba10e77c0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:44.034391 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a34f62c7-3888-4de7-a947-808ba10e77c0 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1502 microversion: 2.1 time: 1.482543 Sep 17 21:04:44.034995 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1678/3456] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:42 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1502 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:44.055213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ba5f002d-d13b-46ad-8c1e-d3f3160c66f9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:44.056147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ba5f002d-d13b-46ad-8c1e-d3f3160c66f9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:44.062845 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ba5f002d-d13b-46ad-8c1e-d3f3160c66f9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:44.063628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ba5f002d-d13b-46ad-8c1e-d3f3160c66f9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:44.064452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ba5f002d-d13b-46ad-8c1e-d3f3160c66f9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:44.065372 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ba5f002d-d13b-46ad-8c1e-d3f3160c66f9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:44.066027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ba5f002d-d13b-46ad-8c1e-d3f3160c66f9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:44.066663 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ba5f002d-d13b-46ad-8c1e-d3f3160c66f9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:44.715059 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7fe89deb-d32a-4e37-a6c5-87dce8a0e63d tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 2.098722 Sep 17 21:04:44.716452 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1779/3457] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Sep 17 21:04:42 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 2101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:04:45.206567 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d8beb727-8daa-44de-9507-be2f9274de35 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2007892845", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "86f7a93f-5ae4-425e-80ec-b768782122ab"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:45.316966 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ba5f002d-d13b-46ad-8c1e-d3f3160c66f9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:45.332902 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ba5f002d-d13b-46ad-8c1e-d3f3160c66f9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 1.280663 Sep 17 21:04:45.336967 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1679/3458] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:44 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:45.354346 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-88dd0159-9b74-4b67-bfd2-ac14f5439159 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:45.356369 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-88dd0159-9b74-4b67-bfd2-ac14f5439159 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:45.368873 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-d8beb727-8daa-44de-9507-be2f9274de35 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] validate_networks() for [('86f7a93f-5ae4-425e-80ec-b768782122ab', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:04:45.377282 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-88dd0159-9b74-4b67-bfd2-ac14f5439159 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:45.378187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-88dd0159-9b74-4b67-bfd2-ac14f5439159 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:45.379396 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-88dd0159-9b74-4b67-bfd2-ac14f5439159 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:45.381386 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-88dd0159-9b74-4b67-bfd2-ac14f5439159 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:45.383378 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-88dd0159-9b74-4b67-bfd2-ac14f5439159 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:45.385278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-88dd0159-9b74-4b67-bfd2-ac14f5439159 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:45.590801 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-88dd0159-9b74-4b67-bfd2-ac14f5439159 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:45.638173 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-88dd0159-9b74-4b67-bfd2-ac14f5439159 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:45.645770 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-88dd0159-9b74-4b67-bfd2-ac14f5439159 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:45.662812 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-88dd0159-9b74-4b67-bfd2-ac14f5439159 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1544 microversion: 2.91 time: 0.323890 Sep 17 21:04:45.664439 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1680/3459] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:04:45 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1544 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:04:45.670142 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fbc9bbc8-a4ea-4d8b-9ee8-56c5c2da55d4 tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] Action: 'create', calling method: .version_select at 0x7f25a4ed0430>, body: {"security_group_rule": {"parent_group_id": "355fc623-30d2-4c82-8af3-7af4a4679a1a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "a99181d1-ce72-483a-a073-3efce467ebb5"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:47.010430 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fbc9bbc8-a4ea-4d8b-9ee8-56c5c2da55d4 tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.344568 Sep 17 21:04:47.020529 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1681/3460] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Sep 17 21:04:45 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:04:47.020529 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a62fab70-f253-4064-a5c8-a15f07cc464a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:47.020773 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a62fab70-f253-4064-a5c8-a15f07cc464a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:47.054707 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a62fab70-f253-4064-a5c8-a15f07cc464a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:47.056861 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a62fab70-f253-4064-a5c8-a15f07cc464a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:47.058321 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a62fab70-f253-4064-a5c8-a15f07cc464a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:47.061370 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a62fab70-f253-4064-a5c8-a15f07cc464a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:47.069621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a62fab70-f253-4064-a5c8-a15f07cc464a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:47.075160 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a62fab70-f253-4064-a5c8-a15f07cc464a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:47.884798 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a62fab70-f253-4064-a5c8-a15f07cc464a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:47.895077 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a62fab70-f253-4064-a5c8-a15f07cc464a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1502 microversion: 2.1 time: 0.882355 Sep 17 21:04:47.895691 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1682/3461] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:47 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1502 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:47.909636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b64ec4ed-2406-430f-b4e7-6a80a7fd9dfc tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:47.912273 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b64ec4ed-2406-430f-b4e7-6a80a7fd9dfc tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:47.937582 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-d8beb727-8daa-44de-9507-be2f9274de35 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:04:47.938849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-d8beb727-8daa-44de-9507-be2f9274de35 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:04:47.939769 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-d8beb727-8daa-44de-9507-be2f9274de35 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:04:47.940564 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-d8beb727-8daa-44de-9507-be2f9274de35 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:04:47.941305 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-d8beb727-8daa-44de-9507-be2f9274de35 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:04:47.944287 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b64ec4ed-2406-430f-b4e7-6a80a7fd9dfc tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:47.947155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b64ec4ed-2406-430f-b4e7-6a80a7fd9dfc tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:47.947663 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b64ec4ed-2406-430f-b4e7-6a80a7fd9dfc tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:47.949817 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b64ec4ed-2406-430f-b4e7-6a80a7fd9dfc tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:47.952443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b64ec4ed-2406-430f-b4e7-6a80a7fd9dfc tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:47.953145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b64ec4ed-2406-430f-b4e7-6a80a7fd9dfc tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:47.986523 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d8beb727-8daa-44de-9507-be2f9274de35 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:47.987088 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d8beb727-8daa-44de-9507-be2f9274de35 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:47.992266 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d8beb727-8daa-44de-9507-be2f9274de35 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:47.997392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d8beb727-8daa-44de-9507-be2f9274de35 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:48.004977 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d8beb727-8daa-44de-9507-be2f9274de35 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:48.005888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d8beb727-8daa-44de-9507-be2f9274de35 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:48.033812 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b64ec4ed-2406-430f-b4e7-6a80a7fd9dfc tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action" status: 200 len: 322 microversion: 2.1 time: 0.136390 Sep 17 21:04:48.034889 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1683/3462] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:04:47 2022] POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action => generated 322 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:04:48.042454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ac704782-1759-43d0-85e1-72c2d667638b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:48.043645 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ac704782-1759-43d0-85e1-72c2d667638b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:48.047815 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-d8beb727-8daa-44de-9507-be2f9274de35 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Getting quotas for project 6cc3ec11e1374785afe8d3f73bc26891. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:04:48.052598 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac704782-1759-43d0-85e1-72c2d667638b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:48.053401 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac704782-1759-43d0-85e1-72c2d667638b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:48.054325 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac704782-1759-43d0-85e1-72c2d667638b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:48.054709 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-d8beb727-8daa-44de-9507-be2f9274de35 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Getting quotas for user 9e38b0461884497e8c5d399051b3d50e and project 6cc3ec11e1374785afe8d3f73bc26891. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:04:48.055761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac704782-1759-43d0-85e1-72c2d667638b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:48.057179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac704782-1759-43d0-85e1-72c2d667638b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:48.057974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac704782-1759-43d0-85e1-72c2d667638b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:48.093898 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d8beb727-8daa-44de-9507-be2f9274de35 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:04:48.107969 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d8beb727-8daa-44de-9507-be2f9274de35 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] [instance: 9b067088-a9ba-43cd-9775-8c54ba91ef6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:04:48.226967 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d8beb727-8daa-44de-9507-be2f9274de35 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.497493 Sep 17 21:04:48.228541 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1780/3463] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:04:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 3512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:04:48.243324 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1592083f-bb51-4f64-bcd1-2ebd54e3130a tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] Action: 'create', calling method: .version_select at 0x7f25a418cc10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-181352546", "description": "tempest-description-32815355"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:48.325212 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ac704782-1759-43d0-85e1-72c2d667638b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:48.342677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ac704782-1759-43d0-85e1-72c2d667638b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:48.347574 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ac704782-1759-43d0-85e1-72c2d667638b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:48.362344 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ac704782-1759-43d0-85e1-72c2d667638b tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1544 microversion: 2.91 time: 0.323011 Sep 17 21:04:48.379545 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1684/3464] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:04:48 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1544 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:04:48.401416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ef10b370-8cc9-4867-afae-4d5f4de409cb tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-2056526286", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "331c24a2-81fb-4013-91e7-3ea588c63f69"}], "security_groups": [{"name": "tempest-securitygroup--1010115680"}], "key_name": "tempest-keypair-2050442800", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:48.715849 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-ef10b370-8cc9-4867-afae-4d5f4de409cb tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] validate_networks() for [('331c24a2-81fb-4013-91e7-3ea588c63f69', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:04:49.228384 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1592083f-bb51-4f64-bcd1-2ebd54e3130a tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.989605 Sep 17 21:04:49.238580 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1781/3465] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Sep 17 21:04:48 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:04:49.244418 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3d139a00-3013-42d3-b3e3-798e1af918c9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:49.245051 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3d139a00-3013-42d3-b3e3-798e1af918c9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:49.292223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d139a00-3013-42d3-b3e3-798e1af918c9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:49.296852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d139a00-3013-42d3-b3e3-798e1af918c9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:49.297728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d139a00-3013-42d3-b3e3-798e1af918c9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:49.298773 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d139a00-3013-42d3-b3e3-798e1af918c9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:49.299549 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d139a00-3013-42d3-b3e3-798e1af918c9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:49.313184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d139a00-3013-42d3-b3e3-798e1af918c9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:49.806567 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3d139a00-3013-42d3-b3e3-798e1af918c9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:49.818208 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3d139a00-3013-42d3-b3e3-798e1af918c9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.578282 Sep 17 21:04:49.823942 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1782/3466] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:49 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:49.839743 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-69c98a28-de12-458e-9d2c-73f74204d8e8 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:49.840362 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-69c98a28-de12-458e-9d2c-73f74204d8e8 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] [instance: 9b067088-a9ba-43cd-9775-8c54ba91ef6f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:49.865816 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69c98a28-de12-458e-9d2c-73f74204d8e8 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:49.867360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69c98a28-de12-458e-9d2c-73f74204d8e8 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:49.868014 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69c98a28-de12-458e-9d2c-73f74204d8e8 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:49.872308 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69c98a28-de12-458e-9d2c-73f74204d8e8 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:49.877436 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69c98a28-de12-458e-9d2c-73f74204d8e8 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:49.878139 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69c98a28-de12-458e-9d2c-73f74204d8e8 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:50.138796 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-69c98a28-de12-458e-9d2c-73f74204d8e8 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e38b0461884497e8c5d399051b3d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc3ec11e1374785afe8d3f73bc26891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:50.150634 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-69c98a28-de12-458e-9d2c-73f74204d8e8 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] 10.222.0.26 "GET /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f" status: 200 len: 1276 microversion: 2.1 time: 0.325499 Sep 17 21:04:50.159714 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1783/3467] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:49 2022] GET /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f => generated 1276 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:50.331472 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-ef10b370-8cc9-4867-afae-4d5f4de409cb tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Getting quotas for project 130f997fde494ab887281d866d6aec31. Resources: dict_keys(['metadata_items']) {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:04:50.356108 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-ef10b370-8cc9-4867-afae-4d5f4de409cb tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Getting quotas for user cd454c25ddef46d993ff15440a64a438 and project 130f997fde494ab887281d866d6aec31. Resources: dict_keys(['metadata_items']) {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:04:50.397496 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-ef10b370-8cc9-4867-afae-4d5f4de409cb tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:04:50.397939 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-ef10b370-8cc9-4867-afae-4d5f4de409cb tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:04:50.398621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-ef10b370-8cc9-4867-afae-4d5f4de409cb tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:04:50.399070 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-ef10b370-8cc9-4867-afae-4d5f4de409cb tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:04:50.399592 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-ef10b370-8cc9-4867-afae-4d5f4de409cb tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:04:50.424025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef10b370-8cc9-4867-afae-4d5f4de409cb tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:50.424529 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef10b370-8cc9-4867-afae-4d5f4de409cb tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:50.424970 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef10b370-8cc9-4867-afae-4d5f4de409cb tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:50.429436 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef10b370-8cc9-4867-afae-4d5f4de409cb tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:50.429981 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef10b370-8cc9-4867-afae-4d5f4de409cb tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:50.430435 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef10b370-8cc9-4867-afae-4d5f4de409cb tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:50.478926 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-ef10b370-8cc9-4867-afae-4d5f4de409cb tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Getting quotas for project 130f997fde494ab887281d866d6aec31. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:04:50.494706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-ef10b370-8cc9-4867-afae-4d5f4de409cb tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Getting quotas for user cd454c25ddef46d993ff15440a64a438 and project 130f997fde494ab887281d866d6aec31. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:04:50.523906 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ef10b370-8cc9-4867-afae-4d5f4de409cb tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:04:50.526545 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ef10b370-8cc9-4867-afae-4d5f4de409cb tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] [instance: 39726f64-c35f-43a9-8ca2-6efc128162ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:04:50.633950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4e00e62f-9710-40ee-bf8e-c1c6ded69878 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-548522587", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "bb1f33c1-b8e9-4cdb-a453-b67560c12d22"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:50.636592 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ef10b370-8cc9-4867-afae-4d5f4de409cb tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.247473 Sep 17 21:04:50.649753 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1685/3468] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:04:48 2022] POST /compute/v2.1/servers => generated 409 bytes in 2261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:04:50.659275 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8103b852-014f-4344-a9d5-ca7609784846 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:50.666562 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8103b852-014f-4344-a9d5-ca7609784846 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:50.693776 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8103b852-014f-4344-a9d5-ca7609784846 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:50.696084 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8103b852-014f-4344-a9d5-ca7609784846 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:50.697404 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8103b852-014f-4344-a9d5-ca7609784846 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:50.700616 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8103b852-014f-4344-a9d5-ca7609784846 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:50.702302 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8103b852-014f-4344-a9d5-ca7609784846 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:50.703583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8103b852-014f-4344-a9d5-ca7609784846 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:50.839717 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-4e00e62f-9710-40ee-bf8e-c1c6ded69878 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] validate_networks() for [('bb1f33c1-b8e9-4cdb-a453-b67560c12d22', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:04:51.490506 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8103b852-014f-4344-a9d5-ca7609784846 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:51.502195 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8103b852-014f-4344-a9d5-ca7609784846 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.850397 Sep 17 21:04:51.504822 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1686/3469] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:50 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:51.530053 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f6c74095-06a4-45df-9f8c-4f218732bded tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] Action: 'create', calling method: .version_select at 0x7f25a47fa430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-950765373", "description": "tempest-description-681621556"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:53.019825 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-4e00e62f-9710-40ee-bf8e-c1c6ded69878 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:04:53.021390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-4e00e62f-9710-40ee-bf8e-c1c6ded69878 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:04:53.021390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-4e00e62f-9710-40ee-bf8e-c1c6ded69878 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:04:53.021677 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-4e00e62f-9710-40ee-bf8e-c1c6ded69878 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:04:53.022182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-4e00e62f-9710-40ee-bf8e-c1c6ded69878 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:04:53.092612 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e00e62f-9710-40ee-bf8e-c1c6ded69878 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:53.093100 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e00e62f-9710-40ee-bf8e-c1c6ded69878 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:53.110734 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e00e62f-9710-40ee-bf8e-c1c6ded69878 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:53.112743 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e00e62f-9710-40ee-bf8e-c1c6ded69878 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:53.113522 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e00e62f-9710-40ee-bf8e-c1c6ded69878 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:53.117681 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e00e62f-9710-40ee-bf8e-c1c6ded69878 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:53.235255 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-4e00e62f-9710-40ee-bf8e-c1c6ded69878 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Getting quotas for project 765dd4c95190458594be8f9a7915210e. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:04:53.257034 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-4e00e62f-9710-40ee-bf8e-c1c6ded69878 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Getting quotas for user e8f7671df52e4e95b829f03defeb6cf5 and project 765dd4c95190458594be8f9a7915210e. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:04:53.305316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4e00e62f-9710-40ee-bf8e-c1c6ded69878 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:04:53.307695 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4e00e62f-9710-40ee-bf8e-c1c6ded69878 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] [instance: f1b3d010-7e10-40fd-936b-f3e04bdaf3fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:04:53.431292 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4e00e62f-9710-40ee-bf8e-c1c6ded69878 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 3.253509 Sep 17 21:04:53.434047 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1784/3470] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Sep 17 21:04:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 3274 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 17 21:04:53.447017 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8504b099-e541-4a38-85fd-803662577a8d tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:53.452682 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8504b099-e541-4a38-85fd-803662577a8d tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:53.468195 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8504b099-e541-4a38-85fd-803662577a8d tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:53.471130 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8504b099-e541-4a38-85fd-803662577a8d tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:53.473235 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8504b099-e541-4a38-85fd-803662577a8d tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:53.474205 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8504b099-e541-4a38-85fd-803662577a8d tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:53.489604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8504b099-e541-4a38-85fd-803662577a8d tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:53.490447 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8504b099-e541-4a38-85fd-803662577a8d tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:53.630831 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f6c74095-06a4-45df-9f8c-4f218732bded tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 2.106450 Sep 17 21:04:53.633790 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1687/3471] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Sep 17 21:04:51 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 2111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:04:53.641407 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6174b0a5-0837-4a9b-88f3-aaaae9af38a8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:53.642846 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6174b0a5-0837-4a9b-88f3-aaaae9af38a8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:53.652547 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8504b099-e541-4a38-85fd-803662577a8d tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:53.661214 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8504b099-e541-4a38-85fd-803662577a8d tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:53.662702 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8504b099-e541-4a38-85fd-803662577a8d tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:53.684228 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6174b0a5-0837-4a9b-88f3-aaaae9af38a8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:53.685780 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6174b0a5-0837-4a9b-88f3-aaaae9af38a8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:53.687043 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8504b099-e541-4a38-85fd-803662577a8d tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1544 microversion: 2.91 time: 0.246964 Sep 17 21:04:53.694930 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6174b0a5-0837-4a9b-88f3-aaaae9af38a8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:53.696394 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6174b0a5-0837-4a9b-88f3-aaaae9af38a8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:53.697074 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1785/3472] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:04:53 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1544 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:04:53.698616 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6174b0a5-0837-4a9b-88f3-aaaae9af38a8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:53.699365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6174b0a5-0837-4a9b-88f3-aaaae9af38a8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:53.702632 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-dbb0c93d-75b0-4d20-9ddc-b1f64f83a425 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:53.711522 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-dbb0c93d-75b0-4d20-9ddc-b1f64f83a425 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] [instance: 39726f64-c35f-43a9-8ca2-6efc128162ee] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:53.732833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dbb0c93d-75b0-4d20-9ddc-b1f64f83a425 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:53.733349 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dbb0c93d-75b0-4d20-9ddc-b1f64f83a425 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:53.733821 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dbb0c93d-75b0-4d20-9ddc-b1f64f83a425 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:53.741340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dbb0c93d-75b0-4d20-9ddc-b1f64f83a425 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:53.741777 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dbb0c93d-75b0-4d20-9ddc-b1f64f83a425 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:53.742209 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dbb0c93d-75b0-4d20-9ddc-b1f64f83a425 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:54.062123 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-dbb0c93d-75b0-4d20-9ddc-b1f64f83a425 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd454c25ddef46d993ff15440a64a438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130f997fde494ab887281d866d6aec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:54.072315 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-dbb0c93d-75b0-4d20-9ddc-b1f64f83a425 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] 10.222.0.26 "GET /compute/v2.1/servers/39726f64-c35f-43a9-8ca2-6efc128162ee" status: 200 len: 1330 microversion: 2.1 time: 0.373466 Sep 17 21:04:54.072855 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1786/3473] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:53 2022] GET /compute/v2.1/servers/39726f64-c35f-43a9-8ca2-6efc128162ee => generated 1330 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:54.093186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-18fb6a2b-71f4-46c5-b3ec-1772baaf9d70 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:54.104778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-18fb6a2b-71f4-46c5-b3ec-1772baaf9d70 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] [instance: 9b067088-a9ba-43cd-9775-8c54ba91ef6f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:54.121595 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18fb6a2b-71f4-46c5-b3ec-1772baaf9d70 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:54.142534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18fb6a2b-71f4-46c5-b3ec-1772baaf9d70 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:54.143460 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18fb6a2b-71f4-46c5-b3ec-1772baaf9d70 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:54.144489 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18fb6a2b-71f4-46c5-b3ec-1772baaf9d70 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:54.145207 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18fb6a2b-71f4-46c5-b3ec-1772baaf9d70 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:54.145662 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18fb6a2b-71f4-46c5-b3ec-1772baaf9d70 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:54.150503 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:04:54.387173 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-18fb6a2b-71f4-46c5-b3ec-1772baaf9d70 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e38b0461884497e8c5d399051b3d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc3ec11e1374785afe8d3f73bc26891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:54.410548 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-18fb6a2b-71f4-46c5-b3ec-1772baaf9d70 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] 10.222.0.26 "GET /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f" status: 200 len: 1282 microversion: 2.1 time: 0.320106 Sep 17 21:04:54.413787 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1787/3474] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:54 2022] GET /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f => generated 1282 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:54.426945 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1695e061-dd53-46c9-ba2d-d732c26dde65 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:54.426945 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1695e061-dd53-46c9-ba2d-d732c26dde65 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:54.472118 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1695e061-dd53-46c9-ba2d-d732c26dde65 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:54.473751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1695e061-dd53-46c9-ba2d-d732c26dde65 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:54.477121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1695e061-dd53-46c9-ba2d-d732c26dde65 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:54.478620 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1695e061-dd53-46c9-ba2d-d732c26dde65 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:54.479331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1695e061-dd53-46c9-ba2d-d732c26dde65 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:54.480081 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1695e061-dd53-46c9-ba2d-d732c26dde65 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:54.710541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6174b0a5-0837-4a9b-88f3-aaaae9af38a8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:54.726066 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6174b0a5-0837-4a9b-88f3-aaaae9af38a8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 1.084673 Sep 17 21:04:54.743770 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1688/3475] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:53 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:54.749615 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-46d66c21-32b2-4968-b193-58e3dd5cb60d tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:54.750597 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-46d66c21-32b2-4968-b193-58e3dd5cb60d tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] [instance: f1b3d010-7e10-40fd-936b-f3e04bdaf3fe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:54.760935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46d66c21-32b2-4968-b193-58e3dd5cb60d tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:54.775934 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46d66c21-32b2-4968-b193-58e3dd5cb60d tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:54.776401 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46d66c21-32b2-4968-b193-58e3dd5cb60d tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:54.777168 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46d66c21-32b2-4968-b193-58e3dd5cb60d tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:54.777671 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46d66c21-32b2-4968-b193-58e3dd5cb60d tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:54.778100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46d66c21-32b2-4968-b193-58e3dd5cb60d tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:54.966241 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-46d66c21-32b2-4968-b193-58e3dd5cb60d tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7671df52e4e95b829f03defeb6cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765dd4c95190458594be8f9a7915210e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:54.987431 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-46d66c21-32b2-4968-b193-58e3dd5cb60d tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7671df52e4e95b829f03defeb6cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765dd4c95190458594be8f9a7915210e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:54.994763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-46d66c21-32b2-4968-b193-58e3dd5cb60d tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7671df52e4e95b829f03defeb6cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765dd4c95190458594be8f9a7915210e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:54.996119 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-46d66c21-32b2-4968-b193-58e3dd5cb60d tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] 10.222.0.26 "GET /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe" status: 200 len: 1262 microversion: 2.21 time: 0.250736 Sep 17 21:04:55.019584 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1689/3476] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:04:54 2022] GET /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe => generated 1262 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:04:55.025364 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0629cfd0-e324-43da-8930-641fc10f4065 tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] Action: 'create', calling method: .version_select at 0x7f25a4f6bdc0>, body: {"security_group_rule": {"parent_group_id": "607f544e-952c-423b-bd5d-3abffa68a3d9", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "9ec2fadf-6f02-4579-b192-7be1f381f8a9"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:55.248838 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1695e061-dd53-46c9-ba2d-d732c26dde65 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:55.261870 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1695e061-dd53-46c9-ba2d-d732c26dde65 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.845605 Sep 17 21:04:55.264595 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1788/3477] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:54 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:55.275521 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6fdbe1d1-e394-4edf-b858-2e286d6571e1 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:55.276502 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6fdbe1d1-e394-4edf-b858-2e286d6571e1 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:55.289769 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6fdbe1d1-e394-4edf-b858-2e286d6571e1 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:55.292399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6fdbe1d1-e394-4edf-b858-2e286d6571e1 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:55.293106 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6fdbe1d1-e394-4edf-b858-2e286d6571e1 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:55.297862 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6fdbe1d1-e394-4edf-b858-2e286d6571e1 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:55.298804 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6fdbe1d1-e394-4edf-b858-2e286d6571e1 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:55.299460 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6fdbe1d1-e394-4edf-b858-2e286d6571e1 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:55.434853 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6fdbe1d1-e394-4edf-b858-2e286d6571e1 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:55.446231 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6fdbe1d1-e394-4edf-b858-2e286d6571e1 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:55.448337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6fdbe1d1-e394-4edf-b858-2e286d6571e1 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:55.454291 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6fdbe1d1-e394-4edf-b858-2e286d6571e1 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1544 microversion: 2.91 time: 0.188365 Sep 17 21:04:55.455712 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1789/3478] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:04:55 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1544 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:04:55.460659 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-aaa42114-5806-402a-9c74-86c24d125ef1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:55.461698 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-aaa42114-5806-402a-9c74-86c24d125ef1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:55.467586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:04:55.469595 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aaa42114-5806-402a-9c74-86c24d125ef1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:55.470423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aaa42114-5806-402a-9c74-86c24d125ef1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:55.471419 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aaa42114-5806-402a-9c74-86c24d125ef1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:55.473158 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aaa42114-5806-402a-9c74-86c24d125ef1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:55.474182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aaa42114-5806-402a-9c74-86c24d125ef1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:55.474910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aaa42114-5806-402a-9c74-86c24d125ef1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:56.298544 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-aaa42114-5806-402a-9c74-86c24d125ef1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:56.311985 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-aaa42114-5806-402a-9c74-86c24d125ef1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.854813 Sep 17 21:04:56.313214 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1790/3479] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:55 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:56.320897 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8a12e04e-3adf-48a8-abba-94579182101a tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:56.322106 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8a12e04e-3adf-48a8-abba-94579182101a tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] [instance: 39726f64-c35f-43a9-8ca2-6efc128162ee] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:56.333331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a12e04e-3adf-48a8-abba-94579182101a tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:56.334074 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a12e04e-3adf-48a8-abba-94579182101a tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:56.334907 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a12e04e-3adf-48a8-abba-94579182101a tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:56.336164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a12e04e-3adf-48a8-abba-94579182101a tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:56.337292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a12e04e-3adf-48a8-abba-94579182101a tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:56.338042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a12e04e-3adf-48a8-abba-94579182101a tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:56.434573 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0629cfd0-e324-43da-8930-641fc10f4065 tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.413460 Sep 17 21:04:56.444932 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1690/3480] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Sep 17 21:04:55 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:04:56.451901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-640490ed-040f-4a31-be66-83cdcc6ada23 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:56.453680 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-640490ed-040f-4a31-be66-83cdcc6ada23 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 50628740-3832-4d35-ba50-ce215fcc73c6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:56.469999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8a12e04e-3adf-48a8-abba-94579182101a tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd454c25ddef46d993ff15440a64a438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130f997fde494ab887281d866d6aec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:56.475774 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-640490ed-040f-4a31-be66-83cdcc6ada23 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Instance 50628740-3832-4d35-ba50-ce215fcc73c6 could not be found. Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-640490ed-040f-4a31-be66-83cdcc6ada23 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers/50628740-3832-4d35-ba50-ce215fcc73c6/action HTTP/1.1 Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 15 Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: {"unpause": {}} Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 50628740-3832-4d35-ba50-ce215fcc73c6 could not be found. Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '50628740-3832-4d35-ba50-ce215fcc73c6', 'body': {'unpause': {}}} Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50628740-3832-4d35-ba50-ce215fcc73c6 could not be found. Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50628740-3832-4d35-ba50-ce215fcc73c6 could not be found. Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:04:56.479985 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:04:56.487496 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:04:56.487496 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:04:56.487496 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50628740-3832-4d35-ba50-ce215fcc73c6 could not be found. Sep 17 21:04:56.487496 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:04:56.487877 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8a12e04e-3adf-48a8-abba-94579182101a tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] 10.222.0.26 "GET /compute/v2.1/servers/39726f64-c35f-43a9-8ca2-6efc128162ee" status: 200 len: 1336 microversion: 2.1 time: 0.167632 Sep 17 21:04:56.498927 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1791/3481] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:56 2022] GET /compute/v2.1/servers/39726f64-c35f-43a9-8ca2-6efc128162ee => generated 1336 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:56.512495 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d67beb6c-ad85-48cc-9065-0c44e5007196 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:56.513437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d67beb6c-ad85-48cc-9065-0c44e5007196 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] [instance: 9b067088-a9ba-43cd-9775-8c54ba91ef6f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:56.525034 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d67beb6c-ad85-48cc-9065-0c44e5007196 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:56.527268 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-640490ed-040f-4a31-be66-83cdcc6ada23 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 404 to user: Instance 50628740-3832-4d35-ba50-ce215fcc73c6 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:04:56.528384 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-640490ed-040f-4a31-be66-83cdcc6ada23 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers/50628740-3832-4d35-ba50-ce215fcc73c6/action" status: 404 len: 111 microversion: 2.1 time: 0.081443 Sep 17 21:04:56.528807 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d67beb6c-ad85-48cc-9065-0c44e5007196 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:56.529036 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1691/3482] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:04:56 2022] POST /compute/v2.1/servers/50628740-3832-4d35-ba50-ce215fcc73c6/action => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:04:56.532623 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d67beb6c-ad85-48cc-9065-0c44e5007196 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:56.533912 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d67beb6c-ad85-48cc-9065-0c44e5007196 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:56.534949 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d67beb6c-ad85-48cc-9065-0c44e5007196 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:56.538698 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d67beb6c-ad85-48cc-9065-0c44e5007196 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:56.544664 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-241ad239-facb-4cde-910a-89ca4672e353 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:56.545361 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-241ad239-facb-4cde-910a-89ca4672e353 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] [instance: f1b3d010-7e10-40fd-936b-f3e04bdaf3fe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:56.563546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-241ad239-facb-4cde-910a-89ca4672e353 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:56.564354 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-241ad239-facb-4cde-910a-89ca4672e353 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:56.565149 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-241ad239-facb-4cde-910a-89ca4672e353 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:56.566176 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-241ad239-facb-4cde-910a-89ca4672e353 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:56.567027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-241ad239-facb-4cde-910a-89ca4672e353 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:56.567634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-241ad239-facb-4cde-910a-89ca4672e353 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:56.753260 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-241ad239-facb-4cde-910a-89ca4672e353 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7671df52e4e95b829f03defeb6cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765dd4c95190458594be8f9a7915210e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:56.772954 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-241ad239-facb-4cde-910a-89ca4672e353 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7671df52e4e95b829f03defeb6cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765dd4c95190458594be8f9a7915210e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:56.786553 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-241ad239-facb-4cde-910a-89ca4672e353 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7671df52e4e95b829f03defeb6cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765dd4c95190458594be8f9a7915210e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:56.790487 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-241ad239-facb-4cde-910a-89ca4672e353 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] 10.222.0.26 "GET /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe" status: 200 len: 1316 microversion: 2.21 time: 0.247689 Sep 17 21:04:56.798378 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1692/3483] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:04:56 2022] GET /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe => generated 1316 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:04:56.829576 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-55ce93d0-60d7-4a94-8617-06213756d76c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:56.832934 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-55ce93d0-60d7-4a94-8617-06213756d76c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:56.860535 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55ce93d0-60d7-4a94-8617-06213756d76c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:56.861073 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55ce93d0-60d7-4a94-8617-06213756d76c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:56.861564 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55ce93d0-60d7-4a94-8617-06213756d76c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:56.862318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55ce93d0-60d7-4a94-8617-06213756d76c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:56.862784 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55ce93d0-60d7-4a94-8617-06213756d76c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:56.863272 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55ce93d0-60d7-4a94-8617-06213756d76c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:56.952054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:04:57.181250 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d67beb6c-ad85-48cc-9065-0c44e5007196 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e38b0461884497e8c5d399051b3d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc3ec11e1374785afe8d3f73bc26891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:57.190873 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d67beb6c-ad85-48cc-9065-0c44e5007196 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] 10.222.0.26 "GET /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f" status: 200 len: 1324 microversion: 2.1 time: 0.690474 Sep 17 21:04:57.194198 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1792/3484] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:56 2022] GET /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f => generated 1324 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:57.203096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-dd69e0fe-d0f7-45ad-97e8-1840f0da60ee tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] Calling method '.version_select at 0x7f25a4128a60>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:57.442359 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-55ce93d0-60d7-4a94-8617-06213756d76c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:57.457823 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-55ce93d0-60d7-4a94-8617-06213756d76c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.656662 Sep 17 21:04:57.458780 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1693/3485] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:56 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:57.470424 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-52bd563e-7327-4a78-9aef-15636fdda6eb tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:57.471054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-52bd563e-7327-4a78-9aef-15636fdda6eb tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:57.473141 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:04:57.503050 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-52bd563e-7327-4a78-9aef-15636fdda6eb tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:57.504092 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-52bd563e-7327-4a78-9aef-15636fdda6eb tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:57.507481 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-52bd563e-7327-4a78-9aef-15636fdda6eb tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:57.509431 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-52bd563e-7327-4a78-9aef-15636fdda6eb tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:57.512302 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-52bd563e-7327-4a78-9aef-15636fdda6eb tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:57.513039 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-52bd563e-7327-4a78-9aef-15636fdda6eb tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:57.728868 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-52bd563e-7327-4a78-9aef-15636fdda6eb tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:57.741521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-52bd563e-7327-4a78-9aef-15636fdda6eb tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:57.742949 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-52bd563e-7327-4a78-9aef-15636fdda6eb tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:57.763710 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-52bd563e-7327-4a78-9aef-15636fdda6eb tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1544 microversion: 2.91 time: 0.303739 Sep 17 21:04:57.770054 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1694/3486] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:04:57 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1544 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:04:57.778554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-34505ca7-2464-46a8-8bbd-448ab7d4b6fd tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:57.779193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-34505ca7-2464-46a8-8bbd-448ab7d4b6fd tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:57.801381 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34505ca7-2464-46a8-8bbd-448ab7d4b6fd tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:57.801988 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34505ca7-2464-46a8-8bbd-448ab7d4b6fd tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:57.802444 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34505ca7-2464-46a8-8bbd-448ab7d4b6fd tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:57.803152 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34505ca7-2464-46a8-8bbd-448ab7d4b6fd tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:57.803625 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34505ca7-2464-46a8-8bbd-448ab7d4b6fd tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:57.804036 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34505ca7-2464-46a8-8bbd-448ab7d4b6fd tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:58.321293 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-34505ca7-2464-46a8-8bbd-448ab7d4b6fd tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:58.333557 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-34505ca7-2464-46a8-8bbd-448ab7d4b6fd tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.558630 Sep 17 21:04:58.338472 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1695/3487] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:57 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:58.344315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-40a9e66a-5da6-47c0-8710-49eec5df8fa2 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:58.344875 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-40a9e66a-5da6-47c0-8710-49eec5df8fa2 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] [instance: 39726f64-c35f-43a9-8ca2-6efc128162ee] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:58.384695 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-40a9e66a-5da6-47c0-8710-49eec5df8fa2 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:58.385507 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-40a9e66a-5da6-47c0-8710-49eec5df8fa2 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:58.386135 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-40a9e66a-5da6-47c0-8710-49eec5df8fa2 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:58.387199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-40a9e66a-5da6-47c0-8710-49eec5df8fa2 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:58.397161 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-40a9e66a-5da6-47c0-8710-49eec5df8fa2 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:58.398088 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-40a9e66a-5da6-47c0-8710-49eec5df8fa2 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:58.767085 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-40a9e66a-5da6-47c0-8710-49eec5df8fa2 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd454c25ddef46d993ff15440a64a438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130f997fde494ab887281d866d6aec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:58.771186 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-dd69e0fe-d0f7-45ad-97e8-1840f0da60ee tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/9ec2fadf-6f02-4579-b192-7be1f381f8a9" status: 202 len: 0 microversion: 2.1 time: 1.571888 Sep 17 21:04:58.772409 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1793/3488] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 21:04:57 2022] DELETE /compute/v2.1/os-security-groups/9ec2fadf-6f02-4579-b192-7be1f381f8a9 => generated 0 bytes in 1577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:04:58.778927 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bd96e216-55bd-4d5e-ab1d-193c878cf47e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-346042982", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "fd58f898-7287-41a8-bd5b-faf66186e8ef"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:04:58.788844 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-40a9e66a-5da6-47c0-8710-49eec5df8fa2 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] 10.222.0.26 "GET /compute/v2.1/servers/39726f64-c35f-43a9-8ca2-6efc128162ee" status: 200 len: 1404 microversion: 2.1 time: 0.447677 Sep 17 21:04:58.791281 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1696/3489] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:58 2022] GET /compute/v2.1/servers/39726f64-c35f-43a9-8ca2-6efc128162ee => generated 1404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:04:58.800276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-69ebb336-a3c9-4ea7-8fdf-d749615a3f8a tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:58.803444 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-69ebb336-a3c9-4ea7-8fdf-d749615a3f8a tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] [instance: f1b3d010-7e10-40fd-936b-f3e04bdaf3fe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:58.816263 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69ebb336-a3c9-4ea7-8fdf-d749615a3f8a tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:58.817330 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69ebb336-a3c9-4ea7-8fdf-d749615a3f8a tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:58.818821 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69ebb336-a3c9-4ea7-8fdf-d749615a3f8a tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:58.821187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69ebb336-a3c9-4ea7-8fdf-d749615a3f8a tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:58.822041 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69ebb336-a3c9-4ea7-8fdf-d749615a3f8a tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:58.822671 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69ebb336-a3c9-4ea7-8fdf-d749615a3f8a tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:58.891090 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-bd96e216-55bd-4d5e-ab1d-193c878cf47e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] validate_networks() for [('fd58f898-7287-41a8-bd5b-faf66186e8ef', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:04:59.276856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-69ebb336-a3c9-4ea7-8fdf-d749615a3f8a tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7671df52e4e95b829f03defeb6cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765dd4c95190458594be8f9a7915210e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:59.288269 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-69ebb336-a3c9-4ea7-8fdf-d749615a3f8a tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7671df52e4e95b829f03defeb6cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765dd4c95190458594be8f9a7915210e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:59.290123 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-69ebb336-a3c9-4ea7-8fdf-d749615a3f8a tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7671df52e4e95b829f03defeb6cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765dd4c95190458594be8f9a7915210e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:04:59.291565 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-69ebb336-a3c9-4ea7-8fdf-d749615a3f8a tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] 10.222.0.26 "GET /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe" status: 200 len: 1358 microversion: 2.21 time: 0.499019 Sep 17 21:04:59.302741 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1697/3490] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:04:58 2022] GET /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe => generated 1358 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:04:59.327000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5847d453-5a86-4031-95e3-264bca85c3ce tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:04:59.328488 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5847d453-5a86-4031-95e3-264bca85c3ce tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] [instance: 9b067088-a9ba-43cd-9775-8c54ba91ef6f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:04:59.336296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5847d453-5a86-4031-95e3-264bca85c3ce tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:59.337231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5847d453-5a86-4031-95e3-264bca85c3ce tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:59.337920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5847d453-5a86-4031-95e3-264bca85c3ce tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:04:59.339175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5847d453-5a86-4031-95e3-264bca85c3ce tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:04:59.339869 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5847d453-5a86-4031-95e3-264bca85c3ce tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:04:59.340533 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5847d453-5a86-4031-95e3-264bca85c3ce tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:00.105746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5847d453-5a86-4031-95e3-264bca85c3ce tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e38b0461884497e8c5d399051b3d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc3ec11e1374785afe8d3f73bc26891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:00.118236 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5847d453-5a86-4031-95e3-264bca85c3ce tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] 10.222.0.26 "GET /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f" status: 200 len: 1324 microversion: 2.1 time: 0.811308 Sep 17 21:05:00.123858 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1698/3491] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:04:59 2022] GET /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f => generated 1324 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:00.135692 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f05ecffe-81eb-4122-84a4-dc10583117c3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:00.137313 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f05ecffe-81eb-4122-84a4-dc10583117c3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:00.149769 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f05ecffe-81eb-4122-84a4-dc10583117c3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:00.155619 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f05ecffe-81eb-4122-84a4-dc10583117c3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:00.156196 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f05ecffe-81eb-4122-84a4-dc10583117c3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:00.157155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f05ecffe-81eb-4122-84a4-dc10583117c3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:00.166073 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f05ecffe-81eb-4122-84a4-dc10583117c3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:00.166701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f05ecffe-81eb-4122-84a4-dc10583117c3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:00.401686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-bd96e216-55bd-4d5e-ab1d-193c878cf47e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:05:00.402231 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-bd96e216-55bd-4d5e-ab1d-193c878cf47e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:05:00.402605 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-bd96e216-55bd-4d5e-ab1d-193c878cf47e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:05:00.403001 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-bd96e216-55bd-4d5e-ab1d-193c878cf47e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:05:00.403620 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-bd96e216-55bd-4d5e-ab1d-193c878cf47e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:05:00.412980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd96e216-55bd-4d5e-ab1d-193c878cf47e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:00.413707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd96e216-55bd-4d5e-ab1d-193c878cf47e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:00.414307 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd96e216-55bd-4d5e-ab1d-193c878cf47e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:00.415237 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd96e216-55bd-4d5e-ab1d-193c878cf47e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:00.416006 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd96e216-55bd-4d5e-ab1d-193c878cf47e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:00.416428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd96e216-55bd-4d5e-ab1d-193c878cf47e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:00.441795 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-bd96e216-55bd-4d5e-ab1d-193c878cf47e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Getting quotas for project 3e48e3c2f7f74636a75679fdf10ef33a. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:05:00.447520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-bd96e216-55bd-4d5e-ab1d-193c878cf47e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Getting quotas for user 2ef547e071fd43ec96c745c26eca119f and project 3e48e3c2f7f74636a75679fdf10ef33a. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:05:00.452463 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:00.462103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f05ecffe-81eb-4122-84a4-dc10583117c3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:00.463114 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bd96e216-55bd-4d5e-ab1d-193c878cf47e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:05:00.466451 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bd96e216-55bd-4d5e-ab1d-193c878cf47e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: d131d8e1-8f52-4d1f-8f88-46b1aef06e29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:05:00.492319 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f05ecffe-81eb-4122-84a4-dc10583117c3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.366561 Sep 17 21:05:00.506045 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1699/3492] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:00 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:00.514386 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-54f4badc-b60e-48ea-9e47-984d0ec7fa2b tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] Calling method '.version_select at 0x7f25a4ed0160>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:00.523933 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=14 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:00.532340 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bd96e216-55bd-4d5e-ab1d-193c878cf47e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.758651 Sep 17 21:05:00.534335 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1794/3493] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:04:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:05:00.540754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e70cc2b8-2f62-40d7-80ea-746186b66bf0 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:00.541656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e70cc2b8-2f62-40d7-80ea-746186b66bf0 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:00.549924 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e70cc2b8-2f62-40d7-80ea-746186b66bf0 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:00.551577 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e70cc2b8-2f62-40d7-80ea-746186b66bf0 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:00.552208 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e70cc2b8-2f62-40d7-80ea-746186b66bf0 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:00.553109 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e70cc2b8-2f62-40d7-80ea-746186b66bf0 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:00.554950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e70cc2b8-2f62-40d7-80ea-746186b66bf0 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:00.556665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e70cc2b8-2f62-40d7-80ea-746186b66bf0 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:00.681376 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e70cc2b8-2f62-40d7-80ea-746186b66bf0 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:00.694346 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e70cc2b8-2f62-40d7-80ea-746186b66bf0 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:00.700550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e70cc2b8-2f62-40d7-80ea-746186b66bf0 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:00.709094 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e70cc2b8-2f62-40d7-80ea-746186b66bf0 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1544 microversion: 2.91 time: 0.172203 Sep 17 21:05:00.709946 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1795/3494] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:05:00 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1544 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:05:00.720590 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-54f4badc-b60e-48ea-9e47-984d0ec7fa2b tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/607f544e-952c-423b-bd5d-3abffa68a3d9" status: 200 len: 245 microversion: 2.1 time: 0.217524 Sep 17 21:05:00.722798 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1700/3495] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Sep 17 21:05:00 2022] GET /compute/v2.1/os-security-groups/607f544e-952c-423b-bd5d-3abffa68a3d9 => generated 245 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:00.729445 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-aba14b2a-6238-4101-a476-d9f46777975f req-cc4fe649-8be4-43fb-a1f0-02e7c4bdc90e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b067088-a9ba-43cd-9775-8c54ba91ef6f", "tag": "63f8d9ca-5b51-4cf8-84b7-f21f7f475682"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:00.731565 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-de37b144-3082-40c9-8e4c-a535ee57893b req-d7446fa3-72fb-406a-b83c-4c5d8bc1c21e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1b3d010-7e10-40fd-936b-f3e04bdaf3fe", "tag": "bd5fbc38-e806-4c41-99e1-d49e50779778"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:00.746597 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-de37b144-3082-40c9-8e4c-a535ee57893b req-d7446fa3-72fb-406a-b83c-4c5d8bc1c21e service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:00.747360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-de37b144-3082-40c9-8e4c-a535ee57893b req-d7446fa3-72fb-406a-b83c-4c5d8bc1c21e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:00.747876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-de37b144-3082-40c9-8e4c-a535ee57893b req-d7446fa3-72fb-406a-b83c-4c5d8bc1c21e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:00.755333 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-aba14b2a-6238-4101-a476-d9f46777975f req-cc4fe649-8be4-43fb-a1f0-02e7c4bdc90e service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:00.755927 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-aba14b2a-6238-4101-a476-d9f46777975f req-cc4fe649-8be4-43fb-a1f0-02e7c4bdc90e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:00.756863 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-aba14b2a-6238-4101-a476-d9f46777975f req-cc4fe649-8be4-43fb-a1f0-02e7c4bdc90e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:00.763259 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-de37b144-3082-40c9-8e4c-a535ee57893b req-d7446fa3-72fb-406a-b83c-4c5d8bc1c21e service nova] Creating event network-changed:bd5fbc38-e806-4c41-99e1-d49e50779778 for instance f1b3d010-7e10-40fd-936b-f3e04bdaf3fe on nch2-master-1 Sep 17 21:05:00.768883 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-de37b144-3082-40c9-8e4c-a535ee57893b req-d7446fa3-72fb-406a-b83c-4c5d8bc1c21e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044276 Sep 17 21:05:00.773094 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-aba14b2a-6238-4101-a476-d9f46777975f req-cc4fe649-8be4-43fb-a1f0-02e7c4bdc90e service nova] Creating event network-changed:63f8d9ca-5b51-4cf8-84b7-f21f7f475682 for instance 9b067088-a9ba-43cd-9775-8c54ba91ef6f on nch2-master-1 Sep 17 21:05:00.773615 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1701/3496] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:00.779379 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-aba14b2a-6238-4101-a476-d9f46777975f req-cc4fe649-8be4-43fb-a1f0-02e7c4bdc90e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061400 Sep 17 21:05:00.779634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-04bb410c-29a0-4eb7-8ec0-df0f9952a870 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:00.780395 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1796/3497] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:00.780529 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-04bb410c-29a0-4eb7-8ec0-df0f9952a870 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] [instance: 39726f64-c35f-43a9-8ca2-6efc128162ee] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:00.786327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c396fe8f-fe17-453c-8eba-446e615cc986 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:00.787109 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c396fe8f-fe17-453c-8eba-446e615cc986 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] [instance: f1b3d010-7e10-40fd-936b-f3e04bdaf3fe] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:00.788449 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04bb410c-29a0-4eb7-8ec0-df0f9952a870 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:00.789001 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04bb410c-29a0-4eb7-8ec0-df0f9952a870 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:00.789666 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04bb410c-29a0-4eb7-8ec0-df0f9952a870 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:00.790542 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04bb410c-29a0-4eb7-8ec0-df0f9952a870 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:00.790659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04bb410c-29a0-4eb7-8ec0-df0f9952a870 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:00.791099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04bb410c-29a0-4eb7-8ec0-df0f9952a870 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:00.794013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c396fe8f-fe17-453c-8eba-446e615cc986 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:00.794520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c396fe8f-fe17-453c-8eba-446e615cc986 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:00.795163 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c396fe8f-fe17-453c-8eba-446e615cc986 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:00.797519 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c396fe8f-fe17-453c-8eba-446e615cc986 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:00.797993 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c396fe8f-fe17-453c-8eba-446e615cc986 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:00.798435 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c396fe8f-fe17-453c-8eba-446e615cc986 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:01.192095 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-04bb410c-29a0-4eb7-8ec0-df0f9952a870 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd454c25ddef46d993ff15440a64a438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130f997fde494ab887281d866d6aec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:01.204580 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c396fe8f-fe17-453c-8eba-446e615cc986 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7671df52e4e95b829f03defeb6cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765dd4c95190458594be8f9a7915210e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:01.212510 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-04bb410c-29a0-4eb7-8ec0-df0f9952a870 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] 10.222.0.26 "GET /compute/v2.1/servers/39726f64-c35f-43a9-8ca2-6efc128162ee" status: 200 len: 1404 microversion: 2.1 time: 0.437709 Sep 17 21:05:01.213110 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1702/3498] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:00 2022] GET /compute/v2.1/servers/39726f64-c35f-43a9-8ca2-6efc128162ee => generated 1404 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:01.218762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c396fe8f-fe17-453c-8eba-446e615cc986 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7671df52e4e95b829f03defeb6cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765dd4c95190458594be8f9a7915210e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:01.220022 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c396fe8f-fe17-453c-8eba-446e615cc986 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7671df52e4e95b829f03defeb6cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765dd4c95190458594be8f9a7915210e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:01.221167 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c396fe8f-fe17-453c-8eba-446e615cc986 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] 10.222.0.26 "GET /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe" status: 200 len: 1358 microversion: 2.21 time: 0.439488 Sep 17 21:05:01.226216 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2e3bff0b-6ed2-4a79-94e9-20a24356c820 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:01.226745 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2e3bff0b-6ed2-4a79-94e9-20a24356c820 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:01.228910 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1797/3499] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:05:00 2022] GET /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe => generated 1358 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:05:01.239242 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3bbce659-006a-4958-a035-876a6c18346d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:01.243902 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3bbce659-006a-4958-a035-876a6c18346d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: d131d8e1-8f52-4d1f-8f88-46b1aef06e29] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:01.255964 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e3bff0b-6ed2-4a79-94e9-20a24356c820 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:01.257102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e3bff0b-6ed2-4a79-94e9-20a24356c820 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:01.260597 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3bbce659-006a-4958-a035-876a6c18346d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:01.266207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e3bff0b-6ed2-4a79-94e9-20a24356c820 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:01.267214 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e3bff0b-6ed2-4a79-94e9-20a24356c820 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:01.267852 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e3bff0b-6ed2-4a79-94e9-20a24356c820 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:01.268442 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e3bff0b-6ed2-4a79-94e9-20a24356c820 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:01.273950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3bbce659-006a-4958-a035-876a6c18346d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:01.274648 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3bbce659-006a-4958-a035-876a6c18346d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:01.275549 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3bbce659-006a-4958-a035-876a6c18346d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:01.277047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3bbce659-006a-4958-a035-876a6c18346d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:01.277697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3bbce659-006a-4958-a035-876a6c18346d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:01.341781 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-2e3bff0b-6ed2-4a79-94e9-20a24356c820 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Cannot 'unpause' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state active Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2e3bff0b-6ed2-4a79-94e9-20a24356c820 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a/action HTTP/1.1 Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 15 Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: {"unpause": {}} Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: exception: Cannot 'unpause' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state active Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '9b986fa2-07ea-4418-adf2-0a5fa127e84a', 'body': {'unpause': {}}} Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a in vm_state active. Cannot unpause while the instance is in this state. Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state active Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:01.349334 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:01.353769 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:01.353769 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:05:01.353769 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:05:01.353769 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state active Sep 17 21:05:01.353769 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:01.353769 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2e3bff0b-6ed2-4a79-94e9-20a24356c820 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 409 to user: Cannot 'unpause' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state active {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:05:01.354315 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2e3bff0b-6ed2-4a79-94e9-20a24356c820 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a/action" status: 409 len: 145 microversion: 2.1 time: 0.131705 Sep 17 21:05:01.354742 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1703/3500] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:05:01 2022] POST /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a/action => generated 145 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 17 21:05:01.360455 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b22880eb-d44a-43b8-a132-44750c682d48 tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] Action: 'create', calling method: .version_select at 0x7f25a4ca6e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-841981359", "description": "tempest-description-79072431"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:01.514448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3bbce659-006a-4958-a035-876a6c18346d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:01.539544 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3bbce659-006a-4958-a035-876a6c18346d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29" status: 200 len: 1218 microversion: 2.1 time: 0.309137 Sep 17 21:05:01.540333 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1798/3501] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:01 2022] GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29 => generated 1218 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:01.548247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f8581861-48ee-43e2-9fec-1799991f656c tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:01.549162 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f8581861-48ee-43e2-9fec-1799991f656c tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] [instance: 9b067088-a9ba-43cd-9775-8c54ba91ef6f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:01.557845 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8581861-48ee-43e2-9fec-1799991f656c tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:01.558886 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8581861-48ee-43e2-9fec-1799991f656c tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:01.559586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8581861-48ee-43e2-9fec-1799991f656c tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:01.560567 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8581861-48ee-43e2-9fec-1799991f656c tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:01.561319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8581861-48ee-43e2-9fec-1799991f656c tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:01.562300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8581861-48ee-43e2-9fec-1799991f656c tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:01.881513 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f8581861-48ee-43e2-9fec-1799991f656c tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e38b0461884497e8c5d399051b3d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc3ec11e1374785afe8d3f73bc26891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:01.891472 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b22880eb-d44a-43b8-a132-44750c682d48 tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.534962 Sep 17 21:05:01.897036 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1704/3502] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Sep 17 21:05:01 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:01.897219 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f8581861-48ee-43e2-9fec-1799991f656c tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] 10.222.0.26 "GET /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f" status: 200 len: 1324 microversion: 2.1 time: 0.349200 Sep 17 21:05:01.897749 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5d07739e-fdd3-4518-b798-ffe4e707d185 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:01.899023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5d07739e-fdd3-4518-b798-ffe4e707d185 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:01.906848 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d07739e-fdd3-4518-b798-ffe4e707d185 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:01.907342 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d07739e-fdd3-4518-b798-ffe4e707d185 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:01.907989 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d07739e-fdd3-4518-b798-ffe4e707d185 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:01.908886 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d07739e-fdd3-4518-b798-ffe4e707d185 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:01.909520 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d07739e-fdd3-4518-b798-ffe4e707d185 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:01.910512 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1799/3503] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:01 2022] GET /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f => generated 1324 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:01.911054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d07739e-fdd3-4518-b798-ffe4e707d185 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:01.919058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2d1666c2-9cec-4ca2-b6f5-68957f7e8806 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:01.919679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2d1666c2-9cec-4ca2-b6f5-68957f7e8806 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:01.936184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2d1666c2-9cec-4ca2-b6f5-68957f7e8806 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:01.936686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2d1666c2-9cec-4ca2-b6f5-68957f7e8806 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:01.937125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2d1666c2-9cec-4ca2-b6f5-68957f7e8806 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:01.937883 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2d1666c2-9cec-4ca2-b6f5-68957f7e8806 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:01.938340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2d1666c2-9cec-4ca2-b6f5-68957f7e8806 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:01.938758 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2d1666c2-9cec-4ca2-b6f5-68957f7e8806 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:02.077257 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2d1666c2-9cec-4ca2-b6f5-68957f7e8806 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:02.096723 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2d1666c2-9cec-4ca2-b6f5-68957f7e8806 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:02.100072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2d1666c2-9cec-4ca2-b6f5-68957f7e8806 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:02.123861 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2d1666c2-9cec-4ca2-b6f5-68957f7e8806 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1544 microversion: 2.91 time: 0.211941 Sep 17 21:05:02.124499 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1800/3504] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:05:01 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1544 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:05:02.143480 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-83c745f1-13de-4254-92f6-9edbc0226e8c tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] Action: 'create', calling method: .version_select at 0x7f25a425b9d0>, body: {"security_group_rule": {"parent_group_id": "8c86f357-85ae-4bf9-b67f-1d96b3917c02", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:02.268948 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5d07739e-fdd3-4518-b798-ffe4e707d185 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:02.278055 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5d07739e-fdd3-4518-b798-ffe4e707d185 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.384447 Sep 17 21:05:02.278867 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1705/3505] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:01 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:02.284335 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1f88936e-ad05-4fbe-968b-425b420e73a0 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:02.285245 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1f88936e-ad05-4fbe-968b-425b420e73a0 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] [instance: 39726f64-c35f-43a9-8ca2-6efc128162ee] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:02.292404 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1f88936e-ad05-4fbe-968b-425b420e73a0 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:02.293920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1f88936e-ad05-4fbe-968b-425b420e73a0 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:02.294589 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1f88936e-ad05-4fbe-968b-425b420e73a0 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:02.296807 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1f88936e-ad05-4fbe-968b-425b420e73a0 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:02.298132 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1f88936e-ad05-4fbe-968b-425b420e73a0 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:02.299823 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1f88936e-ad05-4fbe-968b-425b420e73a0 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:02.709250 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1f88936e-ad05-4fbe-968b-425b420e73a0 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd454c25ddef46d993ff15440a64a438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130f997fde494ab887281d866d6aec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:02.744390 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1f88936e-ad05-4fbe-968b-425b420e73a0 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] 10.222.0.26 "GET /compute/v2.1/servers/39726f64-c35f-43a9-8ca2-6efc128162ee" status: 200 len: 1404 microversion: 2.1 time: 0.454172 Sep 17 21:05:02.750987 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1706/3506] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:02 2022] GET /compute/v2.1/servers/39726f64-c35f-43a9-8ca2-6efc128162ee => generated 1404 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:02.767229 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-36758b7f-31f5-46e6-babe-beabdbda339a tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:02.768167 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-36758b7f-31f5-46e6-babe-beabdbda339a tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] [instance: f1b3d010-7e10-40fd-936b-f3e04bdaf3fe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:02.785055 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36758b7f-31f5-46e6-babe-beabdbda339a tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:02.785794 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36758b7f-31f5-46e6-babe-beabdbda339a tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:02.788655 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36758b7f-31f5-46e6-babe-beabdbda339a tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:02.790536 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36758b7f-31f5-46e6-babe-beabdbda339a tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:02.791443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36758b7f-31f5-46e6-babe-beabdbda339a tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:02.793439 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36758b7f-31f5-46e6-babe-beabdbda339a tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:02.891498 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-83c745f1-13de-4254-92f6-9edbc0226e8c tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.765340 Sep 17 21:05:02.893522 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1801/3507] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Sep 17 21:05:02 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:02.900310 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b06a30df-7158-4950-bc22-13b4846965c3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:02.901430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b06a30df-7158-4950-bc22-13b4846965c3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:02.909227 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b06a30df-7158-4950-bc22-13b4846965c3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:02.910056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b06a30df-7158-4950-bc22-13b4846965c3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:02.910828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b06a30df-7158-4950-bc22-13b4846965c3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:02.911875 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b06a30df-7158-4950-bc22-13b4846965c3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:02.912539 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b06a30df-7158-4950-bc22-13b4846965c3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:02.913269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b06a30df-7158-4950-bc22-13b4846965c3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:03.126153 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-36758b7f-31f5-46e6-babe-beabdbda339a tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7671df52e4e95b829f03defeb6cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765dd4c95190458594be8f9a7915210e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:03.136098 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-36758b7f-31f5-46e6-babe-beabdbda339a tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7671df52e4e95b829f03defeb6cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765dd4c95190458594be8f9a7915210e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:03.137904 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-36758b7f-31f5-46e6-babe-beabdbda339a tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7671df52e4e95b829f03defeb6cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765dd4c95190458594be8f9a7915210e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:03.139172 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-36758b7f-31f5-46e6-babe-beabdbda339a tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] 10.222.0.26 "GET /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe" status: 200 len: 1358 microversion: 2.21 time: 0.386766 Sep 17 21:05:03.139943 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1707/3508] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:05:02 2022] GET /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe => generated 1358 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:05:03.150510 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fb8ad62d-9f86-4ded-9b3c-3edc068003c6 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:03.151519 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fb8ad62d-9f86-4ded-9b3c-3edc068003c6 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: d131d8e1-8f52-4d1f-8f88-46b1aef06e29] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:03.159177 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb8ad62d-9f86-4ded-9b3c-3edc068003c6 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:03.160091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb8ad62d-9f86-4ded-9b3c-3edc068003c6 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:03.160785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb8ad62d-9f86-4ded-9b3c-3edc068003c6 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:03.161854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb8ad62d-9f86-4ded-9b3c-3edc068003c6 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:03.162538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb8ad62d-9f86-4ded-9b3c-3edc068003c6 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:03.163127 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb8ad62d-9f86-4ded-9b3c-3edc068003c6 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:03.296564 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fb8ad62d-9f86-4ded-9b3c-3edc068003c6 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:03.311042 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fb8ad62d-9f86-4ded-9b3c-3edc068003c6 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29" status: 200 len: 1272 microversion: 2.1 time: 0.169570 Sep 17 21:05:03.313819 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b06a30df-7158-4950-bc22-13b4846965c3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:03.322450 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1708/3509] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:03 2022] GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29 => generated 1272 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:03.334927 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b06a30df-7158-4950-bc22-13b4846965c3 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.439834 Sep 17 21:05:03.335856 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1802/3510] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:02 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:03.342175 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-910da762-2a37-42ed-bb70-e8823b185d48 tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] Action: 'create', calling method: .version_select at 0x7f25a425b3a0>, body: {"security_group_rule": {"parent_group_id": "8c86f357-85ae-4bf9-b67f-1d96b3917c02", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:03.351463 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-2c3850dc-0f6d-44f7-8c1c-2de7971c64c8 req-b34c87d5-e280-4c34-914f-95b0e39e050e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39726f64-c35f-43a9-8ca2-6efc128162ee", "tag": "0a4de968-f735-40a2-90dc-6ce02c2af575"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:03.378048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2c3850dc-0f6d-44f7-8c1c-2de7971c64c8 req-b34c87d5-e280-4c34-914f-95b0e39e050e service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:03.378694 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2c3850dc-0f6d-44f7-8c1c-2de7971c64c8 req-b34c87d5-e280-4c34-914f-95b0e39e050e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:03.379442 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2c3850dc-0f6d-44f7-8c1c-2de7971c64c8 req-b34c87d5-e280-4c34-914f-95b0e39e050e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:03.404100 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-2c3850dc-0f6d-44f7-8c1c-2de7971c64c8 req-b34c87d5-e280-4c34-914f-95b0e39e050e service nova] Creating event network-changed:0a4de968-f735-40a2-90dc-6ce02c2af575 for instance 39726f64-c35f-43a9-8ca2-6efc128162ee on nch1-master-1 Sep 17 21:05:03.411828 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-2c3850dc-0f6d-44f7-8c1c-2de7971c64c8 req-b34c87d5-e280-4c34-914f-95b0e39e050e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086356 Sep 17 21:05:03.413026 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1709/3511] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:03.418837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2d29cbd6-cb86-44c4-9b46-cb770a41e100 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:03.419945 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2d29cbd6-cb86-44c4-9b46-cb770a41e100 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] [instance: 9b067088-a9ba-43cd-9775-8c54ba91ef6f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:03.427287 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d29cbd6-cb86-44c4-9b46-cb770a41e100 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:03.428209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d29cbd6-cb86-44c4-9b46-cb770a41e100 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:03.428928 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d29cbd6-cb86-44c4-9b46-cb770a41e100 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:03.430424 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d29cbd6-cb86-44c4-9b46-cb770a41e100 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:03.431174 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d29cbd6-cb86-44c4-9b46-cb770a41e100 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:03.431851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d29cbd6-cb86-44c4-9b46-cb770a41e100 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:04.023419 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2d29cbd6-cb86-44c4-9b46-cb770a41e100 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e38b0461884497e8c5d399051b3d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc3ec11e1374785afe8d3f73bc26891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:04.032457 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2d29cbd6-cb86-44c4-9b46-cb770a41e100 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] 10.222.0.26 "GET /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f" status: 200 len: 1324 microversion: 2.1 time: 0.617903 Sep 17 21:05:04.035695 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1710/3512] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:03 2022] GET /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f => generated 1324 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:04.041353 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-12678887-a4ce-4711-89c8-40a7996173bd tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:04.042178 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-12678887-a4ce-4711-89c8-40a7996173bd tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:04.049081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12678887-a4ce-4711-89c8-40a7996173bd tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:04.049816 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12678887-a4ce-4711-89c8-40a7996173bd tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:04.050456 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12678887-a4ce-4711-89c8-40a7996173bd tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:04.051417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12678887-a4ce-4711-89c8-40a7996173bd tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:04.051879 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12678887-a4ce-4711-89c8-40a7996173bd tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:04.052311 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12678887-a4ce-4711-89c8-40a7996173bd tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:04.187551 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-12678887-a4ce-4711-89c8-40a7996173bd tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:04.204651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-12678887-a4ce-4711-89c8-40a7996173bd tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:04.207632 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-12678887-a4ce-4711-89c8-40a7996173bd tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:04.213590 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-12678887-a4ce-4711-89c8-40a7996173bd tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1531 microversion: 2.91 time: 0.176614 Sep 17 21:05:04.214183 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1711/3513] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:05:04 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1531 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:05:04.244119 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e9f5f9bb-e9a5-4f68-8436-bb2c9e93cfd1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:04.244823 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e9f5f9bb-e9a5-4f68-8436-bb2c9e93cfd1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 5c18cfcc-1a49-4fac-8c2f-cd2d7c3a71af] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:04.254685 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-e9f5f9bb-e9a5-4f68-8436-bb2c9e93cfd1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Instance 5c18cfcc-1a49-4fac-8c2f-cd2d7c3a71af could not be found. Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e9f5f9bb-e9a5-4f68-8436-bb2c9e93cfd1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers/5c18cfcc-1a49-4fac-8c2f-cd2d7c3a71af/action HTTP/1.1 Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 18 Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: {"unshelve": null} Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 5c18cfcc-1a49-4fac-8c2f-cd2d7c3a71af could not be found. Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '5c18cfcc-1a49-4fac-8c2f-cd2d7c3a71af', 'body': {'unshelve': None}} Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c18cfcc-1a49-4fac-8c2f-cd2d7c3a71af could not be found. Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c18cfcc-1a49-4fac-8c2f-cd2d7c3a71af could not be found. Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:04.257740 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:04.264265 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:04.264265 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:04.264265 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:04.264265 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:05:04.264265 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:05:04.264265 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c18cfcc-1a49-4fac-8c2f-cd2d7c3a71af could not be found. Sep 17 21:05:04.264265 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:04.264265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e9f5f9bb-e9a5-4f68-8436-bb2c9e93cfd1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 404 to user: Instance 5c18cfcc-1a49-4fac-8c2f-cd2d7c3a71af could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:05:04.264265 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e9f5f9bb-e9a5-4f68-8436-bb2c9e93cfd1 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers/5c18cfcc-1a49-4fac-8c2f-cd2d7c3a71af/action" status: 404 len: 111 microversion: 2.1 time: 0.024607 Sep 17 21:05:04.264265 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1712/3514] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:05:04 2022] POST /compute/v2.1/servers/5c18cfcc-1a49-4fac-8c2f-cd2d7c3a71af/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:05:04.270559 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d24e6bd9-9a64-4050-a219-82650c7b99f2 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:04.271204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d24e6bd9-9a64-4050-a219-82650c7b99f2 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] [instance: 39726f64-c35f-43a9-8ca2-6efc128162ee] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:04.280692 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d24e6bd9-9a64-4050-a219-82650c7b99f2 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:04.281347 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d24e6bd9-9a64-4050-a219-82650c7b99f2 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:04.281976 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d24e6bd9-9a64-4050-a219-82650c7b99f2 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:04.282732 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d24e6bd9-9a64-4050-a219-82650c7b99f2 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:04.283193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d24e6bd9-9a64-4050-a219-82650c7b99f2 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:04.283626 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d24e6bd9-9a64-4050-a219-82650c7b99f2 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:04.292245 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-910da762-2a37-42ed-bb70-e8823b185d48 tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.955024 Sep 17 21:05:04.299918 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1803/3515] 10.222.0.26 () {60 vars in 1195 bytes} [Sat Sep 17 21:05:03 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:04.303712 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c58f53e9-7ea1-4daa-b112-f33733175880 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:04.304513 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c58f53e9-7ea1-4daa-b112-f33733175880 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] [instance: f1b3d010-7e10-40fd-936b-f3e04bdaf3fe] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:04.317099 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c58f53e9-7ea1-4daa-b112-f33733175880 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:04.317761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c58f53e9-7ea1-4daa-b112-f33733175880 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:04.318214 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c58f53e9-7ea1-4daa-b112-f33733175880 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:04.318934 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c58f53e9-7ea1-4daa-b112-f33733175880 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:04.319395 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c58f53e9-7ea1-4daa-b112-f33733175880 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:04.319826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c58f53e9-7ea1-4daa-b112-f33733175880 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:04.622459 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d24e6bd9-9a64-4050-a219-82650c7b99f2 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd454c25ddef46d993ff15440a64a438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130f997fde494ab887281d866d6aec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:04.629010 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c58f53e9-7ea1-4daa-b112-f33733175880 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7671df52e4e95b829f03defeb6cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765dd4c95190458594be8f9a7915210e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:04.634081 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d24e6bd9-9a64-4050-a219-82650c7b99f2 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] 10.222.0.26 "GET /compute/v2.1/servers/39726f64-c35f-43a9-8ca2-6efc128162ee" status: 200 len: 1404 microversion: 2.1 time: 0.368119 Sep 17 21:05:04.647405 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1713/3516] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:04 2022] GET /compute/v2.1/servers/39726f64-c35f-43a9-8ca2-6efc128162ee => generated 1404 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:04.659048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c58f53e9-7ea1-4daa-b112-f33733175880 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7671df52e4e95b829f03defeb6cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765dd4c95190458594be8f9a7915210e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:04.670408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7f9c8bb4-2112-4848-98c8-c851f20b43a0 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:04.671255 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7f9c8bb4-2112-4848-98c8-c851f20b43a0 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:04.672468 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c58f53e9-7ea1-4daa-b112-f33733175880 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7671df52e4e95b829f03defeb6cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765dd4c95190458594be8f9a7915210e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:04.673766 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c58f53e9-7ea1-4daa-b112-f33733175880 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] 10.222.0.26 "GET /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe" status: 200 len: 1358 microversion: 2.21 time: 0.379037 Sep 17 21:05:04.674763 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1804/3517] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:05:04 2022] GET /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe => generated 1358 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:05:04.680872 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e2fdb21c-f1a1-4d2d-b1f7-f6b22ca15048 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:04.681269 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7f9c8bb4-2112-4848-98c8-c851f20b43a0 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:04.681499 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e2fdb21c-f1a1-4d2d-b1f7-f6b22ca15048 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:04.682135 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7f9c8bb4-2112-4848-98c8-c851f20b43a0 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:04.683289 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7f9c8bb4-2112-4848-98c8-c851f20b43a0 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:04.684171 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7f9c8bb4-2112-4848-98c8-c851f20b43a0 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:04.684779 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7f9c8bb4-2112-4848-98c8-c851f20b43a0 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:04.685364 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7f9c8bb4-2112-4848-98c8-c851f20b43a0 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:04.700307 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2fdb21c-f1a1-4d2d-b1f7-f6b22ca15048 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:04.700954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2fdb21c-f1a1-4d2d-b1f7-f6b22ca15048 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:04.704011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2fdb21c-f1a1-4d2d-b1f7-f6b22ca15048 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:04.704866 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2fdb21c-f1a1-4d2d-b1f7-f6b22ca15048 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:04.708809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2fdb21c-f1a1-4d2d-b1f7-f6b22ca15048 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:04.709508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2fdb21c-f1a1-4d2d-b1f7-f6b22ca15048 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:04.771473 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:04.776458 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-7f9c8bb4-2112-4848-98c8-c851f20b43a0 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] Lazy-loading 'services' on Instance uuid 5b354b73-703b-4577-b7e5-f137385b9c36 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:05:04.802634 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7f9c8bb4-2112-4848-98c8-c851f20b43a0 tempest-UnshelveToHostMultiNodesTest-1058044477 tempest-UnshelveToHostMultiNodesTest-1058044477-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1936 microversion: 2.91 time: 0.153668 Sep 17 21:05:04.803841 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1714/3518] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:05:04 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1936 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:05:04.808996 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-02dc541d-3a3b-4894-afaf-977b689fac86 tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] Calling method '.version_select at 0x7f25a48d51f0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:04.946514 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-02dc541d-3a3b-4894-afaf-977b689fac86 tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/8c86f357-85ae-4bf9-b67f-1d96b3917c02" status: 200 len: 662 microversion: 2.1 time: 0.140245 Sep 17 21:05:04.948837 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1715/3519] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Sep 17 21:05:04 2022] GET /compute/v2.1/os-security-groups/8c86f357-85ae-4bf9-b67f-1d96b3917c02 => generated 662 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:04.969339 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bd242bed-9ed6-4d6b-beb4-d8d874badb23 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:04.971267 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bd242bed-9ed6-4d6b-beb4-d8d874badb23 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: d131d8e1-8f52-4d1f-8f88-46b1aef06e29] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:04.978839 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd242bed-9ed6-4d6b-beb4-d8d874badb23 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:04.979826 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd242bed-9ed6-4d6b-beb4-d8d874badb23 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:04.981359 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd242bed-9ed6-4d6b-beb4-d8d874badb23 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:04.982314 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd242bed-9ed6-4d6b-beb4-d8d874badb23 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:04.983001 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd242bed-9ed6-4d6b-beb4-d8d874badb23 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:04.983589 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd242bed-9ed6-4d6b-beb4-d8d874badb23 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:04.986590 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e2fdb21c-f1a1-4d2d-b1f7-f6b22ca15048 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:05.001868 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e2fdb21c-f1a1-4d2d-b1f7-f6b22ca15048 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.324252 Sep 17 21:05:05.002691 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1805/3520] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:04 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:05.010992 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-707a3ee7-8292-40d2-bba6-5b9fb195a73d req-09f239a6-a94c-479f-8322-faa64dfcf47c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d131d8e1-8f52-4d1f-8f88-46b1aef06e29", "tag": "e767046e-5d7a-4304-ad5e-62e075501024"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:05.025226 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-707a3ee7-8292-40d2-bba6-5b9fb195a73d req-09f239a6-a94c-479f-8322-faa64dfcf47c service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:05.025755 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-707a3ee7-8292-40d2-bba6-5b9fb195a73d req-09f239a6-a94c-479f-8322-faa64dfcf47c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:05.026308 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-707a3ee7-8292-40d2-bba6-5b9fb195a73d req-09f239a6-a94c-479f-8322-faa64dfcf47c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:05.060551 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-707a3ee7-8292-40d2-bba6-5b9fb195a73d req-09f239a6-a94c-479f-8322-faa64dfcf47c service nova] Creating event network-changed:e767046e-5d7a-4304-ad5e-62e075501024 for instance d131d8e1-8f52-4d1f-8f88-46b1aef06e29 on nch1-master-1 Sep 17 21:05:05.068224 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-707a3ee7-8292-40d2-bba6-5b9fb195a73d req-09f239a6-a94c-479f-8322-faa64dfcf47c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063775 Sep 17 21:05:05.069429 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1806/3521] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:05.076774 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a23a0025-001b-481f-9294-f2697e25e0b3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:05.077640 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a23a0025-001b-481f-9294-f2697e25e0b3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:05.086829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a23a0025-001b-481f-9294-f2697e25e0b3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:05.087560 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a23a0025-001b-481f-9294-f2697e25e0b3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:05.088245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a23a0025-001b-481f-9294-f2697e25e0b3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:05.089126 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a23a0025-001b-481f-9294-f2697e25e0b3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:05.089829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a23a0025-001b-481f-9294-f2697e25e0b3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:05.090430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a23a0025-001b-481f-9294-f2697e25e0b3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:05.125874 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a23a0025-001b-481f-9294-f2697e25e0b3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:05:05.167539 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bd242bed-9ed6-4d6b-beb4-d8d874badb23 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:05.168358 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:05.176779 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bd242bed-9ed6-4d6b-beb4-d8d874badb23 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29" status: 200 len: 1314 microversion: 2.1 time: 0.213123 Sep 17 21:05:05.193594 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1716/3522] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:04 2022] GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:05.198670 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b160c53a-2f6d-4e5e-be0e-e0e4f71086b0 tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] Calling method '.version_select at 0x7f25a5c15af0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:05.258270 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a23a0025-001b-481f-9294-f2697e25e0b3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 204 len: 0 microversion: 2.91 time: 0.186798 Sep 17 21:05:05.262069 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1807/3523] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 17 21:05:05 2022] DELETE /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 21:05:05.271244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8a62241f-9e94-4c82-9af9-c5f691106c07 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:05.271244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8a62241f-9e94-4c82-9af9-c5f691106c07 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:05.277316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a62241f-9e94-4c82-9af9-c5f691106c07 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:05.278156 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a62241f-9e94-4c82-9af9-c5f691106c07 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:05.278859 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a62241f-9e94-4c82-9af9-c5f691106c07 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:05.279846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a62241f-9e94-4c82-9af9-c5f691106c07 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:05.280578 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a62241f-9e94-4c82-9af9-c5f691106c07 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:05.281228 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a62241f-9e94-4c82-9af9-c5f691106c07 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:05.507737 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b160c53a-2f6d-4e5e-be0e-e0e4f71086b0 tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-group-rules/99013e1f-959c-427c-a6a9-25202225b7db" status: 202 len: 0 microversion: 2.1 time: 0.312721 Sep 17 21:05:05.508624 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1717/3524] 10.222.0.26 () {58 vars in 1287 bytes} [Sat Sep 17 21:05:05 2022] DELETE /compute/v2.1/os-security-group-rules/99013e1f-959c-427c-a6a9-25202225b7db => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:05:05.515736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-70022efb-42a7-4e5e-8fda-53ebb76e474f tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:05.517627 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-70022efb-42a7-4e5e-8fda-53ebb76e474f tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] [instance: 9b067088-a9ba-43cd-9775-8c54ba91ef6f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:05.526243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-70022efb-42a7-4e5e-8fda-53ebb76e474f tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:05.528405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-70022efb-42a7-4e5e-8fda-53ebb76e474f tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:05.529348 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-70022efb-42a7-4e5e-8fda-53ebb76e474f tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:05.530386 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-70022efb-42a7-4e5e-8fda-53ebb76e474f tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:05.531079 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-70022efb-42a7-4e5e-8fda-53ebb76e474f tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:05.531772 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-70022efb-42a7-4e5e-8fda-53ebb76e474f tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:05.539099 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8a62241f-9e94-4c82-9af9-c5f691106c07 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:05.550506 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8a62241f-9e94-4c82-9af9-c5f691106c07 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.289645 Sep 17 21:05:05.552796 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1808/3525] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:05 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:05.560435 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c78229a2-b16e-468c-a33a-b07f79f8ad92 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:05.566337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c78229a2-b16e-468c-a33a-b07f79f8ad92 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:05.575269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c78229a2-b16e-468c-a33a-b07f79f8ad92 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:05.576343 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c78229a2-b16e-468c-a33a-b07f79f8ad92 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:05.576999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c78229a2-b16e-468c-a33a-b07f79f8ad92 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:05.578010 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c78229a2-b16e-468c-a33a-b07f79f8ad92 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:05.578637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c78229a2-b16e-468c-a33a-b07f79f8ad92 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:05.579228 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c78229a2-b16e-468c-a33a-b07f79f8ad92 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:05.678976 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c78229a2-b16e-468c-a33a-b07f79f8ad92 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:05.688313 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c78229a2-b16e-468c-a33a-b07f79f8ad92 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:05.689790 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c78229a2-b16e-468c-a33a-b07f79f8ad92 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:05.702069 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c78229a2-b16e-468c-a33a-b07f79f8ad92 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1537 microversion: 2.91 time: 0.147506 Sep 17 21:05:05.702673 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1809/3526] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:05:05 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1537 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:05:05.707928 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-c551bf25-1527-461c-8904-be89b6d0f391 req-b9e2e3dd-20a0-4695-bca0-35e97d97fecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1b3d010-7e10-40fd-936b-f3e04bdaf3fe", "name": "network-vif-plugged", "status": "completed", "tag": "bd5fbc38-e806-4c41-99e1-d49e50779778"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:05.725377 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c551bf25-1527-461c-8904-be89b6d0f391 req-b9e2e3dd-20a0-4695-bca0-35e97d97fecd service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:05.726261 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c551bf25-1527-461c-8904-be89b6d0f391 req-b9e2e3dd-20a0-4695-bca0-35e97d97fecd service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:05.726704 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c551bf25-1527-461c-8904-be89b6d0f391 req-b9e2e3dd-20a0-4695-bca0-35e97d97fecd service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:05.742034 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-c551bf25-1527-461c-8904-be89b6d0f391 req-b9e2e3dd-20a0-4695-bca0-35e97d97fecd service nova] Creating event network-vif-plugged:bd5fbc38-e806-4c41-99e1-d49e50779778 for instance f1b3d010-7e10-40fd-936b-f3e04bdaf3fe on nch2-master-1 Sep 17 21:05:05.747175 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-c551bf25-1527-461c-8904-be89b6d0f391 req-b9e2e3dd-20a0-4695-bca0-35e97d97fecd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043001 Sep 17 21:05:05.748025 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1810/3527] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:05.753491 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8a0acd07-d423-4db4-9d6c-fde3a518038e tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] Calling method '.version_select at 0x7f25a414e430>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:05.799510 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-70022efb-42a7-4e5e-8fda-53ebb76e474f tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e38b0461884497e8c5d399051b3d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc3ec11e1374785afe8d3f73bc26891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:05.809989 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-70022efb-42a7-4e5e-8fda-53ebb76e474f tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] 10.222.0.26 "GET /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f" status: 200 len: 1324 microversion: 2.1 time: 0.300044 Sep 17 21:05:05.811760 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1718/3528] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:05 2022] GET /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f => generated 1324 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:05.818209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-35bbc661-cf10-4e40-8c3a-7a5df7ffb0f7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:05.819186 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-35bbc661-cf10-4e40-8c3a-7a5df7ffb0f7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:05.826773 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35bbc661-cf10-4e40-8c3a-7a5df7ffb0f7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:05.828036 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35bbc661-cf10-4e40-8c3a-7a5df7ffb0f7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:05.828746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35bbc661-cf10-4e40-8c3a-7a5df7ffb0f7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:05.829787 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35bbc661-cf10-4e40-8c3a-7a5df7ffb0f7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:05.830532 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35bbc661-cf10-4e40-8c3a-7a5df7ffb0f7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:05.831189 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35bbc661-cf10-4e40-8c3a-7a5df7ffb0f7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:05.858622 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-35bbc661-cf10-4e40-8c3a-7a5df7ffb0f7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Cannot 'unshelve' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state active Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-35bbc661-cf10-4e40-8c3a-7a5df7ffb0f7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a/action HTTP/1.1 Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 18 Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: {"unshelve": null} Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: exception: Cannot 'unshelve' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state active Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '9b986fa2-07ea-4418-adf2-0a5fa127e84a', 'body': {'unshelve': None}} Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a in vm_state active. Cannot unshelve while the instance is in this state. Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 17 21:05:05.860502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 17 21:05:05.865709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state active Sep 17 21:05:05.865709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:05.865709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:05.865709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:05.865709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:05.865709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:05.865709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:05.865709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:05:05.865709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:05:05.865709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state active Sep 17 21:05:05.865709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:05.865709 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-35bbc661-cf10-4e40-8c3a-7a5df7ffb0f7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 409 to user: Cannot 'unshelve' instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a while it is in vm_state active {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:05:05.865709 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-35bbc661-cf10-4e40-8c3a-7a5df7ffb0f7 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "POST /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a/action" status: 409 len: 146 microversion: 2.1 time: 0.049017 Sep 17 21:05:05.865709 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1719/3529] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:05:05 2022] POST /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a/action => generated 146 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 17 21:05:05.867281 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-316b5274-b2e7-4846-a96c-6c61d6d36e06 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:05.868181 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-316b5274-b2e7-4846-a96c-6c61d6d36e06 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] [instance: 39726f64-c35f-43a9-8ca2-6efc128162ee] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:05.876517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-316b5274-b2e7-4846-a96c-6c61d6d36e06 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:05.877411 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-316b5274-b2e7-4846-a96c-6c61d6d36e06 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:05.878285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-316b5274-b2e7-4846-a96c-6c61d6d36e06 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:05.879090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-316b5274-b2e7-4846-a96c-6c61d6d36e06 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:05.879556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-316b5274-b2e7-4846-a96c-6c61d6d36e06 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:05.879990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-316b5274-b2e7-4846-a96c-6c61d6d36e06 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:06.174214 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-316b5274-b2e7-4846-a96c-6c61d6d36e06 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd454c25ddef46d993ff15440a64a438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130f997fde494ab887281d866d6aec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:06.183582 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-316b5274-b2e7-4846-a96c-6c61d6d36e06 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] 10.222.0.26 "GET /compute/v2.1/servers/39726f64-c35f-43a9-8ca2-6efc128162ee" status: 200 len: 1404 microversion: 2.1 time: 0.319820 Sep 17 21:05:06.184348 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1720/3530] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:05 2022] GET /compute/v2.1/servers/39726f64-c35f-43a9-8ca2-6efc128162ee => generated 1404 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:06.194386 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fa82cf6c-557b-47e8-b858-eaaefce0c3ac tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:06.195283 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fa82cf6c-557b-47e8-b858-eaaefce0c3ac tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] [instance: f1b3d010-7e10-40fd-936b-f3e04bdaf3fe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:06.202940 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fa82cf6c-557b-47e8-b858-eaaefce0c3ac tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:06.203689 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fa82cf6c-557b-47e8-b858-eaaefce0c3ac tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:06.204244 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fa82cf6c-557b-47e8-b858-eaaefce0c3ac tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:06.205698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fa82cf6c-557b-47e8-b858-eaaefce0c3ac tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:06.206434 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fa82cf6c-557b-47e8-b858-eaaefce0c3ac tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:06.207384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fa82cf6c-557b-47e8-b858-eaaefce0c3ac tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:06.225770 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8a0acd07-d423-4db4-9d6c-fde3a518038e tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/8c86f357-85ae-4bf9-b67f-1d96b3917c02" status: 202 len: 0 microversion: 2.1 time: 0.476227 Sep 17 21:05:06.226449 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1811/3531] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 21:05:05 2022] DELETE /compute/v2.1/os-security-groups/8c86f357-85ae-4bf9-b67f-1d96b3917c02 => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:05:06.233263 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-89ba9755-0ded-4596-ada0-f4e352360787 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:06.234644 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-89ba9755-0ded-4596-ada0-f4e352360787 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:06.244077 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-89ba9755-0ded-4596-ada0-f4e352360787 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:06.244879 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-89ba9755-0ded-4596-ada0-f4e352360787 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:06.245778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-89ba9755-0ded-4596-ada0-f4e352360787 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:06.247322 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-89ba9755-0ded-4596-ada0-f4e352360787 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:06.247980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-89ba9755-0ded-4596-ada0-f4e352360787 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:06.248603 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-89ba9755-0ded-4596-ada0-f4e352360787 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:06.484320 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-89ba9755-0ded-4596-ada0-f4e352360787 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:06.490500 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fa82cf6c-557b-47e8-b858-eaaefce0c3ac tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7671df52e4e95b829f03defeb6cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765dd4c95190458594be8f9a7915210e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:06.494421 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-89ba9755-0ded-4596-ada0-f4e352360787 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.266587 Sep 17 21:05:06.496516 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1812/3532] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:06 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:06.502362 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-031d20e3-be20-462a-942d-05a532653da3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:06.502599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fa82cf6c-557b-47e8-b858-eaaefce0c3ac tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7671df52e4e95b829f03defeb6cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765dd4c95190458594be8f9a7915210e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:06.503353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-031d20e3-be20-462a-942d-05a532653da3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: d131d8e1-8f52-4d1f-8f88-46b1aef06e29] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:06.504492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fa82cf6c-557b-47e8-b858-eaaefce0c3ac tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7671df52e4e95b829f03defeb6cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765dd4c95190458594be8f9a7915210e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:06.505785 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fa82cf6c-557b-47e8-b858-eaaefce0c3ac tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] 10.222.0.26 "GET /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe" status: 200 len: 1358 microversion: 2.21 time: 0.320019 Sep 17 21:05:06.512938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-031d20e3-be20-462a-942d-05a532653da3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:06.513800 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-031d20e3-be20-462a-942d-05a532653da3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:06.514465 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-031d20e3-be20-462a-942d-05a532653da3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:06.515408 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-031d20e3-be20-462a-942d-05a532653da3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:06.516229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-031d20e3-be20-462a-942d-05a532653da3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:06.517025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-031d20e3-be20-462a-942d-05a532653da3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:06.536458 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1721/3533] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:05:06 2022] GET /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe => generated 1358 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:05:06.545793 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1204f7ab-7753-4690-ad89-9ab588d53adf tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] Calling method '.version_select at 0x7f25a4c7cdc0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:06.581354 ncdv-master-1 devstack@n-api.service[140523]: DEBUG neutronclient.v2_0.client [None req-1204f7ab-7753-4690-ad89-9ab588d53adf tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9ec2fadf-6f02-4579-b192-7be1f381f8a9 does not exist", "detail": ""}} {{(pid=140523) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 17 21:05:06.584257 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.security_group_api [None req-1204f7ab-7753-4690-ad89-9ab588d53adf tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] Neutron security group 9ec2fadf-6f02-4579-b192-7be1f381f8a9 not found {{(pid=140523) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 17 21:05:06.584817 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-1204f7ab-7753-4690-ad89-9ab588d53adf tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] HTTP exception thrown: Security group 9ec2fadf-6f02-4579-b192-7be1f381f8a9 does not exist Sep 17 21:05:06.584817 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-aca74459-4c6d-404a-9d49-bbb81ad0a578'] Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1204f7ab-7753-4690-ad89-9ab588d53adf tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] Request method failure captured: Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/os-security-groups/9ec2fadf-6f02-4579-b192-7be1f381f8a9 HTTP/1.1 Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjZhwlo8Xy8uMhdX0YHP6v5dEy-GFlWN9eeBEtcGKytsMwlyvm9HhRo6juQQKFuLVL8YKxAyx5mZbOQXbd0S7uks_bYk18i9CIJMsoAVtWqT-ZV8ichTHUqxEggF3XCd32FE8q9ouSq9FlqDfnmT5U0Y6abEsiRuUku7ZfVMsn3nfXo Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: a1f37517f6b44de988179cf62fd527a9 Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1789410539 Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a1f37517f6b44de988179cf62fd527a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a1f37517f6b44de988179cf62fd527a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a1f37517f6b44de988179cf62fd527a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a1f37517f6b44de988179cf62fd527a9", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1789410539 Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: a1f37517f6b44de988179cf62fd527a9 Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1789410539 Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-SecurityGroupRulesTestJSON-1789410539-project Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 456546fdd6cc4081ac3eff91382b717f Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1789410539-project Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: exception: Security group 9ec2fadf-6f02-4579-b192-7be1f381f8a9 does not exist Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-aca74459-4c6d-404a-9d49-bbb81ad0a578'] Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '9ec2fadf-6f02-4579-b192-7be1f381f8a9'} Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 17 21:05:06.587314 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9ec2fadf-6f02-4579-b192-7be1f381f8a9 does not exist Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aca74459-4c6d-404a-9d49-bbb81ad0a578'] Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9ec2fadf-6f02-4579-b192-7be1f381f8a9 does not exist Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aca74459-4c6d-404a-9d49-bbb81ad0a578'] Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9ec2fadf-6f02-4579-b192-7be1f381f8a9 does not exist Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aca74459-4c6d-404a-9d49-bbb81ad0a578'] Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9ec2fadf-6f02-4579-b192-7be1f381f8a9 does not exist Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aca74459-4c6d-404a-9d49-bbb81ad0a578'] Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1204f7ab-7753-4690-ad89-9ab588d53adf tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] Returning 404 to user: Security group 9ec2fadf-6f02-4579-b192-7be1f381f8a9 does not exist Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-aca74459-4c6d-404a-9d49-bbb81ad0a578'] {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:05:06.591633 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1204f7ab-7753-4690-ad89-9ab588d53adf tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/9ec2fadf-6f02-4579-b192-7be1f381f8a9" status: 404 len: 194 microversion: 2.1 time: 0.050783 Sep 17 21:05:06.595667 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1722/3534] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 21:05:06 2022] DELETE /compute/v2.1/os-security-groups/9ec2fadf-6f02-4579-b192-7be1f381f8a9 => generated 194 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:05:06.602638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-47efbedd-b451-4f4f-b652-7908aa6e6ae8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:06.603425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-47efbedd-b451-4f4f-b652-7908aa6e6ae8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:06.613304 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47efbedd-b451-4f4f-b652-7908aa6e6ae8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:06.614285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47efbedd-b451-4f4f-b652-7908aa6e6ae8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:06.614837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47efbedd-b451-4f4f-b652-7908aa6e6ae8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:06.615627 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47efbedd-b451-4f4f-b652-7908aa6e6ae8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:06.616293 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47efbedd-b451-4f4f-b652-7908aa6e6ae8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:06.616970 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47efbedd-b451-4f4f-b652-7908aa6e6ae8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:06.796167 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-031d20e3-be20-462a-942d-05a532653da3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:06.805666 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-031d20e3-be20-462a-942d-05a532653da3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29" status: 200 len: 1314 microversion: 2.1 time: 0.307290 Sep 17 21:05:06.810062 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1813/3535] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:06 2022] GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:06.823081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-47efbedd-b451-4f4f-b652-7908aa6e6ae8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:06.832733 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-09ae204b-9a9f-4526-acfb-45060b849594 tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] Calling method '.version_select at 0x7f25a4265040>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:06.836505 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-47efbedd-b451-4f4f-b652-7908aa6e6ae8 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.242003 Sep 17 21:05:06.837396 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1723/3536] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:06 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:06.861348 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ab600498-d414-4282-9110-02768b6e9e4f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:06.862318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ab600498-d414-4282-9110-02768b6e9e4f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:06.869395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab600498-d414-4282-9110-02768b6e9e4f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:06.870054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab600498-d414-4282-9110-02768b6e9e4f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:06.870531 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab600498-d414-4282-9110-02768b6e9e4f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:06.871530 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab600498-d414-4282-9110-02768b6e9e4f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:06.872044 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab600498-d414-4282-9110-02768b6e9e4f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:06.872472 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab600498-d414-4282-9110-02768b6e9e4f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:06.976494 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ab600498-d414-4282-9110-02768b6e9e4f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:06.989264 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ab600498-d414-4282-9110-02768b6e9e4f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:06.991181 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ab600498-d414-4282-9110-02768b6e9e4f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:06.999599 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ab600498-d414-4282-9110-02768b6e9e4f tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1537 microversion: 2.91 time: 0.149343 Sep 17 21:05:07.000401 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1724/3537] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:05:06 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1537 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:05:07.008206 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2f4106e3-0421-4ea1-b997-749f8792da66 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:07.009685 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2f4106e3-0421-4ea1-b997-749f8792da66 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] [instance: 9b067088-a9ba-43cd-9775-8c54ba91ef6f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:07.018171 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f4106e3-0421-4ea1-b997-749f8792da66 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:07.019440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f4106e3-0421-4ea1-b997-749f8792da66 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:07.020588 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f4106e3-0421-4ea1-b997-749f8792da66 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:07.021429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f4106e3-0421-4ea1-b997-749f8792da66 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:07.022977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f4106e3-0421-4ea1-b997-749f8792da66 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:07.022977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f4106e3-0421-4ea1-b997-749f8792da66 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:07.138469 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-09ae204b-9a9f-4526-acfb-45060b849594 tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/607f544e-952c-423b-bd5d-3abffa68a3d9" status: 202 len: 0 microversion: 2.1 time: 0.315060 Sep 17 21:05:07.142427 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1814/3538] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 21:05:06 2022] DELETE /compute/v2.1/os-security-groups/607f544e-952c-423b-bd5d-3abffa68a3d9 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:05:07.149494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-eb48db34-23e4-4d2c-b510-4b074d20186a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1640214136_updated"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:07.152715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-eb48db34-23e4-4d2c-b510-4b074d20186a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9615f246-f052-493e-88a7-0c3d7e1df8d6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:07.159699 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-eb48db34-23e4-4d2c-b510-4b074d20186a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Instance 9615f246-f052-493e-88a7-0c3d7e1df8d6 could not be found. Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-eb48db34-23e4-4d2c-b510-4b074d20186a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: request: PUT /compute/v2.1/servers/9615f246-f052-493e-88a7-0c3d7e1df8d6 HTTP/1.1 Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 81 Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1640214136_updated"}} Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 9615f246-f052-493e-88a7-0c3d7e1df8d6 could not be found. Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '9615f246-f052-493e-88a7-0c3d7e1df8d6', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1640214136_updated'}}} Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9615f246-f052-493e-88a7-0c3d7e1df8d6 could not be found. Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 17 21:05:07.161942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:05:07.168128 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:05:07.168128 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:05:07.168128 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:05:07.168128 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9615f246-f052-493e-88a7-0c3d7e1df8d6 could not be found. Sep 17 21:05:07.168128 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:07.168128 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:07.168128 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:07.168128 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:07.168128 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:07.168128 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:07.168128 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:05:07.168128 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:05:07.168128 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9615f246-f052-493e-88a7-0c3d7e1df8d6 could not be found. Sep 17 21:05:07.168128 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:07.170505 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-eb48db34-23e4-4d2c-b510-4b074d20186a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 404 to user: Instance 9615f246-f052-493e-88a7-0c3d7e1df8d6 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:05:07.171705 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-eb48db34-23e4-4d2c-b510-4b074d20186a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "PUT /compute/v2.1/servers/9615f246-f052-493e-88a7-0c3d7e1df8d6" status: 404 len: 111 microversion: 2.1 time: 0.028102 Sep 17 21:05:07.172846 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1815/3539] 10.222.0.26 () {60 vars in 1256 bytes} [Sat Sep 17 21:05:07 2022] PUT /compute/v2.1/servers/9615f246-f052-493e-88a7-0c3d7e1df8d6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:05:07.179495 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7f6712b3-578e-4265-988f-5309fcfcb67a tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] Calling method '.version_select at 0x7f25a414e040>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:07.268316 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2f4106e3-0421-4ea1-b997-749f8792da66 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e38b0461884497e8c5d399051b3d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc3ec11e1374785afe8d3f73bc26891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:07.282274 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2f4106e3-0421-4ea1-b997-749f8792da66 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] 10.222.0.26 "GET /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f" status: 200 len: 1324 microversion: 2.1 time: 0.280698 Sep 17 21:05:07.283418 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1725/3540] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:07 2022] GET /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f => generated 1324 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:07.289252 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-954568c9-68c4-4b9c-81e9-4eec2760abfb tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:07.290014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-954568c9-68c4-4b9c-81e9-4eec2760abfb tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:07.296890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-954568c9-68c4-4b9c-81e9-4eec2760abfb tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:07.297388 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-954568c9-68c4-4b9c-81e9-4eec2760abfb tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:07.297860 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-954568c9-68c4-4b9c-81e9-4eec2760abfb tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:07.298577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-954568c9-68c4-4b9c-81e9-4eec2760abfb tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:07.299096 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-954568c9-68c4-4b9c-81e9-4eec2760abfb tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:07.299535 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-954568c9-68c4-4b9c-81e9-4eec2760abfb tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:07.508680 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-954568c9-68c4-4b9c-81e9-4eec2760abfb tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:07.517242 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-954568c9-68c4-4b9c-81e9-4eec2760abfb tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.232590 Sep 17 21:05:07.518131 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1726/3541] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:07 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:07.533885 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7f6712b3-578e-4265-988f-5309fcfcb67a tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/a99181d1-ce72-483a-a073-3efce467ebb5" status: 202 len: 0 microversion: 2.1 time: 0.358035 Sep 17 21:05:07.533885 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1816/3542] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 21:05:07 2022] DELETE /compute/v2.1/os-security-groups/a99181d1-ce72-483a-a073-3efce467ebb5 => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:05:07.539961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-74718e4c-5fee-40b0-8a38-f44cc7cc82bc tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:07.541024 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-74718e4c-5fee-40b0-8a38-f44cc7cc82bc tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] [instance: 39726f64-c35f-43a9-8ca2-6efc128162ee] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:07.545072 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1ed60036-a3ff-4512-9f9d-6de78e9713e7 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:07.545864 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1ed60036-a3ff-4512-9f9d-6de78e9713e7 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] [instance: f1b3d010-7e10-40fd-936b-f3e04bdaf3fe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:07.552954 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ed60036-a3ff-4512-9f9d-6de78e9713e7 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:07.553782 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ed60036-a3ff-4512-9f9d-6de78e9713e7 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:07.554540 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ed60036-a3ff-4512-9f9d-6de78e9713e7 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:07.555425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ed60036-a3ff-4512-9f9d-6de78e9713e7 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:07.556049 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ed60036-a3ff-4512-9f9d-6de78e9713e7 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:07.557528 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ed60036-a3ff-4512-9f9d-6de78e9713e7 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:07.559165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-74718e4c-5fee-40b0-8a38-f44cc7cc82bc tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:07.560264 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-74718e4c-5fee-40b0-8a38-f44cc7cc82bc tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:07.560816 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-74718e4c-5fee-40b0-8a38-f44cc7cc82bc tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:07.561886 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-74718e4c-5fee-40b0-8a38-f44cc7cc82bc tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:07.562655 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-74718e4c-5fee-40b0-8a38-f44cc7cc82bc tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:07.565121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-74718e4c-5fee-40b0-8a38-f44cc7cc82bc tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:07.776828 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1ed60036-a3ff-4512-9f9d-6de78e9713e7 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7671df52e4e95b829f03defeb6cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765dd4c95190458594be8f9a7915210e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:07.779203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-74718e4c-5fee-40b0-8a38-f44cc7cc82bc tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd454c25ddef46d993ff15440a64a438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130f997fde494ab887281d866d6aec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:07.787565 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-74718e4c-5fee-40b0-8a38-f44cc7cc82bc tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] 10.222.0.26 "GET /compute/v2.1/servers/39726f64-c35f-43a9-8ca2-6efc128162ee" status: 200 len: 1404 microversion: 2.1 time: 0.252279 Sep 17 21:05:07.788289 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1817/3543] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:07 2022] GET /compute/v2.1/servers/39726f64-c35f-43a9-8ca2-6efc128162ee => generated 1404 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:07.793499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1ed60036-a3ff-4512-9f9d-6de78e9713e7 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7671df52e4e95b829f03defeb6cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765dd4c95190458594be8f9a7915210e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:07.795146 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1ed60036-a3ff-4512-9f9d-6de78e9713e7 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7671df52e4e95b829f03defeb6cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765dd4c95190458594be8f9a7915210e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:07.796358 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1ed60036-a3ff-4512-9f9d-6de78e9713e7 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] 10.222.0.26 "GET /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe" status: 200 len: 1551 microversion: 2.21 time: 0.259648 Sep 17 21:05:07.796910 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1727/3544] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:05:07 2022] GET /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe => generated 1551 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:05:07.801494 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-10e881cc-c48d-4e6e-8704-0283d52c316a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:07.802371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-10e881cc-c48d-4e6e-8704-0283d52c316a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:07.809242 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10e881cc-c48d-4e6e-8704-0283d52c316a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:07.810013 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10e881cc-c48d-4e6e-8704-0283d52c316a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:07.810657 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10e881cc-c48d-4e6e-8704-0283d52c316a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:07.810806 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-37c48ebd-2600-43e4-a8d0-aa05668ec94c tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] Calling method '.version_select at 0x7f25a414e430>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:07.812283 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10e881cc-c48d-4e6e-8704-0283d52c316a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:07.813039 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10e881cc-c48d-4e6e-8704-0283d52c316a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:07.813715 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-10e881cc-c48d-4e6e-8704-0283d52c316a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:08.065113 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-10e881cc-c48d-4e6e-8704-0283d52c316a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:08.078204 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-10e881cc-c48d-4e6e-8704-0283d52c316a tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.280040 Sep 17 21:05:08.088185 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1728/3545] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:07 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:08.094148 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-d6900b9c-63f4-4b9e-a794-0cab041d7303 req-fe5bee3d-3075-4baf-b37d-f45f5f2baf3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39726f64-c35f-43a9-8ca2-6efc128162ee", "name": "network-vif-plugged", "status": "completed", "tag": "0a4de968-f735-40a2-90dc-6ce02c2af575"}, {"server_uuid": "9b067088-a9ba-43cd-9775-8c54ba91ef6f", "name": "network-vif-plugged", "status": "completed", "tag": "63f8d9ca-5b51-4cf8-84b7-f21f7f475682"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:08.105590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d6900b9c-63f4-4b9e-a794-0cab041d7303 req-fe5bee3d-3075-4baf-b37d-f45f5f2baf3e service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:08.106084 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d6900b9c-63f4-4b9e-a794-0cab041d7303 req-fe5bee3d-3075-4baf-b37d-f45f5f2baf3e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:08.106534 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d6900b9c-63f4-4b9e-a794-0cab041d7303 req-fe5bee3d-3075-4baf-b37d-f45f5f2baf3e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:08.120797 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-d6900b9c-63f4-4b9e-a794-0cab041d7303 req-fe5bee3d-3075-4baf-b37d-f45f5f2baf3e service nova] Creating event network-vif-plugged:0a4de968-f735-40a2-90dc-6ce02c2af575 for instance 39726f64-c35f-43a9-8ca2-6efc128162ee on nch1-master-1 Sep 17 21:05:08.121448 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-d6900b9c-63f4-4b9e-a794-0cab041d7303 req-fe5bee3d-3075-4baf-b37d-f45f5f2baf3e service nova] Creating event network-vif-plugged:63f8d9ca-5b51-4cf8-84b7-f21f7f475682 for instance 9b067088-a9ba-43cd-9775-8c54ba91ef6f on nch2-master-1 Sep 17 21:05:08.130430 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-d6900b9c-63f4-4b9e-a794-0cab041d7303 req-fe5bee3d-3075-4baf-b37d-f45f5f2baf3e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040624 Sep 17 21:05:08.132183 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1729/3546] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:08.137708 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d48891bd-0457-49e0-915d-178594b18874 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:08.138567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d48891bd-0457-49e0-915d-178594b18874 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] [instance: f1b3d010-7e10-40fd-936b-f3e04bdaf3fe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:08.145798 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d48891bd-0457-49e0-915d-178594b18874 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:08.146764 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d48891bd-0457-49e0-915d-178594b18874 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:08.147419 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d48891bd-0457-49e0-915d-178594b18874 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:08.148390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d48891bd-0457-49e0-915d-178594b18874 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:08.149051 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d48891bd-0457-49e0-915d-178594b18874 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:08.149681 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d48891bd-0457-49e0-915d-178594b18874 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:08.169268 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-37c48ebd-2600-43e4-a8d0-aa05668ec94c tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/355fc623-30d2-4c82-8af3-7af4a4679a1a" status: 202 len: 0 microversion: 2.1 time: 0.379512 Sep 17 21:05:08.170095 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1818/3547] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 21:05:07 2022] DELETE /compute/v2.1/os-security-groups/355fc623-30d2-4c82-8af3-7af4a4679a1a => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:05:08.175469 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7ec30a4b-06da-4e35-bf42-0fa7e80fea1b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:08.176106 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7ec30a4b-06da-4e35-bf42-0fa7e80fea1b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: d131d8e1-8f52-4d1f-8f88-46b1aef06e29] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:08.181737 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d48891bd-0457-49e0-915d-178594b18874 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] [instance: f1b3d010-7e10-40fd-936b-f3e04bdaf3fe] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:05:08.193566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7ec30a4b-06da-4e35-bf42-0fa7e80fea1b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:08.194079 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7ec30a4b-06da-4e35-bf42-0fa7e80fea1b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:08.194533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7ec30a4b-06da-4e35-bf42-0fa7e80fea1b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:08.195265 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7ec30a4b-06da-4e35-bf42-0fa7e80fea1b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:08.195773 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7ec30a4b-06da-4e35-bf42-0fa7e80fea1b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:08.196236 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7ec30a4b-06da-4e35-bf42-0fa7e80fea1b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:08.322190 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d48891bd-0457-49e0-915d-178594b18874 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe" status: 204 len: 0 microversion: 2.21 time: 0.188081 Sep 17 21:05:08.323221 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1730/3548] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 17 21:05:08 2022] DELETE /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 21:05:08.330000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-90851180-2c9c-440f-bfc9-b6ee0a621255 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:08.330809 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-90851180-2c9c-440f-bfc9-b6ee0a621255 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:08.337033 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90851180-2c9c-440f-bfc9-b6ee0a621255 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:08.337570 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90851180-2c9c-440f-bfc9-b6ee0a621255 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:08.338022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90851180-2c9c-440f-bfc9-b6ee0a621255 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:08.338730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90851180-2c9c-440f-bfc9-b6ee0a621255 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:08.339193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90851180-2c9c-440f-bfc9-b6ee0a621255 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:08.339623 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90851180-2c9c-440f-bfc9-b6ee0a621255 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:08.374682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90851180-2c9c-440f-bfc9-b6ee0a621255 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:08.375175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90851180-2c9c-440f-bfc9-b6ee0a621255 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:08.375625 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90851180-2c9c-440f-bfc9-b6ee0a621255 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:08.376081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-90851180-2c9c-440f-bfc9-b6ee0a621255 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lazy-loading 'fault' on Instance uuid 5b354b73-703b-4577-b7e5-f137385b9c36 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:05:08.461425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-90851180-2c9c-440f-bfc9-b6ee0a621255 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:08.470291 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-90851180-2c9c-440f-bfc9-b6ee0a621255 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:08.471752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-90851180-2c9c-440f-bfc9-b6ee0a621255 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e570c2dfca474a089d281ac21a859e98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1894770a3dfd4dd2aaa4a2b02f9a7f36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:08.477266 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-90851180-2c9c-440f-bfc9-b6ee0a621255 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 200 len: 1542 microversion: 2.91 time: 0.152614 Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1731/3549] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:05:08 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 1542 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-21c74760-14b5-4b81-9b8c-4c418e454723 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-21c74760-14b5-4b81-9b8c-4c418e454723 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: request: PUT /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a HTTP/1.1 Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 280 Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '9b986fa2-07ea-4418-adf2-0a5fa127e84a', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise error Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 17 21:05:08.498568 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:08.502387 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-21c74760-14b5-4b81-9b8c-4c418e454723 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:05:08.510820 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-21c74760-14b5-4b81-9b8c-4c418e454723 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "PUT /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 400 len: 619 microversion: 2.1 time: 0.016809 Sep 17 21:05:08.510820 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1732/3550] 10.222.0.26 () {60 vars in 1257 bytes} [Sat Sep 17 21:05:08 2022] PUT /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 619 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:05:08.517491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a09a5193-f599-4aef-8015-b89b34d8194e tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] Calling method '.version_select at 0x7f25a48aa9d0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:08.517948 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7ec30a4b-06da-4e35-bf42-0fa7e80fea1b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:08.528937 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7ec30a4b-06da-4e35-bf42-0fa7e80fea1b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29" status: 200 len: 1314 microversion: 2.1 time: 0.357611 Sep 17 21:05:08.530085 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1819/3551] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:08 2022] GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:08.537905 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ea6726ac-ee0f-47b9-b1d8-41366b34caa3 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:08.538656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ea6726ac-ee0f-47b9-b1d8-41366b34caa3 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] [instance: 9b067088-a9ba-43cd-9775-8c54ba91ef6f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:08.545852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea6726ac-ee0f-47b9-b1d8-41366b34caa3 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:08.546660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea6726ac-ee0f-47b9-b1d8-41366b34caa3 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:08.547310 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea6726ac-ee0f-47b9-b1d8-41366b34caa3 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:08.548138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea6726ac-ee0f-47b9-b1d8-41366b34caa3 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:08.548656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea6726ac-ee0f-47b9-b1d8-41366b34caa3 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:08.549096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea6726ac-ee0f-47b9-b1d8-41366b34caa3 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:08.751863 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ea6726ac-ee0f-47b9-b1d8-41366b34caa3 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e38b0461884497e8c5d399051b3d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc3ec11e1374785afe8d3f73bc26891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:08.761285 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ea6726ac-ee0f-47b9-b1d8-41366b34caa3 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] 10.222.0.26 "GET /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f" status: 200 len: 1324 microversion: 2.1 time: 0.229441 Sep 17 21:05:08.773486 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1820/3552] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:08 2022] GET /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f => generated 1324 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:08.773486 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2fa7bf85-efa8-450f-8e65-0f7a542a6eb8 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:08.773486 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2fa7bf85-efa8-450f-8e65-0f7a542a6eb8 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] [instance: f1b3d010-7e10-40fd-936b-f3e04bdaf3fe] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:08.774608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2fa7bf85-efa8-450f-8e65-0f7a542a6eb8 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:08.774608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2fa7bf85-efa8-450f-8e65-0f7a542a6eb8 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:08.774846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2fa7bf85-efa8-450f-8e65-0f7a542a6eb8 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:08.775463 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2fa7bf85-efa8-450f-8e65-0f7a542a6eb8 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:08.776324 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2fa7bf85-efa8-450f-8e65-0f7a542a6eb8 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:08.776932 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2fa7bf85-efa8-450f-8e65-0f7a542a6eb8 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:08.932050 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a09a5193-f599-4aef-8015-b89b34d8194e tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/5179e8cb-c111-4c60-986f-12279a03d337" status: 202 len: 0 microversion: 2.1 time: 0.426439 Sep 17 21:05:08.935939 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1733/3553] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 21:05:08 2022] DELETE /compute/v2.1/os-security-groups/5179e8cb-c111-4c60-986f-12279a03d337 => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:05:08.939697 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-add4c016-baff-4139-a198-11e91ec31020 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:08.940384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-add4c016-baff-4139-a198-11e91ec31020 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:08.948188 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-add4c016-baff-4139-a198-11e91ec31020 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:08.948702 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-add4c016-baff-4139-a198-11e91ec31020 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:08.949165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-add4c016-baff-4139-a198-11e91ec31020 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:08.950130 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-add4c016-baff-4139-a198-11e91ec31020 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:08.950380 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-add4c016-baff-4139-a198-11e91ec31020 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:08.950829 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-add4c016-baff-4139-a198-11e91ec31020 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:08.976677 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2fa7bf85-efa8-450f-8e65-0f7a542a6eb8 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7671df52e4e95b829f03defeb6cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765dd4c95190458594be8f9a7915210e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:08.986762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2fa7bf85-efa8-450f-8e65-0f7a542a6eb8 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7671df52e4e95b829f03defeb6cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765dd4c95190458594be8f9a7915210e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:08.988986 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2fa7bf85-efa8-450f-8e65-0f7a542a6eb8 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7671df52e4e95b829f03defeb6cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765dd4c95190458594be8f9a7915210e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:08.990409 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2fa7bf85-efa8-450f-8e65-0f7a542a6eb8 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] 10.222.0.26 "GET /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe" status: 200 len: 1557 microversion: 2.21 time: 0.227175 Sep 17 21:05:08.991510 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1821/3554] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:05:08 2022] GET /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe => generated 1557 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:05:08.997000 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e346773d-50a0-49d9-977d-93efe6ce3314 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:08.997851 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e346773d-50a0-49d9-977d-93efe6ce3314 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] [instance: 39726f64-c35f-43a9-8ca2-6efc128162ee] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:09.012627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e346773d-50a0-49d9-977d-93efe6ce3314 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:09.013307 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e346773d-50a0-49d9-977d-93efe6ce3314 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:09.013854 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e346773d-50a0-49d9-977d-93efe6ce3314 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:09.014651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e346773d-50a0-49d9-977d-93efe6ce3314 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:09.015239 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e346773d-50a0-49d9-977d-93efe6ce3314 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:09.015886 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e346773d-50a0-49d9-977d-93efe6ce3314 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:09.196027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-add4c016-baff-4139-a198-11e91ec31020 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:09.205971 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-add4c016-baff-4139-a198-11e91ec31020 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.270723 Sep 17 21:05:09.208018 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1734/3555] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:08 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:09.222527 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c40c3e38-93a7-4a6d-8a5b-0922e648d95f tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] Calling method '.version_select at 0x7f25a48aa670>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:09.231177 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e346773d-50a0-49d9-977d-93efe6ce3314 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd454c25ddef46d993ff15440a64a438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130f997fde494ab887281d866d6aec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:09.245188 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e346773d-50a0-49d9-977d-93efe6ce3314 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] 10.222.0.26 "GET /compute/v2.1/servers/39726f64-c35f-43a9-8ca2-6efc128162ee" status: 200 len: 1404 microversion: 2.1 time: 0.251586 Sep 17 21:05:09.246204 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1822/3556] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:08 2022] GET /compute/v2.1/servers/39726f64-c35f-43a9-8ca2-6efc128162ee => generated 1404 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:09.252223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-457c29db-e3d5-429e-9b73-2760c6d957f2 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:09.252865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-457c29db-e3d5-429e-9b73-2760c6d957f2 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:09.260432 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-457c29db-e3d5-429e-9b73-2760c6d957f2 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:09.261072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-457c29db-e3d5-429e-9b73-2760c6d957f2 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:09.261747 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-457c29db-e3d5-429e-9b73-2760c6d957f2 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:09.264125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-457c29db-e3d5-429e-9b73-2760c6d957f2 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:09.264736 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-457c29db-e3d5-429e-9b73-2760c6d957f2 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:09.265211 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-457c29db-e3d5-429e-9b73-2760c6d957f2 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:09.500033 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-457c29db-e3d5-429e-9b73-2760c6d957f2 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:09.509580 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-457c29db-e3d5-429e-9b73-2760c6d957f2 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.262177 Sep 17 21:05:09.510274 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1823/3557] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:09 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:09.515288 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-14234c99-d123-4860-b95e-d962c2e0d3d3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:09.516268 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-14234c99-d123-4860-b95e-d962c2e0d3d3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] [instance: 5b354b73-703b-4577-b7e5-f137385b9c36] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:09.528745 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14234c99-d123-4860-b95e-d962c2e0d3d3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:09.529326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14234c99-d123-4860-b95e-d962c2e0d3d3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:09.529987 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14234c99-d123-4860-b95e-d962c2e0d3d3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:09.530936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14234c99-d123-4860-b95e-d962c2e0d3d3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:09.532147 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14234c99-d123-4860-b95e-d962c2e0d3d3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:09.532609 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14234c99-d123-4860-b95e-d962c2e0d3d3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:09.548382 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c40c3e38-93a7-4a6d-8a5b-0922e648d95f tempest-SecurityGroupRulesTestJSON-1789410539 tempest-SecurityGroupRulesTestJSON-1789410539-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/3d0af82d-3353-483e-92d5-08b8df5fae75" status: 202 len: 0 microversion: 2.1 time: 0.338995 Sep 17 21:05:09.549554 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1735/3558] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 21:05:09 2022] DELETE /compute/v2.1/os-security-groups/3d0af82d-3353-483e-92d5-08b8df5fae75 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:05:09.549935 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-14234c99-d123-4860-b95e-d962c2e0d3d3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] HTTP exception thrown: Instance 5b354b73-703b-4577-b7e5-f137385b9c36 could not be found. Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-14234c99-d123-4860-b95e-d962c2e0d3d3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Request method failure captured: Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 HTTP/1.1 Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjXB-8zT8d_BjhPhndrJGz230Y7cYcG9cYBAf9onWrudcqsS1PyjjGmpcqqajI5aZJ7mBY3F1DtnmZUlsJ9bbySEJ9D_WwymkDhsUtDb_TQavUrvd39Y-t3SMzRU2D1BOqcgscWNLErAOgw5anHn65RyiO5F4cuwCKDdUFQr60-85Z0 Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: X-Openstack-Nova-Api-Version: 2.91 Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 1894770a3dfd4dd2aaa4a2b02f9a7f36 Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-367450398 Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1894770a3dfd4dd2aaa4a2b02f9a7f36"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1894770a3dfd4dd2aaa4a2b02f9a7f36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1894770a3dfd4dd2aaa4a2b02f9a7f36"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1894770a3dfd4dd2aaa4a2b02f9a7f36", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-367450398 Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 1894770a3dfd4dd2aaa4a2b02f9a7f36 Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-367450398 Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-UnshelveToHostMultiNodesTest-367450398-project Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: e570c2dfca474a089d281ac21a859e98 Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-367450398-project Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 5b354b73-703b-4577-b7e5-f137385b9c36 could not be found. Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '5b354b73-703b-4577-b7e5-f137385b9c36'} Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b354b73-703b-4577-b7e5-f137385b9c36 could not be found. Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b354b73-703b-4577-b7e5-f137385b9c36 could not be found. Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:09.551746 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:09.556901 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:09.556901 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:09.556901 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:09.556901 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:09.556901 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:05:09.556901 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:05:09.556901 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b354b73-703b-4577-b7e5-f137385b9c36 could not be found. Sep 17 21:05:09.556901 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:09.556901 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-14234c99-d123-4860-b95e-d962c2e0d3d3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] Returning 404 to user: Instance 5b354b73-703b-4577-b7e5-f137385b9c36 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:05:09.558158 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d2b3cb05-2cae-44e1-a624-116321e6847d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d2b3cb05-2cae-44e1-a624-116321e6847d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: request: PUT /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a HTTP/1.1 Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 24 Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: {"server": {"name": ""}} Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '9b986fa2-07ea-4418-adf2-0a5fa127e84a', 'body': {'server': {'name': ''}}} Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise error Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi '' Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 21:05:09.559803 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 17 21:05:09.567698 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:09.567698 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:09.567698 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:09.567698 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:09.567698 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:09.567698 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:09.567698 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 21:05:09.567698 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 21:05:09.567698 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 17 21:05:09.567698 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:09.567698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d2b3cb05-2cae-44e1-a624-116321e6847d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:05:09.568527 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-14234c99-d123-4860-b95e-d962c2e0d3d3 tempest-UnshelveToHostMultiNodesTest-367450398 tempest-UnshelveToHostMultiNodesTest-367450398-project] 10.222.0.26 "GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36" status: 404 len: 111 microversion: 2.91 time: 0.044065 Sep 17 21:05:09.568646 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d2b3cb05-2cae-44e1-a624-116321e6847d tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "PUT /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 400 len: 108 microversion: 2.1 time: 0.010594 Sep 17 21:05:09.568646 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1736/3559] 10.222.0.26 () {60 vars in 1256 bytes} [Sat Sep 17 21:05:09 2022] PUT /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 108 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:05:09.568843 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1824/3560] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:05:09 2022] GET /compute/v2.1/servers/5b354b73-703b-4577-b7e5-f137385b9c36 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:05:09.568940 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f6da9e14-62f0-4556-91a5-f4b42352a1b2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:09.568940 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f6da9e14-62f0-4556-91a5-f4b42352a1b2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: d131d8e1-8f52-4d1f-8f88-46b1aef06e29] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:09.577323 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f6da9e14-62f0-4556-91a5-f4b42352a1b2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:09.578153 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f6da9e14-62f0-4556-91a5-f4b42352a1b2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:09.578699 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f6da9e14-62f0-4556-91a5-f4b42352a1b2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:09.579193 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b1e1cf81-38c7-4675-a45f-765cc287e3a4 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:09.580187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f6da9e14-62f0-4556-91a5-f4b42352a1b2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:09.580446 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b1e1cf81-38c7-4675-a45f-765cc287e3a4 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:09.580658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f6da9e14-62f0-4556-91a5-f4b42352a1b2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:09.581893 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f6da9e14-62f0-4556-91a5-f4b42352a1b2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:09.587475 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:09.607010 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1e1cf81-38c7-4675-a45f-765cc287e3a4 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:09.607550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1e1cf81-38c7-4675-a45f-765cc287e3a4 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:09.607980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1e1cf81-38c7-4675-a45f-765cc287e3a4 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:09.608718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1e1cf81-38c7-4675-a45f-765cc287e3a4 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:09.609183 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1e1cf81-38c7-4675-a45f-765cc287e3a4 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:09.613650 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1e1cf81-38c7-4675-a45f-765cc287e3a4 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:09.872986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f6da9e14-62f0-4556-91a5-f4b42352a1b2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:09.884904 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f6da9e14-62f0-4556-91a5-f4b42352a1b2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29" status: 200 len: 1314 microversion: 2.1 time: 0.320903 Sep 17 21:05:09.901491 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1737/3561] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:09 2022] GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:09.901973 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b1e1cf81-38c7-4675-a45f-765cc287e3a4 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:09.907625 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-aaf828fb-09bd-4073-b779-61541d26ed8b tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:09.907625 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-aaf828fb-09bd-4073-b779-61541d26ed8b tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] [instance: 9b067088-a9ba-43cd-9775-8c54ba91ef6f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:09.907928 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b1e1cf81-38c7-4675-a45f-765cc287e3a4 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1505 microversion: 2.1 time: 0.338084 Sep 17 21:05:09.915138 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aaf828fb-09bd-4073-b779-61541d26ed8b tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:09.916513 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aaf828fb-09bd-4073-b779-61541d26ed8b tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:09.917076 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aaf828fb-09bd-4073-b779-61541d26ed8b tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:09.917842 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1825/3562] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:09 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1505 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:09.918246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aaf828fb-09bd-4073-b779-61541d26ed8b tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:09.918798 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aaf828fb-09bd-4073-b779-61541d26ed8b tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:09.919316 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aaf828fb-09bd-4073-b779-61541d26ed8b tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:10.019560 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c4ddf0eb-b50c-4883-af75-c1b168e87e99 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:10.020843 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c4ddf0eb-b50c-4883-af75-c1b168e87e99 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] [instance: f1b3d010-7e10-40fd-936b-f3e04bdaf3fe] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:10.039283 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4ddf0eb-b50c-4883-af75-c1b168e87e99 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:10.045268 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4ddf0eb-b50c-4883-af75-c1b168e87e99 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:10.049055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4ddf0eb-b50c-4883-af75-c1b168e87e99 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:10.054594 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4ddf0eb-b50c-4883-af75-c1b168e87e99 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:10.055820 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4ddf0eb-b50c-4883-af75-c1b168e87e99 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:10.058707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4ddf0eb-b50c-4883-af75-c1b168e87e99 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:10.355567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-aaf828fb-09bd-4073-b779-61541d26ed8b tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e38b0461884497e8c5d399051b3d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc3ec11e1374785afe8d3f73bc26891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:10.364748 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-aaf828fb-09bd-4073-b779-61541d26ed8b tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] 10.222.0.26 "GET /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f" status: 200 len: 1324 microversion: 2.1 time: 0.473766 Sep 17 21:05:10.382554 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1738/3563] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:09 2022] GET /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f => generated 1324 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:10.400208 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b7fe03c2-7b80-4c2f-8731-965ccdb57b4e tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:10.404107 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b7fe03c2-7b80-4c2f-8731-965ccdb57b4e tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] [instance: 39726f64-c35f-43a9-8ca2-6efc128162ee] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:10.422067 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b7fe03c2-7b80-4c2f-8731-965ccdb57b4e tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:10.426792 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=6 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:10.427093 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b7fe03c2-7b80-4c2f-8731-965ccdb57b4e tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:10.427860 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b7fe03c2-7b80-4c2f-8731-965ccdb57b4e tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:10.428805 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b7fe03c2-7b80-4c2f-8731-965ccdb57b4e tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:10.429548 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b7fe03c2-7b80-4c2f-8731-965ccdb57b4e tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:10.430144 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b7fe03c2-7b80-4c2f-8731-965ccdb57b4e tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:10.456150 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=18 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:10.655721 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c4ddf0eb-b50c-4883-af75-c1b168e87e99 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7671df52e4e95b829f03defeb6cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765dd4c95190458594be8f9a7915210e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:10.664152 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c4ddf0eb-b50c-4883-af75-c1b168e87e99 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7671df52e4e95b829f03defeb6cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765dd4c95190458594be8f9a7915210e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:10.665751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c4ddf0eb-b50c-4883-af75-c1b168e87e99 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7671df52e4e95b829f03defeb6cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765dd4c95190458594be8f9a7915210e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:10.667351 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c4ddf0eb-b50c-4883-af75-c1b168e87e99 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] 10.222.0.26 "GET /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe" status: 200 len: 1557 microversion: 2.21 time: 0.654827 Sep 17 21:05:10.681976 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1826/3564] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:05:10 2022] GET /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe => generated 1557 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:05:10.892609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b7fe03c2-7b80-4c2f-8731-965ccdb57b4e tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd454c25ddef46d993ff15440a64a438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130f997fde494ab887281d866d6aec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:10.913181 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b7fe03c2-7b80-4c2f-8731-965ccdb57b4e tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] 10.222.0.26 "GET /compute/v2.1/servers/39726f64-c35f-43a9-8ca2-6efc128162ee" status: 200 len: 1591 microversion: 2.1 time: 0.519355 Sep 17 21:05:10.914083 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1739/3565] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:10 2022] GET /compute/v2.1/servers/39726f64-c35f-43a9-8ca2-6efc128162ee => generated 1591 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:10.917008 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7fe1bf7d-6e56-4b86-b885-3a238fb364cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:10.917767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7fe1bf7d-6e56-4b86-b885-3a238fb364cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: d131d8e1-8f52-4d1f-8f88-46b1aef06e29] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:10.927513 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7fe1bf7d-6e56-4b86-b885-3a238fb364cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:10.928153 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7fe1bf7d-6e56-4b86-b885-3a238fb364cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:10.928683 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7fe1bf7d-6e56-4b86-b885-3a238fb364cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:10.929504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7fe1bf7d-6e56-4b86-b885-3a238fb364cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:10.930062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7fe1bf7d-6e56-4b86-b885-3a238fb364cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:10.930577 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7fe1bf7d-6e56-4b86-b885-3a238fb364cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:10.938658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7ad81870-7d8a-4141-b9e2-15bad38a34db tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:10.939187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7ad81870-7d8a-4141-b9e2-15bad38a34db tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] [instance: 39726f64-c35f-43a9-8ca2-6efc128162ee] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:10.951746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ad81870-7d8a-4141-b9e2-15bad38a34db tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:10.952587 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ad81870-7d8a-4141-b9e2-15bad38a34db tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:10.953685 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ad81870-7d8a-4141-b9e2-15bad38a34db tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:10.956644 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ad81870-7d8a-4141-b9e2-15bad38a34db tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:10.957975 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ad81870-7d8a-4141-b9e2-15bad38a34db tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:10.958977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ad81870-7d8a-4141-b9e2-15bad38a34db tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:11.183324 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7ad81870-7d8a-4141-b9e2-15bad38a34db tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] 10.222.0.26 "GET /compute/v2.1/servers/39726f64-c35f-43a9-8ca2-6efc128162ee/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.250260 Sep 17 21:05:11.191416 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1740/3566] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Sep 17 21:05:10 2022] GET /compute/v2.1/servers/39726f64-c35f-43a9-8ca2-6efc128162ee/os-interface => generated 285 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:05:11.191416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-f8a4dee8-8498-4b21-a038-914d4ddbfa86 req-5e9758b4-12b1-47ae-a2c5-a3c962312a1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d131d8e1-8f52-4d1f-8f88-46b1aef06e29", "name": "network-vif-plugged", "status": "completed", "tag": "e767046e-5d7a-4304-ad5e-62e075501024"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:11.211113 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f8a4dee8-8498-4b21-a038-914d4ddbfa86 req-5e9758b4-12b1-47ae-a2c5-a3c962312a1d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:11.211955 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f8a4dee8-8498-4b21-a038-914d4ddbfa86 req-5e9758b4-12b1-47ae-a2c5-a3c962312a1d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:11.212801 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f8a4dee8-8498-4b21-a038-914d4ddbfa86 req-5e9758b4-12b1-47ae-a2c5-a3c962312a1d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:11.231965 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-f8a4dee8-8498-4b21-a038-914d4ddbfa86 req-5e9758b4-12b1-47ae-a2c5-a3c962312a1d service nova] Creating event network-vif-plugged:e767046e-5d7a-4304-ad5e-62e075501024 for instance d131d8e1-8f52-4d1f-8f88-46b1aef06e29 on nch1-master-1 Sep 17 21:05:11.244604 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-f8a4dee8-8498-4b21-a038-914d4ddbfa86 req-5e9758b4-12b1-47ae-a2c5-a3c962312a1d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053271 Sep 17 21:05:11.246061 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1741/3567] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:11.396585 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-32f95a5d-f912-4857-aaf1-263286252ce8 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:11.397231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-32f95a5d-f912-4857-aaf1-263286252ce8 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] [instance: 9b067088-a9ba-43cd-9775-8c54ba91ef6f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:11.410776 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32f95a5d-f912-4857-aaf1-263286252ce8 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:11.415039 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32f95a5d-f912-4857-aaf1-263286252ce8 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:11.418919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32f95a5d-f912-4857-aaf1-263286252ce8 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:11.421099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32f95a5d-f912-4857-aaf1-263286252ce8 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:11.421756 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32f95a5d-f912-4857-aaf1-263286252ce8 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:11.422348 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32f95a5d-f912-4857-aaf1-263286252ce8 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:11.694017 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7fe1bf7d-6e56-4b86-b885-3a238fb364cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:11.710018 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7fe1bf7d-6e56-4b86-b885-3a238fb364cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29" status: 200 len: 1314 microversion: 2.1 time: 0.798491 Sep 17 21:05:11.711917 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1827/3568] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:10 2022] GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29 => generated 1314 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:11.717342 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-66fa53c8-d1f2-497d-9ccd-9de3ab481440 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:11.718533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-66fa53c8-d1f2-497d-9ccd-9de3ab481440 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] [instance: f1b3d010-7e10-40fd-936b-f3e04bdaf3fe] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:11.727067 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66fa53c8-d1f2-497d-9ccd-9de3ab481440 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:11.728004 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66fa53c8-d1f2-497d-9ccd-9de3ab481440 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:11.728712 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66fa53c8-d1f2-497d-9ccd-9de3ab481440 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:11.730429 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66fa53c8-d1f2-497d-9ccd-9de3ab481440 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:11.731115 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66fa53c8-d1f2-497d-9ccd-9de3ab481440 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:11.731760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66fa53c8-d1f2-497d-9ccd-9de3ab481440 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:11.963047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-66fa53c8-d1f2-497d-9ccd-9de3ab481440 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8f7671df52e4e95b829f03defeb6cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765dd4c95190458594be8f9a7915210e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:11.982762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-66fa53c8-d1f2-497d-9ccd-9de3ab481440 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8f7671df52e4e95b829f03defeb6cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765dd4c95190458594be8f9a7915210e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:11.985335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-66fa53c8-d1f2-497d-9ccd-9de3ab481440 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8f7671df52e4e95b829f03defeb6cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '765dd4c95190458594be8f9a7915210e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:11.987415 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-66fa53c8-d1f2-497d-9ccd-9de3ab481440 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] 10.222.0.26 "GET /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe" status: 200 len: 1515 microversion: 2.21 time: 0.274105 Sep 17 21:05:12.003057 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1828/3569] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:05:11 2022] GET /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe => generated 1515 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:05:12.061008 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-03a6b032-6771-48f3-8a78-409b18272ca0 req-28e7fa06-e2e7-41f9-a630-4613ada5387c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1b3d010-7e10-40fd-936b-f3e04bdaf3fe", "name": "network-vif-deleted", "tag": "bd5fbc38-e806-4c41-99e1-d49e50779778"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:12.083882 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-03a6b032-6771-48f3-8a78-409b18272ca0 req-28e7fa06-e2e7-41f9-a630-4613ada5387c service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:12.085040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-03a6b032-6771-48f3-8a78-409b18272ca0 req-28e7fa06-e2e7-41f9-a630-4613ada5387c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:12.085886 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-03a6b032-6771-48f3-8a78-409b18272ca0 req-28e7fa06-e2e7-41f9-a630-4613ada5387c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:12.102297 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-32f95a5d-f912-4857-aaf1-263286252ce8 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e38b0461884497e8c5d399051b3d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc3ec11e1374785afe8d3f73bc26891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:12.114961 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-32f95a5d-f912-4857-aaf1-263286252ce8 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] 10.222.0.26 "GET /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f" status: 200 len: 1520 microversion: 2.1 time: 0.723143 Sep 17 21:05:12.117780 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1742/3570] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:11 2022] GET /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f => generated 1520 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:12.155278 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-03a6b032-6771-48f3-8a78-409b18272ca0 req-28e7fa06-e2e7-41f9-a630-4613ada5387c service nova] Creating event network-vif-deleted:bd5fbc38-e806-4c41-99e1-d49e50779778 for instance f1b3d010-7e10-40fd-936b-f3e04bdaf3fe on nch2-master-1 Sep 17 21:05:12.165190 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-03a6b032-6771-48f3-8a78-409b18272ca0 req-28e7fa06-e2e7-41f9-a630-4613ada5387c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134412 Sep 17 21:05:12.171203 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1829/3571] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:12.362024 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e1a55d07-a478-40c2-bd39-b516f7197860 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1908545100", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "86f7a93f-5ae4-425e-80ec-b768782122ab"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e1a55d07-a478-40c2-bd39-b516f7197860 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Request method failure captured: Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 243 Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjZqoe0PXOijJjRcfZsMvSDwBU5DIIySY1pTE2MNzBETT2_zbwTXL-KDRBMgz0Yb_fK2lhNWSFGmnfLcXDMYi701mwoQyhnxbgKJnq9Wzd-cn76PiZlzvGkodY_o06Hxwbvl6AXhMFvdi4-x8HEPkrqNJjnVIz2RuZM6OeVfPNBe2qw Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 6cc3ec11e1374785afe8d3f73bc26891 Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1083745308 Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6cc3ec11e1374785afe8d3f73bc26891"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6cc3ec11e1374785afe8d3f73bc26891"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6cc3ec11e1374785afe8d3f73bc26891"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6cc3ec11e1374785afe8d3f73bc26891", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1083745308 Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 6cc3ec11e1374785afe8d3f73bc26891 Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1083745308 Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerMetadataNegativeTestJSON-1083745308-project Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 9e38b0461884497e8c5d399051b3d50e Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1083745308-project Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1908545100", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "86f7a93f-5ae4-425e-80ec-b768782122ab"}]}} Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1908545100', 'imageRef': '1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '86f7a93f-5ae4-425e-80ec-b768782122ab'}]}}} Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise error Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi {'': 'data1'} Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:05:12.367078 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:05:12.372384 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:05:12.372384 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 21:05:12.372384 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 21:05:12.372384 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 21:05:12.372384 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 21:05:12.372384 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 21:05:12.372384 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 21:05:12.372384 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 17 21:05:12.372384 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.372384 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:12.372384 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.372384 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:12.372384 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:12.372384 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:12.372384 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 21:05:12.372384 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 21:05:12.372384 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 17 21:05:12.372384 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.372384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e1a55d07-a478-40c2-bd39-b516f7197860 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:05:12.372384 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e1a55d07-a478-40c2-bd39-b516f7197860 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.020065 Sep 17 21:05:12.373788 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1743/3572] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:05:12 2022] POST /compute/v2.1/servers => generated 175 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:05:12.387972 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5de5ca11-d79d-4f3f-b3e2-88f00d71c0c8 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:12.388725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5de5ca11-d79d-4f3f-b3e2-88f00d71c0c8 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] [instance: e65bf4a0-9601-4cbf-ba67-d3d2546f7d5e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:12.397886 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-5de5ca11-d79d-4f3f-b3e2-88f00d71c0c8 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] HTTP exception thrown: Instance e65bf4a0-9601-4cbf-ba67-d3d2546f7d5e could not be found. Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5de5ca11-d79d-4f3f-b3e2-88f00d71c0c8 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Request method failure captured: Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/e65bf4a0-9601-4cbf-ba67-d3d2546f7d5e/metadata HTTP/1.1 Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjZqoe0PXOijJjRcfZsMvSDwBU5DIIySY1pTE2MNzBETT2_zbwTXL-KDRBMgz0Yb_fK2lhNWSFGmnfLcXDMYi701mwoQyhnxbgKJnq9Wzd-cn76PiZlzvGkodY_o06Hxwbvl6AXhMFvdi4-x8HEPkrqNJjnVIz2RuZM6OeVfPNBe2qw Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 6cc3ec11e1374785afe8d3f73bc26891 Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1083745308 Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6cc3ec11e1374785afe8d3f73bc26891"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6cc3ec11e1374785afe8d3f73bc26891"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6cc3ec11e1374785afe8d3f73bc26891"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6cc3ec11e1374785afe8d3f73bc26891", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1083745308 Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 6cc3ec11e1374785afe8d3f73bc26891 Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1083745308 Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerMetadataNegativeTestJSON-1083745308-project Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 9e38b0461884497e8c5d399051b3d50e Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1083745308-project Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance e65bf4a0-9601-4cbf-ba67-d3d2546f7d5e could not be found. Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'server_id': 'e65bf4a0-9601-4cbf-ba67-d3d2546f7d5e'} Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e65bf4a0-9601-4cbf-ba67-d3d2546f7d5e could not be found. Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e65bf4a0-9601-4cbf-ba67-d3d2546f7d5e could not be found. Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:12.422659 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:12.428913 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:05:12.428913 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:05:12.428913 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e65bf4a0-9601-4cbf-ba67-d3d2546f7d5e could not be found. Sep 17 21:05:12.428913 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.430470 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a07f2bd6-2467-4dd6-9eed-770b1759f619 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:12.430954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5de5ca11-d79d-4f3f-b3e2-88f00d71c0c8 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Returning 404 to user: Instance e65bf4a0-9601-4cbf-ba67-d3d2546f7d5e could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:05:12.431060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a07f2bd6-2467-4dd6-9eed-770b1759f619 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 6beb0759-caaa-4644-b0d6-1d77d21b7e0b] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:12.432210 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5de5ca11-d79d-4f3f-b3e2-88f00d71c0c8 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] 10.222.0.26 "GET /compute/v2.1/servers/e65bf4a0-9601-4cbf-ba67-d3d2546f7d5e/metadata" status: 404 len: 111 microversion: 2.1 time: 0.051326 Sep 17 21:05:12.443679 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a07f2bd6-2467-4dd6-9eed-770b1759f619 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:12.444720 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a07f2bd6-2467-4dd6-9eed-770b1759f619 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:12.445221 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1830/3573] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Sep 17 21:05:12 2022] GET /compute/v2.1/servers/e65bf4a0-9601-4cbf-ba67-d3d2546f7d5e/metadata => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:05:12.445698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a07f2bd6-2467-4dd6-9eed-770b1759f619 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:12.447104 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a07f2bd6-2467-4dd6-9eed-770b1759f619 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:12.448540 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a07f2bd6-2467-4dd6-9eed-770b1759f619 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:12.449222 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a07f2bd6-2467-4dd6-9eed-770b1759f619 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:12.468301 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-a07f2bd6-2467-4dd6-9eed-770b1759f619 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Instance 6beb0759-caaa-4644-b0d6-1d77d21b7e0b could not be found. Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a07f2bd6-2467-4dd6-9eed-770b1759f619 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b HTTP/1.1 Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 6beb0759-caaa-4644-b0d6-1d77d21b7e0b could not be found. Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '6beb0759-caaa-4644-b0d6-1d77d21b7e0b'} Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6beb0759-caaa-4644-b0d6-1d77d21b7e0b could not be found. Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:05:12.470993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:05:12.478043 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6beb0759-caaa-4644-b0d6-1d77d21b7e0b could not be found. Sep 17 21:05:12.478043 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.478043 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:12.478043 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.478043 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:12.478043 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:12.478043 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:12.478043 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:05:12.478043 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:05:12.478043 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6beb0759-caaa-4644-b0d6-1d77d21b7e0b could not be found. Sep 17 21:05:12.478043 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.483890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a07f2bd6-2467-4dd6-9eed-770b1759f619 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 404 to user: Instance 6beb0759-caaa-4644-b0d6-1d77d21b7e0b could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:05:12.483890 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a07f2bd6-2467-4dd6-9eed-770b1759f619 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b" status: 404 len: 111 microversion: 2.1 time: 0.062124 Sep 17 21:05:12.484996 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1744/3574] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:05:12 2022] DELETE /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:05:12.492778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9cdc3f8e-76c4-4dba-b4c6-5714bc75393e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:12.493554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9cdc3f8e-76c4-4dba-b4c6-5714bc75393e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 6beb0759-caaa-4644-b0d6-1d77d21b7e0b] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:12.513577 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9cdc3f8e-76c4-4dba-b4c6-5714bc75393e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:12.514097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9cdc3f8e-76c4-4dba-b4c6-5714bc75393e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:12.514593 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9cdc3f8e-76c4-4dba-b4c6-5714bc75393e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:12.515331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9cdc3f8e-76c4-4dba-b4c6-5714bc75393e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:12.519117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9cdc3f8e-76c4-4dba-b4c6-5714bc75393e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:12.519664 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9cdc3f8e-76c4-4dba-b4c6-5714bc75393e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:12.560916 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-9cdc3f8e-76c4-4dba-b4c6-5714bc75393e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Instance 6beb0759-caaa-4644-b0d6-1d77d21b7e0b could not be found. Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9cdc3f8e-76c4-4dba-b4c6-5714bc75393e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b HTTP/1.1 Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 6beb0759-caaa-4644-b0d6-1d77d21b7e0b could not be found. Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '6beb0759-caaa-4644-b0d6-1d77d21b7e0b'} Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6beb0759-caaa-4644-b0d6-1d77d21b7e0b could not be found. Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6beb0759-caaa-4644-b0d6-1d77d21b7e0b could not be found. Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:12.564642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.570235 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:12.570235 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:12.570235 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:12.570235 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:05:12.570235 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:05:12.570235 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6beb0759-caaa-4644-b0d6-1d77d21b7e0b could not be found. Sep 17 21:05:12.570235 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.570235 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9cdc3f8e-76c4-4dba-b4c6-5714bc75393e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 404 to user: Instance 6beb0759-caaa-4644-b0d6-1d77d21b7e0b could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:05:12.570235 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9cdc3f8e-76c4-4dba-b4c6-5714bc75393e tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b" status: 404 len: 111 microversion: 2.1 time: 0.078649 Sep 17 21:05:12.571545 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1831/3575] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:12 2022] GET /compute/v2.1/servers/6beb0759-caaa-4644-b0d6-1d77d21b7e0b => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:05:12.583487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2b3b42d9-8f06-45f3-827a-0f8049d8a66f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:12.584131 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2b3b42d9-8f06-45f3-827a-0f8049d8a66f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:12.586695 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:12.597546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b3b42d9-8f06-45f3-827a-0f8049d8a66f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:12.600367 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b3b42d9-8f06-45f3-827a-0f8049d8a66f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:12.600834 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b3b42d9-8f06-45f3-827a-0f8049d8a66f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:12.604109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b3b42d9-8f06-45f3-827a-0f8049d8a66f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:12.604730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b3b42d9-8f06-45f3-827a-0f8049d8a66f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:12.605246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b3b42d9-8f06-45f3-827a-0f8049d8a66f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:12.673194 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-778091f6-149e-4a3c-947a-36bcfeac0f6f tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1208477845", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "86f7a93f-5ae4-425e-80ec-b768782122ab"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-778091f6-149e-4a3c-947a-36bcfeac0f6f tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Request method failure captured: Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 499 Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjZqoe0PXOijJjRcfZsMvSDwBU5DIIySY1pTE2MNzBETT2_zbwTXL-KDRBMgz0Yb_fK2lhNWSFGmnfLcXDMYi701mwoQyhnxbgKJnq9Wzd-cn76PiZlzvGkodY_o06Hxwbvl6AXhMFvdi4-x8HEPkrqNJjnVIz2RuZM6OeVfPNBe2qw Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 6cc3ec11e1374785afe8d3f73bc26891 Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1083745308 Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6cc3ec11e1374785afe8d3f73bc26891"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6cc3ec11e1374785afe8d3f73bc26891"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6cc3ec11e1374785afe8d3f73bc26891"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6cc3ec11e1374785afe8d3f73bc26891", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1083745308 Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 6cc3ec11e1374785afe8d3f73bc26891 Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1083745308 Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerMetadataNegativeTestJSON-1083745308-project Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 9e38b0461884497e8c5d399051b3d50e Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1083745308-project Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1208477845", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "86f7a93f-5ae4-425e-80ec-b768782122ab"}]}} Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1208477845', 'imageRef': '1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '86f7a93f-5ae4-425e-80ec-b768782122ab'}]}}} Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise error Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 17 21:05:12.680740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-778091f6-149e-4a3c-947a-36bcfeac0f6f tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:05:12.684230 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-778091f6-149e-4a3c-947a-36bcfeac0f6f tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.013977 Sep 17 21:05:12.690870 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1832/3576] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:05:12 2022] POST /compute/v2.1/servers => generated 687 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 17 21:05:12.729124 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2b3b42d9-8f06-45f3-827a-0f8049d8a66f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:05:12.736154 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f3b866a5-0cb1-4d3a-81ee-fe6eca6047cc tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:12.737539 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f3b866a5-0cb1-4d3a-81ee-fe6eca6047cc tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: d131d8e1-8f52-4d1f-8f88-46b1aef06e29] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:12.759637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3b866a5-0cb1-4d3a-81ee-fe6eca6047cc tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:12.761831 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3b866a5-0cb1-4d3a-81ee-fe6eca6047cc tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:12.764148 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3b866a5-0cb1-4d3a-81ee-fe6eca6047cc tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:12.768246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3b866a5-0cb1-4d3a-81ee-fe6eca6047cc tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:12.769028 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3b866a5-0cb1-4d3a-81ee-fe6eca6047cc tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:12.770021 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3b866a5-0cb1-4d3a-81ee-fe6eca6047cc tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:12.817989 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:12.922843 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2b3b42d9-8f06-45f3-827a-0f8049d8a66f tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 204 len: 0 microversion: 2.1 time: 0.347443 Sep 17 21:05:12.924798 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1745/3577] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:05:12 2022] DELETE /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:05:12.939584 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dde9efcf-8cd3-4871-babc-99244314f82e tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1102064860", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "86f7a93f-5ae4-425e-80ec-b768782122ab"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dde9efcf-8cd3-4871-babc-99244314f82e tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Request method failure captured: Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 500 Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjZqoe0PXOijJjRcfZsMvSDwBU5DIIySY1pTE2MNzBETT2_zbwTXL-KDRBMgz0Yb_fK2lhNWSFGmnfLcXDMYi701mwoQyhnxbgKJnq9Wzd-cn76PiZlzvGkodY_o06Hxwbvl6AXhMFvdi4-x8HEPkrqNJjnVIz2RuZM6OeVfPNBe2qw Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 6cc3ec11e1374785afe8d3f73bc26891 Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1083745308 Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6cc3ec11e1374785afe8d3f73bc26891"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6cc3ec11e1374785afe8d3f73bc26891"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6cc3ec11e1374785afe8d3f73bc26891"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6cc3ec11e1374785afe8d3f73bc26891", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1083745308 Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 6cc3ec11e1374785afe8d3f73bc26891 Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1083745308 Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerMetadataNegativeTestJSON-1083745308-project Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 9e38b0461884497e8c5d399051b3d50e Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1083745308-project Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1102064860", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "86f7a93f-5ae4-425e-80ec-b768782122ab"}]}} Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1102064860', 'imageRef': '1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '86f7a93f-5ae4-425e-80ec-b768782122ab'}]}}} Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise error Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 17 21:05:12.952492 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 17 21:05:12.956277 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 17 21:05:12.956277 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.956277 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 17 21:05:12.956277 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 17 21:05:12.956277 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.956277 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:12.956277 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.956277 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:12.956277 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:12.956277 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:12.956277 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:05:12.956277 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:05:12.956277 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:05:12.956277 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:05:12.956277 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:05:12.956277 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:05:12.956277 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 21:05:12.956277 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 21:05:12.956277 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 21:05:12.956277 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 21:05:12.956277 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 21:05:12.956277 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 21:05:12.956277 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 17 21:05:12.956277 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.956277 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:12.956277 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.956277 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:12.956277 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:12.956277 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:12.956277 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 21:05:12.956277 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 21:05:12.956277 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 17 21:05:12.956277 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:12.960408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dde9efcf-8cd3-4871-babc-99244314f82e tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:05:12.961523 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dde9efcf-8cd3-4871-babc-99244314f82e tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.034917 Sep 17 21:05:12.971806 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1746/3578] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:05:12 2022] POST /compute/v2.1/servers => generated 689 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:05:12.971806 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-25769a51-68d6-4a71-b362-12105a3d609b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:12.971806 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-25769a51-68d6-4a71-b362-12105a3d609b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:12.978016 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25769a51-68d6-4a71-b362-12105a3d609b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:12.978684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25769a51-68d6-4a71-b362-12105a3d609b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:12.979208 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25769a51-68d6-4a71-b362-12105a3d609b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:12.980104 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25769a51-68d6-4a71-b362-12105a3d609b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:12.980695 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25769a51-68d6-4a71-b362-12105a3d609b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:12.981858 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25769a51-68d6-4a71-b362-12105a3d609b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:13.502779 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-25769a51-68d6-4a71-b362-12105a3d609b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:13.519567 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-25769a51-68d6-4a71-b362-12105a3d609b tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1511 microversion: 2.1 time: 0.552611 Sep 17 21:05:13.521095 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1747/3579] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:12 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1511 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:13.542649 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-be04879f-8645-4eab-bd58-ec7de70e0926 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:13.543730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-be04879f-8645-4eab-bd58-ec7de70e0926 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] [instance: f1b3d010-7e10-40fd-936b-f3e04bdaf3fe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:13.554055 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be04879f-8645-4eab-bd58-ec7de70e0926 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:13.554506 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be04879f-8645-4eab-bd58-ec7de70e0926 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:13.554956 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be04879f-8645-4eab-bd58-ec7de70e0926 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:13.575249 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f3b866a5-0cb1-4d3a-81ee-fe6eca6047cc tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:13.577039 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be04879f-8645-4eab-bd58-ec7de70e0926 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:13.577691 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be04879f-8645-4eab-bd58-ec7de70e0926 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:13.578205 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-be04879f-8645-4eab-bd58-ec7de70e0926 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:13.593171 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f3b866a5-0cb1-4d3a-81ee-fe6eca6047cc tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29" status: 200 len: 1314 microversion: 2.1 time: 0.859117 Sep 17 21:05:13.594929 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1833/3580] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:12 2022] GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29 => generated 1314 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:13.610315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bddf6ff8-e193-4e8a-b1b4-0d39f41724bf tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-648594817", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "86f7a93f-5ae4-425e-80ec-b768782122ab"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:13.612237 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-be04879f-8645-4eab-bd58-ec7de70e0926 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] HTTP exception thrown: Instance f1b3d010-7e10-40fd-936b-f3e04bdaf3fe could not be found. Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-be04879f-8645-4eab-bd58-ec7de70e0926 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Request method failure captured: Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe HTTP/1.1 Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjZwK-9ZwgJ5YB6M-ga3uck8fvmwru9c0fkAXLx24e8zvPcA5yLjqQz5cqwlvDp3YyW4JI4hH8AsluuctA-RA6IruJCdg4h6TNFEojFcKPNGbkKf-ydKPWVBuu_4dcN5cOGqPzAzgNGS3e452qyhZbhXcqF5l-edWB01XUOB0TAepnY Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: X-Openstack-Nova-Api-Version: 2.21 Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 765dd4c95190458594be8f9a7915210e Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-InstanceActionsV221TestJSON-2135602318 Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765dd4c95190458594be8f9a7915210e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/765dd4c95190458594be8f9a7915210e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765dd4c95190458594be8f9a7915210e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_765dd4c95190458594be8f9a7915210e", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-InstanceActionsV221TestJSON-2135602318 Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 765dd4c95190458594be8f9a7915210e Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-2135602318 Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-InstanceActionsV221TestJSON-2135602318-project Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: e8f7671df52e4e95b829f03defeb6cf5 Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-InstanceActionsV221TestJSON-2135602318-project Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance f1b3d010-7e10-40fd-936b-f3e04bdaf3fe could not be found. Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'f1b3d010-7e10-40fd-936b-f3e04bdaf3fe'} Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1b3d010-7e10-40fd-936b-f3e04bdaf3fe could not be found. Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1b3d010-7e10-40fd-936b-f3e04bdaf3fe could not be found. Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.614553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:13.622408 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.622408 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:13.622408 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:13.622408 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:13.622408 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:05:13.622408 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:05:13.622408 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1b3d010-7e10-40fd-936b-f3e04bdaf3fe could not be found. Sep 17 21:05:13.622408 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.622408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-be04879f-8645-4eab-bd58-ec7de70e0926 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Returning 404 to user: Instance f1b3d010-7e10-40fd-936b-f3e04bdaf3fe could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:05:13.622408 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-be04879f-8645-4eab-bd58-ec7de70e0926 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] 10.222.0.26 "GET /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe" status: 404 len: 111 microversion: 2.21 time: 0.093923 Sep 17 21:05:13.622408 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1748/3581] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:05:13 2022] GET /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bddf6ff8-e193-4e8a-b1b4-0d39f41724bf tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Request method failure captured: Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 753 Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjZqoe0PXOijJjRcfZsMvSDwBU5DIIySY1pTE2MNzBETT2_zbwTXL-KDRBMgz0Yb_fK2lhNWSFGmnfLcXDMYi701mwoQyhnxbgKJnq9Wzd-cn76PiZlzvGkodY_o06Hxwbvl6AXhMFvdi4-x8HEPkrqNJjnVIz2RuZM6OeVfPNBe2qw Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 6cc3ec11e1374785afe8d3f73bc26891 Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1083745308 Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6cc3ec11e1374785afe8d3f73bc26891"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6cc3ec11e1374785afe8d3f73bc26891"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6cc3ec11e1374785afe8d3f73bc26891"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6cc3ec11e1374785afe8d3f73bc26891", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1083745308 Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 6cc3ec11e1374785afe8d3f73bc26891 Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1083745308 Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerMetadataNegativeTestJSON-1083745308-project Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 9e38b0461884497e8c5d399051b3d50e Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1083745308-project Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-648594817", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "86f7a93f-5ae4-425e-80ec-b768782122ab"}]}} Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-648594817', 'imageRef': '1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '86f7a93f-5ae4-425e-80ec-b768782122ab'}]}}} Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 21:05:13.630508 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise error Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 21:05:13.635126 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 21:05:13.640589 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 17 21:05:13.640589 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.640589 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bddf6ff8-e193-4e8a-b1b4-0d39f41724bf tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:05:13.640881 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-db8020a8-764c-4dc6-a2a7-f804b77548d8 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Calling method '.version_select at 0x7f25a4ca6430>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:13.641006 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bddf6ff8-e193-4e8a-b1b4-0d39f41724bf tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.031990 Sep 17 21:05:13.641111 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-db8020a8-764c-4dc6-a2a7-f804b77548d8 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] [instance: f1b3d010-7e10-40fd-936b-f3e04bdaf3fe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:13.641227 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1834/3582] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:05:13 2022] POST /compute/v2.1/servers => generated 1197 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 17 21:05:13.644836 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db8020a8-764c-4dc6-a2a7-f804b77548d8 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:13.645793 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db8020a8-764c-4dc6-a2a7-f804b77548d8 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:13.646244 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db8020a8-764c-4dc6-a2a7-f804b77548d8 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:13.647595 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db8020a8-764c-4dc6-a2a7-f804b77548d8 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:13.648073 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db8020a8-764c-4dc6-a2a7-f804b77548d8 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:13.648509 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db8020a8-764c-4dc6-a2a7-f804b77548d8 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:13.768234 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3cacb3b1-daf6-4827-86f5-b338f70cd652 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1231766456", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "86f7a93f-5ae4-425e-80ec-b768782122ab"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:13.770868 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-db8020a8-764c-4dc6-a2a7-f804b77548d8 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] 10.222.0.26 "GET /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.149083 Sep 17 21:05:13.771494 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1749/3583] 10.222.0.26 () {60 vars in 1337 bytes} [Sat Sep 17 21:05:13 2022] GET /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe/os-instance-actions => generated 611 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:05:13.785229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3cacb3b1-daf6-4827-86f5-b338f70cd652 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Request method failure captured: Sep 17 21:05:13.785229 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 17 21:05:13.785229 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:05:13.785229 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:05:13.785229 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:05:13.785229 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 1266 Sep 17 21:05:13.785229 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:05:13.785229 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:05:13.785229 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:05:13.785229 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:05:13.785229 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjZqoe0PXOijJjRcfZsMvSDwBU5DIIySY1pTE2MNzBETT2_zbwTXL-KDRBMgz0Yb_fK2lhNWSFGmnfLcXDMYi701mwoQyhnxbgKJnq9Wzd-cn76PiZlzvGkodY_o06Hxwbvl6AXhMFvdi4-x8HEPkrqNJjnVIz2RuZM6OeVfPNBe2qw Sep 17 21:05:13.785229 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:05:13.785229 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:05:13.785229 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:05:13.785229 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:05:13.785229 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:05:13.785229 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:05:13.785229 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 6cc3ec11e1374785afe8d3f73bc26891 Sep 17 21:05:13.785229 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1083745308 Sep 17 21:05:13.785229 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:05:13.785229 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:05:13.785229 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6cc3ec11e1374785afe8d3f73bc26891"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6cc3ec11e1374785afe8d3f73bc26891"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6cc3ec11e1374785afe8d3f73bc26891"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6cc3ec11e1374785afe8d3f73bc26891", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:05:13.785229 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1083745308 Sep 17 21:05:13.785229 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 6cc3ec11e1374785afe8d3f73bc26891 Sep 17 21:05:13.785229 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1083745308 Sep 17 21:05:13.785229 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerMetadataNegativeTestJSON-1083745308-project Sep 17 21:05:13.785229 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:05:13.785229 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:05:13.785229 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 9e38b0461884497e8c5d399051b3d50e Sep 17 21:05:13.785229 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1083745308-project Sep 17 21:05:13.785229 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:05:13.785229 ncdv-master-1 devstack@n-api.service[140524]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1231766456", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "86f7a93f-5ae4-425e-80ec-b768782122ab"}]}} Sep 17 21:05:13.785229 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:05:13.787742 ncdv-master-1 devstack@n-api.service[140524]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 17 21:05:13.787742 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1231766456', 'imageRef': '1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '86f7a93f-5ae4-425e-80ec-b768782122ab'}]}}} Sep 17 21:05:13.787742 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:05:13.787742 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:13.787742 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 21:05:13.787742 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 21:05:13.787742 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 21:05:13.787742 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise error Sep 17 21:05:13.787742 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 17 21:05:13.787742 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.787742 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 17 21:05:13.787742 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 17 21:05:13.787742 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 17 21:05:13.787742 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 17 21:05:13.787742 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 17 21:05:13.787742 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.787742 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 17 21:05:13.788993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 17 21:05:13.788993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.788993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:13.788993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.788993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:13.788993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:13.788993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:13.788993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:05:13.788993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:05:13.788993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:05:13.788993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:05:13.788993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:05:13.788993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:05:13.788993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 21:05:13.788993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 21:05:13.788993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 21:05:13.788993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 21:05:13.788993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 21:05:13.788993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 21:05:13.788993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 17 21:05:13.788993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.788993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:13.788993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.788993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:13.788993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:13.788993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:13.788993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 21:05:13.788993 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 21:05:13.793432 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 17 21:05:13.793432 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.793817 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d437e6ea-23a4-480f-9800-0ea41d1e874d tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:13.793817 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d437e6ea-23a4-480f-9800-0ea41d1e874d tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] [instance: f1b3d010-7e10-40fd-936b-f3e04bdaf3fe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:13.796589 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3cacb3b1-daf6-4827-86f5-b338f70cd652 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:05:13.798156 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3cacb3b1-daf6-4827-86f5-b338f70cd652 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.041095 Sep 17 21:05:13.799368 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1835/3584] 10.222.0.26 () {60 vars in 1148 bytes} [Sat Sep 17 21:05:13 2022] POST /compute/v2.1/servers => generated 2221 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Sep 17 21:05:13.806171 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d437e6ea-23a4-480f-9800-0ea41d1e874d tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:13.807158 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d437e6ea-23a4-480f-9800-0ea41d1e874d tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:13.808077 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d437e6ea-23a4-480f-9800-0ea41d1e874d tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:13.809331 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d437e6ea-23a4-480f-9800-0ea41d1e874d tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:13.810070 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d437e6ea-23a4-480f-9800-0ea41d1e874d tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:13.810999 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d437e6ea-23a4-480f-9800-0ea41d1e874d tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:13.822397 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7217216a-2344-4971-8a7b-13015beba3e3 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:13.825019 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7217216a-2344-4971-8a7b-13015beba3e3 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] [instance: c49c7add-57be-42a6-bda9-046160461742] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:13.829101 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-d437e6ea-23a4-480f-9800-0ea41d1e874d tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] HTTP exception thrown: Instance f1b3d010-7e10-40fd-936b-f3e04bdaf3fe could not be found. Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d437e6ea-23a4-480f-9800-0ea41d1e874d tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Request method failure captured: Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe HTTP/1.1 Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjZwK-9ZwgJ5YB6M-ga3uck8fvmwru9c0fkAXLx24e8zvPcA5yLjqQz5cqwlvDp3YyW4JI4hH8AsluuctA-RA6IruJCdg4h6TNFEojFcKPNGbkKf-ydKPWVBuu_4dcN5cOGqPzAzgNGS3e452qyhZbhXcqF5l-edWB01XUOB0TAepnY Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: X-Openstack-Nova-Api-Version: 2.21 Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 765dd4c95190458594be8f9a7915210e Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-InstanceActionsV221TestJSON-2135602318 Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765dd4c95190458594be8f9a7915210e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/765dd4c95190458594be8f9a7915210e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765dd4c95190458594be8f9a7915210e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_765dd4c95190458594be8f9a7915210e", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-InstanceActionsV221TestJSON-2135602318 Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 765dd4c95190458594be8f9a7915210e Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-2135602318 Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-InstanceActionsV221TestJSON-2135602318-project Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: e8f7671df52e4e95b829f03defeb6cf5 Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-InstanceActionsV221TestJSON-2135602318-project Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance f1b3d010-7e10-40fd-936b-f3e04bdaf3fe could not be found. Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'f1b3d010-7e10-40fd-936b-f3e04bdaf3fe'} Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1b3d010-7e10-40fd-936b-f3e04bdaf3fe could not be found. Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:05:13.830788 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:05:13.835805 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1b3d010-7e10-40fd-936b-f3e04bdaf3fe could not be found. Sep 17 21:05:13.835805 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.835805 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:13.835805 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.835805 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:13.835805 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:13.835805 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:13.835805 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:05:13.835805 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:05:13.835805 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1b3d010-7e10-40fd-936b-f3e04bdaf3fe could not be found. Sep 17 21:05:13.835805 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.835805 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d437e6ea-23a4-480f-9800-0ea41d1e874d tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Returning 404 to user: Instance f1b3d010-7e10-40fd-936b-f3e04bdaf3fe could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:05:13.835805 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d437e6ea-23a4-480f-9800-0ea41d1e874d tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe" status: 404 len: 111 microversion: 2.21 time: 0.050714 Sep 17 21:05:13.836926 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-7217216a-2344-4971-8a7b-13015beba3e3 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] HTTP exception thrown: Instance c49c7add-57be-42a6-bda9-046160461742 could not be found. Sep 17 21:05:13.837039 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1750/3585] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 17 21:05:13 2022] DELETE /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 17 21:05:13.841739 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4e770354-b350-468d-9807-3757364d7687 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:13.842848 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4e770354-b350-468d-9807-3757364d7687 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] [instance: f1b3d010-7e10-40fd-936b-f3e04bdaf3fe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7217216a-2344-4971-8a7b-13015beba3e3 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Request method failure captured: Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/c49c7add-57be-42a6-bda9-046160461742/metadata/test2 HTTP/1.1 Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjZqoe0PXOijJjRcfZsMvSDwBU5DIIySY1pTE2MNzBETT2_zbwTXL-KDRBMgz0Yb_fK2lhNWSFGmnfLcXDMYi701mwoQyhnxbgKJnq9Wzd-cn76PiZlzvGkodY_o06Hxwbvl6AXhMFvdi4-x8HEPkrqNJjnVIz2RuZM6OeVfPNBe2qw Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 6cc3ec11e1374785afe8d3f73bc26891 Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1083745308 Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6cc3ec11e1374785afe8d3f73bc26891"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6cc3ec11e1374785afe8d3f73bc26891"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6cc3ec11e1374785afe8d3f73bc26891"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6cc3ec11e1374785afe8d3f73bc26891", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1083745308 Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 6cc3ec11e1374785afe8d3f73bc26891 Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1083745308 Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerMetadataNegativeTestJSON-1083745308-project Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 9e38b0461884497e8c5d399051b3d50e Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1083745308-project Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance c49c7add-57be-42a6-bda9-046160461742 could not be found. Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'server_id': 'c49c7add-57be-42a6-bda9-046160461742', 'id': 'test2'} Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c49c7add-57be-42a6-bda9-046160461742 could not be found. Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c49c7add-57be-42a6-bda9-046160461742 could not be found. Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:13.846019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:13.851685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:05:13.851685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:05:13.851685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c49c7add-57be-42a6-bda9-046160461742 could not be found. Sep 17 21:05:13.851685 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.853944 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7217216a-2344-4971-8a7b-13015beba3e3 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Returning 404 to user: Instance c49c7add-57be-42a6-bda9-046160461742 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:05:13.854396 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e770354-b350-468d-9807-3757364d7687 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:13.854987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e770354-b350-468d-9807-3757364d7687 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:13.855557 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e770354-b350-468d-9807-3757364d7687 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:13.856080 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7217216a-2344-4971-8a7b-13015beba3e3 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] 10.222.0.26 "GET /compute/v2.1/servers/c49c7add-57be-42a6-bda9-046160461742/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.044468 Sep 17 21:05:13.856537 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e770354-b350-468d-9807-3757364d7687 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:13.856676 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1836/3586] 10.222.0.26 () {58 vars in 1281 bytes} [Sat Sep 17 21:05:13 2022] GET /compute/v2.1/servers/c49c7add-57be-42a6-bda9-046160461742/metadata/test2 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 21:05:13.866188 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e770354-b350-468d-9807-3757364d7687 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:13.866939 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e770354-b350-468d-9807-3757364d7687 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:13.873843 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f903beb8-9abf-4879-ae43-9934910e46e5 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:13.874497 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f903beb8-9abf-4879-ae43-9934910e46e5 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] [instance: 9b067088-a9ba-43cd-9775-8c54ba91ef6f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:13.884943 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-4e770354-b350-468d-9807-3757364d7687 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] HTTP exception thrown: Instance f1b3d010-7e10-40fd-936b-f3e04bdaf3fe could not be found. Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4e770354-b350-468d-9807-3757364d7687 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Request method failure captured: Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe HTTP/1.1 Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjZwK-9ZwgJ5YB6M-ga3uck8fvmwru9c0fkAXLx24e8zvPcA5yLjqQz5cqwlvDp3YyW4JI4hH8AsluuctA-RA6IruJCdg4h6TNFEojFcKPNGbkKf-ydKPWVBuu_4dcN5cOGqPzAzgNGS3e452qyhZbhXcqF5l-edWB01XUOB0TAepnY Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: X-Openstack-Nova-Api-Version: 2.21 Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 765dd4c95190458594be8f9a7915210e Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-InstanceActionsV221TestJSON-2135602318 Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765dd4c95190458594be8f9a7915210e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/765dd4c95190458594be8f9a7915210e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/765dd4c95190458594be8f9a7915210e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_765dd4c95190458594be8f9a7915210e", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-InstanceActionsV221TestJSON-2135602318 Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 765dd4c95190458594be8f9a7915210e Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-2135602318 Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-InstanceActionsV221TestJSON-2135602318-project Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: e8f7671df52e4e95b829f03defeb6cf5 Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-InstanceActionsV221TestJSON-2135602318-project Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance f1b3d010-7e10-40fd-936b-f3e04bdaf3fe could not be found. Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'f1b3d010-7e10-40fd-936b-f3e04bdaf3fe'} Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1b3d010-7e10-40fd-936b-f3e04bdaf3fe could not be found. Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1b3d010-7e10-40fd-936b-f3e04bdaf3fe could not be found. Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.892489 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:13.896943 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.896943 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:13.896943 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:13.896943 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:13.896943 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:05:13.896943 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:05:13.896943 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1b3d010-7e10-40fd-936b-f3e04bdaf3fe could not be found. Sep 17 21:05:13.896943 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:13.896943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4e770354-b350-468d-9807-3757364d7687 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] Returning 404 to user: Instance f1b3d010-7e10-40fd-936b-f3e04bdaf3fe could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:05:13.896943 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4e770354-b350-468d-9807-3757364d7687 tempest-InstanceActionsV221TestJSON-2135602318 tempest-InstanceActionsV221TestJSON-2135602318-project] 10.222.0.26 "GET /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe" status: 404 len: 111 microversion: 2.21 time: 0.056288 Sep 17 21:05:13.896943 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1751/3587] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:05:13 2022] GET /compute/v2.1/servers/f1b3d010-7e10-40fd-936b-f3e04bdaf3fe => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:05:13.913547 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:13.918141 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f903beb8-9abf-4879-ae43-9934910e46e5 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:13.919033 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f903beb8-9abf-4879-ae43-9934910e46e5 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:13.919556 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f903beb8-9abf-4879-ae43-9934910e46e5 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:13.922616 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f903beb8-9abf-4879-ae43-9934910e46e5 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:13.923892 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f903beb8-9abf-4879-ae43-9934910e46e5 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:13.924616 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f903beb8-9abf-4879-ae43-9934910e46e5 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:13.978311 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f903beb8-9abf-4879-ae43-9934910e46e5 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] [instance: 9b067088-a9ba-43cd-9775-8c54ba91ef6f] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:05:14.133328 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f903beb8-9abf-4879-ae43-9934910e46e5 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f" status: 204 len: 0 microversion: 2.1 time: 0.263044 Sep 17 21:05:14.134569 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1837/3588] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:05:13 2022] DELETE /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 17 21:05:14.146742 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a3414d35-0bc6-486a-980e-8ee182ac6e88 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:14.147463 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a3414d35-0bc6-486a-980e-8ee182ac6e88 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] [instance: 9b067088-a9ba-43cd-9775-8c54ba91ef6f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:14.154352 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3414d35-0bc6-486a-980e-8ee182ac6e88 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:14.154985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3414d35-0bc6-486a-980e-8ee182ac6e88 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:14.155570 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3414d35-0bc6-486a-980e-8ee182ac6e88 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:14.156678 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3414d35-0bc6-486a-980e-8ee182ac6e88 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:14.157320 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3414d35-0bc6-486a-980e-8ee182ac6e88 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:14.157894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3414d35-0bc6-486a-980e-8ee182ac6e88 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:14.373623 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a3414d35-0bc6-486a-980e-8ee182ac6e88 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e38b0461884497e8c5d399051b3d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc3ec11e1374785afe8d3f73bc26891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:14.385741 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a3414d35-0bc6-486a-980e-8ee182ac6e88 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] 10.222.0.26 "GET /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f" status: 200 len: 1526 microversion: 2.1 time: 0.245846 Sep 17 21:05:14.390622 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1752/3589] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:14 2022] GET /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f => generated 1526 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:14.448577 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1485f392-9e1c-4207-a642-18ed2f02149f tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:14.449289 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1485f392-9e1c-4207-a642-18ed2f02149f tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] [instance: 39726f64-c35f-43a9-8ca2-6efc128162ee] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:14.454399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-942ea788-cc97-4aad-9bca-2831a733f73a req-cdd87f29-5c5a-49a2-85f3-b05a8ff7d8a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39726f64-c35f-43a9-8ca2-6efc128162ee", "tag": "0a4de968-f735-40a2-90dc-6ce02c2af575"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:14.482731 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1485f392-9e1c-4207-a642-18ed2f02149f tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:14.483253 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1485f392-9e1c-4207-a642-18ed2f02149f tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:14.483774 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1485f392-9e1c-4207-a642-18ed2f02149f tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:14.486640 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-942ea788-cc97-4aad-9bca-2831a733f73a req-cdd87f29-5c5a-49a2-85f3-b05a8ff7d8a4 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:14.487519 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1485f392-9e1c-4207-a642-18ed2f02149f tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:14.488048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1485f392-9e1c-4207-a642-18ed2f02149f tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:14.488807 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-942ea788-cc97-4aad-9bca-2831a733f73a req-cdd87f29-5c5a-49a2-85f3-b05a8ff7d8a4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:14.489897 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1485f392-9e1c-4207-a642-18ed2f02149f tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:14.490495 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-942ea788-cc97-4aad-9bca-2831a733f73a req-cdd87f29-5c5a-49a2-85f3-b05a8ff7d8a4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:14.537949 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-942ea788-cc97-4aad-9bca-2831a733f73a req-cdd87f29-5c5a-49a2-85f3-b05a8ff7d8a4 service nova] Creating event network-changed:0a4de968-f735-40a2-90dc-6ce02c2af575 for instance 39726f64-c35f-43a9-8ca2-6efc128162ee on nch1-master-1 Sep 17 21:05:14.557529 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-942ea788-cc97-4aad-9bca-2831a733f73a req-cdd87f29-5c5a-49a2-85f3-b05a8ff7d8a4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106613 Sep 17 21:05:14.558241 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1753/3590] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:14.589315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cedaeb41-eee0-4bbd-9c0d-2aacf7be5276 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:14.590774 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cedaeb41-eee0-4bbd-9c0d-2aacf7be5276 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:14.607021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cedaeb41-eee0-4bbd-9c0d-2aacf7be5276 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:14.607550 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cedaeb41-eee0-4bbd-9c0d-2aacf7be5276 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:14.612407 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cedaeb41-eee0-4bbd-9c0d-2aacf7be5276 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:14.621714 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cedaeb41-eee0-4bbd-9c0d-2aacf7be5276 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:14.624818 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cedaeb41-eee0-4bbd-9c0d-2aacf7be5276 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:14.625644 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cedaeb41-eee0-4bbd-9c0d-2aacf7be5276 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:14.754829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1485f392-9e1c-4207-a642-18ed2f02149f tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd454c25ddef46d993ff15440a64a438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130f997fde494ab887281d866d6aec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:14.771445 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1485f392-9e1c-4207-a642-18ed2f02149f tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] 10.222.0.26 "GET /compute/v2.1/servers/39726f64-c35f-43a9-8ca2-6efc128162ee" status: 200 len: 1591 microversion: 2.1 time: 0.327251 Sep 17 21:05:14.781599 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1838/3591] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:14 2022] GET /compute/v2.1/servers/39726f64-c35f-43a9-8ca2-6efc128162ee => generated 1591 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:14.781599 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bfc05a9f-b369-42b5-80bf-4e7b49e478a3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:14.793486 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bfc05a9f-b369-42b5-80bf-4e7b49e478a3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: d131d8e1-8f52-4d1f-8f88-46b1aef06e29] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:14.794678 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bfc05a9f-b369-42b5-80bf-4e7b49e478a3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:14.795176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bfc05a9f-b369-42b5-80bf-4e7b49e478a3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:14.796033 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bfc05a9f-b369-42b5-80bf-4e7b49e478a3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:14.797021 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bfc05a9f-b369-42b5-80bf-4e7b49e478a3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:14.797674 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bfc05a9f-b369-42b5-80bf-4e7b49e478a3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:14.798363 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bfc05a9f-b369-42b5-80bf-4e7b49e478a3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:14.923438 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cedaeb41-eee0-4bbd-9c0d-2aacf7be5276 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:14.934452 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cedaeb41-eee0-4bbd-9c0d-2aacf7be5276 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1511 microversion: 2.1 time: 0.357693 Sep 17 21:05:14.937601 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1754/3592] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:14 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1511 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:15.014715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bfc05a9f-b369-42b5-80bf-4e7b49e478a3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:15.028171 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bfc05a9f-b369-42b5-80bf-4e7b49e478a3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29" status: 200 len: 1501 microversion: 2.1 time: 0.249439 Sep 17 21:05:15.029637 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1839/3593] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:14 2022] GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29 => generated 1501 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:15.060271 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7e3d8cd2-d9bb-4f11-a872-e5846fd6f767 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:15.069156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7e3d8cd2-d9bb-4f11-a872-e5846fd6f767 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:15.069156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7e3d8cd2-d9bb-4f11-a872-e5846fd6f767 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:15.069156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7e3d8cd2-d9bb-4f11-a872-e5846fd6f767 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:15.131228 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7e3d8cd2-d9bb-4f11-a872-e5846fd6f767 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: d131d8e1-8f52-4d1f-8f88-46b1aef06e29] Going to try to stop instance {{(pid=140523) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 17 21:05:15.212775 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7e3d8cd2-d9bb-4f11-a872-e5846fd6f767 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29/action" status: 202 len: 0 microversion: 2.1 time: 0.163425 Sep 17 21:05:15.216977 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1755/3594] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:05:15 2022] POST /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:05:15.221955 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ec9bdab5-98bf-4f8c-af02-2c93318ba761 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:15.222872 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ec9bdab5-98bf-4f8c-af02-2c93318ba761 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: d131d8e1-8f52-4d1f-8f88-46b1aef06e29] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:15.235729 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ec9bdab5-98bf-4f8c-af02-2c93318ba761 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:15.238981 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ec9bdab5-98bf-4f8c-af02-2c93318ba761 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:15.239426 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ec9bdab5-98bf-4f8c-af02-2c93318ba761 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:15.240170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ec9bdab5-98bf-4f8c-af02-2c93318ba761 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:15.240690 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ec9bdab5-98bf-4f8c-af02-2c93318ba761 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:15.241059 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ec9bdab5-98bf-4f8c-af02-2c93318ba761 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:15.413100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-558ad4d3-50b3-4c63-a106-3680ff9e1434 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:15.413744 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-558ad4d3-50b3-4c63-a106-3680ff9e1434 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] [instance: 9b067088-a9ba-43cd-9775-8c54ba91ef6f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:15.425855 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-558ad4d3-50b3-4c63-a106-3680ff9e1434 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:15.431739 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-558ad4d3-50b3-4c63-a106-3680ff9e1434 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:15.432041 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-558ad4d3-50b3-4c63-a106-3680ff9e1434 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:15.432806 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-558ad4d3-50b3-4c63-a106-3680ff9e1434 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:15.433726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-558ad4d3-50b3-4c63-a106-3680ff9e1434 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:15.433726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-558ad4d3-50b3-4c63-a106-3680ff9e1434 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:15.990392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ec9bdab5-98bf-4f8c-af02-2c93318ba761 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:16.002923 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ec9bdab5-98bf-4f8c-af02-2c93318ba761 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29" status: 200 len: 1511 microversion: 2.1 time: 0.784609 Sep 17 21:05:16.004874 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1840/3595] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:15 2022] GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29 => generated 1511 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:16.016756 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0f4affa8-903f-4cb1-9b31-6a5f5ddc8332 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:16.020003 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0f4affa8-903f-4cb1-9b31-6a5f5ddc8332 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:16.030542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f4affa8-903f-4cb1-9b31-6a5f5ddc8332 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:16.031047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f4affa8-903f-4cb1-9b31-6a5f5ddc8332 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:16.033693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f4affa8-903f-4cb1-9b31-6a5f5ddc8332 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:16.038238 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f4affa8-903f-4cb1-9b31-6a5f5ddc8332 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:16.038701 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f4affa8-903f-4cb1-9b31-6a5f5ddc8332 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:16.039218 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f4affa8-903f-4cb1-9b31-6a5f5ddc8332 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:16.121993 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-558ad4d3-50b3-4c63-a106-3680ff9e1434 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e38b0461884497e8c5d399051b3d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc3ec11e1374785afe8d3f73bc26891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:16.139899 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-558ad4d3-50b3-4c63-a106-3680ff9e1434 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] 10.222.0.26 "GET /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f" status: 200 len: 1526 microversion: 2.1 time: 0.731087 Sep 17 21:05:16.142245 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1756/3596] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:15 2022] GET /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f => generated 1526 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:16.619995 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0f4affa8-903f-4cb1-9b31-6a5f5ddc8332 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:16.629926 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0f4affa8-903f-4cb1-9b31-6a5f5ddc8332 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1511 microversion: 2.1 time: 0.623927 Sep 17 21:05:16.630648 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1841/3597] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:16 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1511 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:17.039657 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e9d7cae7-9bdc-4a08-9ea8-ecea61b52fa4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:17.040608 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e9d7cae7-9bdc-4a08-9ea8-ecea61b52fa4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: d131d8e1-8f52-4d1f-8f88-46b1aef06e29] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:17.065594 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9d7cae7-9bdc-4a08-9ea8-ecea61b52fa4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:17.066192 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9d7cae7-9bdc-4a08-9ea8-ecea61b52fa4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:17.066651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9d7cae7-9bdc-4a08-9ea8-ecea61b52fa4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:17.074562 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9d7cae7-9bdc-4a08-9ea8-ecea61b52fa4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:17.077490 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9d7cae7-9bdc-4a08-9ea8-ecea61b52fa4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:17.078565 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9d7cae7-9bdc-4a08-9ea8-ecea61b52fa4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:17.164923 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8be517f3-142d-4dcf-a9cf-596e82ebad56 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:17.165599 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8be517f3-142d-4dcf-a9cf-596e82ebad56 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] [instance: 9b067088-a9ba-43cd-9775-8c54ba91ef6f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:17.176086 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8be517f3-142d-4dcf-a9cf-596e82ebad56 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:17.176595 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8be517f3-142d-4dcf-a9cf-596e82ebad56 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:17.177046 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8be517f3-142d-4dcf-a9cf-596e82ebad56 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:17.179128 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8be517f3-142d-4dcf-a9cf-596e82ebad56 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:17.179403 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:17.179872 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8be517f3-142d-4dcf-a9cf-596e82ebad56 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:17.180045 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8be517f3-142d-4dcf-a9cf-596e82ebad56 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:17.399381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8be517f3-142d-4dcf-a9cf-596e82ebad56 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e38b0461884497e8c5d399051b3d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc3ec11e1374785afe8d3f73bc26891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:17.413615 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8be517f3-142d-4dcf-a9cf-596e82ebad56 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] 10.222.0.26 "GET /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f" status: 200 len: 1484 microversion: 2.1 time: 0.253277 Sep 17 21:05:17.434432 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1842/3598] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:17 2022] GET /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f => generated 1484 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:17.444661 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-9bd42bb7-f794-4fd9-8b4b-7e95c1a48f8b req-e56def91-3160-44e4-b3f0-a8ea9330f2dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b986fa2-07ea-4418-adf2-0a5fa127e84a", "name": "network-vif-deleted", "tag": "f698d869-5f6d-4d34-95fa-00bb9569ec58"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:17.469876 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-9bd42bb7-f794-4fd9-8b4b-7e95c1a48f8b req-e56def91-3160-44e4-b3f0-a8ea9330f2dc service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:17.470581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-9bd42bb7-f794-4fd9-8b4b-7e95c1a48f8b req-e56def91-3160-44e4-b3f0-a8ea9330f2dc service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:17.471111 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-9bd42bb7-f794-4fd9-8b4b-7e95c1a48f8b req-e56def91-3160-44e4-b3f0-a8ea9330f2dc service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:17.495634 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-9bd42bb7-f794-4fd9-8b4b-7e95c1a48f8b req-e56def91-3160-44e4-b3f0-a8ea9330f2dc service nova] Creating event network-vif-deleted:f698d869-5f6d-4d34-95fa-00bb9569ec58 for instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a on nch2-master-1 Sep 17 21:05:17.508545 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-9bd42bb7-f794-4fd9-8b4b-7e95c1a48f8b req-e56def91-3160-44e4-b3f0-a8ea9330f2dc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072706 Sep 17 21:05:17.513417 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1843/3599] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:17.525742 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-a6023fae-e09a-4e83-a400-ec1e8c728beb req-e7129f46-d775-421c-969f-bdadb2fb427f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b067088-a9ba-43cd-9775-8c54ba91ef6f", "name": "network-vif-deleted", "tag": "63f8d9ca-5b51-4cf8-84b7-f21f7f475682"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:17.540809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a6023fae-e09a-4e83-a400-ec1e8c728beb req-e7129f46-d775-421c-969f-bdadb2fb427f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:17.541667 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a6023fae-e09a-4e83-a400-ec1e8c728beb req-e7129f46-d775-421c-969f-bdadb2fb427f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:17.542408 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a6023fae-e09a-4e83-a400-ec1e8c728beb req-e7129f46-d775-421c-969f-bdadb2fb427f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:17.565991 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-a6023fae-e09a-4e83-a400-ec1e8c728beb req-e7129f46-d775-421c-969f-bdadb2fb427f service nova] Creating event network-vif-deleted:63f8d9ca-5b51-4cf8-84b7-f21f7f475682 for instance 9b067088-a9ba-43cd-9775-8c54ba91ef6f on nch2-master-1 Sep 17 21:05:17.574313 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-a6023fae-e09a-4e83-a400-ec1e8c728beb req-e7129f46-d775-421c-969f-bdadb2fb427f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058825 Sep 17 21:05:17.575239 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1844/3600] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:17.656601 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1f7fb1b7-330f-4a05-8195-82d80176fc48 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:17.657411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1f7fb1b7-330f-4a05-8195-82d80176fc48 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:17.667154 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f7fb1b7-330f-4a05-8195-82d80176fc48 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:17.668447 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f7fb1b7-330f-4a05-8195-82d80176fc48 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:17.669130 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f7fb1b7-330f-4a05-8195-82d80176fc48 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:17.670103 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f7fb1b7-330f-4a05-8195-82d80176fc48 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:17.670867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f7fb1b7-330f-4a05-8195-82d80176fc48 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:17.671493 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f7fb1b7-330f-4a05-8195-82d80176fc48 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:17.731670 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f7fb1b7-330f-4a05-8195-82d80176fc48 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:17.732275 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f7fb1b7-330f-4a05-8195-82d80176fc48 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:17.732785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f7fb1b7-330f-4a05-8195-82d80176fc48 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:17.733321 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-1f7fb1b7-330f-4a05-8195-82d80176fc48 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lazy-loading 'fault' on Instance uuid 9b986fa2-07ea-4418-adf2-0a5fa127e84a {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:05:17.883254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1f7fb1b7-330f-4a05-8195-82d80176fc48 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33fa2d463884464fbe90666c98da0fd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36ce01157eec446dbcc93b2948b4be90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:17.894144 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1f7fb1b7-330f-4a05-8195-82d80176fc48 tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 200 len: 1307 microversion: 2.1 time: 0.241287 Sep 17 21:05:17.896717 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e9d7cae7-9bdc-4a08-9ea8-ecea61b52fa4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:17.908488 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e9d7cae7-9bdc-4a08-9ea8-ecea61b52fa4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29" status: 200 len: 1511 microversion: 2.1 time: 0.873854 Sep 17 21:05:17.921973 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1845/3601] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:17 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 1307 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:17.931807 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1757/3602] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:17 2022] GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29 => generated 1511 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:18.442105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b1c2596c-1e86-4d93-9e3f-46b10ce7d579 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:18.443500 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b1c2596c-1e86-4d93-9e3f-46b10ce7d579 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] [instance: 9b067088-a9ba-43cd-9775-8c54ba91ef6f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:18.455381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1c2596c-1e86-4d93-9e3f-46b10ce7d579 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:18.456368 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1c2596c-1e86-4d93-9e3f-46b10ce7d579 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:18.457037 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1c2596c-1e86-4d93-9e3f-46b10ce7d579 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:18.458029 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1c2596c-1e86-4d93-9e3f-46b10ce7d579 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:18.459499 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1c2596c-1e86-4d93-9e3f-46b10ce7d579 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:18.460121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1c2596c-1e86-4d93-9e3f-46b10ce7d579 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:18.571016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1c2596c-1e86-4d93-9e3f-46b10ce7d579 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:18.573765 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1c2596c-1e86-4d93-9e3f-46b10ce7d579 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:18.575110 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1c2596c-1e86-4d93-9e3f-46b10ce7d579 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:18.576733 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-b1c2596c-1e86-4d93-9e3f-46b10ce7d579 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lazy-loading 'fault' on Instance uuid 9b067088-a9ba-43cd-9775-8c54ba91ef6f {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:05:18.921425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-372f7e7f-6183-46e8-b722-cf28ec36392c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:18.922765 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-372f7e7f-6183-46e8-b722-cf28ec36392c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] [instance: 9b986fa2-07ea-4418-adf2-0a5fa127e84a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:18.938457 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-372f7e7f-6183-46e8-b722-cf28ec36392c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:18.939198 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-372f7e7f-6183-46e8-b722-cf28ec36392c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:18.940374 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-372f7e7f-6183-46e8-b722-cf28ec36392c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:18.941179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-372f7e7f-6183-46e8-b722-cf28ec36392c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:18.943915 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-372f7e7f-6183-46e8-b722-cf28ec36392c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:18.946468 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-372f7e7f-6183-46e8-b722-cf28ec36392c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:18.986681 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-372f7e7f-6183-46e8-b722-cf28ec36392c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] HTTP exception thrown: Instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a could not be found. Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-372f7e7f-6183-46e8-b722-cf28ec36392c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Request method failure captured: Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a HTTP/1.1 Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjV0MtWULKnXFuw0eeDgKDpDmZwj5PBmoe2ZV6j-j5VeBHPnacxQK2Paa6Z7oUhJ5LlHHofJZarO9tblefYzmQ4Hqv5pzx_5GLErVXWbqphjjh8NdFl-GQi0kkPzI7AIAv7Kwe7jt5hJ3uNYWmNED8kzcwv2npL6256o5QzFqXpYFx0 Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/36ce01157eec446dbcc93b2948b4be90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_36ce01157eec446dbcc93b2948b4be90", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 36ce01157eec446dbcc93b2948b4be90 Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersNegativeTestJSON-33808428 Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 33fa2d463884464fbe90666c98da0fd7 Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersNegativeTestJSON-33808428-project Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a could not be found. Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '9b986fa2-07ea-4418-adf2-0a5fa127e84a'} Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a could not be found. Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a could not be found. Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:18.988673 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:18.994168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:18.994168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:18.994168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:18.994168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:05:18.994168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:05:18.994168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a could not be found. Sep 17 21:05:18.994168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:05:18.994168 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-372f7e7f-6183-46e8-b722-cf28ec36392c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] Returning 404 to user: Instance 9b986fa2-07ea-4418-adf2-0a5fa127e84a could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:05:18.994869 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-372f7e7f-6183-46e8-b722-cf28ec36392c tempest-ServersNegativeTestJSON-33808428 tempest-ServersNegativeTestJSON-33808428-project] 10.222.0.26 "GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a" status: 404 len: 111 microversion: 2.1 time: 0.077171 Sep 17 21:05:18.995848 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1758/3603] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:18 2022] GET /compute/v2.1/servers/9b986fa2-07ea-4418-adf2-0a5fa127e84a => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:05:19.010079 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-352afc83-d2ef-4d58-bc88-e2cbfac7c165 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:19.011349 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-352afc83-d2ef-4d58-bc88-e2cbfac7c165 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: d131d8e1-8f52-4d1f-8f88-46b1aef06e29] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:19.015795 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b1c2596c-1e86-4d93-9e3f-46b10ce7d579 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e38b0461884497e8c5d399051b3d50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6cc3ec11e1374785afe8d3f73bc26891', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:19.018839 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-352afc83-d2ef-4d58-bc88-e2cbfac7c165 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:19.019611 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-352afc83-d2ef-4d58-bc88-e2cbfac7c165 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:19.020359 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-352afc83-d2ef-4d58-bc88-e2cbfac7c165 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:19.021573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-352afc83-d2ef-4d58-bc88-e2cbfac7c165 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:19.022326 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-352afc83-d2ef-4d58-bc88-e2cbfac7c165 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:19.023136 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-352afc83-d2ef-4d58-bc88-e2cbfac7c165 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:19.026193 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b1c2596c-1e86-4d93-9e3f-46b10ce7d579 tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] 10.222.0.26 "GET /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f" status: 200 len: 1314 microversion: 2.1 time: 0.590927 Sep 17 21:05:19.045496 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1846/3604] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:18 2022] GET /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f => generated 1314 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:19.747576 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-352afc83-d2ef-4d58-bc88-e2cbfac7c165 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:19.763280 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-352afc83-d2ef-4d58-bc88-e2cbfac7c165 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29" status: 200 len: 1511 microversion: 2.1 time: 0.762736 Sep 17 21:05:19.764741 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1759/3605] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:18 2022] GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29 => generated 1511 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:20.060845 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0abd56e6-5d39-4a50-ad7a-97d5caa19cca tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:20.073996 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0abd56e6-5d39-4a50-ad7a-97d5caa19cca tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] [instance: 9b067088-a9ba-43cd-9775-8c54ba91ef6f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:20.115060 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0abd56e6-5d39-4a50-ad7a-97d5caa19cca tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:20.118443 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0abd56e6-5d39-4a50-ad7a-97d5caa19cca tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:20.120765 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0abd56e6-5d39-4a50-ad7a-97d5caa19cca tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:20.121603 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0abd56e6-5d39-4a50-ad7a-97d5caa19cca tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:20.122096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0abd56e6-5d39-4a50-ad7a-97d5caa19cca tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:20.122536 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0abd56e6-5d39-4a50-ad7a-97d5caa19cca tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:20.163018 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-0abd56e6-5d39-4a50-ad7a-97d5caa19cca tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] HTTP exception thrown: Instance 9b067088-a9ba-43cd-9775-8c54ba91ef6f could not be found. Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0abd56e6-5d39-4a50-ad7a-97d5caa19cca tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Request method failure captured: Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f HTTP/1.1 Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjZqoe0PXOijJjRcfZsMvSDwBU5DIIySY1pTE2MNzBETT2_zbwTXL-KDRBMgz0Yb_fK2lhNWSFGmnfLcXDMYi701mwoQyhnxbgKJnq9Wzd-cn76PiZlzvGkodY_o06Hxwbvl6AXhMFvdi4-x8HEPkrqNJjnVIz2RuZM6OeVfPNBe2qw Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 6cc3ec11e1374785afe8d3f73bc26891 Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1083745308 Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6cc3ec11e1374785afe8d3f73bc26891"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6cc3ec11e1374785afe8d3f73bc26891"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6cc3ec11e1374785afe8d3f73bc26891"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6cc3ec11e1374785afe8d3f73bc26891", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1083745308 Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 6cc3ec11e1374785afe8d3f73bc26891 Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1083745308 Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerMetadataNegativeTestJSON-1083745308-project Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 9e38b0461884497e8c5d399051b3d50e Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1083745308-project Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 9b067088-a9ba-43cd-9775-8c54ba91ef6f could not be found. Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '9b067088-a9ba-43cd-9775-8c54ba91ef6f'} Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b067088-a9ba-43cd-9775-8c54ba91ef6f could not be found. Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b067088-a9ba-43cd-9775-8c54ba91ef6f could not be found. Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:20.166331 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:05:20.173057 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:20.173057 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:05:20.173057 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:05:20.173057 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:05:20.173057 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:05:20.173057 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:05:20.173057 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b067088-a9ba-43cd-9775-8c54ba91ef6f could not be found. Sep 17 21:05:20.173057 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:05:20.173057 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0abd56e6-5d39-4a50-ad7a-97d5caa19cca tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] Returning 404 to user: Instance 9b067088-a9ba-43cd-9775-8c54ba91ef6f could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:05:20.173057 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0abd56e6-5d39-4a50-ad7a-97d5caa19cca tempest-ServerMetadataNegativeTestJSON-1083745308 tempest-ServerMetadataNegativeTestJSON-1083745308-project] 10.222.0.26 "GET /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f" status: 404 len: 111 microversion: 2.1 time: 0.111058 Sep 17 21:05:20.173057 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1847/3606] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:20 2022] GET /compute/v2.1/servers/9b067088-a9ba-43cd-9775-8c54ba91ef6f => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:05:20.793883 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a256eacd-425a-4269-bfff-292fe16bb632 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:20.794517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a256eacd-425a-4269-bfff-292fe16bb632 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: d131d8e1-8f52-4d1f-8f88-46b1aef06e29] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:20.822662 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a256eacd-425a-4269-bfff-292fe16bb632 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:20.823786 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a256eacd-425a-4269-bfff-292fe16bb632 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:20.824435 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a256eacd-425a-4269-bfff-292fe16bb632 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:20.826262 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a256eacd-425a-4269-bfff-292fe16bb632 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:20.827986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a256eacd-425a-4269-bfff-292fe16bb632 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:20.831966 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a256eacd-425a-4269-bfff-292fe16bb632 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:21.345845 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a256eacd-425a-4269-bfff-292fe16bb632 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:21.354680 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a256eacd-425a-4269-bfff-292fe16bb632 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29" status: 200 len: 1511 microversion: 2.1 time: 0.570164 Sep 17 21:05:21.355726 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1760/3607] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:20 2022] GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29 => generated 1511 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:22.393606 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-603849d6-9868-4cd8-bc31-3d0a38d3c81a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:22.396819 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-603849d6-9868-4cd8-bc31-3d0a38d3c81a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: d131d8e1-8f52-4d1f-8f88-46b1aef06e29] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:22.405951 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-603849d6-9868-4cd8-bc31-3d0a38d3c81a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:22.406876 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-603849d6-9868-4cd8-bc31-3d0a38d3c81a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:22.407736 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-603849d6-9868-4cd8-bc31-3d0a38d3c81a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:22.408706 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-603849d6-9868-4cd8-bc31-3d0a38d3c81a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:22.409262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-603849d6-9868-4cd8-bc31-3d0a38d3c81a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:22.410013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-603849d6-9868-4cd8-bc31-3d0a38d3c81a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:23.037282 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-603849d6-9868-4cd8-bc31-3d0a38d3c81a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:23.047906 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-603849d6-9868-4cd8-bc31-3d0a38d3c81a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29" status: 200 len: 1511 microversion: 2.1 time: 0.670221 Sep 17 21:05:23.071937 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1848/3608] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:22 2022] GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29 => generated 1511 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:24.071720 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a3e44296-a465-424f-b123-57d1b1fbb28e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:24.072338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a3e44296-a465-424f-b123-57d1b1fbb28e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: d131d8e1-8f52-4d1f-8f88-46b1aef06e29] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:24.086866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3e44296-a465-424f-b123-57d1b1fbb28e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:24.087383 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3e44296-a465-424f-b123-57d1b1fbb28e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:24.087830 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3e44296-a465-424f-b123-57d1b1fbb28e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:24.088553 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3e44296-a465-424f-b123-57d1b1fbb28e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:24.089015 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3e44296-a465-424f-b123-57d1b1fbb28e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:24.089441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3e44296-a465-424f-b123-57d1b1fbb28e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:24.813624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a3e44296-a465-424f-b123-57d1b1fbb28e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:24.823318 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a3e44296-a465-424f-b123-57d1b1fbb28e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29" status: 200 len: 1511 microversion: 2.1 time: 0.755330 Sep 17 21:05:24.824191 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1761/3609] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:24 2022] GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29 => generated 1511 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:25.848771 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cb0a0a45-dd81-478c-b20f-35f51e45e5fe tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:25.849523 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cb0a0a45-dd81-478c-b20f-35f51e45e5fe tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: d131d8e1-8f52-4d1f-8f88-46b1aef06e29] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:25.857883 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb0a0a45-dd81-478c-b20f-35f51e45e5fe tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:25.858800 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb0a0a45-dd81-478c-b20f-35f51e45e5fe tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:25.859809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb0a0a45-dd81-478c-b20f-35f51e45e5fe tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:25.860783 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb0a0a45-dd81-478c-b20f-35f51e45e5fe tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:25.861528 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb0a0a45-dd81-478c-b20f-35f51e45e5fe tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:25.862487 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb0a0a45-dd81-478c-b20f-35f51e45e5fe tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:26.291576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cb0a0a45-dd81-478c-b20f-35f51e45e5fe tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:26.309941 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cb0a0a45-dd81-478c-b20f-35f51e45e5fe tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29" status: 200 len: 1511 microversion: 2.1 time: 0.465985 Sep 17 21:05:26.310544 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1849/3610] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:25 2022] GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29 => generated 1511 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:27.337117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5df64d6e-e0e6-4373-be61-db7757005783 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:27.338518 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5df64d6e-e0e6-4373-be61-db7757005783 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: d131d8e1-8f52-4d1f-8f88-46b1aef06e29] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:27.361318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5df64d6e-e0e6-4373-be61-db7757005783 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:27.362291 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5df64d6e-e0e6-4373-be61-db7757005783 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:27.362840 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5df64d6e-e0e6-4373-be61-db7757005783 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:27.363583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5df64d6e-e0e6-4373-be61-db7757005783 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:27.364166 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5df64d6e-e0e6-4373-be61-db7757005783 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:27.364473 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5df64d6e-e0e6-4373-be61-db7757005783 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:28.295591 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5df64d6e-e0e6-4373-be61-db7757005783 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:28.307544 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5df64d6e-e0e6-4373-be61-db7757005783 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29" status: 200 len: 1511 microversion: 2.1 time: 0.972488 Sep 17 21:05:28.308355 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1762/3611] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:27 2022] GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29 => generated 1511 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:29.333958 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b35b0921-312d-43ac-9356-f9ddd9809665 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:29.334561 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b35b0921-312d-43ac-9356-f9ddd9809665 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: d131d8e1-8f52-4d1f-8f88-46b1aef06e29] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:29.348997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b35b0921-312d-43ac-9356-f9ddd9809665 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:29.398177 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b35b0921-312d-43ac-9356-f9ddd9809665 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:29.399447 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b35b0921-312d-43ac-9356-f9ddd9809665 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.050s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:29.406640 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b35b0921-312d-43ac-9356-f9ddd9809665 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:29.408750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b35b0921-312d-43ac-9356-f9ddd9809665 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:29.409440 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b35b0921-312d-43ac-9356-f9ddd9809665 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:30.221666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b35b0921-312d-43ac-9356-f9ddd9809665 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:30.236160 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b35b0921-312d-43ac-9356-f9ddd9809665 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29" status: 200 len: 1511 microversion: 2.1 time: 0.905948 Sep 17 21:05:30.241034 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1850/3612] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:29 2022] GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29 => generated 1511 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:31.271605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-beb030be-a58e-4796-9b2b-dd87416fb826 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:31.272968 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-beb030be-a58e-4796-9b2b-dd87416fb826 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: d131d8e1-8f52-4d1f-8f88-46b1aef06e29] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:31.288875 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-beb030be-a58e-4796-9b2b-dd87416fb826 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:31.294116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-beb030be-a58e-4796-9b2b-dd87416fb826 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:31.294849 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-beb030be-a58e-4796-9b2b-dd87416fb826 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:31.295719 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-beb030be-a58e-4796-9b2b-dd87416fb826 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:31.296434 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-beb030be-a58e-4796-9b2b-dd87416fb826 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:31.297102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-beb030be-a58e-4796-9b2b-dd87416fb826 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:32.288328 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-beb030be-a58e-4796-9b2b-dd87416fb826 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:32.303128 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-beb030be-a58e-4796-9b2b-dd87416fb826 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29" status: 200 len: 1511 microversion: 2.1 time: 1.038455 Sep 17 21:05:32.309799 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1763/3613] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:31 2022] GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29 => generated 1511 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:32.759779 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6f84ebe1-8c87-4723-9e02-21f736834e5b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-398701411", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "a3d39dbe-6c76-4c3a-83c5-b3a53133f5c8"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:33.328992 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5ddee9cf-ae8d-4a03-8c66-dee248b45596 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:33.330421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5ddee9cf-ae8d-4a03-8c66-dee248b45596 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: d131d8e1-8f52-4d1f-8f88-46b1aef06e29] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:33.348760 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ddee9cf-ae8d-4a03-8c66-dee248b45596 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:33.350605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ddee9cf-ae8d-4a03-8c66-dee248b45596 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:33.351589 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ddee9cf-ae8d-4a03-8c66-dee248b45596 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:33.353700 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ddee9cf-ae8d-4a03-8c66-dee248b45596 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:33.355289 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ddee9cf-ae8d-4a03-8c66-dee248b45596 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:33.355973 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ddee9cf-ae8d-4a03-8c66-dee248b45596 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:33.407880 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-6f84ebe1-8c87-4723-9e02-21f736834e5b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] validate_networks() for [('a3d39dbe-6c76-4c3a-83c5-b3a53133f5c8', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:05:35.397659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5ddee9cf-ae8d-4a03-8c66-dee248b45596 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:35.405991 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5ddee9cf-ae8d-4a03-8c66-dee248b45596 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29" status: 200 len: 1511 microversion: 2.1 time: 2.081340 Sep 17 21:05:35.409302 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1764/3614] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:33 2022] GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29 => generated 1511 bytes in 2086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:35.911813 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-6f84ebe1-8c87-4723-9e02-21f736834e5b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:05:35.913425 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-6f84ebe1-8c87-4723-9e02-21f736834e5b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:05:35.914301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-6f84ebe1-8c87-4723-9e02-21f736834e5b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:05:35.914925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-6f84ebe1-8c87-4723-9e02-21f736834e5b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:05:35.915561 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-6f84ebe1-8c87-4723-9e02-21f736834e5b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:05:35.939704 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f84ebe1-8c87-4723-9e02-21f736834e5b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:35.940406 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f84ebe1-8c87-4723-9e02-21f736834e5b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:35.940941 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f84ebe1-8c87-4723-9e02-21f736834e5b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:35.943116 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f84ebe1-8c87-4723-9e02-21f736834e5b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:35.945210 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f84ebe1-8c87-4723-9e02-21f736834e5b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:35.946991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f84ebe1-8c87-4723-9e02-21f736834e5b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:36.004783 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-6f84ebe1-8c87-4723-9e02-21f736834e5b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Getting quotas for project 598139a6b6764e80822b82231f572770. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:05:36.037185 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-6f84ebe1-8c87-4723-9e02-21f736834e5b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Getting quotas for user 1933f2aed04a45a28bb2617337faa719 and project 598139a6b6764e80822b82231f572770. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:05:36.072489 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6f84ebe1-8c87-4723-9e02-21f736834e5b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:05:36.077323 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6f84ebe1-8c87-4723-9e02-21f736834e5b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] [instance: 829770cb-178d-439d-9efd-ac18ac670932] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:05:36.232902 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6f84ebe1-8c87-4723-9e02-21f736834e5b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.812576 Sep 17 21:05:36.243942 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1851/3615] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:05:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 3825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:05:36.253260 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-54e8fa7d-bf59-4fe3-a52c-6b7fcf9f8504 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:36.254030 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-54e8fa7d-bf59-4fe3-a52c-6b7fcf9f8504 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] [instance: 829770cb-178d-439d-9efd-ac18ac670932] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:36.436551 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-50cc0dd1-46be-43c9-97cf-282b6468b98a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:36.437684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-50cc0dd1-46be-43c9-97cf-282b6468b98a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: d131d8e1-8f52-4d1f-8f88-46b1aef06e29] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:36.462411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50cc0dd1-46be-43c9-97cf-282b6468b98a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:36.462959 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50cc0dd1-46be-43c9-97cf-282b6468b98a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:36.463417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50cc0dd1-46be-43c9-97cf-282b6468b98a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:36.466713 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50cc0dd1-46be-43c9-97cf-282b6468b98a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:36.467232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50cc0dd1-46be-43c9-97cf-282b6468b98a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:36.467631 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50cc0dd1-46be-43c9-97cf-282b6468b98a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:36.547236 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-54e8fa7d-bf59-4fe3-a52c-6b7fcf9f8504 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1933f2aed04a45a28bb2617337faa719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598139a6b6764e80822b82231f572770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:36.555910 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-54e8fa7d-bf59-4fe3-a52c-6b7fcf9f8504 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] 10.222.0.26 "GET /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932" status: 200 len: 1213 microversion: 2.1 time: 0.310408 Sep 17 21:05:36.560364 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1765/3616] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:36 2022] GET /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932 => generated 1213 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:37.059561 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-50cc0dd1-46be-43c9-97cf-282b6468b98a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:37.078771 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-50cc0dd1-46be-43c9-97cf-282b6468b98a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29" status: 200 len: 1511 microversion: 2.1 time: 0.646725 Sep 17 21:05:37.086497 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1852/3617] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:36 2022] GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29 => generated 1511 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:37.594138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-36753acd-d942-4751-a4da-3a5eedd0f6d9 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:37.595253 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-36753acd-d942-4751-a4da-3a5eedd0f6d9 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] [instance: 829770cb-178d-439d-9efd-ac18ac670932] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:37.616299 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-36753acd-d942-4751-a4da-3a5eedd0f6d9 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:37.619399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-36753acd-d942-4751-a4da-3a5eedd0f6d9 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:37.621582 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-36753acd-d942-4751-a4da-3a5eedd0f6d9 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:37.627892 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-36753acd-d942-4751-a4da-3a5eedd0f6d9 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:37.629703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-36753acd-d942-4751-a4da-3a5eedd0f6d9 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:37.632159 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-36753acd-d942-4751-a4da-3a5eedd0f6d9 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:37.641433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c142213c-08b0-4be3-b170-a20741bc6ea9 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Action: 'create', calling method: .version_select at 0x7f25a47b1940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-85286507", "description": "tempest-description-1465456393"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:37.745561 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:38.036253 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-36753acd-d942-4751-a4da-3a5eedd0f6d9 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1933f2aed04a45a28bb2617337faa719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598139a6b6764e80822b82231f572770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:38.061563 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-36753acd-d942-4751-a4da-3a5eedd0f6d9 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] 10.222.0.26 "GET /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932" status: 200 len: 1217 microversion: 2.1 time: 0.472903 Sep 17 21:05:38.080940 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1853/3618] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:37 2022] GET /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932 => generated 1217 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:38.110006 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1861b1f6-814b-4113-adc7-b32870219f10 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:38.110629 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1861b1f6-814b-4113-adc7-b32870219f10 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: d131d8e1-8f52-4d1f-8f88-46b1aef06e29] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:38.138455 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1861b1f6-814b-4113-adc7-b32870219f10 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:38.138961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1861b1f6-814b-4113-adc7-b32870219f10 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:38.139402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1861b1f6-814b-4113-adc7-b32870219f10 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:38.145804 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1861b1f6-814b-4113-adc7-b32870219f10 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:38.146448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1861b1f6-814b-4113-adc7-b32870219f10 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:38.146743 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1861b1f6-814b-4113-adc7-b32870219f10 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:38.459376 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1861b1f6-814b-4113-adc7-b32870219f10 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:38.468903 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1861b1f6-814b-4113-adc7-b32870219f10 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29" status: 200 len: 1511 microversion: 2.1 time: 0.363386 Sep 17 21:05:38.486125 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1854/3619] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:38 2022] GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29 => generated 1511 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:38.625767 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c142213c-08b0-4be3-b170-a20741bc6ea9 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.624916 Sep 17 21:05:38.626914 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1766/3620] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Sep 17 21:05:36 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:38.641788 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-67cb279a-2585-4b56-a995-5744527a5417 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Action: 'create', calling method: .version_select at 0x7f25a47c51f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-230231598", "description": "tempest-description-69381807"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:38.945481 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1a934dc3-446d-46f5-bad6-c0bd93466a5b tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-162256784", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": "none"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:39.033934 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-1a934dc3-446d-46f5-bad6-c0bd93466a5b tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:05:39.035020 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-1a934dc3-446d-46f5-bad6-c0bd93466a5b tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:05:39.036131 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-1a934dc3-446d-46f5-bad6-c0bd93466a5b tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:05:39.036717 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-1a934dc3-446d-46f5-bad6-c0bd93466a5b tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:05:39.038142 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-1a934dc3-446d-46f5-bad6-c0bd93466a5b tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:05:39.067937 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a934dc3-446d-46f5-bad6-c0bd93466a5b tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:39.068769 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a934dc3-446d-46f5-bad6-c0bd93466a5b tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:39.068882 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a934dc3-446d-46f5-bad6-c0bd93466a5b tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:39.069696 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a934dc3-446d-46f5-bad6-c0bd93466a5b tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:39.070126 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a934dc3-446d-46f5-bad6-c0bd93466a5b tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:39.070578 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a934dc3-446d-46f5-bad6-c0bd93466a5b tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:39.108319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-1a934dc3-446d-46f5-bad6-c0bd93466a5b tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Getting quotas for project 4512f54506dd413a80df4b337a6c31c6. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:05:39.119325 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-1a934dc3-446d-46f5-bad6-c0bd93466a5b tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Getting quotas for user 6b27ba12dd5a46b3b27479c3a7c241e5 and project 4512f54506dd413a80df4b337a6c31c6. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:05:39.150677 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1a934dc3-446d-46f5-bad6-c0bd93466a5b tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:05:39.156966 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1a934dc3-446d-46f5-bad6-c0bd93466a5b tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 5df81993-e8a2-4513-8a62-f7abfb64eb5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:05:39.183119 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-67cb279a-2585-4b56-a995-5744527a5417 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.546433 Sep 17 21:05:39.193534 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1767/3621] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Sep 17 21:05:38 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:05:39.279306 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1a934dc3-446d-46f5-bad6-c0bd93466a5b tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.662595 Sep 17 21:05:39.279988 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1855/3622] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Sep 17 21:05:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 17 21:05:39.292576 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-55d3692c-4ad4-4da5-a771-1b46302bc0cc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-872491866", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:39.306262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4e470822-a4ef-425e-acf2-948b4dac322b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:39.306891 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4e470822-a4ef-425e-acf2-948b4dac322b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] [instance: 829770cb-178d-439d-9efd-ac18ac670932] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:39.346390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e470822-a4ef-425e-acf2-948b4dac322b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:39.348990 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e470822-a4ef-425e-acf2-948b4dac322b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:39.349605 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e470822-a4ef-425e-acf2-948b4dac322b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:39.350839 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e470822-a4ef-425e-acf2-948b4dac322b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:39.350839 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e470822-a4ef-425e-acf2-948b4dac322b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:39.351241 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e470822-a4ef-425e-acf2-948b4dac322b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:39.414533 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-55d3692c-4ad4-4da5-a771-1b46302bc0cc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] validate_networks() for [('a953568a-fe33-4e0d-9d9e-690f2b9b852f', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:05:39.528630 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4e470822-a4ef-425e-acf2-948b4dac322b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1933f2aed04a45a28bb2617337faa719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598139a6b6764e80822b82231f572770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:39.544886 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4e470822-a4ef-425e-acf2-948b4dac322b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] 10.222.0.26 "GET /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932" status: 200 len: 1271 microversion: 2.1 time: 0.242489 Sep 17 21:05:39.545509 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1856/3623] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:39 2022] GET /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932 => generated 1271 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:39.550312 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b6020a65-2586-4f0e-9585-fe98408baa06 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:39.553893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b6020a65-2586-4f0e-9585-fe98408baa06 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 5df81993-e8a2-4513-8a62-f7abfb64eb5a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:39.671989 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b6020a65-2586-4f0e-9585-fe98408baa06 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:39.684151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b6020a65-2586-4f0e-9585-fe98408baa06 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:39.694136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b6020a65-2586-4f0e-9585-fe98408baa06 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:39.696597 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b6020a65-2586-4f0e-9585-fe98408baa06 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "GET /compute/v2.1/servers/5df81993-e8a2-4513-8a62-f7abfb64eb5a" status: 200 len: 1277 microversion: 2.47 time: 0.149909 Sep 17 21:05:39.698596 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1857/3624] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:05:39 2022] GET /compute/v2.1/servers/5df81993-e8a2-4513-8a62-f7abfb64eb5a => generated 1277 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:05:39.709999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a5e3c20a-0bdc-4b1f-a13a-8408960c28cb tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-195084648", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "d5958703-fcdc-40a7-aa8d-b8f966d869b7"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:39.830476 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-a5e3c20a-0bdc-4b1f-a13a-8408960c28cb tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] validate_networks() for [('d5958703-fcdc-40a7-aa8d-b8f966d869b7', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:05:41.477258 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-55d3692c-4ad4-4da5-a771-1b46302bc0cc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:05:41.477940 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-55d3692c-4ad4-4da5-a771-1b46302bc0cc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:05:41.478201 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-55d3692c-4ad4-4da5-a771-1b46302bc0cc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:05:41.478619 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-55d3692c-4ad4-4da5-a771-1b46302bc0cc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:05:41.479086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-55d3692c-4ad4-4da5-a771-1b46302bc0cc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:05:41.497218 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55d3692c-4ad4-4da5-a771-1b46302bc0cc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:41.497759 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55d3692c-4ad4-4da5-a771-1b46302bc0cc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:41.498217 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55d3692c-4ad4-4da5-a771-1b46302bc0cc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:41.502246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55d3692c-4ad4-4da5-a771-1b46302bc0cc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:41.502832 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55d3692c-4ad4-4da5-a771-1b46302bc0cc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:41.505134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55d3692c-4ad4-4da5-a771-1b46302bc0cc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:41.537480 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-a5e3c20a-0bdc-4b1f-a13a-8408960c28cb tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:05:41.538662 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-a5e3c20a-0bdc-4b1f-a13a-8408960c28cb tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:05:41.540114 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-a5e3c20a-0bdc-4b1f-a13a-8408960c28cb tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:05:41.540870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-a5e3c20a-0bdc-4b1f-a13a-8408960c28cb tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:05:41.541135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-a5e3c20a-0bdc-4b1f-a13a-8408960c28cb tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:05:41.564122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5e3c20a-0bdc-4b1f-a13a-8408960c28cb tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:41.564646 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5e3c20a-0bdc-4b1f-a13a-8408960c28cb tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:41.565071 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5e3c20a-0bdc-4b1f-a13a-8408960c28cb tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:41.576663 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5e3c20a-0bdc-4b1f-a13a-8408960c28cb tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:41.580111 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5e3c20a-0bdc-4b1f-a13a-8408960c28cb tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:41.580798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5e3c20a-0bdc-4b1f-a13a-8408960c28cb tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:41.585635 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-55d3692c-4ad4-4da5-a771-1b46302bc0cc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Getting quotas for project f8ed24e4bf6643f7b1474fcec78c4995. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:05:41.611638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-55d3692c-4ad4-4da5-a771-1b46302bc0cc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Getting quotas for user 795813bb461e42ad8c2a758e9b8430d6 and project f8ed24e4bf6643f7b1474fcec78c4995. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:05:41.671628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-55d3692c-4ad4-4da5-a771-1b46302bc0cc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:05:41.674094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-55d3692c-4ad4-4da5-a771-1b46302bc0cc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:05:41.684869 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-a5e3c20a-0bdc-4b1f-a13a-8408960c28cb tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Getting quotas for project 1c307636beed407582da5779796cc6a7. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:05:41.699733 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-a5e3c20a-0bdc-4b1f-a13a-8408960c28cb tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Getting quotas for user 30b19896bc4e4d14bfec46dd00519150 and project 1c307636beed407582da5779796cc6a7. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:05:41.773321 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a5e3c20a-0bdc-4b1f-a13a-8408960c28cb tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:05:41.775609 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a5e3c20a-0bdc-4b1f-a13a-8408960c28cb tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:05:41.808070 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-55d3692c-4ad4-4da5-a771-1b46302bc0cc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.620967 Sep 17 21:05:41.815063 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1768/3625] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:05:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 2625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:05:41.820887 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-284cd6fa-42a9-40ff-a77d-54ab5a478611 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:41.823376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-284cd6fa-42a9-40ff-a77d-54ab5a478611 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: d131d8e1-8f52-4d1f-8f88-46b1aef06e29] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:41.849166 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-284cd6fa-42a9-40ff-a77d-54ab5a478611 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:41.874446 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-284cd6fa-42a9-40ff-a77d-54ab5a478611 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:41.874734 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-284cd6fa-42a9-40ff-a77d-54ab5a478611 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:41.875429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-284cd6fa-42a9-40ff-a77d-54ab5a478611 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:41.884436 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-284cd6fa-42a9-40ff-a77d-54ab5a478611 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:41.884901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-284cd6fa-42a9-40ff-a77d-54ab5a478611 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:41.886393 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a5e3c20a-0bdc-4b1f-a13a-8408960c28cb tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.186469 Sep 17 21:05:41.889208 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1858/3626] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:05:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:05:41.900172 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-92d63b93-fcff-46ad-bb53-e223d54943c1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-276953721", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": "none"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:42.084564 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-92d63b93-fcff-46ad-bb53-e223d54943c1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:05:42.085001 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-92d63b93-fcff-46ad-bb53-e223d54943c1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:05:42.085508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-92d63b93-fcff-46ad-bb53-e223d54943c1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:05:42.086124 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-92d63b93-fcff-46ad-bb53-e223d54943c1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:05:42.086543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-92d63b93-fcff-46ad-bb53-e223d54943c1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:05:42.101649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:42.113178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92d63b93-fcff-46ad-bb53-e223d54943c1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:42.115494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92d63b93-fcff-46ad-bb53-e223d54943c1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:42.116851 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92d63b93-fcff-46ad-bb53-e223d54943c1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:42.119919 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92d63b93-fcff-46ad-bb53-e223d54943c1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:42.120767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92d63b93-fcff-46ad-bb53-e223d54943c1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:42.122506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92d63b93-fcff-46ad-bb53-e223d54943c1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:42.186541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-92d63b93-fcff-46ad-bb53-e223d54943c1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Getting quotas for project 4512f54506dd413a80df4b337a6c31c6. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:05:42.200708 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-92d63b93-fcff-46ad-bb53-e223d54943c1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Getting quotas for user 6b27ba12dd5a46b3b27479c3a7c241e5 and project 4512f54506dd413a80df4b337a6c31c6. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:05:42.239159 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-92d63b93-fcff-46ad-bb53-e223d54943c1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:05:42.243594 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-92d63b93-fcff-46ad-bb53-e223d54943c1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:05:42.249177 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-284cd6fa-42a9-40ff-a77d-54ab5a478611 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:42.264238 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-284cd6fa-42a9-40ff-a77d-54ab5a478611 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29" status: 200 len: 1488 microversion: 2.1 time: 0.453485 Sep 17 21:05:42.264794 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1769/3627] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:41 2022] GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29 => generated 1488 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:42.286120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0eeab0a1-f47b-4d86-9630-6ec19483f1b2 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:42.286750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0eeab0a1-f47b-4d86-9630-6ec19483f1b2 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] [instance: 829770cb-178d-439d-9efd-ac18ac670932] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:42.327440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0eeab0a1-f47b-4d86-9630-6ec19483f1b2 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:42.329182 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0eeab0a1-f47b-4d86-9630-6ec19483f1b2 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:42.333510 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0eeab0a1-f47b-4d86-9630-6ec19483f1b2 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:42.337741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0eeab0a1-f47b-4d86-9630-6ec19483f1b2 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:42.341038 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0eeab0a1-f47b-4d86-9630-6ec19483f1b2 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:42.343035 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0eeab0a1-f47b-4d86-9630-6ec19483f1b2 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:42.457378 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-92d63b93-fcff-46ad-bb53-e223d54943c1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.564162 Sep 17 21:05:42.468383 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1859/3628] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Sep 17 21:05:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 17 21:05:42.488449 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f6e61d07-c315-4ffe-9828-abf0173ea0a6 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:42.493327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f6e61d07-c315-4ffe-9828-abf0173ea0a6 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:42.690631 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f6e61d07-c315-4ffe-9828-abf0173ea0a6 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:42.702626 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f6e61d07-c315-4ffe-9828-abf0173ea0a6 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d" status: 200 len: 1221 microversion: 2.1 time: 0.233033 Sep 17 21:05:42.708434 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1860/3629] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:42 2022] GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d => generated 1221 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:42.743134 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f20a8887-a27a-4b16-92b0-8c8f65817dd5 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:42.743910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f20a8887-a27a-4b16-92b0-8c8f65817dd5 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:42.812900 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0eeab0a1-f47b-4d86-9630-6ec19483f1b2 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1933f2aed04a45a28bb2617337faa719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598139a6b6764e80822b82231f572770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:42.832382 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0eeab0a1-f47b-4d86-9630-6ec19483f1b2 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] 10.222.0.26 "GET /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932" status: 200 len: 1313 microversion: 2.1 time: 0.566453 Sep 17 21:05:42.844546 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1770/3630] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:42 2022] GET /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932 => generated 1313 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:42.870085 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-23579cf8-1118-4a0a-8bd0-5f47dc9b9c3c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:42.872774 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-23579cf8-1118-4a0a-8bd0-5f47dc9b9c3c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:42.882597 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:42.887005 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-23579cf8-1118-4a0a-8bd0-5f47dc9b9c3c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:42.887530 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-23579cf8-1118-4a0a-8bd0-5f47dc9b9c3c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:42.888443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-23579cf8-1118-4a0a-8bd0-5f47dc9b9c3c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:42.889896 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-23579cf8-1118-4a0a-8bd0-5f47dc9b9c3c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:42.890962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-23579cf8-1118-4a0a-8bd0-5f47dc9b9c3c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:42.891768 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-23579cf8-1118-4a0a-8bd0-5f47dc9b9c3c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:43.007736 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f20a8887-a27a-4b16-92b0-8c8f65817dd5 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b19896bc4e4d14bfec46dd00519150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c307636beed407582da5779796cc6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:43.016670 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f20a8887-a27a-4b16-92b0-8c8f65817dd5 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807" status: 200 len: 1215 microversion: 2.1 time: 0.305817 Sep 17 21:05:43.020153 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1861/3631] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:42 2022] GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807 => generated 1215 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:43.031248 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4b414f04-03d1-48f9-8b21-45eba1167eed tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:43.034403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4b414f04-03d1-48f9-8b21-45eba1167eed tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:43.076636 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-23579cf8-1118-4a0a-8bd0-5f47dc9b9c3c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action" status: 200 len: 161 microversion: 2.1 time: 0.227775 Sep 17 21:05:43.079008 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1771/3632] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:05:42 2022] POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action => generated 161 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:43.099335 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-25b1d27a-c5f2-4472-ac56-237a66645234 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1462220183", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:43.122882 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4b414f04-03d1-48f9-8b21-45eba1167eed tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "PUT /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f" status: 200 len: 991 microversion: 2.47 time: 0.100709 Sep 17 21:05:43.141586 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1862/3633] 10.222.0.26 () {62 vars in 1297 bytes} [Sat Sep 17 21:05:43 2022] PUT /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f => generated 991 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:05:43.154806 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9d7b5ee6-8a58-4b7f-9ee4-c3fb6befe1da tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:43.167015 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9d7b5ee6-8a58-4b7f-9ee4-c3fb6befe1da tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:43.188366 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d7b5ee6-8a58-4b7f-9ee4-c3fb6befe1da tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:43.189127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d7b5ee6-8a58-4b7f-9ee4-c3fb6befe1da tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:43.189601 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d7b5ee6-8a58-4b7f-9ee4-c3fb6befe1da tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:43.190329 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d7b5ee6-8a58-4b7f-9ee4-c3fb6befe1da tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:43.190852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d7b5ee6-8a58-4b7f-9ee4-c3fb6befe1da tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:43.191282 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d7b5ee6-8a58-4b7f-9ee4-c3fb6befe1da tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:43.247193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-25b1d27a-c5f2-4472-ac56-237a66645234 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] validate_networks() for [('a953568a-fe33-4e0d-9d9e-690f2b9b852f', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:05:43.487483 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9d7b5ee6-8a58-4b7f-9ee4-c3fb6befe1da tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:43.501423 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9d7b5ee6-8a58-4b7f-9ee4-c3fb6befe1da tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.358570 Sep 17 21:05:43.505265 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1863/3634] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:43 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:43.514812 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f6a754bc-6161-4bc9-ba23-f33ba0a918e8 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:43.519677 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f6a754bc-6161-4bc9-ba23-f33ba0a918e8 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:43.540152 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6a754bc-6161-4bc9-ba23-f33ba0a918e8 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:43.541591 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6a754bc-6161-4bc9-ba23-f33ba0a918e8 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:43.544076 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6a754bc-6161-4bc9-ba23-f33ba0a918e8 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:43.546340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6a754bc-6161-4bc9-ba23-f33ba0a918e8 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:43.547141 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6a754bc-6161-4bc9-ba23-f33ba0a918e8 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:43.548312 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6a754bc-6161-4bc9-ba23-f33ba0a918e8 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:43.679572 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f6a754bc-6161-4bc9-ba23-f33ba0a918e8 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:43.699222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f6a754bc-6161-4bc9-ba23-f33ba0a918e8 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:43.701021 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f6a754bc-6161-4bc9-ba23-f33ba0a918e8 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:43.701856 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f6a754bc-6161-4bc9-ba23-f33ba0a918e8 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f" status: 200 len: 1281 microversion: 2.47 time: 0.194295 Sep 17 21:05:43.702749 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1864/3635] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:05:43 2022] GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f => generated 1281 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:05:43.707592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-037ace21-6256-45cf-99b8-53b27ac2b192 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:43.711529 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-037ace21-6256-45cf-99b8-53b27ac2b192 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:43.726882 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-037ace21-6256-45cf-99b8-53b27ac2b192 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:43.727651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-037ace21-6256-45cf-99b8-53b27ac2b192 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:43.728316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-037ace21-6256-45cf-99b8-53b27ac2b192 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:43.731451 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-037ace21-6256-45cf-99b8-53b27ac2b192 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:43.732131 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-037ace21-6256-45cf-99b8-53b27ac2b192 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:43.733062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-037ace21-6256-45cf-99b8-53b27ac2b192 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:44.245910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-037ace21-6256-45cf-99b8-53b27ac2b192 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:44.256126 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-037ace21-6256-45cf-99b8-53b27ac2b192 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.551692 Sep 17 21:05:44.256767 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1865/3636] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:43 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:44.277663 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a0b61b37-849e-4be8-8de5-39cccaef7ed1 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:44.278452 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a0b61b37-849e-4be8-8de5-39cccaef7ed1 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] [instance: 829770cb-178d-439d-9efd-ac18ac670932] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:44.298376 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0b61b37-849e-4be8-8de5-39cccaef7ed1 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:44.300498 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0b61b37-849e-4be8-8de5-39cccaef7ed1 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:44.300908 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0b61b37-849e-4be8-8de5-39cccaef7ed1 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:44.301696 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0b61b37-849e-4be8-8de5-39cccaef7ed1 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:44.302166 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0b61b37-849e-4be8-8de5-39cccaef7ed1 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:44.302597 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0b61b37-849e-4be8-8de5-39cccaef7ed1 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:44.419647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-25b1d27a-c5f2-4472-ac56-237a66645234 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:05:44.420866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-25b1d27a-c5f2-4472-ac56-237a66645234 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:05:44.423437 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-25b1d27a-c5f2-4472-ac56-237a66645234 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:05:44.425369 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-25b1d27a-c5f2-4472-ac56-237a66645234 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:05:44.426112 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-25b1d27a-c5f2-4472-ac56-237a66645234 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:05:44.457715 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25b1d27a-c5f2-4472-ac56-237a66645234 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:44.460880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25b1d27a-c5f2-4472-ac56-237a66645234 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:44.467683 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25b1d27a-c5f2-4472-ac56-237a66645234 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:44.469145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25b1d27a-c5f2-4472-ac56-237a66645234 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:44.469895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25b1d27a-c5f2-4472-ac56-237a66645234 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:44.470525 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25b1d27a-c5f2-4472-ac56-237a66645234 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:44.521659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-25b1d27a-c5f2-4472-ac56-237a66645234 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Getting quotas for project f8ed24e4bf6643f7b1474fcec78c4995. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:05:44.539081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-25b1d27a-c5f2-4472-ac56-237a66645234 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Getting quotas for user 795813bb461e42ad8c2a758e9b8430d6 and project f8ed24e4bf6643f7b1474fcec78c4995. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:05:44.570023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-25b1d27a-c5f2-4472-ac56-237a66645234 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:05:44.573229 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-25b1d27a-c5f2-4472-ac56-237a66645234 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:05:44.654057 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-25b1d27a-c5f2-4472-ac56-237a66645234 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.573181 Sep 17 21:05:44.655532 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1772/3637] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:05:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 1575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:05:44.662421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a4a7c19b-0ed6-4815-b731-ee3f405fa91e tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:44.663369 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a4a7c19b-0ed6-4815-b731-ee3f405fa91e tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:44.672362 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4a7c19b-0ed6-4815-b731-ee3f405fa91e tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:44.673261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4a7c19b-0ed6-4815-b731-ee3f405fa91e tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:44.673976 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4a7c19b-0ed6-4815-b731-ee3f405fa91e tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:44.674977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4a7c19b-0ed6-4815-b731-ee3f405fa91e tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:44.675601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4a7c19b-0ed6-4815-b731-ee3f405fa91e tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:44.676371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4a7c19b-0ed6-4815-b731-ee3f405fa91e tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:44.743483 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a0b61b37-849e-4be8-8de5-39cccaef7ed1 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1933f2aed04a45a28bb2617337faa719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598139a6b6764e80822b82231f572770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:44.752773 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a0b61b37-849e-4be8-8de5-39cccaef7ed1 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] 10.222.0.26 "GET /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932" status: 200 len: 1313 microversion: 2.1 time: 0.494909 Sep 17 21:05:44.753536 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1866/3638] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:44 2022] GET /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932 => generated 1313 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:44.764972 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e0894cae-321f-4298-9ab8-aff2acc9ec55 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:44.769762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e0894cae-321f-4298-9ab8-aff2acc9ec55 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:44.795088 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e0894cae-321f-4298-9ab8-aff2acc9ec55 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:44.795596 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e0894cae-321f-4298-9ab8-aff2acc9ec55 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:44.796040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e0894cae-321f-4298-9ab8-aff2acc9ec55 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:44.802011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e0894cae-321f-4298-9ab8-aff2acc9ec55 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:44.802960 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e0894cae-321f-4298-9ab8-aff2acc9ec55 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:44.803487 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e0894cae-321f-4298-9ab8-aff2acc9ec55 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:45.019237 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a4a7c19b-0ed6-4815-b731-ee3f405fa91e tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b19896bc4e4d14bfec46dd00519150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c307636beed407582da5779796cc6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:45.027369 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a4a7c19b-0ed6-4815-b731-ee3f405fa91e tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807" status: 200 len: 1267 microversion: 2.1 time: 0.370577 Sep 17 21:05:45.047669 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1773/3639] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:44 2022] GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807 => generated 1267 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:45.057622 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-63c13ac2-7275-4d31-b6b5-cc7439767919 req-6aff7201-0aac-4372-ba84-37944cdbf080 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "829770cb-178d-439d-9efd-ac18ac670932", "tag": "3eaf7ffc-5d01-482a-a2a3-bf5ac46ab065"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:45.088888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-63c13ac2-7275-4d31-b6b5-cc7439767919 req-6aff7201-0aac-4372-ba84-37944cdbf080 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:45.093107 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-63c13ac2-7275-4d31-b6b5-cc7439767919 req-6aff7201-0aac-4372-ba84-37944cdbf080 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:45.093642 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-63c13ac2-7275-4d31-b6b5-cc7439767919 req-6aff7201-0aac-4372-ba84-37944cdbf080 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:45.135540 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-63c13ac2-7275-4d31-b6b5-cc7439767919 req-6aff7201-0aac-4372-ba84-37944cdbf080 service nova] Creating event network-changed:3eaf7ffc-5d01-482a-a2a3-bf5ac46ab065 for instance 829770cb-178d-439d-9efd-ac18ac670932 on nch2-master-1 Sep 17 21:05:45.155445 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-63c13ac2-7275-4d31-b6b5-cc7439767919 req-6aff7201-0aac-4372-ba84-37944cdbf080 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106521 Sep 17 21:05:45.157900 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1774/3640] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:45.174577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-09b89a26-9f3b-4ec0-be2c-b27b0a303d1c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:45.175628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-09b89a26-9f3b-4ec0-be2c-b27b0a303d1c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:45.357856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-09b89a26-9f3b-4ec0-be2c-b27b0a303d1c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:45.374259 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-09b89a26-9f3b-4ec0-be2c-b27b0a303d1c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1222 microversion: 2.1 time: 0.214860 Sep 17 21:05:45.384897 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1775/3641] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:45 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1222 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:45.406585 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-12fb6416-66b7-42c2-bb19-0635fe3442ec tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:45.407504 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-12fb6416-66b7-42c2-bb19-0635fe3442ec tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:45.413769 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e0894cae-321f-4298-9ab8-aff2acc9ec55 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:45.422999 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e0894cae-321f-4298-9ab8-aff2acc9ec55 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.664605 Sep 17 21:05:45.427948 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1867/3642] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:44 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:45.431937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12fb6416-66b7-42c2-bb19-0635fe3442ec tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:45.433516 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12fb6416-66b7-42c2-bb19-0635fe3442ec tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:45.434128 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12fb6416-66b7-42c2-bb19-0635fe3442ec tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:45.435035 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12fb6416-66b7-42c2-bb19-0635fe3442ec tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:45.435653 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12fb6416-66b7-42c2-bb19-0635fe3442ec tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:45.437318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12fb6416-66b7-42c2-bb19-0635fe3442ec tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:45.456745 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-defe3a1e-f1b2-44d0-9fdd-a59c46fba34a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:45.457714 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-defe3a1e-f1b2-44d0-9fdd-a59c46fba34a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:45.467870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-defe3a1e-f1b2-44d0-9fdd-a59c46fba34a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:45.468688 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-defe3a1e-f1b2-44d0-9fdd-a59c46fba34a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:45.469107 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-defe3a1e-f1b2-44d0-9fdd-a59c46fba34a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:45.469879 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-defe3a1e-f1b2-44d0-9fdd-a59c46fba34a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:45.470326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-defe3a1e-f1b2-44d0-9fdd-a59c46fba34a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:45.478581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-defe3a1e-f1b2-44d0-9fdd-a59c46fba34a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:45.678867 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-12fb6416-66b7-42c2-bb19-0635fe3442ec tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:45.700506 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-12fb6416-66b7-42c2-bb19-0635fe3442ec tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:45.702142 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-12fb6416-66b7-42c2-bb19-0635fe3442ec tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:45.703362 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-12fb6416-66b7-42c2-bb19-0635fe3442ec tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f" status: 200 len: 1329 microversion: 2.47 time: 0.303805 Sep 17 21:05:45.713981 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1776/3643] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:05:45 2022] GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f => generated 1329 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:05:45.777008 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3cc59eb5-1b92-4412-b08f-8965bf8b051d tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:45.777937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3cc59eb5-1b92-4412-b08f-8965bf8b051d tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] [instance: 829770cb-178d-439d-9efd-ac18ac670932] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:45.791636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3cc59eb5-1b92-4412-b08f-8965bf8b051d tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:45.797756 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3cc59eb5-1b92-4412-b08f-8965bf8b051d tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:45.799257 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3cc59eb5-1b92-4412-b08f-8965bf8b051d tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:45.805644 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3cc59eb5-1b92-4412-b08f-8965bf8b051d tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:45.809763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3cc59eb5-1b92-4412-b08f-8965bf8b051d tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:45.810546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3cc59eb5-1b92-4412-b08f-8965bf8b051d tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:46.063246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-defe3a1e-f1b2-44d0-9fdd-a59c46fba34a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:46.085238 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-defe3a1e-f1b2-44d0-9fdd-a59c46fba34a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.636418 Sep 17 21:05:46.089150 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1868/3644] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:45 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:46.100501 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-059b1da8-c34f-4caa-a003-474de6581189 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:46.102397 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-059b1da8-c34f-4caa-a003-474de6581189 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:46.120858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-059b1da8-c34f-4caa-a003-474de6581189 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:46.124243 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-059b1da8-c34f-4caa-a003-474de6581189 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:46.127002 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-059b1da8-c34f-4caa-a003-474de6581189 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:46.128229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-059b1da8-c34f-4caa-a003-474de6581189 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:46.131633 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-059b1da8-c34f-4caa-a003-474de6581189 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:46.132361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-059b1da8-c34f-4caa-a003-474de6581189 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:46.365340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-059b1da8-c34f-4caa-a003-474de6581189 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b19896bc4e4d14bfec46dd00519150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c307636beed407582da5779796cc6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:46.374756 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3cc59eb5-1b92-4412-b08f-8965bf8b051d tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1933f2aed04a45a28bb2617337faa719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598139a6b6764e80822b82231f572770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:46.401383 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3cc59eb5-1b92-4412-b08f-8965bf8b051d tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] 10.222.0.26 "GET /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932" status: 200 len: 1313 microversion: 2.1 time: 0.624444 Sep 17 21:05:46.403043 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-059b1da8-c34f-4caa-a003-474de6581189 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807" status: 200 len: 1273 microversion: 2.1 time: 0.307729 Sep 17 21:05:46.405925 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1777/3645] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:45 2022] GET /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932 => generated 1313 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:46.406697 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1869/3646] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:46 2022] GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807 => generated 1273 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:46.427400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d21af763-404c-46c1-a320-2ae592097e73 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-133563681", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "fd58f898-7287-41a8-bd5b-faf66186e8ef"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:46.432822 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a0900f75-3bb7-49f1-87a2-c6976c4b4c1f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:46.436750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a0900f75-3bb7-49f1-87a2-c6976c4b4c1f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:46.445354 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0900f75-3bb7-49f1-87a2-c6976c4b4c1f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:46.451241 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0900f75-3bb7-49f1-87a2-c6976c4b4c1f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:46.452293 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0900f75-3bb7-49f1-87a2-c6976c4b4c1f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:46.455718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0900f75-3bb7-49f1-87a2-c6976c4b4c1f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:46.456975 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0900f75-3bb7-49f1-87a2-c6976c4b4c1f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:46.459686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0900f75-3bb7-49f1-87a2-c6976c4b4c1f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:46.504954 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-d21af763-404c-46c1-a320-2ae592097e73 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] validate_networks() for [('fd58f898-7287-41a8-bd5b-faf66186e8ef', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:05:46.638896 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a0900f75-3bb7-49f1-87a2-c6976c4b4c1f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:46.653090 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a0900f75-3bb7-49f1-87a2-c6976c4b4c1f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1274 microversion: 2.1 time: 0.228169 Sep 17 21:05:46.654565 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1870/3647] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:46 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1274 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:46.748046 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-51f1afbf-2e31-4fee-980a-fb775866c4e8 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:46.749219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-51f1afbf-2e31-4fee-980a-fb775866c4e8 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:46.761506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-51f1afbf-2e31-4fee-980a-fb775866c4e8 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:46.762826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-51f1afbf-2e31-4fee-980a-fb775866c4e8 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:46.763769 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-51f1afbf-2e31-4fee-980a-fb775866c4e8 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:46.764795 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-51f1afbf-2e31-4fee-980a-fb775866c4e8 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:46.767431 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-51f1afbf-2e31-4fee-980a-fb775866c4e8 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:46.768689 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-51f1afbf-2e31-4fee-980a-fb775866c4e8 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:46.915533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-51f1afbf-2e31-4fee-980a-fb775866c4e8 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:46.935427 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-51f1afbf-2e31-4fee-980a-fb775866c4e8 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:46.937173 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-51f1afbf-2e31-4fee-980a-fb775866c4e8 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:46.941551 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-51f1afbf-2e31-4fee-980a-fb775866c4e8 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f" status: 200 len: 1335 microversion: 2.47 time: 0.202311 Sep 17 21:05:46.944308 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1871/3648] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:05:46 2022] GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f => generated 1335 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:05:47.390485 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-d21af763-404c-46c1-a320-2ae592097e73 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:05:47.391485 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-d21af763-404c-46c1-a320-2ae592097e73 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:05:47.392212 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-d21af763-404c-46c1-a320-2ae592097e73 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:05:47.392882 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-d21af763-404c-46c1-a320-2ae592097e73 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:05:47.393613 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-d21af763-404c-46c1-a320-2ae592097e73 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:05:47.407523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d21af763-404c-46c1-a320-2ae592097e73 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:47.408399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d21af763-404c-46c1-a320-2ae592097e73 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:47.409042 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d21af763-404c-46c1-a320-2ae592097e73 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:47.410114 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d21af763-404c-46c1-a320-2ae592097e73 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:47.410779 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d21af763-404c-46c1-a320-2ae592097e73 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:47.411412 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d21af763-404c-46c1-a320-2ae592097e73 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:47.425870 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=81 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:47.434264 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-33bbbf5b-5b2a-4c8f-8234-86c3d3bad7e2 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:47.435031 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-33bbbf5b-5b2a-4c8f-8234-86c3d3bad7e2 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] [instance: 829770cb-178d-439d-9efd-ac18ac670932] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:47.445293 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-33bbbf5b-5b2a-4c8f-8234-86c3d3bad7e2 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:47.446051 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-33bbbf5b-5b2a-4c8f-8234-86c3d3bad7e2 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:47.446814 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-33bbbf5b-5b2a-4c8f-8234-86c3d3bad7e2 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:47.447805 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-33bbbf5b-5b2a-4c8f-8234-86c3d3bad7e2 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:47.448287 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-d21af763-404c-46c1-a320-2ae592097e73 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Getting quotas for project 3e48e3c2f7f74636a75679fdf10ef33a. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:05:47.450035 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-33bbbf5b-5b2a-4c8f-8234-86c3d3bad7e2 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:47.450538 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-33bbbf5b-5b2a-4c8f-8234-86c3d3bad7e2 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:47.456995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-d21af763-404c-46c1-a320-2ae592097e73 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Getting quotas for user 2ef547e071fd43ec96c745c26eca119f and project 3e48e3c2f7f74636a75679fdf10ef33a. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:05:47.474412 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d21af763-404c-46c1-a320-2ae592097e73 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:05:47.477309 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d21af763-404c-46c1-a320-2ae592097e73 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 60e59237-9ac3-43d8-9231-af2a77fc368e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:05:47.575198 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d21af763-404c-46c1-a320-2ae592097e73 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.167271 Sep 17 21:05:47.580676 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1778/3649] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:05:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1174 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:05:47.592079 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-466a58fc-ddb9-4a22-934b-a4ddf12c485b tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:47.593763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-466a58fc-ddb9-4a22-934b-a4ddf12c485b tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:47.609914 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-466a58fc-ddb9-4a22-934b-a4ddf12c485b tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:47.610842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-466a58fc-ddb9-4a22-934b-a4ddf12c485b tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:47.611671 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-466a58fc-ddb9-4a22-934b-a4ddf12c485b tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:47.612871 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-466a58fc-ddb9-4a22-934b-a4ddf12c485b tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:47.614021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-466a58fc-ddb9-4a22-934b-a4ddf12c485b tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:47.614698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-466a58fc-ddb9-4a22-934b-a4ddf12c485b tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:47.744038 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-33bbbf5b-5b2a-4c8f-8234-86c3d3bad7e2 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1933f2aed04a45a28bb2617337faa719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598139a6b6764e80822b82231f572770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:47.771110 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-33bbbf5b-5b2a-4c8f-8234-86c3d3bad7e2 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] 10.222.0.26 "GET /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932" status: 200 len: 1313 microversion: 2.1 time: 0.338653 Sep 17 21:05:47.777579 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1872/3650] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:47 2022] GET /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932 => generated 1313 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:05:47.777579 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-21ebfd59-1ff0-47fc-a035-a4418b4eb6b2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:47.781005 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-21ebfd59-1ff0-47fc-a035-a4418b4eb6b2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 60e59237-9ac3-43d8-9231-af2a77fc368e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:47.828042 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-466a58fc-ddb9-4a22-934b-a4ddf12c485b tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b19896bc4e4d14bfec46dd00519150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c307636beed407582da5779796cc6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:47.843186 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-466a58fc-ddb9-4a22-934b-a4ddf12c485b tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807" status: 200 len: 1273 microversion: 2.1 time: 0.260940 Sep 17 21:05:47.843706 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1779/3651] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:47 2022] GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807 => generated 1273 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:47.855574 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7c4a5bb9-ad00-4b36-9b9a-d7ccfc256ed6 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:47.856391 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7c4a5bb9-ad00-4b36-9b9a-d7ccfc256ed6 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:47.863200 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c4a5bb9-ad00-4b36-9b9a-d7ccfc256ed6 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:47.864154 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c4a5bb9-ad00-4b36-9b9a-d7ccfc256ed6 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:47.865166 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c4a5bb9-ad00-4b36-9b9a-d7ccfc256ed6 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:47.866383 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c4a5bb9-ad00-4b36-9b9a-d7ccfc256ed6 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:47.866998 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c4a5bb9-ad00-4b36-9b9a-d7ccfc256ed6 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:47.867784 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c4a5bb9-ad00-4b36-9b9a-d7ccfc256ed6 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:47.911951 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-21ebfd59-1ff0-47fc-a035-a4418b4eb6b2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:47.934545 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-21ebfd59-1ff0-47fc-a035-a4418b4eb6b2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e" status: 200 len: 1214 microversion: 2.1 time: 0.158048 Sep 17 21:05:47.945388 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1873/3652] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:47 2022] GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e => generated 1214 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:47.976205 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-265fbad9-ed7d-46fa-a713-f0e555a5f5fb tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:47.977192 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-265fbad9-ed7d-46fa-a713-f0e555a5f5fb tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:47.990792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7c4a5bb9-ad00-4b36-9b9a-d7ccfc256ed6 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:47.995244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-265fbad9-ed7d-46fa-a713-f0e555a5f5fb tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:47.998207 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-265fbad9-ed7d-46fa-a713-f0e555a5f5fb tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:47.999040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-265fbad9-ed7d-46fa-a713-f0e555a5f5fb tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:48.000318 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-265fbad9-ed7d-46fa-a713-f0e555a5f5fb tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:48.002826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-265fbad9-ed7d-46fa-a713-f0e555a5f5fb tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:48.005640 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-265fbad9-ed7d-46fa-a713-f0e555a5f5fb tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:48.007719 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7c4a5bb9-ad00-4b36-9b9a-d7ccfc256ed6 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1280 microversion: 2.1 time: 0.162911 Sep 17 21:05:48.008914 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1780/3653] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:47 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1280 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:48.185910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-265fbad9-ed7d-46fa-a713-f0e555a5f5fb tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:48.202226 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-265fbad9-ed7d-46fa-a713-f0e555a5f5fb tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:48.212611 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-265fbad9-ed7d-46fa-a713-f0e555a5f5fb tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:48.214566 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-265fbad9-ed7d-46fa-a713-f0e555a5f5fb tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f" status: 200 len: 1335 microversion: 2.47 time: 0.245066 Sep 17 21:05:48.222751 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1874/3654] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:05:47 2022] GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f => generated 1335 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:05:48.797708 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-29027e6f-0d55-4a6d-baf7-072853f06b63 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:48.800033 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-29027e6f-0d55-4a6d-baf7-072853f06b63 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] [instance: 829770cb-178d-439d-9efd-ac18ac670932] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:48.810437 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-29027e6f-0d55-4a6d-baf7-072853f06b63 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:48.811430 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-29027e6f-0d55-4a6d-baf7-072853f06b63 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:48.812570 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-29027e6f-0d55-4a6d-baf7-072853f06b63 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:48.814331 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-29027e6f-0d55-4a6d-baf7-072853f06b63 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:48.815102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-29027e6f-0d55-4a6d-baf7-072853f06b63 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:48.815906 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-29027e6f-0d55-4a6d-baf7-072853f06b63 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:48.871000 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6b8e9608-1285-436f-bafa-95e20767de0c tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:48.871688 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6b8e9608-1285-436f-bafa-95e20767de0c tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:48.883562 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6b8e9608-1285-436f-bafa-95e20767de0c tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:48.891144 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6b8e9608-1285-436f-bafa-95e20767de0c tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:48.891610 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6b8e9608-1285-436f-bafa-95e20767de0c tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:48.892384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6b8e9608-1285-436f-bafa-95e20767de0c tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:48.892847 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6b8e9608-1285-436f-bafa-95e20767de0c tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:48.893276 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6b8e9608-1285-436f-bafa-95e20767de0c tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:49.269664 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6b8e9608-1285-436f-bafa-95e20767de0c tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b19896bc4e4d14bfec46dd00519150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c307636beed407582da5779796cc6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:49.278965 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6b8e9608-1285-436f-bafa-95e20767de0c tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807" status: 200 len: 1273 microversion: 2.1 time: 0.412941 Sep 17 21:05:49.295626 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1875/3655] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:48 2022] GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807 => generated 1273 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:49.302994 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-307f9251-7bdd-439c-a2a6-71f27a861940 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:49.308835 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-307f9251-7bdd-439c-a2a6-71f27a861940 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cd454c25ddef46d993ff15440a64a438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130f997fde494ab887281d866d6aec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:49.310468 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-307f9251-7bdd-439c-a2a6-71f27a861940 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Searching by: {'deleted': False, 'project_id': '130f997fde494ab887281d866d6aec31'} {{(pid=140524) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:05:49.322766 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-307f9251-7bdd-439c-a2a6-71f27a861940 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:49.323612 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-307f9251-7bdd-439c-a2a6-71f27a861940 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:49.324296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-307f9251-7bdd-439c-a2a6-71f27a861940 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:49.325259 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-307f9251-7bdd-439c-a2a6-71f27a861940 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:49.325961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-307f9251-7bdd-439c-a2a6-71f27a861940 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:49.326651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-307f9251-7bdd-439c-a2a6-71f27a861940 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:49.358534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.multi_cell_list [None req-307f9251-7bdd-439c-a2a6-71f27a861940 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140524) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 21:05:49.388950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:49.391366 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-307f9251-7bdd-439c-a2a6-71f27a861940 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.094341 Sep 17 21:05:49.392467 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1876/3656] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Sep 17 21:05:49 2022] GET /compute/v2.1/servers => generated 340 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:49.398369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d0889292-2fe5-42b8-868b-9f97132db2f2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:49.400841 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d0889292-2fe5-42b8-868b-9f97132db2f2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 60e59237-9ac3-43d8-9231-af2a77fc368e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:49.408170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d0889292-2fe5-42b8-868b-9f97132db2f2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:49.412048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d0889292-2fe5-42b8-868b-9f97132db2f2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:49.412976 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d0889292-2fe5-42b8-868b-9f97132db2f2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:49.417645 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d0889292-2fe5-42b8-868b-9f97132db2f2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:49.418985 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d0889292-2fe5-42b8-868b-9f97132db2f2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:49.420274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d0889292-2fe5-42b8-868b-9f97132db2f2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:49.597914 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d0889292-2fe5-42b8-868b-9f97132db2f2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:49.612531 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d0889292-2fe5-42b8-868b-9f97132db2f2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e" status: 200 len: 1266 microversion: 2.1 time: 0.218237 Sep 17 21:05:49.621573 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1877/3657] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:49 2022] GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:49.637161 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-29027e6f-0d55-4a6d-baf7-072853f06b63 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1933f2aed04a45a28bb2617337faa719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598139a6b6764e80822b82231f572770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:49.642638 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-00b95e63-4448-4157-b4c2-f467bbcf1b4a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:49.647766 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-29027e6f-0d55-4a6d-baf7-072853f06b63 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] 10.222.0.26 "GET /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932" status: 200 len: 1313 microversion: 2.1 time: 0.854559 Sep 17 21:05:49.648985 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-00b95e63-4448-4157-b4c2-f467bbcf1b4a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:49.666182 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1781/3658] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:48 2022] GET /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932 => generated 1313 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:49.670588 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00b95e63-4448-4157-b4c2-f467bbcf1b4a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:49.671203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00b95e63-4448-4157-b4c2-f467bbcf1b4a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:49.671765 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00b95e63-4448-4157-b4c2-f467bbcf1b4a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:49.675415 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6a670a99-5323-41a3-bc7e-5647811960ea tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:49.675605 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00b95e63-4448-4157-b4c2-f467bbcf1b4a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:49.676048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6a670a99-5323-41a3-bc7e-5647811960ea tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:49.676256 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00b95e63-4448-4157-b4c2-f467bbcf1b4a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:49.679266 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00b95e63-4448-4157-b4c2-f467bbcf1b4a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:49.698283 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a670a99-5323-41a3-bc7e-5647811960ea tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:49.699130 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a670a99-5323-41a3-bc7e-5647811960ea tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:49.699758 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a670a99-5323-41a3-bc7e-5647811960ea tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:49.700696 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a670a99-5323-41a3-bc7e-5647811960ea tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:49.701356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a670a99-5323-41a3-bc7e-5647811960ea tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:49.701984 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a670a99-5323-41a3-bc7e-5647811960ea tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:50.019944 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-00b95e63-4448-4157-b4c2-f467bbcf1b4a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:50.044624 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-00b95e63-4448-4157-b4c2-f467bbcf1b4a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1280 microversion: 2.1 time: 0.410909 Sep 17 21:05:50.045675 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1878/3659] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:49 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1280 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:50.046342 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6a670a99-5323-41a3-bc7e-5647811960ea tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:50.051380 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3460f661-0e8b-432f-9113-728bd8149cf0 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:50.059500 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3460f661-0e8b-432f-9113-728bd8149cf0 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cd454c25ddef46d993ff15440a64a438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130f997fde494ab887281d866d6aec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:50.061792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6a670a99-5323-41a3-bc7e-5647811960ea tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:50.062872 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3460f661-0e8b-432f-9113-728bd8149cf0 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Searching by: {'deleted': False, 'project_id': '130f997fde494ab887281d866d6aec31'} {{(pid=140524) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:05:50.068398 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6a670a99-5323-41a3-bc7e-5647811960ea tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:50.070657 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6a670a99-5323-41a3-bc7e-5647811960ea tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f" status: 200 len: 1356 microversion: 2.47 time: 0.403305 Sep 17 21:05:50.071361 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1782/3660] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:05:49 2022] GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f => generated 1356 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:05:50.073234 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3460f661-0e8b-432f-9113-728bd8149cf0 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:50.073779 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3460f661-0e8b-432f-9113-728bd8149cf0 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:50.074225 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3460f661-0e8b-432f-9113-728bd8149cf0 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:50.074965 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3460f661-0e8b-432f-9113-728bd8149cf0 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:50.082199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3460f661-0e8b-432f-9113-728bd8149cf0 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:50.082667 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3460f661-0e8b-432f-9113-728bd8149cf0 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:50.108518 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-769d2eff-5ffc-44ca-905b-f002e2c54620 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:50.112226 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-769d2eff-5ffc-44ca-905b-f002e2c54620 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:50.133690 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-769d2eff-5ffc-44ca-905b-f002e2c54620 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:50.135319 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-769d2eff-5ffc-44ca-905b-f002e2c54620 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:50.136444 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-769d2eff-5ffc-44ca-905b-f002e2c54620 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:50.140204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-769d2eff-5ffc-44ca-905b-f002e2c54620 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:50.141025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-769d2eff-5ffc-44ca-905b-f002e2c54620 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:50.141966 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-769d2eff-5ffc-44ca-905b-f002e2c54620 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:50.160635 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.multi_cell_list [None req-3460f661-0e8b-432f-9113-728bd8149cf0 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140524) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 21:05:50.301445 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3460f661-0e8b-432f-9113-728bd8149cf0 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd454c25ddef46d993ff15440a64a438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130f997fde494ab887281d866d6aec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:50.319634 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3460f661-0e8b-432f-9113-728bd8149cf0 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:50.320138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3460f661-0e8b-432f-9113-728bd8149cf0 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:50.320586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3460f661-0e8b-432f-9113-728bd8149cf0 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:50.340228 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-769d2eff-5ffc-44ca-905b-f002e2c54620 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:05:50.344432 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-769d2eff-5ffc-44ca-905b-f002e2c54620 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:05:50.349190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-769d2eff-5ffc-44ca-905b-f002e2c54620 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:05:50.350000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-769d2eff-5ffc-44ca-905b-f002e2c54620 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:05:50.350748 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-769d2eff-5ffc-44ca-905b-f002e2c54620 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:05:50.554632 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-769d2eff-5ffc-44ca-905b-f002e2c54620 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:50.573823 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-769d2eff-5ffc-44ca-905b-f002e2c54620 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:50.602223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-769d2eff-5ffc-44ca-905b-f002e2c54620 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:50.604286 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-769d2eff-5ffc-44ca-905b-f002e2c54620 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:50.605120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-769d2eff-5ffc-44ca-905b-f002e2c54620 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:50.607262 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-769d2eff-5ffc-44ca-905b-f002e2c54620 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:50.612073 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-769d2eff-5ffc-44ca-905b-f002e2c54620 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:50.696542 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-769d2eff-5ffc-44ca-905b-f002e2c54620 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "POST /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f/action" status: 202 len: 1078 microversion: 2.47 time: 0.592413 Sep 17 21:05:50.707957 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1783/3661] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Sep 17 21:05:50 2022] POST /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f/action => generated 1078 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Sep 17 21:05:50.712898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e651c7b0-ffb5-4852-8d3d-9adbb543e198 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:50.713553 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e651c7b0-ffb5-4852-8d3d-9adbb543e198 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:50.728665 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e651c7b0-ffb5-4852-8d3d-9adbb543e198 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:50.729171 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e651c7b0-ffb5-4852-8d3d-9adbb543e198 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:50.737907 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e651c7b0-ffb5-4852-8d3d-9adbb543e198 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:50.739482 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e651c7b0-ffb5-4852-8d3d-9adbb543e198 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:50.739990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e651c7b0-ffb5-4852-8d3d-9adbb543e198 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:50.740444 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e651c7b0-ffb5-4852-8d3d-9adbb543e198 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:51.843005 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e651c7b0-ffb5-4852-8d3d-9adbb543e198 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b19896bc4e4d14bfec46dd00519150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c307636beed407582da5779796cc6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:51.856938 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e651c7b0-ffb5-4852-8d3d-9adbb543e198 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807" status: 200 len: 1315 microversion: 2.1 time: 1.147232 Sep 17 21:05:51.886910 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1784/3662] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:50 2022] GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807 => generated 1315 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:51.896859 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9b02830a-14ab-4d44-a40b-6c2368ac69d3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:51.901447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9b02830a-14ab-4d44-a40b-6c2368ac69d3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 60e59237-9ac3-43d8-9231-af2a77fc368e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:51.915960 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b02830a-14ab-4d44-a40b-6c2368ac69d3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:51.916454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b02830a-14ab-4d44-a40b-6c2368ac69d3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:51.917106 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b02830a-14ab-4d44-a40b-6c2368ac69d3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:51.918053 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b02830a-14ab-4d44-a40b-6c2368ac69d3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:51.920343 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b02830a-14ab-4d44-a40b-6c2368ac69d3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:51.921028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b02830a-14ab-4d44-a40b-6c2368ac69d3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:52.284655 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9b02830a-14ab-4d44-a40b-6c2368ac69d3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:52.318681 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9b02830a-14ab-4d44-a40b-6c2368ac69d3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e" status: 200 len: 1272 microversion: 2.1 time: 0.430386 Sep 17 21:05:52.319719 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1785/3663] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:51 2022] GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e => generated 1272 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:52.324613 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d194b16e-15d7-4c47-897f-be398acc98bd tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:52.334606 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d194b16e-15d7-4c47-897f-be398acc98bd tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] [instance: 829770cb-178d-439d-9efd-ac18ac670932] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:52.342661 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d194b16e-15d7-4c47-897f-be398acc98bd tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:52.343567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d194b16e-15d7-4c47-897f-be398acc98bd tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:52.344228 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d194b16e-15d7-4c47-897f-be398acc98bd tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:52.346074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d194b16e-15d7-4c47-897f-be398acc98bd tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:52.346977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d194b16e-15d7-4c47-897f-be398acc98bd tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:52.354290 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d194b16e-15d7-4c47-897f-be398acc98bd tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:52.415787 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3460f661-0e8b-432f-9113-728bd8149cf0 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 1713 microversion: 2.1 time: 2.367461 Sep 17 21:05:52.417073 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1879/3664] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 21:05:50 2022] GET /compute/v2.1/servers/detail => generated 1713 bytes in 2371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:52.443186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5fd9627d-a0df-4d37-9305-5af409ee0c64 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:52.445514 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5fd9627d-a0df-4d37-9305-5af409ee0c64 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:52.458966 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5fd9627d-a0df-4d37-9305-5af409ee0c64 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:52.459566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5fd9627d-a0df-4d37-9305-5af409ee0c64 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:52.460135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5fd9627d-a0df-4d37-9305-5af409ee0c64 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:52.462742 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5fd9627d-a0df-4d37-9305-5af409ee0c64 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:52.462742 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5fd9627d-a0df-4d37-9305-5af409ee0c64 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:52.462999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5fd9627d-a0df-4d37-9305-5af409ee0c64 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:52.893139 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5fd9627d-a0df-4d37-9305-5af409ee0c64 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:52.905895 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5fd9627d-a0df-4d37-9305-5af409ee0c64 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:52.907841 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5fd9627d-a0df-4d37-9305-5af409ee0c64 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:52.915936 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5fd9627d-a0df-4d37-9305-5af409ee0c64 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f" status: 200 len: 1365 microversion: 2.47 time: 0.495960 Sep 17 21:05:52.918706 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1880/3665] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:05:52 2022] GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f => generated 1365 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:05:52.923944 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0736372e-9795-46e9-903b-f2df863a1381 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:52.925395 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0736372e-9795-46e9-903b-f2df863a1381 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:52.932491 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0736372e-9795-46e9-903b-f2df863a1381 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:52.933191 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0736372e-9795-46e9-903b-f2df863a1381 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:52.933843 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0736372e-9795-46e9-903b-f2df863a1381 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:52.934769 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0736372e-9795-46e9-903b-f2df863a1381 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:52.935406 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0736372e-9795-46e9-903b-f2df863a1381 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:52.936173 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0736372e-9795-46e9-903b-f2df863a1381 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:53.804589 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d194b16e-15d7-4c47-897f-be398acc98bd tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1933f2aed04a45a28bb2617337faa719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598139a6b6764e80822b82231f572770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:53.813641 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d194b16e-15d7-4c47-897f-be398acc98bd tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] 10.222.0.26 "GET /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932" status: 200 len: 1313 microversion: 2.1 time: 1.492593 Sep 17 21:05:53.829162 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1786/3666] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:52 2022] GET /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932 => generated 1313 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:53.834514 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-02cd6251-05e0-458d-9524-b3aba6bc77f2 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:53.859705 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-02cd6251-05e0-458d-9524-b3aba6bc77f2 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028954 Sep 17 21:05:53.860641 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1787/3667] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Sep 17 21:05:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:53.866917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e800e18a-66a5-405f-9a18-bd777920ea77 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:53.867690 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e800e18a-66a5-405f-9a18-bd777920ea77 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:53.870655 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0736372e-9795-46e9-903b-f2df863a1381 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:53.883835 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0736372e-9795-46e9-903b-f2df863a1381 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1322 microversion: 2.1 time: 0.963813 Sep 17 21:05:53.884449 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1881/3668] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:52 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1322 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:53.891759 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e800e18a-66a5-405f-9a18-bd777920ea77 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:53.893541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3397536f-c58f-4d22-91f0-e59827981fe9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:53.894316 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e800e18a-66a5-405f-9a18-bd777920ea77 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:53.899457 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e800e18a-66a5-405f-9a18-bd777920ea77 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:53.901232 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e800e18a-66a5-405f-9a18-bd777920ea77 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:53.901754 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e800e18a-66a5-405f-9a18-bd777920ea77 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:53.902878 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3397536f-c58f-4d22-91f0-e59827981fe9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 60e59237-9ac3-43d8-9231-af2a77fc368e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:53.904902 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e800e18a-66a5-405f-9a18-bd777920ea77 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:53.924168 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3397536f-c58f-4d22-91f0-e59827981fe9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:53.924733 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3397536f-c58f-4d22-91f0-e59827981fe9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:53.931983 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3397536f-c58f-4d22-91f0-e59827981fe9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:53.939104 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3397536f-c58f-4d22-91f0-e59827981fe9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:53.939849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3397536f-c58f-4d22-91f0-e59827981fe9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:53.940526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3397536f-c58f-4d22-91f0-e59827981fe9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:54.139501 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3397536f-c58f-4d22-91f0-e59827981fe9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:54.159633 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3397536f-c58f-4d22-91f0-e59827981fe9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e" status: 200 len: 1272 microversion: 2.1 time: 0.273275 Sep 17 21:05:54.179654 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1882/3669] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:53 2022] GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e => generated 1272 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:54.522261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e800e18a-66a5-405f-9a18-bd777920ea77 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b19896bc4e4d14bfec46dd00519150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c307636beed407582da5779796cc6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:54.538584 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-86f075f4-8634-4c5f-870c-fe8f1870c66a tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Action: 'create', calling method: .version_select at 0x7f25a436fc10>, body: {"keypair": {"name": "tempest-keypair-1370528821", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8RGEt8Fy1p8/R/GqUaYQuMD0+KwhfWd8s+IBvV69Ewiqslm0ZVV9ng9JH6178wh/+9k4trc1MExhujYT7+/QyRUWodpW54JzbBV9VQxauJpCiDNZr9Pk5Px4xBbddewg=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:54.576256 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e800e18a-66a5-405f-9a18-bd777920ea77 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807" status: 200 len: 1315 microversion: 2.1 time: 0.714225 Sep 17 21:05:54.577762 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1788/3670] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:53 2022] GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807 => generated 1315 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:54.583346 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-86f075f4-8634-4c5f-870c-fe8f1870c66a tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Getting quotas for project c3a83c9c29f1483b9ee9c48e94dc17ce. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:05:54.589604 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-b0e69994-fd0a-4d73-8732-eb92701a5268 req-dc1ce823-455f-4faf-b482-092c451d40b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "829770cb-178d-439d-9efd-ac18ac670932", "name": "network-vif-plugged", "status": "completed", "tag": "3eaf7ffc-5d01-482a-a2a3-bf5ac46ab065"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:54.599464 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-86f075f4-8634-4c5f-870c-fe8f1870c66a tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Getting quotas for user 24c7a82126124ebb8baf5c656ff9849d and project c3a83c9c29f1483b9ee9c48e94dc17ce. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:05:54.623228 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b0e69994-fd0a-4d73-8732-eb92701a5268 req-dc1ce823-455f-4faf-b482-092c451d40b4 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:54.625204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b0e69994-fd0a-4d73-8732-eb92701a5268 req-dc1ce823-455f-4faf-b482-092c451d40b4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:54.627408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b0e69994-fd0a-4d73-8732-eb92701a5268 req-dc1ce823-455f-4faf-b482-092c451d40b4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:54.672365 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-86f075f4-8634-4c5f-870c-fe8f1870c66a tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.490572 Sep 17 21:05:54.673847 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1883/3671] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:05:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:54.689896 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-b0e69994-fd0a-4d73-8732-eb92701a5268 req-dc1ce823-455f-4faf-b482-092c451d40b4 service nova] Creating event network-vif-plugged:3eaf7ffc-5d01-482a-a2a3-bf5ac46ab065 for instance 829770cb-178d-439d-9efd-ac18ac670932 on nch2-master-1 Sep 17 21:05:54.703804 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-b0e69994-fd0a-4d73-8732-eb92701a5268 req-dc1ce823-455f-4faf-b482-092c451d40b4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121597 Sep 17 21:05:54.706257 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1789/3672] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:54.719496 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5872c7ac-e5a5-477c-8ec0-7f7b5bf6fa84 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:54.725021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5872c7ac-e5a5-477c-8ec0-7f7b5bf6fa84 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:54.741639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5872c7ac-e5a5-477c-8ec0-7f7b5bf6fa84 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:54.742947 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5872c7ac-e5a5-477c-8ec0-7f7b5bf6fa84 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:54.744869 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5872c7ac-e5a5-477c-8ec0-7f7b5bf6fa84 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:54.746150 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5872c7ac-e5a5-477c-8ec0-7f7b5bf6fa84 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:54.748254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5872c7ac-e5a5-477c-8ec0-7f7b5bf6fa84 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:54.750964 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5872c7ac-e5a5-477c-8ec0-7f7b5bf6fa84 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:54.842443 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-ea94dc47-47d5-4bf4-89ad-8302eda80b28 req-dd6acca6-23af-4cdb-807c-f94eda2e1500 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807", "tag": "ebef2569-9674-41fe-bd16-737edb72b2ba"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:54.854280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-ea94dc47-47d5-4bf4-89ad-8302eda80b28 req-dd6acca6-23af-4cdb-807c-f94eda2e1500 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:54.855136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-ea94dc47-47d5-4bf4-89ad-8302eda80b28 req-dd6acca6-23af-4cdb-807c-f94eda2e1500 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:54.855749 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-ea94dc47-47d5-4bf4-89ad-8302eda80b28 req-dd6acca6-23af-4cdb-807c-f94eda2e1500 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:54.869410 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-ea94dc47-47d5-4bf4-89ad-8302eda80b28 req-dd6acca6-23af-4cdb-807c-f94eda2e1500 service nova] Creating event network-changed:ebef2569-9674-41fe-bd16-737edb72b2ba for instance d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807 on nch2-master-1 Sep 17 21:05:54.876051 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-ea94dc47-47d5-4bf4-89ad-8302eda80b28 req-dd6acca6-23af-4cdb-807c-f94eda2e1500 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200979 Sep 17 21:05:54.878550 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1884/3673] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:54.888146 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-beacab0d-eb9b-4a03-a0a3-aa888d57a3e9 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:54.889035 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-beacab0d-eb9b-4a03-a0a3-aa888d57a3e9 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] [instance: 39726f64-c35f-43a9-8ca2-6efc128162ee] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:54.899841 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-beacab0d-eb9b-4a03-a0a3-aa888d57a3e9 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:54.900656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-beacab0d-eb9b-4a03-a0a3-aa888d57a3e9 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:54.901268 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-beacab0d-eb9b-4a03-a0a3-aa888d57a3e9 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:54.902645 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-beacab0d-eb9b-4a03-a0a3-aa888d57a3e9 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:54.903271 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-beacab0d-eb9b-4a03-a0a3-aa888d57a3e9 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:54.903861 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-beacab0d-eb9b-4a03-a0a3-aa888d57a3e9 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:54.948393 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5872c7ac-e5a5-477c-8ec0-7f7b5bf6fa84 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:54.953975 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-beacab0d-eb9b-4a03-a0a3-aa888d57a3e9 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] [instance: 39726f64-c35f-43a9-8ca2-6efc128162ee] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:05:54.957306 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5872c7ac-e5a5-477c-8ec0-7f7b5bf6fa84 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:54.959120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5872c7ac-e5a5-477c-8ec0-7f7b5bf6fa84 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:54.961305 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5872c7ac-e5a5-477c-8ec0-7f7b5bf6fa84 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f" status: 200 len: 1365 microversion: 2.47 time: 0.253754 Sep 17 21:05:54.978345 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1790/3674] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:05:54 2022] GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f => generated 1365 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:05:54.986763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-f70c08f8-ff80-4ab2-a0b2-bc366a7b48c2 req-04c61bcf-acf3-4f7c-80c8-9b39172dd1a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "904ea7d3-2a78-408a-8a14-bac3845f6e7d", "tag": "5906edb3-bf5e-4b3d-a715-33e774720045"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:54.997372 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f70c08f8-ff80-4ab2-a0b2-bc366a7b48c2 req-04c61bcf-acf3-4f7c-80c8-9b39172dd1a9 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:54.998281 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f70c08f8-ff80-4ab2-a0b2-bc366a7b48c2 req-04c61bcf-acf3-4f7c-80c8-9b39172dd1a9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:54.998967 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f70c08f8-ff80-4ab2-a0b2-bc366a7b48c2 req-04c61bcf-acf3-4f7c-80c8-9b39172dd1a9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:55.011945 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-f70c08f8-ff80-4ab2-a0b2-bc366a7b48c2 req-04c61bcf-acf3-4f7c-80c8-9b39172dd1a9 service nova] Creating event network-changed:5906edb3-bf5e-4b3d-a715-33e774720045 for instance 904ea7d3-2a78-408a-8a14-bac3845f6e7d on nch2-master-1 Sep 17 21:05:55.018525 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-f70c08f8-ff80-4ab2-a0b2-bc366a7b48c2 req-04c61bcf-acf3-4f7c-80c8-9b39172dd1a9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038244 Sep 17 21:05:55.019803 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1791/3675] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:55.026766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f7fe37f5-fcb7-4006-957e-c9b55d9b4641 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:55.027871 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f7fe37f5-fcb7-4006-957e-c9b55d9b4641 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] [instance: 829770cb-178d-439d-9efd-ac18ac670932] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:55.036476 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f7fe37f5-fcb7-4006-957e-c9b55d9b4641 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:55.037750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f7fe37f5-fcb7-4006-957e-c9b55d9b4641 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:55.038732 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f7fe37f5-fcb7-4006-957e-c9b55d9b4641 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:55.039916 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f7fe37f5-fcb7-4006-957e-c9b55d9b4641 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:55.040681 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f7fe37f5-fcb7-4006-957e-c9b55d9b4641 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:55.041346 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f7fe37f5-fcb7-4006-957e-c9b55d9b4641 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:55.133195 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-beacab0d-eb9b-4a03-a0a3-aa888d57a3e9 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] 10.222.0.26 "DELETE /compute/v2.1/servers/39726f64-c35f-43a9-8ca2-6efc128162ee" status: 204 len: 0 microversion: 2.1 time: 0.250939 Sep 17 21:05:55.135240 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1885/3676] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:05:54 2022] DELETE /compute/v2.1/servers/39726f64-c35f-43a9-8ca2-6efc128162ee => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:05:55.145156 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-31e93f2f-46f5-4b38-b7ac-9dff9362898f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:55.146040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-31e93f2f-46f5-4b38-b7ac-9dff9362898f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:55.157160 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31e93f2f-46f5-4b38-b7ac-9dff9362898f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:55.159866 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31e93f2f-46f5-4b38-b7ac-9dff9362898f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:55.160774 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31e93f2f-46f5-4b38-b7ac-9dff9362898f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:55.162243 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31e93f2f-46f5-4b38-b7ac-9dff9362898f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:55.162939 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31e93f2f-46f5-4b38-b7ac-9dff9362898f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:55.164160 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31e93f2f-46f5-4b38-b7ac-9dff9362898f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:55.542775 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f7fe37f5-fcb7-4006-957e-c9b55d9b4641 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1933f2aed04a45a28bb2617337faa719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598139a6b6764e80822b82231f572770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:55.554363 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f7fe37f5-fcb7-4006-957e-c9b55d9b4641 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] 10.222.0.26 "GET /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932" status: 200 len: 1313 microversion: 2.1 time: 0.532939 Sep 17 21:05:55.574584 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1792/3677] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:55 2022] GET /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932 => generated 1313 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:55.580660 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cb262458-e4fd-43fa-a432-e975cd27a15c tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:55.581884 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cb262458-e4fd-43fa-a432-e975cd27a15c tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] [instance: 39726f64-c35f-43a9-8ca2-6efc128162ee] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:55.590133 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb262458-e4fd-43fa-a432-e975cd27a15c tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:55.591023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb262458-e4fd-43fa-a432-e975cd27a15c tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:55.592052 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb262458-e4fd-43fa-a432-e975cd27a15c tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:55.593018 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb262458-e4fd-43fa-a432-e975cd27a15c tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:55.593831 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb262458-e4fd-43fa-a432-e975cd27a15c tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:55.594599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb262458-e4fd-43fa-a432-e975cd27a15c tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:55.637508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-31e93f2f-46f5-4b38-b7ac-9dff9362898f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:55.650230 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-31e93f2f-46f5-4b38-b7ac-9dff9362898f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1322 microversion: 2.1 time: 0.512590 Sep 17 21:05:55.650971 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1886/3678] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:55 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1322 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:55.656041 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b17efb5b-da41-4492-ad7b-fa3c3505a50c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:55.661873 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b17efb5b-da41-4492-ad7b-fa3c3505a50c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 60e59237-9ac3-43d8-9231-af2a77fc368e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:55.687831 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b17efb5b-da41-4492-ad7b-fa3c3505a50c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:55.688657 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b17efb5b-da41-4492-ad7b-fa3c3505a50c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:55.689384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b17efb5b-da41-4492-ad7b-fa3c3505a50c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:55.690761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b17efb5b-da41-4492-ad7b-fa3c3505a50c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:55.691800 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b17efb5b-da41-4492-ad7b-fa3c3505a50c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:55.695288 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b17efb5b-da41-4492-ad7b-fa3c3505a50c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:56.114256 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cb262458-e4fd-43fa-a432-e975cd27a15c tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd454c25ddef46d993ff15440a64a438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130f997fde494ab887281d866d6aec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:56.128201 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cb262458-e4fd-43fa-a432-e975cd27a15c tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] 10.222.0.26 "GET /compute/v2.1/servers/39726f64-c35f-43a9-8ca2-6efc128162ee" status: 200 len: 1716 microversion: 2.1 time: 0.549965 Sep 17 21:05:56.132970 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1793/3679] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:55 2022] GET /compute/v2.1/servers/39726f64-c35f-43a9-8ca2-6efc128162ee => generated 1716 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:56.144754 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6239ff9b-96df-4b3b-a187-05f80f8fe9b8 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:56.148594 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6239ff9b-96df-4b3b-a187-05f80f8fe9b8 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:56.162804 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6239ff9b-96df-4b3b-a187-05f80f8fe9b8 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:56.163773 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6239ff9b-96df-4b3b-a187-05f80f8fe9b8 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:56.164424 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6239ff9b-96df-4b3b-a187-05f80f8fe9b8 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:56.165389 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6239ff9b-96df-4b3b-a187-05f80f8fe9b8 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:56.166556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6239ff9b-96df-4b3b-a187-05f80f8fe9b8 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:56.167285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6239ff9b-96df-4b3b-a187-05f80f8fe9b8 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:56.391165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b17efb5b-da41-4492-ad7b-fa3c3505a50c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:56.401379 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b17efb5b-da41-4492-ad7b-fa3c3505a50c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e" status: 200 len: 1314 microversion: 2.1 time: 0.748895 Sep 17 21:05:56.402018 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1887/3680] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:55 2022] GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e => generated 1314 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:56.436355 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-19527212-33a1-424b-8ed4-2e47e9cc63ef tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:56.439732 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-19527212-33a1-424b-8ed4-2e47e9cc63ef tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:56.444678 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:56.450591 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-19527212-33a1-424b-8ed4-2e47e9cc63ef tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:56.451918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-19527212-33a1-424b-8ed4-2e47e9cc63ef tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:56.453071 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-19527212-33a1-424b-8ed4-2e47e9cc63ef tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:56.454054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-19527212-33a1-424b-8ed4-2e47e9cc63ef tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:56.455451 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-19527212-33a1-424b-8ed4-2e47e9cc63ef tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:56.456960 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-19527212-33a1-424b-8ed4-2e47e9cc63ef tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:57.120601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6239ff9b-96df-4b3b-a187-05f80f8fe9b8 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b19896bc4e4d14bfec46dd00519150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c307636beed407582da5779796cc6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:57.134868 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6239ff9b-96df-4b3b-a187-05f80f8fe9b8 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807" status: 200 len: 1315 microversion: 2.1 time: 1.000196 Sep 17 21:05:57.135783 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1794/3681] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:56 2022] GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807 => generated 1315 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:57.142795 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-19527212-33a1-424b-8ed4-2e47e9cc63ef tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:57.152101 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-19527212-33a1-424b-8ed4-2e47e9cc63ef tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:57.156143 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d09c44e4-e8f9-453f-a3ec-9b0e5c4d0c7c tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:57.156990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d09c44e4-e8f9-453f-a3ec-9b0e5c4d0c7c tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] [instance: 829770cb-178d-439d-9efd-ac18ac670932] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:57.163536 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d09c44e4-e8f9-453f-a3ec-9b0e5c4d0c7c tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:57.164301 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d09c44e4-e8f9-453f-a3ec-9b0e5c4d0c7c tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:57.164919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d09c44e4-e8f9-453f-a3ec-9b0e5c4d0c7c tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:57.165728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-19527212-33a1-424b-8ed4-2e47e9cc63ef tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:57.166126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d09c44e4-e8f9-453f-a3ec-9b0e5c4d0c7c tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:57.166745 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d09c44e4-e8f9-453f-a3ec-9b0e5c4d0c7c tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:57.166972 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-19527212-33a1-424b-8ed4-2e47e9cc63ef tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f" status: 200 len: 1365 microversion: 2.47 time: 0.738767 Sep 17 21:05:57.167514 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d09c44e4-e8f9-453f-a3ec-9b0e5c4d0c7c tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:57.167649 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1888/3682] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:05:56 2022] GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f => generated 1365 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:05:57.210105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fea3011b-8b09-4b40-9333-477b38d1764f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:57.212844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fea3011b-8b09-4b40-9333-477b38d1764f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:57.221399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fea3011b-8b09-4b40-9333-477b38d1764f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:57.222319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fea3011b-8b09-4b40-9333-477b38d1764f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:57.224392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fea3011b-8b09-4b40-9333-477b38d1764f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:57.225723 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fea3011b-8b09-4b40-9333-477b38d1764f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:57.227512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fea3011b-8b09-4b40-9333-477b38d1764f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:57.231827 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fea3011b-8b09-4b40-9333-477b38d1764f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:57.427572 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:57.469876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=22 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:57.794303 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d09c44e4-e8f9-453f-a3ec-9b0e5c4d0c7c tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1933f2aed04a45a28bb2617337faa719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598139a6b6764e80822b82231f572770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:57.796967 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:05:57.804326 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d09c44e4-e8f9-453f-a3ec-9b0e5c4d0c7c tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] 10.222.0.26 "GET /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932" status: 200 len: 1313 microversion: 2.1 time: 0.666480 Sep 17 21:05:57.805257 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1795/3683] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:57 2022] GET /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932 => generated 1313 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:57.810084 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-2b313b7b-1b66-4c4c-a4eb-3c7698b405d3 req-51daad2a-465b-4407-b079-7ad113a4c53b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca76130f-7982-4feb-a9d8-9e8f998b509e", "tag": "d4d945a4-3009-4fd6-95cd-b4cfc8f16e38"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:57.821233 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2b313b7b-1b66-4c4c-a4eb-3c7698b405d3 req-51daad2a-465b-4407-b079-7ad113a4c53b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:57.822160 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2b313b7b-1b66-4c4c-a4eb-3c7698b405d3 req-51daad2a-465b-4407-b079-7ad113a4c53b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:57.822863 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2b313b7b-1b66-4c4c-a4eb-3c7698b405d3 req-51daad2a-465b-4407-b079-7ad113a4c53b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:57.835925 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-2b313b7b-1b66-4c4c-a4eb-3c7698b405d3 req-51daad2a-465b-4407-b079-7ad113a4c53b service nova] Creating event network-changed:d4d945a4-3009-4fd6-95cd-b4cfc8f16e38 for instance ca76130f-7982-4feb-a9d8-9e8f998b509e on nch1-master-1 Sep 17 21:05:57.842874 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-2b313b7b-1b66-4c4c-a4eb-3c7698b405d3 req-51daad2a-465b-4407-b079-7ad113a4c53b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036141 Sep 17 21:05:57.843873 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1796/3684] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:05:57.849866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4d4d859f-8819-4eac-9df2-039c0cc4028e tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:57.850972 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4d4d859f-8819-4eac-9df2-039c0cc4028e tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] [instance: 39726f64-c35f-43a9-8ca2-6efc128162ee] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:57.858306 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d4d859f-8819-4eac-9df2-039c0cc4028e tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:57.859245 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d4d859f-8819-4eac-9df2-039c0cc4028e tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:57.859958 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d4d859f-8819-4eac-9df2-039c0cc4028e tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:57.862493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d4d859f-8819-4eac-9df2-039c0cc4028e tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:57.863263 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d4d859f-8819-4eac-9df2-039c0cc4028e tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:57.868465 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d4d859f-8819-4eac-9df2-039c0cc4028e tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:57.954497 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fea3011b-8b09-4b40-9333-477b38d1764f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:57.967880 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fea3011b-8b09-4b40-9333-477b38d1764f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1322 microversion: 2.1 time: 0.771720 Sep 17 21:05:57.969275 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1889/3685] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:57 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1322 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:57.975496 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e8e99190-5771-4f31-a84f-8f4aa47fcc2b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:57.976655 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e8e99190-5771-4f31-a84f-8f4aa47fcc2b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 60e59237-9ac3-43d8-9231-af2a77fc368e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:57.984740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8e99190-5771-4f31-a84f-8f4aa47fcc2b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:57.985719 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8e99190-5771-4f31-a84f-8f4aa47fcc2b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:57.986408 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8e99190-5771-4f31-a84f-8f4aa47fcc2b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:57.987480 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8e99190-5771-4f31-a84f-8f4aa47fcc2b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:57.988301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8e99190-5771-4f31-a84f-8f4aa47fcc2b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:57.989007 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8e99190-5771-4f31-a84f-8f4aa47fcc2b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:58.478538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4d4d859f-8819-4eac-9df2-039c0cc4028e tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd454c25ddef46d993ff15440a64a438', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '130f997fde494ab887281d866d6aec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:58.491251 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4d4d859f-8819-4eac-9df2-039c0cc4028e tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] 10.222.0.26 "GET /compute/v2.1/servers/39726f64-c35f-43a9-8ca2-6efc128162ee" status: 200 len: 1716 microversion: 2.1 time: 0.645687 Sep 17 21:05:58.492461 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1797/3686] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:57 2022] GET /compute/v2.1/servers/39726f64-c35f-43a9-8ca2-6efc128162ee => generated 1716 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:58.497831 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2608b098-3592-4436-9c46-c86d78dde8c3 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:58.504718 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2608b098-3592-4436-9c46-c86d78dde8c3 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:58.515320 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2608b098-3592-4436-9c46-c86d78dde8c3 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:58.516334 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2608b098-3592-4436-9c46-c86d78dde8c3 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:58.517159 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2608b098-3592-4436-9c46-c86d78dde8c3 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:58.519001 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2608b098-3592-4436-9c46-c86d78dde8c3 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:58.520090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2608b098-3592-4436-9c46-c86d78dde8c3 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:58.520699 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2608b098-3592-4436-9c46-c86d78dde8c3 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:58.750772 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e8e99190-5771-4f31-a84f-8f4aa47fcc2b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:58.769229 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e8e99190-5771-4f31-a84f-8f4aa47fcc2b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e" status: 200 len: 1314 microversion: 2.1 time: 0.797769 Sep 17 21:05:58.775671 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1890/3687] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:57 2022] GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e => generated 1314 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:58.793217 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a6e71271-767e-4dad-a153-1fd0d172ca9e tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:58.803210 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a6e71271-767e-4dad-a153-1fd0d172ca9e tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:58.810913 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6e71271-767e-4dad-a153-1fd0d172ca9e tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:58.812310 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6e71271-767e-4dad-a153-1fd0d172ca9e tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:58.812950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6e71271-767e-4dad-a153-1fd0d172ca9e tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:58.813907 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6e71271-767e-4dad-a153-1fd0d172ca9e tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:58.814535 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6e71271-767e-4dad-a153-1fd0d172ca9e tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:58.815186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6e71271-767e-4dad-a153-1fd0d172ca9e tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:59.028551 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a6e71271-767e-4dad-a153-1fd0d172ca9e tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:59.039411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a6e71271-767e-4dad-a153-1fd0d172ca9e tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:59.046463 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a6e71271-767e-4dad-a153-1fd0d172ca9e tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:59.051458 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a6e71271-767e-4dad-a153-1fd0d172ca9e tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f" status: 200 len: 1365 microversion: 2.47 time: 0.274065 Sep 17 21:05:59.052583 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1891/3688] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:05:58 2022] GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f => generated 1365 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:05:59.075118 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-197e2f24-3679-4788-893b-c44e43d28c4c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1934137990", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "83d59427-cf2b-488c-82e6-78128ffc2fa3"}], "security_groups": [{"name": "tempest-securitygroup--918112521"}], "key_name": "tempest-keypair-1370528821", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:05:59.309824 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-197e2f24-3679-4788-893b-c44e43d28c4c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] validate_networks() for [('83d59427-cf2b-488c-82e6-78128ffc2fa3', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:05:59.462856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2608b098-3592-4436-9c46-c86d78dde8c3 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b19896bc4e4d14bfec46dd00519150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c307636beed407582da5779796cc6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:05:59.472433 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2608b098-3592-4436-9c46-c86d78dde8c3 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807" status: 200 len: 1315 microversion: 2.1 time: 0.978442 Sep 17 21:05:59.480228 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1798/3689] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:58 2022] GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807 => generated 1315 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:05:59.497919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0be278a9-8880-453c-b44a-d2458d80a72d tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:05:59.498860 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0be278a9-8880-453c-b44a-d2458d80a72d tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] [instance: 829770cb-178d-439d-9efd-ac18ac670932] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:05:59.507866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0be278a9-8880-453c-b44a-d2458d80a72d tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:59.508632 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0be278a9-8880-453c-b44a-d2458d80a72d tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:59.509277 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0be278a9-8880-453c-b44a-d2458d80a72d tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:05:59.510531 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0be278a9-8880-453c-b44a-d2458d80a72d tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:05:59.511195 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0be278a9-8880-453c-b44a-d2458d80a72d tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:05:59.511824 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0be278a9-8880-453c-b44a-d2458d80a72d tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:00.105619 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=12 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:00.720070 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0be278a9-8880-453c-b44a-d2458d80a72d tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1933f2aed04a45a28bb2617337faa719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598139a6b6764e80822b82231f572770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:00.729986 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0be278a9-8880-453c-b44a-d2458d80a72d tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] 10.222.0.26 "GET /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932" status: 200 len: 1498 microversion: 2.1 time: 1.245982 Sep 17 21:06:00.730648 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1799/3690] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:05:59 2022] GET /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932 => generated 1498 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:00.735644 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-79aa9ae2-6266-4061-9753-39efd777bddf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:00.736479 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-79aa9ae2-6266-4061-9753-39efd777bddf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:00.743025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79aa9ae2-6266-4061-9753-39efd777bddf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:00.743775 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79aa9ae2-6266-4061-9753-39efd777bddf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:00.744446 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79aa9ae2-6266-4061-9753-39efd777bddf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:00.745380 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79aa9ae2-6266-4061-9753-39efd777bddf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:00.746216 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79aa9ae2-6266-4061-9753-39efd777bddf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:00.746858 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79aa9ae2-6266-4061-9753-39efd777bddf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:01.515845 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-79aa9ae2-6266-4061-9753-39efd777bddf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:01.524377 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-79aa9ae2-6266-4061-9753-39efd777bddf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1322 microversion: 2.1 time: 0.792470 Sep 17 21:06:01.524989 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1800/3691] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:00 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1322 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:01.546996 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-32b23352-096d-48a0-8775-b6a2f52cea49 req-76240bf7-8c92-432f-b0c1-380e4f6cb69b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60e59237-9ac3-43d8-9231-af2a77fc368e", "tag": "130a8d55-49d4-4d80-b4c6-a7ebbe54f44f"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:01.565727 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-32b23352-096d-48a0-8775-b6a2f52cea49 req-76240bf7-8c92-432f-b0c1-380e4f6cb69b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:01.566393 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-32b23352-096d-48a0-8775-b6a2f52cea49 req-76240bf7-8c92-432f-b0c1-380e4f6cb69b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:01.567639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-32b23352-096d-48a0-8775-b6a2f52cea49 req-76240bf7-8c92-432f-b0c1-380e4f6cb69b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:01.595411 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-32b23352-096d-48a0-8775-b6a2f52cea49 req-76240bf7-8c92-432f-b0c1-380e4f6cb69b service nova] Creating event network-changed:130a8d55-49d4-4d80-b4c6-a7ebbe54f44f for instance 60e59237-9ac3-43d8-9231-af2a77fc368e on nch1-master-1 Sep 17 21:06:01.604474 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-32b23352-096d-48a0-8775-b6a2f52cea49 req-76240bf7-8c92-432f-b0c1-380e4f6cb69b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072976 Sep 17 21:06:01.605791 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1801/3692] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:01.612203 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-81546870-ff30-4726-a6ef-90bd03309d14 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:01.613210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-81546870-ff30-4726-a6ef-90bd03309d14 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] [instance: 39726f64-c35f-43a9-8ca2-6efc128162ee] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:01.622024 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81546870-ff30-4726-a6ef-90bd03309d14 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:01.622955 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81546870-ff30-4726-a6ef-90bd03309d14 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:01.623603 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81546870-ff30-4726-a6ef-90bd03309d14 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:01.624515 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81546870-ff30-4726-a6ef-90bd03309d14 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:01.624991 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81546870-ff30-4726-a6ef-90bd03309d14 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:01.625431 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81546870-ff30-4726-a6ef-90bd03309d14 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:01.642397 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-81546870-ff30-4726-a6ef-90bd03309d14 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] HTTP exception thrown: Instance 39726f64-c35f-43a9-8ca2-6efc128162ee could not be found. Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-81546870-ff30-4726-a6ef-90bd03309d14 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Request method failure captured: Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/39726f64-c35f-43a9-8ca2-6efc128162ee HTTP/1.1 Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjZpjuF3TFPJIErvj09tvpOlXF-0fsnFSHZK12HuM1reNzLJDN-lQLjttjy-CwbDaT1COekpcxqh44DMpAJnbNYVzj6cTw41vdNlUL3KJsd2w--XLEZ7g0ImndMzynMHVDxcI-Fqy4dKJzWmOryqlr1Ml65TvTMjaE6MT89CkRnFh2o Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 130f997fde494ab887281d866d6aec31 Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersTestManualDisk-188899892 Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/130f997fde494ab887281d866d6aec31"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/130f997fde494ab887281d866d6aec31"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/130f997fde494ab887281d866d6aec31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_130f997fde494ab887281d866d6aec31", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersTestManualDisk-188899892 Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 130f997fde494ab887281d866d6aec31 Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersTestManualDisk-188899892 Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersTestManualDisk-188899892-project Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: cd454c25ddef46d993ff15440a64a438 Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersTestManualDisk-188899892-project Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 39726f64-c35f-43a9-8ca2-6efc128162ee could not be found. Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '39726f64-c35f-43a9-8ca2-6efc128162ee'} Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39726f64-c35f-43a9-8ca2-6efc128162ee could not be found. Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39726f64-c35f-43a9-8ca2-6efc128162ee could not be found. Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:01.645220 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:01.651257 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:01.651257 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:01.651257 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:01.651257 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:06:01.651257 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:06:01.651257 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39726f64-c35f-43a9-8ca2-6efc128162ee could not be found. Sep 17 21:06:01.651257 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:01.652825 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-81546870-ff30-4726-a6ef-90bd03309d14 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Returning 404 to user: Instance 39726f64-c35f-43a9-8ca2-6efc128162ee could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:06:01.653919 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-81546870-ff30-4726-a6ef-90bd03309d14 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] 10.222.0.26 "GET /compute/v2.1/servers/39726f64-c35f-43a9-8ca2-6efc128162ee" status: 404 len: 111 microversion: 2.1 time: 0.046710 Sep 17 21:06:01.656603 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1802/3693] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:01 2022] GET /compute/v2.1/servers/39726f64-c35f-43a9-8ca2-6efc128162ee => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:06:01.663130 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2c99482c-2dee-4732-b2e0-14b19761dfca tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:01.666243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2c99482c-2dee-4732-b2e0-14b19761dfca tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 60e59237-9ac3-43d8-9231-af2a77fc368e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:01.679692 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2c99482c-2dee-4732-b2e0-14b19761dfca tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:01.680408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2c99482c-2dee-4732-b2e0-14b19761dfca tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:01.681808 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2c99482c-2dee-4732-b2e0-14b19761dfca tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:01.684473 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2c99482c-2dee-4732-b2e0-14b19761dfca tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:01.685285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2c99482c-2dee-4732-b2e0-14b19761dfca tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:01.696636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2c99482c-2dee-4732-b2e0-14b19761dfca tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:01.882770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-197e2f24-3679-4788-893b-c44e43d28c4c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:06:01.883417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-197e2f24-3679-4788-893b-c44e43d28c4c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:06:01.883994 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-197e2f24-3679-4788-893b-c44e43d28c4c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:06:01.885102 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-197e2f24-3679-4788-893b-c44e43d28c4c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:06:01.885679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-197e2f24-3679-4788-893b-c44e43d28c4c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:06:01.896043 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-197e2f24-3679-4788-893b-c44e43d28c4c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:01.897227 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-197e2f24-3679-4788-893b-c44e43d28c4c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:01.897409 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-197e2f24-3679-4788-893b-c44e43d28c4c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:01.898270 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-197e2f24-3679-4788-893b-c44e43d28c4c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:01.898818 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-197e2f24-3679-4788-893b-c44e43d28c4c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:01.899502 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-197e2f24-3679-4788-893b-c44e43d28c4c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:01.927673 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-197e2f24-3679-4788-893b-c44e43d28c4c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Getting quotas for project c3a83c9c29f1483b9ee9c48e94dc17ce. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:06:01.933939 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-197e2f24-3679-4788-893b-c44e43d28c4c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Getting quotas for user 24c7a82126124ebb8baf5c656ff9849d and project c3a83c9c29f1483b9ee9c48e94dc17ce. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:06:01.949730 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-197e2f24-3679-4788-893b-c44e43d28c4c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:06:01.952658 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-197e2f24-3679-4788-893b-c44e43d28c4c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 29c92489-5a3c-43e3-8dae-d5168e2a29bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:06:02.008200 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-197e2f24-3679-4788-893b-c44e43d28c4c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.944465 Sep 17 21:06:02.009508 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1892/3694] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:05:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 2956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:06:02.015909 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-f5564286-6ba0-400f-ac03-c620911207ca req-682aa95f-1da8-4d6a-9e94-6aa295d3cc79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39726f64-c35f-43a9-8ca2-6efc128162ee", "name": "network-vif-deleted", "tag": "0a4de968-f735-40a2-90dc-6ce02c2af575"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:02.040785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f5564286-6ba0-400f-ac03-c620911207ca req-682aa95f-1da8-4d6a-9e94-6aa295d3cc79 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:02.043599 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f5564286-6ba0-400f-ac03-c620911207ca req-682aa95f-1da8-4d6a-9e94-6aa295d3cc79 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:02.044070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f5564286-6ba0-400f-ac03-c620911207ca req-682aa95f-1da8-4d6a-9e94-6aa295d3cc79 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:02.065125 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-f5564286-6ba0-400f-ac03-c620911207ca req-682aa95f-1da8-4d6a-9e94-6aa295d3cc79 service nova] Creating event network-vif-deleted:0a4de968-f735-40a2-90dc-6ce02c2af575 for instance 39726f64-c35f-43a9-8ca2-6efc128162ee on nch1-master-1 Sep 17 21:06:02.072039 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-f5564286-6ba0-400f-ac03-c620911207ca req-682aa95f-1da8-4d6a-9e94-6aa295d3cc79 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061032 Sep 17 21:06:02.079109 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1893/3695] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:02.085677 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f89ea87c-5e92-4d6c-9468-40760d131c9f tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:02.086630 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f89ea87c-5e92-4d6c-9468-40760d131c9f tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:02.094347 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2c99482c-2dee-4732-b2e0-14b19761dfca tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:02.097115 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f89ea87c-5e92-4d6c-9468-40760d131c9f tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:02.097879 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f89ea87c-5e92-4d6c-9468-40760d131c9f tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:02.099202 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f89ea87c-5e92-4d6c-9468-40760d131c9f tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:02.100213 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f89ea87c-5e92-4d6c-9468-40760d131c9f tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:02.100846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f89ea87c-5e92-4d6c-9468-40760d131c9f tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:02.102187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f89ea87c-5e92-4d6c-9468-40760d131c9f tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:02.107923 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:02.116828 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2c99482c-2dee-4732-b2e0-14b19761dfca tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e" status: 200 len: 1314 microversion: 2.1 time: 0.458006 Sep 17 21:06:02.120943 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1803/3696] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:01 2022] GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:02.155497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1142076c-5339-4068-9f55-4f31f6526d61 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:02.159305 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1142076c-5339-4068-9f55-4f31f6526d61 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:02.175600 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:02.179626 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1142076c-5339-4068-9f55-4f31f6526d61 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:02.188736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1142076c-5339-4068-9f55-4f31f6526d61 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:02.192797 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1142076c-5339-4068-9f55-4f31f6526d61 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:02.194043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1142076c-5339-4068-9f55-4f31f6526d61 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:02.194805 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1142076c-5339-4068-9f55-4f31f6526d61 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:02.196333 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1142076c-5339-4068-9f55-4f31f6526d61 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:02.247502 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f89ea87c-5e92-4d6c-9468-40760d131c9f tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:02.262441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f89ea87c-5e92-4d6c-9468-40760d131c9f tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:02.267212 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f89ea87c-5e92-4d6c-9468-40760d131c9f tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:02.271957 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f89ea87c-5e92-4d6c-9468-40760d131c9f tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f" status: 200 len: 1365 microversion: 2.47 time: 0.188346 Sep 17 21:06:02.273660 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1894/3697] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:02 2022] GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:06:02.281492 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c311f5d5-8b4e-49aa-b942-a5e056b81094 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] Calling method '.version_select at 0x7f25a54f09d0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:02.313498 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c311f5d5-8b4e-49aa-b942-a5e056b81094 tempest-ServersTestManualDisk-188899892 tempest-ServersTestManualDisk-188899892-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2050442800" status: 202 len: 0 microversion: 2.1 time: 0.038485 Sep 17 21:06:02.329139 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1895/3698] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Sep 17 21:06:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2050442800 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:06:02.439347 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f5c8a608-f87d-4a30-82e6-61541fd9c4fc tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Action: 'create', calling method: .version_select at 0x7f25a4ce60d0>, body: {"keypair": {"name": "tempest-keypair-177008269", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeATf/jXabNCZZNPX2OWII6bRdT3IsXAzBWbT3fTkcvlKvXf4PLS910jz4QZTNxk8jQ5JH2aEABWhwHF6WO/WwJr+jU0o84bIBCjIsqrWfldxFea30/kb9NX3+bG1Ap7w=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:02.462506 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1142076c-5339-4068-9f55-4f31f6526d61 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b19896bc4e4d14bfec46dd00519150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c307636beed407582da5779796cc6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:02.479267 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1142076c-5339-4068-9f55-4f31f6526d61 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807" status: 200 len: 1315 microversion: 2.1 time: 0.350499 Sep 17 21:06:02.484873 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=45 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:02.491796 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-f5c8a608-f87d-4a30-82e6-61541fd9c4fc tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Getting quotas for project 6fa7e14863254ab3964ac907c168d9e6. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:06:02.495517 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1804/3699] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:02 2022] GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807 => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:02.529524 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-ad9d945c-f9be-40c9-bef1-e8639640e21f req-be543db9-438c-41b5-b988-9f2deb5d25a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca76130f-7982-4feb-a9d8-9e8f998b509e", "name": "network-vif-plugged", "status": "completed", "tag": "d4d945a4-3009-4fd6-95cd-b4cfc8f16e38"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:02.535081 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-f5c8a608-f87d-4a30-82e6-61541fd9c4fc tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Getting quotas for user c544e8e6f7a741c985c92ed7437397cd and project 6fa7e14863254ab3964ac907c168d9e6. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:06:02.554190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-ad9d945c-f9be-40c9-bef1-e8639640e21f req-be543db9-438c-41b5-b988-9f2deb5d25a6 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:02.556852 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-ad9d945c-f9be-40c9-bef1-e8639640e21f req-be543db9-438c-41b5-b988-9f2deb5d25a6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:02.557509 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-ad9d945c-f9be-40c9-bef1-e8639640e21f req-be543db9-438c-41b5-b988-9f2deb5d25a6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:02.592741 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-ad9d945c-f9be-40c9-bef1-e8639640e21f req-be543db9-438c-41b5-b988-9f2deb5d25a6 service nova] Creating event network-vif-plugged:d4d945a4-3009-4fd6-95cd-b4cfc8f16e38 for instance ca76130f-7982-4feb-a9d8-9e8f998b509e on nch1-master-1 Sep 17 21:06:02.594899 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f5c8a608-f87d-4a30-82e6-61541fd9c4fc tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.263890 Sep 17 21:06:02.597204 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1896/3700] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:06:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:02.606915 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-ad9d945c-f9be-40c9-bef1-e8639640e21f req-be543db9-438c-41b5-b988-9f2deb5d25a6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109363 Sep 17 21:06:02.609780 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1805/3701] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:02.619388 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e069129e-53d7-4ee9-9427-e8acf8fce967 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:02.623103 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e069129e-53d7-4ee9-9427-e8acf8fce967 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 29c92489-5a3c-43e3-8dae-d5168e2a29bb] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:02.626932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-997b69cc-3740-475d-a795-8f6819894faf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:02.629079 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-997b69cc-3740-475d-a795-8f6819894faf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:02.645738 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-997b69cc-3740-475d-a795-8f6819894faf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:02.647272 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-997b69cc-3740-475d-a795-8f6819894faf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:02.648920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-997b69cc-3740-475d-a795-8f6819894faf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:02.650872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-997b69cc-3740-475d-a795-8f6819894faf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:02.651530 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-997b69cc-3740-475d-a795-8f6819894faf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:02.654100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-997b69cc-3740-475d-a795-8f6819894faf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:02.783865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e069129e-53d7-4ee9-9427-e8acf8fce967 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c7a82126124ebb8baf5c656ff9849d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a83c9c29f1483b9ee9c48e94dc17ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:02.794089 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e069129e-53d7-4ee9-9427-e8acf8fce967 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb" status: 200 len: 1242 microversion: 2.1 time: 0.195122 Sep 17 21:06:02.796626 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1897/3702] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:02 2022] GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb => generated 1242 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:03.047261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-997b69cc-3740-475d-a795-8f6819894faf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:03.059648 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-997b69cc-3740-475d-a795-8f6819894faf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1322 microversion: 2.1 time: 0.448113 Sep 17 21:06:03.061499 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1806/3703] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:02 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1322 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:03.147330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cb51b83f-5bea-445e-b0cd-ed522a49bcad tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:03.148612 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cb51b83f-5bea-445e-b0cd-ed522a49bcad tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 60e59237-9ac3-43d8-9231-af2a77fc368e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:03.159390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb51b83f-5bea-445e-b0cd-ed522a49bcad tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:03.161076 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb51b83f-5bea-445e-b0cd-ed522a49bcad tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:03.161852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb51b83f-5bea-445e-b0cd-ed522a49bcad tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:03.163345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb51b83f-5bea-445e-b0cd-ed522a49bcad tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:03.170925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb51b83f-5bea-445e-b0cd-ed522a49bcad tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:03.173880 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb51b83f-5bea-445e-b0cd-ed522a49bcad tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:03.305792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6cf9ca1e-cfdc-4b44-9f74-2d69dca7eaf7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:03.305792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6cf9ca1e-cfdc-4b44-9f74-2d69dca7eaf7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:03.321601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6cf9ca1e-cfdc-4b44-9f74-2d69dca7eaf7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:03.322251 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6cf9ca1e-cfdc-4b44-9f74-2d69dca7eaf7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:03.322701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6cf9ca1e-cfdc-4b44-9f74-2d69dca7eaf7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:03.323433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6cf9ca1e-cfdc-4b44-9f74-2d69dca7eaf7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:03.323895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6cf9ca1e-cfdc-4b44-9f74-2d69dca7eaf7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:03.324319 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6cf9ca1e-cfdc-4b44-9f74-2d69dca7eaf7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:03.492778 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6cf9ca1e-cfdc-4b44-9f74-2d69dca7eaf7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:03.505279 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6cf9ca1e-cfdc-4b44-9f74-2d69dca7eaf7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:03.507395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6cf9ca1e-cfdc-4b44-9f74-2d69dca7eaf7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:03.508847 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6cf9ca1e-cfdc-4b44-9f74-2d69dca7eaf7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f" status: 200 len: 1365 microversion: 2.47 time: 0.209812 Sep 17 21:06:03.529957 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1807/3704] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:03 2022] GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:06:03.538015 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d16db91f-11d0-4c2c-9d1e-68c5da85dcd9 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:03.544105 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d16db91f-11d0-4c2c-9d1e-68c5da85dcd9 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:03.568292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d16db91f-11d0-4c2c-9d1e-68c5da85dcd9 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:03.569549 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d16db91f-11d0-4c2c-9d1e-68c5da85dcd9 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:03.570363 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d16db91f-11d0-4c2c-9d1e-68c5da85dcd9 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:03.574389 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d16db91f-11d0-4c2c-9d1e-68c5da85dcd9 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:03.575064 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d16db91f-11d0-4c2c-9d1e-68c5da85dcd9 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:03.575624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d16db91f-11d0-4c2c-9d1e-68c5da85dcd9 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:03.606766 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cb51b83f-5bea-445e-b0cd-ed522a49bcad tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:03.619688 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cb51b83f-5bea-445e-b0cd-ed522a49bcad tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e" status: 200 len: 1314 microversion: 2.1 time: 0.474336 Sep 17 21:06:03.621891 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1898/3705] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:03 2022] GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:03.822425 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f08ea540-fab1-4007-9108-4458f0c68f6b tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:03.823384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f08ea540-fab1-4007-9108-4458f0c68f6b tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 29c92489-5a3c-43e3-8dae-d5168e2a29bb] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:03.836348 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f08ea540-fab1-4007-9108-4458f0c68f6b tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:03.837603 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f08ea540-fab1-4007-9108-4458f0c68f6b tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:03.838451 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f08ea540-fab1-4007-9108-4458f0c68f6b tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:03.839409 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f08ea540-fab1-4007-9108-4458f0c68f6b tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:03.841013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f08ea540-fab1-4007-9108-4458f0c68f6b tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:03.842466 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f08ea540-fab1-4007-9108-4458f0c68f6b tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:03.947567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d16db91f-11d0-4c2c-9d1e-68c5da85dcd9 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b19896bc4e4d14bfec46dd00519150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c307636beed407582da5779796cc6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:03.948077 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f08ea540-fab1-4007-9108-4458f0c68f6b tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c7a82126124ebb8baf5c656ff9849d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a83c9c29f1483b9ee9c48e94dc17ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:03.961844 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f08ea540-fab1-4007-9108-4458f0c68f6b tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb" status: 200 len: 1294 microversion: 2.1 time: 0.144781 Sep 17 21:06:03.964085 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d16db91f-11d0-4c2c-9d1e-68c5da85dcd9 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807" status: 200 len: 1315 microversion: 2.1 time: 0.431317 Sep 17 21:06:03.965396 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1899/3706] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:03 2022] GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb => generated 1294 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:03.969548 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1808/3707] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:03 2022] GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807 => generated 1315 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:04.054796 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5b8a7b14-f6ca-49a9-90af-4d3a6b79a3df tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:04.055419 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5b8a7b14-f6ca-49a9-90af-4d3a6b79a3df tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] [instance: 829770cb-178d-439d-9efd-ac18ac670932] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:04.062498 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b8a7b14-f6ca-49a9-90af-4d3a6b79a3df tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:04.063103 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b8a7b14-f6ca-49a9-90af-4d3a6b79a3df tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:04.063649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b8a7b14-f6ca-49a9-90af-4d3a6b79a3df tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:04.064537 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b8a7b14-f6ca-49a9-90af-4d3a6b79a3df tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:04.065137 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b8a7b14-f6ca-49a9-90af-4d3a6b79a3df tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:04.066088 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b8a7b14-f6ca-49a9-90af-4d3a6b79a3df tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:04.084736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dcb09f54-39b2-4287-86ae-7cfccabf2b64 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:04.086484 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dcb09f54-39b2-4287-86ae-7cfccabf2b64 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:04.096741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dcb09f54-39b2-4287-86ae-7cfccabf2b64 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:04.097659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dcb09f54-39b2-4287-86ae-7cfccabf2b64 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:04.102167 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dcb09f54-39b2-4287-86ae-7cfccabf2b64 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:04.103156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dcb09f54-39b2-4287-86ae-7cfccabf2b64 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:04.103576 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dcb09f54-39b2-4287-86ae-7cfccabf2b64 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:04.104014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dcb09f54-39b2-4287-86ae-7cfccabf2b64 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:04.126926 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5b8a7b14-f6ca-49a9-90af-4d3a6b79a3df tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] [instance: 829770cb-178d-439d-9efd-ac18ac670932] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:06:04.291973 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5b8a7b14-f6ca-49a9-90af-4d3a6b79a3df tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] 10.222.0.26 "DELETE /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932" status: 204 len: 0 microversion: 2.1 time: 0.240298 Sep 17 21:06:04.295042 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1900/3708] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:06:04 2022] DELETE /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:06:04.304869 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fcb2abd9-2258-464d-b5aa-316762f3111b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:04.305904 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fcb2abd9-2258-464d-b5aa-316762f3111b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] [instance: 829770cb-178d-439d-9efd-ac18ac670932] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:04.314391 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fcb2abd9-2258-464d-b5aa-316762f3111b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:04.315301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fcb2abd9-2258-464d-b5aa-316762f3111b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:04.316019 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fcb2abd9-2258-464d-b5aa-316762f3111b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:04.317286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fcb2abd9-2258-464d-b5aa-316762f3111b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:04.318000 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fcb2abd9-2258-464d-b5aa-316762f3111b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:04.319028 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fcb2abd9-2258-464d-b5aa-316762f3111b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:04.530682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dcb09f54-39b2-4287-86ae-7cfccabf2b64 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:04.541970 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dcb09f54-39b2-4287-86ae-7cfccabf2b64 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1322 microversion: 2.1 time: 0.461226 Sep 17 21:06:04.543282 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1809/3709] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:04 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1322 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:04.548215 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-778ac5b4-97bb-4990-918d-bf46f627aeb7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:04.549114 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-778ac5b4-97bb-4990-918d-bf46f627aeb7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:04.556879 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-778ac5b4-97bb-4990-918d-bf46f627aeb7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:04.561158 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-778ac5b4-97bb-4990-918d-bf46f627aeb7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:04.561926 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-778ac5b4-97bb-4990-918d-bf46f627aeb7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:04.563057 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-778ac5b4-97bb-4990-918d-bf46f627aeb7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:04.563520 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-778ac5b4-97bb-4990-918d-bf46f627aeb7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:04.563966 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-778ac5b4-97bb-4990-918d-bf46f627aeb7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:04.765157 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-778ac5b4-97bb-4990-918d-bf46f627aeb7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:04.784974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-778ac5b4-97bb-4990-918d-bf46f627aeb7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:04.786691 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-778ac5b4-97bb-4990-918d-bf46f627aeb7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:04.788010 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-778ac5b4-97bb-4990-918d-bf46f627aeb7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f" status: 200 len: 1365 microversion: 2.47 time: 0.243458 Sep 17 21:06:04.788581 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1810/3710] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:04 2022] GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:06:04.798740 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-60b05456-8d6c-42e4-aec6-270da57174b6 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:04.814350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-60b05456-8d6c-42e4-aec6-270da57174b6 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 60e59237-9ac3-43d8-9231-af2a77fc368e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:04.828467 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60b05456-8d6c-42e4-aec6-270da57174b6 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:04.829012 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60b05456-8d6c-42e4-aec6-270da57174b6 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:04.834251 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60b05456-8d6c-42e4-aec6-270da57174b6 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:04.835186 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60b05456-8d6c-42e4-aec6-270da57174b6 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:04.843497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60b05456-8d6c-42e4-aec6-270da57174b6 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:04.844278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60b05456-8d6c-42e4-aec6-270da57174b6 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:04.855921 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fcb2abd9-2258-464d-b5aa-316762f3111b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1933f2aed04a45a28bb2617337faa719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598139a6b6764e80822b82231f572770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:04.867350 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fcb2abd9-2258-464d-b5aa-316762f3111b tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] 10.222.0.26 "GET /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932" status: 200 len: 1504 microversion: 2.1 time: 0.567673 Sep 17 21:06:04.870196 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1901/3711] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:04 2022] GET /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932 => generated 1504 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:04.885973 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-187210ba-52a9-4942-aec6-4930db17af49 req-c2ad29b6-725d-4f2c-92fa-aab1fbfa2293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807", "name": "network-vif-plugged", "status": "completed", "tag": "ebef2569-9674-41fe-bd16-737edb72b2ba"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:04.903649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-187210ba-52a9-4942-aec6-4930db17af49 req-c2ad29b6-725d-4f2c-92fa-aab1fbfa2293 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:04.905968 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-187210ba-52a9-4942-aec6-4930db17af49 req-c2ad29b6-725d-4f2c-92fa-aab1fbfa2293 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:04.906590 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-187210ba-52a9-4942-aec6-4930db17af49 req-c2ad29b6-725d-4f2c-92fa-aab1fbfa2293 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:04.929294 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-187210ba-52a9-4942-aec6-4930db17af49 req-c2ad29b6-725d-4f2c-92fa-aab1fbfa2293 service nova] Creating event network-vif-plugged:ebef2569-9674-41fe-bd16-737edb72b2ba for instance d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807 on nch2-master-1 Sep 17 21:06:04.937187 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-187210ba-52a9-4942-aec6-4930db17af49 req-c2ad29b6-725d-4f2c-92fa-aab1fbfa2293 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062465 Sep 17 21:06:04.938887 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1902/3712] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:04.990917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c00f9d4e-4886-4af6-aaf7-e7dd706a97b4 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:04.992176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c00f9d4e-4886-4af6-aaf7-e7dd706a97b4 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 29c92489-5a3c-43e3-8dae-d5168e2a29bb] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:05.000464 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c00f9d4e-4886-4af6-aaf7-e7dd706a97b4 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:05.001100 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c00f9d4e-4886-4af6-aaf7-e7dd706a97b4 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:05.002890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c00f9d4e-4886-4af6-aaf7-e7dd706a97b4 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:05.002890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c00f9d4e-4886-4af6-aaf7-e7dd706a97b4 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:05.003461 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c00f9d4e-4886-4af6-aaf7-e7dd706a97b4 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:05.003953 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c00f9d4e-4886-4af6-aaf7-e7dd706a97b4 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:05.240958 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c00f9d4e-4886-4af6-aaf7-e7dd706a97b4 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c7a82126124ebb8baf5c656ff9849d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a83c9c29f1483b9ee9c48e94dc17ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:05.259894 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c00f9d4e-4886-4af6-aaf7-e7dd706a97b4 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb" status: 200 len: 1312 microversion: 2.1 time: 0.274866 Sep 17 21:06:05.266756 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1903/3713] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:04 2022] GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb => generated 1312 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:05.277660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1f3b5247-0033-437b-a8e7-1a4ed9d652b2 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:05.278580 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1f3b5247-0033-437b-a8e7-1a4ed9d652b2 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:05.299212 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f3b5247-0033-437b-a8e7-1a4ed9d652b2 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:05.300592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f3b5247-0033-437b-a8e7-1a4ed9d652b2 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:05.303904 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f3b5247-0033-437b-a8e7-1a4ed9d652b2 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:05.304106 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-60b05456-8d6c-42e4-aec6-270da57174b6 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:05.305806 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f3b5247-0033-437b-a8e7-1a4ed9d652b2 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:05.306655 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f3b5247-0033-437b-a8e7-1a4ed9d652b2 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:05.309060 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f3b5247-0033-437b-a8e7-1a4ed9d652b2 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:05.314862 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-60b05456-8d6c-42e4-aec6-270da57174b6 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e" status: 200 len: 1314 microversion: 2.1 time: 0.519804 Sep 17 21:06:05.327497 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1811/3714] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:04 2022] GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e => generated 1314 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:05.564677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4c92eb56-a853-41c0-a2d3-3cf3ecbc1130 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:05.565714 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4c92eb56-a853-41c0-a2d3-3cf3ecbc1130 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:05.595045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c92eb56-a853-41c0-a2d3-3cf3ecbc1130 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:05.595554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c92eb56-a853-41c0-a2d3-3cf3ecbc1130 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:05.595998 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c92eb56-a853-41c0-a2d3-3cf3ecbc1130 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:05.596780 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c92eb56-a853-41c0-a2d3-3cf3ecbc1130 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:05.597237 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c92eb56-a853-41c0-a2d3-3cf3ecbc1130 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:05.597696 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c92eb56-a853-41c0-a2d3-3cf3ecbc1130 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:06.512072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1f3b5247-0033-437b-a8e7-1a4ed9d652b2 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b19896bc4e4d14bfec46dd00519150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c307636beed407582da5779796cc6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:06.531633 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4c92eb56-a853-41c0-a2d3-3cf3ecbc1130 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:06.533839 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1f3b5247-0033-437b-a8e7-1a4ed9d652b2 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807" status: 200 len: 1315 microversion: 2.1 time: 1.263840 Sep 17 21:06:06.534753 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1904/3715] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:05 2022] GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807 => generated 1315 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:06.544719 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4c92eb56-a853-41c0-a2d3-3cf3ecbc1130 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1515 microversion: 2.1 time: 0.984193 Sep 17 21:06:06.545627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e9b9a4ee-d06e-4f3e-a2ff-92bb6495fcc7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:06.546787 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e9b9a4ee-d06e-4f3e-a2ff-92bb6495fcc7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:06.550116 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1812/3716] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:05 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1515 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:06.555054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bd760c75-b0cc-4f9b-aa41-2bbfc2bfed56 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:06.562381 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bd760c75-b0cc-4f9b-aa41-2bbfc2bfed56 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] [instance: 829770cb-178d-439d-9efd-ac18ac670932] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:06.576460 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9b9a4ee-d06e-4f3e-a2ff-92bb6495fcc7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:06.578897 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9b9a4ee-d06e-4f3e-a2ff-92bb6495fcc7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:06.579065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd760c75-b0cc-4f9b-aa41-2bbfc2bfed56 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:06.580024 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9b9a4ee-d06e-4f3e-a2ff-92bb6495fcc7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:06.581032 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9b9a4ee-d06e-4f3e-a2ff-92bb6495fcc7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:06.581704 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9b9a4ee-d06e-4f3e-a2ff-92bb6495fcc7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:06.582411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9b9a4ee-d06e-4f3e-a2ff-92bb6495fcc7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:06.583626 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd760c75-b0cc-4f9b-aa41-2bbfc2bfed56 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:06.584320 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd760c75-b0cc-4f9b-aa41-2bbfc2bfed56 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:06.585221 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd760c75-b0cc-4f9b-aa41-2bbfc2bfed56 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:06.590462 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd760c75-b0cc-4f9b-aa41-2bbfc2bfed56 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:06.591259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd760c75-b0cc-4f9b-aa41-2bbfc2bfed56 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:06.840515 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e9b9a4ee-d06e-4f3e-a2ff-92bb6495fcc7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:06.853029 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e9b9a4ee-d06e-4f3e-a2ff-92bb6495fcc7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:06.854881 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e9b9a4ee-d06e-4f3e-a2ff-92bb6495fcc7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:06.856320 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e9b9a4ee-d06e-4f3e-a2ff-92bb6495fcc7 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f" status: 200 len: 1365 microversion: 2.47 time: 0.318287 Sep 17 21:06:06.856894 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1905/3717] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:06 2022] GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f => generated 1365 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:06:06.874902 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a45d06f1-de87-491a-aa90-a7d134beaf78 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:06.875819 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a45d06f1-de87-491a-aa90-a7d134beaf78 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 29c92489-5a3c-43e3-8dae-d5168e2a29bb] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:06.887956 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a45d06f1-de87-491a-aa90-a7d134beaf78 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:06.889725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a45d06f1-de87-491a-aa90-a7d134beaf78 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:06.890440 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a45d06f1-de87-491a-aa90-a7d134beaf78 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:06.892042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a45d06f1-de87-491a-aa90-a7d134beaf78 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:06.894627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a45d06f1-de87-491a-aa90-a7d134beaf78 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:06.895357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a45d06f1-de87-491a-aa90-a7d134beaf78 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:07.131877 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a45d06f1-de87-491a-aa90-a7d134beaf78 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c7a82126124ebb8baf5c656ff9849d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a83c9c29f1483b9ee9c48e94dc17ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:07.140713 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a45d06f1-de87-491a-aa90-a7d134beaf78 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb" status: 200 len: 1300 microversion: 2.1 time: 0.282480 Sep 17 21:06:07.141790 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1906/3718] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:06 2022] GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb => generated 1300 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:07.147020 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c18035c8-6915-4a1d-b0ec-4bef48554fe7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:07.147670 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c18035c8-6915-4a1d-b0ec-4bef48554fe7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 60e59237-9ac3-43d8-9231-af2a77fc368e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:07.153906 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c18035c8-6915-4a1d-b0ec-4bef48554fe7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:07.154643 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c18035c8-6915-4a1d-b0ec-4bef48554fe7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:07.155809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c18035c8-6915-4a1d-b0ec-4bef48554fe7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:07.156788 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c18035c8-6915-4a1d-b0ec-4bef48554fe7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:07.157448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c18035c8-6915-4a1d-b0ec-4bef48554fe7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:07.157911 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c18035c8-6915-4a1d-b0ec-4bef48554fe7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:07.330062 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bd760c75-b0cc-4f9b-aa41-2bbfc2bfed56 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1933f2aed04a45a28bb2617337faa719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598139a6b6764e80822b82231f572770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:07.339894 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bd760c75-b0cc-4f9b-aa41-2bbfc2bfed56 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] 10.222.0.26 "GET /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932" status: 200 len: 1504 microversion: 2.1 time: 0.788388 Sep 17 21:06:07.342770 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1813/3719] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:06 2022] GET /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932 => generated 1504 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:07.362532 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-91c9bc80-44da-466e-921a-a08c7f74d05c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:07.365213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-91c9bc80-44da-466e-921a-a08c7f74d05c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:07.371552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-91c9bc80-44da-466e-921a-a08c7f74d05c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:07.372055 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-91c9bc80-44da-466e-921a-a08c7f74d05c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:07.372505 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-91c9bc80-44da-466e-921a-a08c7f74d05c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:07.373223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-91c9bc80-44da-466e-921a-a08c7f74d05c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:07.373761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-91c9bc80-44da-466e-921a-a08c7f74d05c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:07.374182 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-91c9bc80-44da-466e-921a-a08c7f74d05c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:07.399673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-91c9bc80-44da-466e-921a-a08c7f74d05c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lazy-loading 'flavor' on Instance uuid ca76130f-7982-4feb-a9d8-9e8f998b509e {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:06:07.419061 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:07.509406 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-91c9bc80-44da-466e-921a-a08c7f74d05c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "POST /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e/action" status: 200 len: 32 microversion: 2.1 time: 0.150892 Sep 17 21:06:07.517542 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1814/3720] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:06:07 2022] POST /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e/action => generated 32 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:06:07.524321 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-f74f4d11-b8c9-4620-94c2-48be5a268659 req-d2d9c06e-4a67-4835-9e22-5f139f57160b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "904ea7d3-2a78-408a-8a14-bac3845f6e7d", "name": "network-vif-plugged", "status": "completed", "tag": "5906edb3-bf5e-4b3d-a715-33e774720045"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:07.542750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f74f4d11-b8c9-4620-94c2-48be5a268659 req-d2d9c06e-4a67-4835-9e22-5f139f57160b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:07.543454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f74f4d11-b8c9-4620-94c2-48be5a268659 req-d2d9c06e-4a67-4835-9e22-5f139f57160b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:07.544000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f74f4d11-b8c9-4620-94c2-48be5a268659 req-d2d9c06e-4a67-4835-9e22-5f139f57160b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:07.562817 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-f74f4d11-b8c9-4620-94c2-48be5a268659 req-d2d9c06e-4a67-4835-9e22-5f139f57160b service nova] Creating event network-vif-plugged:5906edb3-bf5e-4b3d-a715-33e774720045 for instance 904ea7d3-2a78-408a-8a14-bac3845f6e7d on nch2-master-1 Sep 17 21:06:07.567825 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-f74f4d11-b8c9-4620-94c2-48be5a268659 req-d2d9c06e-4a67-4835-9e22-5f139f57160b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048213 Sep 17 21:06:07.568573 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1815/3721] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:07.575970 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e7d26dfc-f218-41ca-bc3d-2e416232064a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:07.576759 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e7d26dfc-f218-41ca-bc3d-2e416232064a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:07.583659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7d26dfc-f218-41ca-bc3d-2e416232064a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:07.584285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7d26dfc-f218-41ca-bc3d-2e416232064a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:07.584703 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7d26dfc-f218-41ca-bc3d-2e416232064a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:07.585515 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7d26dfc-f218-41ca-bc3d-2e416232064a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:07.586034 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7d26dfc-f218-41ca-bc3d-2e416232064a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:07.586464 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7d26dfc-f218-41ca-bc3d-2e416232064a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:07.678567 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c18035c8-6915-4a1d-b0ec-4bef48554fe7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:07.699306 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c18035c8-6915-4a1d-b0ec-4bef48554fe7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e" status: 200 len: 1314 microversion: 2.1 time: 0.552526 Sep 17 21:06:07.725996 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1907/3722] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:07 2022] GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e => generated 1314 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:07.745821 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-520ec1e6-a971-46c8-8d26-4fe7a7b12957 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:07.746473 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-520ec1e6-a971-46c8-8d26-4fe7a7b12957 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:07.767148 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-520ec1e6-a971-46c8-8d26-4fe7a7b12957 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:07.767686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-520ec1e6-a971-46c8-8d26-4fe7a7b12957 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:07.769726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-520ec1e6-a971-46c8-8d26-4fe7a7b12957 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:07.770703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-520ec1e6-a971-46c8-8d26-4fe7a7b12957 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:07.771431 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-520ec1e6-a971-46c8-8d26-4fe7a7b12957 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:07.772199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-520ec1e6-a971-46c8-8d26-4fe7a7b12957 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:08.244646 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e7d26dfc-f218-41ca-bc3d-2e416232064a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:08.265799 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e7d26dfc-f218-41ca-bc3d-2e416232064a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1521 microversion: 2.1 time: 0.695667 Sep 17 21:06:08.267749 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1816/3723] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:07 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1521 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:08.274140 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b7100a18-c44a-482b-b9a4-be89cd1a18b6 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:08.275296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b7100a18-c44a-482b-b9a4-be89cd1a18b6 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:08.284669 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b7100a18-c44a-482b-b9a4-be89cd1a18b6 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:08.285572 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b7100a18-c44a-482b-b9a4-be89cd1a18b6 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:08.286324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b7100a18-c44a-482b-b9a4-be89cd1a18b6 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:08.288065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b7100a18-c44a-482b-b9a4-be89cd1a18b6 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:08.288855 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b7100a18-c44a-482b-b9a4-be89cd1a18b6 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:08.290616 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b7100a18-c44a-482b-b9a4-be89cd1a18b6 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:08.359726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-520ec1e6-a971-46c8-8d26-4fe7a7b12957 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b19896bc4e4d14bfec46dd00519150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c307636beed407582da5779796cc6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:08.369885 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-520ec1e6-a971-46c8-8d26-4fe7a7b12957 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807" status: 200 len: 1504 microversion: 2.1 time: 0.641635 Sep 17 21:06:08.370789 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1908/3724] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:07 2022] GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807 => generated 1504 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:08.375882 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-2fef4ee5-f399-4127-83cc-2b33e5b983aa req-502cae70-5c21-4c3a-9e94-e2a56bfbfd68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "829770cb-178d-439d-9efd-ac18ac670932", "name": "network-vif-deleted", "tag": "3eaf7ffc-5d01-482a-a2a3-bf5ac46ab065"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:08.388401 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-2fef4ee5-f399-4127-83cc-2b33e5b983aa req-502cae70-5c21-4c3a-9e94-e2a56bfbfd68 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:08.389242 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-2fef4ee5-f399-4127-83cc-2b33e5b983aa req-502cae70-5c21-4c3a-9e94-e2a56bfbfd68 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:08.389888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-2fef4ee5-f399-4127-83cc-2b33e5b983aa req-502cae70-5c21-4c3a-9e94-e2a56bfbfd68 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:08.404996 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-2fef4ee5-f399-4127-83cc-2b33e5b983aa req-502cae70-5c21-4c3a-9e94-e2a56bfbfd68 service nova] Creating event network-vif-deleted:3eaf7ffc-5d01-482a-a2a3-bf5ac46ab065 for instance 829770cb-178d-439d-9efd-ac18ac670932 on nch2-master-1 Sep 17 21:06:08.411042 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-2fef4ee5-f399-4127-83cc-2b33e5b983aa req-502cae70-5c21-4c3a-9e94-e2a56bfbfd68 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038916 Sep 17 21:06:08.412319 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1909/3725] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:08.420200 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4d46cc64-0b9b-4bb9-9007-44ed94ae13a5 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:08.422414 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4d46cc64-0b9b-4bb9-9007-44ed94ae13a5 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 29c92489-5a3c-43e3-8dae-d5168e2a29bb] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:08.431987 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d46cc64-0b9b-4bb9-9007-44ed94ae13a5 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:08.436617 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b7100a18-c44a-482b-b9a4-be89cd1a18b6 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:08.448308 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d46cc64-0b9b-4bb9-9007-44ed94ae13a5 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:08.450380 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d46cc64-0b9b-4bb9-9007-44ed94ae13a5 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:08.452167 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d46cc64-0b9b-4bb9-9007-44ed94ae13a5 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:08.454434 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d46cc64-0b9b-4bb9-9007-44ed94ae13a5 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:08.455019 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b7100a18-c44a-482b-b9a4-be89cd1a18b6 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:08.456064 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d46cc64-0b9b-4bb9-9007-44ed94ae13a5 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:08.460256 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b7100a18-c44a-482b-b9a4-be89cd1a18b6 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:08.463446 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b7100a18-c44a-482b-b9a4-be89cd1a18b6 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f" status: 200 len: 1365 microversion: 2.47 time: 0.193126 Sep 17 21:06:08.465531 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1817/3726] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:08 2022] GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f => generated 1365 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:06:08.475593 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5b74ff5f-d19d-4aa4-96f9-0e33060623fb tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:08.478229 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5b74ff5f-d19d-4aa4-96f9-0e33060623fb tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] [instance: 829770cb-178d-439d-9efd-ac18ac670932] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:08.492368 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b74ff5f-d19d-4aa4-96f9-0e33060623fb tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:08.494137 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b74ff5f-d19d-4aa4-96f9-0e33060623fb tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:08.494758 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b74ff5f-d19d-4aa4-96f9-0e33060623fb tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:08.495655 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b74ff5f-d19d-4aa4-96f9-0e33060623fb tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:08.496284 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b74ff5f-d19d-4aa4-96f9-0e33060623fb tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:08.497010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b74ff5f-d19d-4aa4-96f9-0e33060623fb tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:08.550986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b74ff5f-d19d-4aa4-96f9-0e33060623fb tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:08.551759 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b74ff5f-d19d-4aa4-96f9-0e33060623fb tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:08.552206 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b74ff5f-d19d-4aa4-96f9-0e33060623fb tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:08.552667 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-5b74ff5f-d19d-4aa4-96f9-0e33060623fb tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lazy-loading 'fault' on Instance uuid 829770cb-178d-439d-9efd-ac18ac670932 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:06:08.721486 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5b74ff5f-d19d-4aa4-96f9-0e33060623fb tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1933f2aed04a45a28bb2617337faa719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '598139a6b6764e80822b82231f572770', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:08.737707 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5b74ff5f-d19d-4aa4-96f9-0e33060623fb tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] 10.222.0.26 "GET /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932" status: 200 len: 1303 microversion: 2.1 time: 0.270761 Sep 17 21:06:08.738739 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1818/3727] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:08 2022] GET /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932 => generated 1303 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:08.760288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dae06ee6-5615-4cf0-82a9-b392178155c8 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-85286507"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:08.760836 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dae06ee6-5615-4cf0-82a9-b392178155c8 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:08.768534 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dae06ee6-5615-4cf0-82a9-b392178155c8 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:08.769044 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dae06ee6-5615-4cf0-82a9-b392178155c8 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:08.769523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dae06ee6-5615-4cf0-82a9-b392178155c8 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:08.770604 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dae06ee6-5615-4cf0-82a9-b392178155c8 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:08.771447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dae06ee6-5615-4cf0-82a9-b392178155c8 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:08.772051 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dae06ee6-5615-4cf0-82a9-b392178155c8 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:08.880947 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4d46cc64-0b9b-4bb9-9007-44ed94ae13a5 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c7a82126124ebb8baf5c656ff9849d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a83c9c29f1483b9ee9c48e94dc17ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:08.895042 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4d46cc64-0b9b-4bb9-9007-44ed94ae13a5 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb" status: 200 len: 1367 microversion: 2.1 time: 0.480359 Sep 17 21:06:08.898911 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1910/3728] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:08 2022] GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb => generated 1367 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:08.904442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-963bfe77-116d-4a39-83c7-687baa1a43a1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:08.905276 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-963bfe77-116d-4a39-83c7-687baa1a43a1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 60e59237-9ac3-43d8-9231-af2a77fc368e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:08.912720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-963bfe77-116d-4a39-83c7-687baa1a43a1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:08.913914 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-963bfe77-116d-4a39-83c7-687baa1a43a1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:08.914532 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-963bfe77-116d-4a39-83c7-687baa1a43a1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:08.915485 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-963bfe77-116d-4a39-83c7-687baa1a43a1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:08.916177 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-963bfe77-116d-4a39-83c7-687baa1a43a1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:08.916935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-963bfe77-116d-4a39-83c7-687baa1a43a1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:09.169474 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.network.security_group_api [None req-dae06ee6-5615-4cf0-82a9-b392178155c8 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Adding security group acf9495b-8ee9-443d-b778-676fa503e326 to port ebef2569-9674-41fe-bd16-737edb72b2ba Sep 17 21:06:09.320817 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-963bfe77-116d-4a39-83c7-687baa1a43a1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:09.329851 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-963bfe77-116d-4a39-83c7-687baa1a43a1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e" status: 200 len: 1314 microversion: 2.1 time: 0.429231 Sep 17 21:06:09.330441 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1911/3729] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:08 2022] GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:09.335874 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e199c1a6-86bd-426e-9830-d22e6e049d79 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-117369209", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c4c3ad81-e8f3-4b9c-972a-042303636823"}], "security_groups": [{"name": "tempest-securitygroup--816384613"}], "key_name": "tempest-keypair-177008269", "user_data": "}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:09.717999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-e199c1a6-86bd-426e-9830-d22e6e049d79 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] validate_networks() for [('c4c3ad81-e8f3-4b9c-972a-042303636823', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:06:10.331660 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dae06ee6-5615-4cf0-82a9-b392178155c8 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "POST /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807/action" status: 202 len: 0 microversion: 2.1 time: 1.576868 Sep 17 21:06:10.332295 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1819/3730] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:06:08 2022] POST /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807/action => generated 0 bytes in 1593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:06:10.337109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ccc7107e-5e2a-4624-9ebc-509a7b85d2aa tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:10.337775 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ccc7107e-5e2a-4624-9ebc-509a7b85d2aa tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:10.344270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ccc7107e-5e2a-4624-9ebc-509a7b85d2aa tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:10.345033 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ccc7107e-5e2a-4624-9ebc-509a7b85d2aa tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:10.345684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ccc7107e-5e2a-4624-9ebc-509a7b85d2aa tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:10.346667 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ccc7107e-5e2a-4624-9ebc-509a7b85d2aa tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:10.347372 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ccc7107e-5e2a-4624-9ebc-509a7b85d2aa tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:10.347985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ccc7107e-5e2a-4624-9ebc-509a7b85d2aa tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:11.095729 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ccc7107e-5e2a-4624-9ebc-509a7b85d2aa tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:11.104695 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ccc7107e-5e2a-4624-9ebc-509a7b85d2aa tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1521 microversion: 2.1 time: 0.771338 Sep 17 21:06:11.105491 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1820/3731] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:10 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1521 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:11.120834 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1e9f115c-cf1e-4e3e-8e4a-819fdbbdba96 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:11.121502 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1e9f115c-cf1e-4e3e-8e4a-819fdbbdba96 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:11.128015 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1e9f115c-cf1e-4e3e-8e4a-819fdbbdba96 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:11.129012 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1e9f115c-cf1e-4e3e-8e4a-819fdbbdba96 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:11.129497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1e9f115c-cf1e-4e3e-8e4a-819fdbbdba96 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:11.130578 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1e9f115c-cf1e-4e3e-8e4a-819fdbbdba96 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:11.131327 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1e9f115c-cf1e-4e3e-8e4a-819fdbbdba96 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:11.131757 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1e9f115c-cf1e-4e3e-8e4a-819fdbbdba96 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:11.146768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-e199c1a6-86bd-426e-9830-d22e6e049d79 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:06:11.147270 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-e199c1a6-86bd-426e-9830-d22e6e049d79 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:06:11.148111 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-e199c1a6-86bd-426e-9830-d22e6e049d79 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:06:11.148337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-e199c1a6-86bd-426e-9830-d22e6e049d79 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:06:11.148964 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-e199c1a6-86bd-426e-9830-d22e6e049d79 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:06:11.167344 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e199c1a6-86bd-426e-9830-d22e6e049d79 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:11.174116 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e199c1a6-86bd-426e-9830-d22e6e049d79 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:11.174699 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e199c1a6-86bd-426e-9830-d22e6e049d79 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:11.175600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e199c1a6-86bd-426e-9830-d22e6e049d79 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:11.176163 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e199c1a6-86bd-426e-9830-d22e6e049d79 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:11.176837 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e199c1a6-86bd-426e-9830-d22e6e049d79 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:11.205361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-e199c1a6-86bd-426e-9830-d22e6e049d79 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Getting quotas for project 6fa7e14863254ab3964ac907c168d9e6. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:06:11.212521 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-e199c1a6-86bd-426e-9830-d22e6e049d79 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Getting quotas for user c544e8e6f7a741c985c92ed7437397cd and project 6fa7e14863254ab3964ac907c168d9e6. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:06:11.225531 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e199c1a6-86bd-426e-9830-d22e6e049d79 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:06:11.235415 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1e9f115c-cf1e-4e3e-8e4a-819fdbbdba96 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:11.237073 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e199c1a6-86bd-426e-9830-d22e6e049d79 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 839ed6b8-9a04-4448-afb8-1eb643476249] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:06:11.260767 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1e9f115c-cf1e-4e3e-8e4a-819fdbbdba96 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:11.263127 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1e9f115c-cf1e-4e3e-8e4a-819fdbbdba96 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:11.264478 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1e9f115c-cf1e-4e3e-8e4a-819fdbbdba96 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f" status: 200 len: 1365 microversion: 2.47 time: 0.147933 Sep 17 21:06:11.265442 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1821/3732] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:11 2022] GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:06:11.270283 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:11.272523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-2f6d403e-48a8-4667-8728-a1267f4af422 req-2e32b942-e347-4e37-849c-07e02d9ac79a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60e59237-9ac3-43d8-9231-af2a77fc368e", "name": "network-vif-plugged", "status": "completed", "tag": "130a8d55-49d4-4d80-b4c6-a7ebbe54f44f"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:11.285151 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2f6d403e-48a8-4667-8728-a1267f4af422 req-2e32b942-e347-4e37-849c-07e02d9ac79a service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:11.285985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2f6d403e-48a8-4667-8728-a1267f4af422 req-2e32b942-e347-4e37-849c-07e02d9ac79a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:11.286478 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2f6d403e-48a8-4667-8728-a1267f4af422 req-2e32b942-e347-4e37-849c-07e02d9ac79a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:11.309256 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-2f6d403e-48a8-4667-8728-a1267f4af422 req-2e32b942-e347-4e37-849c-07e02d9ac79a service nova] Creating event network-vif-plugged:130a8d55-49d4-4d80-b4c6-a7ebbe54f44f for instance 60e59237-9ac3-43d8-9231-af2a77fc368e on nch1-master-1 Sep 17 21:06:11.320630 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-2f6d403e-48a8-4667-8728-a1267f4af422 req-2e32b942-e347-4e37-849c-07e02d9ac79a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052847 Sep 17 21:06:11.321733 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1822/3733] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:11.323624 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e199c1a6-86bd-426e-9830-d22e6e049d79 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.991892 Sep 17 21:06:11.326871 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1912/3734] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:06:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 1996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:06:11.337734 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6f2d2d31-f8c5-4a0e-af48-ad6a9ce27471 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:11.339489 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6f2d2d31-f8c5-4a0e-af48-ad6a9ce27471 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 29c92489-5a3c-43e3-8dae-d5168e2a29bb] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:11.355499 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f2d2d31-f8c5-4a0e-af48-ad6a9ce27471 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:11.360662 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d2c2c2c4-467f-46e3-aa6d-adb22b0d4203 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:11.361299 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f2d2d31-f8c5-4a0e-af48-ad6a9ce27471 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:11.362612 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f2d2d31-f8c5-4a0e-af48-ad6a9ce27471 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:11.363484 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f2d2d31-f8c5-4a0e-af48-ad6a9ce27471 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:11.364297 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f2d2d31-f8c5-4a0e-af48-ad6a9ce27471 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:11.364991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f2d2d31-f8c5-4a0e-af48-ad6a9ce27471 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:11.367765 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d2c2c2c4-467f-46e3-aa6d-adb22b0d4203 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] [instance: 829770cb-178d-439d-9efd-ac18ac670932] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:11.393214 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2c2c2c4-467f-46e3-aa6d-adb22b0d4203 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:11.395729 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2c2c2c4-467f-46e3-aa6d-adb22b0d4203 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:11.397905 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2c2c2c4-467f-46e3-aa6d-adb22b0d4203 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:11.399475 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2c2c2c4-467f-46e3-aa6d-adb22b0d4203 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:11.401371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2c2c2c4-467f-46e3-aa6d-adb22b0d4203 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:11.418428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2c2c2c4-467f-46e3-aa6d-adb22b0d4203 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:11.443570 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-d2c2c2c4-467f-46e3-aa6d-adb22b0d4203 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] HTTP exception thrown: Instance 829770cb-178d-439d-9efd-ac18ac670932 could not be found. Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d2c2c2c4-467f-46e3-aa6d-adb22b0d4203 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Request method failure captured: Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932 HTTP/1.1 Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjaXOGdxawlZPd8j385XkzW0Trr6vnppotXj-qrME2I8-4hCnr1Y8cQo3MWOm4NGIKR9KGhu_k8cwtQabuXWwmXnqEX17w1Em-BpAQIP5m7Gs4JZRLsWws6U_AddwvrKTAKsa1IKO_dT9eibuiMSfzTdnt_3x1yRniZXWBWFYaaSqG8 Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 598139a6b6764e80822b82231f572770 Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-VolumesActionsTest-176422482 Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/598139a6b6764e80822b82231f572770"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/598139a6b6764e80822b82231f572770"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/598139a6b6764e80822b82231f572770"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_598139a6b6764e80822b82231f572770", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-VolumesActionsTest-176422482 Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 598139a6b6764e80822b82231f572770 Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-VolumesActionsTest-176422482 Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-VolumesActionsTest-176422482-project Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 1933f2aed04a45a28bb2617337faa719 Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-VolumesActionsTest-176422482-project Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 829770cb-178d-439d-9efd-ac18ac670932 could not be found. Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '829770cb-178d-439d-9efd-ac18ac670932'} Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 829770cb-178d-439d-9efd-ac18ac670932 could not be found. Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 829770cb-178d-439d-9efd-ac18ac670932 could not be found. Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:11.445700 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:11.452588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:11.452588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:11.452588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:11.452588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:06:11.452588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:06:11.452588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 829770cb-178d-439d-9efd-ac18ac670932 could not be found. Sep 17 21:06:11.452588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:11.452588 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d2c2c2c4-467f-46e3-aa6d-adb22b0d4203 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] Returning 404 to user: Instance 829770cb-178d-439d-9efd-ac18ac670932 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:06:11.454511 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d2c2c2c4-467f-46e3-aa6d-adb22b0d4203 tempest-VolumesActionsTest-176422482 tempest-VolumesActionsTest-176422482-project] 10.222.0.26 "GET /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932" status: 404 len: 111 microversion: 2.1 time: 0.124444 Sep 17 21:06:11.470204 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1823/3735] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:11 2022] GET /compute/v2.1/servers/829770cb-178d-439d-9efd-ac18ac670932 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:06:11.476082 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-aa20f78b-ff80-4d12-bb47-6388b8b37f23 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-230231598"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:11.476812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-aa20f78b-ff80-4d12-bb47-6388b8b37f23 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:11.495114 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa20f78b-ff80-4d12-bb47-6388b8b37f23 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:11.497601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa20f78b-ff80-4d12-bb47-6388b8b37f23 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:11.498270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa20f78b-ff80-4d12-bb47-6388b8b37f23 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:11.499181 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa20f78b-ff80-4d12-bb47-6388b8b37f23 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:11.507148 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa20f78b-ff80-4d12-bb47-6388b8b37f23 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:11.508462 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa20f78b-ff80-4d12-bb47-6388b8b37f23 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:11.680255 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6f2d2d31-f8c5-4a0e-af48-ad6a9ce27471 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c7a82126124ebb8baf5c656ff9849d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a83c9c29f1483b9ee9c48e94dc17ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:11.693481 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6f2d2d31-f8c5-4a0e-af48-ad6a9ce27471 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb" status: 200 len: 1367 microversion: 2.1 time: 0.365167 Sep 17 21:06:11.696575 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1913/3736] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:11 2022] GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb => generated 1367 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:11.715080 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-398a4b03-d3cb-457e-9c6b-9acb6d9fdddb tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:11.715741 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-398a4b03-d3cb-457e-9c6b-9acb6d9fdddb tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 60e59237-9ac3-43d8-9231-af2a77fc368e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:11.722958 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-398a4b03-d3cb-457e-9c6b-9acb6d9fdddb tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:11.723658 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-398a4b03-d3cb-457e-9c6b-9acb6d9fdddb tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:11.724333 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-398a4b03-d3cb-457e-9c6b-9acb6d9fdddb tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:11.725247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-398a4b03-d3cb-457e-9c6b-9acb6d9fdddb tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:11.725921 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-398a4b03-d3cb-457e-9c6b-9acb6d9fdddb tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:11.726568 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-398a4b03-d3cb-457e-9c6b-9acb6d9fdddb tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:11.731977 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:11.791840 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.network.security_group_api [None req-aa20f78b-ff80-4d12-bb47-6388b8b37f23 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Adding security group e926e02b-cabf-4bc2-8d7f-591c32051960 to port ebef2569-9674-41fe-bd16-737edb72b2ba Sep 17 21:06:12.216279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-398a4b03-d3cb-457e-9c6b-9acb6d9fdddb tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:12.228474 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-398a4b03-d3cb-457e-9c6b-9acb6d9fdddb tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e" status: 200 len: 1314 microversion: 2.1 time: 0.530726 Sep 17 21:06:12.229259 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1914/3737] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:11 2022] GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e => generated 1314 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:12.238095 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-97b39746-b7fc-46cd-b4c1-8a15d474b78a req-1f2f982f-7890-4b53-81c2-a743925c8197 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807", "tag": "ebef2569-9674-41fe-bd16-737edb72b2ba"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:12.251119 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-97b39746-b7fc-46cd-b4c1-8a15d474b78a req-1f2f982f-7890-4b53-81c2-a743925c8197 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:12.252334 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-97b39746-b7fc-46cd-b4c1-8a15d474b78a req-1f2f982f-7890-4b53-81c2-a743925c8197 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:12.252942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-97b39746-b7fc-46cd-b4c1-8a15d474b78a req-1f2f982f-7890-4b53-81c2-a743925c8197 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:12.270129 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-97b39746-b7fc-46cd-b4c1-8a15d474b78a req-1f2f982f-7890-4b53-81c2-a743925c8197 service nova] Creating event network-changed:ebef2569-9674-41fe-bd16-737edb72b2ba for instance d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807 on nch2-master-1 Sep 17 21:06:12.276645 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-97b39746-b7fc-46cd-b4c1-8a15d474b78a req-1f2f982f-7890-4b53-81c2-a743925c8197 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045418 Sep 17 21:06:12.277611 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1915/3738] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:12.284828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2103d82c-5a87-4d8d-8247-201e584814a2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:12.285754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2103d82c-5a87-4d8d-8247-201e584814a2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 839ed6b8-9a04-4448-afb8-1eb643476249] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:12.294372 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2103d82c-5a87-4d8d-8247-201e584814a2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:12.294913 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2103d82c-5a87-4d8d-8247-201e584814a2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:12.296067 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2103d82c-5a87-4d8d-8247-201e584814a2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:12.297046 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2103d82c-5a87-4d8d-8247-201e584814a2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:12.297533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2103d82c-5a87-4d8d-8247-201e584814a2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:12.298105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2103d82c-5a87-4d8d-8247-201e584814a2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:12.434899 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2103d82c-5a87-4d8d-8247-201e584814a2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:12.443249 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2103d82c-5a87-4d8d-8247-201e584814a2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249" status: 200 len: 1244 microversion: 2.1 time: 0.163865 Sep 17 21:06:12.454613 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1916/3739] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:12 2022] GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249 => generated 1244 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:12.459929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8390ec53-d8f4-40f7-bbc0-8d33bdefa5fb tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:12.461926 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8390ec53-d8f4-40f7-bbc0-8d33bdefa5fb tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:12.471010 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8390ec53-d8f4-40f7-bbc0-8d33bdefa5fb tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:12.471657 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8390ec53-d8f4-40f7-bbc0-8d33bdefa5fb tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:12.472246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8390ec53-d8f4-40f7-bbc0-8d33bdefa5fb tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:12.473752 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8390ec53-d8f4-40f7-bbc0-8d33bdefa5fb tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:12.474517 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8390ec53-d8f4-40f7-bbc0-8d33bdefa5fb tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:12.475098 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8390ec53-d8f4-40f7-bbc0-8d33bdefa5fb tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:12.962461 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8390ec53-d8f4-40f7-bbc0-8d33bdefa5fb tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:12.980555 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8390ec53-d8f4-40f7-bbc0-8d33bdefa5fb tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1521 microversion: 2.1 time: 0.523201 Sep 17 21:06:12.993520 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1917/3740] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:12 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1521 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:12.993520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6904316b-7fee-4b38-9676-c865ac71e6b1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:12.993520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6904316b-7fee-4b38-9676-c865ac71e6b1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:13.010257 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6904316b-7fee-4b38-9676-c865ac71e6b1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:13.010758 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6904316b-7fee-4b38-9676-c865ac71e6b1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:13.011194 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6904316b-7fee-4b38-9676-c865ac71e6b1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:13.012107 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6904316b-7fee-4b38-9676-c865ac71e6b1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:13.012567 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6904316b-7fee-4b38-9676-c865ac71e6b1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:13.013000 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6904316b-7fee-4b38-9676-c865ac71e6b1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:13.159393 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-aa20f78b-ff80-4d12-bb47-6388b8b37f23 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "POST /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807/action" status: 202 len: 0 microversion: 2.1 time: 1.683322 Sep 17 21:06:13.161763 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1824/3741] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:06:11 2022] POST /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807/action => generated 0 bytes in 1691 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:06:13.175530 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a0f12335-8b3d-411c-b240-b54ec3e2b58c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:13.176528 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a0f12335-8b3d-411c-b240-b54ec3e2b58c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 29c92489-5a3c-43e3-8dae-d5168e2a29bb] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:13.195608 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0f12335-8b3d-411c-b240-b54ec3e2b58c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:13.197664 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0f12335-8b3d-411c-b240-b54ec3e2b58c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:13.199362 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0f12335-8b3d-411c-b240-b54ec3e2b58c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:13.201406 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0f12335-8b3d-411c-b240-b54ec3e2b58c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:13.205842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0f12335-8b3d-411c-b240-b54ec3e2b58c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:13.206653 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0f12335-8b3d-411c-b240-b54ec3e2b58c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:13.236302 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6904316b-7fee-4b38-9676-c865ac71e6b1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:13.251436 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6904316b-7fee-4b38-9676-c865ac71e6b1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:13.253290 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6904316b-7fee-4b38-9676-c865ac71e6b1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:13.254525 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6904316b-7fee-4b38-9676-c865ac71e6b1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f" status: 200 len: 1365 microversion: 2.47 time: 0.270639 Sep 17 21:06:13.257821 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1918/3742] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:12 2022] GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f => generated 1365 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:06:13.264468 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f8f33e04-18a7-45e5-ab7f-49c03d3ab877 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:13.265202 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f8f33e04-18a7-45e5-ab7f-49c03d3ab877 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:13.282190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8f33e04-18a7-45e5-ab7f-49c03d3ab877 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:13.283061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8f33e04-18a7-45e5-ab7f-49c03d3ab877 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:13.283855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8f33e04-18a7-45e5-ab7f-49c03d3ab877 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:13.284745 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8f33e04-18a7-45e5-ab7f-49c03d3ab877 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:13.285365 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8f33e04-18a7-45e5-ab7f-49c03d3ab877 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:13.286013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8f33e04-18a7-45e5-ab7f-49c03d3ab877 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:13.715375 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a0f12335-8b3d-411c-b240-b54ec3e2b58c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c7a82126124ebb8baf5c656ff9849d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a83c9c29f1483b9ee9c48e94dc17ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:13.730462 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a0f12335-8b3d-411c-b240-b54ec3e2b58c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb" status: 200 len: 1367 microversion: 2.1 time: 0.561995 Sep 17 21:06:13.731385 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1825/3743] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:13 2022] GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb => generated 1367 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:13.737809 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e8f9b808-e7eb-47f8-8729-9254f34ffa97 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:13.738665 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e8f9b808-e7eb-47f8-8729-9254f34ffa97 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 60e59237-9ac3-43d8-9231-af2a77fc368e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:13.746765 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8f9b808-e7eb-47f8-8729-9254f34ffa97 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:13.748037 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8f9b808-e7eb-47f8-8729-9254f34ffa97 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:13.748659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8f9b808-e7eb-47f8-8729-9254f34ffa97 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:13.750132 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8f9b808-e7eb-47f8-8729-9254f34ffa97 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:13.750771 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8f9b808-e7eb-47f8-8729-9254f34ffa97 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:13.751377 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8f9b808-e7eb-47f8-8729-9254f34ffa97 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:13.776874 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f8f33e04-18a7-45e5-ab7f-49c03d3ab877 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807/os-security-groups" status: 200 len: 1154 microversion: 2.1 time: 0.517713 Sep 17 21:06:13.777777 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1919/3744] 10.222.0.26 () {58 vars in 1293 bytes} [Sat Sep 17 21:06:13 2022] GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807/os-security-groups => generated 1154 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:13.782867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fe7b1b4e-af63-44ab-822f-b4a622bdcc75 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:13.783728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fe7b1b4e-af63-44ab-822f-b4a622bdcc75 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 839ed6b8-9a04-4448-afb8-1eb643476249] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:13.795315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe7b1b4e-af63-44ab-822f-b4a622bdcc75 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:13.798084 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe7b1b4e-af63-44ab-822f-b4a622bdcc75 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:13.798741 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe7b1b4e-af63-44ab-822f-b4a622bdcc75 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:13.800468 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe7b1b4e-af63-44ab-822f-b4a622bdcc75 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:13.803046 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe7b1b4e-af63-44ab-822f-b4a622bdcc75 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:13.803714 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe7b1b4e-af63-44ab-822f-b4a622bdcc75 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:13.961340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fe7b1b4e-af63-44ab-822f-b4a622bdcc75 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:13.974342 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fe7b1b4e-af63-44ab-822f-b4a622bdcc75 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249" status: 200 len: 1298 microversion: 2.1 time: 0.195272 Sep 17 21:06:13.990883 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1920/3745] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:13 2022] GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249 => generated 1298 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:13.999554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-64e10ae9-2233-4914-9dbf-c93c9216b14d tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Action: 'create', calling method: .version_select at 0x7f25a4d4d790>, body: {"security_group": {"name": " tempest-securitygroup -1423802070 ", "description": "tempest-description-1346724809"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:14.610211 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e8f9b808-e7eb-47f8-8729-9254f34ffa97 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:14.625747 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e8f9b808-e7eb-47f8-8729-9254f34ffa97 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e" status: 200 len: 1500 microversion: 2.1 time: 0.892520 Sep 17 21:06:14.627683 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1826/3746] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:13 2022] GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e => generated 1500 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:14.634674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b03437ea-be58-4c09-989f-29f3f9dd7d34 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:14.635762 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b03437ea-be58-4c09-989f-29f3f9dd7d34 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:14.648476 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b03437ea-be58-4c09-989f-29f3f9dd7d34 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:14.649082 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b03437ea-be58-4c09-989f-29f3f9dd7d34 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:14.649646 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b03437ea-be58-4c09-989f-29f3f9dd7d34 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:14.650769 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b03437ea-be58-4c09-989f-29f3f9dd7d34 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:14.651430 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b03437ea-be58-4c09-989f-29f3f9dd7d34 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:14.652479 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b03437ea-be58-4c09-989f-29f3f9dd7d34 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:14.965310 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b03437ea-be58-4c09-989f-29f3f9dd7d34 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:14.976690 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b03437ea-be58-4c09-989f-29f3f9dd7d34 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1521 microversion: 2.1 time: 0.347272 Sep 17 21:06:14.977823 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1827/3747] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:14 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:14.983481 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-64e10ae9-2233-4914-9dbf-c93c9216b14d tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.990514 Sep 17 21:06:14.985307 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1921/3748] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Sep 17 21:06:13 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:14.990440 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-012fc080-7da7-4f4c-aee6-7edd06ea49b2 req-277080d3-8d0e-47ad-820c-e08f1aa5b699 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29c92489-5a3c-43e3-8dae-d5168e2a29bb", "tag": "9cab2864-c670-4626-bc81-dd94642db5a7"}, {"name": "network-changed", "server_uuid": "d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807", "tag": "ebef2569-9674-41fe-bd16-737edb72b2ba"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:14.992628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5b777987-55a2-429f-b455-b622cdda4ff9 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:14.998138 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5b777987-55a2-429f-b455-b622cdda4ff9 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:15.013978 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b777987-55a2-429f-b455-b622cdda4ff9 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:15.014155 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-012fc080-7da7-4f4c-aee6-7edd06ea49b2 req-277080d3-8d0e-47ad-820c-e08f1aa5b699 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:15.014694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-012fc080-7da7-4f4c-aee6-7edd06ea49b2 req-277080d3-8d0e-47ad-820c-e08f1aa5b699 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:15.015155 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-012fc080-7da7-4f4c-aee6-7edd06ea49b2 req-277080d3-8d0e-47ad-820c-e08f1aa5b699 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:15.016758 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b777987-55a2-429f-b455-b622cdda4ff9 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:15.017362 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b777987-55a2-429f-b455-b622cdda4ff9 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:15.019886 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b777987-55a2-429f-b455-b622cdda4ff9 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:15.020499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b777987-55a2-429f-b455-b622cdda4ff9 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:15.021210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b777987-55a2-429f-b455-b622cdda4ff9 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:15.039499 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-012fc080-7da7-4f4c-aee6-7edd06ea49b2 req-277080d3-8d0e-47ad-820c-e08f1aa5b699 service nova] Creating event network-changed:9cab2864-c670-4626-bc81-dd94642db5a7 for instance 29c92489-5a3c-43e3-8dae-d5168e2a29bb on nch1-master-1 Sep 17 21:06:15.040377 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-012fc080-7da7-4f4c-aee6-7edd06ea49b2 req-277080d3-8d0e-47ad-820c-e08f1aa5b699 service nova] Creating event network-changed:ebef2569-9674-41fe-bd16-737edb72b2ba for instance d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807 on nch2-master-1 Sep 17 21:06:15.058734 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-012fc080-7da7-4f4c-aee6-7edd06ea49b2 req-277080d3-8d0e-47ad-820c-e08f1aa5b699 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.071103 Sep 17 21:06:15.060000 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1922/3749] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:15.077473 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-028379f9-3194-4f23-93e6-a8b68725172d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:15.081962 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-028379f9-3194-4f23-93e6-a8b68725172d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 60e59237-9ac3-43d8-9231-af2a77fc368e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:15.090283 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-028379f9-3194-4f23-93e6-a8b68725172d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:15.091178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-028379f9-3194-4f23-93e6-a8b68725172d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:15.091902 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-028379f9-3194-4f23-93e6-a8b68725172d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:15.092947 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-028379f9-3194-4f23-93e6-a8b68725172d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:15.093638 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-028379f9-3194-4f23-93e6-a8b68725172d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:15.094248 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-028379f9-3194-4f23-93e6-a8b68725172d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:15.161647 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-028379f9-3194-4f23-93e6-a8b68725172d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e/action" status: 200 len: 14 microversion: 2.1 time: 0.099748 Sep 17 21:06:15.170090 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1923/3750] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:06:15 2022] POST /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:06:15.183656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-458856ae-68eb-48ce-bac4-450cbf26b605 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:15.184626 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-458856ae-68eb-48ce-bac4-450cbf26b605 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 29c92489-5a3c-43e3-8dae-d5168e2a29bb] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:15.200243 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-458856ae-68eb-48ce-bac4-450cbf26b605 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:15.201065 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-458856ae-68eb-48ce-bac4-450cbf26b605 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:15.202271 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-458856ae-68eb-48ce-bac4-450cbf26b605 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:15.203367 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-458856ae-68eb-48ce-bac4-450cbf26b605 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:15.204778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-458856ae-68eb-48ce-bac4-450cbf26b605 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:15.205527 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-458856ae-68eb-48ce-bac4-450cbf26b605 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:15.256226 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5b777987-55a2-429f-b455-b622cdda4ff9 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:15.271359 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5b777987-55a2-429f-b455-b622cdda4ff9 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:15.275184 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5b777987-55a2-429f-b455-b622cdda4ff9 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:15.278407 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5b777987-55a2-429f-b455-b622cdda4ff9 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f" status: 200 len: 1365 microversion: 2.47 time: 0.299249 Sep 17 21:06:15.280874 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1828/3751] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:14 2022] GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f => generated 1365 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:06:15.286308 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d13f2bd6-f52d-431b-b69c-52d2d7b7ca4c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:15.287296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d13f2bd6-f52d-431b-b69c-52d2d7b7ca4c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 839ed6b8-9a04-4448-afb8-1eb643476249] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:15.296544 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d13f2bd6-f52d-431b-b69c-52d2d7b7ca4c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:15.297353 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d13f2bd6-f52d-431b-b69c-52d2d7b7ca4c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:15.298047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d13f2bd6-f52d-431b-b69c-52d2d7b7ca4c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:15.298959 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d13f2bd6-f52d-431b-b69c-52d2d7b7ca4c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:15.299736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d13f2bd6-f52d-431b-b69c-52d2d7b7ca4c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:15.300364 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d13f2bd6-f52d-431b-b69c-52d2d7b7ca4c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:15.495792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d13f2bd6-f52d-431b-b69c-52d2d7b7ca4c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:15.505874 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d13f2bd6-f52d-431b-b69c-52d2d7b7ca4c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249" status: 200 len: 1298 microversion: 2.1 time: 0.223527 Sep 17 21:06:15.506735 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1829/3752] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:15 2022] GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249 => generated 1298 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:15.512029 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-412c5e6f-1acd-4bdc-b6e7-4cd4c11238f4 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '.version_select at 0x7f25a4770940>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:15.696531 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-412c5e6f-1acd-4bdc-b6e7-4cd4c11238f4 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/dcd95a86-d8a6-489b-b971-f75c6de55aed" status: 200 len: 224 microversion: 2.1 time: 0.188405 Sep 17 21:06:15.697586 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1830/3753] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Sep 17 21:06:15 2022] GET /compute/v2.1/os-security-groups/dcd95a86-d8a6-489b-b971-f75c6de55aed => generated 224 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:15.708470 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-458856ae-68eb-48ce-bac4-450cbf26b605 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c7a82126124ebb8baf5c656ff9849d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a83c9c29f1483b9ee9c48e94dc17ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:15.710656 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c3bad39f-fc3d-411c-b244-053566451500 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '.version_select at 0x7f25a47790d0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:15.726987 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-458856ae-68eb-48ce-bac4-450cbf26b605 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb" status: 200 len: 1367 microversion: 2.1 time: 0.555163 Sep 17 21:06:15.727605 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1924/3754] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:15 2022] GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb => generated 1367 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:16.015542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b3ab0d32-7d27-4009-9867-22eac741bf4b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:16.016184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b3ab0d32-7d27-4009-9867-22eac741bf4b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:16.036233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3ab0d32-7d27-4009-9867-22eac741bf4b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:16.036233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3ab0d32-7d27-4009-9867-22eac741bf4b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:16.036233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3ab0d32-7d27-4009-9867-22eac741bf4b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:16.036233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3ab0d32-7d27-4009-9867-22eac741bf4b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:16.036233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3ab0d32-7d27-4009-9867-22eac741bf4b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:16.036233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3ab0d32-7d27-4009-9867-22eac741bf4b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:16.544495 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b3ab0d32-7d27-4009-9867-22eac741bf4b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:16.552823 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b3ab0d32-7d27-4009-9867-22eac741bf4b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1521 microversion: 2.1 time: 0.540986 Sep 17 21:06:16.565996 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1925/3755] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:16 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1521 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:16.574279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7f480c72-1887-4c25-94ee-199a9f742324 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:16.576978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7f480c72-1887-4c25-94ee-199a9f742324 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 60e59237-9ac3-43d8-9231-af2a77fc368e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:16.583917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7f480c72-1887-4c25-94ee-199a9f742324 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:16.584652 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7f480c72-1887-4c25-94ee-199a9f742324 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:16.585386 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7f480c72-1887-4c25-94ee-199a9f742324 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:16.586466 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7f480c72-1887-4c25-94ee-199a9f742324 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:16.587101 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7f480c72-1887-4c25-94ee-199a9f742324 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:16.587702 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7f480c72-1887-4c25-94ee-199a9f742324 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:16.633990 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7f480c72-1887-4c25-94ee-199a9f742324 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e/action" status: 200 len: 14 microversion: 2.1 time: 0.066229 Sep 17 21:06:16.635246 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1926/3756] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:06:16 2022] POST /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e/action => generated 14 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:06:16.642546 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6865dacb-92ae-4049-a975-3d8baf110368 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:16.643483 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6865dacb-92ae-4049-a975-3d8baf110368 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:16.651833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6865dacb-92ae-4049-a975-3d8baf110368 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:16.652334 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6865dacb-92ae-4049-a975-3d8baf110368 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:16.652970 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6865dacb-92ae-4049-a975-3d8baf110368 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:16.654238 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6865dacb-92ae-4049-a975-3d8baf110368 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:16.654486 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6865dacb-92ae-4049-a975-3d8baf110368 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:16.665679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6865dacb-92ae-4049-a975-3d8baf110368 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:16.918548 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6865dacb-92ae-4049-a975-3d8baf110368 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:16.937686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6865dacb-92ae-4049-a975-3d8baf110368 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:16.939824 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6865dacb-92ae-4049-a975-3d8baf110368 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:16.950547 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6865dacb-92ae-4049-a975-3d8baf110368 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f" status: 200 len: 1365 microversion: 2.47 time: 0.304781 Sep 17 21:06:16.953152 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1927/3757] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:16 2022] GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f => generated 1365 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:06:16.980031 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9418d937-65dd-4186-819f-9bbdd23384ea tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:16.981047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9418d937-65dd-4186-819f-9bbdd23384ea tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 839ed6b8-9a04-4448-afb8-1eb643476249] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:16.991545 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9418d937-65dd-4186-819f-9bbdd23384ea tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:16.992200 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9418d937-65dd-4186-819f-9bbdd23384ea tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:16.992839 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9418d937-65dd-4186-819f-9bbdd23384ea tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:16.993863 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9418d937-65dd-4186-819f-9bbdd23384ea tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:16.994433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9418d937-65dd-4186-819f-9bbdd23384ea tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:16.995050 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9418d937-65dd-4186-819f-9bbdd23384ea tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:17.023604 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c3bad39f-fc3d-411c-b244-053566451500 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/dcd95a86-d8a6-489b-b971-f75c6de55aed" status: 202 len: 0 microversion: 2.1 time: 1.316893 Sep 17 21:06:17.025513 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1831/3758] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 21:06:15 2022] DELETE /compute/v2.1/os-security-groups/dcd95a86-d8a6-489b-b971-f75c6de55aed => generated 0 bytes in 1319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 17 21:06:17.030453 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8f62508b-a1bf-4948-acff-ea8c9f54b976 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:17.031072 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8f62508b-a1bf-4948-acff-ea8c9f54b976 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 29c92489-5a3c-43e3-8dae-d5168e2a29bb] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:17.048455 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8f62508b-a1bf-4948-acff-ea8c9f54b976 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:17.049880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8f62508b-a1bf-4948-acff-ea8c9f54b976 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:17.050334 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8f62508b-a1bf-4948-acff-ea8c9f54b976 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:17.070002 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8f62508b-a1bf-4948-acff-ea8c9f54b976 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:17.071129 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8f62508b-a1bf-4948-acff-ea8c9f54b976 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:17.071608 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8f62508b-a1bf-4948-acff-ea8c9f54b976 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:17.427430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9418d937-65dd-4186-819f-9bbdd23384ea tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:17.442772 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9418d937-65dd-4186-819f-9bbdd23384ea tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249" status: 200 len: 1365 microversion: 2.1 time: 0.488110 Sep 17 21:06:17.443588 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1928/3759] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:16 2022] GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249 => generated 1365 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:17.448199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-49503368-e712-4fe9-ae73-d507603a82af tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '.version_select at 0x7f25a541ee50>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:17.558372 ncdv-master-1 devstack@n-api.service[140524]: DEBUG neutronclient.v2_0.client [None req-49503368-e712-4fe9-ae73-d507603a82af tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dcd95a86-d8a6-489b-b971-f75c6de55aed does not exist", "detail": ""}} {{(pid=140524) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 17 21:06:17.559243 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.security_group_api [None req-49503368-e712-4fe9-ae73-d507603a82af tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Neutron security group dcd95a86-d8a6-489b-b971-f75c6de55aed not found {{(pid=140524) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 17 21:06:17.560155 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-49503368-e712-4fe9-ae73-d507603a82af tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] HTTP exception thrown: Security group dcd95a86-d8a6-489b-b971-f75c6de55aed does not exist Sep 17 21:06:17.560155 ncdv-master-1 devstack@n-api.service[140524]: Neutron server returns request_ids: ['req-4652de91-2905-47b9-9068-e3ed9bf56b7d'] Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-49503368-e712-4fe9-ae73-d507603a82af tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Request method failure captured: Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/os-security-groups/dcd95a86-d8a6-489b-b971-f75c6de55aed HTTP/1.1 Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjagzzYrrTodN4FRISubmKjZ26J-8BGxkNzLU7x20a3MCWENMarIDjJ9bOlqCettGyQPm3qYerTfS4mUFkwcpl7RJrNB079yuTWGsg7iyYHjYrTBkjIt8CtBBLGQxaQp-7J70wULL21t1iBESs97Rxk-MKHrjWOPMZFqMTCeWGgBIAQ Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 1c307636beed407582da5779796cc6a7 Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c307636beed407582da5779796cc6a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c307636beed407582da5779796cc6a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c307636beed407582da5779796cc6a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c307636beed407582da5779796cc6a7", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 1c307636beed407582da5779796cc6a7 Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-SecurityGroupsTestJSON-1804220727-project Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 30b19896bc4e4d14bfec46dd00519150 Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-SecurityGroupsTestJSON-1804220727-project Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: exception: Security group dcd95a86-d8a6-489b-b971-f75c6de55aed does not exist Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: Neutron server returns request_ids: ['req-4652de91-2905-47b9-9068-e3ed9bf56b7d'] Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'dcd95a86-d8a6-489b-b971-f75c6de55aed'} Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 17 21:06:17.562858 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dcd95a86-d8a6-489b-b971-f75c6de55aed does not exist Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4652de91-2905-47b9-9068-e3ed9bf56b7d'] Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dcd95a86-d8a6-489b-b971-f75c6de55aed does not exist Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4652de91-2905-47b9-9068-e3ed9bf56b7d'] Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dcd95a86-d8a6-489b-b971-f75c6de55aed does not exist Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4652de91-2905-47b9-9068-e3ed9bf56b7d'] Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dcd95a86-d8a6-489b-b971-f75c6de55aed does not exist Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4652de91-2905-47b9-9068-e3ed9bf56b7d'] Sep 17 21:06:17.568443 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:17.573411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-49503368-e712-4fe9-ae73-d507603a82af tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Returning 404 to user: Security group dcd95a86-d8a6-489b-b971-f75c6de55aed does not exist Sep 17 21:06:17.573411 ncdv-master-1 devstack@n-api.service[140524]: Neutron server returns request_ids: ['req-4652de91-2905-47b9-9068-e3ed9bf56b7d'] {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:06:17.574904 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-49503368-e712-4fe9-ae73-d507603a82af tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/dcd95a86-d8a6-489b-b971-f75c6de55aed" status: 404 len: 194 microversion: 2.1 time: 0.129898 Sep 17 21:06:17.575486 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1929/3760] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Sep 17 21:06:17 2022] GET /compute/v2.1/os-security-groups/dcd95a86-d8a6-489b-b971-f75c6de55aed => generated 194 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:06:17.690117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8f62508b-a1bf-4948-acff-ea8c9f54b976 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c7a82126124ebb8baf5c656ff9849d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a83c9c29f1483b9ee9c48e94dc17ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:17.706263 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8f62508b-a1bf-4948-acff-ea8c9f54b976 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb" status: 200 len: 1367 microversion: 2.1 time: 0.676346 Sep 17 21:06:17.709018 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1832/3761] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:17 2022] GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb => generated 1367 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:17.720828 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a1699dab-4d4b-43d2-a301-89bc3da53e8b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:17.723578 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a1699dab-4d4b-43d2-a301-89bc3da53e8b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:17.732585 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1699dab-4d4b-43d2-a301-89bc3da53e8b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:17.733169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1699dab-4d4b-43d2-a301-89bc3da53e8b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:17.733652 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1699dab-4d4b-43d2-a301-89bc3da53e8b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:17.734380 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1699dab-4d4b-43d2-a301-89bc3da53e8b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:17.734838 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1699dab-4d4b-43d2-a301-89bc3da53e8b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:17.735268 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1699dab-4d4b-43d2-a301-89bc3da53e8b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:17.850304 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-29074910-4af1-4335-8e77-10cbac13a896 req-fafcb76d-8165-4006-b7a7-bda9fa32c306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29c92489-5a3c-43e3-8dae-d5168e2a29bb", "name": "network-vif-plugged", "status": "completed", "tag": "9cab2864-c670-4626-bc81-dd94642db5a7"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:17.881335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-29074910-4af1-4335-8e77-10cbac13a896 req-fafcb76d-8165-4006-b7a7-bda9fa32c306 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:17.885027 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-29074910-4af1-4335-8e77-10cbac13a896 req-fafcb76d-8165-4006-b7a7-bda9fa32c306 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:17.885743 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-29074910-4af1-4335-8e77-10cbac13a896 req-fafcb76d-8165-4006-b7a7-bda9fa32c306 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:17.932824 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-29074910-4af1-4335-8e77-10cbac13a896 req-fafcb76d-8165-4006-b7a7-bda9fa32c306 service nova] Creating event network-vif-plugged:9cab2864-c670-4626-bc81-dd94642db5a7 for instance 29c92489-5a3c-43e3-8dae-d5168e2a29bb on nch1-master-1 Sep 17 21:06:17.938074 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-29074910-4af1-4335-8e77-10cbac13a896 req-fafcb76d-8165-4006-b7a7-bda9fa32c306 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.356037 Sep 17 21:06:17.939029 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1930/3762] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:17.946551 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3d53dad1-db09-4757-a6db-51c951af6640 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Action: 'create', calling method: .version_select at 0x7f25a4d6f8b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-617525543", "description": "tempest-description-69819616"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:18.216978 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a1699dab-4d4b-43d2-a301-89bc3da53e8b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:18.230369 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a1699dab-4d4b-43d2-a301-89bc3da53e8b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1521 microversion: 2.1 time: 0.519684 Sep 17 21:06:18.231349 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1833/3763] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:17 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1521 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:18.243639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f1edfbb6-fd42-4599-85a5-fab116a0cf40 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:18.246513 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f1edfbb6-fd42-4599-85a5-fab116a0cf40 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 60e59237-9ac3-43d8-9231-af2a77fc368e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:18.255038 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1edfbb6-fd42-4599-85a5-fab116a0cf40 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:18.255939 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1edfbb6-fd42-4599-85a5-fab116a0cf40 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:18.256654 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1edfbb6-fd42-4599-85a5-fab116a0cf40 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:18.257814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1edfbb6-fd42-4599-85a5-fab116a0cf40 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:18.258533 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1edfbb6-fd42-4599-85a5-fab116a0cf40 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:18.259196 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1edfbb6-fd42-4599-85a5-fab116a0cf40 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:18.268353 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:18.445874 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3d53dad1-db09-4757-a6db-51c951af6640 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.504757 Sep 17 21:06:18.446724 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1931/3764] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Sep 17 21:06:17 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:18.451870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3db7de07-c11d-42c7-b7df-4cca54f6d11a tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:18.452728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3db7de07-c11d-42c7-b7df-4cca54f6d11a tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:18.463485 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3db7de07-c11d-42c7-b7df-4cca54f6d11a tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:18.463991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3db7de07-c11d-42c7-b7df-4cca54f6d11a tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:18.464435 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3db7de07-c11d-42c7-b7df-4cca54f6d11a tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:18.465530 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3db7de07-c11d-42c7-b7df-4cca54f6d11a tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:18.466184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3db7de07-c11d-42c7-b7df-4cca54f6d11a tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:18.466784 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3db7de07-c11d-42c7-b7df-4cca54f6d11a tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:18.532032 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f1edfbb6-fd42-4599-85a5-fab116a0cf40 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e/action" status: 200 len: 14 microversion: 2.1 time: 0.298956 Sep 17 21:06:18.532800 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1834/3765] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:06:18 2022] POST /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e/action => generated 14 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:06:18.577156 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3db7de07-c11d-42c7-b7df-4cca54f6d11a tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:18.602483 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3db7de07-c11d-42c7-b7df-4cca54f6d11a tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:18.607078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3db7de07-c11d-42c7-b7df-4cca54f6d11a tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:18.608644 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3db7de07-c11d-42c7-b7df-4cca54f6d11a tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f" status: 200 len: 1365 microversion: 2.47 time: 0.160905 Sep 17 21:06:18.621609 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1932/3766] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:18 2022] GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:06:18.621609 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-49d037bb-844b-4018-b45d-27757fc055ee tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Action: 'create', calling method: .version_select at 0x7f25a4d6f790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-577184150", "description": "tempest-description-249500454"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:18.644638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-aed15d98-bf7f-46e4-b51e-f538cc3df0cc tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1117060183", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:18.725987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-aed15d98-bf7f-46e4-b51e-f538cc3df0cc tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] validate_networks() for [('0a3abe11-a264-489a-ad08-1352aae9bc49', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:06:19.098601 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-49d037bb-844b-4018-b45d-27757fc055ee tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.484399 Sep 17 21:06:19.101524 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1933/3767] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Sep 17 21:06:18 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:19.104979 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-23282939-885a-48b8-ad0d-8294a587f1cb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:19.105817 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-23282939-885a-48b8-ad0d-8294a587f1cb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 839ed6b8-9a04-4448-afb8-1eb643476249] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:19.116841 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23282939-885a-48b8-ad0d-8294a587f1cb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:19.117752 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23282939-885a-48b8-ad0d-8294a587f1cb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:19.118464 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23282939-885a-48b8-ad0d-8294a587f1cb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:19.119545 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23282939-885a-48b8-ad0d-8294a587f1cb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:19.120234 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23282939-885a-48b8-ad0d-8294a587f1cb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:19.120884 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23282939-885a-48b8-ad0d-8294a587f1cb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:19.381423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-23282939-885a-48b8-ad0d-8294a587f1cb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:19.393294 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-23282939-885a-48b8-ad0d-8294a587f1cb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249" status: 200 len: 1365 microversion: 2.1 time: 0.292562 Sep 17 21:06:19.393954 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1934/3768] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:19 2022] GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249 => generated 1365 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:19.410330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b042cdd8-203e-4098-a7d1-2acee0210ec9 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:19.412286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b042cdd8-203e-4098-a7d1-2acee0210ec9 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 29c92489-5a3c-43e3-8dae-d5168e2a29bb] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:19.424631 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b042cdd8-203e-4098-a7d1-2acee0210ec9 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:19.425212 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b042cdd8-203e-4098-a7d1-2acee0210ec9 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:19.425742 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b042cdd8-203e-4098-a7d1-2acee0210ec9 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:19.426477 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b042cdd8-203e-4098-a7d1-2acee0210ec9 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:19.426943 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b042cdd8-203e-4098-a7d1-2acee0210ec9 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:19.428804 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b042cdd8-203e-4098-a7d1-2acee0210ec9 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:19.460229 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-aed15d98-bf7f-46e4-b51e-f538cc3df0cc tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:06:19.460709 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-aed15d98-bf7f-46e4-b51e-f538cc3df0cc tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:06:19.461292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-aed15d98-bf7f-46e4-b51e-f538cc3df0cc tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:06:19.461865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-aed15d98-bf7f-46e4-b51e-f538cc3df0cc tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:06:19.462413 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-aed15d98-bf7f-46e4-b51e-f538cc3df0cc tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:06:19.473409 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aed15d98-bf7f-46e4-b51e-f538cc3df0cc tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:19.473942 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aed15d98-bf7f-46e4-b51e-f538cc3df0cc tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:19.474387 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aed15d98-bf7f-46e4-b51e-f538cc3df0cc tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:19.475120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aed15d98-bf7f-46e4-b51e-f538cc3df0cc tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:19.475578 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aed15d98-bf7f-46e4-b51e-f538cc3df0cc tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:19.476077 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aed15d98-bf7f-46e4-b51e-f538cc3df0cc tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:19.498997 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-aed15d98-bf7f-46e4-b51e-f538cc3df0cc tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Getting quotas for project d527ac7a0b864094a5c74dea23ec445b. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:06:19.504466 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-aed15d98-bf7f-46e4-b51e-f538cc3df0cc tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Getting quotas for user 599c7072545f4280988f6bc50e3ccc5f and project d527ac7a0b864094a5c74dea23ec445b. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:06:19.521315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-aed15d98-bf7f-46e4-b51e-f538cc3df0cc tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:06:19.525668 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-aed15d98-bf7f-46e4-b51e-f538cc3df0cc tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:06:19.610356 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-aed15d98-bf7f-46e4-b51e-f538cc3df0cc tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.075463 Sep 17 21:06:19.611881 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1835/3769] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:06:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 1078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:06:19.617331 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a015dc5e-28a5-450d-99d8-67ab3da519cb tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Action: 'create', calling method: .version_select at 0x7f25a47c68b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-513675014", "description": "tempest-description-839572279"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:19.710773 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b042cdd8-203e-4098-a7d1-2acee0210ec9 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c7a82126124ebb8baf5c656ff9849d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a83c9c29f1483b9ee9c48e94dc17ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:19.721228 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b042cdd8-203e-4098-a7d1-2acee0210ec9 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb" status: 200 len: 1367 microversion: 2.1 time: 0.325842 Sep 17 21:06:19.733819 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1935/3770] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:19 2022] GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb => generated 1367 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:19.738879 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-78396b55-8019-4db8-a700-f06675b0c2c3 req-4a23b980-effc-4863-b3a2-9f070ab5f0f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "839ed6b8-9a04-4448-afb8-1eb643476249", "tag": "ac665539-3ec3-439f-b476-756f416ed8d2"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:19.793450 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-78396b55-8019-4db8-a700-f06675b0c2c3 req-4a23b980-effc-4863-b3a2-9f070ab5f0f1 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:19.794027 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-78396b55-8019-4db8-a700-f06675b0c2c3 req-4a23b980-effc-4863-b3a2-9f070ab5f0f1 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:19.794645 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-78396b55-8019-4db8-a700-f06675b0c2c3 req-4a23b980-effc-4863-b3a2-9f070ab5f0f1 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:19.836762 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-78396b55-8019-4db8-a700-f06675b0c2c3 req-4a23b980-effc-4863-b3a2-9f070ab5f0f1 service nova] Creating event network-changed:ac665539-3ec3-439f-b476-756f416ed8d2 for instance 839ed6b8-9a04-4448-afb8-1eb643476249 on nch2-master-1 Sep 17 21:06:19.855027 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-78396b55-8019-4db8-a700-f06675b0c2c3 req-4a23b980-effc-4863-b3a2-9f070ab5f0f1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119858 Sep 17 21:06:19.856590 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1936/3771] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:19.863040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e17f7307-e1d3-4918-964e-4b2fc6a7cedc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:19.864038 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e17f7307-e1d3-4918-964e-4b2fc6a7cedc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:19.874728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e17f7307-e1d3-4918-964e-4b2fc6a7cedc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:19.875502 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e17f7307-e1d3-4918-964e-4b2fc6a7cedc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:19.876195 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e17f7307-e1d3-4918-964e-4b2fc6a7cedc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:19.877912 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e17f7307-e1d3-4918-964e-4b2fc6a7cedc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:19.878596 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e17f7307-e1d3-4918-964e-4b2fc6a7cedc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:19.879360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e17f7307-e1d3-4918-964e-4b2fc6a7cedc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:19.982295 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a015dc5e-28a5-450d-99d8-67ab3da519cb tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.369099 Sep 17 21:06:19.983087 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1836/3772] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Sep 17 21:06:19 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:19.992175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ab926d6c-ca4a-43f7-9d1e-fd26047a41c0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:19.994721 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ab926d6c-ca4a-43f7-9d1e-fd26047a41c0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 60e59237-9ac3-43d8-9231-af2a77fc368e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:20.008807 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab926d6c-ca4a-43f7-9d1e-fd26047a41c0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:20.009386 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab926d6c-ca4a-43f7-9d1e-fd26047a41c0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:20.010094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab926d6c-ca4a-43f7-9d1e-fd26047a41c0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:20.010987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab926d6c-ca4a-43f7-9d1e-fd26047a41c0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:20.011926 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab926d6c-ca4a-43f7-9d1e-fd26047a41c0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:20.012618 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab926d6c-ca4a-43f7-9d1e-fd26047a41c0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:20.090606 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ab926d6c-ca4a-43f7-9d1e-fd26047a41c0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e/action" status: 200 len: 14 microversion: 2.1 time: 0.102624 Sep 17 21:06:20.092011 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1837/3773] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:06:19 2022] POST /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:06:20.098132 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fc067c44-e38c-44c7-8b2c-15772b3b34c5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:20.102172 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fc067c44-e38c-44c7-8b2c-15772b3b34c5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:20.120194 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e17f7307-e1d3-4918-964e-4b2fc6a7cedc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:20.134901 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e17f7307-e1d3-4918-964e-4b2fc6a7cedc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1521 microversion: 2.1 time: 0.276819 Sep 17 21:06:20.149509 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1937/3774] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:19 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:20.154178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-015e0e83-f183-421f-bf1e-eee7f4c2c11d tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:20.154832 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-015e0e83-f183-421f-bf1e-eee7f4c2c11d tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:20.162274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-015e0e83-f183-421f-bf1e-eee7f4c2c11d tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:20.162782 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-015e0e83-f183-421f-bf1e-eee7f4c2c11d tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:20.163234 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-015e0e83-f183-421f-bf1e-eee7f4c2c11d tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:20.163957 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-015e0e83-f183-421f-bf1e-eee7f4c2c11d tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:20.164429 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-015e0e83-f183-421f-bf1e-eee7f4c2c11d tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:20.164843 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-015e0e83-f183-421f-bf1e-eee7f4c2c11d tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:20.205499 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:20.686512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fc067c44-e38c-44c7-8b2c-15772b3b34c5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:20.707630 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fc067c44-e38c-44c7-8b2c-15772b3b34c5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1214 microversion: 2.1 time: 0.613336 Sep 17 21:06:20.708432 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1838/3775] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:20 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1214 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:20.716735 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-170c2e32-4a40-440b-9d3e-dd56844b7f24 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '.version_select at 0x7f25a4782ca0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:20.732461 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-015e0e83-f183-421f-bf1e-eee7f4c2c11d tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:20.745831 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-015e0e83-f183-421f-bf1e-eee7f4c2c11d tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:20.747702 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-015e0e83-f183-421f-bf1e-eee7f4c2c11d tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:20.749340 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-015e0e83-f183-421f-bf1e-eee7f4c2c11d tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f" status: 200 len: 1371 microversion: 2.47 time: 0.612843 Sep 17 21:06:20.750112 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1938/3776] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:20 2022] GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f => generated 1371 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:06:20.756083 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-34dce7a7-6cbb-43aa-a2d6-c95adee85f77 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:20.756935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-34dce7a7-6cbb-43aa-a2d6-c95adee85f77 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 839ed6b8-9a04-4448-afb8-1eb643476249] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:20.773166 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-34dce7a7-6cbb-43aa-a2d6-c95adee85f77 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:20.774040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-34dce7a7-6cbb-43aa-a2d6-c95adee85f77 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:20.775668 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-34dce7a7-6cbb-43aa-a2d6-c95adee85f77 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:20.776938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-34dce7a7-6cbb-43aa-a2d6-c95adee85f77 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:20.777693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-34dce7a7-6cbb-43aa-a2d6-c95adee85f77 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:20.778361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-34dce7a7-6cbb-43aa-a2d6-c95adee85f77 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:21.099037 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-34dce7a7-6cbb-43aa-a2d6-c95adee85f77 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:21.110321 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-34dce7a7-6cbb-43aa-a2d6-c95adee85f77 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249" status: 200 len: 1365 microversion: 2.1 time: 0.358922 Sep 17 21:06:21.111100 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1939/3777] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:20 2022] GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249 => generated 1365 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:21.125699 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2d13b2ca-5cce-4a33-ba22-6594e6ae873d tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:21.127650 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2d13b2ca-5cce-4a33-ba22-6594e6ae873d tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 29c92489-5a3c-43e3-8dae-d5168e2a29bb] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:21.137594 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2d13b2ca-5cce-4a33-ba22-6594e6ae873d tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:21.138983 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2d13b2ca-5cce-4a33-ba22-6594e6ae873d tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:21.140115 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2d13b2ca-5cce-4a33-ba22-6594e6ae873d tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:21.141143 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2d13b2ca-5cce-4a33-ba22-6594e6ae873d tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:21.142151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2d13b2ca-5cce-4a33-ba22-6594e6ae873d tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:21.142595 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2d13b2ca-5cce-4a33-ba22-6594e6ae873d tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:21.197686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=4 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:21.220918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=11 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:21.338388 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-170c2e32-4a40-440b-9d3e-dd56844b7f24 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups" status: 200 len: 1825 microversion: 2.1 time: 0.627634 Sep 17 21:06:21.338984 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1839/3778] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Sep 17 21:06:20 2022] GET /compute/v2.1/os-security-groups => generated 1825 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:21.344580 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-92286273-4110-4e94-a1c6-ef720de6622e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:21.346962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-92286273-4110-4e94-a1c6-ef720de6622e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 60e59237-9ac3-43d8-9231-af2a77fc368e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:21.355642 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92286273-4110-4e94-a1c6-ef720de6622e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:21.356137 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92286273-4110-4e94-a1c6-ef720de6622e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:21.356577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92286273-4110-4e94-a1c6-ef720de6622e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:21.357290 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92286273-4110-4e94-a1c6-ef720de6622e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:21.357767 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92286273-4110-4e94-a1c6-ef720de6622e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:21.358192 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92286273-4110-4e94-a1c6-ef720de6622e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:21.370601 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2d13b2ca-5cce-4a33-ba22-6594e6ae873d tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c7a82126124ebb8baf5c656ff9849d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a83c9c29f1483b9ee9c48e94dc17ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:21.378949 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2d13b2ca-5cce-4a33-ba22-6594e6ae873d tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb" status: 200 len: 1556 microversion: 2.1 time: 0.266281 Sep 17 21:06:21.379596 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1940/3779] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:21 2022] GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb => generated 1556 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:21.384766 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cfe41ccb-52a0-42bb-a8d3-bae5089971bc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:21.386218 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cfe41ccb-52a0-42bb-a8d3-bae5089971bc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:21.392475 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cfe41ccb-52a0-42bb-a8d3-bae5089971bc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:21.393062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cfe41ccb-52a0-42bb-a8d3-bae5089971bc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:21.393498 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cfe41ccb-52a0-42bb-a8d3-bae5089971bc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:21.394214 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cfe41ccb-52a0-42bb-a8d3-bae5089971bc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:21.394679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cfe41ccb-52a0-42bb-a8d3-bae5089971bc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:21.395306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cfe41ccb-52a0-42bb-a8d3-bae5089971bc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:21.401678 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-92286273-4110-4e94-a1c6-ef720de6622e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e/action" status: 200 len: 14 microversion: 2.1 time: 0.061118 Sep 17 21:06:21.405222 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1840/3780] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:06:21 2022] POST /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e/action => generated 14 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:06:21.407392 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-71f644db-bbda-47c7-a8e1-142ca7c79b61 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '.version_select at 0x7f25a4786940>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:21.791660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cfe41ccb-52a0-42bb-a8d3-bae5089971bc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:21.803018 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cfe41ccb-52a0-42bb-a8d3-bae5089971bc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1521 microversion: 2.1 time: 0.420584 Sep 17 21:06:21.803971 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1941/3781] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:21 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1521 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:21.808967 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-46559828-f4f8-4d86-ac0d-f76a35bc5c0f tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:21.809455 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-46559828-f4f8-4d86-ac0d-f76a35bc5c0f tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 29c92489-5a3c-43e3-8dae-d5168e2a29bb] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:21.816231 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46559828-f4f8-4d86-ac0d-f76a35bc5c0f tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:21.816722 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46559828-f4f8-4d86-ac0d-f76a35bc5c0f tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:21.817162 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46559828-f4f8-4d86-ac0d-f76a35bc5c0f tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:21.818393 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46559828-f4f8-4d86-ac0d-f76a35bc5c0f tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:21.819510 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46559828-f4f8-4d86-ac0d-f76a35bc5c0f tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:21.819962 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46559828-f4f8-4d86-ac0d-f76a35bc5c0f tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:22.136994 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-46559828-f4f8-4d86-ac0d-f76a35bc5c0f tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.331778 Sep 17 21:06:22.138242 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1942/3782] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Sep 17 21:06:21 2022] GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb/os-interface => generated 284 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:22.143683 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e1f1c4e7-c479-4b69-ad23-ebf9faa6dc1b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:22.144608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e1f1c4e7-c479-4b69-ad23-ebf9faa6dc1b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:22.154198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1f1c4e7-c479-4b69-ad23-ebf9faa6dc1b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:22.154951 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1f1c4e7-c479-4b69-ad23-ebf9faa6dc1b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:22.155602 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1f1c4e7-c479-4b69-ad23-ebf9faa6dc1b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:22.156567 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1f1c4e7-c479-4b69-ad23-ebf9faa6dc1b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:22.160207 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1f1c4e7-c479-4b69-ad23-ebf9faa6dc1b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:22.160949 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1f1c4e7-c479-4b69-ad23-ebf9faa6dc1b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:22.360313 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e1f1c4e7-c479-4b69-ad23-ebf9faa6dc1b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:22.376460 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e1f1c4e7-c479-4b69-ad23-ebf9faa6dc1b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1272 microversion: 2.1 time: 0.236687 Sep 17 21:06:22.378022 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1943/3783] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:22 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1272 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:22.385800 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-72464a56-12e3-4eda-9312-3bde3aab92cd tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:22.386826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-72464a56-12e3-4eda-9312-3bde3aab92cd tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:22.396730 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72464a56-12e3-4eda-9312-3bde3aab92cd tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:22.397602 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72464a56-12e3-4eda-9312-3bde3aab92cd tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:22.398295 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72464a56-12e3-4eda-9312-3bde3aab92cd tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:22.399248 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72464a56-12e3-4eda-9312-3bde3aab92cd tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:22.400898 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72464a56-12e3-4eda-9312-3bde3aab92cd tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:22.401689 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72464a56-12e3-4eda-9312-3bde3aab92cd tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:22.456317 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-71f644db-bbda-47c7-a8e1-142ca7c79b61 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/f5d34982-45f8-4a12-a18d-8a04c50509c5" status: 202 len: 0 microversion: 2.1 time: 1.052730 Sep 17 21:06:22.461082 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1841/3784] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 21:06:21 2022] DELETE /compute/v2.1/os-security-groups/f5d34982-45f8-4a12-a18d-8a04c50509c5 => generated 0 bytes in 1058 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:06:22.466906 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2d4c5a27-c948-4dee-a06a-3b9fecfebf7f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:22.467985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2d4c5a27-c948-4dee-a06a-3b9fecfebf7f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 839ed6b8-9a04-4448-afb8-1eb643476249] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:22.476414 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d4c5a27-c948-4dee-a06a-3b9fecfebf7f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:22.477104 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d4c5a27-c948-4dee-a06a-3b9fecfebf7f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:22.477806 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d4c5a27-c948-4dee-a06a-3b9fecfebf7f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:22.478698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d4c5a27-c948-4dee-a06a-3b9fecfebf7f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:22.479315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d4c5a27-c948-4dee-a06a-3b9fecfebf7f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:22.480059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d4c5a27-c948-4dee-a06a-3b9fecfebf7f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:22.584850 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-72464a56-12e3-4eda-9312-3bde3aab92cd tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:22.604997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-72464a56-12e3-4eda-9312-3bde3aab92cd tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:22.606804 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-72464a56-12e3-4eda-9312-3bde3aab92cd tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:22.608216 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-72464a56-12e3-4eda-9312-3bde3aab92cd tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f" status: 200 len: 1356 microversion: 2.47 time: 0.228807 Sep 17 21:06:22.609219 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1944/3785] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:22 2022] GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f => generated 1356 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:06:22.614307 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2f4e8bd1-0947-4027-8da6-a6dfe95db499 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:22.620079 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2f4e8bd1-0947-4027-8da6-a6dfe95db499 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 60e59237-9ac3-43d8-9231-af2a77fc368e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:22.639381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f4e8bd1-0947-4027-8da6-a6dfe95db499 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:22.640186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f4e8bd1-0947-4027-8da6-a6dfe95db499 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:22.640828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f4e8bd1-0947-4027-8da6-a6dfe95db499 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:22.641575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f4e8bd1-0947-4027-8da6-a6dfe95db499 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:22.643405 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f4e8bd1-0947-4027-8da6-a6dfe95db499 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:22.644017 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f4e8bd1-0947-4027-8da6-a6dfe95db499 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:22.721591 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2f4e8bd1-0947-4027-8da6-a6dfe95db499 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e/action" status: 200 len: 14 microversion: 2.1 time: 0.110718 Sep 17 21:06:22.722415 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1945/3786] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:06:22 2022] POST /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:06:22.731116 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f1a3b461-6a53-461a-9fa2-467148972e41 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '.version_select at 0x7f25a42cfa60>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:22.791437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG neutronclient.v2_0.client [None req-f1a3b461-6a53-461a-9fa2-467148972e41 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f5d34982-45f8-4a12-a18d-8a04c50509c5 does not exist", "detail": ""}} {{(pid=140524) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 17 21:06:22.792395 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.security_group_api [None req-f1a3b461-6a53-461a-9fa2-467148972e41 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Neutron security group f5d34982-45f8-4a12-a18d-8a04c50509c5 not found {{(pid=140524) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 17 21:06:22.793592 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-f1a3b461-6a53-461a-9fa2-467148972e41 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] HTTP exception thrown: Security group f5d34982-45f8-4a12-a18d-8a04c50509c5 does not exist Sep 17 21:06:22.793592 ncdv-master-1 devstack@n-api.service[140524]: Neutron server returns request_ids: ['req-05f41cbe-9614-4567-8bd0-9c26e3913f46'] Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f1a3b461-6a53-461a-9fa2-467148972e41 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Request method failure captured: Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/os-security-groups/f5d34982-45f8-4a12-a18d-8a04c50509c5 HTTP/1.1 Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjagzzYrrTodN4FRISubmKjZ26J-8BGxkNzLU7x20a3MCWENMarIDjJ9bOlqCettGyQPm3qYerTfS4mUFkwcpl7RJrNB079yuTWGsg7iyYHjYrTBkjIt8CtBBLGQxaQp-7J70wULL21t1iBESs97Rxk-MKHrjWOPMZFqMTCeWGgBIAQ Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 1c307636beed407582da5779796cc6a7 Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c307636beed407582da5779796cc6a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c307636beed407582da5779796cc6a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c307636beed407582da5779796cc6a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c307636beed407582da5779796cc6a7", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 1c307636beed407582da5779796cc6a7 Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-SecurityGroupsTestJSON-1804220727-project Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 30b19896bc4e4d14bfec46dd00519150 Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-SecurityGroupsTestJSON-1804220727-project Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: exception: Security group f5d34982-45f8-4a12-a18d-8a04c50509c5 does not exist Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: Neutron server returns request_ids: ['req-05f41cbe-9614-4567-8bd0-9c26e3913f46'] Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'f5d34982-45f8-4a12-a18d-8a04c50509c5'} Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 17 21:06:22.795865 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f5d34982-45f8-4a12-a18d-8a04c50509c5 does not exist Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05f41cbe-9614-4567-8bd0-9c26e3913f46'] Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f5d34982-45f8-4a12-a18d-8a04c50509c5 does not exist Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05f41cbe-9614-4567-8bd0-9c26e3913f46'] Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f5d34982-45f8-4a12-a18d-8a04c50509c5 does not exist Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05f41cbe-9614-4567-8bd0-9c26e3913f46'] Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f5d34982-45f8-4a12-a18d-8a04c50509c5 does not exist Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-05f41cbe-9614-4567-8bd0-9c26e3913f46'] Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f1a3b461-6a53-461a-9fa2-467148972e41 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Returning 404 to user: Security group f5d34982-45f8-4a12-a18d-8a04c50509c5 does not exist Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: Neutron server returns request_ids: ['req-05f41cbe-9614-4567-8bd0-9c26e3913f46'] {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f1a3b461-6a53-461a-9fa2-467148972e41 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/f5d34982-45f8-4a12-a18d-8a04c50509c5" status: 404 len: 194 microversion: 2.1 time: 0.074726 Sep 17 21:06:22.805384 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1946/3787] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Sep 17 21:06:22 2022] GET /compute/v2.1/os-security-groups/f5d34982-45f8-4a12-a18d-8a04c50509c5 => generated 194 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:06:22.821568 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-80d578f9-dd45-4cbf-ad92-515f2c703737 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:22.826835 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-80d578f9-dd45-4cbf-ad92-515f2c703737 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:22.827821 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-80d578f9-dd45-4cbf-ad92-515f2c703737 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Searching by: {'deleted': False, 'project_id': '4512f54506dd413a80df4b337a6c31c6'} {{(pid=140524) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:06:22.844137 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-80d578f9-dd45-4cbf-ad92-515f2c703737 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:22.845208 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-80d578f9-dd45-4cbf-ad92-515f2c703737 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:22.845980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-80d578f9-dd45-4cbf-ad92-515f2c703737 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:22.846967 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-80d578f9-dd45-4cbf-ad92-515f2c703737 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:22.847652 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-80d578f9-dd45-4cbf-ad92-515f2c703737 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:22.848323 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-80d578f9-dd45-4cbf-ad92-515f2c703737 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:22.880833 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2d4c5a27-c948-4dee-a06a-3b9fecfebf7f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:22.893281 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2d4c5a27-c948-4dee-a06a-3b9fecfebf7f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249" status: 200 len: 1365 microversion: 2.1 time: 0.430871 Sep 17 21:06:22.893915 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1842/3788] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:22 2022] GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249 => generated 1365 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:22.906776 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-23d3f70e-fd5b-4227-a257-899b476e6bf8 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '.version_select at 0x7f25a476c820>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:23.021218 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.multi_cell_list [None req-80d578f9-dd45-4cbf-ad92-515f2c703737 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140524) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 21:06:23.126884 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-80d578f9-dd45-4cbf-ad92-515f2c703737 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:23.137049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-80d578f9-dd45-4cbf-ad92-515f2c703737 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:23.137584 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-80d578f9-dd45-4cbf-ad92-515f2c703737 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:23.138786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-80d578f9-dd45-4cbf-ad92-515f2c703737 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:23.154969 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-80d578f9-dd45-4cbf-ad92-515f2c703737 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:23.156757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-80d578f9-dd45-4cbf-ad92-515f2c703737 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:23.235914 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-80d578f9-dd45-4cbf-ad92-515f2c703737 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 0.432850 Sep 17 21:06:23.238800 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1947/3789] 10.222.0.26 () {60 vars in 1187 bytes} [Sat Sep 17 21:06:22 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:06:23.245302 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-27f63895-2ebb-4560-b87f-718bfed50aae tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:23.246380 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-27f63895-2ebb-4560-b87f-718bfed50aae tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:23.254983 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27f63895-2ebb-4560-b87f-718bfed50aae tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:23.255890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27f63895-2ebb-4560-b87f-718bfed50aae tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:23.256615 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27f63895-2ebb-4560-b87f-718bfed50aae tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:23.257696 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27f63895-2ebb-4560-b87f-718bfed50aae tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:23.263868 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27f63895-2ebb-4560-b87f-718bfed50aae tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:23.263868 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27f63895-2ebb-4560-b87f-718bfed50aae tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:23.716949 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-23d3f70e-fd5b-4227-a257-899b476e6bf8 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/a80e1c26-e0f7-482b-b455-277f83554c94" status: 202 len: 0 microversion: 2.1 time: 0.821876 Sep 17 21:06:23.718471 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1843/3790] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 21:06:22 2022] DELETE /compute/v2.1/os-security-groups/a80e1c26-e0f7-482b-b455-277f83554c94 => generated 0 bytes in 824 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:06:23.724371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-de02a9ca-1379-4322-b75c-54164ce9243c tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:23.725133 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-de02a9ca-1379-4322-b75c-54164ce9243c tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:23.737022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de02a9ca-1379-4322-b75c-54164ce9243c tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:23.741856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de02a9ca-1379-4322-b75c-54164ce9243c tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:23.742611 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de02a9ca-1379-4322-b75c-54164ce9243c tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:23.743750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de02a9ca-1379-4322-b75c-54164ce9243c tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:23.744548 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de02a9ca-1379-4322-b75c-54164ce9243c tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:23.745204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-de02a9ca-1379-4322-b75c-54164ce9243c tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:23.831723 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-de02a9ca-1379-4322-b75c-54164ce9243c tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:06:23.907006 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-27f63895-2ebb-4560-b87f-718bfed50aae tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:23.916752 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-27f63895-2ebb-4560-b87f-718bfed50aae tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1521 microversion: 2.1 time: 0.676519 Sep 17 21:06:23.926746 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1948/3791] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:23 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1521 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:23.937838 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6daa9bb8-3d20-4175-9cb9-99c4a44a7b63 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:23.938587 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6daa9bb8-3d20-4175-9cb9-99c4a44a7b63 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:23.956293 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6daa9bb8-3d20-4175-9cb9-99c4a44a7b63 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:23.956997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6daa9bb8-3d20-4175-9cb9-99c4a44a7b63 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:23.957592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6daa9bb8-3d20-4175-9cb9-99c4a44a7b63 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:23.958416 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6daa9bb8-3d20-4175-9cb9-99c4a44a7b63 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:23.959123 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6daa9bb8-3d20-4175-9cb9-99c4a44a7b63 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:23.959776 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6daa9bb8-3d20-4175-9cb9-99c4a44a7b63 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:24.120014 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-de02a9ca-1379-4322-b75c-54164ce9243c tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "DELETE /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f" status: 204 len: 0 microversion: 2.47 time: 0.397030 Sep 17 21:06:24.122723 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1844/3792] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 17 21:06:23 2022] DELETE /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 21:06:24.132402 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-10033f91-4e0f-475d-a66e-2e5fe007f0f4 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '.version_select at 0x7f25a476c310>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:24.272746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG neutronclient.v2_0.client [None req-10033f91-4e0f-475d-a66e-2e5fe007f0f4 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a80e1c26-e0f7-482b-b455-277f83554c94 does not exist", "detail": ""}} {{(pid=140523) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 17 21:06:24.275285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.security_group_api [None req-10033f91-4e0f-475d-a66e-2e5fe007f0f4 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Neutron security group a80e1c26-e0f7-482b-b455-277f83554c94 not found {{(pid=140523) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 17 21:06:24.277103 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-10033f91-4e0f-475d-a66e-2e5fe007f0f4 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] HTTP exception thrown: Security group a80e1c26-e0f7-482b-b455-277f83554c94 does not exist Sep 17 21:06:24.277103 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-07b684ea-97c8-467e-a396-8d70e7878e82'] Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-10033f91-4e0f-475d-a66e-2e5fe007f0f4 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Request method failure captured: Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/os-security-groups/a80e1c26-e0f7-482b-b455-277f83554c94 HTTP/1.1 Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjagzzYrrTodN4FRISubmKjZ26J-8BGxkNzLU7x20a3MCWENMarIDjJ9bOlqCettGyQPm3qYerTfS4mUFkwcpl7RJrNB079yuTWGsg7iyYHjYrTBkjIt8CtBBLGQxaQp-7J70wULL21t1iBESs97Rxk-MKHrjWOPMZFqMTCeWGgBIAQ Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 1c307636beed407582da5779796cc6a7 Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c307636beed407582da5779796cc6a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c307636beed407582da5779796cc6a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c307636beed407582da5779796cc6a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c307636beed407582da5779796cc6a7", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 1c307636beed407582da5779796cc6a7 Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-SecurityGroupsTestJSON-1804220727-project Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 30b19896bc4e4d14bfec46dd00519150 Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-SecurityGroupsTestJSON-1804220727-project Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: exception: Security group a80e1c26-e0f7-482b-b455-277f83554c94 does not exist Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-07b684ea-97c8-467e-a396-8d70e7878e82'] Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'a80e1c26-e0f7-482b-b455-277f83554c94'} Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 17 21:06:24.279344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a80e1c26-e0f7-482b-b455-277f83554c94 does not exist Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07b684ea-97c8-467e-a396-8d70e7878e82'] Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a80e1c26-e0f7-482b-b455-277f83554c94 does not exist Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07b684ea-97c8-467e-a396-8d70e7878e82'] Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a80e1c26-e0f7-482b-b455-277f83554c94 does not exist Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07b684ea-97c8-467e-a396-8d70e7878e82'] Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a80e1c26-e0f7-482b-b455-277f83554c94 does not exist Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-07b684ea-97c8-467e-a396-8d70e7878e82'] Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-10033f91-4e0f-475d-a66e-2e5fe007f0f4 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Returning 404 to user: Security group a80e1c26-e0f7-482b-b455-277f83554c94 does not exist Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-07b684ea-97c8-467e-a396-8d70e7878e82'] {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-10033f91-4e0f-475d-a66e-2e5fe007f0f4 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/a80e1c26-e0f7-482b-b455-277f83554c94" status: 404 len: 194 microversion: 2.1 time: 0.157258 Sep 17 21:06:24.285794 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1845/3793] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Sep 17 21:06:24 2022] GET /compute/v2.1/os-security-groups/a80e1c26-e0f7-482b-b455-277f83554c94 => generated 194 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:06:24.292138 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-29c60b3c-7d2a-4799-8139-9a0bde20d1e7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:24.294857 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-29c60b3c-7d2a-4799-8139-9a0bde20d1e7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 60e59237-9ac3-43d8-9231-af2a77fc368e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:24.302246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-29c60b3c-7d2a-4799-8139-9a0bde20d1e7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:24.302733 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-29c60b3c-7d2a-4799-8139-9a0bde20d1e7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:24.303169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-29c60b3c-7d2a-4799-8139-9a0bde20d1e7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:24.304085 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-29c60b3c-7d2a-4799-8139-9a0bde20d1e7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:24.304706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-29c60b3c-7d2a-4799-8139-9a0bde20d1e7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:24.305310 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-29c60b3c-7d2a-4799-8139-9a0bde20d1e7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:24.347211 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-29c60b3c-7d2a-4799-8139-9a0bde20d1e7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e/action" status: 200 len: 14 microversion: 2.1 time: 0.060101 Sep 17 21:06:24.351054 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1846/3794] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:06:24 2022] POST /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:06:24.357573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bb90fa10-a8d5-4e52-9930-b89cbc073ede tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:24.358559 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bb90fa10-a8d5-4e52-9930-b89cbc073ede tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 839ed6b8-9a04-4448-afb8-1eb643476249] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:24.374760 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bb90fa10-a8d5-4e52-9930-b89cbc073ede tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:24.375278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bb90fa10-a8d5-4e52-9930-b89cbc073ede tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:24.375731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bb90fa10-a8d5-4e52-9930-b89cbc073ede tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:24.376052 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6daa9bb8-3d20-4175-9cb9-99c4a44a7b63 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:24.376659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bb90fa10-a8d5-4e52-9930-b89cbc073ede tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:24.377180 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bb90fa10-a8d5-4e52-9930-b89cbc073ede tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:24.377743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bb90fa10-a8d5-4e52-9930-b89cbc073ede tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:24.390452 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6daa9bb8-3d20-4175-9cb9-99c4a44a7b63 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1314 microversion: 2.1 time: 0.462132 Sep 17 21:06:24.408549 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1949/3795] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:23 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:24.414906 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fee1ea03-c8a2-48a9-b83e-3aa354d80bfc tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:24.415753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fee1ea03-c8a2-48a9-b83e-3aa354d80bfc tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:24.423447 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fee1ea03-c8a2-48a9-b83e-3aa354d80bfc tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:24.424229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fee1ea03-c8a2-48a9-b83e-3aa354d80bfc tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:24.424876 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fee1ea03-c8a2-48a9-b83e-3aa354d80bfc tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:24.425654 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fee1ea03-c8a2-48a9-b83e-3aa354d80bfc tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:24.426284 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fee1ea03-c8a2-48a9-b83e-3aa354d80bfc tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:24.426874 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fee1ea03-c8a2-48a9-b83e-3aa354d80bfc tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:24.592453 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fee1ea03-c8a2-48a9-b83e-3aa354d80bfc tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:24.600663 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fee1ea03-c8a2-48a9-b83e-3aa354d80bfc tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:24.602956 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fee1ea03-c8a2-48a9-b83e-3aa354d80bfc tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:24.604524 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fee1ea03-c8a2-48a9-b83e-3aa354d80bfc tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f" status: 200 len: 1362 microversion: 2.47 time: 0.194816 Sep 17 21:06:24.623257 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1950/3796] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:24 2022] GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:06:24.637660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-d175c1bf-9585-4da5-87d6-0612053d4d60 req-b929e4a0-54ac-47ca-b4b1-6d98e175dd21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03d3a17f-d3dd-4daf-8d22-2f4475530fee", "tag": "7e4c926f-87c9-4552-aabf-7578b77e3449"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:24.653528 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d175c1bf-9585-4da5-87d6-0612053d4d60 req-b929e4a0-54ac-47ca-b4b1-6d98e175dd21 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:24.654756 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d175c1bf-9585-4da5-87d6-0612053d4d60 req-b929e4a0-54ac-47ca-b4b1-6d98e175dd21 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:24.655390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d175c1bf-9585-4da5-87d6-0612053d4d60 req-b929e4a0-54ac-47ca-b4b1-6d98e175dd21 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:24.678866 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-d175c1bf-9585-4da5-87d6-0612053d4d60 req-b929e4a0-54ac-47ca-b4b1-6d98e175dd21 service nova] Creating event network-changed:7e4c926f-87c9-4552-aabf-7578b77e3449 for instance 03d3a17f-d3dd-4daf-8d22-2f4475530fee on nch2-master-1 Sep 17 21:06:24.685933 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-d175c1bf-9585-4da5-87d6-0612053d4d60 req-b929e4a0-54ac-47ca-b4b1-6d98e175dd21 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059957 Sep 17 21:06:24.693957 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1951/3797] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:24.702799 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bc505750-cd92-49a5-82c9-3b8680d9205f tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '.version_select at 0x7f25a4ce60d0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:25.195106 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bb90fa10-a8d5-4e52-9930-b89cbc073ede tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:25.206336 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bb90fa10-a8d5-4e52-9930-b89cbc073ede tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249" status: 200 len: 1365 microversion: 2.1 time: 0.853222 Sep 17 21:06:25.206955 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1847/3798] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:24 2022] GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249 => generated 1365 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:25.212127 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a804d546-9186-47ca-b1df-d7461ea5df13 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:25.212987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a804d546-9186-47ca-b1df-d7461ea5df13 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:25.224265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a804d546-9186-47ca-b1df-d7461ea5df13 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:25.225006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a804d546-9186-47ca-b1df-d7461ea5df13 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:25.225686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a804d546-9186-47ca-b1df-d7461ea5df13 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:25.226606 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a804d546-9186-47ca-b1df-d7461ea5df13 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:25.227244 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a804d546-9186-47ca-b1df-d7461ea5df13 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:25.227897 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a804d546-9186-47ca-b1df-d7461ea5df13 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:25.558636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a804d546-9186-47ca-b1df-d7461ea5df13 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:25.562649 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bc505750-cd92-49a5-82c9-3b8680d9205f tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/93aefc96-b12c-485e-a2aa-1241d93cec49" status: 202 len: 0 microversion: 2.1 time: 0.866047 Sep 17 21:06:25.564945 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1952/3799] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 21:06:24 2022] DELETE /compute/v2.1/os-security-groups/93aefc96-b12c-485e-a2aa-1241d93cec49 => generated 0 bytes in 869 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:06:25.578779 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c964dae2-a377-4445-9e44-a8652324c521 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:25.583805 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c964dae2-a377-4445-9e44-a8652324c521 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 60e59237-9ac3-43d8-9231-af2a77fc368e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:25.587099 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a804d546-9186-47ca-b1df-d7461ea5df13 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1521 microversion: 2.1 time: 0.373579 Sep 17 21:06:25.589003 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1848/3800] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:25 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1521 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:25.594616 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7bcf0f62-488d-4e61-b3e3-0a5362c77c55 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:25.595636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7bcf0f62-488d-4e61-b3e3-0a5362c77c55 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:25.602143 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:25.604526 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7bcf0f62-488d-4e61-b3e3-0a5362c77c55 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:25.606100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7bcf0f62-488d-4e61-b3e3-0a5362c77c55 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:25.607162 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7bcf0f62-488d-4e61-b3e3-0a5362c77c55 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:25.608419 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7bcf0f62-488d-4e61-b3e3-0a5362c77c55 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:25.609500 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7bcf0f62-488d-4e61-b3e3-0a5362c77c55 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:25.610306 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7bcf0f62-488d-4e61-b3e3-0a5362c77c55 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:25.614215 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c964dae2-a377-4445-9e44-a8652324c521 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:25.614980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c964dae2-a377-4445-9e44-a8652324c521 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:25.615783 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c964dae2-a377-4445-9e44-a8652324c521 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:25.620070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c964dae2-a377-4445-9e44-a8652324c521 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:25.628546 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c964dae2-a377-4445-9e44-a8652324c521 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:25.631219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c964dae2-a377-4445-9e44-a8652324c521 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:25.720051 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c964dae2-a377-4445-9e44-a8652324c521 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e/action" status: 200 len: 14 microversion: 2.1 time: 0.153068 Sep 17 21:06:25.725173 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1953/3801] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:06:25 2022] POST /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:06:25.732436 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-0bd05e6c-48af-4d5c-ae24-24ccdb8efeb3 req-7007aaed-5a30-475e-9a28-ab8ec73b6cef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29c92489-5a3c-43e3-8dae-d5168e2a29bb", "tag": "9cab2864-c670-4626-bc81-dd94642db5a7"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:25.746436 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-0bd05e6c-48af-4d5c-ae24-24ccdb8efeb3 req-7007aaed-5a30-475e-9a28-ab8ec73b6cef service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:25.746993 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-0bd05e6c-48af-4d5c-ae24-24ccdb8efeb3 req-7007aaed-5a30-475e-9a28-ab8ec73b6cef service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:25.747446 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-0bd05e6c-48af-4d5c-ae24-24ccdb8efeb3 req-7007aaed-5a30-475e-9a28-ab8ec73b6cef service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:25.768585 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-0bd05e6c-48af-4d5c-ae24-24ccdb8efeb3 req-7007aaed-5a30-475e-9a28-ab8ec73b6cef service nova] Creating event network-changed:9cab2864-c670-4626-bc81-dd94642db5a7 for instance 29c92489-5a3c-43e3-8dae-d5168e2a29bb on nch1-master-1 Sep 17 21:06:25.777580 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-0bd05e6c-48af-4d5c-ae24-24ccdb8efeb3 req-7007aaed-5a30-475e-9a28-ab8ec73b6cef service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050317 Sep 17 21:06:25.778986 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1954/3802] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:25.802830 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-81739bd6-9efd-4f9b-a95d-fc0e90a7eabd tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '.version_select at 0x7f25a40db4c0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:25.944504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG neutronclient.v2_0.client [None req-81739bd6-9efd-4f9b-a95d-fc0e90a7eabd tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 93aefc96-b12c-485e-a2aa-1241d93cec49 does not exist", "detail": ""}} {{(pid=140524) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 17 21:06:25.945359 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7bcf0f62-488d-4e61-b3e3-0a5362c77c55 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:25.945573 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.security_group_api [None req-81739bd6-9efd-4f9b-a95d-fc0e90a7eabd tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Neutron security group 93aefc96-b12c-485e-a2aa-1241d93cec49 not found {{(pid=140524) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 17 21:06:25.946732 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-81739bd6-9efd-4f9b-a95d-fc0e90a7eabd tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] HTTP exception thrown: Security group 93aefc96-b12c-485e-a2aa-1241d93cec49 does not exist Sep 17 21:06:25.946732 ncdv-master-1 devstack@n-api.service[140524]: Neutron server returns request_ids: ['req-2f4b9974-d18b-4ccb-a869-3d8ed5ca560c'] Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-81739bd6-9efd-4f9b-a95d-fc0e90a7eabd tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Request method failure captured: Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/os-security-groups/93aefc96-b12c-485e-a2aa-1241d93cec49 HTTP/1.1 Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjagzzYrrTodN4FRISubmKjZ26J-8BGxkNzLU7x20a3MCWENMarIDjJ9bOlqCettGyQPm3qYerTfS4mUFkwcpl7RJrNB079yuTWGsg7iyYHjYrTBkjIt8CtBBLGQxaQp-7J70wULL21t1iBESs97Rxk-MKHrjWOPMZFqMTCeWGgBIAQ Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 1c307636beed407582da5779796cc6a7 Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c307636beed407582da5779796cc6a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c307636beed407582da5779796cc6a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c307636beed407582da5779796cc6a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c307636beed407582da5779796cc6a7", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 1c307636beed407582da5779796cc6a7 Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-SecurityGroupsTestJSON-1804220727-project Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 30b19896bc4e4d14bfec46dd00519150 Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-SecurityGroupsTestJSON-1804220727-project Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: exception: Security group 93aefc96-b12c-485e-a2aa-1241d93cec49 does not exist Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: Neutron server returns request_ids: ['req-2f4b9974-d18b-4ccb-a869-3d8ed5ca560c'] Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '93aefc96-b12c-485e-a2aa-1241d93cec49'} Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 17 21:06:25.948903 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 93aefc96-b12c-485e-a2aa-1241d93cec49 does not exist Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f4b9974-d18b-4ccb-a869-3d8ed5ca560c'] Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 93aefc96-b12c-485e-a2aa-1241d93cec49 does not exist Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f4b9974-d18b-4ccb-a869-3d8ed5ca560c'] Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 93aefc96-b12c-485e-a2aa-1241d93cec49 does not exist Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f4b9974-d18b-4ccb-a869-3d8ed5ca560c'] Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 93aefc96-b12c-485e-a2aa-1241d93cec49 does not exist Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2f4b9974-d18b-4ccb-a869-3d8ed5ca560c'] Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-81739bd6-9efd-4f9b-a95d-fc0e90a7eabd tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Returning 404 to user: Security group 93aefc96-b12c-485e-a2aa-1241d93cec49 does not exist Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: Neutron server returns request_ids: ['req-2f4b9974-d18b-4ccb-a869-3d8ed5ca560c'] {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-81739bd6-9efd-4f9b-a95d-fc0e90a7eabd tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/93aefc96-b12c-485e-a2aa-1241d93cec49" status: 404 len: 194 microversion: 2.1 time: 0.170350 Sep 17 21:06:25.957338 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1955/3803] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Sep 17 21:06:25 2022] GET /compute/v2.1/os-security-groups/93aefc96-b12c-485e-a2aa-1241d93cec49 => generated 194 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:06:25.968248 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fbce2f79-1266-4afe-ba3a-74d81dfd4f66 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:25.968248 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fbce2f79-1266-4afe-ba3a-74d81dfd4f66 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:25.979933 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7bcf0f62-488d-4e61-b3e3-0a5362c77c55 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1314 microversion: 2.1 time: 0.388581 Sep 17 21:06:25.980528 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbce2f79-1266-4afe-ba3a-74d81dfd4f66 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:25.981046 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbce2f79-1266-4afe-ba3a-74d81dfd4f66 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:25.981625 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbce2f79-1266-4afe-ba3a-74d81dfd4f66 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:25.982127 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1849/3804] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:25 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:25.982385 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbce2f79-1266-4afe-ba3a-74d81dfd4f66 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:25.982714 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbce2f79-1266-4afe-ba3a-74d81dfd4f66 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:25.990548 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b324f938-b0f3-438e-84cc-2878f786a5db tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '.version_select at 0x7f25a4714790>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:25.993821 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbce2f79-1266-4afe-ba3a-74d81dfd4f66 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:26.139944 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fbce2f79-1266-4afe-ba3a-74d81dfd4f66 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:26.151408 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fbce2f79-1266-4afe-ba3a-74d81dfd4f66 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:26.153288 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fbce2f79-1266-4afe-ba3a-74d81dfd4f66 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:26.154693 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fbce2f79-1266-4afe-ba3a-74d81dfd4f66 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f" status: 200 len: 1362 microversion: 2.47 time: 0.198332 Sep 17 21:06:26.155958 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1956/3805] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:25 2022] GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:06:26.231627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-69e10f09-abbf-41b1-92a5-5af0805f830f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:26.232205 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-69e10f09-abbf-41b1-92a5-5af0805f830f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 839ed6b8-9a04-4448-afb8-1eb643476249] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:26.238693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69e10f09-abbf-41b1-92a5-5af0805f830f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:26.239649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69e10f09-abbf-41b1-92a5-5af0805f830f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:26.240295 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69e10f09-abbf-41b1-92a5-5af0805f830f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:26.241252 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69e10f09-abbf-41b1-92a5-5af0805f830f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:26.241978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69e10f09-abbf-41b1-92a5-5af0805f830f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:26.242639 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69e10f09-abbf-41b1-92a5-5af0805f830f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:26.532464 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b324f938-b0f3-438e-84cc-2878f786a5db tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups" status: 200 len: 1154 microversion: 2.1 time: 0.548497 Sep 17 21:06:26.533093 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1850/3806] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Sep 17 21:06:25 2022] GET /compute/v2.1/os-security-groups => generated 1154 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:26.556125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-69e10f09-abbf-41b1-92a5-5af0805f830f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:26.557375 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-383d73ba-ad50-405f-a8bc-96252b3f0473 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Action: 'create', calling method: .version_select at 0x7f25a4713dc0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-156105942", "description": "tempest-description-1753116992"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:26.566330 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-69e10f09-abbf-41b1-92a5-5af0805f830f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249" status: 200 len: 1365 microversion: 2.1 time: 0.338675 Sep 17 21:06:26.569979 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1957/3807] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:26 2022] GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249 => generated 1365 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:26.621806 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ae5ceaf3-9778-488e-8df1-6aa6b129c694 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:26.622619 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ae5ceaf3-9778-488e-8df1-6aa6b129c694 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:26.632559 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae5ceaf3-9778-488e-8df1-6aa6b129c694 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:26.633342 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae5ceaf3-9778-488e-8df1-6aa6b129c694 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:26.633960 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae5ceaf3-9778-488e-8df1-6aa6b129c694 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:26.635258 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae5ceaf3-9778-488e-8df1-6aa6b129c694 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:26.636388 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae5ceaf3-9778-488e-8df1-6aa6b129c694 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:26.636836 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae5ceaf3-9778-488e-8df1-6aa6b129c694 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:27.059786 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-383d73ba-ad50-405f-a8bc-96252b3f0473 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.511472 Sep 17 21:06:27.061544 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1851/3808] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Sep 17 21:06:26 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:27.073097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ae5ceaf3-9778-488e-8df1-6aa6b129c694 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:27.078117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ccd23a16-e3bc-42cb-9b9e-3ecfb4f1577f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:27.085437 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ae5ceaf3-9778-488e-8df1-6aa6b129c694 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1521 microversion: 2.1 time: 0.474650 Sep 17 21:06:27.086932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ccd23a16-e3bc-42cb-9b9e-3ecfb4f1577f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 60e59237-9ac3-43d8-9231-af2a77fc368e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:27.088329 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1958/3809] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:26 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1521 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:27.129113 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2b1c2f06-23cc-4295-893f-bef7b235e123 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:27.133140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2b1c2f06-23cc-4295-893f-bef7b235e123 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:27.134516 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ccd23a16-e3bc-42cb-9b9e-3ecfb4f1577f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:27.136133 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ccd23a16-e3bc-42cb-9b9e-3ecfb4f1577f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:27.137370 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ccd23a16-e3bc-42cb-9b9e-3ecfb4f1577f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:27.140211 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ccd23a16-e3bc-42cb-9b9e-3ecfb4f1577f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:27.142626 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ccd23a16-e3bc-42cb-9b9e-3ecfb4f1577f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:27.143999 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ccd23a16-e3bc-42cb-9b9e-3ecfb4f1577f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:27.152674 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b1c2f06-23cc-4295-893f-bef7b235e123 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:27.153587 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b1c2f06-23cc-4295-893f-bef7b235e123 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:27.155026 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b1c2f06-23cc-4295-893f-bef7b235e123 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:27.160732 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b1c2f06-23cc-4295-893f-bef7b235e123 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:27.161357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b1c2f06-23cc-4295-893f-bef7b235e123 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:27.162340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b1c2f06-23cc-4295-893f-bef7b235e123 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:27.240179 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ccd23a16-e3bc-42cb-9b9e-3ecfb4f1577f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e/action" status: 200 len: 8207 microversion: 2.1 time: 0.176591 Sep 17 21:06:27.241016 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1852/3810] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:06:27 2022] POST /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e/action => generated 8207 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:27.247001 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-904f7d02-d6de-43e4-8caa-8c732952765e tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Action: 'create', calling method: .version_select at 0x7f25a4782160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2010759824", "description": "tempest-description-1456326796"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:27.504446 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2b1c2f06-23cc-4295-893f-bef7b235e123 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:27.508933 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:27.517387 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2b1c2f06-23cc-4295-893f-bef7b235e123 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1314 microversion: 2.1 time: 0.408991 Sep 17 21:06:27.518042 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1959/3811] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:27 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:27.527922 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-18b8628c-22f7-44c7-95d2-9fb1f43c7418 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:27.530363 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-18b8628c-22f7-44c7-95d2-9fb1f43c7418 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:27.547769 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18b8628c-22f7-44c7-95d2-9fb1f43c7418 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:27.548491 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18b8628c-22f7-44c7-95d2-9fb1f43c7418 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:27.549109 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18b8628c-22f7-44c7-95d2-9fb1f43c7418 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:27.550478 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18b8628c-22f7-44c7-95d2-9fb1f43c7418 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:27.551486 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18b8628c-22f7-44c7-95d2-9fb1f43c7418 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:27.552066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18b8628c-22f7-44c7-95d2-9fb1f43c7418 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:27.624310 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18b8628c-22f7-44c7-95d2-9fb1f43c7418 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:27.625009 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18b8628c-22f7-44c7-95d2-9fb1f43c7418 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:27.625528 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18b8628c-22f7-44c7-95d2-9fb1f43c7418 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:27.626050 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-18b8628c-22f7-44c7-95d2-9fb1f43c7418 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lazy-loading 'fault' on Instance uuid 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:06:27.700948 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-18b8628c-22f7-44c7-95d2-9fb1f43c7418 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:27.711911 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-18b8628c-22f7-44c7-95d2-9fb1f43c7418 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:27.714536 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-18b8628c-22f7-44c7-95d2-9fb1f43c7418 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:27.716157 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-18b8628c-22f7-44c7-95d2-9fb1f43c7418 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f" status: 200 len: 1367 microversion: 2.47 time: 0.193995 Sep 17 21:06:27.734324 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1960/3812] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:27 2022] GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:06:27.736838 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-904f7d02-d6de-43e4-8caa-8c732952765e tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.494246 Sep 17 21:06:27.737986 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1853/3813] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Sep 17 21:06:27 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:27.742705 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-37b7b053-847c-4ed2-90d1-d191e638f143 req-666770bd-d8fa-4c91-bc2f-6bb1f3fe9f6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "839ed6b8-9a04-4448-afb8-1eb643476249", "name": "network-vif-plugged", "status": "completed", "tag": "ac665539-3ec3-439f-b476-756f416ed8d2"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:27.743180 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-54dc3106-9d49-4429-b9d6-4825de930113 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:27.744402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-54dc3106-9d49-4429-b9d6-4825de930113 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:27.752408 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-54dc3106-9d49-4429-b9d6-4825de930113 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:27.753380 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-54dc3106-9d49-4429-b9d6-4825de930113 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:27.754020 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-54dc3106-9d49-4429-b9d6-4825de930113 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:27.755472 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-54dc3106-9d49-4429-b9d6-4825de930113 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:27.756098 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-54dc3106-9d49-4429-b9d6-4825de930113 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:27.756684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-54dc3106-9d49-4429-b9d6-4825de930113 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:27.759154 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-37b7b053-847c-4ed2-90d1-d191e638f143 req-666770bd-d8fa-4c91-bc2f-6bb1f3fe9f6e service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:27.759655 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-37b7b053-847c-4ed2-90d1-d191e638f143 req-666770bd-d8fa-4c91-bc2f-6bb1f3fe9f6e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:27.760558 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-37b7b053-847c-4ed2-90d1-d191e638f143 req-666770bd-d8fa-4c91-bc2f-6bb1f3fe9f6e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:27.772256 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-37b7b053-847c-4ed2-90d1-d191e638f143 req-666770bd-d8fa-4c91-bc2f-6bb1f3fe9f6e service nova] Creating event network-vif-plugged:ac665539-3ec3-439f-b476-756f416ed8d2 for instance 839ed6b8-9a04-4448-afb8-1eb643476249 on nch2-master-1 Sep 17 21:06:27.778274 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-37b7b053-847c-4ed2-90d1-d191e638f143 req-666770bd-d8fa-4c91-bc2f-6bb1f3fe9f6e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038650 Sep 17 21:06:27.779244 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1854/3814] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:27.785807 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bfb89572-f0cf-4dd5-b16d-3611585bab8f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:27.787012 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bfb89572-f0cf-4dd5-b16d-3611585bab8f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 839ed6b8-9a04-4448-afb8-1eb643476249] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:27.805078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bfb89572-f0cf-4dd5-b16d-3611585bab8f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:27.805804 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bfb89572-f0cf-4dd5-b16d-3611585bab8f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:27.806251 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bfb89572-f0cf-4dd5-b16d-3611585bab8f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:27.807264 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bfb89572-f0cf-4dd5-b16d-3611585bab8f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:27.807757 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bfb89572-f0cf-4dd5-b16d-3611585bab8f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:27.808227 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bfb89572-f0cf-4dd5-b16d-3611585bab8f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:28.170056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-54dc3106-9d49-4429-b9d6-4825de930113 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:28.179722 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-54dc3106-9d49-4429-b9d6-4825de930113 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.443714 Sep 17 21:06:28.194826 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1961/3815] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:27 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:28.209978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fe5dcd9b-ef68-4467-9892-79b281af5f36 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1819880932", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "d5958703-fcdc-40a7-aa8d-b8f966d869b7"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:28.229653 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bfb89572-f0cf-4dd5-b16d-3611585bab8f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:28.237974 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bfb89572-f0cf-4dd5-b16d-3611585bab8f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249" status: 200 len: 1365 microversion: 2.1 time: 0.457205 Sep 17 21:06:28.257556 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1855/3816] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:27 2022] GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249 => generated 1365 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:28.265204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6bdb1264-60ca-4fa7-b628-563303d8378b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:28.266427 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6bdb1264-60ca-4fa7-b628-563303d8378b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:28.272819 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6bdb1264-60ca-4fa7-b628-563303d8378b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:28.273604 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6bdb1264-60ca-4fa7-b628-563303d8378b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:28.274302 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6bdb1264-60ca-4fa7-b628-563303d8378b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:28.275192 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6bdb1264-60ca-4fa7-b628-563303d8378b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:28.276240 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6bdb1264-60ca-4fa7-b628-563303d8378b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:28.276882 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6bdb1264-60ca-4fa7-b628-563303d8378b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:28.304997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-fe5dcd9b-ef68-4467-9892-79b281af5f36 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] validate_networks() for [('d5958703-fcdc-40a7-aa8d-b8f966d869b7', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:06:28.701540 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6bdb1264-60ca-4fa7-b628-563303d8378b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:28.710631 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6bdb1264-60ca-4fa7-b628-563303d8378b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1521 microversion: 2.1 time: 0.451739 Sep 17 21:06:28.711207 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1856/3817] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:28 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1521 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:28.732440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-17c6ec3a-6f93-4156-b16c-e01d7f526e8a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:28.733051 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-17c6ec3a-6f93-4156-b16c-e01d7f526e8a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:28.739974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17c6ec3a-6f93-4156-b16c-e01d7f526e8a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:28.740618 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17c6ec3a-6f93-4156-b16c-e01d7f526e8a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:28.740891 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17c6ec3a-6f93-4156-b16c-e01d7f526e8a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:28.741612 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17c6ec3a-6f93-4156-b16c-e01d7f526e8a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:28.742068 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17c6ec3a-6f93-4156-b16c-e01d7f526e8a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:28.742491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17c6ec3a-6f93-4156-b16c-e01d7f526e8a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:29.120731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-17c6ec3a-6f93-4156-b16c-e01d7f526e8a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:29.128810 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-17c6ec3a-6f93-4156-b16c-e01d7f526e8a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.406601 Sep 17 21:06:29.130076 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1857/3818] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:28 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:29.135266 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1dedebae-67f5-4fc1-a3a4-287d91914348 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:29.135950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1dedebae-67f5-4fc1-a3a4-287d91914348 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:29.141826 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1dedebae-67f5-4fc1-a3a4-287d91914348 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:29.142650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1dedebae-67f5-4fc1-a3a4-287d91914348 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:29.143061 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1dedebae-67f5-4fc1-a3a4-287d91914348 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:29.143971 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1dedebae-67f5-4fc1-a3a4-287d91914348 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:29.144647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1dedebae-67f5-4fc1-a3a4-287d91914348 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:29.145272 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1dedebae-67f5-4fc1-a3a4-287d91914348 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:29.488285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:29.831820 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-fe5dcd9b-ef68-4467-9892-79b281af5f36 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:06:29.832900 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-fe5dcd9b-ef68-4467-9892-79b281af5f36 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:06:29.833640 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-fe5dcd9b-ef68-4467-9892-79b281af5f36 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:06:29.834226 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-fe5dcd9b-ef68-4467-9892-79b281af5f36 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:06:29.835036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-fe5dcd9b-ef68-4467-9892-79b281af5f36 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:06:29.845320 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe5dcd9b-ef68-4467-9892-79b281af5f36 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:29.846012 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe5dcd9b-ef68-4467-9892-79b281af5f36 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:29.846522 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe5dcd9b-ef68-4467-9892-79b281af5f36 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:29.847947 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe5dcd9b-ef68-4467-9892-79b281af5f36 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:29.848459 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe5dcd9b-ef68-4467-9892-79b281af5f36 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:29.848959 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe5dcd9b-ef68-4467-9892-79b281af5f36 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:29.868077 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-fe5dcd9b-ef68-4467-9892-79b281af5f36 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Getting quotas for project 1c307636beed407582da5779796cc6a7. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:06:29.875141 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-fe5dcd9b-ef68-4467-9892-79b281af5f36 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Getting quotas for user 30b19896bc4e4d14bfec46dd00519150 and project 1c307636beed407582da5779796cc6a7. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:06:29.890312 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:29.900325 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1dedebae-67f5-4fc1-a3a4-287d91914348 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:29.902534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fe5dcd9b-ef68-4467-9892-79b281af5f36 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:06:29.906146 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fe5dcd9b-ef68-4467-9892-79b281af5f36 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: 239420ee-3593-46d6-8082-e3c0374a3db1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:06:29.914931 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1dedebae-67f5-4fc1-a3a4-287d91914348 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1314 microversion: 2.1 time: 0.783023 Sep 17 21:06:29.916193 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1858/3819] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:29 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1314 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:29.922109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2fce8448-c397-4951-8757-5fbf70e9f703 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:29.923626 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2fce8448-c397-4951-8757-5fbf70e9f703 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:29.930853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2fce8448-c397-4951-8757-5fbf70e9f703 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:29.931713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2fce8448-c397-4951-8757-5fbf70e9f703 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:29.932269 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2fce8448-c397-4951-8757-5fbf70e9f703 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:29.936961 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2fce8448-c397-4951-8757-5fbf70e9f703 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:29.937593 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2fce8448-c397-4951-8757-5fbf70e9f703 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:29.938075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2fce8448-c397-4951-8757-5fbf70e9f703 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:29.956956 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-2fce8448-c397-4951-8757-5fbf70e9f703 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] HTTP exception thrown: Instance 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f could not be found. Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2fce8448-c397-4951-8757-5fbf70e9f703 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Request method failure captured: Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f HTTP/1.1 Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjaisinBWQaxQ3HX2rumslLyzIcLNKOVkdQ5Cwzz-lZuHAbIXDHuAGyI2OTsrrJmQORh9mp53iCY1PvGVUUOe2sPzoqn3-q8zgiM0IqD8PwJ8yR0WrSLQYGfh9jUENalTuVvRygChoA7lHVaNyh36EjX1vvZol6vDQCHAe7BDbGDc3Q Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: X-Openstack-Nova-Api-Version: 2.47 Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 4512f54506dd413a80df4b337a6c31c6 Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerShowV247Test-2146622484 Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4512f54506dd413a80df4b337a6c31c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4512f54506dd413a80df4b337a6c31c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4512f54506dd413a80df4b337a6c31c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4512f54506dd413a80df4b337a6c31c6", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerShowV247Test-2146622484 Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 4512f54506dd413a80df4b337a6c31c6 Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerShowV247Test-2146622484 Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerShowV247Test-2146622484-project Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 6b27ba12dd5a46b3b27479c3a7c241e5 Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerShowV247Test-2146622484-project Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f could not be found. Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f'} Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f could not be found. Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f could not be found. Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:29.958951 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:29.969275 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:29.969275 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:29.969275 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:29.969275 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:06:29.969275 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:06:29.969275 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f could not be found. Sep 17 21:06:29.969275 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:29.969275 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2fce8448-c397-4951-8757-5fbf70e9f703 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Returning 404 to user: Instance 087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:06:29.969275 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2fce8448-c397-4951-8757-5fbf70e9f703 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f" status: 404 len: 111 microversion: 2.47 time: 0.042970 Sep 17 21:06:29.969275 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1859/3820] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:29 2022] GET /compute/v2.1/servers/087f3aa6-1dbe-45ba-aaeb-07fdd4d13f2f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:06:29.974078 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fe5dcd9b-ef68-4467-9892-79b281af5f36 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.773149 Sep 17 21:06:29.980623 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1962/3821] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:06:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:06:29.980623 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b915db55-bb71-4e85-a1cd-59ec2467c459 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:29.981096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b915db55-bb71-4e85-a1cd-59ec2467c459 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 839ed6b8-9a04-4448-afb8-1eb643476249] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:29.986262 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b595fcbe-9d81-42ae-bf72-01410ed81bd0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:29.987157 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b595fcbe-9d81-42ae-bf72-01410ed81bd0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:29.989412 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b915db55-bb71-4e85-a1cd-59ec2467c459 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:29.989939 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b915db55-bb71-4e85-a1cd-59ec2467c459 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:29.990508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b915db55-bb71-4e85-a1cd-59ec2467c459 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:29.991104 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b915db55-bb71-4e85-a1cd-59ec2467c459 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:29.991580 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b915db55-bb71-4e85-a1cd-59ec2467c459 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:29.992170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b915db55-bb71-4e85-a1cd-59ec2467c459 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:30.023104 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b595fcbe-9d81-42ae-bf72-01410ed81bd0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:30.025028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b595fcbe-9d81-42ae-bf72-01410ed81bd0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:30.025661 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b595fcbe-9d81-42ae-bf72-01410ed81bd0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:30.026443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b595fcbe-9d81-42ae-bf72-01410ed81bd0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:30.027038 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b595fcbe-9d81-42ae-bf72-01410ed81bd0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:30.027408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b595fcbe-9d81-42ae-bf72-01410ed81bd0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:30.233238 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b915db55-bb71-4e85-a1cd-59ec2467c459 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:30.236181 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b595fcbe-9d81-42ae-bf72-01410ed81bd0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:30.244664 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b595fcbe-9d81-42ae-bf72-01410ed81bd0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.282227 Sep 17 21:06:30.245244 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1860/3822] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:29 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:30.249704 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-26fad855-59f9-4389-94d2-921dabdd0a32 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:30.250316 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-26fad855-59f9-4389-94d2-921dabdd0a32 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:30.251415 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b915db55-bb71-4e85-a1cd-59ec2467c459 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249" status: 200 len: 1556 microversion: 2.1 time: 0.269309 Sep 17 21:06:30.252463 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1963/3823] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:29 2022] GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249 => generated 1556 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:30.256635 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26fad855-59f9-4389-94d2-921dabdd0a32 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:30.257116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26fad855-59f9-4389-94d2-921dabdd0a32 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:30.257577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26fad855-59f9-4389-94d2-921dabdd0a32 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:30.258452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26fad855-59f9-4389-94d2-921dabdd0a32 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:30.259402 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26fad855-59f9-4389-94d2-921dabdd0a32 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:30.260147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26fad855-59f9-4389-94d2-921dabdd0a32 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:30.267211 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-1a7e46e5-138b-414f-9322-00ed9c87ec35 req-5597bf4a-cad8-4aa9-a6c0-05d49f0f41d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d3a17f-d3dd-4daf-8d22-2f4475530fee", "name": "network-vif-plugged", "status": "completed", "tag": "7e4c926f-87c9-4552-aabf-7578b77e3449"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:30.287236 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-1a7e46e5-138b-414f-9322-00ed9c87ec35 req-5597bf4a-cad8-4aa9-a6c0-05d49f0f41d1 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:30.287735 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-1a7e46e5-138b-414f-9322-00ed9c87ec35 req-5597bf4a-cad8-4aa9-a6c0-05d49f0f41d1 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:30.288181 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-1a7e46e5-138b-414f-9322-00ed9c87ec35 req-5597bf4a-cad8-4aa9-a6c0-05d49f0f41d1 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:30.310057 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-1a7e46e5-138b-414f-9322-00ed9c87ec35 req-5597bf4a-cad8-4aa9-a6c0-05d49f0f41d1 service nova] Creating event network-vif-plugged:7e4c926f-87c9-4552-aabf-7578b77e3449 for instance 03d3a17f-d3dd-4daf-8d22-2f4475530fee on nch2-master-1 Sep 17 21:06:30.317620 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-1a7e46e5-138b-414f-9322-00ed9c87ec35 req-5597bf4a-cad8-4aa9-a6c0-05d49f0f41d1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062992 Sep 17 21:06:30.319282 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1964/3824] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:30.360763 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7a78feb6-9a73-4c56-8ccc-9a3d6dbc5c8c tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:30.363473 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7a78feb6-9a73-4c56-8ccc-9a3d6dbc5c8c tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 5df81993-e8a2-4513-8a62-f7abfb64eb5a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:30.381879 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a78feb6-9a73-4c56-8ccc-9a3d6dbc5c8c tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:30.383194 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a78feb6-9a73-4c56-8ccc-9a3d6dbc5c8c tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:30.383809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a78feb6-9a73-4c56-8ccc-9a3d6dbc5c8c tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:30.384492 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a78feb6-9a73-4c56-8ccc-9a3d6dbc5c8c tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:30.385055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a78feb6-9a73-4c56-8ccc-9a3d6dbc5c8c tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:30.385530 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a78feb6-9a73-4c56-8ccc-9a3d6dbc5c8c tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:30.429389 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7a78feb6-9a73-4c56-8ccc-9a3d6dbc5c8c tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 5df81993-e8a2-4513-8a62-f7abfb64eb5a] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:06:30.464191 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-26fad855-59f9-4389-94d2-921dabdd0a32 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:30.471709 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:30.474452 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-26fad855-59f9-4389-94d2-921dabdd0a32 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1521 microversion: 2.1 time: 0.228195 Sep 17 21:06:30.491432 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1861/3825] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:30 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:30.498723 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f268013f-2d19-4ce6-b8fa-9b3cfc0a1c49 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:30.499378 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f268013f-2d19-4ce6-b8fa-9b3cfc0a1c49 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: 239420ee-3593-46d6-8082-e3c0374a3db1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:30.565206 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7a78feb6-9a73-4c56-8ccc-9a3d6dbc5c8c tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5df81993-e8a2-4513-8a62-f7abfb64eb5a" status: 204 len: 0 microversion: 2.47 time: 0.244023 Sep 17 21:06:30.568636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f268013f-2d19-4ce6-b8fa-9b3cfc0a1c49 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b19896bc4e4d14bfec46dd00519150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c307636beed407582da5779796cc6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:30.572251 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1965/3826] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 17 21:06:30 2022] DELETE /compute/v2.1/servers/5df81993-e8a2-4513-8a62-f7abfb64eb5a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 21:06:30.578444 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f268013f-2d19-4ce6-b8fa-9b3cfc0a1c49 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1" status: 200 len: 1216 microversion: 2.1 time: 0.085540 Sep 17 21:06:30.579459 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1862/3827] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:30 2022] GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1 => generated 1216 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:30.583354 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0dbd4479-966e-42c9-a359-514950d3ff88 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:30.584428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0dbd4479-966e-42c9-a359-514950d3ff88 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:30.585904 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-38ab4f43-2a91-4412-bea4-5099ad629e92 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:30.586685 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-38ab4f43-2a91-4412-bea4-5099ad629e92 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 839ed6b8-9a04-4448-afb8-1eb643476249] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:30.592340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0dbd4479-966e-42c9-a359-514950d3ff88 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:30.594589 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0dbd4479-966e-42c9-a359-514950d3ff88 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:30.595199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-38ab4f43-2a91-4412-bea4-5099ad629e92 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:30.595460 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0dbd4479-966e-42c9-a359-514950d3ff88 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:30.596058 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-38ab4f43-2a91-4412-bea4-5099ad629e92 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:30.596570 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-38ab4f43-2a91-4412-bea4-5099ad629e92 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:30.596742 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0dbd4479-966e-42c9-a359-514950d3ff88 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:30.597091 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0dbd4479-966e-42c9-a359-514950d3ff88 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:30.597630 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0dbd4479-966e-42c9-a359-514950d3ff88 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:30.597772 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-38ab4f43-2a91-4412-bea4-5099ad629e92 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:30.598360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-38ab4f43-2a91-4412-bea4-5099ad629e92 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:30.599029 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-38ab4f43-2a91-4412-bea4-5099ad629e92 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:30.800428 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-38ab4f43-2a91-4412-bea4-5099ad629e92 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.219513 Sep 17 21:06:30.801903 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1863/3828] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Sep 17 21:06:30 2022] GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249/os-interface => generated 285 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:30.807236 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f0b1b592-deed-4ac0-8966-6b385be30ab9 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:30.808570 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f0b1b592-deed-4ac0-8966-6b385be30ab9 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 5df81993-e8a2-4513-8a62-f7abfb64eb5a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:30.818989 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0b1b592-deed-4ac0-8966-6b385be30ab9 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:30.819590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0b1b592-deed-4ac0-8966-6b385be30ab9 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:30.822052 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0b1b592-deed-4ac0-8966-6b385be30ab9 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:30.822843 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0b1b592-deed-4ac0-8966-6b385be30ab9 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:30.823646 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0b1b592-deed-4ac0-8966-6b385be30ab9 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:30.824273 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0b1b592-deed-4ac0-8966-6b385be30ab9 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:30.940063 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f0b1b592-deed-4ac0-8966-6b385be30ab9 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:30.953864 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0dbd4479-966e-42c9-a359-514950d3ff88 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:30.963572 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f0b1b592-deed-4ac0-8966-6b385be30ab9 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:30.965608 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0dbd4479-966e-42c9-a359-514950d3ff88 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.389077 Sep 17 21:06:30.966237 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1966/3829] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:30 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:30.967388 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f0b1b592-deed-4ac0-8966-6b385be30ab9 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:30.968877 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f0b1b592-deed-4ac0-8966-6b385be30ab9 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "GET /compute/v2.1/servers/5df81993-e8a2-4513-8a62-f7abfb64eb5a" status: 200 len: 1362 microversion: 2.47 time: 0.165802 Sep 17 21:06:30.969439 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1864/3830] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:30 2022] GET /compute/v2.1/servers/5df81993-e8a2-4513-8a62-f7abfb64eb5a => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:06:30.981594 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4298ed0b-1dfd-4137-a905-b1a0ccf6541b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:30.981594 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4298ed0b-1dfd-4137-a905-b1a0ccf6541b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:30.992648 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5b9097a6-01e5-4154-a1d5-9738753bb875 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:30.992648 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5b9097a6-01e5-4154-a1d5-9738753bb875 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:30.999749 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4298ed0b-1dfd-4137-a905-b1a0ccf6541b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:31.000302 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4298ed0b-1dfd-4137-a905-b1a0ccf6541b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:31.000771 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4298ed0b-1dfd-4137-a905-b1a0ccf6541b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:31.005905 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b9097a6-01e5-4154-a1d5-9738753bb875 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:31.006242 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4298ed0b-1dfd-4137-a905-b1a0ccf6541b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:31.007421 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4298ed0b-1dfd-4137-a905-b1a0ccf6541b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:31.007913 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4298ed0b-1dfd-4137-a905-b1a0ccf6541b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:31.008780 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b9097a6-01e5-4154-a1d5-9738753bb875 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:31.009256 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b9097a6-01e5-4154-a1d5-9738753bb875 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:31.010016 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b9097a6-01e5-4154-a1d5-9738753bb875 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:31.011623 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b9097a6-01e5-4154-a1d5-9738753bb875 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:31.012042 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b9097a6-01e5-4154-a1d5-9738753bb875 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:31.083597 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5b9097a6-01e5-4154-a1d5-9738753bb875 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Locking {{(pid=140523) lock /opt/stack/nova/nova/compute/api.py:4845}} Sep 17 21:06:31.170668 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5b9097a6-01e5-4154-a1d5-9738753bb875 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action" status: 202 len: 0 microversion: 2.1 time: 0.182889 Sep 17 21:06:31.171688 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1865/3831] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:06:30 2022] POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 17 21:06:31.181008 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ab574f0a-6d54-4e54-91a7-2d16e3fde5e4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:31.181676 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ab574f0a-6d54-4e54-91a7-2d16e3fde5e4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:31.189110 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4298ed0b-1dfd-4137-a905-b1a0ccf6541b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:31.190374 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab574f0a-6d54-4e54-91a7-2d16e3fde5e4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:31.191187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab574f0a-6d54-4e54-91a7-2d16e3fde5e4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:31.191654 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab574f0a-6d54-4e54-91a7-2d16e3fde5e4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:31.192426 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab574f0a-6d54-4e54-91a7-2d16e3fde5e4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:31.192899 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab574f0a-6d54-4e54-91a7-2d16e3fde5e4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:31.193342 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab574f0a-6d54-4e54-91a7-2d16e3fde5e4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:31.201537 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4298ed0b-1dfd-4137-a905-b1a0ccf6541b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1314 microversion: 2.1 time: 0.226782 Sep 17 21:06:31.219130 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1967/3832] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:30 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:31.345540 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ab574f0a-6d54-4e54-91a7-2d16e3fde5e4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:31.353902 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ab574f0a-6d54-4e54-91a7-2d16e3fde5e4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.176876 Sep 17 21:06:31.355257 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1866/3833] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:31 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:31.377704 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ec333d08-066e-4288-88bd-d1d7c6af7568 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:31.385093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ec333d08-066e-4288-88bd-d1d7c6af7568 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:31.385979 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ec333d08-066e-4288-88bd-d1d7c6af7568 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:31.386667 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ec333d08-066e-4288-88bd-d1d7c6af7568 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:31.416926 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-ec333d08-066e-4288-88bd-d1d7c6af7568 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] HTTP exception thrown: Instance 41393a54-9105-4da5-ae65-3167427ddae8 is locked Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ec333d08-066e-4288-88bd-d1d7c6af7568 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Request method failure captured: Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action HTTP/1.1 Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 15 Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjWtNzto0mtliTp7XFuULyHI3we00ltwNJkYCbse73U4gam1okW0tzurAZa5qe_YztpOkiAgcTw1EzIzI3V47Ip6mNu1JOtXw9_irlu2PoTiHu-RjUFuYp2PItqb9Y3KBbavW0dotTtDS8YxL9QYLwabuvziZ2iGyr941Z01slaUM2o Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 3e48e3c2f7f74636a75679fdf10ef33a Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerActionsTestJSON-1146998919 Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e48e3c2f7f74636a75679fdf10ef33a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3e48e3c2f7f74636a75679fdf10ef33a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e48e3c2f7f74636a75679fdf10ef33a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3e48e3c2f7f74636a75679fdf10ef33a", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerActionsTestJSON-1146998919 Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 3e48e3c2f7f74636a75679fdf10ef33a Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerActionsTestJSON-1146998919 Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerActionsTestJSON-1146998919-project Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 2ef547e071fd43ec96c745c26eca119f Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerActionsTestJSON-1146998919-project Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: {"os-stop": {}} Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 41393a54-9105-4da5-ae65-3167427ddae8 is locked Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '41393a54-9105-4da5-ae65-3167427ddae8', 'body': {'os-stop': {}}} Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 41393a54-9105-4da5-ae65-3167427ddae8 is locked Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 41393a54-9105-4da5-ae65-3167427ddae8 is locked Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41393a54-9105-4da5-ae65-3167427ddae8 is locked Sep 17 21:06:31.419038 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:31.424085 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ec333d08-066e-4288-88bd-d1d7c6af7568 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Returning 409 to user: Instance 41393a54-9105-4da5-ae65-3167427ddae8 is locked {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:06:31.424085 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ec333d08-066e-4288-88bd-d1d7c6af7568 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action" status: 409 len: 107 microversion: 2.1 time: 0.046924 Sep 17 21:06:31.424085 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1968/3834] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:06:31 2022] POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action => generated 107 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 17 21:06:31.429580 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3525e0ce-b84c-4958-9751-a32d48532187 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:31.430130 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3525e0ce-b84c-4958-9751-a32d48532187 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:31.437358 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3525e0ce-b84c-4958-9751-a32d48532187 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:31.437966 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3525e0ce-b84c-4958-9751-a32d48532187 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:31.438538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3525e0ce-b84c-4958-9751-a32d48532187 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:31.439282 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3525e0ce-b84c-4958-9751-a32d48532187 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:31.439813 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3525e0ce-b84c-4958-9751-a32d48532187 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:31.440255 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3525e0ce-b84c-4958-9751-a32d48532187 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:31.490204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3525e0ce-b84c-4958-9751-a32d48532187 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Unlocking {{(pid=140523) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 17 21:06:31.502876 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9f3eac7c-0a82-4a83-aee3-d065eb53d0cf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:31.503768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9f3eac7c-0a82-4a83-aee3-d065eb53d0cf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:31.511932 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9f3eac7c-0a82-4a83-aee3-d065eb53d0cf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:31.512704 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9f3eac7c-0a82-4a83-aee3-d065eb53d0cf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:31.513343 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9f3eac7c-0a82-4a83-aee3-d065eb53d0cf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:31.514281 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9f3eac7c-0a82-4a83-aee3-d065eb53d0cf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:31.514915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9f3eac7c-0a82-4a83-aee3-d065eb53d0cf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:31.515516 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9f3eac7c-0a82-4a83-aee3-d065eb53d0cf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:31.576899 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3525e0ce-b84c-4958-9751-a32d48532187 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action" status: 202 len: 0 microversion: 2.1 time: 0.146851 Sep 17 21:06:31.581756 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1867/3835] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:06:31 2022] POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 17 21:06:31.588824 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e6583654-0c88-403a-9402-759d1df8d7c7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:31.597309 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6583654-0c88-403a-9402-759d1df8d7c7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:31.597924 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6583654-0c88-403a-9402-759d1df8d7c7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:31.598436 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6583654-0c88-403a-9402-759d1df8d7c7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:31.624653 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e6583654-0c88-403a-9402-759d1df8d7c7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Going to try to stop instance {{(pid=140523) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 17 21:06:31.703558 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e6583654-0c88-403a-9402-759d1df8d7c7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action" status: 202 len: 0 microversion: 2.1 time: 0.119655 Sep 17 21:06:31.703750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9f3eac7c-0a82-4a83-aee3-d065eb53d0cf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:31.705926 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1868/3836] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:06:31 2022] POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 17 21:06:31.713449 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9f3eac7c-0a82-4a83-aee3-d065eb53d0cf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1521 microversion: 2.1 time: 0.214454 Sep 17 21:06:31.714055 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1969/3837] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:31 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:31.715155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9b9ad721-8a3a-4f16-b6d0-0fbaf4306963 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:31.716149 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9b9ad721-8a3a-4f16-b6d0-0fbaf4306963 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: 239420ee-3593-46d6-8082-e3c0374a3db1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:31.724177 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b9ad721-8a3a-4f16-b6d0-0fbaf4306963 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:31.724854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b9ad721-8a3a-4f16-b6d0-0fbaf4306963 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:31.725391 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b9ad721-8a3a-4f16-b6d0-0fbaf4306963 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:31.726234 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b9ad721-8a3a-4f16-b6d0-0fbaf4306963 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:31.727104 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b9ad721-8a3a-4f16-b6d0-0fbaf4306963 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:31.727787 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b9ad721-8a3a-4f16-b6d0-0fbaf4306963 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:31.728504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-af99528f-6e07-4d9f-93b0-7e31aa0d1e59 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:31.729138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-af99528f-6e07-4d9f-93b0-7e31aa0d1e59 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:31.736550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af99528f-6e07-4d9f-93b0-7e31aa0d1e59 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:31.737143 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af99528f-6e07-4d9f-93b0-7e31aa0d1e59 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:31.738054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af99528f-6e07-4d9f-93b0-7e31aa0d1e59 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:31.739178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af99528f-6e07-4d9f-93b0-7e31aa0d1e59 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:31.739812 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af99528f-6e07-4d9f-93b0-7e31aa0d1e59 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:31.740404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af99528f-6e07-4d9f-93b0-7e31aa0d1e59 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:31.850623 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9b9ad721-8a3a-4f16-b6d0-0fbaf4306963 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b19896bc4e4d14bfec46dd00519150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c307636beed407582da5779796cc6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:31.864000 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9b9ad721-8a3a-4f16-b6d0-0fbaf4306963 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1" status: 200 len: 1268 microversion: 2.1 time: 0.153979 Sep 17 21:06:31.865875 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1869/3838] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:31 2022] GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1 => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:31.975209 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-af99528f-6e07-4d9f-93b0-7e31aa0d1e59 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:31.985538 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-af99528f-6e07-4d9f-93b0-7e31aa0d1e59 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1681 microversion: 2.1 time: 0.268221 Sep 17 21:06:31.987593 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1970/3839] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:31 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1681 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:32.008301 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-454386cf-56f1-476f-9e7a-bd23c1fb0ca3 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:32.008962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-454386cf-56f1-476f-9e7a-bd23c1fb0ca3 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 5df81993-e8a2-4513-8a62-f7abfb64eb5a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:32.021766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-454386cf-56f1-476f-9e7a-bd23c1fb0ca3 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:32.022312 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-454386cf-56f1-476f-9e7a-bd23c1fb0ca3 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:32.022847 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-454386cf-56f1-476f-9e7a-bd23c1fb0ca3 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:32.023635 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-454386cf-56f1-476f-9e7a-bd23c1fb0ca3 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:32.024159 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-454386cf-56f1-476f-9e7a-bd23c1fb0ca3 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:32.024777 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-454386cf-56f1-476f-9e7a-bd23c1fb0ca3 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:32.110221 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-454386cf-56f1-476f-9e7a-bd23c1fb0ca3 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:32.119427 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-454386cf-56f1-476f-9e7a-bd23c1fb0ca3 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:32.121210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-454386cf-56f1-476f-9e7a-bd23c1fb0ca3 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:32.122688 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-454386cf-56f1-476f-9e7a-bd23c1fb0ca3 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "GET /compute/v2.1/servers/5df81993-e8a2-4513-8a62-f7abfb64eb5a" status: 200 len: 1362 microversion: 2.47 time: 0.124742 Sep 17 21:06:32.123280 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1870/3840] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:31 2022] GET /compute/v2.1/servers/5df81993-e8a2-4513-8a62-f7abfb64eb5a => generated 1362 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:06:32.229226 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-aca662d5-e8f4-4a11-9397-cdc5003c9184 req-7be8b220-6ff3-40aa-8a37-93ceb63bafd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "839ed6b8-9a04-4448-afb8-1eb643476249", "tag": "ac665539-3ec3-439f-b476-756f416ed8d2"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:32.237767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f449b36e-c13e-4fc6-bb43-664b2b77895a tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:32.238393 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f449b36e-c13e-4fc6-bb43-664b2b77895a tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:32.243317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-aca662d5-e8f4-4a11-9397-cdc5003c9184 req-7be8b220-6ff3-40aa-8a37-93ceb63bafd0 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:32.243937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-aca662d5-e8f4-4a11-9397-cdc5003c9184 req-7be8b220-6ff3-40aa-8a37-93ceb63bafd0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:32.244527 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-aca662d5-e8f4-4a11-9397-cdc5003c9184 req-7be8b220-6ff3-40aa-8a37-93ceb63bafd0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:32.257905 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f449b36e-c13e-4fc6-bb43-664b2b77895a tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:32.258894 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f449b36e-c13e-4fc6-bb43-664b2b77895a tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:32.259951 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f449b36e-c13e-4fc6-bb43-664b2b77895a tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:32.261767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f449b36e-c13e-4fc6-bb43-664b2b77895a tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:32.262750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f449b36e-c13e-4fc6-bb43-664b2b77895a tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:32.263619 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f449b36e-c13e-4fc6-bb43-664b2b77895a tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:32.268611 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-aca662d5-e8f4-4a11-9397-cdc5003c9184 req-7be8b220-6ff3-40aa-8a37-93ceb63bafd0 service nova] Creating event network-changed:ac665539-3ec3-439f-b476-756f416ed8d2 for instance 839ed6b8-9a04-4448-afb8-1eb643476249 on nch2-master-1 Sep 17 21:06:32.277218 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-aca662d5-e8f4-4a11-9397-cdc5003c9184 req-7be8b220-6ff3-40aa-8a37-93ceb63bafd0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052516 Sep 17 21:06:32.281895 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1871/3841] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:32.706902 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f449b36e-c13e-4fc6-bb43-664b2b77895a tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:32.715548 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f449b36e-c13e-4fc6-bb43-664b2b77895a tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1499 microversion: 2.1 time: 0.487352 Sep 17 21:06:32.726276 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1971/3842] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:32 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1499 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:32.746512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c4f89edc-e90f-486b-9ab1-7c6a0176a394 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:32.749207 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c4f89edc-e90f-486b-9ab1-7c6a0176a394 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:32.751670 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c8df2112-6734-4496-9e5a-3477f3e5d0f5 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:32.752466 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c8df2112-6734-4496-9e5a-3477f3e5d0f5 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:32.774983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8df2112-6734-4496-9e5a-3477f3e5d0f5 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:32.775538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8df2112-6734-4496-9e5a-3477f3e5d0f5 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:32.775990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8df2112-6734-4496-9e5a-3477f3e5d0f5 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:32.776827 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8df2112-6734-4496-9e5a-3477f3e5d0f5 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:32.777580 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4f89edc-e90f-486b-9ab1-7c6a0176a394 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:32.778245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4f89edc-e90f-486b-9ab1-7c6a0176a394 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:32.778691 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4f89edc-e90f-486b-9ab1-7c6a0176a394 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:32.779444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4f89edc-e90f-486b-9ab1-7c6a0176a394 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:32.779909 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4f89edc-e90f-486b-9ab1-7c6a0176a394 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:32.780357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4f89edc-e90f-486b-9ab1-7c6a0176a394 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:32.783753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8df2112-6734-4496-9e5a-3477f3e5d0f5 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:32.784205 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8df2112-6734-4496-9e5a-3477f3e5d0f5 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:32.839643 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-c4f89edc-e90f-486b-9ab1-7c6a0176a394 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lazy-loading 'flavor' on Instance uuid 03d3a17f-d3dd-4daf-8d22-2f4475530fee {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:06:32.962517 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c4f89edc-e90f-486b-9ab1-7c6a0176a394 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "POST /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee/action" status: 200 len: 32 microversion: 2.1 time: 0.224465 Sep 17 21:06:32.963399 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1972/3843] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:06:32 2022] POST /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee/action => generated 32 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:06:32.970048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-dd58d162-fc51-4c47-94c0-3c133bf9eef6 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:32.970909 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-dd58d162-fc51-4c47-94c0-3c133bf9eef6 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: 239420ee-3593-46d6-8082-e3c0374a3db1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:32.983968 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd58d162-fc51-4c47-94c0-3c133bf9eef6 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:32.990741 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd58d162-fc51-4c47-94c0-3c133bf9eef6 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:32.991206 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd58d162-fc51-4c47-94c0-3c133bf9eef6 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:32.991999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd58d162-fc51-4c47-94c0-3c133bf9eef6 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:32.992505 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd58d162-fc51-4c47-94c0-3c133bf9eef6 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:32.992918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd58d162-fc51-4c47-94c0-3c133bf9eef6 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:33.128470 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-dd58d162-fc51-4c47-94c0-3c133bf9eef6 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b19896bc4e4d14bfec46dd00519150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c307636beed407582da5779796cc6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:33.143620 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-dd58d162-fc51-4c47-94c0-3c133bf9eef6 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1" status: 200 len: 1274 microversion: 2.1 time: 0.178668 Sep 17 21:06:33.158467 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1973/3844] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:32 2022] GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1 => generated 1274 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:33.167476 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b9aa07a9-ec54-467c-9130-cc4a5ec66dd0 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:33.168068 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b9aa07a9-ec54-467c-9130-cc4a5ec66dd0 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:33.175782 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9aa07a9-ec54-467c-9130-cc4a5ec66dd0 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:33.176472 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9aa07a9-ec54-467c-9130-cc4a5ec66dd0 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:33.177296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9aa07a9-ec54-467c-9130-cc4a5ec66dd0 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:33.178335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9aa07a9-ec54-467c-9130-cc4a5ec66dd0 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:33.178970 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9aa07a9-ec54-467c-9130-cc4a5ec66dd0 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:33.179756 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9aa07a9-ec54-467c-9130-cc4a5ec66dd0 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:33.203902 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:33.244313 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c8df2112-6734-4496-9e5a-3477f3e5d0f5 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:33.272044 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c8df2112-6734-4496-9e5a-3477f3e5d0f5 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1521 microversion: 2.1 time: 0.536231 Sep 17 21:06:33.273071 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1872/3845] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:32 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1521 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:33.279601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4d9c26fe-0fb0-4d97-a5bb-88be73389afa tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:33.280650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4d9c26fe-0fb0-4d97-a5bb-88be73389afa tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:33.313849 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d9c26fe-0fb0-4d97-a5bb-88be73389afa tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:33.314726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d9c26fe-0fb0-4d97-a5bb-88be73389afa tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:33.315350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d9c26fe-0fb0-4d97-a5bb-88be73389afa tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:33.316259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d9c26fe-0fb0-4d97-a5bb-88be73389afa tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:33.322742 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d9c26fe-0fb0-4d97-a5bb-88be73389afa tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:33.323494 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d9c26fe-0fb0-4d97-a5bb-88be73389afa tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:33.758653 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b9aa07a9-ec54-467c-9130-cc4a5ec66dd0 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:33.758653 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b9aa07a9-ec54-467c-9130-cc4a5ec66dd0 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1505 microversion: 2.1 time: 0.580747 Sep 17 21:06:33.763091 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1974/3846] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:33 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1505 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:33.769153 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-812c7bc6-20e8-4c50-ad2b-1d125a16e0e1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:33.770178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-812c7bc6-20e8-4c50-ad2b-1d125a16e0e1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 5df81993-e8a2-4513-8a62-f7abfb64eb5a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:33.776861 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-812c7bc6-20e8-4c50-ad2b-1d125a16e0e1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:33.777857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-812c7bc6-20e8-4c50-ad2b-1d125a16e0e1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:33.778473 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-812c7bc6-20e8-4c50-ad2b-1d125a16e0e1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:33.779463 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-812c7bc6-20e8-4c50-ad2b-1d125a16e0e1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:33.780577 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-812c7bc6-20e8-4c50-ad2b-1d125a16e0e1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:33.781192 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-812c7bc6-20e8-4c50-ad2b-1d125a16e0e1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:33.805733 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4d9c26fe-0fb0-4d97-a5bb-88be73389afa tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:33.822722 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4d9c26fe-0fb0-4d97-a5bb-88be73389afa tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1681 microversion: 2.1 time: 0.548298 Sep 17 21:06:33.823557 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1873/3847] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:33 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1681 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:33.845326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-812c7bc6-20e8-4c50-ad2b-1d125a16e0e1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:33.846034 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-812c7bc6-20e8-4c50-ad2b-1d125a16e0e1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:33.846838 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-812c7bc6-20e8-4c50-ad2b-1d125a16e0e1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:33.847300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-812c7bc6-20e8-4c50-ad2b-1d125a16e0e1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lazy-loading 'fault' on Instance uuid 5df81993-e8a2-4513-8a62-f7abfb64eb5a {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:06:33.925384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-812c7bc6-20e8-4c50-ad2b-1d125a16e0e1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:33.940325 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-812c7bc6-20e8-4c50-ad2b-1d125a16e0e1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:33.943697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-812c7bc6-20e8-4c50-ad2b-1d125a16e0e1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6b27ba12dd5a46b3b27479c3a7c241e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4512f54506dd413a80df4b337a6c31c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:33.946050 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-812c7bc6-20e8-4c50-ad2b-1d125a16e0e1 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "GET /compute/v2.1/servers/5df81993-e8a2-4513-8a62-f7abfb64eb5a" status: 200 len: 1367 microversion: 2.47 time: 0.181007 Sep 17 21:06:33.959669 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1975/3848] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:33 2022] GET /compute/v2.1/servers/5df81993-e8a2-4513-8a62-f7abfb64eb5a => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:06:34.171158 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2e8418ac-937f-4689-b182-22d703703520 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:34.172080 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2e8418ac-937f-4689-b182-22d703703520 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: 239420ee-3593-46d6-8082-e3c0374a3db1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:34.183894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e8418ac-937f-4689-b182-22d703703520 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:34.184704 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e8418ac-937f-4689-b182-22d703703520 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:34.185262 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e8418ac-937f-4689-b182-22d703703520 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:34.186280 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e8418ac-937f-4689-b182-22d703703520 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:34.186858 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e8418ac-937f-4689-b182-22d703703520 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:34.188134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e8418ac-937f-4689-b182-22d703703520 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:34.223644 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=5,nova_cell1:UPDATE=9 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:34.300324 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-85f71020-755b-4006-b59f-b12fb9559dcb tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:34.300956 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-85f71020-755b-4006-b59f-b12fb9559dcb tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:34.313523 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85f71020-755b-4006-b59f-b12fb9559dcb tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:34.314100 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85f71020-755b-4006-b59f-b12fb9559dcb tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:34.316834 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85f71020-755b-4006-b59f-b12fb9559dcb tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:34.317651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85f71020-755b-4006-b59f-b12fb9559dcb tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:34.318127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85f71020-755b-4006-b59f-b12fb9559dcb tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:34.318562 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85f71020-755b-4006-b59f-b12fb9559dcb tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:34.482630 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2e8418ac-937f-4689-b182-22d703703520 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b19896bc4e4d14bfec46dd00519150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c307636beed407582da5779796cc6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:34.495720 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2e8418ac-937f-4689-b182-22d703703520 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1" status: 200 len: 1316 microversion: 2.1 time: 0.328869 Sep 17 21:06:34.510702 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1874/3849] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:34 2022] GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1 => generated 1316 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:34.632512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-85f71020-755b-4006-b59f-b12fb9559dcb tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:34.640680 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-85f71020-755b-4006-b59f-b12fb9559dcb tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1521 microversion: 2.1 time: 0.345464 Sep 17 21:06:34.641273 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1976/3850] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:34 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:34.770840 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5d5ab0d4-124c-4b58-8929-2a520c2263c5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:34.771484 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5d5ab0d4-124c-4b58-8929-2a520c2263c5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:34.778210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d5ab0d4-124c-4b58-8929-2a520c2263c5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:34.778705 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d5ab0d4-124c-4b58-8929-2a520c2263c5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:34.779142 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d5ab0d4-124c-4b58-8929-2a520c2263c5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:34.779839 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d5ab0d4-124c-4b58-8929-2a520c2263c5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:34.780278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d5ab0d4-124c-4b58-8929-2a520c2263c5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:34.780701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d5ab0d4-124c-4b58-8929-2a520c2263c5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:34.998378 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5d5ab0d4-124c-4b58-8929-2a520c2263c5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:35.007445 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5d5ab0d4-124c-4b58-8929-2a520c2263c5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1505 microversion: 2.1 time: 0.240618 Sep 17 21:06:35.008214 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1875/3851] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:34 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1505 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:35.012876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3636b599-dd23-4888-9a75-8d285a8f78d6 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:35.013501 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3636b599-dd23-4888-9a75-8d285a8f78d6 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] [instance: 5df81993-e8a2-4513-8a62-f7abfb64eb5a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:35.019360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3636b599-dd23-4888-9a75-8d285a8f78d6 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:35.020319 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3636b599-dd23-4888-9a75-8d285a8f78d6 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:35.021047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3636b599-dd23-4888-9a75-8d285a8f78d6 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:35.021966 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3636b599-dd23-4888-9a75-8d285a8f78d6 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:35.022591 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3636b599-dd23-4888-9a75-8d285a8f78d6 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:35.023184 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3636b599-dd23-4888-9a75-8d285a8f78d6 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:35.046374 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7510c655-0872-4cb7-9c0b-047506d0cf75 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:35.046994 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7510c655-0872-4cb7-9c0b-047506d0cf75 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:35.050449 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-3636b599-dd23-4888-9a75-8d285a8f78d6 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] HTTP exception thrown: Instance 5df81993-e8a2-4513-8a62-f7abfb64eb5a could not be found. Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3636b599-dd23-4888-9a75-8d285a8f78d6 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Request method failure captured: Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/5df81993-e8a2-4513-8a62-f7abfb64eb5a HTTP/1.1 Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjaisinBWQaxQ3HX2rumslLyzIcLNKOVkdQ5Cwzz-lZuHAbIXDHuAGyI2OTsrrJmQORh9mp53iCY1PvGVUUOe2sPzoqn3-q8zgiM0IqD8PwJ8yR0WrSLQYGfh9jUENalTuVvRygChoA7lHVaNyh36EjX1vvZol6vDQCHAe7BDbGDc3Q Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: X-Openstack-Nova-Api-Version: 2.47 Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 4512f54506dd413a80df4b337a6c31c6 Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerShowV247Test-2146622484 Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4512f54506dd413a80df4b337a6c31c6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4512f54506dd413a80df4b337a6c31c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4512f54506dd413a80df4b337a6c31c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4512f54506dd413a80df4b337a6c31c6", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerShowV247Test-2146622484 Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 4512f54506dd413a80df4b337a6c31c6 Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerShowV247Test-2146622484 Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerShowV247Test-2146622484-project Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 6b27ba12dd5a46b3b27479c3a7c241e5 Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerShowV247Test-2146622484-project Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 5df81993-e8a2-4513-8a62-f7abfb64eb5a could not be found. Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '5df81993-e8a2-4513-8a62-f7abfb64eb5a'} Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5df81993-e8a2-4513-8a62-f7abfb64eb5a could not be found. Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5df81993-e8a2-4513-8a62-f7abfb64eb5a could not be found. Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:35.052187 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:35.061073 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:35.061073 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:35.061073 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:35.061073 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:06:35.061073 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:06:35.061073 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5df81993-e8a2-4513-8a62-f7abfb64eb5a could not be found. Sep 17 21:06:35.061073 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:35.061073 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3636b599-dd23-4888-9a75-8d285a8f78d6 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] Returning 404 to user: Instance 5df81993-e8a2-4513-8a62-f7abfb64eb5a could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:06:35.061073 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3636b599-dd23-4888-9a75-8d285a8f78d6 tempest-ServerShowV247Test-2146622484 tempest-ServerShowV247Test-2146622484-project] 10.222.0.26 "GET /compute/v2.1/servers/5df81993-e8a2-4513-8a62-f7abfb64eb5a" status: 404 len: 111 microversion: 2.47 time: 0.044289 Sep 17 21:06:35.061073 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1876/3852] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:06:35 2022] GET /compute/v2.1/servers/5df81993-e8a2-4513-8a62-f7abfb64eb5a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:06:35.062637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7510c655-0872-4cb7-9c0b-047506d0cf75 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:35.062637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7510c655-0872-4cb7-9c0b-047506d0cf75 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:35.062637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7510c655-0872-4cb7-9c0b-047506d0cf75 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:35.062637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7510c655-0872-4cb7-9c0b-047506d0cf75 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:35.062637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7510c655-0872-4cb7-9c0b-047506d0cf75 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:35.062637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7510c655-0872-4cb7-9c0b-047506d0cf75 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:35.276875 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7510c655-0872-4cb7-9c0b-047506d0cf75 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:35.293295 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7510c655-0872-4cb7-9c0b-047506d0cf75 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1681 microversion: 2.1 time: 0.444825 Sep 17 21:06:35.293945 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1977/3853] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:34 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1681 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:35.415220 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-fa422507-b0d2-4699-a978-185e65796995 req-6d0dc76d-c3c3-4a82-8ffd-0dca55867c49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "239420ee-3593-46d6-8082-e3c0374a3db1", "tag": "57a9ed75-fff3-45ef-a015-62f3f2a2d525"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:35.428680 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-fa422507-b0d2-4699-a978-185e65796995 req-6d0dc76d-c3c3-4a82-8ffd-0dca55867c49 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:35.429521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-fa422507-b0d2-4699-a978-185e65796995 req-6d0dc76d-c3c3-4a82-8ffd-0dca55867c49 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:35.430452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-fa422507-b0d2-4699-a978-185e65796995 req-6d0dc76d-c3c3-4a82-8ffd-0dca55867c49 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:35.449076 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-fa422507-b0d2-4699-a978-185e65796995 req-6d0dc76d-c3c3-4a82-8ffd-0dca55867c49 service nova] Creating event network-changed:57a9ed75-fff3-45ef-a015-62f3f2a2d525 for instance 239420ee-3593-46d6-8082-e3c0374a3db1 on nch2-master-1 Sep 17 21:06:35.454577 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-fa422507-b0d2-4699-a978-185e65796995 req-6d0dc76d-c3c3-4a82-8ffd-0dca55867c49 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044677 Sep 17 21:06:35.456175 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1877/3854] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:35.522162 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6ac153f6-764a-413f-94f3-abb8e1660916 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:35.523725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6ac153f6-764a-413f-94f3-abb8e1660916 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: 239420ee-3593-46d6-8082-e3c0374a3db1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:35.532691 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ac153f6-764a-413f-94f3-abb8e1660916 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:35.533734 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ac153f6-764a-413f-94f3-abb8e1660916 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:35.534438 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ac153f6-764a-413f-94f3-abb8e1660916 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:35.535753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ac153f6-764a-413f-94f3-abb8e1660916 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:35.536398 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ac153f6-764a-413f-94f3-abb8e1660916 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:35.537006 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ac153f6-764a-413f-94f3-abb8e1660916 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:35.677307 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-594857b7-ab0d-4d93-ac63-0ced1f9302fd tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:35.678688 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-594857b7-ab0d-4d93-ac63-0ced1f9302fd tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:35.706639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-594857b7-ab0d-4d93-ac63-0ced1f9302fd tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:35.707419 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-594857b7-ab0d-4d93-ac63-0ced1f9302fd tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:35.708035 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-594857b7-ab0d-4d93-ac63-0ced1f9302fd tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:35.709026 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-594857b7-ab0d-4d93-ac63-0ced1f9302fd tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:35.709676 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-594857b7-ab0d-4d93-ac63-0ced1f9302fd tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:35.710271 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-594857b7-ab0d-4d93-ac63-0ced1f9302fd tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:35.829224 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6ac153f6-764a-413f-94f3-abb8e1660916 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b19896bc4e4d14bfec46dd00519150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c307636beed407582da5779796cc6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:35.844387 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6ac153f6-764a-413f-94f3-abb8e1660916 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1" status: 200 len: 1316 microversion: 2.1 time: 0.327903 Sep 17 21:06:35.845196 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1978/3855] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:35 2022] GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1 => generated 1316 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:35.966004 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-594857b7-ab0d-4d93-ac63-0ced1f9302fd tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:35.976205 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-594857b7-ab0d-4d93-ac63-0ced1f9302fd tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1521 microversion: 2.1 time: 0.311946 Sep 17 21:06:35.976804 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1878/3856] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:35 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:36.037070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-501200c1-8d73-4666-b1fd-db6c9e16230b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:36.037980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-501200c1-8d73-4666-b1fd-db6c9e16230b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:36.047439 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-501200c1-8d73-4666-b1fd-db6c9e16230b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:36.048308 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-501200c1-8d73-4666-b1fd-db6c9e16230b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:36.049530 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-501200c1-8d73-4666-b1fd-db6c9e16230b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:36.050429 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-501200c1-8d73-4666-b1fd-db6c9e16230b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:36.052190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-501200c1-8d73-4666-b1fd-db6c9e16230b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:36.053688 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-501200c1-8d73-4666-b1fd-db6c9e16230b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:36.222081 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-501200c1-8d73-4666-b1fd-db6c9e16230b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:36.231082 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-501200c1-8d73-4666-b1fd-db6c9e16230b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1505 microversion: 2.1 time: 0.200217 Sep 17 21:06:36.231713 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1979/3857] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:36 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1505 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:36.316662 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-643792aa-dd52-4f83-87f1-8b03fd290a0c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:36.317285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-643792aa-dd52-4f83-87f1-8b03fd290a0c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:36.324127 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-643792aa-dd52-4f83-87f1-8b03fd290a0c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:36.324622 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-643792aa-dd52-4f83-87f1-8b03fd290a0c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:36.325124 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-643792aa-dd52-4f83-87f1-8b03fd290a0c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:36.325857 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-643792aa-dd52-4f83-87f1-8b03fd290a0c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:36.326468 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-643792aa-dd52-4f83-87f1-8b03fd290a0c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:36.326940 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-643792aa-dd52-4f83-87f1-8b03fd290a0c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:36.474967 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-643792aa-dd52-4f83-87f1-8b03fd290a0c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:36.484603 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-643792aa-dd52-4f83-87f1-8b03fd290a0c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1681 microversion: 2.1 time: 0.171870 Sep 17 21:06:36.496876 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1879/3858] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:36 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:36.647097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-501200c1-8d73-4666-b1fd-db6c9e16230b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:36.648099 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-501200c1-8d73-4666-b1fd-db6c9e16230b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001366 Sep 17 21:06:36.648411 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1980/3859] 10.222.0.26 () {56 vars in 886 bytes} [Sat Sep 17 21:06:36 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 17 21:06:36.873921 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-971c3364-c21d-4cd5-a885-cf53f2eae5f2 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:36.874683 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-971c3364-c21d-4cd5-a885-cf53f2eae5f2 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: 239420ee-3593-46d6-8082-e3c0374a3db1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:36.883333 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-971c3364-c21d-4cd5-a885-cf53f2eae5f2 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:36.883941 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-971c3364-c21d-4cd5-a885-cf53f2eae5f2 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:36.884421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-971c3364-c21d-4cd5-a885-cf53f2eae5f2 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:36.885880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-971c3364-c21d-4cd5-a885-cf53f2eae5f2 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:36.886387 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-971c3364-c21d-4cd5-a885-cf53f2eae5f2 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:36.888169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-971c3364-c21d-4cd5-a885-cf53f2eae5f2 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:37.001058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0a698fe2-aa8d-42a3-a47b-d075e2b6d48a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:37.002048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0a698fe2-aa8d-42a3-a47b-d075e2b6d48a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:37.012311 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a698fe2-aa8d-42a3-a47b-d075e2b6d48a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:37.012936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a698fe2-aa8d-42a3-a47b-d075e2b6d48a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:37.013549 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a698fe2-aa8d-42a3-a47b-d075e2b6d48a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:37.015054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a698fe2-aa8d-42a3-a47b-d075e2b6d48a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:37.016340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a698fe2-aa8d-42a3-a47b-d075e2b6d48a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:37.016340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a698fe2-aa8d-42a3-a47b-d075e2b6d48a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:37.033064 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-971c3364-c21d-4cd5-a885-cf53f2eae5f2 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b19896bc4e4d14bfec46dd00519150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c307636beed407582da5779796cc6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:37.049168 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-971c3364-c21d-4cd5-a885-cf53f2eae5f2 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1" status: 200 len: 1316 microversion: 2.1 time: 0.176831 Sep 17 21:06:37.050303 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1880/3860] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:36 2022] GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1 => generated 1316 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:37.175261 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0a698fe2-aa8d-42a3-a47b-d075e2b6d48a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:37.185422 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0a698fe2-aa8d-42a3-a47b-d075e2b6d48a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1521 microversion: 2.1 time: 0.189360 Sep 17 21:06:37.186279 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1981/3861] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:36 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:37.255724 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4c04f7ed-9259-49fb-b461-fbeeda9ad9a9 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:37.257412 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4c04f7ed-9259-49fb-b461-fbeeda9ad9a9 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:37.263827 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c04f7ed-9259-49fb-b461-fbeeda9ad9a9 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:37.264429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c04f7ed-9259-49fb-b461-fbeeda9ad9a9 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:37.264947 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c04f7ed-9259-49fb-b461-fbeeda9ad9a9 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:37.266037 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c04f7ed-9259-49fb-b461-fbeeda9ad9a9 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:37.266562 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c04f7ed-9259-49fb-b461-fbeeda9ad9a9 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:37.267138 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c04f7ed-9259-49fb-b461-fbeeda9ad9a9 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:37.508762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-66769245-bbb9-49dd-b7ea-543c6ced16db tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:37.509904 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-66769245-bbb9-49dd-b7ea-543c6ced16db tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:37.516341 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66769245-bbb9-49dd-b7ea-543c6ced16db tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:37.516843 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66769245-bbb9-49dd-b7ea-543c6ced16db tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:37.517282 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66769245-bbb9-49dd-b7ea-543c6ced16db tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:37.518099 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66769245-bbb9-49dd-b7ea-543c6ced16db tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:37.518556 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66769245-bbb9-49dd-b7ea-543c6ced16db tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:37.518984 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66769245-bbb9-49dd-b7ea-543c6ced16db tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:37.852088 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4c04f7ed-9259-49fb-b461-fbeeda9ad9a9 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:37.862682 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4c04f7ed-9259-49fb-b461-fbeeda9ad9a9 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1505 microversion: 2.1 time: 0.612097 Sep 17 21:06:37.865102 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1881/3862] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:37 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1505 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:38.010916 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-66769245-bbb9-49dd-b7ea-543c6ced16db tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:38.021542 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-66769245-bbb9-49dd-b7ea-543c6ced16db tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1681 microversion: 2.1 time: 0.516769 Sep 17 21:06:38.037477 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1982/3863] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:37 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1681 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:38.080550 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-30fd5057-78ca-4618-b9f2-e56386ba261d tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:38.081291 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-30fd5057-78ca-4618-b9f2-e56386ba261d tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: 239420ee-3593-46d6-8082-e3c0374a3db1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:38.101176 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30fd5057-78ca-4618-b9f2-e56386ba261d tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:38.101727 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30fd5057-78ca-4618-b9f2-e56386ba261d tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:38.102519 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30fd5057-78ca-4618-b9f2-e56386ba261d tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:38.104116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30fd5057-78ca-4618-b9f2-e56386ba261d tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:38.104587 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30fd5057-78ca-4618-b9f2-e56386ba261d tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:38.105027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30fd5057-78ca-4618-b9f2-e56386ba261d tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:38.211272 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ae01c1cc-2d6d-4a66-9caa-c52edd4b7db3 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:38.212155 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ae01c1cc-2d6d-4a66-9caa-c52edd4b7db3 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:38.221374 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae01c1cc-2d6d-4a66-9caa-c52edd4b7db3 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:38.222061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae01c1cc-2d6d-4a66-9caa-c52edd4b7db3 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:38.222727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae01c1cc-2d6d-4a66-9caa-c52edd4b7db3 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:38.224628 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae01c1cc-2d6d-4a66-9caa-c52edd4b7db3 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:38.225901 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae01c1cc-2d6d-4a66-9caa-c52edd4b7db3 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:38.226633 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ae01c1cc-2d6d-4a66-9caa-c52edd4b7db3 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:38.423521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-30fd5057-78ca-4618-b9f2-e56386ba261d tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b19896bc4e4d14bfec46dd00519150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c307636beed407582da5779796cc6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:38.438720 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-30fd5057-78ca-4618-b9f2-e56386ba261d tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1" status: 200 len: 1316 microversion: 2.1 time: 0.367370 Sep 17 21:06:38.441576 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1882/3864] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:38 2022] GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1 => generated 1316 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:38.491291 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ae01c1cc-2d6d-4a66-9caa-c52edd4b7db3 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:38.500252 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ae01c1cc-2d6d-4a66-9caa-c52edd4b7db3 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1521 microversion: 2.1 time: 0.295189 Sep 17 21:06:38.500926 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1983/3865] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:38 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:38.887541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-432b59e8-77ff-4f47-b942-06c64fec5084 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:38.888389 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-432b59e8-77ff-4f47-b942-06c64fec5084 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:38.896283 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-432b59e8-77ff-4f47-b942-06c64fec5084 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:38.896771 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-432b59e8-77ff-4f47-b942-06c64fec5084 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:38.897198 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-432b59e8-77ff-4f47-b942-06c64fec5084 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:38.897930 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-432b59e8-77ff-4f47-b942-06c64fec5084 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:38.898597 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-432b59e8-77ff-4f47-b942-06c64fec5084 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:38.899022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-432b59e8-77ff-4f47-b942-06c64fec5084 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:39.030796 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-432b59e8-77ff-4f47-b942-06c64fec5084 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:39.039655 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-432b59e8-77ff-4f47-b942-06c64fec5084 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1505 microversion: 2.1 time: 0.156055 Sep 17 21:06:39.040386 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1883/3866] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:38 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:39.051176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-57d0b249-a826-4fb9-95d8-0a54942a6a74 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:39.051851 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-57d0b249-a826-4fb9-95d8-0a54942a6a74 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:39.058090 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57d0b249-a826-4fb9-95d8-0a54942a6a74 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:39.058582 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57d0b249-a826-4fb9-95d8-0a54942a6a74 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:39.059024 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57d0b249-a826-4fb9-95d8-0a54942a6a74 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:39.059760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57d0b249-a826-4fb9-95d8-0a54942a6a74 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:39.060227 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57d0b249-a826-4fb9-95d8-0a54942a6a74 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:39.060649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57d0b249-a826-4fb9-95d8-0a54942a6a74 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:39.196877 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-57d0b249-a826-4fb9-95d8-0a54942a6a74 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:39.205426 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-57d0b249-a826-4fb9-95d8-0a54942a6a74 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1681 microversion: 2.1 time: 0.164819 Sep 17 21:06:39.206698 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1984/3867] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:39 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:39.467427 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-89f07fba-c639-4617-abfd-e2ee4e17cb72 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:39.468025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-89f07fba-c639-4617-abfd-e2ee4e17cb72 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: 239420ee-3593-46d6-8082-e3c0374a3db1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:39.475919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89f07fba-c639-4617-abfd-e2ee4e17cb72 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:39.476421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89f07fba-c639-4617-abfd-e2ee4e17cb72 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:39.476865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89f07fba-c639-4617-abfd-e2ee4e17cb72 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:39.479338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89f07fba-c639-4617-abfd-e2ee4e17cb72 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:39.480021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89f07fba-c639-4617-abfd-e2ee4e17cb72 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:39.481336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89f07fba-c639-4617-abfd-e2ee4e17cb72 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:39.525326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c116e279-29b0-4c46-b519-74009604ef70 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:39.526402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c116e279-29b0-4c46-b519-74009604ef70 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:39.539972 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c116e279-29b0-4c46-b519-74009604ef70 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:39.540479 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c116e279-29b0-4c46-b519-74009604ef70 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:39.540928 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c116e279-29b0-4c46-b519-74009604ef70 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:39.541674 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c116e279-29b0-4c46-b519-74009604ef70 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:39.542132 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c116e279-29b0-4c46-b519-74009604ef70 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:39.542585 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c116e279-29b0-4c46-b519-74009604ef70 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:39.748519 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-89f07fba-c639-4617-abfd-e2ee4e17cb72 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b19896bc4e4d14bfec46dd00519150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c307636beed407582da5779796cc6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:39.764028 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-89f07fba-c639-4617-abfd-e2ee4e17cb72 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1" status: 200 len: 1316 microversion: 2.1 time: 0.300430 Sep 17 21:06:39.765507 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1884/3868] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:39 2022] GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1 => generated 1316 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:39.777877 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c116e279-29b0-4c46-b519-74009604ef70 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:39.787458 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c116e279-29b0-4c46-b519-74009604ef70 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1521 microversion: 2.1 time: 0.267000 Sep 17 21:06:39.788163 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1985/3869] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:39 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:40.062671 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-23d29fd4-cc75-4e71-b4a4-57d8c152b027 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:40.063366 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-23d29fd4-cc75-4e71-b4a4-57d8c152b027 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:40.070809 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-23d29fd4-cc75-4e71-b4a4-57d8c152b027 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:40.071387 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-23d29fd4-cc75-4e71-b4a4-57d8c152b027 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:40.071870 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-23d29fd4-cc75-4e71-b4a4-57d8c152b027 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:40.072723 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-23d29fd4-cc75-4e71-b4a4-57d8c152b027 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:40.073374 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-23d29fd4-cc75-4e71-b4a4-57d8c152b027 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:40.073682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-23d29fd4-cc75-4e71-b4a4-57d8c152b027 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:40.230506 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-23d29fd4-cc75-4e71-b4a4-57d8c152b027 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:40.236950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ff4ea507-fcd0-4086-bdb1-9da4b101fa6e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:40.237952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ff4ea507-fcd0-4086-bdb1-9da4b101fa6e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:40.239919 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-23d29fd4-cc75-4e71-b4a4-57d8c152b027 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1505 microversion: 2.1 time: 0.181182 Sep 17 21:06:40.240670 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1885/3870] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:40 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1505 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:40.241407 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=4 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:40.242510 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=8 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:40.250331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff4ea507-fcd0-4086-bdb1-9da4b101fa6e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:40.251374 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff4ea507-fcd0-4086-bdb1-9da4b101fa6e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:40.252411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff4ea507-fcd0-4086-bdb1-9da4b101fa6e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:40.253144 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff4ea507-fcd0-4086-bdb1-9da4b101fa6e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:40.253646 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff4ea507-fcd0-4086-bdb1-9da4b101fa6e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:40.254093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff4ea507-fcd0-4086-bdb1-9da4b101fa6e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:40.391202 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ff4ea507-fcd0-4086-bdb1-9da4b101fa6e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:40.399177 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ff4ea507-fcd0-4086-bdb1-9da4b101fa6e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1681 microversion: 2.1 time: 0.169708 Sep 17 21:06:40.399716 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1986/3871] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:40 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:40.787307 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-585b3ee3-8a3b-47cd-878e-a020b166d6f7 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:40.787939 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-585b3ee3-8a3b-47cd-878e-a020b166d6f7 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: 239420ee-3593-46d6-8082-e3c0374a3db1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:40.792145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=10 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:40.796317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-585b3ee3-8a3b-47cd-878e-a020b166d6f7 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:40.796787 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-585b3ee3-8a3b-47cd-878e-a020b166d6f7 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:40.797583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-585b3ee3-8a3b-47cd-878e-a020b166d6f7 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:40.798518 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-585b3ee3-8a3b-47cd-878e-a020b166d6f7 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:40.799143 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-585b3ee3-8a3b-47cd-878e-a020b166d6f7 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:40.799582 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-585b3ee3-8a3b-47cd-878e-a020b166d6f7 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:40.810763 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-42f43a79-924a-4cfe-86fc-482ff7dfbca3 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:40.811384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-42f43a79-924a-4cfe-86fc-482ff7dfbca3 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:40.820998 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42f43a79-924a-4cfe-86fc-482ff7dfbca3 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:40.821520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42f43a79-924a-4cfe-86fc-482ff7dfbca3 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:40.821968 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42f43a79-924a-4cfe-86fc-482ff7dfbca3 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:40.822690 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42f43a79-924a-4cfe-86fc-482ff7dfbca3 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:40.825671 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42f43a79-924a-4cfe-86fc-482ff7dfbca3 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:40.826431 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42f43a79-924a-4cfe-86fc-482ff7dfbca3 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:41.092055 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-585b3ee3-8a3b-47cd-878e-a020b166d6f7 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b19896bc4e4d14bfec46dd00519150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c307636beed407582da5779796cc6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:41.095095 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-42f43a79-924a-4cfe-86fc-482ff7dfbca3 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:41.103423 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-585b3ee3-8a3b-47cd-878e-a020b166d6f7 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1" status: 200 len: 1316 microversion: 2.1 time: 0.319854 Sep 17 21:06:41.103693 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-42f43a79-924a-4cfe-86fc-482ff7dfbca3 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1521 microversion: 2.1 time: 0.296755 Sep 17 21:06:41.104297 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1987/3872] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:40 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:41.126882 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1886/3873] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:40 2022] GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1 => generated 1316 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:41.264807 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-32da3878-9087-445a-bce7-f59ee4fcc418 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:41.266016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-32da3878-9087-445a-bce7-f59ee4fcc418 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:41.276439 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32da3878-9087-445a-bce7-f59ee4fcc418 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:41.276948 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32da3878-9087-445a-bce7-f59ee4fcc418 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:41.277395 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32da3878-9087-445a-bce7-f59ee4fcc418 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:41.278130 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32da3878-9087-445a-bce7-f59ee4fcc418 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:41.279658 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32da3878-9087-445a-bce7-f59ee4fcc418 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:41.280090 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32da3878-9087-445a-bce7-f59ee4fcc418 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:41.432394 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a5ba9bc2-c82c-4bea-bb0b-c969fcd5d13b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:41.433418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a5ba9bc2-c82c-4bea-bb0b-c969fcd5d13b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:41.447710 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a5ba9bc2-c82c-4bea-bb0b-c969fcd5d13b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:41.449293 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a5ba9bc2-c82c-4bea-bb0b-c969fcd5d13b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:41.450877 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a5ba9bc2-c82c-4bea-bb0b-c969fcd5d13b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:41.452707 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a5ba9bc2-c82c-4bea-bb0b-c969fcd5d13b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:41.453425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a5ba9bc2-c82c-4bea-bb0b-c969fcd5d13b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:41.455525 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a5ba9bc2-c82c-4bea-bb0b-c969fcd5d13b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:41.477093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-32da3878-9087-445a-bce7-f59ee4fcc418 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:41.491043 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-32da3878-9087-445a-bce7-f59ee4fcc418 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1505 microversion: 2.1 time: 0.230876 Sep 17 21:06:41.491636 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1988/3874] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:41 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1505 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:41.496304 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-1f176fc5-8e73-4594-a8ce-28a4d1b0ba81 req-b7c4f112-4b2f-4ea0-bbb1-438b582dec1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "239420ee-3593-46d6-8082-e3c0374a3db1", "name": "network-vif-plugged", "status": "completed", "tag": "57a9ed75-fff3-45ef-a015-62f3f2a2d525"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:41.531407 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-1f176fc5-8e73-4594-a8ce-28a4d1b0ba81 req-b7c4f112-4b2f-4ea0-bbb1-438b582dec1f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:41.532783 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-1f176fc5-8e73-4594-a8ce-28a4d1b0ba81 req-b7c4f112-4b2f-4ea0-bbb1-438b582dec1f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:41.535545 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-1f176fc5-8e73-4594-a8ce-28a4d1b0ba81 req-b7c4f112-4b2f-4ea0-bbb1-438b582dec1f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:41.564850 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-1f176fc5-8e73-4594-a8ce-28a4d1b0ba81 req-b7c4f112-4b2f-4ea0-bbb1-438b582dec1f service nova] Creating event network-vif-plugged:57a9ed75-fff3-45ef-a015-62f3f2a2d525 for instance 239420ee-3593-46d6-8082-e3c0374a3db1 on nch2-master-1 Sep 17 21:06:41.573656 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-1f176fc5-8e73-4594-a8ce-28a4d1b0ba81 req-b7c4f112-4b2f-4ea0-bbb1-438b582dec1f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080547 Sep 17 21:06:41.574547 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1989/3875] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:41.642471 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a5ba9bc2-c82c-4bea-bb0b-c969fcd5d13b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:41.653026 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a5ba9bc2-c82c-4bea-bb0b-c969fcd5d13b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1681 microversion: 2.1 time: 0.233570 Sep 17 21:06:41.654071 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1887/3876] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:41 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1681 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:42.136676 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a6b1454b-2841-4950-b9b3-011d253eeac4 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:42.137968 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a6b1454b-2841-4950-b9b3-011d253eeac4 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:42.145273 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6b1454b-2841-4950-b9b3-011d253eeac4 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:42.145961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6b1454b-2841-4950-b9b3-011d253eeac4 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:42.146551 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6b1454b-2841-4950-b9b3-011d253eeac4 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:42.147371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6b1454b-2841-4950-b9b3-011d253eeac4 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:42.148214 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6b1454b-2841-4950-b9b3-011d253eeac4 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:42.148738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6b1454b-2841-4950-b9b3-011d253eeac4 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:42.150005 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1354f5f2-c774-42bf-9a22-08eeced323ee tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:42.152204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1354f5f2-c774-42bf-9a22-08eeced323ee tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: 239420ee-3593-46d6-8082-e3c0374a3db1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:42.159511 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1354f5f2-c774-42bf-9a22-08eeced323ee tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:42.160924 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1354f5f2-c774-42bf-9a22-08eeced323ee tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:42.161594 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1354f5f2-c774-42bf-9a22-08eeced323ee tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:42.162515 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1354f5f2-c774-42bf-9a22-08eeced323ee tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:42.163145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1354f5f2-c774-42bf-9a22-08eeced323ee tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:42.164068 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1354f5f2-c774-42bf-9a22-08eeced323ee tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:42.400063 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a6b1454b-2841-4950-b9b3-011d253eeac4 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:42.410285 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a6b1454b-2841-4950-b9b3-011d253eeac4 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1521 microversion: 2.1 time: 0.281551 Sep 17 21:06:42.411692 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1990/3877] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:42 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:42.430569 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1354f5f2-c774-42bf-9a22-08eeced323ee tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b19896bc4e4d14bfec46dd00519150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c307636beed407582da5779796cc6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:42.439444 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1354f5f2-c774-42bf-9a22-08eeced323ee tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1" status: 200 len: 1316 microversion: 2.1 time: 0.293444 Sep 17 21:06:42.440231 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1888/3878] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:42 2022] GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1 => generated 1316 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:42.520812 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d8bec315-5823-414c-a6c8-6ae3b1552e0e tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:42.521593 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d8bec315-5823-414c-a6c8-6ae3b1552e0e tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:42.528432 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d8bec315-5823-414c-a6c8-6ae3b1552e0e tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:42.529050 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d8bec315-5823-414c-a6c8-6ae3b1552e0e tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:42.529519 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d8bec315-5823-414c-a6c8-6ae3b1552e0e tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:42.530241 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d8bec315-5823-414c-a6c8-6ae3b1552e0e tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:42.530705 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d8bec315-5823-414c-a6c8-6ae3b1552e0e tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:42.531131 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d8bec315-5823-414c-a6c8-6ae3b1552e0e tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:42.678688 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f988eba3-055b-4d26-85c5-c6093bac301c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:42.679627 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f988eba3-055b-4d26-85c5-c6093bac301c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:42.690000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f988eba3-055b-4d26-85c5-c6093bac301c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:42.703975 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d8bec315-5823-414c-a6c8-6ae3b1552e0e tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:42.707799 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f988eba3-055b-4d26-85c5-c6093bac301c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:42.708496 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f988eba3-055b-4d26-85c5-c6093bac301c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:42.710813 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f988eba3-055b-4d26-85c5-c6093bac301c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:42.711522 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f988eba3-055b-4d26-85c5-c6093bac301c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:42.712562 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d8bec315-5823-414c-a6c8-6ae3b1552e0e tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1505 microversion: 2.1 time: 0.196013 Sep 17 21:06:42.713051 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f988eba3-055b-4d26-85c5-c6093bac301c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:42.713365 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1991/3879] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:42 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1505 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:42.888395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f988eba3-055b-4d26-85c5-c6093bac301c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:42.897372 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f988eba3-055b-4d26-85c5-c6093bac301c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1658 microversion: 2.1 time: 0.223505 Sep 17 21:06:42.898329 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1889/3880] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:42 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1658 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:42.921237 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-85f79c1b-8dd5-409c-886c-d69b18c26a88 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:42.928836 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85f79c1b-8dd5-409c-886c-d69b18c26a88 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:42.929658 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85f79c1b-8dd5-409c-886c-d69b18c26a88 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:42.930683 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85f79c1b-8dd5-409c-886c-d69b18c26a88 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:42.935457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:42.963955 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-85f79c1b-8dd5-409c-886c-d69b18c26a88 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Going to try to start instance {{(pid=140524) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 17 21:06:43.024479 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-85f79c1b-8dd5-409c-886c-d69b18c26a88 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action" status: 202 len: 0 microversion: 2.1 time: 0.107100 Sep 17 21:06:43.037651 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1992/3881] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:06:42 2022] POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:06:43.044363 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fd0448b4-1079-49f5-81ad-d481624fcb6f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:43.045370 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fd0448b4-1079-49f5-81ad-d481624fcb6f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:43.053369 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd0448b4-1079-49f5-81ad-d481624fcb6f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:43.053886 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd0448b4-1079-49f5-81ad-d481624fcb6f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:43.055104 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd0448b4-1079-49f5-81ad-d481624fcb6f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:43.056138 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd0448b4-1079-49f5-81ad-d481624fcb6f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:43.056693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd0448b4-1079-49f5-81ad-d481624fcb6f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:43.057263 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd0448b4-1079-49f5-81ad-d481624fcb6f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:43.342203 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fd0448b4-1079-49f5-81ad-d481624fcb6f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:43.352977 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fd0448b4-1079-49f5-81ad-d481624fcb6f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1667 microversion: 2.1 time: 0.322302 Sep 17 21:06:43.353613 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1890/3882] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:43 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1667 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:43.437133 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-10fa6ac1-e588-447c-b55b-60e138cf637f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:43.438036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-10fa6ac1-e588-447c-b55b-60e138cf637f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:43.447872 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10fa6ac1-e588-447c-b55b-60e138cf637f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:43.450443 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10fa6ac1-e588-447c-b55b-60e138cf637f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:43.453711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10fa6ac1-e588-447c-b55b-60e138cf637f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:43.462537 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cd3869b4-587a-4720-8ec8-07a07813f547 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:43.463160 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cd3869b4-587a-4720-8ec8-07a07813f547 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: 239420ee-3593-46d6-8082-e3c0374a3db1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:43.468685 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10fa6ac1-e588-447c-b55b-60e138cf637f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:43.469689 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10fa6ac1-e588-447c-b55b-60e138cf637f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:43.471627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10fa6ac1-e588-447c-b55b-60e138cf637f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:43.479481 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd3869b4-587a-4720-8ec8-07a07813f547 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:43.480246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd3869b4-587a-4720-8ec8-07a07813f547 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:43.480863 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd3869b4-587a-4720-8ec8-07a07813f547 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:43.481809 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd3869b4-587a-4720-8ec8-07a07813f547 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:43.482503 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd3869b4-587a-4720-8ec8-07a07813f547 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:43.483107 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd3869b4-587a-4720-8ec8-07a07813f547 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:43.864298 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cd3869b4-587a-4720-8ec8-07a07813f547 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b19896bc4e4d14bfec46dd00519150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c307636beed407582da5779796cc6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:43.876492 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-10fa6ac1-e588-447c-b55b-60e138cf637f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:43.878053 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cd3869b4-587a-4720-8ec8-07a07813f547 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1" status: 200 len: 1505 microversion: 2.1 time: 0.419206 Sep 17 21:06:43.880071 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1891/3883] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:43 2022] GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1 => generated 1505 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:43.885369 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c27d1748-5aa4-446a-867e-064f61ca4cc6 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:43.886450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c27d1748-5aa4-446a-867e-064f61ca4cc6 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:43.892810 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-10fa6ac1-e588-447c-b55b-60e138cf637f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1501 microversion: 2.1 time: 0.459127 Sep 17 21:06:43.894446 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c27d1748-5aa4-446a-867e-064f61ca4cc6 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:43.895119 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c27d1748-5aa4-446a-867e-064f61ca4cc6 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:43.895740 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c27d1748-5aa4-446a-867e-064f61ca4cc6 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:43.896790 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1993/3884] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:43 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1501 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:43.896918 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c27d1748-5aa4-446a-867e-064f61ca4cc6 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:43.897867 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c27d1748-5aa4-446a-867e-064f61ca4cc6 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:43.898508 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c27d1748-5aa4-446a-867e-064f61ca4cc6 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:43.910810 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d2f9f5bd-87c2-4e20-a95a-aea17dde8a5e tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-156105942"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:43.914807 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d2f9f5bd-87c2-4e20-a95a-aea17dde8a5e tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: 239420ee-3593-46d6-8082-e3c0374a3db1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:43.920685 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:43.928419 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d2f9f5bd-87c2-4e20-a95a-aea17dde8a5e tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:43.928932 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d2f9f5bd-87c2-4e20-a95a-aea17dde8a5e tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:43.932844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d2f9f5bd-87c2-4e20-a95a-aea17dde8a5e tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:43.934724 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d2f9f5bd-87c2-4e20-a95a-aea17dde8a5e tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:43.936201 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d2f9f5bd-87c2-4e20-a95a-aea17dde8a5e tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:43.938308 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d2f9f5bd-87c2-4e20-a95a-aea17dde8a5e tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:44.238408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c27d1748-5aa4-446a-867e-064f61ca4cc6 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:44.240753 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.network.security_group_api [None req-d2f9f5bd-87c2-4e20-a95a-aea17dde8a5e tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Adding security group ba684ac0-6c05-44af-b18a-53841f44e6cb to port 57a9ed75-fff3-45ef-a015-62f3f2a2d525 Sep 17 21:06:44.252376 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c27d1748-5aa4-446a-867e-064f61ca4cc6 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1505 microversion: 2.1 time: 0.370878 Sep 17 21:06:44.253001 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1892/3885] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:43 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1505 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:44.259045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-48eaa0e6-3621-4adf-9d4f-2563fc6b7d34 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:44.259609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-48eaa0e6-3621-4adf-9d4f-2563fc6b7d34 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:44.266942 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-48eaa0e6-3621-4adf-9d4f-2563fc6b7d34 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:44.267753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-48eaa0e6-3621-4adf-9d4f-2563fc6b7d34 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:44.268364 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-48eaa0e6-3621-4adf-9d4f-2563fc6b7d34 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:44.269559 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-48eaa0e6-3621-4adf-9d4f-2563fc6b7d34 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:44.270400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-48eaa0e6-3621-4adf-9d4f-2563fc6b7d34 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:44.271918 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-48eaa0e6-3621-4adf-9d4f-2563fc6b7d34 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:44.546786 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-48eaa0e6-3621-4adf-9d4f-2563fc6b7d34 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:44.554575 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-48eaa0e6-3621-4adf-9d4f-2563fc6b7d34 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d" status: 200 len: 1514 microversion: 2.1 time: 0.300322 Sep 17 21:06:44.555593 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1893/3886] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:44 2022] GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d => generated 1514 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:44.560391 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0d9cc865-d262-48ea-b9d9-10f00e0c8051 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:44.561047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0d9cc865-d262-48ea-b9d9-10f00e0c8051 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:44.567245 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d9cc865-d262-48ea-b9d9-10f00e0c8051 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:44.567977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d9cc865-d262-48ea-b9d9-10f00e0c8051 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:44.568626 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d9cc865-d262-48ea-b9d9-10f00e0c8051 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:44.569578 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d9cc865-d262-48ea-b9d9-10f00e0c8051 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:44.570245 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d9cc865-d262-48ea-b9d9-10f00e0c8051 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:44.570879 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d9cc865-d262-48ea-b9d9-10f00e0c8051 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:44.841169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0d9cc865-d262-48ea-b9d9-10f00e0c8051 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:44.883678 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0d9cc865-d262-48ea-b9d9-10f00e0c8051 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1667 microversion: 2.1 time: 0.326766 Sep 17 21:06:44.889502 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d2f9f5bd-87c2-4e20-a95a-aea17dde8a5e tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "POST /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1/action" status: 202 len: 0 microversion: 2.1 time: 0.984672 Sep 17 21:06:44.894560 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1994/3887] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:06:43 2022] POST /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1/action => generated 0 bytes in 991 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:06:44.899898 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1894/3888] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:44 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1667 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:44.902991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-92c22661-eb98-4362-8f05-f6b454267728 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:44.908380 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-92c22661-eb98-4362-8f05-f6b454267728 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: e54a97d4-2e38-4f20-9c72-c5859c1b3bac] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:44.912546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3e063c88-1bc7-404d-b620-c0220bf037ad tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '.version_select at 0x7f25a4748af0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:44.916842 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-92c22661-eb98-4362-8f05-f6b454267728 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] HTTP exception thrown: Instance e54a97d4-2e38-4f20-9c72-c5859c1b3bac could not be found. Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-92c22661-eb98-4362-8f05-f6b454267728 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Request method failure captured: Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers/e54a97d4-2e38-4f20-9c72-c5859c1b3bac/action HTTP/1.1 Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 14 Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjaiOOC2XD-QIsLuDvG9bxN3jnLjmueVdk28NKERipgg7mZAUnmkYYkUcMWYkcsUdzUwALfMrwKYbIvTbrUxBdv7HTTnMRjY98z2HSanC8PyMI0Bvd8_fsMNUR8WwzuWwOyttA6z4v7owoNPIa2XeOfidHHD5bq9m_itbcIiBCzoH1A Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: f8ed24e4bf6643f7b1474fcec78c4995 Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-533169750 Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ed24e4bf6643f7b1474fcec78c4995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f8ed24e4bf6643f7b1474fcec78c4995"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ed24e4bf6643f7b1474fcec78c4995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f8ed24e4bf6643f7b1474fcec78c4995", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerRescueNegativeTestJSON-533169750 Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: f8ed24e4bf6643f7b1474fcec78c4995 Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-533169750 Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerRescueNegativeTestJSON-533169750-project Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 795813bb461e42ad8c2a758e9b8430d6 Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerRescueNegativeTestJSON-533169750-project Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: {"rescue": {}} Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance e54a97d4-2e38-4f20-9c72-c5859c1b3bac could not be found. Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'e54a97d4-2e38-4f20-9c72-c5859c1b3bac', 'body': {'rescue': {}}} Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e54a97d4-2e38-4f20-9c72-c5859c1b3bac could not be found. Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e54a97d4-2e38-4f20-9c72-c5859c1b3bac could not be found. Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:44.952825 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:44.962292 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:44.962292 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:44.962292 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:06:44.962292 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:06:44.962292 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e54a97d4-2e38-4f20-9c72-c5859c1b3bac could not be found. Sep 17 21:06:44.962292 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:44.964550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-92c22661-eb98-4362-8f05-f6b454267728 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Returning 404 to user: Instance e54a97d4-2e38-4f20-9c72-c5859c1b3bac could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:06:44.965764 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-92c22661-eb98-4362-8f05-f6b454267728 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "POST /compute/v2.1/servers/e54a97d4-2e38-4f20-9c72-c5859c1b3bac/action" status: 404 len: 111 microversion: 2.1 time: 0.070100 Sep 17 21:06:44.966569 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1995/3889] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:06:44 2022] POST /compute/v2.1/servers/e54a97d4-2e38-4f20-9c72-c5859c1b3bac/action => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:06:44.981551 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-98682c47-d95c-429e-a994-1a1c464cdb03 req-8d869299-131f-4d09-8757-9339cdc850c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "239420ee-3593-46d6-8082-e3c0374a3db1", "tag": "57a9ed75-fff3-45ef-a015-62f3f2a2d525"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:45.007949 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-98682c47-d95c-429e-a994-1a1c464cdb03 req-8d869299-131f-4d09-8757-9339cdc850c2 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:45.008814 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-98682c47-d95c-429e-a994-1a1c464cdb03 req-8d869299-131f-4d09-8757-9339cdc850c2 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:45.010215 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-98682c47-d95c-429e-a994-1a1c464cdb03 req-8d869299-131f-4d09-8757-9339cdc850c2 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:45.041765 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-98682c47-d95c-429e-a994-1a1c464cdb03 req-8d869299-131f-4d09-8757-9339cdc850c2 service nova] Creating event network-changed:57a9ed75-fff3-45ef-a015-62f3f2a2d525 for instance 239420ee-3593-46d6-8082-e3c0374a3db1 on nch2-master-1 Sep 17 21:06:45.050412 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-98682c47-d95c-429e-a994-1a1c464cdb03 req-8d869299-131f-4d09-8757-9339cdc850c2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075225 Sep 17 21:06:45.055084 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1996/3890] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:45.066033 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-87bb196e-cd26-4791-a50d-df9de5ddb2c1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:45.067025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-87bb196e-cd26-4791-a50d-df9de5ddb2c1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:45.093696 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87bb196e-cd26-4791-a50d-df9de5ddb2c1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:45.094295 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87bb196e-cd26-4791-a50d-df9de5ddb2c1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:45.094779 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87bb196e-cd26-4791-a50d-df9de5ddb2c1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:45.095932 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87bb196e-cd26-4791-a50d-df9de5ddb2c1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:45.096399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87bb196e-cd26-4791-a50d-df9de5ddb2c1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:45.096867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87bb196e-cd26-4791-a50d-df9de5ddb2c1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:45.203365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG neutronclient.v2_0.client [None req-3e063c88-1bc7-404d-b620-c0220bf037ad tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group ba684ac0-6c05-44af-b18a-53841f44e6cb in use.", "detail": ""}} {{(pid=140523) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 17 21:06:45.205170 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-3e063c88-1bc7-404d-b620-c0220bf037ad tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] HTTP exception thrown: Security Group ba684ac0-6c05-44af-b18a-53841f44e6cb in use. Sep 17 21:06:45.205170 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-242b8495-cca8-4862-8c31-d7a9cdf4ad0e'] Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3e063c88-1bc7-404d-b620-c0220bf037ad tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Request method failure captured: Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/os-security-groups/ba684ac0-6c05-44af-b18a-53841f44e6cb HTTP/1.1 Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjagzzYrrTodN4FRISubmKjZ26J-8BGxkNzLU7x20a3MCWENMarIDjJ9bOlqCettGyQPm3qYerTfS4mUFkwcpl7RJrNB079yuTWGsg7iyYHjYrTBkjIt8CtBBLGQxaQp-7J70wULL21t1iBESs97Rxk-MKHrjWOPMZFqMTCeWGgBIAQ Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 1c307636beed407582da5779796cc6a7 Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c307636beed407582da5779796cc6a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c307636beed407582da5779796cc6a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c307636beed407582da5779796cc6a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c307636beed407582da5779796cc6a7", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 1c307636beed407582da5779796cc6a7 Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-SecurityGroupsTestJSON-1804220727-project Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 30b19896bc4e4d14bfec46dd00519150 Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-SecurityGroupsTestJSON-1804220727-project Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: exception: Security Group ba684ac0-6c05-44af-b18a-53841f44e6cb in use. Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-242b8495-cca8-4862-8c31-d7a9cdf4ad0e'] Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'ba684ac0-6c05-44af-b18a-53841f44e6cb'} Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 17 21:06:45.212572 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group ba684ac0-6c05-44af-b18a-53841f44e6cb in use. Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-242b8495-cca8-4862-8c31-d7a9cdf4ad0e'] Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group ba684ac0-6c05-44af-b18a-53841f44e6cb in use. Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-242b8495-cca8-4862-8c31-d7a9cdf4ad0e'] Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group ba684ac0-6c05-44af-b18a-53841f44e6cb in use. Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-242b8495-cca8-4862-8c31-d7a9cdf4ad0e'] Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group ba684ac0-6c05-44af-b18a-53841f44e6cb in use. Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-242b8495-cca8-4862-8c31-d7a9cdf4ad0e'] Sep 17 21:06:45.219162 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:45.236507 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3e063c88-1bc7-404d-b620-c0220bf037ad tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Returning 400 to user: Security Group ba684ac0-6c05-44af-b18a-53841f44e6cb in use. Sep 17 21:06:45.236507 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-242b8495-cca8-4862-8c31-d7a9cdf4ad0e'] {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:06:45.238196 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3e063c88-1bc7-404d-b620-c0220bf037ad tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/ba684ac0-6c05-44af-b18a-53841f44e6cb" status: 400 len: 185 microversion: 2.1 time: 0.333555 Sep 17 21:06:45.239061 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1895/3891] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 21:06:44 2022] DELETE /compute/v2.1/os-security-groups/ba684ac0-6c05-44af-b18a-53841f44e6cb => generated 185 bytes in 339 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:06:45.242885 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-87bb196e-cd26-4791-a50d-df9de5ddb2c1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "POST /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d/action" status: 202 len: 0 microversion: 2.1 time: 0.185869 Sep 17 21:06:45.247914 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1997/3892] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:06:45 2022] POST /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:06:45.261434 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6743b57e-0760-4cdb-85c2-c042c9806ccd tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:45.263139 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-30c40a29-f290-4153-9093-527db42dc70f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:45.267836 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-30c40a29-f290-4153-9093-527db42dc70f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:45.277880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6743b57e-0760-4cdb-85c2-c042c9806ccd tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: 239420ee-3593-46d6-8082-e3c0374a3db1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:45.287592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-30c40a29-f290-4153-9093-527db42dc70f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:45.288104 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-30c40a29-f290-4153-9093-527db42dc70f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:45.288552 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-30c40a29-f290-4153-9093-527db42dc70f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:45.293593 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-30c40a29-f290-4153-9093-527db42dc70f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:45.294013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-30c40a29-f290-4153-9093-527db42dc70f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:45.294458 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-30c40a29-f290-4153-9093-527db42dc70f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:45.308384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6743b57e-0760-4cdb-85c2-c042c9806ccd tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:45.309339 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6743b57e-0760-4cdb-85c2-c042c9806ccd tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:45.313226 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6743b57e-0760-4cdb-85c2-c042c9806ccd tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:45.314749 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6743b57e-0760-4cdb-85c2-c042c9806ccd tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:45.315488 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6743b57e-0760-4cdb-85c2-c042c9806ccd tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:45.317584 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6743b57e-0760-4cdb-85c2-c042c9806ccd tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:45.485564 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6743b57e-0760-4cdb-85c2-c042c9806ccd tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "POST /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1/action" status: 202 len: 0 microversion: 2.1 time: 0.241030 Sep 17 21:06:45.486286 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1896/3893] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:06:45 2022] POST /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:06:45.494314 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-662a1d50-770f-4f3a-90ca-45c6809b2f22 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:45.495711 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-662a1d50-770f-4f3a-90ca-45c6809b2f22 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:45.503099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-662a1d50-770f-4f3a-90ca-45c6809b2f22 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:45.503697 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-662a1d50-770f-4f3a-90ca-45c6809b2f22 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:45.504629 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-662a1d50-770f-4f3a-90ca-45c6809b2f22 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:45.505428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-662a1d50-770f-4f3a-90ca-45c6809b2f22 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:45.506079 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-662a1d50-770f-4f3a-90ca-45c6809b2f22 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:45.506843 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-662a1d50-770f-4f3a-90ca-45c6809b2f22 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:45.681379 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-30c40a29-f290-4153-9093-527db42dc70f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:45.689443 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-30c40a29-f290-4153-9093-527db42dc70f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d" status: 200 len: 1519 microversion: 2.1 time: 0.437404 Sep 17 21:06:45.690269 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1998/3894] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:45 2022] GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d => generated 1519 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:45.695052 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2091a758-3d5b-44db-a190-d40440826d29 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:45.695868 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2091a758-3d5b-44db-a190-d40440826d29 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: 239420ee-3593-46d6-8082-e3c0374a3db1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:45.702804 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2091a758-3d5b-44db-a190-d40440826d29 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:45.703479 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2091a758-3d5b-44db-a190-d40440826d29 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:45.704105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2091a758-3d5b-44db-a190-d40440826d29 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:45.705046 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2091a758-3d5b-44db-a190-d40440826d29 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:45.705709 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2091a758-3d5b-44db-a190-d40440826d29 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:45.706142 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2091a758-3d5b-44db-a190-d40440826d29 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:45.845084 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-662a1d50-770f-4f3a-90ca-45c6809b2f22 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:45.859144 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-662a1d50-770f-4f3a-90ca-45c6809b2f22 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1505 microversion: 2.1 time: 0.371474 Sep 17 21:06:45.864576 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1897/3895] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:45 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1505 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:45.913921 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bf69e892-da8d-4020-b1f6-bc7aa91246e5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:45.915944 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bf69e892-da8d-4020-b1f6-bc7aa91246e5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:45.925247 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf69e892-da8d-4020-b1f6-bc7aa91246e5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:45.926563 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf69e892-da8d-4020-b1f6-bc7aa91246e5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:45.927646 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf69e892-da8d-4020-b1f6-bc7aa91246e5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:45.928653 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf69e892-da8d-4020-b1f6-bc7aa91246e5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:45.929077 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf69e892-da8d-4020-b1f6-bc7aa91246e5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:45.929766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf69e892-da8d-4020-b1f6-bc7aa91246e5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:46.114642 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2091a758-3d5b-44db-a190-d40440826d29 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b19896bc4e4d14bfec46dd00519150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c307636beed407582da5779796cc6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:46.127946 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2091a758-3d5b-44db-a190-d40440826d29 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1" status: 200 len: 1575 microversion: 2.1 time: 0.435927 Sep 17 21:06:46.129047 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 1999/3896] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:45 2022] GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1 => generated 1575 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:46.165656 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bf69e892-da8d-4020-b1f6-bc7aa91246e5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:46.175408 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bf69e892-da8d-4020-b1f6-bc7aa91246e5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.267344 Sep 17 21:06:46.189485 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1898/3897] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:45 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:46.201899 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-57e57efa-da92-4027-b586-8c5696f3607d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:46.202905 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-57e57efa-da92-4027-b586-8c5696f3607d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:46.210093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57e57efa-da92-4027-b586-8c5696f3607d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:46.210672 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57e57efa-da92-4027-b586-8c5696f3607d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:46.211322 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57e57efa-da92-4027-b586-8c5696f3607d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:46.213286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57e57efa-da92-4027-b586-8c5696f3607d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:46.213286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57e57efa-da92-4027-b586-8c5696f3607d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:46.213286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57e57efa-da92-4027-b586-8c5696f3607d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:46.464432 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-57e57efa-da92-4027-b586-8c5696f3607d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:46.477663 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-57e57efa-da92-4027-b586-8c5696f3607d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.282361 Sep 17 21:06:46.479080 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2000/3898] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:46 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:46.500466 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2762c226-ff84-4f7c-ac37-51cd02b044c9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:46.501257 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2762c226-ff84-4f7c-ac37-51cd02b044c9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:46.508487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2762c226-ff84-4f7c-ac37-51cd02b044c9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:46.508980 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2762c226-ff84-4f7c-ac37-51cd02b044c9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:46.509426 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2762c226-ff84-4f7c-ac37-51cd02b044c9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:46.510170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2762c226-ff84-4f7c-ac37-51cd02b044c9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:46.510628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2762c226-ff84-4f7c-ac37-51cd02b044c9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:46.511054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2762c226-ff84-4f7c-ac37-51cd02b044c9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:46.565544 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2762c226-ff84-4f7c-ac37-51cd02b044c9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Unlocking {{(pid=140523) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 17 21:06:46.635933 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2762c226-ff84-4f7c-ac37-51cd02b044c9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action" status: 202 len: 0 microversion: 2.1 time: 0.139303 Sep 17 21:06:46.636596 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1899/3899] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:06:46 2022] POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:06:46.652900 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fedeeb1a-51b5-4b92-b6ce-fd8d8f2788c5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:46.653702 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fedeeb1a-51b5-4b92-b6ce-fd8d8f2788c5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:46.664271 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fedeeb1a-51b5-4b92-b6ce-fd8d8f2788c5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:46.664957 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fedeeb1a-51b5-4b92-b6ce-fd8d8f2788c5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:46.665518 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fedeeb1a-51b5-4b92-b6ce-fd8d8f2788c5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:46.666613 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fedeeb1a-51b5-4b92-b6ce-fd8d8f2788c5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:46.674058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fedeeb1a-51b5-4b92-b6ce-fd8d8f2788c5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:46.675005 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fedeeb1a-51b5-4b92-b6ce-fd8d8f2788c5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:46.713417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-92e81e18-305f-4121-ba8e-6284c7b435a0 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:46.714367 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-92e81e18-305f-4121-ba8e-6284c7b435a0 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:46.726624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92e81e18-305f-4121-ba8e-6284c7b435a0 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:46.728799 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92e81e18-305f-4121-ba8e-6284c7b435a0 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:46.729565 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92e81e18-305f-4121-ba8e-6284c7b435a0 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:46.734582 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92e81e18-305f-4121-ba8e-6284c7b435a0 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:46.735127 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92e81e18-305f-4121-ba8e-6284c7b435a0 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:46.735621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92e81e18-305f-4121-ba8e-6284c7b435a0 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:47.336772 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fedeeb1a-51b5-4b92-b6ce-fd8d8f2788c5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:47.345576 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fedeeb1a-51b5-4b92-b6ce-fd8d8f2788c5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.697070 Sep 17 21:06:47.354601 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2001/3900] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:46 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:47.359013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e6ca7ff7-d579-469c-8781-4e01ca03745e tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:47.359718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e6ca7ff7-d579-469c-8781-4e01ca03745e tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:47.367417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6ca7ff7-d579-469c-8781-4e01ca03745e tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:47.368033 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6ca7ff7-d579-469c-8781-4e01ca03745e tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:47.368551 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6ca7ff7-d579-469c-8781-4e01ca03745e tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:47.369575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6ca7ff7-d579-469c-8781-4e01ca03745e tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:47.369993 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6ca7ff7-d579-469c-8781-4e01ca03745e tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:47.370810 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6ca7ff7-d579-469c-8781-4e01ca03745e tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:47.405162 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-92e81e18-305f-4121-ba8e-6284c7b435a0 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:47.413687 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-92e81e18-305f-4121-ba8e-6284c7b435a0 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d" status: 200 len: 1499 microversion: 2.1 time: 0.703862 Sep 17 21:06:47.414625 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1900/3901] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:46 2022] GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d => generated 1499 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:47.419487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4b5992ff-25e9-4175-ad39-abfca8a735dd tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:47.420206 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4b5992ff-25e9-4175-ad39-abfca8a735dd tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: 239420ee-3593-46d6-8082-e3c0374a3db1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:47.426389 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b5992ff-25e9-4175-ad39-abfca8a735dd tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:47.427140 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b5992ff-25e9-4175-ad39-abfca8a735dd tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:47.427891 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b5992ff-25e9-4175-ad39-abfca8a735dd tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:47.428871 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b5992ff-25e9-4175-ad39-abfca8a735dd tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:47.429631 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b5992ff-25e9-4175-ad39-abfca8a735dd tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:47.430625 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b5992ff-25e9-4175-ad39-abfca8a735dd tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:47.599041 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e6ca7ff7-d579-469c-8781-4e01ca03745e tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:47.607517 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e6ca7ff7-d579-469c-8781-4e01ca03745e tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1505 microversion: 2.1 time: 0.259938 Sep 17 21:06:47.608363 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2002/3902] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:47 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1505 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:47.630107 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-782297a1-45dd-496f-aa17-4544c266309c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:47.631183 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-782297a1-45dd-496f-aa17-4544c266309c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:47.641392 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4b5992ff-25e9-4175-ad39-abfca8a735dd tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b19896bc4e4d14bfec46dd00519150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c307636beed407582da5779796cc6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:47.647361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-782297a1-45dd-496f-aa17-4544c266309c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:47.648069 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-782297a1-45dd-496f-aa17-4544c266309c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:47.649402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-782297a1-45dd-496f-aa17-4544c266309c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:47.650652 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-782297a1-45dd-496f-aa17-4544c266309c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:47.651290 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-782297a1-45dd-496f-aa17-4544c266309c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:47.651975 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-782297a1-45dd-496f-aa17-4544c266309c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:47.652418 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4b5992ff-25e9-4175-ad39-abfca8a735dd tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1" status: 200 len: 1575 microversion: 2.1 time: 0.236017 Sep 17 21:06:47.653179 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1901/3903] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:47 2022] GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1 => generated 1575 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:47.658359 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0e8f875a-57c3-49fd-a3cf-b5c9de7cde6d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:47.661266 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0e8f875a-57c3-49fd-a3cf-b5c9de7cde6d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:47.664286 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:47.668122 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e8f875a-57c3-49fd-a3cf-b5c9de7cde6d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:47.669024 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e8f875a-57c3-49fd-a3cf-b5c9de7cde6d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:47.669809 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e8f875a-57c3-49fd-a3cf-b5c9de7cde6d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:47.670864 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e8f875a-57c3-49fd-a3cf-b5c9de7cde6d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:47.671691 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e8f875a-57c3-49fd-a3cf-b5c9de7cde6d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:47.672416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e8f875a-57c3-49fd-a3cf-b5c9de7cde6d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:47.714804 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-0e8f875a-57c3-49fd-a3cf-b5c9de7cde6d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lazy-loading 'flavor' on Instance uuid 904ea7d3-2a78-408a-8a14-bac3845f6e7d {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:06:47.729282 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-0e8f875a-57c3-49fd-a3cf-b5c9de7cde6d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] HTTP exception thrown: Cannot 'rescue' instance 904ea7d3-2a78-408a-8a14-bac3845f6e7d while it is in vm_state paused Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0e8f875a-57c3-49fd-a3cf-b5c9de7cde6d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Request method failure captured: Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d/action HTTP/1.1 Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 14 Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjaiOOC2XD-QIsLuDvG9bxN3jnLjmueVdk28NKERipgg7mZAUnmkYYkUcMWYkcsUdzUwALfMrwKYbIvTbrUxBdv7HTTnMRjY98z2HSanC8PyMI0Bvd8_fsMNUR8WwzuWwOyttA6z4v7owoNPIa2XeOfidHHD5bq9m_itbcIiBCzoH1A Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: f8ed24e4bf6643f7b1474fcec78c4995 Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-533169750 Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ed24e4bf6643f7b1474fcec78c4995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f8ed24e4bf6643f7b1474fcec78c4995"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ed24e4bf6643f7b1474fcec78c4995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f8ed24e4bf6643f7b1474fcec78c4995", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerRescueNegativeTestJSON-533169750 Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: f8ed24e4bf6643f7b1474fcec78c4995 Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-533169750 Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerRescueNegativeTestJSON-533169750-project Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 795813bb461e42ad8c2a758e9b8430d6 Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerRescueNegativeTestJSON-533169750-project Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: {"rescue": {}} Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: exception: Cannot 'rescue' instance 904ea7d3-2a78-408a-8a14-bac3845f6e7d while it is in vm_state paused Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '904ea7d3-2a78-408a-8a14-bac3845f6e7d', 'body': {'rescue': {}}} Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 904ea7d3-2a78-408a-8a14-bac3845f6e7d in vm_state paused. Cannot rescue while the instance is in this state. Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 904ea7d3-2a78-408a-8a14-bac3845f6e7d while it is in vm_state paused Sep 17 21:06:47.731591 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:47.737863 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:47.737863 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:47.737863 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:47.737863 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:47.737863 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:47.737863 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:06:47.737863 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:06:47.737863 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 904ea7d3-2a78-408a-8a14-bac3845f6e7d while it is in vm_state paused Sep 17 21:06:47.737863 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:47.737863 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0e8f875a-57c3-49fd-a3cf-b5c9de7cde6d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Returning 409 to user: Cannot 'rescue' instance 904ea7d3-2a78-408a-8a14-bac3845f6e7d while it is in vm_state paused {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:06:47.737863 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0e8f875a-57c3-49fd-a3cf-b5c9de7cde6d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "POST /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d/action" status: 409 len: 144 microversion: 2.1 time: 0.081596 Sep 17 21:06:47.737863 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1902/3904] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:06:47 2022] POST /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d/action => generated 144 bytes in 83 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 17 21:06:47.745017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1eb03b5b-5a53-4b1d-8660-19988fd63a77 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:47.745585 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1eb03b5b-5a53-4b1d-8660-19988fd63a77 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:47.753687 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1eb03b5b-5a53-4b1d-8660-19988fd63a77 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:47.753687 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1eb03b5b-5a53-4b1d-8660-19988fd63a77 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:47.753687 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1eb03b5b-5a53-4b1d-8660-19988fd63a77 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:47.753687 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1eb03b5b-5a53-4b1d-8660-19988fd63a77 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:47.754636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1eb03b5b-5a53-4b1d-8660-19988fd63a77 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:47.755283 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1eb03b5b-5a53-4b1d-8660-19988fd63a77 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:47.804066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-782297a1-45dd-496f-aa17-4544c266309c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:47.813420 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-782297a1-45dd-496f-aa17-4544c266309c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.203366 Sep 17 21:06:47.814188 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2003/3905] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:47 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:47.832629 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1eb03b5b-5a53-4b1d-8660-19988fd63a77 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "POST /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d/action" status: 202 len: 0 microversion: 2.1 time: 0.091055 Sep 17 21:06:47.837985 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1903/3906] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:06:47 2022] POST /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 17 21:06:47.839147 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6289d51f-8373-4664-8237-d366ca9031e0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:47.839963 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6289d51f-8373-4664-8237-d366ca9031e0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:47.848508 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-59eef49f-2ba0-4e49-8053-737c39703b4a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:47.849804 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-59eef49f-2ba0-4e49-8053-737c39703b4a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:47.853024 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6289d51f-8373-4664-8237-d366ca9031e0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:47.853865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6289d51f-8373-4664-8237-d366ca9031e0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:47.854377 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6289d51f-8373-4664-8237-d366ca9031e0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:47.855422 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6289d51f-8373-4664-8237-d366ca9031e0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:47.856065 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6289d51f-8373-4664-8237-d366ca9031e0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:47.856556 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6289d51f-8373-4664-8237-d366ca9031e0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:47.859568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59eef49f-2ba0-4e49-8053-737c39703b4a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:47.860388 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59eef49f-2ba0-4e49-8053-737c39703b4a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:47.861058 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59eef49f-2ba0-4e49-8053-737c39703b4a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:47.862154 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59eef49f-2ba0-4e49-8053-737c39703b4a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:47.862677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59eef49f-2ba0-4e49-8053-737c39703b4a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:47.863386 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59eef49f-2ba0-4e49-8053-737c39703b4a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:48.084391 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-59eef49f-2ba0-4e49-8053-737c39703b4a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:48.099146 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6289d51f-8373-4664-8237-d366ca9031e0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:48.107480 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-59eef49f-2ba0-4e49-8053-737c39703b4a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d" status: 200 len: 1506 microversion: 2.1 time: 0.264317 Sep 17 21:06:48.107915 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6289d51f-8373-4664-8237-d366ca9031e0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.273186 Sep 17 21:06:48.117482 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2004/3907] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:47 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:48.117482 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1cd115e5-57a0-407e-b000-012d975aa327 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1606115119", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "72101b36-0cf8-4fab-91c1-881dd0d61851"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:48.125614 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1904/3908] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:47 2022] GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d => generated 1506 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:48.139674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-90a2d1f0-7921-4d01-91db-661ec7705e9d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:48.140226 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-90a2d1f0-7921-4d01-91db-661ec7705e9d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:48.146787 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90a2d1f0-7921-4d01-91db-661ec7705e9d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:48.147684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90a2d1f0-7921-4d01-91db-661ec7705e9d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:48.148134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90a2d1f0-7921-4d01-91db-661ec7705e9d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:48.148897 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90a2d1f0-7921-4d01-91db-661ec7705e9d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:48.149359 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90a2d1f0-7921-4d01-91db-661ec7705e9d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:48.149814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-90a2d1f0-7921-4d01-91db-661ec7705e9d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:48.168697 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:48.176431 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-1cd115e5-57a0-407e-b000-012d975aa327 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] validate_networks() for [('72101b36-0cf8-4fab-91c1-881dd0d61851', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:06:48.248239 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-90a2d1f0-7921-4d01-91db-661ec7705e9d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action" status: 202 len: 0 microversion: 2.1 time: 0.111174 Sep 17 21:06:48.249074 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1905/3909] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:06:48 2022] POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 17 21:06:48.264248 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8bf98395-2ec6-48bc-be7b-119342519b61 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:48.265282 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8bf98395-2ec6-48bc-be7b-119342519b61 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:48.272936 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8bf98395-2ec6-48bc-be7b-119342519b61 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:48.274706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8bf98395-2ec6-48bc-be7b-119342519b61 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:48.275525 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8bf98395-2ec6-48bc-be7b-119342519b61 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:48.276256 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8bf98395-2ec6-48bc-be7b-119342519b61 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:48.277079 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8bf98395-2ec6-48bc-be7b-119342519b61 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:48.277857 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8bf98395-2ec6-48bc-be7b-119342519b61 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:48.532632 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8bf98395-2ec6-48bc-be7b-119342519b61 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:48.543258 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8bf98395-2ec6-48bc-be7b-119342519b61 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1676 microversion: 2.1 time: 0.285121 Sep 17 21:06:48.544232 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1906/3910] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:48 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1676 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:48.636492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-af3db19d-765a-45c9-9cb9-3d9dbec30e91 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:48.637579 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-af3db19d-765a-45c9-9cb9-3d9dbec30e91 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:48.644211 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af3db19d-765a-45c9-9cb9-3d9dbec30e91 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:48.644726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af3db19d-765a-45c9-9cb9-3d9dbec30e91 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:48.645378 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af3db19d-765a-45c9-9cb9-3d9dbec30e91 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:48.646152 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af3db19d-765a-45c9-9cb9-3d9dbec30e91 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:48.646658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af3db19d-765a-45c9-9cb9-3d9dbec30e91 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:48.647096 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af3db19d-765a-45c9-9cb9-3d9dbec30e91 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:48.652015 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-1cd115e5-57a0-407e-b000-012d975aa327 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:06:48.652507 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-1cd115e5-57a0-407e-b000-012d975aa327 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:06:48.652926 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-1cd115e5-57a0-407e-b000-012d975aa327 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:06:48.653334 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-1cd115e5-57a0-407e-b000-012d975aa327 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:06:48.653778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-1cd115e5-57a0-407e-b000-012d975aa327 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:06:48.663508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1cd115e5-57a0-407e-b000-012d975aa327 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:48.663924 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1cd115e5-57a0-407e-b000-012d975aa327 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:48.664360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1cd115e5-57a0-407e-b000-012d975aa327 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:48.665089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1cd115e5-57a0-407e-b000-012d975aa327 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:48.665577 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1cd115e5-57a0-407e-b000-012d975aa327 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:48.666007 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1cd115e5-57a0-407e-b000-012d975aa327 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:48.678547 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:48.686054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-1cd115e5-57a0-407e-b000-012d975aa327 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Getting quotas for project 3e857c532a264ea78e24fd8fe1a44fbc. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:06:48.691895 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-1cd115e5-57a0-407e-b000-012d975aa327 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Getting quotas for user 33784305478f46ae9fdc4d4b82ebc6f5 and project 3e857c532a264ea78e24fd8fe1a44fbc. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:06:48.707797 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1cd115e5-57a0-407e-b000-012d975aa327 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:06:48.715646 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1cd115e5-57a0-407e-b000-012d975aa327 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 95d8ad94-20c4-43ae-be04-087c3ae43d5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:06:48.772578 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1cd115e5-57a0-407e-b000-012d975aa327 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.661536 Sep 17 21:06:48.773657 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2005/3911] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:06:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:06:48.782654 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c668a059-e4a2-4107-b888-f2aefc412743 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:48.783358 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c668a059-e4a2-4107-b888-f2aefc412743 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: 239420ee-3593-46d6-8082-e3c0374a3db1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:48.792951 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-af3db19d-765a-45c9-9cb9-3d9dbec30e91 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:48.793179 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c668a059-e4a2-4107-b888-f2aefc412743 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:48.793673 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c668a059-e4a2-4107-b888-f2aefc412743 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:48.794294 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c668a059-e4a2-4107-b888-f2aefc412743 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:48.796399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c668a059-e4a2-4107-b888-f2aefc412743 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:48.797436 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c668a059-e4a2-4107-b888-f2aefc412743 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:48.798048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c668a059-e4a2-4107-b888-f2aefc412743 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:48.802742 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-af3db19d-765a-45c9-9cb9-3d9dbec30e91 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1505 microversion: 2.1 time: 0.170098 Sep 17 21:06:48.803677 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1907/3912] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:48 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1505 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:48.810240 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-69827a28-a5e1-4028-9d4c-acd08f42797c tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:48.811096 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-69827a28-a5e1-4028-9d4c-acd08f42797c tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 95d8ad94-20c4-43ae-be04-087c3ae43d5b] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:48.875072 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-69827a28-a5e1-4028-9d4c-acd08f42797c tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33784305478f46ae9fdc4d4b82ebc6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e857c532a264ea78e24fd8fe1a44fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:48.883261 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-69827a28-a5e1-4028-9d4c-acd08f42797c tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "GET /compute/v2.1/servers/95d8ad94-20c4-43ae-be04-087c3ae43d5b" status: 200 len: 1214 microversion: 2.1 time: 0.078366 Sep 17 21:06:48.884244 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1908/3913] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:48 2022] GET /compute/v2.1/servers/95d8ad94-20c4-43ae-be04-087c3ae43d5b => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:48.981280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c668a059-e4a2-4107-b888-f2aefc412743 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b19896bc4e4d14bfec46dd00519150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c307636beed407582da5779796cc6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:48.989949 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c668a059-e4a2-4107-b888-f2aefc412743 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1" status: 200 len: 1573 microversion: 2.1 time: 0.214674 Sep 17 21:06:48.991166 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2006/3914] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:48 2022] GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1 => generated 1573 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:49.014024 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-638e3f2b-ef34-45a2-959e-cafdc52d94ce tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2010759824"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:49.014554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-638e3f2b-ef34-45a2-959e-cafdc52d94ce tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: 239420ee-3593-46d6-8082-e3c0374a3db1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:49.020833 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-638e3f2b-ef34-45a2-959e-cafdc52d94ce tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:49.021321 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-638e3f2b-ef34-45a2-959e-cafdc52d94ce tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:49.021798 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-638e3f2b-ef34-45a2-959e-cafdc52d94ce tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:49.022693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-638e3f2b-ef34-45a2-959e-cafdc52d94ce tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:49.023184 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-638e3f2b-ef34-45a2-959e-cafdc52d94ce tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:49.023614 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-638e3f2b-ef34-45a2-959e-cafdc52d94ce tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:49.133189 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3c94eec5-601d-4f09-a88b-8b3cec5cb8b8 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:49.134027 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3c94eec5-601d-4f09-a88b-8b3cec5cb8b8 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:49.141344 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c94eec5-601d-4f09-a88b-8b3cec5cb8b8 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:49.141991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c94eec5-601d-4f09-a88b-8b3cec5cb8b8 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:49.142615 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c94eec5-601d-4f09-a88b-8b3cec5cb8b8 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:49.143711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c94eec5-601d-4f09-a88b-8b3cec5cb8b8 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:49.144411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c94eec5-601d-4f09-a88b-8b3cec5cb8b8 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:49.144996 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c94eec5-601d-4f09-a88b-8b3cec5cb8b8 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:49.252225 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.network.security_group_api [None req-638e3f2b-ef34-45a2-959e-cafdc52d94ce tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Adding security group bc33fc2f-d673-47c6-a5aa-69d5b66539ef to port 57a9ed75-fff3-45ef-a015-62f3f2a2d525 Sep 17 21:06:49.410248 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3c94eec5-601d-4f09-a88b-8b3cec5cb8b8 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:49.420967 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3c94eec5-601d-4f09-a88b-8b3cec5cb8b8 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d" status: 200 len: 1514 microversion: 2.1 time: 0.292614 Sep 17 21:06:49.434079 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2007/3915] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:49 2022] GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d => generated 1514 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:49.580679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-014d9f88-4021-409d-890c-43cf7fb7162d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:49.580679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-014d9f88-4021-409d-890c-43cf7fb7162d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:49.595471 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-014d9f88-4021-409d-890c-43cf7fb7162d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:49.596733 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-014d9f88-4021-409d-890c-43cf7fb7162d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:49.597596 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-014d9f88-4021-409d-890c-43cf7fb7162d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:49.602360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-014d9f88-4021-409d-890c-43cf7fb7162d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:49.604748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-014d9f88-4021-409d-890c-43cf7fb7162d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:49.605238 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-014d9f88-4021-409d-890c-43cf7fb7162d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:49.846825 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-638e3f2b-ef34-45a2-959e-cafdc52d94ce tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "POST /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1/action" status: 202 len: 0 microversion: 2.1 time: 0.831211 Sep 17 21:06:49.846825 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1909/3916] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:06:49 2022] POST /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1/action => generated 0 bytes in 833 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:06:49.848552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e56d7e66-fcdd-42bb-bb3a-0aed28c47157 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:49.849413 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e56d7e66-fcdd-42bb-bb3a-0aed28c47157 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:49.862202 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e56d7e66-fcdd-42bb-bb3a-0aed28c47157 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:49.862728 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e56d7e66-fcdd-42bb-bb3a-0aed28c47157 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:49.863180 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e56d7e66-fcdd-42bb-bb3a-0aed28c47157 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:49.863910 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e56d7e66-fcdd-42bb-bb3a-0aed28c47157 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:49.864372 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e56d7e66-fcdd-42bb-bb3a-0aed28c47157 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:49.873717 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e56d7e66-fcdd-42bb-bb3a-0aed28c47157 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:50.030895 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-014d9f88-4021-409d-890c-43cf7fb7162d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:50.047247 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-014d9f88-4021-409d-890c-43cf7fb7162d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1656 microversion: 2.1 time: 0.478002 Sep 17 21:06:50.060512 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2008/3917] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:49 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1656 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:50.069424 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-faa33622-5be0-45ba-aa12-74c7469acdc6 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '.version_select at 0x7f25a5838550>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:50.148383 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e56d7e66-fcdd-42bb-bb3a-0aed28c47157 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:50.167138 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e56d7e66-fcdd-42bb-bb3a-0aed28c47157 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1505 microversion: 2.1 time: 0.324596 Sep 17 21:06:50.170286 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1910/3918] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:49 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1505 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:50.187171 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-f32b85ac-433b-4a96-80d6-dc62dc0ef0ef req-5c342400-9dbc-47ed-b3ad-fa0c2d73e6c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "239420ee-3593-46d6-8082-e3c0374a3db1", "tag": "57a9ed75-fff3-45ef-a015-62f3f2a2d525"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:50.212666 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f32b85ac-433b-4a96-80d6-dc62dc0ef0ef req-5c342400-9dbc-47ed-b3ad-fa0c2d73e6c4 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:50.213230 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f32b85ac-433b-4a96-80d6-dc62dc0ef0ef req-5c342400-9dbc-47ed-b3ad-fa0c2d73e6c4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:50.213953 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f32b85ac-433b-4a96-80d6-dc62dc0ef0ef req-5c342400-9dbc-47ed-b3ad-fa0c2d73e6c4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:50.229701 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-f32b85ac-433b-4a96-80d6-dc62dc0ef0ef req-5c342400-9dbc-47ed-b3ad-fa0c2d73e6c4 service nova] Creating event network-changed:57a9ed75-fff3-45ef-a015-62f3f2a2d525 for instance 239420ee-3593-46d6-8082-e3c0374a3db1 on nch2-master-1 Sep 17 21:06:50.238165 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-f32b85ac-433b-4a96-80d6-dc62dc0ef0ef req-5c342400-9dbc-47ed-b3ad-fa0c2d73e6c4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064790 Sep 17 21:06:50.239975 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1911/3919] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:50.260585 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-aa887ef7-1092-4fce-ae34-4e11f8715756 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:50.261911 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-aa887ef7-1092-4fce-ae34-4e11f8715756 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 95d8ad94-20c4-43ae-be04-087c3ae43d5b] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:50.270666 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa887ef7-1092-4fce-ae34-4e11f8715756 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:50.271448 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa887ef7-1092-4fce-ae34-4e11f8715756 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:50.272228 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa887ef7-1092-4fce-ae34-4e11f8715756 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:50.273934 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa887ef7-1092-4fce-ae34-4e11f8715756 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:50.274593 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa887ef7-1092-4fce-ae34-4e11f8715756 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:50.275258 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa887ef7-1092-4fce-ae34-4e11f8715756 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:50.418213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-aa887ef7-1092-4fce-ae34-4e11f8715756 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33784305478f46ae9fdc4d4b82ebc6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e857c532a264ea78e24fd8fe1a44fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:50.432326 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-aa887ef7-1092-4fce-ae34-4e11f8715756 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "GET /compute/v2.1/servers/95d8ad94-20c4-43ae-be04-087c3ae43d5b" status: 200 len: 1274 microversion: 2.1 time: 0.190527 Sep 17 21:06:50.433925 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1912/3920] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:50 2022] GET /compute/v2.1/servers/95d8ad94-20c4-43ae-be04-087c3ae43d5b => generated 1274 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:50.450610 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-82ba40f7-224f-4215-87c4-7a8a44d43555 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:50.451241 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-82ba40f7-224f-4215-87c4-7a8a44d43555 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:50.466300 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82ba40f7-224f-4215-87c4-7a8a44d43555 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:50.466926 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82ba40f7-224f-4215-87c4-7a8a44d43555 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:50.467619 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82ba40f7-224f-4215-87c4-7a8a44d43555 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:50.469585 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82ba40f7-224f-4215-87c4-7a8a44d43555 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:50.470546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82ba40f7-224f-4215-87c4-7a8a44d43555 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:50.471270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82ba40f7-224f-4215-87c4-7a8a44d43555 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:50.491705 ncdv-master-1 devstack@n-api.service[140524]: DEBUG neutronclient.v2_0.client [None req-faa33622-5be0-45ba-aa12-74c7469acdc6 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group bc33fc2f-d673-47c6-a5aa-69d5b66539ef in use.", "detail": ""}} {{(pid=140524) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 17 21:06:50.492438 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-faa33622-5be0-45ba-aa12-74c7469acdc6 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] HTTP exception thrown: Security Group bc33fc2f-d673-47c6-a5aa-69d5b66539ef in use. Sep 17 21:06:50.492438 ncdv-master-1 devstack@n-api.service[140524]: Neutron server returns request_ids: ['req-c4fd7608-8858-40e0-bf83-c282c4331e82'] Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-faa33622-5be0-45ba-aa12-74c7469acdc6 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Request method failure captured: Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/os-security-groups/bc33fc2f-d673-47c6-a5aa-69d5b66539ef HTTP/1.1 Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjagzzYrrTodN4FRISubmKjZ26J-8BGxkNzLU7x20a3MCWENMarIDjJ9bOlqCettGyQPm3qYerTfS4mUFkwcpl7RJrNB079yuTWGsg7iyYHjYrTBkjIt8CtBBLGQxaQp-7J70wULL21t1iBESs97Rxk-MKHrjWOPMZFqMTCeWGgBIAQ Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 1c307636beed407582da5779796cc6a7 Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c307636beed407582da5779796cc6a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c307636beed407582da5779796cc6a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c307636beed407582da5779796cc6a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c307636beed407582da5779796cc6a7", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 1c307636beed407582da5779796cc6a7 Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-SecurityGroupsTestJSON-1804220727-project Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 30b19896bc4e4d14bfec46dd00519150 Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-SecurityGroupsTestJSON-1804220727-project Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: exception: Security Group bc33fc2f-d673-47c6-a5aa-69d5b66539ef in use. Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: Neutron server returns request_ids: ['req-c4fd7608-8858-40e0-bf83-c282c4331e82'] Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'bc33fc2f-d673-47c6-a5aa-69d5b66539ef'} Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 17 21:06:50.495403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group bc33fc2f-d673-47c6-a5aa-69d5b66539ef in use. Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4fd7608-8858-40e0-bf83-c282c4331e82'] Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group bc33fc2f-d673-47c6-a5aa-69d5b66539ef in use. Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4fd7608-8858-40e0-bf83-c282c4331e82'] Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group bc33fc2f-d673-47c6-a5aa-69d5b66539ef in use. Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4fd7608-8858-40e0-bf83-c282c4331e82'] Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group bc33fc2f-d673-47c6-a5aa-69d5b66539ef in use. Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c4fd7608-8858-40e0-bf83-c282c4331e82'] Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-faa33622-5be0-45ba-aa12-74c7469acdc6 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Returning 400 to user: Security Group bc33fc2f-d673-47c6-a5aa-69d5b66539ef in use. Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: Neutron server returns request_ids: ['req-c4fd7608-8858-40e0-bf83-c282c4331e82'] {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-faa33622-5be0-45ba-aa12-74c7469acdc6 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/bc33fc2f-d673-47c6-a5aa-69d5b66539ef" status: 400 len: 185 microversion: 2.1 time: 0.435045 Sep 17 21:06:50.500371 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2009/3921] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 21:06:50 2022] DELETE /compute/v2.1/os-security-groups/bc33fc2f-d673-47c6-a5aa-69d5b66539ef => generated 185 bytes in 437 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:06:50.507008 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fa4cf334-0829-41ae-af1e-883534ec44a3 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:50.507508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fa4cf334-0829-41ae-af1e-883534ec44a3 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: 239420ee-3593-46d6-8082-e3c0374a3db1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:50.524001 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa4cf334-0829-41ae-af1e-883534ec44a3 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:50.524525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa4cf334-0829-41ae-af1e-883534ec44a3 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:50.524966 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa4cf334-0829-41ae-af1e-883534ec44a3 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:50.525723 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa4cf334-0829-41ae-af1e-883534ec44a3 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:50.526184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa4cf334-0829-41ae-af1e-883534ec44a3 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:50.527868 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa4cf334-0829-41ae-af1e-883534ec44a3 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:50.571567 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:50.580761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fa4cf334-0829-41ae-af1e-883534ec44a3 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: 239420ee-3593-46d6-8082-e3c0374a3db1] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:06:50.589266 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-82ba40f7-224f-4215-87c4-7a8a44d43555 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action" status: 202 len: 0 microversion: 2.1 time: 0.147591 Sep 17 21:06:50.592792 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1913/3922] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:06:50 2022] POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:06:50.605739 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fb7baefd-1470-4746-88e2-2392015cce08 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:50.607817 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fb7baefd-1470-4746-88e2-2392015cce08 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:50.622537 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb7baefd-1470-4746-88e2-2392015cce08 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:50.623342 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb7baefd-1470-4746-88e2-2392015cce08 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:50.624509 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb7baefd-1470-4746-88e2-2392015cce08 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:50.635711 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb7baefd-1470-4746-88e2-2392015cce08 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:50.638167 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb7baefd-1470-4746-88e2-2392015cce08 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:50.641246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb7baefd-1470-4746-88e2-2392015cce08 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:50.802598 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fa4cf334-0829-41ae-af1e-883534ec44a3 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "DELETE /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1" status: 204 len: 0 microversion: 2.1 time: 0.297986 Sep 17 21:06:50.803621 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2010/3923] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:06:50 2022] DELETE /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:06:50.813366 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a0ca2360-ad2e-4ad6-888b-f9ac9fe47f27 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:50.814430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a0ca2360-ad2e-4ad6-888b-f9ac9fe47f27 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: 239420ee-3593-46d6-8082-e3c0374a3db1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:50.824131 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0ca2360-ad2e-4ad6-888b-f9ac9fe47f27 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:50.824962 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0ca2360-ad2e-4ad6-888b-f9ac9fe47f27 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:50.825656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0ca2360-ad2e-4ad6-888b-f9ac9fe47f27 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:50.826731 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0ca2360-ad2e-4ad6-888b-f9ac9fe47f27 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:50.827398 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0ca2360-ad2e-4ad6-888b-f9ac9fe47f27 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:50.828203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0ca2360-ad2e-4ad6-888b-f9ac9fe47f27 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:50.887023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fb7baefd-1470-4746-88e2-2392015cce08 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:50.902918 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fb7baefd-1470-4746-88e2-2392015cce08 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1663 microversion: 2.1 time: 0.305740 Sep 17 21:06:50.903967 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1914/3924] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:50 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1663 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:51.021371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3057a620-4c21-4105-aa0a-3a0bf21cee8b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:51.023893 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3057a620-4c21-4105-aa0a-3a0bf21cee8b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:51.030842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3057a620-4c21-4105-aa0a-3a0bf21cee8b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:51.031332 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3057a620-4c21-4105-aa0a-3a0bf21cee8b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:51.031767 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3057a620-4c21-4105-aa0a-3a0bf21cee8b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:51.032470 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3057a620-4c21-4105-aa0a-3a0bf21cee8b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:51.032960 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3057a620-4c21-4105-aa0a-3a0bf21cee8b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:51.033446 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3057a620-4c21-4105-aa0a-3a0bf21cee8b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:51.056972 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-3057a620-4c21-4105-aa0a-3a0bf21cee8b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lazy-loading 'flavor' on Instance uuid 904ea7d3-2a78-408a-8a14-bac3845f6e7d {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:06:51.143733 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a0ca2360-ad2e-4ad6-888b-f9ac9fe47f27 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b19896bc4e4d14bfec46dd00519150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c307636beed407582da5779796cc6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:51.147047 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3057a620-4c21-4105-aa0a-3a0bf21cee8b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "POST /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d/action" status: 200 len: 32 microversion: 2.1 time: 0.129497 Sep 17 21:06:51.153167 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1915/3925] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:06:51 2022] POST /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d/action => generated 32 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:06:51.153520 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a0ca2360-ad2e-4ad6-888b-f9ac9fe47f27 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1" status: 200 len: 1648 microversion: 2.1 time: 0.345167 Sep 17 21:06:51.154269 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2011/3926] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:50 2022] GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1 => generated 1648 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:51.159423 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-afe09f8b-aad7-432b-b69c-7e8ee94d172a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:51.160305 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-afe09f8b-aad7-432b-b69c-7e8ee94d172a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:51.167660 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afe09f8b-aad7-432b-b69c-7e8ee94d172a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:51.168234 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afe09f8b-aad7-432b-b69c-7e8ee94d172a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:51.168737 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afe09f8b-aad7-432b-b69c-7e8ee94d172a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:51.169665 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afe09f8b-aad7-432b-b69c-7e8ee94d172a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:51.170490 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afe09f8b-aad7-432b-b69c-7e8ee94d172a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:51.170969 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afe09f8b-aad7-432b-b69c-7e8ee94d172a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:51.193821 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-929c998a-b3ba-47ae-8964-4067c0e1addb tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:51.194974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-929c998a-b3ba-47ae-8964-4067c0e1addb tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:51.201843 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-929c998a-b3ba-47ae-8964-4067c0e1addb tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:51.203824 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-929c998a-b3ba-47ae-8964-4067c0e1addb tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:51.204554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-929c998a-b3ba-47ae-8964-4067c0e1addb tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:51.205484 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-929c998a-b3ba-47ae-8964-4067c0e1addb tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:51.206208 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-929c998a-b3ba-47ae-8964-4067c0e1addb tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:51.206918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-929c998a-b3ba-47ae-8964-4067c0e1addb tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:51.471322 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-afe09f8b-aad7-432b-b69c-7e8ee94d172a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:51.480226 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-afe09f8b-aad7-432b-b69c-7e8ee94d172a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d" status: 200 len: 1520 microversion: 2.1 time: 0.325845 Sep 17 21:06:51.480835 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1916/3927] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:51 2022] GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d => generated 1520 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:51.485954 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-583d6179-1adc-44cd-a02b-4a35afd35c18 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:51.486765 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-583d6179-1adc-44cd-a02b-4a35afd35c18 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 95d8ad94-20c4-43ae-be04-087c3ae43d5b] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:51.489893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-929c998a-b3ba-47ae-8964-4067c0e1addb tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:51.499887 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-929c998a-b3ba-47ae-8964-4067c0e1addb tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1505 microversion: 2.1 time: 0.310193 Sep 17 21:06:51.500482 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2012/3928] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:51 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1505 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:51.504960 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-583d6179-1adc-44cd-a02b-4a35afd35c18 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:51.506078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-583d6179-1adc-44cd-a02b-4a35afd35c18 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:51.506860 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-583d6179-1adc-44cd-a02b-4a35afd35c18 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:51.507903 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-583d6179-1adc-44cd-a02b-4a35afd35c18 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:51.508568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-583d6179-1adc-44cd-a02b-4a35afd35c18 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:51.509171 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-583d6179-1adc-44cd-a02b-4a35afd35c18 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:51.724713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-583d6179-1adc-44cd-a02b-4a35afd35c18 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33784305478f46ae9fdc4d4b82ebc6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e857c532a264ea78e24fd8fe1a44fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:51.734600 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-583d6179-1adc-44cd-a02b-4a35afd35c18 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "GET /compute/v2.1/servers/95d8ad94-20c4-43ae-be04-087c3ae43d5b" status: 200 len: 1314 microversion: 2.1 time: 0.252649 Sep 17 21:06:51.735156 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1917/3929] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:51 2022] GET /compute/v2.1/servers/95d8ad94-20c4-43ae-be04-087c3ae43d5b => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:51.928246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-71d60678-485f-4e60-a446-5ae65510efc4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:51.928892 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-71d60678-485f-4e60-a446-5ae65510efc4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:51.935805 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71d60678-485f-4e60-a446-5ae65510efc4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:51.936550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71d60678-485f-4e60-a446-5ae65510efc4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:51.937186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71d60678-485f-4e60-a446-5ae65510efc4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:51.938164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71d60678-485f-4e60-a446-5ae65510efc4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:51.938785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71d60678-485f-4e60-a446-5ae65510efc4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:51.939417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71d60678-485f-4e60-a446-5ae65510efc4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:52.156224 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-71d60678-485f-4e60-a446-5ae65510efc4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:52.166473 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-71d60678-485f-4e60-a446-5ae65510efc4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.241317 Sep 17 21:06:52.167155 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2013/3930] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:51 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:52.176171 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-295f161f-530c-4ef8-b9c4-bf8290482488 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:52.176800 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-295f161f-530c-4ef8-b9c4-bf8290482488 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: 239420ee-3593-46d6-8082-e3c0374a3db1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:52.183976 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-295f161f-530c-4ef8-b9c4-bf8290482488 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:52.184472 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-295f161f-530c-4ef8-b9c4-bf8290482488 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:52.184925 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-295f161f-530c-4ef8-b9c4-bf8290482488 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:52.185678 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-295f161f-530c-4ef8-b9c4-bf8290482488 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:52.186350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-295f161f-530c-4ef8-b9c4-bf8290482488 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:52.186944 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-295f161f-530c-4ef8-b9c4-bf8290482488 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:52.194110 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3d511266-4c1d-40ae-94ea-7a33362266b0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:52.194813 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3d511266-4c1d-40ae-94ea-7a33362266b0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:52.216759 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d511266-4c1d-40ae-94ea-7a33362266b0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:52.218231 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d511266-4c1d-40ae-94ea-7a33362266b0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:52.222142 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d511266-4c1d-40ae-94ea-7a33362266b0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:52.226736 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d511266-4c1d-40ae-94ea-7a33362266b0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:52.227642 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d511266-4c1d-40ae-94ea-7a33362266b0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:52.228334 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d511266-4c1d-40ae-94ea-7a33362266b0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:52.791122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3d511266-4c1d-40ae-94ea-7a33362266b0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:52.801154 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3d511266-4c1d-40ae-94ea-7a33362266b0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.611835 Sep 17 21:06:52.818551 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2014/3931] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:52 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:52.830598 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-316dfb02-b89c-4aac-abfc-01cd4905bcf5 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:52.832054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-316dfb02-b89c-4aac-abfc-01cd4905bcf5 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:52.839610 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-316dfb02-b89c-4aac-abfc-01cd4905bcf5 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:52.840408 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-316dfb02-b89c-4aac-abfc-01cd4905bcf5 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:52.840952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-316dfb02-b89c-4aac-abfc-01cd4905bcf5 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:52.842590 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-316dfb02-b89c-4aac-abfc-01cd4905bcf5 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:52.843255 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-316dfb02-b89c-4aac-abfc-01cd4905bcf5 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:52.843768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-316dfb02-b89c-4aac-abfc-01cd4905bcf5 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:53.272243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-295f161f-530c-4ef8-b9c4-bf8290482488 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b19896bc4e4d14bfec46dd00519150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c307636beed407582da5779796cc6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:53.286794 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-295f161f-530c-4ef8-b9c4-bf8290482488 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1" status: 200 len: 1648 microversion: 2.1 time: 1.114329 Sep 17 21:06:53.287426 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1918/3932] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:52 2022] GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1 => generated 1648 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:53.301695 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3df7aeb3-4ab2-4155-8105-85ac4497e59b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:53.301695 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3df7aeb3-4ab2-4155-8105-85ac4497e59b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:53.317885 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3df7aeb3-4ab2-4155-8105-85ac4497e59b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:53.318308 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3df7aeb3-4ab2-4155-8105-85ac4497e59b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:53.318905 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3df7aeb3-4ab2-4155-8105-85ac4497e59b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:53.319679 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3df7aeb3-4ab2-4155-8105-85ac4497e59b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:53.320143 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3df7aeb3-4ab2-4155-8105-85ac4497e59b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:53.320577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3df7aeb3-4ab2-4155-8105-85ac4497e59b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:53.858903 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-316dfb02-b89c-4aac-abfc-01cd4905bcf5 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:53.875107 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-316dfb02-b89c-4aac-abfc-01cd4905bcf5 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d" status: 200 len: 1520 microversion: 2.1 time: 1.051531 Sep 17 21:06:53.876313 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2015/3933] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:52 2022] GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d => generated 1520 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:53.880757 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3df7aeb3-4ab2-4155-8105-85ac4497e59b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:53.895602 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-de615e5c-3e39-4bb5-8082-c9a5c5ed1482 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:53.896341 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-de615e5c-3e39-4bb5-8082-c9a5c5ed1482 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 95d8ad94-20c4-43ae-be04-087c3ae43d5b] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:53.898682 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3df7aeb3-4ab2-4155-8105-85ac4497e59b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1505 microversion: 2.1 time: 0.610087 Sep 17 21:06:53.899760 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1919/3934] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:53 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1505 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:53.904265 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-de615e5c-3e39-4bb5-8082-c9a5c5ed1482 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:53.904764 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-de615e5c-3e39-4bb5-8082-c9a5c5ed1482 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:53.906019 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-de615e5c-3e39-4bb5-8082-c9a5c5ed1482 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:53.906904 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-de615e5c-3e39-4bb5-8082-c9a5c5ed1482 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:53.907721 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-de615e5c-3e39-4bb5-8082-c9a5c5ed1482 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:53.908439 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-de615e5c-3e39-4bb5-8082-c9a5c5ed1482 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:53.910853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3933b8c1-1e23-44d1-901e-6d2aadeac80a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:53.912742 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3933b8c1-1e23-44d1-901e-6d2aadeac80a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:53.923200 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3933b8c1-1e23-44d1-901e-6d2aadeac80a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:53.927224 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3933b8c1-1e23-44d1-901e-6d2aadeac80a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:53.928727 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3933b8c1-1e23-44d1-901e-6d2aadeac80a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:53.930784 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3933b8c1-1e23-44d1-901e-6d2aadeac80a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:53.932067 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3933b8c1-1e23-44d1-901e-6d2aadeac80a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:53.933398 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3933b8c1-1e23-44d1-901e-6d2aadeac80a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:53.938791 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:54.247920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-de615e5c-3e39-4bb5-8082-c9a5c5ed1482 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33784305478f46ae9fdc4d4b82ebc6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e857c532a264ea78e24fd8fe1a44fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:54.268237 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-de615e5c-3e39-4bb5-8082-c9a5c5ed1482 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "GET /compute/v2.1/servers/95d8ad94-20c4-43ae-be04-087c3ae43d5b" status: 200 len: 1314 microversion: 2.1 time: 0.390315 Sep 17 21:06:54.270338 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2016/3935] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:53 2022] GET /compute/v2.1/servers/95d8ad94-20c4-43ae-be04-087c3ae43d5b => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:54.275951 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-6d565392-1478-4471-aedf-91c0f90c5cf7 req-48b3e5f1-2a6b-4312-b473-2aab36737ee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "239420ee-3593-46d6-8082-e3c0374a3db1", "name": "network-vif-deleted", "tag": "57a9ed75-fff3-45ef-a015-62f3f2a2d525"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:54.290142 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6d565392-1478-4471-aedf-91c0f90c5cf7 req-48b3e5f1-2a6b-4312-b473-2aab36737ee5 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:54.291072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6d565392-1478-4471-aedf-91c0f90c5cf7 req-48b3e5f1-2a6b-4312-b473-2aab36737ee5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:54.291621 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6d565392-1478-4471-aedf-91c0f90c5cf7 req-48b3e5f1-2a6b-4312-b473-2aab36737ee5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:54.305911 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-6d565392-1478-4471-aedf-91c0f90c5cf7 req-48b3e5f1-2a6b-4312-b473-2aab36737ee5 service nova] Creating event network-vif-deleted:57a9ed75-fff3-45ef-a015-62f3f2a2d525 for instance 239420ee-3593-46d6-8082-e3c0374a3db1 on nch2-master-1 Sep 17 21:06:54.311888 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-6d565392-1478-4471-aedf-91c0f90c5cf7 req-48b3e5f1-2a6b-4312-b473-2aab36737ee5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039354 Sep 17 21:06:54.313272 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2017/3936] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:54.319761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-d31bdc54-690d-486d-8235-a55653bfcae0 req-e7ad6512-1d7c-4f69-9834-f41836384ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95d8ad94-20c4-43ae-be04-087c3ae43d5b", "tag": "04ac8d32-227f-492e-80d6-78229934fd54"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:54.332949 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d31bdc54-690d-486d-8235-a55653bfcae0 req-e7ad6512-1d7c-4f69-9834-f41836384ba9 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:54.334012 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d31bdc54-690d-486d-8235-a55653bfcae0 req-e7ad6512-1d7c-4f69-9834-f41836384ba9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:54.334672 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d31bdc54-690d-486d-8235-a55653bfcae0 req-e7ad6512-1d7c-4f69-9834-f41836384ba9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:54.341563 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3933b8c1-1e23-44d1-901e-6d2aadeac80a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:54.350002 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-d31bdc54-690d-486d-8235-a55653bfcae0 req-e7ad6512-1d7c-4f69-9834-f41836384ba9 service nova] Creating event network-changed:04ac8d32-227f-492e-80d6-78229934fd54 for instance 95d8ad94-20c4-43ae-be04-087c3ae43d5b on nch1-master-1 Sep 17 21:06:54.355599 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-d31bdc54-690d-486d-8235-a55653bfcae0 req-e7ad6512-1d7c-4f69-9834-f41836384ba9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040624 Sep 17 21:06:54.356145 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3933b8c1-1e23-44d1-901e-6d2aadeac80a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.449748 Sep 17 21:06:54.356825 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2018/3937] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:54.366111 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1920/3938] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:53 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:54.377408 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2eeb0f19-eb18-4785-a119-e5e1e15f761b tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:54.380136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2eeb0f19-eb18-4785-a119-e5e1e15f761b tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: 239420ee-3593-46d6-8082-e3c0374a3db1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:54.383999 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-27969ee3-7618-4408-ab80-42c976200e2e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:54.384988 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-27969ee3-7618-4408-ab80-42c976200e2e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:54.394634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-27969ee3-7618-4408-ab80-42c976200e2e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:54.395604 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-27969ee3-7618-4408-ab80-42c976200e2e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:54.396709 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-27969ee3-7618-4408-ab80-42c976200e2e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:54.397774 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-27969ee3-7618-4408-ab80-42c976200e2e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:54.398465 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-27969ee3-7618-4408-ab80-42c976200e2e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:54.398594 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2eeb0f19-eb18-4785-a119-e5e1e15f761b tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:54.399290 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-27969ee3-7618-4408-ab80-42c976200e2e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:54.400716 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2eeb0f19-eb18-4785-a119-e5e1e15f761b tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:54.401180 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2eeb0f19-eb18-4785-a119-e5e1e15f761b tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:54.403890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2eeb0f19-eb18-4785-a119-e5e1e15f761b tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:54.405684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2eeb0f19-eb18-4785-a119-e5e1e15f761b tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:54.411569 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2eeb0f19-eb18-4785-a119-e5e1e15f761b tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:54.483592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2eeb0f19-eb18-4785-a119-e5e1e15f761b tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:54.484226 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2eeb0f19-eb18-4785-a119-e5e1e15f761b tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:54.484668 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2eeb0f19-eb18-4785-a119-e5e1e15f761b tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:54.485129 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-2eeb0f19-eb18-4785-a119-e5e1e15f761b tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lazy-loading 'fault' on Instance uuid 239420ee-3593-46d6-8082-e3c0374a3db1 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:06:54.599693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2eeb0f19-eb18-4785-a119-e5e1e15f761b tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b19896bc4e4d14bfec46dd00519150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c307636beed407582da5779796cc6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:54.609749 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2eeb0f19-eb18-4785-a119-e5e1e15f761b tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1" status: 200 len: 1306 microversion: 2.1 time: 0.250803 Sep 17 21:06:54.611207 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2019/3939] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:54 2022] GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1 => generated 1306 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:54.784186 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-27969ee3-7618-4408-ab80-42c976200e2e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:54.792812 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-27969ee3-7618-4408-ab80-42c976200e2e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.415517 Sep 17 21:06:54.793666 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1921/3940] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:54 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:54.816261 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e6225d10-2aa8-49f6-ab77-a4c28606c355 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:54.817120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e6225d10-2aa8-49f6-ab77-a4c28606c355 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:54.824201 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6225d10-2aa8-49f6-ab77-a4c28606c355 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:54.825015 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6225d10-2aa8-49f6-ab77-a4c28606c355 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:54.825730 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6225d10-2aa8-49f6-ab77-a4c28606c355 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:54.826702 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6225d10-2aa8-49f6-ab77-a4c28606c355 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:54.827457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6225d10-2aa8-49f6-ab77-a4c28606c355 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:54.828129 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6225d10-2aa8-49f6-ab77-a4c28606c355 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:54.899047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9e33be68-9110-46f6-b9ab-f77cb921553b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:54.900205 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9e33be68-9110-46f6-b9ab-f77cb921553b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:54.908138 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e33be68-9110-46f6-b9ab-f77cb921553b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:54.908929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e33be68-9110-46f6-b9ab-f77cb921553b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:54.909576 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e33be68-9110-46f6-b9ab-f77cb921553b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:54.910352 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e33be68-9110-46f6-b9ab-f77cb921553b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:54.910810 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e33be68-9110-46f6-b9ab-f77cb921553b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:54.911236 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e33be68-9110-46f6-b9ab-f77cb921553b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:55.073288 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e6225d10-2aa8-49f6-ab77-a4c28606c355 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:55.082181 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e6225d10-2aa8-49f6-ab77-a4c28606c355 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.269970 Sep 17 21:06:55.082688 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2020/3941] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:54 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:55.088518 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-84eb129d-c532-4934-bdac-e417abbad199 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:55.089092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-84eb129d-c532-4934-bdac-e417abbad199 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:55.095837 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84eb129d-c532-4934-bdac-e417abbad199 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:55.096793 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84eb129d-c532-4934-bdac-e417abbad199 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:55.097443 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84eb129d-c532-4934-bdac-e417abbad199 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:55.098346 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84eb129d-c532-4934-bdac-e417abbad199 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:55.102097 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9e33be68-9110-46f6-b9ab-f77cb921553b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:55.105908 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84eb129d-c532-4934-bdac-e417abbad199 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:55.106423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84eb129d-c532-4934-bdac-e417abbad199 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:55.110533 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9e33be68-9110-46f6-b9ab-f77cb921553b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d" status: 200 len: 1520 microversion: 2.1 time: 0.215509 Sep 17 21:06:55.111309 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1922/3942] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:54 2022] GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:55.115902 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a93408f1-9e8b-49e6-a314-266929ea884a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:55.116538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a93408f1-9e8b-49e6-a314-266929ea884a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:55.122357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a93408f1-9e8b-49e6-a314-266929ea884a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:55.122856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a93408f1-9e8b-49e6-a314-266929ea884a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:55.123325 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a93408f1-9e8b-49e6-a314-266929ea884a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:55.124024 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a93408f1-9e8b-49e6-a314-266929ea884a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:55.124484 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a93408f1-9e8b-49e6-a314-266929ea884a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:55.124918 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a93408f1-9e8b-49e6-a314-266929ea884a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:55.323072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-84eb129d-c532-4934-bdac-e417abbad199 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:55.325617 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a93408f1-9e8b-49e6-a314-266929ea884a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:55.332947 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-84eb129d-c532-4934-bdac-e417abbad199 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1505 microversion: 2.1 time: 0.249113 Sep 17 21:06:55.333745 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a93408f1-9e8b-49e6-a314-266929ea884a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.221403 Sep 17 21:06:55.333931 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2021/3943] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:55 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1505 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:55.334604 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1923/3944] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:55 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:55.339294 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-25d104a9-d395-4475-bf81-8f14c85ec733 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:55.340089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-25d104a9-d395-4475-bf81-8f14c85ec733 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 95d8ad94-20c4-43ae-be04-087c3ae43d5b] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:55.346766 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-25d104a9-d395-4475-bf81-8f14c85ec733 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:55.347563 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-25d104a9-d395-4475-bf81-8f14c85ec733 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:55.348619 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-25d104a9-d395-4475-bf81-8f14c85ec733 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:55.349751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-25d104a9-d395-4475-bf81-8f14c85ec733 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:55.350286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-25d104a9-d395-4475-bf81-8f14c85ec733 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:55.350835 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-25d104a9-d395-4475-bf81-8f14c85ec733 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:55.486338 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-25d104a9-d395-4475-bf81-8f14c85ec733 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33784305478f46ae9fdc4d4b82ebc6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e857c532a264ea78e24fd8fe1a44fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:55.495371 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-25d104a9-d395-4475-bf81-8f14c85ec733 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "GET /compute/v2.1/servers/95d8ad94-20c4-43ae-be04-087c3ae43d5b" status: 200 len: 1314 microversion: 2.1 time: 0.159975 Sep 17 21:06:55.495953 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2022/3945] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:55 2022] GET /compute/v2.1/servers/95d8ad94-20c4-43ae-be04-087c3ae43d5b => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:55.634787 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c0f430ba-0be8-4652-a8e5-b4e0ec176c5f tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:55.635527 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c0f430ba-0be8-4652-a8e5-b4e0ec176c5f tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: 239420ee-3593-46d6-8082-e3c0374a3db1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:55.641747 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0f430ba-0be8-4652-a8e5-b4e0ec176c5f tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:55.642387 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0f430ba-0be8-4652-a8e5-b4e0ec176c5f tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:55.642827 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0f430ba-0be8-4652-a8e5-b4e0ec176c5f tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:55.643492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0f430ba-0be8-4652-a8e5-b4e0ec176c5f tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:55.643992 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0f430ba-0be8-4652-a8e5-b4e0ec176c5f tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:55.644359 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0f430ba-0be8-4652-a8e5-b4e0ec176c5f tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:55.658592 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-c0f430ba-0be8-4652-a8e5-b4e0ec176c5f tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] HTTP exception thrown: Instance 239420ee-3593-46d6-8082-e3c0374a3db1 could not be found. Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c0f430ba-0be8-4652-a8e5-b4e0ec176c5f tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Request method failure captured: Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1 HTTP/1.1 Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjagzzYrrTodN4FRISubmKjZ26J-8BGxkNzLU7x20a3MCWENMarIDjJ9bOlqCettGyQPm3qYerTfS4mUFkwcpl7RJrNB079yuTWGsg7iyYHjYrTBkjIt8CtBBLGQxaQp-7J70wULL21t1iBESs97Rxk-MKHrjWOPMZFqMTCeWGgBIAQ Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 1c307636beed407582da5779796cc6a7 Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c307636beed407582da5779796cc6a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c307636beed407582da5779796cc6a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c307636beed407582da5779796cc6a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c307636beed407582da5779796cc6a7", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 1c307636beed407582da5779796cc6a7 Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-SecurityGroupsTestJSON-1804220727-project Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 30b19896bc4e4d14bfec46dd00519150 Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-SecurityGroupsTestJSON-1804220727-project Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 239420ee-3593-46d6-8082-e3c0374a3db1 could not be found. Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '239420ee-3593-46d6-8082-e3c0374a3db1'} Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 239420ee-3593-46d6-8082-e3c0374a3db1 could not be found. Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 239420ee-3593-46d6-8082-e3c0374a3db1 could not be found. Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:55.660252 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:55.666015 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:55.666015 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:55.666015 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:55.666015 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:06:55.666015 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:06:55.666015 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 239420ee-3593-46d6-8082-e3c0374a3db1 could not be found. Sep 17 21:06:55.666015 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:55.666015 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c0f430ba-0be8-4652-a8e5-b4e0ec176c5f tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Returning 404 to user: Instance 239420ee-3593-46d6-8082-e3c0374a3db1 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:06:55.666015 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c0f430ba-0be8-4652-a8e5-b4e0ec176c5f tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1" status: 404 len: 111 microversion: 2.1 time: 0.031199 Sep 17 21:06:55.666015 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1924/3946] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:55 2022] GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 21:06:55.671673 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-acc8f35e-a97c-491e-bed2-aa537c11b81a tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '.version_select at 0x7f25a9ffe8b0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:55.846066 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-acc8f35e-a97c-491e-bed2-aa537c11b81a tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/ba684ac0-6c05-44af-b18a-53841f44e6cb" status: 202 len: 0 microversion: 2.1 time: 0.178191 Sep 17 21:06:55.846817 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2023/3947] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 21:06:55 2022] DELETE /compute/v2.1/os-security-groups/ba684ac0-6c05-44af-b18a-53841f44e6cb => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:06:55.854894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a3248003-d47a-4301-a174-dc5fd793ae82 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '.version_select at 0x7f25a46a4280>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:56.039597 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a3248003-d47a-4301-a174-dc5fd793ae82 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/bc33fc2f-d673-47c6-a5aa-69d5b66539ef" status: 202 len: 0 microversion: 2.1 time: 0.188534 Sep 17 21:06:56.040374 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1925/3948] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 21:06:55 2022] DELETE /compute/v2.1/os-security-groups/bc33fc2f-d673-47c6-a5aa-69d5b66539ef => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:06:56.054594 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4409a0d2-3180-4d6a-9567-55cc3178d1ee tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Action: 'create', calling method: .version_select at 0x7f25a9f754c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1332072609", "description": "tempest-description-1021674316"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:56.134761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9c6f8a9f-b12e-425c-ba8f-273542a503de tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:56.135838 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9c6f8a9f-b12e-425c-ba8f-273542a503de tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:56.142730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9c6f8a9f-b12e-425c-ba8f-273542a503de tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:56.143487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9c6f8a9f-b12e-425c-ba8f-273542a503de tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:56.144135 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9c6f8a9f-b12e-425c-ba8f-273542a503de tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:56.145056 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9c6f8a9f-b12e-425c-ba8f-273542a503de tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:56.145735 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9c6f8a9f-b12e-425c-ba8f-273542a503de tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:56.146187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9c6f8a9f-b12e-425c-ba8f-273542a503de tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:56.356073 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4409a0d2-3180-4d6a-9567-55cc3178d1ee tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.306394 Sep 17 21:06:56.357330 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2024/3949] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Sep 17 21:06:56 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:56.362526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-73b2a35e-9a12-422b-9124-eb6e43c2a007 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:56.363526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-73b2a35e-9a12-422b-9124-eb6e43c2a007 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:56.371337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-73b2a35e-9a12-422b-9124-eb6e43c2a007 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:56.371882 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-73b2a35e-9a12-422b-9124-eb6e43c2a007 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:56.372602 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-73b2a35e-9a12-422b-9124-eb6e43c2a007 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:56.373577 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-73b2a35e-9a12-422b-9124-eb6e43c2a007 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:56.374449 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-73b2a35e-9a12-422b-9124-eb6e43c2a007 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:56.375683 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-73b2a35e-9a12-422b-9124-eb6e43c2a007 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:56.438618 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9c6f8a9f-b12e-425c-ba8f-273542a503de tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:56.447502 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9c6f8a9f-b12e-425c-ba8f-273542a503de tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d" status: 200 len: 1520 microversion: 2.1 time: 0.317135 Sep 17 21:06:56.457494 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1926/3950] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:56 2022] GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d => generated 1520 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:56.457494 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ae48436f-ba6c-443e-b20f-75e285624dea tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Action: 'update', calling method: .version_select at 0x7f25a46a40d0>, body: {"security_group": {"name": "tempest-sg-hth-344464662", "description": "tempest-description-hth-1717216471"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:56.691823 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-73b2a35e-9a12-422b-9124-eb6e43c2a007 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:56.704896 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-73b2a35e-9a12-422b-9124-eb6e43c2a007 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1505 microversion: 2.1 time: 0.346160 Sep 17 21:06:56.711676 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2025/3951] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:56 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1505 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:56.721954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a62fb112-66bd-4368-aa13-e3a2c9fda6b1 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:56.722773 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a62fb112-66bd-4368-aa13-e3a2c9fda6b1 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 95d8ad94-20c4-43ae-be04-087c3ae43d5b] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:56.729198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a62fb112-66bd-4368-aa13-e3a2c9fda6b1 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:56.730038 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a62fb112-66bd-4368-aa13-e3a2c9fda6b1 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:56.730475 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a62fb112-66bd-4368-aa13-e3a2c9fda6b1 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:56.731178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a62fb112-66bd-4368-aa13-e3a2c9fda6b1 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:56.731623 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a62fb112-66bd-4368-aa13-e3a2c9fda6b1 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:56.732043 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a62fb112-66bd-4368-aa13-e3a2c9fda6b1 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:56.880523 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ae48436f-ba6c-443e-b20f-75e285624dea tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "PUT /compute/v2.1/os-security-groups/61558b3c-7aae-4969-8f3a-a5e9d81aa4ac" status: 200 len: 217 microversion: 2.1 time: 0.430136 Sep 17 21:06:56.881129 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1927/3952] 10.222.0.26 () {60 vars in 1290 bytes} [Sat Sep 17 21:06:56 2022] PUT /compute/v2.1/os-security-groups/61558b3c-7aae-4969-8f3a-a5e9d81aa4ac => generated 217 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:06:56.895416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f108030f-3177-4a4d-a1dd-7432a50be190 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '.version_select at 0x7f25a4698940>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:57.027065 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a62fb112-66bd-4368-aa13-e3a2c9fda6b1 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33784305478f46ae9fdc4d4b82ebc6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e857c532a264ea78e24fd8fe1a44fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:57.036518 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a62fb112-66bd-4368-aa13-e3a2c9fda6b1 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "GET /compute/v2.1/servers/95d8ad94-20c4-43ae-be04-087c3ae43d5b" status: 200 len: 1314 microversion: 2.1 time: 0.318960 Sep 17 21:06:57.037562 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2026/3953] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:56 2022] GET /compute/v2.1/servers/95d8ad94-20c4-43ae-be04-087c3ae43d5b => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:57.056370 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f108030f-3177-4a4d-a1dd-7432a50be190 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/61558b3c-7aae-4969-8f3a-a5e9d81aa4ac" status: 200 len: 217 microversion: 2.1 time: 0.164737 Sep 17 21:06:57.057251 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1928/3954] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Sep 17 21:06:56 2022] GET /compute/v2.1/os-security-groups/61558b3c-7aae-4969-8f3a-a5e9d81aa4ac => generated 217 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:06:57.072372 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-61b95f4e-a17d-4a72-b360-f03a8e701772 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '.version_select at 0x7f25a9f75d30>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:57.258621 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-61b95f4e-a17d-4a72-b360-f03a8e701772 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/61558b3c-7aae-4969-8f3a-a5e9d81aa4ac" status: 202 len: 0 microversion: 2.1 time: 0.191638 Sep 17 21:06:57.259324 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2027/3955] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 21:06:57 2022] DELETE /compute/v2.1/os-security-groups/61558b3c-7aae-4969-8f3a-a5e9d81aa4ac => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:06:57.268218 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3975580d-43c6-4ed2-9fdf-6250c44a6435 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:57.268862 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3975580d-43c6-4ed2-9fdf-6250c44a6435 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: 239420ee-3593-46d6-8082-e3c0374a3db1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:57.275971 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3975580d-43c6-4ed2-9fdf-6250c44a6435 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:57.276476 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3975580d-43c6-4ed2-9fdf-6250c44a6435 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:57.276900 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3975580d-43c6-4ed2-9fdf-6250c44a6435 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:57.277651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3975580d-43c6-4ed2-9fdf-6250c44a6435 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:57.278104 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3975580d-43c6-4ed2-9fdf-6250c44a6435 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:57.278564 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3975580d-43c6-4ed2-9fdf-6250c44a6435 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:57.292642 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-3975580d-43c6-4ed2-9fdf-6250c44a6435 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] HTTP exception thrown: Instance 239420ee-3593-46d6-8082-e3c0374a3db1 could not be found. Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3975580d-43c6-4ed2-9fdf-6250c44a6435 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Request method failure captured: Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1 HTTP/1.1 Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjagzzYrrTodN4FRISubmKjZ26J-8BGxkNzLU7x20a3MCWENMarIDjJ9bOlqCettGyQPm3qYerTfS4mUFkwcpl7RJrNB079yuTWGsg7iyYHjYrTBkjIt8CtBBLGQxaQp-7J70wULL21t1iBESs97Rxk-MKHrjWOPMZFqMTCeWGgBIAQ Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 1c307636beed407582da5779796cc6a7 Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c307636beed407582da5779796cc6a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c307636beed407582da5779796cc6a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c307636beed407582da5779796cc6a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c307636beed407582da5779796cc6a7", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 1c307636beed407582da5779796cc6a7 Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-SecurityGroupsTestJSON-1804220727-project Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 30b19896bc4e4d14bfec46dd00519150 Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-SecurityGroupsTestJSON-1804220727-project Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 239420ee-3593-46d6-8082-e3c0374a3db1 could not be found. Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '239420ee-3593-46d6-8082-e3c0374a3db1'} Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 239420ee-3593-46d6-8082-e3c0374a3db1 could not be found. Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:06:57.294283 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:06:57.300047 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 239420ee-3593-46d6-8082-e3c0374a3db1 could not be found. Sep 17 21:06:57.300047 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.300047 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:57.300047 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.300047 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:57.300047 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:57.300047 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:57.300047 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:06:57.300047 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:06:57.300047 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 239420ee-3593-46d6-8082-e3c0374a3db1 could not be found. Sep 17 21:06:57.300047 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.300047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3975580d-43c6-4ed2-9fdf-6250c44a6435 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Returning 404 to user: Instance 239420ee-3593-46d6-8082-e3c0374a3db1 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:06:57.300047 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3975580d-43c6-4ed2-9fdf-6250c44a6435 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "DELETE /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1" status: 404 len: 111 microversion: 2.1 time: 0.032220 Sep 17 21:06:57.300047 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1929/3956] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:06:57 2022] DELETE /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:06:57.304566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7c884110-3e5d-4808-bc65-ca313dcf57ab tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:57.305635 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7c884110-3e5d-4808-bc65-ca313dcf57ab tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: 239420ee-3593-46d6-8082-e3c0374a3db1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:57.312144 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7c884110-3e5d-4808-bc65-ca313dcf57ab tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:57.312639 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7c884110-3e5d-4808-bc65-ca313dcf57ab tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:57.313085 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7c884110-3e5d-4808-bc65-ca313dcf57ab tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:57.313871 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7c884110-3e5d-4808-bc65-ca313dcf57ab tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:57.314365 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7c884110-3e5d-4808-bc65-ca313dcf57ab tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:57.314801 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7c884110-3e5d-4808-bc65-ca313dcf57ab tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:57.330631 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-7c884110-3e5d-4808-bc65-ca313dcf57ab tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] HTTP exception thrown: Instance 239420ee-3593-46d6-8082-e3c0374a3db1 could not be found. Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7c884110-3e5d-4808-bc65-ca313dcf57ab tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Request method failure captured: Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1 HTTP/1.1 Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjagzzYrrTodN4FRISubmKjZ26J-8BGxkNzLU7x20a3MCWENMarIDjJ9bOlqCettGyQPm3qYerTfS4mUFkwcpl7RJrNB079yuTWGsg7iyYHjYrTBkjIt8CtBBLGQxaQp-7J70wULL21t1iBESs97Rxk-MKHrjWOPMZFqMTCeWGgBIAQ Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 1c307636beed407582da5779796cc6a7 Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c307636beed407582da5779796cc6a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c307636beed407582da5779796cc6a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c307636beed407582da5779796cc6a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c307636beed407582da5779796cc6a7", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 1c307636beed407582da5779796cc6a7 Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-SecurityGroupsTestJSON-1804220727-project Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 30b19896bc4e4d14bfec46dd00519150 Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-SecurityGroupsTestJSON-1804220727-project Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 239420ee-3593-46d6-8082-e3c0374a3db1 could not be found. Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '239420ee-3593-46d6-8082-e3c0374a3db1'} Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 239420ee-3593-46d6-8082-e3c0374a3db1 could not be found. Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 239420ee-3593-46d6-8082-e3c0374a3db1 could not be found. Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:57.332306 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.337295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:57.337295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:57.337295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:57.337295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:06:57.337295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:06:57.337295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 239420ee-3593-46d6-8082-e3c0374a3db1 could not be found. Sep 17 21:06:57.337295 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.337295 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7c884110-3e5d-4808-bc65-ca313dcf57ab tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Returning 404 to user: Instance 239420ee-3593-46d6-8082-e3c0374a3db1 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:06:57.337295 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7c884110-3e5d-4808-bc65-ca313dcf57ab tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1" status: 404 len: 111 microversion: 2.1 time: 0.033208 Sep 17 21:06:57.337295 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2028/3957] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:57 2022] GET /compute/v2.1/servers/239420ee-3593-46d6-8082-e3c0374a3db1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:06:57.348100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-373f265f-947c-41d6-abff-3c45ecd0e9fc tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '.version_select at 0x7f25a4710040>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:57.372248 ncdv-master-1 devstack@n-api.service[140523]: DEBUG neutronclient.v2_0.client [None req-373f265f-947c-41d6-abff-3c45ecd0e9fc tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bc33fc2f-d673-47c6-a5aa-69d5b66539ef does not exist", "detail": ""}} {{(pid=140523) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 17 21:06:57.372864 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.security_group_api [None req-373f265f-947c-41d6-abff-3c45ecd0e9fc tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Neutron security group bc33fc2f-d673-47c6-a5aa-69d5b66539ef not found {{(pid=140523) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 17 21:06:57.373394 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-373f265f-947c-41d6-abff-3c45ecd0e9fc tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] HTTP exception thrown: Security group bc33fc2f-d673-47c6-a5aa-69d5b66539ef does not exist Sep 17 21:06:57.373394 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-8ff0ae08-eb94-48b9-8292-deefd7c725e3'] Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-373f265f-947c-41d6-abff-3c45ecd0e9fc tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Request method failure captured: Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/os-security-groups/bc33fc2f-d673-47c6-a5aa-69d5b66539ef HTTP/1.1 Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjagzzYrrTodN4FRISubmKjZ26J-8BGxkNzLU7x20a3MCWENMarIDjJ9bOlqCettGyQPm3qYerTfS4mUFkwcpl7RJrNB079yuTWGsg7iyYHjYrTBkjIt8CtBBLGQxaQp-7J70wULL21t1iBESs97Rxk-MKHrjWOPMZFqMTCeWGgBIAQ Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 1c307636beed407582da5779796cc6a7 Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c307636beed407582da5779796cc6a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c307636beed407582da5779796cc6a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c307636beed407582da5779796cc6a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c307636beed407582da5779796cc6a7", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 1c307636beed407582da5779796cc6a7 Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-SecurityGroupsTestJSON-1804220727-project Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 30b19896bc4e4d14bfec46dd00519150 Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-SecurityGroupsTestJSON-1804220727-project Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: exception: Security group bc33fc2f-d673-47c6-a5aa-69d5b66539ef does not exist Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-8ff0ae08-eb94-48b9-8292-deefd7c725e3'] Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'bc33fc2f-d673-47c6-a5aa-69d5b66539ef'} Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 17 21:06:57.375274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bc33fc2f-d673-47c6-a5aa-69d5b66539ef does not exist Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ff0ae08-eb94-48b9-8292-deefd7c725e3'] Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bc33fc2f-d673-47c6-a5aa-69d5b66539ef does not exist Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ff0ae08-eb94-48b9-8292-deefd7c725e3'] Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bc33fc2f-d673-47c6-a5aa-69d5b66539ef does not exist Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ff0ae08-eb94-48b9-8292-deefd7c725e3'] Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bc33fc2f-d673-47c6-a5aa-69d5b66539ef does not exist Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ff0ae08-eb94-48b9-8292-deefd7c725e3'] Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-373f265f-947c-41d6-abff-3c45ecd0e9fc tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Returning 404 to user: Security group bc33fc2f-d673-47c6-a5aa-69d5b66539ef does not exist Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-8ff0ae08-eb94-48b9-8292-deefd7c725e3'] {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-373f265f-947c-41d6-abff-3c45ecd0e9fc tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/bc33fc2f-d673-47c6-a5aa-69d5b66539ef" status: 404 len: 194 microversion: 2.1 time: 0.037779 Sep 17 21:06:57.381607 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1930/3958] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 21:06:57 2022] DELETE /compute/v2.1/os-security-groups/bc33fc2f-d673-47c6-a5aa-69d5b66539ef => generated 194 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:06:57.389692 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2bffb8bb-67b2-4799-ba7f-d9867ea447ab tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '.version_select at 0x7f25a5948700>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:57.421973 ncdv-master-1 devstack@n-api.service[140524]: DEBUG neutronclient.v2_0.client [None req-2bffb8bb-67b2-4799-ba7f-d9867ea447ab tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ba684ac0-6c05-44af-b18a-53841f44e6cb does not exist", "detail": ""}} {{(pid=140524) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 17 21:06:57.423146 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.security_group_api [None req-2bffb8bb-67b2-4799-ba7f-d9867ea447ab tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Neutron security group ba684ac0-6c05-44af-b18a-53841f44e6cb not found {{(pid=140524) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 17 21:06:57.423871 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-2bffb8bb-67b2-4799-ba7f-d9867ea447ab tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] HTTP exception thrown: Security group ba684ac0-6c05-44af-b18a-53841f44e6cb does not exist Sep 17 21:06:57.423871 ncdv-master-1 devstack@n-api.service[140524]: Neutron server returns request_ids: ['req-b3184b52-5b81-4182-b0a3-6e2c2facd89f'] Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2bffb8bb-67b2-4799-ba7f-d9867ea447ab tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Request method failure captured: Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/os-security-groups/ba684ac0-6c05-44af-b18a-53841f44e6cb HTTP/1.1 Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjagzzYrrTodN4FRISubmKjZ26J-8BGxkNzLU7x20a3MCWENMarIDjJ9bOlqCettGyQPm3qYerTfS4mUFkwcpl7RJrNB079yuTWGsg7iyYHjYrTBkjIt8CtBBLGQxaQp-7J70wULL21t1iBESs97Rxk-MKHrjWOPMZFqMTCeWGgBIAQ Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 1c307636beed407582da5779796cc6a7 Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c307636beed407582da5779796cc6a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c307636beed407582da5779796cc6a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c307636beed407582da5779796cc6a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c307636beed407582da5779796cc6a7", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 1c307636beed407582da5779796cc6a7 Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-SecurityGroupsTestJSON-1804220727-project Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 30b19896bc4e4d14bfec46dd00519150 Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-SecurityGroupsTestJSON-1804220727-project Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: exception: Security group ba684ac0-6c05-44af-b18a-53841f44e6cb does not exist Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: Neutron server returns request_ids: ['req-b3184b52-5b81-4182-b0a3-6e2c2facd89f'] Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'ba684ac0-6c05-44af-b18a-53841f44e6cb'} Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 17 21:06:57.426031 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ba684ac0-6c05-44af-b18a-53841f44e6cb does not exist Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b3184b52-5b81-4182-b0a3-6e2c2facd89f'] Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ba684ac0-6c05-44af-b18a-53841f44e6cb does not exist Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b3184b52-5b81-4182-b0a3-6e2c2facd89f'] Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ba684ac0-6c05-44af-b18a-53841f44e6cb does not exist Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b3184b52-5b81-4182-b0a3-6e2c2facd89f'] Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ba684ac0-6c05-44af-b18a-53841f44e6cb does not exist Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b3184b52-5b81-4182-b0a3-6e2c2facd89f'] Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2bffb8bb-67b2-4799-ba7f-d9867ea447ab tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Returning 404 to user: Security group ba684ac0-6c05-44af-b18a-53841f44e6cb does not exist Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: Neutron server returns request_ids: ['req-b3184b52-5b81-4182-b0a3-6e2c2facd89f'] {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2bffb8bb-67b2-4799-ba7f-d9867ea447ab tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/ba684ac0-6c05-44af-b18a-53841f44e6cb" status: 404 len: 194 microversion: 2.1 time: 0.044065 Sep 17 21:06:57.431453 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2029/3959] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 21:06:57 2022] DELETE /compute/v2.1/os-security-groups/ba684ac0-6c05-44af-b18a-53841f44e6cb => generated 194 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:06:57.439394 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-03d5c93b-379f-4a48-933b-0208a9bf0026 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '.version_select at 0x7f25a50b1550>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:57.467467 ncdv-master-1 devstack@n-api.service[140523]: DEBUG neutronclient.v2_0.client [None req-03d5c93b-379f-4a48-933b-0208a9bf0026 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 93aefc96-b12c-485e-a2aa-1241d93cec49 does not exist", "detail": ""}} {{(pid=140523) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 17 21:06:57.468097 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.security_group_api [None req-03d5c93b-379f-4a48-933b-0208a9bf0026 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Neutron security group 93aefc96-b12c-485e-a2aa-1241d93cec49 not found {{(pid=140523) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 17 21:06:57.468702 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-03d5c93b-379f-4a48-933b-0208a9bf0026 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] HTTP exception thrown: Security group 93aefc96-b12c-485e-a2aa-1241d93cec49 does not exist Sep 17 21:06:57.468702 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-1e1f4b69-600a-4ab7-9a80-18bfd0f5589a'] Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-03d5c93b-379f-4a48-933b-0208a9bf0026 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Request method failure captured: Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/os-security-groups/93aefc96-b12c-485e-a2aa-1241d93cec49 HTTP/1.1 Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjagzzYrrTodN4FRISubmKjZ26J-8BGxkNzLU7x20a3MCWENMarIDjJ9bOlqCettGyQPm3qYerTfS4mUFkwcpl7RJrNB079yuTWGsg7iyYHjYrTBkjIt8CtBBLGQxaQp-7J70wULL21t1iBESs97Rxk-MKHrjWOPMZFqMTCeWGgBIAQ Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 1c307636beed407582da5779796cc6a7 Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c307636beed407582da5779796cc6a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c307636beed407582da5779796cc6a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c307636beed407582da5779796cc6a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c307636beed407582da5779796cc6a7", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 1c307636beed407582da5779796cc6a7 Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-SecurityGroupsTestJSON-1804220727-project Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 30b19896bc4e4d14bfec46dd00519150 Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-SecurityGroupsTestJSON-1804220727-project Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: exception: Security group 93aefc96-b12c-485e-a2aa-1241d93cec49 does not exist Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-1e1f4b69-600a-4ab7-9a80-18bfd0f5589a'] Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '93aefc96-b12c-485e-a2aa-1241d93cec49'} Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 17 21:06:57.471011 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 93aefc96-b12c-485e-a2aa-1241d93cec49 does not exist Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e1f4b69-600a-4ab7-9a80-18bfd0f5589a'] Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 93aefc96-b12c-485e-a2aa-1241d93cec49 does not exist Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e1f4b69-600a-4ab7-9a80-18bfd0f5589a'] Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 93aefc96-b12c-485e-a2aa-1241d93cec49 does not exist Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e1f4b69-600a-4ab7-9a80-18bfd0f5589a'] Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 93aefc96-b12c-485e-a2aa-1241d93cec49 does not exist Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1e1f4b69-600a-4ab7-9a80-18bfd0f5589a'] Sep 17 21:06:57.477615 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.482016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5a40588d-3e06-4ce1-bffa-1eb04418e789 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:57.482016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5a40588d-3e06-4ce1-bffa-1eb04418e789 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:57.484921 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-03d5c93b-379f-4a48-933b-0208a9bf0026 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Returning 404 to user: Security group 93aefc96-b12c-485e-a2aa-1241d93cec49 does not exist Sep 17 21:06:57.484921 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-1e1f4b69-600a-4ab7-9a80-18bfd0f5589a'] {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:06:57.484921 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-03d5c93b-379f-4a48-933b-0208a9bf0026 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/93aefc96-b12c-485e-a2aa-1241d93cec49" status: 404 len: 194 microversion: 2.1 time: 0.050050 Sep 17 21:06:57.485266 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a40588d-3e06-4ce1-bffa-1eb04418e789 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:57.485933 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a40588d-3e06-4ce1-bffa-1eb04418e789 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:57.486332 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1931/3960] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 21:06:57 2022] DELETE /compute/v2.1/os-security-groups/93aefc96-b12c-485e-a2aa-1241d93cec49 => generated 194 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 21:06:57.486950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a40588d-3e06-4ce1-bffa-1eb04418e789 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:57.487872 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a40588d-3e06-4ce1-bffa-1eb04418e789 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:57.488365 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a40588d-3e06-4ce1-bffa-1eb04418e789 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:57.489239 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a40588d-3e06-4ce1-bffa-1eb04418e789 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:57.495925 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9bc75622-adf5-4711-9cdd-92ec1ca54532 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '.version_select at 0x7f25a46a4dc0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:57.523078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG neutronclient.v2_0.client [None req-9bc75622-adf5-4711-9cdd-92ec1ca54532 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a80e1c26-e0f7-482b-b455-277f83554c94 does not exist", "detail": ""}} {{(pid=140523) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 17 21:06:57.524645 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.security_group_api [None req-9bc75622-adf5-4711-9cdd-92ec1ca54532 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Neutron security group a80e1c26-e0f7-482b-b455-277f83554c94 not found {{(pid=140523) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 17 21:06:57.524645 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-9bc75622-adf5-4711-9cdd-92ec1ca54532 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] HTTP exception thrown: Security group a80e1c26-e0f7-482b-b455-277f83554c94 does not exist Sep 17 21:06:57.524645 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-3fa83f2f-890a-4143-adea-b11a412a9268'] Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9bc75622-adf5-4711-9cdd-92ec1ca54532 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Request method failure captured: Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/os-security-groups/a80e1c26-e0f7-482b-b455-277f83554c94 HTTP/1.1 Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjagzzYrrTodN4FRISubmKjZ26J-8BGxkNzLU7x20a3MCWENMarIDjJ9bOlqCettGyQPm3qYerTfS4mUFkwcpl7RJrNB079yuTWGsg7iyYHjYrTBkjIt8CtBBLGQxaQp-7J70wULL21t1iBESs97Rxk-MKHrjWOPMZFqMTCeWGgBIAQ Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 1c307636beed407582da5779796cc6a7 Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c307636beed407582da5779796cc6a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c307636beed407582da5779796cc6a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c307636beed407582da5779796cc6a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c307636beed407582da5779796cc6a7", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 1c307636beed407582da5779796cc6a7 Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-SecurityGroupsTestJSON-1804220727-project Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 30b19896bc4e4d14bfec46dd00519150 Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-SecurityGroupsTestJSON-1804220727-project Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: exception: Security group a80e1c26-e0f7-482b-b455-277f83554c94 does not exist Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-3fa83f2f-890a-4143-adea-b11a412a9268'] Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'a80e1c26-e0f7-482b-b455-277f83554c94'} Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 17 21:06:57.526068 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a80e1c26-e0f7-482b-b455-277f83554c94 does not exist Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fa83f2f-890a-4143-adea-b11a412a9268'] Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a80e1c26-e0f7-482b-b455-277f83554c94 does not exist Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fa83f2f-890a-4143-adea-b11a412a9268'] Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a80e1c26-e0f7-482b-b455-277f83554c94 does not exist Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fa83f2f-890a-4143-adea-b11a412a9268'] Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a80e1c26-e0f7-482b-b455-277f83554c94 does not exist Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3fa83f2f-890a-4143-adea-b11a412a9268'] Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9bc75622-adf5-4711-9cdd-92ec1ca54532 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Returning 404 to user: Security group a80e1c26-e0f7-482b-b455-277f83554c94 does not exist Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-3fa83f2f-890a-4143-adea-b11a412a9268'] {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9bc75622-adf5-4711-9cdd-92ec1ca54532 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/a80e1c26-e0f7-482b-b455-277f83554c94" status: 404 len: 194 microversion: 2.1 time: 0.037157 Sep 17 21:06:57.534699 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1932/3961] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 21:06:57 2022] DELETE /compute/v2.1/os-security-groups/a80e1c26-e0f7-482b-b455-277f83554c94 => generated 194 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 21:06:57.539632 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-85510842-e581-491d-86e5-12d781452d05 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '.version_select at 0x7f25a47100d0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:57.594582 ncdv-master-1 devstack@n-api.service[140523]: DEBUG neutronclient.v2_0.client [None req-85510842-e581-491d-86e5-12d781452d05 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f5d34982-45f8-4a12-a18d-8a04c50509c5 does not exist", "detail": ""}} {{(pid=140523) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 17 21:06:57.595246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.security_group_api [None req-85510842-e581-491d-86e5-12d781452d05 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Neutron security group f5d34982-45f8-4a12-a18d-8a04c50509c5 not found {{(pid=140523) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 17 21:06:57.595776 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-85510842-e581-491d-86e5-12d781452d05 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] HTTP exception thrown: Security group f5d34982-45f8-4a12-a18d-8a04c50509c5 does not exist Sep 17 21:06:57.595776 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-b29fca2c-fff0-4f9d-a97b-f40505b2d313'] Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-85510842-e581-491d-86e5-12d781452d05 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Request method failure captured: Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/os-security-groups/f5d34982-45f8-4a12-a18d-8a04c50509c5 HTTP/1.1 Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjagzzYrrTodN4FRISubmKjZ26J-8BGxkNzLU7x20a3MCWENMarIDjJ9bOlqCettGyQPm3qYerTfS4mUFkwcpl7RJrNB079yuTWGsg7iyYHjYrTBkjIt8CtBBLGQxaQp-7J70wULL21t1iBESs97Rxk-MKHrjWOPMZFqMTCeWGgBIAQ Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 1c307636beed407582da5779796cc6a7 Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c307636beed407582da5779796cc6a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c307636beed407582da5779796cc6a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c307636beed407582da5779796cc6a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c307636beed407582da5779796cc6a7", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 1c307636beed407582da5779796cc6a7 Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-SecurityGroupsTestJSON-1804220727-project Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 30b19896bc4e4d14bfec46dd00519150 Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-SecurityGroupsTestJSON-1804220727-project Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: exception: Security group f5d34982-45f8-4a12-a18d-8a04c50509c5 does not exist Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-b29fca2c-fff0-4f9d-a97b-f40505b2d313'] Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'f5d34982-45f8-4a12-a18d-8a04c50509c5'} Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 17 21:06:57.597714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f5d34982-45f8-4a12-a18d-8a04c50509c5 does not exist Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b29fca2c-fff0-4f9d-a97b-f40505b2d313'] Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f5d34982-45f8-4a12-a18d-8a04c50509c5 does not exist Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b29fca2c-fff0-4f9d-a97b-f40505b2d313'] Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f5d34982-45f8-4a12-a18d-8a04c50509c5 does not exist Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b29fca2c-fff0-4f9d-a97b-f40505b2d313'] Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f5d34982-45f8-4a12-a18d-8a04c50509c5 does not exist Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b29fca2c-fff0-4f9d-a97b-f40505b2d313'] Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-85510842-e581-491d-86e5-12d781452d05 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Returning 404 to user: Security group f5d34982-45f8-4a12-a18d-8a04c50509c5 does not exist Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-b29fca2c-fff0-4f9d-a97b-f40505b2d313'] {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-85510842-e581-491d-86e5-12d781452d05 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/f5d34982-45f8-4a12-a18d-8a04c50509c5" status: 404 len: 194 microversion: 2.1 time: 0.066560 Sep 17 21:06:57.603391 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1933/3962] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 21:06:57 2022] DELETE /compute/v2.1/os-security-groups/f5d34982-45f8-4a12-a18d-8a04c50509c5 => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:06:57.612046 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2941a77f-a9ea-4cdd-9076-f94070bfb4e0 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '.version_select at 0x7f25a4721ca0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:57.670357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG neutronclient.v2_0.client [None req-2941a77f-a9ea-4cdd-9076-f94070bfb4e0 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dcd95a86-d8a6-489b-b971-f75c6de55aed does not exist", "detail": ""}} {{(pid=140523) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 17 21:06:57.671356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.security_group_api [None req-2941a77f-a9ea-4cdd-9076-f94070bfb4e0 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Neutron security group dcd95a86-d8a6-489b-b971-f75c6de55aed not found {{(pid=140523) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 17 21:06:57.672320 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-2941a77f-a9ea-4cdd-9076-f94070bfb4e0 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] HTTP exception thrown: Security group dcd95a86-d8a6-489b-b971-f75c6de55aed does not exist Sep 17 21:06:57.672320 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-7140b9af-4ef1-40f7-b75b-88c864bf8cf5'] Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2941a77f-a9ea-4cdd-9076-f94070bfb4e0 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Request method failure captured: Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/os-security-groups/dcd95a86-d8a6-489b-b971-f75c6de55aed HTTP/1.1 Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjagzzYrrTodN4FRISubmKjZ26J-8BGxkNzLU7x20a3MCWENMarIDjJ9bOlqCettGyQPm3qYerTfS4mUFkwcpl7RJrNB079yuTWGsg7iyYHjYrTBkjIt8CtBBLGQxaQp-7J70wULL21t1iBESs97Rxk-MKHrjWOPMZFqMTCeWGgBIAQ Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 1c307636beed407582da5779796cc6a7 Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c307636beed407582da5779796cc6a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c307636beed407582da5779796cc6a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c307636beed407582da5779796cc6a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c307636beed407582da5779796cc6a7", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 1c307636beed407582da5779796cc6a7 Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-SecurityGroupsTestJSON-1804220727-project Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 30b19896bc4e4d14bfec46dd00519150 Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-SecurityGroupsTestJSON-1804220727-project Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: exception: Security group dcd95a86-d8a6-489b-b971-f75c6de55aed does not exist Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-7140b9af-4ef1-40f7-b75b-88c864bf8cf5'] Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'dcd95a86-d8a6-489b-b971-f75c6de55aed'} Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 17 21:06:57.675906 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dcd95a86-d8a6-489b-b971-f75c6de55aed does not exist Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7140b9af-4ef1-40f7-b75b-88c864bf8cf5'] Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dcd95a86-d8a6-489b-b971-f75c6de55aed does not exist Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7140b9af-4ef1-40f7-b75b-88c864bf8cf5'] Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dcd95a86-d8a6-489b-b971-f75c6de55aed does not exist Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7140b9af-4ef1-40f7-b75b-88c864bf8cf5'] Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dcd95a86-d8a6-489b-b971-f75c6de55aed does not exist Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7140b9af-4ef1-40f7-b75b-88c864bf8cf5'] Sep 17 21:06:57.680694 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:06:57.684406 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2941a77f-a9ea-4cdd-9076-f94070bfb4e0 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Returning 404 to user: Security group dcd95a86-d8a6-489b-b971-f75c6de55aed does not exist Sep 17 21:06:57.684406 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-7140b9af-4ef1-40f7-b75b-88c864bf8cf5'] {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:06:57.687641 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2941a77f-a9ea-4cdd-9076-f94070bfb4e0 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/dcd95a86-d8a6-489b-b971-f75c6de55aed" status: 404 len: 194 microversion: 2.1 time: 0.079047 Sep 17 21:06:57.693752 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1934/3963] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 21:06:57 2022] DELETE /compute/v2.1/os-security-groups/dcd95a86-d8a6-489b-b971-f75c6de55aed => generated 194 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:06:57.701990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-37bf5f78-4072-4fc6-b46c-4e783b2727e3 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:57.702717 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-37bf5f78-4072-4fc6-b46c-4e783b2727e3 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:57.705011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5a40588d-3e06-4ce1-bffa-1eb04418e789 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:57.711804 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-37bf5f78-4072-4fc6-b46c-4e783b2727e3 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:57.711804 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-37bf5f78-4072-4fc6-b46c-4e783b2727e3 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:57.713738 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5a40588d-3e06-4ce1-bffa-1eb04418e789 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d" status: 200 len: 1520 microversion: 2.1 time: 0.242562 Sep 17 21:06:57.713941 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-37bf5f78-4072-4fc6-b46c-4e783b2727e3 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:57.714799 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-37bf5f78-4072-4fc6-b46c-4e783b2727e3 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:57.715751 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-37bf5f78-4072-4fc6-b46c-4e783b2727e3 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:57.716290 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-37bf5f78-4072-4fc6-b46c-4e783b2727e3 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:57.728619 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2030/3964] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:57 2022] GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:57.737246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-32f889fe-be1f-4c6f-93c2-25a977f96e6b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:57.737908 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-32f889fe-be1f-4c6f-93c2-25a977f96e6b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:57.744653 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32f889fe-be1f-4c6f-93c2-25a977f96e6b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:57.745148 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32f889fe-be1f-4c6f-93c2-25a977f96e6b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:57.745633 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32f889fe-be1f-4c6f-93c2-25a977f96e6b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:57.746344 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32f889fe-be1f-4c6f-93c2-25a977f96e6b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:57.746796 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32f889fe-be1f-4c6f-93c2-25a977f96e6b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:57.747220 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32f889fe-be1f-4c6f-93c2-25a977f96e6b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:57.752751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:57.763389 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-37bf5f78-4072-4fc6-b46c-4e783b2727e3 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:06:57.865230 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-37bf5f78-4072-4fc6-b46c-4e783b2727e3 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807" status: 204 len: 0 microversion: 2.1 time: 0.165853 Sep 17 21:06:57.866135 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1935/3965] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:06:57 2022] DELETE /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:06:57.877021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-89147054-ef43-417d-829f-d3b446837a11 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:57.877832 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-89147054-ef43-417d-829f-d3b446837a11 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:57.885942 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89147054-ef43-417d-829f-d3b446837a11 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:57.886604 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89147054-ef43-417d-829f-d3b446837a11 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:57.887097 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89147054-ef43-417d-829f-d3b446837a11 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:57.888017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89147054-ef43-417d-829f-d3b446837a11 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:57.888889 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89147054-ef43-417d-829f-d3b446837a11 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:57.889572 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89147054-ef43-417d-829f-d3b446837a11 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:57.907970 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-32f889fe-be1f-4c6f-93c2-25a977f96e6b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:57.918488 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-32f889fe-be1f-4c6f-93c2-25a977f96e6b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1505 microversion: 2.1 time: 0.188776 Sep 17 21:06:57.919080 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2031/3966] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:57 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1505 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:58.057623 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-89147054-ef43-417d-829f-d3b446837a11 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b19896bc4e4d14bfec46dd00519150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c307636beed407582da5779796cc6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:58.059975 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5bed1ef2-254d-4e36-a4e7-4b6432ded9fe tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:58.060586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5bed1ef2-254d-4e36-a4e7-4b6432ded9fe tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 95d8ad94-20c4-43ae-be04-087c3ae43d5b] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:58.066801 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5bed1ef2-254d-4e36-a4e7-4b6432ded9fe tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:58.067292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5bed1ef2-254d-4e36-a4e7-4b6432ded9fe tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:58.067446 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-89147054-ef43-417d-829f-d3b446837a11 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807" status: 200 len: 1645 microversion: 2.1 time: 0.195964 Sep 17 21:06:58.067733 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5bed1ef2-254d-4e36-a4e7-4b6432ded9fe tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:58.068430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5bed1ef2-254d-4e36-a4e7-4b6432ded9fe tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:58.068588 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1936/3967] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:57 2022] GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807 => generated 1645 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:58.069187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5bed1ef2-254d-4e36-a4e7-4b6432ded9fe tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:58.069648 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5bed1ef2-254d-4e36-a4e7-4b6432ded9fe tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:58.210383 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5bed1ef2-254d-4e36-a4e7-4b6432ded9fe tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33784305478f46ae9fdc4d4b82ebc6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e857c532a264ea78e24fd8fe1a44fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:58.218688 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5bed1ef2-254d-4e36-a4e7-4b6432ded9fe tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "GET /compute/v2.1/servers/95d8ad94-20c4-43ae-be04-087c3ae43d5b" status: 200 len: 1314 microversion: 2.1 time: 0.162528 Sep 17 21:06:58.219267 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2032/3968] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:58 2022] GET /compute/v2.1/servers/95d8ad94-20c4-43ae-be04-087c3ae43d5b => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:58.739460 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6784cb79-093d-4b50-bacc-92d6a684f8de tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:58.740081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6784cb79-093d-4b50-bacc-92d6a684f8de tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:58.746896 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6784cb79-093d-4b50-bacc-92d6a684f8de tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:58.747577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6784cb79-093d-4b50-bacc-92d6a684f8de tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:58.748385 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6784cb79-093d-4b50-bacc-92d6a684f8de tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:58.749302 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6784cb79-093d-4b50-bacc-92d6a684f8de tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:58.749792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6784cb79-093d-4b50-bacc-92d6a684f8de tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:58.750370 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6784cb79-093d-4b50-bacc-92d6a684f8de tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:58.880265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:58.889001 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6784cb79-093d-4b50-bacc-92d6a684f8de tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:58.898049 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6784cb79-093d-4b50-bacc-92d6a684f8de tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d" status: 200 len: 1520 microversion: 2.1 time: 0.162308 Sep 17 21:06:58.898637 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1937/3969] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:58 2022] GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:06:58.942549 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5075f798-b915-4c87-9367-efbb1e00362d tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:58.942931 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5075f798-b915-4c87-9367-efbb1e00362d tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:58.945444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:58.946236 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=6 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:06:58.952233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5075f798-b915-4c87-9367-efbb1e00362d tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:58.952725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5075f798-b915-4c87-9367-efbb1e00362d tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:58.953164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5075f798-b915-4c87-9367-efbb1e00362d tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:58.953900 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5075f798-b915-4c87-9367-efbb1e00362d tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:58.954355 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5075f798-b915-4c87-9367-efbb1e00362d tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:58.954780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5075f798-b915-4c87-9367-efbb1e00362d tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:59.088495 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5075f798-b915-4c87-9367-efbb1e00362d tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:59.091171 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-516ffcdb-ab03-4222-bb62-cedd1455a0d4 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:59.092006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-516ffcdb-ab03-4222-bb62-cedd1455a0d4 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:59.097679 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5075f798-b915-4c87-9367-efbb1e00362d tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1505 microversion: 2.1 time: 0.159197 Sep 17 21:06:59.098609 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2033/3970] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:58 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:59.098835 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-516ffcdb-ab03-4222-bb62-cedd1455a0d4 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:59.099322 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-516ffcdb-ab03-4222-bb62-cedd1455a0d4 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:59.099758 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-516ffcdb-ab03-4222-bb62-cedd1455a0d4 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:59.100905 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-516ffcdb-ab03-4222-bb62-cedd1455a0d4 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:59.101365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-516ffcdb-ab03-4222-bb62-cedd1455a0d4 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:59.102184 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-516ffcdb-ab03-4222-bb62-cedd1455a0d4 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:59.246813 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ce43c3ac-9a7d-4c85-bac7-e5c55f78edba tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:59.247939 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ce43c3ac-9a7d-4c85-bac7-e5c55f78edba tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 95d8ad94-20c4-43ae-be04-087c3ae43d5b] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:59.257051 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce43c3ac-9a7d-4c85-bac7-e5c55f78edba tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:59.258211 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce43c3ac-9a7d-4c85-bac7-e5c55f78edba tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:59.258842 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce43c3ac-9a7d-4c85-bac7-e5c55f78edba tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:59.259724 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce43c3ac-9a7d-4c85-bac7-e5c55f78edba tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:59.260283 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce43c3ac-9a7d-4c85-bac7-e5c55f78edba tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:59.260824 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce43c3ac-9a7d-4c85-bac7-e5c55f78edba tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:59.268613 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-516ffcdb-ab03-4222-bb62-cedd1455a0d4 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b19896bc4e4d14bfec46dd00519150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c307636beed407582da5779796cc6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:59.278816 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-516ffcdb-ab03-4222-bb62-cedd1455a0d4 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807" status: 200 len: 1645 microversion: 2.1 time: 0.191607 Sep 17 21:06:59.279837 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1938/3971] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:59 2022] GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807 => generated 1645 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:59.450466 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ce43c3ac-9a7d-4c85-bac7-e5c55f78edba tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33784305478f46ae9fdc4d4b82ebc6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e857c532a264ea78e24fd8fe1a44fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:06:59.459853 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ce43c3ac-9a7d-4c85-bac7-e5c55f78edba tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "GET /compute/v2.1/servers/95d8ad94-20c4-43ae-be04-087c3ae43d5b" status: 200 len: 1314 microversion: 2.1 time: 0.218797 Sep 17 21:06:59.460448 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2034/3972] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:59 2022] GET /compute/v2.1/servers/95d8ad94-20c4-43ae-be04-087c3ae43d5b => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:06:59.488969 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-23bd40e0-d0dd-48ea-8318-aae002dba7a8 req-308b6a81-18b4-4e5f-bcc0-bf596cbda15f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d8ad94-20c4-43ae-be04-087c3ae43d5b", "name": "network-vif-plugged", "status": "completed", "tag": "04ac8d32-227f-492e-80d6-78229934fd54"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:06:59.502251 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-23bd40e0-d0dd-48ea-8318-aae002dba7a8 req-308b6a81-18b4-4e5f-bcc0-bf596cbda15f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:59.503044 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-23bd40e0-d0dd-48ea-8318-aae002dba7a8 req-308b6a81-18b4-4e5f-bcc0-bf596cbda15f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:59.503850 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-23bd40e0-d0dd-48ea-8318-aae002dba7a8 req-308b6a81-18b4-4e5f-bcc0-bf596cbda15f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:59.519980 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-23bd40e0-d0dd-48ea-8318-aae002dba7a8 req-308b6a81-18b4-4e5f-bcc0-bf596cbda15f service nova] Creating event network-vif-plugged:04ac8d32-227f-492e-80d6-78229934fd54 for instance 95d8ad94-20c4-43ae-be04-087c3ae43d5b on nch1-master-1 Sep 17 21:06:59.525620 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-23bd40e0-d0dd-48ea-8318-aae002dba7a8 req-308b6a81-18b4-4e5f-bcc0-bf596cbda15f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041245 Sep 17 21:06:59.526896 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1939/3973] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:06:59.920271 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-364ec57b-0443-4c9b-b6a6-86882f011873 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:06:59.920900 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-364ec57b-0443-4c9b-b6a6-86882f011873 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:06:59.928059 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-364ec57b-0443-4c9b-b6a6-86882f011873 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:59.928845 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-364ec57b-0443-4c9b-b6a6-86882f011873 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:59.929751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-364ec57b-0443-4c9b-b6a6-86882f011873 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:06:59.930652 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-364ec57b-0443-4c9b-b6a6-86882f011873 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:06:59.931328 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-364ec57b-0443-4c9b-b6a6-86882f011873 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:06:59.931955 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-364ec57b-0443-4c9b-b6a6-86882f011873 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:00.014267 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-4ab0b851-22e9-4364-8cda-bc3c8d08d788 req-2c6c0839-9338-4939-bdb1-421cd1b8466b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807", "name": "network-vif-deleted", "tag": "ebef2569-9674-41fe-bd16-737edb72b2ba"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:00.026606 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-4ab0b851-22e9-4364-8cda-bc3c8d08d788 req-2c6c0839-9338-4939-bdb1-421cd1b8466b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:00.027390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-4ab0b851-22e9-4364-8cda-bc3c8d08d788 req-2c6c0839-9338-4939-bdb1-421cd1b8466b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:00.027914 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-4ab0b851-22e9-4364-8cda-bc3c8d08d788 req-2c6c0839-9338-4939-bdb1-421cd1b8466b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:00.043224 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-4ab0b851-22e9-4364-8cda-bc3c8d08d788 req-2c6c0839-9338-4939-bdb1-421cd1b8466b service nova] Creating event network-vif-deleted:ebef2569-9674-41fe-bd16-737edb72b2ba for instance d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807 on nch2-master-1 Sep 17 21:07:00.049885 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-4ab0b851-22e9-4364-8cda-bc3c8d08d788 req-2c6c0839-9338-4939-bdb1-421cd1b8466b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046732 Sep 17 21:07:00.051039 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1940/3974] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:07:00.122509 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-364ec57b-0443-4c9b-b6a6-86882f011873 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:00.123053 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-034efc3e-9570-4291-9a4d-323ff0de75ab tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:00.123856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-034efc3e-9570-4291-9a4d-323ff0de75ab tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:00.131574 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-364ec57b-0443-4c9b-b6a6-86882f011873 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d" status: 200 len: 1520 microversion: 2.1 time: 0.215172 Sep 17 21:07:00.132316 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2035/3975] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:06:59 2022] GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:00.136043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-034efc3e-9570-4291-9a4d-323ff0de75ab tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:00.136551 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-034efc3e-9570-4291-9a4d-323ff0de75ab tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:00.136991 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-034efc3e-9570-4291-9a4d-323ff0de75ab tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:00.137735 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-034efc3e-9570-4291-9a4d-323ff0de75ab tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:00.138194 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-034efc3e-9570-4291-9a4d-323ff0de75ab tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:00.138621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-034efc3e-9570-4291-9a4d-323ff0de75ab tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:00.302685 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-034efc3e-9570-4291-9a4d-323ff0de75ab tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:00.308428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3248b6d2-c0e3-40d7-a0cc-bf0409ecb7be tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:00.309121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3248b6d2-c0e3-40d7-a0cc-bf0409ecb7be tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:00.312274 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-034efc3e-9570-4291-9a4d-323ff0de75ab tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1505 microversion: 2.1 time: 0.194858 Sep 17 21:07:00.313084 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1941/3976] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:00 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1505 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:07:00.316172 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3248b6d2-c0e3-40d7-a0cc-bf0409ecb7be tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:00.316672 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3248b6d2-c0e3-40d7-a0cc-bf0409ecb7be tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:00.317115 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3248b6d2-c0e3-40d7-a0cc-bf0409ecb7be tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:00.317919 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3248b6d2-c0e3-40d7-a0cc-bf0409ecb7be tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:00.318384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3248b6d2-c0e3-40d7-a0cc-bf0409ecb7be tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:00.318817 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3248b6d2-c0e3-40d7-a0cc-bf0409ecb7be tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:00.364301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3248b6d2-c0e3-40d7-a0cc-bf0409ecb7be tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:00.364886 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3248b6d2-c0e3-40d7-a0cc-bf0409ecb7be tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:00.365405 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3248b6d2-c0e3-40d7-a0cc-bf0409ecb7be tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:00.366715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-3248b6d2-c0e3-40d7-a0cc-bf0409ecb7be tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lazy-loading 'fault' on Instance uuid d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:07:00.422306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3248b6d2-c0e3-40d7-a0cc-bf0409ecb7be tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30b19896bc4e4d14bfec46dd00519150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c307636beed407582da5779796cc6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:00.431761 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3248b6d2-c0e3-40d7-a0cc-bf0409ecb7be tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807" status: 200 len: 1305 microversion: 2.1 time: 0.131761 Sep 17 21:07:00.432496 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2036/3977] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:00 2022] GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807 => generated 1305 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:07:00.482757 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c67b6993-6240-47db-aea9-d2051e910948 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:00.483688 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c67b6993-6240-47db-aea9-d2051e910948 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 95d8ad94-20c4-43ae-be04-087c3ae43d5b] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:00.491024 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c67b6993-6240-47db-aea9-d2051e910948 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:00.491689 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c67b6993-6240-47db-aea9-d2051e910948 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:00.492128 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c67b6993-6240-47db-aea9-d2051e910948 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:00.492850 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c67b6993-6240-47db-aea9-d2051e910948 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:00.493310 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c67b6993-6240-47db-aea9-d2051e910948 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:00.493765 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c67b6993-6240-47db-aea9-d2051e910948 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:00.637985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c67b6993-6240-47db-aea9-d2051e910948 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33784305478f46ae9fdc4d4b82ebc6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e857c532a264ea78e24fd8fe1a44fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:00.648275 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c67b6993-6240-47db-aea9-d2051e910948 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "GET /compute/v2.1/servers/95d8ad94-20c4-43ae-be04-087c3ae43d5b" status: 200 len: 1314 microversion: 2.1 time: 0.169091 Sep 17 21:07:00.649170 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1942/3978] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:00 2022] GET /compute/v2.1/servers/95d8ad94-20c4-43ae-be04-087c3ae43d5b => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:01.155257 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f78bd137-a525-4aae-9041-f683ce188298 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:01.156039 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f78bd137-a525-4aae-9041-f683ce188298 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:01.165843 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f78bd137-a525-4aae-9041-f683ce188298 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:01.166001 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f78bd137-a525-4aae-9041-f683ce188298 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:01.166458 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f78bd137-a525-4aae-9041-f683ce188298 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:01.167421 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f78bd137-a525-4aae-9041-f683ce188298 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:01.168140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f78bd137-a525-4aae-9041-f683ce188298 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:01.169059 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f78bd137-a525-4aae-9041-f683ce188298 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:01.308388 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f78bd137-a525-4aae-9041-f683ce188298 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:01.317173 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f78bd137-a525-4aae-9041-f683ce188298 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d" status: 200 len: 1520 microversion: 2.1 time: 0.166619 Sep 17 21:07:01.317821 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2037/3979] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:01 2022] GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:01.338925 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-69fe6b94-fcc2-4410-be8b-575ffd96c9e4 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:01.339602 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-69fe6b94-fcc2-4410-be8b-575ffd96c9e4 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:01.346597 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69fe6b94-fcc2-4410-be8b-575ffd96c9e4 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:01.347069 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69fe6b94-fcc2-4410-be8b-575ffd96c9e4 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:01.347706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69fe6b94-fcc2-4410-be8b-575ffd96c9e4 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:01.348403 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69fe6b94-fcc2-4410-be8b-575ffd96c9e4 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:01.348855 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69fe6b94-fcc2-4410-be8b-575ffd96c9e4 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:01.349284 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69fe6b94-fcc2-4410-be8b-575ffd96c9e4 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:01.455835 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9b7a604f-d116-4583-87b5-d9a28b08ab03 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:01.456174 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9b7a604f-d116-4583-87b5-d9a28b08ab03 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] [instance: d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:01.463874 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b7a604f-d116-4583-87b5-d9a28b08ab03 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:01.464452 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b7a604f-d116-4583-87b5-d9a28b08ab03 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:01.464962 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b7a604f-d116-4583-87b5-d9a28b08ab03 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:01.465830 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b7a604f-d116-4583-87b5-d9a28b08ab03 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:01.466430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b7a604f-d116-4583-87b5-d9a28b08ab03 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:01.466889 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b7a604f-d116-4583-87b5-d9a28b08ab03 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:01.482632 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-9b7a604f-d116-4583-87b5-d9a28b08ab03 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] HTTP exception thrown: Instance d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807 could not be found. Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9b7a604f-d116-4583-87b5-d9a28b08ab03 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Request method failure captured: Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807 HTTP/1.1 Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjagzzYrrTodN4FRISubmKjZ26J-8BGxkNzLU7x20a3MCWENMarIDjJ9bOlqCettGyQPm3qYerTfS4mUFkwcpl7RJrNB079yuTWGsg7iyYHjYrTBkjIt8CtBBLGQxaQp-7J70wULL21t1iBESs97Rxk-MKHrjWOPMZFqMTCeWGgBIAQ Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 1c307636beed407582da5779796cc6a7 Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c307636beed407582da5779796cc6a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1c307636beed407582da5779796cc6a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1c307636beed407582da5779796cc6a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1c307636beed407582da5779796cc6a7", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 1c307636beed407582da5779796cc6a7 Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1804220727 Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-SecurityGroupsTestJSON-1804220727-project Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 30b19896bc4e4d14bfec46dd00519150 Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-SecurityGroupsTestJSON-1804220727-project Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807 could not be found. Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'd7ba2cc8-fc77-48f0-abe4-3a19cc9cd807'} Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807 could not be found. Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807 could not be found. Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:01.484351 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:07:01.490401 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:01.490401 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:07:01.490401 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:07:01.490401 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:07:01.490401 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:07:01.490401 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807 could not be found. Sep 17 21:07:01.490401 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:07:01.490401 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9b7a604f-d116-4583-87b5-d9a28b08ab03 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Returning 404 to user: Instance d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:07:01.490401 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9b7a604f-d116-4583-87b5-d9a28b08ab03 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807" status: 404 len: 111 microversion: 2.1 time: 0.034264 Sep 17 21:07:01.490401 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2038/3980] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:01 2022] GET /compute/v2.1/servers/d7ba2cc8-fc77-48f0-abe4-3a19cc9cd807 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:07:01.497279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0cd51552-cc7b-4bf8-85a1-f7986ce003e8 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '.version_select at 0x7f25a5843790>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:01.502624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-69fe6b94-fcc2-4410-be8b-575ffd96c9e4 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:01.511720 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-69fe6b94-fcc2-4410-be8b-575ffd96c9e4 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1505 microversion: 2.1 time: 0.176562 Sep 17 21:07:01.512294 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1943/3981] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:01 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1505 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:01.680687 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1e1da331-1351-4542-93f2-b21e69e47b2c tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:01.681416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1e1da331-1351-4542-93f2-b21e69e47b2c tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 95d8ad94-20c4-43ae-be04-087c3ae43d5b] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:01.685450 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0cd51552-cc7b-4bf8-85a1-f7986ce003e8 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/e926e02b-cabf-4bc2-8d7f-591c32051960" status: 202 len: 0 microversion: 2.1 time: 0.194891 Sep 17 21:07:01.689082 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1e1da331-1351-4542-93f2-b21e69e47b2c tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:01.690625 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1e1da331-1351-4542-93f2-b21e69e47b2c tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:01.691578 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1e1da331-1351-4542-93f2-b21e69e47b2c tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:01.696113 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2039/3982] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 21:07:01 2022] DELETE /compute/v2.1/os-security-groups/e926e02b-cabf-4bc2-8d7f-591c32051960 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 17 21:07:01.698247 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1e1da331-1351-4542-93f2-b21e69e47b2c tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:01.698426 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1e1da331-1351-4542-93f2-b21e69e47b2c tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:01.699126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1e1da331-1351-4542-93f2-b21e69e47b2c tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:01.703131 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-67c775c0-637a-4f8b-b1a6-1f490c2363e5 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] Calling method '.version_select at 0x7f25a55fbf70>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:01.898842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1e1da331-1351-4542-93f2-b21e69e47b2c tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33784305478f46ae9fdc4d4b82ebc6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e857c532a264ea78e24fd8fe1a44fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:01.908094 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1e1da331-1351-4542-93f2-b21e69e47b2c tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "GET /compute/v2.1/servers/95d8ad94-20c4-43ae-be04-087c3ae43d5b" status: 200 len: 1499 microversion: 2.1 time: 0.231517 Sep 17 21:07:01.922337 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1944/3983] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:01 2022] GET /compute/v2.1/servers/95d8ad94-20c4-43ae-be04-087c3ae43d5b => generated 1499 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:01.991472 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-67c775c0-637a-4f8b-b1a6-1f490c2363e5 tempest-SecurityGroupsTestJSON-1804220727 tempest-SecurityGroupsTestJSON-1804220727-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/acf9495b-8ee9-443d-b778-676fa503e326" status: 202 len: 0 microversion: 2.1 time: 0.293992 Sep 17 21:07:01.992769 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2040/3984] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 21:07:01 2022] DELETE /compute/v2.1/os-security-groups/acf9495b-8ee9-443d-b778-676fa503e326 => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:07:02.342074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c5704993-7551-49ab-8a41-6736ddf51a7c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:02.342680 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c5704993-7551-49ab-8a41-6736ddf51a7c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:02.350438 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c5704993-7551-49ab-8a41-6736ddf51a7c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:02.350937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c5704993-7551-49ab-8a41-6736ddf51a7c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:02.351410 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c5704993-7551-49ab-8a41-6736ddf51a7c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:02.352400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c5704993-7551-49ab-8a41-6736ddf51a7c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:02.352864 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c5704993-7551-49ab-8a41-6736ddf51a7c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:02.353300 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c5704993-7551-49ab-8a41-6736ddf51a7c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:02.424980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6841ae13-9a1b-4eb8-9f12-e3667a0bbcbe tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:02.426319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6841ae13-9a1b-4eb8-9f12-e3667a0bbcbe tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 95d8ad94-20c4-43ae-be04-087c3ae43d5b] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:02.437542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6841ae13-9a1b-4eb8-9f12-e3667a0bbcbe tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:02.441680 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6841ae13-9a1b-4eb8-9f12-e3667a0bbcbe tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:02.442880 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6841ae13-9a1b-4eb8-9f12-e3667a0bbcbe tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:02.444424 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6841ae13-9a1b-4eb8-9f12-e3667a0bbcbe tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:02.446555 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6841ae13-9a1b-4eb8-9f12-e3667a0bbcbe tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:02.447078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6841ae13-9a1b-4eb8-9f12-e3667a0bbcbe tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:02.484732 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6841ae13-9a1b-4eb8-9f12-e3667a0bbcbe tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 95d8ad94-20c4-43ae-be04-087c3ae43d5b] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:07:02.562248 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c5704993-7551-49ab-8a41-6736ddf51a7c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:02.566487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:02.571821 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c5704993-7551-49ab-8a41-6736ddf51a7c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d" status: 200 len: 1520 microversion: 2.1 time: 0.234165 Sep 17 21:07:02.578634 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1945/3985] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:02 2022] GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:02.624007 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-45bde318-44d6-41b0-94c2-62cd820c6589 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:02.631136 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-45bde318-44d6-41b0-94c2-62cd820c6589 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:02.653946 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45bde318-44d6-41b0-94c2-62cd820c6589 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:02.655531 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45bde318-44d6-41b0-94c2-62cd820c6589 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:02.655997 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45bde318-44d6-41b0-94c2-62cd820c6589 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:02.658609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45bde318-44d6-41b0-94c2-62cd820c6589 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:02.659229 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45bde318-44d6-41b0-94c2-62cd820c6589 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:02.659681 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45bde318-44d6-41b0-94c2-62cd820c6589 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:02.670738 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6841ae13-9a1b-4eb8-9f12-e3667a0bbcbe tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "DELETE /compute/v2.1/servers/95d8ad94-20c4-43ae-be04-087c3ae43d5b" status: 204 len: 0 microversion: 2.1 time: 0.250616 Sep 17 21:07:02.672064 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2041/3986] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:07:02 2022] DELETE /compute/v2.1/servers/95d8ad94-20c4-43ae-be04-087c3ae43d5b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 17 21:07:02.681240 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8b03ba6a-1e5a-43be-b631-25a63788fdda tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:02.682265 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8b03ba6a-1e5a-43be-b631-25a63788fdda tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 95d8ad94-20c4-43ae-be04-087c3ae43d5b] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:02.698364 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8b03ba6a-1e5a-43be-b631-25a63788fdda tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:02.698871 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8b03ba6a-1e5a-43be-b631-25a63788fdda tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:02.703632 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8b03ba6a-1e5a-43be-b631-25a63788fdda tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:02.704820 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8b03ba6a-1e5a-43be-b631-25a63788fdda tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:02.705005 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8b03ba6a-1e5a-43be-b631-25a63788fdda tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:02.705924 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8b03ba6a-1e5a-43be-b631-25a63788fdda tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:03.318894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-45bde318-44d6-41b0-94c2-62cd820c6589 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:03.328028 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-45bde318-44d6-41b0-94c2-62cd820c6589 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1505 microversion: 2.1 time: 0.742610 Sep 17 21:07:03.335012 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8b03ba6a-1e5a-43be-b631-25a63788fdda tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33784305478f46ae9fdc4d4b82ebc6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e857c532a264ea78e24fd8fe1a44fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:03.344741 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1946/3987] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:02 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1505 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:03.345332 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8b03ba6a-1e5a-43be-b631-25a63788fdda tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "GET /compute/v2.1/servers/95d8ad94-20c4-43ae-be04-087c3ae43d5b" status: 200 len: 1505 microversion: 2.1 time: 0.668890 Sep 17 21:07:03.347317 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2042/3988] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:02 2022] GET /compute/v2.1/servers/95d8ad94-20c4-43ae-be04-087c3ae43d5b => generated 1505 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:07:03.603427 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ce9f4846-0bb7-49e3-9663-4992ea033998 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:03.604120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ce9f4846-0bb7-49e3-9663-4992ea033998 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:03.612793 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce9f4846-0bb7-49e3-9663-4992ea033998 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:03.613447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce9f4846-0bb7-49e3-9663-4992ea033998 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:03.613792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce9f4846-0bb7-49e3-9663-4992ea033998 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:03.614775 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce9f4846-0bb7-49e3-9663-4992ea033998 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:03.615061 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce9f4846-0bb7-49e3-9663-4992ea033998 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:03.615806 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce9f4846-0bb7-49e3-9663-4992ea033998 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:03.752789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-965d4754-61d3-4b5d-b73f-22901a610c28 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "345bdac6-8146-4c95-b81c-59ac61c7b198"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:03.756270 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-965d4754-61d3-4b5d-b73f-22901a610c28 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 29c92489-5a3c-43e3-8dae-d5168e2a29bb] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:03.764964 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-965d4754-61d3-4b5d-b73f-22901a610c28 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:03.765634 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-965d4754-61d3-4b5d-b73f-22901a610c28 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:03.766085 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-965d4754-61d3-4b5d-b73f-22901a610c28 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:03.767713 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-965d4754-61d3-4b5d-b73f-22901a610c28 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:03.768323 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-965d4754-61d3-4b5d-b73f-22901a610c28 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:03.769086 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-965d4754-61d3-4b5d-b73f-22901a610c28 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:03.901495 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ce9f4846-0bb7-49e3-9663-4992ea033998 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:03.910768 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ce9f4846-0bb7-49e3-9663-4992ea033998 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d" status: 200 len: 1520 microversion: 2.1 time: 0.312848 Sep 17 21:07:03.911398 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1947/3989] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:03 2022] GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d => generated 1520 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:04.268551 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-965d4754-61d3-4b5d-b73f-22901a610c28 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "POST /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.426468 Sep 17 21:07:04.268551 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2043/3990] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 17 21:07:03 2022] POST /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb/os-volume_attachments => generated 194 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:07:04.352365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cb6df9ab-2fc6-4603-9c46-f2ea676582c7 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:04.353516 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cb6df9ab-2fc6-4603-9c46-f2ea676582c7 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:04.361339 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb6df9ab-2fc6-4603-9c46-f2ea676582c7 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:04.364630 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb6df9ab-2fc6-4603-9c46-f2ea676582c7 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:04.365959 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb6df9ab-2fc6-4603-9c46-f2ea676582c7 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:04.373883 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-73059704-361a-4ee5-b4e0-598eba94799a tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:04.375198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-73059704-361a-4ee5-b4e0-598eba94799a tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 95d8ad94-20c4-43ae-be04-087c3ae43d5b] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:04.375917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb6df9ab-2fc6-4603-9c46-f2ea676582c7 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:04.376609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb6df9ab-2fc6-4603-9c46-f2ea676582c7 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:04.379635 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb6df9ab-2fc6-4603-9c46-f2ea676582c7 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:04.389919 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-73059704-361a-4ee5-b4e0-598eba94799a tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:04.390841 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-73059704-361a-4ee5-b4e0-598eba94799a tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:04.391290 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-73059704-361a-4ee5-b4e0-598eba94799a tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:04.392055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-73059704-361a-4ee5-b4e0-598eba94799a tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:04.394687 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-73059704-361a-4ee5-b4e0-598eba94799a tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:04.395151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-73059704-361a-4ee5-b4e0-598eba94799a tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:04.852171 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cb6df9ab-2fc6-4603-9c46-f2ea676582c7 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:04.863782 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cb6df9ab-2fc6-4603-9c46-f2ea676582c7 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1505 microversion: 2.1 time: 0.515607 Sep 17 21:07:04.864478 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1948/3991] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:04 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1505 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:04.879468 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-73059704-361a-4ee5-b4e0-598eba94799a tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33784305478f46ae9fdc4d4b82ebc6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e857c532a264ea78e24fd8fe1a44fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:04.895470 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-73059704-361a-4ee5-b4e0-598eba94799a tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "GET /compute/v2.1/servers/95d8ad94-20c4-43ae-be04-087c3ae43d5b" status: 200 len: 1505 microversion: 2.1 time: 0.524472 Sep 17 21:07:04.896390 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2044/3992] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:04 2022] GET /compute/v2.1/servers/95d8ad94-20c4-43ae-be04-087c3ae43d5b => generated 1505 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:04.935087 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e5bde595-adff-4277-845b-6f2ff49cb279 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:04.935712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e5bde595-adff-4277-845b-6f2ff49cb279 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:04.942409 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5bde595-adff-4277-845b-6f2ff49cb279 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:04.943384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5bde595-adff-4277-845b-6f2ff49cb279 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:04.944426 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5bde595-adff-4277-845b-6f2ff49cb279 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:04.945769 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5bde595-adff-4277-845b-6f2ff49cb279 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:04.946238 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5bde595-adff-4277-845b-6f2ff49cb279 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:04.946678 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5bde595-adff-4277-845b-6f2ff49cb279 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:05.260643 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e5bde595-adff-4277-845b-6f2ff49cb279 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:05.285868 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e5bde595-adff-4277-845b-6f2ff49cb279 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d" status: 200 len: 1520 microversion: 2.1 time: 0.354987 Sep 17 21:07:05.301951 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1949/3993] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:04 2022] GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d => generated 1520 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:05.555867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-d35fd17a-1364-464f-a8d0-1f2dcab118e3 req-fbf89be3-d0f6-44a7-9894-a3a597ee48a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95d8ad94-20c4-43ae-be04-087c3ae43d5b", "name": "network-vif-deleted", "tag": "04ac8d32-227f-492e-80d6-78229934fd54"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:05.589648 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d35fd17a-1364-464f-a8d0-1f2dcab118e3 req-fbf89be3-d0f6-44a7-9894-a3a597ee48a3 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:05.590480 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d35fd17a-1364-464f-a8d0-1f2dcab118e3 req-fbf89be3-d0f6-44a7-9894-a3a597ee48a3 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:05.593867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d35fd17a-1364-464f-a8d0-1f2dcab118e3 req-fbf89be3-d0f6-44a7-9894-a3a597ee48a3 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:05.630762 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-d35fd17a-1364-464f-a8d0-1f2dcab118e3 req-fbf89be3-d0f6-44a7-9894-a3a597ee48a3 service nova] Creating event network-vif-deleted:04ac8d32-227f-492e-80d6-78229934fd54 for instance 95d8ad94-20c4-43ae-be04-087c3ae43d5b on nch1-master-1 Sep 17 21:07:05.643747 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-d35fd17a-1364-464f-a8d0-1f2dcab118e3 req-fbf89be3-d0f6-44a7-9894-a3a597ee48a3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090903 Sep 17 21:07:05.644397 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2045/3994] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:07:05.889288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-aad4ca2b-5418-4edc-a6d9-90a2e330df17 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:05.889929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-aad4ca2b-5418-4edc-a6d9-90a2e330df17 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:05.901631 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aad4ca2b-5418-4edc-a6d9-90a2e330df17 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:05.902357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aad4ca2b-5418-4edc-a6d9-90a2e330df17 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:05.902974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aad4ca2b-5418-4edc-a6d9-90a2e330df17 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:05.903880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aad4ca2b-5418-4edc-a6d9-90a2e330df17 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:05.904501 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aad4ca2b-5418-4edc-a6d9-90a2e330df17 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:05.905315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aad4ca2b-5418-4edc-a6d9-90a2e330df17 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:05.919205 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f6894fdc-e3df-412c-8cf1-de999fcb2773 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:05.920541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f6894fdc-e3df-412c-8cf1-de999fcb2773 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 95d8ad94-20c4-43ae-be04-087c3ae43d5b] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:05.932475 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6894fdc-e3df-412c-8cf1-de999fcb2773 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:05.940388 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6894fdc-e3df-412c-8cf1-de999fcb2773 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:05.946231 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6894fdc-e3df-412c-8cf1-de999fcb2773 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:05.947767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6894fdc-e3df-412c-8cf1-de999fcb2773 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:05.948609 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6894fdc-e3df-412c-8cf1-de999fcb2773 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:05.949721 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6894fdc-e3df-412c-8cf1-de999fcb2773 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:06.030507 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6894fdc-e3df-412c-8cf1-de999fcb2773 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:06.031028 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6894fdc-e3df-412c-8cf1-de999fcb2773 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:06.031622 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6894fdc-e3df-412c-8cf1-de999fcb2773 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:06.032151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-f6894fdc-e3df-412c-8cf1-de999fcb2773 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lazy-loading 'fault' on Instance uuid 95d8ad94-20c4-43ae-be04-087c3ae43d5b {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:07:06.169117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f6894fdc-e3df-412c-8cf1-de999fcb2773 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33784305478f46ae9fdc4d4b82ebc6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e857c532a264ea78e24fd8fe1a44fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:06.178428 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f6894fdc-e3df-412c-8cf1-de999fcb2773 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "GET /compute/v2.1/servers/95d8ad94-20c4-43ae-be04-087c3ae43d5b" status: 200 len: 1304 microversion: 2.1 time: 0.263495 Sep 17 21:07:06.183759 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2046/3995] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:05 2022] GET /compute/v2.1/servers/95d8ad94-20c4-43ae-be04-087c3ae43d5b => generated 1304 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:07:06.313933 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cdd80998-3654-4f64-8b34-9fd08eb448c1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:06.314557 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cdd80998-3654-4f64-8b34-9fd08eb448c1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:06.327500 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cdd80998-3654-4f64-8b34-9fd08eb448c1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:06.327997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cdd80998-3654-4f64-8b34-9fd08eb448c1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:06.328473 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cdd80998-3654-4f64-8b34-9fd08eb448c1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:06.329213 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cdd80998-3654-4f64-8b34-9fd08eb448c1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:06.329791 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cdd80998-3654-4f64-8b34-9fd08eb448c1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:06.330254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cdd80998-3654-4f64-8b34-9fd08eb448c1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:06.363997 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-aad4ca2b-5418-4edc-a6d9-90a2e330df17 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:06.373284 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:06.376061 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-aad4ca2b-5418-4edc-a6d9-90a2e330df17 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1505 microversion: 2.1 time: 0.491075 Sep 17 21:07:06.378794 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1950/3996] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:05 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1505 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:06.608043 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cdd80998-3654-4f64-8b34-9fd08eb448c1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:06.626357 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cdd80998-3654-4f64-8b34-9fd08eb448c1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d" status: 200 len: 1520 microversion: 2.1 time: 0.309124 Sep 17 21:07:06.634853 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2047/3997] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:06 2022] GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d => generated 1520 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:07:07.209423 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6d9d5fd0-ff9b-4ad7-ab2e-5c61454ca53d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:07.210090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6d9d5fd0-ff9b-4ad7-ab2e-5c61454ca53d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 95d8ad94-20c4-43ae-be04-087c3ae43d5b] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:07.218017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d9d5fd0-ff9b-4ad7-ab2e-5c61454ca53d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:07.218728 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d9d5fd0-ff9b-4ad7-ab2e-5c61454ca53d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:07.219176 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d9d5fd0-ff9b-4ad7-ab2e-5c61454ca53d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:07.219895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d9d5fd0-ff9b-4ad7-ab2e-5c61454ca53d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:07.220447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d9d5fd0-ff9b-4ad7-ab2e-5c61454ca53d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:07.221103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d9d5fd0-ff9b-4ad7-ab2e-5c61454ca53d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:07.238723 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-6d9d5fd0-ff9b-4ad7-ab2e-5c61454ca53d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] HTTP exception thrown: Instance 95d8ad94-20c4-43ae-be04-087c3ae43d5b could not be found. Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6d9d5fd0-ff9b-4ad7-ab2e-5c61454ca53d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Request method failure captured: Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/95d8ad94-20c4-43ae-be04-087c3ae43d5b HTTP/1.1 Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjbm67UaJxpq8_DWWrPif2Lk6LYyWiz4FFo6ccblXGnkW3sGrrxCpMatVoBrChERHe-w79ATSGSGzjGe2QhqInQDEXO37duDwsQ5xpgDuNLiB5eLbcel2OJIKDdcXHc2sFItRMfsqiv5_M4kkrU9aIsd2rBT3iEC1vyD2BZp7g7wiOw Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 3e857c532a264ea78e24fd8fe1a44fbc Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-VolumesActionsTest-905194390 Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e857c532a264ea78e24fd8fe1a44fbc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3e857c532a264ea78e24fd8fe1a44fbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e857c532a264ea78e24fd8fe1a44fbc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3e857c532a264ea78e24fd8fe1a44fbc", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-VolumesActionsTest-905194390 Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 3e857c532a264ea78e24fd8fe1a44fbc Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-VolumesActionsTest-905194390 Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-VolumesActionsTest-905194390-project Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 33784305478f46ae9fdc4d4b82ebc6f5 Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-VolumesActionsTest-905194390-project Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 95d8ad94-20c4-43ae-be04-087c3ae43d5b could not be found. Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '95d8ad94-20c4-43ae-be04-087c3ae43d5b'} Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95d8ad94-20c4-43ae-be04-087c3ae43d5b could not be found. Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95d8ad94-20c4-43ae-be04-087c3ae43d5b could not be found. Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:07.240434 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:07.243605 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:07.243605 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:07:07.243605 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:07:07.243605 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:07:07.243605 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:07:07.243605 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95d8ad94-20c4-43ae-be04-087c3ae43d5b could not be found. Sep 17 21:07:07.243605 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:07.243605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6d9d5fd0-ff9b-4ad7-ab2e-5c61454ca53d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Returning 404 to user: Instance 95d8ad94-20c4-43ae-be04-087c3ae43d5b could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:07:07.243605 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6d9d5fd0-ff9b-4ad7-ab2e-5c61454ca53d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "GET /compute/v2.1/servers/95d8ad94-20c4-43ae-be04-087c3ae43d5b" status: 404 len: 111 microversion: 2.1 time: 0.037947 Sep 17 21:07:07.243605 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1951/3998] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:07 2022] GET /compute/v2.1/servers/95d8ad94-20c4-43ae-be04-087c3ae43d5b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:07:07.378232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-73514263-eeaa-4746-8674-eab3794f9d05 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2113109392", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "72101b36-0cf8-4fab-91c1-881dd0d61851"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:07.400782 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:07.405286 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-11ed8451-bf5a-4265-90b0-90fe5dde79c6 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:07.406099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-11ed8451-bf5a-4265-90b0-90fe5dde79c6 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:07.421844 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11ed8451-bf5a-4265-90b0-90fe5dde79c6 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:07.422590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11ed8451-bf5a-4265-90b0-90fe5dde79c6 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:07.423080 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11ed8451-bf5a-4265-90b0-90fe5dde79c6 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:07.423818 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11ed8451-bf5a-4265-90b0-90fe5dde79c6 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:07.424486 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11ed8451-bf5a-4265-90b0-90fe5dde79c6 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:07.424853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11ed8451-bf5a-4265-90b0-90fe5dde79c6 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:07.458772 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-73514263-eeaa-4746-8674-eab3794f9d05 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] validate_networks() for [('72101b36-0cf8-4fab-91c1-881dd0d61851', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:07:07.761151 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-11ed8451-bf5a-4265-90b0-90fe5dde79c6 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:07.771347 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-11ed8451-bf5a-4265-90b0-90fe5dde79c6 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1505 microversion: 2.1 time: 0.370684 Sep 17 21:07:07.790936 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1952/3999] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:07 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1505 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:08.055614 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5bfcb1bb-1b44-46ab-b647-3589befb5d11 tempest-VolumesAdminNegativeTest-1681771867 tempest-VolumesAdminNegativeTest-1681771867-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "7b604dab-0b2d-45d3-b373-162e1eaa6773"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:08.058935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5bfcb1bb-1b44-46ab-b647-3589befb5d11 tempest-VolumesAdminNegativeTest-1681771867 tempest-VolumesAdminNegativeTest-1681771867-project-admin] [instance: 29c92489-5a3c-43e3-8dae-d5168e2a29bb] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:08.065304 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5bfcb1bb-1b44-46ab-b647-3589befb5d11 tempest-VolumesAdminNegativeTest-1681771867 tempest-VolumesAdminNegativeTest-1681771867-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:08.065835 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5bfcb1bb-1b44-46ab-b647-3589befb5d11 tempest-VolumesAdminNegativeTest-1681771867 tempest-VolumesAdminNegativeTest-1681771867-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:08.066281 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5bfcb1bb-1b44-46ab-b647-3589befb5d11 tempest-VolumesAdminNegativeTest-1681771867 tempest-VolumesAdminNegativeTest-1681771867-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:08.067057 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5bfcb1bb-1b44-46ab-b647-3589befb5d11 tempest-VolumesAdminNegativeTest-1681771867 tempest-VolumesAdminNegativeTest-1681771867-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:08.067691 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5bfcb1bb-1b44-46ab-b647-3589befb5d11 tempest-VolumesAdminNegativeTest-1681771867 tempest-VolumesAdminNegativeTest-1681771867-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:08.068129 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5bfcb1bb-1b44-46ab-b647-3589befb5d11 tempest-VolumesAdminNegativeTest-1681771867 tempest-VolumesAdminNegativeTest-1681771867-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:08.105450 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-73514263-eeaa-4746-8674-eab3794f9d05 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:07:08.106016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-73514263-eeaa-4746-8674-eab3794f9d05 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:07:08.107147 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-73514263-eeaa-4746-8674-eab3794f9d05 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:07:08.107582 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-73514263-eeaa-4746-8674-eab3794f9d05 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:07:08.108607 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-73514263-eeaa-4746-8674-eab3794f9d05 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:07:08.119438 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-73514263-eeaa-4746-8674-eab3794f9d05 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:08.120133 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-73514263-eeaa-4746-8674-eab3794f9d05 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:08.120773 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-73514263-eeaa-4746-8674-eab3794f9d05 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:08.121688 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-73514263-eeaa-4746-8674-eab3794f9d05 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:08.122385 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-73514263-eeaa-4746-8674-eab3794f9d05 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:08.123000 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-73514263-eeaa-4746-8674-eab3794f9d05 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:08.144994 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-73514263-eeaa-4746-8674-eab3794f9d05 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Getting quotas for project 3e857c532a264ea78e24fd8fe1a44fbc. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:07:08.151847 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-73514263-eeaa-4746-8674-eab3794f9d05 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Getting quotas for user 33784305478f46ae9fdc4d4b82ebc6f5 and project 3e857c532a264ea78e24fd8fe1a44fbc. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:07:08.173390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-73514263-eeaa-4746-8674-eab3794f9d05 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:07:08.175792 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-73514263-eeaa-4746-8674-eab3794f9d05 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 964a7041-9baa-42fb-a51c-f760437411df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:07:08.184484 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-5bfcb1bb-1b44-46ab-b647-3589befb5d11 tempest-VolumesAdminNegativeTest-1681771867 tempest-VolumesAdminNegativeTest-1681771867-project-admin] HTTP exception thrown: Volume 7b604dab-0b2d-45d3-b373-162e1eaa6773 could not be found. Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5bfcb1bb-1b44-46ab-b647-3589befb5d11 tempest-VolumesAdminNegativeTest-1681771867 tempest-VolumesAdminNegativeTest-1681771867-project-admin] Request method failure captured: Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: request: PUT /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb/os-volume_attachments/345bdac6-8146-4c95-b81c-59ac61c7b198 HTTP/1.1 Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 74 Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjaxAIspG1-y63vISMciFYaNsI7_C55Bl7ACpbvnjl2ZhQX-YCPMejqxSTvY71BWqcAhiq2arnPkxLJa2efsEgxPJtD1b1733q6qL4y2vSLBElwEFEKV9HwVd88K4BhQskvlX6q7CgvvpT5_jYD0UNdiMaWf79BxYm7CLbkpbqYXLWw Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: f1fca09044e249e497bc266060c3c3ab Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-VolumesAdminNegativeTest-1681771867 Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: X-Role: admin,member,reader Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: admin,member,reader Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f1fca09044e249e497bc266060c3c3ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f1fca09044e249e497bc266060c3c3ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f1fca09044e249e497bc266060c3c3ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f1fca09044e249e497bc266060c3c3ab", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-VolumesAdminNegativeTest-1681771867 Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: f1fca09044e249e497bc266060c3c3ab Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1681771867 Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-VolumesAdminNegativeTest-1681771867-project-admin Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: fce8fdffbc354641b50a0d46ea6be26f Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-VolumesAdminNegativeTest-1681771867-project-admin Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: {"volumeAttachment": {"volumeId": "7b604dab-0b2d-45d3-b373-162e1eaa6773"}} Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: exception: Volume 7b604dab-0b2d-45d3-b373-162e1eaa6773 could not be found. Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'server_id': '29c92489-5a3c-43e3-8dae-d5168e2a29bb', 'id': '345bdac6-8146-4c95-b81c-59ac61c7b198', 'body': {'volumeAttachment': {'volumeId': '7b604dab-0b2d-45d3-b373-162e1eaa6773'}}} Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7b604dab-0b2d-45d3-b373-162e1eaa6773 could not be found. (HTTP 404) (Request-ID: req-02e7e701-28a6-4f3d-a23f-f9caecc3cb6f) Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 17 21:07:08.188050 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7b604dab-0b2d-45d3-b373-162e1eaa6773 could not be found. Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 7b604dab-0b2d-45d3-b373-162e1eaa6773 could not be found. Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7b604dab-0b2d-45d3-b373-162e1eaa6773 could not be found. Sep 17 21:07:08.191850 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:08.194850 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5bfcb1bb-1b44-46ab-b647-3589befb5d11 tempest-VolumesAdminNegativeTest-1681771867 tempest-VolumesAdminNegativeTest-1681771867-project-admin] Returning 400 to user: Volume 7b604dab-0b2d-45d3-b373-162e1eaa6773 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:07:08.194850 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5bfcb1bb-1b44-46ab-b647-3589befb5d11 tempest-VolumesAdminNegativeTest-1681771867 tempest-VolumesAdminNegativeTest-1681771867-project-admin] 10.222.0.26 "PUT /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb/os-volume_attachments/345bdac6-8146-4c95-b81c-59ac61c7b198" status: 400 len: 107 microversion: 2.1 time: 0.400065 Sep 17 21:07:08.195506 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1953/4000] 10.222.0.26 () {60 vars in 1433 bytes} [Sat Sep 17 21:07:07 2022] PUT /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb/os-volume_attachments/345bdac6-8146-4c95-b81c-59ac61c7b198 => generated 107 bytes in 401 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:07:08.208605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fc68a4de-7ad6-44ca-8f58-379c488c0320 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:08.214231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fc68a4de-7ad6-44ca-8f58-379c488c0320 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:08.226478 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc68a4de-7ad6-44ca-8f58-379c488c0320 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:08.226986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc68a4de-7ad6-44ca-8f58-379c488c0320 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:08.227437 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc68a4de-7ad6-44ca-8f58-379c488c0320 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:08.236701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc68a4de-7ad6-44ca-8f58-379c488c0320 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:08.239382 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc68a4de-7ad6-44ca-8f58-379c488c0320 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:08.239849 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc68a4de-7ad6-44ca-8f58-379c488c0320 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:08.264417 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-73514263-eeaa-4746-8674-eab3794f9d05 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.891079 Sep 17 21:07:08.265662 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2048/4001] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:07:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 17 21:07:08.278232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ace0ba9f-62cb-49a1-b187-270d498e82a6 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:08.279342 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ace0ba9f-62cb-49a1-b187-270d498e82a6 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 964a7041-9baa-42fb-a51c-f760437411df] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:08.413098 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ace0ba9f-62cb-49a1-b187-270d498e82a6 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33784305478f46ae9fdc4d4b82ebc6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e857c532a264ea78e24fd8fe1a44fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:08.421038 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ace0ba9f-62cb-49a1-b187-270d498e82a6 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "GET /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df" status: 200 len: 1214 microversion: 2.1 time: 0.148189 Sep 17 21:07:08.434046 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2049/4002] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:08 2022] GET /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df => generated 1214 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:07:08.445334 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bd90784e-8e50-4eea-8854-0d80837a94d6 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:08.445966 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bd90784e-8e50-4eea-8854-0d80837a94d6 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 29c92489-5a3c-43e3-8dae-d5168e2a29bb] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:08.454689 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd90784e-8e50-4eea-8854-0d80837a94d6 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:08.455947 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd90784e-8e50-4eea-8854-0d80837a94d6 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:08.456614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd90784e-8e50-4eea-8854-0d80837a94d6 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:08.457596 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd90784e-8e50-4eea-8854-0d80837a94d6 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:08.458852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd90784e-8e50-4eea-8854-0d80837a94d6 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:08.459560 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd90784e-8e50-4eea-8854-0d80837a94d6 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:08.500606 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fc68a4de-7ad6-44ca-8f58-379c488c0320 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:08.519037 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fc68a4de-7ad6-44ca-8f58-379c488c0320 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d" status: 200 len: 1500 microversion: 2.1 time: 0.319899 Sep 17 21:07:08.519786 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1954/4003] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:08 2022] GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d => generated 1500 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:08.544860 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-afee1f29-01a7-45fe-b97d-9e20f9ce369a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f337f44a-3587-4bc6-933a-9287690ea825"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:08.549491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-afee1f29-01a7-45fe-b97d-9e20f9ce369a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:08.558401 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afee1f29-01a7-45fe-b97d-9e20f9ce369a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:08.559117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afee1f29-01a7-45fe-b97d-9e20f9ce369a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:08.559727 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afee1f29-01a7-45fe-b97d-9e20f9ce369a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:08.560648 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afee1f29-01a7-45fe-b97d-9e20f9ce369a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:08.561172 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afee1f29-01a7-45fe-b97d-9e20f9ce369a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:08.561711 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afee1f29-01a7-45fe-b97d-9e20f9ce369a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:08.589797 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-bd90784e-8e50-4eea-8854-0d80837a94d6 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lazy-loading 'services' on Instance uuid 29c92489-5a3c-43e3-8dae-d5168e2a29bb {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:07:08.620984 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-afee1f29-01a7-45fe-b97d-9e20f9ce369a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] HTTP exception thrown: Cannot 'attach_volume' instance 904ea7d3-2a78-408a-8a14-bac3845f6e7d while it is in vm_state rescued Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-afee1f29-01a7-45fe-b97d-9e20f9ce369a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Request method failure captured: Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d/os-volume_attachments HTTP/1.1 Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 74 Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjaiOOC2XD-QIsLuDvG9bxN3jnLjmueVdk28NKERipgg7mZAUnmkYYkUcMWYkcsUdzUwALfMrwKYbIvTbrUxBdv7HTTnMRjY98z2HSanC8PyMI0Bvd8_fsMNUR8WwzuWwOyttA6z4v7owoNPIa2XeOfidHHD5bq9m_itbcIiBCzoH1A Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: f8ed24e4bf6643f7b1474fcec78c4995 Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-533169750 Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ed24e4bf6643f7b1474fcec78c4995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f8ed24e4bf6643f7b1474fcec78c4995"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ed24e4bf6643f7b1474fcec78c4995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f8ed24e4bf6643f7b1474fcec78c4995", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerRescueNegativeTestJSON-533169750 Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: f8ed24e4bf6643f7b1474fcec78c4995 Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-533169750 Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerRescueNegativeTestJSON-533169750-project Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 795813bb461e42ad8c2a758e9b8430d6 Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerRescueNegativeTestJSON-533169750-project Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: {"volumeAttachment": {"volumeId": "f337f44a-3587-4bc6-933a-9287690ea825"}} Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: exception: Cannot 'attach_volume' instance 904ea7d3-2a78-408a-8a14-bac3845f6e7d while it is in vm_state rescued Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'server_id': '904ea7d3-2a78-408a-8a14-bac3845f6e7d', 'body': {'volumeAttachment': {'volumeId': 'f337f44a-3587-4bc6-933a-9287690ea825'}}} Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 904ea7d3-2a78-408a-8a14-bac3845f6e7d in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 17 21:07:08.627340 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 17 21:07:08.631948 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 17 21:07:08.631948 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 17 21:07:08.631948 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 904ea7d3-2a78-408a-8a14-bac3845f6e7d while it is in vm_state rescued Sep 17 21:07:08.631948 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:08.631948 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:08.631948 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:08.631948 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:08.631948 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:07:08.631948 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:07:08.631948 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:07:08.631948 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:07:08.631948 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 904ea7d3-2a78-408a-8a14-bac3845f6e7d while it is in vm_state rescued Sep 17 21:07:08.631948 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:08.631948 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-afee1f29-01a7-45fe-b97d-9e20f9ce369a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Returning 409 to user: Cannot 'attach_volume' instance 904ea7d3-2a78-408a-8a14-bac3845f6e7d while it is in vm_state rescued {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:07:08.638440 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-afee1f29-01a7-45fe-b97d-9e20f9ce369a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "POST /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.099017 Sep 17 21:07:08.641637 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1955/4004] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 17 21:07:08 2022] POST /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d/os-volume_attachments => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 17 21:07:08.654335 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bcd4765e-3596-4552-87ef-d94c3ca857a9 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:08.655106 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bcd4765e-3596-4552-87ef-d94c3ca857a9 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:08.663709 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:08.667467 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bcd4765e-3596-4552-87ef-d94c3ca857a9 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:08.668418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bcd4765e-3596-4552-87ef-d94c3ca857a9 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:08.668962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bcd4765e-3596-4552-87ef-d94c3ca857a9 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:08.670054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bcd4765e-3596-4552-87ef-d94c3ca857a9 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:08.670691 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bcd4765e-3596-4552-87ef-d94c3ca857a9 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:08.671476 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bcd4765e-3596-4552-87ef-d94c3ca857a9 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:08.731181 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bd90784e-8e50-4eea-8854-0d80837a94d6 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "DELETE /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb/os-volume_attachments/345bdac6-8146-4c95-b81c-59ac61c7b198" status: 202 len: 0 microversion: 2.1 time: 0.294366 Sep 17 21:07:08.731981 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2050/4005] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Sep 17 21:07:08 2022] DELETE /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb/os-volume_attachments/345bdac6-8146-4c95-b81c-59ac61c7b198 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:07:08.748656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-975be525-b197-4f50-9c7d-33b525a85255 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:08.753733 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-975be525-b197-4f50-9c7d-33b525a85255 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 29c92489-5a3c-43e3-8dae-d5168e2a29bb] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:08.763585 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-975be525-b197-4f50-9c7d-33b525a85255 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:08.764391 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-975be525-b197-4f50-9c7d-33b525a85255 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:08.764977 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-975be525-b197-4f50-9c7d-33b525a85255 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:08.765976 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-975be525-b197-4f50-9c7d-33b525a85255 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:08.766645 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-975be525-b197-4f50-9c7d-33b525a85255 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:08.767398 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-975be525-b197-4f50-9c7d-33b525a85255 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:08.814962 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-975be525-b197-4f50-9c7d-33b525a85255 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077235 Sep 17 21:07:08.815821 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2051/4006] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 17 21:07:08 2022] GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:07:08.821716 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bcd4765e-3596-4552-87ef-d94c3ca857a9 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "POST /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d/action" status: 202 len: 0 microversion: 2.1 time: 0.175479 Sep 17 21:07:08.822429 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c95bb33e-a549-47ab-a1b2-6dc0afa04ad5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:08.823070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c95bb33e-a549-47ab-a1b2-6dc0afa04ad5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:08.830670 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c95bb33e-a549-47ab-a1b2-6dc0afa04ad5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:08.831363 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c95bb33e-a549-47ab-a1b2-6dc0afa04ad5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:08.831935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c95bb33e-a549-47ab-a1b2-6dc0afa04ad5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:08.832811 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c95bb33e-a549-47ab-a1b2-6dc0afa04ad5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:08.833408 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c95bb33e-a549-47ab-a1b2-6dc0afa04ad5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:08.834162 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c95bb33e-a549-47ab-a1b2-6dc0afa04ad5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:08.839334 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1956/4007] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:07:08 2022] POST /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:07:08.850021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3d22904e-b2ee-4103-8538-365dd37c421b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:08.851428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3d22904e-b2ee-4103-8538-365dd37c421b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:08.861916 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3d22904e-b2ee-4103-8538-365dd37c421b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:08.863931 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3d22904e-b2ee-4103-8538-365dd37c421b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:08.864666 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3d22904e-b2ee-4103-8538-365dd37c421b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:08.865954 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3d22904e-b2ee-4103-8538-365dd37c421b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:08.866886 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3d22904e-b2ee-4103-8538-365dd37c421b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:08.868100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3d22904e-b2ee-4103-8538-365dd37c421b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:09.236039 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c95bb33e-a549-47ab-a1b2-6dc0afa04ad5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:09.247967 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3d22904e-b2ee-4103-8538-365dd37c421b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:09.254900 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c95bb33e-a549-47ab-a1b2-6dc0afa04ad5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1485 microversion: 2.1 time: 0.437669 Sep 17 21:07:09.255549 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2052/4008] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:08 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1485 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:09.261312 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3d22904e-b2ee-4103-8538-365dd37c421b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d" status: 200 len: 1508 microversion: 2.1 time: 0.417647 Sep 17 21:07:09.266024 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1957/4009] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:08 2022] GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d => generated 1508 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:07:09.439120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ce1f6044-fe85-408b-97a8-1c803f759925 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1710409677", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:09.445558 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d74b25bb-6756-4e1a-8ea3-d2bd451da5a5 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:09.446286 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d74b25bb-6756-4e1a-8ea3-d2bd451da5a5 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 964a7041-9baa-42fb-a51c-f760437411df] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:09.458551 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d74b25bb-6756-4e1a-8ea3-d2bd451da5a5 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:09.459956 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d74b25bb-6756-4e1a-8ea3-d2bd451da5a5 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:09.463243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d74b25bb-6756-4e1a-8ea3-d2bd451da5a5 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:09.465133 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d74b25bb-6756-4e1a-8ea3-d2bd451da5a5 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:09.466158 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d74b25bb-6756-4e1a-8ea3-d2bd451da5a5 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:09.469298 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d74b25bb-6756-4e1a-8ea3-d2bd451da5a5 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:09.551132 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-ce1f6044-fe85-408b-97a8-1c803f759925 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] validate_networks() for [('0a3abe11-a264-489a-ad08-1352aae9bc49', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:07:09.638841 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d74b25bb-6756-4e1a-8ea3-d2bd451da5a5 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33784305478f46ae9fdc4d4b82ebc6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e857c532a264ea78e24fd8fe1a44fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:09.648051 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d74b25bb-6756-4e1a-8ea3-d2bd451da5a5 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "GET /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df" status: 200 len: 1210 microversion: 2.1 time: 0.207106 Sep 17 21:07:09.649155 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1958/4010] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:09 2022] GET /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df => generated 1210 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:09.828354 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e1d9a22e-a75e-42b0-979d-753fd639fc39 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:09.830669 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e1d9a22e-a75e-42b0-979d-753fd639fc39 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 29c92489-5a3c-43e3-8dae-d5168e2a29bb] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:09.842375 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e1d9a22e-a75e-42b0-979d-753fd639fc39 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:09.844022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e1d9a22e-a75e-42b0-979d-753fd639fc39 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:09.855421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e1d9a22e-a75e-42b0-979d-753fd639fc39 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:09.857873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e1d9a22e-a75e-42b0-979d-753fd639fc39 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:09.858751 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e1d9a22e-a75e-42b0-979d-753fd639fc39 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:09.860966 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e1d9a22e-a75e-42b0-979d-753fd639fc39 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:09.926004 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e1d9a22e-a75e-42b0-979d-753fd639fc39 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.101750 Sep 17 21:07:09.932891 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1959/4011] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 17 21:07:09 2022] GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb/os-volume_attachments => generated 25 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:07:10.238206 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cf4219e2-8f49-4b66-b1be-4ba1f13f449b tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-536337321", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "83d59427-cf2b-488c-82e6-78128ffc2fa3"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:10.291004 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-ce1f6044-fe85-408b-97a8-1c803f759925 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:07:10.291442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-ce1f6044-fe85-408b-97a8-1c803f759925 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:07:10.291919 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-ce1f6044-fe85-408b-97a8-1c803f759925 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:07:10.292532 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-ce1f6044-fe85-408b-97a8-1c803f759925 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:07:10.293576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-ce1f6044-fe85-408b-97a8-1c803f759925 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:07:10.305067 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce1f6044-fe85-408b-97a8-1c803f759925 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:10.307381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce1f6044-fe85-408b-97a8-1c803f759925 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:10.307978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce1f6044-fe85-408b-97a8-1c803f759925 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:10.308908 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce1f6044-fe85-408b-97a8-1c803f759925 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:10.309669 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce1f6044-fe85-408b-97a8-1c803f759925 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:10.310390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce1f6044-fe85-408b-97a8-1c803f759925 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:10.312097 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-cf4219e2-8f49-4b66-b1be-4ba1f13f449b tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] validate_networks() for [('83d59427-cf2b-488c-82e6-78128ffc2fa3', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:07:10.354124 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-ce1f6044-fe85-408b-97a8-1c803f759925 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Getting quotas for project d527ac7a0b864094a5c74dea23ec445b. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:07:10.365266 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-ce1f6044-fe85-408b-97a8-1c803f759925 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Getting quotas for user 599c7072545f4280988f6bc50e3ccc5f and project d527ac7a0b864094a5c74dea23ec445b. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:07:10.409489 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ce1f6044-fe85-408b-97a8-1c803f759925 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:07:10.419641 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ce1f6044-fe85-408b-97a8-1c803f759925 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:07:10.524749 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ce1f6044-fe85-408b-97a8-1c803f759925 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.089255 Sep 17 21:07:10.527232 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2053/4012] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:07:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 1093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:07:10.556402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cbfa2ee5-a726-44b1-b8ad-8705307b31da tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:10.574795 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cbfa2ee5-a726-44b1-b8ad-8705307b31da tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:10.598546 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbfa2ee5-a726-44b1-b8ad-8705307b31da tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:10.599437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbfa2ee5-a726-44b1-b8ad-8705307b31da tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:10.601061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbfa2ee5-a726-44b1-b8ad-8705307b31da tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:10.602360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbfa2ee5-a726-44b1-b8ad-8705307b31da tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:10.604036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbfa2ee5-a726-44b1-b8ad-8705307b31da tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:10.605489 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbfa2ee5-a726-44b1-b8ad-8705307b31da tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:10.984633 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cbfa2ee5-a726-44b1-b8ad-8705307b31da tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:10.998349 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cbfa2ee5-a726-44b1-b8ad-8705307b31da tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d" status: 200 len: 1508 microversion: 2.1 time: 0.468514 Sep 17 21:07:10.999964 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2054/4013] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:10 2022] GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d => generated 1508 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:11.012379 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4ce84b93-74f3-41e5-8676-401d8e7e7f46 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:11.015700 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4ce84b93-74f3-41e5-8676-401d8e7e7f46 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:11.397715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4ce84b93-74f3-41e5-8676-401d8e7e7f46 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:11.405177 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4ce84b93-74f3-41e5-8676-401d8e7e7f46 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1214 microversion: 2.1 time: 0.402622 Sep 17 21:07:11.406322 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2055/4014] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:11 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1214 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:11.410962 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-25f5c92a-30a8-4b00-8d85-4d869d565379 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:11.411573 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-25f5c92a-30a8-4b00-8d85-4d869d565379 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 964a7041-9baa-42fb-a51c-f760437411df] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:11.418381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-25f5c92a-30a8-4b00-8d85-4d869d565379 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:11.419057 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-25f5c92a-30a8-4b00-8d85-4d869d565379 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:11.419758 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-25f5c92a-30a8-4b00-8d85-4d869d565379 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:11.420736 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-25f5c92a-30a8-4b00-8d85-4d869d565379 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:11.421365 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-25f5c92a-30a8-4b00-8d85-4d869d565379 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:11.421982 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-25f5c92a-30a8-4b00-8d85-4d869d565379 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:12.074098 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-25f5c92a-30a8-4b00-8d85-4d869d565379 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33784305478f46ae9fdc4d4b82ebc6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e857c532a264ea78e24fd8fe1a44fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:12.088555 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-25f5c92a-30a8-4b00-8d85-4d869d565379 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "GET /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df" status: 200 len: 1272 microversion: 2.1 time: 0.680608 Sep 17 21:07:12.089179 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2056/4015] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:11 2022] GET /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df => generated 1272 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:12.101183 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-527a9b2a-37a6-4d89-9641-dcb55f0d682e tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:12.102125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-527a9b2a-37a6-4d89-9641-dcb55f0d682e tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:12.115197 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-527a9b2a-37a6-4d89-9641-dcb55f0d682e tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:12.118290 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-527a9b2a-37a6-4d89-9641-dcb55f0d682e tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:12.119266 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-527a9b2a-37a6-4d89-9641-dcb55f0d682e tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:12.120033 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-527a9b2a-37a6-4d89-9641-dcb55f0d682e tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:12.120506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-527a9b2a-37a6-4d89-9641-dcb55f0d682e tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:12.120936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-527a9b2a-37a6-4d89-9641-dcb55f0d682e tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:12.164598 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-cf4219e2-8f49-4b66-b1be-4ba1f13f449b tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:07:12.167144 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-cf4219e2-8f49-4b66-b1be-4ba1f13f449b tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:07:12.167806 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-cf4219e2-8f49-4b66-b1be-4ba1f13f449b tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:07:12.168505 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-cf4219e2-8f49-4b66-b1be-4ba1f13f449b tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:07:12.169069 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-cf4219e2-8f49-4b66-b1be-4ba1f13f449b tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:07:12.184634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf4219e2-8f49-4b66-b1be-4ba1f13f449b tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:12.185131 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf4219e2-8f49-4b66-b1be-4ba1f13f449b tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:12.186304 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf4219e2-8f49-4b66-b1be-4ba1f13f449b tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:12.187241 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf4219e2-8f49-4b66-b1be-4ba1f13f449b tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:12.187789 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf4219e2-8f49-4b66-b1be-4ba1f13f449b tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:12.188220 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf4219e2-8f49-4b66-b1be-4ba1f13f449b tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:12.225931 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-cf4219e2-8f49-4b66-b1be-4ba1f13f449b tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Getting quotas for project c3a83c9c29f1483b9ee9c48e94dc17ce. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:07:12.241975 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-cf4219e2-8f49-4b66-b1be-4ba1f13f449b tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Getting quotas for user 24c7a82126124ebb8baf5c656ff9849d and project c3a83c9c29f1483b9ee9c48e94dc17ce. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:07:12.279705 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cf4219e2-8f49-4b66-b1be-4ba1f13f449b tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:07:12.282623 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cf4219e2-8f49-4b66-b1be-4ba1f13f449b tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 142d8aab-a359-47e1-a8d5-a77303a1f0ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:07:12.374035 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-527a9b2a-37a6-4d89-9641-dcb55f0d682e tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:12.384975 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-527a9b2a-37a6-4d89-9641-dcb55f0d682e tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d" status: 200 len: 1514 microversion: 2.1 time: 0.294235 Sep 17 21:07:12.385957 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2057/4016] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:12 2022] GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d => generated 1514 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:12.409065 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cf4219e2-8f49-4b66-b1be-4ba1f13f449b tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.174833 Sep 17 21:07:12.412486 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1960/4017] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:07:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2179 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:07:12.425224 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3940ed17-ba5f-4dbd-a43b-f70658b89df6 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:12.425925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3940ed17-ba5f-4dbd-a43b-f70658b89df6 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 142d8aab-a359-47e1-a8d5-a77303a1f0ae] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:12.443140 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-98af0f0c-7547-44f4-a91c-4a3bbf7ce8c0 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:12.446260 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-98af0f0c-7547-44f4-a91c-4a3bbf7ce8c0 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:12.456297 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98af0f0c-7547-44f4-a91c-4a3bbf7ce8c0 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:12.470929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98af0f0c-7547-44f4-a91c-4a3bbf7ce8c0 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:12.473401 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98af0f0c-7547-44f4-a91c-4a3bbf7ce8c0 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:12.475250 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98af0f0c-7547-44f4-a91c-4a3bbf7ce8c0 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:12.476097 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98af0f0c-7547-44f4-a91c-4a3bbf7ce8c0 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:12.478099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98af0f0c-7547-44f4-a91c-4a3bbf7ce8c0 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:12.693247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3940ed17-ba5f-4dbd-a43b-f70658b89df6 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c7a82126124ebb8baf5c656ff9849d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a83c9c29f1483b9ee9c48e94dc17ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:12.700310 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-98af0f0c-7547-44f4-a91c-4a3bbf7ce8c0 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:12.707338 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3940ed17-ba5f-4dbd-a43b-f70658b89df6 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "GET /compute/v2.1/servers/142d8aab-a359-47e1-a8d5-a77303a1f0ae" status: 200 len: 1217 microversion: 2.1 time: 0.289272 Sep 17 21:07:12.710038 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2058/4018] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:12 2022] GET /compute/v2.1/servers/142d8aab-a359-47e1-a8d5-a77303a1f0ae => generated 1217 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:12.717744 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-98af0f0c-7547-44f4-a91c-4a3bbf7ce8c0 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1274 microversion: 2.1 time: 0.278305 Sep 17 21:07:12.718810 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1961/4019] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:12 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1274 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:13.114326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bcbd6f6f-bc58-4dfa-b58c-46dceb6aca7d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:13.114828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bcbd6f6f-bc58-4dfa-b58c-46dceb6aca7d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 964a7041-9baa-42fb-a51c-f760437411df] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:13.129895 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bcbd6f6f-bc58-4dfa-b58c-46dceb6aca7d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:13.131743 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bcbd6f6f-bc58-4dfa-b58c-46dceb6aca7d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:13.132518 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bcbd6f6f-bc58-4dfa-b58c-46dceb6aca7d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:13.136372 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bcbd6f6f-bc58-4dfa-b58c-46dceb6aca7d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:13.137621 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bcbd6f6f-bc58-4dfa-b58c-46dceb6aca7d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:13.139863 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bcbd6f6f-bc58-4dfa-b58c-46dceb6aca7d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:13.732544 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9e1ea97e-287f-46c3-98a9-79587e762376 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:13.734168 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9e1ea97e-287f-46c3-98a9-79587e762376 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 142d8aab-a359-47e1-a8d5-a77303a1f0ae] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:13.744937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e1ea97e-287f-46c3-98a9-79587e762376 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:13.746134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e1ea97e-287f-46c3-98a9-79587e762376 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:13.746776 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e1ea97e-287f-46c3-98a9-79587e762376 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:13.747732 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e1ea97e-287f-46c3-98a9-79587e762376 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:13.748378 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e1ea97e-287f-46c3-98a9-79587e762376 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:13.749022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e1ea97e-287f-46c3-98a9-79587e762376 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:13.903651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bcbd6f6f-bc58-4dfa-b58c-46dceb6aca7d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33784305478f46ae9fdc4d4b82ebc6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e857c532a264ea78e24fd8fe1a44fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:13.919029 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bcbd6f6f-bc58-4dfa-b58c-46dceb6aca7d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "GET /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df" status: 200 len: 1314 microversion: 2.1 time: 0.810692 Sep 17 21:07:13.920492 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2059/4020] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:13 2022] GET /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df => generated 1314 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:13.928330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8da9f1c1-69b5-4d45-9371-b03a957575ad tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:13.929553 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8da9f1c1-69b5-4d45-9371-b03a957575ad tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:13.941405 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8da9f1c1-69b5-4d45-9371-b03a957575ad tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:13.942181 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8da9f1c1-69b5-4d45-9371-b03a957575ad tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:13.942857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8da9f1c1-69b5-4d45-9371-b03a957575ad tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:13.943837 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8da9f1c1-69b5-4d45-9371-b03a957575ad tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:13.944865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8da9f1c1-69b5-4d45-9371-b03a957575ad tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:13.945579 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8da9f1c1-69b5-4d45-9371-b03a957575ad tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:14.029587 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9e1ea97e-287f-46c3-98a9-79587e762376 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c7a82126124ebb8baf5c656ff9849d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a83c9c29f1483b9ee9c48e94dc17ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:14.038937 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9e1ea97e-287f-46c3-98a9-79587e762376 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "GET /compute/v2.1/servers/142d8aab-a359-47e1-a8d5-a77303a1f0ae" status: 200 len: 1269 microversion: 2.1 time: 0.311118 Sep 17 21:07:14.046869 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1962/4021] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:13 2022] GET /compute/v2.1/servers/142d8aab-a359-47e1-a8d5-a77303a1f0ae => generated 1269 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:14.091277 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-57c1651d-31cc-4008-bc5c-bae411a8c576 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Action: 'create', calling method: .version_select at 0x7f25a46c0820>, body: {"keypair": {"name": "tempest-keypair-358040941", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHeXalZ8N+Bq4+MCXitK3+nUfXChgBw5+NjI+fowZWUBEhz9eYjt/srFFnNVrjwd4EOpGGhWxHC8UJQhO6IY9v9REQuC6izzYHzY4+TFKvM3eeAdYwTAnGfgcINb2Hlh9Q=="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:14.108494 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-57c1651d-31cc-4008-bc5c-bae411a8c576 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Getting quotas for project f8ed24e4bf6643f7b1474fcec78c4995. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:07:14.115686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-57c1651d-31cc-4008-bc5c-bae411a8c576 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Getting quotas for user 795813bb461e42ad8c2a758e9b8430d6 and project f8ed24e4bf6643f7b1474fcec78c4995. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:07:14.123288 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8da9f1c1-69b5-4d45-9371-b03a957575ad tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:14.138172 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8da9f1c1-69b5-4d45-9371-b03a957575ad tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1272 microversion: 2.1 time: 0.215720 Sep 17 21:07:14.138992 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2060/4022] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:13 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1272 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:14.151076 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-57c1651d-31cc-4008-bc5c-bae411a8c576 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.063537 Sep 17 21:07:14.152547 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1963/4023] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:07:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:07:14.944005 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c28817f7-b699-4c9d-8b27-246ea09f55f7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:14.944633 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c28817f7-b699-4c9d-8b27-246ea09f55f7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 964a7041-9baa-42fb-a51c-f760437411df] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:14.956883 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c28817f7-b699-4c9d-8b27-246ea09f55f7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:14.957291 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c28817f7-b699-4c9d-8b27-246ea09f55f7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:14.963624 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c28817f7-b699-4c9d-8b27-246ea09f55f7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:14.965274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c28817f7-b699-4c9d-8b27-246ea09f55f7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:14.968324 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c28817f7-b699-4c9d-8b27-246ea09f55f7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:14.968826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c28817f7-b699-4c9d-8b27-246ea09f55f7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:15.075489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c375948d-743b-49d9-8376-7e46f3758af7 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:15.077152 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c375948d-743b-49d9-8376-7e46f3758af7 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 142d8aab-a359-47e1-a8d5-a77303a1f0ae] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:15.091153 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c375948d-743b-49d9-8376-7e46f3758af7 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:15.093684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c375948d-743b-49d9-8376-7e46f3758af7 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:15.097705 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c375948d-743b-49d9-8376-7e46f3758af7 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:15.098649 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c375948d-743b-49d9-8376-7e46f3758af7 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:15.099290 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c375948d-743b-49d9-8376-7e46f3758af7 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:15.099761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c375948d-743b-49d9-8376-7e46f3758af7 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:15.150441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:15.349016 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c375948d-743b-49d9-8376-7e46f3758af7 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c7a82126124ebb8baf5c656ff9849d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a83c9c29f1483b9ee9c48e94dc17ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:15.367828 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c375948d-743b-49d9-8376-7e46f3758af7 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "GET /compute/v2.1/servers/142d8aab-a359-47e1-a8d5-a77303a1f0ae" status: 200 len: 1275 microversion: 2.1 time: 0.297988 Sep 17 21:07:15.368385 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1964/4024] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:15 2022] GET /compute/v2.1/servers/142d8aab-a359-47e1-a8d5-a77303a1f0ae => generated 1275 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:15.392479 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2918f398-8901-4d3a-9041-0dd440e08fc4 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:15.417225 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2918f398-8901-4d3a-9041-0dd440e08fc4 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:15.425705 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2918f398-8901-4d3a-9041-0dd440e08fc4 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:15.426408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2918f398-8901-4d3a-9041-0dd440e08fc4 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:15.427086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2918f398-8901-4d3a-9041-0dd440e08fc4 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:15.428104 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2918f398-8901-4d3a-9041-0dd440e08fc4 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:15.430213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2918f398-8901-4d3a-9041-0dd440e08fc4 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:15.431181 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2918f398-8901-4d3a-9041-0dd440e08fc4 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:15.936913 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c28817f7-b699-4c9d-8b27-246ea09f55f7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33784305478f46ae9fdc4d4b82ebc6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e857c532a264ea78e24fd8fe1a44fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:15.953737 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c28817f7-b699-4c9d-8b27-246ea09f55f7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "GET /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df" status: 200 len: 1314 microversion: 2.1 time: 1.013495 Sep 17 21:07:15.954667 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2061/4025] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:14 2022] GET /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df => generated 1314 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:16.355501 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2a2d5e6a-dd8e-4e00-bf25-50ce5989f441 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:16.356029 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2a2d5e6a-dd8e-4e00-bf25-50ce5989f441 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 839ed6b8-9a04-4448-afb8-1eb643476249] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:16.369379 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a2d5e6a-dd8e-4e00-bf25-50ce5989f441 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:16.370881 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a2d5e6a-dd8e-4e00-bf25-50ce5989f441 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:16.371326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a2d5e6a-dd8e-4e00-bf25-50ce5989f441 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:16.372137 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a2d5e6a-dd8e-4e00-bf25-50ce5989f441 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:16.372624 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a2d5e6a-dd8e-4e00-bf25-50ce5989f441 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:16.374128 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a2d5e6a-dd8e-4e00-bf25-50ce5989f441 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:16.401030 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2918f398-8901-4d3a-9041-0dd440e08fc4 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:16.410881 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2918f398-8901-4d3a-9041-0dd440e08fc4 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1314 microversion: 2.1 time: 1.039792 Sep 17 21:07:16.413586 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1965/4026] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:15 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1314 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:16.427832 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2a2d5e6a-dd8e-4e00-bf25-50ce5989f441 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249/ips" status: 200 len: 150 microversion: 2.1 time: 0.077979 Sep 17 21:07:16.429785 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2062/4027] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Sep 17 21:07:16 2022] GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249/ips => generated 150 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:07:16.435813 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-baa4b819-751c-42b8-bc89-1949b22e0eae tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:16.440197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-baa4b819-751c-42b8-bc89-1949b22e0eae tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 142d8aab-a359-47e1-a8d5-a77303a1f0ae] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:16.463133 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-baa4b819-751c-42b8-bc89-1949b22e0eae tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:16.463902 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-baa4b819-751c-42b8-bc89-1949b22e0eae tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:16.464441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-baa4b819-751c-42b8-bc89-1949b22e0eae tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:16.465373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-baa4b819-751c-42b8-bc89-1949b22e0eae tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:16.466027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-baa4b819-751c-42b8-bc89-1949b22e0eae tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:16.466559 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-baa4b819-751c-42b8-bc89-1949b22e0eae tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:16.982851 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-12d613e1-1540-4e63-9d28-cc953ea4c2d6 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:16.984404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-12d613e1-1540-4e63-9d28-cc953ea4c2d6 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 964a7041-9baa-42fb-a51c-f760437411df] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:16.997826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12d613e1-1540-4e63-9d28-cc953ea4c2d6 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:16.999001 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12d613e1-1540-4e63-9d28-cc953ea4c2d6 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:17.000071 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-baa4b819-751c-42b8-bc89-1949b22e0eae tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c7a82126124ebb8baf5c656ff9849d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a83c9c29f1483b9ee9c48e94dc17ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:17.001312 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12d613e1-1540-4e63-9d28-cc953ea4c2d6 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:17.003431 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12d613e1-1540-4e63-9d28-cc953ea4c2d6 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:17.006762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12d613e1-1540-4e63-9d28-cc953ea4c2d6 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:17.008636 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12d613e1-1540-4e63-9d28-cc953ea4c2d6 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:17.013959 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-baa4b819-751c-42b8-bc89-1949b22e0eae tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "GET /compute/v2.1/servers/142d8aab-a359-47e1-a8d5-a77303a1f0ae" status: 200 len: 1317 microversion: 2.1 time: 0.595074 Sep 17 21:07:17.014790 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1966/4028] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:16 2022] GET /compute/v2.1/servers/142d8aab-a359-47e1-a8d5-a77303a1f0ae => generated 1317 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:17.305901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-8a10d485-a694-4752-97c8-062fb95b05c0 req-229f791c-2f7f-4796-b05c-9902a511b417 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "142d8aab-a359-47e1-a8d5-a77303a1f0ae", "tag": "476762ad-4639-45af-9194-c976beae9228"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:17.323945 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8a10d485-a694-4752-97c8-062fb95b05c0 req-229f791c-2f7f-4796-b05c-9902a511b417 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:17.324431 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8a10d485-a694-4752-97c8-062fb95b05c0 req-229f791c-2f7f-4796-b05c-9902a511b417 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:17.324870 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8a10d485-a694-4752-97c8-062fb95b05c0 req-229f791c-2f7f-4796-b05c-9902a511b417 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:17.343936 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-8a10d485-a694-4752-97c8-062fb95b05c0 req-229f791c-2f7f-4796-b05c-9902a511b417 service nova] Creating event network-changed:476762ad-4639-45af-9194-c976beae9228 for instance 142d8aab-a359-47e1-a8d5-a77303a1f0ae on nch1-master-1 Sep 17 21:07:17.349446 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-8a10d485-a694-4752-97c8-062fb95b05c0 req-229f791c-2f7f-4796-b05c-9902a511b417 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047339 Sep 17 21:07:17.350659 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1967/4029] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:07:17.444777 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-55e82493-3043-42d6-834a-e4ccf86b33a8 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:17.447852 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-55e82493-3043-42d6-834a-e4ccf86b33a8 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:17.465159 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55e82493-3043-42d6-834a-e4ccf86b33a8 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:17.466035 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55e82493-3043-42d6-834a-e4ccf86b33a8 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:17.466642 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55e82493-3043-42d6-834a-e4ccf86b33a8 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:17.467376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55e82493-3043-42d6-834a-e4ccf86b33a8 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:17.467835 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55e82493-3043-42d6-834a-e4ccf86b33a8 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:17.468574 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55e82493-3043-42d6-834a-e4ccf86b33a8 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:17.768155 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-12d613e1-1540-4e63-9d28-cc953ea4c2d6 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33784305478f46ae9fdc4d4b82ebc6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e857c532a264ea78e24fd8fe1a44fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:17.777189 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-12d613e1-1540-4e63-9d28-cc953ea4c2d6 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "GET /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df" status: 200 len: 1314 microversion: 2.1 time: 0.800522 Sep 17 21:07:17.778902 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2063/4030] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:16 2022] GET /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df => generated 1314 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:07:17.800676 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-b6f570de-c21e-473e-afe4-81c7d7f22add req-a80ea9c5-758d-471d-b3b9-3f418b1eaa5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "964a7041-9baa-42fb-a51c-f760437411df", "tag": "37895208-c7eb-4756-b85a-84d40b390b4a"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:17.816616 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b6f570de-c21e-473e-afe4-81c7d7f22add req-a80ea9c5-758d-471d-b3b9-3f418b1eaa5a service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:17.817471 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b6f570de-c21e-473e-afe4-81c7d7f22add req-a80ea9c5-758d-471d-b3b9-3f418b1eaa5a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:17.818138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b6f570de-c21e-473e-afe4-81c7d7f22add req-a80ea9c5-758d-471d-b3b9-3f418b1eaa5a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:17.835290 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-b6f570de-c21e-473e-afe4-81c7d7f22add req-a80ea9c5-758d-471d-b3b9-3f418b1eaa5a service nova] Creating event network-changed:37895208-c7eb-4756-b85a-84d40b390b4a for instance 964a7041-9baa-42fb-a51c-f760437411df on nch1-master-1 Sep 17 21:07:17.842283 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-b6f570de-c21e-473e-afe4-81c7d7f22add req-a80ea9c5-758d-471d-b3b9-3f418b1eaa5a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060315 Sep 17 21:07:17.843515 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2064/4031] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:07:18.002075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-55e82493-3043-42d6-834a-e4ccf86b33a8 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:18.015272 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-55e82493-3043-42d6-834a-e4ccf86b33a8 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1314 microversion: 2.1 time: 0.575446 Sep 17 21:07:18.015989 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1968/4032] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:17 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1314 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:18.039807 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-56ebdfed-4775-4ee7-b6e8-fa9b3af84428 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:18.040522 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-56ebdfed-4775-4ee7-b6e8-fa9b3af84428 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 142d8aab-a359-47e1-a8d5-a77303a1f0ae] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:18.053155 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56ebdfed-4775-4ee7-b6e8-fa9b3af84428 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:18.054796 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56ebdfed-4775-4ee7-b6e8-fa9b3af84428 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:18.055725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56ebdfed-4775-4ee7-b6e8-fa9b3af84428 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:18.061978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56ebdfed-4775-4ee7-b6e8-fa9b3af84428 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:18.062971 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56ebdfed-4775-4ee7-b6e8-fa9b3af84428 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:18.065145 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56ebdfed-4775-4ee7-b6e8-fa9b3af84428 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:18.205678 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d1b5b23c-2e05-493b-a964-923d9ca148d4 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1c88125-bbdc-4e6f-99b5-cc2bbb27caf2"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:18.209038 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d1b5b23c-2e05-493b-a964-923d9ca148d4 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 839ed6b8-9a04-4448-afb8-1eb643476249] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:18.216444 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1b5b23c-2e05-493b-a964-923d9ca148d4 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:18.216933 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1b5b23c-2e05-493b-a964-923d9ca148d4 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:18.217370 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1b5b23c-2e05-493b-a964-923d9ca148d4 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:18.218126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1b5b23c-2e05-493b-a964-923d9ca148d4 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:18.218579 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1b5b23c-2e05-493b-a964-923d9ca148d4 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:18.219006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1b5b23c-2e05-493b-a964-923d9ca148d4 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:18.639815 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d1b5b23c-2e05-493b-a964-923d9ca148d4 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "POST /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.436839 Sep 17 21:07:18.641295 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1969/4033] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 17 21:07:18 2022] POST /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249/os-volume_attachments => generated 194 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:07:18.758823 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-77baae84-1602-4deb-a173-a5565e776202 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1115101942", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a953568a-fe33-4e0d-9d9e-690f2b9b852f"}], "security_groups": [{"name": "tempest-securitygroup--841447750"}], "key_name": "tempest-keypair-358040941", "user_data": "}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:18.806976 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-56ebdfed-4775-4ee7-b6e8-fa9b3af84428 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c7a82126124ebb8baf5c656ff9849d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a83c9c29f1483b9ee9c48e94dc17ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:18.824922 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-56ebdfed-4775-4ee7-b6e8-fa9b3af84428 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "GET /compute/v2.1/servers/142d8aab-a359-47e1-a8d5-a77303a1f0ae" status: 200 len: 1317 microversion: 2.1 time: 0.789374 Sep 17 21:07:18.825540 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2065/4034] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:18 2022] GET /compute/v2.1/servers/142d8aab-a359-47e1-a8d5-a77303a1f0ae => generated 1317 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:18.836023 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d496ac9d-47e9-471a-aa94-425d4156d00c tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:18.837844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d496ac9d-47e9-471a-aa94-425d4156d00c tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 964a7041-9baa-42fb-a51c-f760437411df] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:18.849747 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d496ac9d-47e9-471a-aa94-425d4156d00c tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:18.850418 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d496ac9d-47e9-471a-aa94-425d4156d00c tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:18.851068 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d496ac9d-47e9-471a-aa94-425d4156d00c tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:18.852268 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d496ac9d-47e9-471a-aa94-425d4156d00c tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:18.853785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d496ac9d-47e9-471a-aa94-425d4156d00c tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:18.854431 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d496ac9d-47e9-471a-aa94-425d4156d00c tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:19.051955 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-77baae84-1602-4deb-a173-a5565e776202 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] validate_networks() for [('a953568a-fe33-4e0d-9d9e-690f2b9b852f', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:07:19.349195 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d496ac9d-47e9-471a-aa94-425d4156d00c tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33784305478f46ae9fdc4d4b82ebc6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e857c532a264ea78e24fd8fe1a44fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:19.361539 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d496ac9d-47e9-471a-aa94-425d4156d00c tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "GET /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df" status: 200 len: 1314 microversion: 2.1 time: 0.531024 Sep 17 21:07:19.362169 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2066/4035] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:18 2022] GET /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:19.388761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-72466cb2-55cc-47da-8175-58fc23ff8f29 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:19.401026 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-72466cb2-55cc-47da-8175-58fc23ff8f29 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:19.416516 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72466cb2-55cc-47da-8175-58fc23ff8f29 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:19.420399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72466cb2-55cc-47da-8175-58fc23ff8f29 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:19.421975 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72466cb2-55cc-47da-8175-58fc23ff8f29 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:19.423006 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72466cb2-55cc-47da-8175-58fc23ff8f29 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:19.426165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72466cb2-55cc-47da-8175-58fc23ff8f29 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:19.426959 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72466cb2-55cc-47da-8175-58fc23ff8f29 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:19.997943 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-72466cb2-55cc-47da-8175-58fc23ff8f29 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:20.007871 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-72466cb2-55cc-47da-8175-58fc23ff8f29 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1314 microversion: 2.1 time: 0.627898 Sep 17 21:07:20.011148 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2067/4036] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:19 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1314 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:20.021842 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-94d66998-80cc-425b-8d29-c9a50da2f8ec tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:20.022445 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-94d66998-80cc-425b-8d29-c9a50da2f8ec tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 142d8aab-a359-47e1-a8d5-a77303a1f0ae] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:20.029953 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94d66998-80cc-425b-8d29-c9a50da2f8ec tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:20.030688 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94d66998-80cc-425b-8d29-c9a50da2f8ec tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:20.032319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94d66998-80cc-425b-8d29-c9a50da2f8ec tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:20.036596 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94d66998-80cc-425b-8d29-c9a50da2f8ec tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:20.037425 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94d66998-80cc-425b-8d29-c9a50da2f8ec tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:20.038091 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94d66998-80cc-425b-8d29-c9a50da2f8ec tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:20.319849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=4 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:20.794020 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-94d66998-80cc-425b-8d29-c9a50da2f8ec tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c7a82126124ebb8baf5c656ff9849d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a83c9c29f1483b9ee9c48e94dc17ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:20.799032 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:20.807298 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-94d66998-80cc-425b-8d29-c9a50da2f8ec tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "GET /compute/v2.1/servers/142d8aab-a359-47e1-a8d5-a77303a1f0ae" status: 200 len: 1317 microversion: 2.1 time: 0.794973 Sep 17 21:07:20.808240 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2068/4037] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:20 2022] GET /compute/v2.1/servers/142d8aab-a359-47e1-a8d5-a77303a1f0ae => generated 1317 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:20.813696 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-5409d2cd-488c-422d-aae2-3e0cd78f545c req-ee65d7e7-1919-41b5-9ee4-224acf07b367 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aaab678-c37b-490b-85bd-30f9dd9602cc", "tag": "8b1d1005-424b-485f-9d7a-9bfca4b2f098"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:20.829337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-5409d2cd-488c-422d-aae2-3e0cd78f545c req-ee65d7e7-1919-41b5-9ee4-224acf07b367 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:20.830150 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-5409d2cd-488c-422d-aae2-3e0cd78f545c req-ee65d7e7-1919-41b5-9ee4-224acf07b367 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:20.830811 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-5409d2cd-488c-422d-aae2-3e0cd78f545c req-ee65d7e7-1919-41b5-9ee4-224acf07b367 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:20.845407 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-5409d2cd-488c-422d-aae2-3e0cd78f545c req-ee65d7e7-1919-41b5-9ee4-224acf07b367 service nova] Creating event network-changed:8b1d1005-424b-485f-9d7a-9bfca4b2f098 for instance 4aaab678-c37b-490b-85bd-30f9dd9602cc on nch2-master-1 Sep 17 21:07:20.851006 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-5409d2cd-488c-422d-aae2-3e0cd78f545c req-ee65d7e7-1919-41b5-9ee4-224acf07b367 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041456 Sep 17 21:07:20.854205 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2069/4038] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:07:20.860190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1fdccc29-5b63-4791-9be7-d46538661419 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:20.861229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1fdccc29-5b63-4791-9be7-d46538661419 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 964a7041-9baa-42fb-a51c-f760437411df] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:20.868303 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1fdccc29-5b63-4791-9be7-d46538661419 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:20.869063 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1fdccc29-5b63-4791-9be7-d46538661419 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:20.869721 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1fdccc29-5b63-4791-9be7-d46538661419 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:20.870631 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1fdccc29-5b63-4791-9be7-d46538661419 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:20.871309 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1fdccc29-5b63-4791-9be7-d46538661419 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:20.872279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1fdccc29-5b63-4791-9be7-d46538661419 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:20.952003 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-77baae84-1602-4deb-a173-a5565e776202 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:07:20.952526 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-77baae84-1602-4deb-a173-a5565e776202 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:07:20.953200 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-77baae84-1602-4deb-a173-a5565e776202 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:07:20.953662 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-77baae84-1602-4deb-a173-a5565e776202 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:07:20.954784 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-77baae84-1602-4deb-a173-a5565e776202 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:07:20.983340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-77baae84-1602-4deb-a173-a5565e776202 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:20.983822 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-77baae84-1602-4deb-a173-a5565e776202 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:20.984477 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-77baae84-1602-4deb-a173-a5565e776202 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:20.985684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-77baae84-1602-4deb-a173-a5565e776202 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:20.986155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-77baae84-1602-4deb-a173-a5565e776202 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:20.986592 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-77baae84-1602-4deb-a173-a5565e776202 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:21.029798 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-77baae84-1602-4deb-a173-a5565e776202 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Getting quotas for project f8ed24e4bf6643f7b1474fcec78c4995. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:07:21.039159 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-77baae84-1602-4deb-a173-a5565e776202 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Getting quotas for user 795813bb461e42ad8c2a758e9b8430d6 and project f8ed24e4bf6643f7b1474fcec78c4995. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:07:21.069425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-77baae84-1602-4deb-a173-a5565e776202 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:07:21.072177 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-77baae84-1602-4deb-a173-a5565e776202 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:07:21.079828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1fdccc29-5b63-4791-9be7-d46538661419 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33784305478f46ae9fdc4d4b82ebc6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e857c532a264ea78e24fd8fe1a44fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:21.089818 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1fdccc29-5b63-4791-9be7-d46538661419 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "GET /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df" status: 200 len: 1314 microversion: 2.1 time: 0.234061 Sep 17 21:07:21.091118 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2070/4039] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:20 2022] GET /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:21.095965 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e7389093-829b-45e8-8ba6-8d12baf63043 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:21.096856 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e7389093-829b-45e8-8ba6-8d12baf63043 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:21.103266 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7389093-829b-45e8-8ba6-8d12baf63043 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:21.104006 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7389093-829b-45e8-8ba6-8d12baf63043 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:21.104689 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7389093-829b-45e8-8ba6-8d12baf63043 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:21.105711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7389093-829b-45e8-8ba6-8d12baf63043 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:21.106273 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7389093-829b-45e8-8ba6-8d12baf63043 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:21.106728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7389093-829b-45e8-8ba6-8d12baf63043 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:21.167989 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-77baae84-1602-4deb-a173-a5565e776202 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.416403 Sep 17 21:07:21.176897 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1970/4040] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:07:18 2022] POST /compute/v2.1/servers => generated 408 bytes in 2426 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 17 21:07:21.341424 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e6ff6c86-4225-4b2c-85c9-270e36095dda tempest-SecurityGroupsNegativeTestJSON-775369485 tempest-SecurityGroupsNegativeTestJSON-775369485-project] Calling method '.version_select at 0x7f25a4748040>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:21.517901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG neutronclient.v2_0.client [None req-e6ff6c86-4225-4b2c-85c9-270e36095dda tempest-SecurityGroupsNegativeTestJSON-775369485 tempest-SecurityGroupsNegativeTestJSON-775369485-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 54df7ded-5877-4d53-bc1d-d1da109014ab does not exist", "detail": ""}} {{(pid=140523) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 17 21:07:21.518746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.security_group_api [None req-e6ff6c86-4225-4b2c-85c9-270e36095dda tempest-SecurityGroupsNegativeTestJSON-775369485 tempest-SecurityGroupsNegativeTestJSON-775369485-project] Neutron security group 54df7ded-5877-4d53-bc1d-d1da109014ab not found {{(pid=140523) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 17 21:07:21.519577 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-e6ff6c86-4225-4b2c-85c9-270e36095dda tempest-SecurityGroupsNegativeTestJSON-775369485 tempest-SecurityGroupsNegativeTestJSON-775369485-project] HTTP exception thrown: Security group 54df7ded-5877-4d53-bc1d-d1da109014ab does not exist Sep 17 21:07:21.519577 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-57a72cac-65f0-4ad0-b48f-83c63cb6d37e'] Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e6ff6c86-4225-4b2c-85c9-270e36095dda tempest-SecurityGroupsNegativeTestJSON-775369485 tempest-SecurityGroupsNegativeTestJSON-775369485-project] Request method failure captured: Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/os-security-groups/54df7ded-5877-4d53-bc1d-d1da109014ab HTTP/1.1 Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjcJguEn7RPcf0E-Q1ylWwfDjG4UwEIIcwDNpNoXTSiiZipd82KlCNBjKD65vcpBdMNy6LBwRdwU0bScsYiM5ZgvLR8FhQvryXm5Mz7rlm5om7LJR9Kq1kmsNwW-Zo0b7DgbFcCDKxdDDxM1rxbJdHOmXiQbNEQVJv8p15A8kVHtDzI Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: d704de116c314d1e880d826915a43eae Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-775369485 Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d704de116c314d1e880d826915a43eae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d704de116c314d1e880d826915a43eae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d704de116c314d1e880d826915a43eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d704de116c314d1e880d826915a43eae", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-775369485 Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: d704de116c314d1e880d826915a43eae Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-775369485 Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-SecurityGroupsNegativeTestJSON-775369485-project Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 02aa44fb4544430484ce6cf03e6d0aa3 Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-775369485-project Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: exception: Security group 54df7ded-5877-4d53-bc1d-d1da109014ab does not exist Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-57a72cac-65f0-4ad0-b48f-83c63cb6d37e'] Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '54df7ded-5877-4d53-bc1d-d1da109014ab'} Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 17 21:07:21.521804 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 54df7ded-5877-4d53-bc1d-d1da109014ab does not exist Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-57a72cac-65f0-4ad0-b48f-83c63cb6d37e'] Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 54df7ded-5877-4d53-bc1d-d1da109014ab does not exist Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-57a72cac-65f0-4ad0-b48f-83c63cb6d37e'] Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 54df7ded-5877-4d53-bc1d-d1da109014ab does not exist Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-57a72cac-65f0-4ad0-b48f-83c63cb6d37e'] Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 54df7ded-5877-4d53-bc1d-d1da109014ab does not exist Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-57a72cac-65f0-4ad0-b48f-83c63cb6d37e'] Sep 17 21:07:21.525030 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:21.528560 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e6ff6c86-4225-4b2c-85c9-270e36095dda tempest-SecurityGroupsNegativeTestJSON-775369485 tempest-SecurityGroupsNegativeTestJSON-775369485-project] Returning 404 to user: Security group 54df7ded-5877-4d53-bc1d-d1da109014ab does not exist Sep 17 21:07:21.528560 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-57a72cac-65f0-4ad0-b48f-83c63cb6d37e'] {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:07:21.530269 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e6ff6c86-4225-4b2c-85c9-270e36095dda tempest-SecurityGroupsNegativeTestJSON-775369485 tempest-SecurityGroupsNegativeTestJSON-775369485-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/54df7ded-5877-4d53-bc1d-d1da109014ab" status: 404 len: 194 microversion: 2.1 time: 0.352028 Sep 17 21:07:21.531040 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1971/4041] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 21:07:21 2022] DELETE /compute/v2.1/os-security-groups/54df7ded-5877-4d53-bc1d-d1da109014ab => generated 194 bytes in 353 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:07:21.542781 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-57bd174f-3723-410f-b82b-6a8aaea81670 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:21.546128 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-57bd174f-3723-410f-b82b-6a8aaea81670 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:21.674864 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e7389093-829b-45e8-8ba6-8d12baf63043 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:21.685987 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e7389093-829b-45e8-8ba6-8d12baf63043 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1314 microversion: 2.1 time: 0.593507 Sep 17 21:07:21.690179 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2071/4042] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:21 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1314 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:21.706621 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d8425cc3-284e-40b7-933c-017aff07e45d tempest-SecurityGroupsNegativeTestJSON-775369485 tempest-SecurityGroupsNegativeTestJSON-775369485-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.012767 Sep 17 21:07:21.708891 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2072/4043] 10.222.0.26 () {58 vars in 1164 bytes} [Sat Sep 17 21:07:21 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 17 21:07:21.721368 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fdd423a3-7799-45f3-b04e-c8809d160e9b tempest-SecurityGroupsNegativeTestJSON-775369485 tempest-SecurityGroupsNegativeTestJSON-775369485-project] Calling method '.version_select at 0x7f25a5716940>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:21.799400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-57bd174f-3723-410f-b82b-6a8aaea81670 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:21.819222 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-57bd174f-3723-410f-b82b-6a8aaea81670 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915" status: 200 len: 1245 microversion: 2.1 time: 0.286698 Sep 17 21:07:21.834325 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1972/4044] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:21 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 => generated 1245 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:21.851026 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-64903b13-33b9-4aaf-b00a-ab1d4e2e0a6d req-5e8b1ef3-ce38-4ba7-9a06-92ab86eac4c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "142d8aab-a359-47e1-a8d5-a77303a1f0ae", "name": "network-vif-plugged", "status": "completed", "tag": "476762ad-4639-45af-9194-c976beae9228"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:21.871911 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-64903b13-33b9-4aaf-b00a-ab1d4e2e0a6d req-5e8b1ef3-ce38-4ba7-9a06-92ab86eac4c5 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:21.872600 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-64903b13-33b9-4aaf-b00a-ab1d4e2e0a6d req-5e8b1ef3-ce38-4ba7-9a06-92ab86eac4c5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:21.873190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-64903b13-33b9-4aaf-b00a-ab1d4e2e0a6d req-5e8b1ef3-ce38-4ba7-9a06-92ab86eac4c5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:21.894444 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-64903b13-33b9-4aaf-b00a-ab1d4e2e0a6d req-5e8b1ef3-ce38-4ba7-9a06-92ab86eac4c5 service nova] Creating event network-vif-plugged:476762ad-4639-45af-9194-c976beae9228 for instance 142d8aab-a359-47e1-a8d5-a77303a1f0ae on nch1-master-1 Sep 17 21:07:21.904478 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-64903b13-33b9-4aaf-b00a-ab1d4e2e0a6d req-5e8b1ef3-ce38-4ba7-9a06-92ab86eac4c5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065915 Sep 17 21:07:21.906030 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1973/4045] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:07:21.920193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-971cc416-bdef-46b6-824c-844dd90ff9b1 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:21.921726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-971cc416-bdef-46b6-824c-844dd90ff9b1 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 142d8aab-a359-47e1-a8d5-a77303a1f0ae] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:21.930289 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-971cc416-bdef-46b6-824c-844dd90ff9b1 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:21.931111 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-971cc416-bdef-46b6-824c-844dd90ff9b1 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:21.931860 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-971cc416-bdef-46b6-824c-844dd90ff9b1 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:21.932935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-971cc416-bdef-46b6-824c-844dd90ff9b1 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:21.933693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-971cc416-bdef-46b6-824c-844dd90ff9b1 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:21.935727 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-971cc416-bdef-46b6-824c-844dd90ff9b1 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:22.375492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-971cc416-bdef-46b6-824c-844dd90ff9b1 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c7a82126124ebb8baf5c656ff9849d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a83c9c29f1483b9ee9c48e94dc17ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:22.385218 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-971cc416-bdef-46b6-824c-844dd90ff9b1 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "GET /compute/v2.1/servers/142d8aab-a359-47e1-a8d5-a77303a1f0ae" status: 200 len: 1317 microversion: 2.1 time: 0.475633 Sep 17 21:07:22.388948 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1974/4046] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:21 2022] GET /compute/v2.1/servers/142d8aab-a359-47e1-a8d5-a77303a1f0ae => generated 1317 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:22.397910 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-828e64b3-922d-405c-a4ff-7eb615c90ea7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:22.399898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-828e64b3-922d-405c-a4ff-7eb615c90ea7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 964a7041-9baa-42fb-a51c-f760437411df] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:22.417642 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-828e64b3-922d-405c-a4ff-7eb615c90ea7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:22.418411 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-828e64b3-922d-405c-a4ff-7eb615c90ea7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:22.419255 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-828e64b3-922d-405c-a4ff-7eb615c90ea7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:22.421203 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-828e64b3-922d-405c-a4ff-7eb615c90ea7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:22.421922 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-828e64b3-922d-405c-a4ff-7eb615c90ea7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:22.422700 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-828e64b3-922d-405c-a4ff-7eb615c90ea7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:22.483593 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fdd423a3-7799-45f3-b04e-c8809d160e9b tempest-SecurityGroupsNegativeTestJSON-775369485 tempest-SecurityGroupsNegativeTestJSON-775369485-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.768871 Sep 17 21:07:22.484189 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2073/4047] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Sep 17 21:07:21 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:07:22.499460 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a12d23be-8515-4423-8464-dd7d6594fbeb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Action: 'create', calling method: .version_select at 0x7f25a4d13820>, body: {"keypair": {"name": "tempest-keypair-1658892230", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIU0qsq8+A99Zx4t6kiCMz+e+gOUrbaow80/9W2DAP09xjCKU7YlZXlKp7I12FgvgRtJ0iT9dY0g4RydxeVVjVoOnmEnK7dhTneEfceKo8LGOxNO2YPNJNK26JnCb/0EvQ=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:22.521171 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-a12d23be-8515-4423-8464-dd7d6594fbeb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Getting quotas for project 6fa7e14863254ab3964ac907c168d9e6. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:07:22.526933 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-a12d23be-8515-4423-8464-dd7d6594fbeb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Getting quotas for user c544e8e6f7a741c985c92ed7437397cd and project 6fa7e14863254ab3964ac907c168d9e6. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:07:22.560367 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a12d23be-8515-4423-8464-dd7d6594fbeb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.065487 Sep 17 21:07:22.566765 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2074/4048] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:07:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:07:22.574900 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8cc7032f-3a65-438d-80cf-da18592aa2f9 tempest-SecurityGroupsNegativeTestJSON-775369485 tempest-SecurityGroupsNegativeTestJSON-775369485-project] Calling method '.version_select at 0x7f25a9fb8e50>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:22.705549 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-828e64b3-922d-405c-a4ff-7eb615c90ea7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33784305478f46ae9fdc4d4b82ebc6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e857c532a264ea78e24fd8fe1a44fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:22.715209 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-828e64b3-922d-405c-a4ff-7eb615c90ea7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "GET /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df" status: 200 len: 1314 microversion: 2.1 time: 0.325169 Sep 17 21:07:22.718181 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1975/4049] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:22 2022] GET /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:22.723889 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e52983b7-5379-40be-8cd5-25f2d5949e5c tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:22.727617 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e52983b7-5379-40be-8cd5-25f2d5949e5c tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:22.748752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e52983b7-5379-40be-8cd5-25f2d5949e5c tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:22.749944 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e52983b7-5379-40be-8cd5-25f2d5949e5c tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:22.750548 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e52983b7-5379-40be-8cd5-25f2d5949e5c tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:22.751671 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e52983b7-5379-40be-8cd5-25f2d5949e5c tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:22.752387 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e52983b7-5379-40be-8cd5-25f2d5949e5c tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:22.752965 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e52983b7-5379-40be-8cd5-25f2d5949e5c tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:22.821277 ncdv-master-1 devstack@n-api.service[140524]: DEBUG neutronclient.v2_0.client [None req-8cc7032f-3a65-438d-80cf-da18592aa2f9 tempest-SecurityGroupsNegativeTestJSON-775369485 tempest-SecurityGroupsNegativeTestJSON-775369485-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=140524) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 17 21:07:22.822291 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-8cc7032f-3a65-438d-80cf-da18592aa2f9 tempest-SecurityGroupsNegativeTestJSON-775369485 tempest-SecurityGroupsNegativeTestJSON-775369485-project] HTTP exception thrown: Insufficient rights for removing default security group. Sep 17 21:07:22.822291 ncdv-master-1 devstack@n-api.service[140524]: Neutron server returns request_ids: ['req-7a48d9f6-e4c3-480c-ac1f-1b533da947dd'] Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8cc7032f-3a65-438d-80cf-da18592aa2f9 tempest-SecurityGroupsNegativeTestJSON-775369485 tempest-SecurityGroupsNegativeTestJSON-775369485-project] Request method failure captured: Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/os-security-groups/3d7cd45e-cd9b-437b-aac6-f6ae32a450c5 HTTP/1.1 Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjcJguEn7RPcf0E-Q1ylWwfDjG4UwEIIcwDNpNoXTSiiZipd82KlCNBjKD65vcpBdMNy6LBwRdwU0bScsYiM5ZgvLR8FhQvryXm5Mz7rlm5om7LJR9Kq1kmsNwW-Zo0b7DgbFcCDKxdDDxM1rxbJdHOmXiQbNEQVJv8p15A8kVHtDzI Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: d704de116c314d1e880d826915a43eae Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-775369485 Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d704de116c314d1e880d826915a43eae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d704de116c314d1e880d826915a43eae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d704de116c314d1e880d826915a43eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d704de116c314d1e880d826915a43eae", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-775369485 Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: d704de116c314d1e880d826915a43eae Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-775369485 Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-SecurityGroupsNegativeTestJSON-775369485-project Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 02aa44fb4544430484ce6cf03e6d0aa3 Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-775369485-project Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: exception: Insufficient rights for removing default security group. Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: Neutron server returns request_ids: ['req-7a48d9f6-e4c3-480c-ac1f-1b533da947dd'] Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '3d7cd45e-cd9b-437b-aac6-f6ae32a450c5'} Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 17 21:07:22.824768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a48d9f6-e4c3-480c-ac1f-1b533da947dd'] Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a48d9f6-e4c3-480c-ac1f-1b533da947dd'] Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a48d9f6-e4c3-480c-ac1f-1b533da947dd'] Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7a48d9f6-e4c3-480c-ac1f-1b533da947dd'] Sep 17 21:07:22.828778 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:07:22.833451 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8cc7032f-3a65-438d-80cf-da18592aa2f9 tempest-SecurityGroupsNegativeTestJSON-775369485 tempest-SecurityGroupsNegativeTestJSON-775369485-project] Returning 400 to user: Insufficient rights for removing default security group. Sep 17 21:07:22.833451 ncdv-master-1 devstack@n-api.service[140524]: Neutron server returns request_ids: ['req-7a48d9f6-e4c3-480c-ac1f-1b533da947dd'] {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:07:22.834755 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8cc7032f-3a65-438d-80cf-da18592aa2f9 tempest-SecurityGroupsNegativeTestJSON-775369485 tempest-SecurityGroupsNegativeTestJSON-775369485-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/3d7cd45e-cd9b-437b-aac6-f6ae32a450c5" status: 400 len: 182 microversion: 2.1 time: 0.266102 Sep 17 21:07:22.835494 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2075/4050] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 21:07:22 2022] DELETE /compute/v2.1/os-security-groups/3d7cd45e-cd9b-437b-aac6-f6ae32a450c5 => generated 182 bytes in 268 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:07:22.847131 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c4865410-cc11-4573-9a51-a6236e479541 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:22.847766 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c4865410-cc11-4573-9a51-a6236e479541 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:22.871612 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4865410-cc11-4573-9a51-a6236e479541 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:22.872258 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4865410-cc11-4573-9a51-a6236e479541 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:22.872908 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4865410-cc11-4573-9a51-a6236e479541 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:22.873814 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4865410-cc11-4573-9a51-a6236e479541 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:22.874460 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4865410-cc11-4573-9a51-a6236e479541 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:22.874795 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4865410-cc11-4573-9a51-a6236e479541 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:22.986679 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e52983b7-5379-40be-8cd5-25f2d5949e5c tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:22.988127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c4865410-cc11-4573-9a51-a6236e479541 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:23.008359 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e52983b7-5379-40be-8cd5-25f2d5949e5c tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1314 microversion: 2.1 time: 0.288195 Sep 17 21:07:23.010696 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c4865410-cc11-4573-9a51-a6236e479541 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915" status: 200 len: 1297 microversion: 2.1 time: 0.167675 Sep 17 21:07:23.014829 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2076/4051] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:22 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 => generated 1297 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:07:23.022806 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1976/4052] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:22 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:23.028539 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d903030f-4d02-4ac3-9dab-f510160dd4e1 tempest-SecurityGroupsNegativeTestJSON-775369485 tempest-SecurityGroupsNegativeTestJSON-775369485-project] Calling method '.version_select at 0x7f25a9eb1a60>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:23.078342 ncdv-master-1 devstack@n-api.service[140524]: DEBUG neutronclient.v2_0.client [None req-d903030f-4d02-4ac3-9dab-f510160dd4e1 tempest-SecurityGroupsNegativeTestJSON-775369485 tempest-SecurityGroupsNegativeTestJSON-775369485-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 945b0876-066f-4724-b319-48cca59a2e88 does not exist", "detail": ""}} {{(pid=140524) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 17 21:07:23.078947 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.security_group_api [None req-d903030f-4d02-4ac3-9dab-f510160dd4e1 tempest-SecurityGroupsNegativeTestJSON-775369485 tempest-SecurityGroupsNegativeTestJSON-775369485-project] Neutron security group 945b0876-066f-4724-b319-48cca59a2e88 not found {{(pid=140524) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 17 21:07:23.079513 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-d903030f-4d02-4ac3-9dab-f510160dd4e1 tempest-SecurityGroupsNegativeTestJSON-775369485 tempest-SecurityGroupsNegativeTestJSON-775369485-project] HTTP exception thrown: Security group 945b0876-066f-4724-b319-48cca59a2e88 does not exist Sep 17 21:07:23.079513 ncdv-master-1 devstack@n-api.service[140524]: Neutron server returns request_ids: ['req-a666a719-1c89-4d81-8c24-b6516032f8f6'] Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d903030f-4d02-4ac3-9dab-f510160dd4e1 tempest-SecurityGroupsNegativeTestJSON-775369485 tempest-SecurityGroupsNegativeTestJSON-775369485-project] Request method failure captured: Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/os-security-groups/945b0876-066f-4724-b319-48cca59a2e88 HTTP/1.1 Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjcJguEn7RPcf0E-Q1ylWwfDjG4UwEIIcwDNpNoXTSiiZipd82KlCNBjKD65vcpBdMNy6LBwRdwU0bScsYiM5ZgvLR8FhQvryXm5Mz7rlm5om7LJR9Kq1kmsNwW-Zo0b7DgbFcCDKxdDDxM1rxbJdHOmXiQbNEQVJv8p15A8kVHtDzI Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: d704de116c314d1e880d826915a43eae Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-775369485 Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d704de116c314d1e880d826915a43eae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d704de116c314d1e880d826915a43eae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d704de116c314d1e880d826915a43eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d704de116c314d1e880d826915a43eae", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-775369485 Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: d704de116c314d1e880d826915a43eae Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-775369485 Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-SecurityGroupsNegativeTestJSON-775369485-project Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 02aa44fb4544430484ce6cf03e6d0aa3 Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-775369485-project Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: exception: Security group 945b0876-066f-4724-b319-48cca59a2e88 does not exist Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: Neutron server returns request_ids: ['req-a666a719-1c89-4d81-8c24-b6516032f8f6'] Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '945b0876-066f-4724-b319-48cca59a2e88'} Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 17 21:07:23.081369 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 945b0876-066f-4724-b319-48cca59a2e88 does not exist Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a666a719-1c89-4d81-8c24-b6516032f8f6'] Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 945b0876-066f-4724-b319-48cca59a2e88 does not exist Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a666a719-1c89-4d81-8c24-b6516032f8f6'] Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 945b0876-066f-4724-b319-48cca59a2e88 does not exist Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a666a719-1c89-4d81-8c24-b6516032f8f6'] Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 945b0876-066f-4724-b319-48cca59a2e88 does not exist Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a666a719-1c89-4d81-8c24-b6516032f8f6'] Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d903030f-4d02-4ac3-9dab-f510160dd4e1 tempest-SecurityGroupsNegativeTestJSON-775369485 tempest-SecurityGroupsNegativeTestJSON-775369485-project] Returning 404 to user: Security group 945b0876-066f-4724-b319-48cca59a2e88 does not exist Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: Neutron server returns request_ids: ['req-a666a719-1c89-4d81-8c24-b6516032f8f6'] {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d903030f-4d02-4ac3-9dab-f510160dd4e1 tempest-SecurityGroupsNegativeTestJSON-775369485 tempest-SecurityGroupsNegativeTestJSON-775369485-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/945b0876-066f-4724-b319-48cca59a2e88" status: 404 len: 194 microversion: 2.1 time: 0.066648 Sep 17 21:07:23.090485 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2077/4053] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Sep 17 21:07:23 2022] GET /compute/v2.1/os-security-groups/945b0876-066f-4724-b319-48cca59a2e88 => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:07:23.097701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ec13fcad-ba7f-49c0-a180-e443345226d9 tempest-SecurityGroupsNegativeTestJSON-775369485 tempest-SecurityGroupsNegativeTestJSON-775369485-project] Action: 'update', calling method: .version_select at 0x7f25a461b550>, body: {"security_group": {"name": "tempest-sg-817199640", "description": "tempest-description-207761409"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:23.153253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG neutronclient.v2_0.client [None req-ec13fcad-ba7f-49c0-a180-e443345226d9 tempest-SecurityGroupsNegativeTestJSON-775369485 tempest-SecurityGroupsNegativeTestJSON-775369485-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 088cc996-ea3d-4dde-9e07-9b1f12869a04 does not exist", "detail": ""}} {{(pid=140523) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 17 21:07:23.154385 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.security_group_api [None req-ec13fcad-ba7f-49c0-a180-e443345226d9 tempest-SecurityGroupsNegativeTestJSON-775369485 tempest-SecurityGroupsNegativeTestJSON-775369485-project] Neutron security group 088cc996-ea3d-4dde-9e07-9b1f12869a04 not found {{(pid=140523) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 17 21:07:23.155867 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-ec13fcad-ba7f-49c0-a180-e443345226d9 tempest-SecurityGroupsNegativeTestJSON-775369485 tempest-SecurityGroupsNegativeTestJSON-775369485-project] HTTP exception thrown: Security group 088cc996-ea3d-4dde-9e07-9b1f12869a04 does not exist Sep 17 21:07:23.155867 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-cce9ab99-be3c-4726-a183-3d170d207991'] Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ec13fcad-ba7f-49c0-a180-e443345226d9 tempest-SecurityGroupsNegativeTestJSON-775369485 tempest-SecurityGroupsNegativeTestJSON-775369485-project] Request method failure captured: Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: request: PUT /compute/v2.1/os-security-groups/088cc996-ea3d-4dde-9e07-9b1f12869a04 HTTP/1.1 Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 100 Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjcJguEn7RPcf0E-Q1ylWwfDjG4UwEIIcwDNpNoXTSiiZipd82KlCNBjKD65vcpBdMNy6LBwRdwU0bScsYiM5ZgvLR8FhQvryXm5Mz7rlm5om7LJR9Kq1kmsNwW-Zo0b7DgbFcCDKxdDDxM1rxbJdHOmXiQbNEQVJv8p15A8kVHtDzI Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: d704de116c314d1e880d826915a43eae Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-775369485 Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d704de116c314d1e880d826915a43eae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d704de116c314d1e880d826915a43eae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d704de116c314d1e880d826915a43eae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d704de116c314d1e880d826915a43eae", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-775369485 Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: d704de116c314d1e880d826915a43eae Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-775369485 Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-SecurityGroupsNegativeTestJSON-775369485-project Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 02aa44fb4544430484ce6cf03e6d0aa3 Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-775369485-project Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: {"security_group": {"name": "tempest-sg-817199640", "description": "tempest-description-207761409"}} Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: exception: Security group 088cc996-ea3d-4dde-9e07-9b1f12869a04 does not exist Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-cce9ab99-be3c-4726-a183-3d170d207991'] Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '088cc996-ea3d-4dde-9e07-9b1f12869a04', 'body': {'security_group': {'name': 'tempest-sg-817199640', 'description': 'tempest-description-207761409'}}} Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 17 21:07:23.160194 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 088cc996-ea3d-4dde-9e07-9b1f12869a04 does not exist Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cce9ab99-be3c-4726-a183-3d170d207991'] Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 088cc996-ea3d-4dde-9e07-9b1f12869a04 does not exist Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cce9ab99-be3c-4726-a183-3d170d207991'] Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 088cc996-ea3d-4dde-9e07-9b1f12869a04 does not exist Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cce9ab99-be3c-4726-a183-3d170d207991'] Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 088cc996-ea3d-4dde-9e07-9b1f12869a04 does not exist Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cce9ab99-be3c-4726-a183-3d170d207991'] Sep 17 21:07:23.164284 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:23.170707 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ec13fcad-ba7f-49c0-a180-e443345226d9 tempest-SecurityGroupsNegativeTestJSON-775369485 tempest-SecurityGroupsNegativeTestJSON-775369485-project] Returning 404 to user: Security group 088cc996-ea3d-4dde-9e07-9b1f12869a04 does not exist Sep 17 21:07:23.170707 ncdv-master-1 devstack@n-api.service[140523]: Neutron server returns request_ids: ['req-cce9ab99-be3c-4726-a183-3d170d207991'] {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:07:23.172010 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ec13fcad-ba7f-49c0-a180-e443345226d9 tempest-SecurityGroupsNegativeTestJSON-775369485 tempest-SecurityGroupsNegativeTestJSON-775369485-project] 10.222.0.26 "PUT /compute/v2.1/os-security-groups/088cc996-ea3d-4dde-9e07-9b1f12869a04" status: 404 len: 194 microversion: 2.1 time: 0.082553 Sep 17 21:07:23.173307 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1977/4054] 10.222.0.26 () {60 vars in 1290 bytes} [Sat Sep 17 21:07:23 2022] PUT /compute/v2.1/os-security-groups/088cc996-ea3d-4dde-9e07-9b1f12869a04 => generated 194 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:07:23.414439 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-dd8a69a5-63ad-4214-95ac-98f877efaee1 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:23.415229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-dd8a69a5-63ad-4214-95ac-98f877efaee1 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 142d8aab-a359-47e1-a8d5-a77303a1f0ae] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:23.436803 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd8a69a5-63ad-4214-95ac-98f877efaee1 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:23.437437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd8a69a5-63ad-4214-95ac-98f877efaee1 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:23.437921 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd8a69a5-63ad-4214-95ac-98f877efaee1 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:23.438877 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd8a69a5-63ad-4214-95ac-98f877efaee1 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:23.439345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd8a69a5-63ad-4214-95ac-98f877efaee1 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:23.439778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd8a69a5-63ad-4214-95ac-98f877efaee1 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:23.756542 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-42d1342b-f924-49b5-9e2d-cbaf51220af7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:23.757172 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-42d1342b-f924-49b5-9e2d-cbaf51220af7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 964a7041-9baa-42fb-a51c-f760437411df] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:23.778179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-42d1342b-f924-49b5-9e2d-cbaf51220af7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:23.781307 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-42d1342b-f924-49b5-9e2d-cbaf51220af7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:23.781802 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-42d1342b-f924-49b5-9e2d-cbaf51220af7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:23.782678 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-42d1342b-f924-49b5-9e2d-cbaf51220af7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:23.783149 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-42d1342b-f924-49b5-9e2d-cbaf51220af7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:23.783591 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-42d1342b-f924-49b5-9e2d-cbaf51220af7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:24.734784 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-dd8a69a5-63ad-4214-95ac-98f877efaee1 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c7a82126124ebb8baf5c656ff9849d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a83c9c29f1483b9ee9c48e94dc17ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:24.743334 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-dd8a69a5-63ad-4214-95ac-98f877efaee1 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "GET /compute/v2.1/servers/142d8aab-a359-47e1-a8d5-a77303a1f0ae" status: 200 len: 1506 microversion: 2.1 time: 1.333286 Sep 17 21:07:24.754033 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2078/4055] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:23 2022] GET /compute/v2.1/servers/142d8aab-a359-47e1-a8d5-a77303a1f0ae => generated 1506 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:24.779399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-289fdf04-c16c-4af1-af11-bbe28a95f901 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:24.780300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-289fdf04-c16c-4af1-af11-bbe28a95f901 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:24.789598 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-289fdf04-c16c-4af1-af11-bbe28a95f901 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:24.790538 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-289fdf04-c16c-4af1-af11-bbe28a95f901 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:24.791623 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-289fdf04-c16c-4af1-af11-bbe28a95f901 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:24.792745 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-289fdf04-c16c-4af1-af11-bbe28a95f901 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:24.793563 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-289fdf04-c16c-4af1-af11-bbe28a95f901 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:24.794093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-289fdf04-c16c-4af1-af11-bbe28a95f901 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:24.861593 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-42d1342b-f924-49b5-9e2d-cbaf51220af7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33784305478f46ae9fdc4d4b82ebc6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e857c532a264ea78e24fd8fe1a44fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:24.875615 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-42d1342b-f924-49b5-9e2d-cbaf51220af7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "GET /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df" status: 200 len: 1314 microversion: 2.1 time: 1.137710 Sep 17 21:07:24.888077 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1978/4056] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:23 2022] GET /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df => generated 1314 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:07:24.890896 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8b6e8b46-6fce-4296-aebf-33b4b0da00c7 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:24.892158 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8b6e8b46-6fce-4296-aebf-33b4b0da00c7 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:24.906156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8b6e8b46-6fce-4296-aebf-33b4b0da00c7 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:24.913737 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8b6e8b46-6fce-4296-aebf-33b4b0da00c7 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:24.914360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8b6e8b46-6fce-4296-aebf-33b4b0da00c7 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:24.915268 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8b6e8b46-6fce-4296-aebf-33b4b0da00c7 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:24.915895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8b6e8b46-6fce-4296-aebf-33b4b0da00c7 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:24.917998 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8b6e8b46-6fce-4296-aebf-33b4b0da00c7 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:25.180330 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8b6e8b46-6fce-4296-aebf-33b4b0da00c7 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:25.198527 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8b6e8b46-6fce-4296-aebf-33b4b0da00c7 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915" status: 200 len: 1303 microversion: 2.1 time: 0.315952 Sep 17 21:07:25.199258 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1979/4057] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:24 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 => generated 1303 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:25.298759 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0c48d674-0674-440b-b3a6-4eb2f0f62b33 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-272964804", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c4c3ad81-e8f3-4b9c-972a-042303636823"}], "security_groups": [{"name": "tempest-securitygroup--774124561"}], "key_name": "tempest-keypair-1658892230", "user_data": "}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:25.328332 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-289fdf04-c16c-4af1-af11-bbe28a95f901 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:25.337636 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-289fdf04-c16c-4af1-af11-bbe28a95f901 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1314 microversion: 2.1 time: 0.582196 Sep 17 21:07:25.340909 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2079/4058] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:24 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1314 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:25.548801 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-0c48d674-0674-440b-b3a6-4eb2f0f62b33 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] validate_networks() for [('c4c3ad81-e8f3-4b9c-972a-042303636823', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:07:25.682051 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d7d7028b-5629-45b9-b8f2-c066bde238e4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:25.684979 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d7d7028b-5629-45b9-b8f2-c066bde238e4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:25.699857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:25.704298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d7d7028b-5629-45b9-b8f2-c066bde238e4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:25.705161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d7d7028b-5629-45b9-b8f2-c066bde238e4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:25.705896 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d7d7028b-5629-45b9-b8f2-c066bde238e4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:25.706840 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d7d7028b-5629-45b9-b8f2-c066bde238e4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:25.707524 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d7d7028b-5629-45b9-b8f2-c066bde238e4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:25.708149 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d7d7028b-5629-45b9-b8f2-c066bde238e4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:25.817859 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d7d7028b-5629-45b9-b8f2-c066bde238e4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action" status: 202 len: 0 microversion: 2.1 time: 0.151711 Sep 17 21:07:25.819675 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2080/4059] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:07:25 2022] POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:07:25.827417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-2b42dd0a-e96a-4b37-bafc-fb9168a6e623 req-1f9d96bb-e1eb-4318-b82e-12b7ed136e0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "964a7041-9baa-42fb-a51c-f760437411df", "name": "network-vif-plugged", "status": "completed", "tag": "37895208-c7eb-4756-b85a-84d40b390b4a"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:25.841109 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-2b42dd0a-e96a-4b37-bafc-fb9168a6e623 req-1f9d96bb-e1eb-4318-b82e-12b7ed136e0b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:25.842486 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-2b42dd0a-e96a-4b37-bafc-fb9168a6e623 req-1f9d96bb-e1eb-4318-b82e-12b7ed136e0b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:25.843756 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-2b42dd0a-e96a-4b37-bafc-fb9168a6e623 req-1f9d96bb-e1eb-4318-b82e-12b7ed136e0b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:25.863436 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-2b42dd0a-e96a-4b37-bafc-fb9168a6e623 req-1f9d96bb-e1eb-4318-b82e-12b7ed136e0b service nova] Creating event network-vif-plugged:37895208-c7eb-4756-b85a-84d40b390b4a for instance 964a7041-9baa-42fb-a51c-f760437411df on nch1-master-1 Sep 17 21:07:25.872128 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-2b42dd0a-e96a-4b37-bafc-fb9168a6e623 req-1f9d96bb-e1eb-4318-b82e-12b7ed136e0b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050575 Sep 17 21:07:25.874329 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2081/4060] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:07:25.906837 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-55bb6e28-ad5f-41a9-bb10-ca97beac8d56 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:25.912484 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-55bb6e28-ad5f-41a9-bb10-ca97beac8d56 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:25.922661 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55bb6e28-ad5f-41a9-bb10-ca97beac8d56 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:25.923655 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55bb6e28-ad5f-41a9-bb10-ca97beac8d56 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:25.924395 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55bb6e28-ad5f-41a9-bb10-ca97beac8d56 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:25.925397 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55bb6e28-ad5f-41a9-bb10-ca97beac8d56 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:25.926129 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55bb6e28-ad5f-41a9-bb10-ca97beac8d56 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:25.926768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55bb6e28-ad5f-41a9-bb10-ca97beac8d56 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:26.844054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-55bb6e28-ad5f-41a9-bb10-ca97beac8d56 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:26.853002 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-55bb6e28-ad5f-41a9-bb10-ca97beac8d56 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1673 microversion: 2.1 time: 0.974308 Sep 17 21:07:26.853833 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2082/4061] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:25 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1673 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:26.873999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ad8e1f7a-68a7-4ee5-a312-2c36de686e4d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:26.874946 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ad8e1f7a-68a7-4ee5-a312-2c36de686e4d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 964a7041-9baa-42fb-a51c-f760437411df] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:26.881579 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad8e1f7a-68a7-4ee5-a312-2c36de686e4d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:26.882108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad8e1f7a-68a7-4ee5-a312-2c36de686e4d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:26.882534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad8e1f7a-68a7-4ee5-a312-2c36de686e4d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:26.883248 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad8e1f7a-68a7-4ee5-a312-2c36de686e4d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:26.883817 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad8e1f7a-68a7-4ee5-a312-2c36de686e4d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:26.884252 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad8e1f7a-68a7-4ee5-a312-2c36de686e4d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:27.481357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ad8e1f7a-68a7-4ee5-a312-2c36de686e4d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33784305478f46ae9fdc4d4b82ebc6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e857c532a264ea78e24fd8fe1a44fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:27.498518 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ad8e1f7a-68a7-4ee5-a312-2c36de686e4d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "GET /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df" status: 200 len: 1314 microversion: 2.1 time: 0.631785 Sep 17 21:07:27.514554 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2083/4062] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:26 2022] GET /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df => generated 1314 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:27.522199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b38b488c-f07c-47cc-91ba-3886bdf3bd89 tempest-VolumesAdminNegativeTest-1681771867 tempest-VolumesAdminNegativeTest-1681771867-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "ea58986c-9d33-41ac-ae50-266d4bab26b7"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:27.525919 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b38b488c-f07c-47cc-91ba-3886bdf3bd89 tempest-VolumesAdminNegativeTest-1681771867 tempest-VolumesAdminNegativeTest-1681771867-project-admin] [instance: 142d8aab-a359-47e1-a8d5-a77303a1f0ae] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:27.533055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b38b488c-f07c-47cc-91ba-3886bdf3bd89 tempest-VolumesAdminNegativeTest-1681771867 tempest-VolumesAdminNegativeTest-1681771867-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:27.533579 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b38b488c-f07c-47cc-91ba-3886bdf3bd89 tempest-VolumesAdminNegativeTest-1681771867 tempest-VolumesAdminNegativeTest-1681771867-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:27.534233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b38b488c-f07c-47cc-91ba-3886bdf3bd89 tempest-VolumesAdminNegativeTest-1681771867 tempest-VolumesAdminNegativeTest-1681771867-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:27.535433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b38b488c-f07c-47cc-91ba-3886bdf3bd89 tempest-VolumesAdminNegativeTest-1681771867 tempest-VolumesAdminNegativeTest-1681771867-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:27.535887 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b38b488c-f07c-47cc-91ba-3886bdf3bd89 tempest-VolumesAdminNegativeTest-1681771867 tempest-VolumesAdminNegativeTest-1681771867-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:27.536480 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b38b488c-f07c-47cc-91ba-3886bdf3bd89 tempest-VolumesAdminNegativeTest-1681771867 tempest-VolumesAdminNegativeTest-1681771867-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:27.595143 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-0c48d674-0674-440b-b3a6-4eb2f0f62b33 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:07:27.595728 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-0c48d674-0674-440b-b3a6-4eb2f0f62b33 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:07:27.596210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-0c48d674-0674-440b-b3a6-4eb2f0f62b33 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:07:27.596637 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-0c48d674-0674-440b-b3a6-4eb2f0f62b33 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:07:27.597025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-0c48d674-0674-440b-b3a6-4eb2f0f62b33 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:07:27.603520 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-b38b488c-f07c-47cc-91ba-3886bdf3bd89 tempest-VolumesAdminNegativeTest-1681771867 tempest-VolumesAdminNegativeTest-1681771867-project-admin] HTTP exception thrown: Volume 11e00409-094e-4648-9bab-3115f734e319 could not be found. Sep 17 21:07:27.607399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c48d674-0674-440b-b3a6-4eb2f0f62b33 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:27.608085 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c48d674-0674-440b-b3a6-4eb2f0f62b33 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:27.608887 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c48d674-0674-440b-b3a6-4eb2f0f62b33 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b38b488c-f07c-47cc-91ba-3886bdf3bd89 tempest-VolumesAdminNegativeTest-1681771867 tempest-VolumesAdminNegativeTest-1681771867-project-admin] Request method failure captured: Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: request: PUT /compute/v2.1/servers/142d8aab-a359-47e1-a8d5-a77303a1f0ae/os-volume_attachments/11e00409-094e-4648-9bab-3115f734e319 HTTP/1.1 Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 74 Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjaxAIspG1-y63vISMciFYaNsI7_C55Bl7ACpbvnjl2ZhQX-YCPMejqxSTvY71BWqcAhiq2arnPkxLJa2efsEgxPJtD1b1733q6qL4y2vSLBElwEFEKV9HwVd88K4BhQskvlX6q7CgvvpT5_jYD0UNdiMaWf79BxYm7CLbkpbqYXLWw Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: f1fca09044e249e497bc266060c3c3ab Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-VolumesAdminNegativeTest-1681771867 Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: X-Role: admin,member,reader Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: admin,member,reader Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f1fca09044e249e497bc266060c3c3ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f1fca09044e249e497bc266060c3c3ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f1fca09044e249e497bc266060c3c3ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f1fca09044e249e497bc266060c3c3ab", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-VolumesAdminNegativeTest-1681771867 Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: f1fca09044e249e497bc266060c3c3ab Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1681771867 Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-VolumesAdminNegativeTest-1681771867-project-admin Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: fce8fdffbc354641b50a0d46ea6be26f Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-VolumesAdminNegativeTest-1681771867-project-admin Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: {"volumeAttachment": {"volumeId": "ea58986c-9d33-41ac-ae50-266d4bab26b7"}} Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: exception: Volume 11e00409-094e-4648-9bab-3115f734e319 could not be found. Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'server_id': '142d8aab-a359-47e1-a8d5-a77303a1f0ae', 'id': '11e00409-094e-4648-9bab-3115f734e319', 'body': {'volumeAttachment': {'volumeId': 'ea58986c-9d33-41ac-ae50-266d4bab26b7'}}} Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 11e00409-094e-4648-9bab-3115f734e319 could not be found. (HTTP 404) (Request-ID: req-1a525f37-76ed-4b88-80f4-51d532df9112) Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 17 21:07:27.609408 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 11e00409-094e-4648-9bab-3115f734e319 could not be found. Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 11e00409-094e-4648-9bab-3115f734e319 could not be found. Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 11e00409-094e-4648-9bab-3115f734e319 could not be found. Sep 17 21:07:27.612655 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:07:27.618510 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c48d674-0674-440b-b3a6-4eb2f0f62b33 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:27.618510 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c48d674-0674-440b-b3a6-4eb2f0f62b33 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:27.618510 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c48d674-0674-440b-b3a6-4eb2f0f62b33 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:27.624019 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b38b488c-f07c-47cc-91ba-3886bdf3bd89 tempest-VolumesAdminNegativeTest-1681771867 tempest-VolumesAdminNegativeTest-1681771867-project-admin] Returning 404 to user: Volume 11e00409-094e-4648-9bab-3115f734e319 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:07:27.625016 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b38b488c-f07c-47cc-91ba-3886bdf3bd89 tempest-VolumesAdminNegativeTest-1681771867 tempest-VolumesAdminNegativeTest-1681771867-project-admin] 10.222.0.26 "PUT /compute/v2.1/servers/142d8aab-a359-47e1-a8d5-a77303a1f0ae/os-volume_attachments/11e00409-094e-4648-9bab-3115f734e319" status: 404 len: 109 microversion: 2.1 time: 0.109299 Sep 17 21:07:27.626319 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2084/4063] 10.222.0.26 () {60 vars in 1433 bytes} [Sat Sep 17 21:07:27 2022] PUT /compute/v2.1/servers/142d8aab-a359-47e1-a8d5-a77303a1f0ae/os-volume_attachments/11e00409-094e-4648-9bab-3115f734e319 => generated 109 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:07:27.638286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4220527c-cd47-4c02-8935-ba8de912792f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:27.639701 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4220527c-cd47-4c02-8935-ba8de912792f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:27.648340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4220527c-cd47-4c02-8935-ba8de912792f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:27.649074 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4220527c-cd47-4c02-8935-ba8de912792f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:27.649786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4220527c-cd47-4c02-8935-ba8de912792f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:27.650662 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4220527c-cd47-4c02-8935-ba8de912792f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:27.651259 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4220527c-cd47-4c02-8935-ba8de912792f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:27.653010 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4220527c-cd47-4c02-8935-ba8de912792f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:27.691259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-0c48d674-0674-440b-b3a6-4eb2f0f62b33 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Getting quotas for project 6fa7e14863254ab3964ac907c168d9e6. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:07:27.704006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-0c48d674-0674-440b-b3a6-4eb2f0f62b33 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Getting quotas for user c544e8e6f7a741c985c92ed7437397cd and project 6fa7e14863254ab3964ac907c168d9e6. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:07:27.732933 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0c48d674-0674-440b-b3a6-4eb2f0f62b33 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:07:27.741492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0c48d674-0674-440b-b3a6-4eb2f0f62b33 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:07:27.792671 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:27.831614 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0c48d674-0674-440b-b3a6-4eb2f0f62b33 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.542162 Sep 17 21:07:27.833085 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1980/4064] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:07:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 2544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:07:27.840394 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-03afd0d0-0b60-4285-8f7a-815e03e10369 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:27.848866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-03afd0d0-0b60-4285-8f7a-815e03e10369 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:27.861834 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-03afd0d0-0b60-4285-8f7a-815e03e10369 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:27.861834 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-03afd0d0-0b60-4285-8f7a-815e03e10369 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:27.861834 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-03afd0d0-0b60-4285-8f7a-815e03e10369 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:27.861834 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-03afd0d0-0b60-4285-8f7a-815e03e10369 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:27.861834 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-03afd0d0-0b60-4285-8f7a-815e03e10369 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:27.861834 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-03afd0d0-0b60-4285-8f7a-815e03e10369 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:27.912860 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4220527c-cd47-4c02-8935-ba8de912792f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:27.922295 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4220527c-cd47-4c02-8935-ba8de912792f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915" status: 200 len: 1303 microversion: 2.1 time: 0.294586 Sep 17 21:07:27.923819 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2085/4065] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:27 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 => generated 1303 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:27.946727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e5c0bbe9-1b06-445d-b271-8f4961f52b78 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:27.951938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e5c0bbe9-1b06-445d-b271-8f4961f52b78 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:28.436075 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e5c0bbe9-1b06-445d-b271-8f4961f52b78 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:28.447576 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e5c0bbe9-1b06-445d-b271-8f4961f52b78 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc" status: 200 len: 1241 microversion: 2.1 time: 0.522235 Sep 17 21:07:28.457525 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2086/4066] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:27 2022] GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc => generated 1241 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:28.463443 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-835e65bd-d4be-491b-8ba4-7081b3ab3b48 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:28.466548 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-835e65bd-d4be-491b-8ba4-7081b3ab3b48 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:28.480584 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-835e65bd-d4be-491b-8ba4-7081b3ab3b48 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:28.481267 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-835e65bd-d4be-491b-8ba4-7081b3ab3b48 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:28.482213 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-835e65bd-d4be-491b-8ba4-7081b3ab3b48 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:28.488129 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-835e65bd-d4be-491b-8ba4-7081b3ab3b48 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:28.488849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-835e65bd-d4be-491b-8ba4-7081b3ab3b48 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:28.489443 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-835e65bd-d4be-491b-8ba4-7081b3ab3b48 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:28.798324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-03afd0d0-0b60-4285-8f7a-815e03e10369 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:28.808690 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-03afd0d0-0b60-4285-8f7a-815e03e10369 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1314 microversion: 2.1 time: 0.974254 Sep 17 21:07:28.811090 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1981/4067] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:27 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1314 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:28.823264 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-df02373d-6443-4a0f-a92e-6ccaa268c898 req-00324408-faf4-4812-9f22-16e0d2ac649e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aaab678-c37b-490b-85bd-30f9dd9602cc", "name": "network-vif-plugged", "status": "completed", "tag": "8b1d1005-424b-485f-9d7a-9bfca4b2f098"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:28.838305 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-df02373d-6443-4a0f-a92e-6ccaa268c898 req-00324408-faf4-4812-9f22-16e0d2ac649e service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:28.838790 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-df02373d-6443-4a0f-a92e-6ccaa268c898 req-00324408-faf4-4812-9f22-16e0d2ac649e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:28.839232 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-df02373d-6443-4a0f-a92e-6ccaa268c898 req-00324408-faf4-4812-9f22-16e0d2ac649e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:28.879334 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-df02373d-6443-4a0f-a92e-6ccaa268c898 req-00324408-faf4-4812-9f22-16e0d2ac649e service nova] Creating event network-vif-plugged:8b1d1005-424b-485f-9d7a-9bfca4b2f098 for instance 4aaab678-c37b-490b-85bd-30f9dd9602cc on nch2-master-1 Sep 17 21:07:28.886205 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-df02373d-6443-4a0f-a92e-6ccaa268c898 req-00324408-faf4-4812-9f22-16e0d2ac649e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073239 Sep 17 21:07:28.887625 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1982/4068] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:07:28.894322 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2d749238-db71-40c5-8323-31a18a9d36e0 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:28.906344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2d749238-db71-40c5-8323-31a18a9d36e0 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 964a7041-9baa-42fb-a51c-f760437411df] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:28.915434 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d749238-db71-40c5-8323-31a18a9d36e0 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:28.915932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d749238-db71-40c5-8323-31a18a9d36e0 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:28.920174 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d749238-db71-40c5-8323-31a18a9d36e0 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:28.920650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d749238-db71-40c5-8323-31a18a9d36e0 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:28.921289 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d749238-db71-40c5-8323-31a18a9d36e0 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:28.922411 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d749238-db71-40c5-8323-31a18a9d36e0 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:28.936044 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-835e65bd-d4be-491b-8ba4-7081b3ab3b48 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:28.966248 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-835e65bd-d4be-491b-8ba4-7081b3ab3b48 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1673 microversion: 2.1 time: 0.515860 Sep 17 21:07:28.983775 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2087/4069] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:28 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1673 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:29.000840 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c6c10052-8818-4f0f-8df0-ad445a7905d0 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:29.002570 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c6c10052-8818-4f0f-8df0-ad445a7905d0 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 142d8aab-a359-47e1-a8d5-a77303a1f0ae] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:29.022356 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c6c10052-8818-4f0f-8df0-ad445a7905d0 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:29.023191 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c6c10052-8818-4f0f-8df0-ad445a7905d0 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:29.023868 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c6c10052-8818-4f0f-8df0-ad445a7905d0 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:29.024761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c6c10052-8818-4f0f-8df0-ad445a7905d0 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:29.025315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c6c10052-8818-4f0f-8df0-ad445a7905d0 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:29.026025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c6c10052-8818-4f0f-8df0-ad445a7905d0 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:29.057668 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c6c10052-8818-4f0f-8df0-ad445a7905d0 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 142d8aab-a359-47e1-a8d5-a77303a1f0ae] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:07:29.173340 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c6c10052-8818-4f0f-8df0-ad445a7905d0 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "DELETE /compute/v2.1/servers/142d8aab-a359-47e1-a8d5-a77303a1f0ae" status: 204 len: 0 microversion: 2.1 time: 0.188021 Sep 17 21:07:29.174061 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2088/4070] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:07:28 2022] DELETE /compute/v2.1/servers/142d8aab-a359-47e1-a8d5-a77303a1f0ae => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:07:29.184453 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-92332e7a-f0f9-48ed-8007-f109cdcb915a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:29.186534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-92332e7a-f0f9-48ed-8007-f109cdcb915a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:29.193769 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92332e7a-f0f9-48ed-8007-f109cdcb915a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:29.194542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92332e7a-f0f9-48ed-8007-f109cdcb915a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:29.195055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92332e7a-f0f9-48ed-8007-f109cdcb915a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:29.195846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92332e7a-f0f9-48ed-8007-f109cdcb915a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:29.196370 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92332e7a-f0f9-48ed-8007-f109cdcb915a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:29.196859 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92332e7a-f0f9-48ed-8007-f109cdcb915a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:29.368871 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2d749238-db71-40c5-8323-31a18a9d36e0 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33784305478f46ae9fdc4d4b82ebc6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e857c532a264ea78e24fd8fe1a44fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:29.380618 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2d749238-db71-40c5-8323-31a18a9d36e0 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "GET /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df" status: 200 len: 1498 microversion: 2.1 time: 0.491750 Sep 17 21:07:29.381609 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1983/4071] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:28 2022] GET /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df => generated 1498 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:29.387026 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2b13a77b-a3a8-4ffe-9d4b-67c2b2cf3a8a tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:29.388436 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2b13a77b-a3a8-4ffe-9d4b-67c2b2cf3a8a tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 142d8aab-a359-47e1-a8d5-a77303a1f0ae] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:29.394825 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b13a77b-a3a8-4ffe-9d4b-67c2b2cf3a8a tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:29.395536 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b13a77b-a3a8-4ffe-9d4b-67c2b2cf3a8a tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:29.396173 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b13a77b-a3a8-4ffe-9d4b-67c2b2cf3a8a tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:29.397031 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b13a77b-a3a8-4ffe-9d4b-67c2b2cf3a8a tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:29.397666 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b13a77b-a3a8-4ffe-9d4b-67c2b2cf3a8a tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:29.398254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b13a77b-a3a8-4ffe-9d4b-67c2b2cf3a8a tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:29.683904 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-92332e7a-f0f9-48ed-8007-f109cdcb915a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:29.694549 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-92332e7a-f0f9-48ed-8007-f109cdcb915a tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915" status: 200 len: 1370 microversion: 2.1 time: 0.515293 Sep 17 21:07:29.695137 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2089/4072] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:29 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 => generated 1370 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:29.707763 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-080b50e5-2090-4615-9b75-5bab35c63273 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:29.708618 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-080b50e5-2090-4615-9b75-5bab35c63273 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:29.716194 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-080b50e5-2090-4615-9b75-5bab35c63273 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:29.728294 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-080b50e5-2090-4615-9b75-5bab35c63273 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:29.728856 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-080b50e5-2090-4615-9b75-5bab35c63273 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:29.729712 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-080b50e5-2090-4615-9b75-5bab35c63273 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:29.730367 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-080b50e5-2090-4615-9b75-5bab35c63273 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:29.730807 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-080b50e5-2090-4615-9b75-5bab35c63273 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:29.767060 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:29.908589 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-080b50e5-2090-4615-9b75-5bab35c63273 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:29.919437 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-080b50e5-2090-4615-9b75-5bab35c63273 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc" status: 200 len: 1293 microversion: 2.1 time: 0.223014 Sep 17 21:07:29.920357 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2090/4073] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:29 2022] GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc => generated 1293 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:29.937318 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a7da0969-6cc7-40e3-aea0-72b76d43d5f0 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:29.938879 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a7da0969-6cc7-40e3-aea0-72b76d43d5f0 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:29.947414 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7da0969-6cc7-40e3-aea0-72b76d43d5f0 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:29.948239 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7da0969-6cc7-40e3-aea0-72b76d43d5f0 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:29.948888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7da0969-6cc7-40e3-aea0-72b76d43d5f0 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:29.949732 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7da0969-6cc7-40e3-aea0-72b76d43d5f0 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:29.950251 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7da0969-6cc7-40e3-aea0-72b76d43d5f0 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:29.950739 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7da0969-6cc7-40e3-aea0-72b76d43d5f0 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:29.981870 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2b13a77b-a3a8-4ffe-9d4b-67c2b2cf3a8a tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c7a82126124ebb8baf5c656ff9849d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a83c9c29f1483b9ee9c48e94dc17ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:29.998078 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2b13a77b-a3a8-4ffe-9d4b-67c2b2cf3a8a tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "GET /compute/v2.1/servers/142d8aab-a359-47e1-a8d5-a77303a1f0ae" status: 200 len: 1512 microversion: 2.1 time: 0.615162 Sep 17 21:07:29.999771 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1984/4074] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:29 2022] GET /compute/v2.1/servers/142d8aab-a359-47e1-a8d5-a77303a1f0ae => generated 1512 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:30.023481 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-20067638-c96f-4a2b-8006-dcb2a80003b4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:30.023481 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-20067638-c96f-4a2b-8006-dcb2a80003b4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:30.032764 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20067638-c96f-4a2b-8006-dcb2a80003b4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:30.033573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20067638-c96f-4a2b-8006-dcb2a80003b4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:30.034410 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20067638-c96f-4a2b-8006-dcb2a80003b4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:30.035463 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20067638-c96f-4a2b-8006-dcb2a80003b4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:30.037879 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20067638-c96f-4a2b-8006-dcb2a80003b4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:30.038501 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20067638-c96f-4a2b-8006-dcb2a80003b4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:30.321384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a7da0969-6cc7-40e3-aea0-72b76d43d5f0 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:30.330689 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a7da0969-6cc7-40e3-aea0-72b76d43d5f0 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1314 microversion: 2.1 time: 0.408845 Sep 17 21:07:30.331998 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2091/4075] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:29 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:30.337981 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-43ce28c5-11b3-4ab2-9e1a-672afa77e92b tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:30.339289 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-43ce28c5-11b3-4ab2-9e1a-672afa77e92b tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 964a7041-9baa-42fb-a51c-f760437411df] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:30.347333 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43ce28c5-11b3-4ab2-9e1a-672afa77e92b tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:30.348217 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43ce28c5-11b3-4ab2-9e1a-672afa77e92b tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:30.349013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43ce28c5-11b3-4ab2-9e1a-672afa77e92b tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:30.349929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43ce28c5-11b3-4ab2-9e1a-672afa77e92b tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:30.350481 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43ce28c5-11b3-4ab2-9e1a-672afa77e92b tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:30.351057 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43ce28c5-11b3-4ab2-9e1a-672afa77e92b tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:30.377151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-43ce28c5-11b3-4ab2-9e1a-672afa77e92b tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 964a7041-9baa-42fb-a51c-f760437411df] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:07:30.456049 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-20067638-c96f-4a2b-8006-dcb2a80003b4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:30.466265 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-20067638-c96f-4a2b-8006-dcb2a80003b4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.465206 Sep 17 21:07:30.484771 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1985/4076] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:29 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:30.504285 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-43ce28c5-11b3-4ab2-9e1a-672afa77e92b tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "DELETE /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df" status: 204 len: 0 microversion: 2.1 time: 0.169869 Sep 17 21:07:30.505578 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2092/4077] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:07:30 2022] DELETE /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:07:30.519008 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-26cee98f-8456-4b6c-ae55-529b49810128 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:30.520347 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-26cee98f-8456-4b6c-ae55-529b49810128 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 964a7041-9baa-42fb-a51c-f760437411df] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:30.534150 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26cee98f-8456-4b6c-ae55-529b49810128 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:30.534669 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26cee98f-8456-4b6c-ae55-529b49810128 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:30.541920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26cee98f-8456-4b6c-ae55-529b49810128 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:30.554338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26cee98f-8456-4b6c-ae55-529b49810128 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:30.556196 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26cee98f-8456-4b6c-ae55-529b49810128 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:30.557248 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26cee98f-8456-4b6c-ae55-529b49810128 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:30.632570 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:30.720280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-716a917a-ec41-4704-b4db-31f774dd86d9 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:30.720674 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-716a917a-ec41-4704-b4db-31f774dd86d9 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:30.738463 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-716a917a-ec41-4704-b4db-31f774dd86d9 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:30.739059 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-716a917a-ec41-4704-b4db-31f774dd86d9 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:30.739507 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-716a917a-ec41-4704-b4db-31f774dd86d9 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:30.740494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-716a917a-ec41-4704-b4db-31f774dd86d9 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:30.740957 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-716a917a-ec41-4704-b4db-31f774dd86d9 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:30.741446 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-716a917a-ec41-4704-b4db-31f774dd86d9 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:30.985551 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-26cee98f-8456-4b6c-ae55-529b49810128 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33784305478f46ae9fdc4d4b82ebc6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e857c532a264ea78e24fd8fe1a44fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:31.000769 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-26cee98f-8456-4b6c-ae55-529b49810128 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "GET /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df" status: 200 len: 1504 microversion: 2.1 time: 0.488858 Sep 17 21:07:31.002424 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1986/4078] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:30 2022] GET /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df => generated 1504 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:31.037442 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-31b3d7b9-c0e8-4275-9025-da8be18946fd tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:31.039055 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-31b3d7b9-c0e8-4275-9025-da8be18946fd tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:31.048091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-31b3d7b9-c0e8-4275-9025-da8be18946fd tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:31.049154 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-31b3d7b9-c0e8-4275-9025-da8be18946fd tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:31.051052 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-31b3d7b9-c0e8-4275-9025-da8be18946fd tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:31.053399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-31b3d7b9-c0e8-4275-9025-da8be18946fd tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:31.054735 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-31b3d7b9-c0e8-4275-9025-da8be18946fd tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:31.060625 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-716a917a-ec41-4704-b4db-31f774dd86d9 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:31.072712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-31b3d7b9-c0e8-4275-9025-da8be18946fd tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:31.085772 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-716a917a-ec41-4704-b4db-31f774dd86d9 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915" status: 200 len: 1370 microversion: 2.1 time: 0.371419 Sep 17 21:07:31.086372 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2093/4079] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:30 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 => generated 1370 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:31.098443 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-29383e94-b2b0-4aba-850b-2276c503df5d tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:31.099087 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-29383e94-b2b0-4aba-850b-2276c503df5d tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 142d8aab-a359-47e1-a8d5-a77303a1f0ae] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:31.116106 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-29383e94-b2b0-4aba-850b-2276c503df5d tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:31.116631 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-29383e94-b2b0-4aba-850b-2276c503df5d tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:31.117066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-29383e94-b2b0-4aba-850b-2276c503df5d tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:31.119449 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-29383e94-b2b0-4aba-850b-2276c503df5d tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:31.119948 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-29383e94-b2b0-4aba-850b-2276c503df5d tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:31.120390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-29383e94-b2b0-4aba-850b-2276c503df5d tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:31.185707 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-31b3d7b9-c0e8-4275-9025-da8be18946fd tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:31.194710 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-31b3d7b9-c0e8-4275-9025-da8be18946fd tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc" status: 200 len: 1293 microversion: 2.1 time: 0.189665 Sep 17 21:07:31.195785 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1987/4080] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:31 2022] GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc => generated 1293 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:31.241115 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-7b7df2a7-c775-445a-a5b0-89842ee260ad req-0e6f4861-86fa-4c36-aa8c-a88e924f8119 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2341e0c-be19-4ba1-a137-472f1ecc3915", "tag": "79728522-0106-4867-9b9d-f0a0cc2b1675"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:31.252163 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-7b7df2a7-c775-445a-a5b0-89842ee260ad req-0e6f4861-86fa-4c36-aa8c-a88e924f8119 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:31.253032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-7b7df2a7-c775-445a-a5b0-89842ee260ad req-0e6f4861-86fa-4c36-aa8c-a88e924f8119 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:31.254419 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-7b7df2a7-c775-445a-a5b0-89842ee260ad req-0e6f4861-86fa-4c36-aa8c-a88e924f8119 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:31.267043 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-7b7df2a7-c775-445a-a5b0-89842ee260ad req-0e6f4861-86fa-4c36-aa8c-a88e924f8119 service nova] Creating event network-changed:79728522-0106-4867-9b9d-f0a0cc2b1675 for instance c2341e0c-be19-4ba1-a137-472f1ecc3915 on nch2-master-1 Sep 17 21:07:31.273010 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-7b7df2a7-c775-445a-a5b0-89842ee260ad req-0e6f4861-86fa-4c36-aa8c-a88e924f8119 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035854 Sep 17 21:07:31.274547 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1988/4081] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:07:31.361102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a4339e4f-262a-4d4b-bac3-88221da85236 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:31.362621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a4339e4f-262a-4d4b-bac3-88221da85236 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:31.375663 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4339e4f-262a-4d4b-bac3-88221da85236 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:31.376670 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4339e4f-262a-4d4b-bac3-88221da85236 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:31.377607 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4339e4f-262a-4d4b-bac3-88221da85236 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:31.379086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4339e4f-262a-4d4b-bac3-88221da85236 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:31.379730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4339e4f-262a-4d4b-bac3-88221da85236 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:31.380227 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-29383e94-b2b0-4aba-850b-2276c503df5d tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c7a82126124ebb8baf5c656ff9849d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a83c9c29f1483b9ee9c48e94dc17ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:31.380726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4339e4f-262a-4d4b-bac3-88221da85236 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:31.390165 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-29383e94-b2b0-4aba-850b-2276c503df5d tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "GET /compute/v2.1/servers/142d8aab-a359-47e1-a8d5-a77303a1f0ae" status: 200 len: 1512 microversion: 2.1 time: 0.300389 Sep 17 21:07:31.411302 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2094/4082] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:31 2022] GET /compute/v2.1/servers/142d8aab-a359-47e1-a8d5-a77303a1f0ae => generated 1512 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:32.025494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ec8d3517-180c-47f9-aeee-ef8bd66910d7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:32.026372 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ec8d3517-180c-47f9-aeee-ef8bd66910d7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 964a7041-9baa-42fb-a51c-f760437411df] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:32.043759 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ec8d3517-180c-47f9-aeee-ef8bd66910d7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:32.046072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ec8d3517-180c-47f9-aeee-ef8bd66910d7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:32.046710 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ec8d3517-180c-47f9-aeee-ef8bd66910d7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:32.047679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ec8d3517-180c-47f9-aeee-ef8bd66910d7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:32.048340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ec8d3517-180c-47f9-aeee-ef8bd66910d7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:32.049651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ec8d3517-180c-47f9-aeee-ef8bd66910d7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:32.180453 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a4339e4f-262a-4d4b-bac3-88221da85236 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:32.190347 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a4339e4f-262a-4d4b-bac3-88221da85236 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1500 microversion: 2.1 time: 0.836344 Sep 17 21:07:32.191498 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1989/4083] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:31 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1500 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:32.196395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dea37034-0738-4b7e-99a9-1c61060e2da2 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:32.197504 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dea37034-0738-4b7e-99a9-1c61060e2da2 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:32.205748 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dea37034-0738-4b7e-99a9-1c61060e2da2 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:32.206434 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dea37034-0738-4b7e-99a9-1c61060e2da2 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:32.207023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dea37034-0738-4b7e-99a9-1c61060e2da2 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:32.208075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dea37034-0738-4b7e-99a9-1c61060e2da2 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:32.208674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dea37034-0738-4b7e-99a9-1c61060e2da2 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:32.209247 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dea37034-0738-4b7e-99a9-1c61060e2da2 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:32.570826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ec8d3517-180c-47f9-aeee-ef8bd66910d7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33784305478f46ae9fdc4d4b82ebc6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e857c532a264ea78e24fd8fe1a44fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:32.586017 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ec8d3517-180c-47f9-aeee-ef8bd66910d7 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "GET /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df" status: 200 len: 1504 microversion: 2.1 time: 0.565325 Sep 17 21:07:32.587726 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2095/4084] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:32 2022] GET /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df => generated 1504 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:07:32.598441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bca5f621-47ff-46cb-8633-804136eb0704 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:32.601982 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bca5f621-47ff-46cb-8633-804136eb0704 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:32.609054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bca5f621-47ff-46cb-8633-804136eb0704 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:32.610008 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bca5f621-47ff-46cb-8633-804136eb0704 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:32.612409 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bca5f621-47ff-46cb-8633-804136eb0704 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:32.613407 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bca5f621-47ff-46cb-8633-804136eb0704 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:32.614858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bca5f621-47ff-46cb-8633-804136eb0704 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:32.615586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bca5f621-47ff-46cb-8633-804136eb0704 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:32.661215 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-bca5f621-47ff-46cb-8633-804136eb0704 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lazy-loading 'flavor' on Instance uuid 4aaab678-c37b-490b-85bd-30f9dd9602cc {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:07:32.743187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dea37034-0738-4b7e-99a9-1c61060e2da2 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:32.762044 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dea37034-0738-4b7e-99a9-1c61060e2da2 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915" status: 200 len: 1370 microversion: 2.1 time: 0.569128 Sep 17 21:07:32.762685 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1990/4085] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:32 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 => generated 1370 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:32.767752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6ed50a22-379a-48b0-b14b-b00331b2bc38 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:32.772491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6ed50a22-379a-48b0-b14b-b00331b2bc38 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:32.789654 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6ed50a22-379a-48b0-b14b-b00331b2bc38 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:32.790084 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6ed50a22-379a-48b0-b14b-b00331b2bc38 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:32.790684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6ed50a22-379a-48b0-b14b-b00331b2bc38 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:32.791553 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6ed50a22-379a-48b0-b14b-b00331b2bc38 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:32.792081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6ed50a22-379a-48b0-b14b-b00331b2bc38 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:32.792483 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6ed50a22-379a-48b0-b14b-b00331b2bc38 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:32.804990 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bca5f621-47ff-46cb-8633-804136eb0704 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "POST /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc/action" status: 200 len: 32 microversion: 2.1 time: 0.214621 Sep 17 21:07:32.807718 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2096/4086] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:07:32 2022] POST /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc/action => generated 32 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:07:32.819317 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d91d47c9-b8d7-4482-add0-84a5be4ae290 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:32.820097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d91d47c9-b8d7-4482-add0-84a5be4ae290 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 142d8aab-a359-47e1-a8d5-a77303a1f0ae] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:32.826876 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d91d47c9-b8d7-4482-add0-84a5be4ae290 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:32.828001 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d91d47c9-b8d7-4482-add0-84a5be4ae290 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:32.828579 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d91d47c9-b8d7-4482-add0-84a5be4ae290 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:32.829525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d91d47c9-b8d7-4482-add0-84a5be4ae290 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:32.830248 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d91d47c9-b8d7-4482-add0-84a5be4ae290 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:32.830832 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d91d47c9-b8d7-4482-add0-84a5be4ae290 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:33.030883 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6ed50a22-379a-48b0-b14b-b00331b2bc38 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:33.040642 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6ed50a22-379a-48b0-b14b-b00331b2bc38 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc" status: 200 len: 1299 microversion: 2.1 time: 0.276689 Sep 17 21:07:33.053559 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1991/4087] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:32 2022] GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc => generated 1299 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:33.062176 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-22596244-ecf5-4bd3-8efb-c82d3579ee89 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:33.062775 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-22596244-ecf5-4bd3-8efb-c82d3579ee89 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:33.069229 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-22596244-ecf5-4bd3-8efb-c82d3579ee89 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:33.069765 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-22596244-ecf5-4bd3-8efb-c82d3579ee89 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:33.070204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-22596244-ecf5-4bd3-8efb-c82d3579ee89 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:33.070881 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-22596244-ecf5-4bd3-8efb-c82d3579ee89 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:33.071527 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-22596244-ecf5-4bd3-8efb-c82d3579ee89 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:33.071959 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-22596244-ecf5-4bd3-8efb-c82d3579ee89 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:33.460791 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d91d47c9-b8d7-4482-add0-84a5be4ae290 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c7a82126124ebb8baf5c656ff9849d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a83c9c29f1483b9ee9c48e94dc17ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:33.469846 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d91d47c9-b8d7-4482-add0-84a5be4ae290 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "GET /compute/v2.1/servers/142d8aab-a359-47e1-a8d5-a77303a1f0ae" status: 200 len: 1512 microversion: 2.1 time: 0.660414 Sep 17 21:07:33.482235 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2097/4088] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:32 2022] GET /compute/v2.1/servers/142d8aab-a359-47e1-a8d5-a77303a1f0ae => generated 1512 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:33.611696 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3be7966a-f573-4d5a-ab90-0020bbdba40d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:33.614736 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3be7966a-f573-4d5a-ab90-0020bbdba40d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 964a7041-9baa-42fb-a51c-f760437411df] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:33.623211 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3be7966a-f573-4d5a-ab90-0020bbdba40d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:33.623813 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3be7966a-f573-4d5a-ab90-0020bbdba40d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:33.624500 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3be7966a-f573-4d5a-ab90-0020bbdba40d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:33.625286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3be7966a-f573-4d5a-ab90-0020bbdba40d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:33.625890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3be7966a-f573-4d5a-ab90-0020bbdba40d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:33.626497 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3be7966a-f573-4d5a-ab90-0020bbdba40d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:33.928077 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-22596244-ecf5-4bd3-8efb-c82d3579ee89 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:33.941315 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-22596244-ecf5-4bd3-8efb-c82d3579ee89 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1506 microversion: 2.1 time: 0.886101 Sep 17 21:07:33.941954 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1992/4089] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:33 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1506 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:33.946971 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-30508bb2-6a0e-4e3d-b004-dc1e28e67e4d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:33.947816 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-30508bb2-6a0e-4e3d-b004-dc1e28e67e4d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:33.954521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30508bb2-6a0e-4e3d-b004-dc1e28e67e4d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:33.955388 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30508bb2-6a0e-4e3d-b004-dc1e28e67e4d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:33.955814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30508bb2-6a0e-4e3d-b004-dc1e28e67e4d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:33.956734 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30508bb2-6a0e-4e3d-b004-dc1e28e67e4d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:33.957819 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30508bb2-6a0e-4e3d-b004-dc1e28e67e4d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:33.958262 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30508bb2-6a0e-4e3d-b004-dc1e28e67e4d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:34.392858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3be7966a-f573-4d5a-ab90-0020bbdba40d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33784305478f46ae9fdc4d4b82ebc6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e857c532a264ea78e24fd8fe1a44fbc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:34.401772 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3be7966a-f573-4d5a-ab90-0020bbdba40d tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "GET /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df" status: 200 len: 1504 microversion: 2.1 time: 0.795673 Sep 17 21:07:34.402370 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2098/4090] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:33 2022] GET /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df => generated 1504 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:34.419970 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9a5df5b7-9cd6-40fb-8421-e5851e1154d4 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:34.420600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9a5df5b7-9cd6-40fb-8421-e5851e1154d4 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:34.438911 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9a5df5b7-9cd6-40fb-8421-e5851e1154d4 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:34.439458 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9a5df5b7-9cd6-40fb-8421-e5851e1154d4 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:34.444943 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9a5df5b7-9cd6-40fb-8421-e5851e1154d4 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:34.445965 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9a5df5b7-9cd6-40fb-8421-e5851e1154d4 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:34.446584 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9a5df5b7-9cd6-40fb-8421-e5851e1154d4 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:34.447186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9a5df5b7-9cd6-40fb-8421-e5851e1154d4 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:34.499960 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-30508bb2-6a0e-4e3d-b004-dc1e28e67e4d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:34.510215 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-30508bb2-6a0e-4e3d-b004-dc1e28e67e4d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915" status: 200 len: 1370 microversion: 2.1 time: 0.567204 Sep 17 21:07:34.510817 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1993/4091] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:33 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 => generated 1370 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:34.538347 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-2c7445ae-0c87-4744-8c7a-eebe1e355620 req-25052764-7e3a-4b5a-93d2-e21af8db2e9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "964a7041-9baa-42fb-a51c-f760437411df", "name": "network-vif-deleted", "tag": "37895208-c7eb-4756-b85a-84d40b390b4a"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:34.580685 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2c7445ae-0c87-4744-8c7a-eebe1e355620 req-25052764-7e3a-4b5a-93d2-e21af8db2e9f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:34.581169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2c7445ae-0c87-4744-8c7a-eebe1e355620 req-25052764-7e3a-4b5a-93d2-e21af8db2e9f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:34.581633 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2c7445ae-0c87-4744-8c7a-eebe1e355620 req-25052764-7e3a-4b5a-93d2-e21af8db2e9f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:34.609530 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-2c7445ae-0c87-4744-8c7a-eebe1e355620 req-25052764-7e3a-4b5a-93d2-e21af8db2e9f service nova] Creating event network-vif-deleted:37895208-c7eb-4756-b85a-84d40b390b4a for instance 964a7041-9baa-42fb-a51c-f760437411df on nch1-master-1 Sep 17 21:07:34.624129 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-2c7445ae-0c87-4744-8c7a-eebe1e355620 req-25052764-7e3a-4b5a-93d2-e21af8db2e9f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112035 Sep 17 21:07:34.626597 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1994/4092] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:07:34.634238 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-ee5c202a-8b88-4320-89af-8b8a2355e98f req-2ac43319-2274-4f75-940d-ebf7bbc0657e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "142d8aab-a359-47e1-a8d5-a77303a1f0ae", "name": "network-vif-deleted", "tag": "476762ad-4639-45af-9194-c976beae9228"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:34.657578 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9a5df5b7-9cd6-40fb-8421-e5851e1154d4 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:34.660094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-ee5c202a-8b88-4320-89af-8b8a2355e98f req-2ac43319-2274-4f75-940d-ebf7bbc0657e service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:34.660766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-ee5c202a-8b88-4320-89af-8b8a2355e98f req-2ac43319-2274-4f75-940d-ebf7bbc0657e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:34.662269 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-ee5c202a-8b88-4320-89af-8b8a2355e98f req-2ac43319-2274-4f75-940d-ebf7bbc0657e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:34.668202 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9a5df5b7-9cd6-40fb-8421-e5851e1154d4 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc" status: 200 len: 1299 microversion: 2.1 time: 0.264607 Sep 17 21:07:34.681737 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-ee5c202a-8b88-4320-89af-8b8a2355e98f req-2ac43319-2274-4f75-940d-ebf7bbc0657e service nova] Creating event network-vif-deleted:476762ad-4639-45af-9194-c976beae9228 for instance 142d8aab-a359-47e1-a8d5-a77303a1f0ae on nch1-master-1 Sep 17 21:07:34.686195 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2099/4093] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:34 2022] GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc => generated 1299 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:34.698766 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-ee5c202a-8b88-4320-89af-8b8a2355e98f req-2ac43319-2274-4f75-940d-ebf7bbc0657e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069623 Sep 17 21:07:34.699657 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1995/4094] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:07:34.705130 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ed3a45d6-e323-4f45-ba62-852e866a342c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:34.705792 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ed3a45d6-e323-4f45-ba62-852e866a342c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 142d8aab-a359-47e1-a8d5-a77303a1f0ae] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:34.720732 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed3a45d6-e323-4f45-ba62-852e866a342c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:34.721257 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed3a45d6-e323-4f45-ba62-852e866a342c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:34.723643 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed3a45d6-e323-4f45-ba62-852e866a342c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:34.724650 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed3a45d6-e323-4f45-ba62-852e866a342c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:34.725129 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed3a45d6-e323-4f45-ba62-852e866a342c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:34.725678 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed3a45d6-e323-4f45-ba62-852e866a342c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:34.767913 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed3a45d6-e323-4f45-ba62-852e866a342c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:34.768749 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed3a45d6-e323-4f45-ba62-852e866a342c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:34.769190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed3a45d6-e323-4f45-ba62-852e866a342c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:34.769782 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-ed3a45d6-e323-4f45-ba62-852e866a342c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lazy-loading 'fault' on Instance uuid 142d8aab-a359-47e1-a8d5-a77303a1f0ae {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:07:34.820135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ed3a45d6-e323-4f45-ba62-852e866a342c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c7a82126124ebb8baf5c656ff9849d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a83c9c29f1483b9ee9c48e94dc17ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:34.833159 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ed3a45d6-e323-4f45-ba62-852e866a342c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "GET /compute/v2.1/servers/142d8aab-a359-47e1-a8d5-a77303a1f0ae" status: 200 len: 1307 microversion: 2.1 time: 0.145553 Sep 17 21:07:34.833876 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2100/4095] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:34 2022] GET /compute/v2.1/servers/142d8aab-a359-47e1-a8d5-a77303a1f0ae => generated 1307 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:34.965850 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e186a747-d40b-41bd-9552-865a7716fb46 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:34.966612 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e186a747-d40b-41bd-9552-865a7716fb46 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:34.973095 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e186a747-d40b-41bd-9552-865a7716fb46 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:34.973592 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e186a747-d40b-41bd-9552-865a7716fb46 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:34.974039 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e186a747-d40b-41bd-9552-865a7716fb46 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:34.974734 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e186a747-d40b-41bd-9552-865a7716fb46 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:34.975193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e186a747-d40b-41bd-9552-865a7716fb46 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:34.975621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e186a747-d40b-41bd-9552-865a7716fb46 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:35.122164 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e186a747-d40b-41bd-9552-865a7716fb46 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:35.131909 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e186a747-d40b-41bd-9552-865a7716fb46 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1506 microversion: 2.1 time: 0.171268 Sep 17 21:07:35.152308 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1996/4096] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:34 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1506 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:35.428997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-59fb9a89-bbe9-4284-b3bc-141ff5f93a15 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:35.429880 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-59fb9a89-bbe9-4284-b3bc-141ff5f93a15 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] [instance: 964a7041-9baa-42fb-a51c-f760437411df] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:35.441840 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59fb9a89-bbe9-4284-b3bc-141ff5f93a15 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:35.443123 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59fb9a89-bbe9-4284-b3bc-141ff5f93a15 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:35.443725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59fb9a89-bbe9-4284-b3bc-141ff5f93a15 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:35.444447 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59fb9a89-bbe9-4284-b3bc-141ff5f93a15 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:35.445722 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59fb9a89-bbe9-4284-b3bc-141ff5f93a15 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:35.446435 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59fb9a89-bbe9-4284-b3bc-141ff5f93a15 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:35.470023 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-59fb9a89-bbe9-4284-b3bc-141ff5f93a15 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] HTTP exception thrown: Instance 964a7041-9baa-42fb-a51c-f760437411df could not be found. Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-59fb9a89-bbe9-4284-b3bc-141ff5f93a15 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Request method failure captured: Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df HTTP/1.1 Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjbm67UaJxpq8_DWWrPif2Lk6LYyWiz4FFo6ccblXGnkW3sGrrxCpMatVoBrChERHe-w79ATSGSGzjGe2QhqInQDEXO37duDwsQ5xpgDuNLiB5eLbcel2OJIKDdcXHc2sFItRMfsqiv5_M4kkrU9aIsd2rBT3iEC1vyD2BZp7g7wiOw Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 3e857c532a264ea78e24fd8fe1a44fbc Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-VolumesActionsTest-905194390 Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e857c532a264ea78e24fd8fe1a44fbc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3e857c532a264ea78e24fd8fe1a44fbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e857c532a264ea78e24fd8fe1a44fbc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3e857c532a264ea78e24fd8fe1a44fbc", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-VolumesActionsTest-905194390 Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 3e857c532a264ea78e24fd8fe1a44fbc Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-VolumesActionsTest-905194390 Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-VolumesActionsTest-905194390-project Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 33784305478f46ae9fdc4d4b82ebc6f5 Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-VolumesActionsTest-905194390-project Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 964a7041-9baa-42fb-a51c-f760437411df could not be found. Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '964a7041-9baa-42fb-a51c-f760437411df'} Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 964a7041-9baa-42fb-a51c-f760437411df could not be found. Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 964a7041-9baa-42fb-a51c-f760437411df could not be found. Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:35.472658 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:07:35.477190 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:35.477190 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:07:35.477190 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:07:35.477190 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:07:35.477190 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:07:35.477190 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 964a7041-9baa-42fb-a51c-f760437411df could not be found. Sep 17 21:07:35.477190 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:07:35.477190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-59fb9a89-bbe9-4284-b3bc-141ff5f93a15 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] Returning 404 to user: Instance 964a7041-9baa-42fb-a51c-f760437411df could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:07:35.477190 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-59fb9a89-bbe9-4284-b3bc-141ff5f93a15 tempest-VolumesActionsTest-905194390 tempest-VolumesActionsTest-905194390-project] 10.222.0.26 "GET /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df" status: 404 len: 111 microversion: 2.1 time: 0.049954 Sep 17 21:07:35.477190 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2101/4097] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:35 2022] GET /compute/v2.1/servers/964a7041-9baa-42fb-a51c-f760437411df => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:07:35.536170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2ed6e065-ad65-40c7-a9a7-5ad8e048fd5f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:35.536942 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2ed6e065-ad65-40c7-a9a7-5ad8e048fd5f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:35.544583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ed6e065-ad65-40c7-a9a7-5ad8e048fd5f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:35.545308 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ed6e065-ad65-40c7-a9a7-5ad8e048fd5f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:35.546009 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ed6e065-ad65-40c7-a9a7-5ad8e048fd5f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:35.546991 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ed6e065-ad65-40c7-a9a7-5ad8e048fd5f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:35.547710 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ed6e065-ad65-40c7-a9a7-5ad8e048fd5f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:35.548326 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ed6e065-ad65-40c7-a9a7-5ad8e048fd5f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:35.694586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ea898681-bd3f-4f36-b746-8fd90efc7ee2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:35.695824 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ea898681-bd3f-4f36-b746-8fd90efc7ee2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:35.710604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea898681-bd3f-4f36-b746-8fd90efc7ee2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:35.711148 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea898681-bd3f-4f36-b746-8fd90efc7ee2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:35.723321 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea898681-bd3f-4f36-b746-8fd90efc7ee2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:35.724312 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea898681-bd3f-4f36-b746-8fd90efc7ee2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:35.725238 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea898681-bd3f-4f36-b746-8fd90efc7ee2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:35.729902 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea898681-bd3f-4f36-b746-8fd90efc7ee2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:36.334233 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2ed6e065-ad65-40c7-a9a7-5ad8e048fd5f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:36.342162 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2ed6e065-ad65-40c7-a9a7-5ad8e048fd5f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915" status: 200 len: 1370 microversion: 2.1 time: 0.811330 Sep 17 21:07:36.362958 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1997/4098] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:35 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 => generated 1370 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:36.375045 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ea898681-bd3f-4f36-b746-8fd90efc7ee2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:36.381885 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-697445c9-d150-4a97-bd25-464b67b89ceb tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:36.382515 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-697445c9-d150-4a97-bd25-464b67b89ceb tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 142d8aab-a359-47e1-a8d5-a77303a1f0ae] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:36.388971 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ea898681-bd3f-4f36-b746-8fd90efc7ee2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc" status: 200 len: 1366 microversion: 2.1 time: 0.699000 Sep 17 21:07:36.389597 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2102/4099] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:35 2022] GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc => generated 1366 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:36.394659 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5c10d0e1-3cc3-40a7-b3db-c3b87c602207 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:36.403165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5c10d0e1-3cc3-40a7-b3db-c3b87c602207 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:36.413937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-697445c9-d150-4a97-bd25-464b67b89ceb tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:36.417939 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-697445c9-d150-4a97-bd25-464b67b89ceb tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:36.426496 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-697445c9-d150-4a97-bd25-464b67b89ceb tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:36.430474 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-697445c9-d150-4a97-bd25-464b67b89ceb tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:36.435216 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-697445c9-d150-4a97-bd25-464b67b89ceb tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:36.435665 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-697445c9-d150-4a97-bd25-464b67b89ceb tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:36.445409 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c10d0e1-3cc3-40a7-b3db-c3b87c602207 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:36.446122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c10d0e1-3cc3-40a7-b3db-c3b87c602207 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:36.446464 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c10d0e1-3cc3-40a7-b3db-c3b87c602207 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:36.447100 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c10d0e1-3cc3-40a7-b3db-c3b87c602207 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:36.447588 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c10d0e1-3cc3-40a7-b3db-c3b87c602207 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:36.448018 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c10d0e1-3cc3-40a7-b3db-c3b87c602207 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:36.477948 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-697445c9-d150-4a97-bd25-464b67b89ceb tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] HTTP exception thrown: Instance 142d8aab-a359-47e1-a8d5-a77303a1f0ae could not be found. Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-697445c9-d150-4a97-bd25-464b67b89ceb tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Request method failure captured: Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/142d8aab-a359-47e1-a8d5-a77303a1f0ae HTTP/1.1 Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjacAZj10VFiEUh0cWVF2AQMc1JLbHLpNIxz7ojw7CKDlQ6pOQT5Ecy5YasW9Mq9k1264rHRG_72G5QAPn57ZI3-aiVUnPDcUVfi9ENRsg0qJlHQ3C2P1BfvffIvTApyQNhg-vSFgYlY5RxtNwepHIj2jPe-d4E4f91sMJaZbFlvsr0 Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: c3a83c9c29f1483b9ee9c48e94dc17ce Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-VolumesAdminNegativeTest-2142170983 Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3a83c9c29f1483b9ee9c48e94dc17ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c3a83c9c29f1483b9ee9c48e94dc17ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3a83c9c29f1483b9ee9c48e94dc17ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c3a83c9c29f1483b9ee9c48e94dc17ce", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-VolumesAdminNegativeTest-2142170983 Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: c3a83c9c29f1483b9ee9c48e94dc17ce Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2142170983 Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-VolumesAdminNegativeTest-2142170983-project Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 24c7a82126124ebb8baf5c656ff9849d Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-VolumesAdminNegativeTest-2142170983-project Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 142d8aab-a359-47e1-a8d5-a77303a1f0ae could not be found. Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '142d8aab-a359-47e1-a8d5-a77303a1f0ae'} Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 142d8aab-a359-47e1-a8d5-a77303a1f0ae could not be found. Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 142d8aab-a359-47e1-a8d5-a77303a1f0ae could not be found. Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:36.479653 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:36.484974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:36.484974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:07:36.484974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:07:36.484974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:07:36.484974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:07:36.484974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 142d8aab-a359-47e1-a8d5-a77303a1f0ae could not be found. Sep 17 21:07:36.484974 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:36.484974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-697445c9-d150-4a97-bd25-464b67b89ceb tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Returning 404 to user: Instance 142d8aab-a359-47e1-a8d5-a77303a1f0ae could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:07:36.484974 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-697445c9-d150-4a97-bd25-464b67b89ceb tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "GET /compute/v2.1/servers/142d8aab-a359-47e1-a8d5-a77303a1f0ae" status: 404 len: 111 microversion: 2.1 time: 0.116874 Sep 17 21:07:36.484974 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1998/4100] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:36 2022] GET /compute/v2.1/servers/142d8aab-a359-47e1-a8d5-a77303a1f0ae => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:07:36.831728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5c10d0e1-3cc3-40a7-b3db-c3b87c602207 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:36.861504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:36.868010 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5c10d0e1-3cc3-40a7-b3db-c3b87c602207 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1506 microversion: 2.1 time: 0.477161 Sep 17 21:07:36.871244 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2103/4101] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:36 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1506 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:36.952716 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-5ff4ded0-8e66-485f-a53c-ab120d4cfd62 req-6fdfdc9c-0f6e-4e8f-835c-b6afa2b4d2c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc", "tag": "b60e28ec-86a4-47a2-baf7-ab19bebc01d8"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:36.963483 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-5ff4ded0-8e66-485f-a53c-ab120d4cfd62 req-6fdfdc9c-0f6e-4e8f-835c-b6afa2b4d2c9 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:36.964066 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-5ff4ded0-8e66-485f-a53c-ab120d4cfd62 req-6fdfdc9c-0f6e-4e8f-835c-b6afa2b4d2c9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:36.964617 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-5ff4ded0-8e66-485f-a53c-ab120d4cfd62 req-6fdfdc9c-0f6e-4e8f-835c-b6afa2b4d2c9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:36.979228 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-5ff4ded0-8e66-485f-a53c-ab120d4cfd62 req-6fdfdc9c-0f6e-4e8f-835c-b6afa2b4d2c9 service nova] Creating event network-changed:b60e28ec-86a4-47a2-baf7-ab19bebc01d8 for instance 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc on nch1-master-1 Sep 17 21:07:36.985382 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-5ff4ded0-8e66-485f-a53c-ab120d4cfd62 req-6fdfdc9c-0f6e-4e8f-835c-b6afa2b4d2c9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037180 Sep 17 21:07:36.987596 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 1999/4102] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:07:37.378794 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3b7b244b-1973-4678-90be-b4903af4bc33 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:37.379701 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3b7b244b-1973-4678-90be-b4903af4bc33 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:37.389157 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b7b244b-1973-4678-90be-b4903af4bc33 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:37.390332 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b7b244b-1973-4678-90be-b4903af4bc33 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:37.390979 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b7b244b-1973-4678-90be-b4903af4bc33 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:37.392277 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b7b244b-1973-4678-90be-b4903af4bc33 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:37.392925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b7b244b-1973-4678-90be-b4903af4bc33 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:37.393722 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b7b244b-1973-4678-90be-b4903af4bc33 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:37.416857 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-44f84018-2fc4-4765-871b-c58edc8c4f02 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:37.417742 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-44f84018-2fc4-4765-871b-c58edc8c4f02 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:37.427513 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44f84018-2fc4-4765-871b-c58edc8c4f02 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:37.433507 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44f84018-2fc4-4765-871b-c58edc8c4f02 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:37.434161 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44f84018-2fc4-4765-871b-c58edc8c4f02 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:37.435010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44f84018-2fc4-4765-871b-c58edc8c4f02 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:37.435554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44f84018-2fc4-4765-871b-c58edc8c4f02 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:37.444768 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44f84018-2fc4-4765-871b-c58edc8c4f02 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:37.659563 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:37.719029 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=24 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:37.786357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3b7b244b-1973-4678-90be-b4903af4bc33 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:37.807681 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3b7b244b-1973-4678-90be-b4903af4bc33 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915" status: 200 len: 1370 microversion: 2.1 time: 0.438925 Sep 17 21:07:37.812047 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2104/4103] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:37 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 => generated 1370 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:37.825061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-29ec4f0c-9719-435e-aeb9-0f5654493adb tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:37.827975 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-29ec4f0c-9719-435e-aeb9-0f5654493adb tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 29c92489-5a3c-43e3-8dae-d5168e2a29bb] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:37.845559 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-29ec4f0c-9719-435e-aeb9-0f5654493adb tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:37.847445 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-29ec4f0c-9719-435e-aeb9-0f5654493adb tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:37.848101 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-29ec4f0c-9719-435e-aeb9-0f5654493adb tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:37.850202 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-29ec4f0c-9719-435e-aeb9-0f5654493adb tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:37.851344 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-29ec4f0c-9719-435e-aeb9-0f5654493adb tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:37.852230 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-29ec4f0c-9719-435e-aeb9-0f5654493adb tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:37.898686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-44f84018-2fc4-4765-871b-c58edc8c4f02 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:37.919746 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-29ec4f0c-9719-435e-aeb9-0f5654493adb tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 29c92489-5a3c-43e3-8dae-d5168e2a29bb] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:07:37.922263 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-44f84018-2fc4-4765-871b-c58edc8c4f02 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc" status: 200 len: 1366 microversion: 2.1 time: 0.502199 Sep 17 21:07:37.922931 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2000/4104] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:37 2022] GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc => generated 1366 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:07:37.943729 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d64c2bdc-c8fd-414d-b416-750a84a174fc tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:37.946092 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d64c2bdc-c8fd-414d-b416-750a84a174fc tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:37.961340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d64c2bdc-c8fd-414d-b416-750a84a174fc tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:37.968793 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d64c2bdc-c8fd-414d-b416-750a84a174fc tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:37.969220 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d64c2bdc-c8fd-414d-b416-750a84a174fc tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:37.970075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d64c2bdc-c8fd-414d-b416-750a84a174fc tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:37.971001 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d64c2bdc-c8fd-414d-b416-750a84a174fc tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:37.971783 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d64c2bdc-c8fd-414d-b416-750a84a174fc tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:38.057239 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-29ec4f0c-9719-435e-aeb9-0f5654493adb tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "DELETE /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb" status: 204 len: 0 microversion: 2.1 time: 0.242826 Sep 17 21:07:38.058315 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2105/4105] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:07:37 2022] DELETE /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:07:38.073557 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2e59858b-2525-43b5-856c-14499f34151a tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:38.074631 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2e59858b-2525-43b5-856c-14499f34151a tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 29c92489-5a3c-43e3-8dae-d5168e2a29bb] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:38.083375 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e59858b-2525-43b5-856c-14499f34151a tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:38.084127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e59858b-2525-43b5-856c-14499f34151a tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:38.084793 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e59858b-2525-43b5-856c-14499f34151a tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:38.089669 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e59858b-2525-43b5-856c-14499f34151a tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:38.090470 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e59858b-2525-43b5-856c-14499f34151a tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:38.091230 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e59858b-2525-43b5-856c-14499f34151a tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:38.303730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d64c2bdc-c8fd-414d-b416-750a84a174fc tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:38.314896 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d64c2bdc-c8fd-414d-b416-750a84a174fc tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1506 microversion: 2.1 time: 0.386382 Sep 17 21:07:38.315982 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2001/4106] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:37 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1506 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:38.435555 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2e59858b-2525-43b5-856c-14499f34151a tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c7a82126124ebb8baf5c656ff9849d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a83c9c29f1483b9ee9c48e94dc17ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:38.443973 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=24 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:38.447849 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2e59858b-2525-43b5-856c-14499f34151a tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb" status: 200 len: 1681 microversion: 2.1 time: 0.380014 Sep 17 21:07:38.461689 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2106/4107] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:38 2022] GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb => generated 1681 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:07:38.840713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b8174166-b0dc-4d95-a9c9-c259970392f1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:38.841423 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b8174166-b0dc-4d95-a9c9-c259970392f1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:38.848800 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b8174166-b0dc-4d95-a9c9-c259970392f1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:38.851957 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b8174166-b0dc-4d95-a9c9-c259970392f1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:38.852428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b8174166-b0dc-4d95-a9c9-c259970392f1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:38.853170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b8174166-b0dc-4d95-a9c9-c259970392f1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:38.855356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b8174166-b0dc-4d95-a9c9-c259970392f1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:38.860572 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b8174166-b0dc-4d95-a9c9-c259970392f1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:38.948399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a715302f-6317-445b-b224-bad0e80d7005 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:38.949018 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a715302f-6317-445b-b224-bad0e80d7005 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:38.977533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a715302f-6317-445b-b224-bad0e80d7005 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:38.978405 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a715302f-6317-445b-b224-bad0e80d7005 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:38.979997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a715302f-6317-445b-b224-bad0e80d7005 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:38.982232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a715302f-6317-445b-b224-bad0e80d7005 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:38.984405 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a715302f-6317-445b-b224-bad0e80d7005 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:38.985573 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a715302f-6317-445b-b224-bad0e80d7005 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:39.319320 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b8174166-b0dc-4d95-a9c9-c259970392f1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:39.330353 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b8174166-b0dc-4d95-a9c9-c259970392f1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915" status: 200 len: 1370 microversion: 2.1 time: 0.495725 Sep 17 21:07:39.351148 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2002/4108] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:38 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 => generated 1370 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:39.352015 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a715302f-6317-445b-b224-bad0e80d7005 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:39.359101 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dadd9a53-9f3f-4333-b0b6-b54e1be5530b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:39.360048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dadd9a53-9f3f-4333-b0b6-b54e1be5530b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:39.367462 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a715302f-6317-445b-b224-bad0e80d7005 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc" status: 200 len: 1366 microversion: 2.1 time: 0.422901 Sep 17 21:07:39.368416 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2107/4109] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:38 2022] GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc => generated 1366 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:07:39.369101 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dadd9a53-9f3f-4333-b0b6-b54e1be5530b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:39.369824 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dadd9a53-9f3f-4333-b0b6-b54e1be5530b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:39.370396 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dadd9a53-9f3f-4333-b0b6-b54e1be5530b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:39.371402 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dadd9a53-9f3f-4333-b0b6-b54e1be5530b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:39.371996 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dadd9a53-9f3f-4333-b0b6-b54e1be5530b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:39.372561 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dadd9a53-9f3f-4333-b0b6-b54e1be5530b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:39.474036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f349eb5b-c81f-49f8-a807-9c850becd3b4 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:39.475069 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f349eb5b-c81f-49f8-a807-9c850becd3b4 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 29c92489-5a3c-43e3-8dae-d5168e2a29bb] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:39.484415 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f349eb5b-c81f-49f8-a807-9c850becd3b4 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:39.485236 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f349eb5b-c81f-49f8-a807-9c850becd3b4 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:39.485857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f349eb5b-c81f-49f8-a807-9c850becd3b4 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:39.486738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f349eb5b-c81f-49f8-a807-9c850becd3b4 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:39.487346 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f349eb5b-c81f-49f8-a807-9c850becd3b4 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:39.490377 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f349eb5b-c81f-49f8-a807-9c850becd3b4 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:40.386916 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dadd9a53-9f3f-4333-b0b6-b54e1be5530b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:40.395014 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f349eb5b-c81f-49f8-a807-9c850becd3b4 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c7a82126124ebb8baf5c656ff9849d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a83c9c29f1483b9ee9c48e94dc17ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:40.444118 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dadd9a53-9f3f-4333-b0b6-b54e1be5530b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1506 microversion: 2.1 time: 1.089770 Sep 17 21:07:40.445172 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2003/4110] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:39 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1506 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:40.450878 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f349eb5b-c81f-49f8-a807-9c850becd3b4 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb" status: 200 len: 1681 microversion: 2.1 time: 0.980681 Sep 17 21:07:40.451787 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2108/4111] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:39 2022] GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb => generated 1681 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:07:40.453076 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-36d2bc26-aae2-46ef-aa61-ba62a85d1b71 req-40f8681b-284e-4466-89f3-ac1d2b4278d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2341e0c-be19-4ba1-a137-472f1ecc3915", "name": "network-vif-plugged", "status": "completed", "tag": "79728522-0106-4867-9b9d-f0a0cc2b1675"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:40.465079 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5071be5f-32d9-45b0-99ae-6e0c65c85862 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:40.467648 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5071be5f-32d9-45b0-99ae-6e0c65c85862 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:40.474866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-36d2bc26-aae2-46ef-aa61-ba62a85d1b71 req-40f8681b-284e-4466-89f3-ac1d2b4278d0 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:40.475717 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-36d2bc26-aae2-46ef-aa61-ba62a85d1b71 req-40f8681b-284e-4466-89f3-ac1d2b4278d0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:40.476308 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-36d2bc26-aae2-46ef-aa61-ba62a85d1b71 req-40f8681b-284e-4466-89f3-ac1d2b4278d0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:40.501478 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-36d2bc26-aae2-46ef-aa61-ba62a85d1b71 req-40f8681b-284e-4466-89f3-ac1d2b4278d0 service nova] Creating event network-vif-plugged:79728522-0106-4867-9b9d-f0a0cc2b1675 for instance c2341e0c-be19-4ba1-a137-472f1ecc3915 on nch2-master-1 Sep 17 21:07:40.506349 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5071be5f-32d9-45b0-99ae-6e0c65c85862 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:40.506950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5071be5f-32d9-45b0-99ae-6e0c65c85862 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:40.507368 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5071be5f-32d9-45b0-99ae-6e0c65c85862 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:40.508186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5071be5f-32d9-45b0-99ae-6e0c65c85862 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:40.508621 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5071be5f-32d9-45b0-99ae-6e0c65c85862 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:40.518247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5071be5f-32d9-45b0-99ae-6e0c65c85862 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:40.527687 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-36d2bc26-aae2-46ef-aa61-ba62a85d1b71 req-40f8681b-284e-4466-89f3-ac1d2b4278d0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078772 Sep 17 21:07:40.528552 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2004/4112] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:07:40.538960 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-df861f5c-c066-4879-bf7b-c1ea47162a2a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:40.561932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-df861f5c-c066-4879-bf7b-c1ea47162a2a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:40.579235 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df861f5c-c066-4879-bf7b-c1ea47162a2a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:40.579983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df861f5c-c066-4879-bf7b-c1ea47162a2a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:40.590512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df861f5c-c066-4879-bf7b-c1ea47162a2a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:40.591446 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df861f5c-c066-4879-bf7b-c1ea47162a2a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:40.592064 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df861f5c-c066-4879-bf7b-c1ea47162a2a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:40.592637 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df861f5c-c066-4879-bf7b-c1ea47162a2a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:41.089643 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5071be5f-32d9-45b0-99ae-6e0c65c85862 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:41.100385 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5071be5f-32d9-45b0-99ae-6e0c65c85862 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915" status: 200 len: 1370 microversion: 2.1 time: 0.647341 Sep 17 21:07:41.113836 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2109/4113] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:40 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 => generated 1370 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:41.363972 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-df861f5c-c066-4879-bf7b-c1ea47162a2a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:41.385077 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-df861f5c-c066-4879-bf7b-c1ea47162a2a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc" status: 200 len: 1366 microversion: 2.1 time: 0.849690 Sep 17 21:07:41.390958 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2005/4114] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:40 2022] GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc => generated 1366 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:41.480724 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2c0d7fa5-85c4-47fb-8c24-28415f51a6b7 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:41.481876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-137671e7-840c-4352-bb88-d5464343fd8d tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:41.482691 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-137671e7-840c-4352-bb88-d5464343fd8d tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 29c92489-5a3c-43e3-8dae-d5168e2a29bb] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:41.483464 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2c0d7fa5-85c4-47fb-8c24-28415f51a6b7 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:41.504666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c0d7fa5-85c4-47fb-8c24-28415f51a6b7 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:41.506650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-137671e7-840c-4352-bb88-d5464343fd8d tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:41.507568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-137671e7-840c-4352-bb88-d5464343fd8d tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:41.508477 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c0d7fa5-85c4-47fb-8c24-28415f51a6b7 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:41.509172 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-137671e7-840c-4352-bb88-d5464343fd8d tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:41.509858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c0d7fa5-85c4-47fb-8c24-28415f51a6b7 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:41.511365 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c0d7fa5-85c4-47fb-8c24-28415f51a6b7 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:41.511848 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-137671e7-840c-4352-bb88-d5464343fd8d tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:41.512753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-137671e7-840c-4352-bb88-d5464343fd8d tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:41.513434 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c0d7fa5-85c4-47fb-8c24-28415f51a6b7 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:41.514107 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-137671e7-840c-4352-bb88-d5464343fd8d tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:41.514741 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c0d7fa5-85c4-47fb-8c24-28415f51a6b7 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:41.978012 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2c0d7fa5-85c4-47fb-8c24-28415f51a6b7 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:42.006918 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2c0d7fa5-85c4-47fb-8c24-28415f51a6b7 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1506 microversion: 2.1 time: 0.539313 Sep 17 21:07:42.008213 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2110/4115] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:41 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1506 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:42.130570 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f54dbbe5-b191-4d77-b0fc-b16756a7eadf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:42.131457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f54dbbe5-b191-4d77-b0fc-b16756a7eadf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:42.142545 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-137671e7-840c-4352-bb88-d5464343fd8d tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c7a82126124ebb8baf5c656ff9849d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a83c9c29f1483b9ee9c48e94dc17ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:42.146639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:42.165120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f54dbbe5-b191-4d77-b0fc-b16756a7eadf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:42.167027 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-137671e7-840c-4352-bb88-d5464343fd8d tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb" status: 200 len: 1681 microversion: 2.1 time: 0.692909 Sep 17 21:07:42.169870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f54dbbe5-b191-4d77-b0fc-b16756a7eadf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:42.175125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f54dbbe5-b191-4d77-b0fc-b16756a7eadf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:42.176170 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2006/4116] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:41 2022] GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb => generated 1681 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:42.177476 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f54dbbe5-b191-4d77-b0fc-b16756a7eadf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:42.180738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f54dbbe5-b191-4d77-b0fc-b16756a7eadf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:42.182657 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f54dbbe5-b191-4d77-b0fc-b16756a7eadf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:42.422016 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3ac11e45-149e-4be9-b298-4ee3394212f7 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:42.422814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3ac11e45-149e-4be9-b298-4ee3394212f7 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:42.441935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3ac11e45-149e-4be9-b298-4ee3394212f7 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:42.447457 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3ac11e45-149e-4be9-b298-4ee3394212f7 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:42.448094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3ac11e45-149e-4be9-b298-4ee3394212f7 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:42.448997 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3ac11e45-149e-4be9-b298-4ee3394212f7 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:42.449650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3ac11e45-149e-4be9-b298-4ee3394212f7 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:42.450256 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3ac11e45-149e-4be9-b298-4ee3394212f7 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:42.787174 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f54dbbe5-b191-4d77-b0fc-b16756a7eadf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:42.810116 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f54dbbe5-b191-4d77-b0fc-b16756a7eadf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915" status: 200 len: 1370 microversion: 2.1 time: 0.686262 Sep 17 21:07:42.833492 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2111/4117] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:42 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 => generated 1370 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:42.845736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3ac11e45-149e-4be9-b298-4ee3394212f7 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:42.887205 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3ac11e45-149e-4be9-b298-4ee3394212f7 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc" status: 200 len: 1366 microversion: 2.1 time: 0.467559 Sep 17 21:07:42.891389 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2007/4118] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:42 2022] GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc => generated 1366 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:43.032935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4b8e7998-20f3-450f-857e-66db59c61d71 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:43.033831 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4b8e7998-20f3-450f-857e-66db59c61d71 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:43.053131 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b8e7998-20f3-450f-857e-66db59c61d71 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:43.059709 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b8e7998-20f3-450f-857e-66db59c61d71 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:43.064546 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b8e7998-20f3-450f-857e-66db59c61d71 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:43.068676 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b8e7998-20f3-450f-857e-66db59c61d71 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:43.070778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b8e7998-20f3-450f-857e-66db59c61d71 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:43.074216 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b8e7998-20f3-450f-857e-66db59c61d71 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:43.197374 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cd840c38-42db-4c03-bc19-ba01bd07c415 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:43.198026 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cd840c38-42db-4c03-bc19-ba01bd07c415 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 29c92489-5a3c-43e3-8dae-d5168e2a29bb] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:43.205029 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd840c38-42db-4c03-bc19-ba01bd07c415 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:43.205779 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd840c38-42db-4c03-bc19-ba01bd07c415 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:43.206382 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd840c38-42db-4c03-bc19-ba01bd07c415 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:43.207233 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd840c38-42db-4c03-bc19-ba01bd07c415 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:43.207829 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd840c38-42db-4c03-bc19-ba01bd07c415 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:43.208406 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd840c38-42db-4c03-bc19-ba01bd07c415 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:43.413234 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cd840c38-42db-4c03-bc19-ba01bd07c415 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c7a82126124ebb8baf5c656ff9849d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a83c9c29f1483b9ee9c48e94dc17ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:43.433565 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cd840c38-42db-4c03-bc19-ba01bd07c415 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb" status: 200 len: 1614 microversion: 2.1 time: 0.240466 Sep 17 21:07:43.463803 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2008/4119] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:43 2022] GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb => generated 1614 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:43.485883 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4b8e7998-20f3-450f-857e-66db59c61d71 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:43.498942 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4b8e7998-20f3-450f-857e-66db59c61d71 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1506 microversion: 2.1 time: 0.471505 Sep 17 21:07:43.499865 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2112/4120] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:43 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1506 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:43.849340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-686f975b-ef15-4296-b60a-cf5bc30a7649 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:43.850000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-686f975b-ef15-4296-b60a-cf5bc30a7649 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:43.861881 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-686f975b-ef15-4296-b60a-cf5bc30a7649 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:43.862948 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-686f975b-ef15-4296-b60a-cf5bc30a7649 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:43.863726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-686f975b-ef15-4296-b60a-cf5bc30a7649 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:43.865559 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-686f975b-ef15-4296-b60a-cf5bc30a7649 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:43.866178 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-686f975b-ef15-4296-b60a-cf5bc30a7649 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:43.866765 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-686f975b-ef15-4296-b60a-cf5bc30a7649 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:43.919633 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-45a296df-e18e-4f24-9590-69b333879caf tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:43.920394 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-45a296df-e18e-4f24-9590-69b333879caf tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:43.991206 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45a296df-e18e-4f24-9590-69b333879caf tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:43.991882 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45a296df-e18e-4f24-9590-69b333879caf tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:43.998324 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45a296df-e18e-4f24-9590-69b333879caf tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:43.999234 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45a296df-e18e-4f24-9590-69b333879caf tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:43.999788 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45a296df-e18e-4f24-9590-69b333879caf tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:44.000296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45a296df-e18e-4f24-9590-69b333879caf tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:44.332623 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-45a296df-e18e-4f24-9590-69b333879caf tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:44.352240 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-45a296df-e18e-4f24-9590-69b333879caf tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc" status: 200 len: 1366 microversion: 2.1 time: 0.437965 Sep 17 21:07:44.353133 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2113/4121] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:43 2022] GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc => generated 1366 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:44.358008 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-17f6b326-1aa0-4b7c-aed2-d537b0a2afd8 req-cee0d2a4-c8fe-4fdc-aee4-9739961c06e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29c92489-5a3c-43e3-8dae-d5168e2a29bb", "name": "network-vif-deleted", "tag": "9cab2864-c670-4626-bc81-dd94642db5a7"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:44.387882 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-17f6b326-1aa0-4b7c-aed2-d537b0a2afd8 req-cee0d2a4-c8fe-4fdc-aee4-9739961c06e2 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:44.394951 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-17f6b326-1aa0-4b7c-aed2-d537b0a2afd8 req-cee0d2a4-c8fe-4fdc-aee4-9739961c06e2 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:44.395690 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-17f6b326-1aa0-4b7c-aed2-d537b0a2afd8 req-cee0d2a4-c8fe-4fdc-aee4-9739961c06e2 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:44.443840 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-17f6b326-1aa0-4b7c-aed2-d537b0a2afd8 req-cee0d2a4-c8fe-4fdc-aee4-9739961c06e2 service nova] Creating event network-vif-deleted:9cab2864-c670-4626-bc81-dd94642db5a7 for instance 29c92489-5a3c-43e3-8dae-d5168e2a29bb on nch1-master-1 Sep 17 21:07:44.460224 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-17f6b326-1aa0-4b7c-aed2-d537b0a2afd8 req-cee0d2a4-c8fe-4fdc-aee4-9739961c06e2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103877 Sep 17 21:07:44.461531 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2114/4122] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:07:44.467471 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-686f975b-ef15-4296-b60a-cf5bc30a7649 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:44.475326 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-686f975b-ef15-4296-b60a-cf5bc30a7649 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915" status: 200 len: 1564 microversion: 2.1 time: 0.629824 Sep 17 21:07:44.477436 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ac9a07a9-797a-4643-b14f-d5af2000ab9c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:44.482196 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ac9a07a9-797a-4643-b14f-d5af2000ab9c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 29c92489-5a3c-43e3-8dae-d5168e2a29bb] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:44.495366 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac9a07a9-797a-4643-b14f-d5af2000ab9c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:44.495801 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2009/4123] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:43 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 => generated 1564 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:44.500107 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac9a07a9-797a-4643-b14f-d5af2000ab9c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:44.500958 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac9a07a9-797a-4643-b14f-d5af2000ab9c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:44.502668 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac9a07a9-797a-4643-b14f-d5af2000ab9c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:44.506659 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac9a07a9-797a-4643-b14f-d5af2000ab9c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:44.510856 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac9a07a9-797a-4643-b14f-d5af2000ab9c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:44.511404 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-20eea75c-3422-446c-8ef4-fddc0009371c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:44.511963 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-20eea75c-3422-446c-8ef4-fddc0009371c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:44.534914 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20eea75c-3422-446c-8ef4-fddc0009371c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:44.535708 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20eea75c-3422-446c-8ef4-fddc0009371c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:44.537235 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20eea75c-3422-446c-8ef4-fddc0009371c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:44.538217 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20eea75c-3422-446c-8ef4-fddc0009371c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:44.538822 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20eea75c-3422-446c-8ef4-fddc0009371c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:44.539396 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20eea75c-3422-446c-8ef4-fddc0009371c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:44.621776 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac9a07a9-797a-4643-b14f-d5af2000ab9c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:44.624547 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac9a07a9-797a-4643-b14f-d5af2000ab9c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:44.625108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac9a07a9-797a-4643-b14f-d5af2000ab9c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:44.628778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-ac9a07a9-797a-4643-b14f-d5af2000ab9c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lazy-loading 'fault' on Instance uuid 29c92489-5a3c-43e3-8dae-d5168e2a29bb {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:07:44.770249 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-20eea75c-3422-446c-8ef4-fddc0009371c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.273197 Sep 17 21:07:44.771033 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2010/4124] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Sep 17 21:07:44 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915/os-interface => generated 285 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:07:44.784464 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1e3d520a-66e8-4ae1-a1fd-d8489cd23f76 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:44.785295 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1e3d520a-66e8-4ae1-a1fd-d8489cd23f76 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:44.800842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1e3d520a-66e8-4ae1-a1fd-d8489cd23f76 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:44.801771 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1e3d520a-66e8-4ae1-a1fd-d8489cd23f76 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:44.802411 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1e3d520a-66e8-4ae1-a1fd-d8489cd23f76 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:44.803315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1e3d520a-66e8-4ae1-a1fd-d8489cd23f76 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:44.805005 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1e3d520a-66e8-4ae1-a1fd-d8489cd23f76 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:44.805703 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1e3d520a-66e8-4ae1-a1fd-d8489cd23f76 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:44.904241 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ac9a07a9-797a-4643-b14f-d5af2000ab9c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24c7a82126124ebb8baf5c656ff9849d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3a83c9c29f1483b9ee9c48e94dc17ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:44.917307 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ac9a07a9-797a-4643-b14f-d5af2000ab9c tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb" status: 200 len: 1332 microversion: 2.1 time: 0.454196 Sep 17 21:07:44.918475 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2115/4125] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:44 2022] GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb => generated 1332 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:44.923610 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-1945bd5f-a7a1-4d9a-a983-8b2a5a2402fb req-5af2b487-30de-4baa-b8a6-ccd48de0ac69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc", "name": "network-vif-plugged", "status": "completed", "tag": "b60e28ec-86a4-47a2-baf7-ab19bebc01d8"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:44.942565 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-1945bd5f-a7a1-4d9a-a983-8b2a5a2402fb req-5af2b487-30de-4baa-b8a6-ccd48de0ac69 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:44.944003 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-1945bd5f-a7a1-4d9a-a983-8b2a5a2402fb req-5af2b487-30de-4baa-b8a6-ccd48de0ac69 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:44.944645 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-1945bd5f-a7a1-4d9a-a983-8b2a5a2402fb req-5af2b487-30de-4baa-b8a6-ccd48de0ac69 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:44.962649 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-1945bd5f-a7a1-4d9a-a983-8b2a5a2402fb req-5af2b487-30de-4baa-b8a6-ccd48de0ac69 service nova] Creating event network-vif-plugged:b60e28ec-86a4-47a2-baf7-ab19bebc01d8 for instance 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc on nch1-master-1 Sep 17 21:07:44.968462 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-1945bd5f-a7a1-4d9a-a983-8b2a5a2402fb req-5af2b487-30de-4baa-b8a6-ccd48de0ac69 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048238 Sep 17 21:07:44.969901 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2116/4126] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:07:45.382412 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9b76e977-1247-404c-a983-243875278e0d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:45.383223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9b76e977-1247-404c-a983-243875278e0d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:45.406258 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b76e977-1247-404c-a983-243875278e0d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:45.409957 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b76e977-1247-404c-a983-243875278e0d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:45.410493 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b76e977-1247-404c-a983-243875278e0d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:45.411331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b76e977-1247-404c-a983-243875278e0d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:45.412628 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b76e977-1247-404c-a983-243875278e0d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:45.414461 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b76e977-1247-404c-a983-243875278e0d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:45.448575 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1e3d520a-66e8-4ae1-a1fd-d8489cd23f76 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:45.464150 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1e3d520a-66e8-4ae1-a1fd-d8489cd23f76 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1506 microversion: 2.1 time: 0.684183 Sep 17 21:07:45.465228 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2011/4127] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:44 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1506 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:45.820649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9b76e977-1247-404c-a983-243875278e0d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:45.883724 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9b76e977-1247-404c-a983-243875278e0d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc" status: 200 len: 1366 microversion: 2.1 time: 0.506560 Sep 17 21:07:45.890145 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2117/4128] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:45 2022] GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc => generated 1366 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:07:45.945898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-28070f36-1839-4970-9762-a85e664872fc tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:45.953366 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-28070f36-1839-4970-9762-a85e664872fc tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] [instance: 29c92489-5a3c-43e3-8dae-d5168e2a29bb] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:45.962942 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-28070f36-1839-4970-9762-a85e664872fc tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:45.963385 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-28070f36-1839-4970-9762-a85e664872fc tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:45.963989 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-28070f36-1839-4970-9762-a85e664872fc tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:45.970024 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-28070f36-1839-4970-9762-a85e664872fc tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:45.970950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-28070f36-1839-4970-9762-a85e664872fc tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:45.973136 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-28070f36-1839-4970-9762-a85e664872fc tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:46.046928 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-28070f36-1839-4970-9762-a85e664872fc tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] HTTP exception thrown: Instance 29c92489-5a3c-43e3-8dae-d5168e2a29bb could not be found. Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-28070f36-1839-4970-9762-a85e664872fc tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Request method failure captured: Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb HTTP/1.1 Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjacAZj10VFiEUh0cWVF2AQMc1JLbHLpNIxz7ojw7CKDlQ6pOQT5Ecy5YasW9Mq9k1264rHRG_72G5QAPn57ZI3-aiVUnPDcUVfi9ENRsg0qJlHQ3C2P1BfvffIvTApyQNhg-vSFgYlY5RxtNwepHIj2jPe-d4E4f91sMJaZbFlvsr0 Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: c3a83c9c29f1483b9ee9c48e94dc17ce Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-VolumesAdminNegativeTest-2142170983 Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3a83c9c29f1483b9ee9c48e94dc17ce"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c3a83c9c29f1483b9ee9c48e94dc17ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c3a83c9c29f1483b9ee9c48e94dc17ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c3a83c9c29f1483b9ee9c48e94dc17ce", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-VolumesAdminNegativeTest-2142170983 Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: c3a83c9c29f1483b9ee9c48e94dc17ce Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2142170983 Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-VolumesAdminNegativeTest-2142170983-project Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 24c7a82126124ebb8baf5c656ff9849d Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-VolumesAdminNegativeTest-2142170983-project Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 29c92489-5a3c-43e3-8dae-d5168e2a29bb could not be found. Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '29c92489-5a3c-43e3-8dae-d5168e2a29bb'} Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29c92489-5a3c-43e3-8dae-d5168e2a29bb could not be found. Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29c92489-5a3c-43e3-8dae-d5168e2a29bb could not be found. Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:07:46.050021 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:46.053895 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:07:46.053895 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:07:46.053895 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:07:46.053895 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:07:46.053895 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:07:46.053895 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29c92489-5a3c-43e3-8dae-d5168e2a29bb could not be found. Sep 17 21:07:46.053895 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:07:46.059446 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-28070f36-1839-4970-9762-a85e664872fc tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Returning 404 to user: Instance 29c92489-5a3c-43e3-8dae-d5168e2a29bb could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:07:46.063047 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-28070f36-1839-4970-9762-a85e664872fc tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb" status: 404 len: 111 microversion: 2.1 time: 0.122528 Sep 17 21:07:46.075455 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2db21d7c-37d0-4e14-b78f-64aaa8626432 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] Calling method '.version_select at 0x7f25a411fb80>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:46.088162 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2012/4129] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:45 2022] GET /compute/v2.1/servers/29c92489-5a3c-43e3-8dae-d5168e2a29bb => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:07:46.098541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:46.140093 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2db21d7c-37d0-4e14-b78f-64aaa8626432 tempest-VolumesAdminNegativeTest-2142170983 tempest-VolumesAdminNegativeTest-2142170983-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1370528821" status: 202 len: 0 microversion: 2.1 time: 0.069691 Sep 17 21:07:46.145041 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2118/4130] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Sep 17 21:07:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1370528821 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:07:46.492969 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-311bc2e4-1421-4d9c-a7fe-80fa605e3ec3 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:46.493981 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-311bc2e4-1421-4d9c-a7fe-80fa605e3ec3 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:46.506574 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-311bc2e4-1421-4d9c-a7fe-80fa605e3ec3 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:46.508381 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-311bc2e4-1421-4d9c-a7fe-80fa605e3ec3 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:46.510845 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-311bc2e4-1421-4d9c-a7fe-80fa605e3ec3 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:46.513051 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-311bc2e4-1421-4d9c-a7fe-80fa605e3ec3 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:46.515306 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-311bc2e4-1421-4d9c-a7fe-80fa605e3ec3 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:46.516672 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-311bc2e4-1421-4d9c-a7fe-80fa605e3ec3 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:46.912715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8c77089a-4c88-4aa0-a42a-13a61cecd195 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:46.914030 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8c77089a-4c88-4aa0-a42a-13a61cecd195 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:46.935082 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c77089a-4c88-4aa0-a42a-13a61cecd195 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:46.940183 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c77089a-4c88-4aa0-a42a-13a61cecd195 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:46.942064 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c77089a-4c88-4aa0-a42a-13a61cecd195 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:46.944637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c77089a-4c88-4aa0-a42a-13a61cecd195 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:46.945268 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c77089a-4c88-4aa0-a42a-13a61cecd195 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:46.947452 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c77089a-4c88-4aa0-a42a-13a61cecd195 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:48.257977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-311bc2e4-1421-4d9c-a7fe-80fa605e3ec3 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:48.271455 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-311bc2e4-1421-4d9c-a7fe-80fa605e3ec3 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1506 microversion: 2.1 time: 1.783280 Sep 17 21:07:48.277316 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2013/4131] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:46 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1506 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:48.509309 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-eefa0aa0-bf09-44e0-9ced-0c171ee1d681 req-cc733dac-e3e9-43cd-8ca6-4836ab88cd25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2341e0c-be19-4ba1-a137-472f1ecc3915", "tag": "79728522-0106-4867-9b9d-f0a0cc2b1675"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:48.523303 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-eefa0aa0-bf09-44e0-9ced-0c171ee1d681 req-cc733dac-e3e9-43cd-8ca6-4836ab88cd25 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:48.526549 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-eefa0aa0-bf09-44e0-9ced-0c171ee1d681 req-cc733dac-e3e9-43cd-8ca6-4836ab88cd25 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:48.527203 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-eefa0aa0-bf09-44e0-9ced-0c171ee1d681 req-cc733dac-e3e9-43cd-8ca6-4836ab88cd25 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:48.557715 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-eefa0aa0-bf09-44e0-9ced-0c171ee1d681 req-cc733dac-e3e9-43cd-8ca6-4836ab88cd25 service nova] Creating event network-changed:79728522-0106-4867-9b9d-f0a0cc2b1675 for instance c2341e0c-be19-4ba1-a137-472f1ecc3915 on nch2-master-1 Sep 17 21:07:48.584931 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-eefa0aa0-bf09-44e0-9ced-0c171ee1d681 req-cc733dac-e3e9-43cd-8ca6-4836ab88cd25 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083113 Sep 17 21:07:48.589686 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2014/4132] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:07:48.892047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8c77089a-4c88-4aa0-a42a-13a61cecd195 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:48.917056 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8c77089a-4c88-4aa0-a42a-13a61cecd195 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc" status: 200 len: 1366 microversion: 2.1 time: 2.009187 Sep 17 21:07:48.918313 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2119/4133] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:46 2022] GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc => generated 1366 bytes in 2013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:49.295639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a5727a5d-3c1c-4657-9684-57e317e873d5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:49.302300 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a5727a5d-3c1c-4657-9684-57e317e873d5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:49.331116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a5727a5d-3c1c-4657-9684-57e317e873d5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:49.334437 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a5727a5d-3c1c-4657-9684-57e317e873d5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:49.335769 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a5727a5d-3c1c-4657-9684-57e317e873d5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:49.344012 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a5727a5d-3c1c-4657-9684-57e317e873d5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:49.354914 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a5727a5d-3c1c-4657-9684-57e317e873d5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:49.359028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a5727a5d-3c1c-4657-9684-57e317e873d5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:49.940961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-be46aea0-d724-4553-991c-fa8e12e1135f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:49.942114 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-be46aea0-d724-4553-991c-fa8e12e1135f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:49.949123 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be46aea0-d724-4553-991c-fa8e12e1135f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:49.949653 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be46aea0-d724-4553-991c-fa8e12e1135f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:49.950068 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be46aea0-d724-4553-991c-fa8e12e1135f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:49.962796 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be46aea0-d724-4553-991c-fa8e12e1135f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:49.967618 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be46aea0-d724-4553-991c-fa8e12e1135f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:49.968530 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be46aea0-d724-4553-991c-fa8e12e1135f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:50.098041 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a5727a5d-3c1c-4657-9684-57e317e873d5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:50.119757 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a5727a5d-3c1c-4657-9684-57e317e873d5 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1506 microversion: 2.1 time: 0.828596 Sep 17 21:07:50.126624 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2015/4134] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:49 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1506 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:50.545816 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-be46aea0-d724-4553-991c-fa8e12e1135f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:50.566096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:50.568541 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-be46aea0-d724-4553-991c-fa8e12e1135f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc" status: 200 len: 1556 microversion: 2.1 time: 0.632208 Sep 17 21:07:50.577531 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2120/4135] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:49 2022] GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc => generated 1556 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:50.599014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-302c5a94-b3d5-4fa4-8410-afb0f27feaa3 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:50.600835 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-302c5a94-b3d5-4fa4-8410-afb0f27feaa3 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:50.625897 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-302c5a94-b3d5-4fa4-8410-afb0f27feaa3 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:50.627171 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-302c5a94-b3d5-4fa4-8410-afb0f27feaa3 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:50.630586 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-302c5a94-b3d5-4fa4-8410-afb0f27feaa3 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:50.633970 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-302c5a94-b3d5-4fa4-8410-afb0f27feaa3 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:50.638770 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-302c5a94-b3d5-4fa4-8410-afb0f27feaa3 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:50.640933 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-302c5a94-b3d5-4fa4-8410-afb0f27feaa3 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:51.109661 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-302c5a94-b3d5-4fa4-8410-afb0f27feaa3 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.514496 Sep 17 21:07:51.110709 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2016/4136] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Sep 17 21:07:50 2022] GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc/os-interface => generated 284 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:07:51.151987 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4c4a1680-1495-4a99-b074-f84e7fe55f12 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:51.152586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4c4a1680-1495-4a99-b074-f84e7fe55f12 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:51.169986 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c4a1680-1495-4a99-b074-f84e7fe55f12 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:51.170508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c4a1680-1495-4a99-b074-f84e7fe55f12 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:51.170927 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c4a1680-1495-4a99-b074-f84e7fe55f12 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:51.171682 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c4a1680-1495-4a99-b074-f84e7fe55f12 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:51.172104 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c4a1680-1495-4a99-b074-f84e7fe55f12 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:51.172646 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c4a1680-1495-4a99-b074-f84e7fe55f12 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:51.677165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4c4a1680-1495-4a99-b074-f84e7fe55f12 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:51.689358 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4c4a1680-1495-4a99-b074-f84e7fe55f12 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1506 microversion: 2.1 time: 0.538988 Sep 17 21:07:51.690038 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2121/4137] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:51 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1506 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:52.714577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-38c6a0d1-33db-4c75-9dc9-b2a03ddfe62f tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:52.720601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-38c6a0d1-33db-4c75-9dc9-b2a03ddfe62f tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:52.749263 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-38c6a0d1-33db-4c75-9dc9-b2a03ddfe62f tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:52.750155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-38c6a0d1-33db-4c75-9dc9-b2a03ddfe62f tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:52.754247 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-38c6a0d1-33db-4c75-9dc9-b2a03ddfe62f tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:52.755634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-38c6a0d1-33db-4c75-9dc9-b2a03ddfe62f tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:52.756653 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-38c6a0d1-33db-4c75-9dc9-b2a03ddfe62f tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:52.763021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-38c6a0d1-33db-4c75-9dc9-b2a03ddfe62f tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:53.604674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-38c6a0d1-33db-4c75-9dc9-b2a03ddfe62f tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:53.613871 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-38c6a0d1-33db-4c75-9dc9-b2a03ddfe62f tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1506 microversion: 2.1 time: 0.904030 Sep 17 21:07:53.637328 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2017/4138] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:52 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1506 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:54.649972 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-78f6eb55-2de9-4ef3-b91d-4ec5e83ae5fe tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:54.651666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-78f6eb55-2de9-4ef3-b91d-4ec5e83ae5fe tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:54.668885 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-78f6eb55-2de9-4ef3-b91d-4ec5e83ae5fe tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:54.670890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-78f6eb55-2de9-4ef3-b91d-4ec5e83ae5fe tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:54.676612 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-78f6eb55-2de9-4ef3-b91d-4ec5e83ae5fe tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:54.678613 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-78f6eb55-2de9-4ef3-b91d-4ec5e83ae5fe tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:54.679276 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-78f6eb55-2de9-4ef3-b91d-4ec5e83ae5fe tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:54.680965 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-78f6eb55-2de9-4ef3-b91d-4ec5e83ae5fe tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:55.018711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-78f6eb55-2de9-4ef3-b91d-4ec5e83ae5fe tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:55.030867 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-78f6eb55-2de9-4ef3-b91d-4ec5e83ae5fe tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1506 microversion: 2.1 time: 0.390179 Sep 17 21:07:55.032366 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2122/4139] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:54 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1506 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:55.822633 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-cb353036-e6a7-4e45-a7bb-9c6dcef39911 req-c3e453d5-2c18-442b-aa5a-e3b62b560382 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc", "tag": "b60e28ec-86a4-47a2-baf7-ab19bebc01d8"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:07:55.849723 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-cb353036-e6a7-4e45-a7bb-9c6dcef39911 req-c3e453d5-2c18-442b-aa5a-e3b62b560382 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:55.850535 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-cb353036-e6a7-4e45-a7bb-9c6dcef39911 req-c3e453d5-2c18-442b-aa5a-e3b62b560382 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:55.851010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-cb353036-e6a7-4e45-a7bb-9c6dcef39911 req-c3e453d5-2c18-442b-aa5a-e3b62b560382 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:55.916995 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-cb353036-e6a7-4e45-a7bb-9c6dcef39911 req-c3e453d5-2c18-442b-aa5a-e3b62b560382 service nova] Creating event network-changed:b60e28ec-86a4-47a2-baf7-ab19bebc01d8 for instance 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc on nch1-master-1 Sep 17 21:07:55.940865 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-cb353036-e6a7-4e45-a7bb-9c6dcef39911 req-c3e453d5-2c18-442b-aa5a-e3b62b560382 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123972 Sep 17 21:07:55.965923 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2018/4140] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:07:56.057809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b804ca76-69c2-44ad-b309-608e1b38ebeb tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:56.059297 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b804ca76-69c2-44ad-b309-608e1b38ebeb tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:56.082962 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b804ca76-69c2-44ad-b309-608e1b38ebeb tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:56.083472 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b804ca76-69c2-44ad-b309-608e1b38ebeb tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:56.083929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b804ca76-69c2-44ad-b309-608e1b38ebeb tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:56.084661 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b804ca76-69c2-44ad-b309-608e1b38ebeb tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:56.085122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b804ca76-69c2-44ad-b309-608e1b38ebeb tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:56.085581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b804ca76-69c2-44ad-b309-608e1b38ebeb tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:58.124536 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b804ca76-69c2-44ad-b309-608e1b38ebeb tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:58.153812 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b804ca76-69c2-44ad-b309-608e1b38ebeb tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1506 microversion: 2.1 time: 2.101439 Sep 17 21:07:58.154471 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2123/4141] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:56 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1506 bytes in 2105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:07:59.182516 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cb24a675-ac7a-4dc1-9902-f38ee407b043 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:07:59.183836 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cb24a675-ac7a-4dc1-9902-f38ee407b043 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:07:59.199824 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=77 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:07:59.203729 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb24a675-ac7a-4dc1-9902-f38ee407b043 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:59.206127 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb24a675-ac7a-4dc1-9902-f38ee407b043 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:59.206923 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb24a675-ac7a-4dc1-9902-f38ee407b043 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:59.208993 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb24a675-ac7a-4dc1-9902-f38ee407b043 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:07:59.209710 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb24a675-ac7a-4dc1-9902-f38ee407b043 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:07:59.211689 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb24a675-ac7a-4dc1-9902-f38ee407b043 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:07:59.746409 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cb24a675-ac7a-4dc1-9902-f38ee407b043 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:07:59.759653 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cb24a675-ac7a-4dc1-9902-f38ee407b043 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1506 microversion: 2.1 time: 0.582139 Sep 17 21:07:59.760517 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2019/4142] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:07:59 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1506 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:00.785580 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-af586a11-62ca-47ea-8fdc-9a3fc0553676 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:00.786446 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-af586a11-62ca-47ea-8fdc-9a3fc0553676 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:00.818900 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af586a11-62ca-47ea-8fdc-9a3fc0553676 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:00.825541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af586a11-62ca-47ea-8fdc-9a3fc0553676 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:00.825981 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af586a11-62ca-47ea-8fdc-9a3fc0553676 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:00.826764 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af586a11-62ca-47ea-8fdc-9a3fc0553676 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:00.830069 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af586a11-62ca-47ea-8fdc-9a3fc0553676 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:00.830522 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af586a11-62ca-47ea-8fdc-9a3fc0553676 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:01.516350 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-af586a11-62ca-47ea-8fdc-9a3fc0553676 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:01.542712 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-af586a11-62ca-47ea-8fdc-9a3fc0553676 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1506 microversion: 2.1 time: 0.747140 Sep 17 21:08:01.545086 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2124/4143] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:00 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1506 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:02.568454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a63e0048-b9ba-4d9c-9763-5dd5b81e8356 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:02.578158 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a63e0048-b9ba-4d9c-9763-5dd5b81e8356 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:02.581596 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a63e0048-b9ba-4d9c-9763-5dd5b81e8356 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:02.582102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a63e0048-b9ba-4d9c-9763-5dd5b81e8356 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:02.582546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a63e0048-b9ba-4d9c-9763-5dd5b81e8356 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:02.583276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a63e0048-b9ba-4d9c-9763-5dd5b81e8356 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:02.583735 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a63e0048-b9ba-4d9c-9763-5dd5b81e8356 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:02.584168 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a63e0048-b9ba-4d9c-9763-5dd5b81e8356 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:03.123165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3d224eb3-d61a-49c7-9703-3436b65b7071 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:03.123795 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3d224eb3-d61a-49c7-9703-3436b65b7071 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:03.139655 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d224eb3-d61a-49c7-9703-3436b65b7071 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:03.140386 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d224eb3-d61a-49c7-9703-3436b65b7071 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:03.141084 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d224eb3-d61a-49c7-9703-3436b65b7071 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:03.142693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d224eb3-d61a-49c7-9703-3436b65b7071 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:03.146841 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d224eb3-d61a-49c7-9703-3436b65b7071 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:03.148076 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d224eb3-d61a-49c7-9703-3436b65b7071 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:03.360857 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a63e0048-b9ba-4d9c-9763-5dd5b81e8356 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:03.373389 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a63e0048-b9ba-4d9c-9763-5dd5b81e8356 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1506 microversion: 2.1 time: 0.808767 Sep 17 21:08:03.374350 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2020/4144] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:02 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1506 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:04.349691 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3d224eb3-d61a-49c7-9703-3436b65b7071 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:04.363131 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3d224eb3-d61a-49c7-9703-3436b65b7071 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 1.239497 Sep 17 21:08:04.366879 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2125/4145] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:03 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:04.387693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8ac969c3-6437-4a56-977d-12e61ffe3f18 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:04.388322 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8ac969c3-6437-4a56-977d-12e61ffe3f18 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:04.402237 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-84e41d53-d10e-4c5f-8ca3-b0814db07ef9 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:04.403142 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-84e41d53-d10e-4c5f-8ca3-b0814db07ef9 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:04.419832 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ac969c3-6437-4a56-977d-12e61ffe3f18 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:04.423197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ac969c3-6437-4a56-977d-12e61ffe3f18 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:04.425626 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84e41d53-d10e-4c5f-8ca3-b0814db07ef9 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:04.427739 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ac969c3-6437-4a56-977d-12e61ffe3f18 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:04.429297 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ac969c3-6437-4a56-977d-12e61ffe3f18 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:04.431838 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ac969c3-6437-4a56-977d-12e61ffe3f18 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:04.432364 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ac969c3-6437-4a56-977d-12e61ffe3f18 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:04.437008 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84e41d53-d10e-4c5f-8ca3-b0814db07ef9 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:04.437497 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84e41d53-d10e-4c5f-8ca3-b0814db07ef9 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:04.438332 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84e41d53-d10e-4c5f-8ca3-b0814db07ef9 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:04.438905 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84e41d53-d10e-4c5f-8ca3-b0814db07ef9 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:04.439222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84e41d53-d10e-4c5f-8ca3-b0814db07ef9 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:05.001260 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-84e41d53-d10e-4c5f-8ca3-b0814db07ef9 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:05.014357 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-84e41d53-d10e-4c5f-8ca3-b0814db07ef9 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1506 microversion: 2.1 time: 0.617273 Sep 17 21:08:05.015921 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2126/4146] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:04 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1506 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:05.092802 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8ac969c3-6437-4a56-977d-12e61ffe3f18 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:05.108716 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8ac969c3-6437-4a56-977d-12e61ffe3f18 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.720224 Sep 17 21:08:05.110035 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2021/4147] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:04 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:05.142254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-da8a5568-a7b4-4ea4-ab58-2349146b8d16 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:05.142887 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-da8a5568-a7b4-4ea4-ab58-2349146b8d16 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:05.168024 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-da8a5568-a7b4-4ea4-ab58-2349146b8d16 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:05.168548 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-da8a5568-a7b4-4ea4-ab58-2349146b8d16 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:05.168997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-da8a5568-a7b4-4ea4-ab58-2349146b8d16 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:05.169763 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-da8a5568-a7b4-4ea4-ab58-2349146b8d16 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:05.179022 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-da8a5568-a7b4-4ea4-ab58-2349146b8d16 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:05.179486 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-da8a5568-a7b4-4ea4-ab58-2349146b8d16 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:05.871419 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-da8a5568-a7b4-4ea4-ab58-2349146b8d16 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:05.913359 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-da8a5568-a7b4-4ea4-ab58-2349146b8d16 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.780123 Sep 17 21:08:05.943455 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2127/4148] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:05 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:05.972547 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-29be20a9-bd11-436b-ba3b-06772425312b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:05.974422 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-29be20a9-bd11-436b-ba3b-06772425312b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:05.989911 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-29be20a9-bd11-436b-ba3b-06772425312b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:05.991207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-29be20a9-bd11-436b-ba3b-06772425312b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:05.991859 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-29be20a9-bd11-436b-ba3b-06772425312b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:05.992798 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-29be20a9-bd11-436b-ba3b-06772425312b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:05.993705 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-29be20a9-bd11-436b-ba3b-06772425312b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:05.994340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-29be20a9-bd11-436b-ba3b-06772425312b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:06.041815 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-055b075c-75e6-4826-8afd-15195b81f8b9 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:06.043165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-055b075c-75e6-4826-8afd-15195b81f8b9 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:06.054722 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-055b075c-75e6-4826-8afd-15195b81f8b9 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:06.055486 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-055b075c-75e6-4826-8afd-15195b81f8b9 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:06.056136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-055b075c-75e6-4826-8afd-15195b81f8b9 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:06.057253 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-055b075c-75e6-4826-8afd-15195b81f8b9 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:06.058062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-055b075c-75e6-4826-8afd-15195b81f8b9 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:06.058937 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-055b075c-75e6-4826-8afd-15195b81f8b9 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:06.556232 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-29be20a9-bd11-436b-ba3b-06772425312b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:06.571934 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-29be20a9-bd11-436b-ba3b-06772425312b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.616827 Sep 17 21:08:06.573570 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2022/4149] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:05 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:06.638041 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-055b075c-75e6-4826-8afd-15195b81f8b9 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:06.660179 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-055b075c-75e6-4826-8afd-15195b81f8b9 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1486 microversion: 2.1 time: 0.615544 Sep 17 21:08:06.661344 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2128/4150] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:06 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1486 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:08:06.691275 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9d4ae864-74ad-4d64-9bd7-0ec663503246 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:06.691820 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9d4ae864-74ad-4d64-9bd7-0ec663503246 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:06.700642 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d4ae864-74ad-4d64-9bd7-0ec663503246 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:06.701202 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d4ae864-74ad-4d64-9bd7-0ec663503246 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:06.701762 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d4ae864-74ad-4d64-9bd7-0ec663503246 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:06.702531 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d4ae864-74ad-4d64-9bd7-0ec663503246 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:06.703050 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d4ae864-74ad-4d64-9bd7-0ec663503246 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:06.703548 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d4ae864-74ad-4d64-9bd7-0ec663503246 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:06.794467 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e1bdad48-06cc-4ee2-9f69-48f3b7d874df tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1136717067", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "fd58f898-7287-41a8-bd5b-faf66186e8ef"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:06.957515 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9d4ae864-74ad-4d64-9bd7-0ec663503246 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "POST /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc/action" status: 202 len: 0 microversion: 2.1 time: 0.270511 Sep 17 21:08:06.959658 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2023/4151] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:08:06 2022] POST /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:08:06.984742 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d2302fd7-def1-47af-a296-43abbd6b96eb tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:06.986197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d2302fd7-def1-47af-a296-43abbd6b96eb tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:07.034951 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2302fd7-def1-47af-a296-43abbd6b96eb tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:07.045925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-e1bdad48-06cc-4ee2-9f69-48f3b7d874df tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] validate_networks() for [('fd58f898-7287-41a8-bd5b-faf66186e8ef', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:08:07.051765 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2302fd7-def1-47af-a296-43abbd6b96eb tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:07.051944 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2302fd7-def1-47af-a296-43abbd6b96eb tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:07.058016 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2302fd7-def1-47af-a296-43abbd6b96eb tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:07.058513 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2302fd7-def1-47af-a296-43abbd6b96eb tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:07.061765 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2302fd7-def1-47af-a296-43abbd6b96eb tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:08.020370 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d2302fd7-def1-47af-a296-43abbd6b96eb tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:08.056770 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d2302fd7-def1-47af-a296-43abbd6b96eb tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1494 microversion: 2.1 time: 1.089873 Sep 17 21:08:08.061610 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2024/4152] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:06 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1494 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:09.086675 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c00ee07e-9e71-4487-ba0e-81fd8db03bac tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:09.088380 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c00ee07e-9e71-4487-ba0e-81fd8db03bac tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:09.099010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c00ee07e-9e71-4487-ba0e-81fd8db03bac tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:09.100615 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c00ee07e-9e71-4487-ba0e-81fd8db03bac tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:09.102946 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c00ee07e-9e71-4487-ba0e-81fd8db03bac tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:09.108512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c00ee07e-9e71-4487-ba0e-81fd8db03bac tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:09.109251 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c00ee07e-9e71-4487-ba0e-81fd8db03bac tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:09.112560 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c00ee07e-9e71-4487-ba0e-81fd8db03bac tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:09.137209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:08:09.196460 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-e1bdad48-06cc-4ee2-9f69-48f3b7d874df tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:08:09.197297 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-e1bdad48-06cc-4ee2-9f69-48f3b7d874df tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:08:09.197817 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-e1bdad48-06cc-4ee2-9f69-48f3b7d874df tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:08:09.198233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-e1bdad48-06cc-4ee2-9f69-48f3b7d874df tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:08:09.200183 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-e1bdad48-06cc-4ee2-9f69-48f3b7d874df tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:08:09.230655 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1bdad48-06cc-4ee2-9f69-48f3b7d874df tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:09.231176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1bdad48-06cc-4ee2-9f69-48f3b7d874df tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:09.235668 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1bdad48-06cc-4ee2-9f69-48f3b7d874df tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:09.237792 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1bdad48-06cc-4ee2-9f69-48f3b7d874df tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:09.241068 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1bdad48-06cc-4ee2-9f69-48f3b7d874df tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:09.241556 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1bdad48-06cc-4ee2-9f69-48f3b7d874df tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:09.333988 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-e1bdad48-06cc-4ee2-9f69-48f3b7d874df tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Getting quotas for project 3e48e3c2f7f74636a75679fdf10ef33a. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:08:09.349097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-e1bdad48-06cc-4ee2-9f69-48f3b7d874df tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Getting quotas for user 2ef547e071fd43ec96c745c26eca119f and project 3e48e3c2f7f74636a75679fdf10ef33a. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:08:09.384327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e1bdad48-06cc-4ee2-9f69-48f3b7d874df tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:08:09.395409 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e1bdad48-06cc-4ee2-9f69-48f3b7d874df tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 3e57dbfe-799f-429f-8cef-96dec36bb3e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:08:09.496870 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e1bdad48-06cc-4ee2-9f69-48f3b7d874df tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.707367 Sep 17 21:08:09.498025 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2129/4153] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:08:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 17 21:08:09.529085 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-77e019ba-432b-4965-a26a-fba67bded51c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:09.529085 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-77e019ba-432b-4965-a26a-fba67bded51c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 3e57dbfe-799f-429f-8cef-96dec36bb3e1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:09.678544 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-77e019ba-432b-4965-a26a-fba67bded51c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:09.697428 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-77e019ba-432b-4965-a26a-fba67bded51c tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1" status: 200 len: 1215 microversion: 2.1 time: 0.185929 Sep 17 21:08:09.698653 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2130/4154] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:09 2022] GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1 => generated 1215 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:09.707098 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c00ee07e-9e71-4487-ba0e-81fd8db03bac tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:09.726507 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c00ee07e-9e71-4487-ba0e-81fd8db03bac tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1494 microversion: 2.1 time: 0.643589 Sep 17 21:08:09.755858 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2025/4155] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:09 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1494 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:10.725449 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-55be287a-5f82-4b94-9d59-f87203fb7670 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:10.726236 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-55be287a-5f82-4b94-9d59-f87203fb7670 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 3e57dbfe-799f-429f-8cef-96dec36bb3e1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:10.754244 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c65b3c91-5614-4c6d-942b-8c0a5801020d tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:10.754778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55be287a-5f82-4b94-9d59-f87203fb7670 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:10.755453 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c65b3c91-5614-4c6d-942b-8c0a5801020d tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:10.756430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55be287a-5f82-4b94-9d59-f87203fb7670 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:10.757130 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55be287a-5f82-4b94-9d59-f87203fb7670 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:10.758127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55be287a-5f82-4b94-9d59-f87203fb7670 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:10.758994 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55be287a-5f82-4b94-9d59-f87203fb7670 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:10.771684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c65b3c91-5614-4c6d-942b-8c0a5801020d tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:10.772736 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55be287a-5f82-4b94-9d59-f87203fb7670 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:10.774070 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c65b3c91-5614-4c6d-942b-8c0a5801020d tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:10.776781 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c65b3c91-5614-4c6d-942b-8c0a5801020d tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:10.778883 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c65b3c91-5614-4c6d-942b-8c0a5801020d tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:10.779422 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c65b3c91-5614-4c6d-942b-8c0a5801020d tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:10.779818 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c65b3c91-5614-4c6d-942b-8c0a5801020d tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:11.850356 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-55be287a-5f82-4b94-9d59-f87203fb7670 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:11.858556 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-55be287a-5f82-4b94-9d59-f87203fb7670 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1" status: 200 len: 1219 microversion: 2.1 time: 1.139530 Sep 17 21:08:11.872495 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2131/4156] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:10 2022] GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1 => generated 1219 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:11.975066 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c65b3c91-5614-4c6d-942b-8c0a5801020d tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:11.989924 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c65b3c91-5614-4c6d-942b-8c0a5801020d tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1494 microversion: 2.1 time: 1.241097 Sep 17 21:08:11.992549 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2026/4157] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:10 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1494 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:12.889637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ad7bb952-b9dc-4cdf-9373-626889441ac2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:12.891547 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ad7bb952-b9dc-4cdf-9373-626889441ac2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 3e57dbfe-799f-429f-8cef-96dec36bb3e1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:12.918663 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad7bb952-b9dc-4cdf-9373-626889441ac2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:12.922180 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad7bb952-b9dc-4cdf-9373-626889441ac2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:12.925403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad7bb952-b9dc-4cdf-9373-626889441ac2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:12.927195 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad7bb952-b9dc-4cdf-9373-626889441ac2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:12.929024 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad7bb952-b9dc-4cdf-9373-626889441ac2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:12.929702 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad7bb952-b9dc-4cdf-9373-626889441ac2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:13.021967 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b561929d-31b9-48ed-9e9e-2939a6960ca2 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:13.023575 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b561929d-31b9-48ed-9e9e-2939a6960ca2 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:13.041347 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b561929d-31b9-48ed-9e9e-2939a6960ca2 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:13.042309 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b561929d-31b9-48ed-9e9e-2939a6960ca2 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:13.042920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b561929d-31b9-48ed-9e9e-2939a6960ca2 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:13.046644 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b561929d-31b9-48ed-9e9e-2939a6960ca2 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:13.047428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b561929d-31b9-48ed-9e9e-2939a6960ca2 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:13.048017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b561929d-31b9-48ed-9e9e-2939a6960ca2 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:13.147389 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ad7bb952-b9dc-4cdf-9373-626889441ac2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:13.160577 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ad7bb952-b9dc-4cdf-9373-626889441ac2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1" status: 200 len: 1273 microversion: 2.1 time: 0.276386 Sep 17 21:08:13.162691 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2132/4158] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:12 2022] GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1 => generated 1273 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:13.455172 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b561929d-31b9-48ed-9e9e-2939a6960ca2 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:13.492428 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b561929d-31b9-48ed-9e9e-2939a6960ca2 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1500 microversion: 2.1 time: 0.470497 Sep 17 21:08:13.496431 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2027/4159] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:13 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1500 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:08:13.527852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9efa1db9-b6d5-4a92-b89b-601c974190fd tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:13.528356 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9efa1db9-b6d5-4a92-b89b-601c974190fd tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:13.551676 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9efa1db9-b6d5-4a92-b89b-601c974190fd tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:13.559907 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9efa1db9-b6d5-4a92-b89b-601c974190fd tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:13.560618 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9efa1db9-b6d5-4a92-b89b-601c974190fd tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:13.561392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9efa1db9-b6d5-4a92-b89b-601c974190fd tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:13.561896 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9efa1db9-b6d5-4a92-b89b-601c974190fd tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:13.563197 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9efa1db9-b6d5-4a92-b89b-601c974190fd tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:13.670467 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9efa1db9-b6d5-4a92-b89b-601c974190fd tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:08:13.989957 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9efa1db9-b6d5-4a92-b89b-601c974190fd tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 204 len: 0 microversion: 2.1 time: 0.463799 Sep 17 21:08:13.992959 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2133/4160] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:08:13 2022] DELETE /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:08:14.001221 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5456a5df-c0e6-46df-9f97-9625dedcb2d2 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:14.001853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5456a5df-c0e6-46df-9f97-9625dedcb2d2 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:14.015418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5456a5df-c0e6-46df-9f97-9625dedcb2d2 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:14.020889 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5456a5df-c0e6-46df-9f97-9625dedcb2d2 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:14.021349 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5456a5df-c0e6-46df-9f97-9625dedcb2d2 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:14.024601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5456a5df-c0e6-46df-9f97-9625dedcb2d2 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:14.025219 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5456a5df-c0e6-46df-9f97-9625dedcb2d2 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:14.025542 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5456a5df-c0e6-46df-9f97-9625dedcb2d2 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:14.188978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-83e7a859-610a-4939-a166-88aab734bd15 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:14.189726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-83e7a859-610a-4939-a166-88aab734bd15 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 3e57dbfe-799f-429f-8cef-96dec36bb3e1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:14.212682 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-83e7a859-610a-4939-a166-88aab734bd15 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:14.213223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-83e7a859-610a-4939-a166-88aab734bd15 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:14.213713 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-83e7a859-610a-4939-a166-88aab734bd15 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:14.221761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-83e7a859-610a-4939-a166-88aab734bd15 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:14.225637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-83e7a859-610a-4939-a166-88aab734bd15 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:14.231577 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-83e7a859-610a-4939-a166-88aab734bd15 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:14.837194 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-83e7a859-610a-4939-a166-88aab734bd15 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:14.854423 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-83e7a859-610a-4939-a166-88aab734bd15 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1" status: 200 len: 1315 microversion: 2.1 time: 0.670148 Sep 17 21:08:14.861818 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2134/4161] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:14 2022] GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1 => generated 1315 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:14.939380 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5456a5df-c0e6-46df-9f97-9625dedcb2d2 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:14.955307 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5456a5df-c0e6-46df-9f97-9625dedcb2d2 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1506 microversion: 2.1 time: 0.954678 Sep 17 21:08:14.976964 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2028/4162] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:13 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1506 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:15.880876 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b997bd08-f8d1-404e-91e3-8729dbdb3ba3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:15.882484 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b997bd08-f8d1-404e-91e3-8729dbdb3ba3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 3e57dbfe-799f-429f-8cef-96dec36bb3e1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:15.913843 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b997bd08-f8d1-404e-91e3-8729dbdb3ba3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:15.914352 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b997bd08-f8d1-404e-91e3-8729dbdb3ba3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:15.914816 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b997bd08-f8d1-404e-91e3-8729dbdb3ba3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:15.915531 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b997bd08-f8d1-404e-91e3-8729dbdb3ba3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:15.923660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b997bd08-f8d1-404e-91e3-8729dbdb3ba3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:15.926910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b997bd08-f8d1-404e-91e3-8729dbdb3ba3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:15.984259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-49aeccd4-8fd3-46a3-a3f8-19e03b10d0e7 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:15.985106 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-49aeccd4-8fd3-46a3-a3f8-19e03b10d0e7 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:15.996193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49aeccd4-8fd3-46a3-a3f8-19e03b10d0e7 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:15.999889 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49aeccd4-8fd3-46a3-a3f8-19e03b10d0e7 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:16.000663 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49aeccd4-8fd3-46a3-a3f8-19e03b10d0e7 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:16.004370 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49aeccd4-8fd3-46a3-a3f8-19e03b10d0e7 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:16.010163 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49aeccd4-8fd3-46a3-a3f8-19e03b10d0e7 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:16.011041 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49aeccd4-8fd3-46a3-a3f8-19e03b10d0e7 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:16.502138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b997bd08-f8d1-404e-91e3-8729dbdb3ba3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:16.520399 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b997bd08-f8d1-404e-91e3-8729dbdb3ba3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1" status: 200 len: 1315 microversion: 2.1 time: 0.643149 Sep 17 21:08:16.523411 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2135/4163] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:15 2022] GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1 => generated 1315 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:16.588356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-49aeccd4-8fd3-46a3-a3f8-19e03b10d0e7 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:16.601201 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-49aeccd4-8fd3-46a3-a3f8-19e03b10d0e7 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1506 microversion: 2.1 time: 0.620790 Sep 17 21:08:16.609068 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2029/4164] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:15 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1506 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:08:16.677913 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-e9e0e067-acee-40df-ab88-e0018c2730f0 req-14d690b6-bb4e-4c32-bc3d-6244240fb5b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e57dbfe-799f-429f-8cef-96dec36bb3e1", "tag": "0b4fb6b7-6a3b-4673-959e-b0233c88dadf"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:16.692841 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:08:16.727384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e9e0e067-acee-40df-ab88-e0018c2730f0 req-14d690b6-bb4e-4c32-bc3d-6244240fb5b8 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:16.735809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e9e0e067-acee-40df-ab88-e0018c2730f0 req-14d690b6-bb4e-4c32-bc3d-6244240fb5b8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:16.736454 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e9e0e067-acee-40df-ab88-e0018c2730f0 req-14d690b6-bb4e-4c32-bc3d-6244240fb5b8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:16.779977 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-e9e0e067-acee-40df-ab88-e0018c2730f0 req-14d690b6-bb4e-4c32-bc3d-6244240fb5b8 service nova] Creating event network-changed:0b4fb6b7-6a3b-4673-959e-b0233c88dadf for instance 3e57dbfe-799f-429f-8cef-96dec36bb3e1 on nch1-master-1 Sep 17 21:08:16.786222 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-e9e0e067-acee-40df-ab88-e0018c2730f0 req-14d690b6-bb4e-4c32-bc3d-6244240fb5b8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112710 Sep 17 21:08:16.787333 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2136/4165] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:17.562698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c4d89e7b-e8f5-457f-b9c2-8ff0c8270cc8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:17.563471 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c4d89e7b-e8f5-457f-b9c2-8ff0c8270cc8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 3e57dbfe-799f-429f-8cef-96dec36bb3e1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:17.586841 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c4d89e7b-e8f5-457f-b9c2-8ff0c8270cc8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:17.601640 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c4d89e7b-e8f5-457f-b9c2-8ff0c8270cc8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:17.602549 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c4d89e7b-e8f5-457f-b9c2-8ff0c8270cc8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:17.603780 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c4d89e7b-e8f5-457f-b9c2-8ff0c8270cc8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:17.604693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c4d89e7b-e8f5-457f-b9c2-8ff0c8270cc8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:17.605885 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c4d89e7b-e8f5-457f-b9c2-8ff0c8270cc8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:17.639327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e3b3fc6b-08a4-4288-842a-187375929cec tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:17.640330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e3b3fc6b-08a4-4288-842a-187375929cec tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:17.663285 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e3b3fc6b-08a4-4288-842a-187375929cec tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:17.663782 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e3b3fc6b-08a4-4288-842a-187375929cec tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:17.674592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e3b3fc6b-08a4-4288-842a-187375929cec tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:17.675367 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e3b3fc6b-08a4-4288-842a-187375929cec tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:17.675844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e3b3fc6b-08a4-4288-842a-187375929cec tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:17.676286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e3b3fc6b-08a4-4288-842a-187375929cec tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:18.832246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e3b3fc6b-08a4-4288-842a-187375929cec tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:18.843256 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e3b3fc6b-08a4-4288-842a-187375929cec tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1464 microversion: 2.1 time: 1.210290 Sep 17 21:08:18.848051 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2137/4166] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:17 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1464 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:19.193242 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ba9e244b-5fc3-41bd-833b-1405d3ebdcce tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:19.216674 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ba9e244b-5fc3-41bd-833b-1405d3ebdcce tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.365193 Sep 17 21:08:19.229890 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2138/4167] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Sep 17 21:08:18 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:19.235336 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b08b083e-3f23-4aa7-8890-e4f4399e7822 tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:19.290624 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b08b083e-3f23-4aa7-8890-e4f4399e7822 tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] 10.222.0.26 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.059186 Sep 17 21:08:19.308284 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2139/4168] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Sep 17 21:08:19 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:19.314110 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-be3d18c2-9d45-44e4-93d6-8770f72dc94c tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:19.330302 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-be3d18c2-9d45-44e4-93d6-8770f72dc94c tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020309 Sep 17 21:08:19.351088 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2140/4169] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Sep 17 21:08:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:19.353833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:08:19.358979 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-88a8c313-604f-4a04-9b64-2d47e099d94f tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:19.383657 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-88a8c313-604f-4a04-9b64-2d47e099d94f tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030990 Sep 17 21:08:19.392003 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2141/4170] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Sep 17 21:08:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:19.402010 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-47d2f079-560a-4512-8e54-13f50c5a685a tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:19.488772 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-47d2f079-560a-4512-8e54-13f50c5a685a tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.095196 Sep 17 21:08:19.489417 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2142/4171] 10.222.0.26 () {58 vars in 1165 bytes} [Sat Sep 17 21:08:19 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:19.530458 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1723a31d-e44b-4779-9307-71e1fa9f7dab tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:19.561201 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1723a31d-e44b-4779-9307-71e1fa9f7dab tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034793 Sep 17 21:08:19.574930 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2143/4172] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Sep 17 21:08:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:19.597940 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-fae208a8-c78c-4e24-ba60-bf178e7b0e87 req-7f435da9-bd8e-4d17-bb79-d731b90f38c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aaab678-c37b-490b-85bd-30f9dd9602cc", "name": "network-vif-deleted", "tag": "8b1d1005-424b-485f-9d7a-9bfca4b2f098"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:19.655176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-fae208a8-c78c-4e24-ba60-bf178e7b0e87 req-7f435da9-bd8e-4d17-bb79-d731b90f38c1 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:19.655298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-fae208a8-c78c-4e24-ba60-bf178e7b0e87 req-7f435da9-bd8e-4d17-bb79-d731b90f38c1 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:19.655785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-fae208a8-c78c-4e24-ba60-bf178e7b0e87 req-7f435da9-bd8e-4d17-bb79-d731b90f38c1 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:19.661592 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c4d89e7b-e8f5-457f-b9c2-8ff0c8270cc8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:19.676160 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:08:19.678241 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c4d89e7b-e8f5-457f-b9c2-8ff0c8270cc8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1" status: 200 len: 1315 microversion: 2.1 time: 2.127478 Sep 17 21:08:19.680005 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2030/4173] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:17 2022] GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1 => generated 1315 bytes in 2135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:19.688392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=8 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:08:19.698898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-451f0ba0-53ba-4489-8c69-daeafd1d75a7 tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:19.712572 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-fae208a8-c78c-4e24-ba60-bf178e7b0e87 req-7f435da9-bd8e-4d17-bb79-d731b90f38c1 service nova] Creating event network-vif-deleted:8b1d1005-424b-485f-9d7a-9bfca4b2f098 for instance 4aaab678-c37b-490b-85bd-30f9dd9602cc on nch2-master-1 Sep 17 21:08:19.729313 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-fae208a8-c78c-4e24-ba60-bf178e7b0e87 req-7f435da9-bd8e-4d17-bb79-d731b90f38c1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152659 Sep 17 21:08:19.732278 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2144/4174] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:19.873593 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-451f0ba0-53ba-4489-8c69-daeafd1d75a7 tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.184183 Sep 17 21:08:19.876783 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2031/4175] 10.222.0.26 () {58 vars in 1169 bytes} [Sat Sep 17 21:08:19 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:19.881593 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f48df823-5ab8-46bd-a924-8dd34104a2be tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:19.883029 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f48df823-5ab8-46bd-a924-8dd34104a2be tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:19.895997 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-743ac3db-433d-48f6-acfb-0c5c1817100f tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:19.903703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f48df823-5ab8-46bd-a924-8dd34104a2be tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:19.904225 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f48df823-5ab8-46bd-a924-8dd34104a2be tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:19.904665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f48df823-5ab8-46bd-a924-8dd34104a2be tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:19.922873 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f48df823-5ab8-46bd-a924-8dd34104a2be tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:19.930279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f48df823-5ab8-46bd-a924-8dd34104a2be tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:19.930750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f48df823-5ab8-46bd-a924-8dd34104a2be tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:19.944895 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-743ac3db-433d-48f6-acfb-0c5c1817100f tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.057491 Sep 17 21:08:19.959261 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2032/4176] 10.222.0.26 () {58 vars in 1161 bytes} [Sat Sep 17 21:08:19 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:19.972354 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3823c2ac-81a8-4861-bbb1-c1ea8f60f32b tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:19.993723 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3823c2ac-81a8-4861-bbb1-c1ea8f60f32b tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030972 Sep 17 21:08:19.994356 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2033/4177] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Sep 17 21:08:19 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:20.015766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b003a8da-36dc-4425-bdfc-9acf41c3b48d tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:20.085124 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f48df823-5ab8-46bd-a924-8dd34104a2be tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:20.098808 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f48df823-5ab8-46bd-a924-8dd34104a2be tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:20.099694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f48df823-5ab8-46bd-a924-8dd34104a2be tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:20.101513 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-f48df823-5ab8-46bd-a924-8dd34104a2be tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lazy-loading 'fault' on Instance uuid 4aaab678-c37b-490b-85bd-30f9dd9602cc {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:08:20.103651 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b003a8da-36dc-4425-bdfc-9acf41c3b48d tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.099486 Sep 17 21:08:20.104649 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2034/4178] 10.222.0.26 () {58 vars in 1167 bytes} [Sat Sep 17 21:08:20 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:20.122639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cc451ea4-9de8-40cf-861f-454c4c9d5e06 tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:20.133173 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cc451ea4-9de8-40cf-861f-454c4c9d5e06 tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015038 Sep 17 21:08:20.141556 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2035/4179] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Sep 17 21:08:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:20.146784 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2e370c20-1086-4ea5-9b58-b54e2d90838a tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:20.176943 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2e370c20-1086-4ea5-9b58-b54e2d90838a tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] 10.222.0.26 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.033817 Sep 17 21:08:20.187798 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2036/4180] 10.222.0.26 () {58 vars in 1144 bytes} [Sat Sep 17 21:08:20 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:20.205730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0d61dc83-130e-4f84-8ea4-485f67da148a tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:20.222537 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0d61dc83-130e-4f84-8ea4-485f67da148a tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032053 Sep 17 21:08:20.227296 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2037/4181] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Sep 17 21:08:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:20.240722 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-94ea5342-8c7e-46c5-aa0a-3e40693c1070 tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:20.261806 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-94ea5342-8c7e-46c5-aa0a-3e40693c1070 tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] 10.222.0.26 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.028975 Sep 17 21:08:20.263106 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2038/4182] 10.222.0.26 () {58 vars in 1148 bytes} [Sat Sep 17 21:08:20 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:20.289450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1f908957-76e8-4976-8f73-15e90fe71d8d tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:20.313327 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1f908957-76e8-4976-8f73-15e90fe71d8d tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] 10.222.0.26 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.024800 Sep 17 21:08:20.317559 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2039/4183] 10.222.0.26 () {58 vars in 1140 bytes} [Sat Sep 17 21:08:20 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:20.336022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-72093af0-119c-4d20-b0cc-a206256bd8f4 tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:20.347976 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-72093af0-119c-4d20-b0cc-a206256bd8f4 tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021043 Sep 17 21:08:20.356954 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2040/4184] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Sep 17 21:08:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:20.362904 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-50fed36c-9635-4a5d-823e-77030979fcc1 tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:20.392243 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-50fed36c-9635-4a5d-823e-77030979fcc1 tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] 10.222.0.26 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.033624 Sep 17 21:08:20.403267 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2041/4185] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 21:08:20 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:20.408978 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0796c807-d3da-490e-a4ed-7cc477b871e2 tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:20.441795 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0796c807-d3da-490e-a4ed-7cc477b871e2 tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036677 Sep 17 21:08:20.454165 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2042/4186] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 21:08:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:20.462567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-544f26b1-38ed-4855-8368-9219c9e46b4b tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:20.471756 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-544f26b1-38ed-4855-8368-9219c9e46b4b tempest-FlavorsV2TestJSON-2122718823 tempest-FlavorsV2TestJSON-2122718823-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013320 Sep 17 21:08:20.481013 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2043/4187] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Sep 17 21:08:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:20.709360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c46cdaaa-68a0-498d-a5bb-240452af76af tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:20.710256 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c46cdaaa-68a0-498d-a5bb-240452af76af tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 3e57dbfe-799f-429f-8cef-96dec36bb3e1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:20.732069 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c46cdaaa-68a0-498d-a5bb-240452af76af tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:20.736827 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c46cdaaa-68a0-498d-a5bb-240452af76af tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:20.737517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c46cdaaa-68a0-498d-a5bb-240452af76af tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:20.742146 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c46cdaaa-68a0-498d-a5bb-240452af76af tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:20.747932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c46cdaaa-68a0-498d-a5bb-240452af76af tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:20.751148 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c46cdaaa-68a0-498d-a5bb-240452af76af tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:20.839453 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f48df823-5ab8-46bd-a924-8dd34104a2be tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:20.857118 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f48df823-5ab8-46bd-a924-8dd34104a2be tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 200 len: 1304 microversion: 2.1 time: 0.983235 Sep 17 21:08:20.861650 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2145/4188] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:19 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 1304 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:21.205248 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c46cdaaa-68a0-498d-a5bb-240452af76af tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:21.223442 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c46cdaaa-68a0-498d-a5bb-240452af76af tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1" status: 200 len: 1315 microversion: 2.1 time: 0.518265 Sep 17 21:08:21.237504 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2044/4189] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:20 2022] GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1 => generated 1315 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:21.350857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-905303f8-0f3a-47d5-b62d-5eee02443d13 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ba7aae4-11cf-4bae-825a-6ea9f7b052fa"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:21.354303 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-905303f8-0f3a-47d5-b62d-5eee02443d13 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:21.381165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-905303f8-0f3a-47d5-b62d-5eee02443d13 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:21.386935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-905303f8-0f3a-47d5-b62d-5eee02443d13 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:21.390250 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-905303f8-0f3a-47d5-b62d-5eee02443d13 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:21.395825 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-905303f8-0f3a-47d5-b62d-5eee02443d13 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:21.397390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-905303f8-0f3a-47d5-b62d-5eee02443d13 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:21.400697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-905303f8-0f3a-47d5-b62d-5eee02443d13 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:21.887610 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-024af894-9aca-47ac-a58a-140d5fcd8e56 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:21.895285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-024af894-9aca-47ac-a58a-140d5fcd8e56 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 4aaab678-c37b-490b-85bd-30f9dd9602cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:21.916593 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-024af894-9aca-47ac-a58a-140d5fcd8e56 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:21.923845 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-024af894-9aca-47ac-a58a-140d5fcd8e56 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:21.924537 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-024af894-9aca-47ac-a58a-140d5fcd8e56 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:21.928768 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-024af894-9aca-47ac-a58a-140d5fcd8e56 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:21.929447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-024af894-9aca-47ac-a58a-140d5fcd8e56 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:21.934159 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-024af894-9aca-47ac-a58a-140d5fcd8e56 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:21.966824 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-024af894-9aca-47ac-a58a-140d5fcd8e56 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] HTTP exception thrown: Instance 4aaab678-c37b-490b-85bd-30f9dd9602cc could not be found. Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-024af894-9aca-47ac-a58a-140d5fcd8e56 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Request method failure captured: Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc HTTP/1.1 Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjbKMYqyiGhc_x6frp2KS4QmwIuIfhMNWCMqQL_dHzH6uwVTAgX5R3TEwWjtlVPCY5Fnkkfk7srp6ig1b3b9yhR5C5WsPrXtRFEdU7OIWO5-CvfdEY5b3vXsk76jedeKaHKMNEuy_zyu98rerF5qHMXemNb74YZjn9LZbgAiL-QWwd8 Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: d527ac7a0b864094a5c74dea23ec445b Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerRescueTestJSON-1391390438 Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d527ac7a0b864094a5c74dea23ec445b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d527ac7a0b864094a5c74dea23ec445b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d527ac7a0b864094a5c74dea23ec445b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d527ac7a0b864094a5c74dea23ec445b", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerRescueTestJSON-1391390438 Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: d527ac7a0b864094a5c74dea23ec445b Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerRescueTestJSON-1391390438 Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerRescueTestJSON-1391390438-project Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 599c7072545f4280988f6bc50e3ccc5f Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerRescueTestJSON-1391390438-project Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 4aaab678-c37b-490b-85bd-30f9dd9602cc could not be found. Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '4aaab678-c37b-490b-85bd-30f9dd9602cc'} Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aaab678-c37b-490b-85bd-30f9dd9602cc could not be found. Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aaab678-c37b-490b-85bd-30f9dd9602cc could not be found. Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:08:21.983874 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:08:21.988578 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:08:21.988578 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:08:21.988578 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:08:21.988578 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:08:21.988578 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:08:21.988578 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aaab678-c37b-490b-85bd-30f9dd9602cc could not be found. Sep 17 21:08:21.988578 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:08:21.994463 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-024af894-9aca-47ac-a58a-140d5fcd8e56 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Returning 404 to user: Instance 4aaab678-c37b-490b-85bd-30f9dd9602cc could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:08:21.995379 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-024af894-9aca-47ac-a58a-140d5fcd8e56 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc" status: 404 len: 111 microversion: 2.1 time: 0.112788 Sep 17 21:08:22.007674 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2045/4190] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:21 2022] GET /compute/v2.1/servers/4aaab678-c37b-490b-85bd-30f9dd9602cc => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:08:22.013115 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7c5e58f2-92eb-4606-9815-692bc14f8047 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:22.022943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7c5e58f2-92eb-4606-9815-692bc14f8047 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:22.041707 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c5e58f2-92eb-4606-9815-692bc14f8047 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:22.045067 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c5e58f2-92eb-4606-9815-692bc14f8047 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:22.045618 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c5e58f2-92eb-4606-9815-692bc14f8047 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:22.046388 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c5e58f2-92eb-4606-9815-692bc14f8047 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:22.051502 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c5e58f2-92eb-4606-9815-692bc14f8047 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:22.052810 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c5e58f2-92eb-4606-9815-692bc14f8047 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:22.145588 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7c5e58f2-92eb-4606-9815-692bc14f8047 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:08:22.148880 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-905303f8-0f3a-47d5-b62d-5eee02443d13 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "POST /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.802872 Sep 17 21:08:22.163815 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2146/4191] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 17 21:08:21 2022] POST /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915/os-volume_attachments => generated 194 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:22.258456 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-87b30e47-5589-42ca-a5a4-a3b412f1412b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:22.259380 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-87b30e47-5589-42ca-a5a4-a3b412f1412b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 3e57dbfe-799f-429f-8cef-96dec36bb3e1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:22.272438 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87b30e47-5589-42ca-a5a4-a3b412f1412b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:22.282967 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87b30e47-5589-42ca-a5a4-a3b412f1412b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:22.283429 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87b30e47-5589-42ca-a5a4-a3b412f1412b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:22.284209 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87b30e47-5589-42ca-a5a4-a3b412f1412b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:22.284670 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87b30e47-5589-42ca-a5a4-a3b412f1412b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:22.285098 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87b30e47-5589-42ca-a5a4-a3b412f1412b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:22.421492 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7c5e58f2-92eb-4606-9815-692bc14f8047 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "DELETE /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 204 len: 0 microversion: 2.1 time: 0.412376 Sep 17 21:08:22.422769 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2046/4192] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:08:22 2022] DELETE /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:08:22.434288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4595516a-61ff-469f-9c9c-4ecac7c3d90c tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:22.436317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4595516a-61ff-469f-9c9c-4ecac7c3d90c tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:22.453922 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4595516a-61ff-469f-9c9c-4ecac7c3d90c tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:22.454938 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4595516a-61ff-469f-9c9c-4ecac7c3d90c tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:22.455542 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4595516a-61ff-469f-9c9c-4ecac7c3d90c tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:22.456542 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4595516a-61ff-469f-9c9c-4ecac7c3d90c tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:22.457206 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4595516a-61ff-469f-9c9c-4ecac7c3d90c tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:22.459326 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4595516a-61ff-469f-9c9c-4ecac7c3d90c tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:22.958399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-87b30e47-5589-42ca-a5a4-a3b412f1412b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:22.968438 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-87b30e47-5589-42ca-a5a4-a3b412f1412b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1" status: 200 len: 1315 microversion: 2.1 time: 0.716346 Sep 17 21:08:22.969131 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2147/4193] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:22 2022] GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1 => generated 1315 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:08:23.027050 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4595516a-61ff-469f-9c9c-4ecac7c3d90c tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:23.039079 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4595516a-61ff-469f-9c9c-4ecac7c3d90c tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1491 microversion: 2.1 time: 0.612063 Sep 17 21:08:23.040314 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2047/4194] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:22 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1491 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:08:23.896483 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-742f9e50-1e90-4fb7-ba6d-1f3885ff8e4d tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Action: 'create', calling method: .version_select at 0x7f25a57160d0>, body: {"keypair": {"name": "tempest-keypair-1842322073", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCof3iObjg0AbnP39ZqyT7newyy0wO2C2JVDcgmUF8e5LzIIPwHtDGzTSOxgf+NfMFvbjzluSDfMZgJqa4rtgY56dD9ndwC2V6fc5sKVR8QZ3qv5FLOA+roEutRCFkk9Ow=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:23.932612 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-742f9e50-1e90-4fb7-ba6d-1f3885ff8e4d tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Getting quotas for project c4a4d7fd12784db69cf699e7e58d4d6a. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:08:23.942270 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-742f9e50-1e90-4fb7-ba6d-1f3885ff8e4d tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Getting quotas for user 7a13dc0c95a64d499bd05f808565fccd and project c4a4d7fd12784db69cf699e7e58d4d6a. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:08:23.977142 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-742f9e50-1e90-4fb7-ba6d-1f3885ff8e4d tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.085030 Sep 17 21:08:23.978526 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2148/4195] 10.222.0.26 () {62 vars in 1200 bytes} [Sat Sep 17 21:08:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 87 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 17 21:08:23.999530 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1b138364-9d5e-4b01-9985-64c86eb3e25b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:24.000666 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1b138364-9d5e-4b01-9985-64c86eb3e25b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 3e57dbfe-799f-429f-8cef-96dec36bb3e1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:24.009657 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b138364-9d5e-4b01-9985-64c86eb3e25b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:24.010545 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b138364-9d5e-4b01-9985-64c86eb3e25b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:24.011149 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b138364-9d5e-4b01-9985-64c86eb3e25b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:24.012966 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b138364-9d5e-4b01-9985-64c86eb3e25b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:24.013650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b138364-9d5e-4b01-9985-64c86eb3e25b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:24.046980 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b138364-9d5e-4b01-9985-64c86eb3e25b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:24.064519 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6b203b6f-fac5-4c45-b45d-128ce06ac61b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:24.065163 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6b203b6f-fac5-4c45-b45d-128ce06ac61b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:24.095644 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6b203b6f-fac5-4c45-b45d-128ce06ac61b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:24.096176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6b203b6f-fac5-4c45-b45d-128ce06ac61b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:24.096660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6b203b6f-fac5-4c45-b45d-128ce06ac61b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:24.097395 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6b203b6f-fac5-4c45-b45d-128ce06ac61b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:24.105366 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6b203b6f-fac5-4c45-b45d-128ce06ac61b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:24.105878 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6b203b6f-fac5-4c45-b45d-128ce06ac61b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:24.452109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1b138364-9d5e-4b01-9985-64c86eb3e25b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:24.481667 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1b138364-9d5e-4b01-9985-64c86eb3e25b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1" status: 200 len: 1315 microversion: 2.1 time: 0.483961 Sep 17 21:08:24.482636 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2048/4196] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:23 2022] GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1 => generated 1315 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:24.780475 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6b203b6f-fac5-4c45-b45d-128ce06ac61b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:24.789445 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6b203b6f-fac5-4c45-b45d-128ce06ac61b tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1491 microversion: 2.1 time: 0.729037 Sep 17 21:08:24.797611 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2149/4197] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:24 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1491 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:25.102651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-aa5c65f1-6baf-4773-9a4f-6c40d04aefad req-ec742be9-30e8-4d07-b38a-5ad8d7a0d6ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e57dbfe-799f-429f-8cef-96dec36bb3e1", "name": "network-vif-plugged", "status": "completed", "tag": "0b4fb6b7-6a3b-4673-959e-b0233c88dadf"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:25.132060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-aa5c65f1-6baf-4773-9a4f-6c40d04aefad req-ec742be9-30e8-4d07-b38a-5ad8d7a0d6ee service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:25.133860 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-aa5c65f1-6baf-4773-9a4f-6c40d04aefad req-ec742be9-30e8-4d07-b38a-5ad8d7a0d6ee service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:25.135624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-aa5c65f1-6baf-4773-9a4f-6c40d04aefad req-ec742be9-30e8-4d07-b38a-5ad8d7a0d6ee service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:25.159478 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-aa5c65f1-6baf-4773-9a4f-6c40d04aefad req-ec742be9-30e8-4d07-b38a-5ad8d7a0d6ee service nova] Creating event network-vif-plugged:0b4fb6b7-6a3b-4673-959e-b0233c88dadf for instance 3e57dbfe-799f-429f-8cef-96dec36bb3e1 on nch1-master-1 Sep 17 21:08:25.167891 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-aa5c65f1-6baf-4773-9a4f-6c40d04aefad req-ec742be9-30e8-4d07-b38a-5ad8d7a0d6ee service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078600 Sep 17 21:08:25.169250 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2049/4198] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:25.447439 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-938b4c72-01be-4fb8-bb2c-83b9b239413e tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:25.448021 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-938b4c72-01be-4fb8-bb2c-83b9b239413e tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:25.488581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-938b4c72-01be-4fb8-bb2c-83b9b239413e tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:25.489071 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-938b4c72-01be-4fb8-bb2c-83b9b239413e tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:25.491869 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-938b4c72-01be-4fb8-bb2c-83b9b239413e tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:25.493244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-938b4c72-01be-4fb8-bb2c-83b9b239413e tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:25.496459 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-938b4c72-01be-4fb8-bb2c-83b9b239413e tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:25.497426 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-938b4c72-01be-4fb8-bb2c-83b9b239413e tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:25.513173 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d40a29c5-2dbc-4bc6-84f9-75701e672a64 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:25.514231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d40a29c5-2dbc-4bc6-84f9-75701e672a64 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 3e57dbfe-799f-429f-8cef-96dec36bb3e1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:25.524231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d40a29c5-2dbc-4bc6-84f9-75701e672a64 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:25.525166 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d40a29c5-2dbc-4bc6-84f9-75701e672a64 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:25.525819 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d40a29c5-2dbc-4bc6-84f9-75701e672a64 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:25.526902 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d40a29c5-2dbc-4bc6-84f9-75701e672a64 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:25.528186 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d40a29c5-2dbc-4bc6-84f9-75701e672a64 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:25.528865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d40a29c5-2dbc-4bc6-84f9-75701e672a64 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:25.563272 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-938b4c72-01be-4fb8-bb2c-83b9b239413e tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc/ips" status: 200 len: 149 microversion: 2.1 time: 0.121924 Sep 17 21:08:25.566528 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2150/4199] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Sep 17 21:08:25 2022] GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc/ips => generated 149 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:25.592662 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-14af03ba-a076-4106-a2ec-9965390b4bf6 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1c88125-bbdc-4e6f-99b5-cc2bbb27caf2"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:25.597448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-14af03ba-a076-4106-a2ec-9965390b4bf6 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:25.628441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14af03ba-a076-4106-a2ec-9965390b4bf6 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:25.629334 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14af03ba-a076-4106-a2ec-9965390b4bf6 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:25.629987 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14af03ba-a076-4106-a2ec-9965390b4bf6 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:25.631362 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14af03ba-a076-4106-a2ec-9965390b4bf6 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:25.631992 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14af03ba-a076-4106-a2ec-9965390b4bf6 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:25.633913 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14af03ba-a076-4106-a2ec-9965390b4bf6 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:25.776734 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-14af03ba-a076-4106-a2ec-9965390b4bf6 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] HTTP exception thrown: Invalid volume: volume d1c88125-bbdc-4e6f-99b5-cc2bbb27caf2 is already attached to instances: 839ed6b8-9a04-4448-afb8-1eb643476249 Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-14af03ba-a076-4106-a2ec-9965390b4bf6 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Request method failure captured: Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc/os-volume_attachments HTTP/1.1 Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 74 Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJja5IhqAUJRQXEUU1o8JKB7VL3QF2aEShf_6YtjfGFX6a2gdfOrA57RhEkrL_xji2fJrjERU1MYqs2fkCF1UUkZO1MCrMj-4yvDSZkq5ddhPAEMc-mFSR2bL5wENqd3kTDvDHvjjOdVeCZP6ndR-6jR5boE-dCWiUzV7hdKlqCy2Jhg Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 6fa7e14863254ab3964ac907c168d9e6 Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6fa7e14863254ab3964ac907c168d9e6", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 6fa7e14863254ab3964ac907c168d9e6 Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-AttachVolumeNegativeTest-1020448628-project Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: c544e8e6f7a741c985c92ed7437397cd Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-AttachVolumeNegativeTest-1020448628-project Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: {"volumeAttachment": {"volumeId": "d1c88125-bbdc-4e6f-99b5-cc2bbb27caf2"}} Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: exception: Invalid volume: volume d1c88125-bbdc-4e6f-99b5-cc2bbb27caf2 is already attached to instances: 839ed6b8-9a04-4448-afb8-1eb643476249 Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'server_id': '4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc', 'body': {'volumeAttachment': {'volumeId': 'd1c88125-bbdc-4e6f-99b5-cc2bbb27caf2'}}} Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d1c88125-bbdc-4e6f-99b5-cc2bbb27caf2 is already attached to instances: 839ed6b8-9a04-4448-afb8-1eb643476249 Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:08:25.778787 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:08:25.783107 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:08:25.783107 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:08:25.783107 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 17 21:08:25.783107 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 17 21:08:25.783107 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d1c88125-bbdc-4e6f-99b5-cc2bbb27caf2 is already attached to instances: 839ed6b8-9a04-4448-afb8-1eb643476249 Sep 17 21:08:25.783107 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:08:25.783107 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:08:25.783107 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:08:25.783107 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:08:25.783107 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:08:25.783107 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:08:25.783107 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:08:25.783107 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:08:25.783107 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d1c88125-bbdc-4e6f-99b5-cc2bbb27caf2 is already attached to instances: 839ed6b8-9a04-4448-afb8-1eb643476249 Sep 17 21:08:25.783107 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:08:25.789116 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-14af03ba-a076-4106-a2ec-9965390b4bf6 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Returning 400 to user: Invalid volume: volume d1c88125-bbdc-4e6f-99b5-cc2bbb27caf2 is already attached to instances: 839ed6b8-9a04-4448-afb8-1eb643476249 {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:08:25.791059 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-14af03ba-a076-4106-a2ec-9965390b4bf6 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "POST /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.207666 Sep 17 21:08:25.794019 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2151/4200] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 17 21:08:25 2022] POST /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc/os-volume_attachments => generated 174 bytes in 211 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:08:25.803779 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-2a6a7cb4-6a0f-467d-a1be-113a21c78861 req-52070d77-67db-496b-8530-2ada80e9efb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03d3a17f-d3dd-4daf-8d22-2f4475530fee", "name": "network-vif-deleted", "tag": "7e4c926f-87c9-4552-aabf-7578b77e3449"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:25.833938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-2a6a7cb4-6a0f-467d-a1be-113a21c78861 req-52070d77-67db-496b-8530-2ada80e9efb3 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:25.834975 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-2a6a7cb4-6a0f-467d-a1be-113a21c78861 req-52070d77-67db-496b-8530-2ada80e9efb3 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:25.847797 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-2a6a7cb4-6a0f-467d-a1be-113a21c78861 req-52070d77-67db-496b-8530-2ada80e9efb3 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:25.876190 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-2a6a7cb4-6a0f-467d-a1be-113a21c78861 req-52070d77-67db-496b-8530-2ada80e9efb3 service nova] Creating event network-vif-deleted:7e4c926f-87c9-4552-aabf-7578b77e3449 for instance 03d3a17f-d3dd-4daf-8d22-2f4475530fee on nch2-master-1 Sep 17 21:08:25.893494 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-2a6a7cb4-6a0f-467d-a1be-113a21c78861 req-52070d77-67db-496b-8530-2ada80e9efb3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096890 Sep 17 21:08:25.896705 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2152/4201] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:25.907938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b09eac97-6479-438d-943b-df3868cff7af tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:25.911282 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b09eac97-6479-438d-943b-df3868cff7af tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:25.919944 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b09eac97-6479-438d-943b-df3868cff7af tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:25.920725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b09eac97-6479-438d-943b-df3868cff7af tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:25.921451 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b09eac97-6479-438d-943b-df3868cff7af tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:25.922654 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b09eac97-6479-438d-943b-df3868cff7af tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:25.924118 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b09eac97-6479-438d-943b-df3868cff7af tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:25.925032 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b09eac97-6479-438d-943b-df3868cff7af tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:25.956294 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b09eac97-6479-438d-943b-df3868cff7af tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:08:26.113498 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b09eac97-6479-438d-943b-df3868cff7af tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc" status: 204 len: 0 microversion: 2.1 time: 0.214683 Sep 17 21:08:26.115012 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2153/4202] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:08:25 2022] DELETE /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:08:26.125368 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-63f2caaf-855e-4974-aef3-a7865f4a8939 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:26.128518 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-63f2caaf-855e-4974-aef3-a7865f4a8939 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:26.149157 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-63f2caaf-855e-4974-aef3-a7865f4a8939 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:26.151611 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-63f2caaf-855e-4974-aef3-a7865f4a8939 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:26.152382 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-63f2caaf-855e-4974-aef3-a7865f4a8939 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:26.154177 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-63f2caaf-855e-4974-aef3-a7865f4a8939 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:26.155005 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-63f2caaf-855e-4974-aef3-a7865f4a8939 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:26.158676 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-63f2caaf-855e-4974-aef3-a7865f4a8939 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:26.160554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d40a29c5-2dbc-4bc6-84f9-75701e672a64 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:26.177114 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d40a29c5-2dbc-4bc6-84f9-75701e672a64 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1" status: 200 len: 1315 microversion: 2.1 time: 0.668168 Sep 17 21:08:26.197682 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2050/4203] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:25 2022] GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1 => generated 1315 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:26.213060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-71ce0834-b4e9-46c4-ac3f-50a55ff68262 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:26.227852 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-71ce0834-b4e9-46c4-ac3f-50a55ff68262 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:26.235314 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-71ce0834-b4e9-46c4-ac3f-50a55ff68262 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:26.236258 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-71ce0834-b4e9-46c4-ac3f-50a55ff68262 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:26.236992 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-71ce0834-b4e9-46c4-ac3f-50a55ff68262 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:26.237877 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-71ce0834-b4e9-46c4-ac3f-50a55ff68262 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:26.240172 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-71ce0834-b4e9-46c4-ac3f-50a55ff68262 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:26.240775 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-71ce0834-b4e9-46c4-ac3f-50a55ff68262 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:26.284686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-63f2caaf-855e-4974-aef3-a7865f4a8939 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:26.298028 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-63f2caaf-855e-4974-aef3-a7865f4a8939 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:26.300392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-63f2caaf-855e-4974-aef3-a7865f4a8939 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:26.301039 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-63f2caaf-855e-4974-aef3-a7865f4a8939 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lazy-loading 'fault' on Instance uuid 03d3a17f-d3dd-4daf-8d22-2f4475530fee {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:08:26.473361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-63f2caaf-855e-4974-aef3-a7865f4a8939 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '599c7072545f4280988f6bc50e3ccc5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd527ac7a0b864094a5c74dea23ec445b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:26.487981 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-63f2caaf-855e-4974-aef3-a7865f4a8939 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 200 len: 1304 microversion: 2.1 time: 0.371071 Sep 17 21:08:26.489300 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2154/4204] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:26 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 1304 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:26.807091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-71ce0834-b4e9-46c4-ac3f-50a55ff68262 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:26.820048 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-71ce0834-b4e9-46c4-ac3f-50a55ff68262 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc" status: 200 len: 1680 microversion: 2.1 time: 0.618670 Sep 17 21:08:26.835640 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2051/4205] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:26 2022] GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc => generated 1680 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:27.202785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6f0e91cd-4f50-444c-b54d-382bc9066929 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:27.203726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6f0e91cd-4f50-444c-b54d-382bc9066929 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 3e57dbfe-799f-429f-8cef-96dec36bb3e1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:27.213245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f0e91cd-4f50-444c-b54d-382bc9066929 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:27.217092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f0e91cd-4f50-444c-b54d-382bc9066929 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:27.218425 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f0e91cd-4f50-444c-b54d-382bc9066929 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:27.221614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f0e91cd-4f50-444c-b54d-382bc9066929 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:27.222199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f0e91cd-4f50-444c-b54d-382bc9066929 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:27.226514 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f0e91cd-4f50-444c-b54d-382bc9066929 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:27.514950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-73835fc8-5104-4323-ab3f-e41da5314d47 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:27.516223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-73835fc8-5104-4323-ab3f-e41da5314d47 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] [instance: 03d3a17f-d3dd-4daf-8d22-2f4475530fee] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:27.534790 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73835fc8-5104-4323-ab3f-e41da5314d47 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:27.536686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73835fc8-5104-4323-ab3f-e41da5314d47 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:27.539611 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73835fc8-5104-4323-ab3f-e41da5314d47 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:27.544268 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73835fc8-5104-4323-ab3f-e41da5314d47 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:27.545005 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73835fc8-5104-4323-ab3f-e41da5314d47 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:27.545995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73835fc8-5104-4323-ab3f-e41da5314d47 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:27.599512 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-73835fc8-5104-4323-ab3f-e41da5314d47 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] HTTP exception thrown: Instance 03d3a17f-d3dd-4daf-8d22-2f4475530fee could not be found. Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-73835fc8-5104-4323-ab3f-e41da5314d47 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Request method failure captured: Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee HTTP/1.1 Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjbKMYqyiGhc_x6frp2KS4QmwIuIfhMNWCMqQL_dHzH6uwVTAgX5R3TEwWjtlVPCY5Fnkkfk7srp6ig1b3b9yhR5C5WsPrXtRFEdU7OIWO5-CvfdEY5b3vXsk76jedeKaHKMNEuy_zyu98rerF5qHMXemNb74YZjn9LZbgAiL-QWwd8 Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: d527ac7a0b864094a5c74dea23ec445b Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerRescueTestJSON-1391390438 Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d527ac7a0b864094a5c74dea23ec445b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d527ac7a0b864094a5c74dea23ec445b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d527ac7a0b864094a5c74dea23ec445b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d527ac7a0b864094a5c74dea23ec445b", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerRescueTestJSON-1391390438 Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: d527ac7a0b864094a5c74dea23ec445b Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerRescueTestJSON-1391390438 Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerRescueTestJSON-1391390438-project Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 599c7072545f4280988f6bc50e3ccc5f Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerRescueTestJSON-1391390438-project Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 03d3a17f-d3dd-4daf-8d22-2f4475530fee could not be found. Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '03d3a17f-d3dd-4daf-8d22-2f4475530fee'} Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03d3a17f-d3dd-4daf-8d22-2f4475530fee could not be found. Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03d3a17f-d3dd-4daf-8d22-2f4475530fee could not be found. Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:08:27.603998 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:08:27.608074 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:08:27.608074 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:08:27.608074 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:08:27.608074 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:08:27.608074 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:08:27.608074 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03d3a17f-d3dd-4daf-8d22-2f4475530fee could not be found. Sep 17 21:08:27.608074 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:08:27.611879 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-73835fc8-5104-4323-ab3f-e41da5314d47 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] Returning 404 to user: Instance 03d3a17f-d3dd-4daf-8d22-2f4475530fee could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:08:27.612795 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-73835fc8-5104-4323-ab3f-e41da5314d47 tempest-ServerRescueTestJSON-1391390438 tempest-ServerRescueTestJSON-1391390438-project] 10.222.0.26 "GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee" status: 404 len: 111 microversion: 2.1 time: 0.102606 Sep 17 21:08:27.613386 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2052/4206] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:27 2022] GET /compute/v2.1/servers/03d3a17f-d3dd-4daf-8d22-2f4475530fee => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 21:08:27.846904 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-79f8187c-cd16-4318-aa4b-0c40e7c0f0b0 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:27.848094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-79f8187c-cd16-4318-aa4b-0c40e7c0f0b0 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:27.868358 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79f8187c-cd16-4318-aa4b-0c40e7c0f0b0 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:27.870253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79f8187c-cd16-4318-aa4b-0c40e7c0f0b0 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:27.871375 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79f8187c-cd16-4318-aa4b-0c40e7c0f0b0 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:27.872759 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79f8187c-cd16-4318-aa4b-0c40e7c0f0b0 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:27.875954 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79f8187c-cd16-4318-aa4b-0c40e7c0f0b0 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:27.877834 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79f8187c-cd16-4318-aa4b-0c40e7c0f0b0 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:28.444942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6f0e91cd-4f50-444c-b54d-382bc9066929 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:28.458216 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6f0e91cd-4f50-444c-b54d-382bc9066929 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1" status: 200 len: 1315 microversion: 2.1 time: 1.259134 Sep 17 21:08:28.459915 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2155/4207] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:27 2022] GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1 => generated 1315 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:28.611458 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-79f8187c-cd16-4318-aa4b-0c40e7c0f0b0 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:28.626209 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-79f8187c-cd16-4318-aa4b-0c40e7c0f0b0 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc" status: 200 len: 1680 microversion: 2.1 time: 0.785146 Sep 17 21:08:28.628585 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2053/4208] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:27 2022] GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc => generated 1680 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:08:29.270374 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-180edf9b-7e37-48e5-ae40-7baa2ed655f7 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:29.273178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-180edf9b-7e37-48e5-ae40-7baa2ed655f7 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:29.279891 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-180edf9b-7e37-48e5-ae40-7baa2ed655f7 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:29.280608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-180edf9b-7e37-48e5-ae40-7baa2ed655f7 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:29.281265 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-180edf9b-7e37-48e5-ae40-7baa2ed655f7 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:29.282157 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-180edf9b-7e37-48e5-ae40-7baa2ed655f7 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:29.282755 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-180edf9b-7e37-48e5-ae40-7baa2ed655f7 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:29.283314 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-180edf9b-7e37-48e5-ae40-7baa2ed655f7 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:29.327627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-180edf9b-7e37-48e5-ae40-7baa2ed655f7 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lazy-loading 'flavor' on Instance uuid c2341e0c-be19-4ba1-a137-472f1ecc3915 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:08:29.481425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-417a2342-1507-4f1e-8e43-a4fedd8453b8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:29.482416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-417a2342-1507-4f1e-8e43-a4fedd8453b8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 3e57dbfe-799f-429f-8cef-96dec36bb3e1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:29.493435 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:08:29.496774 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-417a2342-1507-4f1e-8e43-a4fedd8453b8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:29.500652 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-417a2342-1507-4f1e-8e43-a4fedd8453b8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:29.501390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-417a2342-1507-4f1e-8e43-a4fedd8453b8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:29.502374 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-417a2342-1507-4f1e-8e43-a4fedd8453b8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:29.503339 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-417a2342-1507-4f1e-8e43-a4fedd8453b8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:29.504868 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-417a2342-1507-4f1e-8e43-a4fedd8453b8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:29.609403 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-180edf9b-7e37-48e5-ae40-7baa2ed655f7 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "POST /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915/action" status: 200 len: 32 microversion: 2.1 time: 0.342978 Sep 17 21:08:29.611249 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2156/4209] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:08:29 2022] POST /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915/action => generated 32 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:08:29.630347 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3e3ffa5c-65f0-44a3-ad42-c6a8e1f20fe7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-906780836", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "84911bdd-1912-4435-a92f-f57bf358edf4"}, {"port": "63947af1-683e-455f-bb53-c3543b6b147d", "tag": "port-1"}, {"port": "09c61392-3418-4f8e-adca-a6a3d5761117", "tag": "port-2"}, {"uuid": "3a84cc9b-b7ce-4236-a14d-8bf48afd00ad", "tag": "net-1"}, {"uuid": "3a84cc9b-b7ce-4236-a14d-8bf48afd00ad"}, {"uuid": "9a4cfb87-744c-488e-8944-40e17072a067", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "9a4cfb87-744c-488e-8944-40e17072a067", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "c9e0dd22-ca21-4935-99e2-ec55ffcac017", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "03debbe2-b045-44c5-a1ec-8136363e731b", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "63216c51-2591-4185-b165-a1abff51874d", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1893886187"}], "key_name": "tempest-keypair-1842322073", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:29.956787 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-3e3ffa5c-65f0-44a3-ad42-c6a8e1f20fe7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] validate_networks() for [('84911bdd-1912-4435-a92f-f57bf358edf4', None, None, None, None, None), (None, None, '63947af1-683e-455f-bb53-c3543b6b147d', None, None, None), (None, None, '09c61392-3418-4f8e-adca-a6a3d5761117', None, None, None), ('3a84cc9b-b7ce-4236-a14d-8bf48afd00ad', None, None, None, None, None), ('3a84cc9b-b7ce-4236-a14d-8bf48afd00ad', None, None, None, None, None), ('9a4cfb87-744c-488e-8944-40e17072a067', '10.2.2.100', None, None, None, None), ('9a4cfb87-744c-488e-8944-40e17072a067', '10.2.2.200', None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:08:30.305939 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-417a2342-1507-4f1e-8e43-a4fedd8453b8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:30.333865 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-417a2342-1507-4f1e-8e43-a4fedd8453b8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1" status: 200 len: 1502 microversion: 2.1 time: 0.855827 Sep 17 21:08:30.351773 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2054/4210] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:29 2022] GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1 => generated 1502 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:30.356951 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-acf4c346-5dd9-4f83-9953-8a5de29831cf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:30.360235 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-acf4c346-5dd9-4f83-9953-8a5de29831cf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:30.374053 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-acf4c346-5dd9-4f83-9953-8a5de29831cf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:30.374548 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-acf4c346-5dd9-4f83-9953-8a5de29831cf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:30.375180 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-acf4c346-5dd9-4f83-9953-8a5de29831cf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:30.375905 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-acf4c346-5dd9-4f83-9953-8a5de29831cf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:30.377063 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-acf4c346-5dd9-4f83-9953-8a5de29831cf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:30.377931 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-acf4c346-5dd9-4f83-9953-8a5de29831cf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:30.424730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:08:31.563980 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-acf4c346-5dd9-4f83-9953-8a5de29831cf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:31.572822 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-acf4c346-5dd9-4f83-9953-8a5de29831cf tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915" status: 200 len: 1735 microversion: 2.1 time: 1.222933 Sep 17 21:08:31.573549 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2055/4211] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:30 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 => generated 1735 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:31.594695 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9e7d7f60-8f0c-40e7-ac13-42724d9fd4fa tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:31.594695 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9e7d7f60-8f0c-40e7-ac13-42724d9fd4fa tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:31.600094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e7d7f60-8f0c-40e7-ac13-42724d9fd4fa tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:31.600590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e7d7f60-8f0c-40e7-ac13-42724d9fd4fa tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:31.605844 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e7d7f60-8f0c-40e7-ac13-42724d9fd4fa tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:31.606671 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e7d7f60-8f0c-40e7-ac13-42724d9fd4fa tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:31.607157 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e7d7f60-8f0c-40e7-ac13-42724d9fd4fa tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:31.607598 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e7d7f60-8f0c-40e7-ac13-42724d9fd4fa tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:32.342176 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9e7d7f60-8f0c-40e7-ac13-42724d9fd4fa tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:32.352566 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9e7d7f60-8f0c-40e7-ac13-42724d9fd4fa tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc" status: 200 len: 1613 microversion: 2.1 time: 0.777893 Sep 17 21:08:32.353597 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2056/4212] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:31 2022] GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc => generated 1613 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:32.372166 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a4485569-b9be-49f3-87be-b2a7e7c8124a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:32.373054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a4485569-b9be-49f3-87be-b2a7e7c8124a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 3e57dbfe-799f-429f-8cef-96dec36bb3e1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:32.393376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4485569-b9be-49f3-87be-b2a7e7c8124a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:32.395951 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4485569-b9be-49f3-87be-b2a7e7c8124a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:32.396724 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4485569-b9be-49f3-87be-b2a7e7c8124a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:32.398663 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4485569-b9be-49f3-87be-b2a7e7c8124a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:32.400466 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4485569-b9be-49f3-87be-b2a7e7c8124a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:32.402886 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4485569-b9be-49f3-87be-b2a7e7c8124a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:32.864370 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.network.security_group_api [None req-a4485569-b9be-49f3-87be-b2a7e7c8124a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Removing security group 5d05c519-594f-4f75-afe2-7c96d7893329 from port 0b4fb6b7-6a3b-4673-959e-b0233c88dadf Sep 17 21:08:33.951291 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=4 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:08:34.424215 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a4485569-b9be-49f3-87be-b2a7e7c8124a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1/action" status: 202 len: 0 microversion: 2.1 time: 2.069122 Sep 17 21:08:34.426278 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2057/4213] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:08:32 2022] POST /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1/action => generated 0 bytes in 2072 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:08:34.432445 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-52a9569e-0874-4d96-91a8-e7e9f2a2a7bb req-c9a74136-3937-409b-ad8d-25a6e56fdf04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc", "name": "network-vif-deleted", "tag": "b60e28ec-86a4-47a2-baf7-ab19bebc01d8"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:34.446049 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-52a9569e-0874-4d96-91a8-e7e9f2a2a7bb req-c9a74136-3937-409b-ad8d-25a6e56fdf04 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:34.446796 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-52a9569e-0874-4d96-91a8-e7e9f2a2a7bb req-c9a74136-3937-409b-ad8d-25a6e56fdf04 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:34.447422 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-52a9569e-0874-4d96-91a8-e7e9f2a2a7bb req-c9a74136-3937-409b-ad8d-25a6e56fdf04 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:34.470201 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-52a9569e-0874-4d96-91a8-e7e9f2a2a7bb req-c9a74136-3937-409b-ad8d-25a6e56fdf04 service nova] Creating event network-vif-deleted:b60e28ec-86a4-47a2-baf7-ab19bebc01d8 for instance 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc on nch1-master-1 Sep 17 21:08:34.483356 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-52a9569e-0874-4d96-91a8-e7e9f2a2a7bb req-c9a74136-3937-409b-ad8d-25a6e56fdf04 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053219 Sep 17 21:08:34.487511 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2058/4214] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:34.497787 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cbf769c9-adce-42b7-803d-08ac502a3824 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:34.500913 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cbf769c9-adce-42b7-803d-08ac502a3824 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:34.510858 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbf769c9-adce-42b7-803d-08ac502a3824 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:34.511641 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbf769c9-adce-42b7-803d-08ac502a3824 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:34.512253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbf769c9-adce-42b7-803d-08ac502a3824 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:34.513173 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbf769c9-adce-42b7-803d-08ac502a3824 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:34.513806 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbf769c9-adce-42b7-803d-08ac502a3824 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:34.514390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbf769c9-adce-42b7-803d-08ac502a3824 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:34.801824 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cbf769c9-adce-42b7-803d-08ac502a3824 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:34.811131 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cbf769c9-adce-42b7-803d-08ac502a3824 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915" status: 200 len: 1735 microversion: 2.1 time: 0.320555 Sep 17 21:08:34.812070 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2059/4215] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:34 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 => generated 1735 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:34.817048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-08c1ec1e-8b63-4c7d-9f91-3087a1a97932 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-422249726", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:34.876318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-08c1ec1e-8b63-4c7d-9f91-3087a1a97932 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] validate_networks() for None {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:08:35.896132 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-08c1ec1e-8b63-4c7d-9f91-3087a1a97932 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:08:35.897250 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-08c1ec1e-8b63-4c7d-9f91-3087a1a97932 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:08:35.897915 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-08c1ec1e-8b63-4c7d-9f91-3087a1a97932 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:08:35.898513 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-08c1ec1e-8b63-4c7d-9f91-3087a1a97932 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:08:35.899223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-08c1ec1e-8b63-4c7d-9f91-3087a1a97932 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:08:35.914269 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08c1ec1e-8b63-4c7d-9f91-3087a1a97932 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:35.915310 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08c1ec1e-8b63-4c7d-9f91-3087a1a97932 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:35.916225 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08c1ec1e-8b63-4c7d-9f91-3087a1a97932 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:35.917628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08c1ec1e-8b63-4c7d-9f91-3087a1a97932 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:35.918539 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08c1ec1e-8b63-4c7d-9f91-3087a1a97932 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:35.919425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08c1ec1e-8b63-4c7d-9f91-3087a1a97932 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:35.943329 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-08c1ec1e-8b63-4c7d-9f91-3087a1a97932 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Getting quotas for project 42e1e6b096bb41419c594dcde97e16e7. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:08:35.951492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-08c1ec1e-8b63-4c7d-9f91-3087a1a97932 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Getting quotas for user 6d03e73a3bed48f6bf61a702f0f41658 and project 42e1e6b096bb41419c594dcde97e16e7. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:08:35.968853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-08c1ec1e-8b63-4c7d-9f91-3087a1a97932 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:08:35.971740 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-08c1ec1e-8b63-4c7d-9f91-3087a1a97932 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] [instance: 2a69c3a3-1e33-4ec8-9c49-176bc80889b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:08:36.046049 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-08c1ec1e-8b63-4c7d-9f91-3087a1a97932 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.232498 Sep 17 21:08:36.056091 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2060/4216] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:08:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:08:36.071645 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bb2abd4f-6288-4c59-9940-226ec22cd30c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:36.072952 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bb2abd4f-6288-4c59-9940-226ec22cd30c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:36.083680 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bb2abd4f-6288-4c59-9940-226ec22cd30c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:36.084311 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bb2abd4f-6288-4c59-9940-226ec22cd30c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:36.084843 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bb2abd4f-6288-4c59-9940-226ec22cd30c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:36.086455 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bb2abd4f-6288-4c59-9940-226ec22cd30c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:36.087356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bb2abd4f-6288-4c59-9940-226ec22cd30c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:36.087921 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bb2abd4f-6288-4c59-9940-226ec22cd30c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:36.113773 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-bb2abd4f-6288-4c59-9940-226ec22cd30c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] HTTP exception thrown: Instance 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc could not be found. Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bb2abd4f-6288-4c59-9940-226ec22cd30c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Request method failure captured: Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc HTTP/1.1 Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJja5IhqAUJRQXEUU1o8JKB7VL3QF2aEShf_6YtjfGFX6a2gdfOrA57RhEkrL_xji2fJrjERU1MYqs2fkCF1UUkZO1MCrMj-4yvDSZkq5ddhPAEMc-mFSR2bL5wENqd3kTDvDHvjjOdVeCZP6ndR-6jR5boE-dCWiUzV7hdKlqCy2Jhg Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 6fa7e14863254ab3964ac907c168d9e6 Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6fa7e14863254ab3964ac907c168d9e6", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 6fa7e14863254ab3964ac907c168d9e6 Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-AttachVolumeNegativeTest-1020448628-project Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: c544e8e6f7a741c985c92ed7437397cd Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-AttachVolumeNegativeTest-1020448628-project Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc could not be found. Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc'} Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc could not be found. Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc could not be found. Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:08:36.116425 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:08:36.122944 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:08:36.122944 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:08:36.122944 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:08:36.122944 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:08:36.122944 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:08:36.122944 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc could not be found. Sep 17 21:08:36.122944 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:08:36.124925 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bb2abd4f-6288-4c59-9940-226ec22cd30c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Returning 404 to user: Instance 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:08:36.126198 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bb2abd4f-6288-4c59-9940-226ec22cd30c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc" status: 404 len: 111 microversion: 2.1 time: 0.074994 Sep 17 21:08:36.131468 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2061/4217] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:36 2022] GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:08:36.139099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dbf6c607-cb32-4e03-bb6c-1ef9a53f94b7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:36.140095 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dbf6c607-cb32-4e03-bb6c-1ef9a53f94b7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 3e57dbfe-799f-429f-8cef-96dec36bb3e1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:36.151713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dbf6c607-cb32-4e03-bb6c-1ef9a53f94b7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:36.152298 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dbf6c607-cb32-4e03-bb6c-1ef9a53f94b7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:36.154063 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dbf6c607-cb32-4e03-bb6c-1ef9a53f94b7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:36.157781 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dbf6c607-cb32-4e03-bb6c-1ef9a53f94b7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:36.158369 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dbf6c607-cb32-4e03-bb6c-1ef9a53f94b7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:36.160024 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dbf6c607-cb32-4e03-bb6c-1ef9a53f94b7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:36.450156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dbf6c607-cb32-4e03-bb6c-1ef9a53f94b7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:36.464773 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dbf6c607-cb32-4e03-bb6c-1ef9a53f94b7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1" status: 200 len: 1460 microversion: 2.1 time: 0.328849 Sep 17 21:08:36.465812 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2062/4218] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:36 2022] GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1 => generated 1460 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:36.872309 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-9e6a916c-8658-4e4d-93ac-0d75d751fadf req-281a9030-d184-4679-838e-d715c622bb97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e57dbfe-799f-429f-8cef-96dec36bb3e1", "tag": "0b4fb6b7-6a3b-4673-959e-b0233c88dadf"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:36.883379 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-9e6a916c-8658-4e4d-93ac-0d75d751fadf req-281a9030-d184-4679-838e-d715c622bb97 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:36.884239 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-9e6a916c-8658-4e4d-93ac-0d75d751fadf req-281a9030-d184-4679-838e-d715c622bb97 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:36.885021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-9e6a916c-8658-4e4d-93ac-0d75d751fadf req-281a9030-d184-4679-838e-d715c622bb97 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:36.903418 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-9e6a916c-8658-4e4d-93ac-0d75d751fadf req-281a9030-d184-4679-838e-d715c622bb97 service nova] Creating event network-changed:0b4fb6b7-6a3b-4673-959e-b0233c88dadf for instance 3e57dbfe-799f-429f-8cef-96dec36bb3e1 on nch1-master-1 Sep 17 21:08:36.910786 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-9e6a916c-8658-4e4d-93ac-0d75d751fadf req-281a9030-d184-4679-838e-d715c622bb97 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.443501 Sep 17 21:08:36.911945 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2063/4219] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:36.918212 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2146b816-8b61-4a94-be4c-9fb8711fe375 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:36.922207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2146b816-8b61-4a94-be4c-9fb8711fe375 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:36.930208 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2146b816-8b61-4a94-be4c-9fb8711fe375 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:36.930948 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2146b816-8b61-4a94-be4c-9fb8711fe375 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:36.932118 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2146b816-8b61-4a94-be4c-9fb8711fe375 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:36.933009 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2146b816-8b61-4a94-be4c-9fb8711fe375 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:36.933673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2146b816-8b61-4a94-be4c-9fb8711fe375 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:36.934255 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2146b816-8b61-4a94-be4c-9fb8711fe375 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:37.213624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2146b816-8b61-4a94-be4c-9fb8711fe375 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:37.229904 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2146b816-8b61-4a94-be4c-9fb8711fe375 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915" status: 200 len: 1735 microversion: 2.1 time: 0.316294 Sep 17 21:08:37.230970 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2064/4220] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:36 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 => generated 1735 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:37.265505 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ef401817-c8ce-441c-9a2d-7bfeef552233 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:37.266664 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ef401817-c8ce-441c-9a2d-7bfeef552233 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] [instance: 2a69c3a3-1e33-4ec8-9c49-176bc80889b7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:37.288305 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef401817-c8ce-441c-9a2d-7bfeef552233 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:37.289142 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef401817-c8ce-441c-9a2d-7bfeef552233 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:37.289772 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef401817-c8ce-441c-9a2d-7bfeef552233 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:37.291090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef401817-c8ce-441c-9a2d-7bfeef552233 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:37.291777 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef401817-c8ce-441c-9a2d-7bfeef552233 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:37.294586 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef401817-c8ce-441c-9a2d-7bfeef552233 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:37.494628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ef401817-c8ce-441c-9a2d-7bfeef552233 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d03e73a3bed48f6bf61a702f0f41658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1e6b096bb41419c594dcde97e16e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:37.505014 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ef401817-c8ce-441c-9a2d-7bfeef552233 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] 10.222.0.26 "GET /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7" status: 200 len: 1265 microversion: 2.1 time: 0.251074 Sep 17 21:08:37.508751 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2065/4221] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:37 2022] GET /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7 => generated 1265 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:37.528407 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bed0882a-b98f-42a7-8899-0421a0e25282 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '.version_select at 0x7f25a45e29d0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:37.573294 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bed0882a-b98f-42a7-8899-0421a0e25282 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1658892230" status: 202 len: 0 microversion: 2.1 time: 0.058347 Sep 17 21:08:37.574318 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2066/4222] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Sep 17 21:08:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1658892230 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:08:37.579963 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ca7fdd4c-9a35-4649-9ee7-2e65a5f759b3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:37.580857 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ca7fdd4c-9a35-4649-9ee7-2e65a5f759b3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:37.588748 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ca7fdd4c-9a35-4649-9ee7-2e65a5f759b3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:37.589506 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ca7fdd4c-9a35-4649-9ee7-2e65a5f759b3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:37.590117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ca7fdd4c-9a35-4649-9ee7-2e65a5f759b3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:37.591062 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ca7fdd4c-9a35-4649-9ee7-2e65a5f759b3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:37.591673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ca7fdd4c-9a35-4649-9ee7-2e65a5f759b3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:37.592319 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ca7fdd4c-9a35-4649-9ee7-2e65a5f759b3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:37.748194 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-3e3ffa5c-65f0-44a3-ad42-c6a8e1f20fe7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:08:37.749854 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-3e3ffa5c-65f0-44a3-ad42-c6a8e1f20fe7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:08:37.750495 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-3e3ffa5c-65f0-44a3-ad42-c6a8e1f20fe7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:08:37.751050 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-3e3ffa5c-65f0-44a3-ad42-c6a8e1f20fe7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:08:37.751623 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-3e3ffa5c-65f0-44a3-ad42-c6a8e1f20fe7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:08:37.775606 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e3ffa5c-65f0-44a3-ad42-c6a8e1f20fe7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:37.776064 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e3ffa5c-65f0-44a3-ad42-c6a8e1f20fe7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:37.776500 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e3ffa5c-65f0-44a3-ad42-c6a8e1f20fe7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:37.777269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e3ffa5c-65f0-44a3-ad42-c6a8e1f20fe7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:37.785051 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e3ffa5c-65f0-44a3-ad42-c6a8e1f20fe7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:37.785702 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e3ffa5c-65f0-44a3-ad42-c6a8e1f20fe7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:37.818025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-3e3ffa5c-65f0-44a3-ad42-c6a8e1f20fe7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Getting quotas for project c4a4d7fd12784db69cf699e7e58d4d6a. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:08:37.824375 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-3e3ffa5c-65f0-44a3-ad42-c6a8e1f20fe7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Getting quotas for user 7a13dc0c95a64d499bd05f808565fccd and project c4a4d7fd12784db69cf699e7e58d4d6a. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:08:37.871276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ca7fdd4c-9a35-4649-9ee7-2e65a5f759b3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:37.884122 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ca7fdd4c-9a35-4649-9ee7-2e65a5f759b3 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.308414 Sep 17 21:08:37.885271 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2067/4223] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:37 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:37.912182 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-162ca441-a76b-4dd8-9993-e6b37bd2166a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:37.912802 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-162ca441-a76b-4dd8-9993-e6b37bd2166a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:37.920569 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-162ca441-a76b-4dd8-9993-e6b37bd2166a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:37.921295 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-162ca441-a76b-4dd8-9993-e6b37bd2166a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:37.921836 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-162ca441-a76b-4dd8-9993-e6b37bd2166a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:37.922551 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-162ca441-a76b-4dd8-9993-e6b37bd2166a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:37.923005 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-162ca441-a76b-4dd8-9993-e6b37bd2166a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:37.923432 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-162ca441-a76b-4dd8-9993-e6b37bd2166a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:38.090119 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3e3ffa5c-65f0-44a3-ad42-c6a8e1f20fe7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:08:38.102081 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3e3ffa5c-65f0-44a3-ad42-c6a8e1f20fe7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='c9e0dd22-ca21-4935-99e2-ec55ffcac017',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='03debbe2-b045-44c5-a1ec-8136363e731b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='63216c51-2591-4185-b165-a1abff51874d',volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:08:38.204585 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-162ca441-a76b-4dd8-9993-e6b37bd2166a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:38.220593 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-162ca441-a76b-4dd8-9993-e6b37bd2166a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.312392 Sep 17 21:08:38.242910 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2068/4224] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:37 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:08:38.256190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1dc1c29a-600d-4fca-8a47-9e9ee78e1815 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:38.257095 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1dc1c29a-600d-4fca-8a47-9e9ee78e1815 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:38.300365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1dc1c29a-600d-4fca-8a47-9e9ee78e1815 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:38.302298 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1dc1c29a-600d-4fca-8a47-9e9ee78e1815 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:38.303379 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1dc1c29a-600d-4fca-8a47-9e9ee78e1815 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:38.304897 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1dc1c29a-600d-4fca-8a47-9e9ee78e1815 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:38.307600 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1dc1c29a-600d-4fca-8a47-9e9ee78e1815 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:38.308251 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1dc1c29a-600d-4fca-8a47-9e9ee78e1815 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:38.815866 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3e3ffa5c-65f0-44a3-ad42-c6a8e1f20fe7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 9.202977 Sep 17 21:08:38.827857 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2157/4225] 10.222.0.26 () {62 vars in 1189 bytes} [Sat Sep 17 21:08:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 9216 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 17 21:08:38.835028 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-17a2e6e6-fb24-4f00-b980-63fa59ad9ded tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:38.835663 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-17a2e6e6-fb24-4f00-b980-63fa59ad9ded tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:38.854868 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17a2e6e6-fb24-4f00-b980-63fa59ad9ded tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:38.856760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17a2e6e6-fb24-4f00-b980-63fa59ad9ded tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:38.857219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17a2e6e6-fb24-4f00-b980-63fa59ad9ded tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:38.859223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17a2e6e6-fb24-4f00-b980-63fa59ad9ded tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:38.859694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17a2e6e6-fb24-4f00-b980-63fa59ad9ded tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:38.860996 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17a2e6e6-fb24-4f00-b980-63fa59ad9ded tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:38.896003 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:08:39.395487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1dc1c29a-600d-4fca-8a47-9e9ee78e1815 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:39.404865 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1dc1c29a-600d-4fca-8a47-9e9ee78e1815 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 1.160647 Sep 17 21:08:39.405833 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2069/4226] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:38 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:39.421878 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-547f3223-9722-4acc-9b14-7041665411bd tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:39.423245 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-547f3223-9722-4acc-9b14-7041665411bd tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] [instance: 2a69c3a3-1e33-4ec8-9c49-176bc80889b7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:39.431201 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-547f3223-9722-4acc-9b14-7041665411bd tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:39.433155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-547f3223-9722-4acc-9b14-7041665411bd tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:39.434709 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-547f3223-9722-4acc-9b14-7041665411bd tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:39.435709 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-547f3223-9722-4acc-9b14-7041665411bd tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:39.436532 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-547f3223-9722-4acc-9b14-7041665411bd tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:39.437327 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-547f3223-9722-4acc-9b14-7041665411bd tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:39.529554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-17a2e6e6-fb24-4f00-b980-63fa59ad9ded tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:39.539141 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-17a2e6e6-fb24-4f00-b980-63fa59ad9ded tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915" status: 200 len: 1735 microversion: 2.1 time: 0.710035 Sep 17 21:08:39.539846 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2158/4227] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:38 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 => generated 1735 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:39.545199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9548e94e-e62b-4f32-be05-b2bafa298cc7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:39.546144 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9548e94e-e62b-4f32-be05-b2bafa298cc7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:39.581500 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-547f3223-9722-4acc-9b14-7041665411bd tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d03e73a3bed48f6bf61a702f0f41658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1e6b096bb41419c594dcde97e16e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:39.607627 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-547f3223-9722-4acc-9b14-7041665411bd tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] 10.222.0.26 "GET /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7" status: 200 len: 1271 microversion: 2.1 time: 0.200248 Sep 17 21:08:39.608783 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2070/4228] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:39 2022] GET /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7 => generated 1271 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:39.613742 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7dfb306f-f7e9-4b4e-9754-8b124e6f410f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:39.621493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7dfb306f-f7e9-4b4e-9754-8b124e6f410f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:39.634431 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7dfb306f-f7e9-4b4e-9754-8b124e6f410f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:39.635499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7dfb306f-f7e9-4b4e-9754-8b124e6f410f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:39.637834 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7dfb306f-f7e9-4b4e-9754-8b124e6f410f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:39.639135 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7dfb306f-f7e9-4b4e-9754-8b124e6f410f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:39.639791 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7dfb306f-f7e9-4b4e-9754-8b124e6f410f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:39.640429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7dfb306f-f7e9-4b4e-9754-8b124e6f410f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:39.654824 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9548e94e-e62b-4f32-be05-b2bafa298cc7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:39.665226 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9548e94e-e62b-4f32-be05-b2bafa298cc7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:39.669185 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9548e94e-e62b-4f32-be05-b2bafa298cc7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:39.670975 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9548e94e-e62b-4f32-be05-b2bafa298cc7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1285 microversion: 2.42 time: 0.129888 Sep 17 21:08:39.672211 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2159/4229] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:08:39 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:08:39.904929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7dfb306f-f7e9-4b4e-9754-8b124e6f410f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:39.920530 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7dfb306f-f7e9-4b4e-9754-8b124e6f410f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.308597 Sep 17 21:08:39.920530 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2071/4230] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:39 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:40.000731 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c1ec67ae-061c-4fdc-9be5-b3cc1cb0d1af tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:40.001336 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c1ec67ae-061c-4fdc-9be5-b3cc1cb0d1af tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 839ed6b8-9a04-4448-afb8-1eb643476249] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:40.008594 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1ec67ae-061c-4fdc-9be5-b3cc1cb0d1af tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:40.009079 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1ec67ae-061c-4fdc-9be5-b3cc1cb0d1af tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:40.009768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1ec67ae-061c-4fdc-9be5-b3cc1cb0d1af tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:40.010473 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1ec67ae-061c-4fdc-9be5-b3cc1cb0d1af tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:40.010918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1ec67ae-061c-4fdc-9be5-b3cc1cb0d1af tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:40.011480 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1ec67ae-061c-4fdc-9be5-b3cc1cb0d1af tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:40.045424 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cb12dd20-34f9-4f44-9b88-bfa029135358 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2118317122", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "fd58f898-7287-41a8-bd5b-faf66186e8ef"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:40.104978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-c1ec67ae-061c-4fdc-9be5-b3cc1cb0d1af tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lazy-loading 'services' on Instance uuid 839ed6b8-9a04-4448-afb8-1eb643476249 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:08:40.111804 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-cb12dd20-34f9-4f44-9b88-bfa029135358 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] validate_networks() for [('fd58f898-7287-41a8-bd5b-faf66186e8ef', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:08:40.226573 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c1ec67ae-061c-4fdc-9be5-b3cc1cb0d1af tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "DELETE /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249/os-volume_attachments/d1c88125-bbdc-4e6f-99b5-cc2bbb27caf2" status: 202 len: 0 microversion: 2.1 time: 0.229893 Sep 17 21:08:40.227856 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2160/4231] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Sep 17 21:08:39 2022] DELETE /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249/os-volume_attachments/d1c88125-bbdc-4e6f-99b5-cc2bbb27caf2 => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:08:40.236738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-abaa6015-d78f-4eda-b681-c30b44c89933 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:40.239749 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-abaa6015-d78f-4eda-b681-c30b44c89933 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 839ed6b8-9a04-4448-afb8-1eb643476249] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:40.253370 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abaa6015-d78f-4eda-b681-c30b44c89933 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:40.260452 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abaa6015-d78f-4eda-b681-c30b44c89933 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:40.262160 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abaa6015-d78f-4eda-b681-c30b44c89933 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:40.264855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abaa6015-d78f-4eda-b681-c30b44c89933 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:40.267848 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abaa6015-d78f-4eda-b681-c30b44c89933 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:40.268401 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abaa6015-d78f-4eda-b681-c30b44c89933 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:40.319653 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-abaa6015-d78f-4eda-b681-c30b44c89933 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086857 Sep 17 21:08:40.320871 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2161/4232] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 17 21:08:40 2022] GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:40.569448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b38d7302-e475-4929-8fdf-3a9e9f738e2b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:40.570975 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b38d7302-e475-4929-8fdf-3a9e9f738e2b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:40.582198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b38d7302-e475-4929-8fdf-3a9e9f738e2b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:40.582840 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b38d7302-e475-4929-8fdf-3a9e9f738e2b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:40.583435 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b38d7302-e475-4929-8fdf-3a9e9f738e2b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:40.584749 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b38d7302-e475-4929-8fdf-3a9e9f738e2b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:40.585705 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b38d7302-e475-4929-8fdf-3a9e9f738e2b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:40.589792 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b38d7302-e475-4929-8fdf-3a9e9f738e2b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:41.015205 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-cb12dd20-34f9-4f44-9b88-bfa029135358 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:08:41.015813 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-cb12dd20-34f9-4f44-9b88-bfa029135358 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:08:41.016458 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-cb12dd20-34f9-4f44-9b88-bfa029135358 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:08:41.017091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-cb12dd20-34f9-4f44-9b88-bfa029135358 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:08:41.017966 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-cb12dd20-34f9-4f44-9b88-bfa029135358 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:08:41.043413 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb12dd20-34f9-4f44-9b88-bfa029135358 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:41.046525 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb12dd20-34f9-4f44-9b88-bfa029135358 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:41.047187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb12dd20-34f9-4f44-9b88-bfa029135358 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:41.048581 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb12dd20-34f9-4f44-9b88-bfa029135358 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:41.052550 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb12dd20-34f9-4f44-9b88-bfa029135358 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:41.053189 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb12dd20-34f9-4f44-9b88-bfa029135358 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:41.092626 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-cb12dd20-34f9-4f44-9b88-bfa029135358 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Getting quotas for project 3e48e3c2f7f74636a75679fdf10ef33a. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:08:41.106836 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-cb12dd20-34f9-4f44-9b88-bfa029135358 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Getting quotas for user 2ef547e071fd43ec96c745c26eca119f and project 3e48e3c2f7f74636a75679fdf10ef33a. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:08:41.140427 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cb12dd20-34f9-4f44-9b88-bfa029135358 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:08:41.147591 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cb12dd20-34f9-4f44-9b88-bfa029135358 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: a0fd9e29-e10d-478a-8caa-1f32e9783550] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:08:41.285302 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b38d7302-e475-4929-8fdf-3a9e9f738e2b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:41.301364 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b38d7302-e475-4929-8fdf-3a9e9f738e2b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915" status: 200 len: 1735 microversion: 2.1 time: 0.741365 Sep 17 21:08:41.306102 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2162/4233] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:40 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 => generated 1735 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:41.319979 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c9b07458-439f-45fa-bd82-2b56ed4be29b tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:41.324392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c9b07458-439f-45fa-bd82-2b56ed4be29b tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] [instance: 2a69c3a3-1e33-4ec8-9c49-176bc80889b7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:41.349773 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9b07458-439f-45fa-bd82-2b56ed4be29b tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:41.351485 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9b07458-439f-45fa-bd82-2b56ed4be29b tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:41.352876 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9b07458-439f-45fa-bd82-2b56ed4be29b tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:41.355319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9b07458-439f-45fa-bd82-2b56ed4be29b tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:41.356089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9b07458-439f-45fa-bd82-2b56ed4be29b tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:41.358328 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9b07458-439f-45fa-bd82-2b56ed4be29b tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:41.363992 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cb12dd20-34f9-4f44-9b88-bfa029135358 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.311094 Sep 17 21:08:41.364754 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2072/4234] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:08:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1324 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 17 21:08:41.385127 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-290cdbb6-85eb-4a40-b2d8-04c0b23c920c tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:41.386221 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-290cdbb6-85eb-4a40-b2d8-04c0b23c920c tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:41.410573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-290cdbb6-85eb-4a40-b2d8-04c0b23c920c tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:41.411084 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-290cdbb6-85eb-4a40-b2d8-04c0b23c920c tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:41.414267 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-290cdbb6-85eb-4a40-b2d8-04c0b23c920c tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:41.419128 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-290cdbb6-85eb-4a40-b2d8-04c0b23c920c tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:41.419681 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-290cdbb6-85eb-4a40-b2d8-04c0b23c920c tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:41.420421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-290cdbb6-85eb-4a40-b2d8-04c0b23c920c tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:41.570060 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c9b07458-439f-45fa-bd82-2b56ed4be29b tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d03e73a3bed48f6bf61a702f0f41658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1e6b096bb41419c594dcde97e16e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:41.581501 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c9b07458-439f-45fa-bd82-2b56ed4be29b tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] 10.222.0.26 "GET /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7" status: 200 len: 1271 microversion: 2.1 time: 0.274099 Sep 17 21:08:41.584358 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2163/4235] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:41 2022] GET /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7 => generated 1271 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:41.600548 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-703b0772-a7ac-4edb-b718-33164639b9f2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:41.603138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-703b0772-a7ac-4edb-b718-33164639b9f2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 839ed6b8-9a04-4448-afb8-1eb643476249] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:41.615605 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-703b0772-a7ac-4edb-b718-33164639b9f2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:41.618086 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-703b0772-a7ac-4edb-b718-33164639b9f2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:41.619751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-703b0772-a7ac-4edb-b718-33164639b9f2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:41.626040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-703b0772-a7ac-4edb-b718-33164639b9f2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:41.626682 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-703b0772-a7ac-4edb-b718-33164639b9f2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:41.627815 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-703b0772-a7ac-4edb-b718-33164639b9f2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:41.723510 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-703b0772-a7ac-4edb-b718-33164639b9f2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.136798 Sep 17 21:08:41.724780 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2164/4236] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 17 21:08:41 2022] GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249/os-volume_attachments => generated 25 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:08:41.730457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4ba1ea6c-bedd-4d55-b4d1-10fa978f5d8e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:41.732006 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4ba1ea6c-bedd-4d55-b4d1-10fa978f5d8e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: a0fd9e29-e10d-478a-8caa-1f32e9783550] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:41.780469 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-290cdbb6-85eb-4a40-b2d8-04c0b23c920c tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:41.803108 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-290cdbb6-85eb-4a40-b2d8-04c0b23c920c tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:41.804569 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-290cdbb6-85eb-4a40-b2d8-04c0b23c920c tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:41.814298 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-290cdbb6-85eb-4a40-b2d8-04c0b23c920c tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1575 microversion: 2.42 time: 0.448362 Sep 17 21:08:41.816582 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2073/4237] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:08:41 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1575 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:08:41.958926 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4ba1ea6c-bedd-4d55-b4d1-10fa978f5d8e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:41.966992 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4ba1ea6c-bedd-4d55-b4d1-10fa978f5d8e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550" status: 200 len: 1215 microversion: 2.1 time: 0.240774 Sep 17 21:08:41.969345 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2165/4238] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:41 2022] GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550 => generated 1215 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:42.000483 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0cd43a4d-eda3-4062-827e-b42193c02885 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:42.001250 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0cd43a4d-eda3-4062-827e-b42193c02885 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 839ed6b8-9a04-4448-afb8-1eb643476249] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:42.005419 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:08:42.017227 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ed063224-9b54-4b6d-b042-8dd447e72d5a tempest-FloatingIPDetailsTestJSON-1099318340 tempest-FloatingIPDetailsTestJSON-1099318340-project] Action: 'create', calling method: .version_select at 0x7f25a45d2700>, body: {"pool": null} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:42.025861 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0cd43a4d-eda3-4062-827e-b42193c02885 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:42.026635 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0cd43a4d-eda3-4062-827e-b42193c02885 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:42.027240 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0cd43a4d-eda3-4062-827e-b42193c02885 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:42.029006 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0cd43a4d-eda3-4062-827e-b42193c02885 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:42.030928 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0cd43a4d-eda3-4062-827e-b42193c02885 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:42.033154 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0cd43a4d-eda3-4062-827e-b42193c02885 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:42.095912 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0cd43a4d-eda3-4062-827e-b42193c02885 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 839ed6b8-9a04-4448-afb8-1eb643476249] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:08:42.301494 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0cd43a4d-eda3-4062-827e-b42193c02885 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "DELETE /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249" status: 204 len: 0 microversion: 2.1 time: 0.312150 Sep 17 21:08:42.302916 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2166/4239] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:08:41 2022] DELETE /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:08:42.318048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6e5e0679-10c3-4a67-9cb4-b82d3c4333d2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:42.320857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6e5e0679-10c3-4a67-9cb4-b82d3c4333d2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 839ed6b8-9a04-4448-afb8-1eb643476249] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:42.336076 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6e5e0679-10c3-4a67-9cb4-b82d3c4333d2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:42.337874 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6e5e0679-10c3-4a67-9cb4-b82d3c4333d2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:42.339492 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6e5e0679-10c3-4a67-9cb4-b82d3c4333d2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:42.340480 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6e5e0679-10c3-4a67-9cb4-b82d3c4333d2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:42.344184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6e5e0679-10c3-4a67-9cb4-b82d3c4333d2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:42.344914 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6e5e0679-10c3-4a67-9cb4-b82d3c4333d2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:42.907072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6e5e0679-10c3-4a67-9cb4-b82d3c4333d2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:42.919706 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6e5e0679-10c3-4a67-9cb4-b82d3c4333d2 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249" status: 200 len: 1680 microversion: 2.1 time: 0.611964 Sep 17 21:08:42.935900 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2167/4240] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:42 2022] GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249 => generated 1680 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:08:42.935900 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b6cea624-29b2-4af3-9ec1-875406cd8310 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:42.935900 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b6cea624-29b2-4af3-9ec1-875406cd8310 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:42.948913 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b6cea624-29b2-4af3-9ec1-875406cd8310 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:42.949751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b6cea624-29b2-4af3-9ec1-875406cd8310 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:42.950307 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b6cea624-29b2-4af3-9ec1-875406cd8310 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:42.951135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b6cea624-29b2-4af3-9ec1-875406cd8310 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:42.952443 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b6cea624-29b2-4af3-9ec1-875406cd8310 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:42.955450 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b6cea624-29b2-4af3-9ec1-875406cd8310 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:43.225161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b6cea624-29b2-4af3-9ec1-875406cd8310 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:43.247591 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b6cea624-29b2-4af3-9ec1-875406cd8310 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915" status: 200 len: 1735 microversion: 2.1 time: 0.325179 Sep 17 21:08:43.248070 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2168/4241] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:42 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 => generated 1735 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:43.267497 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b6ed9714-d55f-4ba2-9711-0357ad73210e tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:43.268118 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b6ed9714-d55f-4ba2-9711-0357ad73210e tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] [instance: 2a69c3a3-1e33-4ec8-9c49-176bc80889b7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:43.292823 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b6ed9714-d55f-4ba2-9711-0357ad73210e tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:43.293342 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b6ed9714-d55f-4ba2-9711-0357ad73210e tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:43.298226 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b6ed9714-d55f-4ba2-9711-0357ad73210e tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:43.299099 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b6ed9714-d55f-4ba2-9711-0357ad73210e tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:43.302759 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b6ed9714-d55f-4ba2-9711-0357ad73210e tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:43.304821 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b6ed9714-d55f-4ba2-9711-0357ad73210e tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:44.739674 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b6ed9714-d55f-4ba2-9711-0357ad73210e tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d03e73a3bed48f6bf61a702f0f41658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1e6b096bb41419c594dcde97e16e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:44.764445 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b6ed9714-d55f-4ba2-9711-0357ad73210e tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] 10.222.0.26 "GET /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7" status: 200 len: 1313 microversion: 2.1 time: 1.512421 Sep 17 21:08:44.765080 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2169/4242] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:43 2022] GET /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7 => generated 1313 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:44.783522 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f27e786d-7839-4888-beff-1a4d1f375d18 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:44.785025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f27e786d-7839-4888-beff-1a4d1f375d18 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:44.803940 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f27e786d-7839-4888-beff-1a4d1f375d18 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:44.804530 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f27e786d-7839-4888-beff-1a4d1f375d18 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:44.807861 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f27e786d-7839-4888-beff-1a4d1f375d18 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:44.808867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f27e786d-7839-4888-beff-1a4d1f375d18 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:44.812240 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f27e786d-7839-4888-beff-1a4d1f375d18 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:44.813320 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f27e786d-7839-4888-beff-1a4d1f375d18 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:45.213286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f27e786d-7839-4888-beff-1a4d1f375d18 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:45.226168 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f27e786d-7839-4888-beff-1a4d1f375d18 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:45.236540 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f27e786d-7839-4888-beff-1a4d1f375d18 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:45.238242 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f27e786d-7839-4888-beff-1a4d1f375d18 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1593 microversion: 2.42 time: 0.466481 Sep 17 21:08:45.262504 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2170/4243] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:08:44 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1593 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:08:45.270715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d5b942ef-c559-451e-a1bb-4712825c04ae tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:45.271448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d5b942ef-c559-451e-a1bb-4712825c04ae tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: a0fd9e29-e10d-478a-8caa-1f32e9783550] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:45.280519 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5b942ef-c559-451e-a1bb-4712825c04ae tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:45.281227 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5b942ef-c559-451e-a1bb-4712825c04ae tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:45.282068 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5b942ef-c559-451e-a1bb-4712825c04ae tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:45.286096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5b942ef-c559-451e-a1bb-4712825c04ae tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:45.286668 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5b942ef-c559-451e-a1bb-4712825c04ae tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:45.287466 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5b942ef-c559-451e-a1bb-4712825c04ae tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:45.793275 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d5b942ef-c559-451e-a1bb-4712825c04ae tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:45.810377 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d5b942ef-c559-451e-a1bb-4712825c04ae tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550" status: 200 len: 1273 microversion: 2.1 time: 0.542625 Sep 17 21:08:45.812425 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2171/4244] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:45 2022] GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550 => generated 1273 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:45.828867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-64081bb8-4276-4007-93b8-46327e60e9be tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:45.830633 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-64081bb8-4276-4007-93b8-46327e60e9be tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 839ed6b8-9a04-4448-afb8-1eb643476249] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:45.858047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64081bb8-4276-4007-93b8-46327e60e9be tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:45.859524 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64081bb8-4276-4007-93b8-46327e60e9be tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:45.861100 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64081bb8-4276-4007-93b8-46327e60e9be tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:45.864138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64081bb8-4276-4007-93b8-46327e60e9be tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:45.864572 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64081bb8-4276-4007-93b8-46327e60e9be tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:45.866127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64081bb8-4276-4007-93b8-46327e60e9be tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:46.465751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-64081bb8-4276-4007-93b8-46327e60e9be tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:46.493350 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-64081bb8-4276-4007-93b8-46327e60e9be tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249" status: 200 len: 1680 microversion: 2.1 time: 0.676790 Sep 17 21:08:46.494576 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2172/4245] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:45 2022] GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249 => generated 1680 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:46.509213 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-faee2e81-d9e3-47d0-bc13-d8d4e9f731b0 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:46.512569 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-faee2e81-d9e3-47d0-bc13-d8d4e9f731b0 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:46.532610 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-faee2e81-d9e3-47d0-bc13-d8d4e9f731b0 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:46.535445 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-faee2e81-d9e3-47d0-bc13-d8d4e9f731b0 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:46.536364 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-faee2e81-d9e3-47d0-bc13-d8d4e9f731b0 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:46.537553 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-faee2e81-d9e3-47d0-bc13-d8d4e9f731b0 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:46.538651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-faee2e81-d9e3-47d0-bc13-d8d4e9f731b0 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:46.539404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-faee2e81-d9e3-47d0-bc13-d8d4e9f731b0 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:47.631563 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-faee2e81-d9e3-47d0-bc13-d8d4e9f731b0 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:47.650729 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-faee2e81-d9e3-47d0-bc13-d8d4e9f731b0 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915" status: 200 len: 1735 microversion: 2.1 time: 1.152092 Sep 17 21:08:47.654546 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2173/4246] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:46 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 => generated 1735 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:47.675756 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b30da66d-c14d-4acd-9c44-aa8d859ba1a0 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:47.676749 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b30da66d-c14d-4acd-9c44-aa8d859ba1a0 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] [instance: 2a69c3a3-1e33-4ec8-9c49-176bc80889b7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:47.707099 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b30da66d-c14d-4acd-9c44-aa8d859ba1a0 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:47.707784 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b30da66d-c14d-4acd-9c44-aa8d859ba1a0 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:47.708379 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b30da66d-c14d-4acd-9c44-aa8d859ba1a0 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:47.709366 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b30da66d-c14d-4acd-9c44-aa8d859ba1a0 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:47.709985 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b30da66d-c14d-4acd-9c44-aa8d859ba1a0 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:47.710555 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b30da66d-c14d-4acd-9c44-aa8d859ba1a0 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:47.806209 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:08:48.265967 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b30da66d-c14d-4acd-9c44-aa8d859ba1a0 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d03e73a3bed48f6bf61a702f0f41658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1e6b096bb41419c594dcde97e16e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:48.269711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:08:48.274324 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b30da66d-c14d-4acd-9c44-aa8d859ba1a0 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] 10.222.0.26 "GET /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7" status: 200 len: 1313 microversion: 2.1 time: 0.618377 Sep 17 21:08:48.279170 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2174/4247] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:47 2022] GET /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7 => generated 1313 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:48.293615 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-be205837-a7ea-407f-bfbd-2e7bf8beab78 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:48.294424 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-be205837-a7ea-407f-bfbd-2e7bf8beab78 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:48.301286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be205837-a7ea-407f-bfbd-2e7bf8beab78 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:48.314177 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be205837-a7ea-407f-bfbd-2e7bf8beab78 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:48.314783 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be205837-a7ea-407f-bfbd-2e7bf8beab78 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:48.315740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be205837-a7ea-407f-bfbd-2e7bf8beab78 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:48.316331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be205837-a7ea-407f-bfbd-2e7bf8beab78 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:48.316878 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be205837-a7ea-407f-bfbd-2e7bf8beab78 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:49.085958 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-be205837-a7ea-407f-bfbd-2e7bf8beab78 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:49.101006 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-be205837-a7ea-407f-bfbd-2e7bf8beab78 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:49.102634 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-be205837-a7ea-407f-bfbd-2e7bf8beab78 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:49.104071 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-be205837-a7ea-407f-bfbd-2e7bf8beab78 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1661 microversion: 2.42 time: 0.823821 Sep 17 21:08:49.106144 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2175/4248] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:08:48 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1661 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:08:49.128107 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-8827b69e-9a54-46f9-85e7-301ffbf9732a req-e385a22d-dd57-4b81-a205-a42cf8a05cdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a69c3a3-1e33-4ec8-9c49-176bc80889b7", "tag": "5bce567d-a349-476d-8d32-93ec77d97908"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:49.146340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8827b69e-9a54-46f9-85e7-301ffbf9732a req-e385a22d-dd57-4b81-a205-a42cf8a05cdd service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:49.147226 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8827b69e-9a54-46f9-85e7-301ffbf9732a req-e385a22d-dd57-4b81-a205-a42cf8a05cdd service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:49.147875 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8827b69e-9a54-46f9-85e7-301ffbf9732a req-e385a22d-dd57-4b81-a205-a42cf8a05cdd service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:49.179210 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-8827b69e-9a54-46f9-85e7-301ffbf9732a req-e385a22d-dd57-4b81-a205-a42cf8a05cdd service nova] Creating event network-changed:5bce567d-a349-476d-8d32-93ec77d97908 for instance 2a69c3a3-1e33-4ec8-9c49-176bc80889b7 on nch1-master-1 Sep 17 21:08:49.186698 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-8827b69e-9a54-46f9-85e7-301ffbf9732a req-e385a22d-dd57-4b81-a205-a42cf8a05cdd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077525 Sep 17 21:08:49.194527 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2176/4249] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:49.200325 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d3379dd1-cc5a-4cc9-8672-c57ddb83b801 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:49.206103 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d3379dd1-cc5a-4cc9-8672-c57ddb83b801 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: a0fd9e29-e10d-478a-8caa-1f32e9783550] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:49.217595 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3379dd1-cc5a-4cc9-8672-c57ddb83b801 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:49.220273 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3379dd1-cc5a-4cc9-8672-c57ddb83b801 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:49.221105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3379dd1-cc5a-4cc9-8672-c57ddb83b801 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:49.222108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3379dd1-cc5a-4cc9-8672-c57ddb83b801 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:49.223989 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3379dd1-cc5a-4cc9-8672-c57ddb83b801 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:49.225180 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3379dd1-cc5a-4cc9-8672-c57ddb83b801 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:49.532236 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ed063224-9b54-4b6d-b042-8dd447e72d5a tempest-FloatingIPDetailsTestJSON-1099318340 tempest-FloatingIPDetailsTestJSON-1099318340-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.698288 Sep 17 21:08:49.534522 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2074/4250] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Sep 17 21:08:41 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:49.541038 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dea636f9-eac3-4a25-8270-65ce0d6136c4 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:49.542759 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dea636f9-eac3-4a25-8270-65ce0d6136c4 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 839ed6b8-9a04-4448-afb8-1eb643476249] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:49.558802 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dea636f9-eac3-4a25-8270-65ce0d6136c4 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:49.560544 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dea636f9-eac3-4a25-8270-65ce0d6136c4 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:49.563199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dea636f9-eac3-4a25-8270-65ce0d6136c4 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:49.565254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dea636f9-eac3-4a25-8270-65ce0d6136c4 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:49.569264 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dea636f9-eac3-4a25-8270-65ce0d6136c4 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:49.572213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dea636f9-eac3-4a25-8270-65ce0d6136c4 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:49.676016 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dea636f9-eac3-4a25-8270-65ce0d6136c4 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:49.676968 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dea636f9-eac3-4a25-8270-65ce0d6136c4 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:49.677621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dea636f9-eac3-4a25-8270-65ce0d6136c4 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:49.678618 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-dea636f9-eac3-4a25-8270-65ce0d6136c4 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lazy-loading 'fault' on Instance uuid 839ed6b8-9a04-4448-afb8-1eb643476249 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:08:49.699702 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d3379dd1-cc5a-4cc9-8672-c57ddb83b801 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:49.711222 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d3379dd1-cc5a-4cc9-8672-c57ddb83b801 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550" status: 200 len: 1315 microversion: 2.1 time: 0.514874 Sep 17 21:08:49.713795 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2177/4251] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:49 2022] GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550 => generated 1315 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:49.725490 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f065068e-dab9-4cf6-bac2-430836c0ac9e tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:49.740299 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f065068e-dab9-4cf6-bac2-430836c0ac9e tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:49.757888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f065068e-dab9-4cf6-bac2-430836c0ac9e tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:49.758797 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f065068e-dab9-4cf6-bac2-430836c0ac9e tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:49.759529 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f065068e-dab9-4cf6-bac2-430836c0ac9e tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:49.760329 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f065068e-dab9-4cf6-bac2-430836c0ac9e tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:49.760892 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f065068e-dab9-4cf6-bac2-430836c0ac9e tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:49.761733 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f065068e-dab9-4cf6-bac2-430836c0ac9e tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:49.875988 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dea636f9-eac3-4a25-8270-65ce0d6136c4 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:49.889903 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dea636f9-eac3-4a25-8270-65ce0d6136c4 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249" status: 200 len: 1330 microversion: 2.1 time: 0.349844 Sep 17 21:08:49.890880 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2075/4252] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:49 2022] GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249 => generated 1330 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:49.921118 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-67b820f1-437a-47b1-b16c-9c7081829847 req-379448fd-2dbd-4e5d-b389-8efbfc255e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "839ed6b8-9a04-4448-afb8-1eb643476249", "name": "network-vif-deleted", "tag": "ac665539-3ec3-439f-b476-756f416ed8d2"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:49.941041 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-67b820f1-437a-47b1-b16c-9c7081829847 req-379448fd-2dbd-4e5d-b389-8efbfc255e87 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:49.941865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-67b820f1-437a-47b1-b16c-9c7081829847 req-379448fd-2dbd-4e5d-b389-8efbfc255e87 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:49.942466 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-67b820f1-437a-47b1-b16c-9c7081829847 req-379448fd-2dbd-4e5d-b389-8efbfc255e87 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:49.956714 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-67b820f1-437a-47b1-b16c-9c7081829847 req-379448fd-2dbd-4e5d-b389-8efbfc255e87 service nova] Creating event network-vif-deleted:ac665539-3ec3-439f-b476-756f416ed8d2 for instance 839ed6b8-9a04-4448-afb8-1eb643476249 on nch2-master-1 Sep 17 21:08:49.962902 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-67b820f1-437a-47b1-b16c-9c7081829847 req-379448fd-2dbd-4e5d-b389-8efbfc255e87 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054940 Sep 17 21:08:49.963751 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2076/4253] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:49.969270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d03c83d6-829b-4172-bc09-1fcf5154d7af tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:49.970235 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d03c83d6-829b-4172-bc09-1fcf5154d7af tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] [instance: 2a69c3a3-1e33-4ec8-9c49-176bc80889b7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:49.976911 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d03c83d6-829b-4172-bc09-1fcf5154d7af tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:49.977732 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d03c83d6-829b-4172-bc09-1fcf5154d7af tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:49.978361 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d03c83d6-829b-4172-bc09-1fcf5154d7af tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:49.979470 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d03c83d6-829b-4172-bc09-1fcf5154d7af tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:49.980095 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d03c83d6-829b-4172-bc09-1fcf5154d7af tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:49.980690 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d03c83d6-829b-4172-bc09-1fcf5154d7af tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:50.680025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f065068e-dab9-4cf6-bac2-430836c0ac9e tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:50.711509 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f065068e-dab9-4cf6-bac2-430836c0ac9e tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915" status: 200 len: 1735 microversion: 2.1 time: 0.996128 Sep 17 21:08:50.712859 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2178/4254] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:49 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 => generated 1735 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:50.722489 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-996f52d1-5418-425d-8331-9835dd5541ef tempest-FloatingIPDetailsTestJSON-1099318340 tempest-FloatingIPDetailsTestJSON-1099318340-project] Action: 'create', calling method: .version_select at 0x7f25a405e4c0>, body: {"pool": null} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:50.847263 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d03c83d6-829b-4172-bc09-1fcf5154d7af tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d03e73a3bed48f6bf61a702f0f41658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1e6b096bb41419c594dcde97e16e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:50.851086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:08:50.866675 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d03c83d6-829b-4172-bc09-1fcf5154d7af tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] 10.222.0.26 "GET /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7" status: 200 len: 1313 microversion: 2.1 time: 0.894396 Sep 17 21:08:50.869643 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2077/4255] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:49 2022] GET /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7 => generated 1313 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:50.878905 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3823258e-f272-4991-8c3a-ec2ecbe644e6 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:50.879758 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3823258e-f272-4991-8c3a-ec2ecbe644e6 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:50.887488 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3823258e-f272-4991-8c3a-ec2ecbe644e6 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:50.888855 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3823258e-f272-4991-8c3a-ec2ecbe644e6 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:50.889541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3823258e-f272-4991-8c3a-ec2ecbe644e6 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:50.892193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3823258e-f272-4991-8c3a-ec2ecbe644e6 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:50.892860 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3823258e-f272-4991-8c3a-ec2ecbe644e6 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:50.893996 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3823258e-f272-4991-8c3a-ec2ecbe644e6 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:51.080596 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=4 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:08:51.124957 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=12 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:08:51.711888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3823258e-f272-4991-8c3a-ec2ecbe644e6 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:51.732267 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3823258e-f272-4991-8c3a-ec2ecbe644e6 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:51.734054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3823258e-f272-4991-8c3a-ec2ecbe644e6 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:51.736399 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3823258e-f272-4991-8c3a-ec2ecbe644e6 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1649 microversion: 2.42 time: 0.864639 Sep 17 21:08:51.738640 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2078/4256] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:08:50 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1649 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:08:51.745455 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b8fb1561-8c77-4684-b3e9-c891742e5e31 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:51.746414 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b8fb1561-8c77-4684-b3e9-c891742e5e31 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: a0fd9e29-e10d-478a-8caa-1f32e9783550] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:51.757086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b8fb1561-8c77-4684-b3e9-c891742e5e31 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:51.757916 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b8fb1561-8c77-4684-b3e9-c891742e5e31 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:51.758578 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b8fb1561-8c77-4684-b3e9-c891742e5e31 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:51.760201 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b8fb1561-8c77-4684-b3e9-c891742e5e31 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:51.761360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b8fb1561-8c77-4684-b3e9-c891742e5e31 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:51.766677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b8fb1561-8c77-4684-b3e9-c891742e5e31 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:51.966702 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=10 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:08:52.351928 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b8fb1561-8c77-4684-b3e9-c891742e5e31 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:52.368593 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b8fb1561-8c77-4684-b3e9-c891742e5e31 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550" status: 200 len: 1315 microversion: 2.1 time: 0.628039 Sep 17 21:08:52.370055 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2079/4257] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:51 2022] GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550 => generated 1315 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:52.398445 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-050cd448-599f-41cc-b3e9-6b77669152fe tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:52.399612 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-050cd448-599f-41cc-b3e9-6b77669152fe tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 839ed6b8-9a04-4448-afb8-1eb643476249] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:52.411941 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-050cd448-599f-41cc-b3e9-6b77669152fe tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:52.412949 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-050cd448-599f-41cc-b3e9-6b77669152fe tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:52.413665 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-050cd448-599f-41cc-b3e9-6b77669152fe tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:52.414868 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-050cd448-599f-41cc-b3e9-6b77669152fe tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:52.416407 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-050cd448-599f-41cc-b3e9-6b77669152fe tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:52.416963 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-050cd448-599f-41cc-b3e9-6b77669152fe tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:52.449363 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-050cd448-599f-41cc-b3e9-6b77669152fe tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] HTTP exception thrown: Instance 839ed6b8-9a04-4448-afb8-1eb643476249 could not be found. Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-050cd448-599f-41cc-b3e9-6b77669152fe tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Request method failure captured: Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249 HTTP/1.1 Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJja5IhqAUJRQXEUU1o8JKB7VL3QF2aEShf_6YtjfGFX6a2gdfOrA57RhEkrL_xji2fJrjERU1MYqs2fkCF1UUkZO1MCrMj-4yvDSZkq5ddhPAEMc-mFSR2bL5wENqd3kTDvDHvjjOdVeCZP6ndR-6jR5boE-dCWiUzV7hdKlqCy2Jhg Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 6fa7e14863254ab3964ac907c168d9e6 Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6fa7e14863254ab3964ac907c168d9e6", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 6fa7e14863254ab3964ac907c168d9e6 Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-AttachVolumeNegativeTest-1020448628-project Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: c544e8e6f7a741c985c92ed7437397cd Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-AttachVolumeNegativeTest-1020448628-project Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 839ed6b8-9a04-4448-afb8-1eb643476249 could not be found. Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '839ed6b8-9a04-4448-afb8-1eb643476249'} Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 839ed6b8-9a04-4448-afb8-1eb643476249 could not be found. Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 839ed6b8-9a04-4448-afb8-1eb643476249 could not be found. Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:08:52.451196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:08:52.455419 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:08:52.455419 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:08:52.455419 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:08:52.455419 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:08:52.455419 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:08:52.455419 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 839ed6b8-9a04-4448-afb8-1eb643476249 could not be found. Sep 17 21:08:52.455419 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:08:52.455419 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-050cd448-599f-41cc-b3e9-6b77669152fe tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Returning 404 to user: Instance 839ed6b8-9a04-4448-afb8-1eb643476249 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:08:52.455419 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-050cd448-599f-41cc-b3e9-6b77669152fe tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249" status: 404 len: 111 microversion: 2.1 time: 0.081231 Sep 17 21:08:52.455419 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2080/4258] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:52 2022] GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:08:52.461238 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-87171913-f110-4e27-828d-c7acdfb584ce req-fe7e74ea-f279-41ce-904a-92bac945554c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0fd9e29-e10d-478a-8caa-1f32e9783550", "tag": "ef4386dd-dc83-43b4-861a-e9e171dfffcf"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:52.471444 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-87171913-f110-4e27-828d-c7acdfb584ce req-fe7e74ea-f279-41ce-904a-92bac945554c service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:52.472211 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-87171913-f110-4e27-828d-c7acdfb584ce req-fe7e74ea-f279-41ce-904a-92bac945554c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:52.472826 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-87171913-f110-4e27-828d-c7acdfb584ce req-fe7e74ea-f279-41ce-904a-92bac945554c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:52.491403 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-87171913-f110-4e27-828d-c7acdfb584ce req-fe7e74ea-f279-41ce-904a-92bac945554c service nova] Creating event network-changed:ef4386dd-dc83-43b4-861a-e9e171dfffcf for instance a0fd9e29-e10d-478a-8caa-1f32e9783550 on nch1-master-1 Sep 17 21:08:52.498973 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-87171913-f110-4e27-828d-c7acdfb584ce req-fe7e74ea-f279-41ce-904a-92bac945554c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043821 Sep 17 21:08:52.505062 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2081/4259] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:52.513189 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1c25e391-1f0c-46a8-8640-9d70629d1ba5 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:52.514006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1c25e391-1f0c-46a8-8640-9d70629d1ba5 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:52.526355 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c25e391-1f0c-46a8-8640-9d70629d1ba5 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:52.527116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c25e391-1f0c-46a8-8640-9d70629d1ba5 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:52.527752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c25e391-1f0c-46a8-8640-9d70629d1ba5 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:52.533648 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c25e391-1f0c-46a8-8640-9d70629d1ba5 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:52.534522 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c25e391-1f0c-46a8-8640-9d70629d1ba5 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:52.535168 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c25e391-1f0c-46a8-8640-9d70629d1ba5 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:53.153250 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1c25e391-1f0c-46a8-8640-9d70629d1ba5 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:53.166646 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1c25e391-1f0c-46a8-8640-9d70629d1ba5 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915" status: 200 len: 1715 microversion: 2.1 time: 0.660078 Sep 17 21:08:53.184499 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2082/4260] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:52 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 => generated 1715 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:53.207057 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5fd910e9-5903-4d1b-8cdb-bf79dc46e61a tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:53.207994 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5fd910e9-5903-4d1b-8cdb-bf79dc46e61a tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] [instance: 2a69c3a3-1e33-4ec8-9c49-176bc80889b7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:53.228462 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5fd910e9-5903-4d1b-8cdb-bf79dc46e61a tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:53.229727 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5fd910e9-5903-4d1b-8cdb-bf79dc46e61a tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:53.231249 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5fd910e9-5903-4d1b-8cdb-bf79dc46e61a tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:53.232540 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5fd910e9-5903-4d1b-8cdb-bf79dc46e61a tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:53.233225 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5fd910e9-5903-4d1b-8cdb-bf79dc46e61a tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:53.235640 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5fd910e9-5903-4d1b-8cdb-bf79dc46e61a tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:53.642310 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5fd910e9-5903-4d1b-8cdb-bf79dc46e61a tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d03e73a3bed48f6bf61a702f0f41658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1e6b096bb41419c594dcde97e16e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:53.656700 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5fd910e9-5903-4d1b-8cdb-bf79dc46e61a tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] 10.222.0.26 "GET /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7" status: 200 len: 1313 microversion: 2.1 time: 0.466331 Sep 17 21:08:53.658564 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2083/4261] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:53 2022] GET /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7 => generated 1313 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:53.785856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7713a214-ad53-496d-be9f-3d7886d0286e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-649416357", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "ff632525-8d7d-4854-beaf-dc49c77bdd36"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:53.880305 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-7713a214-ad53-496d-be9f-3d7886d0286e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] validate_networks() for [('ff632525-8d7d-4854-beaf-dc49c77bdd36', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:08:55.703408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-7713a214-ad53-496d-be9f-3d7886d0286e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:08:55.704490 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-7713a214-ad53-496d-be9f-3d7886d0286e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:08:55.705119 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-7713a214-ad53-496d-be9f-3d7886d0286e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:08:55.706249 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-7713a214-ad53-496d-be9f-3d7886d0286e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:08:55.706828 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-7713a214-ad53-496d-be9f-3d7886d0286e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:08:55.733825 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7713a214-ad53-496d-be9f-3d7886d0286e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:55.734563 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7713a214-ad53-496d-be9f-3d7886d0286e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:55.735014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7713a214-ad53-496d-be9f-3d7886d0286e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:55.735777 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7713a214-ad53-496d-be9f-3d7886d0286e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:55.736238 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7713a214-ad53-496d-be9f-3d7886d0286e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:55.736668 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7713a214-ad53-496d-be9f-3d7886d0286e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:55.780315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-7713a214-ad53-496d-be9f-3d7886d0286e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Getting quotas for project 0b6f25c3540546bf9bffd5610f4f86c8. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:08:55.800094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-7713a214-ad53-496d-be9f-3d7886d0286e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Getting quotas for user 784233ee78764e7dbb774d3cb50165e3 and project 0b6f25c3540546bf9bffd5610f4f86c8. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:08:55.828539 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:08:55.848413 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7713a214-ad53-496d-be9f-3d7886d0286e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:08:55.852237 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7713a214-ad53-496d-be9f-3d7886d0286e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 893e8bd4-4560-4ebe-8abe-635d5413c433] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:08:55.991894 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7713a214-ad53-496d-be9f-3d7886d0286e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.331688 Sep 17 21:08:56.007490 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2084/4262] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:08:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2348 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:08:56.019991 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d6383384-0207-4d5c-bb3d-4cfa1c1ddc06 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '.version_select at 0x7f25a46c0160>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:56.073295 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d6383384-0207-4d5c-bb3d-4cfa1c1ddc06 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-177008269" status: 202 len: 0 microversion: 2.1 time: 0.062187 Sep 17 21:08:56.074769 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2085/4263] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Sep 17 21:08:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-177008269 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:08:56.090471 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-651e681d-3e9b-4167-8e35-709cf2214a45 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:56.091506 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-651e681d-3e9b-4167-8e35-709cf2214a45 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:56.099479 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-651e681d-3e9b-4167-8e35-709cf2214a45 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:56.100485 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-651e681d-3e9b-4167-8e35-709cf2214a45 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:56.101136 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-651e681d-3e9b-4167-8e35-709cf2214a45 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:56.102767 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-651e681d-3e9b-4167-8e35-709cf2214a45 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:56.104979 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-651e681d-3e9b-4167-8e35-709cf2214a45 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:56.105777 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-651e681d-3e9b-4167-8e35-709cf2214a45 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:56.688059 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-996f52d1-5418-425d-8331-9835dd5541ef tempest-FloatingIPDetailsTestJSON-1099318340 tempest-FloatingIPDetailsTestJSON-1099318340-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.973802 Sep 17 21:08:56.700790 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2179/4264] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Sep 17 21:08:50 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5987 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:56.706883 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2f578f50-d687-47a8-a215-524eed74360c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:56.708527 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2f578f50-d687-47a8-a215-524eed74360c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:56.735080 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f578f50-d687-47a8-a215-524eed74360c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:56.735855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f578f50-d687-47a8-a215-524eed74360c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:56.736480 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f578f50-d687-47a8-a215-524eed74360c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:56.737244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f578f50-d687-47a8-a215-524eed74360c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:56.742270 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f578f50-d687-47a8-a215-524eed74360c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:56.748727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f578f50-d687-47a8-a215-524eed74360c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:56.861562 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-651e681d-3e9b-4167-8e35-709cf2214a45 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:56.872026 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-651e681d-3e9b-4167-8e35-709cf2214a45 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:56.873493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-651e681d-3e9b-4167-8e35-709cf2214a45 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:56.874814 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-651e681d-3e9b-4167-8e35-709cf2214a45 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1743 microversion: 2.42 time: 0.798879 Sep 17 21:08:56.875386 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2086/4265] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:08:56 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1743 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:08:56.882716 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e64bcb62-c49d-4cd8-8315-460db168c014 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:56.883357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e64bcb62-c49d-4cd8-8315-460db168c014 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: a0fd9e29-e10d-478a-8caa-1f32e9783550] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:56.894840 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e64bcb62-c49d-4cd8-8315-460db168c014 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:56.895348 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e64bcb62-c49d-4cd8-8315-460db168c014 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:56.895784 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e64bcb62-c49d-4cd8-8315-460db168c014 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:56.904482 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e64bcb62-c49d-4cd8-8315-460db168c014 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:56.905078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e64bcb62-c49d-4cd8-8315-460db168c014 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:56.905654 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e64bcb62-c49d-4cd8-8315-460db168c014 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:56.944193 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-2f578f50-d687-47a8-a215-524eed74360c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] HTTP exception thrown: Cannot 'detach_volume' instance c2341e0c-be19-4ba1-a137-472f1ecc3915 while it is in vm_state rescued Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2f578f50-d687-47a8-a215-524eed74360c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Request method failure captured: Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915/os-volume_attachments/5ba7aae4-11cf-4bae-825a-6ea9f7b052fa HTTP/1.1 Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjaiOOC2XD-QIsLuDvG9bxN3jnLjmueVdk28NKERipgg7mZAUnmkYYkUcMWYkcsUdzUwALfMrwKYbIvTbrUxBdv7HTTnMRjY98z2HSanC8PyMI0Bvd8_fsMNUR8WwzuWwOyttA6z4v7owoNPIa2XeOfidHHD5bq9m_itbcIiBCzoH1A Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: f8ed24e4bf6643f7b1474fcec78c4995 Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-533169750 Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ed24e4bf6643f7b1474fcec78c4995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f8ed24e4bf6643f7b1474fcec78c4995"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ed24e4bf6643f7b1474fcec78c4995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f8ed24e4bf6643f7b1474fcec78c4995", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerRescueNegativeTestJSON-533169750 Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: f8ed24e4bf6643f7b1474fcec78c4995 Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-533169750 Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerRescueNegativeTestJSON-533169750-project Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 795813bb461e42ad8c2a758e9b8430d6 Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerRescueNegativeTestJSON-533169750-project Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: exception: Cannot 'detach_volume' instance c2341e0c-be19-4ba1-a137-472f1ecc3915 while it is in vm_state rescued Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'server_id': 'c2341e0c-be19-4ba1-a137-472f1ecc3915', 'id': '5ba7aae4-11cf-4bae-825a-6ea9f7b052fa'} Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c2341e0c-be19-4ba1-a137-472f1ecc3915 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c2341e0c-be19-4ba1-a137-472f1ecc3915 while it is in vm_state rescued Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:08:56.946125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:08:56.950382 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:08:56.950382 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:08:56.950382 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:08:56.950382 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:08:56.950382 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c2341e0c-be19-4ba1-a137-472f1ecc3915 while it is in vm_state rescued Sep 17 21:08:56.950382 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:08:56.957415 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2f578f50-d687-47a8-a215-524eed74360c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Returning 409 to user: Cannot 'detach_volume' instance c2341e0c-be19-4ba1-a137-472f1ecc3915 while it is in vm_state rescued {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:08:56.958374 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2f578f50-d687-47a8-a215-524eed74360c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915/os-volume_attachments/5ba7aae4-11cf-4bae-825a-6ea9f7b052fa" status: 409 len: 152 microversion: 2.1 time: 0.256287 Sep 17 21:08:56.962239 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2180/4266] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Sep 17 21:08:56 2022] DELETE /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915/os-volume_attachments/5ba7aae4-11cf-4bae-825a-6ea9f7b052fa => generated 152 bytes in 260 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 17 21:08:56.972222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-4a38a748-1bd9-460a-90f0-13caa81e3b34 req-82e8e3ca-a0dd-46dd-9d23-4cd82d67994b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a69c3a3-1e33-4ec8-9c49-176bc80889b7", "name": "network-vif-plugged", "status": "completed", "tag": "5bce567d-a349-476d-8d32-93ec77d97908"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:56.994662 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4a38a748-1bd9-460a-90f0-13caa81e3b34 req-82e8e3ca-a0dd-46dd-9d23-4cd82d67994b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:56.995462 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4a38a748-1bd9-460a-90f0-13caa81e3b34 req-82e8e3ca-a0dd-46dd-9d23-4cd82d67994b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:56.996535 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4a38a748-1bd9-460a-90f0-13caa81e3b34 req-82e8e3ca-a0dd-46dd-9d23-4cd82d67994b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:57.012490 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-4a38a748-1bd9-460a-90f0-13caa81e3b34 req-82e8e3ca-a0dd-46dd-9d23-4cd82d67994b service nova] Creating event network-vif-plugged:5bce567d-a349-476d-8d32-93ec77d97908 for instance 2a69c3a3-1e33-4ec8-9c49-176bc80889b7 on nch1-master-1 Sep 17 21:08:57.040814 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-4a38a748-1bd9-460a-90f0-13caa81e3b34 req-82e8e3ca-a0dd-46dd-9d23-4cd82d67994b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077383 Sep 17 21:08:57.041430 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2181/4267] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:57.047902 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-18a35735-29c6-4324-b3ad-43869728c4cf tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:57.048931 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-18a35735-29c6-4324-b3ad-43869728c4cf tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] [instance: 2a69c3a3-1e33-4ec8-9c49-176bc80889b7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:57.056042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18a35735-29c6-4324-b3ad-43869728c4cf tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:57.056874 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18a35735-29c6-4324-b3ad-43869728c4cf tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:57.057547 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18a35735-29c6-4324-b3ad-43869728c4cf tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:57.058479 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18a35735-29c6-4324-b3ad-43869728c4cf tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:57.059161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18a35735-29c6-4324-b3ad-43869728c4cf tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:57.060105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18a35735-29c6-4324-b3ad-43869728c4cf tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:57.667367 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e64bcb62-c49d-4cd8-8315-460db168c014 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:57.681410 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e64bcb62-c49d-4cd8-8315-460db168c014 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550" status: 200 len: 1315 microversion: 2.1 time: 0.802420 Sep 17 21:08:57.691329 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2087/4268] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:56 2022] GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550 => generated 1315 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:57.715100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-31b45a63-7b13-444f-815a-e3b51a384bd3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:57.715728 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-31b45a63-7b13-444f-815a-e3b51a384bd3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 893e8bd4-4560-4ebe-8abe-635d5413c433] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:57.731230 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-31b45a63-7b13-444f-815a-e3b51a384bd3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:57.733828 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-31b45a63-7b13-444f-815a-e3b51a384bd3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:57.737149 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-31b45a63-7b13-444f-815a-e3b51a384bd3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:57.738156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-31b45a63-7b13-444f-815a-e3b51a384bd3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:57.738798 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-31b45a63-7b13-444f-815a-e3b51a384bd3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:57.742734 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-31b45a63-7b13-444f-815a-e3b51a384bd3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:57.813434 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-18a35735-29c6-4324-b3ad-43869728c4cf tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d03e73a3bed48f6bf61a702f0f41658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1e6b096bb41419c594dcde97e16e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:57.826361 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-18a35735-29c6-4324-b3ad-43869728c4cf tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] 10.222.0.26 "GET /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7" status: 200 len: 1313 microversion: 2.1 time: 0.783209 Sep 17 21:08:57.829596 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2182/4269] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:57 2022] GET /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7 => generated 1313 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:57.836723 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ca142f5b-f5e3-4732-b344-993e15aebaf0 tempest-FloatingIPDetailsTestJSON-1099318340 tempest-FloatingIPDetailsTestJSON-1099318340-project] Action: 'create', calling method: .version_select at 0x7f25a5691ee0>, body: {"pool": null} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:57.904261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-31b45a63-7b13-444f-815a-e3b51a384bd3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:57.919794 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-31b45a63-7b13-444f-815a-e3b51a384bd3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/893e8bd4-4560-4ebe-8abe-635d5413c433" status: 200 len: 1244 microversion: 2.1 time: 0.207992 Sep 17 21:08:57.920670 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2088/4270] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:57 2022] GET /compute/v2.1/servers/893e8bd4-4560-4ebe-8abe-635d5413c433 => generated 1244 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:57.937832 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-68ed146f-28b8-4fbb-9be8-12817257a52d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:57.938864 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-68ed146f-28b8-4fbb-9be8-12817257a52d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:57.951837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68ed146f-28b8-4fbb-9be8-12817257a52d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:57.952647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68ed146f-28b8-4fbb-9be8-12817257a52d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:57.953096 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68ed146f-28b8-4fbb-9be8-12817257a52d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:57.954047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68ed146f-28b8-4fbb-9be8-12817257a52d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:57.954519 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68ed146f-28b8-4fbb-9be8-12817257a52d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:57.954967 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68ed146f-28b8-4fbb-9be8-12817257a52d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:58.083147 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-68ed146f-28b8-4fbb-9be8-12817257a52d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "POST /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915/action" status: 202 len: 0 microversion: 2.1 time: 0.160008 Sep 17 21:08:58.085186 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2089/4271] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:08:57 2022] POST /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:08:58.094462 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8cbf6387-1962-4dc9-a553-408ae283e10b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:58.095423 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8cbf6387-1962-4dc9-a553-408ae283e10b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:58.104395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8cbf6387-1962-4dc9-a553-408ae283e10b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:58.105077 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8cbf6387-1962-4dc9-a553-408ae283e10b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:58.105741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8cbf6387-1962-4dc9-a553-408ae283e10b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:58.107018 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8cbf6387-1962-4dc9-a553-408ae283e10b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:58.107769 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8cbf6387-1962-4dc9-a553-408ae283e10b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:58.108699 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8cbf6387-1962-4dc9-a553-408ae283e10b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:58.674677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8cbf6387-1962-4dc9-a553-408ae283e10b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:58.689397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8cbf6387-1962-4dc9-a553-408ae283e10b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:58.692760 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8cbf6387-1962-4dc9-a553-408ae283e10b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:58.695734 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8cbf6387-1962-4dc9-a553-408ae283e10b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1743 microversion: 2.42 time: 0.608829 Sep 17 21:08:58.696523 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2090/4272] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:08:58 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1743 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:08:58.726284 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4497b044-44e8-4e92-8ccf-c40512a58d00 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:58.727184 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4497b044-44e8-4e92-8ccf-c40512a58d00 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:58.734058 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4497b044-44e8-4e92-8ccf-c40512a58d00 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:58.734801 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4497b044-44e8-4e92-8ccf-c40512a58d00 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:58.735456 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4497b044-44e8-4e92-8ccf-c40512a58d00 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:58.736409 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4497b044-44e8-4e92-8ccf-c40512a58d00 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:58.737034 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4497b044-44e8-4e92-8ccf-c40512a58d00 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:58.737668 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4497b044-44e8-4e92-8ccf-c40512a58d00 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:59.236549 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4497b044-44e8-4e92-8ccf-c40512a58d00 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:08:59.279033 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4497b044-44e8-4e92-8ccf-c40512a58d00 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915" status: 200 len: 1723 microversion: 2.1 time: 0.555171 Sep 17 21:08:59.281911 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2091/4273] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:58 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 => generated 1723 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:08:59.289521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dc4e58bc-a716-49e7-aa17-90791f3ade50 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Action: 'create', calling method: .version_select at 0x7f25a46c01f0>, body: {"keypair": {"name": "tempest-keypair-1790176936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYq4G5GJaCsK7tvhDgmj8R12Dqc2kKzGoLoIxKBjFaMLK207T5NhDZtSj4qsHYsLDrxOVzs1jQ8rLgj8EzJ9juSvAbrGIcNh8AjuFFxbe9MXrKbJnN/6LvlbnSt0+f50w=="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:08:59.335598 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-dc4e58bc-a716-49e7-aa17-90791f3ade50 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Getting quotas for project 6fa7e14863254ab3964ac907c168d9e6. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:08:59.344152 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-dc4e58bc-a716-49e7-aa17-90791f3ade50 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Getting quotas for user c544e8e6f7a741c985c92ed7437397cd and project 6fa7e14863254ab3964ac907c168d9e6. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:08:59.376582 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dc4e58bc-a716-49e7-aa17-90791f3ade50 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.093274 Sep 17 21:08:59.378616 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2092/4274] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:08:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:08:59.384263 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d5c7e3ed-5192-4b73-b434-07017b63c4a7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:08:59.385229 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d5c7e3ed-5192-4b73-b434-07017b63c4a7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: a0fd9e29-e10d-478a-8caa-1f32e9783550] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:08:59.393261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5c7e3ed-5192-4b73-b434-07017b63c4a7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:59.394072 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5c7e3ed-5192-4b73-b434-07017b63c4a7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:59.394515 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5c7e3ed-5192-4b73-b434-07017b63c4a7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:08:59.395244 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5c7e3ed-5192-4b73-b434-07017b63c4a7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:08:59.395712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5c7e3ed-5192-4b73-b434-07017b63c4a7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:08:59.396148 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5c7e3ed-5192-4b73-b434-07017b63c4a7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:00.106149 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d5c7e3ed-5192-4b73-b434-07017b63c4a7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:00.117146 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d5c7e3ed-5192-4b73-b434-07017b63c4a7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550" status: 200 len: 1315 microversion: 2.1 time: 0.736974 Sep 17 21:09:00.118740 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2093/4275] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:08:59 2022] GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550 => generated 1315 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:00.128884 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1256f555-ffc1-4275-9e49-be18f881c76c tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:00.130213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1256f555-ffc1-4275-9e49-be18f881c76c tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] [instance: 2a69c3a3-1e33-4ec8-9c49-176bc80889b7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:00.142365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1256f555-ffc1-4275-9e49-be18f881c76c tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:00.143693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1256f555-ffc1-4275-9e49-be18f881c76c tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:00.144463 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1256f555-ffc1-4275-9e49-be18f881c76c tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:00.145366 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1256f555-ffc1-4275-9e49-be18f881c76c tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:00.145862 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1256f555-ffc1-4275-9e49-be18f881c76c tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:00.146300 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1256f555-ffc1-4275-9e49-be18f881c76c tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:00.744210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1256f555-ffc1-4275-9e49-be18f881c76c tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d03e73a3bed48f6bf61a702f0f41658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1e6b096bb41419c594dcde97e16e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:00.757711 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1256f555-ffc1-4275-9e49-be18f881c76c tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] 10.222.0.26 "GET /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7" status: 200 len: 1462 microversion: 2.1 time: 0.637218 Sep 17 21:09:00.759009 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2094/4276] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:00 2022] GET /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7 => generated 1462 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:00.764032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-77eeaff8-db0c-4715-9b36-50a64cea4ae3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:00.764759 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-77eeaff8-db0c-4715-9b36-50a64cea4ae3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 893e8bd4-4560-4ebe-8abe-635d5413c433] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:00.771641 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-77eeaff8-db0c-4715-9b36-50a64cea4ae3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:00.772247 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-77eeaff8-db0c-4715-9b36-50a64cea4ae3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:00.772813 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-77eeaff8-db0c-4715-9b36-50a64cea4ae3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:00.773661 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-77eeaff8-db0c-4715-9b36-50a64cea4ae3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:00.774227 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-77eeaff8-db0c-4715-9b36-50a64cea4ae3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:00.774760 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-77eeaff8-db0c-4715-9b36-50a64cea4ae3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:01.399075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-77eeaff8-db0c-4715-9b36-50a64cea4ae3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:01.407120 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-77eeaff8-db0c-4715-9b36-50a64cea4ae3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/893e8bd4-4560-4ebe-8abe-635d5413c433" status: 200 len: 1292 microversion: 2.1 time: 0.646707 Sep 17 21:09:01.422907 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2095/4277] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:00 2022] GET /compute/v2.1/servers/893e8bd4-4560-4ebe-8abe-635d5413c433 => generated 1292 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:01.428254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-07a887ef-19d0-4853-a8ea-474909e4d0ee req-f0c0a8c9-5ed7-4c5d-918a-e67d7f1a9e4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0fd9e29-e10d-478a-8caa-1f32e9783550", "name": "network-vif-plugged", "status": "completed", "tag": "ef4386dd-dc83-43b4-861a-e9e171dfffcf"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:01.438619 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-07a887ef-19d0-4853-a8ea-474909e4d0ee req-f0c0a8c9-5ed7-4c5d-918a-e67d7f1a9e4e service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:01.439109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-07a887ef-19d0-4853-a8ea-474909e4d0ee req-f0c0a8c9-5ed7-4c5d-918a-e67d7f1a9e4e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:01.439467 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-07a887ef-19d0-4853-a8ea-474909e4d0ee req-f0c0a8c9-5ed7-4c5d-918a-e67d7f1a9e4e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:01.451547 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-07a887ef-19d0-4853-a8ea-474909e4d0ee req-f0c0a8c9-5ed7-4c5d-918a-e67d7f1a9e4e service nova] Creating event network-vif-plugged:ef4386dd-dc83-43b4-861a-e9e171dfffcf for instance a0fd9e29-e10d-478a-8caa-1f32e9783550 on nch1-master-1 Sep 17 21:09:01.456871 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-07a887ef-19d0-4853-a8ea-474909e4d0ee req-f0c0a8c9-5ed7-4c5d-918a-e67d7f1a9e4e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032422 Sep 17 21:09:01.457684 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2096/4278] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:01.467365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6e590658-e89d-4929-acd9-6b673361ed80 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:01.468480 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6e590658-e89d-4929-acd9-6b673361ed80 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:01.475261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6e590658-e89d-4929-acd9-6b673361ed80 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:01.476068 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6e590658-e89d-4929-acd9-6b673361ed80 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:01.476689 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6e590658-e89d-4929-acd9-6b673361ed80 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:01.477585 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6e590658-e89d-4929-acd9-6b673361ed80 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:01.478191 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6e590658-e89d-4929-acd9-6b673361ed80 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:01.478774 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6e590658-e89d-4929-acd9-6b673361ed80 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:02.087308 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6e590658-e89d-4929-acd9-6b673361ed80 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:02.097791 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6e590658-e89d-4929-acd9-6b673361ed80 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:02.099218 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6e590658-e89d-4929-acd9-6b673361ed80 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:02.100444 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6e590658-e89d-4929-acd9-6b673361ed80 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1790 microversion: 2.42 time: 0.641303 Sep 17 21:09:02.101234 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2097/4279] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:01 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1790 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:02.106660 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e42b5fd3-1836-4b6e-806a-69acb8d31afc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:02.107272 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e42b5fd3-1836-4b6e-806a-69acb8d31afc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:02.113616 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e42b5fd3-1836-4b6e-806a-69acb8d31afc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:02.114121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e42b5fd3-1836-4b6e-806a-69acb8d31afc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:02.114559 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e42b5fd3-1836-4b6e-806a-69acb8d31afc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:02.115442 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e42b5fd3-1836-4b6e-806a-69acb8d31afc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:02.116076 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e42b5fd3-1836-4b6e-806a-69acb8d31afc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:02.116743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e42b5fd3-1836-4b6e-806a-69acb8d31afc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:02.121227 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:09:03.042453 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e42b5fd3-1836-4b6e-806a-69acb8d31afc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:03.052889 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e42b5fd3-1836-4b6e-806a-69acb8d31afc tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915" status: 200 len: 1729 microversion: 2.1 time: 0.950527 Sep 17 21:09:03.058252 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2098/4280] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:02 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 => generated 1729 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:03.067987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4297a356-3fde-4ce0-888d-4eda8959bf07 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab2daf87-1564-4764-b491-1e5192ed5de8", "device": "/dev/sdb"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:03.077075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4297a356-3fde-4ce0-888d-4eda8959bf07 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] [instance: 2a69c3a3-1e33-4ec8-9c49-176bc80889b7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:03.093152 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4297a356-3fde-4ce0-888d-4eda8959bf07 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:03.094421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4297a356-3fde-4ce0-888d-4eda8959bf07 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:03.095309 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4297a356-3fde-4ce0-888d-4eda8959bf07 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:03.096862 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4297a356-3fde-4ce0-888d-4eda8959bf07 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:03.097874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4297a356-3fde-4ce0-888d-4eda8959bf07 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:03.098503 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4297a356-3fde-4ce0-888d-4eda8959bf07 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:03.286274 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ca142f5b-f5e3-4732-b344-993e15aebaf0 tempest-FloatingIPDetailsTestJSON-1099318340 tempest-FloatingIPDetailsTestJSON-1099318340-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.454938 Sep 17 21:09:03.287026 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2183/4281] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Sep 17 21:08:57 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:03.292126 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-478abe26-5086-4289-ad40-f08751e63d7d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:03.292816 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-478abe26-5086-4289-ad40-f08751e63d7d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: a0fd9e29-e10d-478a-8caa-1f32e9783550] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:03.313852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-478abe26-5086-4289-ad40-f08751e63d7d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:03.314359 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-478abe26-5086-4289-ad40-f08751e63d7d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:03.314808 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-478abe26-5086-4289-ad40-f08751e63d7d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:03.315550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-478abe26-5086-4289-ad40-f08751e63d7d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:03.316013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-478abe26-5086-4289-ad40-f08751e63d7d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:03.316442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-478abe26-5086-4289-ad40-f08751e63d7d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:03.439677 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4297a356-3fde-4ce0-888d-4eda8959bf07 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] 10.222.0.26 "POST /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.379783 Sep 17 21:09:03.440562 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2099/4282] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 17 21:09:03 2022] POST /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7/os-volume_attachments => generated 194 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:03.465985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-897a82c7-7fb0-497e-9450-7e7353e5e84d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1420471645", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c4c3ad81-e8f3-4b9c-972a-042303636823"}], "security_groups": [{"name": "tempest-securitygroup--258137485"}], "key_name": "tempest-keypair-1790176936", "user_data": "}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:03.842925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-478abe26-5086-4289-ad40-f08751e63d7d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:03.857665 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-897a82c7-7fb0-497e-9450-7e7353e5e84d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] validate_networks() for [('c4c3ad81-e8f3-4b9c-972a-042303636823', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:09:03.867785 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-478abe26-5086-4289-ad40-f08751e63d7d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550" status: 200 len: 1501 microversion: 2.1 time: 0.577499 Sep 17 21:09:03.868502 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2184/4283] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:03 2022] GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550 => generated 1501 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:03.881937 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ad785add-8966-4035-b190-aba57806fe17 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:03.882587 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ad785add-8966-4035-b190-aba57806fe17 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 893e8bd4-4560-4ebe-8abe-635d5413c433] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:03.905903 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad785add-8966-4035-b190-aba57806fe17 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:03.906553 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad785add-8966-4035-b190-aba57806fe17 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:03.907003 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad785add-8966-4035-b190-aba57806fe17 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:03.907728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad785add-8966-4035-b190-aba57806fe17 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:03.911694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad785add-8966-4035-b190-aba57806fe17 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:03.912179 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad785add-8966-4035-b190-aba57806fe17 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:04.346399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ad785add-8966-4035-b190-aba57806fe17 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:04.358374 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ad785add-8966-4035-b190-aba57806fe17 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/893e8bd4-4560-4ebe-8abe-635d5413c433" status: 200 len: 1292 microversion: 2.1 time: 0.487877 Sep 17 21:09:04.361447 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2185/4284] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:03 2022] GET /compute/v2.1/servers/893e8bd4-4560-4ebe-8abe-635d5413c433 => generated 1292 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:04.368604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cb29fb50-6459-49ee-bd1c-4efc1c5ab136 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:04.370175 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cb29fb50-6459-49ee-bd1c-4efc1c5ab136 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:04.381583 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb29fb50-6459-49ee-bd1c-4efc1c5ab136 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:04.382310 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb29fb50-6459-49ee-bd1c-4efc1c5ab136 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:04.384253 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb29fb50-6459-49ee-bd1c-4efc1c5ab136 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:04.385310 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb29fb50-6459-49ee-bd1c-4efc1c5ab136 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:04.386054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb29fb50-6459-49ee-bd1c-4efc1c5ab136 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:04.386989 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb29fb50-6459-49ee-bd1c-4efc1c5ab136 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:04.691650 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cb29fb50-6459-49ee-bd1c-4efc1c5ab136 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.328818 Sep 17 21:09:04.700713 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2186/4285] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Sep 17 21:09:04 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915/os-interface => generated 285 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:04.703954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9d16cb85-9d9a-4d4e-baec-6eacfde13038 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:04.709909 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9d16cb85-9d9a-4d4e-baec-6eacfde13038 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:04.727061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d16cb85-9d9a-4d4e-baec-6eacfde13038 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:04.727572 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d16cb85-9d9a-4d4e-baec-6eacfde13038 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:04.728017 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d16cb85-9d9a-4d4e-baec-6eacfde13038 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:04.728805 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d16cb85-9d9a-4d4e-baec-6eacfde13038 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:04.729266 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d16cb85-9d9a-4d4e-baec-6eacfde13038 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:04.729718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d16cb85-9d9a-4d4e-baec-6eacfde13038 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:05.379479 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9d16cb85-9d9a-4d4e-baec-6eacfde13038 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:05.390310 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9d16cb85-9d9a-4d4e-baec-6eacfde13038 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:05.392076 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9d16cb85-9d9a-4d4e-baec-6eacfde13038 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:05.393515 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9d16cb85-9d9a-4d4e-baec-6eacfde13038 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1837 microversion: 2.42 time: 0.694194 Sep 17 21:09:05.410344 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2187/4286] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:04 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1837 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:05.417017 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-10e14ec7-a5f2-4b88-a834-4ffd2590896e tempest-FloatingIPDetailsTestJSON-1099318340 tempest-FloatingIPDetailsTestJSON-1099318340-project] Action: 'create', calling method: .version_select at 0x7f25a411f9d0>, body: {"pool": null} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:05.511749 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-897a82c7-7fb0-497e-9450-7e7353e5e84d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:09:05.512899 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-897a82c7-7fb0-497e-9450-7e7353e5e84d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:09:05.513529 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-897a82c7-7fb0-497e-9450-7e7353e5e84d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:09:05.515188 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-897a82c7-7fb0-497e-9450-7e7353e5e84d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:09:05.516511 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-897a82c7-7fb0-497e-9450-7e7353e5e84d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:09:05.527952 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-897a82c7-7fb0-497e-9450-7e7353e5e84d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:05.528513 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-897a82c7-7fb0-497e-9450-7e7353e5e84d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:05.529015 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-897a82c7-7fb0-497e-9450-7e7353e5e84d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:05.530091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-897a82c7-7fb0-497e-9450-7e7353e5e84d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:05.530713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-897a82c7-7fb0-497e-9450-7e7353e5e84d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:05.531237 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-897a82c7-7fb0-497e-9450-7e7353e5e84d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:05.554665 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-897a82c7-7fb0-497e-9450-7e7353e5e84d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Getting quotas for project 6fa7e14863254ab3964ac907c168d9e6. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:09:05.560613 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-897a82c7-7fb0-497e-9450-7e7353e5e84d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Getting quotas for user c544e8e6f7a741c985c92ed7437397cd and project 6fa7e14863254ab3964ac907c168d9e6. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:09:05.588890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-897a82c7-7fb0-497e-9450-7e7353e5e84d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:09:05.591608 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-897a82c7-7fb0-497e-9450-7e7353e5e84d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:09:05.670120 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-897a82c7-7fb0-497e-9450-7e7353e5e84d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.227991 Sep 17 21:09:05.684593 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2100/4287] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:09:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 2243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:09:05.700992 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c030a06c-70bf-4701-9eb7-521f044565c8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:05.701934 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c030a06c-70bf-4701-9eb7-521f044565c8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: a0fd9e29-e10d-478a-8caa-1f32e9783550] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:05.717180 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c030a06c-70bf-4701-9eb7-521f044565c8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:05.719235 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c030a06c-70bf-4701-9eb7-521f044565c8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:05.722373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c030a06c-70bf-4701-9eb7-521f044565c8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:05.723382 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c030a06c-70bf-4701-9eb7-521f044565c8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:05.724030 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c030a06c-70bf-4701-9eb7-521f044565c8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:05.725824 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c030a06c-70bf-4701-9eb7-521f044565c8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:05.852201 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c030a06c-70bf-4701-9eb7-521f044565c8 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550/action" status: 202 len: 0 microversion: 2.1 time: 0.165943 Sep 17 21:09:05.856925 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2101/4288] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:09:05 2022] POST /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:09:05.864614 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-fcf37818-943b-452e-9c38-0ebf3c61464d req-8413ad78-818a-404b-8513-c68f7e94220b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "893e8bd4-4560-4ebe-8abe-635d5413c433", "tag": "1a900c92-cd71-4208-a5e2-9822ce1675a0"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:05.877727 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-fcf37818-943b-452e-9c38-0ebf3c61464d req-8413ad78-818a-404b-8513-c68f7e94220b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:05.878234 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-fcf37818-943b-452e-9c38-0ebf3c61464d req-8413ad78-818a-404b-8513-c68f7e94220b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:05.878791 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-fcf37818-943b-452e-9c38-0ebf3c61464d req-8413ad78-818a-404b-8513-c68f7e94220b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:05.894870 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-fcf37818-943b-452e-9c38-0ebf3c61464d req-8413ad78-818a-404b-8513-c68f7e94220b service nova] Creating event network-changed:1a900c92-cd71-4208-a5e2-9822ce1675a0 for instance 893e8bd4-4560-4ebe-8abe-635d5413c433 on nch2-master-1 Sep 17 21:09:05.903158 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-fcf37818-943b-452e-9c38-0ebf3c61464d req-8413ad78-818a-404b-8513-c68f7e94220b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042561 Sep 17 21:09:05.904410 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2102/4289] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:05.910213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4777f173-3935-4709-99a5-73cca2333c52 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:05.911125 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4777f173-3935-4709-99a5-73cca2333c52 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 893e8bd4-4560-4ebe-8abe-635d5413c433] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:05.922885 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4777f173-3935-4709-99a5-73cca2333c52 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:05.923405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4777f173-3935-4709-99a5-73cca2333c52 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:05.923854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4777f173-3935-4709-99a5-73cca2333c52 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:05.924591 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4777f173-3935-4709-99a5-73cca2333c52 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:05.925053 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4777f173-3935-4709-99a5-73cca2333c52 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:05.925685 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4777f173-3935-4709-99a5-73cca2333c52 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:06.743382 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4777f173-3935-4709-99a5-73cca2333c52 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:06.756828 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4777f173-3935-4709-99a5-73cca2333c52 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/893e8bd4-4560-4ebe-8abe-635d5413c433" status: 200 len: 1292 microversion: 2.1 time: 0.850484 Sep 17 21:09:06.757441 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2103/4290] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:05 2022] GET /compute/v2.1/servers/893e8bd4-4560-4ebe-8abe-635d5413c433 => generated 1292 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:06.773379 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3e6e3c3f-1ace-4c61-bc7b-51f852cc392f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:06.774255 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3e6e3c3f-1ace-4c61-bc7b-51f852cc392f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:06.790867 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3e6e3c3f-1ace-4c61-bc7b-51f852cc392f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:06.805574 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3e6e3c3f-1ace-4c61-bc7b-51f852cc392f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:06.818271 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3e6e3c3f-1ace-4c61-bc7b-51f852cc392f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:06.819358 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3e6e3c3f-1ace-4c61-bc7b-51f852cc392f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:06.820000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3e6e3c3f-1ace-4c61-bc7b-51f852cc392f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:06.820593 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3e6e3c3f-1ace-4c61-bc7b-51f852cc392f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:07.224853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3e6e3c3f-1ace-4c61-bc7b-51f852cc392f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:07.237971 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3e6e3c3f-1ace-4c61-bc7b-51f852cc392f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a" status: 200 len: 1294 microversion: 2.1 time: 0.477282 Sep 17 21:09:07.238378 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2104/4291] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:06 2022] GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a => generated 1294 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:07.243200 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7cc3bcf1-0e9c-46f5-b8c5-17cf865d1dd4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:07.258535 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7cc3bcf1-0e9c-46f5-b8c5-17cf865d1dd4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: a0fd9e29-e10d-478a-8caa-1f32e9783550] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:07.277258 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cc3bcf1-0e9c-46f5-b8c5-17cf865d1dd4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:07.277849 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cc3bcf1-0e9c-46f5-b8c5-17cf865d1dd4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:07.278324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cc3bcf1-0e9c-46f5-b8c5-17cf865d1dd4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:07.279092 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cc3bcf1-0e9c-46f5-b8c5-17cf865d1dd4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:07.279587 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cc3bcf1-0e9c-46f5-b8c5-17cf865d1dd4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:07.280033 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cc3bcf1-0e9c-46f5-b8c5-17cf865d1dd4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:07.774960 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7cc3bcf1-0e9c-46f5-b8c5-17cf865d1dd4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:07.784018 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7cc3bcf1-0e9c-46f5-b8c5-17cf865d1dd4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550" status: 200 len: 1486 microversion: 2.1 time: 0.544361 Sep 17 21:09:07.787888 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2105/4292] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:07 2022] GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550 => generated 1486 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:07.794244 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e266d4aa-8a3b-4ba1-8406-0bace924dc2b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:07.804333 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e266d4aa-8a3b-4ba1-8406-0bace924dc2b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:07.824970 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e266d4aa-8a3b-4ba1-8406-0bace924dc2b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:07.825973 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e266d4aa-8a3b-4ba1-8406-0bace924dc2b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:07.826941 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e266d4aa-8a3b-4ba1-8406-0bace924dc2b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:07.828206 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e266d4aa-8a3b-4ba1-8406-0bace924dc2b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:07.828892 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e266d4aa-8a3b-4ba1-8406-0bace924dc2b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:07.829778 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e266d4aa-8a3b-4ba1-8406-0bace924dc2b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:08.240430 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e266d4aa-8a3b-4ba1-8406-0bace924dc2b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:08.270207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e266d4aa-8a3b-4ba1-8406-0bace924dc2b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:08.271923 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e266d4aa-8a3b-4ba1-8406-0bace924dc2b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:08.273173 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e266d4aa-8a3b-4ba1-8406-0bace924dc2b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1837 microversion: 2.42 time: 0.482887 Sep 17 21:09:08.285487 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2106/4293] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:07 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1837 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:08.285487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8145a4d1-d236-4297-900c-1d766028d960 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:08.285487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8145a4d1-d236-4297-900c-1d766028d960 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 893e8bd4-4560-4ebe-8abe-635d5413c433] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:08.297274 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8145a4d1-d236-4297-900c-1d766028d960 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:08.298032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8145a4d1-d236-4297-900c-1d766028d960 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:08.298658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8145a4d1-d236-4297-900c-1d766028d960 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:08.299379 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8145a4d1-d236-4297-900c-1d766028d960 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:08.299998 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8145a4d1-d236-4297-900c-1d766028d960 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:08.300437 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8145a4d1-d236-4297-900c-1d766028d960 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:08.802381 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8145a4d1-d236-4297-900c-1d766028d960 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:08.816423 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8145a4d1-d236-4297-900c-1d766028d960 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/893e8bd4-4560-4ebe-8abe-635d5413c433" status: 200 len: 1292 microversion: 2.1 time: 0.541131 Sep 17 21:09:08.817022 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2107/4294] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:08 2022] GET /compute/v2.1/servers/893e8bd4-4560-4ebe-8abe-635d5413c433 => generated 1292 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:08.822026 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cb6c9901-c6e8-4351-9627-0eec9ebf18cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:08.822764 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cb6c9901-c6e8-4351-9627-0eec9ebf18cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: a0fd9e29-e10d-478a-8caa-1f32e9783550] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:08.829043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb6c9901-c6e8-4351-9627-0eec9ebf18cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:08.829747 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb6c9901-c6e8-4351-9627-0eec9ebf18cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:08.830349 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb6c9901-c6e8-4351-9627-0eec9ebf18cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:08.831792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb6c9901-c6e8-4351-9627-0eec9ebf18cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:08.832416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb6c9901-c6e8-4351-9627-0eec9ebf18cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:08.833008 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb6c9901-c6e8-4351-9627-0eec9ebf18cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:08.869291 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-cb6c9901-c6e8-4351-9627-0eec9ebf18cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lazy-loading 'flavor' on Instance uuid a0fd9e29-e10d-478a-8caa-1f32e9783550 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:09:09.225723 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cb6c9901-c6e8-4351-9627-0eec9ebf18cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550/action" status: 202 len: 0 microversion: 2.1 time: 0.402715 Sep 17 21:09:09.230364 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2108/4295] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:09:08 2022] POST /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:09:09.238626 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-0e187bc8-2fcd-42e1-90b8-64ee512a7809 req-7bcb7262-408e-4535-81f7-7fb750521db2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59016b2c-e625-4f0c-8379-b48d97025cf3", "tag": "91cb57c8-4607-4745-9e86-253c6e4b6335"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:09.268249 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-0e187bc8-2fcd-42e1-90b8-64ee512a7809 req-7bcb7262-408e-4535-81f7-7fb750521db2 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:09.269031 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-0e187bc8-2fcd-42e1-90b8-64ee512a7809 req-7bcb7262-408e-4535-81f7-7fb750521db2 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:09.269660 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-0e187bc8-2fcd-42e1-90b8-64ee512a7809 req-7bcb7262-408e-4535-81f7-7fb750521db2 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:09.300316 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-0e187bc8-2fcd-42e1-90b8-64ee512a7809 req-7bcb7262-408e-4535-81f7-7fb750521db2 service nova] Creating event network-changed:91cb57c8-4607-4745-9e86-253c6e4b6335 for instance 59016b2c-e625-4f0c-8379-b48d97025cf3 on nch2-master-1 Sep 17 21:09:09.310888 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-0e187bc8-2fcd-42e1-90b8-64ee512a7809 req-7bcb7262-408e-4535-81f7-7fb750521db2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078777 Sep 17 21:09:09.312952 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2109/4296] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:09:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:09.323395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-92f93e57-75e6-49f1-801d-7b3fb805d38f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:09.326063 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-92f93e57-75e6-49f1-801d-7b3fb805d38f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:09.340473 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92f93e57-75e6-49f1-801d-7b3fb805d38f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:09.341822 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92f93e57-75e6-49f1-801d-7b3fb805d38f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:09.345246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92f93e57-75e6-49f1-801d-7b3fb805d38f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:09.346299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92f93e57-75e6-49f1-801d-7b3fb805d38f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:09.346976 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92f93e57-75e6-49f1-801d-7b3fb805d38f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:09.347582 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92f93e57-75e6-49f1-801d-7b3fb805d38f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:09.803375 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-92f93e57-75e6-49f1-801d-7b3fb805d38f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:09.812413 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-92f93e57-75e6-49f1-801d-7b3fb805d38f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a" status: 200 len: 1300 microversion: 2.1 time: 0.497519 Sep 17 21:09:09.813643 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2110/4297] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:09 2022] GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a => generated 1300 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:09.818854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cd5afe28-90f2-41ea-b048-9b0f367d123a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:09.819688 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cd5afe28-90f2-41ea-b048-9b0f367d123a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: a0fd9e29-e10d-478a-8caa-1f32e9783550] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:09.826986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd5afe28-90f2-41ea-b048-9b0f367d123a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:09.827908 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd5afe28-90f2-41ea-b048-9b0f367d123a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:09.828507 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd5afe28-90f2-41ea-b048-9b0f367d123a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:09.829448 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd5afe28-90f2-41ea-b048-9b0f367d123a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:09.830209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd5afe28-90f2-41ea-b048-9b0f367d123a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:09.830792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd5afe28-90f2-41ea-b048-9b0f367d123a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:10.752922 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cd5afe28-90f2-41ea-b048-9b0f367d123a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:10.767354 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cd5afe28-90f2-41ea-b048-9b0f367d123a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550" status: 200 len: 1513 microversion: 2.1 time: 0.951914 Sep 17 21:09:10.768655 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2111/4298] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:09 2022] GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550 => generated 1513 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:10.799215 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-477ba4eb-b491-4824-9952-027b374d30a4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:10.800734 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-477ba4eb-b491-4824-9952-027b374d30a4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:10.817242 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-477ba4eb-b491-4824-9952-027b374d30a4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:10.819034 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-477ba4eb-b491-4824-9952-027b374d30a4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:10.819674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-477ba4eb-b491-4824-9952-027b374d30a4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:10.820845 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-477ba4eb-b491-4824-9952-027b374d30a4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:10.822566 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-477ba4eb-b491-4824-9952-027b374d30a4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:10.823200 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-477ba4eb-b491-4824-9952-027b374d30a4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:10.823827 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-10e14ec7-a5f2-4b88-a834-4ffd2590896e tempest-FloatingIPDetailsTestJSON-1099318340 tempest-FloatingIPDetailsTestJSON-1099318340-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.410984 Sep 17 21:09:10.831631 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2188/4299] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Sep 17 21:09:05 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:10.831631 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-56a93065-be39-4885-93f7-56c52637f6b7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:10.831631 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-56a93065-be39-4885-93f7-56c52637f6b7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 893e8bd4-4560-4ebe-8abe-635d5413c433] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:10.845262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56a93065-be39-4885-93f7-56c52637f6b7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:10.846016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56a93065-be39-4885-93f7-56c52637f6b7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:10.846699 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56a93065-be39-4885-93f7-56c52637f6b7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:10.848061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56a93065-be39-4885-93f7-56c52637f6b7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:10.849308 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56a93065-be39-4885-93f7-56c52637f6b7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:10.849989 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56a93065-be39-4885-93f7-56c52637f6b7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:10.896851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:09:11.174471 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-56a93065-be39-4885-93f7-56c52637f6b7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:11.198105 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-56a93065-be39-4885-93f7-56c52637f6b7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/893e8bd4-4560-4ebe-8abe-635d5413c433" status: 200 len: 1292 microversion: 2.1 time: 0.372211 Sep 17 21:09:11.203533 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2189/4300] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:10 2022] GET /compute/v2.1/servers/893e8bd4-4560-4ebe-8abe-635d5413c433 => generated 1292 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:11.212354 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fdff7bb3-7f7c-4026-8786-e9c142cd9a54 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:11.213011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fdff7bb3-7f7c-4026-8786-e9c142cd9a54 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:11.220255 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fdff7bb3-7f7c-4026-8786-e9c142cd9a54 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:11.220762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fdff7bb3-7f7c-4026-8786-e9c142cd9a54 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:11.223567 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fdff7bb3-7f7c-4026-8786-e9c142cd9a54 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:11.224630 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fdff7bb3-7f7c-4026-8786-e9c142cd9a54 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:11.225683 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fdff7bb3-7f7c-4026-8786-e9c142cd9a54 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:11.226280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fdff7bb3-7f7c-4026-8786-e9c142cd9a54 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:11.431182 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-477ba4eb-b491-4824-9952-027b374d30a4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:11.448339 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-477ba4eb-b491-4824-9952-027b374d30a4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:11.450990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-477ba4eb-b491-4824-9952-027b374d30a4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:11.453349 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-477ba4eb-b491-4824-9952-027b374d30a4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1858 microversion: 2.42 time: 0.671999 Sep 17 21:09:11.454791 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2112/4301] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:10 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1858 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:11.467637 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-15d5e628-a90e-461d-bddd-ba7ee70ee2db tempest-FloatingIPDetailsTestJSON-1099318340 tempest-FloatingIPDetailsTestJSON-1099318340-project] Calling method '.version_select at 0x7f25a46600d0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:11.707273 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fdff7bb3-7f7c-4026-8786-e9c142cd9a54 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:11.722130 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fdff7bb3-7f7c-4026-8786-e9c142cd9a54 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a" status: 200 len: 1367 microversion: 2.1 time: 0.515393 Sep 17 21:09:11.723345 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2190/4302] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:11 2022] GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a => generated 1367 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:11.728101 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-9e2b091d-cbd7-429c-8522-89fdb63ec582 req-5a749e8f-bd2d-4e63-97e2-37c335aa1635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2341e0c-be19-4ba1-a137-472f1ecc3915", "tag": "79728522-0106-4867-9b9d-f0a0cc2b1675"}, {"name": "network-changed", "server_uuid": "c2341e0c-be19-4ba1-a137-472f1ecc3915", "tag": "79728522-0106-4867-9b9d-f0a0cc2b1675"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:11.741868 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-9e2b091d-cbd7-429c-8522-89fdb63ec582 req-5a749e8f-bd2d-4e63-97e2-37c335aa1635 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:11.742680 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-9e2b091d-cbd7-429c-8522-89fdb63ec582 req-5a749e8f-bd2d-4e63-97e2-37c335aa1635 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:11.743293 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-9e2b091d-cbd7-429c-8522-89fdb63ec582 req-5a749e8f-bd2d-4e63-97e2-37c335aa1635 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:11.772865 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-9e2b091d-cbd7-429c-8522-89fdb63ec582 req-5a749e8f-bd2d-4e63-97e2-37c335aa1635 service nova] Creating event network-changed:79728522-0106-4867-9b9d-f0a0cc2b1675 for instance c2341e0c-be19-4ba1-a137-472f1ecc3915 on nch2-master-1 Sep 17 21:09:11.773383 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-9e2b091d-cbd7-429c-8522-89fdb63ec582 req-5a749e8f-bd2d-4e63-97e2-37c335aa1635 service nova] Creating event network-changed:79728522-0106-4867-9b9d-f0a0cc2b1675 for instance c2341e0c-be19-4ba1-a137-472f1ecc3915 on nch2-master-1 Sep 17 21:09:11.784414 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-9e2b091d-cbd7-429c-8522-89fdb63ec582 req-5a749e8f-bd2d-4e63-97e2-37c335aa1635 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.059631 Sep 17 21:09:11.785634 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2191/4303] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:11.813963 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-2fbdd4de-bd57-4a8b-92f8-1e7d127fc695 req-ec66e766-132e-4f5d-a984-c70ac43ed63a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d8e3d0a-75b8-40ed-ade5-deffe7b8105a", "tag": "555687eb-bade-4e83-8253-ed937a447e79"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:11.828649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-2fbdd4de-bd57-4a8b-92f8-1e7d127fc695 req-ec66e766-132e-4f5d-a984-c70ac43ed63a service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:11.829287 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-2fbdd4de-bd57-4a8b-92f8-1e7d127fc695 req-ec66e766-132e-4f5d-a984-c70ac43ed63a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:11.829646 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-2fbdd4de-bd57-4a8b-92f8-1e7d127fc695 req-ec66e766-132e-4f5d-a984-c70ac43ed63a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:11.849343 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-2fbdd4de-bd57-4a8b-92f8-1e7d127fc695 req-ec66e766-132e-4f5d-a984-c70ac43ed63a service nova] Creating event network-changed:555687eb-bade-4e83-8253-ed937a447e79 for instance 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a on nch1-master-1 Sep 17 21:09:11.856638 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-2fbdd4de-bd57-4a8b-92f8-1e7d127fc695 req-ec66e766-132e-4f5d-a984-c70ac43ed63a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068273 Sep 17 21:09:11.857830 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2192/4304] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:11.889452 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d2069c97-c41a-4bfd-bfe8-4305d3860ec5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:11.891842 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d2069c97-c41a-4bfd-bfe8-4305d3860ec5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: a0fd9e29-e10d-478a-8caa-1f32e9783550] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:11.900181 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d2069c97-c41a-4bfd-bfe8-4305d3860ec5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:11.901600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d2069c97-c41a-4bfd-bfe8-4305d3860ec5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:11.902435 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d2069c97-c41a-4bfd-bfe8-4305d3860ec5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:11.903962 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d2069c97-c41a-4bfd-bfe8-4305d3860ec5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:11.904750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d2069c97-c41a-4bfd-bfe8-4305d3860ec5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:11.905498 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d2069c97-c41a-4bfd-bfe8-4305d3860ec5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:12.042114 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-15d5e628-a90e-461d-bddd-ba7ee70ee2db tempest-FloatingIPDetailsTestJSON-1099318340 tempest-FloatingIPDetailsTestJSON-1099318340-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips/20f1308c-c345-4203-acc4-6be6bbf9f270" status: 200 len: 141 microversion: 2.1 time: 0.584800 Sep 17 21:09:12.043648 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2113/4305] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Sep 17 21:09:11 2022] GET /compute/v2.1/os-floating-ips/20f1308c-c345-4203-acc4-6be6bbf9f270 => generated 141 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:12.056242 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-593eaf46-3954-4f75-945f-4be5d477ba23 tempest-FloatingIPDetailsTestJSON-1099318340 tempest-FloatingIPDetailsTestJSON-1099318340-project] Calling method '.version_select at 0x7f25a4660af0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:12.613439 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d2069c97-c41a-4bfd-bfe8-4305d3860ec5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:12.630390 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d2069c97-c41a-4bfd-bfe8-4305d3860ec5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550" status: 200 len: 1513 microversion: 2.1 time: 0.766032 Sep 17 21:09:12.651152 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2193/4306] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:11 2022] GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550 => generated 1513 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:12.656296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-e1286881-fd7e-48f4-9923-e23217f1465a req-51f6222b-95e8-461e-aedb-2b5fe454b935 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893e8bd4-4560-4ebe-8abe-635d5413c433", "name": "network-vif-plugged", "status": "completed", "tag": "1a900c92-cd71-4208-a5e2-9822ce1675a0"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:12.671586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:09:12.679522 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e1286881-fd7e-48f4-9923-e23217f1465a req-51f6222b-95e8-461e-aedb-2b5fe454b935 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:12.680505 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e1286881-fd7e-48f4-9923-e23217f1465a req-51f6222b-95e8-461e-aedb-2b5fe454b935 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:12.681173 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e1286881-fd7e-48f4-9923-e23217f1465a req-51f6222b-95e8-461e-aedb-2b5fe454b935 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:12.699538 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-e1286881-fd7e-48f4-9923-e23217f1465a req-51f6222b-95e8-461e-aedb-2b5fe454b935 service nova] Creating event network-vif-plugged:1a900c92-cd71-4208-a5e2-9822ce1675a0 for instance 893e8bd4-4560-4ebe-8abe-635d5413c433 on nch2-master-1 Sep 17 21:09:12.705703 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-e1286881-fd7e-48f4-9923-e23217f1465a req-51f6222b-95e8-461e-aedb-2b5fe454b935 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053062 Sep 17 21:09:12.706949 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2194/4307] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:12.712537 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ea099353-d265-4b64-9af9-10bfa545628e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:12.713896 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ea099353-d265-4b64-9af9-10bfa545628e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 893e8bd4-4560-4ebe-8abe-635d5413c433] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:12.741680 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea099353-d265-4b64-9af9-10bfa545628e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:12.744985 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea099353-d265-4b64-9af9-10bfa545628e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:12.746308 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea099353-d265-4b64-9af9-10bfa545628e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:12.747751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea099353-d265-4b64-9af9-10bfa545628e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:12.748468 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea099353-d265-4b64-9af9-10bfa545628e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:12.749203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea099353-d265-4b64-9af9-10bfa545628e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:13.870678 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ea099353-d265-4b64-9af9-10bfa545628e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:13.883283 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ea099353-d265-4b64-9af9-10bfa545628e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/893e8bd4-4560-4ebe-8abe-635d5413c433" status: 200 len: 1292 microversion: 2.1 time: 1.171267 Sep 17 21:09:13.886104 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2195/4308] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:12 2022] GET /compute/v2.1/servers/893e8bd4-4560-4ebe-8abe-635d5413c433 => generated 1292 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:13.901335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-671f15fd-97d1-42e2-8f9b-b71a87a88a18 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:13.906716 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-671f15fd-97d1-42e2-8f9b-b71a87a88a18 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:13.924727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-671f15fd-97d1-42e2-8f9b-b71a87a88a18 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:13.927531 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-671f15fd-97d1-42e2-8f9b-b71a87a88a18 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:13.929803 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-671f15fd-97d1-42e2-8f9b-b71a87a88a18 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:13.939542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-671f15fd-97d1-42e2-8f9b-b71a87a88a18 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:13.940973 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-671f15fd-97d1-42e2-8f9b-b71a87a88a18 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:13.945695 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-671f15fd-97d1-42e2-8f9b-b71a87a88a18 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:14.759599 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-671f15fd-97d1-42e2-8f9b-b71a87a88a18 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:14.783283 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-671f15fd-97d1-42e2-8f9b-b71a87a88a18 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:14.788410 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-671f15fd-97d1-42e2-8f9b-b71a87a88a18 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:14.792258 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-671f15fd-97d1-42e2-8f9b-b71a87a88a18 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1858 microversion: 2.42 time: 0.905017 Sep 17 21:09:14.811569 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2196/4309] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:13 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1858 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:14.822994 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d1ef41a6-174a-4f16-9e5a-d4371bbb9941 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:14.829991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d1ef41a6-174a-4f16-9e5a-d4371bbb9941 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:14.845696 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d1ef41a6-174a-4f16-9e5a-d4371bbb9941 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:14.850202 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d1ef41a6-174a-4f16-9e5a-d4371bbb9941 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:14.850881 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d1ef41a6-174a-4f16-9e5a-d4371bbb9941 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:14.851963 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d1ef41a6-174a-4f16-9e5a-d4371bbb9941 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:14.852583 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d1ef41a6-174a-4f16-9e5a-d4371bbb9941 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:14.853178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d1ef41a6-174a-4f16-9e5a-d4371bbb9941 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:15.545711 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=4 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:09:15.584088 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=16 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:09:15.631773 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-593eaf46-3954-4f75-945f-4be5d477ba23 tempest-FloatingIPDetailsTestJSON-1099318340 tempest-FloatingIPDetailsTestJSON-1099318340-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/20f1308c-c345-4203-acc4-6be6bbf9f270" status: 202 len: 0 microversion: 2.1 time: 3.578836 Sep 17 21:09:15.632555 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2114/4310] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Sep 17 21:09:12 2022] DELETE /compute/v2.1/os-floating-ips/20f1308c-c345-4203-acc4-6be6bbf9f270 => generated 0 bytes in 3581 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 17 21:09:15.639115 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6caf1a35-ee74-4458-8c87-7420e083fc8a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:15.639962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6caf1a35-ee74-4458-8c87-7420e083fc8a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: a0fd9e29-e10d-478a-8caa-1f32e9783550] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:15.664617 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6caf1a35-ee74-4458-8c87-7420e083fc8a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:15.665889 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6caf1a35-ee74-4458-8c87-7420e083fc8a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:15.668011 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6caf1a35-ee74-4458-8c87-7420e083fc8a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:15.668945 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6caf1a35-ee74-4458-8c87-7420e083fc8a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:15.671211 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6caf1a35-ee74-4458-8c87-7420e083fc8a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:15.673677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6caf1a35-ee74-4458-8c87-7420e083fc8a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:15.927871 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d1ef41a6-174a-4f16-9e5a-d4371bbb9941 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:15.936651 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d1ef41a6-174a-4f16-9e5a-d4371bbb9941 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a" status: 200 len: 1367 microversion: 2.1 time: 1.123301 Sep 17 21:09:15.949729 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2197/4311] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:14 2022] GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a => generated 1367 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:15.954871 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-1e274985-4987-448f-9aff-016f549b8b98 req-90b771b1-fc0f-496e-803b-ec087f231c7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59016b2c-e625-4f0c-8379-b48d97025cf3", "tag": "63947af1-683e-455f-bb53-c3543b6b147d"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:15.971836 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-1e274985-4987-448f-9aff-016f549b8b98 req-90b771b1-fc0f-496e-803b-ec087f231c7d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:15.972503 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-1e274985-4987-448f-9aff-016f549b8b98 req-90b771b1-fc0f-496e-803b-ec087f231c7d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:15.973240 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-1e274985-4987-448f-9aff-016f549b8b98 req-90b771b1-fc0f-496e-803b-ec087f231c7d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:16.002413 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:09:16.005127 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-1e274985-4987-448f-9aff-016f549b8b98 req-90b771b1-fc0f-496e-803b-ec087f231c7d service nova] Creating event network-changed:63947af1-683e-455f-bb53-c3543b6b147d for instance 59016b2c-e625-4f0c-8379-b48d97025cf3 on nch2-master-1 Sep 17 21:09:16.034358 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-1e274985-4987-448f-9aff-016f549b8b98 req-90b771b1-fc0f-496e-803b-ec087f231c7d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082992 Sep 17 21:09:16.036107 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2198/4312] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:16.045642 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-682b36b2-eb8a-444c-a59b-8d8ea2212f27 req-bf5a5130-3846-43a1-9d98-6054201fc318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0fd9e29-e10d-478a-8caa-1f32e9783550", "name": "network-vif-plugged", "status": "completed", "tag": "ef4386dd-dc83-43b4-861a-e9e171dfffcf"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:16.070791 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-682b36b2-eb8a-444c-a59b-8d8ea2212f27 req-bf5a5130-3846-43a1-9d98-6054201fc318 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:16.071277 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-682b36b2-eb8a-444c-a59b-8d8ea2212f27 req-bf5a5130-3846-43a1-9d98-6054201fc318 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:16.075010 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-682b36b2-eb8a-444c-a59b-8d8ea2212f27 req-bf5a5130-3846-43a1-9d98-6054201fc318 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:16.113235 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-682b36b2-eb8a-444c-a59b-8d8ea2212f27 req-bf5a5130-3846-43a1-9d98-6054201fc318 service nova] Creating event network-vif-plugged:ef4386dd-dc83-43b4-861a-e9e171dfffcf for instance a0fd9e29-e10d-478a-8caa-1f32e9783550 on nch1-master-1 Sep 17 21:09:16.139324 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-682b36b2-eb8a-444c-a59b-8d8ea2212f27 req-bf5a5130-3846-43a1-9d98-6054201fc318 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101733 Sep 17 21:09:16.140577 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2199/4313] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:16.160161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fc038d66-6271-47d1-8e1d-e3bda528380a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:16.161365 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fc038d66-6271-47d1-8e1d-e3bda528380a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 893e8bd4-4560-4ebe-8abe-635d5413c433] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:16.173454 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc038d66-6271-47d1-8e1d-e3bda528380a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:16.182666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc038d66-6271-47d1-8e1d-e3bda528380a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:16.183837 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc038d66-6271-47d1-8e1d-e3bda528380a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:16.185257 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc038d66-6271-47d1-8e1d-e3bda528380a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:16.188198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc038d66-6271-47d1-8e1d-e3bda528380a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:16.189175 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc038d66-6271-47d1-8e1d-e3bda528380a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:16.263584 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6caf1a35-ee74-4458-8c87-7420e083fc8a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:16.278695 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6caf1a35-ee74-4458-8c87-7420e083fc8a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550" status: 200 len: 1508 microversion: 2.1 time: 0.644977 Sep 17 21:09:16.297754 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2115/4314] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:15 2022] GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550 => generated 1508 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:16.303835 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-aadc4a2a-363c-4506-8e21-28bab219f2c5 tempest-FloatingIPDetailsTestJSON-1099318340 tempest-FloatingIPDetailsTestJSON-1099318340-project] Calling method '.version_select at 0x7f25a45ec3a0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:16.984219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fc038d66-6271-47d1-8e1d-e3bda528380a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:17.000241 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fc038d66-6271-47d1-8e1d-e3bda528380a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/893e8bd4-4560-4ebe-8abe-635d5413c433" status: 200 len: 1474 microversion: 2.1 time: 0.858216 Sep 17 21:09:17.007523 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2200/4315] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:16 2022] GET /compute/v2.1/servers/893e8bd4-4560-4ebe-8abe-635d5413c433 => generated 1474 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:17.017865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5e247ea5-d098-4b07-acf7-f4c621168b66 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:17.018915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5e247ea5-d098-4b07-acf7-f4c621168b66 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:17.037827 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e247ea5-d098-4b07-acf7-f4c621168b66 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:17.038901 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e247ea5-d098-4b07-acf7-f4c621168b66 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:17.045764 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e247ea5-d098-4b07-acf7-f4c621168b66 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:17.050167 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e247ea5-d098-4b07-acf7-f4c621168b66 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:17.050859 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e247ea5-d098-4b07-acf7-f4c621168b66 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:17.052865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e247ea5-d098-4b07-acf7-f4c621168b66 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:17.522510 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-aadc4a2a-363c-4506-8e21-28bab219f2c5 tempest-FloatingIPDetailsTestJSON-1099318340 tempest-FloatingIPDetailsTestJSON-1099318340-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 1.223100 Sep 17 21:09:17.523712 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2116/4316] 10.222.0.26 () {58 vars in 1164 bytes} [Sat Sep 17 21:09:16 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:09:17.528964 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-42d71e94-b957-4ca7-ac6e-2ad3c578a5a1 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:17.530025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-42d71e94-b957-4ca7-ac6e-2ad3c578a5a1 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:17.548850 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-42d71e94-b957-4ca7-ac6e-2ad3c578a5a1 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:17.550161 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-42d71e94-b957-4ca7-ac6e-2ad3c578a5a1 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:17.551981 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-42d71e94-b957-4ca7-ac6e-2ad3c578a5a1 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:17.553014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-42d71e94-b957-4ca7-ac6e-2ad3c578a5a1 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:17.557477 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-42d71e94-b957-4ca7-ac6e-2ad3c578a5a1 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:17.558464 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-42d71e94-b957-4ca7-ac6e-2ad3c578a5a1 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:17.800046 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5e247ea5-d098-4b07-acf7-f4c621168b66 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:17.814315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5e247ea5-d098-4b07-acf7-f4c621168b66 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:17.817584 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5e247ea5-d098-4b07-acf7-f4c621168b66 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:17.818864 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5e247ea5-d098-4b07-acf7-f4c621168b66 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1879 microversion: 2.42 time: 0.809956 Sep 17 21:09:17.851073 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2201/4317] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:17 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1879 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:17.867316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-916b6414-b20b-4baf-b086-5cbb9bdd743d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-339854892", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:18.005165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-916b6414-b20b-4baf-b086-5cbb9bdd743d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] validate_networks() for [('ff632525-8d7d-4854-beaf-dc49c77bdd36', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:09:18.498189 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-42d71e94-b957-4ca7-ac6e-2ad3c578a5a1 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:18.513424 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-42d71e94-b957-4ca7-ac6e-2ad3c578a5a1 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a" status: 200 len: 1367 microversion: 2.1 time: 0.988357 Sep 17 21:09:18.519276 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2117/4318] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:17 2022] GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a => generated 1367 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:18.533721 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-370dd806-a27c-4e17-8729-b981dd95e7c7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:18.534387 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-370dd806-a27c-4e17-8729-b981dd95e7c7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: a0fd9e29-e10d-478a-8caa-1f32e9783550] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:18.549215 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-370dd806-a27c-4e17-8729-b981dd95e7c7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:18.551770 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-370dd806-a27c-4e17-8729-b981dd95e7c7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:18.552462 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-370dd806-a27c-4e17-8729-b981dd95e7c7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:18.553382 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-370dd806-a27c-4e17-8729-b981dd95e7c7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:18.554472 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-370dd806-a27c-4e17-8729-b981dd95e7c7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:18.556880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-370dd806-a27c-4e17-8729-b981dd95e7c7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:19.704623 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-370dd806-a27c-4e17-8729-b981dd95e7c7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:19.719242 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-370dd806-a27c-4e17-8729-b981dd95e7c7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550" status: 200 len: 1508 microversion: 2.1 time: 1.196817 Sep 17 21:09:19.720366 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2118/4319] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:18 2022] GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550 => generated 1508 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:19.730304 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4f1d69fe-868d-4216-a349-54024cce5af4 tempest-FloatingIPDetailsTestJSON-1099318340 tempest-FloatingIPDetailsTestJSON-1099318340-project] Calling method '.version_select at 0x7f25a47133a0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:19.772492 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-916b6414-b20b-4baf-b086-5cbb9bdd743d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:09:19.772979 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-916b6414-b20b-4baf-b086-5cbb9bdd743d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:09:19.773494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-916b6414-b20b-4baf-b086-5cbb9bdd743d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:09:19.773894 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-916b6414-b20b-4baf-b086-5cbb9bdd743d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:09:19.774357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-916b6414-b20b-4baf-b086-5cbb9bdd743d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:09:19.793603 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-916b6414-b20b-4baf-b086-5cbb9bdd743d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:19.794427 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-916b6414-b20b-4baf-b086-5cbb9bdd743d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:19.795069 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-916b6414-b20b-4baf-b086-5cbb9bdd743d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:19.798199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-916b6414-b20b-4baf-b086-5cbb9bdd743d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:19.802918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-916b6414-b20b-4baf-b086-5cbb9bdd743d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:19.803745 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-916b6414-b20b-4baf-b086-5cbb9bdd743d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:19.858331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-916b6414-b20b-4baf-b086-5cbb9bdd743d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Getting quotas for project 0b6f25c3540546bf9bffd5610f4f86c8. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:09:19.879196 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-916b6414-b20b-4baf-b086-5cbb9bdd743d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Getting quotas for user 784233ee78764e7dbb774d3cb50165e3 and project 0b6f25c3540546bf9bffd5610f4f86c8. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:09:19.912454 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-916b6414-b20b-4baf-b086-5cbb9bdd743d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:09:19.917554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-916b6414-b20b-4baf-b086-5cbb9bdd743d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 59ced39b-33f7-40af-9993-ff41b9bda651] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:09:20.040362 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4f1d69fe-868d-4216-a349-54024cce5af4 tempest-FloatingIPDetailsTestJSON-1099318340 tempest-FloatingIPDetailsTestJSON-1099318340-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.318723 Sep 17 21:09:20.050964 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2119/4320] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Sep 17 21:09:19 2022] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:20.051352 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-916b6414-b20b-4baf-b086-5cbb9bdd743d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.177491 Sep 17 21:09:20.051447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-dcbce923-8a90-4b2f-84ec-8f2159a3ad3a req-c22f0a6a-dd5d-4ec2-9d00-c5c2884b0d7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59016b2c-e625-4f0c-8379-b48d97025cf3", "tag": "09c61392-3418-4f8e-adca-a6a3d5761117"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:20.056182 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2202/4321] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:09:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 2204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:09:20.070633 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-862e85f6-83c3-46ec-a37a-b197cf4f8abe tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:20.071289 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-862e85f6-83c3-46ec-a37a-b197cf4f8abe tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:20.089835 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-dcbce923-8a90-4b2f-84ec-8f2159a3ad3a req-c22f0a6a-dd5d-4ec2-9d00-c5c2884b0d7b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:20.090755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-dcbce923-8a90-4b2f-84ec-8f2159a3ad3a req-c22f0a6a-dd5d-4ec2-9d00-c5c2884b0d7b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:20.091218 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-dcbce923-8a90-4b2f-84ec-8f2159a3ad3a req-c22f0a6a-dd5d-4ec2-9d00-c5c2884b0d7b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:20.109967 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-862e85f6-83c3-46ec-a37a-b197cf4f8abe tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:20.110607 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-862e85f6-83c3-46ec-a37a-b197cf4f8abe tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:20.111084 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-862e85f6-83c3-46ec-a37a-b197cf4f8abe tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:20.111824 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-862e85f6-83c3-46ec-a37a-b197cf4f8abe tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:20.112280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-862e85f6-83c3-46ec-a37a-b197cf4f8abe tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:20.113181 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-862e85f6-83c3-46ec-a37a-b197cf4f8abe tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:20.122106 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-dcbce923-8a90-4b2f-84ec-8f2159a3ad3a req-c22f0a6a-dd5d-4ec2-9d00-c5c2884b0d7b service nova] Creating event network-changed:09c61392-3418-4f8e-adca-a6a3d5761117 for instance 59016b2c-e625-4f0c-8379-b48d97025cf3 on nch2-master-1 Sep 17 21:09:20.135678 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-dcbce923-8a90-4b2f-84ec-8f2159a3ad3a req-c22f0a6a-dd5d-4ec2-9d00-c5c2884b0d7b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092973 Sep 17 21:09:20.138375 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2120/4322] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:20.150326 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-7e906014-0978-4d6b-a6f1-2aacbb55b647 req-eedefafa-2d97-4eb4-b916-8bde6f04b14f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8e3d0a-75b8-40ed-ade5-deffe7b8105a", "name": "network-vif-plugged", "status": "completed", "tag": "555687eb-bade-4e83-8253-ed937a447e79"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:20.181942 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-7e906014-0978-4d6b-a6f1-2aacbb55b647 req-eedefafa-2d97-4eb4-b916-8bde6f04b14f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:20.183030 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-7e906014-0978-4d6b-a6f1-2aacbb55b647 req-eedefafa-2d97-4eb4-b916-8bde6f04b14f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:20.183897 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-7e906014-0978-4d6b-a6f1-2aacbb55b647 req-eedefafa-2d97-4eb4-b916-8bde6f04b14f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:20.205302 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-7e906014-0978-4d6b-a6f1-2aacbb55b647 req-eedefafa-2d97-4eb4-b916-8bde6f04b14f service nova] Creating event network-vif-plugged:555687eb-bade-4e83-8253-ed937a447e79 for instance 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a on nch1-master-1 Sep 17 21:09:20.238500 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-7e906014-0978-4d6b-a6f1-2aacbb55b647 req-eedefafa-2d97-4eb4-b916-8bde6f04b14f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098446 Sep 17 21:09:20.243243 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2121/4323] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:20.250529 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a944c423-46c3-4037-806d-d6d48328e25c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:20.251471 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a944c423-46c3-4037-806d-d6d48328e25c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:20.265029 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:09:20.280289 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a944c423-46c3-4037-806d-d6d48328e25c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:20.283595 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a944c423-46c3-4037-806d-d6d48328e25c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:20.284280 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a944c423-46c3-4037-806d-d6d48328e25c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:20.285700 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a944c423-46c3-4037-806d-d6d48328e25c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:20.287676 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a944c423-46c3-4037-806d-d6d48328e25c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:20.288291 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a944c423-46c3-4037-806d-d6d48328e25c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:20.904171 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-862e85f6-83c3-46ec-a37a-b197cf4f8abe tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:20.930376 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-862e85f6-83c3-46ec-a37a-b197cf4f8abe tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:20.931934 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-862e85f6-83c3-46ec-a37a-b197cf4f8abe tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:20.940123 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a944c423-46c3-4037-806d-d6d48328e25c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:20.949057 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a944c423-46c3-4037-806d-d6d48328e25c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a" status: 200 len: 1367 microversion: 2.1 time: 0.703348 Sep 17 21:09:20.950316 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-862e85f6-83c3-46ec-a37a-b197cf4f8abe tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1879 microversion: 2.42 time: 0.891570 Sep 17 21:09:20.966679 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2122/4325] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:20 2022] GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a => generated 1367 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:20.966843 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2203/4325] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:20 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1879 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:20.981890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-80568f63-a703-4465-bb24-74ca9d61d052 tempest-FloatingIPDetailsTestJSON-1099318340 tempest-FloatingIPDetailsTestJSON-1099318340-project] Calling method '.version_select at 0x7f25a4710790>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:20.982049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7984f196-4bc3-4b2a-8970-402ca057b062 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:20.982049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7984f196-4bc3-4b2a-8970-402ca057b062 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 59ced39b-33f7-40af-9993-ff41b9bda651] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:21.035864 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7984f196-4bc3-4b2a-8970-402ca057b062 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 59ced39b-33f7-40af-9993-ff41b9bda651] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:09:21.070581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7984f196-4bc3-4b2a-8970-402ca057b062 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:21.071259 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7984f196-4bc3-4b2a-8970-402ca057b062 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:21.071795 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7984f196-4bc3-4b2a-8970-402ca057b062 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:21.160382 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-7984f196-4bc3-4b2a-8970-402ca057b062 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lazy-loading 'flavor' on Instance uuid 59ced39b-33f7-40af-9993-ff41b9bda651 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:09:21.190724 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-7984f196-4bc3-4b2a-8970-402ca057b062 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lazy-loading 'system_metadata' on Instance uuid 59ced39b-33f7-40af-9993-ff41b9bda651 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:09:21.291155 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-7984f196-4bc3-4b2a-8970-402ca057b062 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lazy-loading 'metadata' on Instance uuid 59ced39b-33f7-40af-9993-ff41b9bda651 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:09:21.516567 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7984f196-4bc3-4b2a-8970-402ca057b062 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:21.517784 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7984f196-4bc3-4b2a-8970-402ca057b062 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:21.518305 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7984f196-4bc3-4b2a-8970-402ca057b062 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:21.680645 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7984f196-4bc3-4b2a-8970-402ca057b062 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 59ced39b-33f7-40af-9993-ff41b9bda651] Compute host nch2-master-1 not found during service up check, going to local delete instance {{(pid=140524) _delete /opt/stack/nova/nova/compute/api.py:2526}} Sep 17 21:09:21.682440 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7984f196-4bc3-4b2a-8970-402ca057b062 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 59ced39b-33f7-40af-9993-ff41b9bda651] Doing local delete in cell 056db90a-cdd9-42b2-a8c3-cd5ab36662a4(cell1) {{(pid=140524) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 17 21:09:21.686181 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7984f196-4bc3-4b2a-8970-402ca057b062 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:21.687001 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7984f196-4bc3-4b2a-8970-402ca057b062 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:21.687613 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7984f196-4bc3-4b2a-8970-402ca057b062 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:21.688271 ncdv-master-1 devstack@n-api.service[140524]: WARNING nova.compute.api [None req-7984f196-4bc3-4b2a-8970-402ca057b062 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 59ced39b-33f7-40af-9993-ff41b9bda651] instance's host nch2-master-1 is down, deleting from database Sep 17 21:09:21.691839 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-7984f196-4bc3-4b2a-8970-402ca057b062 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lazy-loading 'flavor' on Instance uuid 59ced39b-33f7-40af-9993-ff41b9bda651 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:09:21.733038 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-7984f196-4bc3-4b2a-8970-402ca057b062 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lazy-loading 'metadata' on Instance uuid 59ced39b-33f7-40af-9993-ff41b9bda651 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:09:21.800908 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-7984f196-4bc3-4b2a-8970-402ca057b062 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 59ced39b-33f7-40af-9993-ff41b9bda651] deallocate_for_instance() {{(pid=140524) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 17 21:09:22.096240 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-7984f196-4bc3-4b2a-8970-402ca057b062 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 59ced39b-33f7-40af-9993-ff41b9bda651] Instance cache missing network info. {{(pid=140524) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3300}} Sep 17 21:09:22.105553 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-7984f196-4bc3-4b2a-8970-402ca057b062 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 59ced39b-33f7-40af-9993-ff41b9bda651] Updating instance_info_cache with network_info: [] {{(pid=140524) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 17 21:09:22.286907 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.scheduler.client.report [None req-7984f196-4bc3-4b2a-8970-402ca057b062 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Deleted allocations for instance 59ced39b-33f7-40af-9993-ff41b9bda651 Sep 17 21:09:22.624300 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7984f196-4bc3-4b2a-8970-402ca057b062 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "DELETE /compute/v2.1/servers/59ced39b-33f7-40af-9993-ff41b9bda651" status: 204 len: 0 microversion: 2.1 time: 1.655971 Sep 17 21:09:22.628013 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2204/4326] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:09:20 2022] DELETE /compute/v2.1/servers/59ced39b-33f7-40af-9993-ff41b9bda651 => generated 0 bytes in 1660 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:09:22.646753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3e3716d1-20b0-4bd0-854c-bb3c486b99cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:22.649048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3e3716d1-20b0-4bd0-854c-bb3c486b99cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: a0fd9e29-e10d-478a-8caa-1f32e9783550] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:22.664488 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e3716d1-20b0-4bd0-854c-bb3c486b99cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:22.670945 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e3716d1-20b0-4bd0-854c-bb3c486b99cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:22.671738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e3716d1-20b0-4bd0-854c-bb3c486b99cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:22.680793 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e3716d1-20b0-4bd0-854c-bb3c486b99cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:22.681727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e3716d1-20b0-4bd0-854c-bb3c486b99cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:22.682353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e3716d1-20b0-4bd0-854c-bb3c486b99cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:23.095037 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3e3716d1-20b0-4bd0-854c-bb3c486b99cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:23.111933 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3e3716d1-20b0-4bd0-854c-bb3c486b99cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550" status: 200 len: 1508 microversion: 2.1 time: 0.482204 Sep 17 21:09:23.112547 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2205/4327] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:22 2022] GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550 => generated 1508 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:23.129946 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f99dcbff-562d-4d91-852c-eec54956dc65 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:23.131489 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f99dcbff-562d-4d91-852c-eec54956dc65 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:23.150196 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f99dcbff-562d-4d91-852c-eec54956dc65 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:23.155288 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f99dcbff-562d-4d91-852c-eec54956dc65 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:23.156514 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f99dcbff-562d-4d91-852c-eec54956dc65 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:23.157277 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f99dcbff-562d-4d91-852c-eec54956dc65 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:23.157895 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f99dcbff-562d-4d91-852c-eec54956dc65 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:23.158584 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f99dcbff-562d-4d91-852c-eec54956dc65 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:23.840044 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f99dcbff-562d-4d91-852c-eec54956dc65 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:23.864792 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f99dcbff-562d-4d91-852c-eec54956dc65 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:23.871886 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f99dcbff-562d-4d91-852c-eec54956dc65 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:23.875594 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f99dcbff-562d-4d91-852c-eec54956dc65 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1879 microversion: 2.42 time: 0.760093 Sep 17 21:09:23.877298 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2206/4328] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:23 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1879 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:23.886203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b3f47c13-e8d6-4dd2-8962-739f10c72dd9 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:23.891734 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b3f47c13-e8d6-4dd2-8962-739f10c72dd9 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:23.903219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3f47c13-e8d6-4dd2-8962-739f10c72dd9 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:23.904074 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3f47c13-e8d6-4dd2-8962-739f10c72dd9 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:23.904766 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3f47c13-e8d6-4dd2-8962-739f10c72dd9 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:23.905973 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3f47c13-e8d6-4dd2-8962-739f10c72dd9 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:23.907224 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3f47c13-e8d6-4dd2-8962-739f10c72dd9 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:23.907859 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3f47c13-e8d6-4dd2-8962-739f10c72dd9 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:24.091050 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-80568f63-a703-4465-bb24-74ca9d61d052 tempest-FloatingIPDetailsTestJSON-1099318340 tempest-FloatingIPDetailsTestJSON-1099318340-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/ed212f26-75f5-4ac7-b0cc-05ddaf8005a8" status: 202 len: 0 microversion: 2.1 time: 3.116616 Sep 17 21:09:24.091996 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2123/4329] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Sep 17 21:09:20 2022] DELETE /compute/v2.1/os-floating-ips/ed212f26-75f5-4ac7-b0cc-05ddaf8005a8 => generated 0 bytes in 3125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:09:24.096925 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-3cf1955e-cb98-4a4b-9c44-812f1c09ac7f req-5b548c10-edf8-4aa7-be56-7971b957dcb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59016b2c-e625-4f0c-8379-b48d97025cf3", "tag": "1a947b45-da95-4264-a22c-d46090d6d9a3"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:24.136433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-3cf1955e-cb98-4a4b-9c44-812f1c09ac7f req-5b548c10-edf8-4aa7-be56-7971b957dcb3 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:24.158506 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-3cf1955e-cb98-4a4b-9c44-812f1c09ac7f req-5b548c10-edf8-4aa7-be56-7971b957dcb3 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:24.164781 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-3cf1955e-cb98-4a4b-9c44-812f1c09ac7f req-5b548c10-edf8-4aa7-be56-7971b957dcb3 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:24.188927 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-3cf1955e-cb98-4a4b-9c44-812f1c09ac7f req-5b548c10-edf8-4aa7-be56-7971b957dcb3 service nova] Creating event network-changed:1a947b45-da95-4264-a22c-d46090d6d9a3 for instance 59016b2c-e625-4f0c-8379-b48d97025cf3 on nch2-master-1 Sep 17 21:09:24.196735 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-3cf1955e-cb98-4a4b-9c44-812f1c09ac7f req-5b548c10-edf8-4aa7-be56-7971b957dcb3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103137 Sep 17 21:09:24.198483 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2124/4330] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:24.224548 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2f986708-4dd0-4c4d-b343-521ce84948d6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:24.229320 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2f986708-4dd0-4c4d-b343-521ce84948d6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 59ced39b-33f7-40af-9993-ff41b9bda651] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:24.241583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f986708-4dd0-4c4d-b343-521ce84948d6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:24.242684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f986708-4dd0-4c4d-b343-521ce84948d6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:24.243347 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f986708-4dd0-4c4d-b343-521ce84948d6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:24.244323 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f986708-4dd0-4c4d-b343-521ce84948d6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:24.245006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f986708-4dd0-4c4d-b343-521ce84948d6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:24.245782 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f986708-4dd0-4c4d-b343-521ce84948d6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:24.272049 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-2f986708-4dd0-4c4d-b343-521ce84948d6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] HTTP exception thrown: Instance 59ced39b-33f7-40af-9993-ff41b9bda651 could not be found. Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2f986708-4dd0-4c4d-b343-521ce84948d6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Request method failure captured: Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/59ced39b-33f7-40af-9993-ff41b9bda651 HTTP/1.1 Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjdkx_dUaa7DUi-TKVFHTZsVxQrlexvG4SUZm6N8-RAgW-Hgl4Fm16QKjLB8Smzb7fg0_3Heh2RxRO4DM6alOpTGfM4lDQjx-JBymYUztOAuBANR84PPvzFMKCK9hdlODMbdRT3LVU-maWvSxN-XNtXdSltD2p8By-EmBSmK4dFa6Xo Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersTestJSON-167161476 Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b6f25c3540546bf9bffd5610f4f86c8", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersTestJSON-167161476 Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersTestJSON-167161476 Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersTestJSON-167161476-project Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 784233ee78764e7dbb774d3cb50165e3 Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersTestJSON-167161476-project Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 59ced39b-33f7-40af-9993-ff41b9bda651 could not be found. Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '59ced39b-33f7-40af-9993-ff41b9bda651'} Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59ced39b-33f7-40af-9993-ff41b9bda651 could not be found. Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59ced39b-33f7-40af-9993-ff41b9bda651 could not be found. Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:09:24.274311 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:09:24.278456 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:09:24.278456 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:09:24.278456 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:09:24.278456 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:09:24.278456 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59ced39b-33f7-40af-9993-ff41b9bda651 could not be found. Sep 17 21:09:24.278456 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:09:24.281054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2f986708-4dd0-4c4d-b343-521ce84948d6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Returning 404 to user: Instance 59ced39b-33f7-40af-9993-ff41b9bda651 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:09:24.282263 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2f986708-4dd0-4c4d-b343-521ce84948d6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/59ced39b-33f7-40af-9993-ff41b9bda651" status: 404 len: 111 microversion: 2.1 time: 0.082015 Sep 17 21:09:24.283420 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2125/4331] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:24 2022] GET /compute/v2.1/servers/59ced39b-33f7-40af-9993-ff41b9bda651 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:09:24.297521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1c71f551-cf91-4125-a96f-381079ac6139 tempest-FloatingIPDetailsTestJSON-1099318340 tempest-FloatingIPDetailsTestJSON-1099318340-project] Calling method '.version_select at 0x7f25a4713790>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:24.472935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b3f47c13-e8d6-4dd2-8962-739f10c72dd9 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:24.476893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:09:24.484384 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b3f47c13-e8d6-4dd2-8962-739f10c72dd9 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a" status: 200 len: 1557 microversion: 2.1 time: 0.605113 Sep 17 21:09:24.486899 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2207/4332] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:23 2022] GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a => generated 1557 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:24.492331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-10a22e65-0b38-4b85-a7a8-e5952e629d19 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:24.493448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-10a22e65-0b38-4b85-a7a8-e5952e629d19 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: a0fd9e29-e10d-478a-8caa-1f32e9783550] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:24.533352 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10a22e65-0b38-4b85-a7a8-e5952e629d19 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:24.535142 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10a22e65-0b38-4b85-a7a8-e5952e629d19 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:24.536124 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10a22e65-0b38-4b85-a7a8-e5952e629d19 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:24.538501 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10a22e65-0b38-4b85-a7a8-e5952e629d19 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:24.540270 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10a22e65-0b38-4b85-a7a8-e5952e629d19 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:24.540863 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10a22e65-0b38-4b85-a7a8-e5952e629d19 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:25.768504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-10a22e65-0b38-4b85-a7a8-e5952e629d19 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:25.779579 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-10a22e65-0b38-4b85-a7a8-e5952e629d19 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550" status: 200 len: 1508 microversion: 2.1 time: 1.291186 Sep 17 21:09:25.786409 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2208/4333] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:24 2022] GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550 => generated 1508 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:25.792855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6bbad08f-62f8-4eac-839e-14eb452fb158 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-665343681", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "ff632525-8d7d-4854-beaf-dc49c77bdd36"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:25.915618 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-6bbad08f-62f8-4eac-839e-14eb452fb158 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] validate_networks() for [('ff632525-8d7d-4854-beaf-dc49c77bdd36', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:09:27.268557 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-6bbad08f-62f8-4eac-839e-14eb452fb158 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:09:27.269311 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-6bbad08f-62f8-4eac-839e-14eb452fb158 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:09:27.269452 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-6bbad08f-62f8-4eac-839e-14eb452fb158 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:09:27.270844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-6bbad08f-62f8-4eac-839e-14eb452fb158 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:09:27.271445 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-6bbad08f-62f8-4eac-839e-14eb452fb158 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:09:27.368762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6bbad08f-62f8-4eac-839e-14eb452fb158 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:27.369267 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6bbad08f-62f8-4eac-839e-14eb452fb158 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:27.369972 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6bbad08f-62f8-4eac-839e-14eb452fb158 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:27.371296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6bbad08f-62f8-4eac-839e-14eb452fb158 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:27.371575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6bbad08f-62f8-4eac-839e-14eb452fb158 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:27.372054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6bbad08f-62f8-4eac-839e-14eb452fb158 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:27.407991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-6bbad08f-62f8-4eac-839e-14eb452fb158 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Getting quotas for project 0b6f25c3540546bf9bffd5610f4f86c8. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:09:27.418336 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-6bbad08f-62f8-4eac-839e-14eb452fb158 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Getting quotas for user 784233ee78764e7dbb774d3cb50165e3 and project 0b6f25c3540546bf9bffd5610f4f86c8. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:09:27.439583 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6bbad08f-62f8-4eac-839e-14eb452fb158 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:09:27.445007 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6bbad08f-62f8-4eac-839e-14eb452fb158 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 23fc7ecb-5658-4a6b-b313-5049d3b1e90d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:09:27.549084 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6bbad08f-62f8-4eac-839e-14eb452fb158 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.760701 Sep 17 21:09:27.550442 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2209/4334] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:09:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:09:27.556065 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ce6ad0ab-0d08-4d28-904e-23ab91d231ca tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:27.562224 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ce6ad0ab-0d08-4d28-904e-23ab91d231ca tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:27.572198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce6ad0ab-0d08-4d28-904e-23ab91d231ca tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:27.573048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce6ad0ab-0d08-4d28-904e-23ab91d231ca tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:27.573682 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce6ad0ab-0d08-4d28-904e-23ab91d231ca tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:27.574543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce6ad0ab-0d08-4d28-904e-23ab91d231ca tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:27.575682 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce6ad0ab-0d08-4d28-904e-23ab91d231ca tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:27.576371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce6ad0ab-0d08-4d28-904e-23ab91d231ca tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:27.729905 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1c71f551-cf91-4125-a96f-381079ac6139 tempest-FloatingIPDetailsTestJSON-1099318340 tempest-FloatingIPDetailsTestJSON-1099318340-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/780b1141-4fbb-4274-9178-f99ad18ae875" status: 202 len: 0 microversion: 2.1 time: 3.444892 Sep 17 21:09:27.730501 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2126/4335] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Sep 17 21:09:24 2022] DELETE /compute/v2.1/os-floating-ips/780b1141-4fbb-4274-9178-f99ad18ae875 => generated 0 bytes in 3446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:09:27.746665 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2b15dc62-f0c4-4960-b124-685ddab0579e tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:27.747291 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2b15dc62-f0c4-4960-b124-685ddab0579e tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:27.768716 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b15dc62-f0c4-4960-b124-685ddab0579e tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:27.770022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b15dc62-f0c4-4960-b124-685ddab0579e tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:27.771037 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b15dc62-f0c4-4960-b124-685ddab0579e tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:27.779771 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b15dc62-f0c4-4960-b124-685ddab0579e tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:27.780377 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b15dc62-f0c4-4960-b124-685ddab0579e tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:27.780833 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b15dc62-f0c4-4960-b124-685ddab0579e tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:27.864878 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ce6ad0ab-0d08-4d28-904e-23ab91d231ca tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.312857 Sep 17 21:09:27.865739 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2210/4336] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Sep 17 21:09:27 2022] GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a/os-interface => generated 284 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:27.871296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fc776714-c9a1-4fed-a1c3-0dbcb5e3104c tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:27.872323 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fc776714-c9a1-4fed-a1c3-0dbcb5e3104c tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] [instance: 2a69c3a3-1e33-4ec8-9c49-176bc80889b7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:27.890348 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc776714-c9a1-4fed-a1c3-0dbcb5e3104c tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:27.891176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc776714-c9a1-4fed-a1c3-0dbcb5e3104c tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:27.891768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc776714-c9a1-4fed-a1c3-0dbcb5e3104c tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:27.892728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc776714-c9a1-4fed-a1c3-0dbcb5e3104c tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:27.893391 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc776714-c9a1-4fed-a1c3-0dbcb5e3104c tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:27.894176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc776714-c9a1-4fed-a1c3-0dbcb5e3104c tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:28.070632 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-fc776714-c9a1-4fed-a1c3-0dbcb5e3104c tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lazy-loading 'services' on Instance uuid 2a69c3a3-1e33-4ec8-9c49-176bc80889b7 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:09:28.201301 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2b15dc62-f0c4-4960-b124-685ddab0579e tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:28.212631 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2b15dc62-f0c4-4960-b124-685ddab0579e tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:28.235566 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2b15dc62-f0c4-4960-b124-685ddab0579e tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:28.241788 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2b15dc62-f0c4-4960-b124-685ddab0579e tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1879 microversion: 2.42 time: 0.501160 Sep 17 21:09:28.250245 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2127/4337] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:27 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1879 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:28.279014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-720769cc-ad63-483b-90d5-e274e7ae74ad tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:28.279829 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-720769cc-ad63-483b-90d5-e274e7ae74ad tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: a0fd9e29-e10d-478a-8caa-1f32e9783550] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:28.300065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-720769cc-ad63-483b-90d5-e274e7ae74ad tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:28.303559 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-720769cc-ad63-483b-90d5-e274e7ae74ad tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:28.304232 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-720769cc-ad63-483b-90d5-e274e7ae74ad tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:28.305003 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-720769cc-ad63-483b-90d5-e274e7ae74ad tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:28.308230 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-720769cc-ad63-483b-90d5-e274e7ae74ad tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:28.308922 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-720769cc-ad63-483b-90d5-e274e7ae74ad tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:28.350611 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fc776714-c9a1-4fed-a1c3-0dbcb5e3104c tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7/os-volume_attachments/ab2daf87-1564-4764-b491-1e5192ed5de8" status: 202 len: 0 microversion: 2.1 time: 0.481838 Sep 17 21:09:28.351847 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2211/4338] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Sep 17 21:09:27 2022] DELETE /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7/os-volume_attachments/ab2daf87-1564-4764-b491-1e5192ed5de8 => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:09:28.389866 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-fbde8d8f-e933-40ed-bcbc-d985e458de56 req-3ed24d45-bfd1-49a0-ab41-78e73818fa00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59016b2c-e625-4f0c-8379-b48d97025cf3", "tag": "00603844-1172-4f4d-a0db-a617c5efc641"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:28.433143 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-fbde8d8f-e933-40ed-bcbc-d985e458de56 req-3ed24d45-bfd1-49a0-ab41-78e73818fa00 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:28.437915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-fbde8d8f-e933-40ed-bcbc-d985e458de56 req-3ed24d45-bfd1-49a0-ab41-78e73818fa00 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:28.438872 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-fbde8d8f-e933-40ed-bcbc-d985e458de56 req-3ed24d45-bfd1-49a0-ab41-78e73818fa00 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:28.493225 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-fbde8d8f-e933-40ed-bcbc-d985e458de56 req-3ed24d45-bfd1-49a0-ab41-78e73818fa00 service nova] Creating event network-changed:00603844-1172-4f4d-a0db-a617c5efc641 for instance 59016b2c-e625-4f0c-8379-b48d97025cf3 on nch2-master-1 Sep 17 21:09:28.513732 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-fbde8d8f-e933-40ed-bcbc-d985e458de56 req-3ed24d45-bfd1-49a0-ab41-78e73818fa00 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157473 Sep 17 21:09:28.516786 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2212/4339] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:28.526707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-03dbc229-2adf-4a94-9472-309d6f64f8a9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:28.530670 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-03dbc229-2adf-4a94-9472-309d6f64f8a9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 23fc7ecb-5658-4a6b-b313-5049d3b1e90d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:28.553108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03dbc229-2adf-4a94-9472-309d6f64f8a9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:28.555627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03dbc229-2adf-4a94-9472-309d6f64f8a9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:28.556428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03dbc229-2adf-4a94-9472-309d6f64f8a9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:28.558270 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03dbc229-2adf-4a94-9472-309d6f64f8a9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:28.562156 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03dbc229-2adf-4a94-9472-309d6f64f8a9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:28.564029 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03dbc229-2adf-4a94-9472-309d6f64f8a9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:28.943697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-03dbc229-2adf-4a94-9472-309d6f64f8a9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:28.959422 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-03dbc229-2adf-4a94-9472-309d6f64f8a9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d" status: 200 len: 1224 microversion: 2.1 time: 0.440750 Sep 17 21:09:28.960266 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2213/4340] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:28 2022] GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d => generated 1224 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:28.968936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1c1995b1-bf21-440b-9677-64a3076e7e37 tempest-FloatingIPDetailsTestJSON-1099318340 tempest-FloatingIPDetailsTestJSON-1099318340-project] Calling method '.version_select at 0x7f25a9f04b80>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:29.420055 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-720769cc-ad63-483b-90d5-e274e7ae74ad tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:29.456194 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-720769cc-ad63-483b-90d5-e274e7ae74ad tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550" status: 200 len: 1508 microversion: 2.1 time: 1.202405 Sep 17 21:09:29.461570 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2128/4341] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:28 2022] GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550 => generated 1508 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:29.471489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9516c0b5-46e9-4673-96cd-18e851291ca0 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:29.482548 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9516c0b5-46e9-4673-96cd-18e851291ca0 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:29.503523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9516c0b5-46e9-4673-96cd-18e851291ca0 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:29.507269 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9516c0b5-46e9-4673-96cd-18e851291ca0 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:29.510546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9516c0b5-46e9-4673-96cd-18e851291ca0 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:29.513230 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9516c0b5-46e9-4673-96cd-18e851291ca0 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:29.514914 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9516c0b5-46e9-4673-96cd-18e851291ca0 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:29.516117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9516c0b5-46e9-4673-96cd-18e851291ca0 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:30.383007 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9516c0b5-46e9-4673-96cd-18e851291ca0 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:30.403122 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9516c0b5-46e9-4673-96cd-18e851291ca0 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:30.404695 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9516c0b5-46e9-4673-96cd-18e851291ca0 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:30.406153 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9516c0b5-46e9-4673-96cd-18e851291ca0 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1879 microversion: 2.42 time: 0.940959 Sep 17 21:09:30.411350 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2129/4342] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:29 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1879 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:30.416252 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-146b93cf-a05c-44a5-b491-7d65a8009398 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:30.416773 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-146b93cf-a05c-44a5-b491-7d65a8009398 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] [instance: 2a69c3a3-1e33-4ec8-9c49-176bc80889b7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:30.438147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-146b93cf-a05c-44a5-b491-7d65a8009398 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:30.439465 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-146b93cf-a05c-44a5-b491-7d65a8009398 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:30.439465 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-146b93cf-a05c-44a5-b491-7d65a8009398 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:30.439813 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-146b93cf-a05c-44a5-b491-7d65a8009398 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:30.440281 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-146b93cf-a05c-44a5-b491-7d65a8009398 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:30.440721 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-146b93cf-a05c-44a5-b491-7d65a8009398 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:30.544451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-146b93cf-a05c-44a5-b491-7d65a8009398 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] [instance: 2a69c3a3-1e33-4ec8-9c49-176bc80889b7] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:09:30.743251 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-146b93cf-a05c-44a5-b491-7d65a8009398 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7" status: 204 len: 0 microversion: 2.1 time: 0.329486 Sep 17 21:09:30.744839 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2130/4343] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:09:30 2022] DELETE /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:09:30.755515 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-44806994-5350-43ac-8f59-a778056e8ab4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:30.756297 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-44806994-5350-43ac-8f59-a778056e8ab4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 23fc7ecb-5658-4a6b-b313-5049d3b1e90d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:30.785198 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44806994-5350-43ac-8f59-a778056e8ab4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:30.785747 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44806994-5350-43ac-8f59-a778056e8ab4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:30.786211 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44806994-5350-43ac-8f59-a778056e8ab4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:30.786962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44806994-5350-43ac-8f59-a778056e8ab4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:30.787431 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44806994-5350-43ac-8f59-a778056e8ab4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:30.787873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44806994-5350-43ac-8f59-a778056e8ab4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:30.949122 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-44806994-5350-43ac-8f59-a778056e8ab4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:30.964653 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-44806994-5350-43ac-8f59-a778056e8ab4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d" status: 200 len: 1278 microversion: 2.1 time: 0.211926 Sep 17 21:09:30.965361 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2131/4344] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:30 2022] GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d => generated 1278 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:30.978014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d8ebb219-6bf2-4d9d-9128-cef92974c839 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:30.978014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d8ebb219-6bf2-4d9d-9128-cef92974c839 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: a0fd9e29-e10d-478a-8caa-1f32e9783550] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:30.990840 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8ebb219-6bf2-4d9d-9128-cef92974c839 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:30.993903 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8ebb219-6bf2-4d9d-9128-cef92974c839 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:30.994055 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8ebb219-6bf2-4d9d-9128-cef92974c839 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:30.999894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8ebb219-6bf2-4d9d-9128-cef92974c839 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:31.000550 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8ebb219-6bf2-4d9d-9128-cef92974c839 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:31.001017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8ebb219-6bf2-4d9d-9128-cef92974c839 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:31.511179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d8ebb219-6bf2-4d9d-9128-cef92974c839 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:31.522932 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d8ebb219-6bf2-4d9d-9128-cef92974c839 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550" status: 200 len: 1508 microversion: 2.1 time: 0.556134 Sep 17 21:09:31.524633 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2132/4345] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:30 2022] GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550 => generated 1508 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:31.532939 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-0a528fed-ce20-4a6b-8fe1-5a85a2a90a25 req-e8d60c64-787d-4277-b938-72873b2dd1da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59016b2c-e625-4f0c-8379-b48d97025cf3", "tag": "3797c879-2df9-4ada-b7ff-c6db7404943b"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:31.565986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-0a528fed-ce20-4a6b-8fe1-5a85a2a90a25 req-e8d60c64-787d-4277-b938-72873b2dd1da service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:31.566726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-0a528fed-ce20-4a6b-8fe1-5a85a2a90a25 req-e8d60c64-787d-4277-b938-72873b2dd1da service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:31.567630 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-0a528fed-ce20-4a6b-8fe1-5a85a2a90a25 req-e8d60c64-787d-4277-b938-72873b2dd1da service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:31.586765 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1c1995b1-bf21-440b-9677-64a3076e7e37 tempest-FloatingIPDetailsTestJSON-1099318340 tempest-FloatingIPDetailsTestJSON-1099318340-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/4c038759-4c80-4bd0-916c-00a625db25f1" status: 202 len: 0 microversion: 2.1 time: 2.625173 Sep 17 21:09:31.591429 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2214/4346] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Sep 17 21:09:28 2022] DELETE /compute/v2.1/os-floating-ips/4c038759-4c80-4bd0-916c-00a625db25f1 => generated 0 bytes in 2630 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:09:31.594175 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-0a528fed-ce20-4a6b-8fe1-5a85a2a90a25 req-e8d60c64-787d-4277-b938-72873b2dd1da service nova] Creating event network-changed:3797c879-2df9-4ada-b7ff-c6db7404943b for instance 59016b2c-e625-4f0c-8379-b48d97025cf3 on nch2-master-1 Sep 17 21:09:31.597619 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fa361215-ea1b-4f79-ac4c-2d32f81f1b02 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:31.598471 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fa361215-ea1b-4f79-ac4c-2d32f81f1b02 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] [instance: 2a69c3a3-1e33-4ec8-9c49-176bc80889b7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:31.604540 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-0a528fed-ce20-4a6b-8fe1-5a85a2a90a25 req-e8d60c64-787d-4277-b938-72873b2dd1da service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078163 Sep 17 21:09:31.605636 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2133/4347] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:31.612515 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c797324c-969a-41ae-8a09-c34f4d8b2435 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:31.612515 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c797324c-969a-41ae-8a09-c34f4d8b2435 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:31.617226 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa361215-ea1b-4f79-ac4c-2d32f81f1b02 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:31.619830 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa361215-ea1b-4f79-ac4c-2d32f81f1b02 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:31.620536 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa361215-ea1b-4f79-ac4c-2d32f81f1b02 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:31.622934 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa361215-ea1b-4f79-ac4c-2d32f81f1b02 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:31.623585 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c797324c-969a-41ae-8a09-c34f4d8b2435 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:31.624542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa361215-ea1b-4f79-ac4c-2d32f81f1b02 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:31.625208 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c797324c-969a-41ae-8a09-c34f4d8b2435 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:31.626088 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c797324c-969a-41ae-8a09-c34f4d8b2435 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:31.627104 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c797324c-969a-41ae-8a09-c34f4d8b2435 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:31.629294 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa361215-ea1b-4f79-ac4c-2d32f81f1b02 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:31.629944 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c797324c-969a-41ae-8a09-c34f4d8b2435 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:31.630896 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c797324c-969a-41ae-8a09-c34f4d8b2435 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:32.177105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fa361215-ea1b-4f79-ac4c-2d32f81f1b02 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d03e73a3bed48f6bf61a702f0f41658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1e6b096bb41419c594dcde97e16e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:32.210835 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fa361215-ea1b-4f79-ac4c-2d32f81f1b02 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] 10.222.0.26 "GET /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7" status: 200 len: 1468 microversion: 2.1 time: 0.614126 Sep 17 21:09:32.214742 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2215/4348] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:31 2022] GET /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7 => generated 1468 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:32.238145 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e6d78255-4e00-49a4-8242-6426ade9d50a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:32.239499 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e6d78255-4e00-49a4-8242-6426ade9d50a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 23fc7ecb-5658-4a6b-b313-5049d3b1e90d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:32.250165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6d78255-4e00-49a4-8242-6426ade9d50a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:32.252425 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6d78255-4e00-49a4-8242-6426ade9d50a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:32.255069 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6d78255-4e00-49a4-8242-6426ade9d50a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:32.257924 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6d78255-4e00-49a4-8242-6426ade9d50a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:32.259599 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6d78255-4e00-49a4-8242-6426ade9d50a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:32.260246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e6d78255-4e00-49a4-8242-6426ade9d50a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:32.307715 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c797324c-969a-41ae-8a09-c34f4d8b2435 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:32.327834 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c797324c-969a-41ae-8a09-c34f4d8b2435 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:32.334802 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c797324c-969a-41ae-8a09-c34f4d8b2435 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:32.336222 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c797324c-969a-41ae-8a09-c34f4d8b2435 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1879 microversion: 2.42 time: 0.729446 Sep 17 21:09:32.336838 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2134/4349] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:31 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1879 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:32.524555 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e6d78255-4e00-49a4-8242-6426ade9d50a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:32.537861 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e6d78255-4e00-49a4-8242-6426ade9d50a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d" status: 200 len: 1278 microversion: 2.1 time: 0.321032 Sep 17 21:09:32.540441 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2216/4350] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:32 2022] GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d => generated 1278 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:32.555317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b82a7006-6040-46c2-90d3-bb9cdb4cda59 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:32.558542 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b82a7006-6040-46c2-90d3-bb9cdb4cda59 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: a0fd9e29-e10d-478a-8caa-1f32e9783550] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:32.568498 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b82a7006-6040-46c2-90d3-bb9cdb4cda59 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:32.569116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b82a7006-6040-46c2-90d3-bb9cdb4cda59 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:32.569669 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b82a7006-6040-46c2-90d3-bb9cdb4cda59 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:32.570468 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b82a7006-6040-46c2-90d3-bb9cdb4cda59 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:32.571130 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b82a7006-6040-46c2-90d3-bb9cdb4cda59 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:32.571777 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b82a7006-6040-46c2-90d3-bb9cdb4cda59 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:32.880581 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b82a7006-6040-46c2-90d3-bb9cdb4cda59 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:32.888956 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b82a7006-6040-46c2-90d3-bb9cdb4cda59 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550" status: 200 len: 1508 microversion: 2.1 time: 0.341022 Sep 17 21:09:32.901486 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2135/4351] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:32 2022] GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550 => generated 1508 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:33.200674 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-b7a34b5e-fe32-4f36-917c-d396395b0fa1 req-8cb4a400-4c8a-4514-99d9-948fb9077bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d8e3d0a-75b8-40ed-ade5-deffe7b8105a", "tag": "555687eb-bade-4e83-8253-ed937a447e79"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:33.218647 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b7a34b5e-fe32-4f36-917c-d396395b0fa1 req-8cb4a400-4c8a-4514-99d9-948fb9077bb4 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:33.230320 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b7a34b5e-fe32-4f36-917c-d396395b0fa1 req-8cb4a400-4c8a-4514-99d9-948fb9077bb4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:33.231188 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b7a34b5e-fe32-4f36-917c-d396395b0fa1 req-8cb4a400-4c8a-4514-99d9-948fb9077bb4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:33.239845 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-01d32c73-48e0-4dda-ade1-0970f911bffc tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:33.240884 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-01d32c73-48e0-4dda-ade1-0970f911bffc tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] [instance: 2a69c3a3-1e33-4ec8-9c49-176bc80889b7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:33.250585 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01d32c73-48e0-4dda-ade1-0970f911bffc tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:33.258276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01d32c73-48e0-4dda-ade1-0970f911bffc tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:33.259095 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01d32c73-48e0-4dda-ade1-0970f911bffc tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:33.260081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01d32c73-48e0-4dda-ade1-0970f911bffc tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:33.260836 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01d32c73-48e0-4dda-ade1-0970f911bffc tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:33.261555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01d32c73-48e0-4dda-ade1-0970f911bffc tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:33.284344 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-b7a34b5e-fe32-4f36-917c-d396395b0fa1 req-8cb4a400-4c8a-4514-99d9-948fb9077bb4 service nova] Creating event network-changed:555687eb-bade-4e83-8253-ed937a447e79 for instance 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a on nch1-master-1 Sep 17 21:09:33.317163 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-b7a34b5e-fe32-4f36-917c-d396395b0fa1 req-8cb4a400-4c8a-4514-99d9-948fb9077bb4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114119 Sep 17 21:09:33.324236 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2217/4352] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:33.369846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2b2ec520-863a-49d7-9729-e1b0c5db76c2 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:33.371545 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2b2ec520-863a-49d7-9729-e1b0c5db76c2 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:33.401712 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b2ec520-863a-49d7-9729-e1b0c5db76c2 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:33.405147 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b2ec520-863a-49d7-9729-e1b0c5db76c2 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:33.405679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b2ec520-863a-49d7-9729-e1b0c5db76c2 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:33.406444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b2ec520-863a-49d7-9729-e1b0c5db76c2 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:33.406908 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b2ec520-863a-49d7-9729-e1b0c5db76c2 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:33.413663 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b2ec520-863a-49d7-9729-e1b0c5db76c2 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:33.694276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-01d32c73-48e0-4dda-ade1-0970f911bffc tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d03e73a3bed48f6bf61a702f0f41658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1e6b096bb41419c594dcde97e16e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:33.698931 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:09:33.704070 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-01d32c73-48e0-4dda-ade1-0970f911bffc tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] 10.222.0.26 "GET /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7" status: 200 len: 1468 microversion: 2.1 time: 0.468178 Sep 17 21:09:33.718271 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2136/4353] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:33 2022] GET /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7 => generated 1468 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:09:33.723370 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9858598c-7115-449c-b67f-8fa3b11a0631 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:33.724165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9858598c-7115-449c-b67f-8fa3b11a0631 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 23fc7ecb-5658-4a6b-b313-5049d3b1e90d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:33.741416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9858598c-7115-449c-b67f-8fa3b11a0631 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:33.742130 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9858598c-7115-449c-b67f-8fa3b11a0631 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:33.743094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9858598c-7115-449c-b67f-8fa3b11a0631 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:33.743976 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9858598c-7115-449c-b67f-8fa3b11a0631 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:33.744604 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9858598c-7115-449c-b67f-8fa3b11a0631 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:33.745204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9858598c-7115-449c-b67f-8fa3b11a0631 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:33.897722 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9858598c-7115-449c-b67f-8fa3b11a0631 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:33.914122 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9858598c-7115-449c-b67f-8fa3b11a0631 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d" status: 200 len: 1278 microversion: 2.1 time: 0.194215 Sep 17 21:09:33.915365 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2137/4354] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:33 2022] GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d => generated 1278 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:33.920629 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-dff4c571-ff52-4bac-b1e9-ec6860caeee5 req-3f622a92-1e30-44c6-8671-6072057a6ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59016b2c-e625-4f0c-8379-b48d97025cf3", "tag": "704aa06b-a7ab-4b0e-a2aa-0236fac21382"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:33.941149 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-dff4c571-ff52-4bac-b1e9-ec6860caeee5 req-3f622a92-1e30-44c6-8671-6072057a6ad6 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:33.949757 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-dff4c571-ff52-4bac-b1e9-ec6860caeee5 req-3f622a92-1e30-44c6-8671-6072057a6ad6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:33.950489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-dff4c571-ff52-4bac-b1e9-ec6860caeee5 req-3f622a92-1e30-44c6-8671-6072057a6ad6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:33.968730 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-dff4c571-ff52-4bac-b1e9-ec6860caeee5 req-3f622a92-1e30-44c6-8671-6072057a6ad6 service nova] Creating event network-changed:704aa06b-a7ab-4b0e-a2aa-0236fac21382 for instance 59016b2c-e625-4f0c-8379-b48d97025cf3 on nch2-master-1 Sep 17 21:09:33.984386 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-dff4c571-ff52-4bac-b1e9-ec6860caeee5 req-3f622a92-1e30-44c6-8671-6072057a6ad6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067531 Sep 17 21:09:33.985371 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2138/4355] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:33.998732 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-903e1a09-abed-4115-aa8a-dfb82d5b50c9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:33.999711 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-903e1a09-abed-4115-aa8a-dfb82d5b50c9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: a0fd9e29-e10d-478a-8caa-1f32e9783550] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:34.015401 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-903e1a09-abed-4115-aa8a-dfb82d5b50c9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:34.016192 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-903e1a09-abed-4115-aa8a-dfb82d5b50c9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:34.016853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-903e1a09-abed-4115-aa8a-dfb82d5b50c9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:34.017825 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-903e1a09-abed-4115-aa8a-dfb82d5b50c9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:34.018517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-903e1a09-abed-4115-aa8a-dfb82d5b50c9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:34.019189 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-903e1a09-abed-4115-aa8a-dfb82d5b50c9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:34.082216 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2b2ec520-863a-49d7-9729-e1b0c5db76c2 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:34.096406 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2b2ec520-863a-49d7-9729-e1b0c5db76c2 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:34.098687 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2b2ec520-863a-49d7-9729-e1b0c5db76c2 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:34.099960 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2b2ec520-863a-49d7-9729-e1b0c5db76c2 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1879 microversion: 2.42 time: 0.740400 Sep 17 21:09:34.105958 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2218/4356] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:33 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1879 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:34.401014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-903e1a09-abed-4115-aa8a-dfb82d5b50c9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:34.418394 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-903e1a09-abed-4115-aa8a-dfb82d5b50c9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550" status: 200 len: 1508 microversion: 2.1 time: 0.430749 Sep 17 21:09:34.419583 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2139/4357] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:33 2022] GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550 => generated 1508 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:34.741100 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5be93b5a-2335-4983-acf0-528f26f4a9b8 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:34.741855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5be93b5a-2335-4983-acf0-528f26f4a9b8 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] [instance: 2a69c3a3-1e33-4ec8-9c49-176bc80889b7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:34.755924 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5be93b5a-2335-4983-acf0-528f26f4a9b8 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:34.767831 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5be93b5a-2335-4983-acf0-528f26f4a9b8 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:34.782176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5be93b5a-2335-4983-acf0-528f26f4a9b8 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:34.787146 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5be93b5a-2335-4983-acf0-528f26f4a9b8 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:34.799483 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5be93b5a-2335-4983-acf0-528f26f4a9b8 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:34.801605 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5be93b5a-2335-4983-acf0-528f26f4a9b8 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:34.943118 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-56658503-3eef-445a-8fe6-99bdc016551a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:34.943750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-56658503-3eef-445a-8fe6-99bdc016551a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 23fc7ecb-5658-4a6b-b313-5049d3b1e90d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:34.950709 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56658503-3eef-445a-8fe6-99bdc016551a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:34.951445 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56658503-3eef-445a-8fe6-99bdc016551a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:34.952144 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56658503-3eef-445a-8fe6-99bdc016551a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:34.953115 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56658503-3eef-445a-8fe6-99bdc016551a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:34.953828 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56658503-3eef-445a-8fe6-99bdc016551a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:34.954449 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56658503-3eef-445a-8fe6-99bdc016551a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:35.291561 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5be93b5a-2335-4983-acf0-528f26f4a9b8 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d03e73a3bed48f6bf61a702f0f41658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1e6b096bb41419c594dcde97e16e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:35.300182 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5be93b5a-2335-4983-acf0-528f26f4a9b8 tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] 10.222.0.26 "GET /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7" status: 200 len: 1468 microversion: 2.1 time: 0.562991 Sep 17 21:09:35.308645 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2219/4358] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:34 2022] GET /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7 => generated 1468 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:35.308645 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-efe22202-a11e-44f2-9358-91a55cd65ec8 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:35.308645 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-efe22202-a11e-44f2-9358-91a55cd65ec8 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:35.313798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-efe22202-a11e-44f2-9358-91a55cd65ec8 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:35.314612 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-efe22202-a11e-44f2-9358-91a55cd65ec8 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:35.315073 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-efe22202-a11e-44f2-9358-91a55cd65ec8 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:35.316040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-efe22202-a11e-44f2-9358-91a55cd65ec8 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:35.316392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-efe22202-a11e-44f2-9358-91a55cd65ec8 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:35.316858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-efe22202-a11e-44f2-9358-91a55cd65ec8 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:35.826931 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-56658503-3eef-445a-8fe6-99bdc016551a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:35.839483 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-56658503-3eef-445a-8fe6-99bdc016551a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d" status: 200 len: 1320 microversion: 2.1 time: 0.900101 Sep 17 21:09:35.855526 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2140/4359] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:34 2022] GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d => generated 1320 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:09:35.866628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-caa462b4-9b0f-4e24-b904-58d68f23d542 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:35.867685 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-caa462b4-9b0f-4e24-b904-58d68f23d542 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: a0fd9e29-e10d-478a-8caa-1f32e9783550] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:35.878842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-caa462b4-9b0f-4e24-b904-58d68f23d542 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:35.879780 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-caa462b4-9b0f-4e24-b904-58d68f23d542 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:35.880479 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-caa462b4-9b0f-4e24-b904-58d68f23d542 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:35.881392 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-caa462b4-9b0f-4e24-b904-58d68f23d542 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:35.882122 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-caa462b4-9b0f-4e24-b904-58d68f23d542 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:35.882645 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-caa462b4-9b0f-4e24-b904-58d68f23d542 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:36.213227 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-efe22202-a11e-44f2-9358-91a55cd65ec8 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:36.245275 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-efe22202-a11e-44f2-9358-91a55cd65ec8 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:36.249566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-efe22202-a11e-44f2-9358-91a55cd65ec8 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:36.260823 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-efe22202-a11e-44f2-9358-91a55cd65ec8 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1879 microversion: 2.42 time: 0.958391 Sep 17 21:09:36.261785 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2220/4360] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:35 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1879 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:36.270400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-b107abdc-b494-4cd1-a106-dec293a041aa req-b6faa5dc-baf1-4e6b-8104-ae90881583dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a69c3a3-1e33-4ec8-9c49-176bc80889b7", "name": "network-vif-deleted", "tag": "5bce567d-a349-476d-8d32-93ec77d97908"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:36.283756 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b107abdc-b494-4cd1-a106-dec293a041aa req-b6faa5dc-baf1-4e6b-8104-ae90881583dd service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:36.284703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b107abdc-b494-4cd1-a106-dec293a041aa req-b6faa5dc-baf1-4e6b-8104-ae90881583dd service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:36.285415 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b107abdc-b494-4cd1-a106-dec293a041aa req-b6faa5dc-baf1-4e6b-8104-ae90881583dd service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:36.285905 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-caa462b4-9b0f-4e24-b904-58d68f23d542 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:36.299519 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-caa462b4-9b0f-4e24-b904-58d68f23d542 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550" status: 200 len: 1505 microversion: 2.1 time: 0.442056 Sep 17 21:09:36.300577 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2141/4361] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:35 2022] GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550 => generated 1505 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:36.300735 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-b107abdc-b494-4cd1-a106-dec293a041aa req-b6faa5dc-baf1-4e6b-8104-ae90881583dd service nova] Creating event network-vif-deleted:5bce567d-a349-476d-8d32-93ec77d97908 for instance 2a69c3a3-1e33-4ec8-9c49-176bc80889b7 on nch1-master-1 Sep 17 21:09:36.308192 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-b107abdc-b494-4cd1-a106-dec293a041aa req-b6faa5dc-baf1-4e6b-8104-ae90881583dd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043130 Sep 17 21:09:36.308941 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2221/4362] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:36.324507 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-757168c4-4dfd-4f7b-a4d9-e0d07b6cebbb tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:36.326314 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-757168c4-4dfd-4f7b-a4d9-e0d07b6cebbb tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] [instance: 2a69c3a3-1e33-4ec8-9c49-176bc80889b7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:36.336098 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-757168c4-4dfd-4f7b-a4d9-e0d07b6cebbb tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:36.337659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-757168c4-4dfd-4f7b-a4d9-e0d07b6cebbb tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:36.338428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-757168c4-4dfd-4f7b-a4d9-e0d07b6cebbb tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:36.340028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-757168c4-4dfd-4f7b-a4d9-e0d07b6cebbb tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:36.340508 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-757168c4-4dfd-4f7b-a4d9-e0d07b6cebbb tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:36.340938 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-757168c4-4dfd-4f7b-a4d9-e0d07b6cebbb tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:36.384668 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-757168c4-4dfd-4f7b-a4d9-e0d07b6cebbb tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:36.385219 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-757168c4-4dfd-4f7b-a4d9-e0d07b6cebbb tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:36.385683 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-757168c4-4dfd-4f7b-a4d9-e0d07b6cebbb tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:36.386146 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-757168c4-4dfd-4f7b-a4d9-e0d07b6cebbb tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lazy-loading 'fault' on Instance uuid 2a69c3a3-1e33-4ec8-9c49-176bc80889b7 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:09:36.496303 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-757168c4-4dfd-4f7b-a4d9-e0d07b6cebbb tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d03e73a3bed48f6bf61a702f0f41658', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42e1e6b096bb41419c594dcde97e16e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:36.511892 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-757168c4-4dfd-4f7b-a4d9-e0d07b6cebbb tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] 10.222.0.26 "GET /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7" status: 200 len: 1303 microversion: 2.1 time: 0.186551 Sep 17 21:09:36.511892 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2142/4363] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:36 2022] GET /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7 => generated 1303 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:36.873451 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9f234cb9-5daf-4d1a-945e-a92f6e3ac93b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:36.875527 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9f234cb9-5daf-4d1a-945e-a92f6e3ac93b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 23fc7ecb-5658-4a6b-b313-5049d3b1e90d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:36.886259 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9f234cb9-5daf-4d1a-945e-a92f6e3ac93b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:36.887035 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9f234cb9-5daf-4d1a-945e-a92f6e3ac93b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:36.887612 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9f234cb9-5daf-4d1a-945e-a92f6e3ac93b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:36.888789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9f234cb9-5daf-4d1a-945e-a92f6e3ac93b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:36.908751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9f234cb9-5daf-4d1a-945e-a92f6e3ac93b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:36.909723 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9f234cb9-5daf-4d1a-945e-a92f6e3ac93b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:37.143930 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9f234cb9-5daf-4d1a-945e-a92f6e3ac93b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:37.152772 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9f234cb9-5daf-4d1a-945e-a92f6e3ac93b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d" status: 200 len: 1320 microversion: 2.1 time: 0.287747 Sep 17 21:09:37.168524 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2222/4364] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:36 2022] GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d => generated 1320 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:09:37.292004 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-99280940-10be-465e-b131-dbbc265023b7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:37.293435 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-99280940-10be-465e-b131-dbbc265023b7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:37.301097 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99280940-10be-465e-b131-dbbc265023b7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:37.301828 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99280940-10be-465e-b131-dbbc265023b7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:37.302473 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99280940-10be-465e-b131-dbbc265023b7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:37.303570 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99280940-10be-465e-b131-dbbc265023b7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:37.304249 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99280940-10be-465e-b131-dbbc265023b7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:37.304831 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99280940-10be-465e-b131-dbbc265023b7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:37.324711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-744f8e2c-8003-486c-b584-449f9ccc9535 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:37.326002 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-744f8e2c-8003-486c-b584-449f9ccc9535 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: a0fd9e29-e10d-478a-8caa-1f32e9783550] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:37.331888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:09:37.334556 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-744f8e2c-8003-486c-b584-449f9ccc9535 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:37.336070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-744f8e2c-8003-486c-b584-449f9ccc9535 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:37.336708 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-744f8e2c-8003-486c-b584-449f9ccc9535 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:37.337744 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-744f8e2c-8003-486c-b584-449f9ccc9535 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:37.338347 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-744f8e2c-8003-486c-b584-449f9ccc9535 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:37.338927 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-744f8e2c-8003-486c-b584-449f9ccc9535 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:37.383614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=4 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:09:37.432560 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=16 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:09:37.681974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-99280940-10be-465e-b131-dbbc265023b7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:37.702778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-744f8e2c-8003-486c-b584-449f9ccc9535 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:37.714473 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-744f8e2c-8003-486c-b584-449f9ccc9535 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550" status: 200 len: 1505 microversion: 2.1 time: 0.394043 Sep 17 21:09:37.716316 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-99280940-10be-465e-b131-dbbc265023b7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:37.718405 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2223/4365] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:37 2022] GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550 => generated 1505 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:09:37.720140 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-99280940-10be-465e-b131-dbbc265023b7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:37.724671 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-99280940-10be-465e-b131-dbbc265023b7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1879 microversion: 2.42 time: 0.437090 Sep 17 21:09:37.741808 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2b2722a6-9592-4b26-9718-05decaf7b07c tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:37.749798 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2143/4366] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:37 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1879 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:37.749928 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2b2722a6-9592-4b26-9718-05decaf7b07c tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] [instance: 2a69c3a3-1e33-4ec8-9c49-176bc80889b7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:37.757730 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b2722a6-9592-4b26-9718-05decaf7b07c tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:37.758566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b2722a6-9592-4b26-9718-05decaf7b07c tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:37.759753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b2722a6-9592-4b26-9718-05decaf7b07c tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:37.760980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b2722a6-9592-4b26-9718-05decaf7b07c tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:37.761659 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b2722a6-9592-4b26-9718-05decaf7b07c tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:37.762876 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b2722a6-9592-4b26-9718-05decaf7b07c tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:37.823699 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-2b2722a6-9592-4b26-9718-05decaf7b07c tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] HTTP exception thrown: Instance 2a69c3a3-1e33-4ec8-9c49-176bc80889b7 could not be found. Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2b2722a6-9592-4b26-9718-05decaf7b07c tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Request method failure captured: Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7 HTTP/1.1 Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjdOCHY2dN54SGvFS49qc6MU00wrcxdXRbaV9KkmKDpdXxqlHkUuHUNYIttXP-YB_NSMiMxci9NYYUL45rM6LwEzy4PbVOQexIDzskLKQSFXjXv_X0BTjsQZPoJieAe2kYUlau6fnCLBsZHkpyqtY9blXIAz600YYJpLAu8Trxj916s Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 42e1e6b096bb41419c594dcde97e16e7 Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-VolumesBackupsTest-615004682 Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/42e1e6b096bb41419c594dcde97e16e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/42e1e6b096bb41419c594dcde97e16e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/42e1e6b096bb41419c594dcde97e16e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_42e1e6b096bb41419c594dcde97e16e7", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-VolumesBackupsTest-615004682 Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 42e1e6b096bb41419c594dcde97e16e7 Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-VolumesBackupsTest-615004682 Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-VolumesBackupsTest-615004682-project Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 6d03e73a3bed48f6bf61a702f0f41658 Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-VolumesBackupsTest-615004682-project Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 2a69c3a3-1e33-4ec8-9c49-176bc80889b7 could not be found. Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '2a69c3a3-1e33-4ec8-9c49-176bc80889b7'} Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a69c3a3-1e33-4ec8-9c49-176bc80889b7 could not be found. Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a69c3a3-1e33-4ec8-9c49-176bc80889b7 could not be found. Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:09:37.826866 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:09:37.831661 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:09:37.831661 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:09:37.831661 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:09:37.831661 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:09:37.831661 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:09:37.831661 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a69c3a3-1e33-4ec8-9c49-176bc80889b7 could not be found. Sep 17 21:09:37.831661 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:09:37.831661 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2b2722a6-9592-4b26-9718-05decaf7b07c tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] Returning 404 to user: Instance 2a69c3a3-1e33-4ec8-9c49-176bc80889b7 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:09:37.831661 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2b2722a6-9592-4b26-9718-05decaf7b07c tempest-VolumesBackupsTest-615004682 tempest-VolumesBackupsTest-615004682-project] 10.222.0.26 "GET /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7" status: 404 len: 111 microversion: 2.1 time: 0.110103 Sep 17 21:09:37.833635 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2224/4367] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:37 2022] GET /compute/v2.1/servers/2a69c3a3-1e33-4ec8-9c49-176bc80889b7 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:09:38.176904 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b3753da9-03e7-4356-b80d-0b6d4ae68a1b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:38.177909 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b3753da9-03e7-4356-b80d-0b6d4ae68a1b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 23fc7ecb-5658-4a6b-b313-5049d3b1e90d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:38.185452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3753da9-03e7-4356-b80d-0b6d4ae68a1b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:38.186391 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3753da9-03e7-4356-b80d-0b6d4ae68a1b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:38.187034 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3753da9-03e7-4356-b80d-0b6d4ae68a1b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:38.187924 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3753da9-03e7-4356-b80d-0b6d4ae68a1b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:38.188546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3753da9-03e7-4356-b80d-0b6d4ae68a1b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:38.189135 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3753da9-03e7-4356-b80d-0b6d4ae68a1b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:38.406544 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-e9c05be1-510f-4990-8bc2-c40f7463c1f0 req-492a3098-a558-46d2-a06f-f427cb3687e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23fc7ecb-5658-4a6b-b313-5049d3b1e90d", "tag": "9bd10b54-78f2-4d11-8426-cb65359ed706"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:38.417846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e9c05be1-510f-4990-8bc2-c40f7463c1f0 req-492a3098-a558-46d2-a06f-f427cb3687e5 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:38.418962 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e9c05be1-510f-4990-8bc2-c40f7463c1f0 req-492a3098-a558-46d2-a06f-f427cb3687e5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:38.419584 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e9c05be1-510f-4990-8bc2-c40f7463c1f0 req-492a3098-a558-46d2-a06f-f427cb3687e5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:38.431785 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-e9c05be1-510f-4990-8bc2-c40f7463c1f0 req-492a3098-a558-46d2-a06f-f427cb3687e5 service nova] Creating event network-changed:9bd10b54-78f2-4d11-8426-cb65359ed706 for instance 23fc7ecb-5658-4a6b-b313-5049d3b1e90d on nch2-master-1 Sep 17 21:09:38.437859 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-e9c05be1-510f-4990-8bc2-c40f7463c1f0 req-492a3098-a558-46d2-a06f-f427cb3687e5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035158 Sep 17 21:09:38.439018 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2225/4368] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:09:38.445815 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b3753da9-03e7-4356-b80d-0b6d4ae68a1b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:38.455497 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b3753da9-03e7-4356-b80d-0b6d4ae68a1b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d" status: 200 len: 1320 microversion: 2.1 time: 0.282898 Sep 17 21:09:38.456115 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2144/4369] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:38 2022] GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d => generated 1320 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:38.747872 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3a331f93-fd9d-4e62-9fd8-efd181492535 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:38.749105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3a331f93-fd9d-4e62-9fd8-efd181492535 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: a0fd9e29-e10d-478a-8caa-1f32e9783550] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:38.764695 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d606c95c-9dee-4596-ad87-9002279c7211 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:38.765706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d606c95c-9dee-4596-ad87-9002279c7211 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:38.783372 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d606c95c-9dee-4596-ad87-9002279c7211 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:38.785032 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a331f93-fd9d-4e62-9fd8-efd181492535 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:38.786307 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d606c95c-9dee-4596-ad87-9002279c7211 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:38.786607 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a331f93-fd9d-4e62-9fd8-efd181492535 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:38.787189 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a331f93-fd9d-4e62-9fd8-efd181492535 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:38.788276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d606c95c-9dee-4596-ad87-9002279c7211 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:38.791104 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a331f93-fd9d-4e62-9fd8-efd181492535 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:38.792091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d606c95c-9dee-4596-ad87-9002279c7211 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:38.792990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d606c95c-9dee-4596-ad87-9002279c7211 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:38.793575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a331f93-fd9d-4e62-9fd8-efd181492535 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:38.794893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a331f93-fd9d-4e62-9fd8-efd181492535 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:38.795353 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d606c95c-9dee-4596-ad87-9002279c7211 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:39.526455 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d606c95c-9dee-4596-ad87-9002279c7211 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:39.541118 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d606c95c-9dee-4596-ad87-9002279c7211 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:39.548925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3a331f93-fd9d-4e62-9fd8-efd181492535 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:39.554080 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d606c95c-9dee-4596-ad87-9002279c7211 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:39.555363 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d606c95c-9dee-4596-ad87-9002279c7211 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1879 microversion: 2.42 time: 0.797589 Sep 17 21:09:39.556170 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2145/4370] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:38 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1879 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:39.559350 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3a331f93-fd9d-4e62-9fd8-efd181492535 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550" status: 200 len: 1505 microversion: 2.1 time: 0.821182 Sep 17 21:09:39.559863 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2226/4371] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:38 2022] GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550 => generated 1505 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:39.561222 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-4c4baf14-2d40-404f-a913-8cb272fd5c02 req-84b5af73-c998-4fb4-9e51-39a7a0fd6977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0fd9e29-e10d-478a-8caa-1f32e9783550", "name": "network-vif-unplugged", "status": "completed", "tag": "ef4386dd-dc83-43b4-861a-e9e171dfffcf"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:39.572720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7ae6af47-4f6a-423d-888a-14c54ad247fe tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:39.573630 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7ae6af47-4f6a-423d-888a-14c54ad247fe tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 23fc7ecb-5658-4a6b-b313-5049d3b1e90d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:39.590190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-4c4baf14-2d40-404f-a913-8cb272fd5c02 req-84b5af73-c998-4fb4-9e51-39a7a0fd6977 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:39.590682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-4c4baf14-2d40-404f-a913-8cb272fd5c02 req-84b5af73-c998-4fb4-9e51-39a7a0fd6977 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:39.591303 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-4c4baf14-2d40-404f-a913-8cb272fd5c02 req-84b5af73-c998-4fb4-9e51-39a7a0fd6977 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:39.603678 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7ae6af47-4f6a-423d-888a-14c54ad247fe tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:39.609880 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7ae6af47-4f6a-423d-888a-14c54ad247fe tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:39.610399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7ae6af47-4f6a-423d-888a-14c54ad247fe tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:39.611159 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7ae6af47-4f6a-423d-888a-14c54ad247fe tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:39.611627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7ae6af47-4f6a-423d-888a-14c54ad247fe tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:39.612064 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7ae6af47-4f6a-423d-888a-14c54ad247fe tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:39.624252 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-4c4baf14-2d40-404f-a913-8cb272fd5c02 req-84b5af73-c998-4fb4-9e51-39a7a0fd6977 service nova] Creating event network-vif-unplugged:ef4386dd-dc83-43b4-861a-e9e171dfffcf for instance a0fd9e29-e10d-478a-8caa-1f32e9783550 on nch1-master-1 Sep 17 21:09:39.630503 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-4c4baf14-2d40-404f-a913-8cb272fd5c02 req-84b5af73-c998-4fb4-9e51-39a7a0fd6977 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072830 Sep 17 21:09:39.631424 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2146/4372] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:40.035084 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7ae6af47-4f6a-423d-888a-14c54ad247fe tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:40.073333 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7ae6af47-4f6a-423d-888a-14c54ad247fe tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d" status: 200 len: 1320 microversion: 2.1 time: 0.508851 Sep 17 21:09:40.074575 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2227/4373] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:39 2022] GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d => generated 1320 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:40.589057 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f8a439e9-7d62-45ae-953b-f78286f0f1bc tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:40.591527 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f8a439e9-7d62-45ae-953b-f78286f0f1bc tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: a0fd9e29-e10d-478a-8caa-1f32e9783550] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:40.595144 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-85a4fabc-0409-45f9-9b48-4f91eb6e4eeb tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:40.597066 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-85a4fabc-0409-45f9-9b48-4f91eb6e4eeb tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:40.614458 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8a439e9-7d62-45ae-953b-f78286f0f1bc tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:40.614962 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8a439e9-7d62-45ae-953b-f78286f0f1bc tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:40.615417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8a439e9-7d62-45ae-953b-f78286f0f1bc tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:40.616140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8a439e9-7d62-45ae-953b-f78286f0f1bc tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:40.616600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8a439e9-7d62-45ae-953b-f78286f0f1bc tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:40.617026 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8a439e9-7d62-45ae-953b-f78286f0f1bc tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:40.630638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-85a4fabc-0409-45f9-9b48-4f91eb6e4eeb tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:40.631214 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-85a4fabc-0409-45f9-9b48-4f91eb6e4eeb tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:40.634266 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-85a4fabc-0409-45f9-9b48-4f91eb6e4eeb tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:40.635106 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-85a4fabc-0409-45f9-9b48-4f91eb6e4eeb tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:40.635591 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-85a4fabc-0409-45f9-9b48-4f91eb6e4eeb tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:40.636039 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-85a4fabc-0409-45f9-9b48-4f91eb6e4eeb tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:41.613222 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-85a4fabc-0409-45f9-9b48-4f91eb6e4eeb tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:41.617341 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f8a439e9-7d62-45ae-953b-f78286f0f1bc tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:41.631369 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-85a4fabc-0409-45f9-9b48-4f91eb6e4eeb tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:41.633095 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-85a4fabc-0409-45f9-9b48-4f91eb6e4eeb tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:41.634664 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-85a4fabc-0409-45f9-9b48-4f91eb6e4eeb tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1879 microversion: 2.42 time: 1.053983 Sep 17 21:09:41.635437 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f8a439e9-7d62-45ae-953b-f78286f0f1bc tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550" status: 200 len: 1448 microversion: 2.1 time: 1.051010 Sep 17 21:09:41.637500 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2147/4374] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:40 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1879 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:41.641632 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2228/4375] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:40 2022] GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550 => generated 1448 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:41.645323 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9c0194c7-c066-4f8c-884e-73f87947c072 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:41.646182 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9c0194c7-c066-4f8c-884e-73f87947c072 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 23fc7ecb-5658-4a6b-b313-5049d3b1e90d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:41.663198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e38e1ab8-8963-4253-822f-4abe43a24cde tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:41.663437 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9c0194c7-c066-4f8c-884e-73f87947c072 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:41.664173 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e38e1ab8-8963-4253-822f-4abe43a24cde tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:41.665855 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9c0194c7-c066-4f8c-884e-73f87947c072 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:41.666919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9c0194c7-c066-4f8c-884e-73f87947c072 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:41.668594 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9c0194c7-c066-4f8c-884e-73f87947c072 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:41.669350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9c0194c7-c066-4f8c-884e-73f87947c072 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:41.670065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9c0194c7-c066-4f8c-884e-73f87947c072 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:41.679923 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e38e1ab8-8963-4253-822f-4abe43a24cde tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:41.680432 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e38e1ab8-8963-4253-822f-4abe43a24cde tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:41.680879 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e38e1ab8-8963-4253-822f-4abe43a24cde tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:41.681641 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e38e1ab8-8963-4253-822f-4abe43a24cde tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:41.682105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e38e1ab8-8963-4253-822f-4abe43a24cde tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:41.682535 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e38e1ab8-8963-4253-822f-4abe43a24cde tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:41.698660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:09:41.877315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-e38e1ab8-8963-4253-822f-4abe43a24cde tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lazy-loading 'services' on Instance uuid c2341e0c-be19-4ba1-a137-472f1ecc3915 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:09:42.016198 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9c0194c7-c066-4f8c-884e-73f87947c072 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:42.027627 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9c0194c7-c066-4f8c-884e-73f87947c072 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d" status: 200 len: 1320 microversion: 2.1 time: 0.387436 Sep 17 21:09:42.028593 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2148/4376] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:41 2022] GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d => generated 1320 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:42.035700 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e38e1ab8-8963-4253-822f-4abe43a24cde tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915/os-volume_attachments/5ba7aae4-11cf-4bae-825a-6ea9f7b052fa" status: 202 len: 0 microversion: 2.1 time: 0.392655 Sep 17 21:09:42.036311 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2229/4377] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Sep 17 21:09:41 2022] DELETE /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915/os-volume_attachments/5ba7aae4-11cf-4bae-825a-6ea9f7b052fa => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:09:42.040491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-40a76134-cc7e-4f50-8225-0b0bafeca7a2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:42.045744 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-838f46a4-4371-4569-b748-19c368a24dc1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:42.046533 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-40a76134-cc7e-4f50-8225-0b0bafeca7a2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:42.048123 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-838f46a4-4371-4569-b748-19c368a24dc1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:42.053065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-40a76134-cc7e-4f50-8225-0b0bafeca7a2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:42.055036 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-40a76134-cc7e-4f50-8225-0b0bafeca7a2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:42.055719 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-40a76134-cc7e-4f50-8225-0b0bafeca7a2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:42.056851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-40a76134-cc7e-4f50-8225-0b0bafeca7a2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:42.057540 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-838f46a4-4371-4569-b748-19c368a24dc1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:42.057766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-40a76134-cc7e-4f50-8225-0b0bafeca7a2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:42.058052 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-838f46a4-4371-4569-b748-19c368a24dc1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:42.058492 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-838f46a4-4371-4569-b748-19c368a24dc1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:42.058872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-40a76134-cc7e-4f50-8225-0b0bafeca7a2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:42.059206 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-838f46a4-4371-4569-b748-19c368a24dc1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:42.059659 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-838f46a4-4371-4569-b748-19c368a24dc1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:42.060269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-838f46a4-4371-4569-b748-19c368a24dc1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:42.112329 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-838f46a4-4371-4569-b748-19c368a24dc1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071144 Sep 17 21:09:42.114044 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2230/4378] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 17 21:09:42 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:09:42.478001 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-40a76134-cc7e-4f50-8225-0b0bafeca7a2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:42.492409 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-40a76134-cc7e-4f50-8225-0b0bafeca7a2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.461213 Sep 17 21:09:42.494376 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2149/4379] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:42 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:42.522975 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e1b94a2e-e415-4a41-8c9f-3a9cd43daba7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:42.523936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e1b94a2e-e415-4a41-8c9f-3a9cd43daba7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:42.532194 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1b94a2e-e415-4a41-8c9f-3a9cd43daba7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:42.533173 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1b94a2e-e415-4a41-8c9f-3a9cd43daba7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:42.533893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1b94a2e-e415-4a41-8c9f-3a9cd43daba7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:42.534749 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1b94a2e-e415-4a41-8c9f-3a9cd43daba7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:42.542575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1b94a2e-e415-4a41-8c9f-3a9cd43daba7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:42.543370 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1b94a2e-e415-4a41-8c9f-3a9cd43daba7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:42.669060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7ca7fd18-dbad-49f9-83ea-a76bce1cc9c4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:42.670540 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7ca7fd18-dbad-49f9-83ea-a76bce1cc9c4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:42.682048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ca7fd18-dbad-49f9-83ea-a76bce1cc9c4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:42.685120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ca7fd18-dbad-49f9-83ea-a76bce1cc9c4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:42.685729 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ca7fd18-dbad-49f9-83ea-a76bce1cc9c4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:42.686659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ca7fd18-dbad-49f9-83ea-a76bce1cc9c4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:42.694424 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ca7fd18-dbad-49f9-83ea-a76bce1cc9c4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:42.695016 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ca7fd18-dbad-49f9-83ea-a76bce1cc9c4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:42.958686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e1b94a2e-e415-4a41-8c9f-3a9cd43daba7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:42.971160 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7ca7fd18-dbad-49f9-83ea-a76bce1cc9c4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:42.973355 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e1b94a2e-e415-4a41-8c9f-3a9cd43daba7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.454124 Sep 17 21:09:42.974102 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2231/4380] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:42 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:43.000071 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-85fbaebe-da7f-4768-8276-e310b69fbe88 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:43.000853 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-85fbaebe-da7f-4768-8276-e310b69fbe88 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:43.004744 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7ca7fd18-dbad-49f9-83ea-a76bce1cc9c4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:43.006990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7ca7fd18-dbad-49f9-83ea-a76bce1cc9c4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:43.012583 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7ca7fd18-dbad-49f9-83ea-a76bce1cc9c4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1879 microversion: 2.42 time: 0.349628 Sep 17 21:09:43.012990 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85fbaebe-da7f-4768-8276-e310b69fbe88 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:43.013676 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2150/4381] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:42 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1879 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:09:43.013760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85fbaebe-da7f-4768-8276-e310b69fbe88 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:43.014074 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85fbaebe-da7f-4768-8276-e310b69fbe88 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:43.014894 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85fbaebe-da7f-4768-8276-e310b69fbe88 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:43.015354 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85fbaebe-da7f-4768-8276-e310b69fbe88 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:43.015789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85fbaebe-da7f-4768-8276-e310b69fbe88 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:43.055481 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e42fb54e-8595-4df4-88b8-cdb4bfc77a2e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:43.056397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e42fb54e-8595-4df4-88b8-cdb4bfc77a2e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 23fc7ecb-5658-4a6b-b313-5049d3b1e90d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:43.067572 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e42fb54e-8595-4df4-88b8-cdb4bfc77a2e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:43.069019 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e42fb54e-8595-4df4-88b8-cdb4bfc77a2e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:43.071429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e42fb54e-8595-4df4-88b8-cdb4bfc77a2e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:43.072398 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e42fb54e-8595-4df4-88b8-cdb4bfc77a2e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:43.073052 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e42fb54e-8595-4df4-88b8-cdb4bfc77a2e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:43.076805 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e42fb54e-8595-4df4-88b8-cdb4bfc77a2e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:43.282652 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-85fbaebe-da7f-4768-8276-e310b69fbe88 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:43.294538 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-85fbaebe-da7f-4768-8276-e310b69fbe88 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.298313 Sep 17 21:09:43.309515 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2232/4382] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:42 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:09:43.311968 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b0d10114-5dab-4725-b4d8-837c42fb3c0f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:43.320316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b0d10114-5dab-4725-b4d8-837c42fb3c0f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:43.335130 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e42fb54e-8595-4df4-88b8-cdb4bfc77a2e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:43.337281 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b0d10114-5dab-4725-b4d8-837c42fb3c0f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:43.342133 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b0d10114-5dab-4725-b4d8-837c42fb3c0f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:43.342957 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b0d10114-5dab-4725-b4d8-837c42fb3c0f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:43.343869 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b0d10114-5dab-4725-b4d8-837c42fb3c0f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:43.344629 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b0d10114-5dab-4725-b4d8-837c42fb3c0f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:43.345251 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b0d10114-5dab-4725-b4d8-837c42fb3c0f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:43.347911 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e42fb54e-8595-4df4-88b8-cdb4bfc77a2e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d" status: 200 len: 1320 microversion: 2.1 time: 0.294251 Sep 17 21:09:43.362625 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2151/4383] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:43 2022] GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d => generated 1320 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:09:43.376761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9981d873-4a35-4a7c-8798-ebee2948ef4b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:43.376761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9981d873-4a35-4a7c-8798-ebee2948ef4b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:43.390566 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9981d873-4a35-4a7c-8798-ebee2948ef4b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:43.391119 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9981d873-4a35-4a7c-8798-ebee2948ef4b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:43.391577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9981d873-4a35-4a7c-8798-ebee2948ef4b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:43.392442 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9981d873-4a35-4a7c-8798-ebee2948ef4b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:43.393348 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9981d873-4a35-4a7c-8798-ebee2948ef4b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:43.393819 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9981d873-4a35-4a7c-8798-ebee2948ef4b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:43.434697 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b0d10114-5dab-4725-b4d8-837c42fb3c0f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134174 Sep 17 21:09:43.435545 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2233/4384] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 17 21:09:43 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:43.615539 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9981d873-4a35-4a7c-8798-ebee2948ef4b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:43.634363 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9981d873-4a35-4a7c-8798-ebee2948ef4b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.270474 Sep 17 21:09:43.635479 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2152/4385] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:43 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:43.661438 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-106f6e26-e90b-4767-84bb-d31d8b55c9d4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:43.682810 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-106f6e26-e90b-4767-84bb-d31d8b55c9d4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:43.683311 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-106f6e26-e90b-4767-84bb-d31d8b55c9d4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:43.683761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-106f6e26-e90b-4767-84bb-d31d8b55c9d4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:43.731293 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-106f6e26-e90b-4767-84bb-d31d8b55c9d4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Going to try to stop instance {{(pid=140524) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 17 21:09:43.827413 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-106f6e26-e90b-4767-84bb-d31d8b55c9d4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action" status: 202 len: 0 microversion: 2.1 time: 0.169325 Sep 17 21:09:43.831842 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2234/4386] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:09:43 2022] POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:09:43.839895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-efc1a2b1-acca-414e-b565-d5e3d59bfe73 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:43.841116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-efc1a2b1-acca-414e-b565-d5e3d59bfe73 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:43.859178 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-efc1a2b1-acca-414e-b565-d5e3d59bfe73 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:43.860467 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-efc1a2b1-acca-414e-b565-d5e3d59bfe73 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:43.861856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-efc1a2b1-acca-414e-b565-d5e3d59bfe73 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:43.866644 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-efc1a2b1-acca-414e-b565-d5e3d59bfe73 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:43.868587 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-efc1a2b1-acca-414e-b565-d5e3d59bfe73 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:43.869282 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-efc1a2b1-acca-414e-b565-d5e3d59bfe73 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:44.043666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-44b66001-96f2-463f-ba51-11f9df670fd2 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:44.045019 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-44b66001-96f2-463f-ba51-11f9df670fd2 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:44.057612 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-44b66001-96f2-463f-ba51-11f9df670fd2 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:44.071045 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-44b66001-96f2-463f-ba51-11f9df670fd2 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:44.073971 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-44b66001-96f2-463f-ba51-11f9df670fd2 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:44.076330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-44b66001-96f2-463f-ba51-11f9df670fd2 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:44.080462 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-44b66001-96f2-463f-ba51-11f9df670fd2 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:44.082701 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-44b66001-96f2-463f-ba51-11f9df670fd2 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:44.321270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-efc1a2b1-acca-414e-b565-d5e3d59bfe73 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:44.335402 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-efc1a2b1-acca-414e-b565-d5e3d59bfe73 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1681 microversion: 2.1 time: 0.499281 Sep 17 21:09:44.341216 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2153/4387] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:43 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1681 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:09:44.376840 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-924345ae-84cf-4323-8025-242e2a028164 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:44.377678 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-924345ae-84cf-4323-8025-242e2a028164 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 23fc7ecb-5658-4a6b-b313-5049d3b1e90d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:44.388077 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-924345ae-84cf-4323-8025-242e2a028164 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:44.390959 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-924345ae-84cf-4323-8025-242e2a028164 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:44.395072 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-924345ae-84cf-4323-8025-242e2a028164 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:44.396127 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-924345ae-84cf-4323-8025-242e2a028164 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:44.396944 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-924345ae-84cf-4323-8025-242e2a028164 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:44.397621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-924345ae-84cf-4323-8025-242e2a028164 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:44.446044 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:09:45.115863 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-44b66001-96f2-463f-ba51-11f9df670fd2 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:45.127241 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-44b66001-96f2-463f-ba51-11f9df670fd2 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:45.128677 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-44b66001-96f2-463f-ba51-11f9df670fd2 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:45.129981 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-44b66001-96f2-463f-ba51-11f9df670fd2 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1879 microversion: 2.42 time: 1.090885 Sep 17 21:09:45.144933 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2235/4388] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:44 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1879 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:09:45.155221 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f6b0bd8c-f604-4e66-a592-b2f481e16ea4 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:45.158657 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f6b0bd8c-f604-4e66-a592-b2f481e16ea4 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:45.166513 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6b0bd8c-f604-4e66-a592-b2f481e16ea4 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:45.168021 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6b0bd8c-f604-4e66-a592-b2f481e16ea4 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:45.168816 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6b0bd8c-f604-4e66-a592-b2f481e16ea4 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:45.170045 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6b0bd8c-f604-4e66-a592-b2f481e16ea4 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:45.171430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6b0bd8c-f604-4e66-a592-b2f481e16ea4 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:45.173135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6b0bd8c-f604-4e66-a592-b2f481e16ea4 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:45.183495 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-924345ae-84cf-4323-8025-242e2a028164 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:45.194656 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-924345ae-84cf-4323-8025-242e2a028164 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d" status: 200 len: 1320 microversion: 2.1 time: 0.822880 Sep 17 21:09:45.196031 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2154/4389] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:44 2022] GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d => generated 1320 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:09:45.214986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-7925946f-9afc-4d35-9253-69e2fa11e525 req-53eaa754-3093-4b2b-b74f-558bd2b8887d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23fc7ecb-5658-4a6b-b313-5049d3b1e90d", "name": "network-vif-plugged", "status": "completed", "tag": "9bd10b54-78f2-4d11-8426-cb65359ed706"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:45.227513 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f6b0bd8c-f604-4e66-a592-b2f481e16ea4 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.081192 Sep 17 21:09:45.230346 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-7925946f-9afc-4d35-9253-69e2fa11e525 req-53eaa754-3093-4b2b-b74f-558bd2b8887d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:45.231249 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-7925946f-9afc-4d35-9253-69e2fa11e525 req-53eaa754-3093-4b2b-b74f-558bd2b8887d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:45.232043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-7925946f-9afc-4d35-9253-69e2fa11e525 req-53eaa754-3093-4b2b-b74f-558bd2b8887d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:45.246303 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2236/4390] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 17 21:09:45 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:09:45.265151 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-7925946f-9afc-4d35-9253-69e2fa11e525 req-53eaa754-3093-4b2b-b74f-558bd2b8887d service nova] Creating event network-vif-plugged:9bd10b54-78f2-4d11-8426-cb65359ed706 for instance 23fc7ecb-5658-4a6b-b313-5049d3b1e90d on nch2-master-1 Sep 17 21:09:45.275240 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-7925946f-9afc-4d35-9253-69e2fa11e525 req-53eaa754-3093-4b2b-b74f-558bd2b8887d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077656 Sep 17 21:09:45.276231 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2155/4391] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:45.368464 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a54fa69f-27d4-42c0-9f6f-b7e524ffc930 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:45.369151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a54fa69f-27d4-42c0-9f6f-b7e524ffc930 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:45.380759 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a54fa69f-27d4-42c0-9f6f-b7e524ffc930 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:45.382563 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a54fa69f-27d4-42c0-9f6f-b7e524ffc930 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:45.383023 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a54fa69f-27d4-42c0-9f6f-b7e524ffc930 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:45.387242 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a54fa69f-27d4-42c0-9f6f-b7e524ffc930 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:45.388173 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a54fa69f-27d4-42c0-9f6f-b7e524ffc930 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:45.389683 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a54fa69f-27d4-42c0-9f6f-b7e524ffc930 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:45.425596 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-af817af6-3e5d-4766-88eb-5a53d86ddd4b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:45.429159 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-af817af6-3e5d-4766-88eb-5a53d86ddd4b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:45.444117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af817af6-3e5d-4766-88eb-5a53d86ddd4b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:45.444635 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af817af6-3e5d-4766-88eb-5a53d86ddd4b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:45.445093 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af817af6-3e5d-4766-88eb-5a53d86ddd4b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:45.448506 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af817af6-3e5d-4766-88eb-5a53d86ddd4b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:45.453377 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af817af6-3e5d-4766-88eb-5a53d86ddd4b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:45.454425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af817af6-3e5d-4766-88eb-5a53d86ddd4b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:45.540672 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-af817af6-3e5d-4766-88eb-5a53d86ddd4b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] HTTP exception thrown: Cannot 'reboot' instance ca76130f-7982-4feb-a9d8-9e8f998b509e while it is in vm_state rescued Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-af817af6-3e5d-4766-88eb-5a53d86ddd4b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Request method failure captured: Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e/action HTTP/1.1 Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 28 Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjaiOOC2XD-QIsLuDvG9bxN3jnLjmueVdk28NKERipgg7mZAUnmkYYkUcMWYkcsUdzUwALfMrwKYbIvTbrUxBdv7HTTnMRjY98z2HSanC8PyMI0Bvd8_fsMNUR8WwzuWwOyttA6z4v7owoNPIa2XeOfidHHD5bq9m_itbcIiBCzoH1A Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: f8ed24e4bf6643f7b1474fcec78c4995 Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-533169750 Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ed24e4bf6643f7b1474fcec78c4995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f8ed24e4bf6643f7b1474fcec78c4995"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ed24e4bf6643f7b1474fcec78c4995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f8ed24e4bf6643f7b1474fcec78c4995", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerRescueNegativeTestJSON-533169750 Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: f8ed24e4bf6643f7b1474fcec78c4995 Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-533169750 Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerRescueNegativeTestJSON-533169750-project Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 795813bb461e42ad8c2a758e9b8430d6 Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerRescueNegativeTestJSON-533169750-project Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: {"reboot": {"type": "HARD"}} Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: exception: Cannot 'reboot' instance ca76130f-7982-4feb-a9d8-9e8f998b509e while it is in vm_state rescued Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'ca76130f-7982-4feb-a9d8-9e8f998b509e', 'body': {'reboot': {'type': 'HARD'}}} Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ca76130f-7982-4feb-a9d8-9e8f998b509e in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 17 21:09:45.543450 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 17 21:09:45.548090 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance ca76130f-7982-4feb-a9d8-9e8f998b509e while it is in vm_state rescued Sep 17 21:09:45.548090 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:09:45.548090 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:09:45.548090 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:09:45.548090 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:09:45.548090 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:09:45.548090 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:09:45.548090 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:09:45.548090 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:09:45.548090 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance ca76130f-7982-4feb-a9d8-9e8f998b509e while it is in vm_state rescued Sep 17 21:09:45.548090 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:09:45.552123 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-af817af6-3e5d-4766-88eb-5a53d86ddd4b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Returning 409 to user: Cannot 'reboot' instance ca76130f-7982-4feb-a9d8-9e8f998b509e while it is in vm_state rescued {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:09:45.554145 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-af817af6-3e5d-4766-88eb-5a53d86ddd4b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "POST /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e/action" status: 409 len: 145 microversion: 2.1 time: 0.132050 Sep 17 21:09:45.561430 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2156/4392] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:09:45 2022] POST /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e/action => generated 145 bytes in 137 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 17 21:09:45.588546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3c4448ec-c738-4d29-bca6-259d3f5747e1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:45.596820 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3c4448ec-c738-4d29-bca6-259d3f5747e1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:45.617517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3c4448ec-c738-4d29-bca6-259d3f5747e1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:45.618205 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3c4448ec-c738-4d29-bca6-259d3f5747e1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:45.619221 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3c4448ec-c738-4d29-bca6-259d3f5747e1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:45.620175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3c4448ec-c738-4d29-bca6-259d3f5747e1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:45.620723 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3c4448ec-c738-4d29-bca6-259d3f5747e1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:45.621680 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3c4448ec-c738-4d29-bca6-259d3f5747e1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:45.704611 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-3c4448ec-c738-4d29-bca6-259d3f5747e1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] HTTP exception thrown: Cannot 'rebuild' instance ca76130f-7982-4feb-a9d8-9e8f998b509e while it is in vm_state rescued Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3c4448ec-c738-4d29-bca6-259d3f5747e1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Request method failure captured: Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e/action HTTP/1.1 Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 65 Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjaiOOC2XD-QIsLuDvG9bxN3jnLjmueVdk28NKERipgg7mZAUnmkYYkUcMWYkcsUdzUwALfMrwKYbIvTbrUxBdv7HTTnMRjY98z2HSanC8PyMI0Bvd8_fsMNUR8WwzuWwOyttA6z4v7owoNPIa2XeOfidHHD5bq9m_itbcIiBCzoH1A Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: f8ed24e4bf6643f7b1474fcec78c4995 Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-533169750 Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ed24e4bf6643f7b1474fcec78c4995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f8ed24e4bf6643f7b1474fcec78c4995"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ed24e4bf6643f7b1474fcec78c4995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f8ed24e4bf6643f7b1474fcec78c4995", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerRescueNegativeTestJSON-533169750 Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: f8ed24e4bf6643f7b1474fcec78c4995 Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-533169750 Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerRescueNegativeTestJSON-533169750-project Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 795813bb461e42ad8c2a758e9b8430d6 Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerRescueNegativeTestJSON-533169750-project Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: {"rebuild": {"imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4"}} Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: exception: Cannot 'rebuild' instance ca76130f-7982-4feb-a9d8-9e8f998b509e while it is in vm_state rescued Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'ca76130f-7982-4feb-a9d8-9e8f998b509e', 'body': {'rebuild': {'imageRef': '1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4'}}} Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ca76130f-7982-4feb-a9d8-9e8f998b509e in vm_state rescued. Cannot rebuild while the instance is in this state. Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:09:45.718509 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:09:45.724376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:09:45.724376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 17 21:09:45.724376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Sep 17 21:09:45.724376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 17 21:09:45.724376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 17 21:09:45.724376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 17 21:09:45.724376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance ca76130f-7982-4feb-a9d8-9e8f998b509e while it is in vm_state rescued Sep 17 21:09:45.724376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:09:45.724376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:09:45.724376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:09:45.724376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:09:45.724376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:09:45.724376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:09:45.724376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:09:45.724376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:09:45.724376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance ca76130f-7982-4feb-a9d8-9e8f998b509e while it is in vm_state rescued Sep 17 21:09:45.724376 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:09:45.724376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3c4448ec-c738-4d29-bca6-259d3f5747e1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Returning 409 to user: Cannot 'rebuild' instance ca76130f-7982-4feb-a9d8-9e8f998b509e while it is in vm_state rescued {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:09:45.728846 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3c4448ec-c738-4d29-bca6-259d3f5747e1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "POST /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e/action" status: 409 len: 146 microversion: 2.1 time: 0.161006 Sep 17 21:09:45.735275 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2157/4393] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:09:45 2022] POST /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e/action => generated 146 bytes in 173 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 17 21:09:45.741287 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2d7185ea-437f-4ec6-bcea-6be3318e3f33 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:45.742132 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2d7185ea-437f-4ec6-bcea-6be3318e3f33 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:45.755622 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d7185ea-437f-4ec6-bcea-6be3318e3f33 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:45.756422 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d7185ea-437f-4ec6-bcea-6be3318e3f33 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:45.757407 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d7185ea-437f-4ec6-bcea-6be3318e3f33 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:45.759225 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d7185ea-437f-4ec6-bcea-6be3318e3f33 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:45.760188 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d7185ea-437f-4ec6-bcea-6be3318e3f33 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:45.760884 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d7185ea-437f-4ec6-bcea-6be3318e3f33 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:45.795383 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2d7185ea-437f-4ec6-bcea-6be3318e3f33 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:09:45.860268 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a54fa69f-27d4-42c0-9f6f-b7e524ffc930 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:45.871341 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a54fa69f-27d4-42c0-9f6f-b7e524ffc930 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1681 microversion: 2.1 time: 0.506546 Sep 17 21:09:45.872953 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2237/4394] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:45 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1681 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:45.918638 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2d7185ea-437f-4ec6-bcea-6be3318e3f33 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915" status: 204 len: 0 microversion: 2.1 time: 0.181100 Sep 17 21:09:45.920063 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2158/4395] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:09:45 2022] DELETE /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:09:45.928791 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7287cb97-bb9d-41d2-9432-7675bf6a68fb tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:45.929644 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7287cb97-bb9d-41d2-9432-7675bf6a68fb tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:45.943261 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7287cb97-bb9d-41d2-9432-7675bf6a68fb tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:45.944966 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7287cb97-bb9d-41d2-9432-7675bf6a68fb tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:45.945741 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7287cb97-bb9d-41d2-9432-7675bf6a68fb tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:45.946780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7287cb97-bb9d-41d2-9432-7675bf6a68fb tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:45.947798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7287cb97-bb9d-41d2-9432-7675bf6a68fb tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:45.948473 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7287cb97-bb9d-41d2-9432-7675bf6a68fb tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:46.158696 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2fa86bbe-22a4-41f8-b22a-b95bf4f6d94c tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:46.160970 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2fa86bbe-22a4-41f8-b22a-b95bf4f6d94c tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:46.170470 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2fa86bbe-22a4-41f8-b22a-b95bf4f6d94c tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:46.171681 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2fa86bbe-22a4-41f8-b22a-b95bf4f6d94c tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:46.172392 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2fa86bbe-22a4-41f8-b22a-b95bf4f6d94c tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:46.174609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2fa86bbe-22a4-41f8-b22a-b95bf4f6d94c tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:46.176594 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2fa86bbe-22a4-41f8-b22a-b95bf4f6d94c tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:46.177987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2fa86bbe-22a4-41f8-b22a-b95bf4f6d94c tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:46.206646 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7287cb97-bb9d-41d2-9432-7675bf6a68fb tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:46.219329 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7287cb97-bb9d-41d2-9432-7675bf6a68fb tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915" status: 200 len: 1689 microversion: 2.1 time: 0.295122 Sep 17 21:09:46.219926 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2238/4396] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:45 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 => generated 1689 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:46.247391 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-05317a9e-6e66-4077-b361-c42ad70f7f07 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:46.248496 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-05317a9e-6e66-4077-b361-c42ad70f7f07 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 23fc7ecb-5658-4a6b-b313-5049d3b1e90d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:46.255788 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-05317a9e-6e66-4077-b361-c42ad70f7f07 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:46.256542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-05317a9e-6e66-4077-b361-c42ad70f7f07 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:46.257135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-05317a9e-6e66-4077-b361-c42ad70f7f07 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:46.258074 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-05317a9e-6e66-4077-b361-c42ad70f7f07 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:46.258683 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-05317a9e-6e66-4077-b361-c42ad70f7f07 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:46.259261 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-05317a9e-6e66-4077-b361-c42ad70f7f07 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:46.705117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-05317a9e-6e66-4077-b361-c42ad70f7f07 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:46.717914 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-05317a9e-6e66-4077-b361-c42ad70f7f07 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d" status: 200 len: 1320 microversion: 2.1 time: 0.481143 Sep 17 21:09:46.720588 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2239/4397] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:46 2022] GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d => generated 1320 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:46.755868 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2fa86bbe-22a4-41f8-b22a-b95bf4f6d94c tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:46.780512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2fa86bbe-22a4-41f8-b22a-b95bf4f6d94c tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:46.783413 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2fa86bbe-22a4-41f8-b22a-b95bf4f6d94c tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:46.788551 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2fa86bbe-22a4-41f8-b22a-b95bf4f6d94c tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1879 microversion: 2.42 time: 0.634726 Sep 17 21:09:46.789900 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2159/4398] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:46 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1879 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:09:46.910231 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-774e5e11-b5b2-49d0-b774-d9f23e8921e4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:46.910939 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-774e5e11-b5b2-49d0-b774-d9f23e8921e4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:46.946379 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-774e5e11-b5b2-49d0-b774-d9f23e8921e4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:46.947228 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-774e5e11-b5b2-49d0-b774-d9f23e8921e4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:46.949595 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-774e5e11-b5b2-49d0-b774-d9f23e8921e4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:46.959127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-774e5e11-b5b2-49d0-b774-d9f23e8921e4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:46.962058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-774e5e11-b5b2-49d0-b774-d9f23e8921e4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:46.962944 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-774e5e11-b5b2-49d0-b774-d9f23e8921e4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:47.257044 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-758b4375-fee9-4a64-a98f-effebbcb38c4 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:47.259399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-758b4375-fee9-4a64-a98f-effebbcb38c4 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:47.294777 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-758b4375-fee9-4a64-a98f-effebbcb38c4 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:47.295525 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-758b4375-fee9-4a64-a98f-effebbcb38c4 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:47.296099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-758b4375-fee9-4a64-a98f-effebbcb38c4 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:47.297055 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-758b4375-fee9-4a64-a98f-effebbcb38c4 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:47.297792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-758b4375-fee9-4a64-a98f-effebbcb38c4 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:47.298437 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-758b4375-fee9-4a64-a98f-effebbcb38c4 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:47.494966 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-774e5e11-b5b2-49d0-b774-d9f23e8921e4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:47.511445 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-774e5e11-b5b2-49d0-b774-d9f23e8921e4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1681 microversion: 2.1 time: 0.617775 Sep 17 21:09:47.512331 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2240/4399] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:46 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1681 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:47.662447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-758b4375-fee9-4a64-a98f-effebbcb38c4 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:47.688209 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-758b4375-fee9-4a64-a98f-effebbcb38c4 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915" status: 200 len: 1689 microversion: 2.1 time: 0.443396 Sep 17 21:09:47.689737 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2160/4400] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:47 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 => generated 1689 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:47.753203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b8d179bc-caed-4ceb-a56e-5bea95842627 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:47.753851 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b8d179bc-caed-4ceb-a56e-5bea95842627 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 23fc7ecb-5658-4a6b-b313-5049d3b1e90d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:47.763981 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b8d179bc-caed-4ceb-a56e-5bea95842627 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:47.764495 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b8d179bc-caed-4ceb-a56e-5bea95842627 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:47.769642 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b8d179bc-caed-4ceb-a56e-5bea95842627 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:47.770699 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b8d179bc-caed-4ceb-a56e-5bea95842627 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:47.774283 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b8d179bc-caed-4ceb-a56e-5bea95842627 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:47.775118 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b8d179bc-caed-4ceb-a56e-5bea95842627 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:47.822363 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-77c3ea8e-7d23-48c5-a112-808fafe565e3 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:47.823543 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-77c3ea8e-7d23-48c5-a112-808fafe565e3 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:47.841614 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-77c3ea8e-7d23-48c5-a112-808fafe565e3 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:47.841763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-77c3ea8e-7d23-48c5-a112-808fafe565e3 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:47.842288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-77c3ea8e-7d23-48c5-a112-808fafe565e3 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:47.843052 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-77c3ea8e-7d23-48c5-a112-808fafe565e3 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:47.843522 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-77c3ea8e-7d23-48c5-a112-808fafe565e3 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:47.843963 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-77c3ea8e-7d23-48c5-a112-808fafe565e3 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:48.277493 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b8d179bc-caed-4ceb-a56e-5bea95842627 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:48.304950 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b8d179bc-caed-4ceb-a56e-5bea95842627 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d" status: 200 len: 1320 microversion: 2.1 time: 0.557050 Sep 17 21:09:48.308958 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2241/4401] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:47 2022] GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d => generated 1320 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:48.309890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-77c3ea8e-7d23-48c5-a112-808fafe565e3 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:48.325668 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-77c3ea8e-7d23-48c5-a112-808fafe565e3 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:48.327472 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-77c3ea8e-7d23-48c5-a112-808fafe565e3 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:48.331083 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-77c3ea8e-7d23-48c5-a112-808fafe565e3 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1879 microversion: 2.42 time: 0.513492 Sep 17 21:09:48.333104 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2161/4402] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:47 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1879 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:09:48.541908 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9e4c64d6-219c-43e9-89a0-58df0f0e82ef tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:48.542485 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9e4c64d6-219c-43e9-89a0-58df0f0e82ef tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:48.557048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9e4c64d6-219c-43e9-89a0-58df0f0e82ef tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:48.557580 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9e4c64d6-219c-43e9-89a0-58df0f0e82ef tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:48.558218 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9e4c64d6-219c-43e9-89a0-58df0f0e82ef tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:48.559145 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9e4c64d6-219c-43e9-89a0-58df0f0e82ef tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:48.559760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9e4c64d6-219c-43e9-89a0-58df0f0e82ef tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:48.563852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9e4c64d6-219c-43e9-89a0-58df0f0e82ef tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:48.722401 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5152e570-3320-4119-b83b-da9102d1b70f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:48.725005 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5152e570-3320-4119-b83b-da9102d1b70f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:48.735554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5152e570-3320-4119-b83b-da9102d1b70f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:48.736794 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5152e570-3320-4119-b83b-da9102d1b70f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:48.737633 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5152e570-3320-4119-b83b-da9102d1b70f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:48.740521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5152e570-3320-4119-b83b-da9102d1b70f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:48.741190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5152e570-3320-4119-b83b-da9102d1b70f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:48.741884 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5152e570-3320-4119-b83b-da9102d1b70f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:48.924885 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9e4c64d6-219c-43e9-89a0-58df0f0e82ef tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:48.951745 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9e4c64d6-219c-43e9-89a0-58df0f0e82ef tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1681 microversion: 2.1 time: 0.411928 Sep 17 21:09:48.954292 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2242/4403] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:48 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1681 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:49.155660 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5152e570-3320-4119-b83b-da9102d1b70f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:49.166524 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5152e570-3320-4119-b83b-da9102d1b70f tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915" status: 200 len: 1689 microversion: 2.1 time: 0.457077 Sep 17 21:09:49.167533 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2162/4404] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:48 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 => generated 1689 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:49.345283 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4abc45c3-b95b-4bf4-b465-aaea666b9884 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:49.347360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4abc45c3-b95b-4bf4-b465-aaea666b9884 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 23fc7ecb-5658-4a6b-b313-5049d3b1e90d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:49.355560 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4abc45c3-b95b-4bf4-b465-aaea666b9884 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:49.356048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4abc45c3-b95b-4bf4-b465-aaea666b9884 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:49.356920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4abc45c3-b95b-4bf4-b465-aaea666b9884 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:49.357877 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4abc45c3-b95b-4bf4-b465-aaea666b9884 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:49.358517 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4abc45c3-b95b-4bf4-b465-aaea666b9884 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:49.359188 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4abc45c3-b95b-4bf4-b465-aaea666b9884 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:49.369136 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bbbc923f-195f-4aa0-9d68-682d7ec060f4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:49.369927 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bbbc923f-195f-4aa0-9d68-682d7ec060f4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:49.378051 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bbbc923f-195f-4aa0-9d68-682d7ec060f4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:49.379002 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bbbc923f-195f-4aa0-9d68-682d7ec060f4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:49.379703 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bbbc923f-195f-4aa0-9d68-682d7ec060f4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:49.381428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bbbc923f-195f-4aa0-9d68-682d7ec060f4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:49.382141 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bbbc923f-195f-4aa0-9d68-682d7ec060f4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:49.382816 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bbbc923f-195f-4aa0-9d68-682d7ec060f4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:50.115692 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bbbc923f-195f-4aa0-9d68-682d7ec060f4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:50.137058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4abc45c3-b95b-4bf4-b465-aaea666b9884 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:50.146584 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bbbc923f-195f-4aa0-9d68-682d7ec060f4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:50.155291 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4abc45c3-b95b-4bf4-b465-aaea666b9884 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d" status: 200 len: 1320 microversion: 2.1 time: 0.820719 Sep 17 21:09:50.161922 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2243/4405] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:49 2022] GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d => generated 1320 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:50.163742 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bbbc923f-195f-4aa0-9d68-682d7ec060f4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:50.165261 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bbbc923f-195f-4aa0-9d68-682d7ec060f4 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1879 microversion: 2.42 time: 0.801754 Sep 17 21:09:50.169851 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5dc310b8-49b6-447b-a331-93b61b6d0720 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:50.172456 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2163/4406] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:49 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1879 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:50.180779 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5dc310b8-49b6-447b-a331-93b61b6d0720 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:50.195499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cbffeed7-a4ac-4fe8-9ff1-08796c44078c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:50.196435 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cbffeed7-a4ac-4fe8-9ff1-08796c44078c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:50.209969 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5dc310b8-49b6-447b-a331-93b61b6d0720 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:50.210754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5dc310b8-49b6-447b-a331-93b61b6d0720 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:50.211295 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5dc310b8-49b6-447b-a331-93b61b6d0720 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:50.211997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5dc310b8-49b6-447b-a331-93b61b6d0720 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:50.212460 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5dc310b8-49b6-447b-a331-93b61b6d0720 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:50.212895 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5dc310b8-49b6-447b-a331-93b61b6d0720 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:50.219664 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbffeed7-a4ac-4fe8-9ff1-08796c44078c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:50.220145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbffeed7-a4ac-4fe8-9ff1-08796c44078c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:50.220714 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbffeed7-a4ac-4fe8-9ff1-08796c44078c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:50.221499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbffeed7-a4ac-4fe8-9ff1-08796c44078c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:50.221952 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbffeed7-a4ac-4fe8-9ff1-08796c44078c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:50.222469 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbffeed7-a4ac-4fe8-9ff1-08796c44078c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:50.258287 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:09:51.760720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5dc310b8-49b6-447b-a331-93b61b6d0720 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:51.778828 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5dc310b8-49b6-447b-a331-93b61b6d0720 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1681 microversion: 2.1 time: 1.615328 Sep 17 21:09:51.797253 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2244/4407] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:50 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1681 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:51.803172 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9fdef788-6af3-4336-8b25-b3e349c4b8ca tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:51.804074 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9fdef788-6af3-4336-8b25-b3e349c4b8ca tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 23fc7ecb-5658-4a6b-b313-5049d3b1e90d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:51.811920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9fdef788-6af3-4336-8b25-b3e349c4b8ca tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:51.812766 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9fdef788-6af3-4336-8b25-b3e349c4b8ca tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:51.813373 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9fdef788-6af3-4336-8b25-b3e349c4b8ca tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:51.814473 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9fdef788-6af3-4336-8b25-b3e349c4b8ca tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:51.815182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9fdef788-6af3-4336-8b25-b3e349c4b8ca tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:51.815789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9fdef788-6af3-4336-8b25-b3e349c4b8ca tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:51.833482 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cbffeed7-a4ac-4fe8-9ff1-08796c44078c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:51.849249 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cbffeed7-a4ac-4fe8-9ff1-08796c44078c tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915" status: 200 len: 1689 microversion: 2.1 time: 1.658109 Sep 17 21:09:51.850191 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2164/4408] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:50 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 => generated 1689 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:51.864387 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bcbfe4e3-d93a-4e59-95fd-4178703fffa6 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:51.865414 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bcbfe4e3-d93a-4e59-95fd-4178703fffa6 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:51.867762 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:09:51.876120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bcbfe4e3-d93a-4e59-95fd-4178703fffa6 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:51.877308 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bcbfe4e3-d93a-4e59-95fd-4178703fffa6 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:51.880502 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bcbfe4e3-d93a-4e59-95fd-4178703fffa6 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:51.881622 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bcbfe4e3-d93a-4e59-95fd-4178703fffa6 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:51.882270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bcbfe4e3-d93a-4e59-95fd-4178703fffa6 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:51.882874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bcbfe4e3-d93a-4e59-95fd-4178703fffa6 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:52.425520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9fdef788-6af3-4336-8b25-b3e349c4b8ca tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:52.435017 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9fdef788-6af3-4336-8b25-b3e349c4b8ca tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d" status: 200 len: 1501 microversion: 2.1 time: 0.636071 Sep 17 21:09:52.443311 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2245/4409] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:51 2022] GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d => generated 1501 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:52.475754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8094fc74-8e03-464b-8b93-4319e11351ed tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:52.476638 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8094fc74-8e03-464b-8b93-4319e11351ed tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 23fc7ecb-5658-4a6b-b313-5049d3b1e90d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:52.488359 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8094fc74-8e03-464b-8b93-4319e11351ed tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:52.488878 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8094fc74-8e03-464b-8b93-4319e11351ed tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:52.489322 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8094fc74-8e03-464b-8b93-4319e11351ed tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:52.490069 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8094fc74-8e03-464b-8b93-4319e11351ed tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:52.490621 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8094fc74-8e03-464b-8b93-4319e11351ed tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:52.491176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8094fc74-8e03-464b-8b93-4319e11351ed tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:52.558845 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bcbfe4e3-d93a-4e59-95fd-4178703fffa6 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:52.573688 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bcbfe4e3-d93a-4e59-95fd-4178703fffa6 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:52.580790 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bcbfe4e3-d93a-4e59-95fd-4178703fffa6 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:52.586306 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bcbfe4e3-d93a-4e59-95fd-4178703fffa6 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1879 microversion: 2.42 time: 0.734865 Sep 17 21:09:52.587592 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2165/4410] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:51 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1879 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:52.804233 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-298d2d46-4793-448c-b19e-6283fef97d1e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:52.805240 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-298d2d46-4793-448c-b19e-6283fef97d1e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:52.813376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-298d2d46-4793-448c-b19e-6283fef97d1e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:52.816369 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-298d2d46-4793-448c-b19e-6283fef97d1e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:52.820281 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-298d2d46-4793-448c-b19e-6283fef97d1e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:52.822359 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-298d2d46-4793-448c-b19e-6283fef97d1e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:52.824452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-298d2d46-4793-448c-b19e-6283fef97d1e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:52.826124 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-298d2d46-4793-448c-b19e-6283fef97d1e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:53.036632 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8094fc74-8e03-464b-8b93-4319e11351ed tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:53.048164 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8094fc74-8e03-464b-8b93-4319e11351ed tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d" status: 200 len: 1501 microversion: 2.1 time: 0.579514 Sep 17 21:09:53.049160 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2246/4411] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:52 2022] GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d => generated 1501 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:53.055867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e89ffcf7-20dc-46d9-b019-0c1f650bb240 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:53.056541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e89ffcf7-20dc-46d9-b019-0c1f650bb240 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:53.065737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e89ffcf7-20dc-46d9-b019-0c1f650bb240 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:53.077343 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e89ffcf7-20dc-46d9-b019-0c1f650bb240 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:53.078340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e89ffcf7-20dc-46d9-b019-0c1f650bb240 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:53.079312 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e89ffcf7-20dc-46d9-b019-0c1f650bb240 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:53.080005 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e89ffcf7-20dc-46d9-b019-0c1f650bb240 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:53.080612 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e89ffcf7-20dc-46d9-b019-0c1f650bb240 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:53.576173 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-298d2d46-4793-448c-b19e-6283fef97d1e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:53.600813 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-298d2d46-4793-448c-b19e-6283fef97d1e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1681 microversion: 2.1 time: 0.800677 Sep 17 21:09:53.605494 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2166/4412] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:52 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1681 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:53.612484 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-470cc7fc-00b0-4101-8c13-486f96fb26fe tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:53.613698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-470cc7fc-00b0-4101-8c13-486f96fb26fe tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 23fc7ecb-5658-4a6b-b313-5049d3b1e90d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:53.652968 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-470cc7fc-00b0-4101-8c13-486f96fb26fe tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:53.654173 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-470cc7fc-00b0-4101-8c13-486f96fb26fe tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:53.654940 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-470cc7fc-00b0-4101-8c13-486f96fb26fe tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:53.655962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-470cc7fc-00b0-4101-8c13-486f96fb26fe tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:53.656865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-470cc7fc-00b0-4101-8c13-486f96fb26fe tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:53.666381 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-470cc7fc-00b0-4101-8c13-486f96fb26fe tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:53.739444 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-470cc7fc-00b0-4101-8c13-486f96fb26fe tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 23fc7ecb-5658-4a6b-b313-5049d3b1e90d] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:09:53.834248 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e89ffcf7-20dc-46d9-b019-0c1f650bb240 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:53.853843 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e89ffcf7-20dc-46d9-b019-0c1f650bb240 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915" status: 200 len: 1689 microversion: 2.1 time: 0.802760 Sep 17 21:09:53.855560 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2247/4413] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:53 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 => generated 1689 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:53.861940 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fe8bef8f-17c1-4473-977c-71b01e0f1ce7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:53.862817 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fe8bef8f-17c1-4473-977c-71b01e0f1ce7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:53.872555 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe8bef8f-17c1-4473-977c-71b01e0f1ce7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:53.874369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe8bef8f-17c1-4473-977c-71b01e0f1ce7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:53.875158 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe8bef8f-17c1-4473-977c-71b01e0f1ce7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:53.876991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe8bef8f-17c1-4473-977c-71b01e0f1ce7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:53.878246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe8bef8f-17c1-4473-977c-71b01e0f1ce7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:53.878887 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe8bef8f-17c1-4473-977c-71b01e0f1ce7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:54.003026 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-470cc7fc-00b0-4101-8c13-486f96fb26fe tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "DELETE /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d" status: 204 len: 0 microversion: 2.1 time: 0.395591 Sep 17 21:09:54.003967 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2167/4414] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:09:53 2022] DELETE /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:09:54.020381 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e767e310-4da3-46cb-bb8f-5dcd2a6ea468 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:54.022363 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e767e310-4da3-46cb-bb8f-5dcd2a6ea468 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 23fc7ecb-5658-4a6b-b313-5049d3b1e90d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:54.034360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e767e310-4da3-46cb-bb8f-5dcd2a6ea468 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:54.035077 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e767e310-4da3-46cb-bb8f-5dcd2a6ea468 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:54.040222 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e767e310-4da3-46cb-bb8f-5dcd2a6ea468 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:54.061426 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e767e310-4da3-46cb-bb8f-5dcd2a6ea468 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:54.066193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e767e310-4da3-46cb-bb8f-5dcd2a6ea468 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:54.066607 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e767e310-4da3-46cb-bb8f-5dcd2a6ea468 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:54.712835 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e767e310-4da3-46cb-bb8f-5dcd2a6ea468 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:54.726699 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e767e310-4da3-46cb-bb8f-5dcd2a6ea468 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d" status: 200 len: 1507 microversion: 2.1 time: 0.717021 Sep 17 21:09:54.736044 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2168/4415] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:54 2022] GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d => generated 1507 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:54.760979 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f0857ae8-7937-4d6a-9ba8-f50b1c9f84ab tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:54.764203 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f0857ae8-7937-4d6a-9ba8-f50b1c9f84ab tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:54.769788 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fe8bef8f-17c1-4473-977c-71b01e0f1ce7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:54.780935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0857ae8-7937-4d6a-9ba8-f50b1c9f84ab tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:54.782476 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0857ae8-7937-4d6a-9ba8-f50b1c9f84ab tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:54.783132 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0857ae8-7937-4d6a-9ba8-f50b1c9f84ab tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:54.784056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fe8bef8f-17c1-4473-977c-71b01e0f1ce7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:54.785508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fe8bef8f-17c1-4473-977c-71b01e0f1ce7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:54.786696 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0857ae8-7937-4d6a-9ba8-f50b1c9f84ab tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:54.787399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0857ae8-7937-4d6a-9ba8-f50b1c9f84ab tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:54.790587 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0857ae8-7937-4d6a-9ba8-f50b1c9f84ab tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:54.791785 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fe8bef8f-17c1-4473-977c-71b01e0f1ce7 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1879 microversion: 2.42 time: 0.934819 Sep 17 21:09:54.805862 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2248/4416] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:53 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1879 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:54.827099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:09:54.884850 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e55279fb-f4b9-4ba0-a9ce-f2d2e9dedd28 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:54.885500 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e55279fb-f4b9-4ba0-a9ce-f2d2e9dedd28 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:54.904033 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e55279fb-f4b9-4ba0-a9ce-f2d2e9dedd28 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:54.904798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e55279fb-f4b9-4ba0-a9ce-f2d2e9dedd28 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:54.905427 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e55279fb-f4b9-4ba0-a9ce-f2d2e9dedd28 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:54.906357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e55279fb-f4b9-4ba0-a9ce-f2d2e9dedd28 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:54.906962 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e55279fb-f4b9-4ba0-a9ce-f2d2e9dedd28 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:54.907542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e55279fb-f4b9-4ba0-a9ce-f2d2e9dedd28 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:55.045424 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e55279fb-f4b9-4ba0-a9ce-f2d2e9dedd28 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:55.055163 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e55279fb-f4b9-4ba0-a9ce-f2d2e9dedd28 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915" status: 200 len: 1622 microversion: 2.1 time: 0.174669 Sep 17 21:09:55.056327 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2249/4417] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:54 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 => generated 1622 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:55.141250 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-e67c87eb-968e-4ae7-906d-aede6f70f325 req-510b8b58-e997-41b7-a19c-d52cc001e9e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2341e0c-be19-4ba1-a137-472f1ecc3915", "name": "network-vif-deleted", "tag": "79728522-0106-4867-9b9d-f0a0cc2b1675"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:55.163848 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f0857ae8-7937-4d6a-9ba8-f50b1c9f84ab tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:55.180900 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e67c87eb-968e-4ae7-906d-aede6f70f325 req-510b8b58-e997-41b7-a19c-d52cc001e9e1 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:55.187401 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f0857ae8-7937-4d6a-9ba8-f50b1c9f84ab tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1658 microversion: 2.1 time: 0.449662 Sep 17 21:09:55.194937 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e67c87eb-968e-4ae7-906d-aede6f70f325 req-510b8b58-e997-41b7-a19c-d52cc001e9e1 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:55.195842 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2169/4418] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:54 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1658 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:55.216609 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e67c87eb-968e-4ae7-906d-aede6f70f325 req-510b8b58-e997-41b7-a19c-d52cc001e9e1 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:55.225882 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bbba0316-f9c5-4c91-84e5-1fadbe5e1cfa tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:55.239055 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bbba0316-f9c5-4c91-84e5-1fadbe5e1cfa tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:55.239847 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bbba0316-f9c5-4c91-84e5-1fadbe5e1cfa tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:55.242175 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-e67c87eb-968e-4ae7-906d-aede6f70f325 req-510b8b58-e997-41b7-a19c-d52cc001e9e1 service nova] Creating event network-vif-deleted:79728522-0106-4867-9b9d-f0a0cc2b1675 for instance c2341e0c-be19-4ba1-a137-472f1ecc3915 on nch2-master-1 Sep 17 21:09:55.245598 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bbba0316-f9c5-4c91-84e5-1fadbe5e1cfa tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:55.252186 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-e67c87eb-968e-4ae7-906d-aede6f70f325 req-510b8b58-e997-41b7-a19c-d52cc001e9e1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114861 Sep 17 21:09:55.253125 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2250/4419] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:09:55.324921 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bbba0316-f9c5-4c91-84e5-1fadbe5e1cfa tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Going to try to start instance {{(pid=140523) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 17 21:09:55.434756 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bbba0316-f9c5-4c91-84e5-1fadbe5e1cfa tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action" status: 202 len: 0 microversion: 2.1 time: 0.214341 Sep 17 21:09:55.436694 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2170/4420] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:09:55 2022] POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 17 21:09:55.448915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4ccece72-db33-4d33-b94f-18443de6f694 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:55.450210 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4ccece72-db33-4d33-b94f-18443de6f694 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:55.484227 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ccece72-db33-4d33-b94f-18443de6f694 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:55.485382 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ccece72-db33-4d33-b94f-18443de6f694 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:55.486679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ccece72-db33-4d33-b94f-18443de6f694 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:55.496571 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ccece72-db33-4d33-b94f-18443de6f694 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:55.503754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ccece72-db33-4d33-b94f-18443de6f694 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:55.504640 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ccece72-db33-4d33-b94f-18443de6f694 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:55.754849 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f27ae082-edda-4eca-8932-987cdde8e98b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:55.755913 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f27ae082-edda-4eca-8932-987cdde8e98b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 23fc7ecb-5658-4a6b-b313-5049d3b1e90d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:55.769583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f27ae082-edda-4eca-8932-987cdde8e98b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:55.772532 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f27ae082-edda-4eca-8932-987cdde8e98b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:55.775754 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f27ae082-edda-4eca-8932-987cdde8e98b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:55.778721 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f27ae082-edda-4eca-8932-987cdde8e98b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:55.779465 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f27ae082-edda-4eca-8932-987cdde8e98b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:55.783667 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f27ae082-edda-4eca-8932-987cdde8e98b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:56.435705 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4ccece72-db33-4d33-b94f-18443de6f694 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:56.465330 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4ccece72-db33-4d33-b94f-18443de6f694 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1667 microversion: 2.1 time: 1.022269 Sep 17 21:09:56.466280 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2251/4421] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:55 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1667 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:56.494641 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1d743ea9-5c75-43a2-a55e-95a905df8942 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:56.495731 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1d743ea9-5c75-43a2-a55e-95a905df8942 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:56.504481 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d743ea9-5c75-43a2-a55e-95a905df8942 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:56.505158 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d743ea9-5c75-43a2-a55e-95a905df8942 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:56.505810 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d743ea9-5c75-43a2-a55e-95a905df8942 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:56.506754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d743ea9-5c75-43a2-a55e-95a905df8942 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:56.507540 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d743ea9-5c75-43a2-a55e-95a905df8942 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:56.508286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d743ea9-5c75-43a2-a55e-95a905df8942 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:56.937270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f27ae082-edda-4eca-8932-987cdde8e98b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:56.973795 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f27ae082-edda-4eca-8932-987cdde8e98b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d" status: 200 len: 1507 microversion: 2.1 time: 1.226315 Sep 17 21:09:56.974422 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2171/4422] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:55 2022] GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d => generated 1507 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:09:57.008637 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ac243ecd-887a-4403-b4b2-5a2b69b0dc15 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:57.009307 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ac243ecd-887a-4403-b4b2-5a2b69b0dc15 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: c2341e0c-be19-4ba1-a137-472f1ecc3915] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:57.036553 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac243ecd-887a-4403-b4b2-5a2b69b0dc15 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:57.037325 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac243ecd-887a-4403-b4b2-5a2b69b0dc15 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:57.038069 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac243ecd-887a-4403-b4b2-5a2b69b0dc15 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:57.039000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac243ecd-887a-4403-b4b2-5a2b69b0dc15 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:57.042133 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac243ecd-887a-4403-b4b2-5a2b69b0dc15 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:57.042790 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac243ecd-887a-4403-b4b2-5a2b69b0dc15 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:57.093162 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-ac243ecd-887a-4403-b4b2-5a2b69b0dc15 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] HTTP exception thrown: Instance c2341e0c-be19-4ba1-a137-472f1ecc3915 could not be found. Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ac243ecd-887a-4403-b4b2-5a2b69b0dc15 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Request method failure captured: Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 HTTP/1.1 Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjaiOOC2XD-QIsLuDvG9bxN3jnLjmueVdk28NKERipgg7mZAUnmkYYkUcMWYkcsUdzUwALfMrwKYbIvTbrUxBdv7HTTnMRjY98z2HSanC8PyMI0Bvd8_fsMNUR8WwzuWwOyttA6z4v7owoNPIa2XeOfidHHD5bq9m_itbcIiBCzoH1A Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: f8ed24e4bf6643f7b1474fcec78c4995 Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-533169750 Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ed24e4bf6643f7b1474fcec78c4995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f8ed24e4bf6643f7b1474fcec78c4995"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ed24e4bf6643f7b1474fcec78c4995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f8ed24e4bf6643f7b1474fcec78c4995", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerRescueNegativeTestJSON-533169750 Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: f8ed24e4bf6643f7b1474fcec78c4995 Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-533169750 Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerRescueNegativeTestJSON-533169750-project Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 795813bb461e42ad8c2a758e9b8430d6 Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerRescueNegativeTestJSON-533169750-project Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance c2341e0c-be19-4ba1-a137-472f1ecc3915 could not be found. Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'c2341e0c-be19-4ba1-a137-472f1ecc3915'} Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2341e0c-be19-4ba1-a137-472f1ecc3915 could not be found. Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2341e0c-be19-4ba1-a137-472f1ecc3915 could not be found. Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:09:57.094964 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:09:57.099766 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:09:57.099766 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:09:57.099766 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:09:57.099766 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:09:57.099766 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:09:57.099766 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:09:57.099766 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2341e0c-be19-4ba1-a137-472f1ecc3915 could not be found. Sep 17 21:09:57.099766 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:09:57.099766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ac243ecd-887a-4403-b4b2-5a2b69b0dc15 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Returning 404 to user: Instance c2341e0c-be19-4ba1-a137-472f1ecc3915 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:09:57.114740 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ac243ecd-887a-4403-b4b2-5a2b69b0dc15 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915" status: 404 len: 111 microversion: 2.1 time: 0.138500 Sep 17 21:09:57.115366 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2172/4423] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:56 2022] GET /compute/v2.1/servers/c2341e0c-be19-4ba1-a137-472f1ecc3915 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:09:57.126657 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c0ec54d0-4bd3-4005-a9df-c91753d735a1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '.version_select at 0x7f25a4721d30>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:57.182856 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c0ec54d0-4bd3-4005-a9df-c91753d735a1 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-358040941" status: 202 len: 0 microversion: 2.1 time: 0.060726 Sep 17 21:09:57.187041 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2173/4424] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Sep 17 21:09:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-358040941 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:09:57.195829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1d743ea9-5c75-43a2-a55e-95a905df8942 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:57.206924 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1d743ea9-5c75-43a2-a55e-95a905df8942 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:57.208350 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1d743ea9-5c75-43a2-a55e-95a905df8942 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:57.220402 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1d743ea9-5c75-43a2-a55e-95a905df8942 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1879 microversion: 2.42 time: 0.752705 Sep 17 21:09:57.228102 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2252/4425] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:56 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1879 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:57.496267 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-88caca4b-a5fe-49ae-9ca4-7c36622d95ba tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:57.496951 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-88caca4b-a5fe-49ae-9ca4-7c36622d95ba tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:57.540197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-88caca4b-a5fe-49ae-9ca4-7c36622d95ba tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:57.541193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-88caca4b-a5fe-49ae-9ca4-7c36622d95ba tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:57.543318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-88caca4b-a5fe-49ae-9ca4-7c36622d95ba tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:57.546645 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-88caca4b-a5fe-49ae-9ca4-7c36622d95ba tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:57.559082 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-88caca4b-a5fe-49ae-9ca4-7c36622d95ba tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:57.559590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-88caca4b-a5fe-49ae-9ca4-7c36622d95ba tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:57.840001 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-46d0d827-f6d6-4ac2-8d55-dfcd4684494a req-53234126-87f1-47dd-a8b6-b6d9941ce98f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23fc7ecb-5658-4a6b-b313-5049d3b1e90d", "name": "network-vif-deleted", "tag": "9bd10b54-78f2-4d11-8426-cb65359ed706"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:57.867361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-46d0d827-f6d6-4ac2-8d55-dfcd4684494a req-53234126-87f1-47dd-a8b6-b6d9941ce98f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:57.868298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-46d0d827-f6d6-4ac2-8d55-dfcd4684494a req-53234126-87f1-47dd-a8b6-b6d9941ce98f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:57.869840 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-46d0d827-f6d6-4ac2-8d55-dfcd4684494a req-53234126-87f1-47dd-a8b6-b6d9941ce98f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:57.888316 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-88caca4b-a5fe-49ae-9ca4-7c36622d95ba tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:57.902938 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-88caca4b-a5fe-49ae-9ca4-7c36622d95ba tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.415475 Sep 17 21:09:57.906908 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-46d0d827-f6d6-4ac2-8d55-dfcd4684494a req-53234126-87f1-47dd-a8b6-b6d9941ce98f service nova] Creating event network-vif-deleted:9bd10b54-78f2-4d11-8426-cb65359ed706 for instance 23fc7ecb-5658-4a6b-b313-5049d3b1e90d on nch2-master-1 Sep 17 21:09:57.926620 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2174/4426] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:57 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:57.929827 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-46d0d827-f6d6-4ac2-8d55-dfcd4684494a req-53234126-87f1-47dd-a8b6-b6d9941ce98f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094025 Sep 17 21:09:57.932983 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2253/4427] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:57.935719 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-91f8533b-bbdb-458c-9720-9187a7b72f09 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:57.937504 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-91f8533b-bbdb-458c-9720-9187a7b72f09 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:57.955841 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-91f8533b-bbdb-458c-9720-9187a7b72f09 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:57.957857 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-91f8533b-bbdb-458c-9720-9187a7b72f09 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:57.958332 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-91f8533b-bbdb-458c-9720-9187a7b72f09 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:57.961448 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-91f8533b-bbdb-458c-9720-9187a7b72f09 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:57.961964 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-91f8533b-bbdb-458c-9720-9187a7b72f09 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:57.963860 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-91f8533b-bbdb-458c-9720-9187a7b72f09 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:58.004535 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1843f8e5-6a8b-4855-8388-ddd1b8ab0df7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:58.007411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1843f8e5-6a8b-4855-8388-ddd1b8ab0df7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 23fc7ecb-5658-4a6b-b313-5049d3b1e90d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:58.044404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1843f8e5-6a8b-4855-8388-ddd1b8ab0df7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:58.045411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1843f8e5-6a8b-4855-8388-ddd1b8ab0df7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:58.046918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1843f8e5-6a8b-4855-8388-ddd1b8ab0df7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:58.047967 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1843f8e5-6a8b-4855-8388-ddd1b8ab0df7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:58.049327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1843f8e5-6a8b-4855-8388-ddd1b8ab0df7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:58.052188 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1843f8e5-6a8b-4855-8388-ddd1b8ab0df7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:58.168162 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1843f8e5-6a8b-4855-8388-ddd1b8ab0df7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:58.169313 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1843f8e5-6a8b-4855-8388-ddd1b8ab0df7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:58.173225 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1843f8e5-6a8b-4855-8388-ddd1b8ab0df7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:58.175391 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-1843f8e5-6a8b-4855-8388-ddd1b8ab0df7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lazy-loading 'fault' on Instance uuid 23fc7ecb-5658-4a6b-b313-5049d3b1e90d {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:09:58.408301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1843f8e5-6a8b-4855-8388-ddd1b8ab0df7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:58.427083 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1843f8e5-6a8b-4855-8388-ddd1b8ab0df7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d" status: 200 len: 1310 microversion: 2.1 time: 0.430171 Sep 17 21:09:58.446627 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2254/4428] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:57 2022] GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d => generated 1310 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:09:58.462355 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6f6f72a5-1aa5-49a9-a410-d336fb98e444 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:58.462983 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6f6f72a5-1aa5-49a9-a410-d336fb98e444 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:58.479822 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f6f72a5-1aa5-49a9-a410-d336fb98e444 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:58.480337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f6f72a5-1aa5-49a9-a410-d336fb98e444 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:58.480780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f6f72a5-1aa5-49a9-a410-d336fb98e444 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:58.481727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f6f72a5-1aa5-49a9-a410-d336fb98e444 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:58.482188 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f6f72a5-1aa5-49a9-a410-d336fb98e444 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:58.482663 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f6f72a5-1aa5-49a9-a410-d336fb98e444 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:58.602273 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-91f8533b-bbdb-458c-9720-9187a7b72f09 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:58.614838 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-91f8533b-bbdb-458c-9720-9187a7b72f09 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.684635 Sep 17 21:09:58.615933 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2175/4429] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:57 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:58.651901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-db223ce3-7c85-4f76-992f-a9d2d8bea984 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:58.652443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-db223ce3-7c85-4f76-992f-a9d2d8bea984 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:58.679725 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db223ce3-7c85-4f76-992f-a9d2d8bea984 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:58.680230 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db223ce3-7c85-4f76-992f-a9d2d8bea984 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:58.684555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db223ce3-7c85-4f76-992f-a9d2d8bea984 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:58.685385 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db223ce3-7c85-4f76-992f-a9d2d8bea984 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:58.685947 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db223ce3-7c85-4f76-992f-a9d2d8bea984 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:58.686403 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db223ce3-7c85-4f76-992f-a9d2d8bea984 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:58.739271 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-db223ce3-7c85-4f76-992f-a9d2d8bea984 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a/ips" status: 200 len: 150 microversion: 2.1 time: 0.105989 Sep 17 21:09:58.745367 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2176/4430] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Sep 17 21:09:58 2022] GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a/ips => generated 150 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:58.770936 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6f75f90c-286a-42d7-9bbd-2fb0ce0ed2c5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:58.777714 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6f75f90c-286a-42d7-9bbd-2fb0ce0ed2c5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:58.807856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6f75f90c-286a-42d7-9bbd-2fb0ce0ed2c5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:58.808612 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6f75f90c-286a-42d7-9bbd-2fb0ce0ed2c5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:58.809435 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6f75f90c-286a-42d7-9bbd-2fb0ce0ed2c5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:58.810351 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6f75f90c-286a-42d7-9bbd-2fb0ce0ed2c5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:58.811073 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6f75f90c-286a-42d7-9bbd-2fb0ce0ed2c5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:58.812481 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6f75f90c-286a-42d7-9bbd-2fb0ce0ed2c5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:59.469990 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6f6f72a5-1aa5-49a9-a410-d336fb98e444 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:59.498604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6f6f72a5-1aa5-49a9-a410-d336fb98e444 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:59.508476 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6f6f72a5-1aa5-49a9-a410-d336fb98e444 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:59.509934 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6f6f72a5-1aa5-49a9-a410-d336fb98e444 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1879 microversion: 2.42 time: 1.061990 Sep 17 21:09:59.512527 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2255/4431] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:09:58 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1879 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:09:59.551889 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4385796d-f586-4b82-a292-9d08fc599cba tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:59.555969 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4385796d-f586-4b82-a292-9d08fc599cba tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 23fc7ecb-5658-4a6b-b313-5049d3b1e90d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:59.576211 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4385796d-f586-4b82-a292-9d08fc599cba tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:59.577106 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4385796d-f586-4b82-a292-9d08fc599cba tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:59.589511 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4385796d-f586-4b82-a292-9d08fc599cba tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:59.591447 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4385796d-f586-4b82-a292-9d08fc599cba tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:59.592231 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4385796d-f586-4b82-a292-9d08fc599cba tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:59.593146 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4385796d-f586-4b82-a292-9d08fc599cba tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:59.646918 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-4385796d-f586-4b82-a292-9d08fc599cba tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] HTTP exception thrown: Instance 23fc7ecb-5658-4a6b-b313-5049d3b1e90d could not be found. Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4385796d-f586-4b82-a292-9d08fc599cba tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Request method failure captured: Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d HTTP/1.1 Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjdkx_dUaa7DUi-TKVFHTZsVxQrlexvG4SUZm6N8-RAgW-Hgl4Fm16QKjLB8Smzb7fg0_3Heh2RxRO4DM6alOpTGfM4lDQjx-JBymYUztOAuBANR84PPvzFMKCK9hdlODMbdRT3LVU-maWvSxN-XNtXdSltD2p8By-EmBSmK4dFa6Xo Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersTestJSON-167161476 Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b6f25c3540546bf9bffd5610f4f86c8", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersTestJSON-167161476 Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersTestJSON-167161476 Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersTestJSON-167161476-project Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 784233ee78764e7dbb774d3cb50165e3 Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersTestJSON-167161476-project Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 23fc7ecb-5658-4a6b-b313-5049d3b1e90d could not be found. Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '23fc7ecb-5658-4a6b-b313-5049d3b1e90d'} Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23fc7ecb-5658-4a6b-b313-5049d3b1e90d could not be found. Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23fc7ecb-5658-4a6b-b313-5049d3b1e90d could not be found. Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:09:59.657843 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:09:59.663130 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:09:59.663130 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:09:59.663130 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:09:59.663130 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:09:59.663130 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23fc7ecb-5658-4a6b-b313-5049d3b1e90d could not be found. Sep 17 21:09:59.663130 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:09:59.663130 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4385796d-f586-4b82-a292-9d08fc599cba tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Returning 404 to user: Instance 23fc7ecb-5658-4a6b-b313-5049d3b1e90d could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:09:59.663130 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4385796d-f586-4b82-a292-9d08fc599cba tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d" status: 404 len: 111 microversion: 2.1 time: 0.146842 Sep 17 21:09:59.663130 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2256/4432] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:59 2022] GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:09:59.691012 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-37c287ca-0b30-4855-974a-0965d667d3a5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Action: 'create', calling method: .version_select at 0x7f259fe97820>, body: {"keypair": {"name": "tempest-key-548919142", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH451fU1OzNqcT4tmD/onwmkOSpgUxbJ54D5Ao+fxtnWiCRzky0W/uU13JlNjV7VP5GyaE/UptuQcB3I7AJSdc4XRQv0YRXNZuV9nnAYXiULuBpT2Q15m9qzOq4RDU/wCQ=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:59.738010 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-37c287ca-0b30-4855-974a-0965d667d3a5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Getting quotas for project 0b6f25c3540546bf9bffd5610f4f86c8. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:09:59.751499 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-37c287ca-0b30-4855-974a-0965d667d3a5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Getting quotas for user 784233ee78764e7dbb774d3cb50165e3 and project 0b6f25c3540546bf9bffd5610f4f86c8. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:09:59.831343 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-37c287ca-0b30-4855-974a-0965d667d3a5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.156793 Sep 17 21:09:59.838114 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2257/4433] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:09:59 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:09:59.838114 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-2ec4bcf6-2aba-45b9-b735-a46b2d4aa4c1 req-9b27aad0-df25-441a-91ca-2158e7dd65a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59016b2c-e625-4f0c-8379-b48d97025cf3", "name": "network-vif-plugged", "status": "completed", "tag": "63947af1-683e-455f-bb53-c3543b6b147d"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:09:59.862775 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-2ec4bcf6-2aba-45b9-b735-a46b2d4aa4c1 req-9b27aad0-df25-441a-91ca-2158e7dd65a0 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:59.866471 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-2ec4bcf6-2aba-45b9-b735-a46b2d4aa4c1 req-9b27aad0-df25-441a-91ca-2158e7dd65a0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:59.867033 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-2ec4bcf6-2aba-45b9-b735-a46b2d4aa4c1 req-9b27aad0-df25-441a-91ca-2158e7dd65a0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:59.907046 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6f75f90c-286a-42d7-9bbd-2fb0ce0ed2c5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:09:59.908198 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-2ec4bcf6-2aba-45b9-b735-a46b2d4aa4c1 req-9b27aad0-df25-441a-91ca-2158e7dd65a0 service nova] Creating event network-vif-plugged:63947af1-683e-455f-bb53-c3543b6b147d for instance 59016b2c-e625-4f0c-8379-b48d97025cf3 on nch2-master-1 Sep 17 21:09:59.918883 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6f75f90c-286a-42d7-9bbd-2fb0ce0ed2c5 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 1.172277 Sep 17 21:09:59.921972 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2177/4434] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:58 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:09:59.931986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b6e4f03a-42b1-4b3e-842a-7d91bc282926 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '.version_select at 0x7f25a4749b80>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:59.938097 ncdv-master-1 devstack@n-api.service[140523]: WARNING oslo_db.sqlalchemy.utils [None req-b6e4f03a-42b1-4b3e-842a-7d91bc282926 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 17 21:09:59.940520 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-2ec4bcf6-2aba-45b9-b735-a46b2d4aa4c1 req-9b27aad0-df25-441a-91ca-2158e7dd65a0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106310 Sep 17 21:09:59.941530 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2258/4435] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:59.946837 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b6e4f03a-42b1-4b3e-842a-7d91bc282926 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.019158 Sep 17 21:09:59.950056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cfef536e-3889-4865-a646-f64805c392ef tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:09:59.950747 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2178/4436] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Sep 17 21:09:59 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:09:59.954149 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cfef536e-3889-4865-a646-f64805c392ef tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:09:59.969906 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cfef536e-3889-4865-a646-f64805c392ef tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:59.971632 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cfef536e-3889-4865-a646-f64805c392ef tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:59.973550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cfef536e-3889-4865-a646-f64805c392ef tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:09:59.982546 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cfef536e-3889-4865-a646-f64805c392ef tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:09:59.983212 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cfef536e-3889-4865-a646-f64805c392ef tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:09:59.983860 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cfef536e-3889-4865-a646-f64805c392ef tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:00.208084 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-43545be9-2810-4e09-8a17-d767aa7e5382 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-541827220", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "key_name": "tempest-key-548919142", "networks": [{"uuid": "ff632525-8d7d-4854-beaf-dc49c77bdd36"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:00.399134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-43545be9-2810-4e09-8a17-d767aa7e5382 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] validate_networks() for [('ff632525-8d7d-4854-beaf-dc49c77bdd36', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:10:00.661227 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cfef536e-3889-4865-a646-f64805c392ef tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:00.681097 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cfef536e-3889-4865-a646-f64805c392ef tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.738224 Sep 17 21:10:00.686112 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2259/4437] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:09:59 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:00.705318 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bf7321f3-fdd1-48aa-8edc-497bf5640a2f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:00.706586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bf7321f3-fdd1-48aa-8edc-497bf5640a2f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:00.726637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf7321f3-fdd1-48aa-8edc-497bf5640a2f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:00.731455 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf7321f3-fdd1-48aa-8edc-497bf5640a2f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:00.732663 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf7321f3-fdd1-48aa-8edc-497bf5640a2f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:00.733754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf7321f3-fdd1-48aa-8edc-497bf5640a2f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:00.738523 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf7321f3-fdd1-48aa-8edc-497bf5640a2f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:00.739059 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf7321f3-fdd1-48aa-8edc-497bf5640a2f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:01.420096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bf7321f3-fdd1-48aa-8edc-497bf5640a2f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:01.434716 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bf7321f3-fdd1-48aa-8edc-497bf5640a2f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:01.436314 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bf7321f3-fdd1-48aa-8edc-497bf5640a2f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:01.439001 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bf7321f3-fdd1-48aa-8edc-497bf5640a2f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1879 microversion: 2.42 time: 0.749258 Sep 17 21:10:01.440855 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2260/4438] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:10:00 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1879 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:10:01.450448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c65cebc9-eec1-48e7-bc4d-606affb33209 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:01.451106 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c65cebc9-eec1-48e7-bc4d-606affb33209 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:01.499844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c65cebc9-eec1-48e7-bc4d-606affb33209 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:01.500395 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c65cebc9-eec1-48e7-bc4d-606affb33209 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:01.502690 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c65cebc9-eec1-48e7-bc4d-606affb33209 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:01.503495 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c65cebc9-eec1-48e7-bc4d-606affb33209 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:01.506742 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c65cebc9-eec1-48e7-bc4d-606affb33209 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:01.507401 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c65cebc9-eec1-48e7-bc4d-606affb33209 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:02.144521 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c65cebc9-eec1-48e7-bc4d-606affb33209 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:02.168009 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c65cebc9-eec1-48e7-bc4d-606affb33209 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.725200 Sep 17 21:10:02.197177 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2261/4439] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:01 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:02.217945 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-018f30e9-4681-4902-a5d6-81a11f9ef24d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f04b4403-7625-47e5-a148-a05fd9ddc8e4"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:02.222586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-018f30e9-4681-4902-a5d6-81a11f9ef24d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:02.265330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-018f30e9-4681-4902-a5d6-81a11f9ef24d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:02.287469 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-43545be9-2810-4e09-8a17-d767aa7e5382 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:10:02.287979 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-43545be9-2810-4e09-8a17-d767aa7e5382 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:10:02.289746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-43545be9-2810-4e09-8a17-d767aa7e5382 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:10:02.294134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-43545be9-2810-4e09-8a17-d767aa7e5382 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:10:02.294793 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-43545be9-2810-4e09-8a17-d767aa7e5382 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:10:02.298848 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-018f30e9-4681-4902-a5d6-81a11f9ef24d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.039s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:02.300882 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-018f30e9-4681-4902-a5d6-81a11f9ef24d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:02.302316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-018f30e9-4681-4902-a5d6-81a11f9ef24d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:02.305764 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-43545be9-2810-4e09-8a17-d767aa7e5382 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:02.306405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-43545be9-2810-4e09-8a17-d767aa7e5382 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:02.306843 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-018f30e9-4681-4902-a5d6-81a11f9ef24d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:02.306959 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-43545be9-2810-4e09-8a17-d767aa7e5382 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:02.307655 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-018f30e9-4681-4902-a5d6-81a11f9ef24d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:02.307770 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-43545be9-2810-4e09-8a17-d767aa7e5382 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:02.308198 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-43545be9-2810-4e09-8a17-d767aa7e5382 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:02.362169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-43545be9-2810-4e09-8a17-d767aa7e5382 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:02.466803 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-43545be9-2810-4e09-8a17-d767aa7e5382 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Getting quotas for project 0b6f25c3540546bf9bffd5610f4f86c8. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:10:02.481682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-43545be9-2810-4e09-8a17-d767aa7e5382 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Getting quotas for user 784233ee78764e7dbb774d3cb50165e3 and project 0b6f25c3540546bf9bffd5610f4f86c8. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:10:02.580248 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-43545be9-2810-4e09-8a17-d767aa7e5382 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:10:02.591593 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-43545be9-2810-4e09-8a17-d767aa7e5382 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: fb346c6f-8465-4e0d-8bb6-0319d440d7fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:10:02.744503 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-43545be9-2810-4e09-8a17-d767aa7e5382 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.542386 Sep 17 21:10:02.748110 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2179/4440] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:10:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:10:03.047672 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:03.066912 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-018f30e9-4681-4902-a5d6-81a11f9ef24d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "POST /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.860577 Sep 17 21:10:03.067630 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2262/4441] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 17 21:10:02 2022] POST /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a/os-volume_attachments => generated 194 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:10:03.102459 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-12e19a63-456d-4054-a2c5-86fcebba56fc req-d5e1653d-c094-481c-839d-3bbb4db7135a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59016b2c-e625-4f0c-8379-b48d97025cf3", "name": "network-vif-plugged", "status": "completed", "tag": "1a947b45-da95-4264-a22c-d46090d6d9a3"}, {"server_uuid": "59016b2c-e625-4f0c-8379-b48d97025cf3", "name": "network-vif-plugged", "status": "completed", "tag": "09c61392-3418-4f8e-adca-a6a3d5761117"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:03.137996 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-12e19a63-456d-4054-a2c5-86fcebba56fc req-d5e1653d-c094-481c-839d-3bbb4db7135a service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:03.138484 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-12e19a63-456d-4054-a2c5-86fcebba56fc req-d5e1653d-c094-481c-839d-3bbb4db7135a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:03.139331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-12e19a63-456d-4054-a2c5-86fcebba56fc req-d5e1653d-c094-481c-839d-3bbb4db7135a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:03.170234 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-12e19a63-456d-4054-a2c5-86fcebba56fc req-d5e1653d-c094-481c-839d-3bbb4db7135a service nova] Creating event network-vif-plugged:1a947b45-da95-4264-a22c-d46090d6d9a3 for instance 59016b2c-e625-4f0c-8379-b48d97025cf3 on nch2-master-1 Sep 17 21:10:03.170813 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-12e19a63-456d-4054-a2c5-86fcebba56fc req-d5e1653d-c094-481c-839d-3bbb4db7135a service nova] Creating event network-vif-plugged:09c61392-3418-4f8e-adca-a6a3d5761117 for instance 59016b2c-e625-4f0c-8379-b48d97025cf3 on nch2-master-1 Sep 17 21:10:03.190726 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-12e19a63-456d-4054-a2c5-86fcebba56fc req-d5e1653d-c094-481c-839d-3bbb4db7135a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.121562 Sep 17 21:10:03.194960 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2263/4442] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:10:03.238791 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2c829cb9-49eb-4b3c-a0b5-aaf872e0e13f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:03.239570 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2c829cb9-49eb-4b3c-a0b5-aaf872e0e13f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:03.257941 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c829cb9-49eb-4b3c-a0b5-aaf872e0e13f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:03.258430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c829cb9-49eb-4b3c-a0b5-aaf872e0e13f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:03.259985 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c829cb9-49eb-4b3c-a0b5-aaf872e0e13f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:03.263104 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c829cb9-49eb-4b3c-a0b5-aaf872e0e13f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:03.265768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c829cb9-49eb-4b3c-a0b5-aaf872e0e13f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:03.266456 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c829cb9-49eb-4b3c-a0b5-aaf872e0e13f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:03.324311 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-2c829cb9-49eb-4b3c-a0b5-aaf872e0e13f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lazy-loading 'flavor' on Instance uuid 41393a54-9105-4da5-ae65-3167427ddae8 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:10:03.371059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b824cabf-038b-4c0d-9a1c-a486503873c4 tempest-FloatingIPDetailsNegativeTestJSON-791527205 tempest-FloatingIPDetailsNegativeTestJSON-791527205-project] Calling method '.version_select at 0x7f25a47bda60>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:03.497785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG neutronclient.v2_0.client [None req-b824cabf-038b-4c0d-9a1c-a486503873c4 tempest-FloatingIPDetailsNegativeTestJSON-791527205 tempest-FloatingIPDetailsNegativeTestJSON-791527205-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 28d210d9-1725-4ef9-9362-7cbbf8f3034b could not be found", "detail": ""}} {{(pid=140523) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 17 21:10:03.498942 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-b824cabf-038b-4c0d-9a1c-a486503873c4 tempest-FloatingIPDetailsNegativeTestJSON-791527205 tempest-FloatingIPDetailsNegativeTestJSON-791527205-project] HTTP exception thrown: Floating IP not found for ID 28d210d9-1725-4ef9-9362-7cbbf8f3034b Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b824cabf-038b-4c0d-9a1c-a486503873c4 tempest-FloatingIPDetailsNegativeTestJSON-791527205 tempest-FloatingIPDetailsNegativeTestJSON-791527205-project] Request method failure captured: Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/os-floating-ips/28d210d9-1725-4ef9-9362-7cbbf8f3034b HTTP/1.1 Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjepeH3a8j-LqoluN2xVUvBNh_ht-thiCFrapyI1sMpS4NX3k1ZzDRh1tPGoei-qIYUxljJJJECpIDdhV3AFv1CGsnMmQyq16Z21u_0D4aG8Ee8UTecv8eL0wizgs-eg_nZ1ZQOWxYLo1PuVTrdb9RcnOCBSo1Lz6XLwkV0_BJdrnUY Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: f0d230830b124d1ea4068261cb71702c Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-791527205 Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f0d230830b124d1ea4068261cb71702c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f0d230830b124d1ea4068261cb71702c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f0d230830b124d1ea4068261cb71702c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f0d230830b124d1ea4068261cb71702c", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-791527205 Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: f0d230830b124d1ea4068261cb71702c Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-791527205 Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-791527205-project Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 8c18a98e163f4789879dce15ed4402be Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-791527205-project Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: exception: Floating IP not found for ID 28d210d9-1725-4ef9-9362-7cbbf8f3034b Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '28d210d9-1725-4ef9-9362-7cbbf8f3034b'} Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 28d210d9-1725-4ef9-9362-7cbbf8f3034b could not be found Sep 17 21:10:03.501756 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e4a8363d-14fa-4b84-907c-4f3c9f31a7ad'] Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 28d210d9-1725-4ef9-9362-7cbbf8f3034b. Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 28d210d9-1725-4ef9-9362-7cbbf8f3034b Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 28d210d9-1725-4ef9-9362-7cbbf8f3034b Sep 17 21:10:03.507354 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:10:03.511914 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b824cabf-038b-4c0d-9a1c-a486503873c4 tempest-FloatingIPDetailsNegativeTestJSON-791527205 tempest-FloatingIPDetailsNegativeTestJSON-791527205-project] Returning 404 to user: Floating IP not found for ID 28d210d9-1725-4ef9-9362-7cbbf8f3034b {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:10:03.513056 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b824cabf-038b-4c0d-9a1c-a486503873c4 tempest-FloatingIPDetailsNegativeTestJSON-791527205 tempest-FloatingIPDetailsNegativeTestJSON-791527205-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips/28d210d9-1725-4ef9-9362-7cbbf8f3034b" status: 404 len: 111 microversion: 2.1 time: 0.763645 Sep 17 21:10:03.514678 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2180/4443] 10.222.0.26 () {58 vars in 1260 bytes} [Sat Sep 17 21:10:02 2022] GET /compute/v2.1/os-floating-ips/28d210d9-1725-4ef9-9362-7cbbf8f3034b => generated 111 bytes in 766 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:10:03.559445 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2c829cb9-49eb-4b3c-a0b5-aaf872e0e13f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action" status: 202 len: 0 microversion: 2.1 time: 0.347141 Sep 17 21:10:03.566536 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2264/4444] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:10:03 2022] POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:10:03.568908 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-48f649c3-37b1-4dbe-ac22-0e5545780289 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:03.572896 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-48f649c3-37b1-4dbe-ac22-0e5545780289 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:03.585370 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5ec05f87-b8bc-4156-b80a-22c084a1dfae tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:03.588794 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5ec05f87-b8bc-4156-b80a-22c084a1dfae tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: fb346c6f-8465-4e0d-8bb6-0319d440d7fe] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:03.605157 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-48f649c3-37b1-4dbe-ac22-0e5545780289 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:03.608111 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-48f649c3-37b1-4dbe-ac22-0e5545780289 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:03.611703 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-48f649c3-37b1-4dbe-ac22-0e5545780289 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:03.612796 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-48f649c3-37b1-4dbe-ac22-0e5545780289 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:03.615040 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-48f649c3-37b1-4dbe-ac22-0e5545780289 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:03.615672 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-48f649c3-37b1-4dbe-ac22-0e5545780289 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:04.261513 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5ec05f87-b8bc-4156-b80a-22c084a1dfae tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:04.276886 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5ec05f87-b8bc-4156-b80a-22c084a1dfae tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe" status: 200 len: 1227 microversion: 2.1 time: 0.711549 Sep 17 21:10:04.277997 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2265/4445] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:03 2022] GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe => generated 1227 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:04.302929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e045a60e-9dcb-4bd3-9e6e-2db9cf6d53c6 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:04.304310 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e045a60e-9dcb-4bd3-9e6e-2db9cf6d53c6 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:04.319524 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:04.345759 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e045a60e-9dcb-4bd3-9e6e-2db9cf6d53c6 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:04.347550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e045a60e-9dcb-4bd3-9e6e-2db9cf6d53c6 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:04.348016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e045a60e-9dcb-4bd3-9e6e-2db9cf6d53c6 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:04.349449 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e045a60e-9dcb-4bd3-9e6e-2db9cf6d53c6 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:04.353720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e045a60e-9dcb-4bd3-9e6e-2db9cf6d53c6 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:04.355863 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e045a60e-9dcb-4bd3-9e6e-2db9cf6d53c6 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:05.946129 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-48f649c3-37b1-4dbe-ac22-0e5545780289 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:05.969433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-48f649c3-37b1-4dbe-ac22-0e5545780289 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:05.977560 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-48f649c3-37b1-4dbe-ac22-0e5545780289 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:05.979203 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-48f649c3-37b1-4dbe-ac22-0e5545780289 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1879 microversion: 2.42 time: 2.462929 Sep 17 21:10:05.982086 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2181/4446] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:10:03 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1879 bytes in 2467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:10:05.999570 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5e95035c-8c80-4f5d-8899-f6aad7b7aa26 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:06.000358 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5e95035c-8c80-4f5d-8899-f6aad7b7aa26 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:06.018582 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e95035c-8c80-4f5d-8899-f6aad7b7aa26 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:06.023718 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e95035c-8c80-4f5d-8899-f6aad7b7aa26 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:06.024344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e95035c-8c80-4f5d-8899-f6aad7b7aa26 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:06.024809 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e95035c-8c80-4f5d-8899-f6aad7b7aa26 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:06.027175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e95035c-8c80-4f5d-8899-f6aad7b7aa26 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:06.032051 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e95035c-8c80-4f5d-8899-f6aad7b7aa26 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:06.132823 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5e95035c-8c80-4f5d-8899-f6aad7b7aa26 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:10:06.245830 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e045a60e-9dcb-4bd3-9e6e-2db9cf6d53c6 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:06.286372 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e045a60e-9dcb-4bd3-9e6e-2db9cf6d53c6 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1679 microversion: 2.1 time: 2.006955 Sep 17 21:10:06.309252 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2266/4447] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:04 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1679 bytes in 2030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:06.329084 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-bc5c4426-535e-46b1-b777-5ee205c2353c req-3115abc0-7efd-450d-82ef-42e7d8bdfe0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59016b2c-e625-4f0c-8379-b48d97025cf3", "name": "network-vif-plugged", "status": "completed", "tag": "704aa06b-a7ab-4b0e-a2aa-0236fac21382"}, {"server_uuid": "59016b2c-e625-4f0c-8379-b48d97025cf3", "name": "network-vif-plugged", "status": "completed", "tag": "91cb57c8-4607-4745-9e86-253c6e4b6335"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:06.358104 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-bc5c4426-535e-46b1-b777-5ee205c2353c req-3115abc0-7efd-450d-82ef-42e7d8bdfe0c service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:06.359122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-bc5c4426-535e-46b1-b777-5ee205c2353c req-3115abc0-7efd-450d-82ef-42e7d8bdfe0c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:06.359709 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-bc5c4426-535e-46b1-b777-5ee205c2353c req-3115abc0-7efd-450d-82ef-42e7d8bdfe0c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:06.394029 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-bc5c4426-535e-46b1-b777-5ee205c2353c req-3115abc0-7efd-450d-82ef-42e7d8bdfe0c service nova] Creating event network-vif-plugged:704aa06b-a7ab-4b0e-a2aa-0236fac21382 for instance 59016b2c-e625-4f0c-8379-b48d97025cf3 on nch2-master-1 Sep 17 21:10:06.394685 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-bc5c4426-535e-46b1-b777-5ee205c2353c req-3115abc0-7efd-450d-82ef-42e7d8bdfe0c service nova] Creating event network-vif-plugged:91cb57c8-4607-4745-9e86-253c6e4b6335 for instance 59016b2c-e625-4f0c-8379-b48d97025cf3 on nch2-master-1 Sep 17 21:10:06.401966 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5e95035c-8c80-4f5d-8899-f6aad7b7aa26 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 204 len: 0 microversion: 2.1 time: 0.414666 Sep 17 21:10:06.402598 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2182/4448] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:10:05 2022] DELETE /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:10:06.408996 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-bc5c4426-535e-46b1-b777-5ee205c2353c req-3115abc0-7efd-450d-82ef-42e7d8bdfe0c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.097275 Sep 17 21:10:06.420196 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2267/4449] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:10:06.424523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0184f863-f3ab-4b77-a632-03b58a6e05ca tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:06.427285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0184f863-f3ab-4b77-a632-03b58a6e05ca tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: fb346c6f-8465-4e0d-8bb6-0319d440d7fe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:06.435939 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e018099d-fdc1-42d2-ad0f-0a5d228ba425 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:06.438614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e018099d-fdc1-42d2-ad0f-0a5d228ba425 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:06.464624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0184f863-f3ab-4b77-a632-03b58a6e05ca tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:06.466593 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e018099d-fdc1-42d2-ad0f-0a5d228ba425 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:06.467333 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e018099d-fdc1-42d2-ad0f-0a5d228ba425 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:06.469260 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e018099d-fdc1-42d2-ad0f-0a5d228ba425 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:06.471774 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e018099d-fdc1-42d2-ad0f-0a5d228ba425 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:06.472246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0184f863-f3ab-4b77-a632-03b58a6e05ca tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:06.472980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e018099d-fdc1-42d2-ad0f-0a5d228ba425 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:06.473964 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0184f863-f3ab-4b77-a632-03b58a6e05ca tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:06.474572 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e018099d-fdc1-42d2-ad0f-0a5d228ba425 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:06.479271 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0184f863-f3ab-4b77-a632-03b58a6e05ca tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:06.481320 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0184f863-f3ab-4b77-a632-03b58a6e05ca tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:06.483753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0184f863-f3ab-4b77-a632-03b58a6e05ca tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:06.864444 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0184f863-f3ab-4b77-a632-03b58a6e05ca tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:06.875084 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0184f863-f3ab-4b77-a632-03b58a6e05ca tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe" status: 200 len: 1285 microversion: 2.1 time: 0.466322 Sep 17 21:10:06.875705 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2183/4450] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:06 2022] GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe => generated 1285 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:07.013831 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-46d18ed4-67a1-4425-9890-b76bc1c3dfac tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:07.014619 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-46d18ed4-67a1-4425-9890-b76bc1c3dfac tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:07.028693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46d18ed4-67a1-4425-9890-b76bc1c3dfac tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:07.029200 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46d18ed4-67a1-4425-9890-b76bc1c3dfac tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:07.033400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46d18ed4-67a1-4425-9890-b76bc1c3dfac tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:07.035549 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46d18ed4-67a1-4425-9890-b76bc1c3dfac tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:07.037361 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46d18ed4-67a1-4425-9890-b76bc1c3dfac tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:07.038667 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46d18ed4-67a1-4425-9890-b76bc1c3dfac tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:07.074193 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e018099d-fdc1-42d2-ad0f-0a5d228ba425 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:07.093162 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e018099d-fdc1-42d2-ad0f-0a5d228ba425 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1507 microversion: 2.1 time: 0.671320 Sep 17 21:10:07.094003 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2268/4451] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:06 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1507 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:07.315789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-17478b00-ea5a-4956-841c-39cdba65e7f9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:07.320646 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-17478b00-ea5a-4956-841c-39cdba65e7f9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:07.333992 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17478b00-ea5a-4956-841c-39cdba65e7f9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:07.334530 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17478b00-ea5a-4956-841c-39cdba65e7f9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:07.338676 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17478b00-ea5a-4956-841c-39cdba65e7f9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:07.339631 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17478b00-ea5a-4956-841c-39cdba65e7f9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:07.340371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17478b00-ea5a-4956-841c-39cdba65e7f9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:07.340823 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17478b00-ea5a-4956-841c-39cdba65e7f9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:07.503595 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-46d18ed4-67a1-4425-9890-b76bc1c3dfac tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:07.523728 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-46d18ed4-67a1-4425-9890-b76bc1c3dfac tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:07.526943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-46d18ed4-67a1-4425-9890-b76bc1c3dfac tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:07.529166 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-46d18ed4-67a1-4425-9890-b76bc1c3dfac tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1879 microversion: 2.42 time: 0.520594 Sep 17 21:10:07.543365 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2184/4452] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:10:07 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1879 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:10:07.696475 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-17478b00-ea5a-4956-841c-39cdba65e7f9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:07.709736 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-17478b00-ea5a-4956-841c-39cdba65e7f9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1662 microversion: 2.1 time: 0.400970 Sep 17 21:10:07.713075 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2269/4453] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:07 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1662 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:07.746520 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a0bc6512-b59c-433e-9108-fde861d817a9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:07.749159 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a0bc6512-b59c-433e-9108-fde861d817a9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:07.766506 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0bc6512-b59c-433e-9108-fde861d817a9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:07.770273 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0bc6512-b59c-433e-9108-fde861d817a9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:07.771905 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0bc6512-b59c-433e-9108-fde861d817a9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:07.772742 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0bc6512-b59c-433e-9108-fde861d817a9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:07.774132 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0bc6512-b59c-433e-9108-fde861d817a9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:07.776479 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0bc6512-b59c-433e-9108-fde861d817a9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:07.900473 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-901a5333-27bb-458b-b7f7-4973c6c07912 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:07.901104 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-901a5333-27bb-458b-b7f7-4973c6c07912 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: fb346c6f-8465-4e0d-8bb6-0319d440d7fe] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:07.921093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-901a5333-27bb-458b-b7f7-4973c6c07912 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:07.921818 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-901a5333-27bb-458b-b7f7-4973c6c07912 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:07.923880 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-901a5333-27bb-458b-b7f7-4973c6c07912 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:07.925177 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-901a5333-27bb-458b-b7f7-4973c6c07912 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:07.925696 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-901a5333-27bb-458b-b7f7-4973c6c07912 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:07.926129 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-901a5333-27bb-458b-b7f7-4973c6c07912 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:07.966009 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a0bc6512-b59c-433e-9108-fde861d817a9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action" status: 202 len: 0 microversion: 2.1 time: 0.220044 Sep 17 21:10:07.967448 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2185/4454] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:10:07 2022] POST /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:10:07.985835 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e469217a-c2c4-474b-9f62-cc4a22b83e6e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:07.989285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e469217a-c2c4-474b-9f62-cc4a22b83e6e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:08.021796 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e469217a-c2c4-474b-9f62-cc4a22b83e6e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:08.022510 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e469217a-c2c4-474b-9f62-cc4a22b83e6e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:08.023072 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e469217a-c2c4-474b-9f62-cc4a22b83e6e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:08.023909 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e469217a-c2c4-474b-9f62-cc4a22b83e6e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:08.028083 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e469217a-c2c4-474b-9f62-cc4a22b83e6e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:08.028851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e469217a-c2c4-474b-9f62-cc4a22b83e6e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:08.120981 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-901a5333-27bb-458b-b7f7-4973c6c07912 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:08.135127 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-901a5333-27bb-458b-b7f7-4973c6c07912 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe" status: 200 len: 1285 microversion: 2.1 time: 0.236000 Sep 17 21:10:08.138433 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2270/4455] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:07 2022] GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe => generated 1285 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:08.146040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-aad68600-e4b5-4558-9bf9-3c912dca2222 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:08.146668 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-aad68600-e4b5-4558-9bf9-3c912dca2222 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:08.154217 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aad68600-e4b5-4558-9bf9-3c912dca2222 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:08.154849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aad68600-e4b5-4558-9bf9-3c912dca2222 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:08.155310 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aad68600-e4b5-4558-9bf9-3c912dca2222 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:08.156143 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aad68600-e4b5-4558-9bf9-3c912dca2222 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:08.156626 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aad68600-e4b5-4558-9bf9-3c912dca2222 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:08.157016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aad68600-e4b5-4558-9bf9-3c912dca2222 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:08.654715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-aad68600-e4b5-4558-9bf9-3c912dca2222 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:08.667543 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-aad68600-e4b5-4558-9bf9-3c912dca2222 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1507 microversion: 2.1 time: 0.527738 Sep 17 21:10:08.668158 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2271/4456] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:08 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1507 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:08.698376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e469217a-c2c4-474b-9f62-cc4a22b83e6e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:08.701082 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-561ca95e-26ca-49ac-87c2-c72cebcd040e req-d339e8b3-bc3d-428c-a0c2-df0e221ac18f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59016b2c-e625-4f0c-8379-b48d97025cf3", "name": "network-vif-plugged", "status": "completed", "tag": "3797c879-2df9-4ada-b7ff-c6db7404943b"}, {"server_uuid": "59016b2c-e625-4f0c-8379-b48d97025cf3", "name": "network-vif-plugged", "status": "completed", "tag": "00603844-1172-4f4d-a0db-a617c5efc641"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:08.705057 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:08.708714 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e469217a-c2c4-474b-9f62-cc4a22b83e6e tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1668 microversion: 2.1 time: 0.736193 Sep 17 21:10:08.715797 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-561ca95e-26ca-49ac-87c2-c72cebcd040e req-d339e8b3-bc3d-428c-a0c2-df0e221ac18f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:08.720075 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-561ca95e-26ca-49ac-87c2-c72cebcd040e req-d339e8b3-bc3d-428c-a0c2-df0e221ac18f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:08.720898 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-561ca95e-26ca-49ac-87c2-c72cebcd040e req-d339e8b3-bc3d-428c-a0c2-df0e221ac18f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:08.727776 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2186/4457] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:07 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1668 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:08.744409 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8498349f-2c3c-4276-90ef-a761ccfc1de1 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:08.747074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8498349f-2c3c-4276-90ef-a761ccfc1de1 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:08.755865 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-561ca95e-26ca-49ac-87c2-c72cebcd040e req-d339e8b3-bc3d-428c-a0c2-df0e221ac18f service nova] Creating event network-vif-plugged:3797c879-2df9-4ada-b7ff-c6db7404943b for instance 59016b2c-e625-4f0c-8379-b48d97025cf3 on nch2-master-1 Sep 17 21:10:08.756491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8498349f-2c3c-4276-90ef-a761ccfc1de1 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:08.757302 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8498349f-2c3c-4276-90ef-a761ccfc1de1 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:08.758068 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8498349f-2c3c-4276-90ef-a761ccfc1de1 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:08.759253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8498349f-2c3c-4276-90ef-a761ccfc1de1 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:08.759906 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8498349f-2c3c-4276-90ef-a761ccfc1de1 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:08.760492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8498349f-2c3c-4276-90ef-a761ccfc1de1 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:08.761666 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-561ca95e-26ca-49ac-87c2-c72cebcd040e req-d339e8b3-bc3d-428c-a0c2-df0e221ac18f service nova] Creating event network-vif-plugged:00603844-1172-4f4d-a0db-a617c5efc641 for instance 59016b2c-e625-4f0c-8379-b48d97025cf3 on nch2-master-1 Sep 17 21:10:08.770068 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-561ca95e-26ca-49ac-87c2-c72cebcd040e req-d339e8b3-bc3d-428c-a0c2-df0e221ac18f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.096246 Sep 17 21:10:08.771759 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2272/4458] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:10:09.165389 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-465230b9-7425-4fd0-9fef-93c429beb77e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:09.166149 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-465230b9-7425-4fd0-9fef-93c429beb77e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: fb346c6f-8465-4e0d-8bb6-0319d440d7fe] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:09.181735 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-465230b9-7425-4fd0-9fef-93c429beb77e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:09.182769 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-465230b9-7425-4fd0-9fef-93c429beb77e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:09.183360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-465230b9-7425-4fd0-9fef-93c429beb77e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:09.184958 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-465230b9-7425-4fd0-9fef-93c429beb77e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:09.185747 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-465230b9-7425-4fd0-9fef-93c429beb77e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:09.186420 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-465230b9-7425-4fd0-9fef-93c429beb77e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:09.247358 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8498349f-2c3c-4276-90ef-a761ccfc1de1 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:09.261034 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8498349f-2c3c-4276-90ef-a761ccfc1de1 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:09.262932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8498349f-2c3c-4276-90ef-a761ccfc1de1 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:09.265941 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8498349f-2c3c-4276-90ef-a761ccfc1de1 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1879 microversion: 2.42 time: 0.534861 Sep 17 21:10:09.267383 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2187/4459] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:10:08 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1879 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:10:09.273893 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f995488b-b694-497d-bb4a-340897629dc5 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f04b4403-7625-47e5-a148-a05fd9ddc8e4"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:09.277214 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f995488b-b694-497d-bb4a-340897629dc5 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:09.295516 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f995488b-b694-497d-bb4a-340897629dc5 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:09.296618 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f995488b-b694-497d-bb4a-340897629dc5 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:09.298281 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f995488b-b694-497d-bb4a-340897629dc5 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:09.299469 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f995488b-b694-497d-bb4a-340897629dc5 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:09.300215 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f995488b-b694-497d-bb4a-340897629dc5 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:09.300904 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f995488b-b694-497d-bb4a-340897629dc5 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:09.453662 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-f995488b-b694-497d-bb4a-340897629dc5 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] HTTP exception thrown: Invalid volume: volume f04b4403-7625-47e5-a148-a05fd9ddc8e4 is already attached to instances: 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f995488b-b694-497d-bb4a-340897629dc5 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Request method failure captured: Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a/os-volume_attachments HTTP/1.1 Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 74 Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJja5IhqAUJRQXEUU1o8JKB7VL3QF2aEShf_6YtjfGFX6a2gdfOrA57RhEkrL_xji2fJrjERU1MYqs2fkCF1UUkZO1MCrMj-4yvDSZkq5ddhPAEMc-mFSR2bL5wENqd3kTDvDHvjjOdVeCZP6ndR-6jR5boE-dCWiUzV7hdKlqCy2Jhg Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 6fa7e14863254ab3964ac907c168d9e6 Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6fa7e14863254ab3964ac907c168d9e6", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 6fa7e14863254ab3964ac907c168d9e6 Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-AttachVolumeNegativeTest-1020448628-project Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: c544e8e6f7a741c985c92ed7437397cd Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-AttachVolumeNegativeTest-1020448628-project Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: {"volumeAttachment": {"volumeId": "f04b4403-7625-47e5-a148-a05fd9ddc8e4"}} Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: exception: Invalid volume: volume f04b4403-7625-47e5-a148-a05fd9ddc8e4 is already attached to instances: 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'server_id': '0d8e3d0a-75b8-40ed-ade5-deffe7b8105a', 'body': {'volumeAttachment': {'volumeId': 'f04b4403-7625-47e5-a148-a05fd9ddc8e4'}}} Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f04b4403-7625-47e5-a148-a05fd9ddc8e4 is already attached to instances: 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:10:09.457936 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:10:09.462597 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:10:09.462597 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:10:09.462597 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 17 21:10:09.462597 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 17 21:10:09.462597 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f04b4403-7625-47e5-a148-a05fd9ddc8e4 is already attached to instances: 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a Sep 17 21:10:09.462597 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:10:09.462597 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:10:09.462597 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:10:09.462597 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:09.462597 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:10:09.462597 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:10:09.462597 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:10:09.462597 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:10:09.462597 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f04b4403-7625-47e5-a148-a05fd9ddc8e4 is already attached to instances: 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a Sep 17 21:10:09.462597 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:10:09.468465 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f995488b-b694-497d-bb4a-340897629dc5 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Returning 400 to user: Invalid volume: volume f04b4403-7625-47e5-a148-a05fd9ddc8e4 is already attached to instances: 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:10:09.469660 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f995488b-b694-497d-bb4a-340897629dc5 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "POST /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.200832 Sep 17 21:10:09.470372 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2188/4460] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 17 21:10:09 2022] POST /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a/os-volume_attachments => generated 174 bytes in 202 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:10:09.593981 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d35fd16f-d1e7-4c9c-ba60-8659adacab70 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:09.594830 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d35fd16f-d1e7-4c9c-ba60-8659adacab70 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:09.602019 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d35fd16f-d1e7-4c9c-ba60-8659adacab70 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:09.602884 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d35fd16f-d1e7-4c9c-ba60-8659adacab70 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:09.603559 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d35fd16f-d1e7-4c9c-ba60-8659adacab70 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:09.604517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d35fd16f-d1e7-4c9c-ba60-8659adacab70 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:09.605185 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d35fd16f-d1e7-4c9c-ba60-8659adacab70 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:09.605979 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d35fd16f-d1e7-4c9c-ba60-8659adacab70 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:09.663111 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-465230b9-7425-4fd0-9fef-93c429beb77e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:09.677686 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-465230b9-7425-4fd0-9fef-93c429beb77e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe" status: 200 len: 1327 microversion: 2.1 time: 0.515240 Sep 17 21:10:09.679189 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2273/4461] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:09 2022] GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe => generated 1327 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:10:09.704852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-46486101-ce6e-4e1b-8005-418834fe7ee7 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:09.705684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-46486101-ce6e-4e1b-8005-418834fe7ee7 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:09.712493 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46486101-ce6e-4e1b-8005-418834fe7ee7 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:09.713167 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46486101-ce6e-4e1b-8005-418834fe7ee7 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:09.713819 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46486101-ce6e-4e1b-8005-418834fe7ee7 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:09.714714 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46486101-ce6e-4e1b-8005-418834fe7ee7 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:09.715330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46486101-ce6e-4e1b-8005-418834fe7ee7 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:09.723233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46486101-ce6e-4e1b-8005-418834fe7ee7 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:09.802084 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-d35fd16f-d1e7-4c9c-ba60-8659adacab70 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lazy-loading 'services' on Instance uuid 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:10:09.923762 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d35fd16f-d1e7-4c9c-ba60-8659adacab70 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a/os-volume_attachments/f04b4403-7625-47e5-a148-a05fd9ddc8e4" status: 202 len: 0 microversion: 2.1 time: 0.334131 Sep 17 21:10:09.925968 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2189/4462] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Sep 17 21:10:09 2022] DELETE /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a/os-volume_attachments/f04b4403-7625-47e5-a148-a05fd9ddc8e4 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:10:09.933734 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5751b75e-53b1-473e-88d5-49d3d8dbf9cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:09.936326 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5751b75e-53b1-473e-88d5-49d3d8dbf9cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:09.944076 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5751b75e-53b1-473e-88d5-49d3d8dbf9cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:09.955491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5751b75e-53b1-473e-88d5-49d3d8dbf9cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:09.956616 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5751b75e-53b1-473e-88d5-49d3d8dbf9cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:09.957583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5751b75e-53b1-473e-88d5-49d3d8dbf9cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:09.958273 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5751b75e-53b1-473e-88d5-49d3d8dbf9cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:09.958829 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5751b75e-53b1-473e-88d5-49d3d8dbf9cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:10.312520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-46486101-ce6e-4e1b-8005-418834fe7ee7 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:10.328583 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-46486101-ce6e-4e1b-8005-418834fe7ee7 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1507 microversion: 2.1 time: 0.636819 Sep 17 21:10:10.331181 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2274/4463] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:09 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1507 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:10:10.337229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c26c3dd2-07cf-4afe-acc7-8273df2d9edd tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:10.339758 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c26c3dd2-07cf-4afe-acc7-8273df2d9edd tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:10.347918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c26c3dd2-07cf-4afe-acc7-8273df2d9edd tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:10.349011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c26c3dd2-07cf-4afe-acc7-8273df2d9edd tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:10.349914 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c26c3dd2-07cf-4afe-acc7-8273df2d9edd tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:10.350954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c26c3dd2-07cf-4afe-acc7-8273df2d9edd tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:10.351769 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c26c3dd2-07cf-4afe-acc7-8273df2d9edd tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:10.352347 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c26c3dd2-07cf-4afe-acc7-8273df2d9edd tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:10.442073 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5751b75e-53b1-473e-88d5-49d3d8dbf9cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:10.451623 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5751b75e-53b1-473e-88d5-49d3d8dbf9cf tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1668 microversion: 2.1 time: 0.524156 Sep 17 21:10:10.456805 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2190/4464] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:09 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1668 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:10.471972 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5da3df55-2666-406a-a708-a32c6c2471ee tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:10.472791 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5da3df55-2666-406a-a708-a32c6c2471ee tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:10.485120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5da3df55-2666-406a-a708-a32c6c2471ee tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:10.485844 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5da3df55-2666-406a-a708-a32c6c2471ee tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:10.486422 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5da3df55-2666-406a-a708-a32c6c2471ee tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:10.487305 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5da3df55-2666-406a-a708-a32c6c2471ee tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:10.492928 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5da3df55-2666-406a-a708-a32c6c2471ee tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:10.493721 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5da3df55-2666-406a-a708-a32c6c2471ee tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:10.943928 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c26c3dd2-07cf-4afe-acc7-8273df2d9edd tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.610327 Sep 17 21:10:10.954823 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2275/4465] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 17 21:10:10 2022] GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a/os-volume_attachments => generated 197 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:10:10.960627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a550f3e6-2faa-4687-8e12-dba6941e3fc6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:10.966923 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a550f3e6-2faa-4687-8e12-dba6941e3fc6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: fb346c6f-8465-4e0d-8bb6-0319d440d7fe] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:10.973821 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a550f3e6-2faa-4687-8e12-dba6941e3fc6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:10.974579 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a550f3e6-2faa-4687-8e12-dba6941e3fc6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:10.975633 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a550f3e6-2faa-4687-8e12-dba6941e3fc6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:10.976510 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a550f3e6-2faa-4687-8e12-dba6941e3fc6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:10.977116 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a550f3e6-2faa-4687-8e12-dba6941e3fc6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:10.977720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a550f3e6-2faa-4687-8e12-dba6941e3fc6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:11.384492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5da3df55-2666-406a-a708-a32c6c2471ee tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:11.432537 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5da3df55-2666-406a-a708-a32c6c2471ee tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:11.442438 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5da3df55-2666-406a-a708-a32c6c2471ee tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:11.449341 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5da3df55-2666-406a-a708-a32c6c2471ee tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 1879 microversion: 2.42 time: 0.990814 Sep 17 21:10:11.454310 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2191/4466] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:10:10 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 1879 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:10:11.475479 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-14ed4638-9116-4121-ae52-d7231937823a req-057de83d-f932-48f8-a440-fc5c834c1805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca76130f-7982-4feb-a9d8-9e8f998b509e", "name": "network-vif-deleted", "tag": "d4d945a4-3009-4fd6-95cd-b4cfc8f16e38"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:11.509942 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-14ed4638-9116-4121-ae52-d7231937823a req-057de83d-f932-48f8-a440-fc5c834c1805 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:11.511935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-14ed4638-9116-4121-ae52-d7231937823a req-057de83d-f932-48f8-a440-fc5c834c1805 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:11.512392 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-14ed4638-9116-4121-ae52-d7231937823a req-057de83d-f932-48f8-a440-fc5c834c1805 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:11.552822 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-14ed4638-9116-4121-ae52-d7231937823a req-057de83d-f932-48f8-a440-fc5c834c1805 service nova] Creating event network-vif-deleted:d4d945a4-3009-4fd6-95cd-b4cfc8f16e38 for instance ca76130f-7982-4feb-a9d8-9e8f998b509e on nch1-master-1 Sep 17 21:10:11.568511 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-14ed4638-9116-4121-ae52-d7231937823a req-057de83d-f932-48f8-a440-fc5c834c1805 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109731 Sep 17 21:10:11.571281 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2192/4467] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:10:11.584292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-71fe58db-b5a5-4958-8c12-64453ee7d52d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:11.585011 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-71fe58db-b5a5-4958-8c12-64453ee7d52d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:11.602800 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-71fe58db-b5a5-4958-8c12-64453ee7d52d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:11.603318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-71fe58db-b5a5-4958-8c12-64453ee7d52d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:11.603785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-71fe58db-b5a5-4958-8c12-64453ee7d52d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:11.604501 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-71fe58db-b5a5-4958-8c12-64453ee7d52d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:11.610395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-71fe58db-b5a5-4958-8c12-64453ee7d52d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:11.612302 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-71fe58db-b5a5-4958-8c12-64453ee7d52d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:11.702616 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-71fe58db-b5a5-4958-8c12-64453ee7d52d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:11.703126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-71fe58db-b5a5-4958-8c12-64453ee7d52d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:11.703581 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-71fe58db-b5a5-4958-8c12-64453ee7d52d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:11.704448 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-71fe58db-b5a5-4958-8c12-64453ee7d52d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lazy-loading 'fault' on Instance uuid ca76130f-7982-4feb-a9d8-9e8f998b509e {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:10:11.849120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-71fe58db-b5a5-4958-8c12-64453ee7d52d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:11.858444 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-71fe58db-b5a5-4958-8c12-64453ee7d52d tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 200 len: 1312 microversion: 2.1 time: 0.285725 Sep 17 21:10:11.866594 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a550f3e6-2faa-4687-8e12-dba6941e3fc6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:11.875501 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2193/4468] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:11 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 1312 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:11.881528 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c4b9f386-8ea8-4b5f-99b0-5b594ffe54fd tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:11.882208 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c4b9f386-8ea8-4b5f-99b0-5b594ffe54fd tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:11.885660 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a550f3e6-2faa-4687-8e12-dba6941e3fc6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe" status: 200 len: 1327 microversion: 2.1 time: 0.927820 Sep 17 21:10:11.889109 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2276/4469] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:10 2022] GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe => generated 1327 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:11.890653 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c4b9f386-8ea8-4b5f-99b0-5b594ffe54fd tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:11.891162 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c4b9f386-8ea8-4b5f-99b0-5b594ffe54fd tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:11.891611 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c4b9f386-8ea8-4b5f-99b0-5b594ffe54fd tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:11.892344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c4b9f386-8ea8-4b5f-99b0-5b594ffe54fd tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:11.892806 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c4b9f386-8ea8-4b5f-99b0-5b594ffe54fd tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:11.893436 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c4b9f386-8ea8-4b5f-99b0-5b594ffe54fd tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:11.967670 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cbc211ac-b4f0-43f1-95cb-c0ffb3f50277 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:11.970553 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cbc211ac-b4f0-43f1-95cb-c0ffb3f50277 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:11.978331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbc211ac-b4f0-43f1-95cb-c0ffb3f50277 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:11.979059 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbc211ac-b4f0-43f1-95cb-c0ffb3f50277 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:11.979771 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbc211ac-b4f0-43f1-95cb-c0ffb3f50277 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:11.980947 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbc211ac-b4f0-43f1-95cb-c0ffb3f50277 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:11.981585 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbc211ac-b4f0-43f1-95cb-c0ffb3f50277 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:11.982170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbc211ac-b4f0-43f1-95cb-c0ffb3f50277 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:12.024954 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cbc211ac-b4f0-43f1-95cb-c0ffb3f50277 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061394 Sep 17 21:10:12.025811 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2277/4470] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 17 21:10:11 2022] GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 17 21:10:12.123594 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d3b98653-8b5a-457b-968f-235c1f0ed2d3 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:12.124657 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d3b98653-8b5a-457b-968f-235c1f0ed2d3 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:12.131870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3b98653-8b5a-457b-968f-235c1f0ed2d3 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:12.132693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3b98653-8b5a-457b-968f-235c1f0ed2d3 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:12.133362 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3b98653-8b5a-457b-968f-235c1f0ed2d3 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:12.134349 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3b98653-8b5a-457b-968f-235c1f0ed2d3 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:12.135241 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3b98653-8b5a-457b-968f-235c1f0ed2d3 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:12.135892 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3b98653-8b5a-457b-968f-235c1f0ed2d3 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:12.167271 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d3b98653-8b5a-457b-968f-235c1f0ed2d3 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:10:12.207664 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c4b9f386-8ea8-4b5f-99b0-5b594ffe54fd tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:12.218081 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c4b9f386-8ea8-4b5f-99b0-5b594ffe54fd tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1668 microversion: 2.1 time: 0.340770 Sep 17 21:10:12.219018 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2194/4471] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:11 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1668 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:12.269998 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d3b98653-8b5a-457b-968f-235c1f0ed2d3 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a" status: 204 len: 0 microversion: 2.1 time: 0.149289 Sep 17 21:10:12.271874 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2278/4472] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:10:12 2022] DELETE /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 17 21:10:12.283969 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cffdb0c8-0645-4ed3-a22a-5ea6d5308017 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:12.284683 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cffdb0c8-0645-4ed3-a22a-5ea6d5308017 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:12.291725 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cffdb0c8-0645-4ed3-a22a-5ea6d5308017 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:12.292224 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cffdb0c8-0645-4ed3-a22a-5ea6d5308017 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:12.292664 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cffdb0c8-0645-4ed3-a22a-5ea6d5308017 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:12.294535 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cffdb0c8-0645-4ed3-a22a-5ea6d5308017 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:12.295281 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cffdb0c8-0645-4ed3-a22a-5ea6d5308017 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:12.296178 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cffdb0c8-0645-4ed3-a22a-5ea6d5308017 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:12.429779 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:12.488333 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ee79c8c2-6881-40c1-917c-ea4081cc0d6a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:12.488996 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ee79c8c2-6881-40c1-917c-ea4081cc0d6a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:12.496648 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee79c8c2-6881-40c1-917c-ea4081cc0d6a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:12.497202 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee79c8c2-6881-40c1-917c-ea4081cc0d6a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:12.497719 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee79c8c2-6881-40c1-917c-ea4081cc0d6a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:12.498610 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee79c8c2-6881-40c1-917c-ea4081cc0d6a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:12.499126 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee79c8c2-6881-40c1-917c-ea4081cc0d6a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:12.499613 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee79c8c2-6881-40c1-917c-ea4081cc0d6a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:12.503319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=94,nova_cell1:UPDATE=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:12.549687 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:13.027321 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cffdb0c8-0645-4ed3-a22a-5ea6d5308017 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:13.036564 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cffdb0c8-0645-4ed3-a22a-5ea6d5308017 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a" status: 200 len: 1682 microversion: 2.1 time: 0.760093 Sep 17 21:10:13.037342 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2195/4473] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:12 2022] GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a => generated 1682 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:10:13.061628 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ee79c8c2-6881-40c1-917c-ea4081cc0d6a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:13.065340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c2beeb8b-f33e-41a8-8bbd-d748e6f4ac84 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:13.066036 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c2beeb8b-f33e-41a8-8bbd-d748e6f4ac84 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: ca76130f-7982-4feb-a9d8-9e8f998b509e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:13.073654 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c2beeb8b-f33e-41a8-8bbd-d748e6f4ac84 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:13.074154 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c2beeb8b-f33e-41a8-8bbd-d748e6f4ac84 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:13.074605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c2beeb8b-f33e-41a8-8bbd-d748e6f4ac84 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:13.075905 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c2beeb8b-f33e-41a8-8bbd-d748e6f4ac84 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:13.076472 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c2beeb8b-f33e-41a8-8bbd-d748e6f4ac84 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:13.076911 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c2beeb8b-f33e-41a8-8bbd-d748e6f4ac84 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:13.083108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ee79c8c2-6881-40c1-917c-ea4081cc0d6a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:13.084720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ee79c8c2-6881-40c1-917c-ea4081cc0d6a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:13.086512 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ee79c8c2-6881-40c1-917c-ea4081cc0d6a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 2832 microversion: 2.42 time: 0.603312 Sep 17 21:10:13.092561 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-c2beeb8b-f33e-41a8-8bbd-d748e6f4ac84 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] HTTP exception thrown: Instance ca76130f-7982-4feb-a9d8-9e8f998b509e could not be found. Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c2beeb8b-f33e-41a8-8bbd-d748e6f4ac84 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Request method failure captured: Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e HTTP/1.1 Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjaiOOC2XD-QIsLuDvG9bxN3jnLjmueVdk28NKERipgg7mZAUnmkYYkUcMWYkcsUdzUwALfMrwKYbIvTbrUxBdv7HTTnMRjY98z2HSanC8PyMI0Bvd8_fsMNUR8WwzuWwOyttA6z4v7owoNPIa2XeOfidHHD5bq9m_itbcIiBCzoH1A Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: f8ed24e4bf6643f7b1474fcec78c4995 Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-533169750 Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ed24e4bf6643f7b1474fcec78c4995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f8ed24e4bf6643f7b1474fcec78c4995"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ed24e4bf6643f7b1474fcec78c4995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f8ed24e4bf6643f7b1474fcec78c4995", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerRescueNegativeTestJSON-533169750 Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: f8ed24e4bf6643f7b1474fcec78c4995 Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-533169750 Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerRescueNegativeTestJSON-533169750-project Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 795813bb461e42ad8c2a758e9b8430d6 Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerRescueNegativeTestJSON-533169750-project Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance ca76130f-7982-4feb-a9d8-9e8f998b509e could not be found. Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'ca76130f-7982-4feb-a9d8-9e8f998b509e'} Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca76130f-7982-4feb-a9d8-9e8f998b509e could not be found. Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca76130f-7982-4feb-a9d8-9e8f998b509e could not be found. Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:10:13.094312 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:10:13.098317 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:10:13.098317 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:13.098317 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:10:13.098317 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:10:13.098317 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:10:13.098317 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:10:13.098317 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca76130f-7982-4feb-a9d8-9e8f998b509e could not be found. Sep 17 21:10:13.098317 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:10:13.098317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c2beeb8b-f33e-41a8-8bbd-d748e6f4ac84 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Returning 404 to user: Instance ca76130f-7982-4feb-a9d8-9e8f998b509e could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:10:13.098317 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c2beeb8b-f33e-41a8-8bbd-d748e6f4ac84 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e" status: 404 len: 111 microversion: 2.1 time: 0.035004 Sep 17 21:10:13.100697 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2196/4474] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:13 2022] GET /compute/v2.1/servers/ca76130f-7982-4feb-a9d8-9e8f998b509e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:10:13.106579 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-afccacbc-08fc-410d-b042-3a31dd76e534 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:13.107217 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-afccacbc-08fc-410d-b042-3a31dd76e534 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: fb346c6f-8465-4e0d-8bb6-0319d440d7fe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:13.115402 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afccacbc-08fc-410d-b042-3a31dd76e534 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:13.115963 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2279/4475] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:10:12 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 2832 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:10:13.116101 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afccacbc-08fc-410d-b042-3a31dd76e534 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:13.116464 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afccacbc-08fc-410d-b042-3a31dd76e534 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:13.117375 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afccacbc-08fc-410d-b042-3a31dd76e534 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:13.117966 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afccacbc-08fc-410d-b042-3a31dd76e534 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:13.118577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-afccacbc-08fc-410d-b042-3a31dd76e534 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:13.126455 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e37388d7-4652-42f9-94a6-ac28eb6a2742 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:13.126963 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e37388d7-4652-42f9-94a6-ac28eb6a2742 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:13.139241 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e37388d7-4652-42f9-94a6-ac28eb6a2742 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:13.140088 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e37388d7-4652-42f9-94a6-ac28eb6a2742 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:13.140932 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e37388d7-4652-42f9-94a6-ac28eb6a2742 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:13.141927 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e37388d7-4652-42f9-94a6-ac28eb6a2742 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:13.142722 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e37388d7-4652-42f9-94a6-ac28eb6a2742 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:13.143365 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e37388d7-4652-42f9-94a6-ac28eb6a2742 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:13.178062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e37388d7-4652-42f9-94a6-ac28eb6a2742 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:10:13.323944 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e37388d7-4652-42f9-94a6-ac28eb6a2742 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "DELETE /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d" status: 204 len: 0 microversion: 2.1 time: 0.201836 Sep 17 21:10:13.324841 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2280/4476] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:10:13 2022] DELETE /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:10:13.335844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1595eaee-8a26-45bf-b16f-dc62f2d96cf5 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:13.336470 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1595eaee-8a26-45bf-b16f-dc62f2d96cf5 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:13.351039 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1595eaee-8a26-45bf-b16f-dc62f2d96cf5 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:13.351811 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1595eaee-8a26-45bf-b16f-dc62f2d96cf5 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:13.352264 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1595eaee-8a26-45bf-b16f-dc62f2d96cf5 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:13.353071 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1595eaee-8a26-45bf-b16f-dc62f2d96cf5 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:13.353710 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1595eaee-8a26-45bf-b16f-dc62f2d96cf5 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:13.354070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1595eaee-8a26-45bf-b16f-dc62f2d96cf5 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:13.423906 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-afccacbc-08fc-410d-b042-3a31dd76e534 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:13.434656 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-afccacbc-08fc-410d-b042-3a31dd76e534 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe" status: 200 len: 1327 microversion: 2.1 time: 0.332127 Sep 17 21:10:13.435764 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2197/4477] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:13 2022] GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe => generated 1327 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:13.444536 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e8eca1e0-b609-4657-9e15-f07e38e1ba34 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:13.445334 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e8eca1e0-b609-4657-9e15-f07e38e1ba34 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:13.451811 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8eca1e0-b609-4657-9e15-f07e38e1ba34 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:13.452507 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8eca1e0-b609-4657-9e15-f07e38e1ba34 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:13.453180 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8eca1e0-b609-4657-9e15-f07e38e1ba34 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:13.454111 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8eca1e0-b609-4657-9e15-f07e38e1ba34 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:13.454850 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8eca1e0-b609-4657-9e15-f07e38e1ba34 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:13.455460 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8eca1e0-b609-4657-9e15-f07e38e1ba34 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:13.562028 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1595eaee-8a26-45bf-b16f-dc62f2d96cf5 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3/os-interface" status: 200 len: 1828 microversion: 2.42 time: 0.234025 Sep 17 21:10:13.562623 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2281/4478] 10.222.0.26 () {60 vars in 1316 bytes} [Sat Sep 17 21:10:13 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3/os-interface => generated 1828 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:10:13.567860 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-edd6ac3a-3052-4c1b-b48c-7987778d5be9 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:13.568814 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-edd6ac3a-3052-4c1b-b48c-7987778d5be9 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:13.581174 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-edd6ac3a-3052-4c1b-b48c-7987778d5be9 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:13.584595 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-edd6ac3a-3052-4c1b-b48c-7987778d5be9 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:13.585488 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-edd6ac3a-3052-4c1b-b48c-7987778d5be9 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:13.586948 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-edd6ac3a-3052-4c1b-b48c-7987778d5be9 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:13.589106 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-edd6ac3a-3052-4c1b-b48c-7987778d5be9 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:13.589873 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-edd6ac3a-3052-4c1b-b48c-7987778d5be9 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:14.080380 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e8eca1e0-b609-4657-9e15-f07e38e1ba34 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:14.089011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-edd6ac3a-3052-4c1b-b48c-7987778d5be9 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:14.098414 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e8eca1e0-b609-4657-9e15-f07e38e1ba34 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.658391 Sep 17 21:10:14.100622 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2198/4479] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:13 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:14.101737 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-edd6ac3a-3052-4c1b-b48c-7987778d5be9 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d" status: 200 len: 1520 microversion: 2.1 time: 0.537717 Sep 17 21:10:14.102588 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2282/4480] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:13 2022] GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d => generated 1520 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:14.107953 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6ff750d4-8f27-4da6-8bbc-43b6adc59322 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:14.108811 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-919be96e-ff46-4fd2-a051-df2db4abd333 req-b97cca43-54ad-40d2-96db-596259d7ce0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb346c6f-8465-4e0d-8bb6-0319d440d7fe", "tag": "7a6524ad-e53f-4159-af1a-89a8899d9676"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:14.117815 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6ff750d4-8f27-4da6-8bbc-43b6adc59322 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:14.130355 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ff750d4-8f27-4da6-8bbc-43b6adc59322 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:14.131027 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ff750d4-8f27-4da6-8bbc-43b6adc59322 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:14.132266 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ff750d4-8f27-4da6-8bbc-43b6adc59322 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:14.133763 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ff750d4-8f27-4da6-8bbc-43b6adc59322 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:14.138193 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ff750d4-8f27-4da6-8bbc-43b6adc59322 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:14.138554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-919be96e-ff46-4fd2-a051-df2db4abd333 req-b97cca43-54ad-40d2-96db-596259d7ce0a service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:14.138925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ff750d4-8f27-4da6-8bbc-43b6adc59322 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:14.139460 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-919be96e-ff46-4fd2-a051-df2db4abd333 req-b97cca43-54ad-40d2-96db-596259d7ce0a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:14.140053 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-919be96e-ff46-4fd2-a051-df2db4abd333 req-b97cca43-54ad-40d2-96db-596259d7ce0a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:14.159929 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-919be96e-ff46-4fd2-a051-df2db4abd333 req-b97cca43-54ad-40d2-96db-596259d7ce0a service nova] Creating event network-changed:7a6524ad-e53f-4159-af1a-89a8899d9676 for instance fb346c6f-8465-4e0d-8bb6-0319d440d7fe on nch1-master-1 Sep 17 21:10:14.168741 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-919be96e-ff46-4fd2-a051-df2db4abd333 req-b97cca43-54ad-40d2-96db-596259d7ce0a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066355 Sep 17 21:10:14.169396 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2199/4481] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:10:14.175559 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-233da179-4cda-4022-b26b-edff75b43ac1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:14.176480 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-233da179-4cda-4022-b26b-edff75b43ac1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:14.178571 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:14.184833 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-233da179-4cda-4022-b26b-edff75b43ac1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:14.185689 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-233da179-4cda-4022-b26b-edff75b43ac1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:14.186308 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-233da179-4cda-4022-b26b-edff75b43ac1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:14.187296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-233da179-4cda-4022-b26b-edff75b43ac1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:14.187990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-233da179-4cda-4022-b26b-edff75b43ac1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:14.188575 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-233da179-4cda-4022-b26b-edff75b43ac1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:14.268519 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=6 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:14.559778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6ff750d4-8f27-4da6-8bbc-43b6adc59322 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:14.571858 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6ff750d4-8f27-4da6-8bbc-43b6adc59322 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a" status: 200 len: 1682 microversion: 2.1 time: 0.467467 Sep 17 21:10:14.572457 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2283/4482] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:14 2022] GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a => generated 1682 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:14.577251 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5bd9e9fb-275b-436b-b29b-09064a3e1103 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:14.582259 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5bd9e9fb-275b-436b-b29b-09064a3e1103 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: fb346c6f-8465-4e0d-8bb6-0319d440d7fe] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:14.591935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5bd9e9fb-275b-436b-b29b-09064a3e1103 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:14.592666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5bd9e9fb-275b-436b-b29b-09064a3e1103 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:14.593303 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5bd9e9fb-275b-436b-b29b-09064a3e1103 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:14.594289 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5bd9e9fb-275b-436b-b29b-09064a3e1103 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:14.594997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5bd9e9fb-275b-436b-b29b-09064a3e1103 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:14.595638 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5bd9e9fb-275b-436b-b29b-09064a3e1103 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:14.604499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-233da179-4cda-4022-b26b-edff75b43ac1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:14.619942 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-233da179-4cda-4022-b26b-edff75b43ac1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1671 microversion: 2.1 time: 0.448488 Sep 17 21:10:14.621217 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2200/4483] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:14 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1671 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:14.650603 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-03d291d8-df65-4b4f-be03-79a2823b3770 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:14.651397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-03d291d8-df65-4b4f-be03-79a2823b3770 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: a0fd9e29-e10d-478a-8caa-1f32e9783550] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:14.687317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-03d291d8-df65-4b4f-be03-79a2823b3770 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:14.688229 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-03d291d8-df65-4b4f-be03-79a2823b3770 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:14.688899 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-03d291d8-df65-4b4f-be03-79a2823b3770 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:14.689900 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-03d291d8-df65-4b4f-be03-79a2823b3770 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:14.690695 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-03d291d8-df65-4b4f-be03-79a2823b3770 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:14.691340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-03d291d8-df65-4b4f-be03-79a2823b3770 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:14.747702 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-03d291d8-df65-4b4f-be03-79a2823b3770 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: a0fd9e29-e10d-478a-8caa-1f32e9783550] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:10:14.761486 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.compute.api [None req-03d291d8-df65-4b4f-be03-79a2823b3770 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: a0fd9e29-e10d-478a-8caa-1f32e9783550] Working on deleting snapshot 01ca2599-c6af-4409-b29c-88f375e13d3e from shelved instance... Sep 17 21:10:14.860525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5bd9e9fb-275b-436b-b29b-09064a3e1103 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:14.873320 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5bd9e9fb-275b-436b-b29b-09064a3e1103 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe" status: 200 len: 1327 microversion: 2.1 time: 0.299635 Sep 17 21:10:14.874404 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2284/4484] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:14 2022] GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe => generated 1327 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:15.135037 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-982416a7-e8ae-4e7e-ad65-3a4499803667 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:15.137883 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-982416a7-e8ae-4e7e-ad65-3a4499803667 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:15.156146 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-982416a7-e8ae-4e7e-ad65-3a4499803667 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:15.156641 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-982416a7-e8ae-4e7e-ad65-3a4499803667 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:15.157082 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-982416a7-e8ae-4e7e-ad65-3a4499803667 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:15.158021 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-982416a7-e8ae-4e7e-ad65-3a4499803667 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:15.158695 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-982416a7-e8ae-4e7e-ad65-3a4499803667 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:15.159300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-982416a7-e8ae-4e7e-ad65-3a4499803667 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:15.564496 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-982416a7-e8ae-4e7e-ad65-3a4499803667 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:15.576354 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-982416a7-e8ae-4e7e-ad65-3a4499803667 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d" status: 200 len: 1520 microversion: 2.1 time: 0.451735 Sep 17 21:10:15.579245 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2285/4485] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:15 2022] GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d => generated 1520 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:15.596987 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8fbe1357-7465-4d5f-92cc-d01f18e9a408 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:15.597885 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8fbe1357-7465-4d5f-92cc-d01f18e9a408 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:15.616176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8fbe1357-7465-4d5f-92cc-d01f18e9a408 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:15.617142 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8fbe1357-7465-4d5f-92cc-d01f18e9a408 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:15.617672 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8fbe1357-7465-4d5f-92cc-d01f18e9a408 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:15.618566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8fbe1357-7465-4d5f-92cc-d01f18e9a408 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:15.619101 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8fbe1357-7465-4d5f-92cc-d01f18e9a408 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:15.619627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8fbe1357-7465-4d5f-92cc-d01f18e9a408 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:15.736454 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8fbe1357-7465-4d5f-92cc-d01f18e9a408 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:15.752643 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8fbe1357-7465-4d5f-92cc-d01f18e9a408 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a" status: 200 len: 1615 microversion: 2.1 time: 0.159911 Sep 17 21:10:15.754371 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2286/4486] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:15 2022] GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a => generated 1615 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:10:15.760058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-7abf6c08-dbfe-4923-9c92-a9a820055744 req-92f77fe8-7b4c-4877-96d0-6317f27c93f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59016b2c-e625-4f0c-8379-b48d97025cf3", "tag": "91cb57c8-4607-4745-9e86-253c6e4b6335"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:15.775106 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7abf6c08-dbfe-4923-9c92-a9a820055744 req-92f77fe8-7b4c-4877-96d0-6317f27c93f8 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:15.777075 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7abf6c08-dbfe-4923-9c92-a9a820055744 req-92f77fe8-7b4c-4877-96d0-6317f27c93f8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:15.777763 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7abf6c08-dbfe-4923-9c92-a9a820055744 req-92f77fe8-7b4c-4877-96d0-6317f27c93f8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:15.812618 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-7abf6c08-dbfe-4923-9c92-a9a820055744 req-92f77fe8-7b4c-4877-96d0-6317f27c93f8 service nova] Creating event network-changed:91cb57c8-4607-4745-9e86-253c6e4b6335 for instance 59016b2c-e625-4f0c-8379-b48d97025cf3 on nch2-master-1 Sep 17 21:10:15.823860 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-7abf6c08-dbfe-4923-9c92-a9a820055744 req-92f77fe8-7b4c-4877-96d0-6317f27c93f8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067622 Sep 17 21:10:15.829037 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2287/4487] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:10:15.903854 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-93d1a2fd-bf81-4eaa-b31d-15efb4dfde8c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:15.904679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-93d1a2fd-bf81-4eaa-b31d-15efb4dfde8c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: fb346c6f-8465-4e0d-8bb6-0319d440d7fe] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:15.914911 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-03d291d8-df65-4b4f-be03-79a2823b3770 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: a0fd9e29-e10d-478a-8caa-1f32e9783550] Doing local delete in cell 056db90a-cdd9-42b2-a8c3-cd5ab36662a4(cell1) {{(pid=140523) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 17 21:10:15.919035 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-93d1a2fd-bf81-4eaa-b31d-15efb4dfde8c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:15.919423 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-03d291d8-df65-4b4f-be03-79a2823b3770 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:15.919539 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-93d1a2fd-bf81-4eaa-b31d-15efb4dfde8c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:15.920060 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-93d1a2fd-bf81-4eaa-b31d-15efb4dfde8c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:15.921423 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-03d291d8-df65-4b4f-be03-79a2823b3770 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:15.922021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-03d291d8-df65-4b4f-be03-79a2823b3770 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:15.923323 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.compute.api [None req-03d291d8-df65-4b4f-be03-79a2823b3770 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: a0fd9e29-e10d-478a-8caa-1f32e9783550] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 17 21:10:15.925486 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-93d1a2fd-bf81-4eaa-b31d-15efb4dfde8c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:15.929261 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-93d1a2fd-bf81-4eaa-b31d-15efb4dfde8c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:15.929903 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-93d1a2fd-bf81-4eaa-b31d-15efb4dfde8c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:15.934902 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-03d291d8-df65-4b4f-be03-79a2823b3770 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: a0fd9e29-e10d-478a-8caa-1f32e9783550] deallocate_for_instance() {{(pid=140523) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 17 21:10:16.516000 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-93d1a2fd-bf81-4eaa-b31d-15efb4dfde8c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:16.530226 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-93d1a2fd-bf81-4eaa-b31d-15efb4dfde8c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe" status: 200 len: 1327 microversion: 2.1 time: 0.632115 Sep 17 21:10:16.551098 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2288/4488] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:15 2022] GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe => generated 1327 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:16.605214 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ccfa60e4-cd14-4f8e-b655-4e90374be6fa tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:16.606336 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ccfa60e4-cd14-4f8e-b655-4e90374be6fa tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:16.620387 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ccfa60e4-cd14-4f8e-b655-4e90374be6fa tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:16.621341 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ccfa60e4-cd14-4f8e-b655-4e90374be6fa tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:16.623579 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ccfa60e4-cd14-4f8e-b655-4e90374be6fa tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:16.626539 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ccfa60e4-cd14-4f8e-b655-4e90374be6fa tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:16.627781 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ccfa60e4-cd14-4f8e-b655-4e90374be6fa tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:16.629337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ccfa60e4-cd14-4f8e-b655-4e90374be6fa tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:17.456103 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ccfa60e4-cd14-4f8e-b655-4e90374be6fa tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:17.464833 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ccfa60e4-cd14-4f8e-b655-4e90374be6fa tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d" status: 200 len: 1520 microversion: 2.1 time: 0.864149 Sep 17 21:10:17.471039 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2289/4489] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:16 2022] GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d => generated 1520 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:10:17.492509 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a5512aad-7a85-41ea-aef5-0a293fa65fc5 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:17.495013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a5512aad-7a85-41ea-aef5-0a293fa65fc5 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:17.510812 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5512aad-7a85-41ea-aef5-0a293fa65fc5 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:17.511696 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5512aad-7a85-41ea-aef5-0a293fa65fc5 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:17.512341 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5512aad-7a85-41ea-aef5-0a293fa65fc5 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:17.513448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5512aad-7a85-41ea-aef5-0a293fa65fc5 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:17.514324 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5512aad-7a85-41ea-aef5-0a293fa65fc5 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:17.514950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5512aad-7a85-41ea-aef5-0a293fa65fc5 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:17.630668 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a5512aad-7a85-41ea-aef5-0a293fa65fc5 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:17.651978 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a5512aad-7a85-41ea-aef5-0a293fa65fc5 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a" status: 200 len: 1615 microversion: 2.1 time: 0.177413 Sep 17 21:10:17.654275 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2290/4490] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:17 2022] GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a => generated 1615 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:17.974148 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-07a79c35-c23e-40f7-80b2-2b9b3bb863ea tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1872798765", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:18.080492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-03d291d8-df65-4b4f-be03-79a2823b3770 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: a0fd9e29-e10d-478a-8caa-1f32e9783550] Updating instance_info_cache with network_info: [] {{(pid=140523) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 17 21:10:18.091886 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-07a79c35-c23e-40f7-80b2-2b9b3bb863ea tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] validate_networks() for None {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:10:18.453537 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=1,nova_cell1:UPDATE=4,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:18.736815 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-07a79c35-c23e-40f7-80b2-2b9b3bb863ea tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:10:18.737335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-07a79c35-c23e-40f7-80b2-2b9b3bb863ea tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:10:18.737884 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-07a79c35-c23e-40f7-80b2-2b9b3bb863ea tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:10:18.738473 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-07a79c35-c23e-40f7-80b2-2b9b3bb863ea tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:10:18.738993 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-07a79c35-c23e-40f7-80b2-2b9b3bb863ea tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:10:18.749445 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-07a79c35-c23e-40f7-80b2-2b9b3bb863ea tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:18.750137 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-07a79c35-c23e-40f7-80b2-2b9b3bb863ea tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:18.751086 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-07a79c35-c23e-40f7-80b2-2b9b3bb863ea tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:18.751935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-07a79c35-c23e-40f7-80b2-2b9b3bb863ea tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:18.752497 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-07a79c35-c23e-40f7-80b2-2b9b3bb863ea tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:18.753024 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-07a79c35-c23e-40f7-80b2-2b9b3bb863ea tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:18.783543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-07a79c35-c23e-40f7-80b2-2b9b3bb863ea tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Getting quotas for project 4ceec62fde59414ebb34572d8f8fbcfe. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:10:18.790421 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-07a79c35-c23e-40f7-80b2-2b9b3bb863ea tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Getting quotas for user 1fbd80f0e5bf46b78a79fd821e9ff89e and project 4ceec62fde59414ebb34572d8f8fbcfe. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:10:18.815334 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-07a79c35-c23e-40f7-80b2-2b9b3bb863ea tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:10:18.818128 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-07a79c35-c23e-40f7-80b2-2b9b3bb863ea tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] [instance: 1bb77042-152e-4948-95ab-8849c8d72c80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:10:18.821123 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-03d291d8-df65-4b4f-be03-79a2823b3770 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550" status: 204 len: 0 microversion: 2.1 time: 4.177159 Sep 17 21:10:18.824113 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2201/4491] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:10:14 2022] DELETE /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550 => generated 0 bytes in 4181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:10:18.836159 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e9c7380e-1b7c-42e1-9522-fa4265be1a86 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:18.837243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e9c7380e-1b7c-42e1-9522-fa4265be1a86 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: fb346c6f-8465-4e0d-8bb6-0319d440d7fe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:18.854187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9c7380e-1b7c-42e1-9522-fa4265be1a86 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:18.855027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9c7380e-1b7c-42e1-9522-fa4265be1a86 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:18.856228 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9c7380e-1b7c-42e1-9522-fa4265be1a86 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:18.858336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9c7380e-1b7c-42e1-9522-fa4265be1a86 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:18.858849 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9c7380e-1b7c-42e1-9522-fa4265be1a86 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:18.859315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9c7380e-1b7c-42e1-9522-fa4265be1a86 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:18.889504 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-07a79c35-c23e-40f7-80b2-2b9b3bb863ea tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.231260 Sep 17 21:10:18.891533 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2291/4492] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:10:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1235 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:10:18.898971 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-c505329a-67d4-4934-a2bb-092b65a2ebbf req-77a09960-0411-455c-bca3-9d5b14b9cd12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8e3d0a-75b8-40ed-ade5-deffe7b8105a", "name": "network-vif-deleted", "tag": "555687eb-bade-4e83-8253-ed937a447e79"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:18.913730 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c505329a-67d4-4934-a2bb-092b65a2ebbf req-77a09960-0411-455c-bca3-9d5b14b9cd12 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:18.914683 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c505329a-67d4-4934-a2bb-092b65a2ebbf req-77a09960-0411-455c-bca3-9d5b14b9cd12 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:18.915436 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c505329a-67d4-4934-a2bb-092b65a2ebbf req-77a09960-0411-455c-bca3-9d5b14b9cd12 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:19.022667 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-c505329a-67d4-4934-a2bb-092b65a2ebbf req-77a09960-0411-455c-bca3-9d5b14b9cd12 service nova] Creating event network-vif-deleted:555687eb-bade-4e83-8253-ed937a447e79 for instance 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a on nch1-master-1 Sep 17 21:10:19.062678 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-c505329a-67d4-4934-a2bb-092b65a2ebbf req-77a09960-0411-455c-bca3-9d5b14b9cd12 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162383 Sep 17 21:10:19.072823 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2292/4493] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:10:19.095087 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-e70505fc-2d17-45b2-99f7-e7ec4a74a38a req-1184a526-b280-419d-92cf-c0320f91464b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0fd9e29-e10d-478a-8caa-1f32e9783550", "name": "network-vif-deleted", "tag": "ef4386dd-dc83-43b4-861a-e9e171dfffcf"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:19.141117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e70505fc-2d17-45b2-99f7-e7ec4a74a38a req-1184a526-b280-419d-92cf-c0320f91464b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:19.143328 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e70505fc-2d17-45b2-99f7-e7ec4a74a38a req-1184a526-b280-419d-92cf-c0320f91464b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:19.144190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e70505fc-2d17-45b2-99f7-e7ec4a74a38a req-1184a526-b280-419d-92cf-c0320f91464b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:19.168656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.compute.server_external_events [req-e70505fc-2d17-45b2-99f7-e7ec4a74a38a req-1184a526-b280-419d-92cf-c0320f91464b service nova] Unable to find a host for instance a0fd9e29-e10d-478a-8caa-1f32e9783550. Dropping event network-vif-deleted {{(pid=140524) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 17 21:10:19.169975 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-e70505fc-2d17-45b2-99f7-e7ec4a74a38a req-1184a526-b280-419d-92cf-c0320f91464b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.094294 Sep 17 21:10:19.171105 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2293/4494] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 98 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 17 21:10:19.196608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-972aeb2a-8b9c-483c-9188-ec05ee6a9366 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:19.202632 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-972aeb2a-8b9c-483c-9188-ec05ee6a9366 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:19.223930 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-972aeb2a-8b9c-483c-9188-ec05ee6a9366 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:19.233097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-972aeb2a-8b9c-483c-9188-ec05ee6a9366 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:19.236467 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-972aeb2a-8b9c-483c-9188-ec05ee6a9366 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:19.238767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-972aeb2a-8b9c-483c-9188-ec05ee6a9366 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:19.239821 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-972aeb2a-8b9c-483c-9188-ec05ee6a9366 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:19.240502 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-972aeb2a-8b9c-483c-9188-ec05ee6a9366 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:19.297114 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-972aeb2a-8b9c-483c-9188-ec05ee6a9366 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:19.297915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-972aeb2a-8b9c-483c-9188-ec05ee6a9366 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:19.298576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-972aeb2a-8b9c-483c-9188-ec05ee6a9366 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:19.299269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-972aeb2a-8b9c-483c-9188-ec05ee6a9366 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lazy-loading 'fault' on Instance uuid 904ea7d3-2a78-408a-8a14-bac3845f6e7d {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:10:19.484566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-972aeb2a-8b9c-483c-9188-ec05ee6a9366 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '795813bb461e42ad8c2a758e9b8430d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8ed24e4bf6643f7b1474fcec78c4995', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:19.501452 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-972aeb2a-8b9c-483c-9188-ec05ee6a9366 tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d" status: 200 len: 1311 microversion: 2.1 time: 0.328079 Sep 17 21:10:19.503242 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2294/4495] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:19 2022] GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d => generated 1311 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:19.516264 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4f2f821f-18f6-4996-bbcc-1354f46d983a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:19.517121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4f2f821f-18f6-4996-bbcc-1354f46d983a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:19.543555 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f2f821f-18f6-4996-bbcc-1354f46d983a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:19.544076 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f2f821f-18f6-4996-bbcc-1354f46d983a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:19.544519 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f2f821f-18f6-4996-bbcc-1354f46d983a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:19.560625 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f2f821f-18f6-4996-bbcc-1354f46d983a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:19.561251 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f2f821f-18f6-4996-bbcc-1354f46d983a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:19.574219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f2f821f-18f6-4996-bbcc-1354f46d983a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:19.612637 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-4f2f821f-18f6-4996-bbcc-1354f46d983a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] HTTP exception thrown: Instance 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a could not be found. Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4f2f821f-18f6-4996-bbcc-1354f46d983a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Request method failure captured: Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a HTTP/1.1 Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJja5IhqAUJRQXEUU1o8JKB7VL3QF2aEShf_6YtjfGFX6a2gdfOrA57RhEkrL_xji2fJrjERU1MYqs2fkCF1UUkZO1MCrMj-4yvDSZkq5ddhPAEMc-mFSR2bL5wENqd3kTDvDHvjjOdVeCZP6ndR-6jR5boE-dCWiUzV7hdKlqCy2Jhg Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 6fa7e14863254ab3964ac907c168d9e6 Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6fa7e14863254ab3964ac907c168d9e6", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 6fa7e14863254ab3964ac907c168d9e6 Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-AttachVolumeNegativeTest-1020448628-project Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: c544e8e6f7a741c985c92ed7437397cd Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-AttachVolumeNegativeTest-1020448628-project Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a could not be found. Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '0d8e3d0a-75b8-40ed-ade5-deffe7b8105a'} Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a could not be found. Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a could not be found. Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:10:19.616133 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:10:19.620421 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:19.620421 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:10:19.620421 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:10:19.620421 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:10:19.620421 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:10:19.620421 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a could not be found. Sep 17 21:10:19.620421 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:10:19.623079 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4f2f821f-18f6-4996-bbcc-1354f46d983a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Returning 404 to user: Instance 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:10:19.624494 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4f2f821f-18f6-4996-bbcc-1354f46d983a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a" status: 404 len: 111 microversion: 2.1 time: 0.119855 Sep 17 21:10:19.629152 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2295/4496] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:19 2022] GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:10:19.638719 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c65c5632-1f42-4b6f-9056-80303775f2b4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:19.642170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c65c5632-1f42-4b6f-9056-80303775f2b4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: a0fd9e29-e10d-478a-8caa-1f32e9783550] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:19.663735 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c65c5632-1f42-4b6f-9056-80303775f2b4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:19.664128 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c65c5632-1f42-4b6f-9056-80303775f2b4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:19.665747 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c65c5632-1f42-4b6f-9056-80303775f2b4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:19.678078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c65c5632-1f42-4b6f-9056-80303775f2b4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:19.678778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c65c5632-1f42-4b6f-9056-80303775f2b4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:19.679286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c65c5632-1f42-4b6f-9056-80303775f2b4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:19.714495 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-c65c5632-1f42-4b6f-9056-80303775f2b4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] HTTP exception thrown: Instance a0fd9e29-e10d-478a-8caa-1f32e9783550 could not be found. Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c65c5632-1f42-4b6f-9056-80303775f2b4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Request method failure captured: Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550 HTTP/1.1 Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjWtNzto0mtliTp7XFuULyHI3we00ltwNJkYCbse73U4gam1okW0tzurAZa5qe_YztpOkiAgcTw1EzIzI3V47Ip6mNu1JOtXw9_irlu2PoTiHu-RjUFuYp2PItqb9Y3KBbavW0dotTtDS8YxL9QYLwabuvziZ2iGyr941Z01slaUM2o Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 3e48e3c2f7f74636a75679fdf10ef33a Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerActionsTestJSON-1146998919 Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e48e3c2f7f74636a75679fdf10ef33a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3e48e3c2f7f74636a75679fdf10ef33a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e48e3c2f7f74636a75679fdf10ef33a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3e48e3c2f7f74636a75679fdf10ef33a", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerActionsTestJSON-1146998919 Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 3e48e3c2f7f74636a75679fdf10ef33a Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerActionsTestJSON-1146998919 Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerActionsTestJSON-1146998919-project Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 2ef547e071fd43ec96c745c26eca119f Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerActionsTestJSON-1146998919-project Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance a0fd9e29-e10d-478a-8caa-1f32e9783550 could not be found. Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'a0fd9e29-e10d-478a-8caa-1f32e9783550'} Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0fd9e29-e10d-478a-8caa-1f32e9783550 could not be found. Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0fd9e29-e10d-478a-8caa-1f32e9783550 could not be found. Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:10:19.716080 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:10:19.721051 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:19.721051 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:10:19.721051 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:10:19.721051 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:10:19.721051 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:10:19.721051 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0fd9e29-e10d-478a-8caa-1f32e9783550 could not be found. Sep 17 21:10:19.721051 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:10:19.721051 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c65c5632-1f42-4b6f-9056-80303775f2b4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Returning 404 to user: Instance a0fd9e29-e10d-478a-8caa-1f32e9783550 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:10:19.721051 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c65c5632-1f42-4b6f-9056-80303775f2b4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550" status: 404 len: 111 microversion: 2.1 time: 0.087074 Sep 17 21:10:19.721051 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2296/4497] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:19 2022] GET /compute/v2.1/servers/a0fd9e29-e10d-478a-8caa-1f32e9783550 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:10:19.723145 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f871ac29-4c3a-4d7b-8b24-6f9ce55cda5e tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:19.723835 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f871ac29-4c3a-4d7b-8b24-6f9ce55cda5e tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] [instance: 1bb77042-152e-4948-95ab-8849c8d72c80] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:19.842098 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f871ac29-4c3a-4d7b-8b24-6f9ce55cda5e tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbd80f0e5bf46b78a79fd821e9ff89e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ceec62fde59414ebb34572d8f8fbcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:19.850412 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f871ac29-4c3a-4d7b-8b24-6f9ce55cda5e tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80" status: 200 len: 1217 microversion: 2.1 time: 0.130761 Sep 17 21:10:19.852768 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2297/4498] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:19 2022] GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80 => generated 1217 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:19.872588 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e9c7380e-1b7c-42e1-9522-fa4265be1a86 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:19.876573 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-58931ada-155a-4f7b-b42d-cc8e1035a33d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '.version_select at 0x7f259fe4a670>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:19.884456 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e9c7380e-1b7c-42e1-9522-fa4265be1a86 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe" status: 200 len: 1327 microversion: 2.1 time: 1.058464 Sep 17 21:10:19.885497 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2202/4499] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:18 2022] GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe => generated 1327 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:19.891603 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e3134207-3237-4d96-871e-89b75a4d1086 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:19.892435 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e3134207-3237-4d96-871e-89b75a4d1086 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 3e57dbfe-799f-429f-8cef-96dec36bb3e1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:19.924817 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e3134207-3237-4d96-871e-89b75a4d1086 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:19.926393 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e3134207-3237-4d96-871e-89b75a4d1086 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:19.934752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e3134207-3237-4d96-871e-89b75a4d1086 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:19.936169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e3134207-3237-4d96-871e-89b75a4d1086 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:19.936837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e3134207-3237-4d96-871e-89b75a4d1086 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:19.937619 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e3134207-3237-4d96-871e-89b75a4d1086 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:19.970279 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-58931ada-155a-4f7b-b42d-cc8e1035a33d tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1790176936" status: 202 len: 0 microversion: 2.1 time: 0.109332 Sep 17 21:10:19.970794 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2298/4500] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Sep 17 21:10:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1790176936 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:10:19.978541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e3134207-3237-4d96-871e-89b75a4d1086 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 3e57dbfe-799f-429f-8cef-96dec36bb3e1] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:10:19.986902 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-f8d93b3b-c484-4759-83fe-722d62aca182 req-b42662d0-81ba-47d3-843d-a3795fc672de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb346c6f-8465-4e0d-8bb6-0319d440d7fe", "name": "network-vif-plugged", "status": "completed", "tag": "7a6524ad-e53f-4159-af1a-89a8899d9676"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:19.997660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f8d93b3b-c484-4759-83fe-722d62aca182 req-b42662d0-81ba-47d3-843d-a3795fc672de service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:19.998274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f8d93b3b-c484-4759-83fe-722d62aca182 req-b42662d0-81ba-47d3-843d-a3795fc672de service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:19.998714 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f8d93b3b-c484-4759-83fe-722d62aca182 req-b42662d0-81ba-47d3-843d-a3795fc672de service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:20.016496 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-f8d93b3b-c484-4759-83fe-722d62aca182 req-b42662d0-81ba-47d3-843d-a3795fc672de service nova] Creating event network-vif-plugged:7a6524ad-e53f-4159-af1a-89a8899d9676 for instance fb346c6f-8465-4e0d-8bb6-0319d440d7fe on nch1-master-1 Sep 17 21:10:20.023562 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-f8d93b3b-c484-4759-83fe-722d62aca182 req-b42662d0-81ba-47d3-843d-a3795fc672de service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040885 Sep 17 21:10:20.024569 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2299/4501] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:10:20.127346 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e3134207-3237-4d96-871e-89b75a4d1086 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1" status: 204 len: 0 microversion: 2.1 time: 0.240074 Sep 17 21:10:20.130830 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2203/4502] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:10:19 2022] DELETE /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:10:20.139642 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1c46e778-0b4c-43a4-88c7-ed6f270d6a92 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:20.140339 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1c46e778-0b4c-43a4-88c7-ed6f270d6a92 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 3e57dbfe-799f-429f-8cef-96dec36bb3e1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:20.142545 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:20.175319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c46e778-0b4c-43a4-88c7-ed6f270d6a92 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:20.176826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c46e778-0b4c-43a4-88c7-ed6f270d6a92 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:20.179130 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c46e778-0b4c-43a4-88c7-ed6f270d6a92 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:20.179890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c46e778-0b4c-43a4-88c7-ed6f270d6a92 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:20.180369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c46e778-0b4c-43a4-88c7-ed6f270d6a92 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:20.182118 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c46e778-0b4c-43a4-88c7-ed6f270d6a92 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:20.407529 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1c46e778-0b4c-43a4-88c7-ed6f270d6a92 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:20.410408 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:20.422490 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1c46e778-0b4c-43a4-88c7-ed6f270d6a92 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1" status: 200 len: 1466 microversion: 2.1 time: 0.286191 Sep 17 21:10:20.439074 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2300/4503] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:20 2022] GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1 => generated 1466 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:20.528357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-137189ff-4223-471c-b70a-85378f63542b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:20.529414 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-137189ff-4223-471c-b70a-85378f63542b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] [instance: 904ea7d3-2a78-408a-8a14-bac3845f6e7d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:20.538103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-137189ff-4223-471c-b70a-85378f63542b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:20.538733 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-137189ff-4223-471c-b70a-85378f63542b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:20.539450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-137189ff-4223-471c-b70a-85378f63542b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:20.540358 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-137189ff-4223-471c-b70a-85378f63542b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:20.540888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-137189ff-4223-471c-b70a-85378f63542b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:20.541550 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-137189ff-4223-471c-b70a-85378f63542b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:20.558809 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-137189ff-4223-471c-b70a-85378f63542b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] HTTP exception thrown: Instance 904ea7d3-2a78-408a-8a14-bac3845f6e7d could not be found. Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-137189ff-4223-471c-b70a-85378f63542b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Request method failure captured: Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d HTTP/1.1 Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjaiOOC2XD-QIsLuDvG9bxN3jnLjmueVdk28NKERipgg7mZAUnmkYYkUcMWYkcsUdzUwALfMrwKYbIvTbrUxBdv7HTTnMRjY98z2HSanC8PyMI0Bvd8_fsMNUR8WwzuWwOyttA6z4v7owoNPIa2XeOfidHHD5bq9m_itbcIiBCzoH1A Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: f8ed24e4bf6643f7b1474fcec78c4995 Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-533169750 Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ed24e4bf6643f7b1474fcec78c4995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f8ed24e4bf6643f7b1474fcec78c4995"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f8ed24e4bf6643f7b1474fcec78c4995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f8ed24e4bf6643f7b1474fcec78c4995", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerRescueNegativeTestJSON-533169750 Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: f8ed24e4bf6643f7b1474fcec78c4995 Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-533169750 Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerRescueNegativeTestJSON-533169750-project Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 795813bb461e42ad8c2a758e9b8430d6 Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerRescueNegativeTestJSON-533169750-project Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 904ea7d3-2a78-408a-8a14-bac3845f6e7d could not be found. Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '904ea7d3-2a78-408a-8a14-bac3845f6e7d'} Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 904ea7d3-2a78-408a-8a14-bac3845f6e7d could not be found. Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 904ea7d3-2a78-408a-8a14-bac3845f6e7d could not be found. Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:10:20.560810 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:10:20.566676 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:10:20.566676 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:20.566676 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:10:20.566676 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:10:20.566676 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:10:20.566676 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:10:20.566676 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 904ea7d3-2a78-408a-8a14-bac3845f6e7d could not be found. Sep 17 21:10:20.566676 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:10:20.566676 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-137189ff-4223-471c-b70a-85378f63542b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] Returning 404 to user: Instance 904ea7d3-2a78-408a-8a14-bac3845f6e7d could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:10:20.566676 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-137189ff-4223-471c-b70a-85378f63542b tempest-ServerRescueNegativeTestJSON-533169750 tempest-ServerRescueNegativeTestJSON-533169750-project] 10.222.0.26 "GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d" status: 404 len: 111 microversion: 2.1 time: 0.043478 Sep 17 21:10:20.568246 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2204/4504] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:20 2022] GET /compute/v2.1/servers/904ea7d3-2a78-408a-8a14-bac3845f6e7d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 21:10:20.879893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bdf3eb68-f2dd-4f58-b980-df80c2aa0202 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:20.880530 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bdf3eb68-f2dd-4f58-b980-df80c2aa0202 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] [instance: 1bb77042-152e-4948-95ab-8849c8d72c80] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:20.901349 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bdf3eb68-f2dd-4f58-b980-df80c2aa0202 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:20.902988 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bdf3eb68-f2dd-4f58-b980-df80c2aa0202 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:20.903671 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bdf3eb68-f2dd-4f58-b980-df80c2aa0202 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:20.904880 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bdf3eb68-f2dd-4f58-b980-df80c2aa0202 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:20.905789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bdf3eb68-f2dd-4f58-b980-df80c2aa0202 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:20.913575 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c8669f76-e3d4-40fb-9482-2395e86edb29 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:20.914129 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c8669f76-e3d4-40fb-9482-2395e86edb29 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: fb346c6f-8465-4e0d-8bb6-0319d440d7fe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:20.918267 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bdf3eb68-f2dd-4f58-b980-df80c2aa0202 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:20.928561 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8669f76-e3d4-40fb-9482-2395e86edb29 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:20.929070 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8669f76-e3d4-40fb-9482-2395e86edb29 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:20.934967 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8669f76-e3d4-40fb-9482-2395e86edb29 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:20.942262 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8669f76-e3d4-40fb-9482-2395e86edb29 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:20.942973 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8669f76-e3d4-40fb-9482-2395e86edb29 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:20.945544 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8669f76-e3d4-40fb-9482-2395e86edb29 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:21.159559 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bdf3eb68-f2dd-4f58-b980-df80c2aa0202 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbd80f0e5bf46b78a79fd821e9ff89e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ceec62fde59414ebb34572d8f8fbcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:21.172443 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bdf3eb68-f2dd-4f58-b980-df80c2aa0202 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80" status: 200 len: 1277 microversion: 2.1 time: 0.300589 Sep 17 21:10:21.174102 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2301/4505] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:20 2022] GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80 => generated 1277 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:21.183475 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-97b4d2eb-d185-4adf-a88a-eee0a35d90ea req-50b49a1a-5105-4746-a4d4-9f3316e65ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "904ea7d3-2a78-408a-8a14-bac3845f6e7d", "name": "network-vif-deleted", "tag": "5906edb3-bf5e-4b3d-a715-33e774720045"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:21.202410 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-97b4d2eb-d185-4adf-a88a-eee0a35d90ea req-50b49a1a-5105-4746-a4d4-9f3316e65ab0 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:21.203567 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-97b4d2eb-d185-4adf-a88a-eee0a35d90ea req-50b49a1a-5105-4746-a4d4-9f3316e65ab0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:21.204407 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-97b4d2eb-d185-4adf-a88a-eee0a35d90ea req-50b49a1a-5105-4746-a4d4-9f3316e65ab0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:21.226290 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-97b4d2eb-d185-4adf-a88a-eee0a35d90ea req-50b49a1a-5105-4746-a4d4-9f3316e65ab0 service nova] Creating event network-vif-deleted:5906edb3-bf5e-4b3d-a715-33e774720045 for instance 904ea7d3-2a78-408a-8a14-bac3845f6e7d on nch2-master-1 Sep 17 21:10:21.234101 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-97b4d2eb-d185-4adf-a88a-eee0a35d90ea req-50b49a1a-5105-4746-a4d4-9f3316e65ab0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056537 Sep 17 21:10:21.235032 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2302/4506] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:10:21.334814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c8669f76-e3d4-40fb-9482-2395e86edb29 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:21.354262 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c8669f76-e3d4-40fb-9482-2395e86edb29 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe" status: 200 len: 1327 microversion: 2.1 time: 0.446567 Sep 17 21:10:21.364201 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2205/4507] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:20 2022] GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe => generated 1327 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:21.461574 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fa79dca9-db2c-45f5-a98e-e9982781e2d4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:21.461574 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fa79dca9-db2c-45f5-a98e-e9982781e2d4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 3e57dbfe-799f-429f-8cef-96dec36bb3e1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:21.483731 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa79dca9-db2c-45f5-a98e-e9982781e2d4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:21.484303 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa79dca9-db2c-45f5-a98e-e9982781e2d4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:21.485403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa79dca9-db2c-45f5-a98e-e9982781e2d4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:21.488222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa79dca9-db2c-45f5-a98e-e9982781e2d4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:21.489203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa79dca9-db2c-45f5-a98e-e9982781e2d4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:21.489835 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa79dca9-db2c-45f5-a98e-e9982781e2d4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:21.615841 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fa79dca9-db2c-45f5-a98e-e9982781e2d4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:21.632584 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fa79dca9-db2c-45f5-a98e-e9982781e2d4 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1" status: 200 len: 1466 microversion: 2.1 time: 0.188109 Sep 17 21:10:21.637868 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2303/4508] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:21 2022] GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1 => generated 1466 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:21.640746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a0c01546-d475-450f-b572-24396ef5b8d1 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Action: 'create', calling method: .version_select at 0x7f25a4f35790>, body: {"keypair": {"name": "tempest-keypair-1651521270", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxnGfxPV8Mp3dVFwDX8mgP5AXOfEUFlb0F8B5l4MQ7MFtMlzRBt37NI/h6mTQM6/oovLUwhu0WhZOoiizt81BzFPRXwVp5xZHZpQTuqVlVvTkEPb42BxcKwjhUpFlOcKA=="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:21.658703 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-a0c01546-d475-450f-b572-24396ef5b8d1 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Getting quotas for project 6fa7e14863254ab3964ac907c168d9e6. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:10:21.664753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-a0c01546-d475-450f-b572-24396ef5b8d1 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Getting quotas for user c544e8e6f7a741c985c92ed7437397cd and project 6fa7e14863254ab3964ac907c168d9e6. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:10:21.710753 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a0c01546-d475-450f-b572-24396ef5b8d1 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.073221 Sep 17 21:10:21.711835 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2206/4509] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:10:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:10:22.200429 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ceb3c623-6970-4d95-b519-929342a5e2c2 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:22.202011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ceb3c623-6970-4d95-b519-929342a5e2c2 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] [instance: 1bb77042-152e-4948-95ab-8849c8d72c80] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:22.215757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ceb3c623-6970-4d95-b519-929342a5e2c2 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:22.216858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ceb3c623-6970-4d95-b519-929342a5e2c2 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:22.217624 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ceb3c623-6970-4d95-b519-929342a5e2c2 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:22.218653 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ceb3c623-6970-4d95-b519-929342a5e2c2 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:22.219389 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ceb3c623-6970-4d95-b519-929342a5e2c2 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:22.220728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ceb3c623-6970-4d95-b519-929342a5e2c2 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:22.314395 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ceb3c623-6970-4d95-b519-929342a5e2c2 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbd80f0e5bf46b78a79fd821e9ff89e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ceec62fde59414ebb34572d8f8fbcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:22.324646 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ceb3c623-6970-4d95-b519-929342a5e2c2 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80" status: 200 len: 1275 microversion: 2.1 time: 0.131633 Sep 17 21:10:22.337992 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2304/4510] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:22 2022] GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80 => generated 1275 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:22.381628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-585965b8-0e6d-406a-be9b-9bccbeb7aea2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:22.382377 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-585965b8-0e6d-406a-be9b-9bccbeb7aea2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: fb346c6f-8465-4e0d-8bb6-0319d440d7fe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:22.394174 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-585965b8-0e6d-406a-be9b-9bccbeb7aea2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:22.394866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-585965b8-0e6d-406a-be9b-9bccbeb7aea2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:22.395506 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-585965b8-0e6d-406a-be9b-9bccbeb7aea2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:22.396515 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-585965b8-0e6d-406a-be9b-9bccbeb7aea2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:22.397055 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-585965b8-0e6d-406a-be9b-9bccbeb7aea2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:22.397497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-585965b8-0e6d-406a-be9b-9bccbeb7aea2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:22.660347 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7be448e1-11d9-4a3d-9458-4aa9431878e0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:22.661344 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7be448e1-11d9-4a3d-9458-4aa9431878e0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 3e57dbfe-799f-429f-8cef-96dec36bb3e1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:22.681105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7be448e1-11d9-4a3d-9458-4aa9431878e0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:22.682650 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7be448e1-11d9-4a3d-9458-4aa9431878e0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:22.683326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7be448e1-11d9-4a3d-9458-4aa9431878e0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:22.684293 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7be448e1-11d9-4a3d-9458-4aa9431878e0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:22.684756 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7be448e1-11d9-4a3d-9458-4aa9431878e0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:22.685393 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7be448e1-11d9-4a3d-9458-4aa9431878e0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:22.710756 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-585965b8-0e6d-406a-be9b-9bccbeb7aea2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:22.729902 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-585965b8-0e6d-406a-be9b-9bccbeb7aea2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe" status: 200 len: 1327 microversion: 2.1 time: 0.353895 Sep 17 21:10:22.745860 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2207/4511] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:22 2022] GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe => generated 1327 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:22.902818 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7be448e1-11d9-4a3d-9458-4aa9431878e0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:22.919831 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7be448e1-11d9-4a3d-9458-4aa9431878e0 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1" status: 200 len: 1466 microversion: 2.1 time: 0.263125 Sep 17 21:10:22.933733 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2305/4512] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:22 2022] GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1 => generated 1466 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:10:23.357137 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e28a9755-1bfe-4e78-b711-32b01487f88a tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:23.359176 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e28a9755-1bfe-4e78-b711-32b01487f88a tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] [instance: 1bb77042-152e-4948-95ab-8849c8d72c80] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:23.389014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e28a9755-1bfe-4e78-b711-32b01487f88a tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:23.389756 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e28a9755-1bfe-4e78-b711-32b01487f88a tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:23.390428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e28a9755-1bfe-4e78-b711-32b01487f88a tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:23.391807 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e28a9755-1bfe-4e78-b711-32b01487f88a tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:23.392441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e28a9755-1bfe-4e78-b711-32b01487f88a tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:23.393492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e28a9755-1bfe-4e78-b711-32b01487f88a tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:23.521002 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e28a9755-1bfe-4e78-b711-32b01487f88a tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbd80f0e5bf46b78a79fd821e9ff89e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ceec62fde59414ebb34572d8f8fbcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:23.535366 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e28a9755-1bfe-4e78-b711-32b01487f88a tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80" status: 200 len: 1275 microversion: 2.1 time: 0.188868 Sep 17 21:10:23.541507 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2208/4513] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:23 2022] GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80 => generated 1275 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:23.720149 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-b572bc26-6bbd-4593-8a0f-49ef8d89197b req-f7f16605-d4d6-434d-8880-afc2b9c2a5d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e57dbfe-799f-429f-8cef-96dec36bb3e1", "name": "network-vif-deleted", "tag": "0b4fb6b7-6a3b-4673-959e-b0233c88dadf"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:23.733722 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b572bc26-6bbd-4593-8a0f-49ef8d89197b req-f7f16605-d4d6-434d-8880-afc2b9c2a5d9 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:23.734827 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b572bc26-6bbd-4593-8a0f-49ef8d89197b req-f7f16605-d4d6-434d-8880-afc2b9c2a5d9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:23.735554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b572bc26-6bbd-4593-8a0f-49ef8d89197b req-f7f16605-d4d6-434d-8880-afc2b9c2a5d9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:23.758289 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7a32e0fa-a11c-4a15-9425-12e24408aabf tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:23.759026 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7a32e0fa-a11c-4a15-9425-12e24408aabf tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: fb346c6f-8465-4e0d-8bb6-0319d440d7fe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:23.777967 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-b572bc26-6bbd-4593-8a0f-49ef8d89197b req-f7f16605-d4d6-434d-8880-afc2b9c2a5d9 service nova] Creating event network-vif-deleted:0b4fb6b7-6a3b-4673-959e-b0233c88dadf for instance 3e57dbfe-799f-429f-8cef-96dec36bb3e1 on nch1-master-1 Sep 17 21:10:23.779981 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a32e0fa-a11c-4a15-9425-12e24408aabf tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:23.780638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a32e0fa-a11c-4a15-9425-12e24408aabf tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:23.782993 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a32e0fa-a11c-4a15-9425-12e24408aabf tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:23.786720 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a32e0fa-a11c-4a15-9425-12e24408aabf tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:23.791148 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a32e0fa-a11c-4a15-9425-12e24408aabf tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:23.792688 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a32e0fa-a11c-4a15-9425-12e24408aabf tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:23.802588 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-b572bc26-6bbd-4593-8a0f-49ef8d89197b req-f7f16605-d4d6-434d-8880-afc2b9c2a5d9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085930 Sep 17 21:10:23.807147 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2306/4514] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:10:23.950722 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8cf5c8fb-7503-44c0-877f-661d0b89e6a1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:23.951560 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8cf5c8fb-7503-44c0-877f-661d0b89e6a1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 3e57dbfe-799f-429f-8cef-96dec36bb3e1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:23.976127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8cf5c8fb-7503-44c0-877f-661d0b89e6a1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:23.977177 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8cf5c8fb-7503-44c0-877f-661d0b89e6a1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:23.979548 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8cf5c8fb-7503-44c0-877f-661d0b89e6a1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:23.981068 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8cf5c8fb-7503-44c0-877f-661d0b89e6a1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:23.983090 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8cf5c8fb-7503-44c0-877f-661d0b89e6a1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:23.985112 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8cf5c8fb-7503-44c0-877f-661d0b89e6a1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:24.086566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8cf5c8fb-7503-44c0-877f-661d0b89e6a1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:24.088307 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8cf5c8fb-7503-44c0-877f-661d0b89e6a1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:24.088957 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8cf5c8fb-7503-44c0-877f-661d0b89e6a1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:24.089740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-8cf5c8fb-7503-44c0-877f-661d0b89e6a1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lazy-loading 'fault' on Instance uuid 3e57dbfe-799f-429f-8cef-96dec36bb3e1 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:10:24.405190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8cf5c8fb-7503-44c0-877f-661d0b89e6a1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:24.435651 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8cf5c8fb-7503-44c0-877f-661d0b89e6a1 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1" status: 200 len: 1305 microversion: 2.1 time: 0.491576 Sep 17 21:10:24.441771 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2307/4515] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:23 2022] GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1 => generated 1305 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:24.566445 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8873a45b-9eff-4ce3-b194-8798ce6c7076 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:24.567444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8873a45b-9eff-4ce3-b194-8798ce6c7076 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] [instance: 1bb77042-152e-4948-95ab-8849c8d72c80] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:24.578474 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8873a45b-9eff-4ce3-b194-8798ce6c7076 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:24.578983 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8873a45b-9eff-4ce3-b194-8798ce6c7076 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:24.580161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8873a45b-9eff-4ce3-b194-8798ce6c7076 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:24.581657 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8873a45b-9eff-4ce3-b194-8798ce6c7076 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:24.583650 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8873a45b-9eff-4ce3-b194-8798ce6c7076 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:24.584124 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8873a45b-9eff-4ce3-b194-8798ce6c7076 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:24.732995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7a32e0fa-a11c-4a15-9425-12e24408aabf tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:24.753272 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7a32e0fa-a11c-4a15-9425-12e24408aabf tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe" status: 200 len: 1509 microversion: 2.1 time: 0.998702 Sep 17 21:10:24.755998 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2209/4516] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:23 2022] GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe => generated 1509 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:10:24.793514 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-633e7d67-454b-41f7-a0d7-3baf72618aad tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:24.795473 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-633e7d67-454b-41f7-a0d7-3baf72618aad tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: fb346c6f-8465-4e0d-8bb6-0319d440d7fe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:24.807630 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-633e7d67-454b-41f7-a0d7-3baf72618aad tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:24.808160 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-633e7d67-454b-41f7-a0d7-3baf72618aad tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:24.814851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-633e7d67-454b-41f7-a0d7-3baf72618aad tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:24.818369 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-633e7d67-454b-41f7-a0d7-3baf72618aad tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:24.819052 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-633e7d67-454b-41f7-a0d7-3baf72618aad tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:24.819987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-633e7d67-454b-41f7-a0d7-3baf72618aad tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:25.499970 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8873a45b-9eff-4ce3-b194-8798ce6c7076 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbd80f0e5bf46b78a79fd821e9ff89e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ceec62fde59414ebb34572d8f8fbcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:25.508663 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8873a45b-9eff-4ce3-b194-8798ce6c7076 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80" status: 200 len: 1317 microversion: 2.1 time: 0.946142 Sep 17 21:10:25.514353 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2308/4517] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:24 2022] GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80 => generated 1317 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:10:25.526912 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e0232615-2cb7-4045-bc31-6a2afb67222f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:25.527666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e0232615-2cb7-4045-bc31-6a2afb67222f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 3e57dbfe-799f-429f-8cef-96dec36bb3e1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:25.537103 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e0232615-2cb7-4045-bc31-6a2afb67222f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:25.538316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e0232615-2cb7-4045-bc31-6a2afb67222f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:25.540448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e0232615-2cb7-4045-bc31-6a2afb67222f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:25.542797 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e0232615-2cb7-4045-bc31-6a2afb67222f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:25.543320 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e0232615-2cb7-4045-bc31-6a2afb67222f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:25.543762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e0232615-2cb7-4045-bc31-6a2afb67222f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:25.574830 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-e0232615-2cb7-4045-bc31-6a2afb67222f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] HTTP exception thrown: Instance 3e57dbfe-799f-429f-8cef-96dec36bb3e1 could not be found. Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e0232615-2cb7-4045-bc31-6a2afb67222f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Request method failure captured: Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1 HTTP/1.1 Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjWtNzto0mtliTp7XFuULyHI3we00ltwNJkYCbse73U4gam1okW0tzurAZa5qe_YztpOkiAgcTw1EzIzI3V47Ip6mNu1JOtXw9_irlu2PoTiHu-RjUFuYp2PItqb9Y3KBbavW0dotTtDS8YxL9QYLwabuvziZ2iGyr941Z01slaUM2o Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 3e48e3c2f7f74636a75679fdf10ef33a Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerActionsTestJSON-1146998919 Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e48e3c2f7f74636a75679fdf10ef33a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3e48e3c2f7f74636a75679fdf10ef33a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e48e3c2f7f74636a75679fdf10ef33a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3e48e3c2f7f74636a75679fdf10ef33a", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerActionsTestJSON-1146998919 Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 3e48e3c2f7f74636a75679fdf10ef33a Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerActionsTestJSON-1146998919 Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerActionsTestJSON-1146998919-project Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 2ef547e071fd43ec96c745c26eca119f Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerActionsTestJSON-1146998919-project Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 3e57dbfe-799f-429f-8cef-96dec36bb3e1 could not be found. Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '3e57dbfe-799f-429f-8cef-96dec36bb3e1'} Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e57dbfe-799f-429f-8cef-96dec36bb3e1 could not be found. Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e57dbfe-799f-429f-8cef-96dec36bb3e1 could not be found. Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:10:25.583975 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:10:25.588862 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:25.588862 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:10:25.588862 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:10:25.588862 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:10:25.588862 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:10:25.588862 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e57dbfe-799f-429f-8cef-96dec36bb3e1 could not be found. Sep 17 21:10:25.588862 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:10:25.588862 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e0232615-2cb7-4045-bc31-6a2afb67222f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Returning 404 to user: Instance 3e57dbfe-799f-429f-8cef-96dec36bb3e1 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:10:25.590430 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e0232615-2cb7-4045-bc31-6a2afb67222f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1" status: 404 len: 111 microversion: 2.1 time: 0.074441 Sep 17 21:10:25.591265 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2309/4518] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:25 2022] GET /compute/v2.1/servers/3e57dbfe-799f-429f-8cef-96dec36bb3e1 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:10:25.603780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9660fcef-4ed6-4299-84be-1d419cc2c7a7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:25.604960 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9660fcef-4ed6-4299-84be-1d419cc2c7a7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 60e59237-9ac3-43d8-9231-af2a77fc368e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:25.616416 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9660fcef-4ed6-4299-84be-1d419cc2c7a7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:25.623827 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9660fcef-4ed6-4299-84be-1d419cc2c7a7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:25.624639 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9660fcef-4ed6-4299-84be-1d419cc2c7a7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:25.626036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9660fcef-4ed6-4299-84be-1d419cc2c7a7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:25.626738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9660fcef-4ed6-4299-84be-1d419cc2c7a7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:25.627404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9660fcef-4ed6-4299-84be-1d419cc2c7a7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:25.657118 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9660fcef-4ed6-4299-84be-1d419cc2c7a7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 60e59237-9ac3-43d8-9231-af2a77fc368e] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:10:25.783362 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9660fcef-4ed6-4299-84be-1d419cc2c7a7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "DELETE /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e" status: 204 len: 0 microversion: 2.1 time: 0.184357 Sep 17 21:10:25.784192 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2310/4519] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:10:25 2022] DELETE /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:10:25.795312 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f873657f-7205-4182-a997-d3b7f2d514f7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:25.796295 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f873657f-7205-4182-a997-d3b7f2d514f7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 60e59237-9ac3-43d8-9231-af2a77fc368e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:25.811779 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f873657f-7205-4182-a997-d3b7f2d514f7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:25.812375 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f873657f-7205-4182-a997-d3b7f2d514f7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:25.813815 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f873657f-7205-4182-a997-d3b7f2d514f7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:25.816559 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f873657f-7205-4182-a997-d3b7f2d514f7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:25.817180 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f873657f-7205-4182-a997-d3b7f2d514f7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:25.819991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f873657f-7205-4182-a997-d3b7f2d514f7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:25.976541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-633e7d67-454b-41f7-a0d7-3baf72618aad tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:25.992164 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-633e7d67-454b-41f7-a0d7-3baf72618aad tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe" status: 200 len: 1509 microversion: 2.1 time: 1.210565 Sep 17 21:10:26.007196 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2210/4520] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:24 2022] GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe => generated 1509 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:26.023355 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ae18a854-57fb-4fab-abe2-ba20e241c385 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:26.024555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ae18a854-57fb-4fab-abe2-ba20e241c385 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: fb346c6f-8465-4e0d-8bb6-0319d440d7fe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:26.042546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ae18a854-57fb-4fab-abe2-ba20e241c385 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:26.044257 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ae18a854-57fb-4fab-abe2-ba20e241c385 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:26.045793 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ae18a854-57fb-4fab-abe2-ba20e241c385 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:26.047505 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ae18a854-57fb-4fab-abe2-ba20e241c385 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:26.048697 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ae18a854-57fb-4fab-abe2-ba20e241c385 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:26.050219 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ae18a854-57fb-4fab-abe2-ba20e241c385 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:26.107295 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ae18a854-57fb-4fab-abe2-ba20e241c385 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: fb346c6f-8465-4e0d-8bb6-0319d440d7fe] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:10:26.265000 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ae18a854-57fb-4fab-abe2-ba20e241c385 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe" status: 204 len: 0 microversion: 2.1 time: 0.249631 Sep 17 21:10:26.271656 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2211/4521] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:10:26 2022] DELETE /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 17 21:10:26.289946 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-aa9f1f9f-1007-41db-86c9-a0859525a73e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:26.294418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-aa9f1f9f-1007-41db-86c9-a0859525a73e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: fb346c6f-8465-4e0d-8bb6-0319d440d7fe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:26.309209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa9f1f9f-1007-41db-86c9-a0859525a73e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:26.310116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa9f1f9f-1007-41db-86c9-a0859525a73e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:26.310966 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa9f1f9f-1007-41db-86c9-a0859525a73e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:26.312283 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa9f1f9f-1007-41db-86c9-a0859525a73e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:26.313881 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa9f1f9f-1007-41db-86c9-a0859525a73e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:26.314449 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa9f1f9f-1007-41db-86c9-a0859525a73e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:26.388432 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f873657f-7205-4182-a997-d3b7f2d514f7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:26.409289 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f873657f-7205-4182-a997-d3b7f2d514f7 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e" status: 200 len: 1506 microversion: 2.1 time: 0.620530 Sep 17 21:10:26.411031 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2311/4522] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:25 2022] GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e => generated 1506 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:10:26.429271 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-a70ce001-2a1d-4de2-b2eb-fdbe643e02a8 req-d248ba5b-025b-4e3a-9588-c9331b742a79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bb77042-152e-4948-95ab-8849c8d72c80", "tag": "5ab301f7-76d2-44ce-a32b-a5a47596282b"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:26.458169 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a70ce001-2a1d-4de2-b2eb-fdbe643e02a8 req-d248ba5b-025b-4e3a-9588-c9331b742a79 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:26.459515 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a70ce001-2a1d-4de2-b2eb-fdbe643e02a8 req-d248ba5b-025b-4e3a-9588-c9331b742a79 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:26.461957 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a70ce001-2a1d-4de2-b2eb-fdbe643e02a8 req-d248ba5b-025b-4e3a-9588-c9331b742a79 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:26.489293 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-a70ce001-2a1d-4de2-b2eb-fdbe643e02a8 req-d248ba5b-025b-4e3a-9588-c9331b742a79 service nova] Creating event network-changed:5ab301f7-76d2-44ce-a32b-a5a47596282b for instance 1bb77042-152e-4948-95ab-8849c8d72c80 on nch2-master-1 Sep 17 21:10:26.502059 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-a70ce001-2a1d-4de2-b2eb-fdbe643e02a8 req-d248ba5b-025b-4e3a-9588-c9331b742a79 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089479 Sep 17 21:10:26.508519 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2312/4523] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:10:26.539973 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8bbfd9f3-8f57-49a7-bfd7-1a6f8984e924 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:26.541002 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8bbfd9f3-8f57-49a7-bfd7-1a6f8984e924 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] [instance: 1bb77042-152e-4948-95ab-8849c8d72c80] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:26.551870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bbfd9f3-8f57-49a7-bfd7-1a6f8984e924 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:26.552640 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bbfd9f3-8f57-49a7-bfd7-1a6f8984e924 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:26.553309 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bbfd9f3-8f57-49a7-bfd7-1a6f8984e924 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:26.554312 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bbfd9f3-8f57-49a7-bfd7-1a6f8984e924 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:26.555001 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bbfd9f3-8f57-49a7-bfd7-1a6f8984e924 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:26.555651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bbfd9f3-8f57-49a7-bfd7-1a6f8984e924 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:26.940386 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-aa9f1f9f-1007-41db-86c9-a0859525a73e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:26.953088 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-aa9f1f9f-1007-41db-86c9-a0859525a73e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe" status: 200 len: 1515 microversion: 2.1 time: 0.675717 Sep 17 21:10:26.954052 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2212/4524] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:26 2022] GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe => generated 1515 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:27.206080 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8bbfd9f3-8f57-49a7-bfd7-1a6f8984e924 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbd80f0e5bf46b78a79fd821e9ff89e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ceec62fde59414ebb34572d8f8fbcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:27.229693 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8bbfd9f3-8f57-49a7-bfd7-1a6f8984e924 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80" status: 200 len: 1317 microversion: 2.1 time: 0.701420 Sep 17 21:10:27.242628 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2313/4525] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:26 2022] GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80 => generated 1317 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:27.436663 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5c252411-e883-45fb-a23c-3a5648ea7146 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:27.438014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5c252411-e883-45fb-a23c-3a5648ea7146 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 60e59237-9ac3-43d8-9231-af2a77fc368e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:27.447024 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c252411-e883-45fb-a23c-3a5648ea7146 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:27.447831 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c252411-e883-45fb-a23c-3a5648ea7146 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:27.448488 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c252411-e883-45fb-a23c-3a5648ea7146 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:27.449622 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c252411-e883-45fb-a23c-3a5648ea7146 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:27.450292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c252411-e883-45fb-a23c-3a5648ea7146 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:27.450934 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c252411-e883-45fb-a23c-3a5648ea7146 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:27.464460 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=14,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:27.617299 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-06535955-dba4-4f5b-8563-3d343f634b9b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1875265368", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c4c3ad81-e8f3-4b9c-972a-042303636823"}], "security_groups": [{"name": "tempest-securitygroup--1740613982"}], "key_name": "tempest-keypair-1651521270", "user_data": "}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:27.903492 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-06535955-dba4-4f5b-8563-3d343f634b9b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] validate_networks() for [('c4c3ad81-e8f3-4b9c-972a-042303636823', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:10:27.918037 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5c252411-e883-45fb-a23c-3a5648ea7146 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:27.930408 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5c252411-e883-45fb-a23c-3a5648ea7146 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e" status: 200 len: 1506 microversion: 2.1 time: 0.498402 Sep 17 21:10:27.931140 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2213/4526] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:27 2022] GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e => generated 1506 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:27.990091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-77cafb9a-fd4d-4a1b-a373-a906a4981bc1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:27.991073 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-77cafb9a-fd4d-4a1b-a373-a906a4981bc1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: fb346c6f-8465-4e0d-8bb6-0319d440d7fe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:27.999147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-77cafb9a-fd4d-4a1b-a373-a906a4981bc1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:28.000556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-77cafb9a-fd4d-4a1b-a373-a906a4981bc1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:28.003457 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-77cafb9a-fd4d-4a1b-a373-a906a4981bc1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:28.004420 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-77cafb9a-fd4d-4a1b-a373-a906a4981bc1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:28.006014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-77cafb9a-fd4d-4a1b-a373-a906a4981bc1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:28.006620 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-77cafb9a-fd4d-4a1b-a373-a906a4981bc1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:28.395978 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-77cafb9a-fd4d-4a1b-a373-a906a4981bc1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:28.405987 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-77cafb9a-fd4d-4a1b-a373-a906a4981bc1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe" status: 200 len: 1515 microversion: 2.1 time: 0.429052 Sep 17 21:10:28.407003 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2214/4527] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:27 2022] GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe => generated 1515 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:28.414078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ca5b5226-715c-416d-a158-123f0a62bef0 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:28.415338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ca5b5226-715c-416d-a158-123f0a62bef0 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] [instance: 1bb77042-152e-4948-95ab-8849c8d72c80] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:28.423154 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ca5b5226-715c-416d-a158-123f0a62bef0 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:28.423998 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ca5b5226-715c-416d-a158-123f0a62bef0 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:28.424470 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ca5b5226-715c-416d-a158-123f0a62bef0 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:28.425530 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ca5b5226-715c-416d-a158-123f0a62bef0 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:28.425733 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ca5b5226-715c-416d-a158-123f0a62bef0 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:28.426171 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ca5b5226-715c-416d-a158-123f0a62bef0 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:28.764244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:28.849299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ca5b5226-715c-416d-a158-123f0a62bef0 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbd80f0e5bf46b78a79fd821e9ff89e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ceec62fde59414ebb34572d8f8fbcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:28.862826 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ca5b5226-715c-416d-a158-123f0a62bef0 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80" status: 200 len: 1317 microversion: 2.1 time: 0.454014 Sep 17 21:10:28.876232 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2215/4528] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:28 2022] GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80 => generated 1317 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:28.954391 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4a7bc6c4-1c96-406e-98b5-8d8ccecfca8d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:28.955277 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4a7bc6c4-1c96-406e-98b5-8d8ccecfca8d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 60e59237-9ac3-43d8-9231-af2a77fc368e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:28.964966 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a7bc6c4-1c96-406e-98b5-8d8ccecfca8d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:28.966048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a7bc6c4-1c96-406e-98b5-8d8ccecfca8d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:28.966588 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a7bc6c4-1c96-406e-98b5-8d8ccecfca8d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:28.967306 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a7bc6c4-1c96-406e-98b5-8d8ccecfca8d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:28.967763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a7bc6c4-1c96-406e-98b5-8d8ccecfca8d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:28.968192 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a7bc6c4-1c96-406e-98b5-8d8ccecfca8d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:29.249757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-06535955-dba4-4f5b-8563-3d343f634b9b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:10:29.252216 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-06535955-dba4-4f5b-8563-3d343f634b9b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:10:29.252969 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-06535955-dba4-4f5b-8563-3d343f634b9b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:10:29.253870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-06535955-dba4-4f5b-8563-3d343f634b9b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:10:29.254008 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4a7bc6c4-1c96-406e-98b5-8d8ccecfca8d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:29.254587 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-06535955-dba4-4f5b-8563-3d343f634b9b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:10:29.265176 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4a7bc6c4-1c96-406e-98b5-8d8ccecfca8d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e" status: 200 len: 1506 microversion: 2.1 time: 0.314875 Sep 17 21:10:29.270966 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06535955-dba4-4f5b-8563-3d343f634b9b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:29.271216 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2216/4529] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:28 2022] GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e => generated 1506 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:10:29.271870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06535955-dba4-4f5b-8563-3d343f634b9b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:29.272682 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06535955-dba4-4f5b-8563-3d343f634b9b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:29.273721 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06535955-dba4-4f5b-8563-3d343f634b9b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:29.274417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06535955-dba4-4f5b-8563-3d343f634b9b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:29.275015 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06535955-dba4-4f5b-8563-3d343f634b9b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:29.304953 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-06535955-dba4-4f5b-8563-3d343f634b9b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Getting quotas for project 6fa7e14863254ab3964ac907c168d9e6. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:10:29.313375 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-06535955-dba4-4f5b-8563-3d343f634b9b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Getting quotas for user c544e8e6f7a741c985c92ed7437397cd and project 6fa7e14863254ab3964ac907c168d9e6. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:10:29.330364 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-06535955-dba4-4f5b-8563-3d343f634b9b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:10:29.333066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-06535955-dba4-4f5b-8563-3d343f634b9b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0e3e136c-7043-4c24-bf6d-f33bf379e7cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:10:29.404251 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-06535955-dba4-4f5b-8563-3d343f634b9b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.791397 Sep 17 21:10:29.404924 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2314/4530] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:10:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 1793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 17 21:10:29.416316 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-be77ea37-2dd4-42ad-b3ac-a1be03c07321 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:29.417176 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-be77ea37-2dd4-42ad-b3ac-a1be03c07321 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0e3e136c-7043-4c24-bf6d-f33bf379e7cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:29.434806 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-83ecaaa3-e7d0-4407-baca-f8df614f5267 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:29.437472 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-83ecaaa3-e7d0-4407-baca-f8df614f5267 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: fb346c6f-8465-4e0d-8bb6-0319d440d7fe] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:29.444974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-83ecaaa3-e7d0-4407-baca-f8df614f5267 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:29.445798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-83ecaaa3-e7d0-4407-baca-f8df614f5267 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:29.446489 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-83ecaaa3-e7d0-4407-baca-f8df614f5267 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:29.447749 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-83ecaaa3-e7d0-4407-baca-f8df614f5267 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:29.448445 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-83ecaaa3-e7d0-4407-baca-f8df614f5267 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:29.449089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-83ecaaa3-e7d0-4407-baca-f8df614f5267 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:29.508972 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-be77ea37-2dd4-42ad-b3ac-a1be03c07321 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:29.518551 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-be77ea37-2dd4-42ad-b3ac-a1be03c07321 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc" status: 200 len: 1242 microversion: 2.1 time: 0.106129 Sep 17 21:10:29.529094 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2217/4531] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:29 2022] GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc => generated 1242 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:29.791151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-83ecaaa3-e7d0-4407-baca-f8df614f5267 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:29.804590 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-83ecaaa3-e7d0-4407-baca-f8df614f5267 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe" status: 200 len: 1515 microversion: 2.1 time: 0.373360 Sep 17 21:10:29.806480 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2315/4532] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:29 2022] GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe => generated 1515 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:29.885810 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-17fd1de3-da78-4900-ac98-f513f5f4d135 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:29.887114 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-17fd1de3-da78-4900-ac98-f513f5f4d135 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] [instance: 1bb77042-152e-4948-95ab-8849c8d72c80] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:29.895734 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17fd1de3-da78-4900-ac98-f513f5f4d135 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:29.896593 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17fd1de3-da78-4900-ac98-f513f5f4d135 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:29.897273 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17fd1de3-da78-4900-ac98-f513f5f4d135 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:29.898230 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17fd1de3-da78-4900-ac98-f513f5f4d135 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:29.898903 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17fd1de3-da78-4900-ac98-f513f5f4d135 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:29.899601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17fd1de3-da78-4900-ac98-f513f5f4d135 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:30.131997 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-17fd1de3-da78-4900-ac98-f513f5f4d135 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbd80f0e5bf46b78a79fd821e9ff89e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ceec62fde59414ebb34572d8f8fbcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:30.141904 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-17fd1de3-da78-4900-ac98-f513f5f4d135 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80" status: 200 len: 1317 microversion: 2.1 time: 0.260098 Sep 17 21:10:30.143420 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2218/4533] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:29 2022] GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80 => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:30.293354 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1f79e53b-79a0-4a53-8d9a-b11041a9a462 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:30.294040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1f79e53b-79a0-4a53-8d9a-b11041a9a462 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 60e59237-9ac3-43d8-9231-af2a77fc368e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:30.304226 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f79e53b-79a0-4a53-8d9a-b11041a9a462 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:30.304974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f79e53b-79a0-4a53-8d9a-b11041a9a462 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:30.306998 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f79e53b-79a0-4a53-8d9a-b11041a9a462 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:30.307967 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f79e53b-79a0-4a53-8d9a-b11041a9a462 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:30.308608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f79e53b-79a0-4a53-8d9a-b11041a9a462 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:30.309320 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f79e53b-79a0-4a53-8d9a-b11041a9a462 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:30.546331 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8ce550b2-ae0a-4f81-a4b4-ed0d1f08bab3 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:30.547234 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8ce550b2-ae0a-4f81-a4b4-ed0d1f08bab3 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0e3e136c-7043-4c24-bf6d-f33bf379e7cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:30.570609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ce550b2-ae0a-4f81-a4b4-ed0d1f08bab3 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:30.571447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ce550b2-ae0a-4f81-a4b4-ed0d1f08bab3 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:30.572065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ce550b2-ae0a-4f81-a4b4-ed0d1f08bab3 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:30.573492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ce550b2-ae0a-4f81-a4b4-ed0d1f08bab3 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:30.573962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ce550b2-ae0a-4f81-a4b4-ed0d1f08bab3 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:30.574578 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ce550b2-ae0a-4f81-a4b4-ed0d1f08bab3 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:31.210637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1f79e53b-79a0-4a53-8d9a-b11041a9a462 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:31.236332 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1f79e53b-79a0-4a53-8d9a-b11041a9a462 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e" status: 200 len: 1464 microversion: 2.1 time: 0.947778 Sep 17 21:10:31.242823 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2316/4534] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:30 2022] GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e => generated 1464 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:31.271599 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9d2635f4-607a-4909-a100-6ab7dac57cae tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:31.272297 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9d2635f4-607a-4909-a100-6ab7dac57cae tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: fb346c6f-8465-4e0d-8bb6-0319d440d7fe] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:31.293707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d2635f4-607a-4909-a100-6ab7dac57cae tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:31.294217 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d2635f4-607a-4909-a100-6ab7dac57cae tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:31.294703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d2635f4-607a-4909-a100-6ab7dac57cae tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:31.295436 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d2635f4-607a-4909-a100-6ab7dac57cae tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:31.309713 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d2635f4-607a-4909-a100-6ab7dac57cae tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:31.310320 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d2635f4-607a-4909-a100-6ab7dac57cae tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:31.453419 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8ce550b2-ae0a-4f81-a4b4-ed0d1f08bab3 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:31.470005 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8ce550b2-ae0a-4f81-a4b4-ed0d1f08bab3 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc" status: 200 len: 1294 microversion: 2.1 time: 0.930179 Sep 17 21:10:31.474998 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2219/4535] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:30 2022] GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc => generated 1294 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:31.485898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-cf8a02f1-a2a5-4431-ae43-d131ea18f2ca req-7feb999f-9de9-489a-84a2-c0328bc8926d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60e59237-9ac3-43d8-9231-af2a77fc368e", "name": "network-vif-deleted", "tag": "130a8d55-49d4-4d80-b4c6-a7ebbe54f44f"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:31.514952 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-cf8a02f1-a2a5-4431-ae43-d131ea18f2ca req-7feb999f-9de9-489a-84a2-c0328bc8926d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:31.515715 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-cf8a02f1-a2a5-4431-ae43-d131ea18f2ca req-7feb999f-9de9-489a-84a2-c0328bc8926d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:31.516313 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-cf8a02f1-a2a5-4431-ae43-d131ea18f2ca req-7feb999f-9de9-489a-84a2-c0328bc8926d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:31.517783 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9d2635f4-607a-4909-a100-6ab7dac57cae tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:31.536485 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9d2635f4-607a-4909-a100-6ab7dac57cae tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe" status: 200 len: 1473 microversion: 2.1 time: 0.292376 Sep 17 21:10:31.538610 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2317/4536] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:31 2022] GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe => generated 1473 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:31.551424 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4a5b477c-d840-42ce-8324-ed2dd6225530 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:31.558743 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4a5b477c-d840-42ce-8324-ed2dd6225530 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] [instance: 1bb77042-152e-4948-95ab-8849c8d72c80] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:31.565576 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-cf8a02f1-a2a5-4431-ae43-d131ea18f2ca req-7feb999f-9de9-489a-84a2-c0328bc8926d service nova] Creating event network-vif-deleted:130a8d55-49d4-4d80-b4c6-a7ebbe54f44f for instance 60e59237-9ac3-43d8-9231-af2a77fc368e on nch1-master-1 Sep 17 21:10:31.567180 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a5b477c-d840-42ce-8324-ed2dd6225530 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:31.567911 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a5b477c-d840-42ce-8324-ed2dd6225530 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:31.568556 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a5b477c-d840-42ce-8324-ed2dd6225530 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:31.569514 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a5b477c-d840-42ce-8324-ed2dd6225530 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:31.570130 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a5b477c-d840-42ce-8324-ed2dd6225530 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:31.570855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a5b477c-d840-42ce-8324-ed2dd6225530 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:31.578948 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-cf8a02f1-a2a5-4431-ae43-d131ea18f2ca req-7feb999f-9de9-489a-84a2-c0328bc8926d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102331 Sep 17 21:10:31.582029 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2220/4537] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:10:32.005568 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4a5b477c-d840-42ce-8324-ed2dd6225530 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbd80f0e5bf46b78a79fd821e9ff89e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ceec62fde59414ebb34572d8f8fbcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:32.007911 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:32.020738 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4a5b477c-d840-42ce-8324-ed2dd6225530 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80" status: 200 len: 1317 microversion: 2.1 time: 0.479070 Sep 17 21:10:32.023459 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2318/4538] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:31 2022] GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80 => generated 1317 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:32.270182 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c7c54c0a-3602-489f-b2a9-bab453fd2c9b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:32.272027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c7c54c0a-3602-489f-b2a9-bab453fd2c9b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 60e59237-9ac3-43d8-9231-af2a77fc368e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:32.290266 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c7c54c0a-3602-489f-b2a9-bab453fd2c9b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:32.292079 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c7c54c0a-3602-489f-b2a9-bab453fd2c9b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:32.294470 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c7c54c0a-3602-489f-b2a9-bab453fd2c9b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:32.298408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c7c54c0a-3602-489f-b2a9-bab453fd2c9b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:32.300994 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c7c54c0a-3602-489f-b2a9-bab453fd2c9b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:32.302273 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c7c54c0a-3602-489f-b2a9-bab453fd2c9b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:32.349628 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-c7c54c0a-3602-489f-b2a9-bab453fd2c9b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] HTTP exception thrown: Instance 60e59237-9ac3-43d8-9231-af2a77fc368e could not be found. Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c7c54c0a-3602-489f-b2a9-bab453fd2c9b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Request method failure captured: Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e HTTP/1.1 Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjWtNzto0mtliTp7XFuULyHI3we00ltwNJkYCbse73U4gam1okW0tzurAZa5qe_YztpOkiAgcTw1EzIzI3V47Ip6mNu1JOtXw9_irlu2PoTiHu-RjUFuYp2PItqb9Y3KBbavW0dotTtDS8YxL9QYLwabuvziZ2iGyr941Z01slaUM2o Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 3e48e3c2f7f74636a75679fdf10ef33a Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerActionsTestJSON-1146998919 Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e48e3c2f7f74636a75679fdf10ef33a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3e48e3c2f7f74636a75679fdf10ef33a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e48e3c2f7f74636a75679fdf10ef33a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3e48e3c2f7f74636a75679fdf10ef33a", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerActionsTestJSON-1146998919 Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 3e48e3c2f7f74636a75679fdf10ef33a Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerActionsTestJSON-1146998919 Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerActionsTestJSON-1146998919-project Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 2ef547e071fd43ec96c745c26eca119f Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerActionsTestJSON-1146998919-project Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 60e59237-9ac3-43d8-9231-af2a77fc368e could not be found. Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '60e59237-9ac3-43d8-9231-af2a77fc368e'} Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60e59237-9ac3-43d8-9231-af2a77fc368e could not be found. Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60e59237-9ac3-43d8-9231-af2a77fc368e could not be found. Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:10:32.356519 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:10:32.362954 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:32.362954 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:10:32.362954 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:10:32.362954 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:10:32.362954 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:10:32.362954 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60e59237-9ac3-43d8-9231-af2a77fc368e could not be found. Sep 17 21:10:32.362954 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:10:32.362954 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c7c54c0a-3602-489f-b2a9-bab453fd2c9b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Returning 404 to user: Instance 60e59237-9ac3-43d8-9231-af2a77fc368e could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:10:32.365311 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c7c54c0a-3602-489f-b2a9-bab453fd2c9b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e" status: 404 len: 111 microversion: 2.1 time: 0.099010 Sep 17 21:10:32.367874 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2221/4539] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:32 2022] GET /compute/v2.1/servers/60e59237-9ac3-43d8-9231-af2a77fc368e => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:10:32.389906 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2c8be403-665e-40f3-a758-845f61fc85be tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:32.392108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2c8be403-665e-40f3-a758-845f61fc85be tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: d131d8e1-8f52-4d1f-8f88-46b1aef06e29] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:32.407236 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c8be403-665e-40f3-a758-845f61fc85be tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:32.407956 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c8be403-665e-40f3-a758-845f61fc85be tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:32.408617 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c8be403-665e-40f3-a758-845f61fc85be tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:32.409540 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c8be403-665e-40f3-a758-845f61fc85be tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:32.410328 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c8be403-665e-40f3-a758-845f61fc85be tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:32.410995 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c8be403-665e-40f3-a758-845f61fc85be tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:32.465487 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2c8be403-665e-40f3-a758-845f61fc85be tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: d131d8e1-8f52-4d1f-8f88-46b1aef06e29] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:10:32.508056 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a4032769-44f1-4883-a5d0-7ab2fc690c3f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:32.509574 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a4032769-44f1-4883-a5d0-7ab2fc690c3f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0e3e136c-7043-4c24-bf6d-f33bf379e7cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:32.532888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4032769-44f1-4883-a5d0-7ab2fc690c3f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:32.535174 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4032769-44f1-4883-a5d0-7ab2fc690c3f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:32.539790 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4032769-44f1-4883-a5d0-7ab2fc690c3f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:32.540720 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4032769-44f1-4883-a5d0-7ab2fc690c3f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:32.541337 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4032769-44f1-4883-a5d0-7ab2fc690c3f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:32.542417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4032769-44f1-4883-a5d0-7ab2fc690c3f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:32.772892 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a4032769-44f1-4883-a5d0-7ab2fc690c3f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:32.787312 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a4032769-44f1-4883-a5d0-7ab2fc690c3f tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc" status: 200 len: 1300 microversion: 2.1 time: 0.287745 Sep 17 21:10:32.789139 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2222/4540] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:32 2022] GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc => generated 1300 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:32.791209 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2c8be403-665e-40f3-a758-845f61fc85be tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29" status: 204 len: 0 microversion: 2.1 time: 0.417237 Sep 17 21:10:32.795156 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2319/4541] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:10:32 2022] DELETE /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:10:32.800583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-590e0111-fc10-4220-bc96-f9994b848720 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:32.802126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-590e0111-fc10-4220-bc96-f9994b848720 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: fb346c6f-8465-4e0d-8bb6-0319d440d7fe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:32.815945 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-590e0111-fc10-4220-bc96-f9994b848720 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:32.816460 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2906486e-e99d-4752-94ed-5794f9a9c9d9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:32.817222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2906486e-e99d-4752-94ed-5794f9a9c9d9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: d131d8e1-8f52-4d1f-8f88-46b1aef06e29] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:32.819831 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-590e0111-fc10-4220-bc96-f9994b848720 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:32.820631 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-590e0111-fc10-4220-bc96-f9994b848720 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:32.821384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-590e0111-fc10-4220-bc96-f9994b848720 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:32.821879 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-590e0111-fc10-4220-bc96-f9994b848720 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:32.825212 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-590e0111-fc10-4220-bc96-f9994b848720 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:32.837773 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2906486e-e99d-4752-94ed-5794f9a9c9d9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:32.840968 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2906486e-e99d-4752-94ed-5794f9a9c9d9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:32.842704 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2906486e-e99d-4752-94ed-5794f9a9c9d9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:32.845910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2906486e-e99d-4752-94ed-5794f9a9c9d9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:32.846777 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2906486e-e99d-4752-94ed-5794f9a9c9d9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:32.848426 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2906486e-e99d-4752-94ed-5794f9a9c9d9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:32.920132 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-590e0111-fc10-4220-bc96-f9994b848720 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:32.920629 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-590e0111-fc10-4220-bc96-f9994b848720 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:32.924986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-590e0111-fc10-4220-bc96-f9994b848720 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:32.925529 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-590e0111-fc10-4220-bc96-f9994b848720 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lazy-loading 'fault' on Instance uuid fb346c6f-8465-4e0d-8bb6-0319d440d7fe {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:10:33.103157 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-590e0111-fc10-4220-bc96-f9994b848720 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:33.123339 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-590e0111-fc10-4220-bc96-f9994b848720 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe" status: 200 len: 1317 microversion: 2.1 time: 0.323940 Sep 17 21:10:33.124614 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2223/4542] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:32 2022] GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe => generated 1317 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:33.134495 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-b8150756-e833-4f20-860a-c3e315c3f72b req-8242a02b-ee59-482b-89b1-c67d37a2b147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bb77042-152e-4948-95ab-8849c8d72c80", "name": "network-vif-plugged", "status": "completed", "tag": "5ab301f7-76d2-44ce-a32b-a5a47596282b"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:33.183930 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b8150756-e833-4f20-860a-c3e315c3f72b req-8242a02b-ee59-482b-89b1-c67d37a2b147 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:33.184418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b8150756-e833-4f20-860a-c3e315c3f72b req-8242a02b-ee59-482b-89b1-c67d37a2b147 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:33.184854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b8150756-e833-4f20-860a-c3e315c3f72b req-8242a02b-ee59-482b-89b1-c67d37a2b147 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:33.269168 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-b8150756-e833-4f20-860a-c3e315c3f72b req-8242a02b-ee59-482b-89b1-c67d37a2b147 service nova] Creating event network-vif-plugged:5ab301f7-76d2-44ce-a32b-a5a47596282b for instance 1bb77042-152e-4948-95ab-8849c8d72c80 on nch2-master-1 Sep 17 21:10:33.287746 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-b8150756-e833-4f20-860a-c3e315c3f72b req-8242a02b-ee59-482b-89b1-c67d37a2b147 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161612 Sep 17 21:10:33.290799 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2224/4543] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:10:33.303199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9f7763c8-24ab-40b7-bcd3-1c93a871bc96 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:33.305695 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9f7763c8-24ab-40b7-bcd3-1c93a871bc96 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] [instance: 1bb77042-152e-4948-95ab-8849c8d72c80] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:33.327177 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f7763c8-24ab-40b7-bcd3-1c93a871bc96 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:33.328062 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f7763c8-24ab-40b7-bcd3-1c93a871bc96 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:33.328511 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f7763c8-24ab-40b7-bcd3-1c93a871bc96 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:33.330005 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f7763c8-24ab-40b7-bcd3-1c93a871bc96 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:33.330491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f7763c8-24ab-40b7-bcd3-1c93a871bc96 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:33.330934 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f7763c8-24ab-40b7-bcd3-1c93a871bc96 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:33.622011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2906486e-e99d-4752-94ed-5794f9a9c9d9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:33.636776 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2906486e-e99d-4752-94ed-5794f9a9c9d9 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29" status: 200 len: 1494 microversion: 2.1 time: 0.840173 Sep 17 21:10:33.637408 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2320/4544] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:32 2022] GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29 => generated 1494 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:33.743454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9f7763c8-24ab-40b7-bcd3-1c93a871bc96 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbd80f0e5bf46b78a79fd821e9ff89e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ceec62fde59414ebb34572d8f8fbcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:33.755947 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9f7763c8-24ab-40b7-bcd3-1c93a871bc96 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80" status: 200 len: 1317 microversion: 2.1 time: 0.462960 Sep 17 21:10:33.769504 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2225/4545] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:33 2022] GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80 => generated 1317 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:33.815053 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3d7d21b5-c95b-4668-be92-442f9f24bf6a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:33.815691 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3d7d21b5-c95b-4668-be92-442f9f24bf6a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0e3e136c-7043-4c24-bf6d-f33bf379e7cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:33.829154 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d7d21b5-c95b-4668-be92-442f9f24bf6a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:33.830013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d7d21b5-c95b-4668-be92-442f9f24bf6a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:33.831844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d7d21b5-c95b-4668-be92-442f9f24bf6a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:33.832762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d7d21b5-c95b-4668-be92-442f9f24bf6a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:33.833801 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d7d21b5-c95b-4668-be92-442f9f24bf6a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:33.834745 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d7d21b5-c95b-4668-be92-442f9f24bf6a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:34.086621 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3d7d21b5-c95b-4668-be92-442f9f24bf6a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:34.101583 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3d7d21b5-c95b-4668-be92-442f9f24bf6a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc" status: 200 len: 1368 microversion: 2.1 time: 0.292937 Sep 17 21:10:34.122593 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2321/4546] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:33 2022] GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc => generated 1368 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:34.152921 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-076e867f-1015-4761-8a80-1f57b9035e38 req-84fe5491-852c-440e-90a1-869d6aad3f16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb346c6f-8465-4e0d-8bb6-0319d440d7fe", "name": "network-vif-deleted", "tag": "7a6524ad-e53f-4159-af1a-89a8899d9676"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:34.167459 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-076e867f-1015-4761-8a80-1f57b9035e38 req-84fe5491-852c-440e-90a1-869d6aad3f16 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:34.168409 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-076e867f-1015-4761-8a80-1f57b9035e38 req-84fe5491-852c-440e-90a1-869d6aad3f16 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:34.169216 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-076e867f-1015-4761-8a80-1f57b9035e38 req-84fe5491-852c-440e-90a1-869d6aad3f16 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:34.184034 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-076e867f-1015-4761-8a80-1f57b9035e38 req-84fe5491-852c-440e-90a1-869d6aad3f16 service nova] Creating event network-vif-deleted:7a6524ad-e53f-4159-af1a-89a8899d9676 for instance fb346c6f-8465-4e0d-8bb6-0319d440d7fe on nch1-master-1 Sep 17 21:10:34.190525 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-076e867f-1015-4761-8a80-1f57b9035e38 req-84fe5491-852c-440e-90a1-869d6aad3f16 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047999 Sep 17 21:10:34.191846 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2322/4547] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:10:34.193134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-789fca13-64d3-4ee2-904c-033f9a062f4f tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-2076139595", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": "none"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:34.198567 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-53a4b201-49e8-4a1a-a1c1-dbcb9591b3cf tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:34.199660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-53a4b201-49e8-4a1a-a1c1-dbcb9591b3cf tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: fb346c6f-8465-4e0d-8bb6-0319d440d7fe] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:34.210117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53a4b201-49e8-4a1a-a1c1-dbcb9591b3cf tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:34.211241 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53a4b201-49e8-4a1a-a1c1-dbcb9591b3cf tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:34.212414 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53a4b201-49e8-4a1a-a1c1-dbcb9591b3cf tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:34.213875 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53a4b201-49e8-4a1a-a1c1-dbcb9591b3cf tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:34.214532 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53a4b201-49e8-4a1a-a1c1-dbcb9591b3cf tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:34.215092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53a4b201-49e8-4a1a-a1c1-dbcb9591b3cf tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:34.250315 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-53a4b201-49e8-4a1a-a1c1-dbcb9591b3cf tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] HTTP exception thrown: Instance fb346c6f-8465-4e0d-8bb6-0319d440d7fe could not be found. Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-53a4b201-49e8-4a1a-a1c1-dbcb9591b3cf tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Request method failure captured: Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe HTTP/1.1 Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjdkx_dUaa7DUi-TKVFHTZsVxQrlexvG4SUZm6N8-RAgW-Hgl4Fm16QKjLB8Smzb7fg0_3Heh2RxRO4DM6alOpTGfM4lDQjx-JBymYUztOAuBANR84PPvzFMKCK9hdlODMbdRT3LVU-maWvSxN-XNtXdSltD2p8By-EmBSmK4dFa6Xo Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersTestJSON-167161476 Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b6f25c3540546bf9bffd5610f4f86c8", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersTestJSON-167161476 Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersTestJSON-167161476 Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersTestJSON-167161476-project Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 784233ee78764e7dbb774d3cb50165e3 Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersTestJSON-167161476-project Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance fb346c6f-8465-4e0d-8bb6-0319d440d7fe could not be found. Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'fb346c6f-8465-4e0d-8bb6-0319d440d7fe'} Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb346c6f-8465-4e0d-8bb6-0319d440d7fe could not be found. Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb346c6f-8465-4e0d-8bb6-0319d440d7fe could not be found. Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:10:34.277919 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:34.282935 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:10:34.282935 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:10:34.282935 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:10:34.282935 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:10:34.282935 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb346c6f-8465-4e0d-8bb6-0319d440d7fe could not be found. Sep 17 21:10:34.282935 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:10:34.284371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-53a4b201-49e8-4a1a-a1c1-dbcb9591b3cf tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Returning 404 to user: Instance fb346c6f-8465-4e0d-8bb6-0319d440d7fe could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:10:34.286163 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-53a4b201-49e8-4a1a-a1c1-dbcb9591b3cf tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe" status: 404 len: 111 microversion: 2.1 time: 0.092419 Sep 17 21:10:34.287841 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2323/4548] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:34 2022] GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:10:34.305937 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-964ffd66-f229-4630-ae6c-699c1adf7da9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '.version_select at 0x7f25a409c790>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:34.351741 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-964ffd66-f229-4630-ae6c-699c1adf7da9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-key-548919142" status: 202 len: 0 microversion: 2.1 time: 0.058066 Sep 17 21:10:34.363547 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2324/4549] 10.222.0.26 () {58 vars in 1206 bytes} [Sat Sep 17 21:10:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-548919142 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:10:34.513874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-789fca13-64d3-4ee2-904c-033f9a062f4f tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:10:34.514303 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-789fca13-64d3-4ee2-904c-033f9a062f4f tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:10:34.514785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-789fca13-64d3-4ee2-904c-033f9a062f4f tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:10:34.515201 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-789fca13-64d3-4ee2-904c-033f9a062f4f tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:10:34.515622 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-789fca13-64d3-4ee2-904c-033f9a062f4f tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:10:34.539913 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-789fca13-64d3-4ee2-904c-033f9a062f4f tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:34.540443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-789fca13-64d3-4ee2-904c-033f9a062f4f tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:34.540886 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-789fca13-64d3-4ee2-904c-033f9a062f4f tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:34.541674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-789fca13-64d3-4ee2-904c-033f9a062f4f tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:34.542164 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-789fca13-64d3-4ee2-904c-033f9a062f4f tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:34.570349 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-789fca13-64d3-4ee2-904c-033f9a062f4f tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:34.609345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d05b15b0-bf85-4640-b298-8918fc57dc1c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1731795571", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "ff632525-8d7d-4854-beaf-dc49c77bdd36"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:34.613038 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-789fca13-64d3-4ee2-904c-033f9a062f4f tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Getting quotas for project f7a3c50d58d347d0a4467cd4e61b06e0. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:10:34.630252 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-789fca13-64d3-4ee2-904c-033f9a062f4f tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Getting quotas for user e8b19d9480444a44a48ac3c5efe7fe17 and project f7a3c50d58d347d0a4467cd4e61b06e0. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:10:34.656277 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-789fca13-64d3-4ee2-904c-033f9a062f4f tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:10:34.661342 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-789fca13-64d3-4ee2-904c-033f9a062f4f tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:10:34.688676 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-d05b15b0-bf85-4640-b298-8918fc57dc1c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] validate_networks() for [('ff632525-8d7d-4854-beaf-dc49c77bdd36', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:10:34.709278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:34.765960 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-789fca13-64d3-4ee2-904c-033f9a062f4f tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.802699 Sep 17 21:10:34.768296 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2226/4550] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Sep 17 21:10:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 17 21:10:34.777701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-73188509-4043-480f-b3ee-478dfd38829d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:34.778604 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-73188509-4043-480f-b3ee-478dfd38829d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: d131d8e1-8f52-4d1f-8f88-46b1aef06e29] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:34.788181 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73188509-4043-480f-b3ee-478dfd38829d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:34.789133 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73188509-4043-480f-b3ee-478dfd38829d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:34.789800 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73188509-4043-480f-b3ee-478dfd38829d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:34.791738 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73188509-4043-480f-b3ee-478dfd38829d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:34.792442 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73188509-4043-480f-b3ee-478dfd38829d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:34.793078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73188509-4043-480f-b3ee-478dfd38829d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:35.425768 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-73188509-4043-480f-b3ee-478dfd38829d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:35.436808 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-73188509-4043-480f-b3ee-478dfd38829d tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29" status: 200 len: 1494 microversion: 2.1 time: 0.667052 Sep 17 21:10:35.438644 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2227/4551] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:34 2022] GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29 => generated 1494 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:35.454486 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-aa6cc0a2-437f-4b55-8258-fa36a14f1be2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:35.455430 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-aa6cc0a2-437f-4b55-8258-fa36a14f1be2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:35.819226 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-aa6cc0a2-437f-4b55-8258-fa36a14f1be2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:35.839208 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-aa6cc0a2-437f-4b55-8258-fa36a14f1be2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:35.842071 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-aa6cc0a2-437f-4b55-8258-fa36a14f1be2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:35.843905 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-aa6cc0a2-437f-4b55-8258-fa36a14f1be2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1278 microversion: 2.54 time: 0.404055 Sep 17 21:10:35.845725 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2228/4552] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:10:35 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1278 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:10:35.851451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0e1a0061-b474-4afb-8c12-ee018c1450f2 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:35.852386 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0e1a0061-b474-4afb-8c12-ee018c1450f2 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] [instance: 1bb77042-152e-4948-95ab-8849c8d72c80] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:35.860220 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e1a0061-b474-4afb-8c12-ee018c1450f2 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:35.862156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e1a0061-b474-4afb-8c12-ee018c1450f2 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:35.863142 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e1a0061-b474-4afb-8c12-ee018c1450f2 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:35.865251 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e1a0061-b474-4afb-8c12-ee018c1450f2 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:35.867087 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e1a0061-b474-4afb-8c12-ee018c1450f2 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:35.867533 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e1a0061-b474-4afb-8c12-ee018c1450f2 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:36.230243 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-d05b15b0-bf85-4640-b298-8918fc57dc1c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:10:36.230772 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-d05b15b0-bf85-4640-b298-8918fc57dc1c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:10:36.232138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-d05b15b0-bf85-4640-b298-8918fc57dc1c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:10:36.232569 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-d05b15b0-bf85-4640-b298-8918fc57dc1c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:10:36.232988 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-d05b15b0-bf85-4640-b298-8918fc57dc1c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:10:36.254531 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d05b15b0-bf85-4640-b298-8918fc57dc1c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:36.255884 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d05b15b0-bf85-4640-b298-8918fc57dc1c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:36.256339 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d05b15b0-bf85-4640-b298-8918fc57dc1c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:36.259567 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d05b15b0-bf85-4640-b298-8918fc57dc1c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:36.260460 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d05b15b0-bf85-4640-b298-8918fc57dc1c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:36.263279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d05b15b0-bf85-4640-b298-8918fc57dc1c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:36.295653 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-d05b15b0-bf85-4640-b298-8918fc57dc1c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Getting quotas for project 0b6f25c3540546bf9bffd5610f4f86c8. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:10:36.303866 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-d05b15b0-bf85-4640-b298-8918fc57dc1c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Getting quotas for user 784233ee78764e7dbb774d3cb50165e3 and project 0b6f25c3540546bf9bffd5610f4f86c8. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:10:36.321753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d05b15b0-bf85-4640-b298-8918fc57dc1c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:10:36.324480 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d05b15b0-bf85-4640-b298-8918fc57dc1c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 640f82db-299b-42a4-a6b6-0a286b8220c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:10:36.399868 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d05b15b0-bf85-4640-b298-8918fc57dc1c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.796756 Sep 17 21:10:36.406921 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2325/4553] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:10:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 17 21:10:36.411786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2c201cbd-2fa0-4714-94fb-706f94139b50 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:36.412454 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2c201cbd-2fa0-4714-94fb-706f94139b50 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0e3e136c-7043-4c24-bf6d-f33bf379e7cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:36.423689 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c201cbd-2fa0-4714-94fb-706f94139b50 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:36.423879 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c201cbd-2fa0-4714-94fb-706f94139b50 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:36.426809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c201cbd-2fa0-4714-94fb-706f94139b50 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:36.430081 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c201cbd-2fa0-4714-94fb-706f94139b50 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:36.431019 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c201cbd-2fa0-4714-94fb-706f94139b50 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:36.431755 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c201cbd-2fa0-4714-94fb-706f94139b50 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:36.803366 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0e1a0061-b474-4afb-8c12-ee018c1450f2 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbd80f0e5bf46b78a79fd821e9ff89e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ceec62fde59414ebb34572d8f8fbcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:36.815677 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0e1a0061-b474-4afb-8c12-ee018c1450f2 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80" status: 200 len: 1466 microversion: 2.1 time: 0.968692 Sep 17 21:10:36.816278 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2229/4554] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:35 2022] GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80 => generated 1466 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:36.827686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-d846efca-77a7-4a79-b023-b97479345e0f req-08ed21da-8989-4d9b-84b5-512b99b185c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d131d8e1-8f52-4d1f-8f88-46b1aef06e29", "name": "network-vif-deleted", "tag": "e767046e-5d7a-4304-ad5e-62e075501024"}, {"name": "network-changed", "server_uuid": "0e3e136c-7043-4c24-bf6d-f33bf379e7cc", "tag": "e0be212d-ddc6-44b6-9963-59a1fa83ae0c"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:36.853720 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d846efca-77a7-4a79-b023-b97479345e0f req-08ed21da-8989-4d9b-84b5-512b99b185c9 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:36.859256 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d846efca-77a7-4a79-b023-b97479345e0f req-08ed21da-8989-4d9b-84b5-512b99b185c9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:36.860048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d846efca-77a7-4a79-b023-b97479345e0f req-08ed21da-8989-4d9b-84b5-512b99b185c9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:36.892205 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-d846efca-77a7-4a79-b023-b97479345e0f req-08ed21da-8989-4d9b-84b5-512b99b185c9 service nova] Creating event network-vif-deleted:e767046e-5d7a-4304-ad5e-62e075501024 for instance d131d8e1-8f52-4d1f-8f88-46b1aef06e29 on nch1-master-1 Sep 17 21:10:36.892738 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-d846efca-77a7-4a79-b023-b97479345e0f req-08ed21da-8989-4d9b-84b5-512b99b185c9 service nova] Creating event network-changed:e0be212d-ddc6-44b6-9963-59a1fa83ae0c for instance 0e3e136c-7043-4c24-bf6d-f33bf379e7cc on nch1-master-1 Sep 17 21:10:36.916718 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-d846efca-77a7-4a79-b023-b97479345e0f req-08ed21da-8989-4d9b-84b5-512b99b185c9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.093038 Sep 17 21:10:36.920490 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2230/4555] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:10:36.944123 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fd3aa5ba-9566-4923-a739-2e82e34d2d19 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:36.945014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fd3aa5ba-9566-4923-a739-2e82e34d2d19 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 640f82db-299b-42a4-a6b6-0a286b8220c9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:37.032156 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2c201cbd-2fa0-4714-94fb-706f94139b50 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:37.042485 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2c201cbd-2fa0-4714-94fb-706f94139b50 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc" status: 200 len: 1368 microversion: 2.1 time: 0.640483 Sep 17 21:10:37.045328 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2326/4556] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:36 2022] GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc => generated 1368 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:37.069227 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e20a194d-c666-46cf-92cd-96d94e05dbcd tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:37.082768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e20a194d-c666-46cf-92cd-96d94e05dbcd tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: d131d8e1-8f52-4d1f-8f88-46b1aef06e29] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:37.087927 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:37.102878 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e20a194d-c666-46cf-92cd-96d94e05dbcd tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:37.109000 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e20a194d-c666-46cf-92cd-96d94e05dbcd tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:37.110473 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e20a194d-c666-46cf-92cd-96d94e05dbcd tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:37.111533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e20a194d-c666-46cf-92cd-96d94e05dbcd tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:37.113278 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e20a194d-c666-46cf-92cd-96d94e05dbcd tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:37.114068 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e20a194d-c666-46cf-92cd-96d94e05dbcd tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:37.150912 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-e20a194d-c666-46cf-92cd-96d94e05dbcd tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] HTTP exception thrown: Instance d131d8e1-8f52-4d1f-8f88-46b1aef06e29 could not be found. Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e20a194d-c666-46cf-92cd-96d94e05dbcd tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Request method failure captured: Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29 HTTP/1.1 Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjWtNzto0mtliTp7XFuULyHI3we00ltwNJkYCbse73U4gam1okW0tzurAZa5qe_YztpOkiAgcTw1EzIzI3V47Ip6mNu1JOtXw9_irlu2PoTiHu-RjUFuYp2PItqb9Y3KBbavW0dotTtDS8YxL9QYLwabuvziZ2iGyr941Z01slaUM2o Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 3e48e3c2f7f74636a75679fdf10ef33a Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerActionsTestJSON-1146998919 Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e48e3c2f7f74636a75679fdf10ef33a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3e48e3c2f7f74636a75679fdf10ef33a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e48e3c2f7f74636a75679fdf10ef33a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3e48e3c2f7f74636a75679fdf10ef33a", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerActionsTestJSON-1146998919 Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 3e48e3c2f7f74636a75679fdf10ef33a Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerActionsTestJSON-1146998919 Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerActionsTestJSON-1146998919-project Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 2ef547e071fd43ec96c745c26eca119f Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerActionsTestJSON-1146998919-project Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance d131d8e1-8f52-4d1f-8f88-46b1aef06e29 could not be found. Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'd131d8e1-8f52-4d1f-8f88-46b1aef06e29'} Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d131d8e1-8f52-4d1f-8f88-46b1aef06e29 could not be found. Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d131d8e1-8f52-4d1f-8f88-46b1aef06e29 could not be found. Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:10:37.160168 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:10:37.164060 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:37.164060 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:10:37.164060 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:10:37.164060 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:10:37.164060 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:10:37.164060 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d131d8e1-8f52-4d1f-8f88-46b1aef06e29 could not be found. Sep 17 21:10:37.164060 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:10:37.167222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e20a194d-c666-46cf-92cd-96d94e05dbcd tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Returning 404 to user: Instance d131d8e1-8f52-4d1f-8f88-46b1aef06e29 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:10:37.170900 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e20a194d-c666-46cf-92cd-96d94e05dbcd tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29" status: 404 len: 111 microversion: 2.1 time: 0.121677 Sep 17 21:10:37.176865 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2327/4557] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:37 2022] GET /compute/v2.1/servers/d131d8e1-8f52-4d1f-8f88-46b1aef06e29 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:10:37.191614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bb99ada2-9d41-476d-b886-10e8dbfcc316 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1619159573", "metadata": {"image_type": "test"}}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:37.213242 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bb99ada2-9d41-476d-b886-10e8dbfcc316 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] [instance: 1bb77042-152e-4948-95ab-8849c8d72c80] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:37.223883 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bb99ada2-9d41-476d-b886-10e8dbfcc316 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:37.224492 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bb99ada2-9d41-476d-b886-10e8dbfcc316 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:37.225209 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bb99ada2-9d41-476d-b886-10e8dbfcc316 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:37.226144 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bb99ada2-9d41-476d-b886-10e8dbfcc316 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:37.226618 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bb99ada2-9d41-476d-b886-10e8dbfcc316 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:37.227048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bb99ada2-9d41-476d-b886-10e8dbfcc316 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:37.306615 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-bb99ada2-9d41-476d-b886-10e8dbfcc316 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Getting quotas for project 4ceec62fde59414ebb34572d8f8fbcfe. Resources: dict_keys(['metadata_items']) {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:10:37.314743 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-bb99ada2-9d41-476d-b886-10e8dbfcc316 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Getting quotas for user 1fbd80f0e5bf46b78a79fd821e9ff89e and project 4ceec62fde59414ebb34572d8f8fbcfe. Resources: dict_keys(['metadata_items']) {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:10:37.316388 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fd3aa5ba-9566-4923-a739-2e82e34d2d19 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:37.324754 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fd3aa5ba-9566-4923-a739-2e82e34d2d19 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9" status: 200 len: 1209 microversion: 2.1 time: 0.402368 Sep 17 21:10:37.329522 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2231/4558] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:36 2022] GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9 => generated 1209 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:37.338696 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e2cc85ff-00d6-4324-bbda-2ddeb022fa6d tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:37.339473 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e2cc85ff-00d6-4324-bbda-2ddeb022fa6d tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:37.350588 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2cc85ff-00d6-4324-bbda-2ddeb022fa6d tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:37.351095 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2cc85ff-00d6-4324-bbda-2ddeb022fa6d tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:37.351543 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2cc85ff-00d6-4324-bbda-2ddeb022fa6d tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:37.353214 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2cc85ff-00d6-4324-bbda-2ddeb022fa6d tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:37.353734 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2cc85ff-00d6-4324-bbda-2ddeb022fa6d tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:37.354179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2cc85ff-00d6-4324-bbda-2ddeb022fa6d tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:37.469149 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e2cc85ff-00d6-4324-bbda-2ddeb022fa6d tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:37.487437 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e2cc85ff-00d6-4324-bbda-2ddeb022fa6d tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:37.491704 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e2cc85ff-00d6-4324-bbda-2ddeb022fa6d tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:37.495973 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e2cc85ff-00d6-4324-bbda-2ddeb022fa6d tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1330 microversion: 2.54 time: 0.164595 Sep 17 21:10:37.498471 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2232/4559] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:10:37 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1330 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:10:37.516886 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0e1e16b6-f086-4ac1-92cd-025d263475f2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:37.519557 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0e1e16b6-f086-4ac1-92cd-025d263475f2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:37.540610 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e1e16b6-f086-4ac1-92cd-025d263475f2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:37.541522 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e1e16b6-f086-4ac1-92cd-025d263475f2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:37.542219 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e1e16b6-f086-4ac1-92cd-025d263475f2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:37.543356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e1e16b6-f086-4ac1-92cd-025d263475f2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:37.544567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e1e16b6-f086-4ac1-92cd-025d263475f2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:37.545321 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e1e16b6-f086-4ac1-92cd-025d263475f2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:37.587727 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0e1e16b6-f086-4ac1-92cd-025d263475f2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:10:37.722417 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bb99ada2-9d41-476d-b886-10e8dbfcc316 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "POST /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80/action" status: 202 len: 0 microversion: 2.1 time: 0.541595 Sep 17 21:10:37.723430 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2328/4560] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:10:37 2022] POST /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80/action => generated 0 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 17 21:10:37.746455 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4f09e9eb-0cdd-4db7-8eef-e702e7c7760a tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f259fee6af0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:37.755122 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0e1e16b6-f086-4ac1-92cd-025d263475f2 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "DELETE /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 204 len: 0 microversion: 2.1 time: 0.252194 Sep 17 21:10:37.759934 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2233/4561] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:10:37 2022] DELETE /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:10:37.773204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b449d000-86dc-490c-8eae-907d9e825584 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:37.774323 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b449d000-86dc-490c-8eae-907d9e825584 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:37.821030 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b449d000-86dc-490c-8eae-907d9e825584 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:37.821822 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b449d000-86dc-490c-8eae-907d9e825584 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:37.822591 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b449d000-86dc-490c-8eae-907d9e825584 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:37.823373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b449d000-86dc-490c-8eae-907d9e825584 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:37.824086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b449d000-86dc-490c-8eae-907d9e825584 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:37.824811 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b449d000-86dc-490c-8eae-907d9e825584 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:37.831768 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:37.871728 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4f09e9eb-0cdd-4db7-8eef-e702e7c7760a tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9" status: 200 len: 1424 microversion: 2.1 time: 0.134740 Sep 17 21:10:37.872823 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2329/4562] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:10:37 2022] GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9 => generated 1424 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:38.068302 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0cf94be6-2388-430b-9b8c-cd7d739ea92b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:38.069080 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0cf94be6-2388-430b-9b8c-cd7d739ea92b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0e3e136c-7043-4c24-bf6d-f33bf379e7cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:38.080443 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0cf94be6-2388-430b-9b8c-cd7d739ea92b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:38.081119 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0cf94be6-2388-430b-9b8c-cd7d739ea92b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:38.082261 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0cf94be6-2388-430b-9b8c-cd7d739ea92b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:38.086161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0cf94be6-2388-430b-9b8c-cd7d739ea92b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:38.086852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0cf94be6-2388-430b-9b8c-cd7d739ea92b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:38.087377 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0cf94be6-2388-430b-9b8c-cd7d739ea92b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:38.128428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b449d000-86dc-490c-8eae-907d9e825584 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:38.140280 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b449d000-86dc-490c-8eae-907d9e825584 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1677 microversion: 2.1 time: 0.375037 Sep 17 21:10:38.141517 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2234/4563] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:37 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1677 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:38.352273 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-52ae4614-f516-439f-93d4-5cd738892e3c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:38.367552 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0cf94be6-2388-430b-9b8c-cd7d739ea92b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:38.368366 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-52ae4614-f516-439f-93d4-5cd738892e3c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 640f82db-299b-42a4-a6b6-0a286b8220c9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:38.414129 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-52ae4614-f516-439f-93d4-5cd738892e3c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:38.414816 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-52ae4614-f516-439f-93d4-5cd738892e3c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:38.418596 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0cf94be6-2388-430b-9b8c-cd7d739ea92b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc" status: 200 len: 1368 microversion: 2.1 time: 0.353165 Sep 17 21:10:38.421977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-52ae4614-f516-439f-93d4-5cd738892e3c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:38.422132 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2330/4564] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:38 2022] GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc => generated 1368 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:10:38.423423 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-52ae4614-f516-439f-93d4-5cd738892e3c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:38.424190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-52ae4614-f516-439f-93d4-5cd738892e3c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:38.424783 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-52ae4614-f516-439f-93d4-5cd738892e3c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:38.524352 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2e6ef37e-91b2-4b2a-9556-84903d75cd62 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:38.525271 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2e6ef37e-91b2-4b2a-9556-84903d75cd62 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:38.538365 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e6ef37e-91b2-4b2a-9556-84903d75cd62 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:38.539166 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e6ef37e-91b2-4b2a-9556-84903d75cd62 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:38.540972 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e6ef37e-91b2-4b2a-9556-84903d75cd62 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:38.543486 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e6ef37e-91b2-4b2a-9556-84903d75cd62 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:38.544188 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e6ef37e-91b2-4b2a-9556-84903d75cd62 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:38.546067 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e6ef37e-91b2-4b2a-9556-84903d75cd62 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:38.643457 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-52ae4614-f516-439f-93d4-5cd738892e3c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:38.652695 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-52ae4614-f516-439f-93d4-5cd738892e3c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9" status: 200 len: 1205 microversion: 2.1 time: 0.305279 Sep 17 21:10:38.653774 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2235/4565] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:38 2022] GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9 => generated 1205 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:10:38.700833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2e6ef37e-91b2-4b2a-9556-84903d75cd62 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:38.712862 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2e6ef37e-91b2-4b2a-9556-84903d75cd62 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:38.714697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2e6ef37e-91b2-4b2a-9556-84903d75cd62 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:38.716808 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2e6ef37e-91b2-4b2a-9556-84903d75cd62 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1338 microversion: 2.54 time: 0.197321 Sep 17 21:10:38.726853 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2331/4566] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:10:38 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1338 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:10:38.889266 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9b17cc40-f223-4da1-8e8d-845239dd632f tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a4756670>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:38.955332 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9b17cc40-f223-4da1-8e8d-845239dd632f tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9" status: 200 len: 1424 microversion: 2.1 time: 0.070823 Sep 17 21:10:38.956384 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2236/4567] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:10:38 2022] GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9 => generated 1424 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:39.165442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-58b36b6a-bb35-4253-a2bd-36fb69bcdc3b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:39.166094 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-58b36b6a-bb35-4253-a2bd-36fb69bcdc3b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:39.174479 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58b36b6a-bb35-4253-a2bd-36fb69bcdc3b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:39.174980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58b36b6a-bb35-4253-a2bd-36fb69bcdc3b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:39.175791 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58b36b6a-bb35-4253-a2bd-36fb69bcdc3b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:39.176356 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58b36b6a-bb35-4253-a2bd-36fb69bcdc3b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:39.176980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58b36b6a-bb35-4253-a2bd-36fb69bcdc3b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:39.177693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58b36b6a-bb35-4253-a2bd-36fb69bcdc3b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:39.390810 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-58b36b6a-bb35-4253-a2bd-36fb69bcdc3b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:39.404439 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-58b36b6a-bb35-4253-a2bd-36fb69bcdc3b tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1677 microversion: 2.1 time: 0.243520 Sep 17 21:10:39.419508 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2332/4568] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:39 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1677 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:39.448975 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-aa1ec860-b6da-4ca2-8a30-6de9b5c32498 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:39.449819 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-aa1ec860-b6da-4ca2-8a30-6de9b5c32498 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0e3e136c-7043-4c24-bf6d-f33bf379e7cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:39.458615 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa1ec860-b6da-4ca2-8a30-6de9b5c32498 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:39.459451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa1ec860-b6da-4ca2-8a30-6de9b5c32498 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:39.460156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa1ec860-b6da-4ca2-8a30-6de9b5c32498 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:39.461425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa1ec860-b6da-4ca2-8a30-6de9b5c32498 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:39.462156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa1ec860-b6da-4ca2-8a30-6de9b5c32498 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:39.462812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa1ec860-b6da-4ca2-8a30-6de9b5c32498 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:39.681153 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c8c18742-13e8-4afe-b2b4-2bacbeb2b9d2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:39.684202 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c8c18742-13e8-4afe-b2b4-2bacbeb2b9d2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 640f82db-299b-42a4-a6b6-0a286b8220c9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:39.706920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8c18742-13e8-4afe-b2b4-2bacbeb2b9d2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:39.707420 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8c18742-13e8-4afe-b2b4-2bacbeb2b9d2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:39.707858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8c18742-13e8-4afe-b2b4-2bacbeb2b9d2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:39.708597 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8c18742-13e8-4afe-b2b4-2bacbeb2b9d2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:39.710223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8c18742-13e8-4afe-b2b4-2bacbeb2b9d2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:39.710223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8c18742-13e8-4afe-b2b4-2bacbeb2b9d2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:39.936028 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c8c18742-13e8-4afe-b2b4-2bacbeb2b9d2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:39.961836 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-aa1ec860-b6da-4ca2-8a30-6de9b5c32498 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:39.965035 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c8c18742-13e8-4afe-b2b4-2bacbeb2b9d2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9" status: 200 len: 1261 microversion: 2.1 time: 0.287862 Sep 17 21:10:39.967523 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2333/4569] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:39 2022] GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9 => generated 1261 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:39.974247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-03756342-0223-47a4-9f5b-6c77e6f65ac8 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:39.975133 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-03756342-0223-47a4-9f5b-6c77e6f65ac8 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:39.977141 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-aa1ec860-b6da-4ca2-8a30-6de9b5c32498 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc" status: 200 len: 1368 microversion: 2.1 time: 0.531135 Sep 17 21:10:39.984463 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03756342-0223-47a4-9f5b-6c77e6f65ac8 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:39.985315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03756342-0223-47a4-9f5b-6c77e6f65ac8 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:39.986009 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03756342-0223-47a4-9f5b-6c77e6f65ac8 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:39.988201 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03756342-0223-47a4-9f5b-6c77e6f65ac8 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:39.988862 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03756342-0223-47a4-9f5b-6c77e6f65ac8 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:39.990045 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03756342-0223-47a4-9f5b-6c77e6f65ac8 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:40.000374 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2237/4570] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:39 2022] GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc => generated 1368 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:40.015783 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1d47efc3-3435-4c6e-b310-48408a878767 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a46a4700>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:40.092293 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1d47efc3-3435-4c6e-b310-48408a878767 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9" status: 200 len: 1424 microversion: 2.1 time: 0.089547 Sep 17 21:10:40.093662 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2238/4571] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:10:40 2022] GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9 => generated 1424 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:40.124391 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-03756342-0223-47a4-9f5b-6c77e6f65ac8 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:40.144614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-03756342-0223-47a4-9f5b-6c77e6f65ac8 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:40.146182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-03756342-0223-47a4-9f5b-6c77e6f65ac8 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:40.147602 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-03756342-0223-47a4-9f5b-6c77e6f65ac8 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1336 microversion: 2.54 time: 0.178851 Sep 17 21:10:40.162326 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2334/4572] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:10:39 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1336 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:10:40.429021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ab0464f7-a113-484c-8ee5-31d33feadb82 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:40.429673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ab0464f7-a113-484c-8ee5-31d33feadb82 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:40.438470 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab0464f7-a113-484c-8ee5-31d33feadb82 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:40.439170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab0464f7-a113-484c-8ee5-31d33feadb82 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:40.441036 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab0464f7-a113-484c-8ee5-31d33feadb82 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:40.442795 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab0464f7-a113-484c-8ee5-31d33feadb82 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:40.443324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab0464f7-a113-484c-8ee5-31d33feadb82 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:40.445871 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab0464f7-a113-484c-8ee5-31d33feadb82 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:40.741586 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ab0464f7-a113-484c-8ee5-31d33feadb82 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:40.751957 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ab0464f7-a113-484c-8ee5-31d33feadb82 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1677 microversion: 2.1 time: 0.327446 Sep 17 21:10:40.775111 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2239/4573] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:40 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1677 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:40.991212 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e8eacf97-8501-4cf1-85e6-a515847fbc8e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:40.992028 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e8eacf97-8501-4cf1-85e6-a515847fbc8e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 640f82db-299b-42a4-a6b6-0a286b8220c9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:41.006162 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b469ed94-c96c-433d-9d84-0a43e5b1437e tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:41.007563 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b469ed94-c96c-433d-9d84-0a43e5b1437e tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0e3e136c-7043-4c24-bf6d-f33bf379e7cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:41.010628 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8eacf97-8501-4cf1-85e6-a515847fbc8e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:41.011142 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8eacf97-8501-4cf1-85e6-a515847fbc8e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:41.011593 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8eacf97-8501-4cf1-85e6-a515847fbc8e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:41.015462 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8eacf97-8501-4cf1-85e6-a515847fbc8e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:41.016206 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8eacf97-8501-4cf1-85e6-a515847fbc8e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:41.018175 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8eacf97-8501-4cf1-85e6-a515847fbc8e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:41.025999 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b469ed94-c96c-433d-9d84-0a43e5b1437e tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:41.026638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b469ed94-c96c-433d-9d84-0a43e5b1437e tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:41.026950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b469ed94-c96c-433d-9d84-0a43e5b1437e tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:41.027866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b469ed94-c96c-433d-9d84-0a43e5b1437e tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:41.030262 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b469ed94-c96c-433d-9d84-0a43e5b1437e tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:41.033402 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b469ed94-c96c-433d-9d84-0a43e5b1437e tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:41.218343 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e8eacf97-8501-4cf1-85e6-a515847fbc8e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:41.235625 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e8eacf97-8501-4cf1-85e6-a515847fbc8e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9" status: 200 len: 1261 microversion: 2.1 time: 0.248700 Sep 17 21:10:41.240374 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2335/4574] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:40 2022] GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9 => generated 1261 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:41.266947 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-12bffd3e-60eb-4de2-a0fd-78ded2b0972f tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a4014310>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:41.415369 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-12bffd3e-60eb-4de2-a0fd-78ded2b0972f tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9" status: 200 len: 1424 microversion: 2.1 time: 0.170170 Sep 17 21:10:41.427164 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2336/4575] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:10:41 2022] GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9 => generated 1424 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:41.444784 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ee897f26-f36d-472a-9521-6f1b5155020c tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:41.445636 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ee897f26-f36d-472a-9521-6f1b5155020c tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:41.463255 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee897f26-f36d-472a-9521-6f1b5155020c tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:41.469883 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee897f26-f36d-472a-9521-6f1b5155020c tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:41.470765 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee897f26-f36d-472a-9521-6f1b5155020c tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:41.472452 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee897f26-f36d-472a-9521-6f1b5155020c tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:41.473627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee897f26-f36d-472a-9521-6f1b5155020c tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:41.474774 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee897f26-f36d-472a-9521-6f1b5155020c tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:41.513554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:41.670875 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ee897f26-f36d-472a-9521-6f1b5155020c tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:41.690556 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ee897f26-f36d-472a-9521-6f1b5155020c tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:41.697920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ee897f26-f36d-472a-9521-6f1b5155020c tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:41.700503 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ee897f26-f36d-472a-9521-6f1b5155020c tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1336 microversion: 2.54 time: 0.269652 Sep 17 21:10:41.703938 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2337/4576] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:10:41 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1336 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:10:41.766466 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b469ed94-c96c-433d-9d84-0a43e5b1437e tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:41.781888 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b469ed94-c96c-433d-9d84-0a43e5b1437e tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc" status: 200 len: 1368 microversion: 2.1 time: 0.779914 Sep 17 21:10:41.784638 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-238ce75f-3986-446c-8179-89324460ad07 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:41.785722 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-238ce75f-3986-446c-8179-89324460ad07 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:41.799758 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2240/4577] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:41 2022] GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc => generated 1368 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:41.804148 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-238ce75f-3986-446c-8179-89324460ad07 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:41.805140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-238ce75f-3986-446c-8179-89324460ad07 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:41.807240 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-238ce75f-3986-446c-8179-89324460ad07 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:41.810253 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-238ce75f-3986-446c-8179-89324460ad07 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:41.813110 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-238ce75f-3986-446c-8179-89324460ad07 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:41.815046 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-238ce75f-3986-446c-8179-89324460ad07 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:41.969236 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-1b039137-bdc3-4388-b861-5e8c3a107e02 req-b15865d2-d0b4-4b57-ad86-c8b32ae482a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e3e136c-7043-4c24-bf6d-f33bf379e7cc", "name": "network-vif-plugged", "status": "completed", "tag": "e0be212d-ddc6-44b6-9963-59a1fa83ae0c"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:41.992478 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-1b039137-bdc3-4388-b861-5e8c3a107e02 req-b15865d2-d0b4-4b57-ad86-c8b32ae482a2 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:41.993230 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-1b039137-bdc3-4388-b861-5e8c3a107e02 req-b15865d2-d0b4-4b57-ad86-c8b32ae482a2 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:41.993861 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-1b039137-bdc3-4388-b861-5e8c3a107e02 req-b15865d2-d0b4-4b57-ad86-c8b32ae482a2 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:42.012785 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-1b039137-bdc3-4388-b861-5e8c3a107e02 req-b15865d2-d0b4-4b57-ad86-c8b32ae482a2 service nova] Creating event network-vif-plugged:e0be212d-ddc6-44b6-9963-59a1fa83ae0c for instance 0e3e136c-7043-4c24-bf6d-f33bf379e7cc on nch1-master-1 Sep 17 21:10:42.019749 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-1b039137-bdc3-4388-b861-5e8c3a107e02 req-b15865d2-d0b4-4b57-ad86-c8b32ae482a2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070837 Sep 17 21:10:42.021694 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2241/4578] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:10:42.205442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-238ce75f-3986-446c-8179-89324460ad07 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:42.215373 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-238ce75f-3986-446c-8179-89324460ad07 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1677 microversion: 2.1 time: 0.440840 Sep 17 21:10:42.216441 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2338/4579] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:41 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1677 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:42.265485 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4412ed93-c242-454c-9ba9-ce412b6f698f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:42.267230 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4412ed93-c242-454c-9ba9-ce412b6f698f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 640f82db-299b-42a4-a6b6-0a286b8220c9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:42.287501 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4412ed93-c242-454c-9ba9-ce412b6f698f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:42.288081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4412ed93-c242-454c-9ba9-ce412b6f698f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:42.291330 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4412ed93-c242-454c-9ba9-ce412b6f698f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:42.292588 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4412ed93-c242-454c-9ba9-ce412b6f698f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:42.293342 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4412ed93-c242-454c-9ba9-ce412b6f698f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:42.294243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4412ed93-c242-454c-9ba9-ce412b6f698f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:42.435064 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b5d08b98-f329-4652-a40b-972217267606 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a405e310>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:42.529219 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b5d08b98-f329-4652-a40b-972217267606 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9" status: 200 len: 1424 microversion: 2.1 time: 0.098523 Sep 17 21:10:42.531938 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2339/4580] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:10:42 2022] GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9 => generated 1424 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:42.610982 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4412ed93-c242-454c-9ba9-ce412b6f698f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:42.626368 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4412ed93-c242-454c-9ba9-ce412b6f698f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9" status: 200 len: 1267 microversion: 2.1 time: 0.366671 Sep 17 21:10:42.626989 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2242/4581] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:42 2022] GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9 => generated 1267 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:42.738341 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-50cb325f-1c39-4304-9e33-349093ae07c7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:42.739660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-50cb325f-1c39-4304-9e33-349093ae07c7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:42.748257 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50cb325f-1c39-4304-9e33-349093ae07c7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:42.750829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50cb325f-1c39-4304-9e33-349093ae07c7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:42.754203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50cb325f-1c39-4304-9e33-349093ae07c7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:42.755988 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50cb325f-1c39-4304-9e33-349093ae07c7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:42.756697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50cb325f-1c39-4304-9e33-349093ae07c7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:42.757364 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50cb325f-1c39-4304-9e33-349093ae07c7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:42.815270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-12426c30-ae34-4b1e-8662-e6257f947696 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:42.815998 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-12426c30-ae34-4b1e-8662-e6257f947696 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0e3e136c-7043-4c24-bf6d-f33bf379e7cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:42.826024 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12426c30-ae34-4b1e-8662-e6257f947696 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:42.837569 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12426c30-ae34-4b1e-8662-e6257f947696 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:42.838266 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12426c30-ae34-4b1e-8662-e6257f947696 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:42.839257 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12426c30-ae34-4b1e-8662-e6257f947696 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:42.841347 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12426c30-ae34-4b1e-8662-e6257f947696 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:42.848026 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12426c30-ae34-4b1e-8662-e6257f947696 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:43.029345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-50cb325f-1c39-4304-9e33-349093ae07c7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:43.038370 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-50cb325f-1c39-4304-9e33-349093ae07c7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:43.042499 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-50cb325f-1c39-4304-9e33-349093ae07c7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:43.048140 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-50cb325f-1c39-4304-9e33-349093ae07c7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1357 microversion: 2.54 time: 0.314411 Sep 17 21:10:43.048981 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2340/4582] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:10:42 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1357 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:10:43.084838 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5d13d211-4910-412a-a986-ecb688fa4994 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Action: 'create', calling method: .version_select at 0x7f25a405edc0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1474968742", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCK55EukjyNTSnLiNOpfVMdo0JdSoYNAg/72KZ8YgHsv4rOypA/cxAb0R9Z0gU1kJWntgREAEtf0+qd1Qt1jQG935tnr1+PKUtQjEIKZDWg2Rm82pwtfM/mUmUJO2PluiA=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:43.122003 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-5d13d211-4910-412a-a986-ecb688fa4994 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Getting quotas for project f7a3c50d58d347d0a4467cd4e61b06e0. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:10:43.131009 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-5d13d211-4910-412a-a986-ecb688fa4994 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Getting quotas for user e8b19d9480444a44a48ac3c5efe7fe17 and project f7a3c50d58d347d0a4467cd4e61b06e0. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:10:43.190401 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5d13d211-4910-412a-a986-ecb688fa4994 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.109004 Sep 17 21:10:43.191288 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2341/4583] 10.222.0.26 () {62 vars in 1200 bytes} [Sat Sep 17 21:10:43 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 111 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 17 21:10:43.204355 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8d092972-0a1d-4c23-941c-6f97e204c0c2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1474968742", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:43.214518 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8d092972-0a1d-4c23-941c-6f97e204c0c2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:43.241823 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d092972-0a1d-4c23-941c-6f97e204c0c2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:43.245673 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d092972-0a1d-4c23-941c-6f97e204c0c2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:43.246355 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d092972-0a1d-4c23-941c-6f97e204c0c2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:43.247477 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d092972-0a1d-4c23-941c-6f97e204c0c2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:43.249683 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d092972-0a1d-4c23-941c-6f97e204c0c2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:43.250737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d092972-0a1d-4c23-941c-6f97e204c0c2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:43.421216 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-8d092972-0a1d-4c23-941c-6f97e204c0c2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:10:43.421721 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-8d092972-0a1d-4c23-941c-6f97e204c0c2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:10:43.422304 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-8d092972-0a1d-4c23-941c-6f97e204c0c2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:10:43.422780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-8d092972-0a1d-4c23-941c-6f97e204c0c2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:10:43.423464 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-8d092972-0a1d-4c23-941c-6f97e204c0c2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:10:43.529047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-12426c30-ae34-4b1e-8662-e6257f947696 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:43.541964 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-12426c30-ae34-4b1e-8662-e6257f947696 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc" status: 200 len: 1368 microversion: 2.1 time: 0.729233 Sep 17 21:10:43.542844 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2243/4584] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:42 2022] GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc => generated 1368 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:10:43.569841 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3f022ff9-90e4-4fe8-a885-5ab88c907542 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:43.574114 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3f022ff9-90e4-4fe8-a885-5ab88c907542 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:43.582290 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f022ff9-90e4-4fe8-a885-5ab88c907542 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:43.583174 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f022ff9-90e4-4fe8-a885-5ab88c907542 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:43.583851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f022ff9-90e4-4fe8-a885-5ab88c907542 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:43.584796 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f022ff9-90e4-4fe8-a885-5ab88c907542 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:43.585613 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f022ff9-90e4-4fe8-a885-5ab88c907542 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:43.586289 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f022ff9-90e4-4fe8-a885-5ab88c907542 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:43.616930 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8d092972-0a1d-4c23-941c-6f97e204c0c2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:43.639517 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d092972-0a1d-4c23-941c-6f97e204c0c2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:43.640462 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d092972-0a1d-4c23-941c-6f97e204c0c2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:43.641882 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d092972-0a1d-4c23-941c-6f97e204c0c2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:43.644513 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d092972-0a1d-4c23-941c-6f97e204c0c2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:43.645246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d092972-0a1d-4c23-941c-6f97e204c0c2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:43.647738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d092972-0a1d-4c23-941c-6f97e204c0c2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:43.743109 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8d092972-0a1d-4c23-941c-6f97e204c0c2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "POST /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360/action" status: 202 len: 1140 microversion: 2.54 time: 0.530964 Sep 17 21:10:43.744186 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2342/4585] 10.222.0.26 () {62 vars in 1320 bytes} [Sat Sep 17 21:10:43 2022] POST /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360/action => generated 1140 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Sep 17 21:10:43.758049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-25242381-7994-45ee-8c17-89fc13a6435b tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a409c700>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:43.968681 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3f022ff9-90e4-4fe8-a885-5ab88c907542 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:43.976363 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-25242381-7994-45ee-8c17-89fc13a6435b tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9" status: 200 len: 1424 microversion: 2.1 time: 0.229789 Sep 17 21:10:43.977004 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2343/4586] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:10:43 2022] GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9 => generated 1424 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:43.982486 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3f022ff9-90e4-4fe8-a885-5ab88c907542 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1609 microversion: 2.1 time: 0.417538 Sep 17 21:10:43.983123 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2244/4587] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:43 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1609 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:43.985444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bbce908d-ba5b-41ac-9840-14e9dec5a3ad tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:43.987505 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bbce908d-ba5b-41ac-9840-14e9dec5a3ad tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 640f82db-299b-42a4-a6b6-0a286b8220c9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:43.998637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbce908d-ba5b-41ac-9840-14e9dec5a3ad tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:43.999423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbce908d-ba5b-41ac-9840-14e9dec5a3ad tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:44.001047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbce908d-ba5b-41ac-9840-14e9dec5a3ad tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:44.003884 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbce908d-ba5b-41ac-9840-14e9dec5a3ad tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:44.020709 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbce908d-ba5b-41ac-9840-14e9dec5a3ad tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:44.022297 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbce908d-ba5b-41ac-9840-14e9dec5a3ad tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:44.025025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e756934c-f6a1-451e-979b-fa9e1d4c834b tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:44.025701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e756934c-f6a1-451e-979b-fa9e1d4c834b tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:44.072640 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e756934c-f6a1-451e-979b-fa9e1d4c834b tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:44.073139 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e756934c-f6a1-451e-979b-fa9e1d4c834b tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:44.085985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e756934c-f6a1-451e-979b-fa9e1d4c834b tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:44.087109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e756934c-f6a1-451e-979b-fa9e1d4c834b tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:44.090264 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e756934c-f6a1-451e-979b-fa9e1d4c834b tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:44.099001 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e756934c-f6a1-451e-979b-fa9e1d4c834b tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:44.594190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:44.598509 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e756934c-f6a1-451e-979b-fa9e1d4c834b tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:44.623052 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e756934c-f6a1-451e-979b-fa9e1d4c834b tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:44.625197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e756934c-f6a1-451e-979b-fa9e1d4c834b tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:44.638059 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e756934c-f6a1-451e-979b-fa9e1d4c834b tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1409 microversion: 2.54 time: 0.653736 Sep 17 21:10:44.638699 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2245/4588] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:10:43 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1409 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:10:44.668250 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-8c3020c7-c590-4740-ad7d-de4d253d40d9 req-4c752de7-ac8f-47c7-b373-1797acc0d2cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bb77042-152e-4948-95ab-8849c8d72c80", "name": "network-vif-plugged", "status": "completed", "tag": "5ab301f7-76d2-44ce-a32b-a5a47596282b"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:44.689847 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8c3020c7-c590-4740-ad7d-de4d253d40d9 req-4c752de7-ac8f-47c7-b373-1797acc0d2cf service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:44.691224 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8c3020c7-c590-4740-ad7d-de4d253d40d9 req-4c752de7-ac8f-47c7-b373-1797acc0d2cf service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:44.691839 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8c3020c7-c590-4740-ad7d-de4d253d40d9 req-4c752de7-ac8f-47c7-b373-1797acc0d2cf service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:44.716530 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-8c3020c7-c590-4740-ad7d-de4d253d40d9 req-4c752de7-ac8f-47c7-b373-1797acc0d2cf service nova] Creating event network-vif-plugged:5ab301f7-76d2-44ce-a32b-a5a47596282b for instance 1bb77042-152e-4948-95ab-8849c8d72c80 on nch2-master-1 Sep 17 21:10:44.722267 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-8c3020c7-c590-4740-ad7d-de4d253d40d9 req-4c752de7-ac8f-47c7-b373-1797acc0d2cf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077211 Sep 17 21:10:44.723939 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2246/4589] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:10:44.741302 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4e4d3de8-af93-4f6c-b3ac-bedd04b6e010 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:44.746922 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4e4d3de8-af93-4f6c-b3ac-bedd04b6e010 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0e3e136c-7043-4c24-bf6d-f33bf379e7cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:44.766683 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e4d3de8-af93-4f6c-b3ac-bedd04b6e010 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:44.767477 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e4d3de8-af93-4f6c-b3ac-bedd04b6e010 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:44.768099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e4d3de8-af93-4f6c-b3ac-bedd04b6e010 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:44.769296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e4d3de8-af93-4f6c-b3ac-bedd04b6e010 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:44.769972 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e4d3de8-af93-4f6c-b3ac-bedd04b6e010 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:44.770621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e4d3de8-af93-4f6c-b3ac-bedd04b6e010 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:44.810218 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bbce908d-ba5b-41ac-9840-14e9dec5a3ad tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:44.824086 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bbce908d-ba5b-41ac-9840-14e9dec5a3ad tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9" status: 200 len: 1309 microversion: 2.1 time: 0.845550 Sep 17 21:10:44.844012 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2344/4590] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:43 2022] GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9 => generated 1309 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:44.844012 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-a86d28c8-75a3-41fe-bf3b-62787e36e7b3 req-03961bb3-729a-459d-a2bd-3f6aa647a1c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41393a54-9105-4da5-ae65-3167427ddae8", "name": "network-vif-deleted", "tag": "4d47e229-8239-4215-8c5c-b5133bcfb47b"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:44.867335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a86d28c8-75a3-41fe-bf3b-62787e36e7b3 req-03961bb3-729a-459d-a2bd-3f6aa647a1c2 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:44.870622 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a86d28c8-75a3-41fe-bf3b-62787e36e7b3 req-03961bb3-729a-459d-a2bd-3f6aa647a1c2 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:44.871232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a86d28c8-75a3-41fe-bf3b-62787e36e7b3 req-03961bb3-729a-459d-a2bd-3f6aa647a1c2 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:44.899667 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-a86d28c8-75a3-41fe-bf3b-62787e36e7b3 req-03961bb3-729a-459d-a2bd-3f6aa647a1c2 service nova] Creating event network-vif-deleted:4d47e229-8239-4215-8c5c-b5133bcfb47b for instance 41393a54-9105-4da5-ae65-3167427ddae8 on nch1-master-1 Sep 17 21:10:44.912685 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-a86d28c8-75a3-41fe-bf3b-62787e36e7b3 req-03961bb3-729a-459d-a2bd-3f6aa647a1c2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080970 Sep 17 21:10:44.915334 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2345/4591] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:10:44.994649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-14ac75b2-71b3-4257-a22a-8bbf4b56a122 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a4095040>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:45.107791 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-14ac75b2-71b3-4257-a22a-8bbf4b56a122 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9" status: 200 len: 1424 microversion: 2.1 time: 0.117042 Sep 17 21:10:45.110506 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2346/4592] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:10:44 2022] GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9 => generated 1424 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:10:45.115660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9bce8191-4145-49b9-ab6b-ed5e932b615a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:45.123374 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9bce8191-4145-49b9-ab6b-ed5e932b615a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:45.139390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9bce8191-4145-49b9-ab6b-ed5e932b615a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:45.141643 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9bce8191-4145-49b9-ab6b-ed5e932b615a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:45.143211 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9bce8191-4145-49b9-ab6b-ed5e932b615a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:45.144482 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9bce8191-4145-49b9-ab6b-ed5e932b615a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:45.145239 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9bce8191-4145-49b9-ab6b-ed5e932b615a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:45.146082 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9bce8191-4145-49b9-ab6b-ed5e932b615a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:45.232522 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4e4d3de8-af93-4f6c-b3ac-bedd04b6e010 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:45.246476 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4e4d3de8-af93-4f6c-b3ac-bedd04b6e010 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc" status: 200 len: 1559 microversion: 2.1 time: 0.522022 Sep 17 21:10:45.251682 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9bce8191-4145-49b9-ab6b-ed5e932b615a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:45.253579 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9bce8191-4145-49b9-ab6b-ed5e932b615a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:45.254358 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9bce8191-4145-49b9-ab6b-ed5e932b615a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:45.255050 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-9bce8191-4145-49b9-ab6b-ed5e932b615a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lazy-loading 'fault' on Instance uuid 41393a54-9105-4da5-ae65-3167427ddae8 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:10:45.266445 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2247/4593] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:44 2022] GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc => generated 1559 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:45.297166 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-98e28934-fb86-4dc7-ba17-4780c8fcdbcb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:45.298755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-98e28934-fb86-4dc7-ba17-4780c8fcdbcb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0e3e136c-7043-4c24-bf6d-f33bf379e7cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:45.309335 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98e28934-fb86-4dc7-ba17-4780c8fcdbcb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:45.311805 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98e28934-fb86-4dc7-ba17-4780c8fcdbcb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:45.312554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98e28934-fb86-4dc7-ba17-4780c8fcdbcb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:45.313365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98e28934-fb86-4dc7-ba17-4780c8fcdbcb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:45.314054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98e28934-fb86-4dc7-ba17-4780c8fcdbcb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:45.314599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98e28934-fb86-4dc7-ba17-4780c8fcdbcb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:45.368574 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9bce8191-4145-49b9-ab6b-ed5e932b615a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ef547e071fd43ec96c745c26eca119f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e48e3c2f7f74636a75679fdf10ef33a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:45.384766 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9bce8191-4145-49b9-ab6b-ed5e932b615a tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 200 len: 1329 microversion: 2.1 time: 0.272863 Sep 17 21:10:45.408096 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2347/4594] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:45 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 1329 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:45.442212 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-98e28934-fb86-4dc7-ba17-4780c8fcdbcb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.166839 Sep 17 21:10:45.442826 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2248/4595] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Sep 17 21:10:45 2022] GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc/os-interface => generated 285 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:10:45.684722 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-aec5919d-6eca-4fe5-a779-25bf7b1dcd57 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:45.699260 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-aec5919d-6eca-4fe5-a779-25bf7b1dcd57 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:45.716809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aec5919d-6eca-4fe5-a779-25bf7b1dcd57 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:45.717766 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aec5919d-6eca-4fe5-a779-25bf7b1dcd57 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:45.722212 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aec5919d-6eca-4fe5-a779-25bf7b1dcd57 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:45.723869 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aec5919d-6eca-4fe5-a779-25bf7b1dcd57 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:45.724517 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aec5919d-6eca-4fe5-a779-25bf7b1dcd57 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:45.725176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aec5919d-6eca-4fe5-a779-25bf7b1dcd57 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:45.854589 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4e639ab1-3e8c-442b-8d35-c161ce3367a8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:45.855970 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4e639ab1-3e8c-442b-8d35-c161ce3367a8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 640f82db-299b-42a4-a6b6-0a286b8220c9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:45.872945 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e639ab1-3e8c-442b-8d35-c161ce3367a8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:45.876336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e639ab1-3e8c-442b-8d35-c161ce3367a8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:45.877731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e639ab1-3e8c-442b-8d35-c161ce3367a8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:45.878903 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e639ab1-3e8c-442b-8d35-c161ce3367a8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:45.880780 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e639ab1-3e8c-442b-8d35-c161ce3367a8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:45.882922 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e639ab1-3e8c-442b-8d35-c161ce3367a8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:46.288633 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=4 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:46.739945 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-aec5919d-6eca-4fe5-a779-25bf7b1dcd57 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:46.749352 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-aec5919d-6eca-4fe5-a779-25bf7b1dcd57 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:46.751211 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-aec5919d-6eca-4fe5-a779-25bf7b1dcd57 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:46.762421 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-aec5919d-6eca-4fe5-a779-25bf7b1dcd57 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1409 microversion: 2.54 time: 1.099123 Sep 17 21:10:46.763118 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2348/4596] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:10:45 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1409 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:10:46.777827 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-34bd0218-bb18-4b09-8b7a-3484b90b30cd tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a4071550>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:46.864907 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-34bd0218-bb18-4b09-8b7a-3484b90b30cd tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9" status: 200 len: 1424 microversion: 2.1 time: 0.100651 Sep 17 21:10:46.865811 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2349/4597] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:10:46 2022] GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9 => generated 1424 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:46.889692 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e66071bb-8659-45c5-9144-9b0024013f2f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:46.890346 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e66071bb-8659-45c5-9144-9b0024013f2f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] [instance: 41393a54-9105-4da5-ae65-3167427ddae8] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:46.912819 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e66071bb-8659-45c5-9144-9b0024013f2f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:46.913331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e66071bb-8659-45c5-9144-9b0024013f2f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:46.913816 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e66071bb-8659-45c5-9144-9b0024013f2f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:46.920931 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e66071bb-8659-45c5-9144-9b0024013f2f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:46.929521 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e66071bb-8659-45c5-9144-9b0024013f2f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:46.930275 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e66071bb-8659-45c5-9144-9b0024013f2f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:46.964360 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-e66071bb-8659-45c5-9144-9b0024013f2f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] HTTP exception thrown: Instance 41393a54-9105-4da5-ae65-3167427ddae8 could not be found. Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e66071bb-8659-45c5-9144-9b0024013f2f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Request method failure captured: Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 HTTP/1.1 Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjWtNzto0mtliTp7XFuULyHI3we00ltwNJkYCbse73U4gam1okW0tzurAZa5qe_YztpOkiAgcTw1EzIzI3V47Ip6mNu1JOtXw9_irlu2PoTiHu-RjUFuYp2PItqb9Y3KBbavW0dotTtDS8YxL9QYLwabuvziZ2iGyr941Z01slaUM2o Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 3e48e3c2f7f74636a75679fdf10ef33a Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerActionsTestJSON-1146998919 Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e48e3c2f7f74636a75679fdf10ef33a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3e48e3c2f7f74636a75679fdf10ef33a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3e48e3c2f7f74636a75679fdf10ef33a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3e48e3c2f7f74636a75679fdf10ef33a", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerActionsTestJSON-1146998919 Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 3e48e3c2f7f74636a75679fdf10ef33a Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerActionsTestJSON-1146998919 Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerActionsTestJSON-1146998919-project Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 2ef547e071fd43ec96c745c26eca119f Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerActionsTestJSON-1146998919-project Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 41393a54-9105-4da5-ae65-3167427ddae8 could not be found. Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '41393a54-9105-4da5-ae65-3167427ddae8'} Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41393a54-9105-4da5-ae65-3167427ddae8 could not be found. Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41393a54-9105-4da5-ae65-3167427ddae8 could not be found. Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:10:46.967801 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:10:46.972731 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:10:46.972731 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:10:46.972731 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:10:46.972731 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:10:46.972731 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:10:46.972731 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41393a54-9105-4da5-ae65-3167427ddae8 could not be found. Sep 17 21:10:46.972731 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:10:46.980286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e66071bb-8659-45c5-9144-9b0024013f2f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Returning 404 to user: Instance 41393a54-9105-4da5-ae65-3167427ddae8 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:10:46.981432 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e66071bb-8659-45c5-9144-9b0024013f2f tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8" status: 404 len: 111 microversion: 2.1 time: 0.114417 Sep 17 21:10:46.982384 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2350/4598] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:46 2022] GET /compute/v2.1/servers/41393a54-9105-4da5-ae65-3167427ddae8 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:10:47.002806 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7badb61d-2e89-472a-b806-583e02e13646 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] Calling method '.version_select at 0x7f25a4071dc0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:47.089760 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7badb61d-2e89-472a-b806-583e02e13646 tempest-ServerActionsTestJSON-1146998919 tempest-ServerActionsTestJSON-1146998919-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1659946339" status: 202 len: 0 microversion: 2.1 time: 0.102137 Sep 17 21:10:47.091808 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2351/4599] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Sep 17 21:10:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1659946339 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:10:47.321574 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=16 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:47.533134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4e639ab1-3e8c-442b-8d35-c161ce3367a8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:47.543876 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4e639ab1-3e8c-442b-8d35-c161ce3367a8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9" status: 200 len: 1309 microversion: 2.1 time: 1.695655 Sep 17 21:10:47.544583 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2249/4600] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:45 2022] GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9 => generated 1309 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:47.795373 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-55e6d5e6-e2c2-4df0-8cfb-832d33bbd389 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:47.796770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-55e6d5e6-e2c2-4df0-8cfb-832d33bbd389 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:47.820250 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55e6d5e6-e2c2-4df0-8cfb-832d33bbd389 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:47.820760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55e6d5e6-e2c2-4df0-8cfb-832d33bbd389 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:47.821203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55e6d5e6-e2c2-4df0-8cfb-832d33bbd389 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:47.830614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55e6d5e6-e2c2-4df0-8cfb-832d33bbd389 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:47.831385 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55e6d5e6-e2c2-4df0-8cfb-832d33bbd389 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:47.831838 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-55e6d5e6-e2c2-4df0-8cfb-832d33bbd389 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:47.889727 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d8018223-07d3-4e7d-8f40-a5060d3a80e2 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a45d28b0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:47.976646 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d8018223-07d3-4e7d-8f40-a5060d3a80e2 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9" status: 200 len: 1424 microversion: 2.1 time: 0.097281 Sep 17 21:10:47.977248 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2250/4601] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:10:47 2022] GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9 => generated 1424 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:48.073648 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-55e6d5e6-e2c2-4df0-8cfb-832d33bbd389 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:48.083802 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-55e6d5e6-e2c2-4df0-8cfb-832d33bbd389 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:48.085851 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-55e6d5e6-e2c2-4df0-8cfb-832d33bbd389 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:48.088636 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-55e6d5e6-e2c2-4df0-8cfb-832d33bbd389 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1409 microversion: 2.54 time: 0.297729 Sep 17 21:10:48.089936 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2352/4602] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:10:47 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1409 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:10:48.569981 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a89e2ec0-6534-4d70-bda7-434999bad83b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:48.571538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a89e2ec0-6534-4d70-bda7-434999bad83b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 640f82db-299b-42a4-a6b6-0a286b8220c9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:48.601276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a89e2ec0-6534-4d70-bda7-434999bad83b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:48.601409 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a89e2ec0-6534-4d70-bda7-434999bad83b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:48.614038 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a89e2ec0-6534-4d70-bda7-434999bad83b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:48.615697 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a89e2ec0-6534-4d70-bda7-434999bad83b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:48.615697 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a89e2ec0-6534-4d70-bda7-434999bad83b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:48.615970 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a89e2ec0-6534-4d70-bda7-434999bad83b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:48.787374 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-bec865f4-6272-45cf-831b-06ea2c71d574 req-f255e98b-c276-4b16-a31a-49176b149182 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "640f82db-299b-42a4-a6b6-0a286b8220c9", "tag": "111dfd5b-5e71-4bad-94d3-ca63cddba527"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:48.820419 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-bec865f4-6272-45cf-831b-06ea2c71d574 req-f255e98b-c276-4b16-a31a-49176b149182 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:48.823143 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-bec865f4-6272-45cf-831b-06ea2c71d574 req-f255e98b-c276-4b16-a31a-49176b149182 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:48.823796 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-bec865f4-6272-45cf-831b-06ea2c71d574 req-f255e98b-c276-4b16-a31a-49176b149182 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:48.926488 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-bec865f4-6272-45cf-831b-06ea2c71d574 req-f255e98b-c276-4b16-a31a-49176b149182 service nova] Creating event network-changed:111dfd5b-5e71-4bad-94d3-ca63cddba527 for instance 640f82db-299b-42a4-a6b6-0a286b8220c9 on nch1-master-1 Sep 17 21:10:48.943054 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-bec865f4-6272-45cf-831b-06ea2c71d574 req-f255e98b-c276-4b16-a31a-49176b149182 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170055 Sep 17 21:10:48.946748 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2353/4603] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:10:48.999740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9d6f307c-075e-4a6f-bc7b-9b6c84bc4aee tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a4101dc0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:49.066894 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9d6f307c-075e-4a6f-bc7b-9b6c84bc4aee tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9" status: 200 len: 1424 microversion: 2.1 time: 0.072677 Sep 17 21:10:49.068151 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2354/4604] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:10:48 2022] GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9 => generated 1424 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:10:49.121004 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-222168af-134e-439b-9600-b1de7c1b5597 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:49.124175 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-222168af-134e-439b-9600-b1de7c1b5597 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:49.155651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-222168af-134e-439b-9600-b1de7c1b5597 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:49.158608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-222168af-134e-439b-9600-b1de7c1b5597 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:49.160247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-222168af-134e-439b-9600-b1de7c1b5597 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:49.161187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-222168af-134e-439b-9600-b1de7c1b5597 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:49.164837 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-222168af-134e-439b-9600-b1de7c1b5597 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:49.167785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-222168af-134e-439b-9600-b1de7c1b5597 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:49.280662 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a89e2ec0-6534-4d70-bda7-434999bad83b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:49.303549 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a89e2ec0-6534-4d70-bda7-434999bad83b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9" status: 200 len: 1309 microversion: 2.1 time: 0.738885 Sep 17 21:10:49.305559 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2251/4605] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:48 2022] GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9 => generated 1309 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:49.418093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-222168af-134e-439b-9600-b1de7c1b5597 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:49.438489 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-222168af-134e-439b-9600-b1de7c1b5597 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:49.444361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-222168af-134e-439b-9600-b1de7c1b5597 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:49.445894 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-222168af-134e-439b-9600-b1de7c1b5597 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1409 microversion: 2.54 time: 0.328963 Sep 17 21:10:49.462642 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2355/4606] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:10:49 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1409 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:10:50.086023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d670de33-9554-418c-9dce-bf40cd232373 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a4fc40d0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:50.252828 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d670de33-9554-418c-9dce-bf40cd232373 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9" status: 200 len: 1424 microversion: 2.1 time: 0.173491 Sep 17 21:10:50.264977 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2252/4607] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:10:50 2022] GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9 => generated 1424 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:50.330250 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6f25a138-f6a7-4db8-8933-82a1cb1e548a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:50.332169 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6f25a138-f6a7-4db8-8933-82a1cb1e548a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 640f82db-299b-42a4-a6b6-0a286b8220c9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:50.351818 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f25a138-f6a7-4db8-8933-82a1cb1e548a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:50.352688 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f25a138-f6a7-4db8-8933-82a1cb1e548a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:50.354152 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f25a138-f6a7-4db8-8933-82a1cb1e548a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:50.355122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f25a138-f6a7-4db8-8933-82a1cb1e548a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:50.355774 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f25a138-f6a7-4db8-8933-82a1cb1e548a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:50.356383 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f25a138-f6a7-4db8-8933-82a1cb1e548a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:50.483127 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-17157b69-af7d-45a6-a98b-0d2af6058f6b tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:50.484594 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-17157b69-af7d-45a6-a98b-0d2af6058f6b tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:50.496222 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17157b69-af7d-45a6-a98b-0d2af6058f6b tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:50.497239 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17157b69-af7d-45a6-a98b-0d2af6058f6b tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:50.497927 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17157b69-af7d-45a6-a98b-0d2af6058f6b tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:50.498755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17157b69-af7d-45a6-a98b-0d2af6058f6b tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:50.499509 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17157b69-af7d-45a6-a98b-0d2af6058f6b tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:50.500741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17157b69-af7d-45a6-a98b-0d2af6058f6b tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:50.632058 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-17157b69-af7d-45a6-a98b-0d2af6058f6b tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:50.646191 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-17157b69-af7d-45a6-a98b-0d2af6058f6b tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:50.648532 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-17157b69-af7d-45a6-a98b-0d2af6058f6b tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:50.652464 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-17157b69-af7d-45a6-a98b-0d2af6058f6b tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1409 microversion: 2.54 time: 0.172381 Sep 17 21:10:50.654197 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2253/4608] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:10:50 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1409 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:10:50.681841 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6f25a138-f6a7-4db8-8933-82a1cb1e548a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:50.706268 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6f25a138-f6a7-4db8-8933-82a1cb1e548a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9" status: 200 len: 1309 microversion: 2.1 time: 0.381428 Sep 17 21:10:50.706919 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2356/4609] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:50 2022] GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9 => generated 1309 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:51.003476 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-4d0e6b61-8922-434a-a900-3bf630188178 req-a0ce646a-0af8-42cf-94dc-168e24f360a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e3e136c-7043-4c24-bf6d-f33bf379e7cc", "tag": "e0be212d-ddc6-44b6-9963-59a1fa83ae0c"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:51.027977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-4d0e6b61-8922-434a-a900-3bf630188178 req-a0ce646a-0af8-42cf-94dc-168e24f360a6 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:51.028466 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-4d0e6b61-8922-434a-a900-3bf630188178 req-a0ce646a-0af8-42cf-94dc-168e24f360a6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:51.028939 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-4d0e6b61-8922-434a-a900-3bf630188178 req-a0ce646a-0af8-42cf-94dc-168e24f360a6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:51.049305 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-4d0e6b61-8922-434a-a900-3bf630188178 req-a0ce646a-0af8-42cf-94dc-168e24f360a6 service nova] Creating event network-changed:e0be212d-ddc6-44b6-9963-59a1fa83ae0c for instance 0e3e136c-7043-4c24-bf6d-f33bf379e7cc on nch1-master-1 Sep 17 21:10:51.056102 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-4d0e6b61-8922-434a-a900-3bf630188178 req-a0ce646a-0af8-42cf-94dc-168e24f360a6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056576 Sep 17 21:10:51.058186 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2254/4610] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:10:51.273646 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e9d16a78-eba6-4032-91d5-e7254ee754c1 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a427a310>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:51.399438 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e9d16a78-eba6-4032-91d5-e7254ee754c1 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9" status: 200 len: 1424 microversion: 2.1 time: 0.128961 Sep 17 21:10:51.401835 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2357/4611] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:10:51 2022] GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9 => generated 1424 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:51.682496 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c0dce511-b70f-4415-b4df-b1c4ab42dfa2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:51.683210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c0dce511-b70f-4415-b4df-b1c4ab42dfa2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:51.706630 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0dce511-b70f-4415-b4df-b1c4ab42dfa2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:51.708163 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0dce511-b70f-4415-b4df-b1c4ab42dfa2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:51.712911 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0dce511-b70f-4415-b4df-b1c4ab42dfa2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:51.715449 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0dce511-b70f-4415-b4df-b1c4ab42dfa2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:51.719354 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0dce511-b70f-4415-b4df-b1c4ab42dfa2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:51.721541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0dce511-b70f-4415-b4df-b1c4ab42dfa2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:51.730574 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3c487328-fb29-438e-ac7c-d5bf7225c3ea tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:51.731669 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3c487328-fb29-438e-ac7c-d5bf7225c3ea tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 640f82db-299b-42a4-a6b6-0a286b8220c9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:51.767313 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c487328-fb29-438e-ac7c-d5bf7225c3ea tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:51.770045 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c487328-fb29-438e-ac7c-d5bf7225c3ea tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:51.775325 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c487328-fb29-438e-ac7c-d5bf7225c3ea tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:51.775936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c487328-fb29-438e-ac7c-d5bf7225c3ea tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:51.776424 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c487328-fb29-438e-ac7c-d5bf7225c3ea tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:51.787720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c487328-fb29-438e-ac7c-d5bf7225c3ea tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:52.114692 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c0dce511-b70f-4415-b4df-b1c4ab42dfa2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:52.137396 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c0dce511-b70f-4415-b4df-b1c4ab42dfa2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:52.143784 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c0dce511-b70f-4415-b4df-b1c4ab42dfa2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:52.150874 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c0dce511-b70f-4415-b4df-b1c4ab42dfa2 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1409 microversion: 2.54 time: 0.471411 Sep 17 21:10:52.189798 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2255/4612] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:10:51 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1409 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:10:52.311621 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3c487328-fb29-438e-ac7c-d5bf7225c3ea tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:52.320148 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3c487328-fb29-438e-ac7c-d5bf7225c3ea tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9" status: 200 len: 1309 microversion: 2.1 time: 0.594246 Sep 17 21:10:52.320754 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2358/4613] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:51 2022] GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9 => generated 1309 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:52.418118 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a739ceef-7802-41b6-b863-15823c9e89bb tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a4ca6b80>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:52.497720 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a739ceef-7802-41b6-b863-15823c9e89bb tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9" status: 200 len: 1424 microversion: 2.1 time: 0.084235 Sep 17 21:10:52.498407 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2256/4614] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:10:52 2022] GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9 => generated 1424 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:53.189088 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2d4d66f4-f44b-4a8d-a0a7-d6021a4bf261 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:53.190072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2d4d66f4-f44b-4a8d-a0a7-d6021a4bf261 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:53.197676 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=24 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:53.210508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2d4d66f4-f44b-4a8d-a0a7-d6021a4bf261 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:53.215343 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2d4d66f4-f44b-4a8d-a0a7-d6021a4bf261 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:53.216177 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2d4d66f4-f44b-4a8d-a0a7-d6021a4bf261 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:53.218970 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2d4d66f4-f44b-4a8d-a0a7-d6021a4bf261 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:53.220037 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2d4d66f4-f44b-4a8d-a0a7-d6021a4bf261 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:53.220779 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2d4d66f4-f44b-4a8d-a0a7-d6021a4bf261 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:53.347412 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4b8f2b31-a670-42ab-9960-aac81f33f44e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:53.348434 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4b8f2b31-a670-42ab-9960-aac81f33f44e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 640f82db-299b-42a4-a6b6-0a286b8220c9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:53.380863 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b8f2b31-a670-42ab-9960-aac81f33f44e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:53.382788 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b8f2b31-a670-42ab-9960-aac81f33f44e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:53.385080 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b8f2b31-a670-42ab-9960-aac81f33f44e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:53.389478 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b8f2b31-a670-42ab-9960-aac81f33f44e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:53.390579 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b8f2b31-a670-42ab-9960-aac81f33f44e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:53.392488 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b8f2b31-a670-42ab-9960-aac81f33f44e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:53.427262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2d4d66f4-f44b-4a8d-a0a7-d6021a4bf261 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:53.446371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2d4d66f4-f44b-4a8d-a0a7-d6021a4bf261 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:53.456853 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2d4d66f4-f44b-4a8d-a0a7-d6021a4bf261 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:53.458308 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2d4d66f4-f44b-4a8d-a0a7-d6021a4bf261 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1409 microversion: 2.54 time: 0.273736 Sep 17 21:10:53.462751 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2359/4615] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:10:53 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1409 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:10:53.514231 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e32ee524-66ef-4f80-982e-2967f86b3ac0 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f259fee6af0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:53.736928 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e32ee524-66ef-4f80-982e-2967f86b3ac0 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9" status: 200 len: 1424 microversion: 2.1 time: 0.226792 Sep 17 21:10:53.759846 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2360/4616] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:10:53 2022] GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9 => generated 1424 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:10:53.908945 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4b8f2b31-a670-42ab-9960-aac81f33f44e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:53.919656 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4b8f2b31-a670-42ab-9960-aac81f33f44e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9" status: 200 len: 1309 microversion: 2.1 time: 0.580579 Sep 17 21:10:53.940008 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2257/4617] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:53 2022] GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9 => generated 1309 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:54.119900 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-a51f2058-76ea-4958-9678-c0ce7daa84d1 req-edfb2b99-36d3-4fb8-9789-0d990336730f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "640f82db-299b-42a4-a6b6-0a286b8220c9", "name": "network-vif-plugged", "status": "completed", "tag": "111dfd5b-5e71-4bad-94d3-ca63cddba527"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:54.135818 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a51f2058-76ea-4958-9678-c0ce7daa84d1 req-edfb2b99-36d3-4fb8-9789-0d990336730f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:54.138042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a51f2058-76ea-4958-9678-c0ce7daa84d1 req-edfb2b99-36d3-4fb8-9789-0d990336730f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:54.138042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a51f2058-76ea-4958-9678-c0ce7daa84d1 req-edfb2b99-36d3-4fb8-9789-0d990336730f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:54.223792 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-a51f2058-76ea-4958-9678-c0ce7daa84d1 req-edfb2b99-36d3-4fb8-9789-0d990336730f service nova] Creating event network-vif-plugged:111dfd5b-5e71-4bad-94d3-ca63cddba527 for instance 640f82db-299b-42a4-a6b6-0a286b8220c9 on nch1-master-1 Sep 17 21:10:54.238013 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-a51f2058-76ea-4958-9678-c0ce7daa84d1 req-edfb2b99-36d3-4fb8-9789-0d990336730f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123186 Sep 17 21:10:54.239123 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2361/4618] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:10:54.497434 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f407ebf8-ccad-4f4a-948d-4b25b2a3cc01 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:54.498788 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f407ebf8-ccad-4f4a-948d-4b25b2a3cc01 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:54.511719 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f407ebf8-ccad-4f4a-948d-4b25b2a3cc01 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:54.516579 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f407ebf8-ccad-4f4a-948d-4b25b2a3cc01 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:54.518474 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f407ebf8-ccad-4f4a-948d-4b25b2a3cc01 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:54.522504 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f407ebf8-ccad-4f4a-948d-4b25b2a3cc01 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:54.523081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f407ebf8-ccad-4f4a-948d-4b25b2a3cc01 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:54.523586 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f407ebf8-ccad-4f4a-948d-4b25b2a3cc01 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:54.558855 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:54.627543 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f407ebf8-ccad-4f4a-948d-4b25b2a3cc01 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:54.641935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f407ebf8-ccad-4f4a-948d-4b25b2a3cc01 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:54.646138 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f407ebf8-ccad-4f4a-948d-4b25b2a3cc01 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:54.649744 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f407ebf8-ccad-4f4a-948d-4b25b2a3cc01 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1409 microversion: 2.54 time: 0.161390 Sep 17 21:10:54.655347 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2258/4619] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:10:54 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1409 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:10:54.764203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c3998693-34e6-4fe5-80a6-dd3cf777e768 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a40993a0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:54.835534 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c3998693-34e6-4fe5-80a6-dd3cf777e768 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9" status: 200 len: 1424 microversion: 2.1 time: 0.075614 Sep 17 21:10:54.841921 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2362/4620] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:10:54 2022] GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9 => generated 1424 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:54.950495 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c7c2c143-82f0-46df-9c8d-e0f46a7927e2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:54.952178 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c7c2c143-82f0-46df-9c8d-e0f46a7927e2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 640f82db-299b-42a4-a6b6-0a286b8220c9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:54.965498 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c7c2c143-82f0-46df-9c8d-e0f46a7927e2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:54.966812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c7c2c143-82f0-46df-9c8d-e0f46a7927e2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:54.968106 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c7c2c143-82f0-46df-9c8d-e0f46a7927e2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:54.970585 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c7c2c143-82f0-46df-9c8d-e0f46a7927e2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:54.971331 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c7c2c143-82f0-46df-9c8d-e0f46a7927e2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:54.973359 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c7c2c143-82f0-46df-9c8d-e0f46a7927e2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:55.275858 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c7c2c143-82f0-46df-9c8d-e0f46a7927e2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:55.285015 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c7c2c143-82f0-46df-9c8d-e0f46a7927e2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9" status: 200 len: 1309 microversion: 2.1 time: 0.338600 Sep 17 21:10:55.292519 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2259/4621] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:54 2022] GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9 => generated 1309 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:55.677446 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0dfef7ab-eca0-4707-ac49-9af8bfb59354 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:55.679222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0dfef7ab-eca0-4707-ac49-9af8bfb59354 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:55.692208 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0dfef7ab-eca0-4707-ac49-9af8bfb59354 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:55.694097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0dfef7ab-eca0-4707-ac49-9af8bfb59354 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:55.694734 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0dfef7ab-eca0-4707-ac49-9af8bfb59354 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:55.698767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0dfef7ab-eca0-4707-ac49-9af8bfb59354 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:55.700259 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0dfef7ab-eca0-4707-ac49-9af8bfb59354 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:55.700977 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0dfef7ab-eca0-4707-ac49-9af8bfb59354 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:55.863303 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-de77cbcc-3328-48fb-b464-d48f7467c993 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a4f6baf0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:55.929059 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-de77cbcc-3328-48fb-b464-d48f7467c993 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9" status: 200 len: 1424 microversion: 2.1 time: 0.078726 Sep 17 21:10:55.937167 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2260/4622] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:10:55 2022] GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9 => generated 1424 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:55.942406 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0dfef7ab-eca0-4707-ac49-9af8bfb59354 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:55.955405 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0dfef7ab-eca0-4707-ac49-9af8bfb59354 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:55.957950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0dfef7ab-eca0-4707-ac49-9af8bfb59354 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:55.960467 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0dfef7ab-eca0-4707-ac49-9af8bfb59354 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1409 microversion: 2.54 time: 0.288025 Sep 17 21:10:55.961277 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2363/4623] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:10:55 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1409 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:10:56.312121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e9c39b66-0875-499d-b811-e0a78842157b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:56.313179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e9c39b66-0875-499d-b811-e0a78842157b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 640f82db-299b-42a4-a6b6-0a286b8220c9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:56.325970 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9c39b66-0875-499d-b811-e0a78842157b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:56.330632 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9c39b66-0875-499d-b811-e0a78842157b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:56.331060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9c39b66-0875-499d-b811-e0a78842157b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:56.331836 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9c39b66-0875-499d-b811-e0a78842157b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:56.332340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9c39b66-0875-499d-b811-e0a78842157b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:56.332727 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9c39b66-0875-499d-b811-e0a78842157b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:56.944290 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4aca7790-581d-489d-a262-71903c9b0230 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a405e9d0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:57.024081 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4aca7790-581d-489d-a262-71903c9b0230 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9" status: 200 len: 1424 microversion: 2.1 time: 0.083651 Sep 17 21:10:57.024693 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2364/4624] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:10:56 2022] GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9 => generated 1424 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:10:57.036264 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-53d490d8-7afb-449e-b23f-c7b47bf66c66 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:57.036899 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-53d490d8-7afb-449e-b23f-c7b47bf66c66 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:57.055893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53d490d8-7afb-449e-b23f-c7b47bf66c66 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:57.056696 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53d490d8-7afb-449e-b23f-c7b47bf66c66 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:57.057306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53d490d8-7afb-449e-b23f-c7b47bf66c66 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:57.058330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53d490d8-7afb-449e-b23f-c7b47bf66c66 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:57.058965 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53d490d8-7afb-449e-b23f-c7b47bf66c66 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:57.059576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53d490d8-7afb-449e-b23f-c7b47bf66c66 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:57.063230 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:57.534654 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e9c39b66-0875-499d-b811-e0a78842157b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:57.543443 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e9c39b66-0875-499d-b811-e0a78842157b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9" status: 200 len: 1490 microversion: 2.1 time: 1.235633 Sep 17 21:10:57.544052 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-53d490d8-7afb-449e-b23f-c7b47bf66c66 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:57.557867 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2261/4625] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:56 2022] GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9 => generated 1490 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:57.567602 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-53d490d8-7afb-449e-b23f-c7b47bf66c66 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:57.572685 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-53d490d8-7afb-449e-b23f-c7b47bf66c66 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:57.577572 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-53d490d8-7afb-449e-b23f-c7b47bf66c66 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1409 microversion: 2.54 time: 0.551796 Sep 17 21:10:57.579975 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2365/4626] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:10:57 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1409 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:10:57.763239 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-da30b8f6-a3a9-4412-a751-d76dd90b5c82 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1731795571", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "ff632525-8d7d-4854-beaf-dc49c77bdd36"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:57.856023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-da30b8f6-a3a9-4412-a751-d76dd90b5c82 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] validate_networks() for [('ff632525-8d7d-4854-beaf-dc49c77bdd36', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:10:58.006286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0233b800-b6c0-4c94-87eb-7dc939f790ea tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1464303125", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:10:58.091968 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-0233b800-b6c0-4c94-87eb-7dc939f790ea tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] validate_networks() for None {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:10:58.859034 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-0233b800-b6c0-4c94-87eb-7dc939f790ea tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:10:58.860241 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-0233b800-b6c0-4c94-87eb-7dc939f790ea tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:10:58.860746 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-0233b800-b6c0-4c94-87eb-7dc939f790ea tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:10:58.861170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-0233b800-b6c0-4c94-87eb-7dc939f790ea tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:10:58.865165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-0233b800-b6c0-4c94-87eb-7dc939f790ea tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:10:58.891788 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0233b800-b6c0-4c94-87eb-7dc939f790ea tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:58.892664 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0233b800-b6c0-4c94-87eb-7dc939f790ea tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:58.893923 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0233b800-b6c0-4c94-87eb-7dc939f790ea tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:58.894753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0233b800-b6c0-4c94-87eb-7dc939f790ea tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:58.895224 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0233b800-b6c0-4c94-87eb-7dc939f790ea tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:58.895664 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0233b800-b6c0-4c94-87eb-7dc939f790ea tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:58.946377 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-0233b800-b6c0-4c94-87eb-7dc939f790ea tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Getting quotas for project 9818fed65901412b8da672532cc5bc52. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:10:58.963767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-0233b800-b6c0-4c94-87eb-7dc939f790ea tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Getting quotas for user 7e12ad7a93ae4a9a95b2a54c1a2b9845 and project 9818fed65901412b8da672532cc5bc52. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:10:58.992531 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0233b800-b6c0-4c94-87eb-7dc939f790ea tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:10:58.998156 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0233b800-b6c0-4c94-87eb-7dc939f790ea tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] [instance: 14f66e5d-ada6-41ab-b6d1-32343c852f5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:10:59.105259 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0233b800-b6c0-4c94-87eb-7dc939f790ea tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.103500 Sep 17 21:10:59.110185 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2366/4627] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:10:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 17 21:10:59.127230 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-247c3965-bf0f-4aa6-98e1-a130ebf5bbfb tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a4014820>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:59.214844 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-247c3965-bf0f-4aa6-98e1-a130ebf5bbfb tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9" status: 200 len: 1424 microversion: 2.1 time: 0.103151 Sep 17 21:10:59.223779 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2367/4628] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:10:59 2022] GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9 => generated 1424 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:59.246505 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ba95bd61-a354-4051-afdb-411c18e79b8e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:59.247712 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ba95bd61-a354-4051-afdb-411c18e79b8e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:59.267223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:10:59.275858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ba95bd61-a354-4051-afdb-411c18e79b8e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:59.277847 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ba95bd61-a354-4051-afdb-411c18e79b8e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:59.279080 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ba95bd61-a354-4051-afdb-411c18e79b8e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:59.285780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ba95bd61-a354-4051-afdb-411c18e79b8e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:59.286869 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ba95bd61-a354-4051-afdb-411c18e79b8e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:59.288412 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ba95bd61-a354-4051-afdb-411c18e79b8e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:59.460369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ba95bd61-a354-4051-afdb-411c18e79b8e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:59.470822 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ba95bd61-a354-4051-afdb-411c18e79b8e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:59.472315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ba95bd61-a354-4051-afdb-411c18e79b8e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:59.473543 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ba95bd61-a354-4051-afdb-411c18e79b8e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1409 microversion: 2.54 time: 0.248432 Sep 17 21:10:59.481138 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2368/4629] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:10:59 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1409 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:10:59.488355 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0d8af8d0-fa9b-4efc-8648-cf297ed17aeb tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:59.493511 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0d8af8d0-fa9b-4efc-8648-cf297ed17aeb tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] [instance: 14f66e5d-ada6-41ab-b6d1-32343c852f5e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:10:59.544377 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-da30b8f6-a3a9-4412-a751-d76dd90b5c82 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:10:59.545388 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-da30b8f6-a3a9-4412-a751-d76dd90b5c82 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:10:59.546066 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-da30b8f6-a3a9-4412-a751-d76dd90b5c82 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:10:59.546873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-da30b8f6-a3a9-4412-a751-d76dd90b5c82 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:10:59.547580 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-da30b8f6-a3a9-4412-a751-d76dd90b5c82 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:10:59.567332 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da30b8f6-a3a9-4412-a751-d76dd90b5c82 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:59.568115 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da30b8f6-a3a9-4412-a751-d76dd90b5c82 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:59.568748 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da30b8f6-a3a9-4412-a751-d76dd90b5c82 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:59.569693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da30b8f6-a3a9-4412-a751-d76dd90b5c82 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:10:59.571743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da30b8f6-a3a9-4412-a751-d76dd90b5c82 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:10:59.572534 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da30b8f6-a3a9-4412-a751-d76dd90b5c82 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:10:59.605480 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-da30b8f6-a3a9-4412-a751-d76dd90b5c82 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Getting quotas for project 0b6f25c3540546bf9bffd5610f4f86c8. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:10:59.611886 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-da30b8f6-a3a9-4412-a751-d76dd90b5c82 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Getting quotas for user 784233ee78764e7dbb774d3cb50165e3 and project 0b6f25c3540546bf9bffd5610f4f86c8. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:10:59.627229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0d8af8d0-fa9b-4efc-8648-cf297ed17aeb tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e12ad7a93ae4a9a95b2a54c1a2b9845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9818fed65901412b8da672532cc5bc52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:10:59.640644 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0d8af8d0-fa9b-4efc-8648-cf297ed17aeb tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] 10.222.0.26 "GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e" status: 200 len: 1215 microversion: 2.1 time: 0.155858 Sep 17 21:10:59.641264 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2369/4630] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:59 2022] GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e => generated 1215 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:10:59.658466 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-da30b8f6-a3a9-4412-a751-d76dd90b5c82 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:10:59.683779 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-da30b8f6-a3a9-4412-a751-d76dd90b5c82 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: f09b5c28-821c-4b0e-be61-2f1acfeb47d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:10:59.819936 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-da30b8f6-a3a9-4412-a751-d76dd90b5c82 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.060757 Sep 17 21:10:59.827865 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2262/4631] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:10:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:10:59.833606 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f339edd2-1949-4248-8894-464ac0c40d91 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:10:59.835515 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f339edd2-1949-4248-8894-464ac0c40d91 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: f09b5c28-821c-4b0e-be61-2f1acfeb47d1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:00.017222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f339edd2-1949-4248-8894-464ac0c40d91 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:00.028891 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f339edd2-1949-4248-8894-464ac0c40d91 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1" status: 200 len: 1209 microversion: 2.1 time: 0.200610 Sep 17 21:11:00.046160 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2370/4632] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:10:59 2022] GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1 => generated 1209 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:11:00.240755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-07d19593-bc7b-44f1-870e-9e25191989bb tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a48b6820>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:00.335292 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-07d19593-bc7b-44f1-870e-9e25191989bb tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9" status: 200 len: 1424 microversion: 2.1 time: 0.100745 Sep 17 21:11:00.338294 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2263/4633] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:00 2022] GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9 => generated 1424 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:00.510387 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2e68bf8b-dd32-4581-8a0e-d486cc80cc23 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:00.511764 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2e68bf8b-dd32-4581-8a0e-d486cc80cc23 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:00.534910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e68bf8b-dd32-4581-8a0e-d486cc80cc23 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:00.537260 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e68bf8b-dd32-4581-8a0e-d486cc80cc23 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:00.541514 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e68bf8b-dd32-4581-8a0e-d486cc80cc23 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:00.542410 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e68bf8b-dd32-4581-8a0e-d486cc80cc23 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:00.547596 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e68bf8b-dd32-4581-8a0e-d486cc80cc23 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:00.553755 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e68bf8b-dd32-4581-8a0e-d486cc80cc23 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:00.672255 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dd6a42fd-b8ec-4b13-97dc-c34c95228f3d tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:00.674157 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dd6a42fd-b8ec-4b13-97dc-c34c95228f3d tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] [instance: 14f66e5d-ada6-41ab-b6d1-32343c852f5e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:00.690340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd6a42fd-b8ec-4b13-97dc-c34c95228f3d tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:00.691209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd6a42fd-b8ec-4b13-97dc-c34c95228f3d tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:00.693654 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd6a42fd-b8ec-4b13-97dc-c34c95228f3d tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:00.694670 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd6a42fd-b8ec-4b13-97dc-c34c95228f3d tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:00.696638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd6a42fd-b8ec-4b13-97dc-c34c95228f3d tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:00.697285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd6a42fd-b8ec-4b13-97dc-c34c95228f3d tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:00.768389 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2e68bf8b-dd32-4581-8a0e-d486cc80cc23 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:00.784034 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2e68bf8b-dd32-4581-8a0e-d486cc80cc23 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:00.789427 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2e68bf8b-dd32-4581-8a0e-d486cc80cc23 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:00.795710 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2e68bf8b-dd32-4581-8a0e-d486cc80cc23 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1409 microversion: 2.54 time: 0.289647 Sep 17 21:11:00.798024 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2371/4634] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:11:00 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1409 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:11:00.893981 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dd6a42fd-b8ec-4b13-97dc-c34c95228f3d tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e12ad7a93ae4a9a95b2a54c1a2b9845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9818fed65901412b8da672532cc5bc52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:00.905639 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dd6a42fd-b8ec-4b13-97dc-c34c95228f3d tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] 10.222.0.26 "GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e" status: 200 len: 1219 microversion: 2.1 time: 0.239769 Sep 17 21:11:00.906967 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2264/4635] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:00 2022] GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e => generated 1219 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:01.056119 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a05950d9-1918-4ae1-b17c-c23036b2a07b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:01.057050 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a05950d9-1918-4ae1-b17c-c23036b2a07b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: f09b5c28-821c-4b0e-be61-2f1acfeb47d1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:01.072181 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a05950d9-1918-4ae1-b17c-c23036b2a07b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:01.080031 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a05950d9-1918-4ae1-b17c-c23036b2a07b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:01.082643 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a05950d9-1918-4ae1-b17c-c23036b2a07b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:01.083715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a05950d9-1918-4ae1-b17c-c23036b2a07b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:01.089035 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a05950d9-1918-4ae1-b17c-c23036b2a07b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:01.090134 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a05950d9-1918-4ae1-b17c-c23036b2a07b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:01.259922 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a05950d9-1918-4ae1-b17c-c23036b2a07b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:01.278835 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a05950d9-1918-4ae1-b17c-c23036b2a07b tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1" status: 200 len: 1213 microversion: 2.1 time: 0.226845 Sep 17 21:11:01.280358 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2372/4636] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:01 2022] GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1 => generated 1213 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:01.354103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f89ec089-06e5-4856-999c-b39c42126452 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a48b6a60>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:01.450690 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f89ec089-06e5-4856-999c-b39c42126452 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9" status: 200 len: 1424 microversion: 2.1 time: 0.100279 Sep 17 21:11:01.459004 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2265/4637] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:01 2022] GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9 => generated 1424 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:01.829333 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-76c0ba6e-21c9-4cb0-bd29-1b9229ff84a7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:01.830261 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-76c0ba6e-21c9-4cb0-bd29-1b9229ff84a7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:01.847871 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76c0ba6e-21c9-4cb0-bd29-1b9229ff84a7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:01.849330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76c0ba6e-21c9-4cb0-bd29-1b9229ff84a7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:01.849957 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76c0ba6e-21c9-4cb0-bd29-1b9229ff84a7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:01.851647 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76c0ba6e-21c9-4cb0-bd29-1b9229ff84a7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:01.855855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76c0ba6e-21c9-4cb0-bd29-1b9229ff84a7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:01.856470 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76c0ba6e-21c9-4cb0-bd29-1b9229ff84a7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:01.939739 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-919db920-e16e-44fd-858c-03c2d4ab3970 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:01.941246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-919db920-e16e-44fd-858c-03c2d4ab3970 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] [instance: 14f66e5d-ada6-41ab-b6d1-32343c852f5e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:01.980647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-919db920-e16e-44fd-858c-03c2d4ab3970 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:01.981559 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-919db920-e16e-44fd-858c-03c2d4ab3970 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:01.982305 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-919db920-e16e-44fd-858c-03c2d4ab3970 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:01.983150 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-919db920-e16e-44fd-858c-03c2d4ab3970 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:01.983820 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-919db920-e16e-44fd-858c-03c2d4ab3970 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:01.984629 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-919db920-e16e-44fd-858c-03c2d4ab3970 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:02.111643 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-76c0ba6e-21c9-4cb0-bd29-1b9229ff84a7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:02.132048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-76c0ba6e-21c9-4cb0-bd29-1b9229ff84a7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:02.134865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-76c0ba6e-21c9-4cb0-bd29-1b9229ff84a7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:02.136423 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-76c0ba6e-21c9-4cb0-bd29-1b9229ff84a7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1409 microversion: 2.54 time: 0.315943 Sep 17 21:11:02.138182 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2373/4638] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:11:01 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1409 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:11:02.193129 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-919db920-e16e-44fd-858c-03c2d4ab3970 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e12ad7a93ae4a9a95b2a54c1a2b9845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9818fed65901412b8da672532cc5bc52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:02.201982 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-919db920-e16e-44fd-858c-03c2d4ab3970 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] 10.222.0.26 "GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e" status: 200 len: 1275 microversion: 2.1 time: 0.271080 Sep 17 21:11:02.206620 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2266/4639] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:01 2022] GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e => generated 1275 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:02.332393 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-685c1722-e988-4459-a3e4-cea6103e4790 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:02.333437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-685c1722-e988-4459-a3e4-cea6103e4790 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: f09b5c28-821c-4b0e-be61-2f1acfeb47d1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:02.370522 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-685c1722-e988-4459-a3e4-cea6103e4790 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:02.375002 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-685c1722-e988-4459-a3e4-cea6103e4790 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:02.381064 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-685c1722-e988-4459-a3e4-cea6103e4790 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:02.384520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-685c1722-e988-4459-a3e4-cea6103e4790 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:02.389108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-685c1722-e988-4459-a3e4-cea6103e4790 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:02.392605 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-685c1722-e988-4459-a3e4-cea6103e4790 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:02.475929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5f96948b-fb47-41cb-8a80-af4e7f97e369 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a4fc4550>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:02.555553 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5f96948b-fb47-41cb-8a80-af4e7f97e369 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9" status: 200 len: 1424 microversion: 2.1 time: 0.090899 Sep 17 21:11:02.568835 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2267/4640] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:02 2022] GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9 => generated 1424 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:02.677596 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-685c1722-e988-4459-a3e4-cea6103e4790 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:02.703267 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-685c1722-e988-4459-a3e4-cea6103e4790 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1" status: 200 len: 1261 microversion: 2.1 time: 0.382747 Sep 17 21:11:02.704242 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2374/4641] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:02 2022] GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1 => generated 1261 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:03.162905 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-45249928-28b0-4ac6-a9b1-f7c5068ee154 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:03.163538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-45249928-28b0-4ac6-a9b1-f7c5068ee154 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:03.188446 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45249928-28b0-4ac6-a9b1-f7c5068ee154 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:03.192782 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45249928-28b0-4ac6-a9b1-f7c5068ee154 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:03.193766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45249928-28b0-4ac6-a9b1-f7c5068ee154 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:03.194891 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45249928-28b0-4ac6-a9b1-f7c5068ee154 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:03.195533 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45249928-28b0-4ac6-a9b1-f7c5068ee154 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:03.196193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45249928-28b0-4ac6-a9b1-f7c5068ee154 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:03.230866 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-79205e34-170f-4af7-92e8-1302b9b6ca6b tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:03.231546 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-79205e34-170f-4af7-92e8-1302b9b6ca6b tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] [instance: 14f66e5d-ada6-41ab-b6d1-32343c852f5e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:03.256543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79205e34-170f-4af7-92e8-1302b9b6ca6b tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:03.259253 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79205e34-170f-4af7-92e8-1302b9b6ca6b tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:03.259892 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79205e34-170f-4af7-92e8-1302b9b6ca6b tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:03.261705 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79205e34-170f-4af7-92e8-1302b9b6ca6b tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:03.263369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79205e34-170f-4af7-92e8-1302b9b6ca6b tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:03.265824 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79205e34-170f-4af7-92e8-1302b9b6ca6b tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:03.448593 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-45249928-28b0-4ac6-a9b1-f7c5068ee154 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:03.466634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-45249928-28b0-4ac6-a9b1-f7c5068ee154 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:03.475454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-45249928-28b0-4ac6-a9b1-f7c5068ee154 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:03.477027 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-45249928-28b0-4ac6-a9b1-f7c5068ee154 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1409 microversion: 2.54 time: 0.318501 Sep 17 21:11:03.477798 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2268/4642] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:11:03 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1409 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:11:03.555484 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-79205e34-170f-4af7-92e8-1302b9b6ca6b tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e12ad7a93ae4a9a95b2a54c1a2b9845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9818fed65901412b8da672532cc5bc52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:03.575328 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-79205e34-170f-4af7-92e8-1302b9b6ca6b tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] 10.222.0.26 "GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e" status: 200 len: 1273 microversion: 2.1 time: 0.349430 Sep 17 21:11:03.575925 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2375/4643] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:03 2022] GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e => generated 1273 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:03.585005 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a7e32808-f62c-42b6-8280-4a93d690976f tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a4727af0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:03.672853 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a7e32808-f62c-42b6-8280-4a93d690976f tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9" status: 200 len: 1424 microversion: 2.1 time: 0.092320 Sep 17 21:11:03.674595 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2269/4644] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:03 2022] GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9 => generated 1424 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:03.730388 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f5e29cad-6e7c-4ace-ad0b-8579601f54e2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:03.730713 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f5e29cad-6e7c-4ace-ad0b-8579601f54e2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: f09b5c28-821c-4b0e-be61-2f1acfeb47d1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:03.742246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f5e29cad-6e7c-4ace-ad0b-8579601f54e2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:03.744012 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f5e29cad-6e7c-4ace-ad0b-8579601f54e2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:03.744676 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f5e29cad-6e7c-4ace-ad0b-8579601f54e2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:03.746344 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f5e29cad-6e7c-4ace-ad0b-8579601f54e2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:03.747063 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f5e29cad-6e7c-4ace-ad0b-8579601f54e2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:03.748059 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f5e29cad-6e7c-4ace-ad0b-8579601f54e2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:04.136054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f5e29cad-6e7c-4ace-ad0b-8579601f54e2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:04.148651 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f5e29cad-6e7c-4ace-ad0b-8579601f54e2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1" status: 200 len: 1309 microversion: 2.1 time: 0.425210 Sep 17 21:11:04.151669 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2376/4645] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:03 2022] GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1 => generated 1309 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:04.514588 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-73786a3c-eeed-473a-8007-1cb5d1c0edbf tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:04.515232 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-73786a3c-eeed-473a-8007-1cb5d1c0edbf tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:04.529791 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73786a3c-eeed-473a-8007-1cb5d1c0edbf tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:04.530303 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73786a3c-eeed-473a-8007-1cb5d1c0edbf tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:04.530853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73786a3c-eeed-473a-8007-1cb5d1c0edbf tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:04.531913 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73786a3c-eeed-473a-8007-1cb5d1c0edbf tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:04.532832 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73786a3c-eeed-473a-8007-1cb5d1c0edbf tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:04.533766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73786a3c-eeed-473a-8007-1cb5d1c0edbf tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:04.604882 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-71804d02-57e9-4016-98ea-883e9a858975 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:04.605638 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-71804d02-57e9-4016-98ea-883e9a858975 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] [instance: 14f66e5d-ada6-41ab-b6d1-32343c852f5e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:04.615243 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71804d02-57e9-4016-98ea-883e9a858975 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:04.615747 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71804d02-57e9-4016-98ea-883e9a858975 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:04.616234 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71804d02-57e9-4016-98ea-883e9a858975 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:04.616937 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71804d02-57e9-4016-98ea-883e9a858975 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:04.617659 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71804d02-57e9-4016-98ea-883e9a858975 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:04.618284 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71804d02-57e9-4016-98ea-883e9a858975 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:04.658721 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-73786a3c-eeed-473a-8007-1cb5d1c0edbf tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:04.673507 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-73786a3c-eeed-473a-8007-1cb5d1c0edbf tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:04.676460 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-73786a3c-eeed-473a-8007-1cb5d1c0edbf tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:04.679642 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-73786a3c-eeed-473a-8007-1cb5d1c0edbf tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1409 microversion: 2.54 time: 0.178919 Sep 17 21:11:04.680865 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2270/4646] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:11:04 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1409 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:11:04.706417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6c393129-b08b-412d-b9f4-f495e9d10fe8 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a5a0c820>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:04.790025 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6c393129-b08b-412d-b9f4-f495e9d10fe8 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9" status: 200 len: 1433 microversion: 2.1 time: 0.094885 Sep 17 21:11:04.791380 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2271/4647] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:04 2022] GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9 => generated 1433 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:04.808147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8a3d9f2a-fd96-4c63-953b-7cef9baf0eac tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a4f1ddc0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:04.891137 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8a3d9f2a-fd96-4c63-953b-7cef9baf0eac tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9" status: 200 len: 1433 microversion: 2.1 time: 0.087990 Sep 17 21:11:04.891902 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2272/4648] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:04 2022] GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9 => generated 1433 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:11:04.906457 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1b29a571-5d31-47db-a2f1-0009d6627d5b tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:04.907386 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1b29a571-5d31-47db-a2f1-0009d6627d5b tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] [instance: 1bb77042-152e-4948-95ab-8849c8d72c80] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:04.918121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:11:04.923823 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b29a571-5d31-47db-a2f1-0009d6627d5b tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:04.924607 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b29a571-5d31-47db-a2f1-0009d6627d5b tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:04.926310 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b29a571-5d31-47db-a2f1-0009d6627d5b tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:04.927315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b29a571-5d31-47db-a2f1-0009d6627d5b tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:04.929190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b29a571-5d31-47db-a2f1-0009d6627d5b tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:04.931645 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b29a571-5d31-47db-a2f1-0009d6627d5b tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:05.612121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-71804d02-57e9-4016-98ea-883e9a858975 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e12ad7a93ae4a9a95b2a54c1a2b9845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9818fed65901412b8da672532cc5bc52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:05.630081 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-71804d02-57e9-4016-98ea-883e9a858975 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] 10.222.0.26 "GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e" status: 200 len: 1315 microversion: 2.1 time: 1.029567 Sep 17 21:11:05.630382 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2377/4649] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:04 2022] GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e => generated 1315 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:05.651506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c1eefbc4-b59e-4133-94e8-262cae119103 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:05.652555 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c1eefbc4-b59e-4133-94e8-262cae119103 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: f09b5c28-821c-4b0e-be61-2f1acfeb47d1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:05.660093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1eefbc4-b59e-4133-94e8-262cae119103 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:05.662802 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1eefbc4-b59e-4133-94e8-262cae119103 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:05.663504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1eefbc4-b59e-4133-94e8-262cae119103 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:05.664417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1eefbc4-b59e-4133-94e8-262cae119103 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:05.665040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1eefbc4-b59e-4133-94e8-262cae119103 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:05.667135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1eefbc4-b59e-4133-94e8-262cae119103 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:05.704781 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1b29a571-5d31-47db-a2f1-0009d6627d5b tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbd80f0e5bf46b78a79fd821e9ff89e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ceec62fde59414ebb34572d8f8fbcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:05.721756 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1b29a571-5d31-47db-a2f1-0009d6627d5b tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80" status: 200 len: 1466 microversion: 2.1 time: 0.818538 Sep 17 21:11:05.724793 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2273/4650] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:04 2022] GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80 => generated 1466 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:11:05.742114 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5651a508-4905-46e6-affa-4f7b2ef50933 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:05.744356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5651a508-4905-46e6-affa-4f7b2ef50933 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:05.762120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5651a508-4905-46e6-affa-4f7b2ef50933 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:05.763060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5651a508-4905-46e6-affa-4f7b2ef50933 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:05.763701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5651a508-4905-46e6-affa-4f7b2ef50933 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:05.764900 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5651a508-4905-46e6-affa-4f7b2ef50933 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:05.765578 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5651a508-4905-46e6-affa-4f7b2ef50933 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:05.766187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5651a508-4905-46e6-affa-4f7b2ef50933 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:05.953021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5651a508-4905-46e6-affa-4f7b2ef50933 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:05.962826 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5651a508-4905-46e6-affa-4f7b2ef50933 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:05.964367 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5651a508-4905-46e6-affa-4f7b2ef50933 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:05.973085 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5651a508-4905-46e6-affa-4f7b2ef50933 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1409 microversion: 2.54 time: 0.245164 Sep 17 21:11:05.974418 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2274/4651] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:11:05 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1409 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:11:05.982270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-54b8406d-f272-487d-bd38-51d1c620c7f9 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a49f3a60>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:06.051937 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-54b8406d-f272-487d-bd38-51d1c620c7f9 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4" status: 200 len: 784 microversion: 2.1 time: 0.075726 Sep 17 21:11:06.052514 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2275/4652] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:05 2022] GET /compute/v2.1/images/1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4 => generated 784 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:11:06.067288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-82a27ba3-0be6-432d-bd35-ef05229d2cfb tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:06.076269 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-82a27ba3-0be6-432d-bd35-ef05229d2cfb tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012842 Sep 17 21:11:06.084847 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2276/4653] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Sep 17 21:11:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:11:06.090371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6402de78-1a45-4b28-bf9b-05118e661c61 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a4ed01f0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:06.254648 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c1eefbc4-b59e-4133-94e8-262cae119103 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:06.267414 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c1eefbc4-b59e-4133-94e8-262cae119103 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1" status: 200 len: 1309 microversion: 2.1 time: 0.619836 Sep 17 21:11:06.268032 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2378/4654] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:05 2022] GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1 => generated 1309 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:06.648333 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-65e7cae1-dfd2-43b2-bbb2-b005e48ef770 req-a9605067-71f7-4ef6-bce6-1b89212e83f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f09b5c28-821c-4b0e-be61-2f1acfeb47d1", "tag": "cb7b746e-1be8-47ec-af5e-1175a22b0d23"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:06.676670 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-65e7cae1-dfd2-43b2-bbb2-b005e48ef770 req-a9605067-71f7-4ef6-bce6-1b89212e83f5 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:06.677511 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-65e7cae1-dfd2-43b2-bbb2-b005e48ef770 req-a9605067-71f7-4ef6-bce6-1b89212e83f5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:06.678056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-65e7cae1-dfd2-43b2-bbb2-b005e48ef770 req-a9605067-71f7-4ef6-bce6-1b89212e83f5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:06.693028 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-65e7cae1-dfd2-43b2-bbb2-b005e48ef770 req-a9605067-71f7-4ef6-bce6-1b89212e83f5 service nova] Creating event network-changed:cb7b746e-1be8-47ec-af5e-1175a22b0d23 for instance f09b5c28-821c-4b0e-be61-2f1acfeb47d1 on nch2-master-1 Sep 17 21:11:06.703684 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-65e7cae1-dfd2-43b2-bbb2-b005e48ef770 req-a9605067-71f7-4ef6-bce6-1b89212e83f5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.433283 Sep 17 21:11:06.705523 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2379/4655] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:11:06.712260 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5e329cec-9687-4cb9-8815-611bd15f970f tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:06.713628 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5e329cec-9687-4cb9-8815-611bd15f970f tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] [instance: 14f66e5d-ada6-41ab-b6d1-32343c852f5e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:06.722823 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e329cec-9687-4cb9-8815-611bd15f970f tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:06.724230 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e329cec-9687-4cb9-8815-611bd15f970f tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:06.724925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e329cec-9687-4cb9-8815-611bd15f970f tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:06.726074 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e329cec-9687-4cb9-8815-611bd15f970f tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:06.726699 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e329cec-9687-4cb9-8815-611bd15f970f tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:06.727814 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e329cec-9687-4cb9-8815-611bd15f970f tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:06.955136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5e329cec-9687-4cb9-8815-611bd15f970f tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e12ad7a93ae4a9a95b2a54c1a2b9845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9818fed65901412b8da672532cc5bc52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:06.975764 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5e329cec-9687-4cb9-8815-611bd15f970f tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] 10.222.0.26 "GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e" status: 200 len: 1315 microversion: 2.1 time: 0.268194 Sep 17 21:11:06.977805 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2380/4656] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:06 2022] GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:07.004123 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f18ae5fb-8bfa-4122-9068-96cce1f0081e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:07.004827 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f18ae5fb-8bfa-4122-9068-96cce1f0081e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:07.015714 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f18ae5fb-8bfa-4122-9068-96cce1f0081e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:07.016513 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f18ae5fb-8bfa-4122-9068-96cce1f0081e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:07.017145 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f18ae5fb-8bfa-4122-9068-96cce1f0081e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:07.018212 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f18ae5fb-8bfa-4122-9068-96cce1f0081e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:07.018832 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f18ae5fb-8bfa-4122-9068-96cce1f0081e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:07.019420 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f18ae5fb-8bfa-4122-9068-96cce1f0081e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:07.206267 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f18ae5fb-8bfa-4122-9068-96cce1f0081e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:07.220039 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f18ae5fb-8bfa-4122-9068-96cce1f0081e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:07.225376 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f18ae5fb-8bfa-4122-9068-96cce1f0081e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:07.226795 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f18ae5fb-8bfa-4122-9068-96cce1f0081e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1409 microversion: 2.54 time: 0.229044 Sep 17 21:11:07.229712 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2381/4657] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:11:06 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1409 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:11:07.296668 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a8521467-0e11-46c1-8e6d-c311d3a643f2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:07.297319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a8521467-0e11-46c1-8e6d-c311d3a643f2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: f09b5c28-821c-4b0e-be61-2f1acfeb47d1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:07.318751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8521467-0e11-46c1-8e6d-c311d3a643f2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:07.320529 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8521467-0e11-46c1-8e6d-c311d3a643f2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:07.321646 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8521467-0e11-46c1-8e6d-c311d3a643f2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:07.323479 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8521467-0e11-46c1-8e6d-c311d3a643f2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:07.324516 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8521467-0e11-46c1-8e6d-c311d3a643f2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:07.326191 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8521467-0e11-46c1-8e6d-c311d3a643f2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:07.405948 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6402de78-1a45-4b28-bf9b-05118e661c61 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "DELETE /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9" status: 204 len: 0 microversion: 2.1 time: 1.319568 Sep 17 21:11:07.406628 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2277/4658] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:06 2022] DELETE /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9 => generated 0 bytes in 1321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:11:07.413693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-597cbca4-459b-415d-8e3d-62249c705342 req-87cbfb83-e04c-42dd-b61a-fc3368d2fd50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14f66e5d-ada6-41ab-b6d1-32343c852f5e", "tag": "5a1f92ec-050d-42de-96a1-54de3f8fa611"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:07.442705 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-597cbca4-459b-415d-8e3d-62249c705342 req-87cbfb83-e04c-42dd-b61a-fc3368d2fd50 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:07.443451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-597cbca4-459b-415d-8e3d-62249c705342 req-87cbfb83-e04c-42dd-b61a-fc3368d2fd50 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:07.444098 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-597cbca4-459b-415d-8e3d-62249c705342 req-87cbfb83-e04c-42dd-b61a-fc3368d2fd50 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:07.461988 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-597cbca4-459b-415d-8e3d-62249c705342 req-87cbfb83-e04c-42dd-b61a-fc3368d2fd50 service nova] Creating event network-changed:5a1f92ec-050d-42de-96a1-54de3f8fa611 for instance 14f66e5d-ada6-41ab-b6d1-32343c852f5e on nch2-master-1 Sep 17 21:11:07.472352 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-597cbca4-459b-415d-8e3d-62249c705342 req-87cbfb83-e04c-42dd-b61a-fc3368d2fd50 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063177 Sep 17 21:11:07.473953 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2278/4659] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:11:07.483198 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6f5a764e-4f30-4e2c-98a2-727b59caea68 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a4cd3310>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:07.515721 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-6f5a764e-4f30-4e2c-98a2-727b59caea68 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] HTTP exception thrown: Image not found. Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6f5a764e-4f30-4e2c-98a2-727b59caea68 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Request method failure captured: Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9 HTTP/1.1 Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJje5pW96mXlG3sEKZKUl50Vom2nWVUErSMUVGOktH9S0Qq3vB20rQivGXglvyfpapn5tQGW6zImyqgBVvz-l17thXLzN77I2eHTk9Jbfx9tNqmYamtHzMnJZWvwngrqsa2HTEASWBt5UftJEO43bkfulMtxTrl44Kx8dRlzhkRZRGJw Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 4ceec62fde59414ebb34572d8f8fbcfe Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ImagesOneServerTestJSON-1821562040 Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ceec62fde59414ebb34572d8f8fbcfe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4ceec62fde59414ebb34572d8f8fbcfe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ceec62fde59414ebb34572d8f8fbcfe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4ceec62fde59414ebb34572d8f8fbcfe", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ImagesOneServerTestJSON-1821562040 Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 4ceec62fde59414ebb34572d8f8fbcfe Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1821562040 Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ImagesOneServerTestJSON-1821562040-project Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 1fbd80f0e5bf46b78a79fd821e9ff89e Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ImagesOneServerTestJSON-1821562040-project Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: exception: Image not found. Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '45ece03b-5d76-41d1-8396-f3d38e4ca2e9'} Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 45ece03b-5d76-41d1-8396-f3d38e4ca2e9 Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 17 21:11:07.520707 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 45ece03b-5d76-41d1-8396-f3d38e4ca2e9 could not be found. Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 17 21:11:07.525230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:07.538324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6f5a764e-4f30-4e2c-98a2-727b59caea68 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Returning 404 to user: Image not found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:11:07.539654 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6f5a764e-4f30-4e2c-98a2-727b59caea68 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9" status: 404 len: 62 microversion: 2.1 time: 0.064473 Sep 17 21:11:07.541112 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2279/4660] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:07 2022] GET /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9 => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 21:11:07.558482 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e2bf46c4-85f3-4647-8ede-4dc284708ed2 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1147950472"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:07.562629 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e2bf46c4-85f3-4647-8ede-4dc284708ed2 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] [instance: 1bb77042-152e-4948-95ab-8849c8d72c80] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:07.568129 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a8521467-0e11-46c1-8e6d-c311d3a643f2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:07.579989 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2bf46c4-85f3-4647-8ede-4dc284708ed2 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:07.580621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2bf46c4-85f3-4647-8ede-4dc284708ed2 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:07.581172 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a8521467-0e11-46c1-8e6d-c311d3a643f2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1" status: 200 len: 1309 microversion: 2.1 time: 0.288814 Sep 17 21:11:07.581590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2bf46c4-85f3-4647-8ede-4dc284708ed2 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:07.582523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2bf46c4-85f3-4647-8ede-4dc284708ed2 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:07.583234 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2bf46c4-85f3-4647-8ede-4dc284708ed2 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:07.583887 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2bf46c4-85f3-4647-8ede-4dc284708ed2 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:07.590931 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2382/4661] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:07 2022] GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1 => generated 1309 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:07.831643 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e2bf46c4-85f3-4647-8ede-4dc284708ed2 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "POST /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80/action" status: 202 len: 0 microversion: 2.1 time: 0.280525 Sep 17 21:11:07.832766 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2280/4662] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:11:07 2022] POST /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 17 21:11:07.844830 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-35cd0356-f616-4f77-88a3-86fe8233d932 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a4071550>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:07.904446 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-35cd0356-f616-4f77-88a3-86fe8233d932 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418" status: 200 len: 1429 microversion: 2.1 time: 0.064091 Sep 17 21:11:07.905725 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2383/4663] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:07 2022] GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418 => generated 1429 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:08.005872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-751e56f1-8f21-4e72-bfdc-4a0edb51bb8e tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:08.007217 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-751e56f1-8f21-4e72-bfdc-4a0edb51bb8e tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] [instance: 14f66e5d-ada6-41ab-b6d1-32343c852f5e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:08.014987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-751e56f1-8f21-4e72-bfdc-4a0edb51bb8e tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:08.016024 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-751e56f1-8f21-4e72-bfdc-4a0edb51bb8e tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:08.017300 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-751e56f1-8f21-4e72-bfdc-4a0edb51bb8e tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:08.018951 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-751e56f1-8f21-4e72-bfdc-4a0edb51bb8e tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:08.019523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-751e56f1-8f21-4e72-bfdc-4a0edb51bb8e tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:08.020040 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-751e56f1-8f21-4e72-bfdc-4a0edb51bb8e tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:08.256703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fcf74f23-bd95-4274-bf85-ae30ac050dd7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:08.257795 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fcf74f23-bd95-4274-bf85-ae30ac050dd7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:08.269076 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fcf74f23-bd95-4274-bf85-ae30ac050dd7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:08.270002 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fcf74f23-bd95-4274-bf85-ae30ac050dd7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:08.270736 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fcf74f23-bd95-4274-bf85-ae30ac050dd7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:08.272035 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fcf74f23-bd95-4274-bf85-ae30ac050dd7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:08.272520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fcf74f23-bd95-4274-bf85-ae30ac050dd7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:08.273264 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fcf74f23-bd95-4274-bf85-ae30ac050dd7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:08.358284 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-751e56f1-8f21-4e72-bfdc-4a0edb51bb8e tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e12ad7a93ae4a9a95b2a54c1a2b9845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9818fed65901412b8da672532cc5bc52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:08.367662 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-751e56f1-8f21-4e72-bfdc-4a0edb51bb8e tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] 10.222.0.26 "GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e" status: 200 len: 1315 microversion: 2.1 time: 0.366708 Sep 17 21:11:08.371915 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2281/4664] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:07 2022] GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:08.438162 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fcf74f23-bd95-4274-bf85-ae30ac050dd7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:08.465371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fcf74f23-bd95-4274-bf85-ae30ac050dd7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:08.468013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fcf74f23-bd95-4274-bf85-ae30ac050dd7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:08.474547 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fcf74f23-bd95-4274-bf85-ae30ac050dd7 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1409 microversion: 2.54 time: 0.219157 Sep 17 21:11:08.475014 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2384/4665] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:11:08 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1409 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:11:08.610375 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-44ac2a23-9b52-4f8b-8650-bc62c407a966 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:08.612025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-44ac2a23-9b52-4f8b-8650-bc62c407a966 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: f09b5c28-821c-4b0e-be61-2f1acfeb47d1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:08.627321 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44ac2a23-9b52-4f8b-8650-bc62c407a966 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:08.629186 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44ac2a23-9b52-4f8b-8650-bc62c407a966 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:08.630053 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44ac2a23-9b52-4f8b-8650-bc62c407a966 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:08.632253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44ac2a23-9b52-4f8b-8650-bc62c407a966 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:08.633121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44ac2a23-9b52-4f8b-8650-bc62c407a966 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:08.634738 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-44ac2a23-9b52-4f8b-8650-bc62c407a966 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:08.920524 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8ceb928d-fa8b-4f21-88f1-8c5cbff2131a tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a5900940>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:08.928676 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:11:08.993966 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8ceb928d-fa8b-4f21-88f1-8c5cbff2131a tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418" status: 200 len: 1429 microversion: 2.1 time: 0.076897 Sep 17 21:11:09.001782 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2385/4666] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:08 2022] GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418 => generated 1429 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:09.107593 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-44ac2a23-9b52-4f8b-8650-bc62c407a966 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:09.119635 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-44ac2a23-9b52-4f8b-8650-bc62c407a966 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1" status: 200 len: 1309 microversion: 2.1 time: 0.516333 Sep 17 21:11:09.123865 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2282/4667] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:08 2022] GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1 => generated 1309 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:09.206544 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-71125db9-d030-4142-8c0d-52290117df60 req-1fc48079-d3a5-4538-96de-23d58764967a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bb77042-152e-4948-95ab-8849c8d72c80", "name": "network-vif-unplugged", "status": "completed", "tag": "5ab301f7-76d2-44ce-a32b-a5a47596282b"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:09.229137 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-71125db9-d030-4142-8c0d-52290117df60 req-1fc48079-d3a5-4538-96de-23d58764967a service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:09.229865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-71125db9-d030-4142-8c0d-52290117df60 req-1fc48079-d3a5-4538-96de-23d58764967a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:09.230327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-71125db9-d030-4142-8c0d-52290117df60 req-1fc48079-d3a5-4538-96de-23d58764967a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:09.256281 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-71125db9-d030-4142-8c0d-52290117df60 req-1fc48079-d3a5-4538-96de-23d58764967a service nova] Creating event network-vif-unplugged:5ab301f7-76d2-44ce-a32b-a5a47596282b for instance 1bb77042-152e-4948-95ab-8849c8d72c80 on nch2-master-1 Sep 17 21:11:09.270075 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-71125db9-d030-4142-8c0d-52290117df60 req-1fc48079-d3a5-4538-96de-23d58764967a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067311 Sep 17 21:11:09.278184 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2386/4668] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:11:09.397235 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2c3e6098-5f5c-4d84-a58a-f18257a1196b tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:09.398763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2c3e6098-5f5c-4d84-a58a-f18257a1196b tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] [instance: 14f66e5d-ada6-41ab-b6d1-32343c852f5e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:09.426450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2c3e6098-5f5c-4d84-a58a-f18257a1196b tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:09.427021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2c3e6098-5f5c-4d84-a58a-f18257a1196b tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:09.427499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2c3e6098-5f5c-4d84-a58a-f18257a1196b tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:09.428713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2c3e6098-5f5c-4d84-a58a-f18257a1196b tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:09.429477 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2c3e6098-5f5c-4d84-a58a-f18257a1196b tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:09.430174 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2c3e6098-5f5c-4d84-a58a-f18257a1196b tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:09.507715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-dfb7e2db-75bc-47c7-bff2-2c1b503b199a tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:09.508525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-dfb7e2db-75bc-47c7-bff2-2c1b503b199a tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:09.516824 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dfb7e2db-75bc-47c7-bff2-2c1b503b199a tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:09.517430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dfb7e2db-75bc-47c7-bff2-2c1b503b199a tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:09.517953 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dfb7e2db-75bc-47c7-bff2-2c1b503b199a tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:09.518774 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dfb7e2db-75bc-47c7-bff2-2c1b503b199a tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:09.519357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dfb7e2db-75bc-47c7-bff2-2c1b503b199a tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:09.520601 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dfb7e2db-75bc-47c7-bff2-2c1b503b199a tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:09.591658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:11:09.637584 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:11:09.718762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-dfb7e2db-75bc-47c7-bff2-2c1b503b199a tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:09.731719 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-dfb7e2db-75bc-47c7-bff2-2c1b503b199a tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:09.733619 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-dfb7e2db-75bc-47c7-bff2-2c1b503b199a tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:09.735275 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-dfb7e2db-75bc-47c7-bff2-2c1b503b199a tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1409 microversion: 2.54 time: 0.233231 Sep 17 21:11:09.746270 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2387/4669] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:11:09 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1409 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:11:09.876137 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2c3e6098-5f5c-4d84-a58a-f18257a1196b tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e12ad7a93ae4a9a95b2a54c1a2b9845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9818fed65901412b8da672532cc5bc52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:09.885083 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2c3e6098-5f5c-4d84-a58a-f18257a1196b tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] 10.222.0.26 "GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e" status: 200 len: 1315 microversion: 2.1 time: 0.493812 Sep 17 21:11:09.886202 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2283/4670] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:09 2022] GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e => generated 1315 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:10.012161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4ab66cb5-ce50-48a0-948a-ef73ea0b09c5 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f259fee6af0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:10.026092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=10 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:11:10.069681 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4ab66cb5-ce50-48a0-948a-ef73ea0b09c5 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418" status: 200 len: 1429 microversion: 2.1 time: 0.062896 Sep 17 21:11:10.070647 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2388/4671] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:10 2022] GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418 => generated 1429 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:10.146731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9a5298c2-b998-425b-8434-66a503215f61 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:10.147350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9a5298c2-b998-425b-8434-66a503215f61 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: f09b5c28-821c-4b0e-be61-2f1acfeb47d1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:10.155315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9a5298c2-b998-425b-8434-66a503215f61 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:10.155840 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9a5298c2-b998-425b-8434-66a503215f61 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:10.156461 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9a5298c2-b998-425b-8434-66a503215f61 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:10.157380 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9a5298c2-b998-425b-8434-66a503215f61 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:10.157930 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9a5298c2-b998-425b-8434-66a503215f61 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:10.158341 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9a5298c2-b998-425b-8434-66a503215f61 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:10.392948 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9a5298c2-b998-425b-8434-66a503215f61 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:10.402802 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9a5298c2-b998-425b-8434-66a503215f61 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1" status: 200 len: 1309 microversion: 2.1 time: 0.260246 Sep 17 21:11:10.404098 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2284/4672] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:10 2022] GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1 => generated 1309 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:11:10.765055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fe1f028b-64fb-4d71-8dca-33e8d48d4096 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:10.766238 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fe1f028b-64fb-4d71-8dca-33e8d48d4096 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:10.783116 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe1f028b-64fb-4d71-8dca-33e8d48d4096 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:10.783762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe1f028b-64fb-4d71-8dca-33e8d48d4096 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:10.784174 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe1f028b-64fb-4d71-8dca-33e8d48d4096 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:10.785272 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe1f028b-64fb-4d71-8dca-33e8d48d4096 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:10.786178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe1f028b-64fb-4d71-8dca-33e8d48d4096 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:10.788108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe1f028b-64fb-4d71-8dca-33e8d48d4096 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:10.901481 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fe1f028b-64fb-4d71-8dca-33e8d48d4096 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:10.904510 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:11:10.911380 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c35a6c2e-c2fd-4453-b70c-5683e6ecd48b tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:10.912370 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c35a6c2e-c2fd-4453-b70c-5683e6ecd48b tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] [instance: 14f66e5d-ada6-41ab-b6d1-32343c852f5e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:10.933322 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fe1f028b-64fb-4d71-8dca-33e8d48d4096 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:10.933938 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c35a6c2e-c2fd-4453-b70c-5683e6ecd48b tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:10.935025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c35a6c2e-c2fd-4453-b70c-5683e6ecd48b tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:10.935493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c35a6c2e-c2fd-4453-b70c-5683e6ecd48b tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:10.937114 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fe1f028b-64fb-4d71-8dca-33e8d48d4096 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:10.938312 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c35a6c2e-c2fd-4453-b70c-5683e6ecd48b tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:10.939821 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c35a6c2e-c2fd-4453-b70c-5683e6ecd48b tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:10.940361 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c35a6c2e-c2fd-4453-b70c-5683e6ecd48b tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:10.941861 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fe1f028b-64fb-4d71-8dca-33e8d48d4096 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1409 microversion: 2.54 time: 0.180359 Sep 17 21:11:10.943625 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2389/4673] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:11:10 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1409 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:11:11.096164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fd2945b5-5aff-4afc-81ec-5cbdfdd56e04 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a5900820>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:11.147543 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c35a6c2e-c2fd-4453-b70c-5683e6ecd48b tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e12ad7a93ae4a9a95b2a54c1a2b9845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9818fed65901412b8da672532cc5bc52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:11.152626 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:11:11.159099 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c35a6c2e-c2fd-4453-b70c-5683e6ecd48b tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] 10.222.0.26 "GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e" status: 200 len: 1315 microversion: 2.1 time: 0.252551 Sep 17 21:11:11.184342 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fd2945b5-5aff-4afc-81ec-5cbdfdd56e04 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418" status: 200 len: 1429 microversion: 2.1 time: 0.100888 Sep 17 21:11:11.185963 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2390/4675] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:11 2022] GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418 => generated 1429 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:11.186187 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2285/4675] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:10 2022] GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:11:11.431103 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d68f8a59-f7aa-4b92-a3e7-fa08f5ce754e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:11.432131 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d68f8a59-f7aa-4b92-a3e7-fa08f5ce754e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: f09b5c28-821c-4b0e-be61-2f1acfeb47d1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:11.444882 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d68f8a59-f7aa-4b92-a3e7-fa08f5ce754e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:11.446723 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d68f8a59-f7aa-4b92-a3e7-fa08f5ce754e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:11.447665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d68f8a59-f7aa-4b92-a3e7-fa08f5ce754e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:11.449533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d68f8a59-f7aa-4b92-a3e7-fa08f5ce754e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:11.450901 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d68f8a59-f7aa-4b92-a3e7-fa08f5ce754e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:11.451709 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d68f8a59-f7aa-4b92-a3e7-fa08f5ce754e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:11.701429 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d68f8a59-f7aa-4b92-a3e7-fa08f5ce754e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:11.714959 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d68f8a59-f7aa-4b92-a3e7-fa08f5ce754e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1" status: 200 len: 1309 microversion: 2.1 time: 0.289622 Sep 17 21:11:11.717201 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2391/4676] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:11 2022] GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1 => generated 1309 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:11.982499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-982a4e7c-9ef3-44fa-9911-911ecfade097 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:11.988674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-982a4e7c-9ef3-44fa-9911-911ecfade097 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:12.012891 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-982a4e7c-9ef3-44fa-9911-911ecfade097 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:12.014696 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-982a4e7c-9ef3-44fa-9911-911ecfade097 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:12.016297 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-982a4e7c-9ef3-44fa-9911-911ecfade097 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:12.018474 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-982a4e7c-9ef3-44fa-9911-911ecfade097 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:12.019562 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-982a4e7c-9ef3-44fa-9911-911ecfade097 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:12.020589 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-982a4e7c-9ef3-44fa-9911-911ecfade097 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:12.186519 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ed311674-0933-4bd5-9100-049e30656e84 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:12.187222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ed311674-0933-4bd5-9100-049e30656e84 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] [instance: 14f66e5d-ada6-41ab-b6d1-32343c852f5e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:12.217117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed311674-0933-4bd5-9100-049e30656e84 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:12.220557 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed311674-0933-4bd5-9100-049e30656e84 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:12.222870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed311674-0933-4bd5-9100-049e30656e84 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:12.223102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-982a4e7c-9ef3-44fa-9911-911ecfade097 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:12.226543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed311674-0933-4bd5-9100-049e30656e84 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:12.227946 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed311674-0933-4bd5-9100-049e30656e84 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:12.247051 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-982a4e7c-9ef3-44fa-9911-911ecfade097 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:12.247899 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed311674-0933-4bd5-9100-049e30656e84 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:12.251825 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-982a4e7c-9ef3-44fa-9911-911ecfade097 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:12.253107 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-982a4e7c-9ef3-44fa-9911-911ecfade097 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1409 microversion: 2.54 time: 0.285011 Sep 17 21:11:12.277428 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2286/4677] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:11:11 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1409 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:11:12.302880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-719fb0ff-5ac6-408d-b0b8-7365a9729aab tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a4f1d8b0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:12.406732 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-719fb0ff-5ac6-408d-b0b8-7365a9729aab tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418" status: 200 len: 1429 microversion: 2.1 time: 0.125528 Sep 17 21:11:12.407712 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2287/4678] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:12 2022] GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418 => generated 1429 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:12.609924 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ed311674-0933-4bd5-9100-049e30656e84 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e12ad7a93ae4a9a95b2a54c1a2b9845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9818fed65901412b8da672532cc5bc52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:12.629543 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ed311674-0933-4bd5-9100-049e30656e84 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] 10.222.0.26 "GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e" status: 200 len: 1315 microversion: 2.1 time: 0.447035 Sep 17 21:11:12.631593 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2392/4679] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:12 2022] GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:12.740924 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e859ff9a-1798-4d72-8b3e-fbebae1f13cf tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:12.741916 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e859ff9a-1798-4d72-8b3e-fbebae1f13cf tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: f09b5c28-821c-4b0e-be61-2f1acfeb47d1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:12.753610 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e859ff9a-1798-4d72-8b3e-fbebae1f13cf tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:12.754466 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e859ff9a-1798-4d72-8b3e-fbebae1f13cf tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:12.755231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e859ff9a-1798-4d72-8b3e-fbebae1f13cf tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:12.759363 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e859ff9a-1798-4d72-8b3e-fbebae1f13cf tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:12.759988 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e859ff9a-1798-4d72-8b3e-fbebae1f13cf tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:12.760629 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e859ff9a-1798-4d72-8b3e-fbebae1f13cf tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:13.066664 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e859ff9a-1798-4d72-8b3e-fbebae1f13cf tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:13.082640 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e859ff9a-1798-4d72-8b3e-fbebae1f13cf tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1" status: 200 len: 1309 microversion: 2.1 time: 0.345641 Sep 17 21:11:13.083452 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2288/4680] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:12 2022] GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1 => generated 1309 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:13.285972 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e9e3283b-0082-4275-b31c-ff6bb89295af tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:13.286593 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e9e3283b-0082-4275-b31c-ff6bb89295af tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:13.297497 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9e3283b-0082-4275-b31c-ff6bb89295af tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:13.299722 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9e3283b-0082-4275-b31c-ff6bb89295af tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:13.300526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9e3283b-0082-4275-b31c-ff6bb89295af tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:13.301699 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9e3283b-0082-4275-b31c-ff6bb89295af tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:13.302920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9e3283b-0082-4275-b31c-ff6bb89295af tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:13.303632 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9e3283b-0082-4275-b31c-ff6bb89295af tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:13.421856 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e9e3283b-0082-4275-b31c-ff6bb89295af tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:13.433179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-60d8c16c-6322-4ebd-be08-bc066b2534c3 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a48b63a0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:13.433359 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e9e3283b-0082-4275-b31c-ff6bb89295af tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:13.434890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e9e3283b-0082-4275-b31c-ff6bb89295af tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:13.436052 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e9e3283b-0082-4275-b31c-ff6bb89295af tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1409 microversion: 2.54 time: 0.154049 Sep 17 21:11:13.436625 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2393/4681] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:11:13 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1409 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:11:13.543971 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-60d8c16c-6322-4ebd-be08-bc066b2534c3 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418" status: 200 len: 1429 microversion: 2.1 time: 0.118205 Sep 17 21:11:13.556316 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2289/4682] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:13 2022] GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418 => generated 1429 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:13.663543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-03dffa5e-5fed-40fd-a1a5-d8be4b1ea59d tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:13.665471 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-03dffa5e-5fed-40fd-a1a5-d8be4b1ea59d tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] [instance: 14f66e5d-ada6-41ab-b6d1-32343c852f5e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:13.687623 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03dffa5e-5fed-40fd-a1a5-d8be4b1ea59d tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:13.689331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03dffa5e-5fed-40fd-a1a5-d8be4b1ea59d tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:13.690203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03dffa5e-5fed-40fd-a1a5-d8be4b1ea59d tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:13.691607 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03dffa5e-5fed-40fd-a1a5-d8be4b1ea59d tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:13.692519 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03dffa5e-5fed-40fd-a1a5-d8be4b1ea59d tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:13.694197 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03dffa5e-5fed-40fd-a1a5-d8be4b1ea59d tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:14.086786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-03dffa5e-5fed-40fd-a1a5-d8be4b1ea59d tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e12ad7a93ae4a9a95b2a54c1a2b9845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9818fed65901412b8da672532cc5bc52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:14.101260 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-03dffa5e-5fed-40fd-a1a5-d8be4b1ea59d tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] 10.222.0.26 "GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e" status: 200 len: 1315 microversion: 2.1 time: 0.448626 Sep 17 21:11:14.102365 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2394/4683] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:13 2022] GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:14.113783 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f8387fe7-5536-40f8-b7e0-6fb4c71fdd1a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:14.114541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f8387fe7-5536-40f8-b7e0-6fb4c71fdd1a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: f09b5c28-821c-4b0e-be61-2f1acfeb47d1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:14.127749 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8387fe7-5536-40f8-b7e0-6fb4c71fdd1a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:14.128606 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8387fe7-5536-40f8-b7e0-6fb4c71fdd1a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:14.129128 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8387fe7-5536-40f8-b7e0-6fb4c71fdd1a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:14.129993 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8387fe7-5536-40f8-b7e0-6fb4c71fdd1a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:14.130744 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8387fe7-5536-40f8-b7e0-6fb4c71fdd1a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:14.131399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8387fe7-5536-40f8-b7e0-6fb4c71fdd1a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:14.365778 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f8387fe7-5536-40f8-b7e0-6fb4c71fdd1a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:14.378634 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f8387fe7-5536-40f8-b7e0-6fb4c71fdd1a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1" status: 200 len: 1309 microversion: 2.1 time: 0.268749 Sep 17 21:11:14.379295 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2290/4684] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:14 2022] GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1 => generated 1309 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:14.475801 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f46afeee-b28e-4aa2-b56f-aa06d98b547f tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:14.477227 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f46afeee-b28e-4aa2-b56f-aa06d98b547f tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:14.494063 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f46afeee-b28e-4aa2-b56f-aa06d98b547f tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:14.495444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f46afeee-b28e-4aa2-b56f-aa06d98b547f tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:14.502649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f46afeee-b28e-4aa2-b56f-aa06d98b547f tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:14.504367 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f46afeee-b28e-4aa2-b56f-aa06d98b547f tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:14.509169 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f46afeee-b28e-4aa2-b56f-aa06d98b547f tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:14.509806 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f46afeee-b28e-4aa2-b56f-aa06d98b547f tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:14.567117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-35e7d675-2255-4e6d-9c59-ce215f98d697 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a4727040>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:14.646094 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f46afeee-b28e-4aa2-b56f-aa06d98b547f tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:14.670191 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f46afeee-b28e-4aa2-b56f-aa06d98b547f tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:14.673706 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-35e7d675-2255-4e6d-9c59-ce215f98d697 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418" status: 200 len: 1429 microversion: 2.1 time: 0.112592 Sep 17 21:11:14.673934 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f46afeee-b28e-4aa2-b56f-aa06d98b547f tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:14.676901 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f46afeee-b28e-4aa2-b56f-aa06d98b547f tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1409 microversion: 2.54 time: 0.212749 Sep 17 21:11:14.691301 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2395/4685] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:11:14 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1409 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:11:14.691512 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2291/4686] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:14 2022] GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418 => generated 1429 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:15.126189 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9ed05812-1ce0-48f8-996c-c7126d5cd167 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:15.127011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9ed05812-1ce0-48f8-996c-c7126d5cd167 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] [instance: 14f66e5d-ada6-41ab-b6d1-32343c852f5e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:15.142210 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ed05812-1ce0-48f8-996c-c7126d5cd167 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:15.142728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ed05812-1ce0-48f8-996c-c7126d5cd167 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:15.143165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ed05812-1ce0-48f8-996c-c7126d5cd167 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:15.146619 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ed05812-1ce0-48f8-996c-c7126d5cd167 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:15.147124 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ed05812-1ce0-48f8-996c-c7126d5cd167 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:15.147969 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ed05812-1ce0-48f8-996c-c7126d5cd167 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:15.403494 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d4f28702-4fae-45a1-aca5-1a1f547c5c43 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:15.404125 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d4f28702-4fae-45a1-aca5-1a1f547c5c43 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: f09b5c28-821c-4b0e-be61-2f1acfeb47d1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:15.420323 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d4f28702-4fae-45a1-aca5-1a1f547c5c43 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:15.422341 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d4f28702-4fae-45a1-aca5-1a1f547c5c43 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:15.423023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d4f28702-4fae-45a1-aca5-1a1f547c5c43 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:15.424158 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d4f28702-4fae-45a1-aca5-1a1f547c5c43 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:15.425116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d4f28702-4fae-45a1-aca5-1a1f547c5c43 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:15.425889 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d4f28702-4fae-45a1-aca5-1a1f547c5c43 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:15.826624 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9ed05812-1ce0-48f8-996c-c7126d5cd167 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e12ad7a93ae4a9a95b2a54c1a2b9845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9818fed65901412b8da672532cc5bc52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:15.835877 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9ed05812-1ce0-48f8-996c-c7126d5cd167 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] 10.222.0.26 "GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e" status: 200 len: 1315 microversion: 2.1 time: 0.715325 Sep 17 21:11:15.840552 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2396/4687] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:15 2022] GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e => generated 1315 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:15.853074 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-abc1e076-7e0b-4430-8fc5-4d288408d7c6 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a54f71f0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:15.916061 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d4f28702-4fae-45a1-aca5-1a1f547c5c43 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:15.934470 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d4f28702-4fae-45a1-aca5-1a1f547c5c43 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1" status: 200 len: 1309 microversion: 2.1 time: 0.536226 Sep 17 21:11:15.935648 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2292/4688] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:15 2022] GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1 => generated 1309 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:11:15.940677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d1b46f75-8f95-467d-b4f0-b87d00fe8f9c tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:15.947452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d1b46f75-8f95-467d-b4f0-b87d00fe8f9c tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:15.967533 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-abc1e076-7e0b-4430-8fc5-4d288408d7c6 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418" status: 200 len: 1429 microversion: 2.1 time: 0.125790 Sep 17 21:11:15.968152 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2397/4689] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:15 2022] GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418 => generated 1429 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:15.994064 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1b46f75-8f95-467d-b4f0-b87d00fe8f9c tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:15.994845 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1b46f75-8f95-467d-b4f0-b87d00fe8f9c tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:15.995490 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1b46f75-8f95-467d-b4f0-b87d00fe8f9c tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:15.996398 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1b46f75-8f95-467d-b4f0-b87d00fe8f9c tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:15.998429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1b46f75-8f95-467d-b4f0-b87d00fe8f9c tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:15.999262 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1b46f75-8f95-467d-b4f0-b87d00fe8f9c tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:16.115435 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-93004591-fa54-4a37-a318-5cbcfcc7aa29 req-9a796741-c92b-42a5-a237-74ffdef78f96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bb77042-152e-4948-95ab-8849c8d72c80", "name": "network-vif-plugged", "status": "completed", "tag": "5ab301f7-76d2-44ce-a32b-a5a47596282b"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:16.136616 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-93004591-fa54-4a37-a318-5cbcfcc7aa29 req-9a796741-c92b-42a5-a237-74ffdef78f96 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:16.137403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-93004591-fa54-4a37-a318-5cbcfcc7aa29 req-9a796741-c92b-42a5-a237-74ffdef78f96 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:16.139493 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-93004591-fa54-4a37-a318-5cbcfcc7aa29 req-9a796741-c92b-42a5-a237-74ffdef78f96 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:16.169339 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-93004591-fa54-4a37-a318-5cbcfcc7aa29 req-9a796741-c92b-42a5-a237-74ffdef78f96 service nova] Creating event network-vif-plugged:5ab301f7-76d2-44ce-a32b-a5a47596282b for instance 1bb77042-152e-4948-95ab-8849c8d72c80 on nch2-master-1 Sep 17 21:11:16.186193 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-93004591-fa54-4a37-a318-5cbcfcc7aa29 req-9a796741-c92b-42a5-a237-74ffdef78f96 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074787 Sep 17 21:11:16.189309 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2398/4690] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:11:16.201791 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d1b46f75-8f95-467d-b4f0-b87d00fe8f9c tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:16.213708 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d1b46f75-8f95-467d-b4f0-b87d00fe8f9c tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:16.215172 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d1b46f75-8f95-467d-b4f0-b87d00fe8f9c tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:16.216475 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d1b46f75-8f95-467d-b4f0-b87d00fe8f9c tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1409 microversion: 2.54 time: 0.279570 Sep 17 21:11:16.223652 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2293/4691] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:11:15 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1409 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:11:16.882656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-854f04a6-1e8c-40d1-a405-829626a70dd8 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:16.886300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-854f04a6-1e8c-40d1-a405-829626a70dd8 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] [instance: 14f66e5d-ada6-41ab-b6d1-32343c852f5e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:16.905217 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-854f04a6-1e8c-40d1-a405-829626a70dd8 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:16.906510 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-854f04a6-1e8c-40d1-a405-829626a70dd8 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:16.907152 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-854f04a6-1e8c-40d1-a405-829626a70dd8 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:16.909122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-854f04a6-1e8c-40d1-a405-829626a70dd8 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:16.910251 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-854f04a6-1e8c-40d1-a405-829626a70dd8 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:16.910857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-854f04a6-1e8c-40d1-a405-829626a70dd8 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:16.965742 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1df9cb6a-146f-4ac0-9cb8-f15cd5ae33d3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:16.967036 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1df9cb6a-146f-4ac0-9cb8-f15cd5ae33d3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: f09b5c28-821c-4b0e-be61-2f1acfeb47d1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:16.976342 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1df9cb6a-146f-4ac0-9cb8-f15cd5ae33d3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:16.977037 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1df9cb6a-146f-4ac0-9cb8-f15cd5ae33d3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:16.979115 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1df9cb6a-146f-4ac0-9cb8-f15cd5ae33d3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:16.980110 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1df9cb6a-146f-4ac0-9cb8-f15cd5ae33d3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:16.981496 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1df9cb6a-146f-4ac0-9cb8-f15cd5ae33d3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:16.982245 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1df9cb6a-146f-4ac0-9cb8-f15cd5ae33d3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:17.298650 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-854f04a6-1e8c-40d1-a405-829626a70dd8 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e12ad7a93ae4a9a95b2a54c1a2b9845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9818fed65901412b8da672532cc5bc52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:17.315035 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-854f04a6-1e8c-40d1-a405-829626a70dd8 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] 10.222.0.26 "GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e" status: 200 len: 1315 microversion: 2.1 time: 0.448636 Sep 17 21:11:17.322555 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2399/4692] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:16 2022] GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:17.342383 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f3f6ca29-3fbd-445e-925d-f41e305d59d3 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a411fd30>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:17.362449 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1df9cb6a-146f-4ac0-9cb8-f15cd5ae33d3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:17.373711 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1df9cb6a-146f-4ac0-9cb8-f15cd5ae33d3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1" status: 200 len: 1309 microversion: 2.1 time: 0.416526 Sep 17 21:11:17.374334 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2294/4693] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:16 2022] GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1 => generated 1309 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:11:17.387313 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-45c3163e-1675-4c04-abd0-4546a828a7cc tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:17.392569 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-45c3163e-1675-4c04-abd0-4546a828a7cc tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:17.406911 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45c3163e-1675-4c04-abd0-4546a828a7cc tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:17.407743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45c3163e-1675-4c04-abd0-4546a828a7cc tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:17.408450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45c3163e-1675-4c04-abd0-4546a828a7cc tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:17.409411 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45c3163e-1675-4c04-abd0-4546a828a7cc tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:17.410069 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45c3163e-1675-4c04-abd0-4546a828a7cc tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:17.410747 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45c3163e-1675-4c04-abd0-4546a828a7cc tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:17.420014 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f3f6ca29-3fbd-445e-925d-f41e305d59d3 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418" status: 200 len: 1429 microversion: 2.1 time: 0.095276 Sep 17 21:11:17.420744 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2400/4694] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:17 2022] GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418 => generated 1429 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:17.520325 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-45c3163e-1675-4c04-abd0-4546a828a7cc tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:17.549300 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-45c3163e-1675-4c04-abd0-4546a828a7cc tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:17.552725 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-45c3163e-1675-4c04-abd0-4546a828a7cc tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:17.566148 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-45c3163e-1675-4c04-abd0-4546a828a7cc tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1415 microversion: 2.54 time: 0.185299 Sep 17 21:11:17.571622 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2295/4695] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:11:17 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1415 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:11:18.357733 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-35552b55-81d2-47da-b7ac-000eaf49fb9d tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:18.360410 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-35552b55-81d2-47da-b7ac-000eaf49fb9d tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] [instance: 14f66e5d-ada6-41ab-b6d1-32343c852f5e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:18.396911 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35552b55-81d2-47da-b7ac-000eaf49fb9d tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:18.397870 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35552b55-81d2-47da-b7ac-000eaf49fb9d tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:18.398526 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35552b55-81d2-47da-b7ac-000eaf49fb9d tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:18.400674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35552b55-81d2-47da-b7ac-000eaf49fb9d tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:18.401422 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35552b55-81d2-47da-b7ac-000eaf49fb9d tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:18.404142 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35552b55-81d2-47da-b7ac-000eaf49fb9d tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:18.764873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-35552b55-81d2-47da-b7ac-000eaf49fb9d tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e12ad7a93ae4a9a95b2a54c1a2b9845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9818fed65901412b8da672532cc5bc52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:18.776101 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-35552b55-81d2-47da-b7ac-000eaf49fb9d tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] 10.222.0.26 "GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e" status: 200 len: 1315 microversion: 2.1 time: 0.435537 Sep 17 21:11:18.780743 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2296/4696] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:18 2022] GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:18.803817 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-06907a65-0333-4bfd-97b9-a6593395217f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:18.806029 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-06907a65-0333-4bfd-97b9-a6593395217f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: f09b5c28-821c-4b0e-be61-2f1acfeb47d1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:18.825843 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06907a65-0333-4bfd-97b9-a6593395217f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:18.826434 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06907a65-0333-4bfd-97b9-a6593395217f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:18.829296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06907a65-0333-4bfd-97b9-a6593395217f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:18.832404 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06907a65-0333-4bfd-97b9-a6593395217f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:18.833727 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06907a65-0333-4bfd-97b9-a6593395217f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:18.834368 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06907a65-0333-4bfd-97b9-a6593395217f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:18.960090 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-ac307692-7c4a-4959-8b74-cfc9c0d250b5 req-02be0b7f-09e6-4bb3-bc3e-7da2d6d62b35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f09b5c28-821c-4b0e-be61-2f1acfeb47d1", "name": "network-vif-plugged", "status": "completed", "tag": "cb7b746e-1be8-47ec-af5e-1175a22b0d23"}, {"server_uuid": "14f66e5d-ada6-41ab-b6d1-32343c852f5e", "name": "network-vif-plugged", "status": "completed", "tag": "5a1f92ec-050d-42de-96a1-54de3f8fa611"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:18.992888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-ac307692-7c4a-4959-8b74-cfc9c0d250b5 req-02be0b7f-09e6-4bb3-bc3e-7da2d6d62b35 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:18.993430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-ac307692-7c4a-4959-8b74-cfc9c0d250b5 req-02be0b7f-09e6-4bb3-bc3e-7da2d6d62b35 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:18.993920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-ac307692-7c4a-4959-8b74-cfc9c0d250b5 req-02be0b7f-09e6-4bb3-bc3e-7da2d6d62b35 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:19.043446 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-ac307692-7c4a-4959-8b74-cfc9c0d250b5 req-02be0b7f-09e6-4bb3-bc3e-7da2d6d62b35 service nova] Creating event network-vif-plugged:cb7b746e-1be8-47ec-af5e-1175a22b0d23 for instance f09b5c28-821c-4b0e-be61-2f1acfeb47d1 on nch2-master-1 Sep 17 21:11:19.052701 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-ac307692-7c4a-4959-8b74-cfc9c0d250b5 req-02be0b7f-09e6-4bb3-bc3e-7da2d6d62b35 service nova] Creating event network-vif-plugged:5a1f92ec-050d-42de-96a1-54de3f8fa611 for instance 14f66e5d-ada6-41ab-b6d1-32343c852f5e on nch2-master-1 Sep 17 21:11:19.072943 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-ac307692-7c4a-4959-8b74-cfc9c0d250b5 req-02be0b7f-09e6-4bb3-bc3e-7da2d6d62b35 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.804035 Sep 17 21:11:19.076267 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2401/4697] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:11:19.114534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7a9a4125-7554-4778-8a54-348b68175ec8 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a4095f70>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:19.134403 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-06907a65-0333-4bfd-97b9-a6593395217f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:19.159008 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-06907a65-0333-4bfd-97b9-a6593395217f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1" status: 200 len: 1309 microversion: 2.1 time: 0.375394 Sep 17 21:11:19.162833 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2297/4698] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:18 2022] GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1 => generated 1309 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:19.181139 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1a7a2a82-c380-4fee-addd-3a615473e44d tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:19.182122 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1a7a2a82-c380-4fee-addd-3a615473e44d tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:19.211145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a7a2a82-c380-4fee-addd-3a615473e44d tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:19.217793 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a7a2a82-c380-4fee-addd-3a615473e44d tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:19.225534 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a7a2a82-c380-4fee-addd-3a615473e44d tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:19.226943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a7a2a82-c380-4fee-addd-3a615473e44d tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:19.227470 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a7a2a82-c380-4fee-addd-3a615473e44d tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:19.232373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a7a2a82-c380-4fee-addd-3a615473e44d tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:19.252271 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7a9a4125-7554-4778-8a54-348b68175ec8 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418" status: 200 len: 1429 microversion: 2.1 time: 0.172179 Sep 17 21:11:19.256180 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2402/4699] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:19 2022] GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418 => generated 1429 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:19.462838 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1a7a2a82-c380-4fee-addd-3a615473e44d tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:19.474513 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1a7a2a82-c380-4fee-addd-3a615473e44d tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:19.476714 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1a7a2a82-c380-4fee-addd-3a615473e44d tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:19.479613 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1a7a2a82-c380-4fee-addd-3a615473e44d tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1400 microversion: 2.54 time: 0.313411 Sep 17 21:11:19.480863 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2298/4700] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:11:19 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1400 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:11:19.511169 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c37931d7-de49-4ab9-aeb2-41078dba1085 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '.version_select at 0x7f25a4071550>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:19.551350 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c37931d7-de49-4ab9-aeb2-41078dba1085 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1474968742" status: 204 len: 0 microversion: 2.54 time: 0.039776 Sep 17 21:11:19.555651 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2403/4701] 10.222.0.26 () {60 vars in 1319 bytes} [Sat Sep 17 21:11:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1474968742 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 21:11:19.566819 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c487a1b6-6a5b-46b4-be21-46c3218edf2e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:19.568525 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c487a1b6-6a5b-46b4-be21-46c3218edf2e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:19.576401 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c487a1b6-6a5b-46b4-be21-46c3218edf2e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:19.578554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c487a1b6-6a5b-46b4-be21-46c3218edf2e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:19.579256 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c487a1b6-6a5b-46b4-be21-46c3218edf2e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:19.580205 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c487a1b6-6a5b-46b4-be21-46c3218edf2e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:19.580887 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c487a1b6-6a5b-46b4-be21-46c3218edf2e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:19.581609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c487a1b6-6a5b-46b4-be21-46c3218edf2e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:19.618443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c487a1b6-6a5b-46b4-be21-46c3218edf2e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:11:19.801229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-48015131-dee6-4792-9a0e-d74b117fc236 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:19.802935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-48015131-dee6-4792-9a0e-d74b117fc236 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] [instance: 14f66e5d-ada6-41ab-b6d1-32343c852f5e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:19.814868 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c487a1b6-6a5b-46b4-be21-46c3218edf2e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 204 len: 0 microversion: 2.54 time: 0.254774 Sep 17 21:11:19.816153 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2299/4702] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 17 21:11:19 2022] DELETE /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 21:11:19.823182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-48015131-dee6-4792-9a0e-d74b117fc236 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:19.824183 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-48015131-dee6-4792-9a0e-d74b117fc236 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:19.826001 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-48015131-dee6-4792-9a0e-d74b117fc236 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:19.833562 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2e92dfc7-2b2a-4452-9c0a-89167d09e623 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:19.834932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2e92dfc7-2b2a-4452-9c0a-89167d09e623 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:19.838448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-48015131-dee6-4792-9a0e-d74b117fc236 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:19.842006 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-48015131-dee6-4792-9a0e-d74b117fc236 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:19.846974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-48015131-dee6-4792-9a0e-d74b117fc236 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:19.855963 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e92dfc7-2b2a-4452-9c0a-89167d09e623 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:19.859507 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e92dfc7-2b2a-4452-9c0a-89167d09e623 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:19.860929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e92dfc7-2b2a-4452-9c0a-89167d09e623 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:19.862162 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e92dfc7-2b2a-4452-9c0a-89167d09e623 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:19.863891 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e92dfc7-2b2a-4452-9c0a-89167d09e623 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:19.865806 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e92dfc7-2b2a-4452-9c0a-89167d09e623 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:20.117197 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-48015131-dee6-4792-9a0e-d74b117fc236 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e12ad7a93ae4a9a95b2a54c1a2b9845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9818fed65901412b8da672532cc5bc52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:20.134017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2e92dfc7-2b2a-4452-9c0a-89167d09e623 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:20.145142 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-48015131-dee6-4792-9a0e-d74b117fc236 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] 10.222.0.26 "GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e" status: 200 len: 1315 microversion: 2.1 time: 0.346839 Sep 17 21:11:20.146012 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2404/4703] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:19 2022] GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:20.153239 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2e92dfc7-2b2a-4452-9c0a-89167d09e623 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:20.162423 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2e92dfc7-2b2a-4452-9c0a-89167d09e623 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:20.166512 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2e92dfc7-2b2a-4452-9c0a-89167d09e623 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1406 microversion: 2.54 time: 0.345855 Sep 17 21:11:20.167306 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2300/4704] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:11:19 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1406 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:11:20.193067 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-382af599-693d-4e42-93ca-c65349c9a6d4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:20.193844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-382af599-693d-4e42-93ca-c65349c9a6d4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: f09b5c28-821c-4b0e-be61-2f1acfeb47d1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:20.201151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-382af599-693d-4e42-93ca-c65349c9a6d4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:20.201858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-382af599-693d-4e42-93ca-c65349c9a6d4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:20.202568 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-382af599-693d-4e42-93ca-c65349c9a6d4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:20.204581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-382af599-693d-4e42-93ca-c65349c9a6d4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:20.205294 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-382af599-693d-4e42-93ca-c65349c9a6d4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:20.206661 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-382af599-693d-4e42-93ca-c65349c9a6d4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:20.271010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e265c59a-8840-423d-b762-5853d7040246 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a47493a0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:20.351448 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e265c59a-8840-423d-b762-5853d7040246 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418" status: 200 len: 1429 microversion: 2.1 time: 0.085677 Sep 17 21:11:20.353329 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2301/4705] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:20 2022] GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418 => generated 1429 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:11:20.440303 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-382af599-693d-4e42-93ca-c65349c9a6d4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:20.452470 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-382af599-693d-4e42-93ca-c65349c9a6d4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1" status: 200 len: 1309 microversion: 2.1 time: 0.263793 Sep 17 21:11:20.455629 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2405/4706] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:20 2022] GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1 => generated 1309 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:21.174173 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0004c4ad-2b21-4d1e-9db8-ea91e1304c93 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:21.175543 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0004c4ad-2b21-4d1e-9db8-ea91e1304c93 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] [instance: 14f66e5d-ada6-41ab-b6d1-32343c852f5e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:21.187048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0004c4ad-2b21-4d1e-9db8-ea91e1304c93 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:21.187844 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0004c4ad-2b21-4d1e-9db8-ea91e1304c93 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:21.188454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0004c4ad-2b21-4d1e-9db8-ea91e1304c93 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:21.189345 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0004c4ad-2b21-4d1e-9db8-ea91e1304c93 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:21.198313 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c639b333-8cb1-4c6a-900d-c426cd6f3c8e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:21.200765 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c639b333-8cb1-4c6a-900d-c426cd6f3c8e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:21.208407 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0004c4ad-2b21-4d1e-9db8-ea91e1304c93 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:21.208719 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0004c4ad-2b21-4d1e-9db8-ea91e1304c93 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:21.225247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c639b333-8cb1-4c6a-900d-c426cd6f3c8e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:21.225865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c639b333-8cb1-4c6a-900d-c426cd6f3c8e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:21.230529 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c639b333-8cb1-4c6a-900d-c426cd6f3c8e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:21.234870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c639b333-8cb1-4c6a-900d-c426cd6f3c8e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:21.236006 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c639b333-8cb1-4c6a-900d-c426cd6f3c8e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:21.236457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c639b333-8cb1-4c6a-900d-c426cd6f3c8e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:21.374124 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c639b333-8cb1-4c6a-900d-c426cd6f3c8e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:21.402474 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c639b333-8cb1-4c6a-900d-c426cd6f3c8e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:21.407143 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c639b333-8cb1-4c6a-900d-c426cd6f3c8e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:21.410955 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c639b333-8cb1-4c6a-900d-c426cd6f3c8e tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1406 microversion: 2.54 time: 0.217381 Sep 17 21:11:21.413896 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2406/4707] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:11:21 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1406 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:11:21.425104 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d6216f1a-ae00-4b5d-97ea-9d328a8c73e2 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a41fbd30>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:21.508134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0004c4ad-2b21-4d1e-9db8-ea91e1304c93 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e12ad7a93ae4a9a95b2a54c1a2b9845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9818fed65901412b8da672532cc5bc52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:21.519290 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0004c4ad-2b21-4d1e-9db8-ea91e1304c93 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] 10.222.0.26 "GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e" status: 200 len: 1315 microversion: 2.1 time: 0.352904 Sep 17 21:11:21.520279 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2302/4708] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:21 2022] GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:21.525827 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ccce72a1-90a7-4368-91b1-ec3840b50471 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:21.526717 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ccce72a1-90a7-4368-91b1-ec3840b50471 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: f09b5c28-821c-4b0e-be61-2f1acfeb47d1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:21.533963 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ccce72a1-90a7-4368-91b1-ec3840b50471 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:21.535492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ccce72a1-90a7-4368-91b1-ec3840b50471 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:21.536181 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ccce72a1-90a7-4368-91b1-ec3840b50471 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:21.537139 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ccce72a1-90a7-4368-91b1-ec3840b50471 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:21.537801 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ccce72a1-90a7-4368-91b1-ec3840b50471 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:21.538425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ccce72a1-90a7-4368-91b1-ec3840b50471 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:21.582660 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d6216f1a-ae00-4b5d-97ea-9d328a8c73e2 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418" status: 200 len: 1429 microversion: 2.1 time: 0.167512 Sep 17 21:11:21.583577 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2407/4709] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:21 2022] GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418 => generated 1429 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:21.753691 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ccce72a1-90a7-4368-91b1-ec3840b50471 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:21.767869 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ccce72a1-90a7-4368-91b1-ec3840b50471 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1" status: 200 len: 1490 microversion: 2.1 time: 0.246078 Sep 17 21:11:21.768475 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2303/4710] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:21 2022] GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1 => generated 1490 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:21.796121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d0415e9c-d9c3-47f6-95ab-948c7365f272 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:21.796854 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d0415e9c-d9c3-47f6-95ab-948c7365f272 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 640f82db-299b-42a4-a6b6-0a286b8220c9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:21.815437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d0415e9c-d9c3-47f6-95ab-948c7365f272 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:21.816072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d0415e9c-d9c3-47f6-95ab-948c7365f272 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:21.816715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d0415e9c-d9c3-47f6-95ab-948c7365f272 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:21.818166 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d0415e9c-d9c3-47f6-95ab-948c7365f272 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:21.819198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d0415e9c-d9c3-47f6-95ab-948c7365f272 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:21.820043 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d0415e9c-d9c3-47f6-95ab-948c7365f272 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:22.131805 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d0415e9c-d9c3-47f6-95ab-948c7365f272 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:22.142709 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d0415e9c-d9c3-47f6-95ab-948c7365f272 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9" status: 200 len: 1490 microversion: 2.1 time: 0.353803 Sep 17 21:11:22.143592 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2408/4711] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:21 2022] GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9 => generated 1490 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:22.168705 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bd3db7dd-8276-4f24-97fe-2b60b310e79a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:22.169417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bd3db7dd-8276-4f24-97fe-2b60b310e79a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: f09b5c28-821c-4b0e-be61-2f1acfeb47d1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:22.178092 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd3db7dd-8276-4f24-97fe-2b60b310e79a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:22.179508 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd3db7dd-8276-4f24-97fe-2b60b310e79a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:22.180201 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd3db7dd-8276-4f24-97fe-2b60b310e79a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:22.181247 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd3db7dd-8276-4f24-97fe-2b60b310e79a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:22.182078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd3db7dd-8276-4f24-97fe-2b60b310e79a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:22.182973 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd3db7dd-8276-4f24-97fe-2b60b310e79a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:22.385113 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bd3db7dd-8276-4f24-97fe-2b60b310e79a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:22.392032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:11:22.414112 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bd3db7dd-8276-4f24-97fe-2b60b310e79a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1" status: 200 len: 1490 microversion: 2.1 time: 0.235250 Sep 17 21:11:22.427245 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2304/4712] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:22 2022] GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1 => generated 1490 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:22.440393 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-06ba0fa8-0c47-405e-a4f1-50d7c96746a0 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:22.442110 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-06ba0fa8-0c47-405e-a4f1-50d7c96746a0 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:22.461001 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06ba0fa8-0c47-405e-a4f1-50d7c96746a0 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:22.461904 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06ba0fa8-0c47-405e-a4f1-50d7c96746a0 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:22.462507 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06ba0fa8-0c47-405e-a4f1-50d7c96746a0 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:22.463421 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06ba0fa8-0c47-405e-a4f1-50d7c96746a0 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:22.464048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06ba0fa8-0c47-405e-a4f1-50d7c96746a0 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:22.466626 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06ba0fa8-0c47-405e-a4f1-50d7c96746a0 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:22.470926 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-08b6f61e-b9d3-4688-ab1c-fb2037e20b0e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:22.471891 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-08b6f61e-b9d3-4688-ab1c-fb2037e20b0e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: f09b5c28-821c-4b0e-be61-2f1acfeb47d1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:22.500496 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08b6f61e-b9d3-4688-ab1c-fb2037e20b0e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:22.501933 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08b6f61e-b9d3-4688-ab1c-fb2037e20b0e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:22.502610 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08b6f61e-b9d3-4688-ab1c-fb2037e20b0e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:22.504299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08b6f61e-b9d3-4688-ab1c-fb2037e20b0e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:22.506369 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08b6f61e-b9d3-4688-ab1c-fb2037e20b0e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:22.507858 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08b6f61e-b9d3-4688-ab1c-fb2037e20b0e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:22.557217 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-08b6f61e-b9d3-4688-ab1c-fb2037e20b0e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: f09b5c28-821c-4b0e-be61-2f1acfeb47d1] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:11:22.631808 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06ba0fa8-0c47-405e-a4f1-50d7c96746a0 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:22.641983 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06ba0fa8-0c47-405e-a4f1-50d7c96746a0 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:22.643372 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06ba0fa8-0c47-405e-a4f1-50d7c96746a0 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:22.646049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-06ba0fa8-0c47-405e-a4f1-50d7c96746a0 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lazy-loading 'fault' on Instance uuid ba5547ed-1146-4e61-88a2-c64319615360 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:11:22.757902 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-08b6f61e-b9d3-4688-ab1c-fb2037e20b0e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1" status: 204 len: 0 microversion: 2.1 time: 0.306046 Sep 17 21:11:22.761423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-06ba0fa8-0c47-405e-a4f1-50d7c96746a0 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:22.764190 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2305/4713] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:11:22 2022] DELETE /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:11:22.771510 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-06ba0fa8-0c47-405e-a4f1-50d7c96746a0 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:22.774091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9f5d6449-a137-4886-80f5-91c817229928 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:22.775665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-06ba0fa8-0c47-405e-a4f1-50d7c96746a0 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e8b19d9480444a44a48ac3c5efe7fe17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7a3c50d58d347d0a4467cd4e61b06e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:22.776941 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9f5d6449-a137-4886-80f5-91c817229928 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] [instance: 14f66e5d-ada6-41ab-b6d1-32343c852f5e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:22.777725 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-06ba0fa8-0c47-405e-a4f1-50d7c96746a0 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 200 len: 1411 microversion: 2.54 time: 0.342499 Sep 17 21:11:22.778927 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2409/4714] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:11:22 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 1411 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:11:22.786632 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f5d6449-a137-4886-80f5-91c817229928 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:22.787270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f5d6449-a137-4886-80f5-91c817229928 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:22.792651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f5d6449-a137-4886-80f5-91c817229928 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:22.792651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f5d6449-a137-4886-80f5-91c817229928 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:22.793148 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f5d6449-a137-4886-80f5-91c817229928 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:22.793564 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9f5d6449-a137-4886-80f5-91c817229928 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:22.798928 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f0b243f6-2584-449e-8e07-efcbd9036943 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a40149d0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:22.907096 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f0b243f6-2584-449e-8e07-efcbd9036943 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418" status: 200 len: 1429 microversion: 2.1 time: 0.125064 Sep 17 21:11:22.907769 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2410/4715] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:22 2022] GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418 => generated 1429 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:22.925277 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d7312d75-b27e-45e6-9634-e0244fba913f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:22.925277 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d7312d75-b27e-45e6-9634-e0244fba913f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: f09b5c28-821c-4b0e-be61-2f1acfeb47d1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:22.952834 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d7312d75-b27e-45e6-9634-e0244fba913f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:22.953361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d7312d75-b27e-45e6-9634-e0244fba913f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:22.955552 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d7312d75-b27e-45e6-9634-e0244fba913f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:22.955552 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d7312d75-b27e-45e6-9634-e0244fba913f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:22.955552 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d7312d75-b27e-45e6-9634-e0244fba913f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:22.955552 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d7312d75-b27e-45e6-9634-e0244fba913f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:23.070854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9f5d6449-a137-4886-80f5-91c817229928 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e12ad7a93ae4a9a95b2a54c1a2b9845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9818fed65901412b8da672532cc5bc52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:23.083060 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9f5d6449-a137-4886-80f5-91c817229928 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] 10.222.0.26 "GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e" status: 200 len: 1465 microversion: 2.1 time: 0.316763 Sep 17 21:11:23.091209 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2306/4716] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:22 2022] GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e => generated 1465 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:23.148629 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e6dda78b-c18b-4730-8d9b-89af6e693c7f tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:23.149188 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e6dda78b-c18b-4730-8d9b-89af6e693c7f tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] [instance: 14f66e5d-ada6-41ab-b6d1-32343c852f5e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:23.157544 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6dda78b-c18b-4730-8d9b-89af6e693c7f tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:23.158064 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6dda78b-c18b-4730-8d9b-89af6e693c7f tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:23.159299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6dda78b-c18b-4730-8d9b-89af6e693c7f tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:23.160864 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6dda78b-c18b-4730-8d9b-89af6e693c7f tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:23.161566 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6dda78b-c18b-4730-8d9b-89af6e693c7f tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:23.162158 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6dda78b-c18b-4730-8d9b-89af6e693c7f tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:23.211737 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e6dda78b-c18b-4730-8d9b-89af6e693c7f tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] [instance: 14f66e5d-ada6-41ab-b6d1-32343c852f5e] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:11:23.229947 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d7312d75-b27e-45e6-9634-e0244fba913f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:23.245374 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d7312d75-b27e-45e6-9634-e0244fba913f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1" status: 200 len: 1496 microversion: 2.1 time: 0.336403 Sep 17 21:11:23.246027 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2411/4717] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:22 2022] GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1 => generated 1496 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:23.405548 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e6dda78b-c18b-4730-8d9b-89af6e693c7f tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] 10.222.0.26 "DELETE /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e" status: 204 len: 0 microversion: 2.1 time: 0.259440 Sep 17 21:11:23.409039 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2307/4718] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:11:23 2022] DELETE /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 17 21:11:23.428090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-74ad48a1-9560-4333-ad55-1c0d4b080fbb tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:23.429290 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-74ad48a1-9560-4333-ad55-1c0d4b080fbb tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] [instance: 14f66e5d-ada6-41ab-b6d1-32343c852f5e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:23.438881 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74ad48a1-9560-4333-ad55-1c0d4b080fbb tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:23.439731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74ad48a1-9560-4333-ad55-1c0d4b080fbb tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:23.441050 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74ad48a1-9560-4333-ad55-1c0d4b080fbb tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:23.443012 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74ad48a1-9560-4333-ad55-1c0d4b080fbb tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:23.443834 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74ad48a1-9560-4333-ad55-1c0d4b080fbb tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:23.444805 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74ad48a1-9560-4333-ad55-1c0d4b080fbb tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:23.739803 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-74ad48a1-9560-4333-ad55-1c0d4b080fbb tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e12ad7a93ae4a9a95b2a54c1a2b9845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9818fed65901412b8da672532cc5bc52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:23.749076 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-74ad48a1-9560-4333-ad55-1c0d4b080fbb tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] 10.222.0.26 "GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e" status: 200 len: 1471 microversion: 2.1 time: 0.335178 Sep 17 21:11:23.751506 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2308/4719] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:23 2022] GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e => generated 1471 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:23.808088 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ff302c7c-5ba2-4177-8eba-e5fc1ff737a5 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:23.808894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ff302c7c-5ba2-4177-8eba-e5fc1ff737a5 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] [instance: ba5547ed-1146-4e61-88a2-c64319615360] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:23.823045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff302c7c-5ba2-4177-8eba-e5fc1ff737a5 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:23.824066 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff302c7c-5ba2-4177-8eba-e5fc1ff737a5 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:23.824319 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff302c7c-5ba2-4177-8eba-e5fc1ff737a5 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:23.825734 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff302c7c-5ba2-4177-8eba-e5fc1ff737a5 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:23.831379 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff302c7c-5ba2-4177-8eba-e5fc1ff737a5 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:23.832721 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ff302c7c-5ba2-4177-8eba-e5fc1ff737a5 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:23.864258 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-ff302c7c-5ba2-4177-8eba-e5fc1ff737a5 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] HTTP exception thrown: Instance ba5547ed-1146-4e61-88a2-c64319615360 could not be found. Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ff302c7c-5ba2-4177-8eba-e5fc1ff737a5 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Request method failure captured: Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 HTTP/1.1 Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjfJLLStBgJ3rcaodOMSuOgPbgk0sPehpTruOwAN8M859OUhAFJzpzg31sW8NZdbGylDSzzW7kLqeJLMp9W8rn9f59bFROfdRzLiTQYPHXg3u5Qti1OBu2pmkhJEipr0GUq_-iMjDkGqla8kR7r-rSnO5qJaZn-8BtdysnUe-Rug7gk Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: X-Openstack-Nova-Api-Version: 2.54 Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: f7a3c50d58d347d0a4467cd4e61b06e0 Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerShowV254Test-1951134767 Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7a3c50d58d347d0a4467cd4e61b06e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f7a3c50d58d347d0a4467cd4e61b06e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f7a3c50d58d347d0a4467cd4e61b06e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f7a3c50d58d347d0a4467cd4e61b06e0", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerShowV254Test-1951134767 Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: f7a3c50d58d347d0a4467cd4e61b06e0 Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerShowV254Test-1951134767 Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerShowV254Test-1951134767-project Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: e8b19d9480444a44a48ac3c5efe7fe17 Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerShowV254Test-1951134767-project Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance ba5547ed-1146-4e61-88a2-c64319615360 could not be found. Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'ba5547ed-1146-4e61-88a2-c64319615360'} Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba5547ed-1146-4e61-88a2-c64319615360 could not be found. Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba5547ed-1146-4e61-88a2-c64319615360 could not be found. Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:23.867842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:23.873398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:23.873398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:23.873398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:23.873398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:11:23.873398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:11:23.873398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba5547ed-1146-4e61-88a2-c64319615360 could not be found. Sep 17 21:11:23.873398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:23.873398 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ff302c7c-5ba2-4177-8eba-e5fc1ff737a5 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] Returning 404 to user: Instance ba5547ed-1146-4e61-88a2-c64319615360 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:11:23.876933 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ff302c7c-5ba2-4177-8eba-e5fc1ff737a5 tempest-ServerShowV254Test-1951134767 tempest-ServerShowV254Test-1951134767-project] 10.222.0.26 "GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360" status: 404 len: 111 microversion: 2.54 time: 0.070535 Sep 17 21:11:23.884290 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2309/4720] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:11:23 2022] GET /compute/v2.1/servers/ba5547ed-1146-4e61-88a2-c64319615360 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:11:23.902187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c5c8b06f-1faf-4d5f-b4c5-a62e2b4b73b6 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:23.902992 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c5c8b06f-1faf-4d5f-b4c5-a62e2b4b73b6 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0e3e136c-7043-4c24-bf6d-f33bf379e7cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:23.915246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c5c8b06f-1faf-4d5f-b4c5-a62e2b4b73b6 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:23.917341 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c5c8b06f-1faf-4d5f-b4c5-a62e2b4b73b6 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:23.924375 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-976a1150-b38c-463c-9871-43fe939c4e80 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a49f38b0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:23.930440 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c5c8b06f-1faf-4d5f-b4c5-a62e2b4b73b6 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:23.932078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c5c8b06f-1faf-4d5f-b4c5-a62e2b4b73b6 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:23.937152 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c5c8b06f-1faf-4d5f-b4c5-a62e2b4b73b6 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:23.938049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c5c8b06f-1faf-4d5f-b4c5-a62e2b4b73b6 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:24.006103 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c5c8b06f-1faf-4d5f-b4c5-a62e2b4b73b6 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc/ips" status: 200 len: 150 microversion: 2.1 time: 0.643785 Sep 17 21:11:24.013354 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2412/4721] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Sep 17 21:11:23 2022] GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc/ips => generated 150 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:11:24.046395 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-976a1150-b38c-463c-9871-43fe939c4e80 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418" status: 200 len: 1429 microversion: 2.1 time: 0.127486 Sep 17 21:11:24.047296 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2310/4722] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:23 2022] GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418 => generated 1429 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:11:24.276966 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-11cb3307-f24d-4115-844c-386a9293d7a1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:24.277759 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-11cb3307-f24d-4115-844c-386a9293d7a1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: f09b5c28-821c-4b0e-be61-2f1acfeb47d1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:24.290847 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-11cb3307-f24d-4115-844c-386a9293d7a1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:24.292634 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-11cb3307-f24d-4115-844c-386a9293d7a1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:24.294844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-11cb3307-f24d-4115-844c-386a9293d7a1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:24.295787 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-11cb3307-f24d-4115-844c-386a9293d7a1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:24.296270 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-11cb3307-f24d-4115-844c-386a9293d7a1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:24.297276 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-11cb3307-f24d-4115-844c-386a9293d7a1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:24.688394 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-11cb3307-f24d-4115-844c-386a9293d7a1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:24.710285 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-11cb3307-f24d-4115-844c-386a9293d7a1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1" status: 200 len: 1496 microversion: 2.1 time: 0.439816 Sep 17 21:11:24.714503 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2413/4723] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:24 2022] GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1 => generated 1496 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:24.783564 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-867cf583-95a9-4f3d-b3d8-746669823f5a tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:24.785539 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-867cf583-95a9-4f3d-b3d8-746669823f5a tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] [instance: 14f66e5d-ada6-41ab-b6d1-32343c852f5e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:24.802195 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-867cf583-95a9-4f3d-b3d8-746669823f5a tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:24.803022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-867cf583-95a9-4f3d-b3d8-746669823f5a tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:24.803628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-867cf583-95a9-4f3d-b3d8-746669823f5a tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:24.804573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-867cf583-95a9-4f3d-b3d8-746669823f5a tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:24.806506 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-867cf583-95a9-4f3d-b3d8-746669823f5a tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:24.807379 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-867cf583-95a9-4f3d-b3d8-746669823f5a tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:25.065282 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-533323af-af3c-4b13-8f75-2187f70a66a3 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a57d70d0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:25.146334 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-533323af-af3c-4b13-8f75-2187f70a66a3 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418" status: 200 len: 1429 microversion: 2.1 time: 0.087042 Sep 17 21:11:25.146946 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2414/4724] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:25 2022] GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418 => generated 1429 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:11:25.244569 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-867cf583-95a9-4f3d-b3d8-746669823f5a tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e12ad7a93ae4a9a95b2a54c1a2b9845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9818fed65901412b8da672532cc5bc52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:25.261423 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-867cf583-95a9-4f3d-b3d8-746669823f5a tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] 10.222.0.26 "GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e" status: 200 len: 1471 microversion: 2.1 time: 0.484583 Sep 17 21:11:25.274175 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2311/4725] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:24 2022] GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e => generated 1471 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:25.740419 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-10bf2c7d-67ce-4196-9eb0-fc0126d2c228 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:25.743750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-10bf2c7d-67ce-4196-9eb0-fc0126d2c228 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: f09b5c28-821c-4b0e-be61-2f1acfeb47d1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:25.758734 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10bf2c7d-67ce-4196-9eb0-fc0126d2c228 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:25.758869 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10bf2c7d-67ce-4196-9eb0-fc0126d2c228 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:25.759213 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10bf2c7d-67ce-4196-9eb0-fc0126d2c228 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:25.781091 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10bf2c7d-67ce-4196-9eb0-fc0126d2c228 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:25.783161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10bf2c7d-67ce-4196-9eb0-fc0126d2c228 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:25.784547 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10bf2c7d-67ce-4196-9eb0-fc0126d2c228 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:25.817188 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c1db15b6-dea2-4956-a5d0-fa57587d78cb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06e1e35e-a1c2-4ffd-b75a-88d143d3a4e2"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:25.820359 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c1db15b6-dea2-4956-a5d0-fa57587d78cb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0e3e136c-7043-4c24-bf6d-f33bf379e7cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:25.840612 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c1db15b6-dea2-4956-a5d0-fa57587d78cb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:25.841893 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c1db15b6-dea2-4956-a5d0-fa57587d78cb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:25.845248 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c1db15b6-dea2-4956-a5d0-fa57587d78cb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:25.847723 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c1db15b6-dea2-4956-a5d0-fa57587d78cb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:25.848557 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c1db15b6-dea2-4956-a5d0-fa57587d78cb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:25.850583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c1db15b6-dea2-4956-a5d0-fa57587d78cb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:26.189371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-10bf2c7d-67ce-4196-9eb0-fc0126d2c228 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:26.191793 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:11:26.199595 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-10bf2c7d-67ce-4196-9eb0-fc0126d2c228 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1" status: 200 len: 1454 microversion: 2.1 time: 0.463188 Sep 17 21:11:26.200244 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2415/4726] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:25 2022] GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1 => generated 1454 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:26.232447 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-517beb1d-56ab-4f43-b197-2f51d045c909 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a4101b80>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:26.320510 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-517beb1d-56ab-4f43-b197-2f51d045c909 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418" status: 200 len: 1429 microversion: 2.1 time: 0.118994 Sep 17 21:11:26.321866 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2416/4727] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:26 2022] GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418 => generated 1429 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:26.334958 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-40bdaba7-4753-4a66-bb8f-480d16fe6eb4 req-95a4daab-711d-49f7-a586-fe56e2ecbd2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f09b5c28-821c-4b0e-be61-2f1acfeb47d1", "name": "network-vif-deleted", "tag": "cb7b746e-1be8-47ec-af5e-1175a22b0d23"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:26.369347 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-40bdaba7-4753-4a66-bb8f-480d16fe6eb4 req-95a4daab-711d-49f7-a586-fe56e2ecbd2a service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:26.370245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-40bdaba7-4753-4a66-bb8f-480d16fe6eb4 req-95a4daab-711d-49f7-a586-fe56e2ecbd2a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:26.370897 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-40bdaba7-4753-4a66-bb8f-480d16fe6eb4 req-95a4daab-711d-49f7-a586-fe56e2ecbd2a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:26.390749 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-40bdaba7-4753-4a66-bb8f-480d16fe6eb4 req-95a4daab-711d-49f7-a586-fe56e2ecbd2a service nova] Creating event network-vif-deleted:cb7b746e-1be8-47ec-af5e-1175a22b0d23 for instance f09b5c28-821c-4b0e-be61-2f1acfeb47d1 on nch2-master-1 Sep 17 21:11:26.396852 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-40bdaba7-4753-4a66-bb8f-480d16fe6eb4 req-95a4daab-711d-49f7-a586-fe56e2ecbd2a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073502 Sep 17 21:11:26.398743 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2417/4728] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:11:26.407142 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f2b1d275-a736-41f9-ab49-014388d5316e tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:26.408240 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f2b1d275-a736-41f9-ab49-014388d5316e tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] [instance: 14f66e5d-ada6-41ab-b6d1-32343c852f5e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:26.416208 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f2b1d275-a736-41f9-ab49-014388d5316e tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:26.416964 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f2b1d275-a736-41f9-ab49-014388d5316e tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:26.417708 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f2b1d275-a736-41f9-ab49-014388d5316e tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:26.420173 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f2b1d275-a736-41f9-ab49-014388d5316e tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:26.420998 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f2b1d275-a736-41f9-ab49-014388d5316e tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:26.421845 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f2b1d275-a736-41f9-ab49-014388d5316e tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:26.480660 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c1db15b6-dea2-4956-a5d0-fa57587d78cb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "POST /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.667229 Sep 17 21:11:26.486072 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2312/4729] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 17 21:11:25 2022] POST /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc/os-volume_attachments => generated 194 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:11:27.261643 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f5f21920-8983-4f71-87fc-95791998349d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:27.278434 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f5f21920-8983-4f71-87fc-95791998349d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: f09b5c28-821c-4b0e-be61-2f1acfeb47d1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:27.346145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f5f21920-8983-4f71-87fc-95791998349d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:27.351278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f5f21920-8983-4f71-87fc-95791998349d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:27.357180 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f5f21920-8983-4f71-87fc-95791998349d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:27.358570 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f5f21920-8983-4f71-87fc-95791998349d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:27.364322 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f5f21920-8983-4f71-87fc-95791998349d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:27.366758 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f5f21920-8983-4f71-87fc-95791998349d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:27.493405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f5f21920-8983-4f71-87fc-95791998349d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:27.496265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f5f21920-8983-4f71-87fc-95791998349d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:27.497201 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f5f21920-8983-4f71-87fc-95791998349d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:27.499039 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-f5f21920-8983-4f71-87fc-95791998349d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lazy-loading 'fault' on Instance uuid f09b5c28-821c-4b0e-be61-2f1acfeb47d1 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:11:27.822251 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f5f21920-8983-4f71-87fc-95791998349d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:27.833489 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f5f21920-8983-4f71-87fc-95791998349d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1" status: 200 len: 1299 microversion: 2.1 time: 0.598841 Sep 17 21:11:27.834277 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2313/4730] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:27 2022] GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1 => generated 1299 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:27.849754 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-92e90299-358b-4818-8090-24dc47d675ec tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a4fc49d0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:27.927810 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-92e90299-358b-4818-8090-24dc47d675ec tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418" status: 200 len: 1429 microversion: 2.1 time: 0.092084 Sep 17 21:11:27.930001 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2314/4731] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:27 2022] GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418 => generated 1429 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:28.050108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f2b1d275-a736-41f9-ab49-014388d5316e tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e12ad7a93ae4a9a95b2a54c1a2b9845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9818fed65901412b8da672532cc5bc52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:28.065716 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f2b1d275-a736-41f9-ab49-014388d5316e tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] 10.222.0.26 "GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e" status: 200 len: 1471 microversion: 2.1 time: 1.665098 Sep 17 21:11:28.098756 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2418/4732] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:26 2022] GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e => generated 1471 bytes in 1699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:28.233676 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-5b143065-76b3-4571-a7d3-be04365bd619 req-d678030d-844a-49b3-a856-d1a84e409fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14f66e5d-ada6-41ab-b6d1-32343c852f5e", "name": "network-vif-unplugged", "status": "completed", "tag": "5a1f92ec-050d-42de-96a1-54de3f8fa611"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:28.265021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-5b143065-76b3-4571-a7d3-be04365bd619 req-d678030d-844a-49b3-a856-d1a84e409fb7 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:28.265809 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-5b143065-76b3-4571-a7d3-be04365bd619 req-d678030d-844a-49b3-a856-d1a84e409fb7 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:28.271896 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-5b143065-76b3-4571-a7d3-be04365bd619 req-d678030d-844a-49b3-a856-d1a84e409fb7 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:28.328177 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-5b143065-76b3-4571-a7d3-be04365bd619 req-d678030d-844a-49b3-a856-d1a84e409fb7 service nova] Creating event network-vif-unplugged:5a1f92ec-050d-42de-96a1-54de3f8fa611 for instance 14f66e5d-ada6-41ab-b6d1-32343c852f5e on nch2-master-1 Sep 17 21:11:28.347303 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-5b143065-76b3-4571-a7d3-be04365bd619 req-d678030d-844a-49b3-a856-d1a84e409fb7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117882 Sep 17 21:11:28.356446 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2315/4733] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:11:28.863959 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-45744c4e-ea29-4691-a76b-f90082719dd4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:28.867501 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-45744c4e-ea29-4691-a76b-f90082719dd4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: f09b5c28-821c-4b0e-be61-2f1acfeb47d1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:28.888755 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45744c4e-ea29-4691-a76b-f90082719dd4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:28.889809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45744c4e-ea29-4691-a76b-f90082719dd4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:28.890446 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45744c4e-ea29-4691-a76b-f90082719dd4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:28.893136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45744c4e-ea29-4691-a76b-f90082719dd4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:28.895713 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45744c4e-ea29-4691-a76b-f90082719dd4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:28.896466 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-45744c4e-ea29-4691-a76b-f90082719dd4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:28.932281 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-45744c4e-ea29-4691-a76b-f90082719dd4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] HTTP exception thrown: Instance f09b5c28-821c-4b0e-be61-2f1acfeb47d1 could not be found. Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-45744c4e-ea29-4691-a76b-f90082719dd4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Request method failure captured: Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1 HTTP/1.1 Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjdkx_dUaa7DUi-TKVFHTZsVxQrlexvG4SUZm6N8-RAgW-Hgl4Fm16QKjLB8Smzb7fg0_3Heh2RxRO4DM6alOpTGfM4lDQjx-JBymYUztOAuBANR84PPvzFMKCK9hdlODMbdRT3LVU-maWvSxN-XNtXdSltD2p8By-EmBSmK4dFa6Xo Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersTestJSON-167161476 Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b6f25c3540546bf9bffd5610f4f86c8", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersTestJSON-167161476 Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersTestJSON-167161476 Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersTestJSON-167161476-project Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 784233ee78764e7dbb774d3cb50165e3 Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersTestJSON-167161476-project Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance f09b5c28-821c-4b0e-be61-2f1acfeb47d1 could not be found. Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'f09b5c28-821c-4b0e-be61-2f1acfeb47d1'} Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f09b5c28-821c-4b0e-be61-2f1acfeb47d1 could not be found. Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f09b5c28-821c-4b0e-be61-2f1acfeb47d1 could not be found. Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:28.935757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:28.940251 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:28.940251 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:28.940251 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:11:28.940251 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:11:28.940251 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f09b5c28-821c-4b0e-be61-2f1acfeb47d1 could not be found. Sep 17 21:11:28.940251 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:28.952074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-14ea6d86-141a-42bb-afe9-5bc11c6ee001 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a4ca6f70>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:28.959565 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-45744c4e-ea29-4691-a76b-f90082719dd4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Returning 404 to user: Instance f09b5c28-821c-4b0e-be61-2f1acfeb47d1 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:11:28.969064 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-45744c4e-ea29-4691-a76b-f90082719dd4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1" status: 404 len: 111 microversion: 2.1 time: 0.102041 Sep 17 21:11:28.972439 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2419/4734] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:28 2022] GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:11:28.995735 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b20c1f24-2775-45ab-98a3-3802c248b408 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:29.000046 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b20c1f24-2775-45ab-98a3-3802c248b408 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 640f82db-299b-42a4-a6b6-0a286b8220c9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:29.028222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b20c1f24-2775-45ab-98a3-3802c248b408 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:29.029161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b20c1f24-2775-45ab-98a3-3802c248b408 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:29.030174 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b20c1f24-2775-45ab-98a3-3802c248b408 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:29.031177 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b20c1f24-2775-45ab-98a3-3802c248b408 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:29.031858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b20c1f24-2775-45ab-98a3-3802c248b408 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:29.032499 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b20c1f24-2775-45ab-98a3-3802c248b408 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:29.067614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b20c1f24-2775-45ab-98a3-3802c248b408 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 640f82db-299b-42a4-a6b6-0a286b8220c9] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:11:29.098780 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-14ea6d86-141a-42bb-afe9-5bc11c6ee001 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418" status: 200 len: 1429 microversion: 2.1 time: 0.153250 Sep 17 21:11:29.104315 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2316/4735] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:28 2022] GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418 => generated 1429 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:29.120668 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fd01a30e-1c57-4a4a-8ce6-0aad1c59a3db tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:29.125716 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fd01a30e-1c57-4a4a-8ce6-0aad1c59a3db tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] [instance: 14f66e5d-ada6-41ab-b6d1-32343c852f5e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:29.159076 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd01a30e-1c57-4a4a-8ce6-0aad1c59a3db tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:29.159605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd01a30e-1c57-4a4a-8ce6-0aad1c59a3db tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:29.160061 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd01a30e-1c57-4a4a-8ce6-0aad1c59a3db tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:29.160819 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd01a30e-1c57-4a4a-8ce6-0aad1c59a3db tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:29.161295 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd01a30e-1c57-4a4a-8ce6-0aad1c59a3db tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:29.161776 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd01a30e-1c57-4a4a-8ce6-0aad1c59a3db tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:29.264322 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b20c1f24-2775-45ab-98a3-3802c248b408 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "DELETE /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9" status: 204 len: 0 microversion: 2.1 time: 0.286189 Sep 17 21:11:29.268995 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2420/4736] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:11:28 2022] DELETE /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:11:29.291222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3169fb60-8773-4541-bbbe-e3529181d26e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:29.299123 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3169fb60-8773-4541-bbbe-e3529181d26e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 640f82db-299b-42a4-a6b6-0a286b8220c9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:29.319525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3169fb60-8773-4541-bbbe-e3529181d26e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:29.329774 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3169fb60-8773-4541-bbbe-e3529181d26e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:29.330403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3169fb60-8773-4541-bbbe-e3529181d26e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:29.332250 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3169fb60-8773-4541-bbbe-e3529181d26e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:29.337434 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3169fb60-8773-4541-bbbe-e3529181d26e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:29.339183 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3169fb60-8773-4541-bbbe-e3529181d26e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:29.733529 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fd01a30e-1c57-4a4a-8ce6-0aad1c59a3db tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e12ad7a93ae4a9a95b2a54c1a2b9845', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9818fed65901412b8da672532cc5bc52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:29.754524 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fd01a30e-1c57-4a4a-8ce6-0aad1c59a3db tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] 10.222.0.26 "GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e" status: 200 len: 1429 microversion: 2.1 time: 0.637104 Sep 17 21:11:29.755936 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2317/4737] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:29 2022] GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e => generated 1429 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:29.777079 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-227ecaff-f0f9-4eca-9aca-dcfa17f17700 req-18d6cb4d-9a0f-4b67-893d-7ec510408631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14f66e5d-ada6-41ab-b6d1-32343c852f5e", "name": "network-vif-deleted", "tag": "5a1f92ec-050d-42de-96a1-54de3f8fa611"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:29.809959 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-227ecaff-f0f9-4eca-9aca-dcfa17f17700 req-18d6cb4d-9a0f-4b67-893d-7ec510408631 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:29.818290 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-227ecaff-f0f9-4eca-9aca-dcfa17f17700 req-18d6cb4d-9a0f-4b67-893d-7ec510408631 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:29.820710 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-227ecaff-f0f9-4eca-9aca-dcfa17f17700 req-18d6cb4d-9a0f-4b67-893d-7ec510408631 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:29.849834 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-227ecaff-f0f9-4eca-9aca-dcfa17f17700 req-18d6cb4d-9a0f-4b67-893d-7ec510408631 service nova] Creating event network-vif-deleted:5a1f92ec-050d-42de-96a1-54de3f8fa611 for instance 14f66e5d-ada6-41ab-b6d1-32343c852f5e on nch2-master-1 Sep 17 21:11:29.860839 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-227ecaff-f0f9-4eca-9aca-dcfa17f17700 req-18d6cb4d-9a0f-4b67-893d-7ec510408631 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102084 Sep 17 21:11:29.862767 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2318/4738] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:11:29.971963 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3169fb60-8773-4541-bbbe-e3529181d26e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:29.982237 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3169fb60-8773-4541-bbbe-e3529181d26e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9" status: 200 len: 1496 microversion: 2.1 time: 0.708625 Sep 17 21:11:29.982838 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2421/4739] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:29 2022] GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9 => generated 1496 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:30.120659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4210a04a-6bb0-40a4-b3b7-5a1f89492ca3 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a4cd3e50>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:30.200846 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4210a04a-6bb0-40a4-b3b7-5a1f89492ca3 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418" status: 200 len: 1429 microversion: 2.1 time: 0.085727 Sep 17 21:11:30.201852 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2319/4740] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:30 2022] GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418 => generated 1429 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:30.810706 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c7cdf086-c1ff-4a26-b868-891382673588 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:30.816940 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c7cdf086-c1ff-4a26-b868-891382673588 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] [instance: 14f66e5d-ada6-41ab-b6d1-32343c852f5e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:30.839830 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:11:30.845209 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c7cdf086-c1ff-4a26-b868-891382673588 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:30.847394 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c7cdf086-c1ff-4a26-b868-891382673588 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:30.848919 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c7cdf086-c1ff-4a26-b868-891382673588 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:30.850148 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c7cdf086-c1ff-4a26-b868-891382673588 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:30.853338 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c7cdf086-c1ff-4a26-b868-891382673588 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:30.854104 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c7cdf086-c1ff-4a26-b868-891382673588 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:30.889173 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-c7cdf086-c1ff-4a26-b868-891382673588 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] HTTP exception thrown: Instance 14f66e5d-ada6-41ab-b6d1-32343c852f5e could not be found. Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c7cdf086-c1ff-4a26-b868-891382673588 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Request method failure captured: Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e HTTP/1.1 Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjffEuMIwGo4T2FYhdHUbBSWG8t3PGmxpgEl1F9I-cyi9KKavpKKmcKnn-qaNQYZrfaSVY-mNqlZNbqk-Z7wcB3T9onwYzig29swyOTZ21s7myLMM1hpCu5WSeJ0XIB0_-Z8YBLV6jlsAbOMbwEMBPXnekUrhlxDVelz2Qcts8w97SE Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 9818fed65901412b8da672532cc5bc52 Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-VolumesNegativeTest-1272947138 Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9818fed65901412b8da672532cc5bc52"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9818fed65901412b8da672532cc5bc52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9818fed65901412b8da672532cc5bc52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9818fed65901412b8da672532cc5bc52", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-VolumesNegativeTest-1272947138 Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 9818fed65901412b8da672532cc5bc52 Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-VolumesNegativeTest-1272947138 Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-VolumesNegativeTest-1272947138-project Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 7e12ad7a93ae4a9a95b2a54c1a2b9845 Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-VolumesNegativeTest-1272947138-project Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 14f66e5d-ada6-41ab-b6d1-32343c852f5e could not be found. Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '14f66e5d-ada6-41ab-b6d1-32343c852f5e'} Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14f66e5d-ada6-41ab-b6d1-32343c852f5e could not be found. Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14f66e5d-ada6-41ab-b6d1-32343c852f5e could not be found. Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:30.891471 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:30.897676 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:30.897676 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:30.897676 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:30.897676 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:11:30.897676 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:11:30.897676 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14f66e5d-ada6-41ab-b6d1-32343c852f5e could not be found. Sep 17 21:11:30.897676 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:30.899707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c7cdf086-c1ff-4a26-b868-891382673588 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] Returning 404 to user: Instance 14f66e5d-ada6-41ab-b6d1-32343c852f5e could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:11:30.900802 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c7cdf086-c1ff-4a26-b868-891382673588 tempest-VolumesNegativeTest-1272947138 tempest-VolumesNegativeTest-1272947138-project] 10.222.0.26 "GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e" status: 404 len: 111 microversion: 2.1 time: 0.121595 Sep 17 21:11:30.901996 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2422/4741] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:30 2022] GET /compute/v2.1/servers/14f66e5d-ada6-41ab-b6d1-32343c852f5e => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:11:31.010335 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4cf4a92e-6ecf-450c-ad20-d0d1d212ce75 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:31.011145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4cf4a92e-6ecf-450c-ad20-d0d1d212ce75 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 640f82db-299b-42a4-a6b6-0a286b8220c9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:31.032610 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4cf4a92e-6ecf-450c-ad20-d0d1d212ce75 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:31.033130 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4cf4a92e-6ecf-450c-ad20-d0d1d212ce75 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:31.033599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4cf4a92e-6ecf-450c-ad20-d0d1d212ce75 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:31.040159 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4cf4a92e-6ecf-450c-ad20-d0d1d212ce75 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:31.044020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4cf4a92e-6ecf-450c-ad20-d0d1d212ce75 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:31.046236 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4cf4a92e-6ecf-450c-ad20-d0d1d212ce75 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:31.217600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f964510c-6a94-4107-95c6-29c17a0a2a57 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a5b15f70>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:31.558059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4cf4a92e-6ecf-450c-ad20-d0d1d212ce75 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:31.572542 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4cf4a92e-6ecf-450c-ad20-d0d1d212ce75 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9" status: 200 len: 1496 microversion: 2.1 time: 0.569841 Sep 17 21:11:31.573167 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2320/4742] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:31 2022] GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9 => generated 1496 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:31.594493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b0ef5191-6da9-44ce-ae12-b059214342ee tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:31.595026 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b0ef5191-6da9-44ce-ae12-b059214342ee tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0e3e136c-7043-4c24-bf6d-f33bf379e7cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:31.615350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0ef5191-6da9-44ce-ae12-b059214342ee tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:31.617384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0ef5191-6da9-44ce-ae12-b059214342ee tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:31.618261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0ef5191-6da9-44ce-ae12-b059214342ee tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:31.623559 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0ef5191-6da9-44ce-ae12-b059214342ee tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:31.625070 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0ef5191-6da9-44ce-ae12-b059214342ee tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:31.625920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0ef5191-6da9-44ce-ae12-b059214342ee tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:31.870920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-b0ef5191-6da9-44ce-ae12-b059214342ee tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lazy-loading 'services' on Instance uuid 0e3e136c-7043-4c24-bf6d-f33bf379e7cc {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:11:32.100306 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:11:32.163607 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b0ef5191-6da9-44ce-ae12-b059214342ee tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc/os-volume_attachments/06e1e35e-a1c2-4ffd-b75a-88d143d3a4e2" status: 202 len: 0 microversion: 2.1 time: 0.585183 Sep 17 21:11:32.167787 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2321/4743] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Sep 17 21:11:31 2022] DELETE /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc/os-volume_attachments/06e1e35e-a1c2-4ffd-b75a-88d143d3a4e2 => generated 0 bytes in 594 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:11:32.198031 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6983f805-64c6-48ce-ab84-af9d8273a57a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:32.221549 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6983f805-64c6-48ce-ab84-af9d8273a57a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0e3e136c-7043-4c24-bf6d-f33bf379e7cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:32.277624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6983f805-64c6-48ce-ab84-af9d8273a57a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:32.278531 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6983f805-64c6-48ce-ab84-af9d8273a57a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:32.279451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6983f805-64c6-48ce-ab84-af9d8273a57a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:32.280977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6983f805-64c6-48ce-ab84-af9d8273a57a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:32.281814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6983f805-64c6-48ce-ab84-af9d8273a57a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:32.282439 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6983f805-64c6-48ce-ab84-af9d8273a57a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:32.363190 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6983f805-64c6-48ce-ab84-af9d8273a57a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.190282 Sep 17 21:11:32.364334 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2322/4744] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 17 21:11:32 2022] GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:11:32.615616 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-72d5dcea-2972-4b6c-b8e5-8171200e7123 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:32.616089 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-72d5dcea-2972-4b6c-b8e5-8171200e7123 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 640f82db-299b-42a4-a6b6-0a286b8220c9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:32.623261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-72d5dcea-2972-4b6c-b8e5-8171200e7123 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:32.625094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-72d5dcea-2972-4b6c-b8e5-8171200e7123 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:32.625922 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-72d5dcea-2972-4b6c-b8e5-8171200e7123 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:32.626977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-72d5dcea-2972-4b6c-b8e5-8171200e7123 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:32.627958 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-72d5dcea-2972-4b6c-b8e5-8171200e7123 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:32.628673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-72d5dcea-2972-4b6c-b8e5-8171200e7123 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:32.920258 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f964510c-6a94-4107-95c6-29c17a0a2a57 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418" status: 200 len: 1429 microversion: 2.1 time: 1.706906 Sep 17 21:11:32.929295 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2423/4745] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:31 2022] GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418 => generated 1429 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:11:32.948037 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-c998aed7-70ad-4a14-a4b5-710181c89988 req-800de340-1f53-43ac-b1db-9777e38489fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "640f82db-299b-42a4-a6b6-0a286b8220c9", "name": "network-vif-deleted", "tag": "111dfd5b-5e71-4bad-94d3-ca63cddba527"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:32.955222 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-72d5dcea-2972-4b6c-b8e5-8171200e7123 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:32.970220 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c998aed7-70ad-4a14-a4b5-710181c89988 req-800de340-1f53-43ac-b1db-9777e38489fb service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:32.972098 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c998aed7-70ad-4a14-a4b5-710181c89988 req-800de340-1f53-43ac-b1db-9777e38489fb service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:32.972908 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c998aed7-70ad-4a14-a4b5-710181c89988 req-800de340-1f53-43ac-b1db-9777e38489fb service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:32.986943 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-c998aed7-70ad-4a14-a4b5-710181c89988 req-800de340-1f53-43ac-b1db-9777e38489fb service nova] Creating event network-vif-deleted:111dfd5b-5e71-4bad-94d3-ca63cddba527 for instance 640f82db-299b-42a4-a6b6-0a286b8220c9 on nch1-master-1 Sep 17 21:11:32.992798 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-72d5dcea-2972-4b6c-b8e5-8171200e7123 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9" status: 200 len: 1454 microversion: 2.1 time: 0.357628 Sep 17 21:11:32.993395 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-c998aed7-70ad-4a14-a4b5-710181c89988 req-800de340-1f53-43ac-b1db-9777e38489fb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062175 Sep 17 21:11:32.994255 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2424/4746] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:11:33.009302 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2323/4747] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:32 2022] GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9 => generated 1454 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:33.377668 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f0b5dec3-436e-4602-854b-a289c0a98b74 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:33.381757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f0b5dec3-436e-4602-854b-a289c0a98b74 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0e3e136c-7043-4c24-bf6d-f33bf379e7cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:33.410439 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f0b5dec3-436e-4602-854b-a289c0a98b74 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:33.413295 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f0b5dec3-436e-4602-854b-a289c0a98b74 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:33.415092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f0b5dec3-436e-4602-854b-a289c0a98b74 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:33.416089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f0b5dec3-436e-4602-854b-a289c0a98b74 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:33.418040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f0b5dec3-436e-4602-854b-a289c0a98b74 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:33.419273 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f0b5dec3-436e-4602-854b-a289c0a98b74 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:33.559938 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f0b5dec3-436e-4602-854b-a289c0a98b74 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.175575 Sep 17 21:11:33.563735 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2425/4748] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 17 21:11:33 2022] GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc/os-volume_attachments => generated 25 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:11:33.715880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4bb6ca46-a5c3-4a5c-944f-c3a604f2c707 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:33.717329 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4bb6ca46-a5c3-4a5c-944f-c3a604f2c707 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0e3e136c-7043-4c24-bf6d-f33bf379e7cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:33.769972 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:11:33.776686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bb6ca46-a5c3-4a5c-944f-c3a604f2c707 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:33.780068 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bb6ca46-a5c3-4a5c-944f-c3a604f2c707 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:33.781562 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bb6ca46-a5c3-4a5c-944f-c3a604f2c707 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:33.784015 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bb6ca46-a5c3-4a5c-944f-c3a604f2c707 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:33.785789 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bb6ca46-a5c3-4a5c-944f-c3a604f2c707 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:33.788307 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bb6ca46-a5c3-4a5c-944f-c3a604f2c707 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:33.885473 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4bb6ca46-a5c3-4a5c-944f-c3a604f2c707 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0e3e136c-7043-4c24-bf6d-f33bf379e7cc] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:11:33.944264 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-81f7c978-a661-4d0a-aa45-5fa179dc8530 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a4cdda60>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:34.205450 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4bb6ca46-a5c3-4a5c-944f-c3a604f2c707 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc" status: 204 len: 0 microversion: 2.1 time: 0.495356 Sep 17 21:11:34.206468 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2324/4749] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:11:33 2022] DELETE /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:11:34.217979 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4db7b49a-20b2-40e5-888d-bcdc5eef2cec tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:34.219106 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4db7b49a-20b2-40e5-888d-bcdc5eef2cec tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 640f82db-299b-42a4-a6b6-0a286b8220c9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:34.230380 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4db7b49a-20b2-40e5-888d-bcdc5eef2cec tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:34.234035 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4db7b49a-20b2-40e5-888d-bcdc5eef2cec tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:34.234763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4db7b49a-20b2-40e5-888d-bcdc5eef2cec tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:34.235590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4db7b49a-20b2-40e5-888d-bcdc5eef2cec tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:34.236182 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4db7b49a-20b2-40e5-888d-bcdc5eef2cec tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:34.236616 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4db7b49a-20b2-40e5-888d-bcdc5eef2cec tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:34.315398 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-4db7b49a-20b2-40e5-888d-bcdc5eef2cec tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] HTTP exception thrown: Instance 640f82db-299b-42a4-a6b6-0a286b8220c9 could not be found. Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4db7b49a-20b2-40e5-888d-bcdc5eef2cec tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Request method failure captured: Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9 HTTP/1.1 Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjdkx_dUaa7DUi-TKVFHTZsVxQrlexvG4SUZm6N8-RAgW-Hgl4Fm16QKjLB8Smzb7fg0_3Heh2RxRO4DM6alOpTGfM4lDQjx-JBymYUztOAuBANR84PPvzFMKCK9hdlODMbdRT3LVU-maWvSxN-XNtXdSltD2p8By-EmBSmK4dFa6Xo Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersTestJSON-167161476 Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b6f25c3540546bf9bffd5610f4f86c8", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersTestJSON-167161476 Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersTestJSON-167161476 Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersTestJSON-167161476-project Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 784233ee78764e7dbb774d3cb50165e3 Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersTestJSON-167161476-project Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 640f82db-299b-42a4-a6b6-0a286b8220c9 could not be found. Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '640f82db-299b-42a4-a6b6-0a286b8220c9'} Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 640f82db-299b-42a4-a6b6-0a286b8220c9 could not be found. Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 640f82db-299b-42a4-a6b6-0a286b8220c9 could not be found. Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:34.321871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:34.329745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:34.329745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:34.329745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:11:34.329745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:11:34.329745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 640f82db-299b-42a4-a6b6-0a286b8220c9 could not be found. Sep 17 21:11:34.329745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:34.329745 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4db7b49a-20b2-40e5-888d-bcdc5eef2cec tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Returning 404 to user: Instance 640f82db-299b-42a4-a6b6-0a286b8220c9 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:11:34.329745 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4db7b49a-20b2-40e5-888d-bcdc5eef2cec tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9" status: 404 len: 111 microversion: 2.1 time: 0.117638 Sep 17 21:11:34.330837 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2325/4750] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:34 2022] GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:11:34.350498 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-675f608e-5f63-44e4-94e7-cc2b334f5e71 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:34.351599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-675f608e-5f63-44e4-94e7-cc2b334f5e71 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0e3e136c-7043-4c24-bf6d-f33bf379e7cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:34.367990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-675f608e-5f63-44e4-94e7-cc2b334f5e71 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:34.372532 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-675f608e-5f63-44e4-94e7-cc2b334f5e71 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:34.373781 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-675f608e-5f63-44e4-94e7-cc2b334f5e71 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:34.377038 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-675f608e-5f63-44e4-94e7-cc2b334f5e71 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:34.378353 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-675f608e-5f63-44e4-94e7-cc2b334f5e71 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:34.381880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-675f608e-5f63-44e4-94e7-cc2b334f5e71 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:34.972846 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-675f608e-5f63-44e4-94e7-cc2b334f5e71 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:34.999067 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-675f608e-5f63-44e4-94e7-cc2b334f5e71 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc" status: 200 len: 1683 microversion: 2.1 time: 0.662444 Sep 17 21:11:35.002342 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2326/4751] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:34 2022] GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc => generated 1683 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:35.037255 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-46fd3e37-3ab0-4373-b6c9-da54bdc03b0f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-303754324", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "ff632525-8d7d-4854-beaf-dc49c77bdd36"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:35.353985 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-81f7c978-a661-4d0a-aa45-5fa179dc8530 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418" status: 200 len: 1429 microversion: 2.1 time: 1.413505 Sep 17 21:11:35.370433 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2426/4752] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:33 2022] GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418 => generated 1429 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:11:35.596517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-46fd3e37-3ab0-4373-b6c9-da54bdc03b0f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] validate_networks() for [('ff632525-8d7d-4854-beaf-dc49c77bdd36', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:11:36.030177 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-dbacf9e7-4098-4af1-b70f-3d9f13bade62 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:36.030834 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-dbacf9e7-4098-4af1-b70f-3d9f13bade62 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0e3e136c-7043-4c24-bf6d-f33bf379e7cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:36.055490 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dbacf9e7-4098-4af1-b70f-3d9f13bade62 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:36.063290 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dbacf9e7-4098-4af1-b70f-3d9f13bade62 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:36.064519 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dbacf9e7-4098-4af1-b70f-3d9f13bade62 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:36.065333 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dbacf9e7-4098-4af1-b70f-3d9f13bade62 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:36.065852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dbacf9e7-4098-4af1-b70f-3d9f13bade62 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:36.066316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dbacf9e7-4098-4af1-b70f-3d9f13bade62 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:37.067256 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-dbacf9e7-4098-4af1-b70f-3d9f13bade62 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:37.079798 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-dbacf9e7-4098-4af1-b70f-3d9f13bade62 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc" status: 200 len: 1683 microversion: 2.1 time: 1.054933 Sep 17 21:11:37.091354 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2427/4753] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:36 2022] GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc => generated 1683 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:37.105438 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-43bfaaf7-a41a-4c6b-9d3b-32e920382577 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a4014790>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:37.339250 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-43bfaaf7-a41a-4c6b-9d3b-32e920382577 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418" status: 200 len: 1429 microversion: 2.1 time: 0.246459 Sep 17 21:11:37.340515 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2428/4754] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:37 2022] GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418 => generated 1429 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:38.118471 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-65541780-a918-4489-b5ea-b98ebcfa555e tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:38.119209 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-65541780-a918-4489-b5ea-b98ebcfa555e tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0e3e136c-7043-4c24-bf6d-f33bf379e7cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:38.132747 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-65541780-a918-4489-b5ea-b98ebcfa555e tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:38.136169 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-65541780-a918-4489-b5ea-b98ebcfa555e tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:38.136851 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-65541780-a918-4489-b5ea-b98ebcfa555e tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:38.138632 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-65541780-a918-4489-b5ea-b98ebcfa555e tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:38.143277 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-65541780-a918-4489-b5ea-b98ebcfa555e tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:38.144488 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-65541780-a918-4489-b5ea-b98ebcfa555e tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:38.672115 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-65541780-a918-4489-b5ea-b98ebcfa555e tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:38.686866 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-65541780-a918-4489-b5ea-b98ebcfa555e tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc" status: 200 len: 1683 microversion: 2.1 time: 0.572529 Sep 17 21:11:38.691407 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2429/4755] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:38 2022] GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc => generated 1683 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:38.721502 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-56b9d790-a4b5-4589-8e6a-c0d645d5d795 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a41fbaf0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:39.336651 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-56b9d790-a4b5-4589-8e6a-c0d645d5d795 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418" status: 200 len: 1429 microversion: 2.1 time: 0.643981 Sep 17 21:11:39.346248 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2430/4756] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:38 2022] GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418 => generated 1429 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:39.722551 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7c456254-3ff1-498d-ab8e-9b4db53cf32b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:39.723659 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7c456254-3ff1-498d-ab8e-9b4db53cf32b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0e3e136c-7043-4c24-bf6d-f33bf379e7cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:39.766742 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7c456254-3ff1-498d-ab8e-9b4db53cf32b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:39.774919 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7c456254-3ff1-498d-ab8e-9b4db53cf32b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:39.782631 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7c456254-3ff1-498d-ab8e-9b4db53cf32b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:39.784912 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7c456254-3ff1-498d-ab8e-9b4db53cf32b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:39.795450 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7c456254-3ff1-498d-ab8e-9b4db53cf32b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:39.796279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7c456254-3ff1-498d-ab8e-9b4db53cf32b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:40.859265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-46fd3e37-3ab0-4373-b6c9-da54bdc03b0f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:11:40.859836 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-46fd3e37-3ab0-4373-b6c9-da54bdc03b0f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:11:40.860197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-46fd3e37-3ab0-4373-b6c9-da54bdc03b0f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:11:40.861935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-46fd3e37-3ab0-4373-b6c9-da54bdc03b0f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:11:40.862449 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-46fd3e37-3ab0-4373-b6c9-da54bdc03b0f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:11:40.882522 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46fd3e37-3ab0-4373-b6c9-da54bdc03b0f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:40.882755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46fd3e37-3ab0-4373-b6c9-da54bdc03b0f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:40.886890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46fd3e37-3ab0-4373-b6c9-da54bdc03b0f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:40.888589 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46fd3e37-3ab0-4373-b6c9-da54bdc03b0f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:40.890750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46fd3e37-3ab0-4373-b6c9-da54bdc03b0f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:40.892000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46fd3e37-3ab0-4373-b6c9-da54bdc03b0f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:40.966124 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-46fd3e37-3ab0-4373-b6c9-da54bdc03b0f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Getting quotas for project 0b6f25c3540546bf9bffd5610f4f86c8. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:11:40.974851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-46fd3e37-3ab0-4373-b6c9-da54bdc03b0f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Getting quotas for user 784233ee78764e7dbb774d3cb50165e3 and project 0b6f25c3540546bf9bffd5610f4f86c8. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:11:41.001706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-46fd3e37-3ab0-4373-b6c9-da54bdc03b0f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:11:41.008027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-46fd3e37-3ab0-4373-b6c9-da54bdc03b0f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 6bddcf4c-0951-44ad-a435-0ceb98ec51af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:11:41.148906 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-46fd3e37-3ab0-4373-b6c9-da54bdc03b0f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.128756 Sep 17 21:11:41.151555 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2327/4757] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:11:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 6132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:11:41.187820 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f425ef24-eee0-4b02-a1ed-8ed537672c0e tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a9fe0b80>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:41.356937 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f425ef24-eee0-4b02-a1ed-8ed537672c0e tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418" status: 200 len: 1438 microversion: 2.1 time: 0.194200 Sep 17 21:11:41.361967 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2328/4758] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:41 2022] GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418 => generated 1438 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:41.384481 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0d8643d1-b123-4421-9694-bc0050f56049 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:41.386666 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0d8643d1-b123-4421-9694-bc0050f56049 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 6bddcf4c-0951-44ad-a435-0ceb98ec51af] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:41.738206 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7c456254-3ff1-498d-ab8e-9b4db53cf32b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:41.753179 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7c456254-3ff1-498d-ab8e-9b4db53cf32b tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc" status: 200 len: 1683 microversion: 2.1 time: 2.038103 Sep 17 21:11:41.757216 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2431/4759] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:39 2022] GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc => generated 1683 bytes in 2043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:41.782994 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e4fe3d89-a0b7-4023-9a5d-8e29df2b15ea tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a9f624c0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:41.894183 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e4fe3d89-a0b7-4023-9a5d-8e29df2b15ea tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418" status: 200 len: 1438 microversion: 2.1 time: 0.131500 Sep 17 21:11:41.894734 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2432/4760] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:41 2022] GET /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418 => generated 1438 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:41.961774 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c7441428-9c3c-403a-b94e-2d6abb4084fc tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:41.972349 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c7441428-9c3c-403a-b94e-2d6abb4084fc tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] [instance: 1bb77042-152e-4948-95ab-8849c8d72c80] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:41.997263 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c7441428-9c3c-403a-b94e-2d6abb4084fc tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:41.998148 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c7441428-9c3c-403a-b94e-2d6abb4084fc tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:41.998730 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c7441428-9c3c-403a-b94e-2d6abb4084fc tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:41.999474 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c7441428-9c3c-403a-b94e-2d6abb4084fc tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:42.000569 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c7441428-9c3c-403a-b94e-2d6abb4084fc tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:42.002081 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c7441428-9c3c-403a-b94e-2d6abb4084fc tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:42.059270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0d8643d1-b123-4421-9694-bc0050f56049 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:42.070534 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0d8643d1-b123-4421-9694-bc0050f56049 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af" status: 200 len: 1208 microversion: 2.1 time: 0.706417 Sep 17 21:11:42.087444 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2329/4761] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:41 2022] GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af => generated 1208 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:42.739735 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-99f85449-7fe2-4630-9e63-380f12351642 req-0ddd5ba0-872c-463e-a92d-3ca8845e4eff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e3e136c-7043-4c24-bf6d-f33bf379e7cc", "name": "network-vif-deleted", "tag": "e0be212d-ddc6-44b6-9963-59a1fa83ae0c"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:42.808821 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-99f85449-7fe2-4630-9e63-380f12351642 req-0ddd5ba0-872c-463e-a92d-3ca8845e4eff service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:42.809755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-99f85449-7fe2-4630-9e63-380f12351642 req-0ddd5ba0-872c-463e-a92d-3ca8845e4eff service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:42.810500 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-99f85449-7fe2-4630-9e63-380f12351642 req-0ddd5ba0-872c-463e-a92d-3ca8845e4eff service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:42.833386 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-99f85449-7fe2-4630-9e63-380f12351642 req-0ddd5ba0-872c-463e-a92d-3ca8845e4eff service nova] Creating event network-vif-deleted:e0be212d-ddc6-44b6-9963-59a1fa83ae0c for instance 0e3e136c-7043-4c24-bf6d-f33bf379e7cc on nch1-master-1 Sep 17 21:11:42.840108 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-99f85449-7fe2-4630-9e63-380f12351642 req-0ddd5ba0-872c-463e-a92d-3ca8845e4eff service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107919 Sep 17 21:11:42.843399 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2330/4762] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:11:42.849858 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a609904f-eae4-4f7e-973f-d19500deab52 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:42.851447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a609904f-eae4-4f7e-973f-d19500deab52 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0e3e136c-7043-4c24-bf6d-f33bf379e7cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:42.874885 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a609904f-eae4-4f7e-973f-d19500deab52 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:42.875441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a609904f-eae4-4f7e-973f-d19500deab52 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:42.875935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a609904f-eae4-4f7e-973f-d19500deab52 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:42.876778 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a609904f-eae4-4f7e-973f-d19500deab52 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:42.877211 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a609904f-eae4-4f7e-973f-d19500deab52 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:42.880195 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a609904f-eae4-4f7e-973f-d19500deab52 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:42.968377 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c7441428-9c3c-403a-b94e-2d6abb4084fc tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbd80f0e5bf46b78a79fd821e9ff89e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ceec62fde59414ebb34572d8f8fbcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:42.979535 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c7441428-9c3c-403a-b94e-2d6abb4084fc tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80" status: 200 len: 1466 microversion: 2.1 time: 1.069789 Sep 17 21:11:43.018497 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2433/4763] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:41 2022] GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80 => generated 1466 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:43.031867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a39fc390-9c54-477c-8529-fb4c75b2575f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:43.039489 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a39fc390-9c54-477c-8529-fb4c75b2575f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:43.064417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a39fc390-9c54-477c-8529-fb4c75b2575f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:43.065023 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a39fc390-9c54-477c-8529-fb4c75b2575f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:43.065744 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a39fc390-9c54-477c-8529-fb4c75b2575f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:43.085682 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a39fc390-9c54-477c-8529-fb4c75b2575f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:43.088172 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a39fc390-9c54-477c-8529-fb4c75b2575f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:43.089299 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a39fc390-9c54-477c-8529-fb4c75b2575f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:43.177153 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a609904f-eae4-4f7e-973f-d19500deab52 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c544e8e6f7a741c985c92ed7437397cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fa7e14863254ab3964ac907c168d9e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:43.199376 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a609904f-eae4-4f7e-973f-d19500deab52 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc" status: 200 len: 1615 microversion: 2.1 time: 0.352318 Sep 17 21:11:43.202960 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2331/4764] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:42 2022] GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc => generated 1615 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:43.216769 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-04eaaab7-c6f4-4d72-a0f8-1ee2a81f1c86 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a4cd3a60>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:43.902849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a39fc390-9c54-477c-8529-fb4c75b2575f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:43.931987 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a39fc390-9c54-477c-8529-fb4c75b2575f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:43.933691 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a39fc390-9c54-477c-8529-fb4c75b2575f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:43.935213 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a39fc390-9c54-477c-8529-fb4c75b2575f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 2951 microversion: 2.42 time: 0.918064 Sep 17 21:11:43.935850 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2434/4765] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:11:43 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 2951 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:11:43.953312 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-837f9896-f7e5-4334-b58a-ef4eb2b74ffa tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:43.964169 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-837f9896-f7e5-4334-b58a-ef4eb2b74ffa tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 6bddcf4c-0951-44ad-a435-0ceb98ec51af] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:43.978089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-837f9896-f7e5-4334-b58a-ef4eb2b74ffa tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:43.992968 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-837f9896-f7e5-4334-b58a-ef4eb2b74ffa tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:43.993672 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-837f9896-f7e5-4334-b58a-ef4eb2b74ffa tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:43.995285 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-837f9896-f7e5-4334-b58a-ef4eb2b74ffa tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:43.995929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-837f9896-f7e5-4334-b58a-ef4eb2b74ffa tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:43.996726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-837f9896-f7e5-4334-b58a-ef4eb2b74ffa tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:44.329890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-837f9896-f7e5-4334-b58a-ef4eb2b74ffa tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:44.355412 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-837f9896-f7e5-4334-b58a-ef4eb2b74ffa tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af" status: 200 len: 1266 microversion: 2.1 time: 0.418431 Sep 17 21:11:44.357973 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2435/4766] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:43 2022] GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af => generated 1266 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:44.368674 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2f72c271-4a4b-4e7d-965e-05ad7390499e tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:44.377502 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2f72c271-4a4b-4e7d-965e-05ad7390499e tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:44.395109 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f72c271-4a4b-4e7d-965e-05ad7390499e tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:44.395542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f72c271-4a4b-4e7d-965e-05ad7390499e tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:44.395982 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f72c271-4a4b-4e7d-965e-05ad7390499e tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:44.396709 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f72c271-4a4b-4e7d-965e-05ad7390499e tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:44.397213 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f72c271-4a4b-4e7d-965e-05ad7390499e tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:44.397729 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f72c271-4a4b-4e7d-965e-05ad7390499e tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:44.712852 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2f72c271-4a4b-4e7d-965e-05ad7390499e tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3/os-interface" status: 200 len: 1828 microversion: 2.42 time: 0.353486 Sep 17 21:11:44.713543 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2436/4767] 10.222.0.26 () {60 vars in 1316 bytes} [Sat Sep 17 21:11:44 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3/os-interface => generated 1828 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:11:44.722651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9d10b324-35b1-441b-8461-13489a527852 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:44.723464 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9d10b324-35b1-441b-8461-13489a527852 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0e3e136c-7043-4c24-bf6d-f33bf379e7cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:44.748500 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d10b324-35b1-441b-8461-13489a527852 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:44.749213 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d10b324-35b1-441b-8461-13489a527852 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:44.750291 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d10b324-35b1-441b-8461-13489a527852 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:44.751578 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d10b324-35b1-441b-8461-13489a527852 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:44.752234 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d10b324-35b1-441b-8461-13489a527852 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:44.752920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d10b324-35b1-441b-8461-13489a527852 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:44.773845 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-9d10b324-35b1-441b-8461-13489a527852 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] HTTP exception thrown: Instance 0e3e136c-7043-4c24-bf6d-f33bf379e7cc could not be found. Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9d10b324-35b1-441b-8461-13489a527852 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Request method failure captured: Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc HTTP/1.1 Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJja5IhqAUJRQXEUU1o8JKB7VL3QF2aEShf_6YtjfGFX6a2gdfOrA57RhEkrL_xji2fJrjERU1MYqs2fkCF1UUkZO1MCrMj-4yvDSZkq5ddhPAEMc-mFSR2bL5wENqd3kTDvDHvjjOdVeCZP6ndR-6jR5boE-dCWiUzV7hdKlqCy2Jhg Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 6fa7e14863254ab3964ac907c168d9e6 Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6fa7e14863254ab3964ac907c168d9e6", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 6fa7e14863254ab3964ac907c168d9e6 Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-AttachVolumeNegativeTest-1020448628-project Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: c544e8e6f7a741c985c92ed7437397cd Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-AttachVolumeNegativeTest-1020448628-project Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 0e3e136c-7043-4c24-bf6d-f33bf379e7cc could not be found. Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '0e3e136c-7043-4c24-bf6d-f33bf379e7cc'} Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e3e136c-7043-4c24-bf6d-f33bf379e7cc could not be found. Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e3e136c-7043-4c24-bf6d-f33bf379e7cc could not be found. Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:44.775895 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:44.780963 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:44.780963 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:44.780963 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:44.780963 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:11:44.780963 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:11:44.780963 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e3e136c-7043-4c24-bf6d-f33bf379e7cc could not be found. Sep 17 21:11:44.780963 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:44.782612 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9d10b324-35b1-441b-8461-13489a527852 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Returning 404 to user: Instance 0e3e136c-7043-4c24-bf6d-f33bf379e7cc could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:11:44.783702 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9d10b324-35b1-441b-8461-13489a527852 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc" status: 404 len: 111 microversion: 2.1 time: 0.069223 Sep 17 21:11:44.785319 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2437/4768] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:44 2022] GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:11:44.790806 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-9fed4ed7-2aa9-41a2-8b3b-6f489a2fc6ef req-3952fa5f-7f35-4fd6-bd5e-a3636e86a605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bb77042-152e-4948-95ab-8849c8d72c80", "name": "network-vif-unplugged", "status": "completed", "tag": "5ab301f7-76d2-44ce-a32b-a5a47596282b"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:44.808472 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-9fed4ed7-2aa9-41a2-8b3b-6f489a2fc6ef req-3952fa5f-7f35-4fd6-bd5e-a3636e86a605 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:44.809316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-9fed4ed7-2aa9-41a2-8b3b-6f489a2fc6ef req-3952fa5f-7f35-4fd6-bd5e-a3636e86a605 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:44.810014 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-9fed4ed7-2aa9-41a2-8b3b-6f489a2fc6ef req-3952fa5f-7f35-4fd6-bd5e-a3636e86a605 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:44.825770 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-9fed4ed7-2aa9-41a2-8b3b-6f489a2fc6ef req-3952fa5f-7f35-4fd6-bd5e-a3636e86a605 service nova] Creating event network-vif-unplugged:5ab301f7-76d2-44ce-a32b-a5a47596282b for instance 1bb77042-152e-4948-95ab-8849c8d72c80 on nch2-master-1 Sep 17 21:11:44.843947 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-9fed4ed7-2aa9-41a2-8b3b-6f489a2fc6ef req-3952fa5f-7f35-4fd6-bd5e-a3636e86a605 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057439 Sep 17 21:11:44.844561 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2438/4769] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:11:44.861889 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ac4ebf4c-2939-40b2-b09b-10b52979a6c0 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '.version_select at 0x7f25a9fb8160>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:44.905279 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ac4ebf4c-2939-40b2-b09b-10b52979a6c0 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1651521270" status: 202 len: 0 microversion: 2.1 time: 0.058694 Sep 17 21:11:44.910224 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2439/4770] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Sep 17 21:11:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1651521270 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:11:45.258085 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-04eaaab7-c6f4-4d72-a0f8-1ee2a81f1c86 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "DELETE /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418" status: 204 len: 0 microversion: 2.1 time: 2.052675 Sep 17 21:11:45.259421 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2332/4771] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:43 2022] DELETE /compute/v2.1/images/d46964f1-f91c-4b86-bb16-79eb0e37a418 => generated 0 bytes in 2056 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:11:45.269741 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-991cebb6-0cc2-4f19-9ef4-11a60c71be90 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '.version_select at 0x7f25a4d73820>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:45.321034 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-991cebb6-0cc2-4f19-9ef4-11a60c71be90 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] HTTP exception thrown: Image not found. Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-991cebb6-0cc2-4f19-9ef4-11a60c71be90 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Request method failure captured: Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9 HTTP/1.1 Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJje5pW96mXlG3sEKZKUl50Vom2nWVUErSMUVGOktH9S0Qq3vB20rQivGXglvyfpapn5tQGW6zImyqgBVvz-l17thXLzN77I2eHTk9Jbfx9tNqmYamtHzMnJZWvwngrqsa2HTEASWBt5UftJEO43bkfulMtxTrl44Kx8dRlzhkRZRGJw Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 4ceec62fde59414ebb34572d8f8fbcfe Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ImagesOneServerTestJSON-1821562040 Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ceec62fde59414ebb34572d8f8fbcfe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4ceec62fde59414ebb34572d8f8fbcfe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ceec62fde59414ebb34572d8f8fbcfe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4ceec62fde59414ebb34572d8f8fbcfe", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ImagesOneServerTestJSON-1821562040 Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 4ceec62fde59414ebb34572d8f8fbcfe Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1821562040 Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ImagesOneServerTestJSON-1821562040-project Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 1fbd80f0e5bf46b78a79fd821e9ff89e Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ImagesOneServerTestJSON-1821562040-project Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: exception: Image not found. Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '45ece03b-5d76-41d1-8396-f3d38e4ca2e9'} Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 45ece03b-5d76-41d1-8396-f3d38e4ca2e9 to delete Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 45ece03b-5d76-41d1-8396-f3d38e4ca2e9 could not be found. Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:45.323290 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:45.329429 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:45.329429 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:45.329429 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:11:45.329429 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:11:45.329429 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:11:45.329429 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:11:45.329429 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:11:45.329429 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:11:45.329429 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 17 21:11:45.329429 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 17 21:11:45.329429 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 17 21:11:45.329429 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:45.329429 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:45.329429 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:45.329429 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:45.329429 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:45.329429 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:45.329429 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:11:45.329429 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:11:45.329429 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 17 21:11:45.329429 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:45.329429 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-991cebb6-0cc2-4f19-9ef4-11a60c71be90 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Returning 404 to user: Image not found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:11:45.329429 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-991cebb6-0cc2-4f19-9ef4-11a60c71be90 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "DELETE /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9" status: 404 len: 62 microversion: 2.1 time: 0.064559 Sep 17 21:11:45.332035 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2440/4772] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:45 2022] DELETE /compute/v2.1/images/45ece03b-5d76-41d1-8396-f3d38e4ca2e9 => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 21:11:45.342514 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bf320127-0af9-478b-bfdc-b8e53266a9c5 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:45.343128 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bf320127-0af9-478b-bfdc-b8e53266a9c5 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] [instance: 1bb77042-152e-4948-95ab-8849c8d72c80] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:45.364338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf320127-0af9-478b-bfdc-b8e53266a9c5 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:45.364812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf320127-0af9-478b-bfdc-b8e53266a9c5 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:45.366399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf320127-0af9-478b-bfdc-b8e53266a9c5 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:45.372309 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf320127-0af9-478b-bfdc-b8e53266a9c5 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:45.372829 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf320127-0af9-478b-bfdc-b8e53266a9c5 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:45.373533 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf320127-0af9-478b-bfdc-b8e53266a9c5 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:45.383570 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5bb216b1-438b-47db-b67f-ad8566a6f173 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:45.384617 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5bb216b1-438b-47db-b67f-ad8566a6f173 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 6bddcf4c-0951-44ad-a435-0ceb98ec51af] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:45.403392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5bb216b1-438b-47db-b67f-ad8566a6f173 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:45.403959 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5bb216b1-438b-47db-b67f-ad8566a6f173 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:45.407231 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5bb216b1-438b-47db-b67f-ad8566a6f173 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:45.408127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5bb216b1-438b-47db-b67f-ad8566a6f173 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:45.408723 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5bb216b1-438b-47db-b67f-ad8566a6f173 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:45.409118 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5bb216b1-438b-47db-b67f-ad8566a6f173 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:45.466953 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bf320127-0af9-478b-bfdc-b8e53266a9c5 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] [instance: 1bb77042-152e-4948-95ab-8849c8d72c80] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:11:45.728475 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bf320127-0af9-478b-bfdc-b8e53266a9c5 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80" status: 204 len: 0 microversion: 2.1 time: 0.391251 Sep 17 21:11:45.732688 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2333/4773] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:11:45 2022] DELETE /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:11:45.748344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ea961e9e-c60e-4e71-980d-0d51be2c1285 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:45.749064 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ea961e9e-c60e-4e71-980d-0d51be2c1285 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] [instance: 1bb77042-152e-4948-95ab-8849c8d72c80] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:45.770605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea961e9e-c60e-4e71-980d-0d51be2c1285 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:45.771252 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea961e9e-c60e-4e71-980d-0d51be2c1285 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:45.771728 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea961e9e-c60e-4e71-980d-0d51be2c1285 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:45.772500 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea961e9e-c60e-4e71-980d-0d51be2c1285 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:45.772976 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea961e9e-c60e-4e71-980d-0d51be2c1285 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:45.773431 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea961e9e-c60e-4e71-980d-0d51be2c1285 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:45.818571 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5bb216b1-438b-47db-b67f-ad8566a6f173 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:45.848197 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5bb216b1-438b-47db-b67f-ad8566a6f173 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af" status: 200 len: 1266 microversion: 2.1 time: 0.465921 Sep 17 21:11:45.849153 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2441/4774] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:45 2022] GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af => generated 1266 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:46.482781 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ea961e9e-c60e-4e71-980d-0d51be2c1285 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbd80f0e5bf46b78a79fd821e9ff89e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ceec62fde59414ebb34572d8f8fbcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:46.494626 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ea961e9e-c60e-4e71-980d-0d51be2c1285 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80" status: 200 len: 1472 microversion: 2.1 time: 0.760408 Sep 17 21:11:46.495241 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2334/4775] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:45 2022] GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80 => generated 1472 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:46.899161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d81fa0d1-c0de-4b43-aa23-71412e4201eb tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:46.902533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d81fa0d1-c0de-4b43-aa23-71412e4201eb tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 6bddcf4c-0951-44ad-a435-0ceb98ec51af] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:46.919817 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d81fa0d1-c0de-4b43-aa23-71412e4201eb tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:46.921829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d81fa0d1-c0de-4b43-aa23-71412e4201eb tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:46.923573 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d81fa0d1-c0de-4b43-aa23-71412e4201eb tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:46.925561 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d81fa0d1-c0de-4b43-aa23-71412e4201eb tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:46.927156 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d81fa0d1-c0de-4b43-aa23-71412e4201eb tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:46.928040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d81fa0d1-c0de-4b43-aa23-71412e4201eb tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:47.525592 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0cd31e8a-3e90-4808-83e4-fd5caef9206e tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:47.526967 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0cd31e8a-3e90-4808-83e4-fd5caef9206e tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] [instance: 1bb77042-152e-4948-95ab-8849c8d72c80] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:47.538657 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0cd31e8a-3e90-4808-83e4-fd5caef9206e tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:47.544825 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0cd31e8a-3e90-4808-83e4-fd5caef9206e tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:47.545716 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0cd31e8a-3e90-4808-83e4-fd5caef9206e tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:47.546771 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0cd31e8a-3e90-4808-83e4-fd5caef9206e tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:47.547792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0cd31e8a-3e90-4808-83e4-fd5caef9206e tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:47.548572 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0cd31e8a-3e90-4808-83e4-fd5caef9206e tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:48.096987 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d81fa0d1-c0de-4b43-aa23-71412e4201eb tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:48.155334 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d81fa0d1-c0de-4b43-aa23-71412e4201eb tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af" status: 200 len: 1308 microversion: 2.1 time: 1.268309 Sep 17 21:11:48.171785 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2442/4776] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:46 2022] GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af => generated 1308 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:48.406332 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2c936638-deb1-40de-ba2a-327faa65a3cd tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:48.407750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2c936638-deb1-40de-ba2a-327faa65a3cd tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0e3e136c-7043-4c24-bf6d-f33bf379e7cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:48.423121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c936638-deb1-40de-ba2a-327faa65a3cd tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:48.424028 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c936638-deb1-40de-ba2a-327faa65a3cd tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:48.424550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c936638-deb1-40de-ba2a-327faa65a3cd tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:48.425967 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c936638-deb1-40de-ba2a-327faa65a3cd tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:48.437007 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c936638-deb1-40de-ba2a-327faa65a3cd tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:48.438344 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c936638-deb1-40de-ba2a-327faa65a3cd tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:48.452140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:11:48.478973 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-2c936638-deb1-40de-ba2a-327faa65a3cd tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] HTTP exception thrown: Instance 0e3e136c-7043-4c24-bf6d-f33bf379e7cc could not be found. Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2c936638-deb1-40de-ba2a-327faa65a3cd tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Request method failure captured: Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc HTTP/1.1 Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJja5IhqAUJRQXEUU1o8JKB7VL3QF2aEShf_6YtjfGFX6a2gdfOrA57RhEkrL_xji2fJrjERU1MYqs2fkCF1UUkZO1MCrMj-4yvDSZkq5ddhPAEMc-mFSR2bL5wENqd3kTDvDHvjjOdVeCZP6ndR-6jR5boE-dCWiUzV7hdKlqCy2Jhg Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 6fa7e14863254ab3964ac907c168d9e6 Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6fa7e14863254ab3964ac907c168d9e6", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 6fa7e14863254ab3964ac907c168d9e6 Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-AttachVolumeNegativeTest-1020448628-project Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: c544e8e6f7a741c985c92ed7437397cd Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-AttachVolumeNegativeTest-1020448628-project Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 0e3e136c-7043-4c24-bf6d-f33bf379e7cc could not be found. Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '0e3e136c-7043-4c24-bf6d-f33bf379e7cc'} Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e3e136c-7043-4c24-bf6d-f33bf379e7cc could not be found. Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:11:48.481451 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:11:48.486268 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e3e136c-7043-4c24-bf6d-f33bf379e7cc could not be found. Sep 17 21:11:48.486268 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:48.486268 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:48.486268 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:48.486268 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:48.486268 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:48.486268 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:48.486268 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:11:48.486268 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:11:48.486268 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e3e136c-7043-4c24-bf6d-f33bf379e7cc could not be found. Sep 17 21:11:48.486268 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:48.489114 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2c936638-deb1-40de-ba2a-327faa65a3cd tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Returning 404 to user: Instance 0e3e136c-7043-4c24-bf6d-f33bf379e7cc could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:11:48.490221 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2c936638-deb1-40de-ba2a-327faa65a3cd tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc" status: 404 len: 111 microversion: 2.1 time: 0.090523 Sep 17 21:11:48.491693 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2443/4777] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:11:48 2022] DELETE /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 21:11:48.510472 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-92b6b592-9323-42d3-821a-ce74f114024c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:48.517782 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-92b6b592-9323-42d3-821a-ce74f114024c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0e3e136c-7043-4c24-bf6d-f33bf379e7cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:48.526041 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92b6b592-9323-42d3-821a-ce74f114024c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:48.526802 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92b6b592-9323-42d3-821a-ce74f114024c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:48.527431 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92b6b592-9323-42d3-821a-ce74f114024c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:48.528552 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92b6b592-9323-42d3-821a-ce74f114024c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:48.530325 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92b6b592-9323-42d3-821a-ce74f114024c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:48.530325 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92b6b592-9323-42d3-821a-ce74f114024c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:48.549851 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-92b6b592-9323-42d3-821a-ce74f114024c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] HTTP exception thrown: Instance 0e3e136c-7043-4c24-bf6d-f33bf379e7cc could not be found. Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-92b6b592-9323-42d3-821a-ce74f114024c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Request method failure captured: Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc HTTP/1.1 Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJja5IhqAUJRQXEUU1o8JKB7VL3QF2aEShf_6YtjfGFX6a2gdfOrA57RhEkrL_xji2fJrjERU1MYqs2fkCF1UUkZO1MCrMj-4yvDSZkq5ddhPAEMc-mFSR2bL5wENqd3kTDvDHvjjOdVeCZP6ndR-6jR5boE-dCWiUzV7hdKlqCy2Jhg Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 6fa7e14863254ab3964ac907c168d9e6 Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6fa7e14863254ab3964ac907c168d9e6", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 6fa7e14863254ab3964ac907c168d9e6 Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-AttachVolumeNegativeTest-1020448628-project Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: c544e8e6f7a741c985c92ed7437397cd Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-AttachVolumeNegativeTest-1020448628-project Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 0e3e136c-7043-4c24-bf6d-f33bf379e7cc could not be found. Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '0e3e136c-7043-4c24-bf6d-f33bf379e7cc'} Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e3e136c-7043-4c24-bf6d-f33bf379e7cc could not be found. Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e3e136c-7043-4c24-bf6d-f33bf379e7cc could not be found. Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:48.552229 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:48.556317 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:48.556317 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:48.556317 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:48.556317 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:11:48.556317 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:11:48.556317 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e3e136c-7043-4c24-bf6d-f33bf379e7cc could not be found. Sep 17 21:11:48.556317 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:48.558685 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-92b6b592-9323-42d3-821a-ce74f114024c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Returning 404 to user: Instance 0e3e136c-7043-4c24-bf6d-f33bf379e7cc could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:11:48.560333 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-92b6b592-9323-42d3-821a-ce74f114024c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc" status: 404 len: 111 microversion: 2.1 time: 0.064082 Sep 17 21:11:48.561439 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2444/4778] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:48 2022] GET /compute/v2.1/servers/0e3e136c-7043-4c24-bf6d-f33bf379e7cc => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:11:48.967329 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0cd31e8a-3e90-4808-83e4-fd5caef9206e tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbd80f0e5bf46b78a79fd821e9ff89e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ceec62fde59414ebb34572d8f8fbcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:48.982146 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0cd31e8a-3e90-4808-83e4-fd5caef9206e tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80" status: 200 len: 1472 microversion: 2.1 time: 1.461040 Sep 17 21:11:49.011476 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2335/4779] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:47 2022] GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80 => generated 1472 bytes in 1484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:11:49.186851 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f9f06372-ada7-44ed-9623-c2a156ec51c0 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:49.188852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f9f06372-ada7-44ed-9623-c2a156ec51c0 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 6bddcf4c-0951-44ad-a435-0ceb98ec51af] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:49.205738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f9f06372-ada7-44ed-9623-c2a156ec51c0 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:49.211520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f9f06372-ada7-44ed-9623-c2a156ec51c0 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:49.213957 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f9f06372-ada7-44ed-9623-c2a156ec51c0 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:49.222679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f9f06372-ada7-44ed-9623-c2a156ec51c0 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:49.223167 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f9f06372-ada7-44ed-9623-c2a156ec51c0 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:49.224244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f9f06372-ada7-44ed-9623-c2a156ec51c0 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:49.879485 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ead5d980-e9b8-4a4a-bf2e-ea0e6c4b1444 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:49.880253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ead5d980-e9b8-4a4a-bf2e-ea0e6c4b1444 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:49.892300 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ead5d980-e9b8-4a4a-bf2e-ea0e6c4b1444 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:49.899069 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ead5d980-e9b8-4a4a-bf2e-ea0e6c4b1444 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:49.899608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f9f06372-ada7-44ed-9623-c2a156ec51c0 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:49.899777 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ead5d980-e9b8-4a4a-bf2e-ea0e6c4b1444 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:49.921230 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ead5d980-e9b8-4a4a-bf2e-ea0e6c4b1444 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:49.924345 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ead5d980-e9b8-4a4a-bf2e-ea0e6c4b1444 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:49.925521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ead5d980-e9b8-4a4a-bf2e-ea0e6c4b1444 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:49.929697 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f9f06372-ada7-44ed-9623-c2a156ec51c0 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af" status: 200 len: 1308 microversion: 2.1 time: 0.748990 Sep 17 21:11:49.939140 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2445/4780] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:49 2022] GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af => generated 1308 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:50.014192 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0cd9903f-22c8-486b-a07a-525c95612c53 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:50.014849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0cd9903f-22c8-486b-a07a-525c95612c53 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] [instance: 1bb77042-152e-4948-95ab-8849c8d72c80] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:50.021296 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-ead5d980-e9b8-4a4a-bf2e-ea0e6c4b1444 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] HTTP exception thrown: Instance 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a could not be found. Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ead5d980-e9b8-4a4a-bf2e-ea0e6c4b1444 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Request method failure captured: Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a HTTP/1.1 Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJja5IhqAUJRQXEUU1o8JKB7VL3QF2aEShf_6YtjfGFX6a2gdfOrA57RhEkrL_xji2fJrjERU1MYqs2fkCF1UUkZO1MCrMj-4yvDSZkq5ddhPAEMc-mFSR2bL5wENqd3kTDvDHvjjOdVeCZP6ndR-6jR5boE-dCWiUzV7hdKlqCy2Jhg Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 6fa7e14863254ab3964ac907c168d9e6 Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6fa7e14863254ab3964ac907c168d9e6", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 6fa7e14863254ab3964ac907c168d9e6 Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-AttachVolumeNegativeTest-1020448628-project Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: c544e8e6f7a741c985c92ed7437397cd Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-AttachVolumeNegativeTest-1020448628-project Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a could not be found. Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '0d8e3d0a-75b8-40ed-ade5-deffe7b8105a'} Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a could not be found. Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:11:50.029016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:11:50.035196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a could not be found. Sep 17 21:11:50.035196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:50.035196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:50.035196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:50.035196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:50.035196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:50.035196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:50.035196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:11:50.035196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:11:50.035196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a could not be found. Sep 17 21:11:50.035196 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:50.036568 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0cd9903f-22c8-486b-a07a-525c95612c53 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:50.037091 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0cd9903f-22c8-486b-a07a-525c95612c53 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:50.038794 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0cd9903f-22c8-486b-a07a-525c95612c53 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:50.039475 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ead5d980-e9b8-4a4a-bf2e-ea0e6c4b1444 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Returning 404 to user: Instance 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:11:50.041923 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0cd9903f-22c8-486b-a07a-525c95612c53 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:50.043344 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0cd9903f-22c8-486b-a07a-525c95612c53 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:50.043977 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0cd9903f-22c8-486b-a07a-525c95612c53 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:50.044356 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ead5d980-e9b8-4a4a-bf2e-ea0e6c4b1444 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a" status: 404 len: 111 microversion: 2.1 time: 0.165945 Sep 17 21:11:50.055114 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2336/4781] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:11:49 2022] DELETE /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 21:11:50.070588 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4acf9d5a-47dc-4173-ada1-c446acda90eb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:50.073061 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4acf9d5a-47dc-4173-ada1-c446acda90eb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:50.089431 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4acf9d5a-47dc-4173-ada1-c446acda90eb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:50.090493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4acf9d5a-47dc-4173-ada1-c446acda90eb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:50.091549 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4acf9d5a-47dc-4173-ada1-c446acda90eb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:50.094786 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4acf9d5a-47dc-4173-ada1-c446acda90eb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:50.095472 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4acf9d5a-47dc-4173-ada1-c446acda90eb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:50.096080 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4acf9d5a-47dc-4173-ada1-c446acda90eb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:50.116538 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-4acf9d5a-47dc-4173-ada1-c446acda90eb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] HTTP exception thrown: Instance 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a could not be found. Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4acf9d5a-47dc-4173-ada1-c446acda90eb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Request method failure captured: Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a HTTP/1.1 Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJja5IhqAUJRQXEUU1o8JKB7VL3QF2aEShf_6YtjfGFX6a2gdfOrA57RhEkrL_xji2fJrjERU1MYqs2fkCF1UUkZO1MCrMj-4yvDSZkq5ddhPAEMc-mFSR2bL5wENqd3kTDvDHvjjOdVeCZP6ndR-6jR5boE-dCWiUzV7hdKlqCy2Jhg Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 6fa7e14863254ab3964ac907c168d9e6 Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6fa7e14863254ab3964ac907c168d9e6", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 6fa7e14863254ab3964ac907c168d9e6 Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-AttachVolumeNegativeTest-1020448628-project Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: c544e8e6f7a741c985c92ed7437397cd Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-AttachVolumeNegativeTest-1020448628-project Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a could not be found. Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '0d8e3d0a-75b8-40ed-ade5-deffe7b8105a'} Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a could not be found. Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a could not be found. Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:50.119977 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:50.126449 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:50.126449 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:50.126449 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:50.126449 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:11:50.126449 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:11:50.126449 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a could not be found. Sep 17 21:11:50.126449 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:50.128763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4acf9d5a-47dc-4173-ada1-c446acda90eb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Returning 404 to user: Instance 0d8e3d0a-75b8-40ed-ade5-deffe7b8105a could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:11:50.130422 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4acf9d5a-47dc-4173-ada1-c446acda90eb tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a" status: 404 len: 111 microversion: 2.1 time: 0.073402 Sep 17 21:11:50.131577 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2337/4782] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:50 2022] GET /compute/v2.1/servers/0d8e3d0a-75b8-40ed-ade5-deffe7b8105a => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:11:50.153230 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e15d8c1b-7290-4656-9ad5-d65be214539c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:50.154752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e15d8c1b-7290-4656-9ad5-d65be214539c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:50.166599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e15d8c1b-7290-4656-9ad5-d65be214539c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:50.167398 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e15d8c1b-7290-4656-9ad5-d65be214539c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:50.168417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e15d8c1b-7290-4656-9ad5-d65be214539c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:50.172016 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e15d8c1b-7290-4656-9ad5-d65be214539c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:50.174021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e15d8c1b-7290-4656-9ad5-d65be214539c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:50.174773 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e15d8c1b-7290-4656-9ad5-d65be214539c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:50.198952 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-e15d8c1b-7290-4656-9ad5-d65be214539c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] HTTP exception thrown: Instance 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc could not be found. Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e15d8c1b-7290-4656-9ad5-d65be214539c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Request method failure captured: Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc HTTP/1.1 Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJja5IhqAUJRQXEUU1o8JKB7VL3QF2aEShf_6YtjfGFX6a2gdfOrA57RhEkrL_xji2fJrjERU1MYqs2fkCF1UUkZO1MCrMj-4yvDSZkq5ddhPAEMc-mFSR2bL5wENqd3kTDvDHvjjOdVeCZP6ndR-6jR5boE-dCWiUzV7hdKlqCy2Jhg Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 6fa7e14863254ab3964ac907c168d9e6 Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6fa7e14863254ab3964ac907c168d9e6", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 6fa7e14863254ab3964ac907c168d9e6 Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-AttachVolumeNegativeTest-1020448628-project Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: c544e8e6f7a741c985c92ed7437397cd Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-AttachVolumeNegativeTest-1020448628-project Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc could not be found. Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc'} Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc could not be found. Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:11:50.201612 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:11:50.207596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc could not be found. Sep 17 21:11:50.207596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:50.207596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:50.207596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:50.207596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:50.207596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:50.207596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:50.207596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:11:50.207596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:11:50.207596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc could not be found. Sep 17 21:11:50.207596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:50.210507 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e15d8c1b-7290-4656-9ad5-d65be214539c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Returning 404 to user: Instance 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:11:50.211967 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e15d8c1b-7290-4656-9ad5-d65be214539c tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc" status: 404 len: 111 microversion: 2.1 time: 0.074701 Sep 17 21:11:50.212751 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2338/4783] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:11:50 2022] DELETE /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:11:50.226317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7e991d20-14b4-44ce-9853-0e9a07c3c3ce tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:50.227314 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7e991d20-14b4-44ce-9853-0e9a07c3c3ce tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:50.235333 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7e991d20-14b4-44ce-9853-0e9a07c3c3ce tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:50.236531 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7e991d20-14b4-44ce-9853-0e9a07c3c3ce tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:50.237821 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7e991d20-14b4-44ce-9853-0e9a07c3c3ce tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:50.238991 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7e991d20-14b4-44ce-9853-0e9a07c3c3ce tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:50.239670 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7e991d20-14b4-44ce-9853-0e9a07c3c3ce tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:50.240549 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7e991d20-14b4-44ce-9853-0e9a07c3c3ce tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:50.261657 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-7e991d20-14b4-44ce-9853-0e9a07c3c3ce tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] HTTP exception thrown: Instance 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc could not be found. Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7e991d20-14b4-44ce-9853-0e9a07c3c3ce tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Request method failure captured: Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc HTTP/1.1 Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJja5IhqAUJRQXEUU1o8JKB7VL3QF2aEShf_6YtjfGFX6a2gdfOrA57RhEkrL_xji2fJrjERU1MYqs2fkCF1UUkZO1MCrMj-4yvDSZkq5ddhPAEMc-mFSR2bL5wENqd3kTDvDHvjjOdVeCZP6ndR-6jR5boE-dCWiUzV7hdKlqCy2Jhg Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 6fa7e14863254ab3964ac907c168d9e6 Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6fa7e14863254ab3964ac907c168d9e6", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 6fa7e14863254ab3964ac907c168d9e6 Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-AttachVolumeNegativeTest-1020448628-project Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: c544e8e6f7a741c985c92ed7437397cd Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-AttachVolumeNegativeTest-1020448628-project Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc could not be found. Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc'} Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc could not be found. Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc could not be found. Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:50.264067 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:50.268599 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:50.268599 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:50.268599 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:50.268599 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:11:50.268599 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:11:50.268599 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc could not be found. Sep 17 21:11:50.268599 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:50.271728 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7e991d20-14b4-44ce-9853-0e9a07c3c3ce tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Returning 404 to user: Instance 4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:11:50.273017 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7e991d20-14b4-44ce-9853-0e9a07c3c3ce tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc" status: 404 len: 111 microversion: 2.1 time: 0.055360 Sep 17 21:11:50.273837 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2339/4784] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:50 2022] GET /compute/v2.1/servers/4b43ba8f-e0ce-4f73-a5f7-3f6f7eac07dc => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:11:50.781783 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0cd9903f-22c8-486b-a07a-525c95612c53 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbd80f0e5bf46b78a79fd821e9ff89e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ceec62fde59414ebb34572d8f8fbcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:50.793576 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0cd9903f-22c8-486b-a07a-525c95612c53 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80" status: 200 len: 1472 microversion: 2.1 time: 0.786453 Sep 17 21:11:50.794177 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2446/4785] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:50 2022] GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80 => generated 1472 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:50.959337 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:11:50.971529 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5f6c9a46-ee54-40f9-8309-82044e4e9a29 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:50.972940 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5f6c9a46-ee54-40f9-8309-82044e4e9a29 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 6bddcf4c-0951-44ad-a435-0ceb98ec51af] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:51.019867 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5f6c9a46-ee54-40f9-8309-82044e4e9a29 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:51.025056 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5f6c9a46-ee54-40f9-8309-82044e4e9a29 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:51.027147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5f6c9a46-ee54-40f9-8309-82044e4e9a29 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:51.032050 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5f6c9a46-ee54-40f9-8309-82044e4e9a29 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:51.034136 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5f6c9a46-ee54-40f9-8309-82044e4e9a29 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:51.036968 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5f6c9a46-ee54-40f9-8309-82044e4e9a29 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:51.330778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-789c472b-8008-4abd-8ecb-29e49a637c39 req-0ffa3d42-5268-4e2b-a486-7e2c93e739ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bb77042-152e-4948-95ab-8849c8d72c80", "name": "network-vif-deleted", "tag": "5ab301f7-76d2-44ce-a32b-a5a47596282b"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:51.355831 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-789c472b-8008-4abd-8ecb-29e49a637c39 req-0ffa3d42-5268-4e2b-a486-7e2c93e739ef service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:51.355831 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-789c472b-8008-4abd-8ecb-29e49a637c39 req-0ffa3d42-5268-4e2b-a486-7e2c93e739ef service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:51.355831 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-789c472b-8008-4abd-8ecb-29e49a637c39 req-0ffa3d42-5268-4e2b-a486-7e2c93e739ef service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:51.424119 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-789c472b-8008-4abd-8ecb-29e49a637c39 req-0ffa3d42-5268-4e2b-a486-7e2c93e739ef service nova] Creating event network-vif-deleted:5ab301f7-76d2-44ce-a32b-a5a47596282b for instance 1bb77042-152e-4948-95ab-8849c8d72c80 on nch2-master-1 Sep 17 21:11:51.443686 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-789c472b-8008-4abd-8ecb-29e49a637c39 req-0ffa3d42-5268-4e2b-a486-7e2c93e739ef service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117211 Sep 17 21:11:51.446856 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2447/4786] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:11:51.674465 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fe26382b-f76f-4e52-bd5b-6baf3afb5a44 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:51.681889 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fe26382b-f76f-4e52-bd5b-6baf3afb5a44 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 839ed6b8-9a04-4448-afb8-1eb643476249] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:51.712241 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe26382b-f76f-4e52-bd5b-6baf3afb5a44 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:51.724062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe26382b-f76f-4e52-bd5b-6baf3afb5a44 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:51.728132 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe26382b-f76f-4e52-bd5b-6baf3afb5a44 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:51.731489 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe26382b-f76f-4e52-bd5b-6baf3afb5a44 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:51.733333 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe26382b-f76f-4e52-bd5b-6baf3afb5a44 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:51.737743 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fe26382b-f76f-4e52-bd5b-6baf3afb5a44 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:51.786071 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-fe26382b-f76f-4e52-bd5b-6baf3afb5a44 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] HTTP exception thrown: Instance 839ed6b8-9a04-4448-afb8-1eb643476249 could not be found. Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fe26382b-f76f-4e52-bd5b-6baf3afb5a44 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Request method failure captured: Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249 HTTP/1.1 Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJja5IhqAUJRQXEUU1o8JKB7VL3QF2aEShf_6YtjfGFX6a2gdfOrA57RhEkrL_xji2fJrjERU1MYqs2fkCF1UUkZO1MCrMj-4yvDSZkq5ddhPAEMc-mFSR2bL5wENqd3kTDvDHvjjOdVeCZP6ndR-6jR5boE-dCWiUzV7hdKlqCy2Jhg Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 6fa7e14863254ab3964ac907c168d9e6 Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6fa7e14863254ab3964ac907c168d9e6", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 6fa7e14863254ab3964ac907c168d9e6 Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-AttachVolumeNegativeTest-1020448628-project Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: c544e8e6f7a741c985c92ed7437397cd Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-AttachVolumeNegativeTest-1020448628-project Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 839ed6b8-9a04-4448-afb8-1eb643476249 could not be found. Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '839ed6b8-9a04-4448-afb8-1eb643476249'} Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 839ed6b8-9a04-4448-afb8-1eb643476249 could not be found. Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:11:51.799309 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:11:51.805285 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 839ed6b8-9a04-4448-afb8-1eb643476249 could not be found. Sep 17 21:11:51.805285 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:51.805285 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:51.805285 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:51.805285 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:51.805285 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:51.805285 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:51.805285 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:11:51.805285 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:11:51.805285 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 839ed6b8-9a04-4448-afb8-1eb643476249 could not be found. Sep 17 21:11:51.805285 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:51.805285 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fe26382b-f76f-4e52-bd5b-6baf3afb5a44 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Returning 404 to user: Instance 839ed6b8-9a04-4448-afb8-1eb643476249 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:11:51.805285 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fe26382b-f76f-4e52-bd5b-6baf3afb5a44 tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "DELETE /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249" status: 404 len: 111 microversion: 2.1 time: 0.134903 Sep 17 21:11:51.805285 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2448/4787] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:11:51 2022] DELETE /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:11:51.815480 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9406c109-efdc-4b50-adbe-02d18f31c18a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:51.821128 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9406c109-efdc-4b50-adbe-02d18f31c18a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] [instance: 839ed6b8-9a04-4448-afb8-1eb643476249] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:51.829351 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5f6c9a46-ee54-40f9-8309-82044e4e9a29 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:51.836949 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9406c109-efdc-4b50-adbe-02d18f31c18a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:51.839470 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9406c109-efdc-4b50-adbe-02d18f31c18a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:51.840245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9406c109-efdc-4b50-adbe-02d18f31c18a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:51.841376 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9406c109-efdc-4b50-adbe-02d18f31c18a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:51.841687 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5f6c9a46-ee54-40f9-8309-82044e4e9a29 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af" status: 200 len: 1308 microversion: 2.1 time: 0.880709 Sep 17 21:11:51.842218 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2340/4788] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:50 2022] GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af => generated 1308 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:51.843995 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9406c109-efdc-4b50-adbe-02d18f31c18a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:51.844473 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9406c109-efdc-4b50-adbe-02d18f31c18a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:51.859364 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5430f1d1-46d2-4920-b741-59f2e3295d48 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:51.860346 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5430f1d1-46d2-4920-b741-59f2e3295d48 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] [instance: 1bb77042-152e-4948-95ab-8849c8d72c80] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:51.876859 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-9406c109-efdc-4b50-adbe-02d18f31c18a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] HTTP exception thrown: Instance 839ed6b8-9a04-4448-afb8-1eb643476249 could not be found. Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9406c109-efdc-4b50-adbe-02d18f31c18a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Request method failure captured: Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249 HTTP/1.1 Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJja5IhqAUJRQXEUU1o8JKB7VL3QF2aEShf_6YtjfGFX6a2gdfOrA57RhEkrL_xji2fJrjERU1MYqs2fkCF1UUkZO1MCrMj-4yvDSZkq5ddhPAEMc-mFSR2bL5wENqd3kTDvDHvjjOdVeCZP6ndR-6jR5boE-dCWiUzV7hdKlqCy2Jhg Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 6fa7e14863254ab3964ac907c168d9e6 Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6fa7e14863254ab3964ac907c168d9e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6fa7e14863254ab3964ac907c168d9e6", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 6fa7e14863254ab3964ac907c168d9e6 Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1020448628 Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-AttachVolumeNegativeTest-1020448628-project Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: c544e8e6f7a741c985c92ed7437397cd Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-AttachVolumeNegativeTest-1020448628-project Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 839ed6b8-9a04-4448-afb8-1eb643476249 could not be found. Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '839ed6b8-9a04-4448-afb8-1eb643476249'} Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 839ed6b8-9a04-4448-afb8-1eb643476249 could not be found. Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 839ed6b8-9a04-4448-afb8-1eb643476249 could not be found. Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:51.878874 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:51.883798 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:51.883798 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:51.883798 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:51.883798 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:11:51.883798 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:11:51.883798 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 839ed6b8-9a04-4448-afb8-1eb643476249 could not be found. Sep 17 21:11:51.883798 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:51.883798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9406c109-efdc-4b50-adbe-02d18f31c18a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] Returning 404 to user: Instance 839ed6b8-9a04-4448-afb8-1eb643476249 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:11:51.885252 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5430f1d1-46d2-4920-b741-59f2e3295d48 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:51.885252 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5430f1d1-46d2-4920-b741-59f2e3295d48 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:51.886109 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9406c109-efdc-4b50-adbe-02d18f31c18a tempest-AttachVolumeNegativeTest-1020448628 tempest-AttachVolumeNegativeTest-1020448628-project] 10.222.0.26 "GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249" status: 404 len: 111 microversion: 2.1 time: 0.072421 Sep 17 21:11:51.886254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5430f1d1-46d2-4920-b741-59f2e3295d48 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:51.886254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5430f1d1-46d2-4920-b741-59f2e3295d48 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:51.891003 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2449/4789] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:51 2022] GET /compute/v2.1/servers/839ed6b8-9a04-4448-afb8-1eb643476249 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:11:51.894101 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5430f1d1-46d2-4920-b741-59f2e3295d48 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:51.895083 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5430f1d1-46d2-4920-b741-59f2e3295d48 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:52.011511 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5430f1d1-46d2-4920-b741-59f2e3295d48 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:52.012040 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5430f1d1-46d2-4920-b741-59f2e3295d48 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:52.012725 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5430f1d1-46d2-4920-b741-59f2e3295d48 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:52.012970 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-5430f1d1-46d2-4920-b741-59f2e3295d48 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lazy-loading 'fault' on Instance uuid 1bb77042-152e-4948-95ab-8849c8d72c80 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:11:52.065620 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=8 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:11:52.316671 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5430f1d1-46d2-4920-b741-59f2e3295d48 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fbd80f0e5bf46b78a79fd821e9ff89e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ceec62fde59414ebb34572d8f8fbcfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:52.327924 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5430f1d1-46d2-4920-b741-59f2e3295d48 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80" status: 200 len: 1307 microversion: 2.1 time: 0.482735 Sep 17 21:11:52.334233 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2341/4790] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:51 2022] GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80 => generated 1307 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:52.869135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-30e8804b-709e-4cb6-8245-9a156c45509f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:52.870671 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-30e8804b-709e-4cb6-8245-9a156c45509f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 6bddcf4c-0951-44ad-a435-0ceb98ec51af] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:52.884341 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-30e8804b-709e-4cb6-8245-9a156c45509f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:52.887875 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-30e8804b-709e-4cb6-8245-9a156c45509f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:52.888442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-30e8804b-709e-4cb6-8245-9a156c45509f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:52.891019 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-30e8804b-709e-4cb6-8245-9a156c45509f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:52.891492 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-30e8804b-709e-4cb6-8245-9a156c45509f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:52.893519 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-30e8804b-709e-4cb6-8245-9a156c45509f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:53.359641 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4bba8672-17c4-4174-90ef-6221c4ea0209 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:53.360879 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4bba8672-17c4-4174-90ef-6221c4ea0209 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] [instance: 1bb77042-152e-4948-95ab-8849c8d72c80] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:53.379778 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bba8672-17c4-4174-90ef-6221c4ea0209 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:53.381936 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bba8672-17c4-4174-90ef-6221c4ea0209 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:53.382483 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bba8672-17c4-4174-90ef-6221c4ea0209 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:53.385037 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bba8672-17c4-4174-90ef-6221c4ea0209 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:53.386776 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bba8672-17c4-4174-90ef-6221c4ea0209 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:53.387354 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bba8672-17c4-4174-90ef-6221c4ea0209 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:53.416146 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-4bba8672-17c4-4174-90ef-6221c4ea0209 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] HTTP exception thrown: Instance 1bb77042-152e-4948-95ab-8849c8d72c80 could not be found. Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4bba8672-17c4-4174-90ef-6221c4ea0209 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Request method failure captured: Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80 HTTP/1.1 Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJje5pW96mXlG3sEKZKUl50Vom2nWVUErSMUVGOktH9S0Qq3vB20rQivGXglvyfpapn5tQGW6zImyqgBVvz-l17thXLzN77I2eHTk9Jbfx9tNqmYamtHzMnJZWvwngrqsa2HTEASWBt5UftJEO43bkfulMtxTrl44Kx8dRlzhkRZRGJw Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 4ceec62fde59414ebb34572d8f8fbcfe Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ImagesOneServerTestJSON-1821562040 Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ceec62fde59414ebb34572d8f8fbcfe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4ceec62fde59414ebb34572d8f8fbcfe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4ceec62fde59414ebb34572d8f8fbcfe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4ceec62fde59414ebb34572d8f8fbcfe", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ImagesOneServerTestJSON-1821562040 Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 4ceec62fde59414ebb34572d8f8fbcfe Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1821562040 Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ImagesOneServerTestJSON-1821562040-project Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 1fbd80f0e5bf46b78a79fd821e9ff89e Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ImagesOneServerTestJSON-1821562040-project Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 1bb77042-152e-4948-95ab-8849c8d72c80 could not be found. Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '1bb77042-152e-4948-95ab-8849c8d72c80'} Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bb77042-152e-4948-95ab-8849c8d72c80 could not be found. Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bb77042-152e-4948-95ab-8849c8d72c80 could not be found. Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:53.417871 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:53.424967 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:53.424967 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:53.424967 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:53.424967 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:11:53.424967 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:11:53.424967 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bb77042-152e-4948-95ab-8849c8d72c80 could not be found. Sep 17 21:11:53.424967 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:11:53.424967 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4bba8672-17c4-4174-90ef-6221c4ea0209 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] Returning 404 to user: Instance 1bb77042-152e-4948-95ab-8849c8d72c80 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:11:53.424967 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4bba8672-17c4-4174-90ef-6221c4ea0209 tempest-ImagesOneServerTestJSON-1821562040 tempest-ImagesOneServerTestJSON-1821562040-project] 10.222.0.26 "GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80" status: 404 len: 111 microversion: 2.1 time: 0.065459 Sep 17 21:11:53.426599 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2342/4791] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:53 2022] GET /compute/v2.1/servers/1bb77042-152e-4948-95ab-8849c8d72c80 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 21:11:53.510959 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-217b11d0-ba55-4a54-b79e-2c22c3bbf9d5 req-69908e14-1914-47af-9122-d86264cae176 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bddcf4c-0951-44ad-a435-0ceb98ec51af", "tag": "af044225-1892-49b2-a364-4110608bb901"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:11:53.531270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-217b11d0-ba55-4a54-b79e-2c22c3bbf9d5 req-69908e14-1914-47af-9122-d86264cae176 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:53.532190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-217b11d0-ba55-4a54-b79e-2c22c3bbf9d5 req-69908e14-1914-47af-9122-d86264cae176 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:53.532872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-217b11d0-ba55-4a54-b79e-2c22c3bbf9d5 req-69908e14-1914-47af-9122-d86264cae176 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:53.544814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:11:53.567706 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-217b11d0-ba55-4a54-b79e-2c22c3bbf9d5 req-69908e14-1914-47af-9122-d86264cae176 service nova] Creating event network-changed:af044225-1892-49b2-a364-4110608bb901 for instance 6bddcf4c-0951-44ad-a435-0ceb98ec51af on nch1-master-1 Sep 17 21:11:53.581815 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-217b11d0-ba55-4a54-b79e-2c22c3bbf9d5 req-69908e14-1914-47af-9122-d86264cae176 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074402 Sep 17 21:11:53.587242 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2343/4792] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:11:53.710906 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-30e8804b-709e-4cb6-8245-9a156c45509f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:53.725000 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-30e8804b-709e-4cb6-8245-9a156c45509f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af" status: 200 len: 1308 microversion: 2.1 time: 0.858852 Sep 17 21:11:53.727238 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2450/4793] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:52 2022] GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af => generated 1308 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:54.756580 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5fa7cdd5-13f3-435b-b7ef-5aab8d7748f4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:54.757423 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5fa7cdd5-13f3-435b-b7ef-5aab8d7748f4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 6bddcf4c-0951-44ad-a435-0ceb98ec51af] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:54.781034 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5fa7cdd5-13f3-435b-b7ef-5aab8d7748f4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:54.782687 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5fa7cdd5-13f3-435b-b7ef-5aab8d7748f4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:54.784902 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5fa7cdd5-13f3-435b-b7ef-5aab8d7748f4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:54.786158 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5fa7cdd5-13f3-435b-b7ef-5aab8d7748f4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:54.787808 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5fa7cdd5-13f3-435b-b7ef-5aab8d7748f4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:54.798004 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5fa7cdd5-13f3-435b-b7ef-5aab8d7748f4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:56.275988 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5fa7cdd5-13f3-435b-b7ef-5aab8d7748f4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:56.290580 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5fa7cdd5-13f3-435b-b7ef-5aab8d7748f4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af" status: 200 len: 1308 microversion: 2.1 time: 1.540184 Sep 17 21:11:56.291195 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2344/4794] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:54 2022] GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af => generated 1308 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:57.215796 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3a0514e2-912c-442f-b3c3-a55dd78382f7 tempest-ListImageFiltersNegativeTestJSON-813000713 tempest-ListImageFiltersNegativeTestJSON-813000713-project] Calling method '.version_select at 0x7f25a9f623a0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:57.253604 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-3a0514e2-912c-442f-b3c3-a55dd78382f7 tempest-ListImageFiltersNegativeTestJSON-813000713 tempest-ListImageFiltersNegativeTestJSON-813000713-project] HTTP exception thrown: Image not found. Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3a0514e2-912c-442f-b3c3-a55dd78382f7 tempest-ListImageFiltersNegativeTestJSON-813000713 tempest-ListImageFiltersNegativeTestJSON-813000713-project] Request method failure captured: Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/images/955dc57a-c5e5-4e32-bf02-d7fad124db4e HTTP/1.1 Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjgchHK2gqSt3yaKfmuCPwMY9jabq_-wktsaLquuh5bOsZvqm-1Y6z7aUz4g816VhbpVL-AZjiJzSOrOp1eWuAIF3MCbInlIUog0Z8i1dCsa3-OykSU2_HmMJ1IjbP4IEUZ3jCkoBxV6JiwBrsED01eIcb9BVdiMzDb2Eqgo4NtT_5A Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: cbb1a70cd16e44b599ca8fbfc8ab2b68 Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-813000713 Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cbb1a70cd16e44b599ca8fbfc8ab2b68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cbb1a70cd16e44b599ca8fbfc8ab2b68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cbb1a70cd16e44b599ca8fbfc8ab2b68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cbb1a70cd16e44b599ca8fbfc8ab2b68", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-813000713 Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: cbb1a70cd16e44b599ca8fbfc8ab2b68 Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-813000713 Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ListImageFiltersNegativeTestJSON-813000713-project Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: a8779d6467bd4be0878e1bfa5a32fb2e Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-813000713-project Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: exception: Image not found. Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '955dc57a-c5e5-4e32-bf02-d7fad124db4e'} Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 955dc57a-c5e5-4e32-bf02-d7fad124db4e Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 17 21:11:57.256258 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 955dc57a-c5e5-4e32-bf02-d7fad124db4e could not be found. Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3a0514e2-912c-442f-b3c3-a55dd78382f7 tempest-ListImageFiltersNegativeTestJSON-813000713 tempest-ListImageFiltersNegativeTestJSON-813000713-project] Returning 404 to user: Image not found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:11:57.261124 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3a0514e2-912c-442f-b3c3-a55dd78382f7 tempest-ListImageFiltersNegativeTestJSON-813000713 tempest-ListImageFiltersNegativeTestJSON-813000713-project] 10.222.0.26 "GET /compute/v2.1/images/955dc57a-c5e5-4e32-bf02-d7fad124db4e" status: 404 len: 62 microversion: 2.1 time: 0.677454 Sep 17 21:11:57.266768 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2451/4795] 10.222.0.26 () {58 vars in 1233 bytes} [Sat Sep 17 21:11:56 2022] GET /compute/v2.1/images/955dc57a-c5e5-4e32-bf02-d7fad124db4e => generated 62 bytes in 685 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 21:11:57.319050 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8b57a460-ea42-4e51-9eca-1473191daf34 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:57.319882 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8b57a460-ea42-4e51-9eca-1473191daf34 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 6bddcf4c-0951-44ad-a435-0ceb98ec51af] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:57.334249 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8b57a460-ea42-4e51-9eca-1473191daf34 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:57.336404 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8b57a460-ea42-4e51-9eca-1473191daf34 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:57.339158 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8b57a460-ea42-4e51-9eca-1473191daf34 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:57.340117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8b57a460-ea42-4e51-9eca-1473191daf34 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:57.340947 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8b57a460-ea42-4e51-9eca-1473191daf34 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:57.346091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8b57a460-ea42-4e51-9eca-1473191daf34 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:58.178341 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8b57a460-ea42-4e51-9eca-1473191daf34 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:58.197423 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8b57a460-ea42-4e51-9eca-1473191daf34 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af" status: 200 len: 1308 microversion: 2.1 time: 0.882482 Sep 17 21:11:58.202722 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2345/4796] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:57 2022] GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af => generated 1308 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:11:59.234219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d2579cd1-3445-471d-8075-b07ee034d6ae tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:11:59.234819 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d2579cd1-3445-471d-8075-b07ee034d6ae tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 6bddcf4c-0951-44ad-a435-0ceb98ec51af] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:11:59.253047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d2579cd1-3445-471d-8075-b07ee034d6ae tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:59.254565 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d2579cd1-3445-471d-8075-b07ee034d6ae tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:59.256078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d2579cd1-3445-471d-8075-b07ee034d6ae tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:59.258033 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d2579cd1-3445-471d-8075-b07ee034d6ae tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:11:59.259768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d2579cd1-3445-471d-8075-b07ee034d6ae tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:11:59.260515 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d2579cd1-3445-471d-8075-b07ee034d6ae tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:11:59.802739 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d2579cd1-3445-471d-8075-b07ee034d6ae tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:11:59.818336 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d2579cd1-3445-471d-8075-b07ee034d6ae tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af" status: 200 len: 1308 microversion: 2.1 time: 0.591548 Sep 17 21:11:59.835542 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2452/4797] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:11:59 2022] GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af => generated 1308 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:00.853620 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-aa5f2cf8-82a1-4b7b-af68-2bd6d9593f8e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:00.855074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-aa5f2cf8-82a1-4b7b-af68-2bd6d9593f8e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 6bddcf4c-0951-44ad-a435-0ceb98ec51af] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:00.901672 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa5f2cf8-82a1-4b7b-af68-2bd6d9593f8e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:00.903650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa5f2cf8-82a1-4b7b-af68-2bd6d9593f8e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:00.905273 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa5f2cf8-82a1-4b7b-af68-2bd6d9593f8e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:00.906757 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa5f2cf8-82a1-4b7b-af68-2bd6d9593f8e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:00.914088 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa5f2cf8-82a1-4b7b-af68-2bd6d9593f8e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:00.918253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa5f2cf8-82a1-4b7b-af68-2bd6d9593f8e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:01.473889 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-aa5f2cf8-82a1-4b7b-af68-2bd6d9593f8e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:01.493061 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-aa5f2cf8-82a1-4b7b-af68-2bd6d9593f8e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af" status: 200 len: 1308 microversion: 2.1 time: 0.648650 Sep 17 21:12:01.496645 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2346/4798] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:00 2022] GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af => generated 1308 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:02.524502 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-79dc2fba-3b50-4018-99fa-9147acbfd7b5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:02.525925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-79dc2fba-3b50-4018-99fa-9147acbfd7b5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 6bddcf4c-0951-44ad-a435-0ceb98ec51af] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:02.535912 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:12:02.581541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79dc2fba-3b50-4018-99fa-9147acbfd7b5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:02.582148 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79dc2fba-3b50-4018-99fa-9147acbfd7b5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:02.584354 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79dc2fba-3b50-4018-99fa-9147acbfd7b5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:02.585204 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79dc2fba-3b50-4018-99fa-9147acbfd7b5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:02.587391 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79dc2fba-3b50-4018-99fa-9147acbfd7b5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:02.589381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79dc2fba-3b50-4018-99fa-9147acbfd7b5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:03.150280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-79dc2fba-3b50-4018-99fa-9147acbfd7b5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:03.158424 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-79dc2fba-3b50-4018-99fa-9147acbfd7b5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af" status: 200 len: 1308 microversion: 2.1 time: 0.638696 Sep 17 21:12:03.159615 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2453/4799] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:02 2022] GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af => generated 1308 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:04.183981 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3c0115e0-08db-4172-9524-d6e475af6bb5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:04.184583 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3c0115e0-08db-4172-9524-d6e475af6bb5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 6bddcf4c-0951-44ad-a435-0ceb98ec51af] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:04.194569 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c0115e0-08db-4172-9524-d6e475af6bb5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:04.195081 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c0115e0-08db-4172-9524-d6e475af6bb5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:04.195530 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c0115e0-08db-4172-9524-d6e475af6bb5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:04.196259 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c0115e0-08db-4172-9524-d6e475af6bb5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:04.196736 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c0115e0-08db-4172-9524-d6e475af6bb5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:04.197165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c0115e0-08db-4172-9524-d6e475af6bb5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:04.297973 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f20776f7-c62c-4690-9606-ae2d9f75270d tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1376449055", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "665f64bf-2d10-4ce1-9860-5ea3f82bcd90"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:12:04.353287 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:12:04.433016 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-f20776f7-c62c-4690-9606-ae2d9f75270d tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] validate_networks() for [('665f64bf-2d10-4ce1-9860-5ea3f82bcd90', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:12:04.621883 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3c0115e0-08db-4172-9524-d6e475af6bb5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:04.632916 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3c0115e0-08db-4172-9524-d6e475af6bb5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af" status: 200 len: 1308 microversion: 2.1 time: 0.453454 Sep 17 21:12:04.655868 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2454/4800] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:04 2022] GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af => generated 1308 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:05.137728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-4bc00414-8be2-4649-b500-5d0ab977d7ba req-c1d411f5-3973-460c-ba6c-59204c11d6ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bddcf4c-0951-44ad-a435-0ceb98ec51af", "name": "network-vif-plugged", "status": "completed", "tag": "af044225-1892-49b2-a364-4110608bb901"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:12:05.162122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4bc00414-8be2-4649-b500-5d0ab977d7ba req-c1d411f5-3973-460c-ba6c-59204c11d6ab service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:05.162622 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4bc00414-8be2-4649-b500-5d0ab977d7ba req-c1d411f5-3973-460c-ba6c-59204c11d6ab service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:05.163065 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4bc00414-8be2-4649-b500-5d0ab977d7ba req-c1d411f5-3973-460c-ba6c-59204c11d6ab service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:05.206836 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-4bc00414-8be2-4649-b500-5d0ab977d7ba req-c1d411f5-3973-460c-ba6c-59204c11d6ab service nova] Creating event network-vif-plugged:af044225-1892-49b2-a364-4110608bb901 for instance 6bddcf4c-0951-44ad-a435-0ceb98ec51af on nch1-master-1 Sep 17 21:12:05.219986 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-4bc00414-8be2-4649-b500-5d0ab977d7ba req-c1d411f5-3973-460c-ba6c-59204c11d6ab service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084170 Sep 17 21:12:05.223975 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2455/4801] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:12:05.664386 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-10efaa63-8c23-44c7-97ec-0baba8c63312 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:05.665338 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-10efaa63-8c23-44c7-97ec-0baba8c63312 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 6bddcf4c-0951-44ad-a435-0ceb98ec51af] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:05.714474 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10efaa63-8c23-44c7-97ec-0baba8c63312 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:05.715617 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10efaa63-8c23-44c7-97ec-0baba8c63312 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:05.717589 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10efaa63-8c23-44c7-97ec-0baba8c63312 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:05.719200 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10efaa63-8c23-44c7-97ec-0baba8c63312 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:05.721712 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10efaa63-8c23-44c7-97ec-0baba8c63312 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:05.722409 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10efaa63-8c23-44c7-97ec-0baba8c63312 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:05.952907 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-10efaa63-8c23-44c7-97ec-0baba8c63312 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:05.974057 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-10efaa63-8c23-44c7-97ec-0baba8c63312 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af" status: 200 len: 1308 microversion: 2.1 time: 0.314195 Sep 17 21:12:05.974685 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2456/4802] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:05 2022] GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af => generated 1308 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:06.579837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-f20776f7-c62c-4690-9606-ae2d9f75270d tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:12:06.580354 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-f20776f7-c62c-4690-9606-ae2d9f75270d tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:12:06.580743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-f20776f7-c62c-4690-9606-ae2d9f75270d tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:12:06.581161 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-f20776f7-c62c-4690-9606-ae2d9f75270d tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:12:06.581874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-f20776f7-c62c-4690-9606-ae2d9f75270d tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:12:06.608499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f20776f7-c62c-4690-9606-ae2d9f75270d tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:06.608992 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f20776f7-c62c-4690-9606-ae2d9f75270d tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:06.612521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f20776f7-c62c-4690-9606-ae2d9f75270d tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:06.614404 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f20776f7-c62c-4690-9606-ae2d9f75270d tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:06.616472 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f20776f7-c62c-4690-9606-ae2d9f75270d tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:06.617659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f20776f7-c62c-4690-9606-ae2d9f75270d tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:06.711002 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-f20776f7-c62c-4690-9606-ae2d9f75270d tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Getting quotas for project bbb68270a6474c41b16e24cae657407c. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:12:06.728174 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-f20776f7-c62c-4690-9606-ae2d9f75270d tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Getting quotas for user adfe77cd9de149508efbea44af748876 and project bbb68270a6474c41b16e24cae657407c. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:12:06.776667 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f20776f7-c62c-4690-9606-ae2d9f75270d tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:12:06.788728 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f20776f7-c62c-4690-9606-ae2d9f75270d tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] [instance: 1aa0744f-d655-4a61-b2cb-c640353d85c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:12:06.957180 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f20776f7-c62c-4690-9606-ae2d9f75270d tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.107237 Sep 17 21:12:06.965798 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2347/4803] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:12:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 3115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:12:06.969635 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-dbda4986-ec37-4f18-a87d-4427f654b408 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:06.970345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-dbda4986-ec37-4f18-a87d-4427f654b408 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] [instance: 1aa0744f-d655-4a61-b2cb-c640353d85c5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:07.003518 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b3e61594-e914-48cc-ae35-420aafb116e3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:07.004150 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b3e61594-e914-48cc-ae35-420aafb116e3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 6bddcf4c-0951-44ad-a435-0ceb98ec51af] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:07.020494 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3e61594-e914-48cc-ae35-420aafb116e3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:07.021260 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3e61594-e914-48cc-ae35-420aafb116e3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:07.021749 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3e61594-e914-48cc-ae35-420aafb116e3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:07.028046 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3e61594-e914-48cc-ae35-420aafb116e3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:07.028528 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3e61594-e914-48cc-ae35-420aafb116e3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:07.028976 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3e61594-e914-48cc-ae35-420aafb116e3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:08.007349 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-dbda4986-ec37-4f18-a87d-4427f654b408 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfe77cd9de149508efbea44af748876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb68270a6474c41b16e24cae657407c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:08.019568 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-dbda4986-ec37-4f18-a87d-4427f654b408 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5" status: 200 len: 1228 microversion: 2.1 time: 1.054268 Sep 17 21:12:08.038069 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2457/4804] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:06 2022] GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5 => generated 1228 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:08.313880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b3e61594-e914-48cc-ae35-420aafb116e3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:08.326267 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b3e61594-e914-48cc-ae35-420aafb116e3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af" status: 200 len: 1308 microversion: 2.1 time: 1.326917 Sep 17 21:12:08.347113 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2348/4805] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:06 2022] GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af => generated 1308 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:09.051173 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c6b9234f-d3c0-497c-af4b-e6cca27b76ab tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:09.051973 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c6b9234f-d3c0-497c-af4b-e6cca27b76ab tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] [instance: 1aa0744f-d655-4a61-b2cb-c640353d85c5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:09.077431 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c6b9234f-d3c0-497c-af4b-e6cca27b76ab tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:09.077931 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c6b9234f-d3c0-497c-af4b-e6cca27b76ab tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:09.079457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c6b9234f-d3c0-497c-af4b-e6cca27b76ab tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:09.080309 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c6b9234f-d3c0-497c-af4b-e6cca27b76ab tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:09.083207 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c6b9234f-d3c0-497c-af4b-e6cca27b76ab tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:09.083756 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c6b9234f-d3c0-497c-af4b-e6cca27b76ab tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:09.248263 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c6b9234f-d3c0-497c-af4b-e6cca27b76ab tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfe77cd9de149508efbea44af748876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb68270a6474c41b16e24cae657407c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:09.268812 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c6b9234f-d3c0-497c-af4b-e6cca27b76ab tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5" status: 200 len: 1280 microversion: 2.1 time: 0.223653 Sep 17 21:12:09.272639 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2458/4806] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:09 2022] GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5 => generated 1280 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:09.354668 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-31023317-6d5f-44d0-96ca-4ce2799e6031 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:09.355569 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-31023317-6d5f-44d0-96ca-4ce2799e6031 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 6bddcf4c-0951-44ad-a435-0ceb98ec51af] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:09.376100 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31023317-6d5f-44d0-96ca-4ce2799e6031 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:09.376751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31023317-6d5f-44d0-96ca-4ce2799e6031 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:09.380392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31023317-6d5f-44d0-96ca-4ce2799e6031 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:09.384822 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31023317-6d5f-44d0-96ca-4ce2799e6031 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:09.386136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31023317-6d5f-44d0-96ca-4ce2799e6031 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:09.387711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31023317-6d5f-44d0-96ca-4ce2799e6031 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:09.849239 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ef30d9d0-da44-4ddf-a76f-0d16678e5d39 tempest-VolumesNegativeTest-694653778 tempest-VolumesNegativeTest-694653778-project] Action: 'create', calling method: .version_select at 0x7f25a5b2c430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1688149922", "metadata": {"Type": "work"}}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ef30d9d0-da44-4ddf-a76f-0d16678e5d39 tempest-VolumesNegativeTest-694653778 tempest-VolumesNegativeTest-694653778-project] Request method failure captured: Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 122 Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjgp0XtVWS0jduApNRspMJ4FS-4gHhwNkq_5OhT2EEApTCckwyrBLNQEzwb2BGE-TMLDHuxXiJISf9qcb672Qto2gHW7tmKPiZRXO521cGqMJSLNNtWDFf8zTzsQSox2b1hpxY5yedY5bcrC_-uv0i2CjK2l6fTsHTRhYe6XGzO8bXs Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: fb5d96e0cc3e44cf87621d02139e5d08 Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-VolumesNegativeTest-694653778 Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb5d96e0cc3e44cf87621d02139e5d08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fb5d96e0cc3e44cf87621d02139e5d08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb5d96e0cc3e44cf87621d02139e5d08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fb5d96e0cc3e44cf87621d02139e5d08", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-VolumesNegativeTest-694653778 Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: fb5d96e0cc3e44cf87621d02139e5d08 Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-VolumesNegativeTest-694653778 Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-VolumesNegativeTest-694653778-project Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: b0a6fe32bc05417785f59880fe99b1aa Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-VolumesNegativeTest-694653778-project Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1688149922", "metadata": {"Type": "work"}}} Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1688149922', 'metadata': {'Type': 'work'}}}} Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise error Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi '#$%' Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 21:12:09.859387 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 21:12:09.864168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 17 21:12:09.864168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:09.864168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:12:09.864168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:09.864168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:09.864168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:12:09.864168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:12:09.864168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 21:12:09.864168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 21:12:09.864168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 17 21:12:09.864168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:09.867505 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ef30d9d0-da44-4ddf-a76f-0d16678e5d39 tempest-VolumesNegativeTest-694653778 tempest-VolumesNegativeTest-694653778-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:12:09.869310 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ef30d9d0-da44-4ddf-a76f-0d16678e5d39 tempest-VolumesNegativeTest-694653778 tempest-VolumesNegativeTest-694653778-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.547413 Sep 17 21:12:09.870517 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2349/4807] 10.222.0.26 () {60 vars in 1156 bytes} [Sat Sep 17 21:12:09 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 549 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:12:09.885111 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-560e41e1-28f1-45da-8790-dc97554b12e6 tempest-VolumesNegativeTest-694653778 tempest-VolumesNegativeTest-694653778-project] Action: 'create', calling method: .version_select at 0x7f25a4cd3a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-161551439", "metadata": {"Type": "work"}}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-560e41e1-28f1-45da-8790-dc97554b12e6 tempest-VolumesNegativeTest-694653778 tempest-VolumesNegativeTest-694653778-project] Request method failure captured: Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 119 Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjgp0XtVWS0jduApNRspMJ4FS-4gHhwNkq_5OhT2EEApTCckwyrBLNQEzwb2BGE-TMLDHuxXiJISf9qcb672Qto2gHW7tmKPiZRXO521cGqMJSLNNtWDFf8zTzsQSox2b1hpxY5yedY5bcrC_-uv0i2CjK2l6fTsHTRhYe6XGzO8bXs Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: fb5d96e0cc3e44cf87621d02139e5d08 Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-VolumesNegativeTest-694653778 Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb5d96e0cc3e44cf87621d02139e5d08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fb5d96e0cc3e44cf87621d02139e5d08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb5d96e0cc3e44cf87621d02139e5d08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fb5d96e0cc3e44cf87621d02139e5d08", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-VolumesNegativeTest-694653778 Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: fb5d96e0cc3e44cf87621d02139e5d08 Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-VolumesNegativeTest-694653778 Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-VolumesNegativeTest-694653778-project Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: b0a6fe32bc05417785f59880fe99b1aa Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-VolumesNegativeTest-694653778-project Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-161551439", "metadata": {"Type": "work"}}} Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-161551439', 'metadata': {'Type': 'work'}}}} Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise error Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi '0' Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 21:12:09.890968 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 21:12:09.895239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 17 21:12:09.895239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:09.895239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:12:09.895239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:09.895239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:09.895239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:12:09.895239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:12:09.895239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 21:12:09.895239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 21:12:09.895239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 17 21:12:09.895239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:09.898555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-560e41e1-28f1-45da-8790-dc97554b12e6 tempest-VolumesNegativeTest-694653778 tempest-VolumesNegativeTest-694653778-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:12:09.899988 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-560e41e1-28f1-45da-8790-dc97554b12e6 tempest-VolumesNegativeTest-694653778 tempest-VolumesNegativeTest-694653778-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.021511 Sep 17 21:12:09.901048 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2350/4808] 10.222.0.26 () {60 vars in 1156 bytes} [Sat Sep 17 21:12:09 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:12:09.915105 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-653c5a71-2c76-4ac9-aca4-807f4a06e801 tempest-VolumesNegativeTest-694653778 tempest-VolumesNegativeTest-694653778-project] Action: 'create', calling method: .version_select at 0x7f25a4710670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1262153106", "metadata": {"Type": "work"}}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-653c5a71-2c76-4ac9-aca4-807f4a06e801 tempest-VolumesNegativeTest-694653778 tempest-VolumesNegativeTest-694653778-project] Request method failure captured: Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 119 Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjgp0XtVWS0jduApNRspMJ4FS-4gHhwNkq_5OhT2EEApTCckwyrBLNQEzwb2BGE-TMLDHuxXiJISf9qcb672Qto2gHW7tmKPiZRXO521cGqMJSLNNtWDFf8zTzsQSox2b1hpxY5yedY5bcrC_-uv0i2CjK2l6fTsHTRhYe6XGzO8bXs Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: fb5d96e0cc3e44cf87621d02139e5d08 Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-VolumesNegativeTest-694653778 Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb5d96e0cc3e44cf87621d02139e5d08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fb5d96e0cc3e44cf87621d02139e5d08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb5d96e0cc3e44cf87621d02139e5d08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fb5d96e0cc3e44cf87621d02139e5d08", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-VolumesNegativeTest-694653778 Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: fb5d96e0cc3e44cf87621d02139e5d08 Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-VolumesNegativeTest-694653778 Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-VolumesNegativeTest-694653778-project Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: b0a6fe32bc05417785f59880fe99b1aa Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-VolumesNegativeTest-694653778-project Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1262153106", "metadata": {"Type": "work"}}} Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1262153106', 'metadata': {'Type': 'work'}}}} Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise error Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi '' Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 21:12:09.920713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 21:12:09.925058 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 17 21:12:09.925058 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:09.925058 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:12:09.925058 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:09.925058 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:09.925058 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:12:09.925058 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:12:09.925058 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 21:12:09.925058 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 21:12:09.925058 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 17 21:12:09.925058 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:09.929900 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-653c5a71-2c76-4ac9-aca4-807f4a06e801 tempest-VolumesNegativeTest-694653778 tempest-VolumesNegativeTest-694653778-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:12:09.931277 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-653c5a71-2c76-4ac9-aca4-807f4a06e801 tempest-VolumesNegativeTest-694653778 tempest-VolumesNegativeTest-694653778-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.020782 Sep 17 21:12:09.936831 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2351/4809] 10.222.0.26 () {60 vars in 1156 bytes} [Sat Sep 17 21:12:09 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:12:09.947568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-594448d9-a6bd-4119-8446-27fc97a85bc1 tempest-VolumesNegativeTest-694653778 tempest-VolumesNegativeTest-694653778-project] Calling method '.version_select at 0x7f25a4fc4160>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:10.003329 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-594448d9-a6bd-4119-8446-27fc97a85bc1 tempest-VolumesNegativeTest-694653778 tempest-VolumesNegativeTest-694653778-project] HTTP exception thrown: Volume tempest-invalid-480411182 could not be found. Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-594448d9-a6bd-4119-8446-27fc97a85bc1 tempest-VolumesNegativeTest-694653778 tempest-VolumesNegativeTest-694653778-project] Request method failure captured: Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-480411182 HTTP/1.1 Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjgp0XtVWS0jduApNRspMJ4FS-4gHhwNkq_5OhT2EEApTCckwyrBLNQEzwb2BGE-TMLDHuxXiJISf9qcb672Qto2gHW7tmKPiZRXO521cGqMJSLNNtWDFf8zTzsQSox2b1hpxY5yedY5bcrC_-uv0i2CjK2l6fTsHTRhYe6XGzO8bXs Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: fb5d96e0cc3e44cf87621d02139e5d08 Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-VolumesNegativeTest-694653778 Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb5d96e0cc3e44cf87621d02139e5d08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fb5d96e0cc3e44cf87621d02139e5d08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb5d96e0cc3e44cf87621d02139e5d08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fb5d96e0cc3e44cf87621d02139e5d08", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-VolumesNegativeTest-694653778 Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: fb5d96e0cc3e44cf87621d02139e5d08 Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-VolumesNegativeTest-694653778 Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-VolumesNegativeTest-694653778-project Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: b0a6fe32bc05417785f59880fe99b1aa Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-VolumesNegativeTest-694653778-project Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: exception: Volume tempest-invalid-480411182 could not be found. Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'tempest-invalid-480411182'} Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-480411182 could not be found. (HTTP 404) (Request-ID: req-01b07575-163d-4c38-a547-2897aa500a8f) Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 17 21:12:10.005609 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-480411182 could not be found. Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-480411182 could not be found. Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-480411182 could not be found. Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-594448d9-a6bd-4119-8446-27fc97a85bc1 tempest-VolumesNegativeTest-694653778 tempest-VolumesNegativeTest-694653778-project] Returning 404 to user: Volume tempest-invalid-480411182 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-594448d9-a6bd-4119-8446-27fc97a85bc1 tempest-VolumesNegativeTest-694653778 tempest-VolumesNegativeTest-694653778-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-480411182" status: 404 len: 98 microversion: 2.1 time: 0.063784 Sep 17 21:12:10.011865 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2352/4810] 10.222.0.26 () {58 vars in 1215 bytes} [Sat Sep 17 21:12:09 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-480411182 => generated 98 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 21:12:10.020193 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-10ae9cf8-f082-4732-9a2a-3d8768144eca tempest-VolumesNegativeTest-694653778 tempest-VolumesNegativeTest-694653778-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005061 Sep 17 21:12:10.020987 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2353/4811] 10.222.0.26 () {58 vars in 1140 bytes} [Sat Sep 17 21:12:10 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 17 21:12:10.036347 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d94fac3c-fdc3-4cab-8388-19d09527e484 tempest-VolumesNegativeTest-694653778 tempest-VolumesNegativeTest-694653778-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008650 Sep 17 21:12:10.039272 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2354/4812] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Sep 17 21:12:10 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 17 21:12:10.051814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6aee9878-454b-4d58-8254-7ef0d8aaf830 tempest-VolumesNegativeTest-694653778 tempest-VolumesNegativeTest-694653778-project] Calling method '.version_select at 0x7f25a5b2cd30>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:10.109369 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-6aee9878-454b-4d58-8254-7ef0d8aaf830 tempest-VolumesNegativeTest-694653778 tempest-VolumesNegativeTest-694653778-project] HTTP exception thrown: Volume 91d747a3-8c9e-4342-b7ab-c155487ab41f could not be found. Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6aee9878-454b-4d58-8254-7ef0d8aaf830 tempest-VolumesNegativeTest-694653778 tempest-VolumesNegativeTest-694653778-project] Request method failure captured: Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/os-volumes/91d747a3-8c9e-4342-b7ab-c155487ab41f HTTP/1.1 Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjgp0XtVWS0jduApNRspMJ4FS-4gHhwNkq_5OhT2EEApTCckwyrBLNQEzwb2BGE-TMLDHuxXiJISf9qcb672Qto2gHW7tmKPiZRXO521cGqMJSLNNtWDFf8zTzsQSox2b1hpxY5yedY5bcrC_-uv0i2CjK2l6fTsHTRhYe6XGzO8bXs Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: fb5d96e0cc3e44cf87621d02139e5d08 Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-VolumesNegativeTest-694653778 Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb5d96e0cc3e44cf87621d02139e5d08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fb5d96e0cc3e44cf87621d02139e5d08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb5d96e0cc3e44cf87621d02139e5d08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fb5d96e0cc3e44cf87621d02139e5d08", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-VolumesNegativeTest-694653778 Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: fb5d96e0cc3e44cf87621d02139e5d08 Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-VolumesNegativeTest-694653778 Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-VolumesNegativeTest-694653778-project Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: b0a6fe32bc05417785f59880fe99b1aa Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-VolumesNegativeTest-694653778-project Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: exception: Volume 91d747a3-8c9e-4342-b7ab-c155487ab41f could not be found. Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '91d747a3-8c9e-4342-b7ab-c155487ab41f'} Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 91d747a3-8c9e-4342-b7ab-c155487ab41f could not be found. (HTTP 404) (Request-ID: req-02b85453-0413-471b-b69a-2032a2260eb3) Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 17 21:12:10.111596 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 91d747a3-8c9e-4342-b7ab-c155487ab41f could not be found. Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 91d747a3-8c9e-4342-b7ab-c155487ab41f could not be found. Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 91d747a3-8c9e-4342-b7ab-c155487ab41f could not be found. Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6aee9878-454b-4d58-8254-7ef0d8aaf830 tempest-VolumesNegativeTest-694653778 tempest-VolumesNegativeTest-694653778-project] Returning 404 to user: Volume 91d747a3-8c9e-4342-b7ab-c155487ab41f could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6aee9878-454b-4d58-8254-7ef0d8aaf830 tempest-VolumesNegativeTest-694653778 tempest-VolumesNegativeTest-694653778-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/91d747a3-8c9e-4342-b7ab-c155487ab41f" status: 404 len: 109 microversion: 2.1 time: 0.067843 Sep 17 21:12:10.116397 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2355/4813] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Sep 17 21:12:10 2022] DELETE /compute/v2.1/os-volumes/91d747a3-8c9e-4342-b7ab-c155487ab41f => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:12:10.135846 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a88b861c-eb78-470b-b012-6295fde68bfa tempest-VolumesNegativeTest-694653778 tempest-VolumesNegativeTest-694653778-project] Calling method '.version_select at 0x7f25a5a8f4c0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:10.182798 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-a88b861c-eb78-470b-b012-6295fde68bfa tempest-VolumesNegativeTest-694653778 tempest-VolumesNegativeTest-694653778-project] HTTP exception thrown: Volume 1302d79e-0775-4ede-95af-5c887fb7c387 could not be found. Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a88b861c-eb78-470b-b012-6295fde68bfa tempest-VolumesNegativeTest-694653778 tempest-VolumesNegativeTest-694653778-project] Request method failure captured: Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/os-volumes/1302d79e-0775-4ede-95af-5c887fb7c387 HTTP/1.1 Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjgp0XtVWS0jduApNRspMJ4FS-4gHhwNkq_5OhT2EEApTCckwyrBLNQEzwb2BGE-TMLDHuxXiJISf9qcb672Qto2gHW7tmKPiZRXO521cGqMJSLNNtWDFf8zTzsQSox2b1hpxY5yedY5bcrC_-uv0i2CjK2l6fTsHTRhYe6XGzO8bXs Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: fb5d96e0cc3e44cf87621d02139e5d08 Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-VolumesNegativeTest-694653778 Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb5d96e0cc3e44cf87621d02139e5d08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fb5d96e0cc3e44cf87621d02139e5d08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fb5d96e0cc3e44cf87621d02139e5d08"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fb5d96e0cc3e44cf87621d02139e5d08", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-VolumesNegativeTest-694653778 Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: fb5d96e0cc3e44cf87621d02139e5d08 Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-VolumesNegativeTest-694653778 Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-VolumesNegativeTest-694653778-project Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: b0a6fe32bc05417785f59880fe99b1aa Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-VolumesNegativeTest-694653778-project Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: exception: Volume 1302d79e-0775-4ede-95af-5c887fb7c387 could not be found. Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '1302d79e-0775-4ede-95af-5c887fb7c387'} Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1302d79e-0775-4ede-95af-5c887fb7c387 could not be found. (HTTP 404) (Request-ID: req-5ba9a2c3-dc5c-47be-9298-1d912b52ddd1) Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 17 21:12:10.186505 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1302d79e-0775-4ede-95af-5c887fb7c387 could not be found. Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1302d79e-0775-4ede-95af-5c887fb7c387 could not be found. Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1302d79e-0775-4ede-95af-5c887fb7c387 could not be found. Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a88b861c-eb78-470b-b012-6295fde68bfa tempest-VolumesNegativeTest-694653778 tempest-VolumesNegativeTest-694653778-project] Returning 404 to user: Volume 1302d79e-0775-4ede-95af-5c887fb7c387 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a88b861c-eb78-470b-b012-6295fde68bfa tempest-VolumesNegativeTest-694653778 tempest-VolumesNegativeTest-694653778-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/1302d79e-0775-4ede-95af-5c887fb7c387" status: 404 len: 109 microversion: 2.1 time: 0.067566 Sep 17 21:12:10.193016 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2356/4814] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Sep 17 21:12:10 2022] GET /compute/v2.1/os-volumes/1302d79e-0775-4ede-95af-5c887fb7c387 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:12:10.295925 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e30575b4-ea13-4c96-b463-d7e699369055 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:10.297452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e30575b4-ea13-4c96-b463-d7e699369055 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] [instance: 1aa0744f-d655-4a61-b2cb-c640353d85c5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:10.324141 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e30575b4-ea13-4c96-b463-d7e699369055 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:10.325083 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e30575b4-ea13-4c96-b463-d7e699369055 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:10.330217 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e30575b4-ea13-4c96-b463-d7e699369055 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:10.334018 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e30575b4-ea13-4c96-b463-d7e699369055 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:10.334769 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e30575b4-ea13-4c96-b463-d7e699369055 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:10.336608 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e30575b4-ea13-4c96-b463-d7e699369055 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:10.339681 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-31023317-6d5f-44d0-96ca-4ce2799e6031 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:10.361192 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-31023317-6d5f-44d0-96ca-4ce2799e6031 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af" status: 200 len: 1489 microversion: 2.1 time: 1.011860 Sep 17 21:12:10.387988 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2459/4815] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:09 2022] GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af => generated 1489 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:12:10.398957 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3e0580b2-0eb4-4c99-b9cd-49b1a7b7745f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:12:10.402719 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3e0580b2-0eb4-4c99-b9cd-49b1a7b7745f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 6bddcf4c-0951-44ad-a435-0ceb98ec51af] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:10.410674 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e0580b2-0eb4-4c99-b9cd-49b1a7b7745f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:10.411420 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e0580b2-0eb4-4c99-b9cd-49b1a7b7745f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:10.412075 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e0580b2-0eb4-4c99-b9cd-49b1a7b7745f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:10.412975 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e0580b2-0eb4-4c99-b9cd-49b1a7b7745f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:10.413643 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e0580b2-0eb4-4c99-b9cd-49b1a7b7745f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:10.414240 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e0580b2-0eb4-4c99-b9cd-49b1a7b7745f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:10.517967 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3e0580b2-0eb4-4c99-b9cd-49b1a7b7745f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "PUT /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af" status: 200 len: 1084 microversion: 2.1 time: 0.128681 Sep 17 21:12:10.518640 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2460/4816] 10.222.0.26 () {60 vars in 1256 bytes} [Sat Sep 17 21:12:10 2022] PUT /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af => generated 1084 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:10.538970 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-61f85dc6-8aec-4db9-aac7-9f8981f57722 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:10.539725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-61f85dc6-8aec-4db9-aac7-9f8981f57722 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 6bddcf4c-0951-44ad-a435-0ceb98ec51af] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:10.549577 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-61f85dc6-8aec-4db9-aac7-9f8981f57722 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:10.550357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-61f85dc6-8aec-4db9-aac7-9f8981f57722 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:10.551084 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-61f85dc6-8aec-4db9-aac7-9f8981f57722 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:10.551998 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-61f85dc6-8aec-4db9-aac7-9f8981f57722 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:10.552926 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-61f85dc6-8aec-4db9-aac7-9f8981f57722 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:10.553624 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-61f85dc6-8aec-4db9-aac7-9f8981f57722 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:10.839885 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e30575b4-ea13-4c96-b463-d7e699369055 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfe77cd9de149508efbea44af748876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb68270a6474c41b16e24cae657407c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:10.850354 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e30575b4-ea13-4c96-b463-d7e699369055 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5" status: 200 len: 1286 microversion: 2.1 time: 0.561542 Sep 17 21:12:10.871992 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2357/4817] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:10 2022] GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5 => generated 1286 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:11.270679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-61f85dc6-8aec-4db9-aac7-9f8981f57722 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:11.279680 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-61f85dc6-8aec-4db9-aac7-9f8981f57722 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af" status: 200 len: 1510 microversion: 2.1 time: 0.744499 Sep 17 21:12:11.282264 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2461/4818] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:10 2022] GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af => generated 1510 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:11.312361 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e2472578-8393-4f64-a3e1-370a39f5b488 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:11.312996 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e2472578-8393-4f64-a3e1-370a39f5b488 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 6bddcf4c-0951-44ad-a435-0ceb98ec51af] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:11.328407 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2472578-8393-4f64-a3e1-370a39f5b488 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:11.328922 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2472578-8393-4f64-a3e1-370a39f5b488 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:11.329371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2472578-8393-4f64-a3e1-370a39f5b488 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:11.332193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2472578-8393-4f64-a3e1-370a39f5b488 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:11.332676 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2472578-8393-4f64-a3e1-370a39f5b488 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:11.333118 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2472578-8393-4f64-a3e1-370a39f5b488 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:11.876147 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e1a110eb-4f98-4b27-8e32-67de971f847b tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:11.876770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e1a110eb-4f98-4b27-8e32-67de971f847b tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] [instance: 1aa0744f-d655-4a61-b2cb-c640353d85c5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:11.896626 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1a110eb-4f98-4b27-8e32-67de971f847b tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:11.904327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1a110eb-4f98-4b27-8e32-67de971f847b tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:11.904788 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1a110eb-4f98-4b27-8e32-67de971f847b tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:11.905904 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1a110eb-4f98-4b27-8e32-67de971f847b tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:11.906528 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1a110eb-4f98-4b27-8e32-67de971f847b tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:11.907132 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1a110eb-4f98-4b27-8e32-67de971f847b tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:12.060034 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e1a110eb-4f98-4b27-8e32-67de971f847b tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfe77cd9de149508efbea44af748876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb68270a6474c41b16e24cae657407c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:12.082433 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e1a110eb-4f98-4b27-8e32-67de971f847b tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5" status: 200 len: 1286 microversion: 2.1 time: 0.210173 Sep 17 21:12:12.097544 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2462/4819] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:11 2022] GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5 => generated 1286 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:12.366168 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e2472578-8393-4f64-a3e1-370a39f5b488 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:12.384510 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e2472578-8393-4f64-a3e1-370a39f5b488 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af" status: 200 len: 1510 microversion: 2.1 time: 1.076198 Sep 17 21:12:12.385415 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2358/4820] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:11 2022] GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af => generated 1510 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:12.410238 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-50e0c867-232a-4ded-8d66-1a370431f21f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:12.410926 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-50e0c867-232a-4ded-8d66-1a370431f21f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 6bddcf4c-0951-44ad-a435-0ceb98ec51af] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:12.420780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50e0c867-232a-4ded-8d66-1a370431f21f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:12.421726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50e0c867-232a-4ded-8d66-1a370431f21f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:12.424690 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50e0c867-232a-4ded-8d66-1a370431f21f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:12.431411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50e0c867-232a-4ded-8d66-1a370431f21f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:12.432049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50e0c867-232a-4ded-8d66-1a370431f21f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:12.432506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50e0c867-232a-4ded-8d66-1a370431f21f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:12.508483 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-50e0c867-232a-4ded-8d66-1a370431f21f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 6bddcf4c-0951-44ad-a435-0ceb98ec51af] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:12:12.601575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:12:12.703092 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-50e0c867-232a-4ded-8d66-1a370431f21f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af" status: 204 len: 0 microversion: 2.1 time: 0.296375 Sep 17 21:12:12.704169 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2463/4821] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:12:12 2022] DELETE /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:12:12.715670 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8f65b00a-0671-42a1-920f-57bcb493e555 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:12.716310 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8f65b00a-0671-42a1-920f-57bcb493e555 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 6bddcf4c-0951-44ad-a435-0ceb98ec51af] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:12.727111 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8f65b00a-0671-42a1-920f-57bcb493e555 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:12.728210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8f65b00a-0671-42a1-920f-57bcb493e555 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:12.728660 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8f65b00a-0671-42a1-920f-57bcb493e555 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:12.729992 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8f65b00a-0671-42a1-920f-57bcb493e555 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:12.730542 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8f65b00a-0671-42a1-920f-57bcb493e555 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:12.730989 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8f65b00a-0671-42a1-920f-57bcb493e555 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:13.105004 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-04da4c77-9a26-4b5e-995e-315993dc78cb tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:13.105970 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-04da4c77-9a26-4b5e-995e-315993dc78cb tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] [instance: 1aa0744f-d655-4a61-b2cb-c640353d85c5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:13.126944 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-04da4c77-9a26-4b5e-995e-315993dc78cb tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:13.127376 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-04da4c77-9a26-4b5e-995e-315993dc78cb tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:13.127824 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-04da4c77-9a26-4b5e-995e-315993dc78cb tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:13.129773 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-04da4c77-9a26-4b5e-995e-315993dc78cb tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:13.132171 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-04da4c77-9a26-4b5e-995e-315993dc78cb tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:13.133787 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-04da4c77-9a26-4b5e-995e-315993dc78cb tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:13.233185 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8f65b00a-0671-42a1-920f-57bcb493e555 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:13.241427 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8f65b00a-0671-42a1-920f-57bcb493e555 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af" status: 200 len: 1516 microversion: 2.1 time: 0.532860 Sep 17 21:12:13.244337 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2359/4822] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:12 2022] GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af => generated 1516 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:13.585365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d8359d9b-ab1e-4a31-8b05-429e5c6bc314 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Action: 'create', calling method: .version_select at 0x7f25a9fe0280>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1819630111", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCziKxSQTPX65j9MT/GiW5Ajv3twhUw3IzWzrN+HF0D9mBFUDvRe21xogWFbICsYtwXHZaes/WnNCoVOJsxD6KPMNQ6GZJK1n7TpuOoOncfqxiUJiGUJ9w/PvumXWuEIpA=="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:12:13.623899 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-d8359d9b-ab1e-4a31-8b05-429e5c6bc314 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Getting quotas for project cfc26054d4a34fb2b2aef34fb4891b4c. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:12:13.644106 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-d8359d9b-ab1e-4a31-8b05-429e5c6bc314 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Getting quotas for user caa2c2f4848e497f80d4a439c785c2b0 and project cfc26054d4a34fb2b2aef34fb4891b4c. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:12:13.706067 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d8359d9b-ab1e-4a31-8b05-429e5c6bc314 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.446483 Sep 17 21:12:13.712870 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2360/4823] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:12:13 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:12:14.272496 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7064ea04-70bc-44ab-a572-d34e931fef39 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:14.273354 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7064ea04-70bc-44ab-a572-d34e931fef39 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 6bddcf4c-0951-44ad-a435-0ceb98ec51af] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:14.285326 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7064ea04-70bc-44ab-a572-d34e931fef39 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:14.287652 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7064ea04-70bc-44ab-a572-d34e931fef39 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:14.288512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7064ea04-70bc-44ab-a572-d34e931fef39 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:14.292161 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7064ea04-70bc-44ab-a572-d34e931fef39 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:14.297101 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7064ea04-70bc-44ab-a572-d34e931fef39 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:14.298202 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7064ea04-70bc-44ab-a572-d34e931fef39 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:14.434775 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-04da4c77-9a26-4b5e-995e-315993dc78cb tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfe77cd9de149508efbea44af748876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb68270a6474c41b16e24cae657407c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:14.444664 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-04da4c77-9a26-4b5e-995e-315993dc78cb tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5" status: 200 len: 1328 microversion: 2.1 time: 1.343969 Sep 17 21:12:14.445521 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2464/4824] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:13 2022] GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5 => generated 1328 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:15.470681 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a874f630-925e-4deb-b2f8-ae9be5d4f8ad tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:15.471315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a874f630-925e-4deb-b2f8-ae9be5d4f8ad tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] [instance: 1aa0744f-d655-4a61-b2cb-c640353d85c5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:15.484130 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a874f630-925e-4deb-b2f8-ae9be5d4f8ad tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:15.486488 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a874f630-925e-4deb-b2f8-ae9be5d4f8ad tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:15.490958 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a874f630-925e-4deb-b2f8-ae9be5d4f8ad tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:15.492218 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a874f630-925e-4deb-b2f8-ae9be5d4f8ad tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:15.494857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a874f630-925e-4deb-b2f8-ae9be5d4f8ad tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:15.495488 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a874f630-925e-4deb-b2f8-ae9be5d4f8ad tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:15.920891 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7064ea04-70bc-44ab-a572-d34e931fef39 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:15.935576 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7064ea04-70bc-44ab-a572-d34e931fef39 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af" status: 200 len: 1516 microversion: 2.1 time: 1.665589 Sep 17 21:12:15.939157 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2361/4825] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:14 2022] GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af => generated 1516 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:16.164536 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a874f630-925e-4deb-b2f8-ae9be5d4f8ad tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfe77cd9de149508efbea44af748876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb68270a6474c41b16e24cae657407c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:16.172986 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a874f630-925e-4deb-b2f8-ae9be5d4f8ad tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5" status: 200 len: 1328 microversion: 2.1 time: 0.706079 Sep 17 21:12:16.173536 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2465/4826] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:15 2022] GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5 => generated 1328 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:12:16.777792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-a9ab7673-bf7b-4361-ae42-5948f96245d2 req-57123c1f-e22b-45c7-bdeb-1420ac3e0000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bddcf4c-0951-44ad-a435-0ceb98ec51af", "name": "network-vif-deleted", "tag": "af044225-1892-49b2-a364-4110608bb901"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:12:16.799627 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:12:16.826111 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-a9ab7673-bf7b-4361-ae42-5948f96245d2 req-57123c1f-e22b-45c7-bdeb-1420ac3e0000 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:16.827558 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-a9ab7673-bf7b-4361-ae42-5948f96245d2 req-57123c1f-e22b-45c7-bdeb-1420ac3e0000 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:16.828043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-a9ab7673-bf7b-4361-ae42-5948f96245d2 req-57123c1f-e22b-45c7-bdeb-1420ac3e0000 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:16.872424 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-a9ab7673-bf7b-4361-ae42-5948f96245d2 req-57123c1f-e22b-45c7-bdeb-1420ac3e0000 service nova] Creating event network-vif-deleted:af044225-1892-49b2-a364-4110608bb901 for instance 6bddcf4c-0951-44ad-a435-0ceb98ec51af on nch1-master-1 Sep 17 21:12:16.885287 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-a9ab7673-bf7b-4361-ae42-5948f96245d2 req-57123c1f-e22b-45c7-bdeb-1420ac3e0000 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111378 Sep 17 21:12:16.891274 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2362/4827] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:12:16.966247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-42b771db-845e-4c50-a8b8-d0846d68e035 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:16.968756 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-42b771db-845e-4c50-a8b8-d0846d68e035 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 6bddcf4c-0951-44ad-a435-0ceb98ec51af] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:16.984908 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42b771db-845e-4c50-a8b8-d0846d68e035 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:16.985415 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42b771db-845e-4c50-a8b8-d0846d68e035 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:16.985940 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42b771db-845e-4c50-a8b8-d0846d68e035 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:16.986846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42b771db-845e-4c50-a8b8-d0846d68e035 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:16.987498 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42b771db-845e-4c50-a8b8-d0846d68e035 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:16.988093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42b771db-845e-4c50-a8b8-d0846d68e035 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:17.090907 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42b771db-845e-4c50-a8b8-d0846d68e035 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:17.091694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42b771db-845e-4c50-a8b8-d0846d68e035 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:17.092307 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42b771db-845e-4c50-a8b8-d0846d68e035 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:17.092938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-42b771db-845e-4c50-a8b8-d0846d68e035 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lazy-loading 'fault' on Instance uuid 6bddcf4c-0951-44ad-a435-0ceb98ec51af {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:12:17.216165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-24e078cd-2ec3-465b-a447-ccc5252c4a83 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:17.219631 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-24e078cd-2ec3-465b-a447-ccc5252c4a83 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] [instance: 1aa0744f-d655-4a61-b2cb-c640353d85c5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:17.250213 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-42b771db-845e-4c50-a8b8-d0846d68e035 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:17.275179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-24e078cd-2ec3-465b-a447-ccc5252c4a83 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:17.280100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-24e078cd-2ec3-465b-a447-ccc5252c4a83 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:17.281478 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-24e078cd-2ec3-465b-a447-ccc5252c4a83 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:17.285012 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-42b771db-845e-4c50-a8b8-d0846d68e035 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af" status: 200 len: 1319 microversion: 2.1 time: 0.322696 Sep 17 21:12:17.285795 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-24e078cd-2ec3-465b-a447-ccc5252c4a83 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:17.318482 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-24e078cd-2ec3-465b-a447-ccc5252c4a83 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:17.319940 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2466/4828] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:16 2022] GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af => generated 1319 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:17.320786 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-24e078cd-2ec3-465b-a447-ccc5252c4a83 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:17.747434 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-24e078cd-2ec3-465b-a447-ccc5252c4a83 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfe77cd9de149508efbea44af748876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb68270a6474c41b16e24cae657407c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:17.759789 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-24e078cd-2ec3-465b-a447-ccc5252c4a83 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5" status: 200 len: 1328 microversion: 2.1 time: 0.566713 Sep 17 21:12:17.761700 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2363/4829] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:17 2022] GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5 => generated 1328 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:18.323196 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5b461aa7-47e7-4dd3-955c-304247703bb8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:18.323936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5b461aa7-47e7-4dd3-955c-304247703bb8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 6bddcf4c-0951-44ad-a435-0ceb98ec51af] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:18.332898 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:12:18.339108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b461aa7-47e7-4dd3-955c-304247703bb8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:18.339108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b461aa7-47e7-4dd3-955c-304247703bb8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:18.339692 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b461aa7-47e7-4dd3-955c-304247703bb8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:18.341988 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b461aa7-47e7-4dd3-955c-304247703bb8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:18.342670 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b461aa7-47e7-4dd3-955c-304247703bb8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:18.343228 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b461aa7-47e7-4dd3-955c-304247703bb8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:18.362454 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-5b461aa7-47e7-4dd3-955c-304247703bb8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] HTTP exception thrown: Instance 6bddcf4c-0951-44ad-a435-0ceb98ec51af could not be found. Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5b461aa7-47e7-4dd3-955c-304247703bb8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Request method failure captured: Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af HTTP/1.1 Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjdkx_dUaa7DUi-TKVFHTZsVxQrlexvG4SUZm6N8-RAgW-Hgl4Fm16QKjLB8Smzb7fg0_3Heh2RxRO4DM6alOpTGfM4lDQjx-JBymYUztOAuBANR84PPvzFMKCK9hdlODMbdRT3LVU-maWvSxN-XNtXdSltD2p8By-EmBSmK4dFa6Xo Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersTestJSON-167161476 Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b6f25c3540546bf9bffd5610f4f86c8", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersTestJSON-167161476 Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersTestJSON-167161476 Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersTestJSON-167161476-project Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 784233ee78764e7dbb774d3cb50165e3 Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersTestJSON-167161476-project Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 6bddcf4c-0951-44ad-a435-0ceb98ec51af could not be found. Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '6bddcf4c-0951-44ad-a435-0ceb98ec51af'} Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bddcf4c-0951-44ad-a435-0ceb98ec51af could not be found. Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bddcf4c-0951-44ad-a435-0ceb98ec51af could not be found. Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:12:18.364729 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:18.370600 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:12:18.370600 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:12:18.370600 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:12:18.370600 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:12:18.370600 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bddcf4c-0951-44ad-a435-0ceb98ec51af could not be found. Sep 17 21:12:18.370600 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:12:18.371666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5b461aa7-47e7-4dd3-955c-304247703bb8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Returning 404 to user: Instance 6bddcf4c-0951-44ad-a435-0ceb98ec51af could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:12:18.371993 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5b461aa7-47e7-4dd3-955c-304247703bb8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af" status: 404 len: 111 microversion: 2.1 time: 0.059255 Sep 17 21:12:18.372842 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2467/4830] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:18 2022] GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:12:18.561745 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-698026c7-6322-489b-8bfa-54de7cf80dd3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1611685962", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "ff632525-8d7d-4854-beaf-dc49c77bdd36"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:12:18.666123 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-698026c7-6322-489b-8bfa-54de7cf80dd3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] validate_networks() for [('ff632525-8d7d-4854-beaf-dc49c77bdd36', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:12:18.784494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-722a27ed-59d0-4be4-8fa4-e17c23626c8c tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:18.785233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-722a27ed-59d0-4be4-8fa4-e17c23626c8c tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] [instance: 1aa0744f-d655-4a61-b2cb-c640353d85c5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:18.791649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-722a27ed-59d0-4be4-8fa4-e17c23626c8c tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:18.798222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-722a27ed-59d0-4be4-8fa4-e17c23626c8c tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:18.799030 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-722a27ed-59d0-4be4-8fa4-e17c23626c8c tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:18.800052 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-722a27ed-59d0-4be4-8fa4-e17c23626c8c tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:18.801397 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-722a27ed-59d0-4be4-8fa4-e17c23626c8c tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:18.802323 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-722a27ed-59d0-4be4-8fa4-e17c23626c8c tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:19.607512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-722a27ed-59d0-4be4-8fa4-e17c23626c8c tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfe77cd9de149508efbea44af748876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb68270a6474c41b16e24cae657407c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:19.620149 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-722a27ed-59d0-4be4-8fa4-e17c23626c8c tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5" status: 200 len: 1328 microversion: 2.1 time: 0.840164 Sep 17 21:12:19.636689 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2468/4831] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:18 2022] GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5 => generated 1328 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:12:19.647626 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-6d4e19a0-07de-4128-9f79-b335b1478d2f req-f6bf9b9e-bac8-4702-bc64-3ba7c76605ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aa0744f-d655-4a61-b2cb-c640353d85c5", "tag": "56a84396-c082-49b0-ad97-c3c5dcd571e5"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:12:19.666632 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6d4e19a0-07de-4128-9f79-b335b1478d2f req-f6bf9b9e-bac8-4702-bc64-3ba7c76605ec service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:19.667536 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6d4e19a0-07de-4128-9f79-b335b1478d2f req-f6bf9b9e-bac8-4702-bc64-3ba7c76605ec service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:19.668333 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6d4e19a0-07de-4128-9f79-b335b1478d2f req-f6bf9b9e-bac8-4702-bc64-3ba7c76605ec service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:19.697392 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-6d4e19a0-07de-4128-9f79-b335b1478d2f req-f6bf9b9e-bac8-4702-bc64-3ba7c76605ec service nova] Creating event network-changed:56a84396-c082-49b0-ad97-c3c5dcd571e5 for instance 1aa0744f-d655-4a61-b2cb-c640353d85c5 on nch2-master-1 Sep 17 21:12:19.715915 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-6d4e19a0-07de-4128-9f79-b335b1478d2f req-f6bf9b9e-bac8-4702-bc64-3ba7c76605ec service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073734 Sep 17 21:12:19.718777 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2469/4832] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:12:20.605553 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-698026c7-6322-489b-8bfa-54de7cf80dd3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:12:20.606097 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-698026c7-6322-489b-8bfa-54de7cf80dd3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:12:20.606492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-698026c7-6322-489b-8bfa-54de7cf80dd3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:12:20.606915 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-698026c7-6322-489b-8bfa-54de7cf80dd3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:12:20.607326 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-698026c7-6322-489b-8bfa-54de7cf80dd3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:12:20.677656 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-698026c7-6322-489b-8bfa-54de7cf80dd3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:20.678232 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-698026c7-6322-489b-8bfa-54de7cf80dd3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:20.678661 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-698026c7-6322-489b-8bfa-54de7cf80dd3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:20.679465 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-698026c7-6322-489b-8bfa-54de7cf80dd3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:20.680037 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-698026c7-6322-489b-8bfa-54de7cf80dd3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:20.680471 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-698026c7-6322-489b-8bfa-54de7cf80dd3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:20.772094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-698026c7-6322-489b-8bfa-54de7cf80dd3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Getting quotas for project 0b6f25c3540546bf9bffd5610f4f86c8. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:12:20.795307 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-698026c7-6322-489b-8bfa-54de7cf80dd3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Getting quotas for user 784233ee78764e7dbb774d3cb50165e3 and project 0b6f25c3540546bf9bffd5610f4f86c8. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:12:20.831175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-698026c7-6322-489b-8bfa-54de7cf80dd3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:12:20.835957 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-698026c7-6322-489b-8bfa-54de7cf80dd3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:12:20.951498 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-698026c7-6322-489b-8bfa-54de7cf80dd3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.395689 Sep 17 21:12:20.953313 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2364/4833] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:12:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2398 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:12:20.978815 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4f521c81-125e-4fa2-b3af-8541666ac3e7 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:20.979454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4f521c81-125e-4fa2-b3af-8541666ac3e7 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] [instance: 1aa0744f-d655-4a61-b2cb-c640353d85c5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:21.006308 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f521c81-125e-4fa2-b3af-8541666ac3e7 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:21.011043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f521c81-125e-4fa2-b3af-8541666ac3e7 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:21.012121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f521c81-125e-4fa2-b3af-8541666ac3e7 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:21.014693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f521c81-125e-4fa2-b3af-8541666ac3e7 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:21.015740 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f521c81-125e-4fa2-b3af-8541666ac3e7 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:21.016879 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f521c81-125e-4fa2-b3af-8541666ac3e7 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:21.101031 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a0971678-1198-41c2-9817-f99a98bf4fb1 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1749290669", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "134e884a-f34d-4490-ac9f-4d9042caa38e"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:12:21.212817 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-a0971678-1198-41c2-9817-f99a98bf4fb1 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] validate_networks() for [('134e884a-f34d-4490-ac9f-4d9042caa38e', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:12:21.750707 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4f521c81-125e-4fa2-b3af-8541666ac3e7 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfe77cd9de149508efbea44af748876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb68270a6474c41b16e24cae657407c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:21.768531 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4f521c81-125e-4fa2-b3af-8541666ac3e7 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5" status: 200 len: 1328 microversion: 2.1 time: 0.808357 Sep 17 21:12:21.783114 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2365/4834] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:20 2022] GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5 => generated 1328 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:21.800386 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-90ffd5af-b903-40c7-8002-1ce341e7ddce tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:21.807842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-90ffd5af-b903-40c7-8002-1ce341e7ddce tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:22.062247 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-90ffd5af-b903-40c7-8002-1ce341e7ddce tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:22.070647 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-90ffd5af-b903-40c7-8002-1ce341e7ddce tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1209 microversion: 2.1 time: 0.285426 Sep 17 21:12:22.075661 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2366/4835] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:21 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1209 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:22.660563 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-a0971678-1198-41c2-9817-f99a98bf4fb1 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:12:22.661103 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-a0971678-1198-41c2-9817-f99a98bf4fb1 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:12:22.661717 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-a0971678-1198-41c2-9817-f99a98bf4fb1 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:12:22.662281 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-a0971678-1198-41c2-9817-f99a98bf4fb1 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:12:22.662831 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-a0971678-1198-41c2-9817-f99a98bf4fb1 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:12:22.708684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0971678-1198-41c2-9817-f99a98bf4fb1 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:22.709422 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0971678-1198-41c2-9817-f99a98bf4fb1 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:22.710097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0971678-1198-41c2-9817-f99a98bf4fb1 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:22.710886 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0971678-1198-41c2-9817-f99a98bf4fb1 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:22.711356 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0971678-1198-41c2-9817-f99a98bf4fb1 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:22.711795 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0971678-1198-41c2-9817-f99a98bf4fb1 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:22.738747 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-a0971678-1198-41c2-9817-f99a98bf4fb1 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Getting quotas for project 3723f4e7f0bb4a71ac7aaf46def6b4f6. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:12:22.745255 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-a0971678-1198-41c2-9817-f99a98bf4fb1 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Getting quotas for user 2d249eb9b0124c339d8e730c96649171 and project 3723f4e7f0bb4a71ac7aaf46def6b4f6. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:12:22.760666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a0971678-1198-41c2-9817-f99a98bf4fb1 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:12:22.763441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a0971678-1198-41c2-9817-f99a98bf4fb1 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] [instance: d95d4afe-e40a-4d99-844a-04411efde007] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:12:22.798574 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4beda777-19d3-4139-aac9-7a701cd906f3 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:22.799874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4beda777-19d3-4139-aac9-7a701cd906f3 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] [instance: 1aa0744f-d655-4a61-b2cb-c640353d85c5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:22.811732 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4beda777-19d3-4139-aac9-7a701cd906f3 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:22.815880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4beda777-19d3-4139-aac9-7a701cd906f3 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:22.818054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4beda777-19d3-4139-aac9-7a701cd906f3 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:22.821288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4beda777-19d3-4139-aac9-7a701cd906f3 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:22.821969 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4beda777-19d3-4139-aac9-7a701cd906f3 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:22.822761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4beda777-19d3-4139-aac9-7a701cd906f3 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:22.853442 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a0971678-1198-41c2-9817-f99a98bf4fb1 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.409912 Sep 17 21:12:22.856428 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2470/4836] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:12:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2431 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 17 21:12:22.868138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c034ebc3-7c72-40c3-aeb1-9dccd46a9976 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:22.879931 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c034ebc3-7c72-40c3-aeb1-9dccd46a9976 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] [instance: d95d4afe-e40a-4d99-844a-04411efde007] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:23.202832 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c034ebc3-7c72-40c3-aeb1-9dccd46a9976 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d249eb9b0124c339d8e730c96649171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3723f4e7f0bb4a71ac7aaf46def6b4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:23.219329 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c034ebc3-7c72-40c3-aeb1-9dccd46a9976 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] 10.222.0.26 "GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007" status: 200 len: 1217 microversion: 2.1 time: 0.347464 Sep 17 21:12:23.221223 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2471/4837] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:22 2022] GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007 => generated 1217 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:12:23.226374 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b73b5d5c-35d7-4780-8824-a056cf7cc959 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:23.241981 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b73b5d5c-35d7-4780-8824-a056cf7cc959 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:23.252569 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b73b5d5c-35d7-4780-8824-a056cf7cc959 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:23.253077 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b73b5d5c-35d7-4780-8824-a056cf7cc959 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:23.253543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b73b5d5c-35d7-4780-8824-a056cf7cc959 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:23.254268 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b73b5d5c-35d7-4780-8824-a056cf7cc959 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:23.254737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b73b5d5c-35d7-4780-8824-a056cf7cc959 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:23.255166 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b73b5d5c-35d7-4780-8824-a056cf7cc959 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:23.526687 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b73b5d5c-35d7-4780-8824-a056cf7cc959 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:23.539928 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b73b5d5c-35d7-4780-8824-a056cf7cc959 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1267 microversion: 2.1 time: 0.317210 Sep 17 21:12:23.541876 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2472/4838] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:23 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1267 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:23.575205 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4beda777-19d3-4139-aac9-7a701cd906f3 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfe77cd9de149508efbea44af748876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb68270a6474c41b16e24cae657407c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:23.585645 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4beda777-19d3-4139-aac9-7a701cd906f3 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5" status: 200 len: 1328 microversion: 2.1 time: 0.791762 Sep 17 21:12:23.589536 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2367/4839] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:22 2022] GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5 => generated 1328 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:24.243615 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9ad933e7-1603-4015-b007-6be09720bc41 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:24.244293 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9ad933e7-1603-4015-b007-6be09720bc41 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] [instance: d95d4afe-e40a-4d99-844a-04411efde007] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:24.257936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ad933e7-1603-4015-b007-6be09720bc41 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:24.258317 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ad933e7-1603-4015-b007-6be09720bc41 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:24.259811 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ad933e7-1603-4015-b007-6be09720bc41 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:24.263334 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ad933e7-1603-4015-b007-6be09720bc41 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:24.263835 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ad933e7-1603-4015-b007-6be09720bc41 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:24.264281 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ad933e7-1603-4015-b007-6be09720bc41 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:24.465605 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9ad933e7-1603-4015-b007-6be09720bc41 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d249eb9b0124c339d8e730c96649171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3723f4e7f0bb4a71ac7aaf46def6b4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:24.474028 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9ad933e7-1603-4015-b007-6be09720bc41 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] 10.222.0.26 "GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007" status: 200 len: 1221 microversion: 2.1 time: 0.234421 Sep 17 21:12:24.475296 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2473/4840] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:24 2022] GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007 => generated 1221 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:24.574495 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6d99b085-3f37-4a8d-af80-aca0d028728f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:24.575897 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6d99b085-3f37-4a8d-af80-aca0d028728f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:24.591096 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d99b085-3f37-4a8d-af80-aca0d028728f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:24.607371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d99b085-3f37-4a8d-af80-aca0d028728f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:24.608958 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d99b085-3f37-4a8d-af80-aca0d028728f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:24.611861 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a6febc30-4846-43b7-8b89-6eab0723471b tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:24.613727 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d99b085-3f37-4a8d-af80-aca0d028728f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:24.614423 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d99b085-3f37-4a8d-af80-aca0d028728f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:24.615062 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d99b085-3f37-4a8d-af80-aca0d028728f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:24.615480 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a6febc30-4846-43b7-8b89-6eab0723471b tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] [instance: 1aa0744f-d655-4a61-b2cb-c640353d85c5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:24.631133 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6febc30-4846-43b7-8b89-6eab0723471b tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:24.639687 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6febc30-4846-43b7-8b89-6eab0723471b tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:24.640300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6febc30-4846-43b7-8b89-6eab0723471b tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:24.642842 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6febc30-4846-43b7-8b89-6eab0723471b tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:24.643350 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6febc30-4846-43b7-8b89-6eab0723471b tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:24.643776 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a6febc30-4846-43b7-8b89-6eab0723471b tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:24.928707 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6d99b085-3f37-4a8d-af80-aca0d028728f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:24.935907 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=77 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:12:24.940543 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6d99b085-3f37-4a8d-af80-aca0d028728f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1267 microversion: 2.1 time: 0.375953 Sep 17 21:12:24.943325 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2368/4841] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:24 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1267 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:25.173978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a6febc30-4846-43b7-8b89-6eab0723471b tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfe77cd9de149508efbea44af748876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb68270a6474c41b16e24cae657407c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:25.182784 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a6febc30-4846-43b7-8b89-6eab0723471b tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5" status: 200 len: 1328 microversion: 2.1 time: 0.574548 Sep 17 21:12:25.185754 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2474/4842] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:24 2022] GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5 => generated 1328 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:25.501656 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-09917aa7-2748-4bb9-ab47-e9545be43ae7 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:25.503815 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-09917aa7-2748-4bb9-ab47-e9545be43ae7 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] [instance: d95d4afe-e40a-4d99-844a-04411efde007] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:25.532432 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09917aa7-2748-4bb9-ab47-e9545be43ae7 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:25.532976 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09917aa7-2748-4bb9-ab47-e9545be43ae7 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:25.535975 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09917aa7-2748-4bb9-ab47-e9545be43ae7 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:25.539030 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09917aa7-2748-4bb9-ab47-e9545be43ae7 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:25.541071 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09917aa7-2748-4bb9-ab47-e9545be43ae7 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:25.543034 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09917aa7-2748-4bb9-ab47-e9545be43ae7 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:25.886236 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-09917aa7-2748-4bb9-ab47-e9545be43ae7 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d249eb9b0124c339d8e730c96649171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3723f4e7f0bb4a71ac7aaf46def6b4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:25.897998 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-09917aa7-2748-4bb9-ab47-e9545be43ae7 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] 10.222.0.26 "GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007" status: 200 len: 1287 microversion: 2.1 time: 0.403273 Sep 17 21:12:25.902706 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2369/4843] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:25 2022] GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007 => generated 1287 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:25.965681 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0b416614-fdfe-4199-98b1-928ed90ff1e1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:25.966259 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0b416614-fdfe-4199-98b1-928ed90ff1e1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:25.981927 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b416614-fdfe-4199-98b1-928ed90ff1e1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:25.985048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b416614-fdfe-4199-98b1-928ed90ff1e1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:25.985546 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b416614-fdfe-4199-98b1-928ed90ff1e1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:25.987816 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b416614-fdfe-4199-98b1-928ed90ff1e1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:25.988303 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b416614-fdfe-4199-98b1-928ed90ff1e1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:25.988739 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b416614-fdfe-4199-98b1-928ed90ff1e1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:26.208946 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f96b8882-d600-4902-b3ad-01b881550e08 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:26.209610 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f96b8882-d600-4902-b3ad-01b881550e08 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] [instance: 1aa0744f-d655-4a61-b2cb-c640353d85c5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:26.218580 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f96b8882-d600-4902-b3ad-01b881550e08 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:26.221826 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f96b8882-d600-4902-b3ad-01b881550e08 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:26.222537 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f96b8882-d600-4902-b3ad-01b881550e08 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:26.225672 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f96b8882-d600-4902-b3ad-01b881550e08 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:26.226364 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f96b8882-d600-4902-b3ad-01b881550e08 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:26.227890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f96b8882-d600-4902-b3ad-01b881550e08 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:26.528395 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0b416614-fdfe-4199-98b1-928ed90ff1e1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:26.541004 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0b416614-fdfe-4199-98b1-928ed90ff1e1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1309 microversion: 2.1 time: 0.580134 Sep 17 21:12:26.543292 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2475/4844] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:25 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1309 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:26.755573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f96b8882-d600-4902-b3ad-01b881550e08 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfe77cd9de149508efbea44af748876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb68270a6474c41b16e24cae657407c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:26.770452 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f96b8882-d600-4902-b3ad-01b881550e08 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5" status: 200 len: 1328 microversion: 2.1 time: 0.565929 Sep 17 21:12:26.771390 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2370/4845] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:26 2022] GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5 => generated 1328 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:26.928595 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-31aca908-e1b7-4553-a88f-0eea99668718 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:26.929223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-31aca908-e1b7-4553-a88f-0eea99668718 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] [instance: d95d4afe-e40a-4d99-844a-04411efde007] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:26.950717 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31aca908-e1b7-4553-a88f-0eea99668718 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:26.951241 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31aca908-e1b7-4553-a88f-0eea99668718 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:26.951693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31aca908-e1b7-4553-a88f-0eea99668718 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:26.952426 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31aca908-e1b7-4553-a88f-0eea99668718 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:26.952889 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31aca908-e1b7-4553-a88f-0eea99668718 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:26.953319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31aca908-e1b7-4553-a88f-0eea99668718 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:27.119897 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-31aca908-e1b7-4553-a88f-0eea99668718 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d249eb9b0124c339d8e730c96649171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3723f4e7f0bb4a71ac7aaf46def6b4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:27.130994 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-31aca908-e1b7-4553-a88f-0eea99668718 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] 10.222.0.26 "GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007" status: 200 len: 1275 microversion: 2.1 time: 0.206881 Sep 17 21:12:27.131615 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2476/4846] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:26 2022] GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007 => generated 1275 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:27.565962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-36e36a7c-80e7-4340-8fcb-a7553051a1dd tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:27.567419 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-36e36a7c-80e7-4340-8fcb-a7553051a1dd tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:27.577862 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36e36a7c-80e7-4340-8fcb-a7553051a1dd tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:27.583472 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36e36a7c-80e7-4340-8fcb-a7553051a1dd tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:27.584140 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36e36a7c-80e7-4340-8fcb-a7553051a1dd tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:27.587450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36e36a7c-80e7-4340-8fcb-a7553051a1dd tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:27.595455 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36e36a7c-80e7-4340-8fcb-a7553051a1dd tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:27.596251 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36e36a7c-80e7-4340-8fcb-a7553051a1dd tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:27.793869 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6c8d1c35-a1df-4a6b-9d16-45e5d0872086 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:27.794502 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6c8d1c35-a1df-4a6b-9d16-45e5d0872086 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] [instance: 1aa0744f-d655-4a61-b2cb-c640353d85c5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:27.807652 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6c8d1c35-a1df-4a6b-9d16-45e5d0872086 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:27.808182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6c8d1c35-a1df-4a6b-9d16-45e5d0872086 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:27.808761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6c8d1c35-a1df-4a6b-9d16-45e5d0872086 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:27.809654 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6c8d1c35-a1df-4a6b-9d16-45e5d0872086 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:27.810134 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6c8d1c35-a1df-4a6b-9d16-45e5d0872086 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:27.816300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6c8d1c35-a1df-4a6b-9d16-45e5d0872086 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:28.833324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-36e36a7c-80e7-4340-8fcb-a7553051a1dd tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:28.844466 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-36e36a7c-80e7-4340-8fcb-a7553051a1dd tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1309 microversion: 2.1 time: 1.282913 Sep 17 21:12:28.847388 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2371/4847] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:27 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1309 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:28.857308 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-08194290-d839-4a53-8ff9-47db8489d123 req-9a9dfa5b-11d1-4c56-ab27-638e11a31f4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25", "tag": "42984aab-4bb2-4035-a5e9-3d96a81be113"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:12:28.900220 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-08194290-d839-4a53-8ff9-47db8489d123 req-9a9dfa5b-11d1-4c56-ab27-638e11a31f4b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:28.902497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-08194290-d839-4a53-8ff9-47db8489d123 req-9a9dfa5b-11d1-4c56-ab27-638e11a31f4b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:28.903112 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-08194290-d839-4a53-8ff9-47db8489d123 req-9a9dfa5b-11d1-4c56-ab27-638e11a31f4b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:28.930343 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-08194290-d839-4a53-8ff9-47db8489d123 req-9a9dfa5b-11d1-4c56-ab27-638e11a31f4b service nova] Creating event network-changed:42984aab-4bb2-4035-a5e9-3d96a81be113 for instance 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 on nch1-master-1 Sep 17 21:12:28.941844 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-08194290-d839-4a53-8ff9-47db8489d123 req-9a9dfa5b-11d1-4c56-ab27-638e11a31f4b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089467 Sep 17 21:12:28.942903 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2372/4848] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:12:28.949942 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f2686ab0-3f51-40c0-b47c-827d02f7e6eb tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:28.950831 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f2686ab0-3f51-40c0-b47c-827d02f7e6eb tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] [instance: d95d4afe-e40a-4d99-844a-04411efde007] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:28.962352 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2686ab0-3f51-40c0-b47c-827d02f7e6eb tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:28.963050 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2686ab0-3f51-40c0-b47c-827d02f7e6eb tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:28.963750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2686ab0-3f51-40c0-b47c-827d02f7e6eb tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:28.964664 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2686ab0-3f51-40c0-b47c-827d02f7e6eb tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:28.965409 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2686ab0-3f51-40c0-b47c-827d02f7e6eb tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:28.966163 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2686ab0-3f51-40c0-b47c-827d02f7e6eb tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:29.289627 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f2686ab0-3f51-40c0-b47c-827d02f7e6eb tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d249eb9b0124c339d8e730c96649171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3723f4e7f0bb4a71ac7aaf46def6b4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:29.309510 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f2686ab0-3f51-40c0-b47c-827d02f7e6eb tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] 10.222.0.26 "GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007" status: 200 len: 1275 microversion: 2.1 time: 0.364946 Sep 17 21:12:29.339226 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2373/4849] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:28 2022] GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007 => generated 1275 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:29.353637 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-fc8149f8-fdaa-4660-a391-59b98d5adf3d req-c6e3ddce-cff0-4261-8332-8d9e7c627c4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa0744f-d655-4a61-b2cb-c640353d85c5", "name": "network-vif-plugged", "status": "completed", "tag": "56a84396-c082-49b0-ad97-c3c5dcd571e5"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:12:29.371692 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-fc8149f8-fdaa-4660-a391-59b98d5adf3d req-c6e3ddce-cff0-4261-8332-8d9e7c627c4f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:29.373164 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-fc8149f8-fdaa-4660-a391-59b98d5adf3d req-c6e3ddce-cff0-4261-8332-8d9e7c627c4f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:29.374785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-fc8149f8-fdaa-4660-a391-59b98d5adf3d req-c6e3ddce-cff0-4261-8332-8d9e7c627c4f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:29.390513 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-fc8149f8-fdaa-4660-a391-59b98d5adf3d req-c6e3ddce-cff0-4261-8332-8d9e7c627c4f service nova] Creating event network-vif-plugged:56a84396-c082-49b0-ad97-c3c5dcd571e5 for instance 1aa0744f-d655-4a61-b2cb-c640353d85c5 on nch2-master-1 Sep 17 21:12:29.398935 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-fc8149f8-fdaa-4660-a391-59b98d5adf3d req-c6e3ddce-cff0-4261-8332-8d9e7c627c4f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056916 Sep 17 21:12:29.401083 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2374/4850] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:12:29.437066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6c8d1c35-a1df-4a6b-9d16-45e5d0872086 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfe77cd9de149508efbea44af748876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb68270a6474c41b16e24cae657407c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:29.456373 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6c8d1c35-a1df-4a6b-9d16-45e5d0872086 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5" status: 200 len: 1328 microversion: 2.1 time: 1.666999 Sep 17 21:12:29.457572 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2477/4851] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:27 2022] GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5 => generated 1328 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:29.882131 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-25a5d1ca-a640-4c94-9ff6-49d4fe77db57 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:29.895643 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-25a5d1ca-a640-4c94-9ff6-49d4fe77db57 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:29.941687 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25a5d1ca-a640-4c94-9ff6-49d4fe77db57 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:29.942199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25a5d1ca-a640-4c94-9ff6-49d4fe77db57 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:29.956629 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25a5d1ca-a640-4c94-9ff6-49d4fe77db57 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:29.961057 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25a5d1ca-a640-4c94-9ff6-49d4fe77db57 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:29.962645 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25a5d1ca-a640-4c94-9ff6-49d4fe77db57 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:29.965927 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25a5d1ca-a640-4c94-9ff6-49d4fe77db57 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:30.353241 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d808b19a-b410-4a6a-9d91-c0dffa4eaa19 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:30.353986 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d808b19a-b410-4a6a-9d91-c0dffa4eaa19 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] [instance: d95d4afe-e40a-4d99-844a-04411efde007] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:30.372570 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d808b19a-b410-4a6a-9d91-c0dffa4eaa19 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:30.373333 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d808b19a-b410-4a6a-9d91-c0dffa4eaa19 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:30.374732 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d808b19a-b410-4a6a-9d91-c0dffa4eaa19 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:30.375713 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d808b19a-b410-4a6a-9d91-c0dffa4eaa19 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:30.376391 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d808b19a-b410-4a6a-9d91-c0dffa4eaa19 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:30.377418 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d808b19a-b410-4a6a-9d91-c0dffa4eaa19 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:30.738785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:12:30.755665 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-25a5d1ca-a640-4c94-9ff6-49d4fe77db57 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:30.771069 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-25a5d1ca-a640-4c94-9ff6-49d4fe77db57 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1309 microversion: 2.1 time: 0.895651 Sep 17 21:12:30.773897 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2375/4852] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:29 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1309 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:30.783825 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4b206411-47b4-4ddd-a737-a8b4b10e3a35 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:30.786639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4b206411-47b4-4ddd-a737-a8b4b10e3a35 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] [instance: 1aa0744f-d655-4a61-b2cb-c640353d85c5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:30.799266 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b206411-47b4-4ddd-a737-a8b4b10e3a35 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:30.805639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b206411-47b4-4ddd-a737-a8b4b10e3a35 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:30.810626 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b206411-47b4-4ddd-a737-a8b4b10e3a35 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:30.811607 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b206411-47b4-4ddd-a737-a8b4b10e3a35 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:30.812277 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b206411-47b4-4ddd-a737-a8b4b10e3a35 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:30.813156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b206411-47b4-4ddd-a737-a8b4b10e3a35 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:30.957780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d808b19a-b410-4a6a-9d91-c0dffa4eaa19 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d249eb9b0124c339d8e730c96649171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3723f4e7f0bb4a71ac7aaf46def6b4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:30.970410 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d808b19a-b410-4a6a-9d91-c0dffa4eaa19 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] 10.222.0.26 "GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007" status: 200 len: 1317 microversion: 2.1 time: 0.625647 Sep 17 21:12:30.972761 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2478/4853] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:30 2022] GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007 => generated 1317 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:31.317564 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4b206411-47b4-4ddd-a737-a8b4b10e3a35 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfe77cd9de149508efbea44af748876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb68270a6474c41b16e24cae657407c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:31.326608 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4b206411-47b4-4ddd-a737-a8b4b10e3a35 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5" status: 200 len: 1328 microversion: 2.1 time: 0.551057 Sep 17 21:12:31.327339 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2376/4854] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:30 2022] GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5 => generated 1328 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:31.804138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c5462170-b69e-4c0e-929a-cfe63567a478 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:31.805345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c5462170-b69e-4c0e-929a-cfe63567a478 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:31.827301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c5462170-b69e-4c0e-929a-cfe63567a478 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:31.835554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c5462170-b69e-4c0e-929a-cfe63567a478 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:31.836209 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c5462170-b69e-4c0e-929a-cfe63567a478 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:31.837117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c5462170-b69e-4c0e-929a-cfe63567a478 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:31.838141 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c5462170-b69e-4c0e-929a-cfe63567a478 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:31.839203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c5462170-b69e-4c0e-929a-cfe63567a478 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:31.981787 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-5d864873-7a60-439e-bc72-eb179dded1a6 req-ba6f25b8-ae4e-480c-bd24-dc6a0148c5da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d95d4afe-e40a-4d99-844a-04411efde007", "tag": "c6dc6a35-88b4-4187-9e6d-57dbac1d6c3e"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:12:32.012089 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-5d864873-7a60-439e-bc72-eb179dded1a6 req-ba6f25b8-ae4e-480c-bd24-dc6a0148c5da service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:32.012587 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-5d864873-7a60-439e-bc72-eb179dded1a6 req-ba6f25b8-ae4e-480c-bd24-dc6a0148c5da service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:32.013028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-5d864873-7a60-439e-bc72-eb179dded1a6 req-ba6f25b8-ae4e-480c-bd24-dc6a0148c5da service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:32.042972 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-5d864873-7a60-439e-bc72-eb179dded1a6 req-ba6f25b8-ae4e-480c-bd24-dc6a0148c5da service nova] Creating event network-changed:c6dc6a35-88b4-4187-9e6d-57dbac1d6c3e for instance d95d4afe-e40a-4d99-844a-04411efde007 on nch1-master-1 Sep 17 21:12:32.051613 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-5d864873-7a60-439e-bc72-eb179dded1a6 req-ba6f25b8-ae4e-480c-bd24-dc6a0148c5da service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075072 Sep 17 21:12:32.052227 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2377/4855] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:12:32.057555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ec68d464-9a77-4078-af29-d6f0cc7a6dcc tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:32.058309 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ec68d464-9a77-4078-af29-d6f0cc7a6dcc tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] [instance: d95d4afe-e40a-4d99-844a-04411efde007] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:32.073142 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=18 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:12:32.080376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec68d464-9a77-4078-af29-d6f0cc7a6dcc tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:32.081073 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec68d464-9a77-4078-af29-d6f0cc7a6dcc tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:32.081718 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec68d464-9a77-4078-af29-d6f0cc7a6dcc tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:32.085050 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec68d464-9a77-4078-af29-d6f0cc7a6dcc tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:32.085752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec68d464-9a77-4078-af29-d6f0cc7a6dcc tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:32.086356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec68d464-9a77-4078-af29-d6f0cc7a6dcc tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:32.706634 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c5462170-b69e-4c0e-929a-cfe63567a478 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:32.722256 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c5462170-b69e-4c0e-929a-cfe63567a478 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1309 microversion: 2.1 time: 0.925426 Sep 17 21:12:32.722966 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2479/4856] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:31 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1309 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:32.728304 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:12:32.737926 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6b6d7588-62d1-4c43-a991-394a5306e960 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:32.738700 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6b6d7588-62d1-4c43-a991-394a5306e960 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] [instance: 1aa0744f-d655-4a61-b2cb-c640353d85c5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:32.748720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:12:32.756665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6b6d7588-62d1-4c43-a991-394a5306e960 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:32.759151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6b6d7588-62d1-4c43-a991-394a5306e960 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:32.759896 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6b6d7588-62d1-4c43-a991-394a5306e960 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:32.764245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6b6d7588-62d1-4c43-a991-394a5306e960 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:32.764855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6b6d7588-62d1-4c43-a991-394a5306e960 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:32.765578 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6b6d7588-62d1-4c43-a991-394a5306e960 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:33.067809 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ec68d464-9a77-4078-af29-d6f0cc7a6dcc tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d249eb9b0124c339d8e730c96649171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3723f4e7f0bb4a71ac7aaf46def6b4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:33.079458 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ec68d464-9a77-4078-af29-d6f0cc7a6dcc tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] 10.222.0.26 "GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007" status: 200 len: 1317 microversion: 2.1 time: 1.025911 Sep 17 21:12:33.082304 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2378/4857] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:32 2022] GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007 => generated 1317 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:33.211286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=8 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:12:33.261706 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6b6d7588-62d1-4c43-a991-394a5306e960 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfe77cd9de149508efbea44af748876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb68270a6474c41b16e24cae657407c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:33.275072 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6b6d7588-62d1-4c43-a991-394a5306e960 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5" status: 200 len: 1528 microversion: 2.1 time: 0.550566 Sep 17 21:12:33.278410 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2480/4858] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:32 2022] GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5 => generated 1528 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:33.304814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8b00b617-ef52-45cc-9c0c-97e2b1fc6684 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:33.306046 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8b00b617-ef52-45cc-9c0c-97e2b1fc6684 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] [instance: 1aa0744f-d655-4a61-b2cb-c640353d85c5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:33.317312 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8b00b617-ef52-45cc-9c0c-97e2b1fc6684 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:33.317860 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8b00b617-ef52-45cc-9c0c-97e2b1fc6684 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:33.318317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8b00b617-ef52-45cc-9c0c-97e2b1fc6684 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:33.319038 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8b00b617-ef52-45cc-9c0c-97e2b1fc6684 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:33.326888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8b00b617-ef52-45cc-9c0c-97e2b1fc6684 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:33.327275 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8b00b617-ef52-45cc-9c0c-97e2b1fc6684 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:33.748563 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-507911e4-0b51-409e-8b6e-1a6a1f20bce5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:33.749600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-507911e4-0b51-409e-8b6e-1a6a1f20bce5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:33.762235 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-507911e4-0b51-409e-8b6e-1a6a1f20bce5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:33.762741 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-507911e4-0b51-409e-8b6e-1a6a1f20bce5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:33.763187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-507911e4-0b51-409e-8b6e-1a6a1f20bce5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:33.763919 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-507911e4-0b51-409e-8b6e-1a6a1f20bce5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:33.764380 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-507911e4-0b51-409e-8b6e-1a6a1f20bce5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:33.764805 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-507911e4-0b51-409e-8b6e-1a6a1f20bce5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:33.805271 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8b00b617-ef52-45cc-9c0c-97e2b1fc6684 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfe77cd9de149508efbea44af748876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb68270a6474c41b16e24cae657407c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:33.822693 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8b00b617-ef52-45cc-9c0c-97e2b1fc6684 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5" status: 200 len: 1528 microversion: 2.1 time: 0.520659 Sep 17 21:12:33.827425 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2379/4859] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:33 2022] GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5 => generated 1528 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:34.294473 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-aee26b73-0724-4f8d-8b64-8081af1714fe tempest-ServersNegativeTestMultiTenantJSON-1960768923 tempest-ServersNegativeTestMultiTenantJSON-1960768923-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:34.295953 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-aee26b73-0724-4f8d-8b64-8081af1714fe tempest-ServersNegativeTestMultiTenantJSON-1960768923 tempest-ServersNegativeTestMultiTenantJSON-1960768923-project] [instance: 1aa0744f-d655-4a61-b2cb-c640353d85c5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:34.309505 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aee26b73-0724-4f8d-8b64-8081af1714fe tempest-ServersNegativeTestMultiTenantJSON-1960768923 tempest-ServersNegativeTestMultiTenantJSON-1960768923-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:34.310243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aee26b73-0724-4f8d-8b64-8081af1714fe tempest-ServersNegativeTestMultiTenantJSON-1960768923 tempest-ServersNegativeTestMultiTenantJSON-1960768923-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:34.311141 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aee26b73-0724-4f8d-8b64-8081af1714fe tempest-ServersNegativeTestMultiTenantJSON-1960768923 tempest-ServersNegativeTestMultiTenantJSON-1960768923-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:34.312088 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aee26b73-0724-4f8d-8b64-8081af1714fe tempest-ServersNegativeTestMultiTenantJSON-1960768923 tempest-ServersNegativeTestMultiTenantJSON-1960768923-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:34.312780 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aee26b73-0724-4f8d-8b64-8081af1714fe tempest-ServersNegativeTestMultiTenantJSON-1960768923 tempest-ServersNegativeTestMultiTenantJSON-1960768923-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:34.313533 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aee26b73-0724-4f8d-8b64-8081af1714fe tempest-ServersNegativeTestMultiTenantJSON-1960768923 tempest-ServersNegativeTestMultiTenantJSON-1960768923-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:34.330029 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-aee26b73-0724-4f8d-8b64-8081af1714fe tempest-ServersNegativeTestMultiTenantJSON-1960768923 tempest-ServersNegativeTestMultiTenantJSON-1960768923-project] HTTP exception thrown: Instance 1aa0744f-d655-4a61-b2cb-c640353d85c5 could not be found. Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-aee26b73-0724-4f8d-8b64-8081af1714fe tempest-ServersNegativeTestMultiTenantJSON-1960768923 tempest-ServersNegativeTestMultiTenantJSON-1960768923-project] Request method failure captured: Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5 HTTP/1.1 Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjgjHr7x2vGy9e2E0qE8yEpHZAYxg64ak0VuzHvhCovzpQDH4Vq3w7zedO_yj-JSbnOB0fXB7JIxKbZ8QaVEcv7HeYBNMoyGlgcvT150Jetf6doTRh79Jh5c_a8TrvCfJathlKuOmxY0nQEVYsaqPDR2asnoOoBCAA2i-VqSNRNgGPo Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 81efda2512d54722b767bdf07a566236 Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1960768923 Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/81efda2512d54722b767bdf07a566236"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/81efda2512d54722b767bdf07a566236"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/81efda2512d54722b767bdf07a566236"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_81efda2512d54722b767bdf07a566236", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1960768923 Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 81efda2512d54722b767bdf07a566236 Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1960768923 Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1960768923-project Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: b2704d86338949ba9bb87bf60ee24146 Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1960768923-project Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 1aa0744f-d655-4a61-b2cb-c640353d85c5 could not be found. Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '1aa0744f-d655-4a61-b2cb-c640353d85c5'} Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aa0744f-d655-4a61-b2cb-c640353d85c5 could not be found. Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:12:34.332236 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:12:34.336494 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aa0744f-d655-4a61-b2cb-c640353d85c5 could not be found. Sep 17 21:12:34.336494 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:34.336494 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:12:34.336494 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:34.336494 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:34.336494 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:12:34.336494 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:12:34.336494 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:12:34.336494 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:12:34.336494 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aa0744f-d655-4a61-b2cb-c640353d85c5 could not be found. Sep 17 21:12:34.336494 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:34.339086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-aee26b73-0724-4f8d-8b64-8081af1714fe tempest-ServersNegativeTestMultiTenantJSON-1960768923 tempest-ServersNegativeTestMultiTenantJSON-1960768923-project] Returning 404 to user: Instance 1aa0744f-d655-4a61-b2cb-c640353d85c5 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:12:34.340318 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-aee26b73-0724-4f8d-8b64-8081af1714fe tempest-ServersNegativeTestMultiTenantJSON-1960768923 tempest-ServersNegativeTestMultiTenantJSON-1960768923-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5" status: 404 len: 111 microversion: 2.1 time: 0.490489 Sep 17 21:12:34.341444 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2380/4860] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:12:33 2022] DELETE /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5 => generated 111 bytes in 493 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:12:34.342311 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-507911e4-0b51-409e-8b6e-1a6a1f20bce5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:34.347770 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f1a8c1cb-1e78-428f-9b51-c7fecde7d1b5 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:34.348775 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f1a8c1cb-1e78-428f-9b51-c7fecde7d1b5 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] [instance: d95d4afe-e40a-4d99-844a-04411efde007] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:34.356203 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1a8c1cb-1e78-428f-9b51-c7fecde7d1b5 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:34.357029 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1a8c1cb-1e78-428f-9b51-c7fecde7d1b5 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:34.357776 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1a8c1cb-1e78-428f-9b51-c7fecde7d1b5 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:34.358590 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-507911e4-0b51-409e-8b6e-1a6a1f20bce5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1309 microversion: 2.1 time: 0.613926 Sep 17 21:12:34.370189 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2481/4861] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:33 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1309 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:12:34.370735 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1a8c1cb-1e78-428f-9b51-c7fecde7d1b5 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:34.371683 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1a8c1cb-1e78-428f-9b51-c7fecde7d1b5 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:34.372440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1a8c1cb-1e78-428f-9b51-c7fecde7d1b5 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:34.378206 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7e513b89-d8e1-4297-9681-1f56adda351d tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:34.378206 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7e513b89-d8e1-4297-9681-1f56adda351d tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] [instance: 1aa0744f-d655-4a61-b2cb-c640353d85c5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:34.392439 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e513b89-d8e1-4297-9681-1f56adda351d tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:34.393595 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e513b89-d8e1-4297-9681-1f56adda351d tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:34.394048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e513b89-d8e1-4297-9681-1f56adda351d tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:34.394788 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e513b89-d8e1-4297-9681-1f56adda351d tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:34.395251 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e513b89-d8e1-4297-9681-1f56adda351d tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:34.399455 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e513b89-d8e1-4297-9681-1f56adda351d tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:35.386725 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f1a8c1cb-1e78-428f-9b51-c7fecde7d1b5 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d249eb9b0124c339d8e730c96649171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3723f4e7f0bb4a71ac7aaf46def6b4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:35.404347 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f1a8c1cb-1e78-428f-9b51-c7fecde7d1b5 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] 10.222.0.26 "GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007" status: 200 len: 1317 microversion: 2.1 time: 1.061147 Sep 17 21:12:35.404956 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2381/4862] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:34 2022] GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007 => generated 1317 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:35.421632 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b4756d64-b024-433d-8cc0-8affba93b9a1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-338602773-access_point-524321380", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "06ac9e71-6911-4002-9419-c39af65e7214"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1819630111", "security_groups": [{"name": "tempest-secgroup_access--1222860142"}, {"name": "tempest-secgroup_general--853565266"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:12:35.422684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7e513b89-d8e1-4297-9681-1f56adda351d tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfe77cd9de149508efbea44af748876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb68270a6474c41b16e24cae657407c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:35.429952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:12:35.432483 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7e513b89-d8e1-4297-9681-1f56adda351d tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5" status: 200 len: 1528 microversion: 2.1 time: 1.067660 Sep 17 21:12:35.437084 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2482/4863] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:34 2022] GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5 => generated 1528 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:35.442564 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-94c5b524-e7a4-4ed3-97c8-2f9b0b4c31f6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:35.446309 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-94c5b524-e7a4-4ed3-97c8-2f9b0b4c31f6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:35.466195 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94c5b524-e7a4-4ed3-97c8-2f9b0b4c31f6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:35.467833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94c5b524-e7a4-4ed3-97c8-2f9b0b4c31f6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:35.468783 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94c5b524-e7a4-4ed3-97c8-2f9b0b4c31f6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:35.469902 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:12:35.470029 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94c5b524-e7a4-4ed3-97c8-2f9b0b4c31f6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:35.470703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94c5b524-e7a4-4ed3-97c8-2f9b0b4c31f6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:35.475144 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94c5b524-e7a4-4ed3-97c8-2f9b0b4c31f6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:35.847423 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-b4756d64-b024-433d-8cc0-8affba93b9a1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] validate_networks() for [('06ac9e71-6911-4002-9419-c39af65e7214', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:12:36.036047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-94c5b524-e7a4-4ed3-97c8-2f9b0b4c31f6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:36.050282 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-94c5b524-e7a4-4ed3-97c8-2f9b0b4c31f6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1309 microversion: 2.1 time: 0.611731 Sep 17 21:12:36.051630 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2483/4864] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:35 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1309 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:36.075603 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-243382d9-4e8e-4ea6-a7b7-8d4083c045ff tempest-ServersNegativeTestMultiTenantJSON-1960768923 tempest-ServersNegativeTestMultiTenantJSON-1960768923-project] Action: 'update', calling method: >, body: {"server": {"name": "1aa0744f-d655-4a61-b2cb-c640353d85c5_new"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:12:36.093606 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-243382d9-4e8e-4ea6-a7b7-8d4083c045ff tempest-ServersNegativeTestMultiTenantJSON-1960768923 tempest-ServersNegativeTestMultiTenantJSON-1960768923-project] [instance: 1aa0744f-d655-4a61-b2cb-c640353d85c5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:36.111902 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-243382d9-4e8e-4ea6-a7b7-8d4083c045ff tempest-ServersNegativeTestMultiTenantJSON-1960768923 tempest-ServersNegativeTestMultiTenantJSON-1960768923-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:36.112662 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-243382d9-4e8e-4ea6-a7b7-8d4083c045ff tempest-ServersNegativeTestMultiTenantJSON-1960768923 tempest-ServersNegativeTestMultiTenantJSON-1960768923-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:36.113395 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-243382d9-4e8e-4ea6-a7b7-8d4083c045ff tempest-ServersNegativeTestMultiTenantJSON-1960768923 tempest-ServersNegativeTestMultiTenantJSON-1960768923-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:36.117487 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-243382d9-4e8e-4ea6-a7b7-8d4083c045ff tempest-ServersNegativeTestMultiTenantJSON-1960768923 tempest-ServersNegativeTestMultiTenantJSON-1960768923-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:36.118075 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-243382d9-4e8e-4ea6-a7b7-8d4083c045ff tempest-ServersNegativeTestMultiTenantJSON-1960768923 tempest-ServersNegativeTestMultiTenantJSON-1960768923-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:36.118546 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-243382d9-4e8e-4ea6-a7b7-8d4083c045ff tempest-ServersNegativeTestMultiTenantJSON-1960768923 tempest-ServersNegativeTestMultiTenantJSON-1960768923-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:36.159041 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-243382d9-4e8e-4ea6-a7b7-8d4083c045ff tempest-ServersNegativeTestMultiTenantJSON-1960768923 tempest-ServersNegativeTestMultiTenantJSON-1960768923-project] HTTP exception thrown: Instance 1aa0744f-d655-4a61-b2cb-c640353d85c5 could not be found. Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-243382d9-4e8e-4ea6-a7b7-8d4083c045ff tempest-ServersNegativeTestMultiTenantJSON-1960768923 tempest-ServersNegativeTestMultiTenantJSON-1960768923-project] Request method failure captured: Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: request: PUT /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5 HTTP/1.1 Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 64 Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjgjHr7x2vGy9e2E0qE8yEpHZAYxg64ak0VuzHvhCovzpQDH4Vq3w7zedO_yj-JSbnOB0fXB7JIxKbZ8QaVEcv7HeYBNMoyGlgcvT150Jetf6doTRh79Jh5c_a8TrvCfJathlKuOmxY0nQEVYsaqPDR2asnoOoBCAA2i-VqSNRNgGPo Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 81efda2512d54722b767bdf07a566236 Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1960768923 Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/81efda2512d54722b767bdf07a566236"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/81efda2512d54722b767bdf07a566236"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/81efda2512d54722b767bdf07a566236"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_81efda2512d54722b767bdf07a566236", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1960768923 Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 81efda2512d54722b767bdf07a566236 Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1960768923 Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1960768923-project Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: b2704d86338949ba9bb87bf60ee24146 Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1960768923-project Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: {"server": {"name": "1aa0744f-d655-4a61-b2cb-c640353d85c5_new"}} Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 1aa0744f-d655-4a61-b2cb-c640353d85c5 could not be found. Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '1aa0744f-d655-4a61-b2cb-c640353d85c5', 'body': {'server': {'name': '1aa0744f-d655-4a61-b2cb-c640353d85c5_new'}}} Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aa0744f-d655-4a61-b2cb-c640353d85c5 could not be found. Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:12:36.160884 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 17 21:12:36.167458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 17 21:12:36.167458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 17 21:12:36.167458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:12:36.167458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:12:36.167458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:12:36.167458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:12:36.167458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aa0744f-d655-4a61-b2cb-c640353d85c5 could not be found. Sep 17 21:12:36.167458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:12:36.167458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:12:36.167458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:12:36.167458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:36.167458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:12:36.167458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:12:36.167458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:12:36.167458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:12:36.167458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aa0744f-d655-4a61-b2cb-c640353d85c5 could not be found. Sep 17 21:12:36.167458 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:12:36.167458 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-243382d9-4e8e-4ea6-a7b7-8d4083c045ff tempest-ServersNegativeTestMultiTenantJSON-1960768923 tempest-ServersNegativeTestMultiTenantJSON-1960768923-project] Returning 404 to user: Instance 1aa0744f-d655-4a61-b2cb-c640353d85c5 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:12:36.167458 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-243382d9-4e8e-4ea6-a7b7-8d4083c045ff tempest-ServersNegativeTestMultiTenantJSON-1960768923 tempest-ServersNegativeTestMultiTenantJSON-1960768923-project] 10.222.0.26 "PUT /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5" status: 404 len: 111 microversion: 2.1 time: 0.095849 Sep 17 21:12:36.167458 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2484/4865] 10.222.0.26 () {60 vars in 1256 bytes} [Sat Sep 17 21:12:36 2022] PUT /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:12:36.172395 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a69697f1-59a2-4b9d-9d85-403a2b6a04a2 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:36.172908 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a69697f1-59a2-4b9d-9d85-403a2b6a04a2 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] [instance: 1aa0744f-d655-4a61-b2cb-c640353d85c5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:36.188221 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a69697f1-59a2-4b9d-9d85-403a2b6a04a2 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:36.188732 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a69697f1-59a2-4b9d-9d85-403a2b6a04a2 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:36.189186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a69697f1-59a2-4b9d-9d85-403a2b6a04a2 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:36.189949 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a69697f1-59a2-4b9d-9d85-403a2b6a04a2 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:36.190420 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a69697f1-59a2-4b9d-9d85-403a2b6a04a2 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:36.190858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a69697f1-59a2-4b9d-9d85-403a2b6a04a2 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:36.276825 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a69697f1-59a2-4b9d-9d85-403a2b6a04a2 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] [instance: 1aa0744f-d655-4a61-b2cb-c640353d85c5] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:12:36.505635 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a69697f1-59a2-4b9d-9d85-403a2b6a04a2 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5" status: 204 len: 0 microversion: 2.1 time: 0.336496 Sep 17 21:12:36.506775 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2485/4866] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:12:36 2022] DELETE /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 17 21:12:36.518816 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-98e66a4e-79ad-4357-9942-6b0ae81c5280 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:36.530471 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-98e66a4e-79ad-4357-9942-6b0ae81c5280 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] [instance: d95d4afe-e40a-4d99-844a-04411efde007] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:36.540114 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-98e66a4e-79ad-4357-9942-6b0ae81c5280 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:36.540935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-98e66a4e-79ad-4357-9942-6b0ae81c5280 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:36.543555 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-98e66a4e-79ad-4357-9942-6b0ae81c5280 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:36.544695 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-98e66a4e-79ad-4357-9942-6b0ae81c5280 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:36.548813 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-98e66a4e-79ad-4357-9942-6b0ae81c5280 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:36.549565 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-98e66a4e-79ad-4357-9942-6b0ae81c5280 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:36.836523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-b4756d64-b024-433d-8cc0-8affba93b9a1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:12:36.838407 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-b4756d64-b024-433d-8cc0-8affba93b9a1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:12:36.839137 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-b4756d64-b024-433d-8cc0-8affba93b9a1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:12:36.839873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-b4756d64-b024-433d-8cc0-8affba93b9a1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:12:36.840959 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-b4756d64-b024-433d-8cc0-8affba93b9a1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:12:36.869122 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b4756d64-b024-433d-8cc0-8affba93b9a1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:36.869833 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b4756d64-b024-433d-8cc0-8affba93b9a1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:36.873414 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b4756d64-b024-433d-8cc0-8affba93b9a1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:36.877261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b4756d64-b024-433d-8cc0-8affba93b9a1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:36.878041 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b4756d64-b024-433d-8cc0-8affba93b9a1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:36.878981 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b4756d64-b024-433d-8cc0-8affba93b9a1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:36.913292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-98e66a4e-79ad-4357-9942-6b0ae81c5280 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d249eb9b0124c339d8e730c96649171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3723f4e7f0bb4a71ac7aaf46def6b4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:36.924228 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-98e66a4e-79ad-4357-9942-6b0ae81c5280 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] 10.222.0.26 "GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007" status: 200 len: 1317 microversion: 2.1 time: 0.415183 Sep 17 21:12:36.926036 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2486/4867] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:36 2022] GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007 => generated 1317 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:36.933676 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6d67685a-1690-4b0c-889d-e403fbfd0ca4 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:36.934713 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6d67685a-1690-4b0c-889d-e403fbfd0ca4 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] [instance: 1aa0744f-d655-4a61-b2cb-c640353d85c5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:36.943416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-b4756d64-b024-433d-8cc0-8affba93b9a1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Getting quotas for project cfc26054d4a34fb2b2aef34fb4891b4c. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:12:36.943833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6d67685a-1690-4b0c-889d-e403fbfd0ca4 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:36.945083 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6d67685a-1690-4b0c-889d-e403fbfd0ca4 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:36.945737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6d67685a-1690-4b0c-889d-e403fbfd0ca4 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:36.946770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6d67685a-1690-4b0c-889d-e403fbfd0ca4 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:36.947399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6d67685a-1690-4b0c-889d-e403fbfd0ca4 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:36.948138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6d67685a-1690-4b0c-889d-e403fbfd0ca4 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:36.957828 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-b4756d64-b024-433d-8cc0-8affba93b9a1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Getting quotas for user caa2c2f4848e497f80d4a439c785c2b0 and project cfc26054d4a34fb2b2aef34fb4891b4c. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:12:36.992561 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b4756d64-b024-433d-8cc0-8affba93b9a1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:12:36.994703 ncdv-master-1 devstack@n-api.service[140523]: WARNING nova.utils [None req-b4756d64-b024-433d-8cc0-8affba93b9a1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-338602773-access_point-524321380 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-338602773-acc Sep 17 21:12:36.995479 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b4756d64-b024-433d-8cc0-8affba93b9a1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: ecbd9cec-fdea-45b2-bb96-487bdaf97635] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:12:37.078984 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b4756d64-b024-433d-8cc0-8affba93b9a1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 1.660183 Sep 17 21:12:37.080156 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2382/4868] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:12:35 2022] POST /compute/v2.1/servers => generated 457 bytes in 1674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:12:37.085143 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0d3d1dfe-66c2-4458-825a-6b30901ac40c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:37.086384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0d3d1dfe-66c2-4458-825a-6b30901ac40c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:37.093866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d3d1dfe-66c2-4458-825a-6b30901ac40c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:37.094875 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d3d1dfe-66c2-4458-825a-6b30901ac40c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:37.095624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d3d1dfe-66c2-4458-825a-6b30901ac40c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:37.096712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d3d1dfe-66c2-4458-825a-6b30901ac40c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:37.097590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d3d1dfe-66c2-4458-825a-6b30901ac40c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:37.098259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d3d1dfe-66c2-4458-825a-6b30901ac40c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:37.164614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6d67685a-1690-4b0c-889d-e403fbfd0ca4 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfe77cd9de149508efbea44af748876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb68270a6474c41b16e24cae657407c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:37.185039 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6d67685a-1690-4b0c-889d-e403fbfd0ca4 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5" status: 200 len: 1534 microversion: 2.1 time: 0.257815 Sep 17 21:12:37.186770 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2487/4869] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:36 2022] GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5 => generated 1534 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:37.191906 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f418a78b-3a02-402d-a5a7-c8aa0b338fc3 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:37.192783 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f418a78b-3a02-402d-a5a7-c8aa0b338fc3 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: ecbd9cec-fdea-45b2-bb96-487bdaf97635] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:37.284354 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f418a78b-3a02-402d-a5a7-c8aa0b338fc3 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:37.293575 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f418a78b-3a02-402d-a5a7-c8aa0b338fc3 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635" status: 200 len: 1293 microversion: 2.1 time: 0.105287 Sep 17 21:12:37.294674 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2488/4870] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:37 2022] GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635 => generated 1293 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:37.351053 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0d3d1dfe-66c2-4458-825a-6b30901ac40c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:37.360564 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0d3d1dfe-66c2-4458-825a-6b30901ac40c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1309 microversion: 2.1 time: 0.279037 Sep 17 21:12:37.378180 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2383/4871] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:37 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1309 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:37.952746 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1c8d53cf-517c-41a8-ac25-db6885d485a6 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:37.953792 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1c8d53cf-517c-41a8-ac25-db6885d485a6 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] [instance: d95d4afe-e40a-4d99-844a-04411efde007] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:37.967627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c8d53cf-517c-41a8-ac25-db6885d485a6 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:37.968724 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c8d53cf-517c-41a8-ac25-db6885d485a6 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:37.969713 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c8d53cf-517c-41a8-ac25-db6885d485a6 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:37.970922 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c8d53cf-517c-41a8-ac25-db6885d485a6 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:37.971633 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c8d53cf-517c-41a8-ac25-db6885d485a6 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:37.973360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c8d53cf-517c-41a8-ac25-db6885d485a6 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:38.214276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7fb7de8f-9bc4-4eac-bb33-bc6c33193a53 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:38.215672 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7fb7de8f-9bc4-4eac-bb33-bc6c33193a53 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] [instance: 1aa0744f-d655-4a61-b2cb-c640353d85c5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:38.224553 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7fb7de8f-9bc4-4eac-bb33-bc6c33193a53 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:38.226245 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7fb7de8f-9bc4-4eac-bb33-bc6c33193a53 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:38.226934 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7fb7de8f-9bc4-4eac-bb33-bc6c33193a53 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:38.233288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7fb7de8f-9bc4-4eac-bb33-bc6c33193a53 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:38.234257 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7fb7de8f-9bc4-4eac-bb33-bc6c33193a53 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:38.234908 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7fb7de8f-9bc4-4eac-bb33-bc6c33193a53 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:38.481243 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1c8d53cf-517c-41a8-ac25-db6885d485a6 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d249eb9b0124c339d8e730c96649171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3723f4e7f0bb4a71ac7aaf46def6b4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:38.497900 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1c8d53cf-517c-41a8-ac25-db6885d485a6 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] 10.222.0.26 "GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007" status: 200 len: 1317 microversion: 2.1 time: 0.548551 Sep 17 21:12:38.498690 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2489/4872] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:37 2022] GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007 => generated 1317 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:38.505999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bd05c1ab-5152-43c8-8959-9e7852ee1af6 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:38.506733 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bd05c1ab-5152-43c8-8959-9e7852ee1af6 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: ecbd9cec-fdea-45b2-bb96-487bdaf97635] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:38.515646 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd05c1ab-5152-43c8-8959-9e7852ee1af6 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:38.527258 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd05c1ab-5152-43c8-8959-9e7852ee1af6 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:38.528830 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd05c1ab-5152-43c8-8959-9e7852ee1af6 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:38.531495 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd05c1ab-5152-43c8-8959-9e7852ee1af6 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:38.532680 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd05c1ab-5152-43c8-8959-9e7852ee1af6 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:38.533657 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd05c1ab-5152-43c8-8959-9e7852ee1af6 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:38.720220 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7fb7de8f-9bc4-4eac-bb33-bc6c33193a53 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfe77cd9de149508efbea44af748876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb68270a6474c41b16e24cae657407c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:38.721790 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bd05c1ab-5152-43c8-8959-9e7852ee1af6 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:38.748002 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7fb7de8f-9bc4-4eac-bb33-bc6c33193a53 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5" status: 200 len: 1534 microversion: 2.1 time: 0.539317 Sep 17 21:12:38.749184 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2384/4873] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:38 2022] GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5 => generated 1534 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:38.751758 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bd05c1ab-5152-43c8-8959-9e7852ee1af6 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635" status: 200 len: 1345 microversion: 2.1 time: 0.246859 Sep 17 21:12:38.753707 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2490/4874] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:38 2022] GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635 => generated 1345 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:38.782807 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d87318e4-b02c-475e-af67-45ae5c84ba38 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:38.783347 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-b67c159d-9f7b-4fd1-9db1-50d1298038af req-7fb801f3-d7e4-4f20-9e2a-7c6b8323eb35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25", "name": "network-vif-plugged", "status": "completed", "tag": "42984aab-4bb2-4035-a5e9-3d96a81be113"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:12:38.786136 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d87318e4-b02c-475e-af67-45ae5c84ba38 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:38.820371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b67c159d-9f7b-4fd1-9db1-50d1298038af req-7fb801f3-d7e4-4f20-9e2a-7c6b8323eb35 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:38.821183 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b67c159d-9f7b-4fd1-9db1-50d1298038af req-7fb801f3-d7e4-4f20-9e2a-7c6b8323eb35 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:38.821841 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b67c159d-9f7b-4fd1-9db1-50d1298038af req-7fb801f3-d7e4-4f20-9e2a-7c6b8323eb35 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:38.828212 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d87318e4-b02c-475e-af67-45ae5c84ba38 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:38.828750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d87318e4-b02c-475e-af67-45ae5c84ba38 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:38.829199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d87318e4-b02c-475e-af67-45ae5c84ba38 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:38.829994 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d87318e4-b02c-475e-af67-45ae5c84ba38 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:38.830452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d87318e4-b02c-475e-af67-45ae5c84ba38 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:38.830897 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d87318e4-b02c-475e-af67-45ae5c84ba38 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:38.838551 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-b67c159d-9f7b-4fd1-9db1-50d1298038af req-7fb801f3-d7e4-4f20-9e2a-7c6b8323eb35 service nova] Creating event network-vif-plugged:42984aab-4bb2-4035-a5e9-3d96a81be113 for instance 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 on nch1-master-1 Sep 17 21:12:38.844649 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-b67c159d-9f7b-4fd1-9db1-50d1298038af req-7fb801f3-d7e4-4f20-9e2a-7c6b8323eb35 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088198 Sep 17 21:12:38.845907 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2491/4875] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:12:39.322119 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d87318e4-b02c-475e-af67-45ae5c84ba38 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:39.338172 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d87318e4-b02c-475e-af67-45ae5c84ba38 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1309 microversion: 2.1 time: 0.580722 Sep 17 21:12:39.341501 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2385/4876] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:38 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1309 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:39.523994 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e5955478-e0fc-4480-a006-0944d428fdf9 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:39.525040 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e5955478-e0fc-4480-a006-0944d428fdf9 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] [instance: d95d4afe-e40a-4d99-844a-04411efde007] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:39.531653 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5955478-e0fc-4480-a006-0944d428fdf9 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:39.532165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5955478-e0fc-4480-a006-0944d428fdf9 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:39.532676 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5955478-e0fc-4480-a006-0944d428fdf9 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:39.532875 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-366d7174-f67f-4d57-b431-9898eb469e9d req-27018d3e-6c88-4744-8021-4739b75fee50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa0744f-d655-4a61-b2cb-c640353d85c5", "name": "network-vif-deleted", "tag": "56a84396-c082-49b0-ad97-c3c5dcd571e5"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:12:39.533609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5955478-e0fc-4480-a006-0944d428fdf9 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:39.533896 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5955478-e0fc-4480-a006-0944d428fdf9 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:39.534690 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5955478-e0fc-4480-a006-0944d428fdf9 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:39.553814 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-366d7174-f67f-4d57-b431-9898eb469e9d req-27018d3e-6c88-4744-8021-4739b75fee50 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:39.556070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-366d7174-f67f-4d57-b431-9898eb469e9d req-27018d3e-6c88-4744-8021-4739b75fee50 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:39.556719 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-366d7174-f67f-4d57-b431-9898eb469e9d req-27018d3e-6c88-4744-8021-4739b75fee50 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:39.573130 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-366d7174-f67f-4d57-b431-9898eb469e9d req-27018d3e-6c88-4744-8021-4739b75fee50 service nova] Creating event network-vif-deleted:56a84396-c082-49b0-ad97-c3c5dcd571e5 for instance 1aa0744f-d655-4a61-b2cb-c640353d85c5 on nch2-master-1 Sep 17 21:12:39.579339 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-366d7174-f67f-4d57-b431-9898eb469e9d req-27018d3e-6c88-4744-8021-4739b75fee50 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063192 Sep 17 21:12:39.580544 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2492/4877] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:12:39.774442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7b8b2f23-774d-47f1-8b32-7fff65e02c13 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:39.775487 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7b8b2f23-774d-47f1-8b32-7fff65e02c13 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] [instance: 1aa0744f-d655-4a61-b2cb-c640353d85c5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:39.817665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7b8b2f23-774d-47f1-8b32-7fff65e02c13 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:39.818431 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7b8b2f23-774d-47f1-8b32-7fff65e02c13 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:39.819112 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7b8b2f23-774d-47f1-8b32-7fff65e02c13 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:39.820215 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7b8b2f23-774d-47f1-8b32-7fff65e02c13 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:39.821079 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7b8b2f23-774d-47f1-8b32-7fff65e02c13 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:39.827662 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7b8b2f23-774d-47f1-8b32-7fff65e02c13 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:39.864136 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e5955478-e0fc-4480-a006-0944d428fdf9 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d249eb9b0124c339d8e730c96649171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3723f4e7f0bb4a71ac7aaf46def6b4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:39.880208 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e5955478-e0fc-4480-a006-0944d428fdf9 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] 10.222.0.26 "GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007" status: 200 len: 1317 microversion: 2.1 time: 0.357828 Sep 17 21:12:39.890864 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2386/4878] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:39 2022] GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007 => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:39.912073 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2d4d8543-4af2-4f16-9d3d-de5b1e0c0cd3 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:39.912918 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2d4d8543-4af2-4f16-9d3d-de5b1e0c0cd3 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: ecbd9cec-fdea-45b2-bb96-487bdaf97635] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:39.925422 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d4d8543-4af2-4f16-9d3d-de5b1e0c0cd3 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:39.928378 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d4d8543-4af2-4f16-9d3d-de5b1e0c0cd3 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:39.930065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d4d8543-4af2-4f16-9d3d-de5b1e0c0cd3 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:39.932253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d4d8543-4af2-4f16-9d3d-de5b1e0c0cd3 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:39.941528 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d4d8543-4af2-4f16-9d3d-de5b1e0c0cd3 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:39.942472 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d4d8543-4af2-4f16-9d3d-de5b1e0c0cd3 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:40.060504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7b8b2f23-774d-47f1-8b32-7fff65e02c13 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfe77cd9de149508efbea44af748876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb68270a6474c41b16e24cae657407c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:40.072460 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7b8b2f23-774d-47f1-8b32-7fff65e02c13 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5" status: 200 len: 1313 microversion: 2.1 time: 0.303713 Sep 17 21:12:40.075768 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2493/4879] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:39 2022] GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5 => generated 1313 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:12:40.138480 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2d4d8543-4af2-4f16-9d3d-de5b1e0c0cd3 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:40.161248 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2d4d8543-4af2-4f16-9d3d-de5b1e0c0cd3 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635" status: 200 len: 1351 microversion: 2.1 time: 0.268385 Sep 17 21:12:40.165267 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2387/4880] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:39 2022] GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635 => generated 1351 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:40.374978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ee7b488c-00c8-4f9e-ad38-ac9b7a455e7a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:40.375688 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ee7b488c-00c8-4f9e-ad38-ac9b7a455e7a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:40.418501 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee7b488c-00c8-4f9e-ad38-ac9b7a455e7a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:40.419600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee7b488c-00c8-4f9e-ad38-ac9b7a455e7a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:40.420060 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee7b488c-00c8-4f9e-ad38-ac9b7a455e7a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:40.423357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee7b488c-00c8-4f9e-ad38-ac9b7a455e7a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:40.423859 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee7b488c-00c8-4f9e-ad38-ac9b7a455e7a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:40.424305 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee7b488c-00c8-4f9e-ad38-ac9b7a455e7a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:40.791127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ee7b488c-00c8-4f9e-ad38-ac9b7a455e7a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:40.804333 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ee7b488c-00c8-4f9e-ad38-ac9b7a455e7a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1309 microversion: 2.1 time: 0.443108 Sep 17 21:12:40.807853 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2494/4881] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:40 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1309 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:40.885762 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-629a794d-7f36-4f77-b8b2-945c97c69e77 req-b9e4511c-9bbe-4f6e-a83f-4d7f7614eaf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d95d4afe-e40a-4d99-844a-04411efde007", "name": "network-vif-plugged", "status": "completed", "tag": "c6dc6a35-88b4-4187-9e6d-57dbac1d6c3e"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:12:40.915415 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-629a794d-7f36-4f77-b8b2-945c97c69e77 req-b9e4511c-9bbe-4f6e-a83f-4d7f7614eaf5 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:40.915926 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-629a794d-7f36-4f77-b8b2-945c97c69e77 req-b9e4511c-9bbe-4f6e-a83f-4d7f7614eaf5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:40.916372 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-629a794d-7f36-4f77-b8b2-945c97c69e77 req-b9e4511c-9bbe-4f6e-a83f-4d7f7614eaf5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:40.918516 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d809c679-08e4-4dbb-ad36-bfa6a733ba46 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:40.920279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d809c679-08e4-4dbb-ad36-bfa6a733ba46 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] [instance: d95d4afe-e40a-4d99-844a-04411efde007] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:40.932909 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-629a794d-7f36-4f77-b8b2-945c97c69e77 req-b9e4511c-9bbe-4f6e-a83f-4d7f7614eaf5 service nova] Creating event network-vif-plugged:c6dc6a35-88b4-4187-9e6d-57dbac1d6c3e for instance d95d4afe-e40a-4d99-844a-04411efde007 on nch1-master-1 Sep 17 21:12:40.935551 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d809c679-08e4-4dbb-ad36-bfa6a733ba46 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:40.937866 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d809c679-08e4-4dbb-ad36-bfa6a733ba46 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:40.938634 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d809c679-08e4-4dbb-ad36-bfa6a733ba46 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:40.939115 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-629a794d-7f36-4f77-b8b2-945c97c69e77 req-b9e4511c-9bbe-4f6e-a83f-4d7f7614eaf5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060995 Sep 17 21:12:40.940099 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2388/4882] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:12:40.940587 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d809c679-08e4-4dbb-ad36-bfa6a733ba46 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:40.941187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d809c679-08e4-4dbb-ad36-bfa6a733ba46 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:40.941773 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d809c679-08e4-4dbb-ad36-bfa6a733ba46 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:41.101809 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8ca021c4-0e1a-4ce9-a91d-82bfd6734262 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:41.102608 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8ca021c4-0e1a-4ce9-a91d-82bfd6734262 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] [instance: 1aa0744f-d655-4a61-b2cb-c640353d85c5] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:41.112199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ca021c4-0e1a-4ce9-a91d-82bfd6734262 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:41.120089 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ca021c4-0e1a-4ce9-a91d-82bfd6734262 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:41.120937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ca021c4-0e1a-4ce9-a91d-82bfd6734262 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:41.121921 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ca021c4-0e1a-4ce9-a91d-82bfd6734262 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:41.122554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ca021c4-0e1a-4ce9-a91d-82bfd6734262 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:41.123340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ca021c4-0e1a-4ce9-a91d-82bfd6734262 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:41.156994 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:12:41.198091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ca021c4-0e1a-4ce9-a91d-82bfd6734262 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:41.202808 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ca021c4-0e1a-4ce9-a91d-82bfd6734262 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:41.203516 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ca021c4-0e1a-4ce9-a91d-82bfd6734262 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:41.204169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-8ca021c4-0e1a-4ce9-a91d-82bfd6734262 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lazy-loading 'fault' on Instance uuid 1aa0744f-d655-4a61-b2cb-c640353d85c5 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:12:41.306384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8ca021c4-0e1a-4ce9-a91d-82bfd6734262 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'adfe77cd9de149508efbea44af748876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb68270a6474c41b16e24cae657407c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:41.318927 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8ca021c4-0e1a-4ce9-a91d-82bfd6734262 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5" status: 200 len: 1318 microversion: 2.1 time: 0.221549 Sep 17 21:12:41.319869 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2389/4883] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:41 2022] GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:12:41.326262 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-16432a5d-1bd0-4cb7-8a86-c9d43d37de59 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:41.327404 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-16432a5d-1bd0-4cb7-8a86-c9d43d37de59 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: ecbd9cec-fdea-45b2-bb96-487bdaf97635] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:41.334204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-16432a5d-1bd0-4cb7-8a86-c9d43d37de59 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:41.334955 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-16432a5d-1bd0-4cb7-8a86-c9d43d37de59 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:41.335606 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-16432a5d-1bd0-4cb7-8a86-c9d43d37de59 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:41.336527 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-16432a5d-1bd0-4cb7-8a86-c9d43d37de59 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:41.337442 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-16432a5d-1bd0-4cb7-8a86-c9d43d37de59 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:41.338104 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-16432a5d-1bd0-4cb7-8a86-c9d43d37de59 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:41.383854 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d809c679-08e4-4dbb-ad36-bfa6a733ba46 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d249eb9b0124c339d8e730c96649171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3723f4e7f0bb4a71ac7aaf46def6b4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:41.411130 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d809c679-08e4-4dbb-ad36-bfa6a733ba46 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] 10.222.0.26 "GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007" status: 200 len: 1317 microversion: 2.1 time: 0.498374 Sep 17 21:12:41.418505 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2495/4884] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:40 2022] GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007 => generated 1317 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:41.569570 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-16432a5d-1bd0-4cb7-8a86-c9d43d37de59 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:41.579961 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-16432a5d-1bd0-4cb7-8a86-c9d43d37de59 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635" status: 200 len: 1470 microversion: 2.1 time: 0.258589 Sep 17 21:12:41.581269 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2390/4885] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:41 2022] GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635 => generated 1470 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:41.835181 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-58787fdc-a031-48e6-ada6-5f1ed4860903 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:41.837257 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-58787fdc-a031-48e6-ada6-5f1ed4860903 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:41.852668 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58787fdc-a031-48e6-ada6-5f1ed4860903 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:41.853453 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58787fdc-a031-48e6-ada6-5f1ed4860903 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:41.853931 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58787fdc-a031-48e6-ada6-5f1ed4860903 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:41.855163 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58787fdc-a031-48e6-ada6-5f1ed4860903 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:41.855770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58787fdc-a031-48e6-ada6-5f1ed4860903 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:41.857495 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58787fdc-a031-48e6-ada6-5f1ed4860903 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:41.909498 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-15fa3316-f5a7-4e4c-a4f3-c8bba28e13a6 req-7a17e142-3e2c-491f-8853-5231d1479dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecbd9cec-fdea-45b2-bb96-487bdaf97635", "tag": "0956417c-fbac-420c-8610-6825b3468c52"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:12:41.944745 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-15fa3316-f5a7-4e4c-a4f3-c8bba28e13a6 req-7a17e142-3e2c-491f-8853-5231d1479dd4 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:41.945238 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-15fa3316-f5a7-4e4c-a4f3-c8bba28e13a6 req-7a17e142-3e2c-491f-8853-5231d1479dd4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:41.946422 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-15fa3316-f5a7-4e4c-a4f3-c8bba28e13a6 req-7a17e142-3e2c-491f-8853-5231d1479dd4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:41.980178 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-15fa3316-f5a7-4e4c-a4f3-c8bba28e13a6 req-7a17e142-3e2c-491f-8853-5231d1479dd4 service nova] Creating event network-changed:0956417c-fbac-420c-8610-6825b3468c52 for instance ecbd9cec-fdea-45b2-bb96-487bdaf97635 on nch2-master-1 Sep 17 21:12:41.989048 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-15fa3316-f5a7-4e4c-a4f3-c8bba28e13a6 req-7a17e142-3e2c-491f-8853-5231d1479dd4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090627 Sep 17 21:12:41.990590 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2391/4886] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:12:42.159651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-58787fdc-a031-48e6-ada6-5f1ed4860903 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:42.169593 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-58787fdc-a031-48e6-ada6-5f1ed4860903 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1490 microversion: 2.1 time: 0.340984 Sep 17 21:12:42.190123 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2496/4887] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:41 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1490 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:42.223552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0a0673a5-7df4-4f29-a8d8-396f23c3f855 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-609096232"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:12:42.230240 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0a0673a5-7df4-4f29-a8d8-396f23c3f855 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:42.252091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0a0673a5-7df4-4f29-a8d8-396f23c3f855 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:42.252799 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0a0673a5-7df4-4f29-a8d8-396f23c3f855 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:42.253892 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0a0673a5-7df4-4f29-a8d8-396f23c3f855 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:42.255455 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0a0673a5-7df4-4f29-a8d8-396f23c3f855 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:42.256221 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0a0673a5-7df4-4f29-a8d8-396f23c3f855 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:42.256824 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0a0673a5-7df4-4f29-a8d8-396f23c3f855 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:42.344810 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b07ecb2c-900f-490a-8ed5-71713dd3ded1 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:42.345441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b07ecb2c-900f-490a-8ed5-71713dd3ded1 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] [instance: 1aa0744f-d655-4a61-b2cb-c640353d85c5] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:42.370984 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b07ecb2c-900f-490a-8ed5-71713dd3ded1 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:42.371937 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b07ecb2c-900f-490a-8ed5-71713dd3ded1 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:42.375381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b07ecb2c-900f-490a-8ed5-71713dd3ded1 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:42.376323 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b07ecb2c-900f-490a-8ed5-71713dd3ded1 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:42.376960 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b07ecb2c-900f-490a-8ed5-71713dd3ded1 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:42.380199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b07ecb2c-900f-490a-8ed5-71713dd3ded1 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:42.427812 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-b07ecb2c-900f-490a-8ed5-71713dd3ded1 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] HTTP exception thrown: Instance 1aa0744f-d655-4a61-b2cb-c640353d85c5 could not be found. Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b07ecb2c-900f-490a-8ed5-71713dd3ded1 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Request method failure captured: Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5 HTTP/1.1 Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjgNeeQ3o3gF7nPbxWwNlBk46nst5vfvPSpZvfp6B-LBEcReiR2UYd2_sRwcQtjg7BpV3O5XrgC9urQvOgSP2RI0zTSohGIWsIs5CpncKYv2VtqPdfV0t2LnXKw8f7vewZkJvwm5AERq56EDl2nclBRmbexGTGqrLLZbaVuInLb4_wM Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: bbb68270a6474c41b16e24cae657407c Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2021718223 Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bbb68270a6474c41b16e24cae657407c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bbb68270a6474c41b16e24cae657407c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bbb68270a6474c41b16e24cae657407c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bbb68270a6474c41b16e24cae657407c", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2021718223 Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: bbb68270a6474c41b16e24cae657407c Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2021718223 Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2021718223-project Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: adfe77cd9de149508efbea44af748876 Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2021718223-project Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 1aa0744f-d655-4a61-b2cb-c640353d85c5 could not be found. Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '1aa0744f-d655-4a61-b2cb-c640353d85c5'} Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aa0744f-d655-4a61-b2cb-c640353d85c5 could not be found. Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aa0744f-d655-4a61-b2cb-c640353d85c5 could not be found. Sep 17 21:12:42.429947 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:12:42.436025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:12:42.436025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:12:42.436025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:42.436025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:12:42.436025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:12:42.436025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:12:42.436025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:12:42.436025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aa0744f-d655-4a61-b2cb-c640353d85c5 could not be found. Sep 17 21:12:42.436025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:12:42.437966 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0a0673a5-7df4-4f29-a8d8-396f23c3f855 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "PUT /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1074 microversion: 2.1 time: 0.244486 Sep 17 21:12:42.438643 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2392/4888] 10.222.0.26 () {60 vars in 1256 bytes} [Sat Sep 17 21:12:42 2022] PUT /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1074 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:42.448882 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b07ecb2c-900f-490a-8ed5-71713dd3ded1 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] Returning 404 to user: Instance 1aa0744f-d655-4a61-b2cb-c640353d85c5 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:12:42.448882 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b07ecb2c-900f-490a-8ed5-71713dd3ded1 tempest-ServersNegativeTestMultiTenantJSON-2021718223 tempest-ServersNegativeTestMultiTenantJSON-2021718223-project] 10.222.0.26 "GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5" status: 404 len: 111 microversion: 2.1 time: 0.105283 Sep 17 21:12:42.454996 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2497/4889] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:42 2022] GET /compute/v2.1/servers/1aa0744f-d655-4a61-b2cb-c640353d85c5 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:12:42.455360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8b00d6f0-ff85-420c-8f75-d6cfdcaa942f tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:42.456203 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8b00d6f0-ff85-420c-8f75-d6cfdcaa942f tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] [instance: d95d4afe-e40a-4d99-844a-04411efde007] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:42.469669 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-af42d1fd-3aac-4e0a-b73e-b98eea76671c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:42.470409 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-af42d1fd-3aac-4e0a-b73e-b98eea76671c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:42.483850 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8b00d6f0-ff85-420c-8f75-d6cfdcaa942f tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:42.484785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8b00d6f0-ff85-420c-8f75-d6cfdcaa942f tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:42.485492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8b00d6f0-ff85-420c-8f75-d6cfdcaa942f tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:42.486472 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8b00d6f0-ff85-420c-8f75-d6cfdcaa942f tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:42.487780 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8b00d6f0-ff85-420c-8f75-d6cfdcaa942f tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:42.488555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8b00d6f0-ff85-420c-8f75-d6cfdcaa942f tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:42.489078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af42d1fd-3aac-4e0a-b73e-b98eea76671c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:42.489838 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af42d1fd-3aac-4e0a-b73e-b98eea76671c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:42.495115 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af42d1fd-3aac-4e0a-b73e-b98eea76671c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:42.496474 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af42d1fd-3aac-4e0a-b73e-b98eea76671c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:42.497261 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af42d1fd-3aac-4e0a-b73e-b98eea76671c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:42.497969 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af42d1fd-3aac-4e0a-b73e-b98eea76671c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:42.814136 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8b00d6f0-ff85-420c-8f75-d6cfdcaa942f tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d249eb9b0124c339d8e730c96649171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3723f4e7f0bb4a71ac7aaf46def6b4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:42.825734 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8b00d6f0-ff85-420c-8f75-d6cfdcaa942f tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] 10.222.0.26 "GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007" status: 200 len: 1506 microversion: 2.1 time: 0.385964 Sep 17 21:12:42.826332 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2393/4890] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:42 2022] GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007 => generated 1506 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:42.845441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d22bf1b3-d847-444d-81bf-051d5ac0dd0a tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:42.848040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-af42d1fd-3aac-4e0a-b73e-b98eea76671c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:42.849251 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d22bf1b3-d847-444d-81bf-051d5ac0dd0a tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: ecbd9cec-fdea-45b2-bb96-487bdaf97635] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:42.861453 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-af42d1fd-3aac-4e0a-b73e-b98eea76671c tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1500 microversion: 2.1 time: 0.398981 Sep 17 21:12:42.864023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d22bf1b3-d847-444d-81bf-051d5ac0dd0a tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:42.864619 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d22bf1b3-d847-444d-81bf-051d5ac0dd0a tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:42.869768 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d22bf1b3-d847-444d-81bf-051d5ac0dd0a tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:42.871031 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d22bf1b3-d847-444d-81bf-051d5ac0dd0a tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:42.871718 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d22bf1b3-d847-444d-81bf-051d5ac0dd0a tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:42.872372 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d22bf1b3-d847-444d-81bf-051d5ac0dd0a tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:42.874466 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2498/4891] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:42 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1500 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:42.894974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-42a7e79f-3ce4-4b52-8302-1bb7527d72a4 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:42.895575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-42a7e79f-3ce4-4b52-8302-1bb7527d72a4 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] [instance: d95d4afe-e40a-4d99-844a-04411efde007] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:42.913121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42a7e79f-3ce4-4b52-8302-1bb7527d72a4 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:42.914309 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42a7e79f-3ce4-4b52-8302-1bb7527d72a4 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:42.914942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42a7e79f-3ce4-4b52-8302-1bb7527d72a4 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:42.916503 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42a7e79f-3ce4-4b52-8302-1bb7527d72a4 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:42.917139 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42a7e79f-3ce4-4b52-8302-1bb7527d72a4 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:42.917806 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42a7e79f-3ce4-4b52-8302-1bb7527d72a4 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:42.982407 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-42a7e79f-3ce4-4b52-8302-1bb7527d72a4 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] 10.222.0.26 "GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007/ips" status: 200 len: 109 microversion: 2.1 time: 0.102488 Sep 17 21:12:42.983672 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2499/4892] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Sep 17 21:12:42 2022] GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007/ips => generated 109 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:12:43.001619 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-66ceb6d0-9db6-475a-887c-c4adf191dd74 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:43.002519 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-66ceb6d0-9db6-475a-887c-c4adf191dd74 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:43.012762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66ceb6d0-9db6-475a-887c-c4adf191dd74 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:43.013368 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66ceb6d0-9db6-475a-887c-c4adf191dd74 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:43.014552 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66ceb6d0-9db6-475a-887c-c4adf191dd74 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:43.016725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66ceb6d0-9db6-475a-887c-c4adf191dd74 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:43.017393 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66ceb6d0-9db6-475a-887c-c4adf191dd74 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:43.017962 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-66ceb6d0-9db6-475a-887c-c4adf191dd74 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:43.145951 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d22bf1b3-d847-444d-81bf-051d5ac0dd0a tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:43.158137 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d22bf1b3-d847-444d-81bf-051d5ac0dd0a tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635" status: 200 len: 1470 microversion: 2.1 time: 0.323933 Sep 17 21:12:43.160555 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2394/4893] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:42 2022] GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635 => generated 1470 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:43.167928 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fbd703e7-7e22-403b-9072-84b89857755c tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:43.168862 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fbd703e7-7e22-403b-9072-84b89857755c tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] [instance: d95d4afe-e40a-4d99-844a-04411efde007] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:43.176755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fbd703e7-7e22-403b-9072-84b89857755c tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:43.177488 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fbd703e7-7e22-403b-9072-84b89857755c tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:43.178230 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fbd703e7-7e22-403b-9072-84b89857755c tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:43.179902 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fbd703e7-7e22-403b-9072-84b89857755c tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:43.180903 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fbd703e7-7e22-403b-9072-84b89857755c tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:43.181995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fbd703e7-7e22-403b-9072-84b89857755c tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:43.213510 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fbd703e7-7e22-403b-9072-84b89857755c tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] 10.222.0.26 "GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007/ips" status: 200 len: 109 microversion: 2.1 time: 0.051853 Sep 17 21:12:43.214410 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2395/4894] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Sep 17 21:12:43 2022] GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007/ips => generated 109 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:12:43.230368 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2c38c496-b278-4254-a4e5-3464e58b2fbe tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:43.231376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2c38c496-b278-4254-a4e5-3464e58b2fbe tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] [instance: d95d4afe-e40a-4d99-844a-04411efde007] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:43.239795 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2c38c496-b278-4254-a4e5-3464e58b2fbe tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:43.241365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2c38c496-b278-4254-a4e5-3464e58b2fbe tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:43.242064 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2c38c496-b278-4254-a4e5-3464e58b2fbe tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:43.243145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2c38c496-b278-4254-a4e5-3464e58b2fbe tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:43.243792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2c38c496-b278-4254-a4e5-3464e58b2fbe tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:43.244410 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2c38c496-b278-4254-a4e5-3464e58b2fbe tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:43.277648 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2c38c496-b278-4254-a4e5-3464e58b2fbe tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] 10.222.0.26 "GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007/ips/tempest-ServerAddressesTestJSON-1017864421-network" status: 200 len: 94 microversion: 2.1 time: 0.054549 Sep 17 21:12:43.286607 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2396/4895] 10.222.0.26 () {58 vars in 1401 bytes} [Sat Sep 17 21:12:43 2022] GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007/ips/tempest-ServerAddressesTestJSON-1017864421-network => generated 94 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:12:43.292293 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4fb40da8-1224-45c6-bd17-e0428fc2e442 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:43.293104 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4fb40da8-1224-45c6-bd17-e0428fc2e442 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] [instance: d95d4afe-e40a-4d99-844a-04411efde007] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:43.301614 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4fb40da8-1224-45c6-bd17-e0428fc2e442 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:43.302362 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4fb40da8-1224-45c6-bd17-e0428fc2e442 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:43.303344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4fb40da8-1224-45c6-bd17-e0428fc2e442 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:43.304456 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4fb40da8-1224-45c6-bd17-e0428fc2e442 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:43.305229 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4fb40da8-1224-45c6-bd17-e0428fc2e442 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:43.305872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4fb40da8-1224-45c6-bd17-e0428fc2e442 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:43.318942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-66ceb6d0-9db6-475a-887c-c4adf191dd74 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:43.334141 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-66ceb6d0-9db6-475a-887c-c4adf191dd74 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1500 microversion: 2.1 time: 0.344725 Sep 17 21:12:43.337348 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2500/4896] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:42 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1500 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:43.364335 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4fb40da8-1224-45c6-bd17-e0428fc2e442 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] [instance: d95d4afe-e40a-4d99-844a-04411efde007] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:12:43.366595 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-79f7e68e-052c-4548-9da8-6e878ed42a59 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:12:43.374560 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79f7e68e-052c-4548-9da8-6e878ed42a59 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:43.375058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79f7e68e-052c-4548-9da8-6e878ed42a59 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:43.375502 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79f7e68e-052c-4548-9da8-6e878ed42a59 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:43.450710 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-79f7e68e-052c-4548-9da8-6e878ed42a59 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Going to try to stop instance {{(pid=140524) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 17 21:12:43.463313 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:12:43.505293 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4fb40da8-1224-45c6-bd17-e0428fc2e442 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007" status: 204 len: 0 microversion: 2.1 time: 0.216987 Sep 17 21:12:43.509898 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2397/4897] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:12:43 2022] DELETE /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:12:43.518956 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-60b618ea-ceba-4cd6-b38d-e2c37a9ddd2f tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:43.519896 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-60b618ea-ceba-4cd6-b38d-e2c37a9ddd2f tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] [instance: d95d4afe-e40a-4d99-844a-04411efde007] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:43.528077 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60b618ea-ceba-4cd6-b38d-e2c37a9ddd2f tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:43.528984 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60b618ea-ceba-4cd6-b38d-e2c37a9ddd2f tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:43.529628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60b618ea-ceba-4cd6-b38d-e2c37a9ddd2f tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:43.530872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60b618ea-ceba-4cd6-b38d-e2c37a9ddd2f tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:43.531669 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60b618ea-ceba-4cd6-b38d-e2c37a9ddd2f tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:43.532598 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60b618ea-ceba-4cd6-b38d-e2c37a9ddd2f tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:43.560833 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-79f7e68e-052c-4548-9da8-6e878ed42a59 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "POST /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25/action" status: 202 len: 0 microversion: 2.1 time: 0.198071 Sep 17 21:12:43.564837 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2501/4898] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:12:43 2022] POST /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:12:43.573854 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e7f9c7bf-0501-49ee-9d77-2c1f83876788 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:43.574660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e7f9c7bf-0501-49ee-9d77-2c1f83876788 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:43.590233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7f9c7bf-0501-49ee-9d77-2c1f83876788 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:43.590740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7f9c7bf-0501-49ee-9d77-2c1f83876788 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:43.591184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7f9c7bf-0501-49ee-9d77-2c1f83876788 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:43.591897 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7f9c7bf-0501-49ee-9d77-2c1f83876788 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:43.592339 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7f9c7bf-0501-49ee-9d77-2c1f83876788 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:43.592823 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7f9c7bf-0501-49ee-9d77-2c1f83876788 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:43.894930 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-60b618ea-ceba-4cd6-b38d-e2c37a9ddd2f tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d249eb9b0124c339d8e730c96649171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3723f4e7f0bb4a71ac7aaf46def6b4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:43.911321 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-60b618ea-ceba-4cd6-b38d-e2c37a9ddd2f tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] 10.222.0.26 "GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007" status: 200 len: 1512 microversion: 2.1 time: 0.397636 Sep 17 21:12:43.911980 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2398/4899] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:43 2022] GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007 => generated 1512 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:43.927448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e7f9c7bf-0501-49ee-9d77-2c1f83876788 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:43.940977 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e7f9c7bf-0501-49ee-9d77-2c1f83876788 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1510 microversion: 2.1 time: 0.374443 Sep 17 21:12:43.948352 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2502/4900] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:43 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1510 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:12:44.183444 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-68d78331-3970-4955-b547-daa946c99bbb tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:44.184045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-68d78331-3970-4955-b547-daa946c99bbb tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: ecbd9cec-fdea-45b2-bb96-487bdaf97635] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:44.191296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68d78331-3970-4955-b547-daa946c99bbb tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:44.191781 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68d78331-3970-4955-b547-daa946c99bbb tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:44.192651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68d78331-3970-4955-b547-daa946c99bbb tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:44.193657 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68d78331-3970-4955-b547-daa946c99bbb tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:44.194180 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68d78331-3970-4955-b547-daa946c99bbb tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:44.194836 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68d78331-3970-4955-b547-daa946c99bbb tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:44.451356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-68d78331-3970-4955-b547-daa946c99bbb tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:44.481759 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-68d78331-3970-4955-b547-daa946c99bbb tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635" status: 200 len: 1470 microversion: 2.1 time: 0.301738 Sep 17 21:12:44.484848 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2399/4901] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:44 2022] GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635 => generated 1470 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:44.948157 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9a40afb1-d3c8-47d8-ae1e-aec0f29991f2 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:44.949204 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9a40afb1-d3c8-47d8-ae1e-aec0f29991f2 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] [instance: d95d4afe-e40a-4d99-844a-04411efde007] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:44.959978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9a40afb1-d3c8-47d8-ae1e-aec0f29991f2 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:44.960570 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9a40afb1-d3c8-47d8-ae1e-aec0f29991f2 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:44.962129 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9a40afb1-d3c8-47d8-ae1e-aec0f29991f2 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:44.963807 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9a40afb1-d3c8-47d8-ae1e-aec0f29991f2 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:44.964799 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9a40afb1-d3c8-47d8-ae1e-aec0f29991f2 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:44.976030 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9a40afb1-d3c8-47d8-ae1e-aec0f29991f2 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:44.980862 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-79c77c49-e472-4789-a920-ac55026730f1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:44.982716 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-79c77c49-e472-4789-a920-ac55026730f1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:45.001378 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79c77c49-e472-4789-a920-ac55026730f1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:45.003776 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79c77c49-e472-4789-a920-ac55026730f1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:45.005254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79c77c49-e472-4789-a920-ac55026730f1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:45.006332 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79c77c49-e472-4789-a920-ac55026730f1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:45.021906 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79c77c49-e472-4789-a920-ac55026730f1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:45.026932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79c77c49-e472-4789-a920-ac55026730f1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:45.784039 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9a40afb1-d3c8-47d8-ae1e-aec0f29991f2 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d249eb9b0124c339d8e730c96649171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3723f4e7f0bb4a71ac7aaf46def6b4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:45.795857 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9a40afb1-d3c8-47d8-ae1e-aec0f29991f2 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] 10.222.0.26 "GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007" status: 200 len: 1512 microversion: 2.1 time: 0.857704 Sep 17 21:12:45.797045 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2503/4902] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:44 2022] GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007 => generated 1512 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:45.804272 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9b3489ee-8944-4137-8374-da7e8d631654 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:45.805240 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9b3489ee-8944-4137-8374-da7e8d631654 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: ecbd9cec-fdea-45b2-bb96-487bdaf97635] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:45.812655 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b3489ee-8944-4137-8374-da7e8d631654 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:45.813674 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b3489ee-8944-4137-8374-da7e8d631654 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:45.814281 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b3489ee-8944-4137-8374-da7e8d631654 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:45.815154 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b3489ee-8944-4137-8374-da7e8d631654 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:45.817500 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b3489ee-8944-4137-8374-da7e8d631654 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:45.819197 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b3489ee-8944-4137-8374-da7e8d631654 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:45.952266 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-79c77c49-e472-4789-a920-ac55026730f1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:45.964949 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-79c77c49-e472-4789-a920-ac55026730f1 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1510 microversion: 2.1 time: 0.993634 Sep 17 21:12:45.968624 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2400/4903] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:44 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1510 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:46.217892 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9b3489ee-8944-4137-8374-da7e8d631654 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:46.230315 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9b3489ee-8944-4137-8374-da7e8d631654 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635" status: 200 len: 1470 microversion: 2.1 time: 0.431266 Sep 17 21:12:46.233771 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2504/4904] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:45 2022] GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635 => generated 1470 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:46.347665 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-961b6945-4d8b-4728-a7fe-ba0b138ca4ee req-2e068bfd-a078-4c72-9f96-26b1fce33741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d95d4afe-e40a-4d99-844a-04411efde007", "name": "network-vif-deleted", "tag": "c6dc6a35-88b4-4187-9e6d-57dbac1d6c3e"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:12:46.369450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-961b6945-4d8b-4728-a7fe-ba0b138ca4ee req-2e068bfd-a078-4c72-9f96-26b1fce33741 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:46.371509 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-961b6945-4d8b-4728-a7fe-ba0b138ca4ee req-2e068bfd-a078-4c72-9f96-26b1fce33741 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:46.375856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-961b6945-4d8b-4728-a7fe-ba0b138ca4ee req-2e068bfd-a078-4c72-9f96-26b1fce33741 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:46.395623 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-961b6945-4d8b-4728-a7fe-ba0b138ca4ee req-2e068bfd-a078-4c72-9f96-26b1fce33741 service nova] Creating event network-vif-deleted:c6dc6a35-88b4-4187-9e6d-57dbac1d6c3e for instance d95d4afe-e40a-4d99-844a-04411efde007 on nch1-master-1 Sep 17 21:12:46.402485 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-961b6945-4d8b-4728-a7fe-ba0b138ca4ee req-2e068bfd-a078-4c72-9f96-26b1fce33741 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057867 Sep 17 21:12:46.403763 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2401/4905] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:12:46.823504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c0813337-e672-4bbb-9f2a-0ee23b0ffb80 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:46.824309 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c0813337-e672-4bbb-9f2a-0ee23b0ffb80 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] [instance: d95d4afe-e40a-4d99-844a-04411efde007] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:46.842598 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0813337-e672-4bbb-9f2a-0ee23b0ffb80 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:46.843110 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0813337-e672-4bbb-9f2a-0ee23b0ffb80 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:46.843567 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0813337-e672-4bbb-9f2a-0ee23b0ffb80 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:46.844304 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0813337-e672-4bbb-9f2a-0ee23b0ffb80 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:46.844769 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0813337-e672-4bbb-9f2a-0ee23b0ffb80 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:46.845204 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0813337-e672-4bbb-9f2a-0ee23b0ffb80 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:46.931211 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0813337-e672-4bbb-9f2a-0ee23b0ffb80 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:46.935116 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0813337-e672-4bbb-9f2a-0ee23b0ffb80 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:46.936600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c0813337-e672-4bbb-9f2a-0ee23b0ffb80 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:46.937275 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-c0813337-e672-4bbb-9f2a-0ee23b0ffb80 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lazy-loading 'fault' on Instance uuid d95d4afe-e40a-4d99-844a-04411efde007 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:12:46.988029 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:12:46.989782 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:12:46.996427 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6cd5b969-c210-4c98-8f03-b30cc715b939 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:46.997484 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6cd5b969-c210-4c98-8f03-b30cc715b939 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:47.047448 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6cd5b969-c210-4c98-8f03-b30cc715b939 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:47.053120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6cd5b969-c210-4c98-8f03-b30cc715b939 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:47.055484 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6cd5b969-c210-4c98-8f03-b30cc715b939 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:47.056345 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6cd5b969-c210-4c98-8f03-b30cc715b939 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:47.062034 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6cd5b969-c210-4c98-8f03-b30cc715b939 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:47.062986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6cd5b969-c210-4c98-8f03-b30cc715b939 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:47.212772 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c0813337-e672-4bbb-9f2a-0ee23b0ffb80 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d249eb9b0124c339d8e730c96649171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3723f4e7f0bb4a71ac7aaf46def6b4f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:47.225789 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c0813337-e672-4bbb-9f2a-0ee23b0ffb80 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] 10.222.0.26 "GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007" status: 200 len: 1307 microversion: 2.1 time: 0.404625 Sep 17 21:12:47.229824 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2505/4906] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:46 2022] GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007 => generated 1307 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:47.262454 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c5890a82-0dc6-499f-a1ac-6e81ed5590d2 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:47.264088 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c5890a82-0dc6-499f-a1ac-6e81ed5590d2 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: ecbd9cec-fdea-45b2-bb96-487bdaf97635] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:47.277710 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c5890a82-0dc6-499f-a1ac-6e81ed5590d2 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:47.278551 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c5890a82-0dc6-499f-a1ac-6e81ed5590d2 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:47.281187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c5890a82-0dc6-499f-a1ac-6e81ed5590d2 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:47.284036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c5890a82-0dc6-499f-a1ac-6e81ed5590d2 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:47.286522 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c5890a82-0dc6-499f-a1ac-6e81ed5590d2 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:47.287247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c5890a82-0dc6-499f-a1ac-6e81ed5590d2 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:47.304786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:12:47.547741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6cd5b969-c210-4c98-8f03-b30cc715b939 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:47.556171 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6cd5b969-c210-4c98-8f03-b30cc715b939 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1510 microversion: 2.1 time: 0.569668 Sep 17 21:12:47.565935 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2402/4907] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:46 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1510 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:47.781442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c5890a82-0dc6-499f-a1ac-6e81ed5590d2 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:47.794994 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c5890a82-0dc6-499f-a1ac-6e81ed5590d2 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635" status: 200 len: 1470 microversion: 2.1 time: 0.541067 Sep 17 21:12:47.796753 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2506/4908] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:47 2022] GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635 => generated 1470 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:48.265207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bfba7938-80cd-490d-b0d8-58660a111709 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:48.266089 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bfba7938-80cd-490d-b0d8-58660a111709 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] [instance: d95d4afe-e40a-4d99-844a-04411efde007] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:48.281301 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bfba7938-80cd-490d-b0d8-58660a111709 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:48.281848 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bfba7938-80cd-490d-b0d8-58660a111709 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:48.283713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bfba7938-80cd-490d-b0d8-58660a111709 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:48.286418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bfba7938-80cd-490d-b0d8-58660a111709 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:48.287117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bfba7938-80cd-490d-b0d8-58660a111709 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:48.289250 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bfba7938-80cd-490d-b0d8-58660a111709 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:48.325841 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-bfba7938-80cd-490d-b0d8-58660a111709 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] HTTP exception thrown: Instance d95d4afe-e40a-4d99-844a-04411efde007 could not be found. Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bfba7938-80cd-490d-b0d8-58660a111709 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Request method failure captured: Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007 HTTP/1.1 Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjg0EfoSJTSb_wDmVV7b0_zjguiHJZtjqItpbtQ2auxvmmGCbr7P0oLHU9TVHvLH9QBxPIxACK0lYvRTRK7cL5lytImchsn0GerhhvU0w8mxa2uX51ZxWtE4zzxSstJbIE3oR8Dgi-_0SjcA9yG0cyevBdnlG3wM7Jnmc3ruusIByxc Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 3723f4e7f0bb4a71ac7aaf46def6b4f6 Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerAddressesTestJSON-1541944535 Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3723f4e7f0bb4a71ac7aaf46def6b4f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3723f4e7f0bb4a71ac7aaf46def6b4f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3723f4e7f0bb4a71ac7aaf46def6b4f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3723f4e7f0bb4a71ac7aaf46def6b4f6", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerAddressesTestJSON-1541944535 Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 3723f4e7f0bb4a71ac7aaf46def6b4f6 Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1541944535 Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerAddressesTestJSON-1541944535-project Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 2d249eb9b0124c339d8e730c96649171 Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerAddressesTestJSON-1541944535-project Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance d95d4afe-e40a-4d99-844a-04411efde007 could not be found. Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'd95d4afe-e40a-4d99-844a-04411efde007'} Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d95d4afe-e40a-4d99-844a-04411efde007 could not be found. Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d95d4afe-e40a-4d99-844a-04411efde007 could not be found. Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:12:48.331207 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:48.336592 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:12:48.336592 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:12:48.336592 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:12:48.336592 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:12:48.336592 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:12:48.336592 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d95d4afe-e40a-4d99-844a-04411efde007 could not be found. Sep 17 21:12:48.336592 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:12:48.336592 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bfba7938-80cd-490d-b0d8-58660a111709 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] Returning 404 to user: Instance d95d4afe-e40a-4d99-844a-04411efde007 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:12:48.336592 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bfba7938-80cd-490d-b0d8-58660a111709 tempest-ServerAddressesTestJSON-1541944535 tempest-ServerAddressesTestJSON-1541944535-project] 10.222.0.26 "GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007" status: 404 len: 111 microversion: 2.1 time: 0.080196 Sep 17 21:12:48.339892 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2403/4909] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:48 2022] GET /compute/v2.1/servers/d95d4afe-e40a-4d99-844a-04411efde007 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:12:48.594891 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bf7bb6a8-40c7-4176-a9b9-049a2a6a94d9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:48.596262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bf7bb6a8-40c7-4176-a9b9-049a2a6a94d9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:48.611585 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf7bb6a8-40c7-4176-a9b9-049a2a6a94d9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:48.612458 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf7bb6a8-40c7-4176-a9b9-049a2a6a94d9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:48.614303 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf7bb6a8-40c7-4176-a9b9-049a2a6a94d9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:48.616322 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf7bb6a8-40c7-4176-a9b9-049a2a6a94d9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:48.617416 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf7bb6a8-40c7-4176-a9b9-049a2a6a94d9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:48.619841 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf7bb6a8-40c7-4176-a9b9-049a2a6a94d9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:48.823496 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-234e2a51-263b-4cf4-897e-80e7eee1a9d0 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:48.824265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-234e2a51-263b-4cf4-897e-80e7eee1a9d0 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: ecbd9cec-fdea-45b2-bb96-487bdaf97635] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:48.834347 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-234e2a51-263b-4cf4-897e-80e7eee1a9d0 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:48.834915 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-234e2a51-263b-4cf4-897e-80e7eee1a9d0 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:48.835578 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-234e2a51-263b-4cf4-897e-80e7eee1a9d0 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:48.836548 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-234e2a51-263b-4cf4-897e-80e7eee1a9d0 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:48.837422 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-234e2a51-263b-4cf4-897e-80e7eee1a9d0 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:48.838082 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-234e2a51-263b-4cf4-897e-80e7eee1a9d0 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:49.075996 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bf7bb6a8-40c7-4176-a9b9-049a2a6a94d9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:49.090663 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bf7bb6a8-40c7-4176-a9b9-049a2a6a94d9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1510 microversion: 2.1 time: 0.501743 Sep 17 21:12:49.091855 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2507/4910] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:48 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1510 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:49.099537 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-cfa6b329-3490-4290-81d1-fe4b7a8251e7 req-f6aa0412-c7b6-4a20-9f81-181ea364c8f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecbd9cec-fdea-45b2-bb96-487bdaf97635", "name": "network-vif-plugged", "status": "completed", "tag": "0956417c-fbac-420c-8610-6825b3468c52"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:12:49.111783 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-cfa6b329-3490-4290-81d1-fe4b7a8251e7 req-f6aa0412-c7b6-4a20-9f81-181ea364c8f0 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:49.113140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-cfa6b329-3490-4290-81d1-fe4b7a8251e7 req-f6aa0412-c7b6-4a20-9f81-181ea364c8f0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:49.114073 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-cfa6b329-3490-4290-81d1-fe4b7a8251e7 req-f6aa0412-c7b6-4a20-9f81-181ea364c8f0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:49.138107 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-cfa6b329-3490-4290-81d1-fe4b7a8251e7 req-f6aa0412-c7b6-4a20-9f81-181ea364c8f0 service nova] Creating event network-vif-plugged:0956417c-fbac-420c-8610-6825b3468c52 for instance ecbd9cec-fdea-45b2-bb96-487bdaf97635 on nch2-master-1 Sep 17 21:12:49.146309 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-cfa6b329-3490-4290-81d1-fe4b7a8251e7 req-f6aa0412-c7b6-4a20-9f81-181ea364c8f0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052464 Sep 17 21:12:49.147958 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2508/4911] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:12:49.184612 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-234e2a51-263b-4cf4-897e-80e7eee1a9d0 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:49.194761 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-234e2a51-263b-4cf4-897e-80e7eee1a9d0 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635" status: 200 len: 1470 microversion: 2.1 time: 0.376040 Sep 17 21:12:49.195353 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2404/4912] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:48 2022] GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635 => generated 1470 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:50.126327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3b554952-9f99-4548-83d5-f3a3a2e9c114 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:50.128101 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3b554952-9f99-4548-83d5-f3a3a2e9c114 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:50.143158 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b554952-9f99-4548-83d5-f3a3a2e9c114 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:50.145275 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b554952-9f99-4548-83d5-f3a3a2e9c114 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:50.146363 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b554952-9f99-4548-83d5-f3a3a2e9c114 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:50.147491 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b554952-9f99-4548-83d5-f3a3a2e9c114 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:50.148424 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b554952-9f99-4548-83d5-f3a3a2e9c114 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:50.150035 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b554952-9f99-4548-83d5-f3a3a2e9c114 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:50.221634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-64078ea8-907e-46f1-8dd7-1c1c0327a905 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:50.222282 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-64078ea8-907e-46f1-8dd7-1c1c0327a905 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: ecbd9cec-fdea-45b2-bb96-487bdaf97635] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:50.231752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-64078ea8-907e-46f1-8dd7-1c1c0327a905 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:50.232254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-64078ea8-907e-46f1-8dd7-1c1c0327a905 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:50.232695 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-64078ea8-907e-46f1-8dd7-1c1c0327a905 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:50.233841 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-64078ea8-907e-46f1-8dd7-1c1c0327a905 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:50.234464 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-64078ea8-907e-46f1-8dd7-1c1c0327a905 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:50.235057 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-64078ea8-907e-46f1-8dd7-1c1c0327a905 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:50.581614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3b554952-9f99-4548-83d5-f3a3a2e9c114 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:50.590501 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3b554952-9f99-4548-83d5-f3a3a2e9c114 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1510 microversion: 2.1 time: 0.478467 Sep 17 21:12:50.606864 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2509/4913] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:50 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1510 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:50.694400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-64078ea8-907e-46f1-8dd7-1c1c0327a905 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:50.710142 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-64078ea8-907e-46f1-8dd7-1c1c0327a905 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635" status: 200 len: 1470 microversion: 2.1 time: 0.493208 Sep 17 21:12:50.711771 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2405/4914] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:50 2022] GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635 => generated 1470 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:12:51.629186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-26b5dac1-a525-49b1-abf9-6b19d70aab2e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:51.632376 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-26b5dac1-a525-49b1-abf9-6b19d70aab2e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:51.644923 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26b5dac1-a525-49b1-abf9-6b19d70aab2e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:51.645606 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26b5dac1-a525-49b1-abf9-6b19d70aab2e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:51.646955 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26b5dac1-a525-49b1-abf9-6b19d70aab2e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:51.648536 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26b5dac1-a525-49b1-abf9-6b19d70aab2e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:51.649209 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26b5dac1-a525-49b1-abf9-6b19d70aab2e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:51.649953 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26b5dac1-a525-49b1-abf9-6b19d70aab2e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:51.736285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dd9b3705-6628-41c0-8b4f-737de07844ce tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:51.737770 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dd9b3705-6628-41c0-8b4f-737de07844ce tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: ecbd9cec-fdea-45b2-bb96-487bdaf97635] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:51.749450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd9b3705-6628-41c0-8b4f-737de07844ce tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:51.750228 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd9b3705-6628-41c0-8b4f-737de07844ce tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:51.751937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd9b3705-6628-41c0-8b4f-737de07844ce tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:51.753064 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd9b3705-6628-41c0-8b4f-737de07844ce tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:51.754554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd9b3705-6628-41c0-8b4f-737de07844ce tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:51.755346 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd9b3705-6628-41c0-8b4f-737de07844ce tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:51.760868 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:12:52.558206 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-26b5dac1-a525-49b1-abf9-6b19d70aab2e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:52.583118 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-26b5dac1-a525-49b1-abf9-6b19d70aab2e tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1510 microversion: 2.1 time: 0.960857 Sep 17 21:12:52.598033 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2510/4915] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:51 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1510 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:52.620050 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dd9b3705-6628-41c0-8b4f-737de07844ce tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:52.632955 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dd9b3705-6628-41c0-8b4f-737de07844ce tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635" status: 200 len: 1642 microversion: 2.1 time: 0.900845 Sep 17 21:12:52.648265 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2406/4916] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:51 2022] GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635 => generated 1642 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:52.663894 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c3e500b9-b70b-4092-aced-c5d2696df08f tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:52.665935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c3e500b9-b70b-4092-aced-c5d2696df08f tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: ecbd9cec-fdea-45b2-bb96-487bdaf97635] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:52.675134 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3e500b9-b70b-4092-aced-c5d2696df08f tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:52.676349 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3e500b9-b70b-4092-aced-c5d2696df08f tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:52.676858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3e500b9-b70b-4092-aced-c5d2696df08f tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:52.678269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3e500b9-b70b-4092-aced-c5d2696df08f tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:52.679485 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3e500b9-b70b-4092-aced-c5d2696df08f tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:52.680096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3e500b9-b70b-4092-aced-c5d2696df08f tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:53.092482 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c3e500b9-b70b-4092-aced-c5d2696df08f tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:53.112441 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c3e500b9-b70b-4092-aced-c5d2696df08f tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635" status: 200 len: 1642 microversion: 2.1 time: 0.454325 Sep 17 21:12:53.113370 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2511/4917] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:52 2022] GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635 => generated 1642 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:12:53.141474 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cfcd13a9-e38e-46fd-a9c4-80f467524546 tempest-TestSecurityGroupsBasicOps-1755280313 tempest-TestSecurityGroupsBasicOps-1755280313-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:53.143337 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cfcd13a9-e38e-46fd-a9c4-80f467524546 tempest-TestSecurityGroupsBasicOps-1755280313 tempest-TestSecurityGroupsBasicOps-1755280313-project-admin] [instance: ecbd9cec-fdea-45b2-bb96-487bdaf97635] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:53.151841 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cfcd13a9-e38e-46fd-a9c4-80f467524546 tempest-TestSecurityGroupsBasicOps-1755280313 tempest-TestSecurityGroupsBasicOps-1755280313-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:53.152414 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cfcd13a9-e38e-46fd-a9c4-80f467524546 tempest-TestSecurityGroupsBasicOps-1755280313 tempest-TestSecurityGroupsBasicOps-1755280313-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:53.153520 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cfcd13a9-e38e-46fd-a9c4-80f467524546 tempest-TestSecurityGroupsBasicOps-1755280313 tempest-TestSecurityGroupsBasicOps-1755280313-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:53.154519 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cfcd13a9-e38e-46fd-a9c4-80f467524546 tempest-TestSecurityGroupsBasicOps-1755280313 tempest-TestSecurityGroupsBasicOps-1755280313-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:53.155196 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cfcd13a9-e38e-46fd-a9c4-80f467524546 tempest-TestSecurityGroupsBasicOps-1755280313 tempest-TestSecurityGroupsBasicOps-1755280313-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:53.155815 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cfcd13a9-e38e-46fd-a9c4-80f467524546 tempest-TestSecurityGroupsBasicOps-1755280313 tempest-TestSecurityGroupsBasicOps-1755280313-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:53.624407 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-58cc2f7e-c8e2-4b6b-863a-9026a6bacbbc tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:53.625040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-58cc2f7e-c8e2-4b6b-863a-9026a6bacbbc tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:53.634065 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58cc2f7e-c8e2-4b6b-863a-9026a6bacbbc tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:53.634925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58cc2f7e-c8e2-4b6b-863a-9026a6bacbbc tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:53.635792 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58cc2f7e-c8e2-4b6b-863a-9026a6bacbbc tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:53.637327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58cc2f7e-c8e2-4b6b-863a-9026a6bacbbc tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:53.639431 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58cc2f7e-c8e2-4b6b-863a-9026a6bacbbc tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:53.671677 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58cc2f7e-c8e2-4b6b-863a-9026a6bacbbc tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:54.034253 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cfcd13a9-e38e-46fd-a9c4-80f467524546 tempest-TestSecurityGroupsBasicOps-1755280313 tempest-TestSecurityGroupsBasicOps-1755280313-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635" status: 200 len: 1793 microversion: 2.1 time: 0.897635 Sep 17 21:12:54.035269 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2407/4918] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:53 2022] GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635 => generated 1793 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:54.260070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-58cc2f7e-c8e2-4b6b-863a-9026a6bacbbc tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:54.273048 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-58cc2f7e-c8e2-4b6b-863a-9026a6bacbbc tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1510 microversion: 2.1 time: 0.652272 Sep 17 21:12:54.274465 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2512/4919] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:53 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1510 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:55.301163 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8be5a2a3-2e94-4368-a878-d70abec60c70 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:55.303106 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8be5a2a3-2e94-4368-a878-d70abec60c70 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:55.320284 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8be5a2a3-2e94-4368-a878-d70abec60c70 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:55.322315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8be5a2a3-2e94-4368-a878-d70abec60c70 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:55.324018 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8be5a2a3-2e94-4368-a878-d70abec60c70 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:55.326394 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8be5a2a3-2e94-4368-a878-d70abec60c70 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:55.328951 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8be5a2a3-2e94-4368-a878-d70abec60c70 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:55.329695 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8be5a2a3-2e94-4368-a878-d70abec60c70 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:55.659718 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8be5a2a3-2e94-4368-a878-d70abec60c70 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:55.668741 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8be5a2a3-2e94-4368-a878-d70abec60c70 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1510 microversion: 2.1 time: 0.374288 Sep 17 21:12:55.675805 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2408/4920] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:55 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1510 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:56.702541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4e8938e6-d664-444f-b435-5def232a8794 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:56.704281 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4e8938e6-d664-444f-b435-5def232a8794 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:56.731296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e8938e6-d664-444f-b435-5def232a8794 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:56.732061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e8938e6-d664-444f-b435-5def232a8794 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:56.732579 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e8938e6-d664-444f-b435-5def232a8794 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:56.733685 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e8938e6-d664-444f-b435-5def232a8794 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:56.734392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e8938e6-d664-444f-b435-5def232a8794 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:56.735514 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e8938e6-d664-444f-b435-5def232a8794 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:57.050296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4e8938e6-d664-444f-b435-5def232a8794 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:57.064112 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4e8938e6-d664-444f-b435-5def232a8794 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1510 microversion: 2.1 time: 0.366531 Sep 17 21:12:57.065765 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2513/4921] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:56 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1510 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:57.490516 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-041a5191-c8f0-4ee3-bb2c-5e9a6ded3eb6 req-e590457e-63ec-4dac-af6b-7343a32afee5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecbd9cec-fdea-45b2-bb96-487bdaf97635", "tag": "0956417c-fbac-420c-8610-6825b3468c52"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:12:57.505290 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-041a5191-c8f0-4ee3-bb2c-5e9a6ded3eb6 req-e590457e-63ec-4dac-af6b-7343a32afee5 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:57.519346 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-041a5191-c8f0-4ee3-bb2c-5e9a6ded3eb6 req-e590457e-63ec-4dac-af6b-7343a32afee5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:57.520165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-041a5191-c8f0-4ee3-bb2c-5e9a6ded3eb6 req-e590457e-63ec-4dac-af6b-7343a32afee5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:57.572747 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-041a5191-c8f0-4ee3-bb2c-5e9a6ded3eb6 req-e590457e-63ec-4dac-af6b-7343a32afee5 service nova] Creating event network-changed:0956417c-fbac-420c-8610-6825b3468c52 for instance ecbd9cec-fdea-45b2-bb96-487bdaf97635 on nch2-master-1 Sep 17 21:12:57.591903 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-041a5191-c8f0-4ee3-bb2c-5e9a6ded3eb6 req-e590457e-63ec-4dac-af6b-7343a32afee5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104969 Sep 17 21:12:57.598613 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2409/4922] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:12:58.089306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b9e0d7e0-b7c4-4329-aa9e-236e645f8262 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:58.090294 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b9e0d7e0-b7c4-4329-aa9e-236e645f8262 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:58.101153 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9e0d7e0-b7c4-4329-aa9e-236e645f8262 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:58.102084 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9e0d7e0-b7c4-4329-aa9e-236e645f8262 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:58.104109 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9e0d7e0-b7c4-4329-aa9e-236e645f8262 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:58.105180 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9e0d7e0-b7c4-4329-aa9e-236e645f8262 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:58.108500 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9e0d7e0-b7c4-4329-aa9e-236e645f8262 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:58.109226 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9e0d7e0-b7c4-4329-aa9e-236e645f8262 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:58.738457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b9e0d7e0-b7c4-4329-aa9e-236e645f8262 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:12:58.749603 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b9e0d7e0-b7c4-4329-aa9e-236e645f8262 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1510 microversion: 2.1 time: 0.664771 Sep 17 21:12:58.750866 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2514/4923] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:58 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1510 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:12:59.778140 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b59c2414-e80a-4f47-b739-2b11b88f644d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:12:59.779815 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b59c2414-e80a-4f47-b739-2b11b88f644d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:12:59.790184 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b59c2414-e80a-4f47-b739-2b11b88f644d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:59.790975 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b59c2414-e80a-4f47-b739-2b11b88f644d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:59.791656 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b59c2414-e80a-4f47-b739-2b11b88f644d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:12:59.793308 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b59c2414-e80a-4f47-b739-2b11b88f644d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:12:59.794015 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b59c2414-e80a-4f47-b739-2b11b88f644d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:12:59.794710 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b59c2414-e80a-4f47-b739-2b11b88f644d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:00.069909 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b59c2414-e80a-4f47-b739-2b11b88f644d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:00.081889 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b59c2414-e80a-4f47-b739-2b11b88f644d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1510 microversion: 2.1 time: 0.310276 Sep 17 21:13:00.084678 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2410/4924] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:12:59 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1510 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:01.107607 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2b7a8b74-7cd9-4e2f-bf9a-46b65aa26d40 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:01.110482 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2b7a8b74-7cd9-4e2f-bf9a-46b65aa26d40 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:01.129958 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b7a8b74-7cd9-4e2f-bf9a-46b65aa26d40 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:01.130472 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b7a8b74-7cd9-4e2f-bf9a-46b65aa26d40 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:01.130915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b7a8b74-7cd9-4e2f-bf9a-46b65aa26d40 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:01.133142 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b7a8b74-7cd9-4e2f-bf9a-46b65aa26d40 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:01.133900 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b7a8b74-7cd9-4e2f-bf9a-46b65aa26d40 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:01.134506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b7a8b74-7cd9-4e2f-bf9a-46b65aa26d40 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:01.309571 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2b7a8b74-7cd9-4e2f-bf9a-46b65aa26d40 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:01.319588 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2b7a8b74-7cd9-4e2f-bf9a-46b65aa26d40 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1510 microversion: 2.1 time: 0.217490 Sep 17 21:13:01.321193 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2515/4925] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:01 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1510 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:02.351179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7ed1fdaa-337c-421b-947a-ef25103d9cb4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:02.352023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7ed1fdaa-337c-421b-947a-ef25103d9cb4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:02.361840 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ed1fdaa-337c-421b-947a-ef25103d9cb4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:02.362547 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ed1fdaa-337c-421b-947a-ef25103d9cb4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:02.362824 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ed1fdaa-337c-421b-947a-ef25103d9cb4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:02.363974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ed1fdaa-337c-421b-947a-ef25103d9cb4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:02.365166 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ed1fdaa-337c-421b-947a-ef25103d9cb4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:02.365821 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ed1fdaa-337c-421b-947a-ef25103d9cb4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:02.659789 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7ed1fdaa-337c-421b-947a-ef25103d9cb4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:02.690210 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7ed1fdaa-337c-421b-947a-ef25103d9cb4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1510 microversion: 2.1 time: 0.338872 Sep 17 21:13:02.707480 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2411/4926] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:02 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1510 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:03.744369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6ee7283d-311a-445d-8627-cafb3560d419 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:03.745698 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6ee7283d-311a-445d-8627-cafb3560d419 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:03.754161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:13:03.756944 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ee7283d-311a-445d-8627-cafb3560d419 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:03.757757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ee7283d-311a-445d-8627-cafb3560d419 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:03.758651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ee7283d-311a-445d-8627-cafb3560d419 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:03.759671 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ee7283d-311a-445d-8627-cafb3560d419 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:03.760866 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ee7283d-311a-445d-8627-cafb3560d419 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:03.761678 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ee7283d-311a-445d-8627-cafb3560d419 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:04.135754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6ee7283d-311a-445d-8627-cafb3560d419 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:04.146462 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6ee7283d-311a-445d-8627-cafb3560d419 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1510 microversion: 2.1 time: 0.408802 Sep 17 21:13:04.163786 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2516/4927] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:03 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1510 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:04.655890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ded1dcfd-1ab1-459f-8bb9-b0770d3308c9 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1255911440", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:13:04.726995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-ded1dcfd-1ab1-459f-8bb9-b0770d3308c9 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] validate_networks() for [('1fb95ae4-adb5-4d86-81a3-7ea7f2bd9b93', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:13:05.180409 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9154ef4f-3a7c-4551-95a3-f20903587c9f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:05.185224 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9154ef4f-3a7c-4551-95a3-f20903587c9f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:05.223537 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9154ef4f-3a7c-4551-95a3-f20903587c9f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:05.224087 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9154ef4f-3a7c-4551-95a3-f20903587c9f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:05.224548 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9154ef4f-3a7c-4551-95a3-f20903587c9f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:05.225325 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9154ef4f-3a7c-4551-95a3-f20903587c9f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:05.225831 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9154ef4f-3a7c-4551-95a3-f20903587c9f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:05.226264 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9154ef4f-3a7c-4551-95a3-f20903587c9f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:05.421120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-ded1dcfd-1ab1-459f-8bb9-b0770d3308c9 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:13:05.421847 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-ded1dcfd-1ab1-459f-8bb9-b0770d3308c9 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:13:05.422619 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-ded1dcfd-1ab1-459f-8bb9-b0770d3308c9 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:13:05.423272 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-ded1dcfd-1ab1-459f-8bb9-b0770d3308c9 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:13:05.424125 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-ded1dcfd-1ab1-459f-8bb9-b0770d3308c9 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:13:05.434364 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ded1dcfd-1ab1-459f-8bb9-b0770d3308c9 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:05.435223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ded1dcfd-1ab1-459f-8bb9-b0770d3308c9 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:05.436054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ded1dcfd-1ab1-459f-8bb9-b0770d3308c9 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:05.437270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ded1dcfd-1ab1-459f-8bb9-b0770d3308c9 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:05.437904 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ded1dcfd-1ab1-459f-8bb9-b0770d3308c9 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:05.439419 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ded1dcfd-1ab1-459f-8bb9-b0770d3308c9 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:05.463525 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-ded1dcfd-1ab1-459f-8bb9-b0770d3308c9 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Getting quotas for project ee1481a8ca9c4dd590cd6c7c53179df8. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:13:05.469771 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9154ef4f-3a7c-4551-95a3-f20903587c9f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:05.470816 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-ded1dcfd-1ab1-459f-8bb9-b0770d3308c9 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Getting quotas for user 2db8955202fe42d2a4c86a15b193787f and project ee1481a8ca9c4dd590cd6c7c53179df8. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:13:05.472574 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:13:05.484035 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9154ef4f-3a7c-4551-95a3-f20903587c9f tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1510 microversion: 2.1 time: 0.310645 Sep 17 21:13:05.485230 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2517/4928] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:05 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1510 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:05.489284 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ded1dcfd-1ab1-459f-8bb9-b0770d3308c9 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:13:05.492419 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ded1dcfd-1ab1-459f-8bb9-b0770d3308c9 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:13:05.506343 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:13:05.556795 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ded1dcfd-1ab1-459f-8bb9-b0770d3308c9 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.259500 Sep 17 21:13:05.558775 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2412/4929] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:13:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 1262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:13:05.570017 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6213534c-d506-49d6-969b-411a71d42a59 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:05.570831 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6213534c-d506-49d6-969b-411a71d42a59 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:05.658593 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6213534c-d506-49d6-969b-411a71d42a59 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:05.669694 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6213534c-d506-49d6-969b-411a71d42a59 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1223 microversion: 2.1 time: 0.104316 Sep 17 21:13:05.670778 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2518/4930] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:05 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1223 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:06.510252 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6b3f51d1-4279-4a51-939c-81eb23e45484 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:06.511081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6b3f51d1-4279-4a51-939c-81eb23e45484 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:06.525786 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6b3f51d1-4279-4a51-939c-81eb23e45484 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:06.526807 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6b3f51d1-4279-4a51-939c-81eb23e45484 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:06.530276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6b3f51d1-4279-4a51-939c-81eb23e45484 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:06.531035 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6b3f51d1-4279-4a51-939c-81eb23e45484 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:06.531515 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6b3f51d1-4279-4a51-939c-81eb23e45484 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:06.531956 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6b3f51d1-4279-4a51-939c-81eb23e45484 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:06.695178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3a8a5ed8-0709-4a31-9cce-f8a199b845c2 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:06.696240 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3a8a5ed8-0709-4a31-9cce-f8a199b845c2 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:06.708040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a8a5ed8-0709-4a31-9cce-f8a199b845c2 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:06.711022 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a8a5ed8-0709-4a31-9cce-f8a199b845c2 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:06.711497 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a8a5ed8-0709-4a31-9cce-f8a199b845c2 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:06.712260 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a8a5ed8-0709-4a31-9cce-f8a199b845c2 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:06.716979 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a8a5ed8-0709-4a31-9cce-f8a199b845c2 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:06.717447 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a8a5ed8-0709-4a31-9cce-f8a199b845c2 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:06.739149 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6b3f51d1-4279-4a51-939c-81eb23e45484 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:06.749652 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6b3f51d1-4279-4a51-939c-81eb23e45484 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1510 microversion: 2.1 time: 0.245094 Sep 17 21:13:06.750511 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2413/4931] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:06 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1510 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:06.826676 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3a8a5ed8-0709-4a31-9cce-f8a199b845c2 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:06.839418 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3a8a5ed8-0709-4a31-9cce-f8a199b845c2 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1275 microversion: 2.1 time: 0.148648 Sep 17 21:13:06.840865 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2519/4932] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:06 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1275 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:13:07.775863 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e2da6f21-9d8e-4ca1-9a9c-1f890969ad75 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:07.777299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e2da6f21-9d8e-4ca1-9a9c-1f890969ad75 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:07.790007 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2da6f21-9d8e-4ca1-9a9c-1f890969ad75 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:07.790724 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2da6f21-9d8e-4ca1-9a9c-1f890969ad75 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:07.791519 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2da6f21-9d8e-4ca1-9a9c-1f890969ad75 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:07.792435 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2da6f21-9d8e-4ca1-9a9c-1f890969ad75 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:07.793045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2da6f21-9d8e-4ca1-9a9c-1f890969ad75 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:07.793664 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2da6f21-9d8e-4ca1-9a9c-1f890969ad75 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:07.865200 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-57eab6a4-7935-4251-90e6-460cdcce8b52 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:07.865929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-57eab6a4-7935-4251-90e6-460cdcce8b52 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:07.882968 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57eab6a4-7935-4251-90e6-460cdcce8b52 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:07.883727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57eab6a4-7935-4251-90e6-460cdcce8b52 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:07.885280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57eab6a4-7935-4251-90e6-460cdcce8b52 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:07.887793 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57eab6a4-7935-4251-90e6-460cdcce8b52 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:07.888357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57eab6a4-7935-4251-90e6-460cdcce8b52 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:07.890277 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57eab6a4-7935-4251-90e6-460cdcce8b52 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:08.080817 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-57eab6a4-7935-4251-90e6-460cdcce8b52 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:08.094448 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-57eab6a4-7935-4251-90e6-460cdcce8b52 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1281 microversion: 2.1 time: 0.233593 Sep 17 21:13:08.095088 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2520/4933] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:07 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1281 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:08.209273 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e2da6f21-9d8e-4ca1-9a9c-1f890969ad75 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:08.224952 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e2da6f21-9d8e-4ca1-9a9c-1f890969ad75 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1510 microversion: 2.1 time: 0.451889 Sep 17 21:13:08.227727 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2414/4934] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:07 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1510 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:09.120522 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a651a8a4-95ec-4cfd-b54d-c32408cf7e60 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:09.121375 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a651a8a4-95ec-4cfd-b54d-c32408cf7e60 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:09.132016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a651a8a4-95ec-4cfd-b54d-c32408cf7e60 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:09.132750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a651a8a4-95ec-4cfd-b54d-c32408cf7e60 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:09.133916 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a651a8a4-95ec-4cfd-b54d-c32408cf7e60 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:09.135138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a651a8a4-95ec-4cfd-b54d-c32408cf7e60 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:09.135834 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a651a8a4-95ec-4cfd-b54d-c32408cf7e60 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:09.136664 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a651a8a4-95ec-4cfd-b54d-c32408cf7e60 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:09.252604 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e155cbd4-0618-4205-91fa-4307b75f0c62 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:09.253607 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e155cbd4-0618-4205-91fa-4307b75f0c62 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:09.261887 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e155cbd4-0618-4205-91fa-4307b75f0c62 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:09.262653 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e155cbd4-0618-4205-91fa-4307b75f0c62 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:09.263172 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e155cbd4-0618-4205-91fa-4307b75f0c62 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:09.264154 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e155cbd4-0618-4205-91fa-4307b75f0c62 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:09.264683 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e155cbd4-0618-4205-91fa-4307b75f0c62 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:09.265298 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e155cbd4-0618-4205-91fa-4307b75f0c62 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:09.433825 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a651a8a4-95ec-4cfd-b54d-c32408cf7e60 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:09.451822 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a651a8a4-95ec-4cfd-b54d-c32408cf7e60 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1323 microversion: 2.1 time: 0.336769 Sep 17 21:13:09.452807 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2521/4935] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:09 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1323 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:13:09.555876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e155cbd4-0618-4205-91fa-4307b75f0c62 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:09.570696 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e155cbd4-0618-4205-91fa-4307b75f0c62 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1510 microversion: 2.1 time: 0.321857 Sep 17 21:13:09.571804 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2415/4936] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:09 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1510 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:13:09.596634 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-a8e710b9-60e7-4723-b5c3-9b8e84edf50b req-f24c29e2-288e-4f44-8505-ae4b8c8b245e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c45f5fe-2176-44d4-a8b5-972d6b92d53c", "tag": "64dac991-3106-4bed-aa53-9b65aedc4b13"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:13:09.614159 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a8e710b9-60e7-4723-b5c3-9b8e84edf50b req-f24c29e2-288e-4f44-8505-ae4b8c8b245e service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:09.614664 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a8e710b9-60e7-4723-b5c3-9b8e84edf50b req-f24c29e2-288e-4f44-8505-ae4b8c8b245e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:09.615111 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a8e710b9-60e7-4723-b5c3-9b8e84edf50b req-f24c29e2-288e-4f44-8505-ae4b8c8b245e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:09.631123 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-a8e710b9-60e7-4723-b5c3-9b8e84edf50b req-f24c29e2-288e-4f44-8505-ae4b8c8b245e service nova] Creating event network-changed:64dac991-3106-4bed-aa53-9b65aedc4b13 for instance 6c45f5fe-2176-44d4-a8b5-972d6b92d53c on nch1-master-1 Sep 17 21:13:09.636904 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-a8e710b9-60e7-4723-b5c3-9b8e84edf50b req-f24c29e2-288e-4f44-8505-ae4b8c8b245e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044167 Sep 17 21:13:09.638393 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2522/4937] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:13:10.476496 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-333a7480-2aa7-458a-9039-7095e74924ae tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:10.477115 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-333a7480-2aa7-458a-9039-7095e74924ae tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:10.486480 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-333a7480-2aa7-458a-9039-7095e74924ae tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:10.487085 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-333a7480-2aa7-458a-9039-7095e74924ae tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:10.487472 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-333a7480-2aa7-458a-9039-7095e74924ae tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:10.488240 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-333a7480-2aa7-458a-9039-7095e74924ae tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:10.494724 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-333a7480-2aa7-458a-9039-7095e74924ae tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:10.495640 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-333a7480-2aa7-458a-9039-7095e74924ae tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:10.597595 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b645f78b-efa0-4c2b-b16a-5f4123fa22ef tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:10.599395 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b645f78b-efa0-4c2b-b16a-5f4123fa22ef tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:10.617590 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b645f78b-efa0-4c2b-b16a-5f4123fa22ef tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:10.618154 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b645f78b-efa0-4c2b-b16a-5f4123fa22ef tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:10.619773 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b645f78b-efa0-4c2b-b16a-5f4123fa22ef tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:10.620616 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b645f78b-efa0-4c2b-b16a-5f4123fa22ef tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:10.621395 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b645f78b-efa0-4c2b-b16a-5f4123fa22ef tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:10.621933 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b645f78b-efa0-4c2b-b16a-5f4123fa22ef tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:10.735136 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-333a7480-2aa7-458a-9039-7095e74924ae tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:10.751785 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-333a7480-2aa7-458a-9039-7095e74924ae tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1323 microversion: 2.1 time: 0.279371 Sep 17 21:13:10.752456 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2416/4938] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:10 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1323 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:10.845865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b645f78b-efa0-4c2b-b16a-5f4123fa22ef tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:10.854824 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b645f78b-efa0-4c2b-b16a-5f4123fa22ef tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1510 microversion: 2.1 time: 0.262085 Sep 17 21:13:10.855538 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2523/4939] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:10 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1510 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:11.775554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-314b3788-30be-41c3-b820-4598695816e1 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:11.776276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-314b3788-30be-41c3-b820-4598695816e1 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:11.796056 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-314b3788-30be-41c3-b820-4598695816e1 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:11.796925 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-314b3788-30be-41c3-b820-4598695816e1 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:11.797661 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-314b3788-30be-41c3-b820-4598695816e1 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:11.799492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-314b3788-30be-41c3-b820-4598695816e1 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:11.800266 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-314b3788-30be-41c3-b820-4598695816e1 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:11.800985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-314b3788-30be-41c3-b820-4598695816e1 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:11.879096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-68de0292-e0b2-458c-9a9d-4e69269411cb tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:11.880440 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-68de0292-e0b2-458c-9a9d-4e69269411cb tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:11.889958 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68de0292-e0b2-458c-9a9d-4e69269411cb tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:11.893783 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68de0292-e0b2-458c-9a9d-4e69269411cb tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:11.894974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68de0292-e0b2-458c-9a9d-4e69269411cb tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:11.897078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68de0292-e0b2-458c-9a9d-4e69269411cb tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:11.898249 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68de0292-e0b2-458c-9a9d-4e69269411cb tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:11.900996 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68de0292-e0b2-458c-9a9d-4e69269411cb tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:12.199520 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-314b3788-30be-41c3-b820-4598695816e1 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:12.213509 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-314b3788-30be-41c3-b820-4598695816e1 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1323 microversion: 2.1 time: 0.441900 Sep 17 21:13:12.214176 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2417/4940] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:11 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1323 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:12.284153 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-68de0292-e0b2-458c-9a9d-4e69269411cb tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:12.292701 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-68de0292-e0b2-458c-9a9d-4e69269411cb tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1510 microversion: 2.1 time: 0.417573 Sep 17 21:13:12.293351 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2524/4941] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:11 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1510 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:13:13.238042 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-49744911-c02f-4677-9ee3-764e9d9fef14 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:13.238816 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-49744911-c02f-4677-9ee3-764e9d9fef14 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:13.249212 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49744911-c02f-4677-9ee3-764e9d9fef14 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:13.250005 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49744911-c02f-4677-9ee3-764e9d9fef14 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:13.250527 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49744911-c02f-4677-9ee3-764e9d9fef14 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:13.251322 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49744911-c02f-4677-9ee3-764e9d9fef14 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:13.251980 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49744911-c02f-4677-9ee3-764e9d9fef14 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:13.252517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49744911-c02f-4677-9ee3-764e9d9fef14 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:13.322997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4645b31e-8d37-4843-9e48-e47d61d5aaa5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:13.324302 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4645b31e-8d37-4843-9e48-e47d61d5aaa5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:13.339907 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4645b31e-8d37-4843-9e48-e47d61d5aaa5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:13.340843 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4645b31e-8d37-4843-9e48-e47d61d5aaa5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:13.343183 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4645b31e-8d37-4843-9e48-e47d61d5aaa5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:13.349942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4645b31e-8d37-4843-9e48-e47d61d5aaa5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:13.350896 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4645b31e-8d37-4843-9e48-e47d61d5aaa5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:13.351546 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4645b31e-8d37-4843-9e48-e47d61d5aaa5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:13.579688 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-49744911-c02f-4677-9ee3-764e9d9fef14 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:13.597448 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-49744911-c02f-4677-9ee3-764e9d9fef14 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1323 microversion: 2.1 time: 0.363583 Sep 17 21:13:13.598989 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2418/4942] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:13 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1323 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:13.645412 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4645b31e-8d37-4843-9e48-e47d61d5aaa5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:13.655523 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4645b31e-8d37-4843-9e48-e47d61d5aaa5 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1510 microversion: 2.1 time: 0.338264 Sep 17 21:13:13.672977 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2525/4943] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:13 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1510 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:13:14.623950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-deff35b7-1d5c-4695-b0cc-8ad0e3228282 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:14.625265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-deff35b7-1d5c-4695-b0cc-8ad0e3228282 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:14.634597 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-deff35b7-1d5c-4695-b0cc-8ad0e3228282 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:14.635562 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-deff35b7-1d5c-4695-b0cc-8ad0e3228282 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:14.636528 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-deff35b7-1d5c-4695-b0cc-8ad0e3228282 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:14.638087 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-deff35b7-1d5c-4695-b0cc-8ad0e3228282 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:14.638729 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-deff35b7-1d5c-4695-b0cc-8ad0e3228282 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:14.639340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-deff35b7-1d5c-4695-b0cc-8ad0e3228282 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:14.681122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b019724f-553d-418e-be72-1a2a0b75263d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:14.682537 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b019724f-553d-418e-be72-1a2a0b75263d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:14.693147 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b019724f-553d-418e-be72-1a2a0b75263d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:14.693902 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b019724f-553d-418e-be72-1a2a0b75263d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:14.694955 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b019724f-553d-418e-be72-1a2a0b75263d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:14.697994 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b019724f-553d-418e-be72-1a2a0b75263d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:14.699793 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b019724f-553d-418e-be72-1a2a0b75263d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:14.701831 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b019724f-553d-418e-be72-1a2a0b75263d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:14.962485 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-deff35b7-1d5c-4695-b0cc-8ad0e3228282 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:14.972635 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-deff35b7-1d5c-4695-b0cc-8ad0e3228282 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1323 microversion: 2.1 time: 0.353709 Sep 17 21:13:14.975453 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2419/4944] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:14 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1323 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:13:15.037120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b019724f-553d-418e-be72-1a2a0b75263d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:15.047365 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b019724f-553d-418e-be72-1a2a0b75263d tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1510 microversion: 2.1 time: 0.371259 Sep 17 21:13:15.048004 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2526/4945] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:14 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1510 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:13:16.001322 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cd683e5b-85a1-448f-aa3d-07c3f6c2b0fd tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:16.002773 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cd683e5b-85a1-448f-aa3d-07c3f6c2b0fd tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:16.012791 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:13:16.014577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:13:16.019259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd683e5b-85a1-448f-aa3d-07c3f6c2b0fd tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:16.020003 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd683e5b-85a1-448f-aa3d-07c3f6c2b0fd tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:16.021602 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd683e5b-85a1-448f-aa3d-07c3f6c2b0fd tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:16.022687 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd683e5b-85a1-448f-aa3d-07c3f6c2b0fd tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:16.023355 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd683e5b-85a1-448f-aa3d-07c3f6c2b0fd tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:16.024232 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd683e5b-85a1-448f-aa3d-07c3f6c2b0fd tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:16.073406 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7ad9d7fa-6733-4e40-8567-7de773de09e7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:16.074738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7ad9d7fa-6733-4e40-8567-7de773de09e7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:16.082687 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:13:16.085141 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7ad9d7fa-6733-4e40-8567-7de773de09e7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:16.085878 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7ad9d7fa-6733-4e40-8567-7de773de09e7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:16.086595 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7ad9d7fa-6733-4e40-8567-7de773de09e7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:16.087530 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7ad9d7fa-6733-4e40-8567-7de773de09e7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:16.088263 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7ad9d7fa-6733-4e40-8567-7de773de09e7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:16.088973 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7ad9d7fa-6733-4e40-8567-7de773de09e7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:16.581230 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cd683e5b-85a1-448f-aa3d-07c3f6c2b0fd tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:16.601635 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cd683e5b-85a1-448f-aa3d-07c3f6c2b0fd tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1323 microversion: 2.1 time: 0.607455 Sep 17 21:13:16.602286 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2420/4946] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:15 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1323 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:16.662712 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7ad9d7fa-6733-4e40-8567-7de773de09e7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:16.683198 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-7a0da370-76bc-40dc-9318-3ed02a132f62 req-52801961-5d1f-4edd-b951-370a83b331e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c45f5fe-2176-44d4-a8b5-972d6b92d53c", "name": "network-vif-plugged", "status": "completed", "tag": "64dac991-3106-4bed-aa53-9b65aedc4b13"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:13:16.687662 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7ad9d7fa-6733-4e40-8567-7de773de09e7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1487 microversion: 2.1 time: 0.617946 Sep 17 21:13:16.703467 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-7a0da370-76bc-40dc-9318-3ed02a132f62 req-52801961-5d1f-4edd-b951-370a83b331e5 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:16.705856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-7a0da370-76bc-40dc-9318-3ed02a132f62 req-52801961-5d1f-4edd-b951-370a83b331e5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:16.706518 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-7a0da370-76bc-40dc-9318-3ed02a132f62 req-52801961-5d1f-4edd-b951-370a83b331e5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:16.708312 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2527/4947] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:16 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1487 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:16.736428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-13354981-be17-4e70-9b1d-0bc9184bd054 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-719088550"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:13:16.764954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-13354981-be17-4e70-9b1d-0bc9184bd054 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:16.792842 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-13354981-be17-4e70-9b1d-0bc9184bd054 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:16.794949 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-13354981-be17-4e70-9b1d-0bc9184bd054 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:16.795252 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-7a0da370-76bc-40dc-9318-3ed02a132f62 req-52801961-5d1f-4edd-b951-370a83b331e5 service nova] Creating event network-vif-plugged:64dac991-3106-4bed-aa53-9b65aedc4b13 for instance 6c45f5fe-2176-44d4-a8b5-972d6b92d53c on nch1-master-1 Sep 17 21:13:16.799166 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-13354981-be17-4e70-9b1d-0bc9184bd054 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:16.801045 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-13354981-be17-4e70-9b1d-0bc9184bd054 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:16.801802 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-13354981-be17-4e70-9b1d-0bc9184bd054 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:16.802433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-13354981-be17-4e70-9b1d-0bc9184bd054 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:16.809665 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-7a0da370-76bc-40dc-9318-3ed02a132f62 req-52801961-5d1f-4edd-b951-370a83b331e5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131114 Sep 17 21:13:16.810866 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2421/4948] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:13:16.918445 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-13354981-be17-4e70-9b1d-0bc9184bd054 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "PUT /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1060 microversion: 2.1 time: 0.186597 Sep 17 21:13:16.921653 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2528/4949] 10.222.0.26 () {60 vars in 1256 bytes} [Sat Sep 17 21:13:16 2022] PUT /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1060 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:16.947492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-752451fa-d9af-498e-8326-2012a6ed1894 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:16.948290 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-752451fa-d9af-498e-8326-2012a6ed1894 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:16.958501 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-752451fa-d9af-498e-8326-2012a6ed1894 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:16.959004 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-752451fa-d9af-498e-8326-2012a6ed1894 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:16.959451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-752451fa-d9af-498e-8326-2012a6ed1894 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:16.960171 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-752451fa-d9af-498e-8326-2012a6ed1894 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:16.960634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-752451fa-d9af-498e-8326-2012a6ed1894 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:16.961101 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-752451fa-d9af-498e-8326-2012a6ed1894 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:17.333121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-752451fa-d9af-498e-8326-2012a6ed1894 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:17.349933 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-752451fa-d9af-498e-8326-2012a6ed1894 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1487 microversion: 2.1 time: 0.406521 Sep 17 21:13:17.351380 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2422/4950] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:16 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1487 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:17.375265 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bdf093fc-56f3-4d72-a405-ec59a6f9e8e2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:17.376728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bdf093fc-56f3-4d72-a405-ec59a6f9e8e2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:17.391262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bdf093fc-56f3-4d72-a405-ec59a6f9e8e2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:17.391969 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bdf093fc-56f3-4d72-a405-ec59a6f9e8e2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:17.392768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bdf093fc-56f3-4d72-a405-ec59a6f9e8e2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:17.393953 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bdf093fc-56f3-4d72-a405-ec59a6f9e8e2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:17.394982 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bdf093fc-56f3-4d72-a405-ec59a6f9e8e2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:17.400309 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bdf093fc-56f3-4d72-a405-ec59a6f9e8e2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:17.628824 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-df71baf1-e230-4372-8fca-a0a0d2dde5fd tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:17.629448 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-df71baf1-e230-4372-8fca-a0a0d2dde5fd tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:17.644151 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df71baf1-e230-4372-8fca-a0a0d2dde5fd tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:17.646728 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df71baf1-e230-4372-8fca-a0a0d2dde5fd tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:17.647188 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df71baf1-e230-4372-8fca-a0a0d2dde5fd tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:17.647928 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df71baf1-e230-4372-8fca-a0a0d2dde5fd tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:17.651872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df71baf1-e230-4372-8fca-a0a0d2dde5fd tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:17.652998 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df71baf1-e230-4372-8fca-a0a0d2dde5fd tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:17.700505 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bdf093fc-56f3-4d72-a405-ec59a6f9e8e2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:17.719556 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bdf093fc-56f3-4d72-a405-ec59a6f9e8e2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1487 microversion: 2.1 time: 0.345492 Sep 17 21:13:17.720715 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2529/4951] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:17 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1487 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:17.751767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fa145efe-7216-41d2-85d1-03ce54e5ed17 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:17.752405 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fa145efe-7216-41d2-85d1-03ce54e5ed17 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:17.766914 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa145efe-7216-41d2-85d1-03ce54e5ed17 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:17.768727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa145efe-7216-41d2-85d1-03ce54e5ed17 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:17.769188 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa145efe-7216-41d2-85d1-03ce54e5ed17 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:17.774748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa145efe-7216-41d2-85d1-03ce54e5ed17 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:17.774748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa145efe-7216-41d2-85d1-03ce54e5ed17 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:17.774748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa145efe-7216-41d2-85d1-03ce54e5ed17 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:17.869074 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fa145efe-7216-41d2-85d1-03ce54e5ed17 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:13:18.057969 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fa145efe-7216-41d2-85d1-03ce54e5ed17 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 204 len: 0 microversion: 2.1 time: 0.316792 Sep 17 21:13:18.059907 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2530/4952] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:13:17 2022] DELETE /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:13:18.068007 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3aafc3eb-ca9b-48e1-b170-0186f7496e52 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:18.068939 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3aafc3eb-ca9b-48e1-b170-0186f7496e52 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:18.075501 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3aafc3eb-ca9b-48e1-b170-0186f7496e52 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:18.076234 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3aafc3eb-ca9b-48e1-b170-0186f7496e52 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:18.076865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3aafc3eb-ca9b-48e1-b170-0186f7496e52 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:18.077778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3aafc3eb-ca9b-48e1-b170-0186f7496e52 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:18.078715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3aafc3eb-ca9b-48e1-b170-0186f7496e52 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:18.080768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3aafc3eb-ca9b-48e1-b170-0186f7496e52 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:18.127170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-df71baf1-e230-4372-8fca-a0a0d2dde5fd tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:18.140123 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-df71baf1-e230-4372-8fca-a0a0d2dde5fd tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1323 microversion: 2.1 time: 0.512230 Sep 17 21:13:18.141254 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2423/4953] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:17 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1323 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:18.354725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3aafc3eb-ca9b-48e1-b170-0186f7496e52 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:18.367035 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3aafc3eb-ca9b-48e1-b170-0186f7496e52 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1493 microversion: 2.1 time: 0.303093 Sep 17 21:13:18.369479 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2531/4954] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:18 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1493 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:19.164239 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-02a883ab-d6b0-4625-aab9-5bd273ef14b3 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:19.165017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-02a883ab-d6b0-4625-aab9-5bd273ef14b3 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:19.178503 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02a883ab-d6b0-4625-aab9-5bd273ef14b3 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:19.180434 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02a883ab-d6b0-4625-aab9-5bd273ef14b3 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:19.182635 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02a883ab-d6b0-4625-aab9-5bd273ef14b3 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:19.183821 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02a883ab-d6b0-4625-aab9-5bd273ef14b3 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:19.185889 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02a883ab-d6b0-4625-aab9-5bd273ef14b3 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:19.187442 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02a883ab-d6b0-4625-aab9-5bd273ef14b3 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:19.397047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e67c672f-90fc-48eb-ac05-8f198f9e16b4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:19.398226 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e67c672f-90fc-48eb-ac05-8f198f9e16b4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:19.409091 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e67c672f-90fc-48eb-ac05-8f198f9e16b4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:19.411447 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e67c672f-90fc-48eb-ac05-8f198f9e16b4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:19.412016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e67c672f-90fc-48eb-ac05-8f198f9e16b4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:19.413214 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e67c672f-90fc-48eb-ac05-8f198f9e16b4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:19.413774 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e67c672f-90fc-48eb-ac05-8f198f9e16b4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:19.414635 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e67c672f-90fc-48eb-ac05-8f198f9e16b4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:19.573324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-02a883ab-d6b0-4625-aab9-5bd273ef14b3 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:19.583251 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:13:19.587413 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-02a883ab-d6b0-4625-aab9-5bd273ef14b3 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1323 microversion: 2.1 time: 0.427712 Sep 17 21:13:19.602910 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2424/4955] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:19 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1323 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:19.751092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e67c672f-90fc-48eb-ac05-8f198f9e16b4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:19.763693 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e67c672f-90fc-48eb-ac05-8f198f9e16b4 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1493 microversion: 2.1 time: 0.370406 Sep 17 21:13:19.764605 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2532/4956] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:19 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1493 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:13:20.348876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-d32ba77e-6a81-4bad-a61c-1e20f5cf59ab req-b4bf5d38-46f3-41df-92ff-e6a5930e2606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25", "name": "network-vif-deleted", "tag": "42984aab-4bb2-4035-a5e9-3d96a81be113"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:13:20.414090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d32ba77e-6a81-4bad-a61c-1e20f5cf59ab req-b4bf5d38-46f3-41df-92ff-e6a5930e2606 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:20.414878 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d32ba77e-6a81-4bad-a61c-1e20f5cf59ab req-b4bf5d38-46f3-41df-92ff-e6a5930e2606 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:20.415482 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d32ba77e-6a81-4bad-a61c-1e20f5cf59ab req-b4bf5d38-46f3-41df-92ff-e6a5930e2606 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:20.430970 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-d32ba77e-6a81-4bad-a61c-1e20f5cf59ab req-b4bf5d38-46f3-41df-92ff-e6a5930e2606 service nova] Creating event network-vif-deleted:42984aab-4bb2-4035-a5e9-3d96a81be113 for instance 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 on nch1-master-1 Sep 17 21:13:20.437113 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-d32ba77e-6a81-4bad-a61c-1e20f5cf59ab req-b4bf5d38-46f3-41df-92ff-e6a5930e2606 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093375 Sep 17 21:13:20.439092 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2425/4957] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:13:20.612767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2c06f3a9-339b-4ad4-a072-bb3a87c8a335 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:20.614353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2c06f3a9-339b-4ad4-a072-bb3a87c8a335 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:20.624145 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c06f3a9-339b-4ad4-a072-bb3a87c8a335 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:20.625062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c06f3a9-339b-4ad4-a072-bb3a87c8a335 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:20.626061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c06f3a9-339b-4ad4-a072-bb3a87c8a335 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:20.627430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c06f3a9-339b-4ad4-a072-bb3a87c8a335 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:20.628153 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c06f3a9-339b-4ad4-a072-bb3a87c8a335 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:20.628810 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c06f3a9-339b-4ad4-a072-bb3a87c8a335 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:20.778407 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2c06f3a9-339b-4ad4-a072-bb3a87c8a335 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:20.783043 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:13:20.788254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-91e97656-0f60-4c8d-a6b3-39a2e25add88 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:20.788905 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-91e97656-0f60-4c8d-a6b3-39a2e25add88 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:20.790447 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2c06f3a9-339b-4ad4-a072-bb3a87c8a335 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1517 microversion: 2.1 time: 0.184333 Sep 17 21:13:20.791041 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2533/4958] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:20 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1517 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:13:20.796901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-91e97656-0f60-4c8d-a6b3-39a2e25add88 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:20.797403 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-91e97656-0f60-4c8d-a6b3-39a2e25add88 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:20.797885 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-91e97656-0f60-4c8d-a6b3-39a2e25add88 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:20.798602 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-91e97656-0f60-4c8d-a6b3-39a2e25add88 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:20.799090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-91e97656-0f60-4c8d-a6b3-39a2e25add88 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:20.799525 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-91e97656-0f60-4c8d-a6b3-39a2e25add88 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:20.819747 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-405a1694-0084-4d0a-97fc-95661c787eff tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:13:20.826256 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-405a1694-0084-4d0a-97fc-95661c787eff tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:20.837097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-405a1694-0084-4d0a-97fc-95661c787eff tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:20.838042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-405a1694-0084-4d0a-97fc-95661c787eff tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:20.839012 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-405a1694-0084-4d0a-97fc-95661c787eff tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:20.839929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-91e97656-0f60-4c8d-a6b3-39a2e25add88 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:20.840427 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-91e97656-0f60-4c8d-a6b3-39a2e25add88 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:20.840767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-405a1694-0084-4d0a-97fc-95661c787eff tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:20.840888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-91e97656-0f60-4c8d-a6b3-39a2e25add88 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:20.841313 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-91e97656-0f60-4c8d-a6b3-39a2e25add88 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lazy-loading 'fault' on Instance uuid 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:13:20.842149 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-405a1694-0084-4d0a-97fc-95661c787eff tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:20.843635 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-405a1694-0084-4d0a-97fc-95661c787eff tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:20.887055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-405a1694-0084-4d0a-97fc-95661c787eff tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lazy-loading 'flavor' on Instance uuid 6c45f5fe-2176-44d4-a8b5-972d6b92d53c {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:13:20.918223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-91e97656-0f60-4c8d-a6b3-39a2e25add88 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:20.942338 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-91e97656-0f60-4c8d-a6b3-39a2e25add88 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 200 len: 1309 microversion: 2.1 time: 0.158533 Sep 17 21:13:20.942997 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2426/4959] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:20 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 1309 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:21.028236 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-405a1694-0084-4d0a-97fc-95661c787eff tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "POST /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c/action" status: 200 len: 32 microversion: 2.1 time: 0.216685 Sep 17 21:13:21.029713 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2534/4960] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:13:20 2022] POST /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c/action => generated 32 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 17 21:13:21.048814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cbbf547c-3899-40e5-be76-e8bf5a5de2e6 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:21.052548 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cbbf547c-3899-40e5-be76-e8bf5a5de2e6 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:21.066018 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbbf547c-3899-40e5-be76-e8bf5a5de2e6 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:21.066787 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbbf547c-3899-40e5-be76-e8bf5a5de2e6 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:21.067471 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbbf547c-3899-40e5-be76-e8bf5a5de2e6 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:21.071482 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbbf547c-3899-40e5-be76-e8bf5a5de2e6 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:21.072772 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbbf547c-3899-40e5-be76-e8bf5a5de2e6 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:21.073803 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbbf547c-3899-40e5-be76-e8bf5a5de2e6 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:21.382743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cbbf547c-3899-40e5-be76-e8bf5a5de2e6 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:21.402805 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cbbf547c-3899-40e5-be76-e8bf5a5de2e6 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1523 microversion: 2.1 time: 0.367506 Sep 17 21:13:21.403407 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2427/4961] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:21 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1523 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:21.967629 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b7417d97-3d36-4234-84ac-799ffb6270c3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:21.968333 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b7417d97-3d36-4234-84ac-799ffb6270c3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:21.975905 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b7417d97-3d36-4234-84ac-799ffb6270c3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:21.976475 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b7417d97-3d36-4234-84ac-799ffb6270c3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:21.977118 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b7417d97-3d36-4234-84ac-799ffb6270c3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:21.978093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b7417d97-3d36-4234-84ac-799ffb6270c3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:21.978742 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b7417d97-3d36-4234-84ac-799ffb6270c3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:21.979386 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b7417d97-3d36-4234-84ac-799ffb6270c3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:21.995646 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-b7417d97-3d36-4234-84ac-799ffb6270c3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] HTTP exception thrown: Instance 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 could not be found. Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b7417d97-3d36-4234-84ac-799ffb6270c3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Request method failure captured: Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 HTTP/1.1 Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjdkx_dUaa7DUi-TKVFHTZsVxQrlexvG4SUZm6N8-RAgW-Hgl4Fm16QKjLB8Smzb7fg0_3Heh2RxRO4DM6alOpTGfM4lDQjx-JBymYUztOAuBANR84PPvzFMKCK9hdlODMbdRT3LVU-maWvSxN-XNtXdSltD2p8By-EmBSmK4dFa6Xo Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersTestJSON-167161476 Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b6f25c3540546bf9bffd5610f4f86c8", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersTestJSON-167161476 Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersTestJSON-167161476 Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersTestJSON-167161476-project Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 784233ee78764e7dbb774d3cb50165e3 Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersTestJSON-167161476-project Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 could not be found. Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25'} Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 could not be found. Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 could not be found. Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:13:21.997642 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.003440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:22.003440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:22.003440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:13:22.003440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:13:22.003440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 could not be found. Sep 17 21:13:22.003440 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.004992 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b7417d97-3d36-4234-84ac-799ffb6270c3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Returning 404 to user: Instance 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:13:22.006123 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b7417d97-3d36-4234-84ac-799ffb6270c3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 404 len: 111 microversion: 2.1 time: 0.043206 Sep 17 21:13:22.006877 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2535/4962] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:21 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 21:13:22.022320 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3fab5b9a-d3ef-4aed-ac51-e5eace45dde7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:22.022989 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3fab5b9a-d3ef-4aed-ac51-e5eace45dde7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:22.030724 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3fab5b9a-d3ef-4aed-ac51-e5eace45dde7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.031225 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3fab5b9a-d3ef-4aed-ac51-e5eace45dde7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.031680 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3fab5b9a-d3ef-4aed-ac51-e5eace45dde7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.032393 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3fab5b9a-d3ef-4aed-ac51-e5eace45dde7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.033077 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3fab5b9a-d3ef-4aed-ac51-e5eace45dde7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.033556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3fab5b9a-d3ef-4aed-ac51-e5eace45dde7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.048799 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-3fab5b9a-d3ef-4aed-ac51-e5eace45dde7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] HTTP exception thrown: Instance 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 could not be found. Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3fab5b9a-d3ef-4aed-ac51-e5eace45dde7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Request method failure captured: Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 HTTP/1.1 Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjdkx_dUaa7DUi-TKVFHTZsVxQrlexvG4SUZm6N8-RAgW-Hgl4Fm16QKjLB8Smzb7fg0_3Heh2RxRO4DM6alOpTGfM4lDQjx-JBymYUztOAuBANR84PPvzFMKCK9hdlODMbdRT3LVU-maWvSxN-XNtXdSltD2p8By-EmBSmK4dFa6Xo Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b6f25c3540546bf9bffd5610f4f86c8", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersTestJSON-167161476-project Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 784233ee78764e7dbb774d3cb50165e3 Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersTestJSON-167161476-project Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 could not be found. Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25'} Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 could not be found. Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:13:22.050537 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 could not be found. Sep 17 21:13:22.054987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.054987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:22.054987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.054987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.054987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:22.054987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:22.054987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:13:22.054987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:13:22.054987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 could not be found. Sep 17 21:13:22.054987 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.054987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3fab5b9a-d3ef-4aed-ac51-e5eace45dde7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Returning 404 to user: Instance 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:13:22.054987 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3fab5b9a-d3ef-4aed-ac51-e5eace45dde7 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 404 len: 111 microversion: 2.1 time: 0.033940 Sep 17 21:13:22.054987 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2428/4963] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:13:22 2022] DELETE /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:13:22.060766 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bf0f5aa4-cfb0-4d65-8ccc-8432b46cfe03 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:22.061393 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bf0f5aa4-cfb0-4d65-8ccc-8432b46cfe03 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:22.068826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf0f5aa4-cfb0-4d65-8ccc-8432b46cfe03 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.069328 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf0f5aa4-cfb0-4d65-8ccc-8432b46cfe03 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.069803 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf0f5aa4-cfb0-4d65-8ccc-8432b46cfe03 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.070512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf0f5aa4-cfb0-4d65-8ccc-8432b46cfe03 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.071140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf0f5aa4-cfb0-4d65-8ccc-8432b46cfe03 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.071735 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf0f5aa4-cfb0-4d65-8ccc-8432b46cfe03 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.088467 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-bf0f5aa4-cfb0-4d65-8ccc-8432b46cfe03 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] HTTP exception thrown: Instance 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 could not be found. Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bf0f5aa4-cfb0-4d65-8ccc-8432b46cfe03 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Request method failure captured: Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 HTTP/1.1 Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjdkx_dUaa7DUi-TKVFHTZsVxQrlexvG4SUZm6N8-RAgW-Hgl4Fm16QKjLB8Smzb7fg0_3Heh2RxRO4DM6alOpTGfM4lDQjx-JBymYUztOAuBANR84PPvzFMKCK9hdlODMbdRT3LVU-maWvSxN-XNtXdSltD2p8By-EmBSmK4dFa6Xo Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b6f25c3540546bf9bffd5610f4f86c8", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersTestJSON-167161476-project Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 784233ee78764e7dbb774d3cb50165e3 Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersTestJSON-167161476-project Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 could not be found. Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25'} Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 could not be found. Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 could not be found. Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.090321 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.099422 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:22.099422 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:22.099422 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:13:22.099422 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:13:22.099422 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 could not be found. Sep 17 21:13:22.099422 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.099422 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bf0f5aa4-cfb0-4d65-8ccc-8432b46cfe03 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Returning 404 to user: Instance 3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:13:22.099422 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bf0f5aa4-cfb0-4d65-8ccc-8432b46cfe03 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25" status: 404 len: 111 microversion: 2.1 time: 0.034953 Sep 17 21:13:22.099422 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2536/4964] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:22 2022] GET /compute/v2.1/servers/3839d2ff-e9ce-4b76-a5b0-63a5c28e9d25 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:13:22.102018 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-27e6b921-60f9-4a65-883d-35de143ecc47 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:22.102784 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-27e6b921-60f9-4a65-883d-35de143ecc47 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 6bddcf4c-0951-44ad-a435-0ceb98ec51af] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:22.113382 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-27e6b921-60f9-4a65-883d-35de143ecc47 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.113917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-27e6b921-60f9-4a65-883d-35de143ecc47 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.114404 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-27e6b921-60f9-4a65-883d-35de143ecc47 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.115159 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-27e6b921-60f9-4a65-883d-35de143ecc47 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.115649 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-27e6b921-60f9-4a65-883d-35de143ecc47 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.116060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-27e6b921-60f9-4a65-883d-35de143ecc47 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.134753 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-27e6b921-60f9-4a65-883d-35de143ecc47 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] HTTP exception thrown: Instance 6bddcf4c-0951-44ad-a435-0ceb98ec51af could not be found. Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-27e6b921-60f9-4a65-883d-35de143ecc47 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Request method failure captured: Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af HTTP/1.1 Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjdkx_dUaa7DUi-TKVFHTZsVxQrlexvG4SUZm6N8-RAgW-Hgl4Fm16QKjLB8Smzb7fg0_3Heh2RxRO4DM6alOpTGfM4lDQjx-JBymYUztOAuBANR84PPvzFMKCK9hdlODMbdRT3LVU-maWvSxN-XNtXdSltD2p8By-EmBSmK4dFa6Xo Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b6f25c3540546bf9bffd5610f4f86c8", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersTestJSON-167161476-project Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 784233ee78764e7dbb774d3cb50165e3 Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersTestJSON-167161476-project Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 6bddcf4c-0951-44ad-a435-0ceb98ec51af could not be found. Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '6bddcf4c-0951-44ad-a435-0ceb98ec51af'} Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bddcf4c-0951-44ad-a435-0ceb98ec51af could not be found. Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:13:22.136543 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bddcf4c-0951-44ad-a435-0ceb98ec51af could not be found. Sep 17 21:13:22.140842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.140842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:22.140842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.140842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.140842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:22.140842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:22.140842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:13:22.140842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:13:22.140842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bddcf4c-0951-44ad-a435-0ceb98ec51af could not be found. Sep 17 21:13:22.140842 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.140842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-27e6b921-60f9-4a65-883d-35de143ecc47 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Returning 404 to user: Instance 6bddcf4c-0951-44ad-a435-0ceb98ec51af could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:13:22.141636 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-27e6b921-60f9-4a65-883d-35de143ecc47 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af" status: 404 len: 111 microversion: 2.1 time: 0.043210 Sep 17 21:13:22.143415 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2429/4965] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:13:22 2022] DELETE /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:13:22.154249 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7144db82-2715-4584-8bd3-cf7952d60461 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:22.155113 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7144db82-2715-4584-8bd3-cf7952d60461 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 6bddcf4c-0951-44ad-a435-0ceb98ec51af] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:22.161871 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7144db82-2715-4584-8bd3-cf7952d60461 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.162439 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7144db82-2715-4584-8bd3-cf7952d60461 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.162947 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7144db82-2715-4584-8bd3-cf7952d60461 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.163854 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7144db82-2715-4584-8bd3-cf7952d60461 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.164310 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7144db82-2715-4584-8bd3-cf7952d60461 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.164906 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7144db82-2715-4584-8bd3-cf7952d60461 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.183383 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-7144db82-2715-4584-8bd3-cf7952d60461 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] HTTP exception thrown: Instance 6bddcf4c-0951-44ad-a435-0ceb98ec51af could not be found. Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7144db82-2715-4584-8bd3-cf7952d60461 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Request method failure captured: Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af HTTP/1.1 Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjdkx_dUaa7DUi-TKVFHTZsVxQrlexvG4SUZm6N8-RAgW-Hgl4Fm16QKjLB8Smzb7fg0_3Heh2RxRO4DM6alOpTGfM4lDQjx-JBymYUztOAuBANR84PPvzFMKCK9hdlODMbdRT3LVU-maWvSxN-XNtXdSltD2p8By-EmBSmK4dFa6Xo Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b6f25c3540546bf9bffd5610f4f86c8", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersTestJSON-167161476-project Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 784233ee78764e7dbb774d3cb50165e3 Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersTestJSON-167161476-project Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 6bddcf4c-0951-44ad-a435-0ceb98ec51af could not be found. Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '6bddcf4c-0951-44ad-a435-0ceb98ec51af'} Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bddcf4c-0951-44ad-a435-0ceb98ec51af could not be found. Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bddcf4c-0951-44ad-a435-0ceb98ec51af could not be found. Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.187300 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.195193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:22.195193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:22.195193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:13:22.195193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:13:22.195193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bddcf4c-0951-44ad-a435-0ceb98ec51af could not be found. Sep 17 21:13:22.195193 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.195193 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7144db82-2715-4584-8bd3-cf7952d60461 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Returning 404 to user: Instance 6bddcf4c-0951-44ad-a435-0ceb98ec51af could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:13:22.195193 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7144db82-2715-4584-8bd3-cf7952d60461 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af" status: 404 len: 111 microversion: 2.1 time: 0.039536 Sep 17 21:13:22.195193 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2537/4966] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:22 2022] GET /compute/v2.1/servers/6bddcf4c-0951-44ad-a435-0ceb98ec51af => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 21:13:22.196639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9cfbf13d-6412-4621-803a-740c51077c82 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:22.197380 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9cfbf13d-6412-4621-803a-740c51077c82 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: f09b5c28-821c-4b0e-be61-2f1acfeb47d1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:22.203749 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9cfbf13d-6412-4621-803a-740c51077c82 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.204251 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9cfbf13d-6412-4621-803a-740c51077c82 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.204700 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9cfbf13d-6412-4621-803a-740c51077c82 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.205411 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9cfbf13d-6412-4621-803a-740c51077c82 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.205913 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9cfbf13d-6412-4621-803a-740c51077c82 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.206357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9cfbf13d-6412-4621-803a-740c51077c82 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.222561 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-9cfbf13d-6412-4621-803a-740c51077c82 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] HTTP exception thrown: Instance f09b5c28-821c-4b0e-be61-2f1acfeb47d1 could not be found. Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9cfbf13d-6412-4621-803a-740c51077c82 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Request method failure captured: Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1 HTTP/1.1 Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjdkx_dUaa7DUi-TKVFHTZsVxQrlexvG4SUZm6N8-RAgW-Hgl4Fm16QKjLB8Smzb7fg0_3Heh2RxRO4DM6alOpTGfM4lDQjx-JBymYUztOAuBANR84PPvzFMKCK9hdlODMbdRT3LVU-maWvSxN-XNtXdSltD2p8By-EmBSmK4dFa6Xo Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b6f25c3540546bf9bffd5610f4f86c8", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersTestJSON-167161476-project Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 784233ee78764e7dbb774d3cb50165e3 Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersTestJSON-167161476-project Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance f09b5c28-821c-4b0e-be61-2f1acfeb47d1 could not be found. Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'f09b5c28-821c-4b0e-be61-2f1acfeb47d1'} Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f09b5c28-821c-4b0e-be61-2f1acfeb47d1 could not be found. Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:13:22.224157 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f09b5c28-821c-4b0e-be61-2f1acfeb47d1 could not be found. Sep 17 21:13:22.234682 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.234682 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:22.234682 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.234682 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.234682 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:22.234682 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:22.234682 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:13:22.234682 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:13:22.234682 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f09b5c28-821c-4b0e-be61-2f1acfeb47d1 could not be found. Sep 17 21:13:22.234682 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.234682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9cfbf13d-6412-4621-803a-740c51077c82 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Returning 404 to user: Instance f09b5c28-821c-4b0e-be61-2f1acfeb47d1 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:13:22.234682 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9cfbf13d-6412-4621-803a-740c51077c82 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1" status: 404 len: 111 microversion: 2.1 time: 0.033748 Sep 17 21:13:22.234682 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2430/4967] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:13:22 2022] DELETE /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:13:22.241284 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1a5ed8e4-b5ad-4092-bf19-a762792a8a73 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:22.251377 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1a5ed8e4-b5ad-4092-bf19-a762792a8a73 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: f09b5c28-821c-4b0e-be61-2f1acfeb47d1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:22.260981 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a5ed8e4-b5ad-4092-bf19-a762792a8a73 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.261641 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a5ed8e4-b5ad-4092-bf19-a762792a8a73 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.261971 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a5ed8e4-b5ad-4092-bf19-a762792a8a73 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.262691 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a5ed8e4-b5ad-4092-bf19-a762792a8a73 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.263150 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a5ed8e4-b5ad-4092-bf19-a762792a8a73 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.263580 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a5ed8e4-b5ad-4092-bf19-a762792a8a73 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.278652 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-1a5ed8e4-b5ad-4092-bf19-a762792a8a73 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] HTTP exception thrown: Instance f09b5c28-821c-4b0e-be61-2f1acfeb47d1 could not be found. Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1a5ed8e4-b5ad-4092-bf19-a762792a8a73 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Request method failure captured: Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1 HTTP/1.1 Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjdkx_dUaa7DUi-TKVFHTZsVxQrlexvG4SUZm6N8-RAgW-Hgl4Fm16QKjLB8Smzb7fg0_3Heh2RxRO4DM6alOpTGfM4lDQjx-JBymYUztOAuBANR84PPvzFMKCK9hdlODMbdRT3LVU-maWvSxN-XNtXdSltD2p8By-EmBSmK4dFa6Xo Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b6f25c3540546bf9bffd5610f4f86c8", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersTestJSON-167161476-project Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 784233ee78764e7dbb774d3cb50165e3 Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersTestJSON-167161476-project Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance f09b5c28-821c-4b0e-be61-2f1acfeb47d1 could not be found. Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'f09b5c28-821c-4b0e-be61-2f1acfeb47d1'} Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f09b5c28-821c-4b0e-be61-2f1acfeb47d1 could not be found. Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f09b5c28-821c-4b0e-be61-2f1acfeb47d1 could not be found. Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.280345 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.287225 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:22.287225 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:22.287225 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:13:22.287225 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:13:22.287225 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f09b5c28-821c-4b0e-be61-2f1acfeb47d1 could not be found. Sep 17 21:13:22.287225 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.287225 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1a5ed8e4-b5ad-4092-bf19-a762792a8a73 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Returning 404 to user: Instance f09b5c28-821c-4b0e-be61-2f1acfeb47d1 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:13:22.287225 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1a5ed8e4-b5ad-4092-bf19-a762792a8a73 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1" status: 404 len: 111 microversion: 2.1 time: 0.050133 Sep 17 21:13:22.287225 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2538/4968] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:22 2022] GET /compute/v2.1/servers/f09b5c28-821c-4b0e-be61-2f1acfeb47d1 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:13:22.291205 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c235cd67-755e-428b-8c90-c7f01b990a46 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:22.291712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c235cd67-755e-428b-8c90-c7f01b990a46 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 640f82db-299b-42a4-a6b6-0a286b8220c9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:22.298056 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c235cd67-755e-428b-8c90-c7f01b990a46 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.298586 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c235cd67-755e-428b-8c90-c7f01b990a46 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.298985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c235cd67-755e-428b-8c90-c7f01b990a46 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.300090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c235cd67-755e-428b-8c90-c7f01b990a46 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.300523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c235cd67-755e-428b-8c90-c7f01b990a46 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.300981 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c235cd67-755e-428b-8c90-c7f01b990a46 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.321709 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-c235cd67-755e-428b-8c90-c7f01b990a46 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] HTTP exception thrown: Instance 640f82db-299b-42a4-a6b6-0a286b8220c9 could not be found. Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c235cd67-755e-428b-8c90-c7f01b990a46 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Request method failure captured: Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9 HTTP/1.1 Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjdkx_dUaa7DUi-TKVFHTZsVxQrlexvG4SUZm6N8-RAgW-Hgl4Fm16QKjLB8Smzb7fg0_3Heh2RxRO4DM6alOpTGfM4lDQjx-JBymYUztOAuBANR84PPvzFMKCK9hdlODMbdRT3LVU-maWvSxN-XNtXdSltD2p8By-EmBSmK4dFa6Xo Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b6f25c3540546bf9bffd5610f4f86c8", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersTestJSON-167161476-project Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 784233ee78764e7dbb774d3cb50165e3 Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersTestJSON-167161476-project Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 640f82db-299b-42a4-a6b6-0a286b8220c9 could not be found. Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '640f82db-299b-42a4-a6b6-0a286b8220c9'} Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 640f82db-299b-42a4-a6b6-0a286b8220c9 could not be found. Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:13:22.324229 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 640f82db-299b-42a4-a6b6-0a286b8220c9 could not be found. Sep 17 21:13:22.331292 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.331292 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:22.331292 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.331292 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.331292 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:22.331292 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:22.331292 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:13:22.331292 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:13:22.331292 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 640f82db-299b-42a4-a6b6-0a286b8220c9 could not be found. Sep 17 21:13:22.331292 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.331292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c235cd67-755e-428b-8c90-c7f01b990a46 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Returning 404 to user: Instance 640f82db-299b-42a4-a6b6-0a286b8220c9 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:13:22.331292 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c235cd67-755e-428b-8c90-c7f01b990a46 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "DELETE /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9" status: 404 len: 111 microversion: 2.1 time: 0.040928 Sep 17 21:13:22.331292 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2431/4969] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:13:22 2022] DELETE /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:13:22.340837 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-792af309-32a3-4c1e-8486-a1f88bde2b03 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:22.340837 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-792af309-32a3-4c1e-8486-a1f88bde2b03 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 640f82db-299b-42a4-a6b6-0a286b8220c9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:22.347239 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-792af309-32a3-4c1e-8486-a1f88bde2b03 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.347752 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-792af309-32a3-4c1e-8486-a1f88bde2b03 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.348680 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-792af309-32a3-4c1e-8486-a1f88bde2b03 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.349929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-792af309-32a3-4c1e-8486-a1f88bde2b03 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.351428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-792af309-32a3-4c1e-8486-a1f88bde2b03 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.352798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-792af309-32a3-4c1e-8486-a1f88bde2b03 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.373561 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-792af309-32a3-4c1e-8486-a1f88bde2b03 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] HTTP exception thrown: Instance 640f82db-299b-42a4-a6b6-0a286b8220c9 could not be found. Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-792af309-32a3-4c1e-8486-a1f88bde2b03 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Request method failure captured: Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9 HTTP/1.1 Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjdkx_dUaa7DUi-TKVFHTZsVxQrlexvG4SUZm6N8-RAgW-Hgl4Fm16QKjLB8Smzb7fg0_3Heh2RxRO4DM6alOpTGfM4lDQjx-JBymYUztOAuBANR84PPvzFMKCK9hdlODMbdRT3LVU-maWvSxN-XNtXdSltD2p8By-EmBSmK4dFa6Xo Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b6f25c3540546bf9bffd5610f4f86c8", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersTestJSON-167161476-project Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 784233ee78764e7dbb774d3cb50165e3 Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersTestJSON-167161476-project Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 640f82db-299b-42a4-a6b6-0a286b8220c9 could not be found. Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '640f82db-299b-42a4-a6b6-0a286b8220c9'} Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 640f82db-299b-42a4-a6b6-0a286b8220c9 could not be found. Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 640f82db-299b-42a4-a6b6-0a286b8220c9 could not be found. Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.376145 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.381832 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:22.381832 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:22.381832 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:13:22.381832 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:13:22.381832 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 640f82db-299b-42a4-a6b6-0a286b8220c9 could not be found. Sep 17 21:13:22.381832 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.381832 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-792af309-32a3-4c1e-8486-a1f88bde2b03 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Returning 404 to user: Instance 640f82db-299b-42a4-a6b6-0a286b8220c9 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:13:22.381832 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-792af309-32a3-4c1e-8486-a1f88bde2b03 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9" status: 404 len: 111 microversion: 2.1 time: 0.044738 Sep 17 21:13:22.381832 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2539/4970] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:22 2022] GET /compute/v2.1/servers/640f82db-299b-42a4-a6b6-0a286b8220c9 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:13:22.388253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1fd0c004-029a-43e3-bba0-1fbdd97c7ab8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:22.388938 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1fd0c004-029a-43e3-bba0-1fbdd97c7ab8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: fb346c6f-8465-4e0d-8bb6-0319d440d7fe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:22.396905 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1fd0c004-029a-43e3-bba0-1fbdd97c7ab8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.397745 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1fd0c004-029a-43e3-bba0-1fbdd97c7ab8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.398183 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1fd0c004-029a-43e3-bba0-1fbdd97c7ab8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.398920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1fd0c004-029a-43e3-bba0-1fbdd97c7ab8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.399421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1fd0c004-029a-43e3-bba0-1fbdd97c7ab8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.399864 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1fd0c004-029a-43e3-bba0-1fbdd97c7ab8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.416570 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-1fd0c004-029a-43e3-bba0-1fbdd97c7ab8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] HTTP exception thrown: Instance fb346c6f-8465-4e0d-8bb6-0319d440d7fe could not be found. Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1fd0c004-029a-43e3-bba0-1fbdd97c7ab8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Request method failure captured: Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe HTTP/1.1 Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjdkx_dUaa7DUi-TKVFHTZsVxQrlexvG4SUZm6N8-RAgW-Hgl4Fm16QKjLB8Smzb7fg0_3Heh2RxRO4DM6alOpTGfM4lDQjx-JBymYUztOAuBANR84PPvzFMKCK9hdlODMbdRT3LVU-maWvSxN-XNtXdSltD2p8By-EmBSmK4dFa6Xo Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b6f25c3540546bf9bffd5610f4f86c8", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersTestJSON-167161476-project Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 784233ee78764e7dbb774d3cb50165e3 Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersTestJSON-167161476-project Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance fb346c6f-8465-4e0d-8bb6-0319d440d7fe could not be found. Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'fb346c6f-8465-4e0d-8bb6-0319d440d7fe'} Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb346c6f-8465-4e0d-8bb6-0319d440d7fe could not be found. Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:13:22.418345 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb346c6f-8465-4e0d-8bb6-0319d440d7fe could not be found. Sep 17 21:13:22.426822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.426822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:22.426822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.426822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.426822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:22.426822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:22.426822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:13:22.426822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:13:22.426822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb346c6f-8465-4e0d-8bb6-0319d440d7fe could not be found. Sep 17 21:13:22.426822 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.426822 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1fd0c004-029a-43e3-bba0-1fbdd97c7ab8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Returning 404 to user: Instance fb346c6f-8465-4e0d-8bb6-0319d440d7fe could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:13:22.426822 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1fd0c004-029a-43e3-bba0-1fbdd97c7ab8 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe" status: 404 len: 111 microversion: 2.1 time: 0.037061 Sep 17 21:13:22.426822 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2432/4971] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:13:22 2022] DELETE /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 21:13:22.431018 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d6b1a283-89e4-4b95-8236-3eaf6bc690c2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:22.431798 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d6b1a283-89e4-4b95-8236-3eaf6bc690c2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: fb346c6f-8465-4e0d-8bb6-0319d440d7fe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:22.432233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-21ce99f1-2d2a-4019-85ea-8b9d5ac063aa tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:22.433651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-21ce99f1-2d2a-4019-85ea-8b9d5ac063aa tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:22.439133 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d6b1a283-89e4-4b95-8236-3eaf6bc690c2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.439641 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d6b1a283-89e4-4b95-8236-3eaf6bc690c2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.440093 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d6b1a283-89e4-4b95-8236-3eaf6bc690c2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.440867 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d6b1a283-89e4-4b95-8236-3eaf6bc690c2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.441262 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d6b1a283-89e4-4b95-8236-3eaf6bc690c2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.441872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d6b1a283-89e4-4b95-8236-3eaf6bc690c2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.443143 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-21ce99f1-2d2a-4019-85ea-8b9d5ac063aa tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.443946 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-21ce99f1-2d2a-4019-85ea-8b9d5ac063aa tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.444615 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-21ce99f1-2d2a-4019-85ea-8b9d5ac063aa tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.445324 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-21ce99f1-2d2a-4019-85ea-8b9d5ac063aa tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.445822 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-21ce99f1-2d2a-4019-85ea-8b9d5ac063aa tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.446248 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-21ce99f1-2d2a-4019-85ea-8b9d5ac063aa tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.456430 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-d6b1a283-89e4-4b95-8236-3eaf6bc690c2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] HTTP exception thrown: Instance fb346c6f-8465-4e0d-8bb6-0319d440d7fe could not be found. Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d6b1a283-89e4-4b95-8236-3eaf6bc690c2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Request method failure captured: Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe HTTP/1.1 Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjdkx_dUaa7DUi-TKVFHTZsVxQrlexvG4SUZm6N8-RAgW-Hgl4Fm16QKjLB8Smzb7fg0_3Heh2RxRO4DM6alOpTGfM4lDQjx-JBymYUztOAuBANR84PPvzFMKCK9hdlODMbdRT3LVU-maWvSxN-XNtXdSltD2p8By-EmBSmK4dFa6Xo Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b6f25c3540546bf9bffd5610f4f86c8", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersTestJSON-167161476-project Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 784233ee78764e7dbb774d3cb50165e3 Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersTestJSON-167161476-project Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance fb346c6f-8465-4e0d-8bb6-0319d440d7fe could not be found. Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'fb346c6f-8465-4e0d-8bb6-0319d440d7fe'} Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb346c6f-8465-4e0d-8bb6-0319d440d7fe could not be found. Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb346c6f-8465-4e0d-8bb6-0319d440d7fe could not be found. Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.458150 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.463454 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:22.463454 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:22.463454 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:13:22.463454 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:13:22.463454 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb346c6f-8465-4e0d-8bb6-0319d440d7fe could not be found. Sep 17 21:13:22.463454 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.463454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d6b1a283-89e4-4b95-8236-3eaf6bc690c2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Returning 404 to user: Instance fb346c6f-8465-4e0d-8bb6-0319d440d7fe could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:13:22.463454 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d6b1a283-89e4-4b95-8236-3eaf6bc690c2 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe" status: 404 len: 111 microversion: 2.1 time: 0.034127 Sep 17 21:13:22.464374 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2433/4972] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:22 2022] GET /compute/v2.1/servers/fb346c6f-8465-4e0d-8bb6-0319d440d7fe => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 21:13:22.468661 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-168a3bdf-4757-460d-ba10-27ce1cd47973 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:22.469176 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-168a3bdf-4757-460d-ba10-27ce1cd47973 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 23fc7ecb-5658-4a6b-b313-5049d3b1e90d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:22.475547 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-168a3bdf-4757-460d-ba10-27ce1cd47973 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.476048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-168a3bdf-4757-460d-ba10-27ce1cd47973 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.476590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-168a3bdf-4757-460d-ba10-27ce1cd47973 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.477322 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-168a3bdf-4757-460d-ba10-27ce1cd47973 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.477799 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-168a3bdf-4757-460d-ba10-27ce1cd47973 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.478253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-168a3bdf-4757-460d-ba10-27ce1cd47973 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.494325 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-168a3bdf-4757-460d-ba10-27ce1cd47973 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] HTTP exception thrown: Instance 23fc7ecb-5658-4a6b-b313-5049d3b1e90d could not be found. Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-168a3bdf-4757-460d-ba10-27ce1cd47973 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Request method failure captured: Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d HTTP/1.1 Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjdkx_dUaa7DUi-TKVFHTZsVxQrlexvG4SUZm6N8-RAgW-Hgl4Fm16QKjLB8Smzb7fg0_3Heh2RxRO4DM6alOpTGfM4lDQjx-JBymYUztOAuBANR84PPvzFMKCK9hdlODMbdRT3LVU-maWvSxN-XNtXdSltD2p8By-EmBSmK4dFa6Xo Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b6f25c3540546bf9bffd5610f4f86c8", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersTestJSON-167161476-project Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 784233ee78764e7dbb774d3cb50165e3 Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersTestJSON-167161476-project Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 23fc7ecb-5658-4a6b-b313-5049d3b1e90d could not be found. Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '23fc7ecb-5658-4a6b-b313-5049d3b1e90d'} Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23fc7ecb-5658-4a6b-b313-5049d3b1e90d could not be found. Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:13:22.496183 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23fc7ecb-5658-4a6b-b313-5049d3b1e90d could not be found. Sep 17 21:13:22.500973 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.500973 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:22.500973 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.500973 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.500973 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:22.500973 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:22.500973 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:13:22.500973 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:13:22.500973 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23fc7ecb-5658-4a6b-b313-5049d3b1e90d could not be found. Sep 17 21:13:22.500973 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.508302 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-168a3bdf-4757-460d-ba10-27ce1cd47973 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Returning 404 to user: Instance 23fc7ecb-5658-4a6b-b313-5049d3b1e90d could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:13:22.508302 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-168a3bdf-4757-460d-ba10-27ce1cd47973 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "DELETE /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d" status: 404 len: 111 microversion: 2.1 time: 0.039113 Sep 17 21:13:22.509387 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2434/4973] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:13:22 2022] DELETE /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:13:22.515322 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-220370f6-58e3-42f7-bf6e-e8fa8085a5b9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:22.516066 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-220370f6-58e3-42f7-bf6e-e8fa8085a5b9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 23fc7ecb-5658-4a6b-b313-5049d3b1e90d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:22.523208 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-220370f6-58e3-42f7-bf6e-e8fa8085a5b9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.523930 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-220370f6-58e3-42f7-bf6e-e8fa8085a5b9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.524551 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-220370f6-58e3-42f7-bf6e-e8fa8085a5b9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.525438 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-220370f6-58e3-42f7-bf6e-e8fa8085a5b9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.526106 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-220370f6-58e3-42f7-bf6e-e8fa8085a5b9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.526869 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-220370f6-58e3-42f7-bf6e-e8fa8085a5b9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.547220 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-220370f6-58e3-42f7-bf6e-e8fa8085a5b9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] HTTP exception thrown: Instance 23fc7ecb-5658-4a6b-b313-5049d3b1e90d could not be found. Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-220370f6-58e3-42f7-bf6e-e8fa8085a5b9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Request method failure captured: Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d HTTP/1.1 Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjdkx_dUaa7DUi-TKVFHTZsVxQrlexvG4SUZm6N8-RAgW-Hgl4Fm16QKjLB8Smzb7fg0_3Heh2RxRO4DM6alOpTGfM4lDQjx-JBymYUztOAuBANR84PPvzFMKCK9hdlODMbdRT3LVU-maWvSxN-XNtXdSltD2p8By-EmBSmK4dFa6Xo Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b6f25c3540546bf9bffd5610f4f86c8", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersTestJSON-167161476-project Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 784233ee78764e7dbb774d3cb50165e3 Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersTestJSON-167161476-project Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 23fc7ecb-5658-4a6b-b313-5049d3b1e90d could not be found. Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '23fc7ecb-5658-4a6b-b313-5049d3b1e90d'} Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23fc7ecb-5658-4a6b-b313-5049d3b1e90d could not be found. Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23fc7ecb-5658-4a6b-b313-5049d3b1e90d could not be found. Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.548796 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.556227 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:22.556227 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:22.556227 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:13:22.556227 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:13:22.556227 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23fc7ecb-5658-4a6b-b313-5049d3b1e90d could not be found. Sep 17 21:13:22.556227 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.556227 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-220370f6-58e3-42f7-bf6e-e8fa8085a5b9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Returning 404 to user: Instance 23fc7ecb-5658-4a6b-b313-5049d3b1e90d could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:13:22.556227 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-220370f6-58e3-42f7-bf6e-e8fa8085a5b9 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d" status: 404 len: 111 microversion: 2.1 time: 0.039496 Sep 17 21:13:22.556227 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2435/4974] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:22 2022] GET /compute/v2.1/servers/23fc7ecb-5658-4a6b-b313-5049d3b1e90d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:13:22.558864 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4d5b0b00-4977-494f-bdac-668b2c22b8ef tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:22.559373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4d5b0b00-4977-494f-bdac-668b2c22b8ef tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 59ced39b-33f7-40af-9993-ff41b9bda651] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:22.566029 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d5b0b00-4977-494f-bdac-668b2c22b8ef tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.566531 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d5b0b00-4977-494f-bdac-668b2c22b8ef tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.566989 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d5b0b00-4977-494f-bdac-668b2c22b8ef tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.567914 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d5b0b00-4977-494f-bdac-668b2c22b8ef tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.568363 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d5b0b00-4977-494f-bdac-668b2c22b8ef tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.569028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d5b0b00-4977-494f-bdac-668b2c22b8ef tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.588102 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-4d5b0b00-4977-494f-bdac-668b2c22b8ef tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] HTTP exception thrown: Instance 59ced39b-33f7-40af-9993-ff41b9bda651 could not be found. Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4d5b0b00-4977-494f-bdac-668b2c22b8ef tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Request method failure captured: Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/59ced39b-33f7-40af-9993-ff41b9bda651 HTTP/1.1 Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjdkx_dUaa7DUi-TKVFHTZsVxQrlexvG4SUZm6N8-RAgW-Hgl4Fm16QKjLB8Smzb7fg0_3Heh2RxRO4DM6alOpTGfM4lDQjx-JBymYUztOAuBANR84PPvzFMKCK9hdlODMbdRT3LVU-maWvSxN-XNtXdSltD2p8By-EmBSmK4dFa6Xo Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b6f25c3540546bf9bffd5610f4f86c8", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersTestJSON-167161476-project Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 784233ee78764e7dbb774d3cb50165e3 Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersTestJSON-167161476-project Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 59ced39b-33f7-40af-9993-ff41b9bda651 could not be found. Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '59ced39b-33f7-40af-9993-ff41b9bda651'} Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59ced39b-33f7-40af-9993-ff41b9bda651 could not be found. Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:13:22.590193 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59ced39b-33f7-40af-9993-ff41b9bda651 could not be found. Sep 17 21:13:22.594714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.594714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:22.594714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.594714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.594714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:22.594714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:22.594714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:13:22.594714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:13:22.594714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59ced39b-33f7-40af-9993-ff41b9bda651 could not be found. Sep 17 21:13:22.594714 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.596626 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4d5b0b00-4977-494f-bdac-668b2c22b8ef tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Returning 404 to user: Instance 59ced39b-33f7-40af-9993-ff41b9bda651 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:13:22.597740 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4d5b0b00-4977-494f-bdac-668b2c22b8ef tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "DELETE /compute/v2.1/servers/59ced39b-33f7-40af-9993-ff41b9bda651" status: 404 len: 111 microversion: 2.1 time: 0.042754 Sep 17 21:13:22.598570 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2436/4975] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:13:22 2022] DELETE /compute/v2.1/servers/59ced39b-33f7-40af-9993-ff41b9bda651 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:13:22.607376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fb26c7cd-290c-4b74-bc0b-4b6d237bd6b3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:22.608221 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fb26c7cd-290c-4b74-bc0b-4b6d237bd6b3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 59ced39b-33f7-40af-9993-ff41b9bda651] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:22.614604 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb26c7cd-290c-4b74-bc0b-4b6d237bd6b3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.615368 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb26c7cd-290c-4b74-bc0b-4b6d237bd6b3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.616050 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb26c7cd-290c-4b74-bc0b-4b6d237bd6b3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.617000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb26c7cd-290c-4b74-bc0b-4b6d237bd6b3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.617692 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb26c7cd-290c-4b74-bc0b-4b6d237bd6b3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.618329 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb26c7cd-290c-4b74-bc0b-4b6d237bd6b3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.628025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-21ce99f1-2d2a-4019-85ea-8b9d5ac063aa tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:22.639427 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-21ce99f1-2d2a-4019-85ea-8b9d5ac063aa tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1523 microversion: 2.1 time: 0.214781 Sep 17 21:13:22.639986 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2540/4976] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:22 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1523 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:22.647475 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-fb26c7cd-290c-4b74-bc0b-4b6d237bd6b3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] HTTP exception thrown: Instance 59ced39b-33f7-40af-9993-ff41b9bda651 could not be found. Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fb26c7cd-290c-4b74-bc0b-4b6d237bd6b3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Request method failure captured: Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/59ced39b-33f7-40af-9993-ff41b9bda651 HTTP/1.1 Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjdkx_dUaa7DUi-TKVFHTZsVxQrlexvG4SUZm6N8-RAgW-Hgl4Fm16QKjLB8Smzb7fg0_3Heh2RxRO4DM6alOpTGfM4lDQjx-JBymYUztOAuBANR84PPvzFMKCK9hdlODMbdRT3LVU-maWvSxN-XNtXdSltD2p8By-EmBSmK4dFa6Xo Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b6f25c3540546bf9bffd5610f4f86c8", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersTestJSON-167161476 Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersTestJSON-167161476-project Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 784233ee78764e7dbb774d3cb50165e3 Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersTestJSON-167161476-project Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 59ced39b-33f7-40af-9993-ff41b9bda651 could not be found. Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '59ced39b-33f7-40af-9993-ff41b9bda651'} Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59ced39b-33f7-40af-9993-ff41b9bda651 could not be found. Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59ced39b-33f7-40af-9993-ff41b9bda651 could not be found. Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.649080 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:22.655861 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:22.655861 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:22.655861 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:13:22.655861 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:13:22.655861 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59ced39b-33f7-40af-9993-ff41b9bda651 could not be found. Sep 17 21:13:22.655861 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:22.655861 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fb26c7cd-290c-4b74-bc0b-4b6d237bd6b3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Returning 404 to user: Instance 59ced39b-33f7-40af-9993-ff41b9bda651 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:13:22.655861 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fb26c7cd-290c-4b74-bc0b-4b6d237bd6b3 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/59ced39b-33f7-40af-9993-ff41b9bda651" status: 404 len: 111 microversion: 2.1 time: 0.047418 Sep 17 21:13:22.657597 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2437/4977] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:22 2022] GET /compute/v2.1/servers/59ced39b-33f7-40af-9993-ff41b9bda651 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:13:22.663013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cbe9e7e3-d628-405b-921f-ba1bf99526b6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:22.663173 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cbe9e7e3-d628-405b-921f-ba1bf99526b6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 893e8bd4-4560-4ebe-8abe-635d5413c433] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:22.670140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbe9e7e3-d628-405b-921f-ba1bf99526b6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.670626 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbe9e7e3-d628-405b-921f-ba1bf99526b6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.671070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbe9e7e3-d628-405b-921f-ba1bf99526b6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.671780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbe9e7e3-d628-405b-921f-ba1bf99526b6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.672269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbe9e7e3-d628-405b-921f-ba1bf99526b6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.672700 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbe9e7e3-d628-405b-921f-ba1bf99526b6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.707469 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cbe9e7e3-d628-405b-921f-ba1bf99526b6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 893e8bd4-4560-4ebe-8abe-635d5413c433] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:13:22.813936 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cbe9e7e3-d628-405b-921f-ba1bf99526b6 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "DELETE /compute/v2.1/servers/893e8bd4-4560-4ebe-8abe-635d5413c433" status: 204 len: 0 microversion: 2.1 time: 0.156550 Sep 17 21:13:22.814953 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2541/4978] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:13:22 2022] DELETE /compute/v2.1/servers/893e8bd4-4560-4ebe-8abe-635d5413c433 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 17 21:13:22.825117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-639b62c1-2b0b-4a33-bdc2-ec2013661e80 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:22.825772 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-639b62c1-2b0b-4a33-bdc2-ec2013661e80 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 893e8bd4-4560-4ebe-8abe-635d5413c433] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:22.833038 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-639b62c1-2b0b-4a33-bdc2-ec2013661e80 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.833584 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-639b62c1-2b0b-4a33-bdc2-ec2013661e80 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.834208 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-639b62c1-2b0b-4a33-bdc2-ec2013661e80 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:22.834994 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-639b62c1-2b0b-4a33-bdc2-ec2013661e80 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:22.835958 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-639b62c1-2b0b-4a33-bdc2-ec2013661e80 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:22.836635 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-639b62c1-2b0b-4a33-bdc2-ec2013661e80 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:23.074741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-639b62c1-2b0b-4a33-bdc2-ec2013661e80 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:23.085927 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-639b62c1-2b0b-4a33-bdc2-ec2013661e80 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/893e8bd4-4560-4ebe-8abe-635d5413c433" status: 200 len: 1480 microversion: 2.1 time: 0.264656 Sep 17 21:13:23.086792 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2438/4979] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:22 2022] GET /compute/v2.1/servers/893e8bd4-4560-4ebe-8abe-635d5413c433 => generated 1480 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:23.667550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e5f2881d-377b-4be1-89a9-57ba60ab147f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:23.668531 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e5f2881d-377b-4be1-89a9-57ba60ab147f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:23.680059 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5f2881d-377b-4be1-89a9-57ba60ab147f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:23.680960 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5f2881d-377b-4be1-89a9-57ba60ab147f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:23.681911 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5f2881d-377b-4be1-89a9-57ba60ab147f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:23.689406 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5f2881d-377b-4be1-89a9-57ba60ab147f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:23.689406 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5f2881d-377b-4be1-89a9-57ba60ab147f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:23.689406 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5f2881d-377b-4be1-89a9-57ba60ab147f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:23.952233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e5f2881d-377b-4be1-89a9-57ba60ab147f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:23.964035 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e5f2881d-377b-4be1-89a9-57ba60ab147f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1523 microversion: 2.1 time: 0.302211 Sep 17 21:13:23.964641 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2542/4980] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:23 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1523 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:24.112092 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d87e20f1-d058-478a-9ea4-fb36d76e05cd tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:24.113447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d87e20f1-d058-478a-9ea4-fb36d76e05cd tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 893e8bd4-4560-4ebe-8abe-635d5413c433] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:24.126478 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d87e20f1-d058-478a-9ea4-fb36d76e05cd tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:24.127974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d87e20f1-d058-478a-9ea4-fb36d76e05cd tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:24.128749 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d87e20f1-d058-478a-9ea4-fb36d76e05cd tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:24.130202 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d87e20f1-d058-478a-9ea4-fb36d76e05cd tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:24.130719 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d87e20f1-d058-478a-9ea4-fb36d76e05cd tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:24.131194 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d87e20f1-d058-478a-9ea4-fb36d76e05cd tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:24.329778 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d87e20f1-d058-478a-9ea4-fb36d76e05cd tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:24.337884 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d87e20f1-d058-478a-9ea4-fb36d76e05cd tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/893e8bd4-4560-4ebe-8abe-635d5413c433" status: 200 len: 1480 microversion: 2.1 time: 0.230723 Sep 17 21:13:24.339820 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2439/4981] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:24 2022] GET /compute/v2.1/servers/893e8bd4-4560-4ebe-8abe-635d5413c433 => generated 1480 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:13:24.992802 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f791a8f3-4e22-4045-923a-7dea7ac42fdb tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:24.993635 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f791a8f3-4e22-4045-923a-7dea7ac42fdb tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:25.000919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f791a8f3-4e22-4045-923a-7dea7ac42fdb tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:25.001727 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f791a8f3-4e22-4045-923a-7dea7ac42fdb tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:25.002552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f791a8f3-4e22-4045-923a-7dea7ac42fdb tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:25.004487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f791a8f3-4e22-4045-923a-7dea7ac42fdb tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:25.005161 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f791a8f3-4e22-4045-923a-7dea7ac42fdb tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:25.005823 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f791a8f3-4e22-4045-923a-7dea7ac42fdb tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:25.198221 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f791a8f3-4e22-4045-923a-7dea7ac42fdb tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:25.212573 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f791a8f3-4e22-4045-923a-7dea7ac42fdb tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1523 microversion: 2.1 time: 0.224723 Sep 17 21:13:25.228114 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2440/4982] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:24 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1523 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:13:25.233992 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-1dd1899e-5882-401f-90ad-c8701d44565f req-2b50fbe4-dc0a-4b72-bbe1-0ffd069906ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893e8bd4-4560-4ebe-8abe-635d5413c433", "name": "network-vif-deleted", "tag": "1a900c92-cd71-4208-a5e2-9822ce1675a0"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:13:25.244424 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-1dd1899e-5882-401f-90ad-c8701d44565f req-2b50fbe4-dc0a-4b72-bbe1-0ffd069906ea service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:25.245346 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-1dd1899e-5882-401f-90ad-c8701d44565f req-2b50fbe4-dc0a-4b72-bbe1-0ffd069906ea service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:25.246565 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-1dd1899e-5882-401f-90ad-c8701d44565f req-2b50fbe4-dc0a-4b72-bbe1-0ffd069906ea service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:25.260426 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-1dd1899e-5882-401f-90ad-c8701d44565f req-2b50fbe4-dc0a-4b72-bbe1-0ffd069906ea service nova] Creating event network-vif-deleted:1a900c92-cd71-4208-a5e2-9822ce1675a0 for instance 893e8bd4-4560-4ebe-8abe-635d5413c433 on nch2-master-1 Sep 17 21:13:25.267299 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-1dd1899e-5882-401f-90ad-c8701d44565f req-2b50fbe4-dc0a-4b72-bbe1-0ffd069906ea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036340 Sep 17 21:13:25.268715 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2441/4983] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:13:25.367019 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-65d27421-ce3a-4cd2-84ad-f43d851fcad0 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:25.368876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-65d27421-ce3a-4cd2-84ad-f43d851fcad0 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 893e8bd4-4560-4ebe-8abe-635d5413c433] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:25.377207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-65d27421-ce3a-4cd2-84ad-f43d851fcad0 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:25.377932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-65d27421-ce3a-4cd2-84ad-f43d851fcad0 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:25.378542 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-65d27421-ce3a-4cd2-84ad-f43d851fcad0 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:25.379439 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-65d27421-ce3a-4cd2-84ad-f43d851fcad0 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:25.379995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-65d27421-ce3a-4cd2-84ad-f43d851fcad0 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:25.380435 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-65d27421-ce3a-4cd2-84ad-f43d851fcad0 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:25.380560 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-02a62802-a41c-489d-87e9-151be81ee2be tempest-PortsAdminExtendedAttrsTestJSON-1177857250 tempest-PortsAdminExtendedAttrsTestJSON-1177857250-project-admin] Calling method '.version_select at 0x7f25a4d65ee0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:25.382354 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02a62802-a41c-489d-87e9-151be81ee2be tempest-PortsAdminExtendedAttrsTestJSON-1177857250 tempest-PortsAdminExtendedAttrsTestJSON-1177857250-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:25.382746 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02a62802-a41c-489d-87e9-151be81ee2be tempest-PortsAdminExtendedAttrsTestJSON-1177857250 tempest-PortsAdminExtendedAttrsTestJSON-1177857250-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:25.383359 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02a62802-a41c-489d-87e9-151be81ee2be tempest-PortsAdminExtendedAttrsTestJSON-1177857250 tempest-PortsAdminExtendedAttrsTestJSON-1177857250-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:25.398446 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02a62802-a41c-489d-87e9-151be81ee2be tempest-PortsAdminExtendedAttrsTestJSON-1177857250 tempest-PortsAdminExtendedAttrsTestJSON-1177857250-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:25.399011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02a62802-a41c-489d-87e9-151be81ee2be tempest-PortsAdminExtendedAttrsTestJSON-1177857250 tempest-PortsAdminExtendedAttrsTestJSON-1177857250-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:25.399465 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02a62802-a41c-489d-87e9-151be81ee2be tempest-PortsAdminExtendedAttrsTestJSON-1177857250 tempest-PortsAdminExtendedAttrsTestJSON-1177857250-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:25.410799 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02a62802-a41c-489d-87e9-151be81ee2be tempest-PortsAdminExtendedAttrsTestJSON-1177857250 tempest-PortsAdminExtendedAttrsTestJSON-1177857250-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:25.410951 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02a62802-a41c-489d-87e9-151be81ee2be tempest-PortsAdminExtendedAttrsTestJSON-1177857250 tempest-PortsAdminExtendedAttrsTestJSON-1177857250-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:25.411390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02a62802-a41c-489d-87e9-151be81ee2be tempest-PortsAdminExtendedAttrsTestJSON-1177857250 tempest-PortsAdminExtendedAttrsTestJSON-1177857250-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:25.419842 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-02a62802-a41c-489d-87e9-151be81ee2be tempest-PortsAdminExtendedAttrsTestJSON-1177857250 tempest-PortsAdminExtendedAttrsTestJSON-1177857250-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.536179 Sep 17 21:13:25.428032 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2543/4984] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 21:13:24 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:13:25.445350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-65d27421-ce3a-4cd2-84ad-f43d851fcad0 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:25.445904 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-65d27421-ce3a-4cd2-84ad-f43d851fcad0 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:25.446356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-65d27421-ce3a-4cd2-84ad-f43d851fcad0 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:25.447023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-65d27421-ce3a-4cd2-84ad-f43d851fcad0 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lazy-loading 'fault' on Instance uuid 893e8bd4-4560-4ebe-8abe-635d5413c433 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:13:25.509048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-65d27421-ce3a-4cd2-84ad-f43d851fcad0 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784233ee78764e7dbb774d3cb50165e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6f25c3540546bf9bffd5610f4f86c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:25.520737 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-65d27421-ce3a-4cd2-84ad-f43d851fcad0 tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/893e8bd4-4560-4ebe-8abe-635d5413c433" status: 200 len: 1282 microversion: 2.1 time: 0.157715 Sep 17 21:13:25.520737 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2442/4985] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:25 2022] GET /compute/v2.1/servers/893e8bd4-4560-4ebe-8abe-635d5413c433 => generated 1282 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:26.240983 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-17736217-07d0-468e-837c-297ea697278f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:26.241657 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-17736217-07d0-468e-837c-297ea697278f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:26.260875 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17736217-07d0-468e-837c-297ea697278f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:26.261410 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17736217-07d0-468e-837c-297ea697278f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:26.264871 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17736217-07d0-468e-837c-297ea697278f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:26.266013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17736217-07d0-468e-837c-297ea697278f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:26.266498 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17736217-07d0-468e-837c-297ea697278f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:26.266943 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17736217-07d0-468e-837c-297ea697278f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:26.544501 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-36e5ccf6-143f-4e90-94b3-f55feb29d58a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:26.546051 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-36e5ccf6-143f-4e90-94b3-f55feb29d58a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] [instance: 893e8bd4-4560-4ebe-8abe-635d5413c433] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:26.555129 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36e5ccf6-143f-4e90-94b3-f55feb29d58a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:26.556022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36e5ccf6-143f-4e90-94b3-f55feb29d58a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:26.556755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36e5ccf6-143f-4e90-94b3-f55feb29d58a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:26.558604 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36e5ccf6-143f-4e90-94b3-f55feb29d58a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:26.559489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36e5ccf6-143f-4e90-94b3-f55feb29d58a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:26.560509 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36e5ccf6-143f-4e90-94b3-f55feb29d58a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:26.580341 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-36e5ccf6-143f-4e90-94b3-f55feb29d58a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] HTTP exception thrown: Instance 893e8bd4-4560-4ebe-8abe-635d5413c433 could not be found. Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-36e5ccf6-143f-4e90-94b3-f55feb29d58a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Request method failure captured: Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/893e8bd4-4560-4ebe-8abe-635d5413c433 HTTP/1.1 Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjdkx_dUaa7DUi-TKVFHTZsVxQrlexvG4SUZm6N8-RAgW-Hgl4Fm16QKjLB8Smzb7fg0_3Heh2RxRO4DM6alOpTGfM4lDQjx-JBymYUztOAuBANR84PPvzFMKCK9hdlODMbdRT3LVU-maWvSxN-XNtXdSltD2p8By-EmBSmK4dFa6Xo Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersTestJSON-167161476 Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b6f25c3540546bf9bffd5610f4f86c8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b6f25c3540546bf9bffd5610f4f86c8", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersTestJSON-167161476 Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 0b6f25c3540546bf9bffd5610f4f86c8 Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersTestJSON-167161476 Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersTestJSON-167161476-project Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 784233ee78764e7dbb774d3cb50165e3 Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersTestJSON-167161476-project Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 893e8bd4-4560-4ebe-8abe-635d5413c433 could not be found. Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '893e8bd4-4560-4ebe-8abe-635d5413c433'} Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 893e8bd4-4560-4ebe-8abe-635d5413c433 could not be found. Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 893e8bd4-4560-4ebe-8abe-635d5413c433 could not be found. Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:26.582411 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:13:26.587389 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:13:26.587389 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:13:26.587389 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:13:26.587389 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:13:26.587389 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 893e8bd4-4560-4ebe-8abe-635d5413c433 could not be found. Sep 17 21:13:26.587389 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:13:26.589649 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-36e5ccf6-143f-4e90-94b3-f55feb29d58a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] Returning 404 to user: Instance 893e8bd4-4560-4ebe-8abe-635d5413c433 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:13:26.591304 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-36e5ccf6-143f-4e90-94b3-f55feb29d58a tempest-ServersTestJSON-167161476 tempest-ServersTestJSON-167161476-project] 10.222.0.26 "GET /compute/v2.1/servers/893e8bd4-4560-4ebe-8abe-635d5413c433" status: 404 len: 111 microversion: 2.1 time: 0.051674 Sep 17 21:13:26.592135 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2443/4986] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:26 2022] GET /compute/v2.1/servers/893e8bd4-4560-4ebe-8abe-635d5413c433 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:13:27.185532 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-17736217-07d0-468e-837c-297ea697278f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:27.200407 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-17736217-07d0-468e-837c-297ea697278f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1523 microversion: 2.1 time: 0.967702 Sep 17 21:13:27.201678 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2544/4987] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:26 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1523 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:13:28.227705 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3f067383-63ff-4eca-aaab-065c49f7f4db tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:28.229213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3f067383-63ff-4eca-aaab-065c49f7f4db tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:28.251405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f067383-63ff-4eca-aaab-065c49f7f4db tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:28.251965 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f067383-63ff-4eca-aaab-065c49f7f4db tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:28.252417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f067383-63ff-4eca-aaab-065c49f7f4db tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:28.254873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f067383-63ff-4eca-aaab-065c49f7f4db tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:28.256763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f067383-63ff-4eca-aaab-065c49f7f4db tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:28.258457 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f067383-63ff-4eca-aaab-065c49f7f4db tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:28.652331 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3f067383-63ff-4eca-aaab-065c49f7f4db tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:28.667263 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3f067383-63ff-4eca-aaab-065c49f7f4db tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1523 microversion: 2.1 time: 0.445676 Sep 17 21:13:28.667865 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2444/4988] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:28 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1523 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:29.694787 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-086ac2c5-8801-47fb-8ab9-b636c4fda4f2 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:29.696843 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-086ac2c5-8801-47fb-8ab9-b636c4fda4f2 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:29.711313 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-086ac2c5-8801-47fb-8ab9-b636c4fda4f2 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:29.711912 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-086ac2c5-8801-47fb-8ab9-b636c4fda4f2 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:29.712575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-086ac2c5-8801-47fb-8ab9-b636c4fda4f2 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:29.714518 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-086ac2c5-8801-47fb-8ab9-b636c4fda4f2 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:29.715018 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-086ac2c5-8801-47fb-8ab9-b636c4fda4f2 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:29.715472 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-086ac2c5-8801-47fb-8ab9-b636c4fda4f2 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:30.412470 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-086ac2c5-8801-47fb-8ab9-b636c4fda4f2 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:30.423839 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-086ac2c5-8801-47fb-8ab9-b636c4fda4f2 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1523 microversion: 2.1 time: 0.734514 Sep 17 21:13:30.446822 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2545/4989] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:29 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1523 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:31.449646 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d0bec1ea-d2e6-4afe-919e-624b9f449f04 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:31.450933 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d0bec1ea-d2e6-4afe-919e-624b9f449f04 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:31.465169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d0bec1ea-d2e6-4afe-919e-624b9f449f04 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:31.465873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d0bec1ea-d2e6-4afe-919e-624b9f449f04 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:31.466724 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d0bec1ea-d2e6-4afe-919e-624b9f449f04 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:31.467630 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d0bec1ea-d2e6-4afe-919e-624b9f449f04 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:31.468240 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d0bec1ea-d2e6-4afe-919e-624b9f449f04 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:31.472909 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d0bec1ea-d2e6-4afe-919e-624b9f449f04 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:31.693522 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d0bec1ea-d2e6-4afe-919e-624b9f449f04 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:31.706465 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d0bec1ea-d2e6-4afe-919e-624b9f449f04 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1523 microversion: 2.1 time: 0.261983 Sep 17 21:13:31.722042 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2445/4990] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:31 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1523 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:32.734542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6bafeb0c-f1e7-4afa-93e4-dbfa9ea957e1 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:32.735151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6bafeb0c-f1e7-4afa-93e4-dbfa9ea957e1 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:32.749525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6bafeb0c-f1e7-4afa-93e4-dbfa9ea957e1 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:32.752011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6bafeb0c-f1e7-4afa-93e4-dbfa9ea957e1 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:32.752472 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6bafeb0c-f1e7-4afa-93e4-dbfa9ea957e1 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:32.754491 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6bafeb0c-f1e7-4afa-93e4-dbfa9ea957e1 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:32.756716 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6bafeb0c-f1e7-4afa-93e4-dbfa9ea957e1 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:32.757116 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6bafeb0c-f1e7-4afa-93e4-dbfa9ea957e1 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:33.147285 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6bafeb0c-f1e7-4afa-93e4-dbfa9ea957e1 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:33.174945 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6bafeb0c-f1e7-4afa-93e4-dbfa9ea957e1 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1523 microversion: 2.1 time: 0.444399 Sep 17 21:13:33.177368 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2546/4991] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:32 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1523 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:13:34.200912 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-df526d4a-0156-4e57-909d-e5278cc65947 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:34.201567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-df526d4a-0156-4e57-909d-e5278cc65947 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:34.217597 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df526d4a-0156-4e57-909d-e5278cc65947 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:34.218106 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df526d4a-0156-4e57-909d-e5278cc65947 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:34.218550 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df526d4a-0156-4e57-909d-e5278cc65947 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:34.219504 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df526d4a-0156-4e57-909d-e5278cc65947 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:34.220148 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df526d4a-0156-4e57-909d-e5278cc65947 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:34.220756 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df526d4a-0156-4e57-909d-e5278cc65947 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:34.819412 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-df526d4a-0156-4e57-909d-e5278cc65947 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:34.829754 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-df526d4a-0156-4e57-909d-e5278cc65947 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1523 microversion: 2.1 time: 0.633432 Sep 17 21:13:34.830647 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2446/4992] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:34 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1523 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:35.862443 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-73bda9dd-5182-42a3-88e4-903648884477 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:35.863919 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-73bda9dd-5182-42a3-88e4-903648884477 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:35.871557 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:13:35.876855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-73bda9dd-5182-42a3-88e4-903648884477 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:35.878292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-73bda9dd-5182-42a3-88e4-903648884477 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:35.878963 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-73bda9dd-5182-42a3-88e4-903648884477 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:35.879931 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-73bda9dd-5182-42a3-88e4-903648884477 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:35.880631 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-73bda9dd-5182-42a3-88e4-903648884477 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:35.881285 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-73bda9dd-5182-42a3-88e4-903648884477 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:36.457180 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-73bda9dd-5182-42a3-88e4-903648884477 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:36.482343 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-73bda9dd-5182-42a3-88e4-903648884477 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1523 microversion: 2.1 time: 0.626083 Sep 17 21:13:36.486453 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2547/4993] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:35 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1523 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:37.513412 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d4d0917e-71fd-43ac-ae47-585460850dd7 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:37.514162 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d4d0917e-71fd-43ac-ae47-585460850dd7 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:37.534065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=73 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:13:37.540846 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d4d0917e-71fd-43ac-ae47-585460850dd7 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:37.553576 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d4d0917e-71fd-43ac-ae47-585460850dd7 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:37.554658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d4d0917e-71fd-43ac-ae47-585460850dd7 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:37.564786 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d4d0917e-71fd-43ac-ae47-585460850dd7 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:37.566100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d4d0917e-71fd-43ac-ae47-585460850dd7 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:37.566856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d4d0917e-71fd-43ac-ae47-585460850dd7 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:38.341172 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-73bda9dd-5182-42a3-88e4-903648884477 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:38.343146 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-73bda9dd-5182-42a3-88e4-903648884477 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002200 Sep 17 21:13:38.343674 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2548/4994] 10.222.0.26 () {56 vars in 886 bytes} [Sat Sep 17 21:13:38 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Sep 17 21:13:38.353255 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-73bda9dd-5182-42a3-88e4-903648884477 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:38.354800 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-73bda9dd-5182-42a3-88e4-903648884477 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002084 Sep 17 21:13:38.355769 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2549/4995] 10.222.0.26 () {54 vars in 1035 bytes} [Sat Sep 17 21:13:38 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (2 switches on core 0) Sep 17 21:13:38.366185 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-73bda9dd-5182-42a3-88e4-903648884477 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:38.369295 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-73bda9dd-5182-42a3-88e4-903648884477 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.004428 Sep 17 21:13:38.371478 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2550/4996] 10.222.0.26 () {54 vars in 1041 bytes} [Sat Sep 17 21:13:38 2022] GET /compute/v2.1/ => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:13:38.371745 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d4d0917e-71fd-43ac-ae47-585460850dd7 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:38.381177 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-73bda9dd-5182-42a3-88e4-903648884477 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:38.385781 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-73bda9dd-5182-42a3-88e4-903648884477 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004899 Sep 17 21:13:38.387941 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d4d0917e-71fd-43ac-ae47-585460850dd7 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1523 microversion: 2.1 time: 0.879109 Sep 17 21:13:38.389635 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2551/4997] 10.222.0.26 () {56 vars in 886 bytes} [Sat Sep 17 21:13:38 2022] GET /compute/ => generated 377 bytes in 10 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 17 21:13:38.390779 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2447/4998] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:37 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1523 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:39.423718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-53775c7b-8947-4ab4-97b9-3bb42287ab5f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:39.425119 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-53775c7b-8947-4ab4-97b9-3bb42287ab5f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:39.445713 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53775c7b-8947-4ab4-97b9-3bb42287ab5f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:39.451140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53775c7b-8947-4ab4-97b9-3bb42287ab5f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:39.452054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53775c7b-8947-4ab4-97b9-3bb42287ab5f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:39.453164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53775c7b-8947-4ab4-97b9-3bb42287ab5f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:39.454373 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53775c7b-8947-4ab4-97b9-3bb42287ab5f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:39.456124 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53775c7b-8947-4ab4-97b9-3bb42287ab5f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:41.031147 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-53775c7b-8947-4ab4-97b9-3bb42287ab5f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:41.039729 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-53775c7b-8947-4ab4-97b9-3bb42287ab5f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1523 microversion: 2.1 time: 1.622019 Sep 17 21:13:41.044203 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2552/4999] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:39 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1523 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:42.070336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4f30cf15-6d78-4219-8c68-ddb8e183ab2d tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:42.070961 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4f30cf15-6d78-4219-8c68-ddb8e183ab2d tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:42.088168 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f30cf15-6d78-4219-8c68-ddb8e183ab2d tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:42.089607 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f30cf15-6d78-4219-8c68-ddb8e183ab2d tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:42.091614 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f30cf15-6d78-4219-8c68-ddb8e183ab2d tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:42.094160 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f30cf15-6d78-4219-8c68-ddb8e183ab2d tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:42.094852 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f30cf15-6d78-4219-8c68-ddb8e183ab2d tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:42.096747 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f30cf15-6d78-4219-8c68-ddb8e183ab2d tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:42.328505 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ff972067-a961-4f23-a789-52519c6df2c1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-315256148", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "567eddc7-5ea4-4e03-a964-d97c8980e690"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1819630111", "security_groups": []}, "os:scheduler_hints": {"different_host": ["ecbd9cec-fdea-45b2-bb96-487bdaf97635"]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:13:42.369895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4f30cf15-6d78-4219-8c68-ddb8e183ab2d tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:42.384214 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4f30cf15-6d78-4219-8c68-ddb8e183ab2d tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1523 microversion: 2.1 time: 0.317954 Sep 17 21:13:42.386960 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2448/5000] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:42 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1523 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:42.466635 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-ff972067-a961-4f23-a789-52519c6df2c1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] validate_networks() for [('567eddc7-5ea4-4e03-a964-d97c8980e690', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:13:43.408187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-625ab0cc-b4b8-417c-bf53-e686c5531e2d tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:43.409517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-625ab0cc-b4b8-417c-bf53-e686c5531e2d tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:43.426468 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-625ab0cc-b4b8-417c-bf53-e686c5531e2d tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:43.426869 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-625ab0cc-b4b8-417c-bf53-e686c5531e2d tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:43.431987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-625ab0cc-b4b8-417c-bf53-e686c5531e2d tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:43.432849 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-625ab0cc-b4b8-417c-bf53-e686c5531e2d tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:43.435999 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-625ab0cc-b4b8-417c-bf53-e686c5531e2d tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:43.440056 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-625ab0cc-b4b8-417c-bf53-e686c5531e2d tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:43.478691 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:13:43.826121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-625ab0cc-b4b8-417c-bf53-e686c5531e2d tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:43.835413 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-625ab0cc-b4b8-417c-bf53-e686c5531e2d tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1523 microversion: 2.1 time: 0.431003 Sep 17 21:13:43.838843 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2449/5001] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:43 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1523 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:13:43.990102 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-ff972067-a961-4f23-a789-52519c6df2c1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:13:43.990601 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-ff972067-a961-4f23-a789-52519c6df2c1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:13:43.991001 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-ff972067-a961-4f23-a789-52519c6df2c1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:13:43.991415 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-ff972067-a961-4f23-a789-52519c6df2c1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:13:43.991815 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-ff972067-a961-4f23-a789-52519c6df2c1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:13:44.011180 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff972067-a961-4f23-a789-52519c6df2c1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:44.013025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff972067-a961-4f23-a789-52519c6df2c1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:44.015127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff972067-a961-4f23-a789-52519c6df2c1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:44.016116 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff972067-a961-4f23-a789-52519c6df2c1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:44.018939 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff972067-a961-4f23-a789-52519c6df2c1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:44.019573 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff972067-a961-4f23-a789-52519c6df2c1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:44.087301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-ff972067-a961-4f23-a789-52519c6df2c1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Getting quotas for project cfc26054d4a34fb2b2aef34fb4891b4c. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:13:44.105713 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-ff972067-a961-4f23-a789-52519c6df2c1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Getting quotas for user caa2c2f4848e497f80d4a439c785c2b0 and project cfc26054d4a34fb2b2aef34fb4891b4c. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:13:44.135367 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ff972067-a961-4f23-a789-52519c6df2c1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:13:44.146070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ff972067-a961-4f23-a789-52519c6df2c1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: a8bdbeff-7f16-4d67-823e-df6ec3e09842] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:13:44.222856 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ff972067-a961-4f23-a789-52519c6df2c1 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.901627 Sep 17 21:13:44.236574 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3e2a32bf-b2f7-40bc-962b-688462caa0aa tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:44.237732 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2553/5002] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:13:42 2022] POST /compute/v2.1/servers => generated 361 bytes in 1918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:13:44.238309 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3e2a32bf-b2f7-40bc-962b-688462caa0aa tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: a8bdbeff-7f16-4d67-823e-df6ec3e09842] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:44.365693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3e2a32bf-b2f7-40bc-962b-688462caa0aa tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:44.381195 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3e2a32bf-b2f7-40bc-962b-688462caa0aa tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842" status: 200 len: 1241 microversion: 2.1 time: 0.146992 Sep 17 21:13:44.395572 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2450/5003] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:44 2022] GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842 => generated 1241 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:44.866847 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cbd061f8-9a29-4911-a595-13ad0630efa8 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:44.868061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cbd061f8-9a29-4911-a595-13ad0630efa8 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:44.892547 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbd061f8-9a29-4911-a595-13ad0630efa8 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:44.899216 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbd061f8-9a29-4911-a595-13ad0630efa8 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:44.900283 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbd061f8-9a29-4911-a595-13ad0630efa8 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:44.901241 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbd061f8-9a29-4911-a595-13ad0630efa8 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:44.901730 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbd061f8-9a29-4911-a595-13ad0630efa8 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:44.907859 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbd061f8-9a29-4911-a595-13ad0630efa8 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:45.413112 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-043b9fc0-8461-4867-abae-c2760b4231ac tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:45.414233 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-043b9fc0-8461-4867-abae-c2760b4231ac tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: a8bdbeff-7f16-4d67-823e-df6ec3e09842] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:45.434032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-043b9fc0-8461-4867-abae-c2760b4231ac tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:45.452404 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-043b9fc0-8461-4867-abae-c2760b4231ac tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:45.453595 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-043b9fc0-8461-4867-abae-c2760b4231ac tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:45.456244 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-043b9fc0-8461-4867-abae-c2760b4231ac tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:45.458105 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-043b9fc0-8461-4867-abae-c2760b4231ac tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:45.460963 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-043b9fc0-8461-4867-abae-c2760b4231ac tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:45.635552 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cbd061f8-9a29-4911-a595-13ad0630efa8 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:45.637846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:13:45.648671 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cbd061f8-9a29-4911-a595-13ad0630efa8 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1523 microversion: 2.1 time: 0.788396 Sep 17 21:13:45.649271 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2554/5004] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:44 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1523 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:45.792253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-043b9fc0-8461-4867-abae-c2760b4231ac tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:45.801066 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-043b9fc0-8461-4867-abae-c2760b4231ac tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842" status: 200 len: 1245 microversion: 2.1 time: 0.395000 Sep 17 21:13:45.801685 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2451/5005] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:45 2022] GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842 => generated 1245 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:46.675641 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5526db7d-e2be-419c-a403-9f58aa6c90d1 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:46.677011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5526db7d-e2be-419c-a403-9f58aa6c90d1 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:46.693331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5526db7d-e2be-419c-a403-9f58aa6c90d1 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:46.697115 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5526db7d-e2be-419c-a403-9f58aa6c90d1 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:46.698023 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5526db7d-e2be-419c-a403-9f58aa6c90d1 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:46.703741 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5526db7d-e2be-419c-a403-9f58aa6c90d1 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:46.705954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5526db7d-e2be-419c-a403-9f58aa6c90d1 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:46.707251 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5526db7d-e2be-419c-a403-9f58aa6c90d1 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:46.829611 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-69d9d640-f09d-4797-a98b-355be0b43eab tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:46.835447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-69d9d640-f09d-4797-a98b-355be0b43eab tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: a8bdbeff-7f16-4d67-823e-df6ec3e09842] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:46.845452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69d9d640-f09d-4797-a98b-355be0b43eab tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:46.848261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69d9d640-f09d-4797-a98b-355be0b43eab tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:46.848735 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69d9d640-f09d-4797-a98b-355be0b43eab tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:46.849717 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69d9d640-f09d-4797-a98b-355be0b43eab tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:46.850358 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69d9d640-f09d-4797-a98b-355be0b43eab tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:46.850838 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69d9d640-f09d-4797-a98b-355be0b43eab tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:47.146327 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-69d9d640-f09d-4797-a98b-355be0b43eab tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:47.157918 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-69d9d640-f09d-4797-a98b-355be0b43eab tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842" status: 200 len: 1299 microversion: 2.1 time: 0.334702 Sep 17 21:13:47.160094 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2452/5006] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:46 2022] GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842 => generated 1299 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:47.334308 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5526db7d-e2be-419c-a403-9f58aa6c90d1 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:47.346328 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5526db7d-e2be-419c-a403-9f58aa6c90d1 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1523 microversion: 2.1 time: 0.675575 Sep 17 21:13:47.350498 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2555/5007] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:46 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1523 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:48.185240 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a01954ab-5795-4201-a6e4-fbd18b8bc605 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:48.186362 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a01954ab-5795-4201-a6e4-fbd18b8bc605 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: a8bdbeff-7f16-4d67-823e-df6ec3e09842] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:48.209840 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a01954ab-5795-4201-a6e4-fbd18b8bc605 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:48.210349 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a01954ab-5795-4201-a6e4-fbd18b8bc605 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:48.217286 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a01954ab-5795-4201-a6e4-fbd18b8bc605 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:48.222552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a01954ab-5795-4201-a6e4-fbd18b8bc605 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:48.223763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a01954ab-5795-4201-a6e4-fbd18b8bc605 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:48.225173 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a01954ab-5795-4201-a6e4-fbd18b8bc605 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:48.375598 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a968de20-f8ff-40c3-bbae-f10f6367aeb6 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:48.376349 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a968de20-f8ff-40c3-bbae-f10f6367aeb6 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:48.391396 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a968de20-f8ff-40c3-bbae-f10f6367aeb6 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:48.394462 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a968de20-f8ff-40c3-bbae-f10f6367aeb6 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:48.395096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a968de20-f8ff-40c3-bbae-f10f6367aeb6 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:48.395755 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a968de20-f8ff-40c3-bbae-f10f6367aeb6 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:48.396144 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a968de20-f8ff-40c3-bbae-f10f6367aeb6 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:48.396605 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a968de20-f8ff-40c3-bbae-f10f6367aeb6 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:48.567616 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a01954ab-5795-4201-a6e4-fbd18b8bc605 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:48.580358 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a01954ab-5795-4201-a6e4-fbd18b8bc605 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842" status: 200 len: 1299 microversion: 2.1 time: 0.399446 Sep 17 21:13:48.580969 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2453/5008] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:48 2022] GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842 => generated 1299 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:48.869329 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a968de20-f8ff-40c3-bbae-f10f6367aeb6 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:48.877939 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a968de20-f8ff-40c3-bbae-f10f6367aeb6 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1523 microversion: 2.1 time: 0.508142 Sep 17 21:13:48.889908 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2556/5009] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:48 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1523 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:13:49.607725 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-36596442-7a6e-494a-a328-a0fab948e481 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:49.615130 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-36596442-7a6e-494a-a328-a0fab948e481 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: a8bdbeff-7f16-4d67-823e-df6ec3e09842] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:49.656877 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36596442-7a6e-494a-a328-a0fab948e481 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:49.657322 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36596442-7a6e-494a-a328-a0fab948e481 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:49.657744 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36596442-7a6e-494a-a328-a0fab948e481 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:49.658899 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36596442-7a6e-494a-a328-a0fab948e481 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:49.659599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36596442-7a6e-494a-a328-a0fab948e481 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:49.660039 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36596442-7a6e-494a-a328-a0fab948e481 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:49.916154 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-36596442-7a6e-494a-a328-a0fab948e481 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:49.922744 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a2afa01d-0e92-42fa-9657-0d41176e2c78 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:49.923373 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a2afa01d-0e92-42fa-9657-0d41176e2c78 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:49.940255 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-36596442-7a6e-494a-a328-a0fab948e481 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842" status: 200 len: 1299 microversion: 2.1 time: 0.333087 Sep 17 21:13:49.940911 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2454/5010] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:49 2022] GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842 => generated 1299 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:49.957954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a2afa01d-0e92-42fa-9657-0d41176e2c78 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:49.960305 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a2afa01d-0e92-42fa-9657-0d41176e2c78 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:49.960780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a2afa01d-0e92-42fa-9657-0d41176e2c78 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:49.964850 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a2afa01d-0e92-42fa-9657-0d41176e2c78 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:49.965728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a2afa01d-0e92-42fa-9657-0d41176e2c78 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:49.966196 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a2afa01d-0e92-42fa-9657-0d41176e2c78 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:50.520442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a2afa01d-0e92-42fa-9657-0d41176e2c78 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:50.541349 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a2afa01d-0e92-42fa-9657-0d41176e2c78 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1503 microversion: 2.1 time: 0.640083 Sep 17 21:13:50.563819 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2557/5011] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:49 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1503 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:50.579931 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7e353209-759a-4eed-8b60-8236f3f68b4b tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Action: 'create', calling method: .version_select at 0x7f25a4d73310>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-632911269", "description": "tempest-description-250879281"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:13:50.794802 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-58325cd5-159b-4c61-913f-9ba7267a948f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:50.795380 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-58325cd5-159b-4c61-913f-9ba7267a948f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:50.805059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58325cd5-159b-4c61-913f-9ba7267a948f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:50.808419 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58325cd5-159b-4c61-913f-9ba7267a948f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:50.818244 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58325cd5-159b-4c61-913f-9ba7267a948f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:50.819036 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58325cd5-159b-4c61-913f-9ba7267a948f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:50.819519 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58325cd5-159b-4c61-913f-9ba7267a948f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:50.819962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-58325cd5-159b-4c61-913f-9ba7267a948f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:50.896829 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-58325cd5-159b-4c61-913f-9ba7267a948f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:13:51.133838 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-58325cd5-159b-4c61-913f-9ba7267a948f tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "DELETE /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 204 len: 0 microversion: 2.42 time: 0.977848 Sep 17 21:13:51.134465 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2455/5012] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 17 21:13:50 2022] DELETE /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 0 bytes in 981 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 21:13:51.142599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f1220a5f-cefe-452d-ba00-5290b0192f8b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:51.143591 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f1220a5f-cefe-452d-ba00-5290b0192f8b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: a8bdbeff-7f16-4d67-823e-df6ec3e09842] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:51.151151 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1220a5f-cefe-452d-ba00-5290b0192f8b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:51.153887 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1220a5f-cefe-452d-ba00-5290b0192f8b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:51.155117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1220a5f-cefe-452d-ba00-5290b0192f8b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:51.155932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1220a5f-cefe-452d-ba00-5290b0192f8b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:51.157243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1220a5f-cefe-452d-ba00-5290b0192f8b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:51.158169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1220a5f-cefe-452d-ba00-5290b0192f8b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:51.464482 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f1220a5f-cefe-452d-ba00-5290b0192f8b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:51.479078 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f1220a5f-cefe-452d-ba00-5290b0192f8b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842" status: 200 len: 1299 microversion: 2.1 time: 0.342734 Sep 17 21:13:51.482280 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2456/5013] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:51 2022] GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842 => generated 1299 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:51.498944 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6767565e-169f-4a44-84f1-572a30435052 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:51.501237 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6767565e-169f-4a44-84f1-572a30435052 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:51.523231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6767565e-169f-4a44-84f1-572a30435052 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:51.524014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6767565e-169f-4a44-84f1-572a30435052 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:51.526672 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6767565e-169f-4a44-84f1-572a30435052 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:51.540531 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6767565e-169f-4a44-84f1-572a30435052 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:51.541312 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6767565e-169f-4a44-84f1-572a30435052 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:51.542364 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6767565e-169f-4a44-84f1-572a30435052 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:51.695966 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7e353209-759a-4eed-8b60-8236f3f68b4b tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 1.127730 Sep 17 21:13:51.697196 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2558/5014] 10.222.0.26 () {60 vars in 1180 bytes} [Sat Sep 17 21:13:50 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:13:51.711961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b747cd1b-69a1-478c-816f-c7db58936058 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-632911269"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:13:51.712712 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b747cd1b-69a1-478c-816f-c7db58936058 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:51.723244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b747cd1b-69a1-478c-816f-c7db58936058 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:51.723983 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b747cd1b-69a1-478c-816f-c7db58936058 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:51.730651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b747cd1b-69a1-478c-816f-c7db58936058 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:51.731079 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b747cd1b-69a1-478c-816f-c7db58936058 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:51.731559 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b747cd1b-69a1-478c-816f-c7db58936058 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:51.732133 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b747cd1b-69a1-478c-816f-c7db58936058 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:52.727617 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.network.security_group_api [None req-b747cd1b-69a1-478c-816f-c7db58936058 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Adding security group cd98bc0d-63f6-4c0c-9b4f-3b6ecd5cb48e to port 64dac991-3106-4bed-aa53-9b65aedc4b13 Sep 17 21:13:52.767376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6767565e-169f-4a44-84f1-572a30435052 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:52.792086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6767565e-169f-4a44-84f1-572a30435052 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:52.811651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6767565e-169f-4a44-84f1-572a30435052 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:52.817712 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6767565e-169f-4a44-84f1-572a30435052 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 2957 microversion: 2.42 time: 1.333943 Sep 17 21:13:52.821027 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2457/5015] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:51 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 2957 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:52.835274 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-81617e6e-e1b3-424a-8f6f-5e9bf891cb48 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:52.837748 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-81617e6e-e1b3-424a-8f6f-5e9bf891cb48 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: a8bdbeff-7f16-4d67-823e-df6ec3e09842] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:52.854395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81617e6e-e1b3-424a-8f6f-5e9bf891cb48 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:52.860009 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81617e6e-e1b3-424a-8f6f-5e9bf891cb48 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:52.865390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81617e6e-e1b3-424a-8f6f-5e9bf891cb48 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:52.868357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81617e6e-e1b3-424a-8f6f-5e9bf891cb48 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:52.870521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81617e6e-e1b3-424a-8f6f-5e9bf891cb48 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:52.871937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81617e6e-e1b3-424a-8f6f-5e9bf891cb48 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:53.401723 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-81617e6e-e1b3-424a-8f6f-5e9bf891cb48 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:53.411669 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-81617e6e-e1b3-424a-8f6f-5e9bf891cb48 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842" status: 200 len: 1299 microversion: 2.1 time: 0.589184 Sep 17 21:13:53.412479 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2458/5016] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:52 2022] GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842 => generated 1299 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:53.820383 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-e86087a4-8b6f-4bc3-ad91-0bfe0528698b req-1c740a80-5b20-4be7-9b47-e26b94dd7760 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8bdbeff-7f16-4d67-823e-df6ec3e09842", "tag": "172671df-7dc4-4512-ac66-f01f8e2d77d5"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:13:53.837741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-e86087a4-8b6f-4bc3-ad91-0bfe0528698b req-1c740a80-5b20-4be7-9b47-e26b94dd7760 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:53.842228 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-e86087a4-8b6f-4bc3-ad91-0bfe0528698b req-1c740a80-5b20-4be7-9b47-e26b94dd7760 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:53.842969 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-e86087a4-8b6f-4bc3-ad91-0bfe0528698b req-1c740a80-5b20-4be7-9b47-e26b94dd7760 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:53.876742 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-e86087a4-8b6f-4bc3-ad91-0bfe0528698b req-1c740a80-5b20-4be7-9b47-e26b94dd7760 service nova] Creating event network-changed:172671df-7dc4-4512-ac66-f01f8e2d77d5 for instance a8bdbeff-7f16-4d67-823e-df6ec3e09842 on nch1-master-1 Sep 17 21:13:53.888005 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-e86087a4-8b6f-4bc3-ad91-0bfe0528698b req-1c740a80-5b20-4be7-9b47-e26b94dd7760 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.355783 Sep 17 21:13:53.889281 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2459/5017] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:13:53.895360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-07a0e548-eca8-403a-b418-df6577ee9651 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:53.900548 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-07a0e548-eca8-403a-b418-df6577ee9651 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:53.917937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-07a0e548-eca8-403a-b418-df6577ee9651 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:53.928844 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-07a0e548-eca8-403a-b418-df6577ee9651 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:53.934776 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-07a0e548-eca8-403a-b418-df6577ee9651 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:53.935866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-07a0e548-eca8-403a-b418-df6577ee9651 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:53.937372 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-07a0e548-eca8-403a-b418-df6577ee9651 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:53.937953 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-07a0e548-eca8-403a-b418-df6577ee9651 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:54.068410 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:13:54.128956 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=6 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:13:54.379414 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:13:54.805310 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b747cd1b-69a1-478c-816f-c7db58936058 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "POST /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c/action" status: 202 len: 0 microversion: 2.1 time: 3.098152 Sep 17 21:13:54.805972 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2559/5018] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:13:51 2022] POST /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c/action => generated 0 bytes in 3100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 17 21:13:54.826460 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-47a096ed-a5ee-4934-a171-84a128c9dcad tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:54.827286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-47a096ed-a5ee-4934-a171-84a128c9dcad tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: a8bdbeff-7f16-4d67-823e-df6ec3e09842] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:54.850503 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-47a096ed-a5ee-4934-a171-84a128c9dcad tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:54.851112 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-47a096ed-a5ee-4934-a171-84a128c9dcad tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:54.851571 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-47a096ed-a5ee-4934-a171-84a128c9dcad tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:54.855939 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-47a096ed-a5ee-4934-a171-84a128c9dcad tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:54.856370 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-47a096ed-a5ee-4934-a171-84a128c9dcad tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:54.856823 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-47a096ed-a5ee-4934-a171-84a128c9dcad tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:55.091346 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-07a0e548-eca8-403a-b418-df6577ee9651 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:55.105454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-07a0e548-eca8-403a-b418-df6577ee9651 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:55.107351 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-07a0e548-eca8-403a-b418-df6577ee9651 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:55.116035 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-07a0e548-eca8-403a-b418-df6577ee9651 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 2957 microversion: 2.42 time: 1.220955 Sep 17 21:13:55.139981 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2460/5019] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:53 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 2957 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:55.157116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-995ee0f7-11c5-4bcb-b212-24c462a7e70f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-632911269"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:13:55.158408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-995ee0f7-11c5-4bcb-b212-24c462a7e70f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:55.165593 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-995ee0f7-11c5-4bcb-b212-24c462a7e70f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:55.170100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-995ee0f7-11c5-4bcb-b212-24c462a7e70f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:55.170805 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-995ee0f7-11c5-4bcb-b212-24c462a7e70f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:55.171754 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-995ee0f7-11c5-4bcb-b212-24c462a7e70f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:55.172379 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-995ee0f7-11c5-4bcb-b212-24c462a7e70f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:55.175196 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-995ee0f7-11c5-4bcb-b212-24c462a7e70f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:55.920265 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-47a096ed-a5ee-4934-a171-84a128c9dcad tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:55.928159 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-47a096ed-a5ee-4934-a171-84a128c9dcad tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842" status: 200 len: 1299 microversion: 2.1 time: 1.117600 Sep 17 21:13:55.942015 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2560/5020] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:54 2022] GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842 => generated 1299 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:55.958525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-480ffe94-fdbd-4bc2-b3b3-53a133c29431 req-3bab85c4-d4cc-46e5-92fa-16304ecbd95e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c45f5fe-2176-44d4-a8b5-972d6b92d53c", "tag": "64dac991-3106-4bed-aa53-9b65aedc4b13"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:13:55.970116 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-480ffe94-fdbd-4bc2-b3b3-53a133c29431 req-3bab85c4-d4cc-46e5-92fa-16304ecbd95e service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:55.971176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-480ffe94-fdbd-4bc2-b3b3-53a133c29431 req-3bab85c4-d4cc-46e5-92fa-16304ecbd95e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:55.972089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-480ffe94-fdbd-4bc2-b3b3-53a133c29431 req-3bab85c4-d4cc-46e5-92fa-16304ecbd95e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:55.988417 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-480ffe94-fdbd-4bc2-b3b3-53a133c29431 req-3bab85c4-d4cc-46e5-92fa-16304ecbd95e service nova] Creating event network-changed:64dac991-3106-4bed-aa53-9b65aedc4b13 for instance 6c45f5fe-2176-44d4-a8b5-972d6b92d53c on nch1-master-1 Sep 17 21:13:55.999387 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-480ffe94-fdbd-4bc2-b3b3-53a133c29431 req-3bab85c4-d4cc-46e5-92fa-16304ecbd95e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055458 Sep 17 21:13:56.000527 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2561/5021] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:13:56.149649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2c04b3bc-5725-4626-a1ff-baeadda9d818 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:56.150852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2c04b3bc-5725-4626-a1ff-baeadda9d818 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:56.160650 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c04b3bc-5725-4626-a1ff-baeadda9d818 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:56.160946 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c04b3bc-5725-4626-a1ff-baeadda9d818 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:56.161392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c04b3bc-5725-4626-a1ff-baeadda9d818 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:56.166802 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c04b3bc-5725-4626-a1ff-baeadda9d818 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:56.168786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c04b3bc-5725-4626-a1ff-baeadda9d818 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:56.169543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c04b3bc-5725-4626-a1ff-baeadda9d818 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:56.269417 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.network.security_group_api [None req-995ee0f7-11c5-4bcb-b212-24c462a7e70f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Removing security group cd98bc0d-63f6-4c0c-9b4f-3b6ecd5cb48e from port 64dac991-3106-4bed-aa53-9b65aedc4b13 Sep 17 21:13:56.953430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2c04b3bc-5725-4626-a1ff-baeadda9d818 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:56.972836 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2c04b3bc-5725-4626-a1ff-baeadda9d818 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:56.974326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2c04b3bc-5725-4626-a1ff-baeadda9d818 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:56.975622 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2c04b3bc-5725-4626-a1ff-baeadda9d818 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 2936 microversion: 2.42 time: 0.831533 Sep 17 21:13:56.976404 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2562/5022] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:56 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 2936 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:56.988192 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2f1e53fc-cf99-4f6f-9673-457bd7585ec9 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:56.990172 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2f1e53fc-cf99-4f6f-9673-457bd7585ec9 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: a8bdbeff-7f16-4d67-823e-df6ec3e09842] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:57.009170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f1e53fc-cf99-4f6f-9673-457bd7585ec9 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:57.009796 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f1e53fc-cf99-4f6f-9673-457bd7585ec9 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:57.010369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f1e53fc-cf99-4f6f-9673-457bd7585ec9 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:57.011155 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f1e53fc-cf99-4f6f-9673-457bd7585ec9 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:57.011682 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f1e53fc-cf99-4f6f-9673-457bd7585ec9 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:57.017569 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f1e53fc-cf99-4f6f-9673-457bd7585ec9 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:57.371036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2f1e53fc-cf99-4f6f-9673-457bd7585ec9 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:57.388560 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2f1e53fc-cf99-4f6f-9673-457bd7585ec9 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842" status: 200 len: 1299 microversion: 2.1 time: 0.410367 Sep 17 21:13:57.390342 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2563/5023] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:56 2022] GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842 => generated 1299 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:57.760128 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-3ec58282-09ad-4146-a988-cde7ed18efdf req-1b3bd54a-9dbc-4a0b-bf96-90da7bf26458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59016b2c-e625-4f0c-8379-b48d97025cf3", "name": "network-vif-deleted", "tag": "704aa06b-a7ab-4b0e-a2aa-0236fac21382"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:13:57.781043 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-3ec58282-09ad-4146-a988-cde7ed18efdf req-1b3bd54a-9dbc-4a0b-bf96-90da7bf26458 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:57.782705 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-3ec58282-09ad-4146-a988-cde7ed18efdf req-1b3bd54a-9dbc-4a0b-bf96-90da7bf26458 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:57.783191 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-3ec58282-09ad-4146-a988-cde7ed18efdf req-1b3bd54a-9dbc-4a0b-bf96-90da7bf26458 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:57.813220 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-3ec58282-09ad-4146-a988-cde7ed18efdf req-1b3bd54a-9dbc-4a0b-bf96-90da7bf26458 service nova] Creating event network-vif-deleted:704aa06b-a7ab-4b0e-a2aa-0236fac21382 for instance 59016b2c-e625-4f0c-8379-b48d97025cf3 on nch2-master-1 Sep 17 21:13:57.831300 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-3ec58282-09ad-4146-a988-cde7ed18efdf req-1b3bd54a-9dbc-4a0b-bf96-90da7bf26458 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077071 Sep 17 21:13:57.831937 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2564/5024] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:13:58.006467 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c64e124f-b0cf-4160-b6e1-242ec016f91b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:58.007192 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c64e124f-b0cf-4160-b6e1-242ec016f91b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:58.032575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c64e124f-b0cf-4160-b6e1-242ec016f91b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:58.033423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c64e124f-b0cf-4160-b6e1-242ec016f91b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:58.034078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c64e124f-b0cf-4160-b6e1-242ec016f91b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:58.035060 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c64e124f-b0cf-4160-b6e1-242ec016f91b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:58.035561 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c64e124f-b0cf-4160-b6e1-242ec016f91b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:58.041387 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c64e124f-b0cf-4160-b6e1-242ec016f91b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:58.827805 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-995ee0f7-11c5-4bcb-b212-24c462a7e70f tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "POST /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c/action" status: 202 len: 0 microversion: 2.1 time: 3.686547 Sep 17 21:13:58.828404 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2461/5025] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:13:55 2022] POST /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c/action => generated 0 bytes in 3688 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:13:58.835217 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e8da501c-faec-4b30-a124-f30acfcc9e87 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:58.835834 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e8da501c-faec-4b30-a124-f30acfcc9e87 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: a8bdbeff-7f16-4d67-823e-df6ec3e09842] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:58.861303 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8da501c-faec-4b30-a124-f30acfcc9e87 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:58.865232 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8da501c-faec-4b30-a124-f30acfcc9e87 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:58.865853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8da501c-faec-4b30-a124-f30acfcc9e87 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:58.869643 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8da501c-faec-4b30-a124-f30acfcc9e87 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:58.870159 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8da501c-faec-4b30-a124-f30acfcc9e87 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:58.870615 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8da501c-faec-4b30-a124-f30acfcc9e87 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:58.881922 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c64e124f-b0cf-4160-b6e1-242ec016f91b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:58.892772 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c64e124f-b0cf-4160-b6e1-242ec016f91b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:58.904121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c64e124f-b0cf-4160-b6e1-242ec016f91b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:58.907112 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c64e124f-b0cf-4160-b6e1-242ec016f91b tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 2754 microversion: 2.42 time: 0.905820 Sep 17 21:13:58.908398 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2565/5026] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:57 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 2754 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:13:58.916108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-54f084fd-7076-4154-af36-aae5f6804b78 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Action: 'create', calling method: .version_select at 0x7f25a9f75160>, body: {"pool": null} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:13:59.307977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e8da501c-faec-4b30-a124-f30acfcc9e87 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:13:59.324614 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e8da501c-faec-4b30-a124-f30acfcc9e87 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842" status: 200 len: 1299 microversion: 2.1 time: 0.495003 Sep 17 21:13:59.325245 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2462/5027] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:13:58 2022] GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842 => generated 1299 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:13:59.352147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-cfc4625c-b65b-4a42-9a35-81b1c03523f8 req-6b77b7a6-a650-4335-9be0-45ae7ef69614 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c45f5fe-2176-44d4-a8b5-972d6b92d53c", "tag": "64dac991-3106-4bed-aa53-9b65aedc4b13"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:13:59.375281 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-cfc4625c-b65b-4a42-9a35-81b1c03523f8 req-6b77b7a6-a650-4335-9be0-45ae7ef69614 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:59.378001 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-cfc4625c-b65b-4a42-9a35-81b1c03523f8 req-6b77b7a6-a650-4335-9be0-45ae7ef69614 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:59.378609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-cfc4625c-b65b-4a42-9a35-81b1c03523f8 req-6b77b7a6-a650-4335-9be0-45ae7ef69614 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:59.409084 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-cfc4625c-b65b-4a42-9a35-81b1c03523f8 req-6b77b7a6-a650-4335-9be0-45ae7ef69614 service nova] Creating event network-changed:64dac991-3106-4bed-aa53-9b65aedc4b13 for instance 6c45f5fe-2176-44d4-a8b5-972d6b92d53c on nch1-master-1 Sep 17 21:13:59.421125 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-cfc4625c-b65b-4a42-9a35-81b1c03523f8 req-6b77b7a6-a650-4335-9be0-45ae7ef69614 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091636 Sep 17 21:13:59.422704 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2463/5028] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:13:59.624296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-568feb0b-71ef-4d2e-99df-b828481b003b req-7d1523b4-c214-4cbc-86a7-668986c337ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59016b2c-e625-4f0c-8379-b48d97025cf3", "name": "network-vif-unplugged", "status": "completed", "tag": "3797c879-2df9-4ada-b7ff-c6db7404943b"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:13:59.646280 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-568feb0b-71ef-4d2e-99df-b828481b003b req-7d1523b4-c214-4cbc-86a7-668986c337ef service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:59.648289 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-568feb0b-71ef-4d2e-99df-b828481b003b req-7d1523b4-c214-4cbc-86a7-668986c337ef service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:59.649046 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-568feb0b-71ef-4d2e-99df-b828481b003b req-7d1523b4-c214-4cbc-86a7-668986c337ef service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:59.672207 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-568feb0b-71ef-4d2e-99df-b828481b003b req-7d1523b4-c214-4cbc-86a7-668986c337ef service nova] Creating event network-vif-unplugged:3797c879-2df9-4ada-b7ff-c6db7404943b for instance 59016b2c-e625-4f0c-8379-b48d97025cf3 on nch2-master-1 Sep 17 21:13:59.679887 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-568feb0b-71ef-4d2e-99df-b828481b003b req-7d1523b4-c214-4cbc-86a7-668986c337ef service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059988 Sep 17 21:13:59.681255 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2464/5029] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:13:59.954195 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-893c8c52-1184-4160-983c-0fd807e63a4a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:13:59.955006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-893c8c52-1184-4160-983c-0fd807e63a4a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:13:59.975139 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-893c8c52-1184-4160-983c-0fd807e63a4a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:59.976016 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-893c8c52-1184-4160-983c-0fd807e63a4a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:59.977102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-893c8c52-1184-4160-983c-0fd807e63a4a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:13:59.982144 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-893c8c52-1184-4160-983c-0fd807e63a4a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:13:59.983086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-893c8c52-1184-4160-983c-0fd807e63a4a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:13:59.983784 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-893c8c52-1184-4160-983c-0fd807e63a4a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:01.381291 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-893c8c52-1184-4160-983c-0fd807e63a4a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:01.404219 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-893c8c52-1184-4160-983c-0fd807e63a4a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:01.412122 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-893c8c52-1184-4160-983c-0fd807e63a4a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:01.413744 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-893c8c52-1184-4160-983c-0fd807e63a4a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 2707 microversion: 2.42 time: 1.476409 Sep 17 21:14:01.414542 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2465/5030] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:13:59 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 2707 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:14:01.446720 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-9f220f62-dcda-41f3-aa74-0ca9c0b89a0a req-4524bb31-1f49-44c6-b04e-bd78a65114aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59016b2c-e625-4f0c-8379-b48d97025cf3", "name": "network-vif-deleted", "tag": "91cb57c8-4607-4745-9e86-253c6e4b6335"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:14:01.459079 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-9f220f62-dcda-41f3-aa74-0ca9c0b89a0a req-4524bb31-1f49-44c6-b04e-bd78a65114aa service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:01.459847 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-9f220f62-dcda-41f3-aa74-0ca9c0b89a0a req-4524bb31-1f49-44c6-b04e-bd78a65114aa service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:01.460443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-9f220f62-dcda-41f3-aa74-0ca9c0b89a0a req-4524bb31-1f49-44c6-b04e-bd78a65114aa service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:01.490271 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-9f220f62-dcda-41f3-aa74-0ca9c0b89a0a req-4524bb31-1f49-44c6-b04e-bd78a65114aa service nova] Creating event network-vif-deleted:91cb57c8-4607-4745-9e86-253c6e4b6335 for instance 59016b2c-e625-4f0c-8379-b48d97025cf3 on nch2-master-1 Sep 17 21:14:01.498305 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-9f220f62-dcda-41f3-aa74-0ca9c0b89a0a req-4524bb31-1f49-44c6-b04e-bd78a65114aa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054614 Sep 17 21:14:01.499665 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2466/5031] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:14:01.506312 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-53eeb93f-6e02-4a58-b4d5-d437a0b6f13b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:01.518403 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-53eeb93f-6e02-4a58-b4d5-d437a0b6f13b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: a8bdbeff-7f16-4d67-823e-df6ec3e09842] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:01.531752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53eeb93f-6e02-4a58-b4d5-d437a0b6f13b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:01.532388 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53eeb93f-6e02-4a58-b4d5-d437a0b6f13b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:01.532920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53eeb93f-6e02-4a58-b4d5-d437a0b6f13b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:01.537242 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53eeb93f-6e02-4a58-b4d5-d437a0b6f13b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:01.538416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53eeb93f-6e02-4a58-b4d5-d437a0b6f13b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:01.538962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53eeb93f-6e02-4a58-b4d5-d437a0b6f13b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:01.780379 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-53eeb93f-6e02-4a58-b4d5-d437a0b6f13b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:01.789811 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-53eeb93f-6e02-4a58-b4d5-d437a0b6f13b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842" status: 200 len: 1299 microversion: 2.1 time: 0.287869 Sep 17 21:14:01.790590 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2467/5032] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:01 2022] GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842 => generated 1299 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:14:01.812122 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-080a70fd-40bb-44cf-b868-fdde8c7b9668 req-5629f397-cc72-4b35-9f13-b3f0d33d0574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59016b2c-e625-4f0c-8379-b48d97025cf3", "name": "network-vif-unplugged", "status": "completed", "tag": "1a947b45-da95-4264-a22c-d46090d6d9a3"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:14:01.835213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-080a70fd-40bb-44cf-b868-fdde8c7b9668 req-5629f397-cc72-4b35-9f13-b3f0d33d0574 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:01.835568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-080a70fd-40bb-44cf-b868-fdde8c7b9668 req-5629f397-cc72-4b35-9f13-b3f0d33d0574 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:01.836020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-080a70fd-40bb-44cf-b868-fdde8c7b9668 req-5629f397-cc72-4b35-9f13-b3f0d33d0574 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:01.876599 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-080a70fd-40bb-44cf-b868-fdde8c7b9668 req-5629f397-cc72-4b35-9f13-b3f0d33d0574 service nova] Creating event network-vif-unplugged:1a947b45-da95-4264-a22c-d46090d6d9a3 for instance 59016b2c-e625-4f0c-8379-b48d97025cf3 on nch2-master-1 Sep 17 21:14:01.888353 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-080a70fd-40bb-44cf-b868-fdde8c7b9668 req-5629f397-cc72-4b35-9f13-b3f0d33d0574 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080172 Sep 17 21:14:01.894676 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2468/5033] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:14:02.454098 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-95fe1a60-2929-42ba-9760-f8d98e2b8f4a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:02.460011 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-95fe1a60-2929-42ba-9760-f8d98e2b8f4a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:02.502441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95fe1a60-2929-42ba-9760-f8d98e2b8f4a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:02.507634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95fe1a60-2929-42ba-9760-f8d98e2b8f4a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:02.526931 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95fe1a60-2929-42ba-9760-f8d98e2b8f4a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:02.527950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95fe1a60-2929-42ba-9760-f8d98e2b8f4a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:02.529499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95fe1a60-2929-42ba-9760-f8d98e2b8f4a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:02.529959 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95fe1a60-2929-42ba-9760-f8d98e2b8f4a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:02.546021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:14:03.410483 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-95fe1a60-2929-42ba-9760-f8d98e2b8f4a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:03.426856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-95fe1a60-2929-42ba-9760-f8d98e2b8f4a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:03.430371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-95fe1a60-2929-42ba-9760-f8d98e2b8f4a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:03.434556 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-95fe1a60-2929-42ba-9760-f8d98e2b8f4a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 2369 microversion: 2.42 time: 0.989746 Sep 17 21:14:03.435726 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2469/5034] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:14:02 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 2369 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:14:03.449350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6a9c87be-b896-4bb6-98d4-22fd083dab4c tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:03.453098 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6a9c87be-b896-4bb6-98d4-22fd083dab4c tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: a8bdbeff-7f16-4d67-823e-df6ec3e09842] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:03.475870 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a9c87be-b896-4bb6-98d4-22fd083dab4c tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:03.477280 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a9c87be-b896-4bb6-98d4-22fd083dab4c tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:03.481633 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a9c87be-b896-4bb6-98d4-22fd083dab4c tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:03.483357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a9c87be-b896-4bb6-98d4-22fd083dab4c tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:03.483849 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a9c87be-b896-4bb6-98d4-22fd083dab4c tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:03.486376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a9c87be-b896-4bb6-98d4-22fd083dab4c tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:03.918988 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6a9c87be-b896-4bb6-98d4-22fd083dab4c tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:03.934288 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6a9c87be-b896-4bb6-98d4-22fd083dab4c tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842" status: 200 len: 1299 microversion: 2.1 time: 0.493342 Sep 17 21:14:03.934897 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2470/5035] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:03 2022] GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842 => generated 1299 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:14:03.954334 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-69bcb940-f0de-499c-bf96-d35af6a130e5 req-de021170-d2d2-43bd-8e6b-4b1fc405be75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59016b2c-e625-4f0c-8379-b48d97025cf3", "name": "network-vif-deleted", "tag": "1a947b45-da95-4264-a22c-d46090d6d9a3"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:14:03.976670 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-69bcb940-f0de-499c-bf96-d35af6a130e5 req-de021170-d2d2-43bd-8e6b-4b1fc405be75 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:03.977362 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-69bcb940-f0de-499c-bf96-d35af6a130e5 req-de021170-d2d2-43bd-8e6b-4b1fc405be75 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:03.978426 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-69bcb940-f0de-499c-bf96-d35af6a130e5 req-de021170-d2d2-43bd-8e6b-4b1fc405be75 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:04.026237 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-69bcb940-f0de-499c-bf96-d35af6a130e5 req-de021170-d2d2-43bd-8e6b-4b1fc405be75 service nova] Creating event network-vif-deleted:1a947b45-da95-4264-a22c-d46090d6d9a3 for instance 59016b2c-e625-4f0c-8379-b48d97025cf3 on nch2-master-1 Sep 17 21:14:04.034238 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-69bcb940-f0de-499c-bf96-d35af6a130e5 req-de021170-d2d2-43bd-8e6b-4b1fc405be75 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091556 Sep 17 21:14:04.036086 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2471/5036] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:14:04.100595 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-41b46862-c287-43fe-a2de-e8684208a1df req-f10c32f5-c579-42b3-ad37-4bd1b4d21b57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59016b2c-e625-4f0c-8379-b48d97025cf3", "name": "network-vif-unplugged", "status": "completed", "tag": "00603844-1172-4f4d-a0db-a617c5efc641"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:14:04.120843 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-41b46862-c287-43fe-a2de-e8684208a1df req-f10c32f5-c579-42b3-ad37-4bd1b4d21b57 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:04.125109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-41b46862-c287-43fe-a2de-e8684208a1df req-f10c32f5-c579-42b3-ad37-4bd1b4d21b57 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:04.125711 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-41b46862-c287-43fe-a2de-e8684208a1df req-f10c32f5-c579-42b3-ad37-4bd1b4d21b57 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:04.147463 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-41b46862-c287-43fe-a2de-e8684208a1df req-f10c32f5-c579-42b3-ad37-4bd1b4d21b57 service nova] Creating event network-vif-unplugged:00603844-1172-4f4d-a0db-a617c5efc641 for instance 59016b2c-e625-4f0c-8379-b48d97025cf3 on nch2-master-1 Sep 17 21:14:04.155426 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-41b46862-c287-43fe-a2de-e8684208a1df req-f10c32f5-c579-42b3-ad37-4bd1b4d21b57 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060251 Sep 17 21:14:04.156740 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2472/5037] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:14:04.469952 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f7d9c2bb-a83f-4772-9179-a7f3924f2768 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:04.471028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f7d9c2bb-a83f-4772-9179-a7f3924f2768 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:04.522465 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f7d9c2bb-a83f-4772-9179-a7f3924f2768 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:04.526426 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f7d9c2bb-a83f-4772-9179-a7f3924f2768 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:04.526902 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f7d9c2bb-a83f-4772-9179-a7f3924f2768 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:04.527668 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f7d9c2bb-a83f-4772-9179-a7f3924f2768 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:04.533205 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f7d9c2bb-a83f-4772-9179-a7f3924f2768 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:04.534400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f7d9c2bb-a83f-4772-9179-a7f3924f2768 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:05.419421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f7d9c2bb-a83f-4772-9179-a7f3924f2768 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:05.438328 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f7d9c2bb-a83f-4772-9179-a7f3924f2768 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:05.440190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f7d9c2bb-a83f-4772-9179-a7f3924f2768 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7a13dc0c95a64d499bd05f808565fccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a4d7fd12784db69cf699e7e58d4d6a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:05.442268 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f7d9c2bb-a83f-4772-9179-a7f3924f2768 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 200 len: 2210 microversion: 2.42 time: 0.979419 Sep 17 21:14:05.455420 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2473/5038] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:14:04 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 2210 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:14:05.474289 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bf236b7f-aff3-4c92-a7b2-ceaf100bb63b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:05.474952 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bf236b7f-aff3-4c92-a7b2-ceaf100bb63b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: a8bdbeff-7f16-4d67-823e-df6ec3e09842] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:05.485217 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf236b7f-aff3-4c92-a7b2-ceaf100bb63b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:05.486025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf236b7f-aff3-4c92-a7b2-ceaf100bb63b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:05.486705 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf236b7f-aff3-4c92-a7b2-ceaf100bb63b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:05.488178 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf236b7f-aff3-4c92-a7b2-ceaf100bb63b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:05.489306 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf236b7f-aff3-4c92-a7b2-ceaf100bb63b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:05.490621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf236b7f-aff3-4c92-a7b2-ceaf100bb63b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:05.891192 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bf236b7f-aff3-4c92-a7b2-ceaf100bb63b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:05.904088 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bf236b7f-aff3-4c92-a7b2-ceaf100bb63b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842" status: 200 len: 1299 microversion: 2.1 time: 0.447518 Sep 17 21:14:05.904698 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2474/5039] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:05 2022] GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842 => generated 1299 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:14:06.152548 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-54f084fd-7076-4154-af36-aae5f6804b78 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.242970 Sep 17 21:14:06.154032 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2566/5040] 10.222.0.26 () {60 vars in 1170 bytes} [Sat Sep 17 21:13:58 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:14:06.177406 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-59a8299b-cef8-4bd6-91a7-1ce087bd3423 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.7.249"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:14:06.181288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-59a8299b-cef8-4bd6-91a7-1ce087bd3423 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:06.189143 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-e114f485-61f3-4fcb-8dd0-411b48688bb9 req-164ace71-08c3-473d-a24f-2218b8cb2f42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59016b2c-e625-4f0c-8379-b48d97025cf3", "name": "network-vif-deleted", "tag": "3797c879-2df9-4ada-b7ff-c6db7404943b"}, {"server_uuid": "59016b2c-e625-4f0c-8379-b48d97025cf3", "name": "network-vif-deleted", "tag": "00603844-1172-4f4d-a0db-a617c5efc641"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:14:06.196570 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59a8299b-cef8-4bd6-91a7-1ce087bd3423 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:06.197750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59a8299b-cef8-4bd6-91a7-1ce087bd3423 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:06.198452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59a8299b-cef8-4bd6-91a7-1ce087bd3423 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:06.199633 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59a8299b-cef8-4bd6-91a7-1ce087bd3423 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:06.200508 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59a8299b-cef8-4bd6-91a7-1ce087bd3423 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:06.201176 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59a8299b-cef8-4bd6-91a7-1ce087bd3423 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:06.231458 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:14:06.236814 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e114f485-61f3-4fcb-8dd0-411b48688bb9 req-164ace71-08c3-473d-a24f-2218b8cb2f42 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:06.243559 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e114f485-61f3-4fcb-8dd0-411b48688bb9 req-164ace71-08c3-473d-a24f-2218b8cb2f42 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:06.244831 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e114f485-61f3-4fcb-8dd0-411b48688bb9 req-164ace71-08c3-473d-a24f-2218b8cb2f42 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:06.265944 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59a8299b-cef8-4bd6-91a7-1ce087bd3423 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "refresh_cache-6c45f5fe-2176-44d4-a8b5-972d6b92d53c" {{(pid=140523) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 17 21:14:06.266663 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59a8299b-cef8-4bd6-91a7-1ce087bd3423 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquired lock "refresh_cache-6c45f5fe-2176-44d4-a8b5-972d6b92d53c" {{(pid=140523) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 17 21:14:06.320391 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-e114f485-61f3-4fcb-8dd0-411b48688bb9 req-164ace71-08c3-473d-a24f-2218b8cb2f42 service nova] Creating event network-vif-deleted:3797c879-2df9-4ada-b7ff-c6db7404943b for instance 59016b2c-e625-4f0c-8379-b48d97025cf3 on nch2-master-1 Sep 17 21:14:06.321705 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-e114f485-61f3-4fcb-8dd0-411b48688bb9 req-164ace71-08c3-473d-a24f-2218b8cb2f42 service nova] Creating event network-vif-deleted:00603844-1172-4f4d-a0db-a617c5efc641 for instance 59016b2c-e625-4f0c-8379-b48d97025cf3 on nch2-master-1 Sep 17 21:14:06.333371 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-e114f485-61f3-4fcb-8dd0-411b48688bb9 req-164ace71-08c3-473d-a24f-2218b8cb2f42 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.151824 Sep 17 21:14:06.335718 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2567/5041] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:14:06.345632 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-20d53080-5be6-4f76-9cad-a6a8f31a83ae req-34ca5327-2b94-4ded-a3c3-9a31ddf72864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8bdbeff-7f16-4d67-823e-df6ec3e09842", "name": "network-vif-plugged", "status": "completed", "tag": "172671df-7dc4-4512-ac66-f01f8e2d77d5"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:14:06.365144 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-20d53080-5be6-4f76-9cad-a6a8f31a83ae req-34ca5327-2b94-4ded-a3c3-9a31ddf72864 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:06.365773 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-20d53080-5be6-4f76-9cad-a6a8f31a83ae req-34ca5327-2b94-4ded-a3c3-9a31ddf72864 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:06.366482 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-20d53080-5be6-4f76-9cad-a6a8f31a83ae req-34ca5327-2b94-4ded-a3c3-9a31ddf72864 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:06.384166 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-20d53080-5be6-4f76-9cad-a6a8f31a83ae req-34ca5327-2b94-4ded-a3c3-9a31ddf72864 service nova] Creating event network-vif-plugged:172671df-7dc4-4512-ac66-f01f8e2d77d5 for instance a8bdbeff-7f16-4d67-823e-df6ec3e09842 on nch1-master-1 Sep 17 21:14:06.392843 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-20d53080-5be6-4f76-9cad-a6a8f31a83ae req-34ca5327-2b94-4ded-a3c3-9a31ddf72864 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054750 Sep 17 21:14:06.393870 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2568/5042] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:14:07.345114 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-abd85057-5f00-4761-9185-bec54dfad0d8 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Action: 'create', calling method: .version_select at 0x7f25a436f0d0>, body: {"keypair": {"name": "tempest-keypair-1874286382", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmCHQQDBCQrFs5MT1BTTXmdGOhRQ7zBGOp3NGoSrIjK5NS/xZ5RoqdwW/1wFOwEy9+9OY4Un44eFj73TAo/bFwxWntgHlPDpnwDfr6gNwFRjfQeHMvk358GGqLZdfFLpg=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:14:07.404046 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-abd85057-5f00-4761-9185-bec54dfad0d8 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Getting quotas for project 720881c6f7304aadbf069698c97dc5c5. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:14:07.422687 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-abd85057-5f00-4761-9185-bec54dfad0d8 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Getting quotas for user 8ddb1d0a7bca457493d7ac9a58a01e64 and project 720881c6f7304aadbf069698c97dc5c5. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:14:07.475021 ncdv-master-1 devstack@n-api.service[140524]: ERROR oslo.messaging._drivers.impl_rabbit [None req-abd85057-5f00-4761-9185-bec54dfad0d8 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [7114cc1e-c6b3-4781-b959-9e22cb9fe2c9] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 17 21:14:08.483057 ncdv-master-1 devstack@n-api.service[140524]: INFO oslo.messaging._drivers.impl_rabbit [None req-abd85057-5f00-4761-9185-bec54dfad0d8 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [7114cc1e-c6b3-4781-b959-9e22cb9fe2c9] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 57854. Sep 17 21:14:08.518544 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-abd85057-5f00-4761-9185-bec54dfad0d8 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 2.045612 Sep 17 21:14:08.521360 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2569/5043] 10.222.0.26 () {62 vars in 1200 bytes} [Sat Sep 17 21:14:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 2049 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 17 21:14:08.528511 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c3a99803-dae1-48fd-8e8d-3268f42835db tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:08.530060 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c3a99803-dae1-48fd-8e8d-3268f42835db tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:08.539282 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3a99803-dae1-48fd-8e8d-3268f42835db tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:08.540344 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3a99803-dae1-48fd-8e8d-3268f42835db tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:08.542562 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3a99803-dae1-48fd-8e8d-3268f42835db tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:08.543906 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3a99803-dae1-48fd-8e8d-3268f42835db tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:08.544618 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3a99803-dae1-48fd-8e8d-3268f42835db tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:08.545575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3a99803-dae1-48fd-8e8d-3268f42835db tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:08.567915 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-c3a99803-dae1-48fd-8e8d-3268f42835db tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] HTTP exception thrown: Instance 59016b2c-e625-4f0c-8379-b48d97025cf3 could not be found. Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c3a99803-dae1-48fd-8e8d-3268f42835db tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Request method failure captured: Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 HTTP/1.1 Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjcntI3owAMxOH9W5qCSaJGcHtXQ0G8LKwo2XDAFvq16FKstTDd6SgTnAad3YZsQkF82V46f87Kt3zJAd6R8xNTKRGIbS9sag0WazD6IcxF5ZTDjmqSdZ3yyvikP9vExCvz4gO_iELQFvDKvzIJ8WNl9o7ua77T7djWFVqOCQ9WBy_s Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: X-Openstack-Nova-Api-Version: 2.42 Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: c4a4d7fd12784db69cf699e7e58d4d6a Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-970179712 Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c4a4d7fd12784db69cf699e7e58d4d6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c4a4d7fd12784db69cf699e7e58d4d6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c4a4d7fd12784db69cf699e7e58d4d6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c4a4d7fd12784db69cf699e7e58d4d6a", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-TaggedBootDevicesTest_v242-970179712 Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: c4a4d7fd12784db69cf699e7e58d4d6a Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-970179712 Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-TaggedBootDevicesTest_v242-970179712-project Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 7a13dc0c95a64d499bd05f808565fccd Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-TaggedBootDevicesTest_v242-970179712-project Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 59016b2c-e625-4f0c-8379-b48d97025cf3 could not be found. Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '59016b2c-e625-4f0c-8379-b48d97025cf3'} Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59016b2c-e625-4f0c-8379-b48d97025cf3 could not be found. Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59016b2c-e625-4f0c-8379-b48d97025cf3 could not be found. Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:14:08.570666 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:08.576673 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:14:08.576673 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:08.576673 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:08.576673 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:08.576673 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:14:08.576673 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:14:08.576673 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59016b2c-e625-4f0c-8379-b48d97025cf3 could not be found. Sep 17 21:14:08.576673 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:14:08.581972 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c3a99803-dae1-48fd-8e8d-3268f42835db tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Returning 404 to user: Instance 59016b2c-e625-4f0c-8379-b48d97025cf3 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:14:08.584980 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c3a99803-dae1-48fd-8e8d-3268f42835db tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 404 len: 111 microversion: 2.42 time: 0.061118 Sep 17 21:14:08.600728 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2570/5044] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:14:08 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:14:08.619754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-dabf9baa-dc98-4e4c-afbd-0f104e6ce856 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:08.624880 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-dabf9baa-dc98-4e4c-afbd-0f104e6ce856 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: a8bdbeff-7f16-4d67-823e-df6ec3e09842] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:08.642456 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dabf9baa-dc98-4e4c-afbd-0f104e6ce856 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:08.646041 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dabf9baa-dc98-4e4c-afbd-0f104e6ce856 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:08.646612 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dabf9baa-dc98-4e4c-afbd-0f104e6ce856 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:08.647779 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dabf9baa-dc98-4e4c-afbd-0f104e6ce856 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:08.648485 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dabf9baa-dc98-4e4c-afbd-0f104e6ce856 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:08.649379 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dabf9baa-dc98-4e4c-afbd-0f104e6ce856 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:09.103832 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-dabf9baa-dc98-4e4c-afbd-0f104e6ce856 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:09.144872 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-dabf9baa-dc98-4e4c-afbd-0f104e6ce856 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842" status: 200 len: 1470 microversion: 2.1 time: 0.544544 Sep 17 21:14:09.157387 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2571/5045] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:08 2022] GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842 => generated 1470 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:14:09.188857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e0e6734f-1dd2-4798-b635-78803fb308df tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '.version_select at 0x7f25a4382280>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:09.270796 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e0e6734f-1dd2-4798-b635-78803fb308df tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1842322073" status: 204 len: 0 microversion: 2.42 time: 0.111895 Sep 17 21:14:09.271459 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2572/5046] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Sep 17 21:14:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1842322073 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 21:14:09.276651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-43010121-9f7c-4699-98e8-c6133832ff03 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:09.277986 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-43010121-9f7c-4699-98e8-c6133832ff03 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: a8bdbeff-7f16-4d67-823e-df6ec3e09842] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:09.286427 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43010121-9f7c-4699-98e8-c6133832ff03 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:09.287298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43010121-9f7c-4699-98e8-c6133832ff03 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:09.288356 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43010121-9f7c-4699-98e8-c6133832ff03 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:09.290054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43010121-9f7c-4699-98e8-c6133832ff03 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:09.290883 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43010121-9f7c-4699-98e8-c6133832ff03 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:09.291791 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-43010121-9f7c-4699-98e8-c6133832ff03 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:09.532184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-43010121-9f7c-4699-98e8-c6133832ff03 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:09.540777 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-43010121-9f7c-4699-98e8-c6133832ff03 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842" status: 200 len: 1470 microversion: 2.1 time: 0.268189 Sep 17 21:14:09.541447 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2573/5047] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:09 2022] GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842 => generated 1470 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:14:09.568699 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2e15abb7-af38-429b-922a-c199db00ce19 tempest-TestSecurityGroupsBasicOps-1755280313 tempest-TestSecurityGroupsBasicOps-1755280313-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:09.569337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2e15abb7-af38-429b-922a-c199db00ce19 tempest-TestSecurityGroupsBasicOps-1755280313 tempest-TestSecurityGroupsBasicOps-1755280313-project-admin] [instance: a8bdbeff-7f16-4d67-823e-df6ec3e09842] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:09.579821 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e15abb7-af38-429b-922a-c199db00ce19 tempest-TestSecurityGroupsBasicOps-1755280313 tempest-TestSecurityGroupsBasicOps-1755280313-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:09.580327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e15abb7-af38-429b-922a-c199db00ce19 tempest-TestSecurityGroupsBasicOps-1755280313 tempest-TestSecurityGroupsBasicOps-1755280313-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:09.581453 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e15abb7-af38-429b-922a-c199db00ce19 tempest-TestSecurityGroupsBasicOps-1755280313 tempest-TestSecurityGroupsBasicOps-1755280313-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:09.596470 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e15abb7-af38-429b-922a-c199db00ce19 tempest-TestSecurityGroupsBasicOps-1755280313 tempest-TestSecurityGroupsBasicOps-1755280313-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:09.597042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e15abb7-af38-429b-922a-c199db00ce19 tempest-TestSecurityGroupsBasicOps-1755280313 tempest-TestSecurityGroupsBasicOps-1755280313-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:09.597897 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e15abb7-af38-429b-922a-c199db00ce19 tempest-TestSecurityGroupsBasicOps-1755280313 tempest-TestSecurityGroupsBasicOps-1755280313-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:09.812212 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2e15abb7-af38-429b-922a-c199db00ce19 tempest-TestSecurityGroupsBasicOps-1755280313 tempest-TestSecurityGroupsBasicOps-1755280313-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842" status: 200 len: 1621 microversion: 2.1 time: 0.251148 Sep 17 21:14:09.818698 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2574/5048] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:09 2022] GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842 => generated 1621 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:14:09.840392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c9fa1816-8105-405f-81b2-1f134dbae445 tempest-TestSecurityGroupsBasicOps-1755280313 tempest-TestSecurityGroupsBasicOps-1755280313-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:09.840888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c9fa1816-8105-405f-81b2-1f134dbae445 tempest-TestSecurityGroupsBasicOps-1755280313 tempest-TestSecurityGroupsBasicOps-1755280313-project-admin] [instance: ecbd9cec-fdea-45b2-bb96-487bdaf97635] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:09.860802 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9fa1816-8105-405f-81b2-1f134dbae445 tempest-TestSecurityGroupsBasicOps-1755280313 tempest-TestSecurityGroupsBasicOps-1755280313-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:09.861319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9fa1816-8105-405f-81b2-1f134dbae445 tempest-TestSecurityGroupsBasicOps-1755280313 tempest-TestSecurityGroupsBasicOps-1755280313-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:09.861849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9fa1816-8105-405f-81b2-1f134dbae445 tempest-TestSecurityGroupsBasicOps-1755280313 tempest-TestSecurityGroupsBasicOps-1755280313-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:09.862534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9fa1816-8105-405f-81b2-1f134dbae445 tempest-TestSecurityGroupsBasicOps-1755280313 tempest-TestSecurityGroupsBasicOps-1755280313-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:09.862984 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9fa1816-8105-405f-81b2-1f134dbae445 tempest-TestSecurityGroupsBasicOps-1755280313 tempest-TestSecurityGroupsBasicOps-1755280313-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:09.863421 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9fa1816-8105-405f-81b2-1f134dbae445 tempest-TestSecurityGroupsBasicOps-1755280313 tempest-TestSecurityGroupsBasicOps-1755280313-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:09.902526 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-59a8299b-cef8-4bd6-91a7-1ce087bd3423 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Building network info cache for instance {{(pid=140523) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 17 21:14:11.068390 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c9fa1816-8105-405f-81b2-1f134dbae445 tempest-TestSecurityGroupsBasicOps-1755280313 tempest-TestSecurityGroupsBasicOps-1755280313-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635" status: 200 len: 1912 microversion: 2.1 time: 1.232196 Sep 17 21:14:11.068970 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2575/5049] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:09 2022] GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635 => generated 1912 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:14:11.096394 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-d17d83c5-8832-4772-a7c3-dea572fea25a req-6eb66661-1a04-4aa9-843c-c4a320c7c510 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c45f5fe-2176-44d4-a8b5-972d6b92d53c", "tag": "64dac991-3106-4bed-aa53-9b65aedc4b13"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:14:11.123741 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d17d83c5-8832-4772-a7c3-dea572fea25a req-6eb66661-1a04-4aa9-843c-c4a320c7c510 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:11.126403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d17d83c5-8832-4772-a7c3-dea572fea25a req-6eb66661-1a04-4aa9-843c-c4a320c7c510 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:11.127118 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d17d83c5-8832-4772-a7c3-dea572fea25a req-6eb66661-1a04-4aa9-843c-c4a320c7c510 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:11.152368 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-d17d83c5-8832-4772-a7c3-dea572fea25a req-6eb66661-1a04-4aa9-843c-c4a320c7c510 service nova] Creating event network-changed:64dac991-3106-4bed-aa53-9b65aedc4b13 for instance 6c45f5fe-2176-44d4-a8b5-972d6b92d53c on nch1-master-1 Sep 17 21:14:11.175851 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-d17d83c5-8832-4772-a7c3-dea572fea25a req-6eb66661-1a04-4aa9-843c-c4a320c7c510 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083233 Sep 17 21:14:11.176768 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2576/5050] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:14:11.787476 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4a143bb3-f0fe-40d9-8688-d5946b57e008 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:11.788351 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4a143bb3-f0fe-40d9-8688-d5946b57e008 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: a8bdbeff-7f16-4d67-823e-df6ec3e09842] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:11.805423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a143bb3-f0fe-40d9-8688-d5946b57e008 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:11.806084 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a143bb3-f0fe-40d9-8688-d5946b57e008 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:11.806539 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a143bb3-f0fe-40d9-8688-d5946b57e008 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:11.807495 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a143bb3-f0fe-40d9-8688-d5946b57e008 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:11.810268 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a143bb3-f0fe-40d9-8688-d5946b57e008 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:11.810854 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a143bb3-f0fe-40d9-8688-d5946b57e008 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:11.885156 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4a143bb3-f0fe-40d9-8688-d5946b57e008 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: a8bdbeff-7f16-4d67-823e-df6ec3e09842] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:14:12.091949 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4a143bb3-f0fe-40d9-8688-d5946b57e008 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842" status: 204 len: 0 microversion: 2.1 time: 0.309276 Sep 17 21:14:12.095209 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2577/5051] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:14:11 2022] DELETE /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:14:12.104939 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-eb270da7-8421-4b15-85d7-b35deae5bddd tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:12.115070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-eb270da7-8421-4b15-85d7-b35deae5bddd tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: a8bdbeff-7f16-4d67-823e-df6ec3e09842] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:12.126921 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eb270da7-8421-4b15-85d7-b35deae5bddd tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:12.128565 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eb270da7-8421-4b15-85d7-b35deae5bddd tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:12.129927 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eb270da7-8421-4b15-85d7-b35deae5bddd tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:12.131627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eb270da7-8421-4b15-85d7-b35deae5bddd tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:12.132452 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eb270da7-8421-4b15-85d7-b35deae5bddd tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:12.133126 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eb270da7-8421-4b15-85d7-b35deae5bddd tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:12.181495 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:14:12.486697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-eb270da7-8421-4b15-85d7-b35deae5bddd tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:12.505150 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-eb270da7-8421-4b15-85d7-b35deae5bddd tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842" status: 200 len: 1476 microversion: 2.1 time: 0.404240 Sep 17 21:14:12.508751 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2578/5052] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:12 2022] GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842 => generated 1476 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:14:13.404173 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-59a8299b-cef8-4bd6-91a7-1ce087bd3423 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Updating instance_info_cache with network_info: [{"id": "64dac991-3106-4bed-aa53-9b65aedc4b13", "address": "fa:16:3e:ce:0d:71", "network": {"id": "1fb95ae4-adb5-4d86-81a3-7ea7f2bd9b93", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-139225101-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.7.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ee1481a8ca9c4dd590cd6c7c53179df8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap64dac991-31", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140523) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 17 21:14:13.417736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59a8299b-cef8-4bd6-91a7-1ce087bd3423 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Releasing lock "refresh_cache-6c45f5fe-2176-44d4-a8b5-972d6b92d53c" {{(pid=140523) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 17 21:14:13.418883 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-59a8299b-cef8-4bd6-91a7-1ce087bd3423 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "POST /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c/action" status: 202 len: 0 microversion: 2.1 time: 7.246320 Sep 17 21:14:13.419510 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2475/5053] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:14:06 2022] POST /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c/action => generated 0 bytes in 7248 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 17 21:14:13.432035 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d07f6092-b32d-41f7-9f70-6a995aa781c4 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.7.249"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:14:13.533185 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-31f2a839-2c77-4bca-a353-dcb4e2baa9d8 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:13.533861 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-31f2a839-2c77-4bca-a353-dcb4e2baa9d8 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: a8bdbeff-7f16-4d67-823e-df6ec3e09842] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:13.536862 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:14:13.544115 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-31f2a839-2c77-4bca-a353-dcb4e2baa9d8 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:13.544991 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-31f2a839-2c77-4bca-a353-dcb4e2baa9d8 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:13.545724 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-31f2a839-2c77-4bca-a353-dcb4e2baa9d8 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:13.546725 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-31f2a839-2c77-4bca-a353-dcb4e2baa9d8 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:13.547289 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-31f2a839-2c77-4bca-a353-dcb4e2baa9d8 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:13.548201 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-31f2a839-2c77-4bca-a353-dcb4e2baa9d8 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:13.833639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-31f2a839-2c77-4bca-a353-dcb4e2baa9d8 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:13.854154 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-31f2a839-2c77-4bca-a353-dcb4e2baa9d8 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842" status: 200 len: 1476 microversion: 2.1 time: 0.323216 Sep 17 21:14:13.873316 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2476/5054] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:13 2022] GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842 => generated 1476 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:14:13.912206 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d07f6092-b32d-41f7-9f70-6a995aa781c4 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:13.921066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d07f6092-b32d-41f7-9f70-6a995aa781c4 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:13.921935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d07f6092-b32d-41f7-9f70-6a995aa781c4 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:13.922701 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d07f6092-b32d-41f7-9f70-6a995aa781c4 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:13.924242 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d07f6092-b32d-41f7-9f70-6a995aa781c4 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:13.924868 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d07f6092-b32d-41f7-9f70-6a995aa781c4 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:13.925494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d07f6092-b32d-41f7-9f70-6a995aa781c4 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:14.551999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d07f6092-b32d-41f7-9f70-6a995aa781c4 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "refresh_cache-6c45f5fe-2176-44d4-a8b5-972d6b92d53c" {{(pid=140524) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 17 21:14:14.552604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d07f6092-b32d-41f7-9f70-6a995aa781c4 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquired lock "refresh_cache-6c45f5fe-2176-44d4-a8b5-972d6b92d53c" {{(pid=140524) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 17 21:14:14.880504 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5ffd1d10-1198-44f5-adab-2b2af13f23d3 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:14.881247 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5ffd1d10-1198-44f5-adab-2b2af13f23d3 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: a8bdbeff-7f16-4d67-823e-df6ec3e09842] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:14.905034 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ffd1d10-1198-44f5-adab-2b2af13f23d3 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:14.906302 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ffd1d10-1198-44f5-adab-2b2af13f23d3 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:14.906940 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ffd1d10-1198-44f5-adab-2b2af13f23d3 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:14.907854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ffd1d10-1198-44f5-adab-2b2af13f23d3 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:14.909112 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ffd1d10-1198-44f5-adab-2b2af13f23d3 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:14.910165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ffd1d10-1198-44f5-adab-2b2af13f23d3 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:15.380025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5ffd1d10-1198-44f5-adab-2b2af13f23d3 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:15.396714 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5ffd1d10-1198-44f5-adab-2b2af13f23d3 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842" status: 200 len: 1476 microversion: 2.1 time: 0.517434 Sep 17 21:14:15.418893 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2477/5055] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:14 2022] GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842 => generated 1476 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:14:16.125246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-e5f7bf6c-b017-4266-96a2-3b0a45ea2cc6 req-59f5dad0-d3ac-4ab1-a58d-abcb10c90cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8bdbeff-7f16-4d67-823e-df6ec3e09842", "name": "network-vif-deleted", "tag": "172671df-7dc4-4512-ac66-f01f8e2d77d5"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:14:16.162843 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-e5f7bf6c-b017-4266-96a2-3b0a45ea2cc6 req-59f5dad0-d3ac-4ab1-a58d-abcb10c90cc5 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:16.165797 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-e5f7bf6c-b017-4266-96a2-3b0a45ea2cc6 req-59f5dad0-d3ac-4ab1-a58d-abcb10c90cc5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:16.166684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-e5f7bf6c-b017-4266-96a2-3b0a45ea2cc6 req-59f5dad0-d3ac-4ab1-a58d-abcb10c90cc5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:16.214328 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-e5f7bf6c-b017-4266-96a2-3b0a45ea2cc6 req-59f5dad0-d3ac-4ab1-a58d-abcb10c90cc5 service nova] Creating event network-vif-deleted:172671df-7dc4-4512-ac66-f01f8e2d77d5 for instance a8bdbeff-7f16-4d67-823e-df6ec3e09842 on nch1-master-1 Sep 17 21:14:16.228469 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-e5f7bf6c-b017-4266-96a2-3b0a45ea2cc6 req-59f5dad0-d3ac-4ab1-a58d-abcb10c90cc5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110672 Sep 17 21:14:16.245549 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2478/5056] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:14:16.424856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a0873a53-2d2f-4536-8e4f-760c642ad809 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:16.425864 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a0873a53-2d2f-4536-8e4f-760c642ad809 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: a8bdbeff-7f16-4d67-823e-df6ec3e09842] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:16.437100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0873a53-2d2f-4536-8e4f-760c642ad809 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:16.438166 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0873a53-2d2f-4536-8e4f-760c642ad809 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:16.439107 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0873a53-2d2f-4536-8e4f-760c642ad809 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:16.440489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0873a53-2d2f-4536-8e4f-760c642ad809 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:16.441211 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0873a53-2d2f-4536-8e4f-760c642ad809 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:16.441910 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0873a53-2d2f-4536-8e4f-760c642ad809 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:16.508535 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0873a53-2d2f-4536-8e4f-760c642ad809 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:16.509293 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0873a53-2d2f-4536-8e4f-760c642ad809 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:16.510005 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0873a53-2d2f-4536-8e4f-760c642ad809 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:16.510737 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-a0873a53-2d2f-4536-8e4f-760c642ad809 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lazy-loading 'fault' on Instance uuid a8bdbeff-7f16-4d67-823e-df6ec3e09842 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:14:16.961762 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a0873a53-2d2f-4536-8e4f-760c642ad809 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:16.972623 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a0873a53-2d2f-4536-8e4f-760c642ad809 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842" status: 200 len: 1331 microversion: 2.1 time: 0.552333 Sep 17 21:14:16.974056 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2479/5057] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:16 2022] GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842 => generated 1331 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:14:17.445511 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=4 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:14:17.753786 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-461b529d-a362-40a2-b550-c51d0cc94b38 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-470388731", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "50731d33-6e2a-4367-9931-32837ecb7f6a"}], "security_groups": [{"name": "tempest-securitygroup--407048995"}], "key_name": "tempest-keypair-1874286382", "user_data": "}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:14:18.151743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-461b529d-a362-40a2-b550-c51d0cc94b38 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] validate_networks() for [('50731d33-6e2a-4367-9931-32837ecb7f6a', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:14:18.533953 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-d07f6092-b32d-41f7-9f70-6a995aa781c4 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Building network info cache for instance {{(pid=140524) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 17 21:14:20.328961 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-461b529d-a362-40a2-b550-c51d0cc94b38 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:14:20.329528 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-461b529d-a362-40a2-b550-c51d0cc94b38 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:14:20.330007 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-461b529d-a362-40a2-b550-c51d0cc94b38 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:14:20.330550 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-461b529d-a362-40a2-b550-c51d0cc94b38 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:14:20.331036 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-461b529d-a362-40a2-b550-c51d0cc94b38 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:14:20.350766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-461b529d-a362-40a2-b550-c51d0cc94b38 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:20.352267 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-461b529d-a362-40a2-b550-c51d0cc94b38 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:20.352728 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-461b529d-a362-40a2-b550-c51d0cc94b38 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:20.354723 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-461b529d-a362-40a2-b550-c51d0cc94b38 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:20.355191 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-461b529d-a362-40a2-b550-c51d0cc94b38 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:20.355625 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-461b529d-a362-40a2-b550-c51d0cc94b38 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:20.408362 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-461b529d-a362-40a2-b550-c51d0cc94b38 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Getting quotas for project 720881c6f7304aadbf069698c97dc5c5. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:14:20.428447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-461b529d-a362-40a2-b550-c51d0cc94b38 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Getting quotas for user 8ddb1d0a7bca457493d7ac9a58a01e64 and project 720881c6f7304aadbf069698c97dc5c5. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:14:20.458590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-461b529d-a362-40a2-b550-c51d0cc94b38 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:14:20.461626 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-461b529d-a362-40a2-b550-c51d0cc94b38 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:14:20.528302 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-461b529d-a362-40a2-b550-c51d0cc94b38 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.784687 Sep 17 21:14:20.529738 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2480/5058] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Sep 17 21:14:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 2787 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 17 21:14:20.535605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-71c6b2c2-deb9-4e83-a122-77b0754e4f1d tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:20.536759 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-71c6b2c2-deb9-4e83-a122-77b0754e4f1d tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: a8bdbeff-7f16-4d67-823e-df6ec3e09842] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:20.545756 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-71c6b2c2-deb9-4e83-a122-77b0754e4f1d tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:20.548148 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-71c6b2c2-deb9-4e83-a122-77b0754e4f1d tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:20.548938 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-71c6b2c2-deb9-4e83-a122-77b0754e4f1d tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:20.550241 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-71c6b2c2-deb9-4e83-a122-77b0754e4f1d tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:20.551828 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-71c6b2c2-deb9-4e83-a122-77b0754e4f1d tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:20.552712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-71c6b2c2-deb9-4e83-a122-77b0754e4f1d tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:20.572503 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-71c6b2c2-deb9-4e83-a122-77b0754e4f1d tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] HTTP exception thrown: Instance a8bdbeff-7f16-4d67-823e-df6ec3e09842 could not be found. Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-71c6b2c2-deb9-4e83-a122-77b0754e4f1d tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Request method failure captured: Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842 HTTP/1.1 Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjgpZkDTZP7qPMsXRYIooSnSxPSv3KfqyblFGj1YVmLiLy9HDMWi_NPmaWUmM6f75x9eHAFQEkmWh6Z5jSanozjgdJ0mKYVnx9KCw5Ayw0qPv4F3IigX-ECywSpE3qF3HMMcJcZcOzipaGAm2COYVYVAsoqHX3nizF-pSXs7izYhAj4 Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: cfc26054d4a34fb2b2aef34fb4891b4c Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-338602773 Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cfc26054d4a34fb2b2aef34fb4891b4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cfc26054d4a34fb2b2aef34fb4891b4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cfc26054d4a34fb2b2aef34fb4891b4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cfc26054d4a34fb2b2aef34fb4891b4c", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-TestSecurityGroupsBasicOps-338602773 Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: cfc26054d4a34fb2b2aef34fb4891b4c Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-338602773 Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-TestSecurityGroupsBasicOps-338602773-project Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: caa2c2f4848e497f80d4a439c785c2b0 Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-TestSecurityGroupsBasicOps-338602773-project Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance a8bdbeff-7f16-4d67-823e-df6ec3e09842 could not be found. Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'a8bdbeff-7f16-4d67-823e-df6ec3e09842'} Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8bdbeff-7f16-4d67-823e-df6ec3e09842 could not be found. Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8bdbeff-7f16-4d67-823e-df6ec3e09842 could not be found. Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:20.603792 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:14:20.609745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:20.609745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:20.609745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:20.609745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:14:20.609745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:14:20.609745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8bdbeff-7f16-4d67-823e-df6ec3e09842 could not be found. Sep 17 21:14:20.609745 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:14:20.612912 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-71c6b2c2-deb9-4e83-a122-77b0754e4f1d tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Returning 404 to user: Instance a8bdbeff-7f16-4d67-823e-df6ec3e09842 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:14:20.616367 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-71c6b2c2-deb9-4e83-a122-77b0754e4f1d tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842" status: 404 len: 111 microversion: 2.1 time: 0.084461 Sep 17 21:14:20.617123 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2481/5059] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:20 2022] GET /compute/v2.1/servers/a8bdbeff-7f16-4d67-823e-df6ec3e09842 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:14:20.626640 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-238772fa-b0b8-47d1-9d56-2c4813d73625 req-553f4a00-b977-4367-9022-c8b598be4d35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c45f5fe-2176-44d4-a8b5-972d6b92d53c", "tag": "64dac991-3106-4bed-aa53-9b65aedc4b13"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:14:20.640105 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-238772fa-b0b8-47d1-9d56-2c4813d73625 req-553f4a00-b977-4367-9022-c8b598be4d35 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:20.640771 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-238772fa-b0b8-47d1-9d56-2c4813d73625 req-553f4a00-b977-4367-9022-c8b598be4d35 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:20.641628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-238772fa-b0b8-47d1-9d56-2c4813d73625 req-553f4a00-b977-4367-9022-c8b598be4d35 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:20.664774 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-238772fa-b0b8-47d1-9d56-2c4813d73625 req-553f4a00-b977-4367-9022-c8b598be4d35 service nova] Creating event network-changed:64dac991-3106-4bed-aa53-9b65aedc4b13 for instance 6c45f5fe-2176-44d4-a8b5-972d6b92d53c on nch1-master-1 Sep 17 21:14:20.670890 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-238772fa-b0b8-47d1-9d56-2c4813d73625 req-553f4a00-b977-4367-9022-c8b598be4d35 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051541 Sep 17 21:14:20.672016 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2482/5060] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:14:20.677552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-53d95338-3f49-4e84-9da4-9953798cfa9c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:20.678459 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-53d95338-3f49-4e84-9da4-9953798cfa9c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:21.055606 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-53d95338-3f49-4e84-9da4-9953798cfa9c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:21.077347 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-53d95338-3f49-4e84-9da4-9953798cfa9c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:21.081725 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-53d95338-3f49-4e84-9da4-9953798cfa9c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:21.084889 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-53d95338-3f49-4e84-9da4-9953798cfa9c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1281 microversion: 2.20 time: 0.410790 Sep 17 21:14:21.086251 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2483/5061] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:14:20 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1281 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:14:21.350323 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-d07f6092-b32d-41f7-9f70-6a995aa781c4 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Updating instance_info_cache with network_info: [{"id": "64dac991-3106-4bed-aa53-9b65aedc4b13", "address": "fa:16:3e:ce:0d:71", "network": {"id": "1fb95ae4-adb5-4d86-81a3-7ea7f2bd9b93", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-139225101-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "ee1481a8ca9c4dd590cd6c7c53179df8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap64dac991-31", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=140524) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 17 21:14:21.379725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d07f6092-b32d-41f7-9f70-6a995aa781c4 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Releasing lock "refresh_cache-6c45f5fe-2176-44d4-a8b5-972d6b92d53c" {{(pid=140524) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 17 21:14:21.380867 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d07f6092-b32d-41f7-9f70-6a995aa781c4 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "POST /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c/action" status: 202 len: 0 microversion: 2.1 time: 7.956037 Sep 17 21:14:21.381380 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2579/5062] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:14:13 2022] POST /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c/action => generated 0 bytes in 7958 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Sep 17 21:14:21.390081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-961195fd-d275-4fc6-93f0-25548d40e73e tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '.version_select at 0x7f25a47b2430>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:22.114645 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5f4a988d-a3e5-4110-ab2f-db40b5b0958a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:22.115277 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5f4a988d-a3e5-4110-ab2f-db40b5b0958a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:22.130040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5f4a988d-a3e5-4110-ab2f-db40b5b0958a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:22.130555 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5f4a988d-a3e5-4110-ab2f-db40b5b0958a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:22.131003 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5f4a988d-a3e5-4110-ab2f-db40b5b0958a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:22.131743 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5f4a988d-a3e5-4110-ab2f-db40b5b0958a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:22.132216 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5f4a988d-a3e5-4110-ab2f-db40b5b0958a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:22.132804 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5f4a988d-a3e5-4110-ab2f-db40b5b0958a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:22.566566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5f4a988d-a3e5-4110-ab2f-db40b5b0958a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:22.575847 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5f4a988d-a3e5-4110-ab2f-db40b5b0958a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:22.587860 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5f4a988d-a3e5-4110-ab2f-db40b5b0958a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:22.589159 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5f4a988d-a3e5-4110-ab2f-db40b5b0958a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1333 microversion: 2.20 time: 0.478482 Sep 17 21:14:22.599969 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2580/5063] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:14:22 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1333 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:14:22.613571 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6a18dd04-87d7-4ad6-b1c8-60217b87c02a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:22.613571 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6a18dd04-87d7-4ad6-b1c8-60217b87c02a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:22.633651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a18dd04-87d7-4ad6-b1c8-60217b87c02a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:22.642048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a18dd04-87d7-4ad6-b1c8-60217b87c02a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:22.643459 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a18dd04-87d7-4ad6-b1c8-60217b87c02a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:22.648618 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a18dd04-87d7-4ad6-b1c8-60217b87c02a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:22.649391 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a18dd04-87d7-4ad6-b1c8-60217b87c02a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:22.650167 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a18dd04-87d7-4ad6-b1c8-60217b87c02a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:22.700887 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-6a18dd04-87d7-4ad6-b1c8-60217b87c02a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] HTTP exception thrown: Instance 59016b2c-e625-4f0c-8379-b48d97025cf3 could not be found. Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6a18dd04-87d7-4ad6-b1c8-60217b87c02a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Request method failure captured: Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 HTTP/1.1 Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjcntI3owAMxOH9W5qCSaJGcHtXQ0G8LKwo2XDAFvq16FKstTDd6SgTnAad3YZsQkF82V46f87Kt3zJAd6R8xNTKRGIbS9sag0WazD6IcxF5ZTDjmqSdZ3yyvikP9vExCvz4gO_iELQFvDKvzIJ8WNl9o7ua77T7djWFVqOCQ9WBy_s Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: X-Openstack-Nova-Api-Version: 2.42 Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: c4a4d7fd12784db69cf699e7e58d4d6a Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-970179712 Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c4a4d7fd12784db69cf699e7e58d4d6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c4a4d7fd12784db69cf699e7e58d4d6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c4a4d7fd12784db69cf699e7e58d4d6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c4a4d7fd12784db69cf699e7e58d4d6a", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-TaggedBootDevicesTest_v242-970179712 Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: c4a4d7fd12784db69cf699e7e58d4d6a Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-970179712 Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-TaggedBootDevicesTest_v242-970179712-project Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 7a13dc0c95a64d499bd05f808565fccd Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-TaggedBootDevicesTest_v242-970179712-project Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 59016b2c-e625-4f0c-8379-b48d97025cf3 could not be found. Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '59016b2c-e625-4f0c-8379-b48d97025cf3'} Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59016b2c-e625-4f0c-8379-b48d97025cf3 could not be found. Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:14:22.706014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:14:22.712232 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59016b2c-e625-4f0c-8379-b48d97025cf3 could not be found. Sep 17 21:14:22.712232 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:14:22.712232 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:22.712232 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:14:22.712232 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:22.712232 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:22.712232 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:22.712232 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:14:22.712232 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:14:22.712232 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59016b2c-e625-4f0c-8379-b48d97025cf3 could not be found. Sep 17 21:14:22.712232 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:14:22.713515 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6a18dd04-87d7-4ad6-b1c8-60217b87c02a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Returning 404 to user: Instance 59016b2c-e625-4f0c-8379-b48d97025cf3 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:14:22.715221 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6a18dd04-87d7-4ad6-b1c8-60217b87c02a tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "DELETE /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 404 len: 111 microversion: 2.42 time: 0.115751 Sep 17 21:14:22.717011 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2581/5064] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 17 21:14:22 2022] DELETE /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:14:22.732009 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9957316a-80f6-4240-89a3-f34cd39c6079 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:22.735055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9957316a-80f6-4240-89a3-f34cd39c6079 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] [instance: 59016b2c-e625-4f0c-8379-b48d97025cf3] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:22.761256 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9957316a-80f6-4240-89a3-f34cd39c6079 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:22.761256 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9957316a-80f6-4240-89a3-f34cd39c6079 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:22.761644 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9957316a-80f6-4240-89a3-f34cd39c6079 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:22.764985 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9957316a-80f6-4240-89a3-f34cd39c6079 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:22.766967 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9957316a-80f6-4240-89a3-f34cd39c6079 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:22.768242 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9957316a-80f6-4240-89a3-f34cd39c6079 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:22.805377 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-9957316a-80f6-4240-89a3-f34cd39c6079 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] HTTP exception thrown: Instance 59016b2c-e625-4f0c-8379-b48d97025cf3 could not be found. Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9957316a-80f6-4240-89a3-f34cd39c6079 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Request method failure captured: Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 HTTP/1.1 Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjcntI3owAMxOH9W5qCSaJGcHtXQ0G8LKwo2XDAFvq16FKstTDd6SgTnAad3YZsQkF82V46f87Kt3zJAd6R8xNTKRGIbS9sag0WazD6IcxF5ZTDjmqSdZ3yyvikP9vExCvz4gO_iELQFvDKvzIJ8WNl9o7ua77T7djWFVqOCQ9WBy_s Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: X-Openstack-Nova-Api-Version: 2.42 Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: c4a4d7fd12784db69cf699e7e58d4d6a Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-970179712 Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c4a4d7fd12784db69cf699e7e58d4d6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c4a4d7fd12784db69cf699e7e58d4d6a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c4a4d7fd12784db69cf699e7e58d4d6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c4a4d7fd12784db69cf699e7e58d4d6a", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-TaggedBootDevicesTest_v242-970179712 Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: c4a4d7fd12784db69cf699e7e58d4d6a Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-970179712 Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-TaggedBootDevicesTest_v242-970179712-project Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 7a13dc0c95a64d499bd05f808565fccd Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-TaggedBootDevicesTest_v242-970179712-project Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 59016b2c-e625-4f0c-8379-b48d97025cf3 could not be found. Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '59016b2c-e625-4f0c-8379-b48d97025cf3'} Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59016b2c-e625-4f0c-8379-b48d97025cf3 could not be found. Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59016b2c-e625-4f0c-8379-b48d97025cf3 could not be found. Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:14:22.807316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:22.812757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:14:22.812757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:22.812757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:22.812757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:22.812757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:14:22.812757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:14:22.812757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59016b2c-e625-4f0c-8379-b48d97025cf3 could not be found. Sep 17 21:14:22.812757 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:14:22.815043 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9957316a-80f6-4240-89a3-f34cd39c6079 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] Returning 404 to user: Instance 59016b2c-e625-4f0c-8379-b48d97025cf3 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:14:22.816125 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9957316a-80f6-4240-89a3-f34cd39c6079 tempest-TaggedBootDevicesTest_v242-970179712 tempest-TaggedBootDevicesTest_v242-970179712-project] 10.222.0.26 "GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3" status: 404 len: 111 microversion: 2.42 time: 0.094397 Sep 17 21:14:22.817232 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2582/5065] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:14:22 2022] GET /compute/v2.1/servers/59016b2c-e625-4f0c-8379-b48d97025cf3 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:14:23.624416 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0aab360a-8c68-466d-ad6b-c7205ce0a4ae tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:23.626031 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0aab360a-8c68-466d-ad6b-c7205ce0a4ae tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:23.644849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0aab360a-8c68-466d-ad6b-c7205ce0a4ae tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:23.646752 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0aab360a-8c68-466d-ad6b-c7205ce0a4ae tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:23.648898 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0aab360a-8c68-466d-ad6b-c7205ce0a4ae tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:23.651353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0aab360a-8c68-466d-ad6b-c7205ce0a4ae tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:23.652259 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0aab360a-8c68-466d-ad6b-c7205ce0a4ae tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:23.654292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0aab360a-8c68-466d-ad6b-c7205ce0a4ae tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:23.957132 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0aab360a-8c68-466d-ad6b-c7205ce0a4ae tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:23.969857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0aab360a-8c68-466d-ad6b-c7205ce0a4ae tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:23.971838 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0aab360a-8c68-466d-ad6b-c7205ce0a4ae tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:23.973809 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0aab360a-8c68-466d-ad6b-c7205ce0a4ae tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1339 microversion: 2.20 time: 0.356123 Sep 17 21:14:23.974908 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2583/5066] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:14:23 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1339 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:14:25.005151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a3f6eb67-635a-4236-83d7-e3c14ae5d0b2 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:25.011475 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a3f6eb67-635a-4236-83d7-e3c14ae5d0b2 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:25.028740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a3f6eb67-635a-4236-83d7-e3c14ae5d0b2 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:25.030581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a3f6eb67-635a-4236-83d7-e3c14ae5d0b2 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:25.032011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a3f6eb67-635a-4236-83d7-e3c14ae5d0b2 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:25.034896 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a3f6eb67-635a-4236-83d7-e3c14ae5d0b2 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:25.035504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a3f6eb67-635a-4236-83d7-e3c14ae5d0b2 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:25.037821 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a3f6eb67-635a-4236-83d7-e3c14ae5d0b2 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:25.173066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a3f6eb67-635a-4236-83d7-e3c14ae5d0b2 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:25.197708 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a3f6eb67-635a-4236-83d7-e3c14ae5d0b2 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:25.199249 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a3f6eb67-635a-4236-83d7-e3c14ae5d0b2 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:25.205406 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a3f6eb67-635a-4236-83d7-e3c14ae5d0b2 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1339 microversion: 2.20 time: 0.209380 Sep 17 21:14:25.206066 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2584/5067] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:14:24 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1339 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:14:25.681962 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-961195fd-d275-4fc6-93f0-25548d40e73e tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/1ae80c1b-32c3-4f5a-9e91-5add708db143" status: 202 len: 0 microversion: 2.1 time: 4.295513 Sep 17 21:14:25.682675 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2484/5068] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Sep 17 21:14:21 2022] DELETE /compute/v2.1/os-floating-ips/1ae80c1b-32c3-4f5a-9e91-5add708db143 => generated 0 bytes in 4297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:14:25.717108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c4749ec5-506d-4203-97a4-6874a68b7610 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '.version_select at 0x7f25a43314c0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:26.240012 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-432061d7-1720-45ce-9c4d-082fe1e5a4ea tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:26.240639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-432061d7-1720-45ce-9c4d-082fe1e5a4ea tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:26.254972 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-432061d7-1720-45ce-9c4d-082fe1e5a4ea tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:26.255374 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-432061d7-1720-45ce-9c4d-082fe1e5a4ea tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:26.256328 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-432061d7-1720-45ce-9c4d-082fe1e5a4ea tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:26.256638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-432061d7-1720-45ce-9c4d-082fe1e5a4ea tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:26.257032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-432061d7-1720-45ce-9c4d-082fe1e5a4ea tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:26.257418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-432061d7-1720-45ce-9c4d-082fe1e5a4ea tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:26.796984 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c4749ec5-506d-4203-97a4-6874a68b7610 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/cd98bc0d-63f6-4c0c-9b4f-3b6ecd5cb48e" status: 202 len: 0 microversion: 2.1 time: 1.101700 Sep 17 21:14:26.799403 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2585/5069] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 21:14:25 2022] DELETE /compute/v2.1/os-security-groups/cd98bc0d-63f6-4c0c-9b4f-3b6ecd5cb48e => generated 0 bytes in 1105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:14:26.810063 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-32b2e726-e510-4df4-bf69-9eddf6aaba40 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:26.811095 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-32b2e726-e510-4df4-bf69-9eddf6aaba40 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:26.823679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32b2e726-e510-4df4-bf69-9eddf6aaba40 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:26.825906 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32b2e726-e510-4df4-bf69-9eddf6aaba40 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:26.827362 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32b2e726-e510-4df4-bf69-9eddf6aaba40 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:26.830729 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32b2e726-e510-4df4-bf69-9eddf6aaba40 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:26.831703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32b2e726-e510-4df4-bf69-9eddf6aaba40 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:26.833909 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32b2e726-e510-4df4-bf69-9eddf6aaba40 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:26.925915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-32b2e726-e510-4df4-bf69-9eddf6aaba40 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:14:27.156088 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-32b2e726-e510-4df4-bf69-9eddf6aaba40 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 204 len: 0 microversion: 2.1 time: 0.352173 Sep 17 21:14:27.156705 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2586/5070] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:14:26 2022] DELETE /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 17 21:14:27.165531 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-aa5db978-47bb-48aa-9648-c3331cfcc34a tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:27.168402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-aa5db978-47bb-48aa-9648-c3331cfcc34a tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:27.180228 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa5db978-47bb-48aa-9648-c3331cfcc34a tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:27.180913 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa5db978-47bb-48aa-9648-c3331cfcc34a tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:27.181621 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa5db978-47bb-48aa-9648-c3331cfcc34a tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:27.182546 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa5db978-47bb-48aa-9648-c3331cfcc34a tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:27.183343 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa5db978-47bb-48aa-9648-c3331cfcc34a tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:27.197506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa5db978-47bb-48aa-9648-c3331cfcc34a tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:27.569239 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-432061d7-1720-45ce-9c4d-082fe1e5a4ea tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:27.588950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-432061d7-1720-45ce-9c4d-082fe1e5a4ea tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:27.593734 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-432061d7-1720-45ce-9c4d-082fe1e5a4ea tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:27.599195 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-432061d7-1720-45ce-9c4d-082fe1e5a4ea tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1406 microversion: 2.20 time: 1.363022 Sep 17 21:14:27.601371 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2485/5071] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:14:26 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1406 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:14:27.760292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-aa5db978-47bb-48aa-9648-c3331cfcc34a tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:27.780635 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-aa5db978-47bb-48aa-9648-c3331cfcc34a tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1509 microversion: 2.1 time: 0.618481 Sep 17 21:14:27.799678 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2587/5072] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:27 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1509 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:14:28.628891 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dfa8d048-c6a1-42b5-85a4-5277a4ac08de tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:28.629812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dfa8d048-c6a1-42b5-85a4-5277a4ac08de tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:28.690099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfa8d048-c6a1-42b5-85a4-5277a4ac08de tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:28.690710 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfa8d048-c6a1-42b5-85a4-5277a4ac08de tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:28.695436 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfa8d048-c6a1-42b5-85a4-5277a4ac08de tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:28.700718 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfa8d048-c6a1-42b5-85a4-5277a4ac08de tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:28.701324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfa8d048-c6a1-42b5-85a4-5277a4ac08de tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:28.703356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfa8d048-c6a1-42b5-85a4-5277a4ac08de tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:28.804862 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1108180e-13ab-4f22-86c0-22c781236a65 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:28.806252 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1108180e-13ab-4f22-86c0-22c781236a65 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:28.822154 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1108180e-13ab-4f22-86c0-22c781236a65 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:28.823183 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1108180e-13ab-4f22-86c0-22c781236a65 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:28.823850 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1108180e-13ab-4f22-86c0-22c781236a65 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:28.826528 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1108180e-13ab-4f22-86c0-22c781236a65 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:28.827006 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1108180e-13ab-4f22-86c0-22c781236a65 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:28.829987 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1108180e-13ab-4f22-86c0-22c781236a65 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:29.309728 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dfa8d048-c6a1-42b5-85a4-5277a4ac08de tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:29.318477 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dfa8d048-c6a1-42b5-85a4-5277a4ac08de tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:29.319931 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dfa8d048-c6a1-42b5-85a4-5277a4ac08de tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:29.321082 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dfa8d048-c6a1-42b5-85a4-5277a4ac08de tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1406 microversion: 2.20 time: 0.696918 Sep 17 21:14:29.321678 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2486/5073] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:14:28 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1406 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:14:29.391308 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1108180e-13ab-4f22-86c0-22c781236a65 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:29.399963 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1108180e-13ab-4f22-86c0-22c781236a65 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1509 microversion: 2.1 time: 0.599030 Sep 17 21:14:29.401328 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2588/5074] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:28 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1509 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:14:30.353126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e0ad04df-85c9-4dcd-b123-86d11d24ab9e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:30.354825 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e0ad04df-85c9-4dcd-b123-86d11d24ab9e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:30.385076 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0ad04df-85c9-4dcd-b123-86d11d24ab9e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:30.385940 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0ad04df-85c9-4dcd-b123-86d11d24ab9e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:30.387247 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0ad04df-85c9-4dcd-b123-86d11d24ab9e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:30.394567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0ad04df-85c9-4dcd-b123-86d11d24ab9e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:30.397236 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0ad04df-85c9-4dcd-b123-86d11d24ab9e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:30.397983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0ad04df-85c9-4dcd-b123-86d11d24ab9e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:30.399247 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:14:30.430218 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1b120d7f-d6de-4bda-9895-3fe4916b503b tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:30.430864 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1b120d7f-d6de-4bda-9895-3fe4916b503b tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:30.441389 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1b120d7f-d6de-4bda-9895-3fe4916b503b tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:30.449423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1b120d7f-d6de-4bda-9895-3fe4916b503b tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:30.449936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1b120d7f-d6de-4bda-9895-3fe4916b503b tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:30.450709 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1b120d7f-d6de-4bda-9895-3fe4916b503b tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:30.451182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1b120d7f-d6de-4bda-9895-3fe4916b503b tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:30.451619 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1b120d7f-d6de-4bda-9895-3fe4916b503b tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:31.002542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1b120d7f-d6de-4bda-9895-3fe4916b503b tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:31.043363 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1b120d7f-d6de-4bda-9895-3fe4916b503b tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1509 microversion: 2.1 time: 0.623388 Sep 17 21:14:31.056589 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2589/5075] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:30 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1509 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:14:31.067050 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=8 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:14:31.184462 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e0ad04df-85c9-4dcd-b123-86d11d24ab9e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:31.198224 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e0ad04df-85c9-4dcd-b123-86d11d24ab9e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:31.199673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e0ad04df-85c9-4dcd-b123-86d11d24ab9e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:31.200840 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e0ad04df-85c9-4dcd-b123-86d11d24ab9e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1406 microversion: 2.20 time: 0.857214 Sep 17 21:14:31.233161 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2487/5076] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:14:30 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1406 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:14:31.771139 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-4ff4f886-64d4-4c9f-8637-db7d3fce2248 req-6762bbe0-7a17-4c10-9e37-185cad61d390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c45f5fe-2176-44d4-a8b5-972d6b92d53c", "name": "network-vif-deleted", "tag": "64dac991-3106-4bed-aa53-9b65aedc4b13"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:14:31.792062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4ff4f886-64d4-4c9f-8637-db7d3fce2248 req-6762bbe0-7a17-4c10-9e37-185cad61d390 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:31.793025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4ff4f886-64d4-4c9f-8637-db7d3fce2248 req-6762bbe0-7a17-4c10-9e37-185cad61d390 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:31.799094 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4ff4f886-64d4-4c9f-8637-db7d3fce2248 req-6762bbe0-7a17-4c10-9e37-185cad61d390 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:31.824352 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-4ff4f886-64d4-4c9f-8637-db7d3fce2248 req-6762bbe0-7a17-4c10-9e37-185cad61d390 service nova] Creating event network-vif-deleted:64dac991-3106-4bed-aa53-9b65aedc4b13 for instance 6c45f5fe-2176-44d4-a8b5-972d6b92d53c on nch1-master-1 Sep 17 21:14:31.833234 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-4ff4f886-64d4-4c9f-8637-db7d3fce2248 req-6762bbe0-7a17-4c10-9e37-185cad61d390 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066973 Sep 17 21:14:31.834162 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2590/5077] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:14:32.068767 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-56e9ac9d-7cb8-4207-bde1-acdb0c6d9b6a tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:32.069508 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-56e9ac9d-7cb8-4207-bde1-acdb0c6d9b6a tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:32.078058 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56e9ac9d-7cb8-4207-bde1-acdb0c6d9b6a tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:32.078920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56e9ac9d-7cb8-4207-bde1-acdb0c6d9b6a tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:32.080111 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56e9ac9d-7cb8-4207-bde1-acdb0c6d9b6a tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:32.081179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56e9ac9d-7cb8-4207-bde1-acdb0c6d9b6a tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:32.081906 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56e9ac9d-7cb8-4207-bde1-acdb0c6d9b6a tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:32.083527 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56e9ac9d-7cb8-4207-bde1-acdb0c6d9b6a tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:32.138909 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56e9ac9d-7cb8-4207-bde1-acdb0c6d9b6a tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:32.139582 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56e9ac9d-7cb8-4207-bde1-acdb0c6d9b6a tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:32.140047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56e9ac9d-7cb8-4207-bde1-acdb0c6d9b6a tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:32.141251 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-56e9ac9d-7cb8-4207-bde1-acdb0c6d9b6a tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lazy-loading 'fault' on Instance uuid 6c45f5fe-2176-44d4-a8b5-972d6b92d53c {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:14:32.234301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bfd2353e-3dd2-4c2a-8859-e3a033c7798b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:32.235394 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bfd2353e-3dd2-4c2a-8859-e3a033c7798b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:32.252833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bfd2353e-3dd2-4c2a-8859-e3a033c7798b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:32.254730 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bfd2353e-3dd2-4c2a-8859-e3a033c7798b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:32.256020 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bfd2353e-3dd2-4c2a-8859-e3a033c7798b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:32.257156 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bfd2353e-3dd2-4c2a-8859-e3a033c7798b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:32.258082 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bfd2353e-3dd2-4c2a-8859-e3a033c7798b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:32.259298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bfd2353e-3dd2-4c2a-8859-e3a033c7798b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:32.760569 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-56e9ac9d-7cb8-4207-bde1-acdb0c6d9b6a tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db8955202fe42d2a4c86a15b193787f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee1481a8ca9c4dd590cd6c7c53179df8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:32.763018 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:14:32.775010 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-56e9ac9d-7cb8-4207-bde1-acdb0c6d9b6a tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 200 len: 1313 microversion: 2.1 time: 0.708430 Sep 17 21:14:32.778153 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2488/5078] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:32 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 1313 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:14:33.079020 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bfd2353e-3dd2-4c2a-8859-e3a033c7798b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:33.088378 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bfd2353e-3dd2-4c2a-8859-e3a033c7798b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:33.089860 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bfd2353e-3dd2-4c2a-8859-e3a033c7798b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:33.091035 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bfd2353e-3dd2-4c2a-8859-e3a033c7798b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1406 microversion: 2.20 time: 0.863773 Sep 17 21:14:33.113512 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2591/5079] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:14:32 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1406 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:14:33.803914 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b82cf324-be61-4074-9372-2d6c57cfcb45 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:33.804513 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b82cf324-be61-4074-9372-2d6c57cfcb45 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] [instance: 6c45f5fe-2176-44d4-a8b5-972d6b92d53c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:33.838346 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b82cf324-be61-4074-9372-2d6c57cfcb45 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:33.838920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b82cf324-be61-4074-9372-2d6c57cfcb45 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:33.843109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b82cf324-be61-4074-9372-2d6c57cfcb45 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:33.845020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b82cf324-be61-4074-9372-2d6c57cfcb45 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:33.845721 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b82cf324-be61-4074-9372-2d6c57cfcb45 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:33.846395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b82cf324-be61-4074-9372-2d6c57cfcb45 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:33.865902 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-b82cf324-be61-4074-9372-2d6c57cfcb45 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] HTTP exception thrown: Instance 6c45f5fe-2176-44d4-a8b5-972d6b92d53c could not be found. Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b82cf324-be61-4074-9372-2d6c57cfcb45 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Request method failure captured: Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c HTTP/1.1 Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjhfb_OHZnAYdKSrk6EA_FVPgwgDB83XZloqCrIMmF0nhmnSIq3STAgPRtjgDidMz4VCJujEWY8ur78E0L9g6vpUWxwlxAn0kaaBJolGHGMadZpUq0wS0sOGJGiYKZ4E7qaAVYLANKUUN769gQbA6wLJiB3V2G58HthZUvOwIzOvmMU Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: ee1481a8ca9c4dd590cd6c7c53179df8 Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1487215451 Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee1481a8ca9c4dd590cd6c7c53179df8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ee1481a8ca9c4dd590cd6c7c53179df8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ee1481a8ca9c4dd590cd6c7c53179df8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ee1481a8ca9c4dd590cd6c7c53179df8", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1487215451 Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: ee1481a8ca9c4dd590cd6c7c53179df8 Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1487215451 Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerRescueTestJSONUnderV235-1487215451-project Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 2db8955202fe42d2a4c86a15b193787f Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1487215451-project Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 6c45f5fe-2176-44d4-a8b5-972d6b92d53c could not be found. Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '6c45f5fe-2176-44d4-a8b5-972d6b92d53c'} Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c45f5fe-2176-44d4-a8b5-972d6b92d53c could not be found. Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c45f5fe-2176-44d4-a8b5-972d6b92d53c could not be found. Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:14:33.868094 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:33.873831 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:14:33.873831 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:33.873831 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:33.873831 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:33.873831 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:14:33.873831 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:14:33.873831 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c45f5fe-2176-44d4-a8b5-972d6b92d53c could not be found. Sep 17 21:14:33.873831 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:14:33.875894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b82cf324-be61-4074-9372-2d6c57cfcb45 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] Returning 404 to user: Instance 6c45f5fe-2176-44d4-a8b5-972d6b92d53c could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:14:33.877631 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b82cf324-be61-4074-9372-2d6c57cfcb45 tempest-ServerRescueTestJSONUnderV235-1487215451 tempest-ServerRescueTestJSONUnderV235-1487215451-project] 10.222.0.26 "GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c" status: 404 len: 111 microversion: 2.1 time: 0.077548 Sep 17 21:14:33.878718 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2489/5080] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:33 2022] GET /compute/v2.1/servers/6c45f5fe-2176-44d4-a8b5-972d6b92d53c => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:14:33.896779 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-fc3f4ccd-60bc-4a99-a5c5-d9e31820d842 req-514562f7-7c26-44d6-b170-d00d75318900 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "796cf34c-7dbb-444e-a74e-68139729405f", "tag": "74223161-c2a1-4706-8b34-7e44c8bdcb2b"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:14:33.939487 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-fc3f4ccd-60bc-4a99-a5c5-d9e31820d842 req-514562f7-7c26-44d6-b170-d00d75318900 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:33.940011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-fc3f4ccd-60bc-4a99-a5c5-d9e31820d842 req-514562f7-7c26-44d6-b170-d00d75318900 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:33.940461 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-fc3f4ccd-60bc-4a99-a5c5-d9e31820d842 req-514562f7-7c26-44d6-b170-d00d75318900 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:33.956376 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-fc3f4ccd-60bc-4a99-a5c5-d9e31820d842 req-514562f7-7c26-44d6-b170-d00d75318900 service nova] Creating event network-changed:74223161-c2a1-4706-8b34-7e44c8bdcb2b for instance 796cf34c-7dbb-444e-a74e-68139729405f on nch2-master-1 Sep 17 21:14:33.964301 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-fc3f4ccd-60bc-4a99-a5c5-d9e31820d842 req-514562f7-7c26-44d6-b170-d00d75318900 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071222 Sep 17 21:14:33.965251 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2592/5081] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:14:34.131228 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c14500aa-e281-4be6-adfc-78e7f39c190a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:34.131838 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c14500aa-e281-4be6-adfc-78e7f39c190a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:34.140982 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c14500aa-e281-4be6-adfc-78e7f39c190a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:34.142546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c14500aa-e281-4be6-adfc-78e7f39c190a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:34.143232 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c14500aa-e281-4be6-adfc-78e7f39c190a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:34.144363 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c14500aa-e281-4be6-adfc-78e7f39c190a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:34.144819 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c14500aa-e281-4be6-adfc-78e7f39c190a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:34.145599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c14500aa-e281-4be6-adfc-78e7f39c190a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:34.561930 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c14500aa-e281-4be6-adfc-78e7f39c190a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:34.578690 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c14500aa-e281-4be6-adfc-78e7f39c190a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:34.586916 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c14500aa-e281-4be6-adfc-78e7f39c190a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:34.594529 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c14500aa-e281-4be6-adfc-78e7f39c190a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1406 microversion: 2.20 time: 0.461680 Sep 17 21:14:34.610586 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2490/5082] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:14:34 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1406 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:14:35.631988 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0358b43a-7d33-47d7-bcf0-f616fd84c4d5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:35.633820 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0358b43a-7d33-47d7-bcf0-f616fd84c4d5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:35.648705 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0358b43a-7d33-47d7-bcf0-f616fd84c4d5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:35.653027 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0358b43a-7d33-47d7-bcf0-f616fd84c4d5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:35.654022 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0358b43a-7d33-47d7-bcf0-f616fd84c4d5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:35.658841 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0358b43a-7d33-47d7-bcf0-f616fd84c4d5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:35.659756 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0358b43a-7d33-47d7-bcf0-f616fd84c4d5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:35.661747 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0358b43a-7d33-47d7-bcf0-f616fd84c4d5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:36.266900 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0358b43a-7d33-47d7-bcf0-f616fd84c4d5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:36.275716 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0358b43a-7d33-47d7-bcf0-f616fd84c4d5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:36.289685 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0358b43a-7d33-47d7-bcf0-f616fd84c4d5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:36.291018 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0358b43a-7d33-47d7-bcf0-f616fd84c4d5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1406 microversion: 2.20 time: 0.671682 Sep 17 21:14:36.319805 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2593/5083] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:14:35 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1406 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:14:37.326693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b67a156d-273a-4325-ae4a-290c01898276 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:37.327318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b67a156d-273a-4325-ae4a-290c01898276 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:37.342089 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b67a156d-273a-4325-ae4a-290c01898276 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:37.343860 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b67a156d-273a-4325-ae4a-290c01898276 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:37.344325 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b67a156d-273a-4325-ae4a-290c01898276 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:37.346605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b67a156d-273a-4325-ae4a-290c01898276 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:37.347169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b67a156d-273a-4325-ae4a-290c01898276 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:37.347770 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b67a156d-273a-4325-ae4a-290c01898276 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:38.609405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b67a156d-273a-4325-ae4a-290c01898276 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:38.623390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b67a156d-273a-4325-ae4a-290c01898276 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:38.631888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b67a156d-273a-4325-ae4a-290c01898276 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:38.636333 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b67a156d-273a-4325-ae4a-290c01898276 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1406 microversion: 2.20 time: 1.313934 Sep 17 21:14:38.640191 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2491/5084] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:14:37 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1406 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:14:39.529253 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-a70c9859-1cc5-4cec-87fa-af1f9bbbdac4 req-31daab9d-0d46-4c27-abcf-b7958a6e110c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "796cf34c-7dbb-444e-a74e-68139729405f", "name": "network-vif-plugged", "status": "completed", "tag": "74223161-c2a1-4706-8b34-7e44c8bdcb2b"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:14:39.548020 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:14:39.557352 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a70c9859-1cc5-4cec-87fa-af1f9bbbdac4 req-31daab9d-0d46-4c27-abcf-b7958a6e110c service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:39.561078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a70c9859-1cc5-4cec-87fa-af1f9bbbdac4 req-31daab9d-0d46-4c27-abcf-b7958a6e110c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:39.564007 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a70c9859-1cc5-4cec-87fa-af1f9bbbdac4 req-31daab9d-0d46-4c27-abcf-b7958a6e110c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:39.594639 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-a70c9859-1cc5-4cec-87fa-af1f9bbbdac4 req-31daab9d-0d46-4c27-abcf-b7958a6e110c service nova] Creating event network-vif-plugged:74223161-c2a1-4706-8b34-7e44c8bdcb2b for instance 796cf34c-7dbb-444e-a74e-68139729405f on nch2-master-1 Sep 17 21:14:39.617716 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-a70c9859-1cc5-4cec-87fa-af1f9bbbdac4 req-31daab9d-0d46-4c27-abcf-b7958a6e110c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092016 Sep 17 21:14:39.626185 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2594/5085] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:14:39.676623 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6a7ded34-0382-4b20-82e5-05e05e664248 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:39.678621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6a7ded34-0382-4b20-82e5-05e05e664248 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:39.693156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a7ded34-0382-4b20-82e5-05e05e664248 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:39.694299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a7ded34-0382-4b20-82e5-05e05e664248 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:39.697873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a7ded34-0382-4b20-82e5-05e05e664248 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:39.699766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a7ded34-0382-4b20-82e5-05e05e664248 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:39.701447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a7ded34-0382-4b20-82e5-05e05e664248 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:39.701991 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6a7ded34-0382-4b20-82e5-05e05e664248 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:40.795162 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6a7ded34-0382-4b20-82e5-05e05e664248 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:40.805601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6a7ded34-0382-4b20-82e5-05e05e664248 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:40.812660 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6a7ded34-0382-4b20-82e5-05e05e664248 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:40.818891 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6a7ded34-0382-4b20-82e5-05e05e664248 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1406 microversion: 2.20 time: 1.154228 Sep 17 21:14:40.819800 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2492/5086] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:14:39 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1406 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:14:41.849612 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c11c0fc3-1cd3-4603-8ebe-41c3e4d48d9c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:41.850970 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c11c0fc3-1cd3-4603-8ebe-41c3e4d48d9c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:41.865550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c11c0fc3-1cd3-4603-8ebe-41c3e4d48d9c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:41.866449 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c11c0fc3-1cd3-4603-8ebe-41c3e4d48d9c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:41.867737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c11c0fc3-1cd3-4603-8ebe-41c3e4d48d9c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:41.870753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c11c0fc3-1cd3-4603-8ebe-41c3e4d48d9c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:41.871447 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c11c0fc3-1cd3-4603-8ebe-41c3e4d48d9c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:41.878894 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c11c0fc3-1cd3-4603-8ebe-41c3e4d48d9c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:42.036173 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a282a6d4-2b15-45c7-a76c-79475515f53f tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:42.036822 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a282a6d4-2b15-45c7-a76c-79475515f53f tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: ecbd9cec-fdea-45b2-bb96-487bdaf97635] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:42.050817 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a282a6d4-2b15-45c7-a76c-79475515f53f tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:42.052509 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a282a6d4-2b15-45c7-a76c-79475515f53f tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:42.053160 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a282a6d4-2b15-45c7-a76c-79475515f53f tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:42.054847 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a282a6d4-2b15-45c7-a76c-79475515f53f tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:42.055518 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a282a6d4-2b15-45c7-a76c-79475515f53f tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:42.055972 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a282a6d4-2b15-45c7-a76c-79475515f53f tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:42.116650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a282a6d4-2b15-45c7-a76c-79475515f53f tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: ecbd9cec-fdea-45b2-bb96-487bdaf97635] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:14:42.296006 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a282a6d4-2b15-45c7-a76c-79475515f53f tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635" status: 204 len: 0 microversion: 2.1 time: 0.261166 Sep 17 21:14:42.300833 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2493/5087] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:14:42 2022] DELETE /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 17 21:14:42.315824 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-f8f6b94e-4889-477b-8368-56c318346caf req-1b4b5db9-d748-4555-a6ec-c8318d261020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecbd9cec-fdea-45b2-bb96-487bdaf97635", "tag": "0956417c-fbac-420c-8610-6825b3468c52"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:14:42.328042 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f8f6b94e-4889-477b-8368-56c318346caf req-1b4b5db9-d748-4555-a6ec-c8318d261020 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:42.328833 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f8f6b94e-4889-477b-8368-56c318346caf req-1b4b5db9-d748-4555-a6ec-c8318d261020 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:42.329519 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f8f6b94e-4889-477b-8368-56c318346caf req-1b4b5db9-d748-4555-a6ec-c8318d261020 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:42.343795 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-f8f6b94e-4889-477b-8368-56c318346caf req-1b4b5db9-d748-4555-a6ec-c8318d261020 service nova] Creating event network-changed:0956417c-fbac-420c-8610-6825b3468c52 for instance ecbd9cec-fdea-45b2-bb96-487bdaf97635 on nch2-master-1 Sep 17 21:14:42.350208 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-f8f6b94e-4889-477b-8368-56c318346caf req-1b4b5db9-d748-4555-a6ec-c8318d261020 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046904 Sep 17 21:14:42.351124 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2494/5088] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:14:42.357259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9889c179-0a20-4154-8da2-4ad3943814e5 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:42.358356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9889c179-0a20-4154-8da2-4ad3943814e5 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: ecbd9cec-fdea-45b2-bb96-487bdaf97635] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:42.365857 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9889c179-0a20-4154-8da2-4ad3943814e5 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:42.366687 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9889c179-0a20-4154-8da2-4ad3943814e5 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:42.367423 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9889c179-0a20-4154-8da2-4ad3943814e5 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:42.368137 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9889c179-0a20-4154-8da2-4ad3943814e5 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:42.368660 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9889c179-0a20-4154-8da2-4ad3943814e5 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:42.369129 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9889c179-0a20-4154-8da2-4ad3943814e5 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:42.654350 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c11c0fc3-1cd3-4603-8ebe-41c3e4d48d9c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:42.665531 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:14:42.679711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c11c0fc3-1cd3-4603-8ebe-41c3e4d48d9c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:42.682068 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c11c0fc3-1cd3-4603-8ebe-41c3e4d48d9c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:42.697661 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c11c0fc3-1cd3-4603-8ebe-41c3e4d48d9c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1597 microversion: 2.20 time: 0.842965 Sep 17 21:14:42.700269 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2595/5089] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:14:41 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1597 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:14:42.729526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-eb43af0c-820e-46df-961c-28abf92c7fab tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:42.730921 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-eb43af0c-820e-46df-961c-28abf92c7fab tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:42.755090 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eb43af0c-820e-46df-961c-28abf92c7fab tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:42.755866 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eb43af0c-820e-46df-961c-28abf92c7fab tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:42.756580 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eb43af0c-820e-46df-961c-28abf92c7fab tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:42.757844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eb43af0c-820e-46df-961c-28abf92c7fab tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:42.758952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eb43af0c-820e-46df-961c-28abf92c7fab tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:42.759682 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eb43af0c-820e-46df-961c-28abf92c7fab tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:42.969063 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9889c179-0a20-4154-8da2-4ad3943814e5 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:42.986636 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9889c179-0a20-4154-8da2-4ad3943814e5 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635" status: 200 len: 1767 microversion: 2.1 time: 0.633610 Sep 17 21:14:42.987617 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2495/5090] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:42 2022] GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635 => generated 1767 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:14:42.998183 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-eb43af0c-820e-46df-961c-28abf92c7fab tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.275325 Sep 17 21:14:43.011976 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2596/5091] 10.222.0.26 () {60 vars in 1316 bytes} [Sat Sep 17 21:14:42 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f/os-interface => generated 284 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 17 21:14:44.015300 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a3e8347b-ac67-4c0e-9366-367c795607f7 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:44.016580 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a3e8347b-ac67-4c0e-9366-367c795607f7 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: ecbd9cec-fdea-45b2-bb96-487bdaf97635] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:44.023124 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:14:44.024830 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3e8347b-ac67-4c0e-9366-367c795607f7 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:44.025666 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3e8347b-ac67-4c0e-9366-367c795607f7 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:44.026444 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3e8347b-ac67-4c0e-9366-367c795607f7 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:44.027413 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3e8347b-ac67-4c0e-9366-367c795607f7 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:44.028096 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3e8347b-ac67-4c0e-9366-367c795607f7 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:44.028747 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3e8347b-ac67-4c0e-9366-367c795607f7 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:44.711055 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a3e8347b-ac67-4c0e-9366-367c795607f7 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:44.727254 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a3e8347b-ac67-4c0e-9366-367c795607f7 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635" status: 200 len: 1767 microversion: 2.1 time: 0.714627 Sep 17 21:14:44.729217 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2496/5092] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:44 2022] GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635 => generated 1767 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:14:45.769040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2ea9f54c-bec7-412c-9356-d10c1440d02b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:45.771613 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2ea9f54c-bec7-412c-9356-d10c1440d02b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: ecbd9cec-fdea-45b2-bb96-487bdaf97635] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:45.810493 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ea9f54c-bec7-412c-9356-d10c1440d02b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:45.811002 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ea9f54c-bec7-412c-9356-d10c1440d02b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:45.811446 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ea9f54c-bec7-412c-9356-d10c1440d02b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:45.813862 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ea9f54c-bec7-412c-9356-d10c1440d02b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:45.814796 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ea9f54c-bec7-412c-9356-d10c1440d02b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:45.815614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ea9f54c-bec7-412c-9356-d10c1440d02b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:46.202927 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-5f0a06ae-c1b3-45c5-b096-598597470d86 req-bdf50749-0a63-4cf0-a110-b8eeddfd768b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecbd9cec-fdea-45b2-bb96-487bdaf97635", "name": "network-vif-deleted", "tag": "0956417c-fbac-420c-8610-6825b3468c52"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:14:46.231767 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-5f0a06ae-c1b3-45c5-b096-598597470d86 req-bdf50749-0a63-4cf0-a110-b8eeddfd768b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:46.232582 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-5f0a06ae-c1b3-45c5-b096-598597470d86 req-bdf50749-0a63-4cf0-a110-b8eeddfd768b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:46.235532 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-5f0a06ae-c1b3-45c5-b096-598597470d86 req-bdf50749-0a63-4cf0-a110-b8eeddfd768b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:46.312028 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-5f0a06ae-c1b3-45c5-b096-598597470d86 req-bdf50749-0a63-4cf0-a110-b8eeddfd768b service nova] Creating event network-vif-deleted:0956417c-fbac-420c-8610-6825b3468c52 for instance ecbd9cec-fdea-45b2-bb96-487bdaf97635 on nch2-master-1 Sep 17 21:14:46.331899 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-5f0a06ae-c1b3-45c5-b096-598597470d86 req-bdf50749-0a63-4cf0-a110-b8eeddfd768b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133082 Sep 17 21:14:46.334344 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2497/5093] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:14:46.527273 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2ea9f54c-bec7-412c-9356-d10c1440d02b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caa2c2f4848e497f80d4a439c785c2b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfc26054d4a34fb2b2aef34fb4891b4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:46.539963 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2ea9f54c-bec7-412c-9356-d10c1440d02b tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635" status: 200 len: 1648 microversion: 2.1 time: 0.789351 Sep 17 21:14:46.541520 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2597/5094] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:45 2022] GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635 => generated 1648 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:14:47.567011 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-410e218f-6fd0-49f2-a8d8-b477485d2287 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:47.568020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-410e218f-6fd0-49f2-a8d8-b477485d2287 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [instance: ecbd9cec-fdea-45b2-bb96-487bdaf97635] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:47.587877 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-410e218f-6fd0-49f2-a8d8-b477485d2287 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:47.588751 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-410e218f-6fd0-49f2-a8d8-b477485d2287 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:47.591612 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-410e218f-6fd0-49f2-a8d8-b477485d2287 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:47.593396 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-410e218f-6fd0-49f2-a8d8-b477485d2287 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:47.595646 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-410e218f-6fd0-49f2-a8d8-b477485d2287 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:47.597034 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-410e218f-6fd0-49f2-a8d8-b477485d2287 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:47.613740 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-410e218f-6fd0-49f2-a8d8-b477485d2287 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] HTTP exception thrown: Instance ecbd9cec-fdea-45b2-bb96-487bdaf97635 could not be found. Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-410e218f-6fd0-49f2-a8d8-b477485d2287 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Request method failure captured: Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635 HTTP/1.1 Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjgpZkDTZP7qPMsXRYIooSnSxPSv3KfqyblFGj1YVmLiLy9HDMWi_NPmaWUmM6f75x9eHAFQEkmWh6Z5jSanozjgdJ0mKYVnx9KCw5Ayw0qPv4F3IigX-ECywSpE3qF3HMMcJcZcOzipaGAm2COYVYVAsoqHX3nizF-pSXs7izYhAj4 Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: cfc26054d4a34fb2b2aef34fb4891b4c Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-338602773 Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cfc26054d4a34fb2b2aef34fb4891b4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cfc26054d4a34fb2b2aef34fb4891b4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cfc26054d4a34fb2b2aef34fb4891b4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cfc26054d4a34fb2b2aef34fb4891b4c", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-TestSecurityGroupsBasicOps-338602773 Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: cfc26054d4a34fb2b2aef34fb4891b4c Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-338602773 Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-TestSecurityGroupsBasicOps-338602773-project Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: caa2c2f4848e497f80d4a439c785c2b0 Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-TestSecurityGroupsBasicOps-338602773-project Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance ecbd9cec-fdea-45b2-bb96-487bdaf97635 could not be found. Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'ecbd9cec-fdea-45b2-bb96-487bdaf97635'} Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecbd9cec-fdea-45b2-bb96-487bdaf97635 could not be found. Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecbd9cec-fdea-45b2-bb96-487bdaf97635 could not be found. Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:14:47.615748 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:14:47.623865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:14:47.623865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:14:47.623865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:14:47.623865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:14:47.623865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:14:47.623865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecbd9cec-fdea-45b2-bb96-487bdaf97635 could not be found. Sep 17 21:14:47.623865 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:14:47.627087 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-410e218f-6fd0-49f2-a8d8-b477485d2287 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Returning 404 to user: Instance ecbd9cec-fdea-45b2-bb96-487bdaf97635 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:14:47.628430 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-410e218f-6fd0-49f2-a8d8-b477485d2287 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635" status: 404 len: 111 microversion: 2.1 time: 0.067792 Sep 17 21:14:47.629190 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2498/5095] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:14:47 2022] GET /compute/v2.1/servers/ecbd9cec-fdea-45b2-bb96-487bdaf97635 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:14:48.328092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-2d014372-fb2f-49d1-927c-a318d60e7717 req-bceefa00-b825-4e8d-8e2d-01b1ea4c59c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "796cf34c-7dbb-444e-a74e-68139729405f", "tag": "74223161-c2a1-4706-8b34-7e44c8bdcb2b"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:14:48.349844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-2d014372-fb2f-49d1-927c-a318d60e7717 req-bceefa00-b825-4e8d-8e2d-01b1ea4c59c8 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:48.350760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-2d014372-fb2f-49d1-927c-a318d60e7717 req-bceefa00-b825-4e8d-8e2d-01b1ea4c59c8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:48.351386 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-2d014372-fb2f-49d1-927c-a318d60e7717 req-bceefa00-b825-4e8d-8e2d-01b1ea4c59c8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:48.376341 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-2d014372-fb2f-49d1-927c-a318d60e7717 req-bceefa00-b825-4e8d-8e2d-01b1ea4c59c8 service nova] Creating event network-changed:74223161-c2a1-4706-8b34-7e44c8bdcb2b for instance 796cf34c-7dbb-444e-a74e-68139729405f on nch2-master-1 Sep 17 21:14:48.390898 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-2d014372-fb2f-49d1-927c-a318d60e7717 req-bceefa00-b825-4e8d-8e2d-01b1ea4c59c8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066315 Sep 17 21:14:48.391547 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2598/5096] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:14:50.232296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-54b169d9-3414-4ff4-a66c-4f6b0c5ac6da tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1290405361", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": "none"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:14:50.343830 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-54b169d9-3414-4ff4-a66c-4f6b0c5ac6da tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:14:50.344260 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-54b169d9-3414-4ff4-a66c-4f6b0c5ac6da tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:14:50.344744 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-54b169d9-3414-4ff4-a66c-4f6b0c5ac6da tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:14:50.345155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-54b169d9-3414-4ff4-a66c-4f6b0c5ac6da tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:14:50.345594 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-54b169d9-3414-4ff4-a66c-4f6b0c5ac6da tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:14:50.373597 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-54b169d9-3414-4ff4-a66c-4f6b0c5ac6da tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:50.373992 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-54b169d9-3414-4ff4-a66c-4f6b0c5ac6da tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:50.376025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-54b169d9-3414-4ff4-a66c-4f6b0c5ac6da tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:50.378187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-54b169d9-3414-4ff4-a66c-4f6b0c5ac6da tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:50.378758 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-54b169d9-3414-4ff4-a66c-4f6b0c5ac6da tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:50.379834 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-54b169d9-3414-4ff4-a66c-4f6b0c5ac6da tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:50.421096 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-54b169d9-3414-4ff4-a66c-4f6b0c5ac6da tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Getting quotas for project aedb1becfa4b42deb13b265c9377e368. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:14:50.430835 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-54b169d9-3414-4ff4-a66c-4f6b0c5ac6da tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Getting quotas for user c777e5af74e64cb3805ef28d1d0ed776 and project aedb1becfa4b42deb13b265c9377e368. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:14:50.458895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-54b169d9-3414-4ff4-a66c-4f6b0c5ac6da tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:14:50.461847 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-54b169d9-3414-4ff4-a66c-4f6b0c5ac6da tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:14:50.525065 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-54b169d9-3414-4ff4-a66c-4f6b0c5ac6da tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.503427 Sep 17 21:14:50.526442 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2499/5097] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Sep 17 21:14:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 17 21:14:50.542527 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4985c1a2-81db-4b83-89ff-4b47849bac61 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:50.545966 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4985c1a2-81db-4b83-89ff-4b47849bac61 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:50.826089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4985c1a2-81db-4b83-89ff-4b47849bac61 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:50.870309 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4985c1a2-81db-4b83-89ff-4b47849bac61 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:50.870309 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4985c1a2-81db-4b83-89ff-4b47849bac61 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:50.870309 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4985c1a2-81db-4b83-89ff-4b47849bac61 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4" status: 200 len: 1278 microversion: 2.57 time: 0.335713 Sep 17 21:14:50.886742 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2599/5098] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:14:50 2022] GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4 => generated 1278 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:14:51.904499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2da9c9ff-642d-41a7-a0ec-26386f242a9d tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:51.905122 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2da9c9ff-642d-41a7-a0ec-26386f242a9d tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:51.923462 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2da9c9ff-642d-41a7-a0ec-26386f242a9d tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:51.924323 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2da9c9ff-642d-41a7-a0ec-26386f242a9d tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:51.925090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2da9c9ff-642d-41a7-a0ec-26386f242a9d tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:51.927511 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2da9c9ff-642d-41a7-a0ec-26386f242a9d tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:51.928232 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2da9c9ff-642d-41a7-a0ec-26386f242a9d tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:51.929185 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2da9c9ff-642d-41a7-a0ec-26386f242a9d tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:52.152171 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2da9c9ff-642d-41a7-a0ec-26386f242a9d tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:52.169453 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2da9c9ff-642d-41a7-a0ec-26386f242a9d tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:52.173090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2da9c9ff-642d-41a7-a0ec-26386f242a9d tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:52.174349 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2da9c9ff-642d-41a7-a0ec-26386f242a9d tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4" status: 200 len: 1330 microversion: 2.57 time: 0.274008 Sep 17 21:14:52.177511 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2500/5099] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:14:51 2022] GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4 => generated 1330 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:14:53.204371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9353e47c-67c0-4b23-8e1c-684a4b0199b9 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:53.205016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9353e47c-67c0-4b23-8e1c-684a4b0199b9 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:53.213201 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9353e47c-67c0-4b23-8e1c-684a4b0199b9 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:53.214011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9353e47c-67c0-4b23-8e1c-684a4b0199b9 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:53.214651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9353e47c-67c0-4b23-8e1c-684a4b0199b9 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:53.215555 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9353e47c-67c0-4b23-8e1c-684a4b0199b9 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:53.216186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9353e47c-67c0-4b23-8e1c-684a4b0199b9 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:53.216801 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9353e47c-67c0-4b23-8e1c-684a4b0199b9 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:53.558916 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9353e47c-67c0-4b23-8e1c-684a4b0199b9 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:53.575058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9353e47c-67c0-4b23-8e1c-684a4b0199b9 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:53.576463 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9353e47c-67c0-4b23-8e1c-684a4b0199b9 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:53.577672 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9353e47c-67c0-4b23-8e1c-684a4b0199b9 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4" status: 200 len: 1336 microversion: 2.57 time: 0.377316 Sep 17 21:14:53.590167 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2600/5100] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:14:53 2022] GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4 => generated 1336 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:14:54.608408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-34b473c1-ffd6-4376-b6fb-df742b20a38e tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:54.609835 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-34b473c1-ffd6-4376-b6fb-df742b20a38e tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:54.624608 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34b473c1-ffd6-4376-b6fb-df742b20a38e tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:54.626553 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34b473c1-ffd6-4376-b6fb-df742b20a38e tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:54.627663 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34b473c1-ffd6-4376-b6fb-df742b20a38e tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:54.646325 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34b473c1-ffd6-4376-b6fb-df742b20a38e tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:54.648259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34b473c1-ffd6-4376-b6fb-df742b20a38e tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:54.651149 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34b473c1-ffd6-4376-b6fb-df742b20a38e tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:54.930712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-34b473c1-ffd6-4376-b6fb-df742b20a38e tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:54.944027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-34b473c1-ffd6-4376-b6fb-df742b20a38e tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:54.945812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-34b473c1-ffd6-4376-b6fb-df742b20a38e tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:54.947320 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-34b473c1-ffd6-4376-b6fb-df742b20a38e tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4" status: 200 len: 1357 microversion: 2.57 time: 0.343423 Sep 17 21:14:54.948403 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2501/5101] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:14:54 2022] GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4 => generated 1357 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:14:54.976944 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1219eafa-4013-4709-b752-d8c17b49ad02 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:14:54.980964 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1219eafa-4013-4709-b752-d8c17b49ad02 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:54.999463 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1219eafa-4013-4709-b752-d8c17b49ad02 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:55.000287 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1219eafa-4013-4709-b752-d8c17b49ad02 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:55.000916 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1219eafa-4013-4709-b752-d8c17b49ad02 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:55.002169 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1219eafa-4013-4709-b752-d8c17b49ad02 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:55.002807 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1219eafa-4013-4709-b752-d8c17b49ad02 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:55.003413 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1219eafa-4013-4709-b752-d8c17b49ad02 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:55.160065 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-1219eafa-4013-4709-b752-d8c17b49ad02 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:14:55.160498 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-1219eafa-4013-4709-b752-d8c17b49ad02 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:14:55.160981 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-1219eafa-4013-4709-b752-d8c17b49ad02 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:14:55.161392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-1219eafa-4013-4709-b752-d8c17b49ad02 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:14:55.166168 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-1219eafa-4013-4709-b752-d8c17b49ad02 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:14:55.299695 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1219eafa-4013-4709-b752-d8c17b49ad02 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:55.311476 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1219eafa-4013-4709-b752-d8c17b49ad02 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:55.311982 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1219eafa-4013-4709-b752-d8c17b49ad02 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:55.313294 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1219eafa-4013-4709-b752-d8c17b49ad02 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:55.314236 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1219eafa-4013-4709-b752-d8c17b49ad02 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:55.317354 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1219eafa-4013-4709-b752-d8c17b49ad02 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:55.318104 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1219eafa-4013-4709-b752-d8c17b49ad02 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:55.414152 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1219eafa-4013-4709-b752-d8c17b49ad02 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "POST /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4/action" status: 202 len: 1138 microversion: 2.57 time: 0.437836 Sep 17 21:14:55.415142 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2601/5102] 10.222.0.26 () {62 vars in 1320 bytes} [Sat Sep 17 21:14:54 2022] POST /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4/action => generated 1138 bytes in 443 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 17 21:14:55.441096 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d38e3a20-76d6-4193-b093-df01bdff4a7e tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:55.442580 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d38e3a20-76d6-4193-b093-df01bdff4a7e tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:55.470115 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d38e3a20-76d6-4193-b093-df01bdff4a7e tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:55.488908 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d38e3a20-76d6-4193-b093-df01bdff4a7e tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:55.493113 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d38e3a20-76d6-4193-b093-df01bdff4a7e tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:55.502117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d38e3a20-76d6-4193-b093-df01bdff4a7e tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:55.502650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d38e3a20-76d6-4193-b093-df01bdff4a7e tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:55.506008 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d38e3a20-76d6-4193-b093-df01bdff4a7e tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:55.717488 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d38e3a20-76d6-4193-b093-df01bdff4a7e tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:55.734319 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d38e3a20-76d6-4193-b093-df01bdff4a7e tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:55.739659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d38e3a20-76d6-4193-b093-df01bdff4a7e tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:55.744075 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d38e3a20-76d6-4193-b093-df01bdff4a7e tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4" status: 200 len: 1366 microversion: 2.57 time: 0.306120 Sep 17 21:14:55.766249 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2502/5103] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:14:55 2022] GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4 => generated 1366 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:14:56.774184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-51588099-5cd9-4872-812e-0a6327edb05c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:56.776329 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-51588099-5cd9-4872-812e-0a6327edb05c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:56.788882 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-51588099-5cd9-4872-812e-0a6327edb05c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:56.792901 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-51588099-5cd9-4872-812e-0a6327edb05c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:56.793601 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-51588099-5cd9-4872-812e-0a6327edb05c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:56.794538 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-51588099-5cd9-4872-812e-0a6327edb05c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:56.796867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-51588099-5cd9-4872-812e-0a6327edb05c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:56.797734 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-51588099-5cd9-4872-812e-0a6327edb05c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:57.021891 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-51588099-5cd9-4872-812e-0a6327edb05c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:57.035328 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-51588099-5cd9-4872-812e-0a6327edb05c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:57.039716 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-51588099-5cd9-4872-812e-0a6327edb05c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:57.041656 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-51588099-5cd9-4872-812e-0a6327edb05c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4" status: 200 len: 1366 microversion: 2.57 time: 0.271581 Sep 17 21:14:57.042803 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2602/5104] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:14:56 2022] GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4 => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:14:58.069116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9b3f068e-f977-4922-8a29-6965869f5970 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:58.070802 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9b3f068e-f977-4922-8a29-6965869f5970 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:58.088761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b3f068e-f977-4922-8a29-6965869f5970 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:58.089572 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b3f068e-f977-4922-8a29-6965869f5970 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:58.090475 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b3f068e-f977-4922-8a29-6965869f5970 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:58.095487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b3f068e-f977-4922-8a29-6965869f5970 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:58.095487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b3f068e-f977-4922-8a29-6965869f5970 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:58.096364 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b3f068e-f977-4922-8a29-6965869f5970 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:58.576784 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9b3f068e-f977-4922-8a29-6965869f5970 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:58.589571 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9b3f068e-f977-4922-8a29-6965869f5970 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:58.593042 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9b3f068e-f977-4922-8a29-6965869f5970 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:58.595096 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9b3f068e-f977-4922-8a29-6965869f5970 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4" status: 200 len: 1366 microversion: 2.57 time: 0.531111 Sep 17 21:14:58.609553 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2503/5105] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:14:58 2022] GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4 => generated 1366 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:14:59.636036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9f7d062d-5b51-4125-931b-3186fdc62537 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:14:59.641274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9f7d062d-5b51-4125-931b-3186fdc62537 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:14:59.661343 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9f7d062d-5b51-4125-931b-3186fdc62537 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:59.662092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9f7d062d-5b51-4125-931b-3186fdc62537 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:59.662718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9f7d062d-5b51-4125-931b-3186fdc62537 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:59.664027 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9f7d062d-5b51-4125-931b-3186fdc62537 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:14:59.664670 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9f7d062d-5b51-4125-931b-3186fdc62537 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:14:59.665260 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9f7d062d-5b51-4125-931b-3186fdc62537 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:14:59.957204 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9f7d062d-5b51-4125-931b-3186fdc62537 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:59.969520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9f7d062d-5b51-4125-931b-3186fdc62537 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:59.974047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9f7d062d-5b51-4125-931b-3186fdc62537 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:14:59.977811 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9f7d062d-5b51-4125-931b-3186fdc62537 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4" status: 200 len: 1366 microversion: 2.57 time: 0.359249 Sep 17 21:14:59.995926 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2603/5106] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:14:59 2022] GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4 => generated 1366 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:00.283726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d6020fed-300e-4d54-85ec-13039dfb41c0 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] Calling method '.version_select at 0x7f25a4559b80>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:00.288622 ncdv-master-1 devstack@n-api.service[140523]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d6020fed-300e-4d54-85ec-13039dfb41c0 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [9efb08ca-d886-44ef-8eb7-b5da91c3f6b6] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 17 21:15:00.407062 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:15:00.451922 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:15:01.018372 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b06932cb-e9c7-4271-b15e-faeaccb97ae0 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:01.049272 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b06932cb-e9c7-4271-b15e-faeaccb97ae0 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:01.066107 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:15:01.119541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b06932cb-e9c7-4271-b15e-faeaccb97ae0 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:01.120953 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b06932cb-e9c7-4271-b15e-faeaccb97ae0 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:01.122670 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b06932cb-e9c7-4271-b15e-faeaccb97ae0 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:01.124321 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b06932cb-e9c7-4271-b15e-faeaccb97ae0 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:01.127322 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b06932cb-e9c7-4271-b15e-faeaccb97ae0 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:01.127786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b06932cb-e9c7-4271-b15e-faeaccb97ae0 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:01.313346 ncdv-master-1 devstack@n-api.service[140523]: INFO oslo.messaging._drivers.impl_rabbit [None req-d6020fed-300e-4d54-85ec-13039dfb41c0 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] [9efb08ca-d886-44ef-8eb7-b5da91c3f6b6] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 59220. Sep 17 21:15:01.368136 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d6020fed-300e-4d54-85ec-13039dfb41c0 tempest-TestSecurityGroupsBasicOps-338602773 tempest-TestSecurityGroupsBasicOps-338602773-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1819630111" status: 202 len: 0 microversion: 2.1 time: 1.088012 Sep 17 21:15:01.369769 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2504/5107] 10.222.0.26 () {58 vars in 1278 bytes} [Sat Sep 17 21:15:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1819630111 => generated 0 bytes in 1091 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:15:01.447733 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b06932cb-e9c7-4271-b15e-faeaccb97ae0 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:01.465865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b06932cb-e9c7-4271-b15e-faeaccb97ae0 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:01.467416 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b06932cb-e9c7-4271-b15e-faeaccb97ae0 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:01.474263 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b06932cb-e9c7-4271-b15e-faeaccb97ae0 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4" status: 200 len: 1366 microversion: 2.57 time: 0.459866 Sep 17 21:15:01.474948 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2604/5108] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:01 2022] GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4 => generated 1366 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:02.504576 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-82b48378-2ab5-4e1b-a4e3-d7834c2a7641 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:02.505583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-82b48378-2ab5-4e1b-a4e3-d7834c2a7641 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:02.517273 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82b48378-2ab5-4e1b-a4e3-d7834c2a7641 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:02.518144 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82b48378-2ab5-4e1b-a4e3-d7834c2a7641 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:02.518573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82b48378-2ab5-4e1b-a4e3-d7834c2a7641 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:02.519289 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82b48378-2ab5-4e1b-a4e3-d7834c2a7641 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:02.519747 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82b48378-2ab5-4e1b-a4e3-d7834c2a7641 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:02.520176 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82b48378-2ab5-4e1b-a4e3-d7834c2a7641 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:02.655034 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-82b48378-2ab5-4e1b-a4e3-d7834c2a7641 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:02.698717 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-82b48378-2ab5-4e1b-a4e3-d7834c2a7641 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:02.701691 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-82b48378-2ab5-4e1b-a4e3-d7834c2a7641 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:02.709513 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-82b48378-2ab5-4e1b-a4e3-d7834c2a7641 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4" status: 200 len: 1366 microversion: 2.57 time: 0.206799 Sep 17 21:15:02.710856 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2505/5109] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:02 2022] GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:03.752644 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e8653026-4409-4d02-beba-50782c39b9e3 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:03.757124 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e8653026-4409-4d02-beba-50782c39b9e3 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:03.783382 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8653026-4409-4d02-beba-50782c39b9e3 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:03.785607 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8653026-4409-4d02-beba-50782c39b9e3 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:03.787046 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8653026-4409-4d02-beba-50782c39b9e3 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:03.788352 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8653026-4409-4d02-beba-50782c39b9e3 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:03.789813 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8653026-4409-4d02-beba-50782c39b9e3 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:03.790723 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8653026-4409-4d02-beba-50782c39b9e3 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:03.950449 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e8653026-4409-4d02-beba-50782c39b9e3 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:03.968139 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e8653026-4409-4d02-beba-50782c39b9e3 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:03.970268 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e8653026-4409-4d02-beba-50782c39b9e3 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:03.981838 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e8653026-4409-4d02-beba-50782c39b9e3 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4" status: 200 len: 1366 microversion: 2.57 time: 0.238281 Sep 17 21:15:03.982972 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2605/5110] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:03 2022] GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4 => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:05.027925 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1eb59262-9855-4116-866b-ca0fb89fe8e2 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:05.034278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1eb59262-9855-4116-866b-ca0fb89fe8e2 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:05.056549 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1eb59262-9855-4116-866b-ca0fb89fe8e2 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:05.057060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1eb59262-9855-4116-866b-ca0fb89fe8e2 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:05.057562 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1eb59262-9855-4116-866b-ca0fb89fe8e2 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:05.058295 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1eb59262-9855-4116-866b-ca0fb89fe8e2 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:05.061630 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1eb59262-9855-4116-866b-ca0fb89fe8e2 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:05.062286 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1eb59262-9855-4116-866b-ca0fb89fe8e2 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:05.071723 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:15:05.198871 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1eb59262-9855-4116-866b-ca0fb89fe8e2 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:05.243688 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1eb59262-9855-4116-866b-ca0fb89fe8e2 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:05.247337 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1eb59262-9855-4116-866b-ca0fb89fe8e2 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:05.263780 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1eb59262-9855-4116-866b-ca0fb89fe8e2 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4" status: 200 len: 1366 microversion: 2.57 time: 0.256265 Sep 17 21:15:05.264413 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2506/5111] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:05 2022] GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:06.295340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e67f42ab-e26c-4c23-8c2b-0b4d32ac9a88 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:06.296114 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e67f42ab-e26c-4c23-8c2b-0b4d32ac9a88 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:06.311448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e67f42ab-e26c-4c23-8c2b-0b4d32ac9a88 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:06.313290 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e67f42ab-e26c-4c23-8c2b-0b4d32ac9a88 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:06.314112 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e67f42ab-e26c-4c23-8c2b-0b4d32ac9a88 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:06.315233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e67f42ab-e26c-4c23-8c2b-0b4d32ac9a88 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:06.316001 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e67f42ab-e26c-4c23-8c2b-0b4d32ac9a88 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:06.316937 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e67f42ab-e26c-4c23-8c2b-0b4d32ac9a88 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:06.503600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e67f42ab-e26c-4c23-8c2b-0b4d32ac9a88 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:06.519242 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e67f42ab-e26c-4c23-8c2b-0b4d32ac9a88 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:06.520959 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e67f42ab-e26c-4c23-8c2b-0b4d32ac9a88 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:06.522471 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e67f42ab-e26c-4c23-8c2b-0b4d32ac9a88 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4" status: 200 len: 1366 microversion: 2.57 time: 0.233698 Sep 17 21:15:06.553952 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2606/5112] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:06 2022] GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4 => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:07.552929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9d42b2a6-b0c3-46e5-ae6e-2f85ec372c6c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:07.553691 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9d42b2a6-b0c3-46e5-ae6e-2f85ec372c6c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:07.590937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d42b2a6-b0c3-46e5-ae6e-2f85ec372c6c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:07.597565 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d42b2a6-b0c3-46e5-ae6e-2f85ec372c6c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:07.598375 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d42b2a6-b0c3-46e5-ae6e-2f85ec372c6c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:07.602789 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d42b2a6-b0c3-46e5-ae6e-2f85ec372c6c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:07.603497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d42b2a6-b0c3-46e5-ae6e-2f85ec372c6c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:07.604025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d42b2a6-b0c3-46e5-ae6e-2f85ec372c6c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:08.177698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9d42b2a6-b0c3-46e5-ae6e-2f85ec372c6c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:08.191961 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9d42b2a6-b0c3-46e5-ae6e-2f85ec372c6c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:08.194918 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9d42b2a6-b0c3-46e5-ae6e-2f85ec372c6c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:08.205558 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9d42b2a6-b0c3-46e5-ae6e-2f85ec372c6c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4" status: 200 len: 1366 microversion: 2.57 time: 0.656705 Sep 17 21:15:08.209998 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2507/5113] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:07 2022] GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4 => generated 1366 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:09.236460 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bf5f95cf-0575-4f0e-be02-ae91da7826b9 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:09.237089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bf5f95cf-0575-4f0e-be02-ae91da7826b9 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:09.253693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf5f95cf-0575-4f0e-be02-ae91da7826b9 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:09.256281 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf5f95cf-0575-4f0e-be02-ae91da7826b9 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:09.257560 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf5f95cf-0575-4f0e-be02-ae91da7826b9 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:09.261336 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf5f95cf-0575-4f0e-be02-ae91da7826b9 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:09.262225 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf5f95cf-0575-4f0e-be02-ae91da7826b9 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:09.263958 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf5f95cf-0575-4f0e-be02-ae91da7826b9 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:09.476882 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bf5f95cf-0575-4f0e-be02-ae91da7826b9 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:09.494714 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bf5f95cf-0575-4f0e-be02-ae91da7826b9 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:09.496716 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bf5f95cf-0575-4f0e-be02-ae91da7826b9 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:09.498986 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bf5f95cf-0575-4f0e-be02-ae91da7826b9 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4" status: 200 len: 1366 microversion: 2.57 time: 0.266637 Sep 17 21:15:09.514010 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2607/5114] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:09 2022] GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4 => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:10.530806 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9bd36f11-6925-4d30-a78c-c93d2129bf3c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:10.532086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9bd36f11-6925-4d30-a78c-c93d2129bf3c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:10.564404 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9bd36f11-6925-4d30-a78c-c93d2129bf3c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:10.565986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9bd36f11-6925-4d30-a78c-c93d2129bf3c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:10.566598 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9bd36f11-6925-4d30-a78c-c93d2129bf3c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:10.567489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9bd36f11-6925-4d30-a78c-c93d2129bf3c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:10.568116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9bd36f11-6925-4d30-a78c-c93d2129bf3c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:10.569013 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9bd36f11-6925-4d30-a78c-c93d2129bf3c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:10.791601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9bd36f11-6925-4d30-a78c-c93d2129bf3c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:10.802287 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9bd36f11-6925-4d30-a78c-c93d2129bf3c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:10.803747 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9bd36f11-6925-4d30-a78c-c93d2129bf3c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:10.804943 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9bd36f11-6925-4d30-a78c-c93d2129bf3c tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4" status: 200 len: 1366 microversion: 2.57 time: 0.278749 Sep 17 21:15:10.818299 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2508/5115] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:10 2022] GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4 => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:11.834968 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-df8b119c-0b78-4d0a-86a6-8ee40cee7034 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:11.838132 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-df8b119c-0b78-4d0a-86a6-8ee40cee7034 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:11.855874 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-df8b119c-0b78-4d0a-86a6-8ee40cee7034 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:11.861955 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-df8b119c-0b78-4d0a-86a6-8ee40cee7034 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:11.862742 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-df8b119c-0b78-4d0a-86a6-8ee40cee7034 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:11.864444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-df8b119c-0b78-4d0a-86a6-8ee40cee7034 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:11.869219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-df8b119c-0b78-4d0a-86a6-8ee40cee7034 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:11.870517 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-df8b119c-0b78-4d0a-86a6-8ee40cee7034 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:12.038142 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-df8b119c-0b78-4d0a-86a6-8ee40cee7034 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:12.053276 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-df8b119c-0b78-4d0a-86a6-8ee40cee7034 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:12.055332 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-df8b119c-0b78-4d0a-86a6-8ee40cee7034 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:12.056650 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-df8b119c-0b78-4d0a-86a6-8ee40cee7034 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4" status: 200 len: 1366 microversion: 2.57 time: 0.226097 Sep 17 21:15:12.060166 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2608/5116] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:11 2022] GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:13.085962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9fe266f7-0590-4dfa-825d-f9a11d041982 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:13.087336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9fe266f7-0590-4dfa-825d-f9a11d041982 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:13.095023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9fe266f7-0590-4dfa-825d-f9a11d041982 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:13.095802 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9fe266f7-0590-4dfa-825d-f9a11d041982 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:13.096443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9fe266f7-0590-4dfa-825d-f9a11d041982 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:13.097351 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9fe266f7-0590-4dfa-825d-f9a11d041982 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:13.098001 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9fe266f7-0590-4dfa-825d-f9a11d041982 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:13.098612 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9fe266f7-0590-4dfa-825d-f9a11d041982 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:13.255640 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9fe266f7-0590-4dfa-825d-f9a11d041982 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:13.267890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9fe266f7-0590-4dfa-825d-f9a11d041982 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:13.274320 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9fe266f7-0590-4dfa-825d-f9a11d041982 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:13.275839 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9fe266f7-0590-4dfa-825d-f9a11d041982 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4" status: 200 len: 1366 microversion: 2.57 time: 0.193869 Sep 17 21:15:13.279218 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2509/5117] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:13 2022] GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:13.523211 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8d1867ba-b267-4b62-889b-5153db8c5286 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:13.525419 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8d1867ba-b267-4b62-889b-5153db8c5286 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:13.541675 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=36 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:15:13.545372 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d1867ba-b267-4b62-889b-5153db8c5286 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:13.546495 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d1867ba-b267-4b62-889b-5153db8c5286 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:13.548801 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d1867ba-b267-4b62-889b-5153db8c5286 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:13.550580 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d1867ba-b267-4b62-889b-5153db8c5286 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:13.551297 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d1867ba-b267-4b62-889b-5153db8c5286 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:13.552094 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d1867ba-b267-4b62-889b-5153db8c5286 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:13.593569 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:15:13.630823 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8d1867ba-b267-4b62-889b-5153db8c5286 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f/ips" status: 200 len: 150 microversion: 2.20 time: 0.123358 Sep 17 21:15:13.636615 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2609/5118] 10.222.0.26 () {60 vars in 1289 bytes} [Sat Sep 17 21:15:13 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f/ips => generated 150 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:15:14.311122 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-21d4d951-cb4c-4d36-a84d-36b23cd3976a tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:14.312819 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-21d4d951-cb4c-4d36-a84d-36b23cd3976a tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:14.315261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:15:14.329199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21d4d951-cb4c-4d36-a84d-36b23cd3976a tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:14.330238 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21d4d951-cb4c-4d36-a84d-36b23cd3976a tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:14.367014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21d4d951-cb4c-4d36-a84d-36b23cd3976a tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:14.368983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21d4d951-cb4c-4d36-a84d-36b23cd3976a tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:14.370988 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21d4d951-cb4c-4d36-a84d-36b23cd3976a tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:14.374008 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21d4d951-cb4c-4d36-a84d-36b23cd3976a tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:14.715874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-21d4d951-cb4c-4d36-a84d-36b23cd3976a tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:14.754738 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-21d4d951-cb4c-4d36-a84d-36b23cd3976a tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:14.761603 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-21d4d951-cb4c-4d36-a84d-36b23cd3976a tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:14.767172 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-21d4d951-cb4c-4d36-a84d-36b23cd3976a tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4" status: 200 len: 1366 microversion: 2.57 time: 0.466933 Sep 17 21:15:14.787557 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2510/5119] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:14 2022] GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4 => generated 1366 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:15.399705 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0c856e51-0a94-47d2-a1fb-a646a009e3af tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-447912819", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "ee20c5bc-e805-4fb7-b9e9-d954380a72be"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:15:15.500952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-0c856e51-0a94-47d2-a1fb-a646a009e3af tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] validate_networks() for [('ee20c5bc-e805-4fb7-b9e9-d954380a72be', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:15:15.798378 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-32badfbe-3de9-4296-a302-e3ed43cedcd0 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:15.799042 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-32badfbe-3de9-4296-a302-e3ed43cedcd0 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:15.815388 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32badfbe-3de9-4296-a302-e3ed43cedcd0 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:15.815905 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32badfbe-3de9-4296-a302-e3ed43cedcd0 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:15.816544 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32badfbe-3de9-4296-a302-e3ed43cedcd0 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:15.817283 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32badfbe-3de9-4296-a302-e3ed43cedcd0 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:15.817779 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32badfbe-3de9-4296-a302-e3ed43cedcd0 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:15.835308 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32badfbe-3de9-4296-a302-e3ed43cedcd0 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:16.092307 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-32badfbe-3de9-4296-a302-e3ed43cedcd0 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:16.103308 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-32badfbe-3de9-4296-a302-e3ed43cedcd0 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:16.104775 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-32badfbe-3de9-4296-a302-e3ed43cedcd0 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:16.115836 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-32badfbe-3de9-4296-a302-e3ed43cedcd0 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4" status: 200 len: 1366 microversion: 2.57 time: 0.321650 Sep 17 21:15:16.117316 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2511/5120] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:15 2022] GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4 => generated 1366 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:15:16.285706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-302fd513-5015-4855-bb0b-ea27a1ffcdd1 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:15:16.286985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-302fd513-5015-4855-bb0b-ea27a1ffcdd1 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:16.297959 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-302fd513-5015-4855-bb0b-ea27a1ffcdd1 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:16.298562 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-302fd513-5015-4855-bb0b-ea27a1ffcdd1 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:16.299891 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-302fd513-5015-4855-bb0b-ea27a1ffcdd1 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:16.300739 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-302fd513-5015-4855-bb0b-ea27a1ffcdd1 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:16.301550 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-302fd513-5015-4855-bb0b-ea27a1ffcdd1 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:16.302648 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-302fd513-5015-4855-bb0b-ea27a1ffcdd1 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:16.380420 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-302fd513-5015-4855-bb0b-ea27a1ffcdd1 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lazy-loading 'flavor' on Instance uuid 796cf34c-7dbb-444e-a74e-68139729405f {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:15:16.864011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-0c856e51-0a94-47d2-a1fb-a646a009e3af tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:15:16.864499 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-0c856e51-0a94-47d2-a1fb-a646a009e3af tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:15:16.864911 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-0c856e51-0a94-47d2-a1fb-a646a009e3af tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:15:16.865322 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-0c856e51-0a94-47d2-a1fb-a646a009e3af tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:15:16.865935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-0c856e51-0a94-47d2-a1fb-a646a009e3af tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:15:16.894726 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-302fd513-5015-4855-bb0b-ea27a1ffcdd1 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "POST /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f/action" status: 202 len: 0 microversion: 2.20 time: 0.613641 Sep 17 21:15:16.895938 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2512/5121] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Sep 17 21:15:16 2022] POST /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f/action => generated 0 bytes in 619 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:15:16.905276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2786de28-635e-455c-8069-af0a3ec1c14f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:16.910647 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c856e51-0a94-47d2-a1fb-a646a009e3af tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:16.911149 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c856e51-0a94-47d2-a1fb-a646a009e3af tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:16.911604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c856e51-0a94-47d2-a1fb-a646a009e3af tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:16.912335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c856e51-0a94-47d2-a1fb-a646a009e3af tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:16.912798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c856e51-0a94-47d2-a1fb-a646a009e3af tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:16.913229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c856e51-0a94-47d2-a1fb-a646a009e3af tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:16.926815 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2786de28-635e-455c-8069-af0a3ec1c14f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:16.960404 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2786de28-635e-455c-8069-af0a3ec1c14f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:16.961050 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2786de28-635e-455c-8069-af0a3ec1c14f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:16.961530 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2786de28-635e-455c-8069-af0a3ec1c14f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:16.962365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2786de28-635e-455c-8069-af0a3ec1c14f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:16.962830 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2786de28-635e-455c-8069-af0a3ec1c14f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:16.963267 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2786de28-635e-455c-8069-af0a3ec1c14f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:16.983857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-0c856e51-0a94-47d2-a1fb-a646a009e3af tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Getting quotas for project bdfb56572d9c4d559ad4fbce7cb6d527. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:15:17.004760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-0c856e51-0a94-47d2-a1fb-a646a009e3af tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Getting quotas for user 753144834d1a418897a600589137fcbc and project bdfb56572d9c4d559ad4fbce7cb6d527. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:15:17.026331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0c856e51-0a94-47d2-a1fb-a646a009e3af tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:15:17.029002 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0c856e51-0a94-47d2-a1fb-a646a009e3af tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] [instance: 44929832-cf9c-4d3a-bfda-fc6212c1426d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:15:17.106629 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0c856e51-0a94-47d2-a1fb-a646a009e3af tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.398453 Sep 17 21:15:17.116535 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2610/5122] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:15:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2410 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:15:17.128881 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cf8cadce-8f1c-4d16-8ccd-4c914345482e tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:17.129563 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cf8cadce-8f1c-4d16-8ccd-4c914345482e tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] [instance: 44929832-cf9c-4d3a-bfda-fc6212c1426d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:17.357586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cf8cadce-8f1c-4d16-8ccd-4c914345482e tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753144834d1a418897a600589137fcbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfb56572d9c4d559ad4fbce7cb6d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:17.368256 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cf8cadce-8f1c-4d16-8ccd-4c914345482e tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] 10.222.0.26 "GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d" status: 200 len: 1216 microversion: 2.1 time: 0.250475 Sep 17 21:15:17.374187 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2611/5123] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:17 2022] GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d => generated 1216 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:17.401986 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-09ed5f4c-4a1b-4878-ae6b-ccc0d67a9e63 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:17.402802 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-09ed5f4c-4a1b-4878-ae6b-ccc0d67a9e63 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:17.417738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09ed5f4c-4a1b-4878-ae6b-ccc0d67a9e63 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:17.422794 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09ed5f4c-4a1b-4878-ae6b-ccc0d67a9e63 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:17.423849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09ed5f4c-4a1b-4878-ae6b-ccc0d67a9e63 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:17.424671 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09ed5f4c-4a1b-4878-ae6b-ccc0d67a9e63 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:17.425106 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09ed5f4c-4a1b-4878-ae6b-ccc0d67a9e63 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:17.425662 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-09ed5f4c-4a1b-4878-ae6b-ccc0d67a9e63 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:17.637378 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-09ed5f4c-4a1b-4878-ae6b-ccc0d67a9e63 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:17.666270 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-09ed5f4c-4a1b-4878-ae6b-ccc0d67a9e63 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:17.678269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-09ed5f4c-4a1b-4878-ae6b-ccc0d67a9e63 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:17.679667 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-09ed5f4c-4a1b-4878-ae6b-ccc0d67a9e63 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4" status: 200 len: 1366 microversion: 2.57 time: 0.297135 Sep 17 21:15:17.703692 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2612/5124] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:17 2022] GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4 => generated 1366 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:17.873917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2786de28-635e-455c-8069-af0a3ec1c14f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:17.885314 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2786de28-635e-455c-8069-af0a3ec1c14f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:17.886821 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2786de28-635e-455c-8069-af0a3ec1c14f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:17.892484 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2786de28-635e-455c-8069-af0a3ec1c14f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1721 microversion: 2.20 time: 0.991343 Sep 17 21:15:17.910593 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2513/5125] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:16 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1721 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:18.407514 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4ee6e973-4c41-496a-bc17-c673f2493a29 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:18.414502 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4ee6e973-4c41-496a-bc17-c673f2493a29 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] [instance: 44929832-cf9c-4d3a-bfda-fc6212c1426d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:18.435675 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ee6e973-4c41-496a-bc17-c673f2493a29 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:18.440257 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ee6e973-4c41-496a-bc17-c673f2493a29 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:18.440887 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ee6e973-4c41-496a-bc17-c673f2493a29 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:18.441814 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ee6e973-4c41-496a-bc17-c673f2493a29 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:18.443844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ee6e973-4c41-496a-bc17-c673f2493a29 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:18.445098 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ee6e973-4c41-496a-bc17-c673f2493a29 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:18.664562 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4ee6e973-4c41-496a-bc17-c673f2493a29 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753144834d1a418897a600589137fcbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfb56572d9c4d559ad4fbce7cb6d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:18.699445 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4ee6e973-4c41-496a-bc17-c673f2493a29 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] 10.222.0.26 "GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d" status: 200 len: 1212 microversion: 2.1 time: 0.303005 Sep 17 21:15:18.700061 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2613/5126] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:18 2022] GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d => generated 1212 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:18.742876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b952fa55-96d6-44dd-b66d-48311aeab442 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:18.750780 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b952fa55-96d6-44dd-b66d-48311aeab442 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:18.788698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b952fa55-96d6-44dd-b66d-48311aeab442 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:18.793230 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b952fa55-96d6-44dd-b66d-48311aeab442 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:18.796295 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b952fa55-96d6-44dd-b66d-48311aeab442 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:18.797864 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b952fa55-96d6-44dd-b66d-48311aeab442 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:18.802044 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b952fa55-96d6-44dd-b66d-48311aeab442 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:18.805691 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b952fa55-96d6-44dd-b66d-48311aeab442 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:18.927919 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-428cf601-86b2-4c66-833e-ca47b677a044 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:18.930428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-428cf601-86b2-4c66-833e-ca47b677a044 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:18.957104 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-428cf601-86b2-4c66-833e-ca47b677a044 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:18.959806 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-428cf601-86b2-4c66-833e-ca47b677a044 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:18.960437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-428cf601-86b2-4c66-833e-ca47b677a044 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:18.961383 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-428cf601-86b2-4c66-833e-ca47b677a044 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:18.963843 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-428cf601-86b2-4c66-833e-ca47b677a044 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:18.964492 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-428cf601-86b2-4c66-833e-ca47b677a044 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:19.018198 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b952fa55-96d6-44dd-b66d-48311aeab442 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:19.044057 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b952fa55-96d6-44dd-b66d-48311aeab442 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:19.046101 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b952fa55-96d6-44dd-b66d-48311aeab442 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:19.047573 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b952fa55-96d6-44dd-b66d-48311aeab442 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4" status: 200 len: 1366 microversion: 2.57 time: 0.323452 Sep 17 21:15:19.054883 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2514/5127] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:18 2022] GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4 => generated 1366 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:19.471925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-428cf601-86b2-4c66-833e-ca47b677a044 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:19.484955 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-428cf601-86b2-4c66-833e-ca47b677a044 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:19.486928 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-428cf601-86b2-4c66-833e-ca47b677a044 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:19.497347 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-428cf601-86b2-4c66-833e-ca47b677a044 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1721 microversion: 2.20 time: 0.573506 Sep 17 21:15:19.498279 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2614/5128] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:18 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1721 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:15:19.739354 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-84a2c932-3fc1-4223-8f7a-e62493031379 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:19.740053 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-84a2c932-3fc1-4223-8f7a-e62493031379 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] [instance: 44929832-cf9c-4d3a-bfda-fc6212c1426d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:19.754010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84a2c932-3fc1-4223-8f7a-e62493031379 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:19.755788 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84a2c932-3fc1-4223-8f7a-e62493031379 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:19.757764 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84a2c932-3fc1-4223-8f7a-e62493031379 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:19.759561 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84a2c932-3fc1-4223-8f7a-e62493031379 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:19.760231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84a2c932-3fc1-4223-8f7a-e62493031379 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:19.762156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84a2c932-3fc1-4223-8f7a-e62493031379 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:20.075750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c6e8eb4a-fd82-4078-8761-721198e39e5f tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:20.076715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c6e8eb4a-fd82-4078-8761-721198e39e5f tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:20.107232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c6e8eb4a-fd82-4078-8761-721198e39e5f tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:20.112889 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c6e8eb4a-fd82-4078-8761-721198e39e5f tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:20.119893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c6e8eb4a-fd82-4078-8761-721198e39e5f tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:20.122669 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c6e8eb4a-fd82-4078-8761-721198e39e5f tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:20.125690 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c6e8eb4a-fd82-4078-8761-721198e39e5f tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:20.127258 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c6e8eb4a-fd82-4078-8761-721198e39e5f tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:20.588221 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-84a2c932-3fc1-4223-8f7a-e62493031379 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753144834d1a418897a600589137fcbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfb56572d9c4d559ad4fbce7cb6d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:20.589016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c6e8eb4a-fd82-4078-8761-721198e39e5f tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:20.598060 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c6e8eb4a-fd82-4078-8761-721198e39e5f tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:20.606698 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-84a2c932-3fc1-4223-8f7a-e62493031379 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] 10.222.0.26 "GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d" status: 200 len: 1274 microversion: 2.1 time: 0.872328 Sep 17 21:15:20.608247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c6e8eb4a-fd82-4078-8761-721198e39e5f tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:20.609252 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2515/5129] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:19 2022] GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d => generated 1274 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:20.617135 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c6e8eb4a-fd82-4078-8761-721198e39e5f tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4" status: 200 len: 1366 microversion: 2.57 time: 0.539093 Sep 17 21:15:20.629485 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2615/5130] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:20 2022] GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4 => generated 1366 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:15:20.643472 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d129e844-87a6-4579-84c1-8878b8b51ab3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:20.644313 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d129e844-87a6-4579-84c1-8878b8b51ab3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:20.653189 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d129e844-87a6-4579-84c1-8878b8b51ab3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:20.653741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d129e844-87a6-4579-84c1-8878b8b51ab3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:20.654205 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d129e844-87a6-4579-84c1-8878b8b51ab3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:20.656387 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d129e844-87a6-4579-84c1-8878b8b51ab3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:20.656953 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d129e844-87a6-4579-84c1-8878b8b51ab3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:20.674179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d129e844-87a6-4579-84c1-8878b8b51ab3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:21.171822 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d129e844-87a6-4579-84c1-8878b8b51ab3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:21.186865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d129e844-87a6-4579-84c1-8878b8b51ab3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:21.189356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d129e844-87a6-4579-84c1-8878b8b51ab3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:21.195158 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d129e844-87a6-4579-84c1-8878b8b51ab3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1721 microversion: 2.20 time: 0.584549 Sep 17 21:15:21.197814 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2516/5131] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:20 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1721 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:21.639042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-af670397-67a1-40db-b0f7-0fa2c2dacd13 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:21.639661 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-af670397-67a1-40db-b0f7-0fa2c2dacd13 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] [instance: 44929832-cf9c-4d3a-bfda-fc6212c1426d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:21.645250 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-34cee9df-1f23-40f4-8aa0-66fed5dc9536 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:21.645936 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-34cee9df-1f23-40f4-8aa0-66fed5dc9536 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:21.656175 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af670397-67a1-40db-b0f7-0fa2c2dacd13 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:21.659544 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af670397-67a1-40db-b0f7-0fa2c2dacd13 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:21.661161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af670397-67a1-40db-b0f7-0fa2c2dacd13 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:21.662125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af670397-67a1-40db-b0f7-0fa2c2dacd13 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:21.662841 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34cee9df-1f23-40f4-8aa0-66fed5dc9536 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:21.665879 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34cee9df-1f23-40f4-8aa0-66fed5dc9536 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:21.666422 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34cee9df-1f23-40f4-8aa0-66fed5dc9536 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:21.667923 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34cee9df-1f23-40f4-8aa0-66fed5dc9536 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:21.667923 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34cee9df-1f23-40f4-8aa0-66fed5dc9536 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:21.667923 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34cee9df-1f23-40f4-8aa0-66fed5dc9536 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:21.672346 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af670397-67a1-40db-b0f7-0fa2c2dacd13 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:21.673056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-af670397-67a1-40db-b0f7-0fa2c2dacd13 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:22.025782 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-34cee9df-1f23-40f4-8aa0-66fed5dc9536 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:22.036636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-34cee9df-1f23-40f4-8aa0-66fed5dc9536 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:22.048481 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-34cee9df-1f23-40f4-8aa0-66fed5dc9536 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:22.049616 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-34cee9df-1f23-40f4-8aa0-66fed5dc9536 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4" status: 200 len: 1366 microversion: 2.57 time: 0.408278 Sep 17 21:15:22.065530 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2517/5132] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:21 2022] GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4 => generated 1366 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:22.223612 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e7156874-e512-48c1-bf9b-50c7085b885f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:22.224505 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e7156874-e512-48c1-bf9b-50c7085b885f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:22.241065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7156874-e512-48c1-bf9b-50c7085b885f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:22.242951 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7156874-e512-48c1-bf9b-50c7085b885f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:22.244570 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7156874-e512-48c1-bf9b-50c7085b885f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:22.245850 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7156874-e512-48c1-bf9b-50c7085b885f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:22.247036 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7156874-e512-48c1-bf9b-50c7085b885f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:22.249100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7156874-e512-48c1-bf9b-50c7085b885f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:22.253117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-af670397-67a1-40db-b0f7-0fa2c2dacd13 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753144834d1a418897a600589137fcbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfb56572d9c4d559ad4fbce7cb6d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:22.272395 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-af670397-67a1-40db-b0f7-0fa2c2dacd13 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] 10.222.0.26 "GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d" status: 200 len: 1316 microversion: 2.1 time: 0.638224 Sep 17 21:15:22.302384 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2616/5133] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:21 2022] GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d => generated 1316 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:23.093270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e7156874-e512-48c1-bf9b-50c7085b885f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:23.094825 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cfe530eb-d84c-4341-b833-576124bf5832 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:23.099468 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cfe530eb-d84c-4341-b833-576124bf5832 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:23.107800 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e7156874-e512-48c1-bf9b-50c7085b885f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:23.112274 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e7156874-e512-48c1-bf9b-50c7085b885f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:23.116302 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e7156874-e512-48c1-bf9b-50c7085b885f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1721 microversion: 2.20 time: 0.897734 Sep 17 21:15:23.121248 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2518/5134] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:22 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1721 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:23.153639 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cfe530eb-d84c-4341-b833-576124bf5832 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:23.164964 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cfe530eb-d84c-4341-b833-576124bf5832 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:23.169188 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cfe530eb-d84c-4341-b833-576124bf5832 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:23.173609 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cfe530eb-d84c-4341-b833-576124bf5832 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:23.177586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cfe530eb-d84c-4341-b833-576124bf5832 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:23.180053 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cfe530eb-d84c-4341-b833-576124bf5832 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:23.304851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-089fb29b-5494-46a2-98a7-ead30bafe9db tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:23.305745 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-089fb29b-5494-46a2-98a7-ead30bafe9db tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] [instance: 44929832-cf9c-4d3a-bfda-fc6212c1426d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:23.319662 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-089fb29b-5494-46a2-98a7-ead30bafe9db tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:23.322089 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-089fb29b-5494-46a2-98a7-ead30bafe9db tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:23.328089 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-089fb29b-5494-46a2-98a7-ead30bafe9db tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:23.329083 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-089fb29b-5494-46a2-98a7-ead30bafe9db tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:23.330143 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-089fb29b-5494-46a2-98a7-ead30bafe9db tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:23.330792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-089fb29b-5494-46a2-98a7-ead30bafe9db tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:23.509536 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cfe530eb-d84c-4341-b833-576124bf5832 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:23.521295 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cfe530eb-d84c-4341-b833-576124bf5832 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:23.528106 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cfe530eb-d84c-4341-b833-576124bf5832 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:23.529538 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cfe530eb-d84c-4341-b833-576124bf5832 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4" status: 200 len: 1372 microversion: 2.57 time: 0.450783 Sep 17 21:15:23.531048 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2617/5135] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:23 2022] GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4 => generated 1372 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:15:23.754898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-089fb29b-5494-46a2-98a7-ead30bafe9db tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753144834d1a418897a600589137fcbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfb56572d9c4d559ad4fbce7cb6d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:23.764768 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-089fb29b-5494-46a2-98a7-ead30bafe9db tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] 10.222.0.26 "GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d" status: 200 len: 1316 microversion: 2.1 time: 0.464060 Sep 17 21:15:23.765521 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2519/5136] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:23 2022] GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d => generated 1316 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:24.150199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b850ad2c-6c98-4391-97e3-425d190280ca tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:24.151489 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b850ad2c-6c98-4391-97e3-425d190280ca tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:24.160731 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b850ad2c-6c98-4391-97e3-425d190280ca tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:24.161230 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b850ad2c-6c98-4391-97e3-425d190280ca tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:24.161706 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b850ad2c-6c98-4391-97e3-425d190280ca tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:24.162438 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b850ad2c-6c98-4391-97e3-425d190280ca tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:24.162894 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b850ad2c-6c98-4391-97e3-425d190280ca tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:24.165548 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b850ad2c-6c98-4391-97e3-425d190280ca tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:24.422205 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b850ad2c-6c98-4391-97e3-425d190280ca tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:24.434999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b850ad2c-6c98-4391-97e3-425d190280ca tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:24.436475 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b850ad2c-6c98-4391-97e3-425d190280ca tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:24.437743 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b850ad2c-6c98-4391-97e3-425d190280ca tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1721 microversion: 2.20 time: 0.292531 Sep 17 21:15:24.457489 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2618/5137] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:24 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1721 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:24.560573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dafb7580-7322-43d4-b89f-39dbb42984f5 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:24.561859 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dafb7580-7322-43d4-b89f-39dbb42984f5 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:24.585434 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dafb7580-7322-43d4-b89f-39dbb42984f5 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:24.593089 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dafb7580-7322-43d4-b89f-39dbb42984f5 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:24.595463 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dafb7580-7322-43d4-b89f-39dbb42984f5 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:24.598448 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dafb7580-7322-43d4-b89f-39dbb42984f5 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:24.607063 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dafb7580-7322-43d4-b89f-39dbb42984f5 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:24.607795 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dafb7580-7322-43d4-b89f-39dbb42984f5 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:24.788773 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-366bcb11-b148-4d2a-90fd-73dcee1153fb tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:24.789484 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-366bcb11-b148-4d2a-90fd-73dcee1153fb tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] [instance: 44929832-cf9c-4d3a-bfda-fc6212c1426d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:24.804698 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-366bcb11-b148-4d2a-90fd-73dcee1153fb tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:24.805224 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-366bcb11-b148-4d2a-90fd-73dcee1153fb tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:24.805731 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-366bcb11-b148-4d2a-90fd-73dcee1153fb tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:24.811332 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-366bcb11-b148-4d2a-90fd-73dcee1153fb tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:24.812411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-366bcb11-b148-4d2a-90fd-73dcee1153fb tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:24.813599 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-366bcb11-b148-4d2a-90fd-73dcee1153fb tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:24.927944 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dafb7580-7322-43d4-b89f-39dbb42984f5 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:24.930384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:15:24.939919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dafb7580-7322-43d4-b89f-39dbb42984f5 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:24.954503 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dafb7580-7322-43d4-b89f-39dbb42984f5 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:24.955764 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dafb7580-7322-43d4-b89f-39dbb42984f5 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4" status: 200 len: 1372 microversion: 2.57 time: 0.401249 Sep 17 21:15:24.966969 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2520/5138] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:24 2022] GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4 => generated 1372 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:25.134521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-a899d8b1-0e83-4373-9068-e5539039fb12 req-bd2efe01-60f3-4cfb-b3eb-227351602a9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44929832-cf9c-4d3a-bfda-fc6212c1426d", "tag": "a3f090f9-fcce-413f-9340-da6823ff76fc"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:15:25.138987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-a899d8b1-0e83-4373-9068-e5539039fb12 req-bd2efe01-60f3-4cfb-b3eb-227351602a9c service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:25.139479 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-a899d8b1-0e83-4373-9068-e5539039fb12 req-bd2efe01-60f3-4cfb-b3eb-227351602a9c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:25.139919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-a899d8b1-0e83-4373-9068-e5539039fb12 req-bd2efe01-60f3-4cfb-b3eb-227351602a9c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:25.194323 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-a899d8b1-0e83-4373-9068-e5539039fb12 req-bd2efe01-60f3-4cfb-b3eb-227351602a9c service nova] Creating event network-changed:a3f090f9-fcce-413f-9340-da6823ff76fc for instance 44929832-cf9c-4d3a-bfda-fc6212c1426d on nch1-master-1 Sep 17 21:15:25.216626 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-a899d8b1-0e83-4373-9068-e5539039fb12 req-bd2efe01-60f3-4cfb-b3eb-227351602a9c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124652 Sep 17 21:15:25.225003 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2521/5139] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:15:25.477282 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4631ae20-5113-423b-8e6d-f8f98e834380 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:25.478360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4631ae20-5113-423b-8e6d-f8f98e834380 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:25.491433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4631ae20-5113-423b-8e6d-f8f98e834380 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:25.492099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4631ae20-5113-423b-8e6d-f8f98e834380 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:25.494866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4631ae20-5113-423b-8e6d-f8f98e834380 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:25.497316 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4631ae20-5113-423b-8e6d-f8f98e834380 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:25.502513 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4631ae20-5113-423b-8e6d-f8f98e834380 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:25.503196 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4631ae20-5113-423b-8e6d-f8f98e834380 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:25.845927 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-366bcb11-b148-4d2a-90fd-73dcee1153fb tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753144834d1a418897a600589137fcbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfb56572d9c4d559ad4fbce7cb6d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:25.856503 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-366bcb11-b148-4d2a-90fd-73dcee1153fb tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] 10.222.0.26 "GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d" status: 200 len: 1316 microversion: 2.1 time: 1.072316 Sep 17 21:15:25.878315 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2619/5140] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:24 2022] GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d => generated 1316 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:25.987832 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-42d4906b-03ac-4902-afb7-e08fc2db8860 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:25.988677 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-42d4906b-03ac-4902-afb7-e08fc2db8860 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:26.001817 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42d4906b-03ac-4902-afb7-e08fc2db8860 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:26.003378 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42d4906b-03ac-4902-afb7-e08fc2db8860 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:26.005016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42d4906b-03ac-4902-afb7-e08fc2db8860 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:26.007126 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42d4906b-03ac-4902-afb7-e08fc2db8860 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:26.008656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42d4906b-03ac-4902-afb7-e08fc2db8860 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:26.009315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42d4906b-03ac-4902-afb7-e08fc2db8860 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:26.131183 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4631ae20-5113-423b-8e6d-f8f98e834380 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:26.144510 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4631ae20-5113-423b-8e6d-f8f98e834380 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:26.150305 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4631ae20-5113-423b-8e6d-f8f98e834380 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:26.152906 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4631ae20-5113-423b-8e6d-f8f98e834380 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1721 microversion: 2.20 time: 0.679993 Sep 17 21:15:26.155509 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2522/5141] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:25 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1721 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:15:26.171809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-42d4906b-03ac-4902-afb7-e08fc2db8860 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:26.195220 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-42d4906b-03ac-4902-afb7-e08fc2db8860 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:26.199571 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-42d4906b-03ac-4902-afb7-e08fc2db8860 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:26.201696 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-42d4906b-03ac-4902-afb7-e08fc2db8860 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4" status: 200 len: 1357 microversion: 2.57 time: 0.219579 Sep 17 21:15:26.202857 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2620/5142] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:25 2022] GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4 => generated 1357 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:26.240156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-aac91c2a-da68-44e6-803f-b55343a52011 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:26.241045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-aac91c2a-da68-44e6-803f-b55343a52011 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:26.251847 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aac91c2a-da68-44e6-803f-b55343a52011 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:26.252351 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aac91c2a-da68-44e6-803f-b55343a52011 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:26.252797 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aac91c2a-da68-44e6-803f-b55343a52011 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:26.256317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aac91c2a-da68-44e6-803f-b55343a52011 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:26.258003 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aac91c2a-da68-44e6-803f-b55343a52011 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:26.258461 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aac91c2a-da68-44e6-803f-b55343a52011 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:26.302019 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-aac91c2a-da68-44e6-803f-b55343a52011 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:15:26.476708 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-aac91c2a-da68-44e6-803f-b55343a52011 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4" status: 204 len: 0 microversion: 2.57 time: 0.240952 Sep 17 21:15:26.478194 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2523/5143] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 17 21:15:26 2022] DELETE /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 21:15:26.489910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0058a593-d410-45ac-9136-10cb379de824 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:26.491664 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0058a593-d410-45ac-9136-10cb379de824 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:26.519766 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0058a593-d410-45ac-9136-10cb379de824 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:26.520292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0058a593-d410-45ac-9136-10cb379de824 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:26.520745 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0058a593-d410-45ac-9136-10cb379de824 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:26.523624 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0058a593-d410-45ac-9136-10cb379de824 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:26.527496 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0058a593-d410-45ac-9136-10cb379de824 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:26.528167 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0058a593-d410-45ac-9136-10cb379de824 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:26.740455 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0058a593-d410-45ac-9136-10cb379de824 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:26.761166 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0058a593-d410-45ac-9136-10cb379de824 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:26.764828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0058a593-d410-45ac-9136-10cb379de824 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:26.767435 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0058a593-d410-45ac-9136-10cb379de824 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4" status: 200 len: 1363 microversion: 2.57 time: 0.284588 Sep 17 21:15:26.772002 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2621/5144] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:26 2022] GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4 => generated 1363 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:26.892687 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-db9c89fa-c5b6-4290-95bf-fab3ae524753 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:26.893658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-db9c89fa-c5b6-4290-95bf-fab3ae524753 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] [instance: 44929832-cf9c-4d3a-bfda-fc6212c1426d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:26.910819 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db9c89fa-c5b6-4290-95bf-fab3ae524753 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:26.911619 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db9c89fa-c5b6-4290-95bf-fab3ae524753 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:26.912510 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db9c89fa-c5b6-4290-95bf-fab3ae524753 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:26.916101 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db9c89fa-c5b6-4290-95bf-fab3ae524753 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:26.916759 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db9c89fa-c5b6-4290-95bf-fab3ae524753 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:26.921195 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db9c89fa-c5b6-4290-95bf-fab3ae524753 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:27.184006 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1487e037-9e4c-4574-a3fb-585e828a98bc tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:27.184630 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1487e037-9e4c-4574-a3fb-585e828a98bc tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:27.192233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:15:27.201525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1487e037-9e4c-4574-a3fb-585e828a98bc tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:27.204772 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1487e037-9e4c-4574-a3fb-585e828a98bc tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:27.208782 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1487e037-9e4c-4574-a3fb-585e828a98bc tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:27.216679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1487e037-9e4c-4574-a3fb-585e828a98bc tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:27.217682 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1487e037-9e4c-4574-a3fb-585e828a98bc tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:27.218727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1487e037-9e4c-4574-a3fb-585e828a98bc tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:27.364602 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=8 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:15:28.078115 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-db9c89fa-c5b6-4290-95bf-fab3ae524753 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753144834d1a418897a600589137fcbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfb56572d9c4d559ad4fbce7cb6d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:28.088381 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-db9c89fa-c5b6-4290-95bf-fab3ae524753 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] 10.222.0.26 "GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d" status: 200 len: 1316 microversion: 2.1 time: 1.200571 Sep 17 21:15:28.095263 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2524/5145] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:26 2022] GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d => generated 1316 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:28.114100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cf463db4-a6c6-451c-a6aa-2e860b0e4366 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:28.115546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cf463db4-a6c6-451c-a6aa-2e860b0e4366 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:28.124051 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf463db4-a6c6-451c-a6aa-2e860b0e4366 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:28.129203 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf463db4-a6c6-451c-a6aa-2e860b0e4366 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:28.129820 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf463db4-a6c6-451c-a6aa-2e860b0e4366 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:28.130701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf463db4-a6c6-451c-a6aa-2e860b0e4366 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:28.132152 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf463db4-a6c6-451c-a6aa-2e860b0e4366 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:28.134169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf463db4-a6c6-451c-a6aa-2e860b0e4366 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:28.207353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1487e037-9e4c-4574-a3fb-585e828a98bc tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:28.216874 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1487e037-9e4c-4574-a3fb-585e828a98bc tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:28.219619 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1487e037-9e4c-4574-a3fb-585e828a98bc tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:28.220865 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1487e037-9e4c-4574-a3fb-585e828a98bc tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1721 microversion: 2.20 time: 1.041297 Sep 17 21:15:28.238062 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2622/5146] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:27 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1721 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:15:28.287593 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cf463db4-a6c6-451c-a6aa-2e860b0e4366 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:28.299990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cf463db4-a6c6-451c-a6aa-2e860b0e4366 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:28.301695 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cf463db4-a6c6-451c-a6aa-2e860b0e4366 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:28.306623 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cf463db4-a6c6-451c-a6aa-2e860b0e4366 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4" status: 200 len: 1363 microversion: 2.57 time: 0.209316 Sep 17 21:15:28.309176 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2525/5147] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:28 2022] GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4 => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:29.120605 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-363e8dd7-1d68-494e-a85d-4f52faaecb86 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:29.121314 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-363e8dd7-1d68-494e-a85d-4f52faaecb86 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] [instance: 44929832-cf9c-4d3a-bfda-fc6212c1426d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:29.145963 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-363e8dd7-1d68-494e-a85d-4f52faaecb86 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:29.150328 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-363e8dd7-1d68-494e-a85d-4f52faaecb86 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:29.152046 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-363e8dd7-1d68-494e-a85d-4f52faaecb86 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:29.152943 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-363e8dd7-1d68-494e-a85d-4f52faaecb86 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:29.153917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-363e8dd7-1d68-494e-a85d-4f52faaecb86 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:29.156014 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-363e8dd7-1d68-494e-a85d-4f52faaecb86 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:29.266358 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1aef5672-c19c-4b6d-91eb-b81123e2dcad tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:29.272379 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1aef5672-c19c-4b6d-91eb-b81123e2dcad tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:29.294923 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1aef5672-c19c-4b6d-91eb-b81123e2dcad tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:29.295487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1aef5672-c19c-4b6d-91eb-b81123e2dcad tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:29.295940 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1aef5672-c19c-4b6d-91eb-b81123e2dcad tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:29.298642 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1aef5672-c19c-4b6d-91eb-b81123e2dcad tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:29.299512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1aef5672-c19c-4b6d-91eb-b81123e2dcad tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:29.305092 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1aef5672-c19c-4b6d-91eb-b81123e2dcad tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:30.018658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1aef5672-c19c-4b6d-91eb-b81123e2dcad tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:30.047092 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1aef5672-c19c-4b6d-91eb-b81123e2dcad tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:30.055376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1aef5672-c19c-4b6d-91eb-b81123e2dcad tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:30.058209 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1aef5672-c19c-4b6d-91eb-b81123e2dcad tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1742 microversion: 2.20 time: 0.804413 Sep 17 21:15:30.060957 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2526/5148] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:29 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1742 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:30.066907 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-363e8dd7-1d68-494e-a85d-4f52faaecb86 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753144834d1a418897a600589137fcbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfb56572d9c4d559ad4fbce7cb6d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:30.086550 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-363e8dd7-1d68-494e-a85d-4f52faaecb86 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] 10.222.0.26 "GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d" status: 200 len: 1316 microversion: 2.1 time: 0.967060 Sep 17 21:15:30.088438 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2623/5149] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:29 2022] GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d => generated 1316 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:30.091795 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0b8d3483-292a-43c6-8841-bb50f90d8d6a tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:30.092731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0b8d3483-292a-43c6-8841-bb50f90d8d6a tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:30.119982 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0b8d3483-292a-43c6-8841-bb50f90d8d6a tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:30.123353 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0b8d3483-292a-43c6-8841-bb50f90d8d6a tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:30.125620 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0b8d3483-292a-43c6-8841-bb50f90d8d6a tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:30.127957 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0b8d3483-292a-43c6-8841-bb50f90d8d6a tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:30.128995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0b8d3483-292a-43c6-8841-bb50f90d8d6a tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:30.131933 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0b8d3483-292a-43c6-8841-bb50f90d8d6a tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:30.232219 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0b8d3483-292a-43c6-8841-bb50f90d8d6a tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:30.233116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0b8d3483-292a-43c6-8841-bb50f90d8d6a tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:30.234072 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0b8d3483-292a-43c6-8841-bb50f90d8d6a tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:30.234818 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-0b8d3483-292a-43c6-8841-bb50f90d8d6a tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lazy-loading 'fault' on Instance uuid d3784ca6-37ed-479d-b058-2275c6388be4 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:15:30.389896 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0b8d3483-292a-43c6-8841-bb50f90d8d6a tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:30.416773 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0b8d3483-292a-43c6-8841-bb50f90d8d6a tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:30.422176 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0b8d3483-292a-43c6-8841-bb50f90d8d6a tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c777e5af74e64cb3805ef28d1d0ed776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aedb1becfa4b42deb13b265c9377e368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:30.439672 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0b8d3483-292a-43c6-8841-bb50f90d8d6a tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4" status: 200 len: 1368 microversion: 2.57 time: 0.349518 Sep 17 21:15:30.444808 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2527/5150] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:30 2022] GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4 => generated 1368 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:31.092776 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d41274b4-836d-4617-8e30-44a4580b5a15 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:31.094338 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d41274b4-836d-4617-8e30-44a4580b5a15 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:31.115004 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c3241ea9-2838-4a3c-bcfb-54195f183830 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:31.115847 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c3241ea9-2838-4a3c-bcfb-54195f183830 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] [instance: 44929832-cf9c-4d3a-bfda-fc6212c1426d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:31.127390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3241ea9-2838-4a3c-bcfb-54195f183830 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:31.145918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d41274b4-836d-4617-8e30-44a4580b5a15 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:31.146834 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3241ea9-2838-4a3c-bcfb-54195f183830 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:31.147738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d41274b4-836d-4617-8e30-44a4580b5a15 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:31.148419 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3241ea9-2838-4a3c-bcfb-54195f183830 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:31.149092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d41274b4-836d-4617-8e30-44a4580b5a15 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:31.150141 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3241ea9-2838-4a3c-bcfb-54195f183830 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:31.151065 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d41274b4-836d-4617-8e30-44a4580b5a15 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:31.151713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3241ea9-2838-4a3c-bcfb-54195f183830 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:31.153208 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d41274b4-836d-4617-8e30-44a4580b5a15 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:31.156039 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3241ea9-2838-4a3c-bcfb-54195f183830 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:31.157173 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d41274b4-836d-4617-8e30-44a4580b5a15 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:32.118859 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c3241ea9-2838-4a3c-bcfb-54195f183830 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753144834d1a418897a600589137fcbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfb56572d9c4d559ad4fbce7cb6d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:32.132057 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c3241ea9-2838-4a3c-bcfb-54195f183830 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] 10.222.0.26 "GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d" status: 200 len: 1316 microversion: 2.1 time: 1.022317 Sep 17 21:15:32.134286 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2528/5151] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:31 2022] GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d => generated 1316 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:15:32.147604 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-11839011-0959-4d92-88c2-88672ddcc2d7 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:32.153652 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d41274b4-836d-4617-8e30-44a4580b5a15 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:32.163164 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-11839011-0959-4d92-88c2-88672ddcc2d7 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] [instance: d3784ca6-37ed-479d-b058-2275c6388be4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:32.170510 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d41274b4-836d-4617-8e30-44a4580b5a15 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:32.179497 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d41274b4-836d-4617-8e30-44a4580b5a15 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:32.185244 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d41274b4-836d-4617-8e30-44a4580b5a15 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1737 microversion: 2.20 time: 1.095448 Sep 17 21:15:32.185723 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11839011-0959-4d92-88c2-88672ddcc2d7 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:32.186500 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11839011-0959-4d92-88c2-88672ddcc2d7 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:32.187580 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2624/5152] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:31 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1737 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:32.188900 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11839011-0959-4d92-88c2-88672ddcc2d7 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:32.190937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11839011-0959-4d92-88c2-88672ddcc2d7 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:32.192155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11839011-0959-4d92-88c2-88672ddcc2d7 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:32.193033 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11839011-0959-4d92-88c2-88672ddcc2d7 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:32.229911 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-11839011-0959-4d92-88c2-88672ddcc2d7 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] HTTP exception thrown: Instance d3784ca6-37ed-479d-b058-2275c6388be4 could not be found. Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-11839011-0959-4d92-88c2-88672ddcc2d7 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Request method failure captured: Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4 HTTP/1.1 Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjjJUGtr0dSxkuaawO5IsPkNQYgiyYY-WeMVnIhNXwJ1HbLDxVtK0-B9C7eLAHdygXJ5g7n84gRGVe4iqvGf8rBRjCQahWObS95owJYYpMgBQ1JuqRSPSSsDC0OGUQKwc6subgm7NXubkOu6tTMUxqt2iQjoKl3LxPk9mT3qezZr3Cs Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: X-Openstack-Nova-Api-Version: 2.57 Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: aedb1becfa4b42deb13b265c9377e368 Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerShowV257Test-1550565911 Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aedb1becfa4b42deb13b265c9377e368"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/aedb1becfa4b42deb13b265c9377e368"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/aedb1becfa4b42deb13b265c9377e368"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_aedb1becfa4b42deb13b265c9377e368", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerShowV257Test-1550565911 Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: aedb1becfa4b42deb13b265c9377e368 Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerShowV257Test-1550565911 Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerShowV257Test-1550565911-project Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: c777e5af74e64cb3805ef28d1d0ed776 Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerShowV257Test-1550565911-project Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance d3784ca6-37ed-479d-b058-2275c6388be4 could not be found. Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'd3784ca6-37ed-479d-b058-2275c6388be4'} Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3784ca6-37ed-479d-b058-2275c6388be4 could not be found. Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3784ca6-37ed-479d-b058-2275c6388be4 could not be found. Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:15:32.233721 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:15:32.238776 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:15:32.238776 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:15:32.238776 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:15:32.238776 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:15:32.238776 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:15:32.238776 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3784ca6-37ed-479d-b058-2275c6388be4 could not be found. Sep 17 21:15:32.238776 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:15:32.241631 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-11839011-0959-4d92-88c2-88672ddcc2d7 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] Returning 404 to user: Instance d3784ca6-37ed-479d-b058-2275c6388be4 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:15:32.251033 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-11839011-0959-4d92-88c2-88672ddcc2d7 tempest-ServerShowV257Test-1550565911 tempest-ServerShowV257Test-1550565911-project] 10.222.0.26 "GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4" status: 404 len: 111 microversion: 2.57 time: 0.114093 Sep 17 21:15:32.252289 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2529/5153] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:32 2022] GET /compute/v2.1/servers/d3784ca6-37ed-479d-b058-2275c6388be4 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:15:33.160441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c81e4f64-061c-49e7-9c35-dd4b1481e525 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:33.161773 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c81e4f64-061c-49e7-9c35-dd4b1481e525 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] [instance: 44929832-cf9c-4d3a-bfda-fc6212c1426d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:33.183965 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c81e4f64-061c-49e7-9c35-dd4b1481e525 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:33.186102 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c81e4f64-061c-49e7-9c35-dd4b1481e525 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:33.188017 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c81e4f64-061c-49e7-9c35-dd4b1481e525 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:33.194556 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c81e4f64-061c-49e7-9c35-dd4b1481e525 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:33.197271 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c81e4f64-061c-49e7-9c35-dd4b1481e525 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:33.198759 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c81e4f64-061c-49e7-9c35-dd4b1481e525 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:33.226988 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-66a248f2-6ced-4090-a80e-f59a4a2a14f9 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:33.228313 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-66a248f2-6ced-4090-a80e-f59a4a2a14f9 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:33.238480 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-66a248f2-6ced-4090-a80e-f59a4a2a14f9 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:33.257660 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-66a248f2-6ced-4090-a80e-f59a4a2a14f9 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:33.258409 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-66a248f2-6ced-4090-a80e-f59a4a2a14f9 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:33.263904 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-66a248f2-6ced-4090-a80e-f59a4a2a14f9 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:33.270190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-66a248f2-6ced-4090-a80e-f59a4a2a14f9 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:33.270660 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-66a248f2-6ced-4090-a80e-f59a4a2a14f9 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:34.231431 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-66a248f2-6ced-4090-a80e-f59a4a2a14f9 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:34.250557 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-66a248f2-6ced-4090-a80e-f59a4a2a14f9 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:34.252353 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-66a248f2-6ced-4090-a80e-f59a4a2a14f9 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:34.254631 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-66a248f2-6ced-4090-a80e-f59a4a2a14f9 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1737 microversion: 2.20 time: 1.031870 Sep 17 21:15:34.256426 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2530/5154] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:33 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1737 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:15:34.275118 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-daa97221-22f5-4315-9e62-007e13a44b11 req-2b9792d7-f17e-4113-8fb6-63e60f98170d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "796cf34c-7dbb-444e-a74e-68139729405f", "name": "network-vif-plugged", "status": "completed", "tag": "74223161-c2a1-4706-8b34-7e44c8bdcb2b"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:15:34.294160 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-daa97221-22f5-4315-9e62-007e13a44b11 req-2b9792d7-f17e-4113-8fb6-63e60f98170d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:34.297874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-daa97221-22f5-4315-9e62-007e13a44b11 req-2b9792d7-f17e-4113-8fb6-63e60f98170d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:34.298579 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-daa97221-22f5-4315-9e62-007e13a44b11 req-2b9792d7-f17e-4113-8fb6-63e60f98170d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:34.305984 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c81e4f64-061c-49e7-9c35-dd4b1481e525 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753144834d1a418897a600589137fcbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfb56572d9c4d559ad4fbce7cb6d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:34.318184 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c81e4f64-061c-49e7-9c35-dd4b1481e525 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] 10.222.0.26 "GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d" status: 200 len: 1316 microversion: 2.1 time: 1.161612 Sep 17 21:15:34.327144 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-daa97221-22f5-4315-9e62-007e13a44b11 req-2b9792d7-f17e-4113-8fb6-63e60f98170d service nova] Creating event network-vif-plugged:74223161-c2a1-4706-8b34-7e44c8bdcb2b for instance 796cf34c-7dbb-444e-a74e-68139729405f on nch2-master-1 Sep 17 21:15:34.333488 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2625/5155] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:33 2022] GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d => generated 1316 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:34.338402 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-daa97221-22f5-4315-9e62-007e13a44b11 req-2b9792d7-f17e-4113-8fb6-63e60f98170d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080378 Sep 17 21:15:34.340856 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2531/5156] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:15:35.288051 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6904ff6a-0699-4818-b3ff-270b6b2c1e9b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:35.288661 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6904ff6a-0699-4818-b3ff-270b6b2c1e9b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:35.315604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6904ff6a-0699-4818-b3ff-270b6b2c1e9b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:35.316939 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6904ff6a-0699-4818-b3ff-270b6b2c1e9b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:35.319961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6904ff6a-0699-4818-b3ff-270b6b2c1e9b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:35.326068 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6904ff6a-0699-4818-b3ff-270b6b2c1e9b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:35.326768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6904ff6a-0699-4818-b3ff-270b6b2c1e9b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:35.328085 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6904ff6a-0699-4818-b3ff-270b6b2c1e9b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:35.341743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dd8ef41e-3f12-4db2-ae8d-d5bb44d5816e tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:35.342975 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dd8ef41e-3f12-4db2-ae8d-d5bb44d5816e tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] [instance: 44929832-cf9c-4d3a-bfda-fc6212c1426d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:35.354837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd8ef41e-3f12-4db2-ae8d-d5bb44d5816e tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:35.355581 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd8ef41e-3f12-4db2-ae8d-d5bb44d5816e tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:35.357746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd8ef41e-3f12-4db2-ae8d-d5bb44d5816e tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:35.358660 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd8ef41e-3f12-4db2-ae8d-d5bb44d5816e tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:35.362092 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd8ef41e-3f12-4db2-ae8d-d5bb44d5816e tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:35.362735 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd8ef41e-3f12-4db2-ae8d-d5bb44d5816e tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:36.575723 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dd8ef41e-3f12-4db2-ae8d-d5bb44d5816e tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753144834d1a418897a600589137fcbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfb56572d9c4d559ad4fbce7cb6d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:36.603892 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dd8ef41e-3f12-4db2-ae8d-d5bb44d5816e tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] 10.222.0.26 "GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d" status: 200 len: 1316 microversion: 2.1 time: 1.265180 Sep 17 21:15:36.624175 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2532/5157] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:35 2022] GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d => generated 1316 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:15:36.638555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-9f9ac6b4-f7fb-4da0-bbc0-5508c1aa83fe req-d8761ea0-3c3f-4ff6-b6ff-c99acb86d56b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44929832-cf9c-4d3a-bfda-fc6212c1426d", "name": "network-vif-plugged", "status": "completed", "tag": "a3f090f9-fcce-413f-9340-da6823ff76fc"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:15:36.658121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-9f9ac6b4-f7fb-4da0-bbc0-5508c1aa83fe req-d8761ea0-3c3f-4ff6-b6ff-c99acb86d56b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:36.658854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-9f9ac6b4-f7fb-4da0-bbc0-5508c1aa83fe req-d8761ea0-3c3f-4ff6-b6ff-c99acb86d56b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:36.659439 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-9f9ac6b4-f7fb-4da0-bbc0-5508c1aa83fe req-d8761ea0-3c3f-4ff6-b6ff-c99acb86d56b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:36.700077 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-9f9ac6b4-f7fb-4da0-bbc0-5508c1aa83fe req-d8761ea0-3c3f-4ff6-b6ff-c99acb86d56b service nova] Creating event network-vif-plugged:a3f090f9-fcce-413f-9340-da6823ff76fc for instance 44929832-cf9c-4d3a-bfda-fc6212c1426d on nch1-master-1 Sep 17 21:15:36.711215 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-9f9ac6b4-f7fb-4da0-bbc0-5508c1aa83fe req-d8761ea0-3c3f-4ff6-b6ff-c99acb86d56b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085487 Sep 17 21:15:36.712281 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2533/5158] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:15:36.873347 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6904ff6a-0699-4818-b3ff-270b6b2c1e9b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:36.903306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6904ff6a-0699-4818-b3ff-270b6b2c1e9b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:36.914194 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6904ff6a-0699-4818-b3ff-270b6b2c1e9b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:36.917612 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6904ff6a-0699-4818-b3ff-270b6b2c1e9b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1737 microversion: 2.20 time: 1.633050 Sep 17 21:15:36.918872 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2626/5159] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:35 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1737 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:37.637308 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b6c38daa-b9c1-400f-b799-6c835d440db0 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:37.640555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b6c38daa-b9c1-400f-b799-6c835d440db0 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] [instance: 44929832-cf9c-4d3a-bfda-fc6212c1426d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:37.685332 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6c38daa-b9c1-400f-b799-6c835d440db0 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:37.686241 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6c38daa-b9c1-400f-b799-6c835d440db0 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:37.689292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6c38daa-b9c1-400f-b799-6c835d440db0 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:37.694785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6c38daa-b9c1-400f-b799-6c835d440db0 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:37.695399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6c38daa-b9c1-400f-b799-6c835d440db0 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:37.697483 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6c38daa-b9c1-400f-b799-6c835d440db0 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:37.951127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-25917e91-fb27-430a-a806-3ec688c869dd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:37.952526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-25917e91-fb27-430a-a806-3ec688c869dd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:37.962625 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-25917e91-fb27-430a-a806-3ec688c869dd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:37.964103 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-25917e91-fb27-430a-a806-3ec688c869dd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:37.964794 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-25917e91-fb27-430a-a806-3ec688c869dd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:37.966010 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-25917e91-fb27-430a-a806-3ec688c869dd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:37.966772 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-25917e91-fb27-430a-a806-3ec688c869dd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:37.967518 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-25917e91-fb27-430a-a806-3ec688c869dd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:38.500063 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b6c38daa-b9c1-400f-b799-6c835d440db0 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753144834d1a418897a600589137fcbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfb56572d9c4d559ad4fbce7cb6d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:38.513702 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b6c38daa-b9c1-400f-b799-6c835d440db0 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] 10.222.0.26 "GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d" status: 200 len: 1316 microversion: 2.1 time: 0.888665 Sep 17 21:15:38.519923 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2534/5160] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:37 2022] GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d => generated 1316 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:38.841669 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-25917e91-fb27-430a-a806-3ec688c869dd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:38.845226 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:15:38.867145 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-25917e91-fb27-430a-a806-3ec688c869dd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:38.870581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-25917e91-fb27-430a-a806-3ec688c869dd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:38.875605 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-25917e91-fb27-430a-a806-3ec688c869dd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1737 microversion: 2.20 time: 0.930276 Sep 17 21:15:38.878155 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2627/5161] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:37 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1737 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:38.984799 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-eb006fba-92a5-4646-8059-b9b8b1f214c5 tempest-ComputeTenantNetworksTest-2066255471 tempest-ComputeTenantNetworksTest-2066255471-project] Calling method '.version_select at 0x7f25a44ec280>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:39.500909 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-eb006fba-92a5-4646-8059-b9b8b1f214c5 tempest-ComputeTenantNetworksTest-2066255471 tempest-ComputeTenantNetworksTest-2066255471-project] 10.222.0.26 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.799730 Sep 17 21:15:39.501607 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2535/5162] 10.222.0.26 () {58 vars in 1158 bytes} [Sat Sep 17 21:15:38 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:15:39.513877 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9da3cb35-cbed-41d6-b281-089649723348 tempest-ComputeTenantNetworksTest-2066255471 tempest-ComputeTenantNetworksTest-2066255471-project] Calling method '.version_select at 0x7f25a418c160>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:39.545372 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ac3c86ad-3080-4e3f-bcca-f57a28a01cfc tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:39.546261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ac3c86ad-3080-4e3f-bcca-f57a28a01cfc tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] [instance: 44929832-cf9c-4d3a-bfda-fc6212c1426d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:39.568856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac3c86ad-3080-4e3f-bcca-f57a28a01cfc tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:39.571673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac3c86ad-3080-4e3f-bcca-f57a28a01cfc tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:39.572350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac3c86ad-3080-4e3f-bcca-f57a28a01cfc tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:39.573522 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac3c86ad-3080-4e3f-bcca-f57a28a01cfc tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:39.574148 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac3c86ad-3080-4e3f-bcca-f57a28a01cfc tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:39.574790 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ac3c86ad-3080-4e3f-bcca-f57a28a01cfc tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:39.838611 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9da3cb35-cbed-41d6-b281-089649723348 tempest-ComputeTenantNetworksTest-2066255471 tempest-ComputeTenantNetworksTest-2066255471-project] 10.222.0.26 "GET /compute/v2.1/os-tenant-networks/55311e7a-ddbf-419e-8ed4-05d80038ca66" status: 200 len: 140 microversion: 2.1 time: 0.329827 Sep 17 21:15:39.845589 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2628/5163] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Sep 17 21:15:39 2022] GET /compute/v2.1/os-tenant-networks/55311e7a-ddbf-419e-8ed4-05d80038ca66 => generated 140 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:15:39.908631 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0936e891-0d06-43cd-99c9-01294f0dc63f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:39.909321 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0936e891-0d06-43cd-99c9-01294f0dc63f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:39.922915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0936e891-0d06-43cd-99c9-01294f0dc63f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:39.923932 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0936e891-0d06-43cd-99c9-01294f0dc63f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:39.926431 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0936e891-0d06-43cd-99c9-01294f0dc63f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:39.927227 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0936e891-0d06-43cd-99c9-01294f0dc63f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:39.933384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0936e891-0d06-43cd-99c9-01294f0dc63f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:39.934114 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0936e891-0d06-43cd-99c9-01294f0dc63f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:40.452665 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ac3c86ad-3080-4e3f-bcca-f57a28a01cfc tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753144834d1a418897a600589137fcbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfb56572d9c4d559ad4fbce7cb6d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:40.461283 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ac3c86ad-3080-4e3f-bcca-f57a28a01cfc tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] 10.222.0.26 "GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d" status: 200 len: 1506 microversion: 2.1 time: 0.920640 Sep 17 21:15:40.465886 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2536/5164] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:39 2022] GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d => generated 1506 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:15:40.488668 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6086c2cd-46f5-400d-a524-c0eefc287add tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:40.489221 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6086c2cd-46f5-400d-a524-c0eefc287add tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] [instance: 44929832-cf9c-4d3a-bfda-fc6212c1426d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:40.506397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6086c2cd-46f5-400d-a524-c0eefc287add tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:40.506916 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6086c2cd-46f5-400d-a524-c0eefc287add tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:40.507354 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6086c2cd-46f5-400d-a524-c0eefc287add tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:40.510104 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6086c2cd-46f5-400d-a524-c0eefc287add tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:40.511159 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6086c2cd-46f5-400d-a524-c0eefc287add tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:40.513322 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6086c2cd-46f5-400d-a524-c0eefc287add tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:40.639152 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6086c2cd-46f5-400d-a524-c0eefc287add tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '753144834d1a418897a600589137fcbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfb56572d9c4d559ad4fbce7cb6d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:40.641199 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6086c2cd-46f5-400d-a524-c0eefc287add tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] 10.222.0.26 "GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d/os-instance-actions/req-0c856e51-0a94-47d2-a1fb-a646a009e3af" status: 200 len: 313 microversion: 2.1 time: 0.156623 Sep 17 21:15:40.661499 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2537/5165] 10.222.0.26 () {58 vars in 1419 bytes} [Sat Sep 17 21:15:40 2022] GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d/os-instance-actions/req-0c856e51-0a94-47d2-a1fb-a646a009e3af => generated 313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:15:40.674664 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6139bdc9-a14a-4f6a-87b0-becade1c466d tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:15:40.684512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6139bdc9-a14a-4f6a-87b0-becade1c466d tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] [instance: 44929832-cf9c-4d3a-bfda-fc6212c1426d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:40.722763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6139bdc9-a14a-4f6a-87b0-becade1c466d tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:40.724292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6139bdc9-a14a-4f6a-87b0-becade1c466d tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:40.726205 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6139bdc9-a14a-4f6a-87b0-becade1c466d tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:40.727596 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6139bdc9-a14a-4f6a-87b0-becade1c466d tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:40.730813 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6139bdc9-a14a-4f6a-87b0-becade1c466d tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:40.731515 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6139bdc9-a14a-4f6a-87b0-becade1c466d tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:40.892102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:15:41.007572 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0936e891-0d06-43cd-99c9-01294f0dc63f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:41.036829 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6139bdc9-a14a-4f6a-87b0-becade1c466d tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] 10.222.0.26 "POST /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d/action" status: 202 len: 0 microversion: 2.1 time: 0.363080 Sep 17 21:15:41.040701 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0936e891-0d06-43cd-99c9-01294f0dc63f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:41.040701 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0936e891-0d06-43cd-99c9-01294f0dc63f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:41.041117 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2538/5166] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:15:40 2022] POST /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:15:41.046649 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-722c0bad-431e-4965-a9f8-788cb93c8933 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:41.047385 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-722c0bad-431e-4965-a9f8-788cb93c8933 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] [instance: 44929832-cf9c-4d3a-bfda-fc6212c1426d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:41.052430 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0936e891-0d06-43cd-99c9-01294f0dc63f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1737 microversion: 2.20 time: 1.145047 Sep 17 21:15:41.053254 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2629/5167] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:39 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1737 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:15:41.077861 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-722c0bad-431e-4965-a9f8-788cb93c8933 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:41.078396 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-722c0bad-431e-4965-a9f8-788cb93c8933 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:41.079071 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-722c0bad-431e-4965-a9f8-788cb93c8933 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:41.081091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-722c0bad-431e-4965-a9f8-788cb93c8933 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:41.081618 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-722c0bad-431e-4965-a9f8-788cb93c8933 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:41.082069 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-722c0bad-431e-4965-a9f8-788cb93c8933 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:42.081553 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-46fbf59a-d8e8-4476-932d-98547c7e4a6d tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:42.082866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-722c0bad-431e-4965-a9f8-788cb93c8933 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753144834d1a418897a600589137fcbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfb56572d9c4d559ad4fbce7cb6d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:42.083309 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-46fbf59a-d8e8-4476-932d-98547c7e4a6d tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:42.103498 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-722c0bad-431e-4965-a9f8-788cb93c8933 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] 10.222.0.26 "GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d" status: 200 len: 1508 microversion: 2.1 time: 1.059452 Sep 17 21:15:42.104282 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46fbf59a-d8e8-4476-932d-98547c7e4a6d tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:42.106334 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2539/5168] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:41 2022] GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d => generated 1508 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:42.107308 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46fbf59a-d8e8-4476-932d-98547c7e4a6d tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:42.109575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46fbf59a-d8e8-4476-932d-98547c7e4a6d tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:42.110377 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46fbf59a-d8e8-4476-932d-98547c7e4a6d tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:42.119403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46fbf59a-d8e8-4476-932d-98547c7e4a6d tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:42.120239 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46fbf59a-d8e8-4476-932d-98547c7e4a6d tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:43.138635 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8a951940-0e32-4415-847e-b183d026b35a tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:43.141546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8a951940-0e32-4415-847e-b183d026b35a tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] [instance: 44929832-cf9c-4d3a-bfda-fc6212c1426d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:43.153910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-46fbf59a-d8e8-4476-932d-98547c7e4a6d tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:43.181555 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-46fbf59a-d8e8-4476-932d-98547c7e4a6d tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:43.184512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8a951940-0e32-4415-847e-b183d026b35a tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:43.185109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8a951940-0e32-4415-847e-b183d026b35a tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:43.185492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8a951940-0e32-4415-847e-b183d026b35a tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:43.192277 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-46fbf59a-d8e8-4476-932d-98547c7e4a6d tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:43.195147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8a951940-0e32-4415-847e-b183d026b35a tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:43.195648 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8a951940-0e32-4415-847e-b183d026b35a tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:43.196217 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8a951940-0e32-4415-847e-b183d026b35a tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:43.200292 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-46fbf59a-d8e8-4476-932d-98547c7e4a6d tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1737 microversion: 2.20 time: 1.124587 Sep 17 21:15:43.200947 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2630/5169] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:42 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1737 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:44.132049 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8a951940-0e32-4415-847e-b183d026b35a tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753144834d1a418897a600589137fcbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfb56572d9c4d559ad4fbce7cb6d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:44.145305 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8a951940-0e32-4415-847e-b183d026b35a tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] 10.222.0.26 "GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d" status: 200 len: 1508 microversion: 2.1 time: 1.016180 Sep 17 21:15:44.147032 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2540/5170] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:43 2022] GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d => generated 1508 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:15:44.241755 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e1377e99-3f4e-487c-b4eb-bf7275227527 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:44.242901 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e1377e99-3f4e-487c-b4eb-bf7275227527 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:44.246915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:15:44.263774 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1377e99-3f4e-487c-b4eb-bf7275227527 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:44.264726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1377e99-3f4e-487c-b4eb-bf7275227527 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:44.265959 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1377e99-3f4e-487c-b4eb-bf7275227527 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:44.267643 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1377e99-3f4e-487c-b4eb-bf7275227527 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:44.269607 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1377e99-3f4e-487c-b4eb-bf7275227527 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:44.270953 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e1377e99-3f4e-487c-b4eb-bf7275227527 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:44.609634 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e1377e99-3f4e-487c-b4eb-bf7275227527 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:44.634646 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e1377e99-3f4e-487c-b4eb-bf7275227527 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:44.644338 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e1377e99-3f4e-487c-b4eb-bf7275227527 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:44.652258 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e1377e99-3f4e-487c-b4eb-bf7275227527 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1737 microversion: 2.20 time: 0.409318 Sep 17 21:15:44.653881 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2631/5171] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:44 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1737 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:45.169668 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a8c39d96-38eb-4fc1-a0db-4db8f639a3d8 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:45.170294 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a8c39d96-38eb-4fc1-a0db-4db8f639a3d8 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] [instance: 44929832-cf9c-4d3a-bfda-fc6212c1426d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:45.176327 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:15:45.178390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a8c39d96-38eb-4fc1-a0db-4db8f639a3d8 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:45.189557 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a8c39d96-38eb-4fc1-a0db-4db8f639a3d8 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:45.192939 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a8c39d96-38eb-4fc1-a0db-4db8f639a3d8 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:45.194376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a8c39d96-38eb-4fc1-a0db-4db8f639a3d8 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:45.199946 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a8c39d96-38eb-4fc1-a0db-4db8f639a3d8 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:45.201914 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a8c39d96-38eb-4fc1-a0db-4db8f639a3d8 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:45.477400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a8c39d96-38eb-4fc1-a0db-4db8f639a3d8 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753144834d1a418897a600589137fcbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfb56572d9c4d559ad4fbce7cb6d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:45.489605 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a8c39d96-38eb-4fc1-a0db-4db8f639a3d8 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] 10.222.0.26 "GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d" status: 200 len: 1506 microversion: 2.1 time: 0.322607 Sep 17 21:15:45.517269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4eeb4275-2610-48bb-bdf5-449906afa1c0 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Calling method '.version_select at 0x7f25a4213b80>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:45.518524 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4eeb4275-2610-48bb-bdf5-449906afa1c0 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] [instance: 44929832-cf9c-4d3a-bfda-fc6212c1426d] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:45.520426 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2541/5172] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:45 2022] GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d => generated 1506 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:45.529122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4eeb4275-2610-48bb-bdf5-449906afa1c0 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:45.530350 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4eeb4275-2610-48bb-bdf5-449906afa1c0 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:45.532857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4eeb4275-2610-48bb-bdf5-449906afa1c0 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:45.533772 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4eeb4275-2610-48bb-bdf5-449906afa1c0 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:45.537312 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4eeb4275-2610-48bb-bdf5-449906afa1c0 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:45.537919 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4eeb4275-2610-48bb-bdf5-449906afa1c0 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:45.607708 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4eeb4275-2610-48bb-bdf5-449906afa1c0 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] 10.222.0.26 "GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.095044 Sep 17 21:15:45.613784 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2632/5173] 10.222.0.26 () {58 vars in 1296 bytes} [Sat Sep 17 21:15:45 2022] GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d/os-instance-actions => generated 611 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:15:45.630907 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4f71a9e4-d738-4879-9626-a2bce715012f tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:45.632565 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4f71a9e4-d738-4879-9626-a2bce715012f tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] [instance: 44929832-cf9c-4d3a-bfda-fc6212c1426d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:45.647427 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f71a9e4-d738-4879-9626-a2bce715012f tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:45.648380 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f71a9e4-d738-4879-9626-a2bce715012f tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:45.652797 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f71a9e4-d738-4879-9626-a2bce715012f tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:45.658276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f71a9e4-d738-4879-9626-a2bce715012f tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:45.659401 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f71a9e4-d738-4879-9626-a2bce715012f tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:45.661824 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f71a9e4-d738-4879-9626-a2bce715012f tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:45.684083 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-69693d79-40af-4cbc-8fd7-f5571832d103 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:45.684813 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-69693d79-40af-4cbc-8fd7-f5571832d103 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:45.697872 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69693d79-40af-4cbc-8fd7-f5571832d103 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:45.698503 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69693d79-40af-4cbc-8fd7-f5571832d103 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:45.699399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69693d79-40af-4cbc-8fd7-f5571832d103 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:45.700385 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69693d79-40af-4cbc-8fd7-f5571832d103 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:45.701070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69693d79-40af-4cbc-8fd7-f5571832d103 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:45.702597 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4f71a9e4-d738-4879-9626-a2bce715012f tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] [instance: 44929832-cf9c-4d3a-bfda-fc6212c1426d] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:15:45.703119 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69693d79-40af-4cbc-8fd7-f5571832d103 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:45.912719 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4f71a9e4-d738-4879-9626-a2bce715012f tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] 10.222.0.26 "DELETE /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d" status: 204 len: 0 microversion: 2.1 time: 0.291043 Sep 17 21:15:45.918205 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2542/5174] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:15:45 2022] DELETE /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:15:45.927008 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-18c602aa-eeb8-462f-aeff-9a588aa82e89 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:45.928638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-18c602aa-eeb8-462f-aeff-9a588aa82e89 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] [instance: 44929832-cf9c-4d3a-bfda-fc6212c1426d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:45.939420 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-18c602aa-eeb8-462f-aeff-9a588aa82e89 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:45.940434 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-18c602aa-eeb8-462f-aeff-9a588aa82e89 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:45.941279 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-18c602aa-eeb8-462f-aeff-9a588aa82e89 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:45.942302 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-18c602aa-eeb8-462f-aeff-9a588aa82e89 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:45.943053 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-18c602aa-eeb8-462f-aeff-9a588aa82e89 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:45.943884 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-18c602aa-eeb8-462f-aeff-9a588aa82e89 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:47.137412 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-69693d79-40af-4cbc-8fd7-f5571832d103 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:47.153639 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-69693d79-40af-4cbc-8fd7-f5571832d103 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:47.157454 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-69693d79-40af-4cbc-8fd7-f5571832d103 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:47.160462 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-69693d79-40af-4cbc-8fd7-f5571832d103 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1737 microversion: 2.20 time: 1.481343 Sep 17 21:15:47.174229 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2633/5175] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:45 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1737 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:15:47.237322 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-18c602aa-eeb8-462f-aeff-9a588aa82e89 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753144834d1a418897a600589137fcbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfb56572d9c4d559ad4fbce7cb6d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:47.247155 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-18c602aa-eeb8-462f-aeff-9a588aa82e89 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] 10.222.0.26 "GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d" status: 200 len: 1512 microversion: 2.1 time: 1.326119 Sep 17 21:15:47.247747 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2543/5176] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:45 2022] GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d => generated 1512 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:48.190137 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e7071bfb-346e-4126-bd9c-26eef22b5bf0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:48.190780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e7071bfb-346e-4126-bd9c-26eef22b5bf0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:48.217991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7071bfb-346e-4126-bd9c-26eef22b5bf0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:48.222163 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7071bfb-346e-4126-bd9c-26eef22b5bf0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:48.222685 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7071bfb-346e-4126-bd9c-26eef22b5bf0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:48.229002 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7071bfb-346e-4126-bd9c-26eef22b5bf0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:48.231283 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7071bfb-346e-4126-bd9c-26eef22b5bf0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:48.236132 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e7071bfb-346e-4126-bd9c-26eef22b5bf0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:48.279519 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-70a93f54-bb99-4bbb-a5ee-edafc8b4b977 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:48.280502 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-70a93f54-bb99-4bbb-a5ee-edafc8b4b977 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] [instance: 44929832-cf9c-4d3a-bfda-fc6212c1426d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:48.316185 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-70a93f54-bb99-4bbb-a5ee-edafc8b4b977 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:48.319262 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-70a93f54-bb99-4bbb-a5ee-edafc8b4b977 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:48.321961 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-70a93f54-bb99-4bbb-a5ee-edafc8b4b977 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:48.322912 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-70a93f54-bb99-4bbb-a5ee-edafc8b4b977 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:48.328338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-70a93f54-bb99-4bbb-a5ee-edafc8b4b977 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:48.328820 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-70a93f54-bb99-4bbb-a5ee-edafc8b4b977 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:48.854197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-70a93f54-bb99-4bbb-a5ee-edafc8b4b977 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753144834d1a418897a600589137fcbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdfb56572d9c4d559ad4fbce7cb6d527', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:48.863900 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-70a93f54-bb99-4bbb-a5ee-edafc8b4b977 tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] 10.222.0.26 "GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d" status: 200 len: 1470 microversion: 2.1 time: 0.588516 Sep 17 21:15:48.868302 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2544/5177] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:48 2022] GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d => generated 1470 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:15:48.891799 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-f0e229cf-4719-4d0f-b5b7-d0642a48e3e2 req-1ed30eba-4fe2-4073-85f5-984e68a550ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44929832-cf9c-4d3a-bfda-fc6212c1426d", "name": "network-vif-deleted", "tag": "a3f090f9-fcce-413f-9340-da6823ff76fc"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:15:48.913426 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f0e229cf-4719-4d0f-b5b7-d0642a48e3e2 req-1ed30eba-4fe2-4073-85f5-984e68a550ed service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:48.913984 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f0e229cf-4719-4d0f-b5b7-d0642a48e3e2 req-1ed30eba-4fe2-4073-85f5-984e68a550ed service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:48.914429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f0e229cf-4719-4d0f-b5b7-d0642a48e3e2 req-1ed30eba-4fe2-4073-85f5-984e68a550ed service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:48.946758 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-f0e229cf-4719-4d0f-b5b7-d0642a48e3e2 req-1ed30eba-4fe2-4073-85f5-984e68a550ed service nova] Creating event network-vif-deleted:a3f090f9-fcce-413f-9340-da6823ff76fc for instance 44929832-cf9c-4d3a-bfda-fc6212c1426d on nch1-master-1 Sep 17 21:15:48.957840 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-f0e229cf-4719-4d0f-b5b7-d0642a48e3e2 req-1ed30eba-4fe2-4073-85f5-984e68a550ed service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074013 Sep 17 21:15:48.959221 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2545/5178] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:15:49.100711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e7071bfb-346e-4126-bd9c-26eef22b5bf0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:49.112623 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e7071bfb-346e-4126-bd9c-26eef22b5bf0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:49.114798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e7071bfb-346e-4126-bd9c-26eef22b5bf0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:49.116450 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e7071bfb-346e-4126-bd9c-26eef22b5bf0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1737 microversion: 2.20 time: 0.933291 Sep 17 21:15:49.117637 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2634/5179] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:48 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1737 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:49.892336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-36e5a8f6-dbe4-468f-88ef-0ca705f7f75a tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:49.893043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-36e5a8f6-dbe4-468f-88ef-0ca705f7f75a tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] [instance: 44929832-cf9c-4d3a-bfda-fc6212c1426d] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:49.905432 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36e5a8f6-dbe4-468f-88ef-0ca705f7f75a tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:49.908479 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36e5a8f6-dbe4-468f-88ef-0ca705f7f75a tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:49.909090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36e5a8f6-dbe4-468f-88ef-0ca705f7f75a tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:49.911393 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36e5a8f6-dbe4-468f-88ef-0ca705f7f75a tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:49.912016 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36e5a8f6-dbe4-468f-88ef-0ca705f7f75a tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:49.913377 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36e5a8f6-dbe4-468f-88ef-0ca705f7f75a tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:49.932256 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-36e5a8f6-dbe4-468f-88ef-0ca705f7f75a tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] HTTP exception thrown: Instance 44929832-cf9c-4d3a-bfda-fc6212c1426d could not be found. Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-36e5a8f6-dbe4-468f-88ef-0ca705f7f75a tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Request method failure captured: Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d HTTP/1.1 Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjjikngxXhh2z9pEl_9WApZofpo-_3N3ncrmz6XJuZ-7RsxQwquCpnHQx_fGlyuWZoO4YAGrAzQfYk8qy1KUcyr3uidpCQoqlm29MSDZexIhs6PK9i5IhcpaPY3kpkwjFa4rkctgYiBbIL4EiJo8A3Dfhc8loIx6JDvpXpVHvdNF4Qs Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: bdfb56572d9c4d559ad4fbce7cb6d527 Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-InstanceActionsTestJSON-502202677 Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bdfb56572d9c4d559ad4fbce7cb6d527"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bdfb56572d9c4d559ad4fbce7cb6d527"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bdfb56572d9c4d559ad4fbce7cb6d527"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bdfb56572d9c4d559ad4fbce7cb6d527", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-InstanceActionsTestJSON-502202677 Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: bdfb56572d9c4d559ad4fbce7cb6d527 Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-InstanceActionsTestJSON-502202677 Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-InstanceActionsTestJSON-502202677-project Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 753144834d1a418897a600589137fcbc Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-InstanceActionsTestJSON-502202677-project Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 44929832-cf9c-4d3a-bfda-fc6212c1426d could not be found. Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '44929832-cf9c-4d3a-bfda-fc6212c1426d'} Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44929832-cf9c-4d3a-bfda-fc6212c1426d could not be found. Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44929832-cf9c-4d3a-bfda-fc6212c1426d could not be found. Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:15:49.934174 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:15:49.939039 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:15:49.939039 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:15:49.939039 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:15:49.939039 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:15:49.939039 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:15:49.939039 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44929832-cf9c-4d3a-bfda-fc6212c1426d could not be found. Sep 17 21:15:49.939039 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:15:49.939039 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-36e5a8f6-dbe4-468f-88ef-0ca705f7f75a tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] Returning 404 to user: Instance 44929832-cf9c-4d3a-bfda-fc6212c1426d could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:15:49.939039 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-36e5a8f6-dbe4-468f-88ef-0ca705f7f75a tempest-InstanceActionsTestJSON-502202677 tempest-InstanceActionsTestJSON-502202677-project] 10.222.0.26 "GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d" status: 404 len: 111 microversion: 2.1 time: 0.047670 Sep 17 21:15:49.939039 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2546/5180] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:15:49 2022] GET /compute/v2.1/servers/44929832-cf9c-4d3a-bfda-fc6212c1426d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:15:50.146723 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ee435293-692e-4cd7-88b5-44f84faf6798 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:50.147343 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ee435293-692e-4cd7-88b5-44f84faf6798 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:50.166066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee435293-692e-4cd7-88b5-44f84faf6798 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:50.166942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee435293-692e-4cd7-88b5-44f84faf6798 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:50.175793 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee435293-692e-4cd7-88b5-44f84faf6798 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:50.176599 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee435293-692e-4cd7-88b5-44f84faf6798 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:50.177086 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee435293-692e-4cd7-88b5-44f84faf6798 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:50.177554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee435293-692e-4cd7-88b5-44f84faf6798 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:50.801445 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ee435293-692e-4cd7-88b5-44f84faf6798 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:50.816617 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ee435293-692e-4cd7-88b5-44f84faf6798 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:50.819785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ee435293-692e-4cd7-88b5-44f84faf6798 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:50.822279 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ee435293-692e-4cd7-88b5-44f84faf6798 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1737 microversion: 2.20 time: 0.679480 Sep 17 21:15:50.842350 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2635/5181] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:50 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1737 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:51.862530 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0609b30c-e8f0-4ecc-bdfd-e67e84ae25c0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:51.864661 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0609b30c-e8f0-4ecc-bdfd-e67e84ae25c0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:51.878348 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0609b30c-e8f0-4ecc-bdfd-e67e84ae25c0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:51.879391 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0609b30c-e8f0-4ecc-bdfd-e67e84ae25c0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:51.881762 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0609b30c-e8f0-4ecc-bdfd-e67e84ae25c0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:51.884600 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0609b30c-e8f0-4ecc-bdfd-e67e84ae25c0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:51.887239 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0609b30c-e8f0-4ecc-bdfd-e67e84ae25c0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:51.890524 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0609b30c-e8f0-4ecc-bdfd-e67e84ae25c0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:53.547306 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0609b30c-e8f0-4ecc-bdfd-e67e84ae25c0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:53.557845 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0609b30c-e8f0-4ecc-bdfd-e67e84ae25c0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:53.559323 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0609b30c-e8f0-4ecc-bdfd-e67e84ae25c0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:53.576630 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0609b30c-e8f0-4ecc-bdfd-e67e84ae25c0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1737 microversion: 2.20 time: 1.720290 Sep 17 21:15:53.584041 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2547/5182] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:51 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1737 bytes in 1727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:54.616932 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-26c972ad-7071-4079-befc-6e96253d47a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:54.619040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-26c972ad-7071-4079-befc-6e96253d47a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:54.654296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26c972ad-7071-4079-befc-6e96253d47a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:54.654815 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26c972ad-7071-4079-befc-6e96253d47a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:54.658491 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26c972ad-7071-4079-befc-6e96253d47a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:54.659268 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26c972ad-7071-4079-befc-6e96253d47a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:54.659743 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26c972ad-7071-4079-befc-6e96253d47a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:54.660181 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-26c972ad-7071-4079-befc-6e96253d47a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:56.477951 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-26c972ad-7071-4079-befc-6e96253d47a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:56.505630 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-26c972ad-7071-4079-befc-6e96253d47a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:56.513517 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-26c972ad-7071-4079-befc-6e96253d47a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:56.520333 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-26c972ad-7071-4079-befc-6e96253d47a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1737 microversion: 2.20 time: 1.908520 Sep 17 21:15:56.526203 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2636/5183] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:54 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1737 bytes in 1915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:57.554059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b6360c85-26af-457b-8cbe-1625efcf531c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:57.554678 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b6360c85-26af-457b-8cbe-1625efcf531c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:57.566530 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6360c85-26af-457b-8cbe-1625efcf531c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:57.567037 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6360c85-26af-457b-8cbe-1625efcf531c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:57.567483 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6360c85-26af-457b-8cbe-1625efcf531c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:57.570811 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6360c85-26af-457b-8cbe-1625efcf531c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:57.571339 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6360c85-26af-457b-8cbe-1625efcf531c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:57.571788 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6360c85-26af-457b-8cbe-1625efcf531c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:58.202323 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b6360c85-26af-457b-8cbe-1625efcf531c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:58.215000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b6360c85-26af-457b-8cbe-1625efcf531c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:58.216932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b6360c85-26af-457b-8cbe-1625efcf531c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:58.218444 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b6360c85-26af-457b-8cbe-1625efcf531c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1737 microversion: 2.20 time: 0.668380 Sep 17 21:15:58.235725 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2548/5184] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:57 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1737 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:15:59.252826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-46da7fe2-74a7-4828-a0ec-70facd943e12 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:15:59.253529 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-46da7fe2-74a7-4828-a0ec-70facd943e12 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:15:59.261993 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46da7fe2-74a7-4828-a0ec-70facd943e12 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:59.262494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46da7fe2-74a7-4828-a0ec-70facd943e12 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:59.262933 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46da7fe2-74a7-4828-a0ec-70facd943e12 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:59.263653 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46da7fe2-74a7-4828-a0ec-70facd943e12 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:15:59.264108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46da7fe2-74a7-4828-a0ec-70facd943e12 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:15:59.264538 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-46da7fe2-74a7-4828-a0ec-70facd943e12 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:15:59.695137 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-46da7fe2-74a7-4828-a0ec-70facd943e12 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:59.706945 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-46da7fe2-74a7-4828-a0ec-70facd943e12 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:59.708702 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-46da7fe2-74a7-4828-a0ec-70facd943e12 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:15:59.710069 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-46da7fe2-74a7-4828-a0ec-70facd943e12 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1719 microversion: 2.20 time: 0.464259 Sep 17 21:15:59.710916 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2637/5185] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:15:59 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1719 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:16:00.742513 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a444d067-c6fb-48a1-97d4-88e1de3d5c25 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:00.745110 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a444d067-c6fb-48a1-97d4-88e1de3d5c25 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:00.752865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a444d067-c6fb-48a1-97d4-88e1de3d5c25 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:00.753370 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a444d067-c6fb-48a1-97d4-88e1de3d5c25 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:00.753845 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a444d067-c6fb-48a1-97d4-88e1de3d5c25 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:00.754574 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a444d067-c6fb-48a1-97d4-88e1de3d5c25 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:00.755041 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a444d067-c6fb-48a1-97d4-88e1de3d5c25 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:00.755470 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a444d067-c6fb-48a1-97d4-88e1de3d5c25 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:02.339736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a444d067-c6fb-48a1-97d4-88e1de3d5c25 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:02.353440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a444d067-c6fb-48a1-97d4-88e1de3d5c25 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:02.356130 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a444d067-c6fb-48a1-97d4-88e1de3d5c25 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:02.357366 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a444d067-c6fb-48a1-97d4-88e1de3d5c25 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1719 microversion: 2.20 time: 1.622991 Sep 17 21:16:02.373486 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2549/5186] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:16:00 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1719 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:16:03.392548 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ce417216-f302-4021-b16a-772d8d4274f7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:03.393652 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ce417216-f302-4021-b16a-772d8d4274f7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:03.405277 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce417216-f302-4021-b16a-772d8d4274f7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:03.405803 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce417216-f302-4021-b16a-772d8d4274f7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:03.406243 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce417216-f302-4021-b16a-772d8d4274f7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:03.410517 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce417216-f302-4021-b16a-772d8d4274f7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:03.411018 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce417216-f302-4021-b16a-772d8d4274f7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:03.411458 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce417216-f302-4021-b16a-772d8d4274f7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:03.719629 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-d539f0c2-692c-4452-a66b-0a0f175fcd15 req-8f666270-8fdf-4d77-9fda-560dff71af19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "796cf34c-7dbb-444e-a74e-68139729405f", "name": "network-vif-unplugged", "status": "completed", "tag": "74223161-c2a1-4706-8b34-7e44c8bdcb2b"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:03.743901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d539f0c2-692c-4452-a66b-0a0f175fcd15 req-8f666270-8fdf-4d77-9fda-560dff71af19 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:03.762416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d539f0c2-692c-4452-a66b-0a0f175fcd15 req-8f666270-8fdf-4d77-9fda-560dff71af19 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:03.763209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d539f0c2-692c-4452-a66b-0a0f175fcd15 req-8f666270-8fdf-4d77-9fda-560dff71af19 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:03.822465 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.compute.server_external_events [req-d539f0c2-692c-4452-a66b-0a0f175fcd15 req-8f666270-8fdf-4d77-9fda-560dff71af19 service nova] Unable to find a host for instance 796cf34c-7dbb-444e-a74e-68139729405f. Dropping event network-vif-unplugged {{(pid=140523) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 17 21:16:03.824468 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-d539f0c2-692c-4452-a66b-0a0f175fcd15 req-8f666270-8fdf-4d77-9fda-560dff71af19 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.109885 Sep 17 21:16:03.829098 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2550/5187] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 115 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 17 21:16:04.351366 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ce417216-f302-4021-b16a-772d8d4274f7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:04.361606 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ce417216-f302-4021-b16a-772d8d4274f7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:04.364913 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ce417216-f302-4021-b16a-772d8d4274f7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:04.366521 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ce417216-f302-4021-b16a-772d8d4274f7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1662 microversion: 2.20 time: 0.978668 Sep 17 21:16:04.367997 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2638/5188] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:16:03 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1662 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:16:04.393764 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ccdbd60d-24df-47ee-851b-5d6b723f407f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2bc9cfa-f40b-411e-8a44-20b3f6134615"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:04.396638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ccdbd60d-24df-47ee-851b-5d6b723f407f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:04.403726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ccdbd60d-24df-47ee-851b-5d6b723f407f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:04.404455 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ccdbd60d-24df-47ee-851b-5d6b723f407f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:04.405100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ccdbd60d-24df-47ee-851b-5d6b723f407f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:04.406074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ccdbd60d-24df-47ee-851b-5d6b723f407f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:04.406788 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ccdbd60d-24df-47ee-851b-5d6b723f407f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:04.407451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ccdbd60d-24df-47ee-851b-5d6b723f407f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:04.972664 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ccdbd60d-24df-47ee-851b-5d6b723f407f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "POST /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.582198 Sep 17 21:16:04.983317 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2551/5189] 10.222.0.26 () {62 vars in 1364 bytes} [Sat Sep 17 21:16:04 2022] POST /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f/os-volume_attachments => generated 188 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:16:05.193282 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0726694d-04a0-4a2c-a98c-4244b2c672a7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:05.194621 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0726694d-04a0-4a2c-a98c-4244b2c672a7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:05.205767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0726694d-04a0-4a2c-a98c-4244b2c672a7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:05.206953 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0726694d-04a0-4a2c-a98c-4244b2c672a7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:05.207842 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0726694d-04a0-4a2c-a98c-4244b2c672a7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:05.209840 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0726694d-04a0-4a2c-a98c-4244b2c672a7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:05.210935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0726694d-04a0-4a2c-a98c-4244b2c672a7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:05.211791 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0726694d-04a0-4a2c-a98c-4244b2c672a7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:05.507159 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0726694d-04a0-4a2c-a98c-4244b2c672a7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=140524) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 17 21:16:05.675238 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0726694d-04a0-4a2c-a98c-4244b2c672a7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "POST /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f/action" status: 202 len: 0 microversion: 2.20 time: 0.503580 Sep 17 21:16:05.676475 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2639/5190] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Sep 17 21:16:05 2022] POST /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:16:05.690828 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-255c0a72-1740-44c2-9f9a-3a95d22e9fe3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:05.693097 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-255c0a72-1740-44c2-9f9a-3a95d22e9fe3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:05.710590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-255c0a72-1740-44c2-9f9a-3a95d22e9fe3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:05.711929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-255c0a72-1740-44c2-9f9a-3a95d22e9fe3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:05.712539 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-255c0a72-1740-44c2-9f9a-3a95d22e9fe3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:05.713508 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-255c0a72-1740-44c2-9f9a-3a95d22e9fe3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:05.714485 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-255c0a72-1740-44c2-9f9a-3a95d22e9fe3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:05.715066 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-255c0a72-1740-44c2-9f9a-3a95d22e9fe3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:05.737862 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:16:06.096339 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-255c0a72-1740-44c2-9f9a-3a95d22e9fe3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:06.107829 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-255c0a72-1740-44c2-9f9a-3a95d22e9fe3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:06.109659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-255c0a72-1740-44c2-9f9a-3a95d22e9fe3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:06.111219 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-255c0a72-1740-44c2-9f9a-3a95d22e9fe3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1748 microversion: 2.20 time: 0.429783 Sep 17 21:16:06.127606 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2552/5191] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:16:05 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1748 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:16:06.836008 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e3c38713-1064-457f-9f76-c2cab8ebe4ff tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Action: 'create', calling method: .version_select at 0x7f25a53b8430>, body: {"keypair": {"name": "tempest-keypair-1856299699", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaUdApAnXrqIsROj0nihCC4MlUjMTcHSHQmZR29rWtoL/i44/Dce43jph5yHs/6Fb2lh/9a3tHsgTjLiSU5cnqnKz9EiDKL3/FA1qs5q8abudnGCEfKqdfynJSDNwPJHA=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:06.891714 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-e3c38713-1064-457f-9f76-c2cab8ebe4ff tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Getting quotas for project 8d3fab3adf0c425680c91af8afcc516f. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:16:06.899069 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-e3c38713-1064-457f-9f76-c2cab8ebe4ff tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Getting quotas for user 7ff5b886208a44c0891c2d1ba65dc083 and project 8d3fab3adf0c425680c91af8afcc516f. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:16:06.955912 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e3c38713-1064-457f-9f76-c2cab8ebe4ff tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.254205 Sep 17 21:16:06.957394 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2640/5192] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:16:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:16:07.142773 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0567e1c1-ad7b-438e-839e-036023490f7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:07.143251 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0567e1c1-ad7b-438e-839e-036023490f7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:07.157690 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0567e1c1-ad7b-438e-839e-036023490f7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:07.159377 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0567e1c1-ad7b-438e-839e-036023490f7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:07.160488 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0567e1c1-ad7b-438e-839e-036023490f7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:07.161975 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0567e1c1-ad7b-438e-839e-036023490f7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:07.163463 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0567e1c1-ad7b-438e-839e-036023490f7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:07.165839 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0567e1c1-ad7b-438e-839e-036023490f7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:07.788922 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0567e1c1-ad7b-438e-839e-036023490f7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:07.801108 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0567e1c1-ad7b-438e-839e-036023490f7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:07.806349 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0567e1c1-ad7b-438e-839e-036023490f7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:07.810916 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0567e1c1-ad7b-438e-839e-036023490f7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1748 microversion: 2.20 time: 0.673214 Sep 17 21:16:07.813067 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2553/5193] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:16:07 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1748 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:16:08.841215 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5305cf32-d4f5-43bb-991c-c971becb3e13 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:08.842474 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5305cf32-d4f5-43bb-991c-c971becb3e13 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:08.859229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5305cf32-d4f5-43bb-991c-c971becb3e13 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:08.863287 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5305cf32-d4f5-43bb-991c-c971becb3e13 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:08.864025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5305cf32-d4f5-43bb-991c-c971becb3e13 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:08.865563 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5305cf32-d4f5-43bb-991c-c971becb3e13 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:08.866497 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5305cf32-d4f5-43bb-991c-c971becb3e13 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:08.867731 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5305cf32-d4f5-43bb-991c-c971becb3e13 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:09.873961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5305cf32-d4f5-43bb-991c-c971becb3e13 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:09.877085 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:16:09.891512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5305cf32-d4f5-43bb-991c-c971becb3e13 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:09.893536 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5305cf32-d4f5-43bb-991c-c971becb3e13 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:09.899123 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5305cf32-d4f5-43bb-991c-c971becb3e13 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1750 microversion: 2.20 time: 1.061873 Sep 17 21:16:09.903449 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2641/5194] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:16:08 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1750 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:16:10.939640 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-773d2818-5d48-4aa1-b660-90d914546b73 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:10.941123 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-773d2818-5d48-4aa1-b660-90d914546b73 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:10.959429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-773d2818-5d48-4aa1-b660-90d914546b73 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:10.959811 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-773d2818-5d48-4aa1-b660-90d914546b73 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:10.960261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-773d2818-5d48-4aa1-b660-90d914546b73 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:10.960994 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-773d2818-5d48-4aa1-b660-90d914546b73 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:10.961546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-773d2818-5d48-4aa1-b660-90d914546b73 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:10.961987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-773d2818-5d48-4aa1-b660-90d914546b73 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:11.609437 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-773d2818-5d48-4aa1-b660-90d914546b73 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:11.625339 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-773d2818-5d48-4aa1-b660-90d914546b73 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:11.626862 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-773d2818-5d48-4aa1-b660-90d914546b73 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:11.628094 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-773d2818-5d48-4aa1-b660-90d914546b73 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1750 microversion: 2.20 time: 0.700862 Sep 17 21:16:11.628680 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2554/5195] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:16:10 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1750 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:16:12.668591 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b07f75a2-71ed-47c6-a1ec-1a18eda9ae7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:12.673061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b07f75a2-71ed-47c6-a1ec-1a18eda9ae7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:12.706002 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b07f75a2-71ed-47c6-a1ec-1a18eda9ae7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:12.707010 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b07f75a2-71ed-47c6-a1ec-1a18eda9ae7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:12.708663 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b07f75a2-71ed-47c6-a1ec-1a18eda9ae7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:12.710279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b07f75a2-71ed-47c6-a1ec-1a18eda9ae7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:12.711925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b07f75a2-71ed-47c6-a1ec-1a18eda9ae7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:12.712893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b07f75a2-71ed-47c6-a1ec-1a18eda9ae7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:13.248930 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b07f75a2-71ed-47c6-a1ec-1a18eda9ae7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:13.259287 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b07f75a2-71ed-47c6-a1ec-1a18eda9ae7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:13.271580 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b07f75a2-71ed-47c6-a1ec-1a18eda9ae7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:13.273240 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b07f75a2-71ed-47c6-a1ec-1a18eda9ae7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1806 microversion: 2.20 time: 0.623106 Sep 17 21:16:13.274261 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2642/5196] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:16:12 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1806 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:16:13.434884 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0c386c9c-f881-45dd-947d-044bd9c92360 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1048419553", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "edb1c384-fe19-4c45-ae46-f262434e13af"}], "security_groups": [{"name": "tempest-securitygroup--634111623"}], "key_name": "tempest-keypair-1856299699", "user_data": "}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:13.833321 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-0c386c9c-f881-45dd-947d-044bd9c92360 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] validate_networks() for [('edb1c384-fe19-4c45-ae46-f262434e13af', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:16:14.306367 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9577b5b5-89c0-4e25-9f9a-8525867b4162 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:14.306993 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9577b5b5-89c0-4e25-9f9a-8525867b4162 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:14.318891 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:16:14.320456 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9577b5b5-89c0-4e25-9f9a-8525867b4162 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:14.321190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9577b5b5-89c0-4e25-9f9a-8525867b4162 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:14.323441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9577b5b5-89c0-4e25-9f9a-8525867b4162 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:14.324360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9577b5b5-89c0-4e25-9f9a-8525867b4162 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:14.326227 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9577b5b5-89c0-4e25-9f9a-8525867b4162 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:14.329382 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9577b5b5-89c0-4e25-9f9a-8525867b4162 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:15.284566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9577b5b5-89c0-4e25-9f9a-8525867b4162 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:15.297632 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9577b5b5-89c0-4e25-9f9a-8525867b4162 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:15.301849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9577b5b5-89c0-4e25-9f9a-8525867b4162 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:15.304609 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9577b5b5-89c0-4e25-9f9a-8525867b4162 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1806 microversion: 2.20 time: 1.003203 Sep 17 21:16:15.305239 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2643/5197] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:16:14 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1806 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:16:16.228907 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-0c386c9c-f881-45dd-947d-044bd9c92360 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:16:16.230013 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-0c386c9c-f881-45dd-947d-044bd9c92360 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:16:16.230663 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-0c386c9c-f881-45dd-947d-044bd9c92360 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:16:16.231231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-0c386c9c-f881-45dd-947d-044bd9c92360 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:16:16.231796 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-0c386c9c-f881-45dd-947d-044bd9c92360 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:16:16.234266 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:16:16.257298 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c386c9c-f881-45dd-947d-044bd9c92360 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:16.257823 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c386c9c-f881-45dd-947d-044bd9c92360 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:16.258468 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c386c9c-f881-45dd-947d-044bd9c92360 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:16.259484 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c386c9c-f881-45dd-947d-044bd9c92360 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:16.260117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c386c9c-f881-45dd-947d-044bd9c92360 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:16.260697 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c386c9c-f881-45dd-947d-044bd9c92360 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:16.307936 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-0c386c9c-f881-45dd-947d-044bd9c92360 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Getting quotas for project 8d3fab3adf0c425680c91af8afcc516f. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:16:16.324564 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-0c386c9c-f881-45dd-947d-044bd9c92360 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Getting quotas for user 7ff5b886208a44c0891c2d1ba65dc083 and project 8d3fab3adf0c425680c91af8afcc516f. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:16:16.333574 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3ad539f0-81fa-4516-a3a0-a140f2ace901 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:16.334960 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3ad539f0-81fa-4516-a3a0-a140f2ace901 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:16.343287 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ad539f0-81fa-4516-a3a0-a140f2ace901 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:16.343952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ad539f0-81fa-4516-a3a0-a140f2ace901 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:16.345164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ad539f0-81fa-4516-a3a0-a140f2ace901 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:16.346100 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ad539f0-81fa-4516-a3a0-a140f2ace901 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:16.346901 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ad539f0-81fa-4516-a3a0-a140f2ace901 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:16.347486 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ad539f0-81fa-4516-a3a0-a140f2ace901 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:16.390224 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0c386c9c-f881-45dd-947d-044bd9c92360 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:16:16.396516 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0c386c9c-f881-45dd-947d-044bd9c92360 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:16:16.504467 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0c386c9c-f881-45dd-947d-044bd9c92360 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.074844 Sep 17 21:16:16.513342 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2555/5198] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:16:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 3085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:16:16.521403 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d9e649ec-40a2-4d6f-94d7-190c6126f01f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:16.522473 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d9e649ec-40a2-4d6f-94d7-190c6126f01f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:16.917744 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=4 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:16:16.987344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d9e649ec-40a2-4d6f-94d7-190c6126f01f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:17.009847 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d9e649ec-40a2-4d6f-94d7-190c6126f01f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1238 microversion: 2.1 time: 0.491478 Sep 17 21:16:17.017875 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2556/5199] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:16 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1238 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:17.441114 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3ad539f0-81fa-4516-a3a0-a140f2ace901 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:17.461090 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3ad539f0-81fa-4516-a3a0-a140f2ace901 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:17.467059 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3ad539f0-81fa-4516-a3a0-a140f2ace901 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:17.468425 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3ad539f0-81fa-4516-a3a0-a140f2ace901 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1806 microversion: 2.20 time: 1.138891 Sep 17 21:16:17.477584 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2644/5200] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:16:16 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1806 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:16:17.988156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-373a087a-04b3-40cb-903e-432bb6e6a4ef req-5eec8384-3fda-494b-8672-335bda85af78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "796cf34c-7dbb-444e-a74e-68139729405f", "tag": "74223161-c2a1-4706-8b34-7e44c8bdcb2b"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:18.006366 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-373a087a-04b3-40cb-903e-432bb6e6a4ef req-5eec8384-3fda-494b-8672-335bda85af78 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:18.007582 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-373a087a-04b3-40cb-903e-432bb6e6a4ef req-5eec8384-3fda-494b-8672-335bda85af78 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:18.008639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-373a087a-04b3-40cb-903e-432bb6e6a4ef req-5eec8384-3fda-494b-8672-335bda85af78 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:18.024839 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-373a087a-04b3-40cb-903e-432bb6e6a4ef req-5eec8384-3fda-494b-8672-335bda85af78 service nova] Creating event network-changed:74223161-c2a1-4706-8b34-7e44c8bdcb2b for instance 796cf34c-7dbb-444e-a74e-68139729405f on nch1-master-1 Sep 17 21:16:18.032771 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7415180c-4c9b-4cb4-988a-5382439efe09 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:18.032984 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-373a087a-04b3-40cb-903e-432bb6e6a4ef req-5eec8384-3fda-494b-8672-335bda85af78 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048227 Sep 17 21:16:18.033640 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7415180c-4c9b-4cb4-988a-5382439efe09 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:18.033955 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2557/5201] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:16:18.043957 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7415180c-4c9b-4cb4-988a-5382439efe09 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:18.044598 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7415180c-4c9b-4cb4-988a-5382439efe09 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:18.045151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7415180c-4c9b-4cb4-988a-5382439efe09 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:18.050775 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7415180c-4c9b-4cb4-988a-5382439efe09 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:18.051463 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7415180c-4c9b-4cb4-988a-5382439efe09 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:18.099835 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7415180c-4c9b-4cb4-988a-5382439efe09 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.045s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:18.430346 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7415180c-4c9b-4cb4-988a-5382439efe09 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:18.459905 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7415180c-4c9b-4cb4-988a-5382439efe09 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1290 microversion: 2.1 time: 0.431349 Sep 17 21:16:18.466344 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2645/5202] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:18 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1290 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:18.507098 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2645ff6a-b765-494c-aced-e5d2c0be2041 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:18.507995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2645ff6a-b765-494c-aced-e5d2c0be2041 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:18.522004 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2645ff6a-b765-494c-aced-e5d2c0be2041 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:18.522857 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2645ff6a-b765-494c-aced-e5d2c0be2041 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:18.523493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2645ff6a-b765-494c-aced-e5d2c0be2041 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:18.524445 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2645ff6a-b765-494c-aced-e5d2c0be2041 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:18.525704 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2645ff6a-b765-494c-aced-e5d2c0be2041 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:18.528546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2645ff6a-b765-494c-aced-e5d2c0be2041 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:19.039951 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2645ff6a-b765-494c-aced-e5d2c0be2041 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:19.060722 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2645ff6a-b765-494c-aced-e5d2c0be2041 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:19.062223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2645ff6a-b765-494c-aced-e5d2c0be2041 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:19.063437 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2645ff6a-b765-494c-aced-e5d2c0be2041 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1806 microversion: 2.20 time: 0.560899 Sep 17 21:16:19.079480 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2558/5203] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:16:18 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1806 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:16:19.489247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2668193d-6d2e-4bec-8d62-74361354a704 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:19.489920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2668193d-6d2e-4bec-8d62-74361354a704 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:19.512361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2668193d-6d2e-4bec-8d62-74361354a704 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:19.513152 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2668193d-6d2e-4bec-8d62-74361354a704 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:19.519379 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2668193d-6d2e-4bec-8d62-74361354a704 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:19.520291 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2668193d-6d2e-4bec-8d62-74361354a704 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:19.528712 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2668193d-6d2e-4bec-8d62-74361354a704 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:19.529239 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2668193d-6d2e-4bec-8d62-74361354a704 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:19.756145 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2668193d-6d2e-4bec-8d62-74361354a704 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:19.767513 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2668193d-6d2e-4bec-8d62-74361354a704 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1296 microversion: 2.1 time: 0.282932 Sep 17 21:16:19.788376 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2646/5204] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:19 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1296 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:20.096682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-911509a2-be7e-4a5d-acc3-a27b010fce74 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:20.097592 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-911509a2-be7e-4a5d-acc3-a27b010fce74 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:20.115474 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-911509a2-be7e-4a5d-acc3-a27b010fce74 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:20.116069 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-911509a2-be7e-4a5d-acc3-a27b010fce74 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:20.116535 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-911509a2-be7e-4a5d-acc3-a27b010fce74 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:20.117326 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-911509a2-be7e-4a5d-acc3-a27b010fce74 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:20.122059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-911509a2-be7e-4a5d-acc3-a27b010fce74 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:20.122547 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-911509a2-be7e-4a5d-acc3-a27b010fce74 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:20.813055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-323058d2-df8d-40fb-8143-ee602a254e73 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:20.814379 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-323058d2-df8d-40fb-8143-ee602a254e73 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:20.834990 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-323058d2-df8d-40fb-8143-ee602a254e73 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:20.837478 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-323058d2-df8d-40fb-8143-ee602a254e73 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:20.841452 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-323058d2-df8d-40fb-8143-ee602a254e73 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:20.842506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-323058d2-df8d-40fb-8143-ee602a254e73 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:20.846192 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-323058d2-df8d-40fb-8143-ee602a254e73 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:20.846985 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-323058d2-df8d-40fb-8143-ee602a254e73 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:21.359488 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-911509a2-be7e-4a5d-acc3-a27b010fce74 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:21.376535 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-911509a2-be7e-4a5d-acc3-a27b010fce74 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:21.378286 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-911509a2-be7e-4a5d-acc3-a27b010fce74 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:21.380037 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-911509a2-be7e-4a5d-acc3-a27b010fce74 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1806 microversion: 2.20 time: 1.287602 Sep 17 21:16:21.381174 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2559/5205] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:16:20 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1806 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:16:21.444292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-323058d2-df8d-40fb-8143-ee602a254e73 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:21.478112 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-323058d2-df8d-40fb-8143-ee602a254e73 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1296 microversion: 2.1 time: 0.669614 Sep 17 21:16:21.479717 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2647/5206] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:20 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1296 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:22.411489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fb60ae1b-3c4e-4f28-98af-ea18361fa752 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:22.413110 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fb60ae1b-3c4e-4f28-98af-ea18361fa752 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:22.435875 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb60ae1b-3c4e-4f28-98af-ea18361fa752 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:22.436684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb60ae1b-3c4e-4f28-98af-ea18361fa752 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:22.439547 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb60ae1b-3c4e-4f28-98af-ea18361fa752 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:22.443786 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb60ae1b-3c4e-4f28-98af-ea18361fa752 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:22.444994 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb60ae1b-3c4e-4f28-98af-ea18361fa752 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:22.446021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb60ae1b-3c4e-4f28-98af-ea18361fa752 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:22.508537 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-18eaa498-7556-467c-bf8f-f4f098e1adea tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:22.509179 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-18eaa498-7556-467c-bf8f-f4f098e1adea tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:22.531643 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18eaa498-7556-467c-bf8f-f4f098e1adea tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:22.536678 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18eaa498-7556-467c-bf8f-f4f098e1adea tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:22.537296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18eaa498-7556-467c-bf8f-f4f098e1adea tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:22.538344 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18eaa498-7556-467c-bf8f-f4f098e1adea tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:22.539606 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18eaa498-7556-467c-bf8f-f4f098e1adea tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:22.540176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18eaa498-7556-467c-bf8f-f4f098e1adea tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:23.658799 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-18eaa498-7556-467c-bf8f-f4f098e1adea tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:23.683980 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-18eaa498-7556-467c-bf8f-f4f098e1adea tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1363 microversion: 2.1 time: 1.177704 Sep 17 21:16:23.697632 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2648/5207] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:22 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1363 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:24.024617 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fbcbd020-eb19-4e8c-a299-bc510d6500ad tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1915116177", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "9209c79a-2d6a-4e93-beed-220de6aa97fa"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:24.156355 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-fbcbd020-eb19-4e8c-a299-bc510d6500ad tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] validate_networks() for [('9209c79a-2d6a-4e93-beed-220de6aa97fa', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:16:25.004990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fb60ae1b-3c4e-4f28-98af-ea18361fa752 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:25.040311 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fb60ae1b-3c4e-4f28-98af-ea18361fa752 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:25.058736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fb60ae1b-3c4e-4f28-98af-ea18361fa752 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:25.063871 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fb60ae1b-3c4e-4f28-98af-ea18361fa752 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1806 microversion: 2.20 time: 2.657036 Sep 17 21:16:25.067714 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2560/5208] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:16:22 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1806 bytes in 2662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:16:25.090766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a55f69dc-d8b6-4006-97a4-a04f6d5d521c tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:25.091400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a55f69dc-d8b6-4006-97a4-a04f6d5d521c tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:25.123543 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a55f69dc-d8b6-4006-97a4-a04f6d5d521c tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:25.125872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a55f69dc-d8b6-4006-97a4-a04f6d5d521c tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:25.128690 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a55f69dc-d8b6-4006-97a4-a04f6d5d521c tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:25.132216 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a55f69dc-d8b6-4006-97a4-a04f6d5d521c tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:25.134850 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a55f69dc-d8b6-4006-97a4-a04f6d5d521c tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:25.138524 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a55f69dc-d8b6-4006-97a4-a04f6d5d521c tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:26.277749 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:16:26.749484 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a55f69dc-d8b6-4006-97a4-a04f6d5d521c tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:26.769106 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a55f69dc-d8b6-4006-97a4-a04f6d5d521c tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1363 microversion: 2.1 time: 1.694678 Sep 17 21:16:26.793417 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2561/5209] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:25 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1363 bytes in 1725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:26.949626 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-b4931a45-1f6a-4f41-aed7-9f19acd1a740 req-16f77295-f7c9-4aa1-b7d0-1c1e90731f45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fa19be0-63c9-4071-979b-b23744235f16", "tag": "42ddec5f-4dce-48d9-a03c-50a2244f6f0b"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:26.969831 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b4931a45-1f6a-4f41-aed7-9f19acd1a740 req-16f77295-f7c9-4aa1-b7d0-1c1e90731f45 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:26.970461 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b4931a45-1f6a-4f41-aed7-9f19acd1a740 req-16f77295-f7c9-4aa1-b7d0-1c1e90731f45 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:26.971037 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b4931a45-1f6a-4f41-aed7-9f19acd1a740 req-16f77295-f7c9-4aa1-b7d0-1c1e90731f45 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:27.006503 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=8 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:16:27.021083 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-b4931a45-1f6a-4f41-aed7-9f19acd1a740 req-16f77295-f7c9-4aa1-b7d0-1c1e90731f45 service nova] Creating event network-changed:42ddec5f-4dce-48d9-a03c-50a2244f6f0b for instance 3fa19be0-63c9-4071-979b-b23744235f16 on nch2-master-1 Sep 17 21:16:27.027822 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-b4931a45-1f6a-4f41-aed7-9f19acd1a740 req-16f77295-f7c9-4aa1-b7d0-1c1e90731f45 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.232254 Sep 17 21:16:27.030149 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2562/5210] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:16:27.035634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-55938fc2-cca3-4eda-9d91-9c5d36341e45 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:27.036570 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-55938fc2-cca3-4eda-9d91-9c5d36341e45 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:27.046260 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55938fc2-cca3-4eda-9d91-9c5d36341e45 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:27.049878 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55938fc2-cca3-4eda-9d91-9c5d36341e45 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:27.050741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55938fc2-cca3-4eda-9d91-9c5d36341e45 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:27.054159 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55938fc2-cca3-4eda-9d91-9c5d36341e45 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:27.054939 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55938fc2-cca3-4eda-9d91-9c5d36341e45 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:27.055578 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55938fc2-cca3-4eda-9d91-9c5d36341e45 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:27.490964 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-fbcbd020-eb19-4e8c-a299-bc510d6500ad tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:16:27.492962 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-fbcbd020-eb19-4e8c-a299-bc510d6500ad tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:16:27.493652 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-fbcbd020-eb19-4e8c-a299-bc510d6500ad tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:16:27.497360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-fbcbd020-eb19-4e8c-a299-bc510d6500ad tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:16:27.498168 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-fbcbd020-eb19-4e8c-a299-bc510d6500ad tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:16:27.537141 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbcbd020-eb19-4e8c-a299-bc510d6500ad tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:27.537681 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbcbd020-eb19-4e8c-a299-bc510d6500ad tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:27.538127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbcbd020-eb19-4e8c-a299-bc510d6500ad tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:27.538864 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbcbd020-eb19-4e8c-a299-bc510d6500ad tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:27.539374 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbcbd020-eb19-4e8c-a299-bc510d6500ad tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:27.539801 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fbcbd020-eb19-4e8c-a299-bc510d6500ad tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:27.638905 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-fbcbd020-eb19-4e8c-a299-bc510d6500ad tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Getting quotas for project f082a1525e7a400b9248faddccccad57. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:16:27.668985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-55938fc2-cca3-4eda-9d91-9c5d36341e45 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:27.688046 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-fbcbd020-eb19-4e8c-a299-bc510d6500ad tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Getting quotas for user a19f3d81b25a452997230984e774d3a8 and project f082a1525e7a400b9248faddccccad57. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:16:27.732291 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-55938fc2-cca3-4eda-9d91-9c5d36341e45 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:27.753096 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-55938fc2-cca3-4eda-9d91-9c5d36341e45 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:27.756251 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-55938fc2-cca3-4eda-9d91-9c5d36341e45 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1806 microversion: 2.20 time: 0.723595 Sep 17 21:16:27.757512 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2563/5211] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:16:27 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1806 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:16:27.783531 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fbcbd020-eb19-4e8c-a299-bc510d6500ad tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Going to run 3 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:16:27.786305 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fbcbd020-eb19-4e8c-a299-bc510d6500ad tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:16:27.796342 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a949225b-1d68-4c9a-9cd4-6b1825b25662 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:27.797217 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a949225b-1d68-4c9a-9cd4-6b1825b25662 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:27.813075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a949225b-1d68-4c9a-9cd4-6b1825b25662 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:27.826512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a949225b-1d68-4c9a-9cd4-6b1825b25662 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:27.827213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a949225b-1d68-4c9a-9cd4-6b1825b25662 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:27.830401 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a949225b-1d68-4c9a-9cd4-6b1825b25662 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:27.831145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a949225b-1d68-4c9a-9cd4-6b1825b25662 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:27.832966 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a949225b-1d68-4c9a-9cd4-6b1825b25662 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:27.941061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fbcbd020-eb19-4e8c-a299-bc510d6500ad tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: 4e0db75a-49c1-4693-ad54-79a1c20aac86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:16:28.022817 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fbcbd020-eb19-4e8c-a299-bc510d6500ad tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: de3c1689-cd5c-4d17-820d-5ae1624d7fcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=4e0db75a-49c1-4693-ad54-79a1c20aac86,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:16:28.200240 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fbcbd020-eb19-4e8c-a299-bc510d6500ad tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.501156 Sep 17 21:16:28.201519 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2649/5212] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:16:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 4503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:16:28.212592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-dc08f1a1-bde0-4969-abf5-148625265379 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:28.225547 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-dc08f1a1-bde0-4969-abf5-148625265379 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:28.230385 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-dc08f1a1-bde0-4969-abf5-148625265379 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Searching by: {'deleted': False, 'project_id': 'f082a1525e7a400b9248faddccccad57'} {{(pid=140524) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:16:28.300853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a949225b-1d68-4c9a-9cd4-6b1825b25662 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:28.317631 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a949225b-1d68-4c9a-9cd4-6b1825b25662 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1363 microversion: 2.1 time: 0.519763 Sep 17 21:16:28.318535 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2564/5213] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:27 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1363 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:16:28.333026 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dc08f1a1-bde0-4969-abf5-148625265379 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:28.333600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dc08f1a1-bde0-4969-abf5-148625265379 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:28.334039 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dc08f1a1-bde0-4969-abf5-148625265379 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:28.334841 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dc08f1a1-bde0-4969-abf5-148625265379 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:28.335294 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dc08f1a1-bde0-4969-abf5-148625265379 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:28.335722 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dc08f1a1-bde0-4969-abf5-148625265379 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:28.409236 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-dc08f1a1-bde0-4969-abf5-148625265379 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.200570 Sep 17 21:16:28.410251 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2650/5214] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Sep 17 21:16:28 2022] GET /compute/v2.1/servers => generated 1018 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:16:28.422731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1e91463c-68e7-408a-a0a4-491c6b5319ab tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:28.423596 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1e91463c-68e7-408a-a0a4-491c6b5319ab tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: de3c1689-cd5c-4d17-820d-5ae1624d7fcc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:28.598542 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1e91463c-68e7-408a-a0a4-491c6b5319ab tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:28.616146 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1e91463c-68e7-408a-a0a4-491c6b5319ab tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc" status: 200 len: 1223 microversion: 2.1 time: 0.194593 Sep 17 21:16:28.620306 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2565/5215] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:28 2022] GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc => generated 1223 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:28.790885 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3d82ddce-8b56-4040-a5d1-b765ac386a9b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:28.792581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3d82ddce-8b56-4040-a5d1-b765ac386a9b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:28.823397 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d82ddce-8b56-4040-a5d1-b765ac386a9b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:28.824292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d82ddce-8b56-4040-a5d1-b765ac386a9b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:28.824890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d82ddce-8b56-4040-a5d1-b765ac386a9b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:28.825785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d82ddce-8b56-4040-a5d1-b765ac386a9b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:28.826383 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d82ddce-8b56-4040-a5d1-b765ac386a9b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:28.826950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d82ddce-8b56-4040-a5d1-b765ac386a9b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:29.351107 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c32633d7-e098-43fa-8999-6ef616f41e9d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:29.353690 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c32633d7-e098-43fa-8999-6ef616f41e9d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:29.382474 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c32633d7-e098-43fa-8999-6ef616f41e9d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:29.389537 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c32633d7-e098-43fa-8999-6ef616f41e9d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:29.390270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c32633d7-e098-43fa-8999-6ef616f41e9d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:29.391050 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c32633d7-e098-43fa-8999-6ef616f41e9d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:29.391541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c32633d7-e098-43fa-8999-6ef616f41e9d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:29.391936 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c32633d7-e098-43fa-8999-6ef616f41e9d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:29.748353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3d82ddce-8b56-4040-a5d1-b765ac386a9b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:29.770040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3d82ddce-8b56-4040-a5d1-b765ac386a9b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:29.771813 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3d82ddce-8b56-4040-a5d1-b765ac386a9b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:29.778527 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3d82ddce-8b56-4040-a5d1-b765ac386a9b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1806 microversion: 2.20 time: 0.994101 Sep 17 21:16:29.780196 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2651/5216] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:16:28 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1806 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:16:29.804044 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-399f095a-0405-4286-9bbe-1d95962d3ee3 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:29.806886 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-399f095a-0405-4286-9bbe-1d95962d3ee3 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: de3c1689-cd5c-4d17-820d-5ae1624d7fcc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:30.085346 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-399f095a-0405-4286-9bbe-1d95962d3ee3 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:30.093186 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-399f095a-0405-4286-9bbe-1d95962d3ee3 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc" status: 200 len: 1223 microversion: 2.1 time: 0.311656 Sep 17 21:16:30.107668 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2652/5217] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:29 2022] GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc => generated 1223 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:30.152253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c32633d7-e098-43fa-8999-6ef616f41e9d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:30.163298 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c32633d7-e098-43fa-8999-6ef616f41e9d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1363 microversion: 2.1 time: 0.825952 Sep 17 21:16:30.163298 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2566/5218] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:29 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1363 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:16:30.811780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e50f4eb5-789b-4143-a923-fb46ee24560f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:30.812436 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e50f4eb5-789b-4143-a923-fb46ee24560f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:30.837994 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e50f4eb5-789b-4143-a923-fb46ee24560f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:30.844198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e50f4eb5-789b-4143-a923-fb46ee24560f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:30.845764 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e50f4eb5-789b-4143-a923-fb46ee24560f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:30.855102 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e50f4eb5-789b-4143-a923-fb46ee24560f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:30.855617 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e50f4eb5-789b-4143-a923-fb46ee24560f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:30.856062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e50f4eb5-789b-4143-a923-fb46ee24560f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:31.138830 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e957b617-636d-47f0-81ff-d0ad7b2ca652 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:31.140225 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e957b617-636d-47f0-81ff-d0ad7b2ca652 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: de3c1689-cd5c-4d17-820d-5ae1624d7fcc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:31.178954 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e957b617-636d-47f0-81ff-d0ad7b2ca652 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:31.178954 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e957b617-636d-47f0-81ff-d0ad7b2ca652 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:31.179327 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e957b617-636d-47f0-81ff-d0ad7b2ca652 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:31.186852 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e957b617-636d-47f0-81ff-d0ad7b2ca652 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:31.189237 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e957b617-636d-47f0-81ff-d0ad7b2ca652 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:31.190475 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e957b617-636d-47f0-81ff-d0ad7b2ca652 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:31.545781 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e957b617-636d-47f0-81ff-d0ad7b2ca652 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:31.586315 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e957b617-636d-47f0-81ff-d0ad7b2ca652 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc" status: 200 len: 1219 microversion: 2.1 time: 0.455406 Sep 17 21:16:31.592167 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2567/5219] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:31 2022] GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc => generated 1219 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:16:31.628023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-36545f32-cf9f-481d-9188-7ae5de8d076b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:31.629280 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-36545f32-cf9f-481d-9188-7ae5de8d076b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:31.667128 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36545f32-cf9f-481d-9188-7ae5de8d076b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:31.670139 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36545f32-cf9f-481d-9188-7ae5de8d076b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:31.681965 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36545f32-cf9f-481d-9188-7ae5de8d076b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:31.684541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36545f32-cf9f-481d-9188-7ae5de8d076b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:31.686742 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36545f32-cf9f-481d-9188-7ae5de8d076b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:31.690190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36545f32-cf9f-481d-9188-7ae5de8d076b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:32.721795 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e50f4eb5-789b-4143-a923-fb46ee24560f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:32.736882 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e50f4eb5-789b-4143-a923-fb46ee24560f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:32.740535 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e50f4eb5-789b-4143-a923-fb46ee24560f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:32.743452 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e50f4eb5-789b-4143-a923-fb46ee24560f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1806 microversion: 2.20 time: 1.935415 Sep 17 21:16:32.763339 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2653/5220] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:16:30 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1806 bytes in 1956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:16:32.781419 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f631dd3d-3733-466a-9d0f-f45cca67ef80 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:32.785307 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f631dd3d-3733-466a-9d0f-f45cca67ef80 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: de3c1689-cd5c-4d17-820d-5ae1624d7fcc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:32.807666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f631dd3d-3733-466a-9d0f-f45cca67ef80 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:32.809420 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f631dd3d-3733-466a-9d0f-f45cca67ef80 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:32.810144 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f631dd3d-3733-466a-9d0f-f45cca67ef80 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:32.811106 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f631dd3d-3733-466a-9d0f-f45cca67ef80 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:32.814210 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f631dd3d-3733-466a-9d0f-f45cca67ef80 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:32.815570 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f631dd3d-3733-466a-9d0f-f45cca67ef80 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:33.114390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f631dd3d-3733-466a-9d0f-f45cca67ef80 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:33.129170 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f631dd3d-3733-466a-9d0f-f45cca67ef80 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc" status: 200 len: 1275 microversion: 2.1 time: 0.363742 Sep 17 21:16:33.133356 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2654/5221] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:32 2022] GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc => generated 1275 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:33.278671 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-36545f32-cf9f-481d-9188-7ae5de8d076b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:33.296322 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-36545f32-cf9f-481d-9188-7ae5de8d076b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1363 microversion: 2.1 time: 1.700509 Sep 17 21:16:33.297203 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2568/5222] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:31 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1363 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:33.777980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-252a203a-02ce-411b-9566-41d3b795605a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:33.780151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-252a203a-02ce-411b-9566-41d3b795605a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:33.794064 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-252a203a-02ce-411b-9566-41d3b795605a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:33.798377 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-252a203a-02ce-411b-9566-41d3b795605a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:33.800362 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-252a203a-02ce-411b-9566-41d3b795605a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:33.802802 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-252a203a-02ce-411b-9566-41d3b795605a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:33.805315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-252a203a-02ce-411b-9566-41d3b795605a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:33.806180 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-252a203a-02ce-411b-9566-41d3b795605a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:34.337148 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-f712e275-8c11-4731-b847-5a526dde299c req-cf36e41f-898e-45bd-be4f-20bd5b9294b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fa19be0-63c9-4071-979b-b23744235f16", "name": "network-vif-plugged", "status": "completed", "tag": "42ddec5f-4dce-48d9-a03c-50a2244f6f0b"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:34.372339 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f712e275-8c11-4731-b847-5a526dde299c req-cf36e41f-898e-45bd-be4f-20bd5b9294b3 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:34.372842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f712e275-8c11-4731-b847-5a526dde299c req-cf36e41f-898e-45bd-be4f-20bd5b9294b3 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:34.373290 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f712e275-8c11-4731-b847-5a526dde299c req-cf36e41f-898e-45bd-be4f-20bd5b9294b3 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:34.392789 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-f712e275-8c11-4731-b847-5a526dde299c req-cf36e41f-898e-45bd-be4f-20bd5b9294b3 service nova] Creating event network-vif-plugged:42ddec5f-4dce-48d9-a03c-50a2244f6f0b for instance 3fa19be0-63c9-4071-979b-b23744235f16 on nch2-master-1 Sep 17 21:16:34.410497 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-f712e275-8c11-4731-b847-5a526dde299c req-cf36e41f-898e-45bd-be4f-20bd5b9294b3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.425307 Sep 17 21:16:34.411421 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2569/5223] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:16:34.416642 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a59846f6-96df-41c0-91f7-cb41e5f80e28 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:34.417362 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a59846f6-96df-41c0-91f7-cb41e5f80e28 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: de3c1689-cd5c-4d17-820d-5ae1624d7fcc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:34.433635 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a59846f6-96df-41c0-91f7-cb41e5f80e28 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:34.434537 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a59846f6-96df-41c0-91f7-cb41e5f80e28 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:34.435209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a59846f6-96df-41c0-91f7-cb41e5f80e28 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:34.436134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a59846f6-96df-41c0-91f7-cb41e5f80e28 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:34.436816 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a59846f6-96df-41c0-91f7-cb41e5f80e28 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:34.442338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a59846f6-96df-41c0-91f7-cb41e5f80e28 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:34.869853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a59846f6-96df-41c0-91f7-cb41e5f80e28 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:34.882106 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a59846f6-96df-41c0-91f7-cb41e5f80e28 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc" status: 200 len: 1281 microversion: 2.1 time: 0.469426 Sep 17 21:16:34.886201 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2570/5224] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:34 2022] GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc => generated 1281 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:34.906140 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5de5d8bf-3aeb-4209-90d9-9e0e1afebdbf tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:34.909110 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5de5d8bf-3aeb-4209-90d9-9e0e1afebdbf tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:34.931650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5de5d8bf-3aeb-4209-90d9-9e0e1afebdbf tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:34.935658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5de5d8bf-3aeb-4209-90d9-9e0e1afebdbf tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:34.936334 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5de5d8bf-3aeb-4209-90d9-9e0e1afebdbf tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:34.937270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5de5d8bf-3aeb-4209-90d9-9e0e1afebdbf tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:34.946861 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5de5d8bf-3aeb-4209-90d9-9e0e1afebdbf tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:34.949730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5de5d8bf-3aeb-4209-90d9-9e0e1afebdbf tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:35.637641 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-252a203a-02ce-411b-9566-41d3b795605a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:35.652114 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-252a203a-02ce-411b-9566-41d3b795605a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:35.655093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-252a203a-02ce-411b-9566-41d3b795605a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:35.659507 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-252a203a-02ce-411b-9566-41d3b795605a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1806 microversion: 2.20 time: 1.889645 Sep 17 21:16:35.660238 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2655/5225] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:16:33 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1806 bytes in 1894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:16:35.746334 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5de5d8bf-3aeb-4209-90d9-9e0e1afebdbf tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:35.760365 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5de5d8bf-3aeb-4209-90d9-9e0e1afebdbf tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1363 microversion: 2.1 time: 0.870954 Sep 17 21:16:35.761171 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2571/5226] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:34 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1363 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:35.911105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-62fa44bb-429a-496a-85ef-17c2759ebcc0 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:35.912009 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-62fa44bb-429a-496a-85ef-17c2759ebcc0 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: de3c1689-cd5c-4d17-820d-5ae1624d7fcc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:35.919292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62fa44bb-429a-496a-85ef-17c2759ebcc0 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:35.920780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62fa44bb-429a-496a-85ef-17c2759ebcc0 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:35.921380 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62fa44bb-429a-496a-85ef-17c2759ebcc0 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:35.922303 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62fa44bb-429a-496a-85ef-17c2759ebcc0 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:35.922934 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62fa44bb-429a-496a-85ef-17c2759ebcc0 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:35.923506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62fa44bb-429a-496a-85ef-17c2759ebcc0 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:36.189737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-62fa44bb-429a-496a-85ef-17c2759ebcc0 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:36.200234 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-62fa44bb-429a-496a-85ef-17c2759ebcc0 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc" status: 200 len: 1281 microversion: 2.1 time: 0.293126 Sep 17 21:16:36.219752 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2656/5227] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:35 2022] GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc => generated 1281 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:36.694184 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7d672c9c-3531-4f7f-9b14-2ca8d1eafbe3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:36.695054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7d672c9c-3531-4f7f-9b14-2ca8d1eafbe3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:36.710289 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7d672c9c-3531-4f7f-9b14-2ca8d1eafbe3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:36.716657 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7d672c9c-3531-4f7f-9b14-2ca8d1eafbe3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:36.719995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7d672c9c-3531-4f7f-9b14-2ca8d1eafbe3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:36.723229 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7d672c9c-3531-4f7f-9b14-2ca8d1eafbe3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:36.727078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7d672c9c-3531-4f7f-9b14-2ca8d1eafbe3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:36.732087 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7d672c9c-3531-4f7f-9b14-2ca8d1eafbe3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:36.754432 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=90 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:16:36.786702 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3fe2369d-d11c-4db5-8a9a-7c3a679fa07d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:36.787331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3fe2369d-d11c-4db5-8a9a-7c3a679fa07d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:36.797393 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3fe2369d-d11c-4db5-8a9a-7c3a679fa07d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:36.797928 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3fe2369d-d11c-4db5-8a9a-7c3a679fa07d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:36.798380 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3fe2369d-d11c-4db5-8a9a-7c3a679fa07d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:36.799086 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3fe2369d-d11c-4db5-8a9a-7c3a679fa07d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:36.799555 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3fe2369d-d11c-4db5-8a9a-7c3a679fa07d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:36.826595 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3fe2369d-d11c-4db5-8a9a-7c3a679fa07d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:37.516856 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3fe2369d-d11c-4db5-8a9a-7c3a679fa07d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:37.538884 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3fe2369d-d11c-4db5-8a9a-7c3a679fa07d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1548 microversion: 2.1 time: 0.756111 Sep 17 21:16:37.539551 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2657/5228] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:36 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1548 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:16:37.556974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9b31e4da-12d8-489a-9936-3d2b72808947 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:37.558036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9b31e4da-12d8-489a-9936-3d2b72808947 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: de3c1689-cd5c-4d17-820d-5ae1624d7fcc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:37.578038 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b31e4da-12d8-489a-9936-3d2b72808947 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:37.578794 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b31e4da-12d8-489a-9936-3d2b72808947 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:37.579512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b31e4da-12d8-489a-9936-3d2b72808947 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:37.587091 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b31e4da-12d8-489a-9936-3d2b72808947 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:37.587752 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b31e4da-12d8-489a-9936-3d2b72808947 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:37.588347 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9b31e4da-12d8-489a-9936-3d2b72808947 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:37.663778 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7d672c9c-3531-4f7f-9b14-2ca8d1eafbe3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:37.698292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7d672c9c-3531-4f7f-9b14-2ca8d1eafbe3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:37.707230 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7d672c9c-3531-4f7f-9b14-2ca8d1eafbe3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:37.711972 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7d672c9c-3531-4f7f-9b14-2ca8d1eafbe3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1806 microversion: 2.20 time: 1.023419 Sep 17 21:16:37.720798 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2572/5229] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:16:36 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1806 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:16:37.755852 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b8127b6b-fa8a-4c89-a86f-8695150475eb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:37.761818 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b8127b6b-fa8a-4c89-a86f-8695150475eb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:37.772449 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b8127b6b-fa8a-4c89-a86f-8695150475eb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:37.773505 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b8127b6b-fa8a-4c89-a86f-8695150475eb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:37.773957 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b8127b6b-fa8a-4c89-a86f-8695150475eb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:37.774727 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b8127b6b-fa8a-4c89-a86f-8695150475eb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:37.775407 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b8127b6b-fa8a-4c89-a86f-8695150475eb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:37.775998 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b8127b6b-fa8a-4c89-a86f-8695150475eb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:37.967108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9b31e4da-12d8-489a-9936-3d2b72808947 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:37.984389 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9b31e4da-12d8-489a-9936-3d2b72808947 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc" status: 200 len: 1281 microversion: 2.1 time: 0.437100 Sep 17 21:16:37.989898 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2658/5230] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:37 2022] GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc => generated 1281 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:38.090527 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b8127b6b-fa8a-4c89-a86f-8695150475eb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.367727 Sep 17 21:16:38.091866 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2573/5231] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Sep 17 21:16:37 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16/os-interface => generated 284 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:16:38.755413 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-28f8fa48-1a7b-44aa-bce2-0e0de3fa515b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:38.759473 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-28f8fa48-1a7b-44aa-bce2-0e0de3fa515b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:38.762763 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=4 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:16:38.776190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28f8fa48-1a7b-44aa-bce2-0e0de3fa515b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:38.781308 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28f8fa48-1a7b-44aa-bce2-0e0de3fa515b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:38.781950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28f8fa48-1a7b-44aa-bce2-0e0de3fa515b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:38.792410 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28f8fa48-1a7b-44aa-bce2-0e0de3fa515b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:38.793123 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28f8fa48-1a7b-44aa-bce2-0e0de3fa515b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:38.795496 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28f8fa48-1a7b-44aa-bce2-0e0de3fa515b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:39.008588 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:16:39.015554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-26ab2c53-f671-4a77-8378-a42153f29642 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:39.016666 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-26ab2c53-f671-4a77-8378-a42153f29642 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: de3c1689-cd5c-4d17-820d-5ae1624d7fcc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:39.026139 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26ab2c53-f671-4a77-8378-a42153f29642 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:39.027207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26ab2c53-f671-4a77-8378-a42153f29642 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:39.028694 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26ab2c53-f671-4a77-8378-a42153f29642 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:39.029799 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26ab2c53-f671-4a77-8378-a42153f29642 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:39.030777 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26ab2c53-f671-4a77-8378-a42153f29642 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:39.031567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26ab2c53-f671-4a77-8378-a42153f29642 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:40.092853 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=8 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:16:40.193403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-28f8fa48-1a7b-44aa-bce2-0e0de3fa515b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:40.206931 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-28f8fa48-1a7b-44aa-bce2-0e0de3fa515b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:40.218958 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-28f8fa48-1a7b-44aa-bce2-0e0de3fa515b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:40.221362 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-28f8fa48-1a7b-44aa-bce2-0e0de3fa515b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1806 microversion: 2.20 time: 1.486013 Sep 17 21:16:40.222575 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2659/5232] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:16:38 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1806 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:16:40.247036 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-26ab2c53-f671-4a77-8378-a42153f29642 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:40.271406 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-26ab2c53-f671-4a77-8378-a42153f29642 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc" status: 200 len: 1323 microversion: 2.1 time: 1.264635 Sep 17 21:16:40.274872 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2574/5233] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:39 2022] GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc => generated 1323 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:16:41.251947 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-dad2d22d-bf77-464d-98a2-ea7d9f6505ac tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:41.253271 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-dad2d22d-bf77-464d-98a2-ea7d9f6505ac tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:41.262295 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dad2d22d-bf77-464d-98a2-ea7d9f6505ac tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:41.263082 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dad2d22d-bf77-464d-98a2-ea7d9f6505ac tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:41.263826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dad2d22d-bf77-464d-98a2-ea7d9f6505ac tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:41.264727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dad2d22d-bf77-464d-98a2-ea7d9f6505ac tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:41.265361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dad2d22d-bf77-464d-98a2-ea7d9f6505ac tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:41.266030 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dad2d22d-bf77-464d-98a2-ea7d9f6505ac tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:41.297010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c644e121-b563-4214-a29c-003405e6e176 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:41.298281 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c644e121-b563-4214-a29c-003405e6e176 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: de3c1689-cd5c-4d17-820d-5ae1624d7fcc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:41.308561 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c644e121-b563-4214-a29c-003405e6e176 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:41.322248 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c644e121-b563-4214-a29c-003405e6e176 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:41.323573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c644e121-b563-4214-a29c-003405e6e176 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:41.324495 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c644e121-b563-4214-a29c-003405e6e176 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:41.325139 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c644e121-b563-4214-a29c-003405e6e176 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:41.325773 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c644e121-b563-4214-a29c-003405e6e176 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:41.890960 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-dad2d22d-bf77-464d-98a2-ea7d9f6505ac tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:41.894267 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:16:41.929991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-dad2d22d-bf77-464d-98a2-ea7d9f6505ac tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:41.940985 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-dad2d22d-bf77-464d-98a2-ea7d9f6505ac tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:41.945973 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-dad2d22d-bf77-464d-98a2-ea7d9f6505ac tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1806 microversion: 2.20 time: 0.698475 Sep 17 21:16:41.949898 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2660/5234] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:16:41 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1806 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:16:41.973011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-ccc26a81-c6ff-4836-b78a-fb042bf961c8 req-2f4f43ad-675f-4581-bc02-1e7abd2bfc8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "796cf34c-7dbb-444e-a74e-68139729405f", "name": "network-vif-plugged", "status": "completed", "tag": "74223161-c2a1-4706-8b34-7e44c8bdcb2b"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:41.979443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c644e121-b563-4214-a29c-003405e6e176 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:41.993510 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c644e121-b563-4214-a29c-003405e6e176 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc" status: 200 len: 1323 microversion: 2.1 time: 0.700290 Sep 17 21:16:41.994131 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2575/5235] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:41 2022] GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc => generated 1323 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:42.024699 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-ccc26a81-c6ff-4836-b78a-fb042bf961c8 req-2f4f43ad-675f-4581-bc02-1e7abd2bfc8d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:42.025720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-ccc26a81-c6ff-4836-b78a-fb042bf961c8 req-2f4f43ad-675f-4581-bc02-1e7abd2bfc8d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:42.027688 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-ccc26a81-c6ff-4836-b78a-fb042bf961c8 req-2f4f43ad-675f-4581-bc02-1e7abd2bfc8d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:42.066739 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-ccc26a81-c6ff-4836-b78a-fb042bf961c8 req-2f4f43ad-675f-4581-bc02-1e7abd2bfc8d service nova] Creating event network-vif-plugged:74223161-c2a1-4706-8b34-7e44c8bdcb2b for instance 796cf34c-7dbb-444e-a74e-68139729405f on nch1-master-1 Sep 17 21:16:42.081375 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-ccc26a81-c6ff-4836-b78a-fb042bf961c8 req-2f4f43ad-675f-4581-bc02-1e7abd2bfc8d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127224 Sep 17 21:16:42.082685 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2661/5236] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:16:42.438895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-f0703829-1064-45e1-af03-eb238bd8388c req-e0d9188e-5e45-4e5a-a13c-b7bff9973707 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e0db75a-49c1-4693-ad54-79a1c20aac86", "tag": "142af4b2-a98f-48b8-85b1-745d2fae5881"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:42.460228 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f0703829-1064-45e1-af03-eb238bd8388c req-e0d9188e-5e45-4e5a-a13c-b7bff9973707 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:42.461030 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f0703829-1064-45e1-af03-eb238bd8388c req-e0d9188e-5e45-4e5a-a13c-b7bff9973707 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:42.461686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f0703829-1064-45e1-af03-eb238bd8388c req-e0d9188e-5e45-4e5a-a13c-b7bff9973707 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:42.480431 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-f0703829-1064-45e1-af03-eb238bd8388c req-e0d9188e-5e45-4e5a-a13c-b7bff9973707 service nova] Creating event network-changed:142af4b2-a98f-48b8-85b1-745d2fae5881 for instance 4e0db75a-49c1-4693-ad54-79a1c20aac86 on nch2-master-1 Sep 17 21:16:42.489324 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-f0703829-1064-45e1-af03-eb238bd8388c req-e0d9188e-5e45-4e5a-a13c-b7bff9973707 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054791 Sep 17 21:16:42.491200 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2576/5237] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:16:42.906241 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-2db1ae4d-3cf5-43f6-899f-ae3008fa2430 req-b12e825e-0eb8-4b0a-b822-403be2e18f3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fa19be0-63c9-4071-979b-b23744235f16", "tag": "42ddec5f-4dce-48d9-a03c-50a2244f6f0b"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:42.929240 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-2db1ae4d-3cf5-43f6-899f-ae3008fa2430 req-b12e825e-0eb8-4b0a-b822-403be2e18f3c service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:42.931091 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-2db1ae4d-3cf5-43f6-899f-ae3008fa2430 req-b12e825e-0eb8-4b0a-b822-403be2e18f3c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:42.931846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-2db1ae4d-3cf5-43f6-899f-ae3008fa2430 req-b12e825e-0eb8-4b0a-b822-403be2e18f3c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:42.959837 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-2db1ae4d-3cf5-43f6-899f-ae3008fa2430 req-b12e825e-0eb8-4b0a-b822-403be2e18f3c service nova] Creating event network-changed:42ddec5f-4dce-48d9-a03c-50a2244f6f0b for instance 3fa19be0-63c9-4071-979b-b23744235f16 on nch2-master-1 Sep 17 21:16:42.967054 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-2db1ae4d-3cf5-43f6-899f-ae3008fa2430 req-b12e825e-0eb8-4b0a-b822-403be2e18f3c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064606 Sep 17 21:16:42.968425 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2662/5238] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:16:42.981185 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-634ca130-a418-4419-8579-f042bec53ba8 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:42.982021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-634ca130-a418-4419-8579-f042bec53ba8 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:42.999455 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-634ca130-a418-4419-8579-f042bec53ba8 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:43.003058 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-634ca130-a418-4419-8579-f042bec53ba8 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:43.003699 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-634ca130-a418-4419-8579-f042bec53ba8 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:43.005384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-634ca130-a418-4419-8579-f042bec53ba8 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:43.006820 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-634ca130-a418-4419-8579-f042bec53ba8 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:43.009923 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-634ca130-a418-4419-8579-f042bec53ba8 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:43.020840 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d41f1bed-aba4-4a85-aade-e520faea69ac tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:43.027130 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d41f1bed-aba4-4a85-aade-e520faea69ac tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: de3c1689-cd5c-4d17-820d-5ae1624d7fcc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:43.037071 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d41f1bed-aba4-4a85-aade-e520faea69ac tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:43.038059 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d41f1bed-aba4-4a85-aade-e520faea69ac tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:43.038655 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d41f1bed-aba4-4a85-aade-e520faea69ac tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:43.047185 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d41f1bed-aba4-4a85-aade-e520faea69ac tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:43.048317 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d41f1bed-aba4-4a85-aade-e520faea69ac tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:43.048920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d41f1bed-aba4-4a85-aade-e520faea69ac tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:43.685013 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-634ca130-a418-4419-8579-f042bec53ba8 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:43.708756 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-634ca130-a418-4419-8579-f042bec53ba8 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:43.711700 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-634ca130-a418-4419-8579-f042bec53ba8 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:43.713661 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-634ca130-a418-4419-8579-f042bec53ba8 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1806 microversion: 2.20 time: 0.739863 Sep 17 21:16:43.715161 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2577/5239] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:16:42 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1806 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:16:43.742514 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d41f1bed-aba4-4a85-aade-e520faea69ac tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:43.751179 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d41f1bed-aba4-4a85-aade-e520faea69ac tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc" status: 200 len: 1323 microversion: 2.1 time: 0.735395 Sep 17 21:16:43.752465 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2663/5240] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:43 2022] GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc => generated 1323 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:44.741810 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-39636dc5-290a-45b8-9656-fd969e6d3ac6 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:44.743196 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-39636dc5-290a-45b8-9656-fd969e6d3ac6 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:44.760216 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-39636dc5-290a-45b8-9656-fd969e6d3ac6 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:44.760964 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-39636dc5-290a-45b8-9656-fd969e6d3ac6 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:44.761779 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-39636dc5-290a-45b8-9656-fd969e6d3ac6 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:44.762818 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-39636dc5-290a-45b8-9656-fd969e6d3ac6 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:44.763562 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-39636dc5-290a-45b8-9656-fd969e6d3ac6 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:44.764643 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-39636dc5-290a-45b8-9656-fd969e6d3ac6 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:44.779508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3e4cc764-6738-4a28-a206-2f259e58ad98 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:44.780624 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3e4cc764-6738-4a28-a206-2f259e58ad98 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: de3c1689-cd5c-4d17-820d-5ae1624d7fcc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:44.800449 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=9 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:16:44.807234 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e4cc764-6738-4a28-a206-2f259e58ad98 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:44.808388 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e4cc764-6738-4a28-a206-2f259e58ad98 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:44.809091 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e4cc764-6738-4a28-a206-2f259e58ad98 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:44.810149 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e4cc764-6738-4a28-a206-2f259e58ad98 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:44.810941 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e4cc764-6738-4a28-a206-2f259e58ad98 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:44.812301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e4cc764-6738-4a28-a206-2f259e58ad98 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:45.413105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3e4cc764-6738-4a28-a206-2f259e58ad98 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:45.436496 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3e4cc764-6738-4a28-a206-2f259e58ad98 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc" status: 200 len: 1323 microversion: 2.1 time: 0.664698 Sep 17 21:16:45.437324 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2664/5241] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:44 2022] GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc => generated 1323 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:45.457246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-a0dd11ed-6bc0-4bf5-9fe5-a3a13c01f1a6 req-cab083ea-9e2e-4bdb-9c6d-79c5eacdbc8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082", "tag": "cae93b36-576e-478d-ad85-7c386a684417"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:45.479006 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a0dd11ed-6bc0-4bf5-9fe5-a3a13c01f1a6 req-cab083ea-9e2e-4bdb-9c6d-79c5eacdbc8c service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:45.479603 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a0dd11ed-6bc0-4bf5-9fe5-a3a13c01f1a6 req-cab083ea-9e2e-4bdb-9c6d-79c5eacdbc8c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:45.480115 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a0dd11ed-6bc0-4bf5-9fe5-a3a13c01f1a6 req-cab083ea-9e2e-4bdb-9c6d-79c5eacdbc8c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:45.493365 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-a0dd11ed-6bc0-4bf5-9fe5-a3a13c01f1a6 req-cab083ea-9e2e-4bdb-9c6d-79c5eacdbc8c service nova] Creating event network-changed:cae93b36-576e-478d-ad85-7c386a684417 for instance c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082 on nch1-master-1 Sep 17 21:16:45.499790 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-a0dd11ed-6bc0-4bf5-9fe5-a3a13c01f1a6 req-cab083ea-9e2e-4bdb-9c6d-79c5eacdbc8c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046910 Sep 17 21:16:45.500795 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2665/5242] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:16:45.506918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-0e806c79-2474-4775-87a6-c92fb82e891a req-452ac681-099a-4cf5-996d-6d2274d6872d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de3c1689-cd5c-4d17-820d-5ae1624d7fcc", "tag": "d65d4ba6-c6eb-49f6-a6f8-2741e2887401"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:45.519250 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-0e806c79-2474-4775-87a6-c92fb82e891a req-452ac681-099a-4cf5-996d-6d2274d6872d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:45.519849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-0e806c79-2474-4775-87a6-c92fb82e891a req-452ac681-099a-4cf5-996d-6d2274d6872d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:45.521651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-0e806c79-2474-4775-87a6-c92fb82e891a req-452ac681-099a-4cf5-996d-6d2274d6872d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:45.544391 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-0e806c79-2474-4775-87a6-c92fb82e891a req-452ac681-099a-4cf5-996d-6d2274d6872d service nova] Creating event network-changed:d65d4ba6-c6eb-49f6-a6f8-2741e2887401 for instance de3c1689-cd5c-4d17-820d-5ae1624d7fcc on nch1-master-1 Sep 17 21:16:45.551783 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-0e806c79-2474-4775-87a6-c92fb82e891a req-452ac681-099a-4cf5-996d-6d2274d6872d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049491 Sep 17 21:16:45.553158 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2666/5243] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:16:46.063793 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-39636dc5-290a-45b8-9656-fd969e6d3ac6 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:46.082425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-39636dc5-290a-45b8-9656-fd969e6d3ac6 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:46.089226 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-39636dc5-290a-45b8-9656-fd969e6d3ac6 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:46.094154 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-39636dc5-290a-45b8-9656-fd969e6d3ac6 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1806 microversion: 2.20 time: 1.357744 Sep 17 21:16:46.096360 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2578/5244] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:16:44 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1806 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:16:46.461211 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4883f3c9-1e09-403b-95f1-4535174af3c2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:46.464322 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4883f3c9-1e09-403b-95f1-4535174af3c2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: de3c1689-cd5c-4d17-820d-5ae1624d7fcc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:46.485599 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4883f3c9-1e09-403b-95f1-4535174af3c2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:46.486404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4883f3c9-1e09-403b-95f1-4535174af3c2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:46.487020 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4883f3c9-1e09-403b-95f1-4535174af3c2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:46.487915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4883f3c9-1e09-403b-95f1-4535174af3c2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:46.488517 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4883f3c9-1e09-403b-95f1-4535174af3c2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:46.489297 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4883f3c9-1e09-403b-95f1-4535174af3c2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:47.079855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4883f3c9-1e09-403b-95f1-4535174af3c2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:47.114389 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4883f3c9-1e09-403b-95f1-4535174af3c2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc" status: 200 len: 1323 microversion: 2.1 time: 0.658340 Sep 17 21:16:47.121295 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2667/5245] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:46 2022] GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc => generated 1323 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:47.124355 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f5c0e78b-c035-4951-b776-e0594aff0072 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:47.124972 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f5c0e78b-c035-4951-b776-e0594aff0072 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:47.139712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:16:47.141168 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f5c0e78b-c035-4951-b776-e0594aff0072 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:47.141882 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f5c0e78b-c035-4951-b776-e0594aff0072 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:47.155416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f5c0e78b-c035-4951-b776-e0594aff0072 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:47.155993 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f5c0e78b-c035-4951-b776-e0594aff0072 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:47.156494 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f5c0e78b-c035-4951-b776-e0594aff0072 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:47.156938 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f5c0e78b-c035-4951-b776-e0594aff0072 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:48.077029 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f5c0e78b-c035-4951-b776-e0594aff0072 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:48.095137 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f5c0e78b-c035-4951-b776-e0594aff0072 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:48.097059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f5c0e78b-c035-4951-b776-e0594aff0072 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:48.099140 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f5c0e78b-c035-4951-b776-e0594aff0072 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1793 microversion: 2.20 time: 0.979247 Sep 17 21:16:48.100291 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2579/5246] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:16:47 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1793 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:16:48.141366 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a9cbf89c-11f9-481e-8559-44d398a4d242 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:48.143054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a9cbf89c-11f9-481e-8559-44d398a4d242 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: de3c1689-cd5c-4d17-820d-5ae1624d7fcc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:48.151990 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a9cbf89c-11f9-481e-8559-44d398a4d242 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:48.152828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a9cbf89c-11f9-481e-8559-44d398a4d242 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:48.153516 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a9cbf89c-11f9-481e-8559-44d398a4d242 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:48.155935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a9cbf89c-11f9-481e-8559-44d398a4d242 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:48.156752 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a9cbf89c-11f9-481e-8559-44d398a4d242 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:48.157401 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a9cbf89c-11f9-481e-8559-44d398a4d242 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:48.566333 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a9cbf89c-11f9-481e-8559-44d398a4d242 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:48.595155 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a9cbf89c-11f9-481e-8559-44d398a4d242 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc" status: 200 len: 1323 microversion: 2.1 time: 0.457426 Sep 17 21:16:48.597390 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2668/5247] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:48 2022] GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc => generated 1323 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:49.619859 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d1644a61-1ad1-4a6a-80cb-5ff7001db733 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:49.620495 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d1644a61-1ad1-4a6a-80cb-5ff7001db733 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: de3c1689-cd5c-4d17-820d-5ae1624d7fcc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:49.639643 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1644a61-1ad1-4a6a-80cb-5ff7001db733 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:49.640320 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1644a61-1ad1-4a6a-80cb-5ff7001db733 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:49.640842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1644a61-1ad1-4a6a-80cb-5ff7001db733 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:49.641635 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1644a61-1ad1-4a6a-80cb-5ff7001db733 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:49.642098 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1644a61-1ad1-4a6a-80cb-5ff7001db733 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:49.642527 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1644a61-1ad1-4a6a-80cb-5ff7001db733 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:50.171978 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d1644a61-1ad1-4a6a-80cb-5ff7001db733 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:50.188296 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d1644a61-1ad1-4a6a-80cb-5ff7001db733 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc" status: 200 len: 1323 microversion: 2.1 time: 0.567415 Sep 17 21:16:50.192598 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2580/5248] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:49 2022] GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc => generated 1323 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:51.218964 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f7f3711b-0ac9-496f-a685-4fa83c96401f tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:51.219616 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f7f3711b-0ac9-496f-a685-4fa83c96401f tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: de3c1689-cd5c-4d17-820d-5ae1624d7fcc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:51.232358 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7f3711b-0ac9-496f-a685-4fa83c96401f tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:51.233634 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7f3711b-0ac9-496f-a685-4fa83c96401f tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:51.235080 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7f3711b-0ac9-496f-a685-4fa83c96401f tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:51.238524 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7f3711b-0ac9-496f-a685-4fa83c96401f tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:51.240730 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7f3711b-0ac9-496f-a685-4fa83c96401f tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:51.242500 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7f3711b-0ac9-496f-a685-4fa83c96401f tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:52.191472 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f7f3711b-0ac9-496f-a685-4fa83c96401f tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:52.207204 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f7f3711b-0ac9-496f-a685-4fa83c96401f tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc" status: 200 len: 1323 microversion: 2.1 time: 0.993199 Sep 17 21:16:52.230389 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2669/5249] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:51 2022] GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc => generated 1323 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:53.236918 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-70a02d65-770a-429b-8c64-b4cb7f76fbad tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:53.238332 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-70a02d65-770a-429b-8c64-b4cb7f76fbad tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: de3c1689-cd5c-4d17-820d-5ae1624d7fcc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:53.247302 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-70a02d65-770a-429b-8c64-b4cb7f76fbad tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:53.252785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-70a02d65-770a-429b-8c64-b4cb7f76fbad tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:53.253640 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-70a02d65-770a-429b-8c64-b4cb7f76fbad tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:53.258309 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-70a02d65-770a-429b-8c64-b4cb7f76fbad tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:53.259085 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-70a02d65-770a-429b-8c64-b4cb7f76fbad tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:53.260010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-70a02d65-770a-429b-8c64-b4cb7f76fbad tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:53.530193 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-e2be1e13-4747-4acd-a3af-e5b036e630df req-64efcd99-fc98-42e9-a6be-3562f274dce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e0db75a-49c1-4693-ad54-79a1c20aac86", "name": "network-vif-plugged", "status": "completed", "tag": "142af4b2-a98f-48b8-85b1-745d2fae5881"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:53.546734 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e2be1e13-4747-4acd-a3af-e5b036e630df req-64efcd99-fc98-42e9-a6be-3562f274dce7 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:53.547533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e2be1e13-4747-4acd-a3af-e5b036e630df req-64efcd99-fc98-42e9-a6be-3562f274dce7 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:53.548129 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e2be1e13-4747-4acd-a3af-e5b036e630df req-64efcd99-fc98-42e9-a6be-3562f274dce7 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:53.566639 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-e2be1e13-4747-4acd-a3af-e5b036e630df req-64efcd99-fc98-42e9-a6be-3562f274dce7 service nova] Creating event network-vif-plugged:142af4b2-a98f-48b8-85b1-745d2fae5881 for instance 4e0db75a-49c1-4693-ad54-79a1c20aac86 on nch2-master-1 Sep 17 21:16:53.574646 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-e2be1e13-4747-4acd-a3af-e5b036e630df req-64efcd99-fc98-42e9-a6be-3562f274dce7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049421 Sep 17 21:16:53.575867 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2670/5250] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:16:53.578392 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-70a02d65-770a-429b-8c64-b4cb7f76fbad tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:53.599089 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-70a02d65-770a-429b-8c64-b4cb7f76fbad tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc" status: 200 len: 1323 microversion: 2.1 time: 0.366147 Sep 17 21:16:53.616518 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2581/5251] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:53 2022] GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc => generated 1323 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:54.626192 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f1a7c3d7-ce99-4f02-b722-4431f565f285 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:54.628662 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f1a7c3d7-ce99-4f02-b722-4431f565f285 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: de3c1689-cd5c-4d17-820d-5ae1624d7fcc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:54.646956 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f1a7c3d7-ce99-4f02-b722-4431f565f285 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:54.647662 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f1a7c3d7-ce99-4f02-b722-4431f565f285 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:54.649390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f1a7c3d7-ce99-4f02-b722-4431f565f285 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:54.650616 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f1a7c3d7-ce99-4f02-b722-4431f565f285 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:54.657326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f1a7c3d7-ce99-4f02-b722-4431f565f285 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:54.658070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f1a7c3d7-ce99-4f02-b722-4431f565f285 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:55.029518 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f1a7c3d7-ce99-4f02-b722-4431f565f285 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:55.047522 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f1a7c3d7-ce99-4f02-b722-4431f565f285 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc" status: 200 len: 1323 microversion: 2.1 time: 0.429183 Sep 17 21:16:55.051447 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2671/5252] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:54 2022] GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc => generated 1323 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:55.628445 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-75de895a-4e56-4f0a-b6cc-b78ee87629e1 req-a80ab8f3-f3c6-4be1-a930-dd133096b3df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082", "name": "network-vif-plugged", "status": "completed", "tag": "cae93b36-576e-478d-ad85-7c386a684417"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:55.659909 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-75de895a-4e56-4f0a-b6cc-b78ee87629e1 req-a80ab8f3-f3c6-4be1-a930-dd133096b3df service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:55.660547 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-75de895a-4e56-4f0a-b6cc-b78ee87629e1 req-a80ab8f3-f3c6-4be1-a930-dd133096b3df service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:55.668919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-75de895a-4e56-4f0a-b6cc-b78ee87629e1 req-a80ab8f3-f3c6-4be1-a930-dd133096b3df service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:55.702162 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-75de895a-4e56-4f0a-b6cc-b78ee87629e1 req-a80ab8f3-f3c6-4be1-a930-dd133096b3df service nova] Creating event network-vif-plugged:cae93b36-576e-478d-ad85-7c386a684417 for instance c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082 on nch1-master-1 Sep 17 21:16:55.711696 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-75de895a-4e56-4f0a-b6cc-b78ee87629e1 req-a80ab8f3-f3c6-4be1-a930-dd133096b3df service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087909 Sep 17 21:16:55.712345 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2582/5253] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:16:56.078222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cb3f7b76-9e99-40f5-bb5a-d908522cfc41 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:56.078934 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cb3f7b76-9e99-40f5-bb5a-d908522cfc41 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: de3c1689-cd5c-4d17-820d-5ae1624d7fcc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:56.091540 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb3f7b76-9e99-40f5-bb5a-d908522cfc41 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:56.093104 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb3f7b76-9e99-40f5-bb5a-d908522cfc41 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:56.093692 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb3f7b76-9e99-40f5-bb5a-d908522cfc41 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:56.096342 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb3f7b76-9e99-40f5-bb5a-d908522cfc41 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:56.097198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb3f7b76-9e99-40f5-bb5a-d908522cfc41 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:56.099190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb3f7b76-9e99-40f5-bb5a-d908522cfc41 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:56.566728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cb3f7b76-9e99-40f5-bb5a-d908522cfc41 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:56.589414 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cb3f7b76-9e99-40f5-bb5a-d908522cfc41 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc" status: 200 len: 1323 microversion: 2.1 time: 0.515316 Sep 17 21:16:56.592364 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2672/5254] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:56 2022] GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc => generated 1323 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:57.626087 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0669f053-fc23-422b-be57-fd4925f7e340 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:57.627332 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0669f053-fc23-422b-be57-fd4925f7e340 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: de3c1689-cd5c-4d17-820d-5ae1624d7fcc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:57.693087 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0669f053-fc23-422b-be57-fd4925f7e340 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:57.695790 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0669f053-fc23-422b-be57-fd4925f7e340 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:57.696468 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0669f053-fc23-422b-be57-fd4925f7e340 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:57.698600 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0669f053-fc23-422b-be57-fd4925f7e340 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:57.700987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0669f053-fc23-422b-be57-fd4925f7e340 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:57.702443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0669f053-fc23-422b-be57-fd4925f7e340 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:58.439793 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-b6981e86-2451-4820-b785-0f5df99c830a req-e75896b1-173e-4c45-928f-9c69357d5ebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de3c1689-cd5c-4d17-820d-5ae1624d7fcc", "name": "network-vif-plugged", "status": "completed", "tag": "d65d4ba6-c6eb-49f6-a6f8-2741e2887401"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:16:58.472843 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b6981e86-2451-4820-b785-0f5df99c830a req-e75896b1-173e-4c45-928f-9c69357d5ebb service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:58.473735 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b6981e86-2451-4820-b785-0f5df99c830a req-e75896b1-173e-4c45-928f-9c69357d5ebb service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:58.474389 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b6981e86-2451-4820-b785-0f5df99c830a req-e75896b1-173e-4c45-928f-9c69357d5ebb service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:58.501173 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-b6981e86-2451-4820-b785-0f5df99c830a req-e75896b1-173e-4c45-928f-9c69357d5ebb service nova] Creating event network-vif-plugged:d65d4ba6-c6eb-49f6-a6f8-2741e2887401 for instance de3c1689-cd5c-4d17-820d-5ae1624d7fcc on nch1-master-1 Sep 17 21:16:58.508976 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0669f053-fc23-422b-be57-fd4925f7e340 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:58.517882 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0669f053-fc23-422b-be57-fd4925f7e340 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc" status: 200 len: 1323 microversion: 2.1 time: 0.903644 Sep 17 21:16:58.520052 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-b6981e86-2451-4820-b785-0f5df99c830a req-e75896b1-173e-4c45-928f-9c69357d5ebb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088321 Sep 17 21:16:58.535540 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2583/5255] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:57 2022] GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc => generated 1323 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:16:58.538966 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2673/5256] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:16:59.546644 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6815412f-c2f1-48e2-9a66-168b8b9df868 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:16:59.547278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6815412f-c2f1-48e2-9a66-168b8b9df868 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: de3c1689-cd5c-4d17-820d-5ae1624d7fcc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:16:59.564444 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6815412f-c2f1-48e2-9a66-168b8b9df868 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:59.565293 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6815412f-c2f1-48e2-9a66-168b8b9df868 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:59.565919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6815412f-c2f1-48e2-9a66-168b8b9df868 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:59.566795 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6815412f-c2f1-48e2-9a66-168b8b9df868 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:16:59.567442 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6815412f-c2f1-48e2-9a66-168b8b9df868 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:16:59.568015 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6815412f-c2f1-48e2-9a66-168b8b9df868 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:16:59.899039 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6815412f-c2f1-48e2-9a66-168b8b9df868 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:16:59.909788 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6815412f-c2f1-48e2-9a66-168b8b9df868 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc" status: 200 len: 1323 microversion: 2.1 time: 0.365226 Sep 17 21:16:59.911477 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2584/5257] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:16:59 2022] GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc => generated 1323 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:17:00.936697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-dc6adfd4-b87c-4d2a-908a-ae950b5f1187 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:00.937795 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-dc6adfd4-b87c-4d2a-908a-ae950b5f1187 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: de3c1689-cd5c-4d17-820d-5ae1624d7fcc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:00.951344 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dc6adfd4-b87c-4d2a-908a-ae950b5f1187 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:00.960990 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dc6adfd4-b87c-4d2a-908a-ae950b5f1187 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:00.961672 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dc6adfd4-b87c-4d2a-908a-ae950b5f1187 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:00.965559 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dc6adfd4-b87c-4d2a-908a-ae950b5f1187 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:00.966113 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dc6adfd4-b87c-4d2a-908a-ae950b5f1187 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:00.966668 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dc6adfd4-b87c-4d2a-908a-ae950b5f1187 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:01.549170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-dc6adfd4-b87c-4d2a-908a-ae950b5f1187 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:01.558694 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-dc6adfd4-b87c-4d2a-908a-ae950b5f1187 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc" status: 200 len: 1516 microversion: 2.1 time: 0.628119 Sep 17 21:17:01.563605 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2674/5258] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:00 2022] GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc => generated 1516 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:17:01.589166 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6bdddf93-990e-494f-ac4f-773b4401e37d tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:01.590514 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6bdddf93-990e-494f-ac4f-773b4401e37d tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: 4e0db75a-49c1-4693-ad54-79a1c20aac86] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:01.604414 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6bdddf93-990e-494f-ac4f-773b4401e37d tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:01.606109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6bdddf93-990e-494f-ac4f-773b4401e37d tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:01.607457 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6bdddf93-990e-494f-ac4f-773b4401e37d tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:01.609378 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6bdddf93-990e-494f-ac4f-773b4401e37d tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:01.612135 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6bdddf93-990e-494f-ac4f-773b4401e37d tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:01.613935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6bdddf93-990e-494f-ac4f-773b4401e37d tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:02.244967 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6bdddf93-990e-494f-ac4f-773b4401e37d tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:02.253733 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6bdddf93-990e-494f-ac4f-773b4401e37d tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/4e0db75a-49c1-4693-ad54-79a1c20aac86" status: 200 len: 1517 microversion: 2.1 time: 0.668596 Sep 17 21:17:02.258260 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2585/5259] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:01 2022] GET /compute/v2.1/servers/4e0db75a-49c1-4693-ad54-79a1c20aac86 => generated 1517 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:02.287548 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4a0d8798-f490-49a8-bcb6-76cef473c990 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:02.288331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4a0d8798-f490-49a8-bcb6-76cef473c990 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:02.301808 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a0d8798-f490-49a8-bcb6-76cef473c990 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:02.307354 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a0d8798-f490-49a8-bcb6-76cef473c990 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:02.308028 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a0d8798-f490-49a8-bcb6-76cef473c990 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:02.309050 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a0d8798-f490-49a8-bcb6-76cef473c990 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:02.309750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a0d8798-f490-49a8-bcb6-76cef473c990 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:02.310379 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a0d8798-f490-49a8-bcb6-76cef473c990 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:03.285721 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4a0d8798-f490-49a8-bcb6-76cef473c990 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:03.296316 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4a0d8798-f490-49a8-bcb6-76cef473c990 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082" status: 200 len: 1517 microversion: 2.1 time: 1.010881 Sep 17 21:17:03.297687 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2675/5260] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:02 2022] GET /compute/v2.1/servers/c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082 => generated 1517 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:03.321413 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-daa63fb0-166a-4958-a890-6d3a52a56c39 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:03.321996 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-daa63fb0-166a-4958-a890-6d3a52a56c39 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:03.340504 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-daa63fb0-166a-4958-a890-6d3a52a56c39 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:03.341094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-daa63fb0-166a-4958-a890-6d3a52a56c39 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:03.341690 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-daa63fb0-166a-4958-a890-6d3a52a56c39 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:03.345887 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-daa63fb0-166a-4958-a890-6d3a52a56c39 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:03.346510 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-daa63fb0-166a-4958-a890-6d3a52a56c39 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:03.347065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-daa63fb0-166a-4958-a890-6d3a52a56c39 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:03.411849 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-daa63fb0-166a-4958-a890-6d3a52a56c39 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:17:03.676236 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-daa63fb0-166a-4958-a890-6d3a52a56c39 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082" status: 204 len: 0 microversion: 2.1 time: 0.359059 Sep 17 21:17:03.677930 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2586/5261] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:17:03 2022] DELETE /compute/v2.1/servers/c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:17:03.687537 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b5a913c3-4c6e-4c60-a91c-679de313b3d2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:03.688463 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b5a913c3-4c6e-4c60-a91c-679de313b3d2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:03.716500 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b5a913c3-4c6e-4c60-a91c-679de313b3d2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:03.717099 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b5a913c3-4c6e-4c60-a91c-679de313b3d2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:03.717711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b5a913c3-4c6e-4c60-a91c-679de313b3d2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:03.718537 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b5a913c3-4c6e-4c60-a91c-679de313b3d2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:03.719116 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b5a913c3-4c6e-4c60-a91c-679de313b3d2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:03.719655 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b5a913c3-4c6e-4c60-a91c-679de313b3d2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:04.274213 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b5a913c3-4c6e-4c60-a91c-679de313b3d2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:04.286313 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b5a913c3-4c6e-4c60-a91c-679de313b3d2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082" status: 200 len: 1523 microversion: 2.1 time: 0.602400 Sep 17 21:17:04.310895 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2676/5262] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:03 2022] GET /compute/v2.1/servers/c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082 => generated 1523 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:05.324014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bac042e4-d921-46ec-97fe-7a76d6bdece2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:05.325716 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bac042e4-d921-46ec-97fe-7a76d6bdece2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:05.333977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bac042e4-d921-46ec-97fe-7a76d6bdece2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:05.334760 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bac042e4-d921-46ec-97fe-7a76d6bdece2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:05.335355 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bac042e4-d921-46ec-97fe-7a76d6bdece2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:05.336307 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bac042e4-d921-46ec-97fe-7a76d6bdece2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:05.336927 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bac042e4-d921-46ec-97fe-7a76d6bdece2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:05.337558 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bac042e4-d921-46ec-97fe-7a76d6bdece2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:06.309715 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bac042e4-d921-46ec-97fe-7a76d6bdece2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:06.319490 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bac042e4-d921-46ec-97fe-7a76d6bdece2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082" status: 200 len: 1523 microversion: 2.1 time: 0.999964 Sep 17 21:17:06.323301 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2587/5263] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:05 2022] GET /compute/v2.1/servers/c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082 => generated 1523 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:06.511359 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cbb0f8e4-1fbb-43cf-b27c-537e6bf8bdd2 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Action: 'create', calling method: .version_select at 0x7f25a9ffe1f0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-637496389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLuRKSgfO78LZmQBkDqHys9OvgLznSWBwnCGa+2R3rDkjbIkDqTMj39fMZG56jgbTWtxOI7Mn8pdEk84nKeCtnSJgKC5W1E74z1bb4joEQU7V3XfNSBpSjmDEd9wR2cE+Q=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:17:06.543443 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-cbb0f8e4-1fbb-43cf-b27c-537e6bf8bdd2 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Getting quotas for project 09f16a815901466791a114b9a19cc763. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:17:06.559779 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-cbb0f8e4-1fbb-43cf-b27c-537e6bf8bdd2 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Getting quotas for user df6cec0e04954a3eba096b48a7cd2189 and project 09f16a815901466791a114b9a19cc763. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:17:06.608894 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cbb0f8e4-1fbb-43cf-b27c-537e6bf8bdd2 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.363461 Sep 17 21:17:06.616228 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2677/5264] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:17:06 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:17:06.865060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-15da21ea-a869-4951-9711-cdffbab199d4 req-c5959146-49c8-4df0-a6c7-010c8c134f8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082", "name": "network-vif-deleted", "tag": "cae93b36-576e-478d-ad85-7c386a684417"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:17:06.879297 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-15da21ea-a869-4951-9711-cdffbab199d4 req-c5959146-49c8-4df0-a6c7-010c8c134f8f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:06.880164 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-15da21ea-a869-4951-9711-cdffbab199d4 req-c5959146-49c8-4df0-a6c7-010c8c134f8f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:06.880747 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-15da21ea-a869-4951-9711-cdffbab199d4 req-c5959146-49c8-4df0-a6c7-010c8c134f8f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:06.909846 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:17:06.913175 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-15da21ea-a869-4951-9711-cdffbab199d4 req-c5959146-49c8-4df0-a6c7-010c8c134f8f service nova] Creating event network-vif-deleted:cae93b36-576e-478d-ad85-7c386a684417 for instance c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082 on nch1-master-1 Sep 17 21:17:06.929164 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-15da21ea-a869-4951-9711-cdffbab199d4 req-c5959146-49c8-4df0-a6c7-010c8c134f8f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067841 Sep 17 21:17:06.951427 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2588/5265] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:17:07.356616 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8e6000b5-96cf-47d4-ae7f-d55d566733fc tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:07.357262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8e6000b5-96cf-47d4-ae7f-d55d566733fc tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:07.377916 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e6000b5-96cf-47d4-ae7f-d55d566733fc tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:07.378326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e6000b5-96cf-47d4-ae7f-d55d566733fc tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:07.378773 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e6000b5-96cf-47d4-ae7f-d55d566733fc tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:07.379501 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e6000b5-96cf-47d4-ae7f-d55d566733fc tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:07.387359 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e6000b5-96cf-47d4-ae7f-d55d566733fc tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:07.388149 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e6000b5-96cf-47d4-ae7f-d55d566733fc tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:07.434626 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e6000b5-96cf-47d4-ae7f-d55d566733fc tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:07.435180 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e6000b5-96cf-47d4-ae7f-d55d566733fc tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:07.435627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e6000b5-96cf-47d4-ae7f-d55d566733fc tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:07.436087 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-8e6000b5-96cf-47d4-ae7f-d55d566733fc tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lazy-loading 'fault' on Instance uuid c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:17:07.514618 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8e6000b5-96cf-47d4-ae7f-d55d566733fc tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:07.528224 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8e6000b5-96cf-47d4-ae7f-d55d566733fc tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082" status: 200 len: 1313 microversion: 2.1 time: 0.184201 Sep 17 21:17:07.530694 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2678/5266] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:07 2022] GET /compute/v2.1/servers/c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:08.553786 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d2822cab-2f24-4068-9442-61a27576e9a6 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:08.555266 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d2822cab-2f24-4068-9442-61a27576e9a6 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:08.572163 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2822cab-2f24-4068-9442-61a27576e9a6 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:08.573016 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2822cab-2f24-4068-9442-61a27576e9a6 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:08.573692 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2822cab-2f24-4068-9442-61a27576e9a6 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:08.574615 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2822cab-2f24-4068-9442-61a27576e9a6 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:08.575281 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2822cab-2f24-4068-9442-61a27576e9a6 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:08.575949 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2822cab-2f24-4068-9442-61a27576e9a6 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:08.592527 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-d2822cab-2f24-4068-9442-61a27576e9a6 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] HTTP exception thrown: Instance c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082 could not be found. Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d2822cab-2f24-4068-9442-61a27576e9a6 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Request method failure captured: Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082 HTTP/1.1 Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjkm39QchJ1bStZzJgn_rwieqbBmkL_e_gmMYpZTAvszDj2G908EMQsq6iFVvbfpi1UGMTa_h4daNs7A3C6rmqXljifAy7Lv3Y6Cb_gz77iUVItjZ46qQnmykCGvwOkXrvIpxZ2ydot8i9RpiN6y_9y5mMgYi6RebGZnjUJYLE8imfY Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: f082a1525e7a400b9248faddccccad57 Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ListServersNegativeTestJSON-714359434 Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f082a1525e7a400b9248faddccccad57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f082a1525e7a400b9248faddccccad57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f082a1525e7a400b9248faddccccad57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f082a1525e7a400b9248faddccccad57", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ListServersNegativeTestJSON-714359434 Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: f082a1525e7a400b9248faddccccad57 Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-714359434 Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ListServersNegativeTestJSON-714359434-project Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: a19f3d81b25a452997230984e774d3a8 Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ListServersNegativeTestJSON-714359434-project Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082 could not be found. Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082'} Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082 could not be found. Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082 could not be found. Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:08.594548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:17:08.598089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:08.598089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:17:08.598089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:17:08.598089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:17:08.598089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:17:08.598089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:17:08.598089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082 could not be found. Sep 17 21:17:08.598089 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:08.600396 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d2822cab-2f24-4068-9442-61a27576e9a6 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Returning 404 to user: Instance c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:17:08.601599 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d2822cab-2f24-4068-9442-61a27576e9a6 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082" status: 404 len: 111 microversion: 2.1 time: 0.052998 Sep 17 21:17:08.603864 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2589/5267] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:08 2022] GET /compute/v2.1/servers/c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:17:08.613592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bab6ec6f-3b21-46bf-ac87-a0c7cad49adc tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:08.618976 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bab6ec6f-3b21-46bf-ac87-a0c7cad49adc tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:08.623390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bab6ec6f-3b21-46bf-ac87-a0c7cad49adc tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'f082a1525e7a400b9248faddccccad57'} {{(pid=140524) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:17:08.633137 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bab6ec6f-3b21-46bf-ac87-a0c7cad49adc tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:08.633910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bab6ec6f-3b21-46bf-ac87-a0c7cad49adc tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:08.634596 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bab6ec6f-3b21-46bf-ac87-a0c7cad49adc tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:08.635643 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bab6ec6f-3b21-46bf-ac87-a0c7cad49adc tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:08.637261 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bab6ec6f-3b21-46bf-ac87-a0c7cad49adc tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:08.637928 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bab6ec6f-3b21-46bf-ac87-a0c7cad49adc tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:08.836470 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bab6ec6f-3b21-46bf-ac87-a0c7cad49adc tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.227440 Sep 17 21:17:08.838369 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2679/5268] 10.222.0.26 () {58 vars in 1230 bytes} [Sat Sep 17 21:17:08 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:17:08.855943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-683d37f2-51e5-4320-8651-15f08227b6bc tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-683d37f2-51e5-4320-8651-15f08227b6bc tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Request method failure captured: Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjkm39QchJ1bStZzJgn_rwieqbBmkL_e_gmMYpZTAvszDj2G908EMQsq6iFVvbfpi1UGMTa_h4daNs7A3C6rmqXljifAy7Lv3Y6Cb_gz77iUVItjZ46qQnmykCGvwOkXrvIpxZ2ydot8i9RpiN6y_9y5mMgYi6RebGZnjUJYLE8imfY Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: f082a1525e7a400b9248faddccccad57 Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ListServersNegativeTestJSON-714359434 Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f082a1525e7a400b9248faddccccad57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f082a1525e7a400b9248faddccccad57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f082a1525e7a400b9248faddccccad57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f082a1525e7a400b9248faddccccad57", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ListServersNegativeTestJSON-714359434 Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: f082a1525e7a400b9248faddccccad57 Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-714359434 Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ListServersNegativeTestJSON-714359434-project Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: a19f3d81b25a452997230984e774d3a8 Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ListServersNegativeTestJSON-714359434-project Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: action_args: {} Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise error Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi '2011/01/01' Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 17 21:17:08.861553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 21:17:08.866053 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 21:17:08.866053 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 21:17:08.866053 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 21:17:08.866053 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 17 21:17:08.866053 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:08.866053 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:17:08.866053 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:08.866053 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:17:08.866053 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:17:08.866053 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:17:08.866053 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 21:17:08.866053 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 21:17:08.866053 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 17 21:17:08.866053 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:08.871399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-683d37f2-51e5-4320-8651-15f08227b6bc tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:17:08.872618 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-683d37f2-51e5-4320-8651-15f08227b6bc tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.022970 Sep 17 21:17:08.874357 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2590/5269] 10.222.0.26 () {58 vars in 1182 bytes} [Sat Sep 17 21:17:08 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:17:08.885003 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2b713e79-3c79-4dd7-ab3a-15fadec0c70b tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:08.896208 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2b713e79-3c79-4dd7-ab3a-15fadec0c70b tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:08.897002 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2b713e79-3c79-4dd7-ab3a-15fadec0c70b tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Searching by: {'deleted': False, 'project_id': 'f082a1525e7a400b9248faddccccad57'} {{(pid=140524) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:17:08.911521 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b713e79-3c79-4dd7-ab3a-15fadec0c70b tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:08.912045 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b713e79-3c79-4dd7-ab3a-15fadec0c70b tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:08.912487 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b713e79-3c79-4dd7-ab3a-15fadec0c70b tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:08.918592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b713e79-3c79-4dd7-ab3a-15fadec0c70b tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:08.919230 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b713e79-3c79-4dd7-ab3a-15fadec0c70b tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:08.919686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b713e79-3c79-4dd7-ab3a-15fadec0c70b tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:08.983955 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.multi_cell_list [None req-2b713e79-3c79-4dd7-ab3a-15fadec0c70b tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140524) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 21:17:09.030902 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2b713e79-3c79-4dd7-ab3a-15fadec0c70b tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.151016 Sep 17 21:17:09.032625 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2680/5270] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Sep 17 21:17:08 2022] GET /compute/v2.1/servers => generated 683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:17:09.047030 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0b0afa99-7613-4c27-a514-f89e26f7bc7a tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:09.053485 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0b0afa99-7613-4c27-a514-f89e26f7bc7a tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:09.054206 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.compute.servers [None req-0b0afa99-7613-4c27-a514-f89e26f7bc7a tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Removing options 'limit' from query {{(pid=140523) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 17 21:17:09.055399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0b0afa99-7613-4c27-a514-f89e26f7bc7a tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Searching by: {'deleted': False, 'project_id': 'f082a1525e7a400b9248faddccccad57'} {{(pid=140523) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:17:09.062113 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0b0afa99-7613-4c27-a514-f89e26f7bc7a tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:09.062764 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0b0afa99-7613-4c27-a514-f89e26f7bc7a tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:09.063359 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0b0afa99-7613-4c27-a514-f89e26f7bc7a tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:09.064270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0b0afa99-7613-4c27-a514-f89e26f7bc7a tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:09.064880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0b0afa99-7613-4c27-a514-f89e26f7bc7a tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:09.065646 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0b0afa99-7613-4c27-a514-f89e26f7bc7a tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:09.093854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.multi_cell_list [None req-0b0afa99-7613-4c27-a514-f89e26f7bc7a tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=140523) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 21:17:09.135681 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0b0afa99-7613-4c27-a514-f89e26f7bc7a tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.094566 Sep 17 21:17:09.136760 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2591/5271] 10.222.0.26 () {58 vars in 1144 bytes} [Sat Sep 17 21:17:09 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:17:09.157876 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7466f99b-4ae3-4e9a-96d7-865621c46b34 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7466f99b-4ae3-4e9a-96d7-865621c46b34 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Request method failure captured: Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjkm39QchJ1bStZzJgn_rwieqbBmkL_e_gmMYpZTAvszDj2G908EMQsq6iFVvbfpi1UGMTa_h4daNs7A3C6rmqXljifAy7Lv3Y6Cb_gz77iUVItjZ46qQnmykCGvwOkXrvIpxZ2ydot8i9RpiN6y_9y5mMgYi6RebGZnjUJYLE8imfY Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: f082a1525e7a400b9248faddccccad57 Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ListServersNegativeTestJSON-714359434 Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f082a1525e7a400b9248faddccccad57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f082a1525e7a400b9248faddccccad57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f082a1525e7a400b9248faddccccad57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f082a1525e7a400b9248faddccccad57", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ListServersNegativeTestJSON-714359434 Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: f082a1525e7a400b9248faddccccad57 Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-714359434 Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ListServersNegativeTestJSON-714359434-project Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: a19f3d81b25a452997230984e774d3a8 Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ListServersNegativeTestJSON-714359434-project Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: action_args: {} Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise error Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi '-1' Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 17 21:17:09.163810 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 17 21:17:09.168432 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 21:17:09.168432 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 21:17:09.168432 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 21:17:09.168432 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 21:17:09.168432 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 17 21:17:09.168432 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:17:09.168432 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:17:09.168432 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:17:09.168432 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:17:09.168432 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:17:09.168432 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:17:09.168432 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 21:17:09.168432 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 21:17:09.168432 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 17 21:17:09.168432 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:17:09.170251 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7466f99b-4ae3-4e9a-96d7-865621c46b34 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:17:09.171287 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7466f99b-4ae3-4e9a-96d7-865621c46b34 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.025589 Sep 17 21:17:09.172609 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2681/5272] 10.222.0.26 () {58 vars in 1142 bytes} [Sat Sep 17 21:17:09 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:17:09.182168 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6c24f3c5-6287-47e4-8c11-d396776d1006 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6c24f3c5-6287-47e4-8c11-d396776d1006 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Request method failure captured: Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjkm39QchJ1bStZzJgn_rwieqbBmkL_e_gmMYpZTAvszDj2G908EMQsq6iFVvbfpi1UGMTa_h4daNs7A3C6rmqXljifAy7Lv3Y6Cb_gz77iUVItjZ46qQnmykCGvwOkXrvIpxZ2ydot8i9RpiN6y_9y5mMgYi6RebGZnjUJYLE8imfY Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: f082a1525e7a400b9248faddccccad57 Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ListServersNegativeTestJSON-714359434 Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f082a1525e7a400b9248faddccccad57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f082a1525e7a400b9248faddccccad57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f082a1525e7a400b9248faddccccad57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f082a1525e7a400b9248faddccccad57", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ListServersNegativeTestJSON-714359434 Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: f082a1525e7a400b9248faddccccad57 Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-714359434 Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ListServersNegativeTestJSON-714359434-project Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: a19f3d81b25a452997230984e774d3a8 Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ListServersNegativeTestJSON-714359434-project Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: action_args: {} Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise error Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi 'testing' Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 17 21:17:09.186144 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 17 21:17:09.190795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 21:17:09.190795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 21:17:09.190795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 21:17:09.190795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 21:17:09.190795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 17 21:17:09.190795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:09.190795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:17:09.190795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:09.190795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:17:09.190795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:17:09.190795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:17:09.190795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 21:17:09.190795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 21:17:09.190795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 17 21:17:09.190795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:09.190795 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6c24f3c5-6287-47e4-8c11-d396776d1006 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:17:09.190795 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6c24f3c5-6287-47e4-8c11-d396776d1006 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.010209 Sep 17 21:17:09.194570 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2592/5273] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Sep 17 21:17:09 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:17:09.203607 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5272d313-a3a8-435f-acf7-68d3345938d2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:09.210248 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5272d313-a3a8-435f-acf7-68d3345938d2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:09.217353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5272d313-a3a8-435f-acf7-68d3345938d2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'f082a1525e7a400b9248faddccccad57'} {{(pid=140524) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:17:09.229445 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.compute.servers [None req-5272d313-a3a8-435f-acf7-68d3345938d2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Flavor 'non_existing_flavor' could not be found {{(pid=140524) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Sep 17 21:17:09.230593 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5272d313-a3a8-435f-acf7-68d3345938d2 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.034845 Sep 17 21:17:09.234379 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2682/5274] 10.222.0.26 () {58 vars in 1178 bytes} [Sat Sep 17 21:17:09 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 17 21:17:09.245683 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9e00eef9-7d5e-4a3f-8ddc-b83fd1c743ae tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:09.251563 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9e00eef9-7d5e-4a3f-8ddc-b83fd1c743ae tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:09.252308 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9e00eef9-7d5e-4a3f-8ddc-b83fd1c743ae tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'f082a1525e7a400b9248faddccccad57'} {{(pid=140523) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:17:09.259263 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e00eef9-7d5e-4a3f-8ddc-b83fd1c743ae tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:09.259626 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e00eef9-7d5e-4a3f-8ddc-b83fd1c743ae tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:09.260258 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e00eef9-7d5e-4a3f-8ddc-b83fd1c743ae tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:09.262779 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e00eef9-7d5e-4a3f-8ddc-b83fd1c743ae tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:09.263421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e00eef9-7d5e-4a3f-8ddc-b83fd1c743ae tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:09.264425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e00eef9-7d5e-4a3f-8ddc-b83fd1c743ae tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:09.363507 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9e00eef9-7d5e-4a3f-8ddc-b83fd1c743ae tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.121969 Sep 17 21:17:09.380569 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b862bdb7-f4eb-4953-ae02-614c929efea0 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:09.387386 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2593/5275] 10.222.0.26 () {58 vars in 1174 bytes} [Sat Sep 17 21:17:09 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:17:09.387742 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b862bdb7-f4eb-4953-ae02-614c929efea0 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:09.388604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b862bdb7-f4eb-4953-ae02-614c929efea0 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'f082a1525e7a400b9248faddccccad57'} {{(pid=140524) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:17:09.395608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b862bdb7-f4eb-4953-ae02-614c929efea0 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:09.396292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b862bdb7-f4eb-4953-ae02-614c929efea0 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:09.397190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b862bdb7-f4eb-4953-ae02-614c929efea0 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:09.398194 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b862bdb7-f4eb-4953-ae02-614c929efea0 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:09.398928 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b862bdb7-f4eb-4953-ae02-614c929efea0 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:09.399565 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b862bdb7-f4eb-4953-ae02-614c929efea0 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:09.537286 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b862bdb7-f4eb-4953-ae02-614c929efea0 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.162230 Sep 17 21:17:09.538508 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2683/5276] 10.222.0.26 () {58 vars in 1184 bytes} [Sat Sep 17 21:17:09 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:17:09.550924 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d45da34f-03b7-40aa-bed9-bed6e6063a28 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:09.558631 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d45da34f-03b7-40aa-bed9-bed6e6063a28 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:09.571861 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d45da34f-03b7-40aa-bed9-bed6e6063a28 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Searching by: {'deleted': False, 'project_id': 'f082a1525e7a400b9248faddccccad57'} {{(pid=140523) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:17:09.601298 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d45da34f-03b7-40aa-bed9-bed6e6063a28 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:09.609995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d45da34f-03b7-40aa-bed9-bed6e6063a28 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:09.610658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d45da34f-03b7-40aa-bed9-bed6e6063a28 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:09.611510 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d45da34f-03b7-40aa-bed9-bed6e6063a28 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:09.611990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d45da34f-03b7-40aa-bed9-bed6e6063a28 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:09.612415 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d45da34f-03b7-40aa-bed9-bed6e6063a28 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:09.732718 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.multi_cell_list [None req-d45da34f-03b7-40aa-bed9-bed6e6063a28 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140523) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 21:17:09.780167 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2ed0db53-5dca-4982-a382-9e63829baf60 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1626088078", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-637496389", "security_groups": [{"name": "tempest-secgroup-smoke-1504759707"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "cfa52b76-4588-42de-a9fa-7a5fb5b98ba3"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:17:09.805829 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d45da34f-03b7-40aa-bed9-bed6e6063a28 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:09.822086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d45da34f-03b7-40aa-bed9-bed6e6063a28 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:09.823000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d45da34f-03b7-40aa-bed9-bed6e6063a28 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:09.823616 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d45da34f-03b7-40aa-bed9-bed6e6063a28 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:10.191113 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-2ed0db53-5dca-4982-a382-9e63829baf60 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] validate_networks() for [('cfa52b76-4588-42de-a9fa-7a5fb5b98ba3', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:17:10.427274 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d45da34f-03b7-40aa-bed9-bed6e6063a28 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 0.880614 Sep 17 21:17:10.428735 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2594/5277] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 21:17:09 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:10.457744 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-782f50c1-93a2-421e-b63b-eb0ad9f9b712 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:10.465131 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-782f50c1-93a2-421e-b63b-eb0ad9f9b712 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:10.468013 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-782f50c1-93a2-421e-b63b-eb0ad9f9b712 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.014407 Sep 17 21:17:10.475056 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2595/5278] 10.222.0.26 () {58 vars in 1178 bytes} [Sat Sep 17 21:17:10 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:17:10.487398 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-660c520d-03f1-4268-93d8-5561a3eb557c tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:10.497028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-660c520d-03f1-4268-93d8-5561a3eb557c tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:10.498194 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-660c520d-03f1-4268-93d8-5561a3eb557c tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Searching by: {'deleted': False, 'project_id': 'f082a1525e7a400b9248faddccccad57'} {{(pid=140523) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:17:10.506670 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-660c520d-03f1-4268-93d8-5561a3eb557c tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:10.511328 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-660c520d-03f1-4268-93d8-5561a3eb557c tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:10.512008 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-660c520d-03f1-4268-93d8-5561a3eb557c tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:10.514956 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-660c520d-03f1-4268-93d8-5561a3eb557c tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:10.515674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-660c520d-03f1-4268-93d8-5561a3eb557c tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:10.517791 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-660c520d-03f1-4268-93d8-5561a3eb557c tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:10.572413 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.multi_cell_list [None req-660c520d-03f1-4268-93d8-5561a3eb557c tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=140523) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 21:17:10.642972 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-660c520d-03f1-4268-93d8-5561a3eb557c tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.159631 Sep 17 21:17:10.643598 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2596/5279] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Sep 17 21:17:10 2022] GET /compute/v2.1/servers => generated 683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:17:10.658316 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2578af05-dfb8-44b8-81d4-e6a685581c1d tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:10.658911 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2578af05-dfb8-44b8-81d4-e6a685581c1d tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:10.677643 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2578af05-dfb8-44b8-81d4-e6a685581c1d tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:10.678176 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2578af05-dfb8-44b8-81d4-e6a685581c1d tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:10.678945 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2578af05-dfb8-44b8-81d4-e6a685581c1d tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:10.679508 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2578af05-dfb8-44b8-81d4-e6a685581c1d tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:10.680126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2578af05-dfb8-44b8-81d4-e6a685581c1d tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:10.680584 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2578af05-dfb8-44b8-81d4-e6a685581c1d tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:10.717348 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-2578af05-dfb8-44b8-81d4-e6a685581c1d tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] HTTP exception thrown: Instance c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082 could not be found. Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2578af05-dfb8-44b8-81d4-e6a685581c1d tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Request method failure captured: Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082 HTTP/1.1 Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjkm39QchJ1bStZzJgn_rwieqbBmkL_e_gmMYpZTAvszDj2G908EMQsq6iFVvbfpi1UGMTa_h4daNs7A3C6rmqXljifAy7Lv3Y6Cb_gz77iUVItjZ46qQnmykCGvwOkXrvIpxZ2ydot8i9RpiN6y_9y5mMgYi6RebGZnjUJYLE8imfY Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: f082a1525e7a400b9248faddccccad57 Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ListServersNegativeTestJSON-714359434 Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f082a1525e7a400b9248faddccccad57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f082a1525e7a400b9248faddccccad57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f082a1525e7a400b9248faddccccad57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f082a1525e7a400b9248faddccccad57", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ListServersNegativeTestJSON-714359434 Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: f082a1525e7a400b9248faddccccad57 Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-714359434 Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ListServersNegativeTestJSON-714359434-project Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: a19f3d81b25a452997230984e774d3a8 Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ListServersNegativeTestJSON-714359434-project Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082 could not be found. Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082'} Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082 could not be found. Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:17:10.719020 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:17:10.723095 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082 could not be found. Sep 17 21:17:10.723095 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:10.723095 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:17:10.723095 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:10.723095 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:17:10.723095 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:17:10.723095 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:17:10.723095 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:17:10.723095 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:17:10.723095 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082 could not be found. Sep 17 21:17:10.723095 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:10.730345 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2578af05-dfb8-44b8-81d4-e6a685581c1d tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Returning 404 to user: Instance c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:17:10.743082 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2578af05-dfb8-44b8-81d4-e6a685581c1d tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082" status: 404 len: 111 microversion: 2.1 time: 0.089212 Sep 17 21:17:10.743789 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2597/5280] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:17:10 2022] DELETE /compute/v2.1/servers/c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 21:17:10.753015 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4a72089d-a5cd-4b23-aa9f-f203e2acb602 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:10.759991 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4a72089d-a5cd-4b23-aa9f-f203e2acb602 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: 4e0db75a-49c1-4693-ad54-79a1c20aac86] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:10.770480 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a72089d-a5cd-4b23-aa9f-f203e2acb602 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:10.770990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a72089d-a5cd-4b23-aa9f-f203e2acb602 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:10.771592 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a72089d-a5cd-4b23-aa9f-f203e2acb602 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:10.772328 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a72089d-a5cd-4b23-aa9f-f203e2acb602 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:10.772788 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a72089d-a5cd-4b23-aa9f-f203e2acb602 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:10.778455 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a72089d-a5cd-4b23-aa9f-f203e2acb602 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:10.834759 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4a72089d-a5cd-4b23-aa9f-f203e2acb602 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: 4e0db75a-49c1-4693-ad54-79a1c20aac86] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:17:11.039053 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4a72089d-a5cd-4b23-aa9f-f203e2acb602 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4e0db75a-49c1-4693-ad54-79a1c20aac86" status: 204 len: 0 microversion: 2.1 time: 0.290017 Sep 17 21:17:11.039637 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2598/5281] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:17:10 2022] DELETE /compute/v2.1/servers/4e0db75a-49c1-4693-ad54-79a1c20aac86 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 17 21:17:11.048862 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6888e66e-8690-4bc5-a8eb-84a8a7343df7 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:11.049926 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6888e66e-8690-4bc5-a8eb-84a8a7343df7 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: de3c1689-cd5c-4d17-820d-5ae1624d7fcc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:11.063631 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6888e66e-8690-4bc5-a8eb-84a8a7343df7 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:11.064145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6888e66e-8690-4bc5-a8eb-84a8a7343df7 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:11.064591 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6888e66e-8690-4bc5-a8eb-84a8a7343df7 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:11.065326 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6888e66e-8690-4bc5-a8eb-84a8a7343df7 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:11.065819 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6888e66e-8690-4bc5-a8eb-84a8a7343df7 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:11.066357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6888e66e-8690-4bc5-a8eb-84a8a7343df7 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:11.130790 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6888e66e-8690-4bc5-a8eb-84a8a7343df7 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: de3c1689-cd5c-4d17-820d-5ae1624d7fcc] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:17:11.279322 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6888e66e-8690-4bc5-a8eb-84a8a7343df7 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "DELETE /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc" status: 204 len: 0 microversion: 2.1 time: 0.234361 Sep 17 21:17:11.284053 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2599/5282] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:17:11 2022] DELETE /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 17 21:17:11.292985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c0f729a1-3e88-4d26-989b-8d04678d121c tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:11.294774 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c0f729a1-3e88-4d26-989b-8d04678d121c tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:11.319751 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0f729a1-3e88-4d26-989b-8d04678d121c tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:11.320462 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0f729a1-3e88-4d26-989b-8d04678d121c tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:11.327582 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0f729a1-3e88-4d26-989b-8d04678d121c tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:11.329512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0f729a1-3e88-4d26-989b-8d04678d121c tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:11.330203 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0f729a1-3e88-4d26-989b-8d04678d121c tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:11.330797 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0f729a1-3e88-4d26-989b-8d04678d121c tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:11.362960 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-c0f729a1-3e88-4d26-989b-8d04678d121c tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] HTTP exception thrown: Instance c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082 could not be found. Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c0f729a1-3e88-4d26-989b-8d04678d121c tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Request method failure captured: Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082 HTTP/1.1 Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjkm39QchJ1bStZzJgn_rwieqbBmkL_e_gmMYpZTAvszDj2G908EMQsq6iFVvbfpi1UGMTa_h4daNs7A3C6rmqXljifAy7Lv3Y6Cb_gz77iUVItjZ46qQnmykCGvwOkXrvIpxZ2ydot8i9RpiN6y_9y5mMgYi6RebGZnjUJYLE8imfY Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: f082a1525e7a400b9248faddccccad57 Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ListServersNegativeTestJSON-714359434 Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f082a1525e7a400b9248faddccccad57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f082a1525e7a400b9248faddccccad57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f082a1525e7a400b9248faddccccad57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f082a1525e7a400b9248faddccccad57", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ListServersNegativeTestJSON-714359434 Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: f082a1525e7a400b9248faddccccad57 Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-714359434 Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ListServersNegativeTestJSON-714359434-project Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: a19f3d81b25a452997230984e774d3a8 Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ListServersNegativeTestJSON-714359434-project Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082 could not be found. Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082'} Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082 could not be found. Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082 could not be found. Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:11.367438 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:17:11.371984 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:11.371984 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:17:11.371984 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:17:11.371984 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:17:11.371984 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:17:11.371984 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:17:11.371984 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082 could not be found. Sep 17 21:17:11.371984 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:11.374878 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c0f729a1-3e88-4d26-989b-8d04678d121c tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Returning 404 to user: Instance c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:17:11.378661 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c0f729a1-3e88-4d26-989b-8d04678d121c tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082" status: 404 len: 111 microversion: 2.1 time: 0.093332 Sep 17 21:17:11.383424 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2600/5283] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:11 2022] GET /compute/v2.1/servers/c697cdf1-4ab4-4b5a-86a4-59a8c9d4f082 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:17:11.398625 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ab10a82c-222b-48bf-adff-ba20312fe056 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:11.414683 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ab10a82c-222b-48bf-adff-ba20312fe056 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: 4e0db75a-49c1-4693-ad54-79a1c20aac86] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:11.436056 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab10a82c-222b-48bf-adff-ba20312fe056 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:11.436713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab10a82c-222b-48bf-adff-ba20312fe056 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:11.437204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab10a82c-222b-48bf-adff-ba20312fe056 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:11.438035 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab10a82c-222b-48bf-adff-ba20312fe056 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:11.438540 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab10a82c-222b-48bf-adff-ba20312fe056 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:11.438969 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab10a82c-222b-48bf-adff-ba20312fe056 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:11.638586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-2ed0db53-5dca-4982-a382-9e63829baf60 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Getting quotas for project 09f16a815901466791a114b9a19cc763. Resources: dict_keys(['metadata_items']) {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:17:11.652491 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-2ed0db53-5dca-4982-a382-9e63829baf60 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Getting quotas for user df6cec0e04954a3eba096b48a7cd2189 and project 09f16a815901466791a114b9a19cc763. Resources: dict_keys(['metadata_items']) {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:17:11.697323 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-2ed0db53-5dca-4982-a382-9e63829baf60 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:17:11.697803 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-2ed0db53-5dca-4982-a382-9e63829baf60 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:17:11.708146 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-2ed0db53-5dca-4982-a382-9e63829baf60 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:17:11.708851 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-2ed0db53-5dca-4982-a382-9e63829baf60 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:17:11.709294 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-2ed0db53-5dca-4982-a382-9e63829baf60 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:17:11.735752 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ed0db53-5dca-4982-a382-9e63829baf60 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:11.736284 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ed0db53-5dca-4982-a382-9e63829baf60 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:11.739295 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ed0db53-5dca-4982-a382-9e63829baf60 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:11.742094 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ed0db53-5dca-4982-a382-9e63829baf60 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:11.743651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ed0db53-5dca-4982-a382-9e63829baf60 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:11.746000 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ed0db53-5dca-4982-a382-9e63829baf60 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:11.804119 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-2ed0db53-5dca-4982-a382-9e63829baf60 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Getting quotas for project 09f16a815901466791a114b9a19cc763. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:17:11.829851 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-2ed0db53-5dca-4982-a382-9e63829baf60 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Getting quotas for user df6cec0e04954a3eba096b48a7cd2189 and project 09f16a815901466791a114b9a19cc763. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:17:11.865016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2ed0db53-5dca-4982-a382-9e63829baf60 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:17:11.873419 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2ed0db53-5dca-4982-a382-9e63829baf60 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] [instance: 4cf30912-b358-44af-ae25-2ce3f03ffd19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:17:12.009699 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2ed0db53-5dca-4982-a382-9e63829baf60 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.236089 Sep 17 21:17:12.026244 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2684/5284] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:17:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 2253 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:17:12.047613 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a7c64343-34b2-4bd4-a0e6-a48fe318159a tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:12.049348 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a7c64343-34b2-4bd4-a0e6-a48fe318159a tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] [instance: 4cf30912-b358-44af-ae25-2ce3f03ffd19] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:12.260451 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a7c64343-34b2-4bd4-a0e6-a48fe318159a tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6cec0e04954a3eba096b48a7cd2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f16a815901466791a114b9a19cc763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:12.274872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ab10a82c-222b-48bf-adff-ba20312fe056 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:12.281248 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a7c64343-34b2-4bd4-a0e6-a48fe318159a tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] 10.222.0.26 "GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19" status: 200 len: 1302 microversion: 2.1 time: 0.252382 Sep 17 21:17:12.282012 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2685/5285] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:12 2022] GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19 => generated 1302 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:12.284640 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ab10a82c-222b-48bf-adff-ba20312fe056 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/4e0db75a-49c1-4693-ad54-79a1c20aac86" status: 200 len: 1523 microversion: 2.1 time: 0.899927 Sep 17 21:17:12.290947 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2601/5286] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:11 2022] GET /compute/v2.1/servers/4e0db75a-49c1-4693-ad54-79a1c20aac86 => generated 1523 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:13.307660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b2eae926-2907-466a-84cd-04c83d2f05c0 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:13.308989 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b2eae926-2907-466a-84cd-04c83d2f05c0 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] [instance: 4cf30912-b358-44af-ae25-2ce3f03ffd19] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:13.322165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e06a3be4-374a-4234-9a1d-9bc447fbc66d tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:13.323900 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e06a3be4-374a-4234-9a1d-9bc447fbc66d tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: 4e0db75a-49c1-4693-ad54-79a1c20aac86] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:13.327466 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b2eae926-2907-466a-84cd-04c83d2f05c0 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:13.328461 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b2eae926-2907-466a-84cd-04c83d2f05c0 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:13.329066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b2eae926-2907-466a-84cd-04c83d2f05c0 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:13.330044 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b2eae926-2907-466a-84cd-04c83d2f05c0 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:13.330663 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b2eae926-2907-466a-84cd-04c83d2f05c0 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:13.331295 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b2eae926-2907-466a-84cd-04c83d2f05c0 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:13.363939 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e06a3be4-374a-4234-9a1d-9bc447fbc66d tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:13.367494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=96 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:17:13.367647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e06a3be4-374a-4234-9a1d-9bc447fbc66d tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:13.369076 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e06a3be4-374a-4234-9a1d-9bc447fbc66d tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:13.371590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e06a3be4-374a-4234-9a1d-9bc447fbc66d tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:13.374529 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e06a3be4-374a-4234-9a1d-9bc447fbc66d tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:13.375725 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e06a3be4-374a-4234-9a1d-9bc447fbc66d tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:13.483952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b2eae926-2907-466a-84cd-04c83d2f05c0 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6cec0e04954a3eba096b48a7cd2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f16a815901466791a114b9a19cc763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:13.502035 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b2eae926-2907-466a-84cd-04c83d2f05c0 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] 10.222.0.26 "GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19" status: 200 len: 1354 microversion: 2.1 time: 0.200115 Sep 17 21:17:13.503133 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2686/5287] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:13 2022] GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19 => generated 1354 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:14.054577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e06a3be4-374a-4234-9a1d-9bc447fbc66d tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:14.069768 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e06a3be4-374a-4234-9a1d-9bc447fbc66d tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/4e0db75a-49c1-4693-ad54-79a1c20aac86" status: 200 len: 1523 microversion: 2.1 time: 0.757024 Sep 17 21:17:14.071525 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2602/5288] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:13 2022] GET /compute/v2.1/servers/4e0db75a-49c1-4693-ad54-79a1c20aac86 => generated 1523 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:17:14.531090 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-52d878a8-9ad9-4102-8ca9-9c221ed42505 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:14.532310 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-52d878a8-9ad9-4102-8ca9-9c221ed42505 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] [instance: 4cf30912-b358-44af-ae25-2ce3f03ffd19] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:14.539370 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-52d878a8-9ad9-4102-8ca9-9c221ed42505 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:14.540085 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-52d878a8-9ad9-4102-8ca9-9c221ed42505 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:14.540775 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-52d878a8-9ad9-4102-8ca9-9c221ed42505 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:14.541670 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-52d878a8-9ad9-4102-8ca9-9c221ed42505 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:14.542119 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-52d878a8-9ad9-4102-8ca9-9c221ed42505 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:14.542717 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-52d878a8-9ad9-4102-8ca9-9c221ed42505 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:14.635721 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-52d878a8-9ad9-4102-8ca9-9c221ed42505 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6cec0e04954a3eba096b48a7cd2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f16a815901466791a114b9a19cc763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:14.656687 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-52d878a8-9ad9-4102-8ca9-9c221ed42505 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] 10.222.0.26 "GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19" status: 200 len: 1360 microversion: 2.1 time: 0.128407 Sep 17 21:17:14.672609 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2687/5289] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:14 2022] GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19 => generated 1360 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:14.810344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-83ceecb1-5515-4c5b-b06c-8f1223dd7186 req-8225e3a9-01f8-4a8f-84f9-dee3d297e830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e0db75a-49c1-4693-ad54-79a1c20aac86", "name": "network-vif-deleted", "tag": "142af4b2-a98f-48b8-85b1-745d2fae5881"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:17:14.831923 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-83ceecb1-5515-4c5b-b06c-8f1223dd7186 req-8225e3a9-01f8-4a8f-84f9-dee3d297e830 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:14.832407 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-83ceecb1-5515-4c5b-b06c-8f1223dd7186 req-8225e3a9-01f8-4a8f-84f9-dee3d297e830 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:14.832862 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-83ceecb1-5515-4c5b-b06c-8f1223dd7186 req-8225e3a9-01f8-4a8f-84f9-dee3d297e830 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:14.862068 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-83ceecb1-5515-4c5b-b06c-8f1223dd7186 req-8225e3a9-01f8-4a8f-84f9-dee3d297e830 service nova] Creating event network-vif-deleted:142af4b2-a98f-48b8-85b1-745d2fae5881 for instance 4e0db75a-49c1-4693-ad54-79a1c20aac86 on nch2-master-1 Sep 17 21:17:14.873866 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-83ceecb1-5515-4c5b-b06c-8f1223dd7186 req-8225e3a9-01f8-4a8f-84f9-dee3d297e830 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068692 Sep 17 21:17:14.875430 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2603/5290] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:17:15.092782 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-855e1073-2c32-4b7e-96ea-46406328cea9 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:15.093555 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-855e1073-2c32-4b7e-96ea-46406328cea9 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: 4e0db75a-49c1-4693-ad54-79a1c20aac86] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:15.096533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:17:15.118398 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-855e1073-2c32-4b7e-96ea-46406328cea9 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:15.122198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-855e1073-2c32-4b7e-96ea-46406328cea9 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:15.122694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-855e1073-2c32-4b7e-96ea-46406328cea9 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:15.127065 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-855e1073-2c32-4b7e-96ea-46406328cea9 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:15.127545 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-855e1073-2c32-4b7e-96ea-46406328cea9 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:15.127970 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-855e1073-2c32-4b7e-96ea-46406328cea9 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:15.213337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-855e1073-2c32-4b7e-96ea-46406328cea9 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:15.213856 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-855e1073-2c32-4b7e-96ea-46406328cea9 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:15.214348 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-855e1073-2c32-4b7e-96ea-46406328cea9 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:15.214810 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-855e1073-2c32-4b7e-96ea-46406328cea9 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lazy-loading 'fault' on Instance uuid 4e0db75a-49c1-4693-ad54-79a1c20aac86 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:17:15.432068 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-855e1073-2c32-4b7e-96ea-46406328cea9 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a19f3d81b25a452997230984e774d3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f082a1525e7a400b9248faddccccad57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:15.447196 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-855e1073-2c32-4b7e-96ea-46406328cea9 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/4e0db75a-49c1-4693-ad54-79a1c20aac86" status: 200 len: 1313 microversion: 2.1 time: 0.358424 Sep 17 21:17:15.458994 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2688/5291] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:15 2022] GET /compute/v2.1/servers/4e0db75a-49c1-4693-ad54-79a1c20aac86 => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:15.521918 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0494540b-1eee-465b-b40f-51b3239bb312 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:15.522915 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0494540b-1eee-465b-b40f-51b3239bb312 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:15.536605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0494540b-1eee-465b-b40f-51b3239bb312 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:15.537615 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0494540b-1eee-465b-b40f-51b3239bb312 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:15.538291 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0494540b-1eee-465b-b40f-51b3239bb312 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:15.540136 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0494540b-1eee-465b-b40f-51b3239bb312 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:15.541010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0494540b-1eee-465b-b40f-51b3239bb312 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:15.541703 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0494540b-1eee-465b-b40f-51b3239bb312 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:15.578817 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0494540b-1eee-465b-b40f-51b3239bb312 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16/ips" status: 200 len: 145 microversion: 2.1 time: 0.076730 Sep 17 21:17:15.580150 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2604/5292] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Sep 17 21:17:15 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16/ips => generated 145 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:17:15.683774 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-92e8db9c-f3f1-4914-8190-bed599b20607 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:15.684675 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-92e8db9c-f3f1-4914-8190-bed599b20607 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] [instance: 4cf30912-b358-44af-ae25-2ce3f03ffd19] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:15.703832 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92e8db9c-f3f1-4914-8190-bed599b20607 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:15.704333 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92e8db9c-f3f1-4914-8190-bed599b20607 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:15.704776 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92e8db9c-f3f1-4914-8190-bed599b20607 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:15.705608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92e8db9c-f3f1-4914-8190-bed599b20607 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:15.712281 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92e8db9c-f3f1-4914-8190-bed599b20607 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:15.712851 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92e8db9c-f3f1-4914-8190-bed599b20607 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:16.295023 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-92e8db9c-f3f1-4914-8190-bed599b20607 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6cec0e04954a3eba096b48a7cd2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f16a815901466791a114b9a19cc763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:16.303554 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-92e8db9c-f3f1-4914-8190-bed599b20607 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] 10.222.0.26 "GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19" status: 200 len: 1428 microversion: 2.1 time: 0.624657 Sep 17 21:17:16.313640 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2689/5293] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:15 2022] GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19 => generated 1428 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:16.488682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5e3bf1a2-e208-40e8-a0f5-f2c7cdf56060 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:16.489995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5e3bf1a2-e208-40e8-a0f5-f2c7cdf56060 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: 4e0db75a-49c1-4693-ad54-79a1c20aac86] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:16.507024 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e3bf1a2-e208-40e8-a0f5-f2c7cdf56060 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:16.508837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e3bf1a2-e208-40e8-a0f5-f2c7cdf56060 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:16.509929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e3bf1a2-e208-40e8-a0f5-f2c7cdf56060 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:16.511212 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e3bf1a2-e208-40e8-a0f5-f2c7cdf56060 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:16.512325 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e3bf1a2-e208-40e8-a0f5-f2c7cdf56060 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:16.513046 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e3bf1a2-e208-40e8-a0f5-f2c7cdf56060 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:16.563372 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-5e3bf1a2-e208-40e8-a0f5-f2c7cdf56060 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] HTTP exception thrown: Instance 4e0db75a-49c1-4693-ad54-79a1c20aac86 could not be found. Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5e3bf1a2-e208-40e8-a0f5-f2c7cdf56060 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Request method failure captured: Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/4e0db75a-49c1-4693-ad54-79a1c20aac86 HTTP/1.1 Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjkm39QchJ1bStZzJgn_rwieqbBmkL_e_gmMYpZTAvszDj2G908EMQsq6iFVvbfpi1UGMTa_h4daNs7A3C6rmqXljifAy7Lv3Y6Cb_gz77iUVItjZ46qQnmykCGvwOkXrvIpxZ2ydot8i9RpiN6y_9y5mMgYi6RebGZnjUJYLE8imfY Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: f082a1525e7a400b9248faddccccad57 Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ListServersNegativeTestJSON-714359434 Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f082a1525e7a400b9248faddccccad57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f082a1525e7a400b9248faddccccad57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f082a1525e7a400b9248faddccccad57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f082a1525e7a400b9248faddccccad57", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ListServersNegativeTestJSON-714359434 Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: f082a1525e7a400b9248faddccccad57 Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-714359434 Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ListServersNegativeTestJSON-714359434-project Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: a19f3d81b25a452997230984e774d3a8 Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ListServersNegativeTestJSON-714359434-project Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 4e0db75a-49c1-4693-ad54-79a1c20aac86 could not be found. Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '4e0db75a-49c1-4693-ad54-79a1c20aac86'} Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e0db75a-49c1-4693-ad54-79a1c20aac86 could not be found. Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e0db75a-49c1-4693-ad54-79a1c20aac86 could not be found. Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:16.566036 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:17:16.570828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:16.570828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:17:16.570828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:17:16.570828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:17:16.570828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:17:16.570828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:17:16.570828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e0db75a-49c1-4693-ad54-79a1c20aac86 could not be found. Sep 17 21:17:16.570828 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:17:16.576685 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5e3bf1a2-e208-40e8-a0f5-f2c7cdf56060 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Returning 404 to user: Instance 4e0db75a-49c1-4693-ad54-79a1c20aac86 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:17:16.577866 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5e3bf1a2-e208-40e8-a0f5-f2c7cdf56060 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/4e0db75a-49c1-4693-ad54-79a1c20aac86" status: 404 len: 111 microversion: 2.1 time: 0.095428 Sep 17 21:17:16.579148 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2605/5294] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:16 2022] GET /compute/v2.1/servers/4e0db75a-49c1-4693-ad54-79a1c20aac86 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:17:16.586899 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0e7235c3-f424-44f7-a425-0ce68cb394a1 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:16.587523 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0e7235c3-f424-44f7-a425-0ce68cb394a1 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] [instance: de3c1689-cd5c-4d17-820d-5ae1624d7fcc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:16.604760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0e7235c3-f424-44f7-a425-0ce68cb394a1 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:16.606435 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0e7235c3-f424-44f7-a425-0ce68cb394a1 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:16.607149 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0e7235c3-f424-44f7-a425-0ce68cb394a1 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:16.608125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0e7235c3-f424-44f7-a425-0ce68cb394a1 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:16.608658 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0e7235c3-f424-44f7-a425-0ce68cb394a1 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:16.609171 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0e7235c3-f424-44f7-a425-0ce68cb394a1 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:16.653566 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-0e7235c3-f424-44f7-a425-0ce68cb394a1 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] HTTP exception thrown: Instance de3c1689-cd5c-4d17-820d-5ae1624d7fcc could not be found. Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0e7235c3-f424-44f7-a425-0ce68cb394a1 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Request method failure captured: Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc HTTP/1.1 Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjkm39QchJ1bStZzJgn_rwieqbBmkL_e_gmMYpZTAvszDj2G908EMQsq6iFVvbfpi1UGMTa_h4daNs7A3C6rmqXljifAy7Lv3Y6Cb_gz77iUVItjZ46qQnmykCGvwOkXrvIpxZ2ydot8i9RpiN6y_9y5mMgYi6RebGZnjUJYLE8imfY Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: f082a1525e7a400b9248faddccccad57 Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ListServersNegativeTestJSON-714359434 Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f082a1525e7a400b9248faddccccad57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f082a1525e7a400b9248faddccccad57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f082a1525e7a400b9248faddccccad57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f082a1525e7a400b9248faddccccad57", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ListServersNegativeTestJSON-714359434 Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: f082a1525e7a400b9248faddccccad57 Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-714359434 Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ListServersNegativeTestJSON-714359434-project Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: a19f3d81b25a452997230984e774d3a8 Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ListServersNegativeTestJSON-714359434-project Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance de3c1689-cd5c-4d17-820d-5ae1624d7fcc could not be found. Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'de3c1689-cd5c-4d17-820d-5ae1624d7fcc'} Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de3c1689-cd5c-4d17-820d-5ae1624d7fcc could not be found. Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de3c1689-cd5c-4d17-820d-5ae1624d7fcc could not be found. Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:17:16.656639 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:17:16.660731 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:17:16.660731 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:17:16.660731 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:17:16.660731 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:17:16.660731 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:17:16.660731 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:17:16.660731 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de3c1689-cd5c-4d17-820d-5ae1624d7fcc could not be found. Sep 17 21:17:16.660731 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:17:16.663524 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0e7235c3-f424-44f7-a425-0ce68cb394a1 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] Returning 404 to user: Instance de3c1689-cd5c-4d17-820d-5ae1624d7fcc could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:17:16.664816 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0e7235c3-f424-44f7-a425-0ce68cb394a1 tempest-ListServersNegativeTestJSON-714359434 tempest-ListServersNegativeTestJSON-714359434-project] 10.222.0.26 "GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc" status: 404 len: 111 microversion: 2.1 time: 0.081828 Sep 17 21:17:16.666008 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2690/5295] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:16 2022] GET /compute/v2.1/servers/de3c1689-cd5c-4d17-820d-5ae1624d7fcc => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:17:16.923682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-4fc4b5e7-6b9a-44f0-8caf-9ac5226090af req-76cd859b-5d07-4b9d-9aa4-a60768fd0b14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de3c1689-cd5c-4d17-820d-5ae1624d7fcc", "name": "network-vif-deleted", "tag": "d65d4ba6-c6eb-49f6-a6f8-2741e2887401"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:17:16.945533 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-4fc4b5e7-6b9a-44f0-8caf-9ac5226090af req-76cd859b-5d07-4b9d-9aa4-a60768fd0b14 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:16.946327 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-4fc4b5e7-6b9a-44f0-8caf-9ac5226090af req-76cd859b-5d07-4b9d-9aa4-a60768fd0b14 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:16.947016 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-4fc4b5e7-6b9a-44f0-8caf-9ac5226090af req-76cd859b-5d07-4b9d-9aa4-a60768fd0b14 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:16.966154 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-4fc4b5e7-6b9a-44f0-8caf-9ac5226090af req-76cd859b-5d07-4b9d-9aa4-a60768fd0b14 service nova] Creating event network-vif-deleted:d65d4ba6-c6eb-49f6-a6f8-2741e2887401 for instance de3c1689-cd5c-4d17-820d-5ae1624d7fcc on nch1-master-1 Sep 17 21:17:16.974389 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-4fc4b5e7-6b9a-44f0-8caf-9ac5226090af req-76cd859b-5d07-4b9d-9aa4-a60768fd0b14 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055667 Sep 17 21:17:16.975265 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2606/5296] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:17:17.338882 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-479e05d1-c6da-4cd0-8797-a12fed78be22 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:17.339580 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-479e05d1-c6da-4cd0-8797-a12fed78be22 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] [instance: 4cf30912-b358-44af-ae25-2ce3f03ffd19] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:17.353670 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-479e05d1-c6da-4cd0-8797-a12fed78be22 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:17.354510 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-479e05d1-c6da-4cd0-8797-a12fed78be22 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:17.355604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-479e05d1-c6da-4cd0-8797-a12fed78be22 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:17.358279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-479e05d1-c6da-4cd0-8797-a12fed78be22 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:17.359214 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-479e05d1-c6da-4cd0-8797-a12fed78be22 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:17.359853 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-479e05d1-c6da-4cd0-8797-a12fed78be22 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:17.724285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-84e63d4b-ddec-42e4-a3b5-1a65e494b336 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:17.724850 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-84e63d4b-ddec-42e4-a3b5-1a65e494b336 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:17.736672 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:17:17.744153 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84e63d4b-ddec-42e4-a3b5-1a65e494b336 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:17.748770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-479e05d1-c6da-4cd0-8797-a12fed78be22 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6cec0e04954a3eba096b48a7cd2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f16a815901466791a114b9a19cc763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:17.753252 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84e63d4b-ddec-42e4-a3b5-1a65e494b336 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:17.754369 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84e63d4b-ddec-42e4-a3b5-1a65e494b336 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:17.755410 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84e63d4b-ddec-42e4-a3b5-1a65e494b336 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:17.759214 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84e63d4b-ddec-42e4-a3b5-1a65e494b336 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:17.759882 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84e63d4b-ddec-42e4-a3b5-1a65e494b336 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:17.760727 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-479e05d1-c6da-4cd0-8797-a12fed78be22 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] 10.222.0.26 "GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19" status: 200 len: 1428 microversion: 2.1 time: 0.426015 Sep 17 21:17:17.761853 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2691/5297] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:17 2022] GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19 => generated 1428 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:17.807520 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-84e63d4b-ddec-42e4-a3b5-1a65e494b336 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f/os-volume_attachments/b2bc9cfa-f40b-411e-8a44-20b3f6134615" status: 200 len: 194 microversion: 2.20 time: 0.093050 Sep 17 21:17:17.810281 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2607/5298] 10.222.0.26 () {60 vars in 1454 bytes} [Sat Sep 17 21:17:17 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f/os-volume_attachments/b2bc9cfa-f40b-411e-8a44-20b3f6134615 => generated 194 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:17:17.878479 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-342fcc2c-02a4-4830-ba42-689531c67116 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "779942d3-ce89-44ed-bbfc-e00719495d8e"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:17:17.881372 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-342fcc2c-02a4-4830-ba42-689531c67116 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:17.890822 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-342fcc2c-02a4-4830-ba42-689531c67116 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:17.901876 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-342fcc2c-02a4-4830-ba42-689531c67116 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:17.902473 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-342fcc2c-02a4-4830-ba42-689531c67116 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:17.903262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-342fcc2c-02a4-4830-ba42-689531c67116 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:17.903751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-342fcc2c-02a4-4830-ba42-689531c67116 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:17.904190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-342fcc2c-02a4-4830-ba42-689531c67116 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:17.923012 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8a0b749e-4abd-4d21-9f8f-6780dea2e55e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:17.923684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8a0b749e-4abd-4d21-9f8f-6780dea2e55e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:17.930977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8a0b749e-4abd-4d21-9f8f-6780dea2e55e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:17.931778 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8a0b749e-4abd-4d21-9f8f-6780dea2e55e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:17.934055 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8a0b749e-4abd-4d21-9f8f-6780dea2e55e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:17.935349 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8a0b749e-4abd-4d21-9f8f-6780dea2e55e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:17.935986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8a0b749e-4abd-4d21-9f8f-6780dea2e55e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:17.936699 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8a0b749e-4abd-4d21-9f8f-6780dea2e55e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:18.067349 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:17:18.079069 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-8a0b749e-4abd-4d21-9f8f-6780dea2e55e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lazy-loading 'services' on Instance uuid 796cf34c-7dbb-444e-a74e-68139729405f {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:17:18.202591 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8a0b749e-4abd-4d21-9f8f-6780dea2e55e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "DELETE /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f/os-volume_attachments/b2bc9cfa-f40b-411e-8a44-20b3f6134615" status: 202 len: 0 microversion: 2.20 time: 0.286627 Sep 17 21:17:18.203187 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2608/5299] 10.222.0.26 () {60 vars in 1457 bytes} [Sat Sep 17 21:17:17 2022] DELETE /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f/os-volume_attachments/b2bc9cfa-f40b-411e-8a44-20b3f6134615 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:17:18.222371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-562378fb-7961-4e60-bd68-f54d2378d52f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:18.233299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-562378fb-7961-4e60-bd68-f54d2378d52f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:18.262021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-562378fb-7961-4e60-bd68-f54d2378d52f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:18.262614 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-562378fb-7961-4e60-bd68-f54d2378d52f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:18.270170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-562378fb-7961-4e60-bd68-f54d2378d52f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:18.271116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-562378fb-7961-4e60-bd68-f54d2378d52f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:18.271788 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-562378fb-7961-4e60-bd68-f54d2378d52f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:18.272160 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-562378fb-7961-4e60-bd68-f54d2378d52f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:18.293790 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-342fcc2c-02a4-4830-ba42-689531c67116 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "POST /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.419871 Sep 17 21:17:18.296724 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2692/5300] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 17 21:17:17 2022] POST /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16/os-volume_attachments => generated 194 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:17:18.335527 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-562378fb-7961-4e60-bd68-f54d2378d52f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.119260 Sep 17 21:17:18.339127 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2609/5301] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Sep 17 21:17:18 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:17:18.785223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-62551d3b-f711-438a-bcab-a39bd5174d26 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:18.786031 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-62551d3b-f711-438a-bcab-a39bd5174d26 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] [instance: 4cf30912-b358-44af-ae25-2ce3f03ffd19] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:18.805535 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62551d3b-f711-438a-bcab-a39bd5174d26 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:18.806225 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62551d3b-f711-438a-bcab-a39bd5174d26 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:18.806838 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62551d3b-f711-438a-bcab-a39bd5174d26 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:18.807913 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62551d3b-f711-438a-bcab-a39bd5174d26 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:18.808390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62551d3b-f711-438a-bcab-a39bd5174d26 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:18.808984 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62551d3b-f711-438a-bcab-a39bd5174d26 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:18.993338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-2d18579d-7970-4fea-a658-7255b9741c77 req-0745de7b-e349-482c-80cf-757a3e12df85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cf30912-b358-44af-ae25-2ce3f03ffd19", "tag": "b1a0e827-d369-4e5b-9d28-d813cfa10e95"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:17:19.009079 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2d18579d-7970-4fea-a658-7255b9741c77 req-0745de7b-e349-482c-80cf-757a3e12df85 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:19.010284 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2d18579d-7970-4fea-a658-7255b9741c77 req-0745de7b-e349-482c-80cf-757a3e12df85 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:19.011794 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2d18579d-7970-4fea-a658-7255b9741c77 req-0745de7b-e349-482c-80cf-757a3e12df85 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:19.051749 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-2d18579d-7970-4fea-a658-7255b9741c77 req-0745de7b-e349-482c-80cf-757a3e12df85 service nova] Creating event network-changed:b1a0e827-d369-4e5b-9d28-d813cfa10e95 for instance 4cf30912-b358-44af-ae25-2ce3f03ffd19 on nch1-master-1 Sep 17 21:17:19.065411 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-2d18579d-7970-4fea-a658-7255b9741c77 req-0745de7b-e349-482c-80cf-757a3e12df85 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075615 Sep 17 21:17:19.068497 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2610/5302] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:17:19.115638 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-62551d3b-f711-438a-bcab-a39bd5174d26 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6cec0e04954a3eba096b48a7cd2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f16a815901466791a114b9a19cc763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:19.125325 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-62551d3b-f711-438a-bcab-a39bd5174d26 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] 10.222.0.26 "GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19" status: 200 len: 1428 microversion: 2.1 time: 0.344556 Sep 17 21:17:19.128674 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2693/5303] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:18 2022] GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19 => generated 1428 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:19.349985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3fa32301-ecdd-4d80-97c3-55b466287f91 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:19.352319 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3fa32301-ecdd-4d80-97c3-55b466287f91 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:19.369538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3fa32301-ecdd-4d80-97c3-55b466287f91 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:19.370654 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3fa32301-ecdd-4d80-97c3-55b466287f91 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:19.371250 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3fa32301-ecdd-4d80-97c3-55b466287f91 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:19.372114 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3fa32301-ecdd-4d80-97c3-55b466287f91 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:19.372717 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3fa32301-ecdd-4d80-97c3-55b466287f91 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:19.373296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3fa32301-ecdd-4d80-97c3-55b466287f91 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:19.435028 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3fa32301-ecdd-4d80-97c3-55b466287f91 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.089240 Sep 17 21:17:19.436032 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2611/5304] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Sep 17 21:17:19 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:17:20.153496 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-033f64e4-1ee3-4c68-844f-8bd1cd443238 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:20.154137 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-033f64e4-1ee3-4c68-844f-8bd1cd443238 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] [instance: 4cf30912-b358-44af-ae25-2ce3f03ffd19] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:20.166422 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-033f64e4-1ee3-4c68-844f-8bd1cd443238 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:20.167398 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-033f64e4-1ee3-4c68-844f-8bd1cd443238 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:20.168271 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-033f64e4-1ee3-4c68-844f-8bd1cd443238 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:20.169166 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-033f64e4-1ee3-4c68-844f-8bd1cd443238 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:20.169797 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-033f64e4-1ee3-4c68-844f-8bd1cd443238 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:20.170368 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-033f64e4-1ee3-4c68-844f-8bd1cd443238 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:20.423730 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-033f64e4-1ee3-4c68-844f-8bd1cd443238 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6cec0e04954a3eba096b48a7cd2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f16a815901466791a114b9a19cc763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:20.434754 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-033f64e4-1ee3-4c68-844f-8bd1cd443238 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] 10.222.0.26 "GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19" status: 200 len: 1428 microversion: 2.1 time: 0.286072 Sep 17 21:17:20.436160 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2694/5305] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:20 2022] GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19 => generated 1428 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:20.464747 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-eef46414-8b72-47ec-97ad-0560e47d5f92 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:20.469292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-eef46414-8b72-47ec-97ad-0560e47d5f92 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:20.472503 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:17:20.482854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eef46414-8b72-47ec-97ad-0560e47d5f92 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:20.483714 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eef46414-8b72-47ec-97ad-0560e47d5f92 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:20.485537 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eef46414-8b72-47ec-97ad-0560e47d5f92 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:20.486526 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eef46414-8b72-47ec-97ad-0560e47d5f92 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:20.487155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eef46414-8b72-47ec-97ad-0560e47d5f92 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:20.487891 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eef46414-8b72-47ec-97ad-0560e47d5f92 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:20.525310 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=8 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:17:20.552369 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-eef46414-8b72-47ec-97ad-0560e47d5f92 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.096710 Sep 17 21:17:20.556056 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2612/5306] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Sep 17 21:17:20 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:20.630550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0b7e48fe-2a82-4350-9b9f-36ed2f64817e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:20.631521 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0b7e48fe-2a82-4350-9b9f-36ed2f64817e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:20.642823 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b7e48fe-2a82-4350-9b9f-36ed2f64817e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:20.643548 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b7e48fe-2a82-4350-9b9f-36ed2f64817e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:20.646142 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b7e48fe-2a82-4350-9b9f-36ed2f64817e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:20.648297 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b7e48fe-2a82-4350-9b9f-36ed2f64817e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:20.650197 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b7e48fe-2a82-4350-9b9f-36ed2f64817e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:20.659851 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b7e48fe-2a82-4350-9b9f-36ed2f64817e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:20.715739 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0b7e48fe-2a82-4350-9b9f-36ed2f64817e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:17:20.834986 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0b7e48fe-2a82-4350-9b9f-36ed2f64817e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "DELETE /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 204 len: 0 microversion: 2.20 time: 0.209183 Sep 17 21:17:20.839889 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2695/5307] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 17 21:17:20 2022] DELETE /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 21:17:20.845068 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d25d9863-9651-4b0a-8114-7ad315326658 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:20.847218 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d25d9863-9651-4b0a-8114-7ad315326658 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:20.854115 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d25d9863-9651-4b0a-8114-7ad315326658 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:20.854713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d25d9863-9651-4b0a-8114-7ad315326658 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:20.855225 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d25d9863-9651-4b0a-8114-7ad315326658 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:20.856015 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d25d9863-9651-4b0a-8114-7ad315326658 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:20.856550 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d25d9863-9651-4b0a-8114-7ad315326658 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:20.857048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d25d9863-9651-4b0a-8114-7ad315326658 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:21.429400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d25d9863-9651-4b0a-8114-7ad315326658 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:21.443565 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d25d9863-9651-4b0a-8114-7ad315326658 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:21.448853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d25d9863-9651-4b0a-8114-7ad315326658 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:21.453627 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d25d9863-9651-4b0a-8114-7ad315326658 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1721 microversion: 2.20 time: 0.609663 Sep 17 21:17:21.486462 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ddd5d495-5058-4759-9dc5-923eef92c48b tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:21.487269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ddd5d495-5058-4759-9dc5-923eef92c48b tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] [instance: 4cf30912-b358-44af-ae25-2ce3f03ffd19] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:21.492835 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2613/5308] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:17:20 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1721 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:17:21.510120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ddd5d495-5058-4759-9dc5-923eef92c48b tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:21.511062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ddd5d495-5058-4759-9dc5-923eef92c48b tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:21.511610 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ddd5d495-5058-4759-9dc5-923eef92c48b tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:21.512661 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ddd5d495-5058-4759-9dc5-923eef92c48b tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:21.513135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ddd5d495-5058-4759-9dc5-923eef92c48b tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:21.513592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ddd5d495-5058-4759-9dc5-923eef92c48b tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:21.773737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=8 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:17:21.797787 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-25c15f5f-de7c-401b-b369-60222406c3f0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:17:21.811603 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25c15f5f-de7c-401b-b369-60222406c3f0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:21.812123 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25c15f5f-de7c-401b-b369-60222406c3f0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:21.812573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25c15f5f-de7c-401b-b369-60222406c3f0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:21.873052 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-25c15f5f-de7c-401b-b369-60222406c3f0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Going to try to stop instance {{(pid=140523) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 17 21:17:21.955824 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-25c15f5f-de7c-401b-b369-60222406c3f0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "POST /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16/action" status: 202 len: 0 microversion: 2.1 time: 0.160936 Sep 17 21:17:21.956938 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2614/5309] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:17:21 2022] POST /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 17 21:17:21.978968 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cb37033d-167b-467c-8e49-217a4400a98d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:21.979766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cb37033d-167b-467c-8e49-217a4400a98d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:21.993127 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb37033d-167b-467c-8e49-217a4400a98d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:21.998500 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb37033d-167b-467c-8e49-217a4400a98d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:21.999017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb37033d-167b-467c-8e49-217a4400a98d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:22.000043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb37033d-167b-467c-8e49-217a4400a98d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:22.000634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb37033d-167b-467c-8e49-217a4400a98d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:22.001143 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb37033d-167b-467c-8e49-217a4400a98d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:22.050577 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ddd5d495-5058-4759-9dc5-923eef92c48b tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6cec0e04954a3eba096b48a7cd2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f16a815901466791a114b9a19cc763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:22.059291 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ddd5d495-5058-4759-9dc5-923eef92c48b tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] 10.222.0.26 "GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19" status: 200 len: 1428 microversion: 2.1 time: 0.587184 Sep 17 21:17:22.075194 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2696/5310] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:21 2022] GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19 => generated 1428 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:22.489488 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-873a3d74-1281-4be5-9314-9c19b60f474c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:22.490148 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-873a3d74-1281-4be5-9314-9c19b60f474c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:22.497105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=16 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:17:22.500767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-873a3d74-1281-4be5-9314-9c19b60f474c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:22.501273 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-873a3d74-1281-4be5-9314-9c19b60f474c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:22.502579 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-873a3d74-1281-4be5-9314-9c19b60f474c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:22.503237 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-873a3d74-1281-4be5-9314-9c19b60f474c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:22.503704 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-873a3d74-1281-4be5-9314-9c19b60f474c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:22.504311 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-873a3d74-1281-4be5-9314-9c19b60f474c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:22.616539 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cb37033d-167b-467c-8e49-217a4400a98d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:22.629293 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cb37033d-167b-467c-8e49-217a4400a98d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1723 microversion: 2.1 time: 0.660079 Sep 17 21:17:22.629626 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2615/5311] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:21 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1723 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:22.806178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-873a3d74-1281-4be5-9314-9c19b60f474c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:22.815521 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-873a3d74-1281-4be5-9314-9c19b60f474c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:22.817145 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-873a3d74-1281-4be5-9314-9c19b60f474c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:22.818373 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-873a3d74-1281-4be5-9314-9c19b60f474c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1721 microversion: 2.20 time: 0.333944 Sep 17 21:17:22.823862 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2697/5312] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:17:22 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1721 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:17:23.095291 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b3f58e74-2b9d-4ad3-b046-b5eaa50c5507 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:23.096847 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b3f58e74-2b9d-4ad3-b046-b5eaa50c5507 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] [instance: 4cf30912-b358-44af-ae25-2ce3f03ffd19] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:23.107962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3f58e74-2b9d-4ad3-b046-b5eaa50c5507 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:23.108812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3f58e74-2b9d-4ad3-b046-b5eaa50c5507 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:23.110448 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3f58e74-2b9d-4ad3-b046-b5eaa50c5507 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:23.111926 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3f58e74-2b9d-4ad3-b046-b5eaa50c5507 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:23.113365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3f58e74-2b9d-4ad3-b046-b5eaa50c5507 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:23.114077 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3f58e74-2b9d-4ad3-b046-b5eaa50c5507 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:23.398232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-79b91c85-886d-472f-be4a-ea0cb3eea0d9 req-aeda1af7-410c-4947-aaed-9236e4773ebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cf30912-b358-44af-ae25-2ce3f03ffd19", "name": "network-vif-plugged", "status": "completed", "tag": "b1a0e827-d369-4e5b-9d28-d813cfa10e95"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:17:23.415882 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-79b91c85-886d-472f-be4a-ea0cb3eea0d9 req-aeda1af7-410c-4947-aaed-9236e4773ebe service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:23.416669 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-79b91c85-886d-472f-be4a-ea0cb3eea0d9 req-aeda1af7-410c-4947-aaed-9236e4773ebe service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:23.417286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-79b91c85-886d-472f-be4a-ea0cb3eea0d9 req-aeda1af7-410c-4947-aaed-9236e4773ebe service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:23.453232 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b3f58e74-2b9d-4ad3-b046-b5eaa50c5507 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6cec0e04954a3eba096b48a7cd2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f16a815901466791a114b9a19cc763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:23.471546 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-79b91c85-886d-472f-be4a-ea0cb3eea0d9 req-aeda1af7-410c-4947-aaed-9236e4773ebe service nova] Creating event network-vif-plugged:b1a0e827-d369-4e5b-9d28-d813cfa10e95 for instance 4cf30912-b358-44af-ae25-2ce3f03ffd19 on nch1-master-1 Sep 17 21:17:23.473550 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b3f58e74-2b9d-4ad3-b046-b5eaa50c5507 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] 10.222.0.26 "GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19" status: 200 len: 1428 microversion: 2.1 time: 0.386084 Sep 17 21:17:23.477959 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2616/5313] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:23 2022] GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19 => generated 1428 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:23.501630 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-79b91c85-886d-472f-be4a-ea0cb3eea0d9 req-aeda1af7-410c-4947-aaed-9236e4773ebe service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107493 Sep 17 21:17:23.502571 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2698/5314] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:17:23.657653 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2cf81a25-1376-47c6-acf3-9187650f8dc0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:23.659184 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2cf81a25-1376-47c6-acf3-9187650f8dc0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:23.680096 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2cf81a25-1376-47c6-acf3-9187650f8dc0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:23.681522 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2cf81a25-1376-47c6-acf3-9187650f8dc0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:23.682532 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2cf81a25-1376-47c6-acf3-9187650f8dc0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:23.683554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2cf81a25-1376-47c6-acf3-9187650f8dc0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:23.683994 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2cf81a25-1376-47c6-acf3-9187650f8dc0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:23.685900 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2cf81a25-1376-47c6-acf3-9187650f8dc0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:23.845967 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5c8e6b29-22f7-4eac-8912-adf8f7b891c4 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:23.847462 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5c8e6b29-22f7-4eac-8912-adf8f7b891c4 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:23.856030 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c8e6b29-22f7-4eac-8912-adf8f7b891c4 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:23.856895 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c8e6b29-22f7-4eac-8912-adf8f7b891c4 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:23.857786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c8e6b29-22f7-4eac-8912-adf8f7b891c4 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:23.858971 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c8e6b29-22f7-4eac-8912-adf8f7b891c4 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:23.859712 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c8e6b29-22f7-4eac-8912-adf8f7b891c4 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:23.860414 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c8e6b29-22f7-4eac-8912-adf8f7b891c4 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:23.896015 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2cf81a25-1376-47c6-acf3-9187650f8dc0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:23.907559 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2cf81a25-1376-47c6-acf3-9187650f8dc0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1723 microversion: 2.1 time: 0.255050 Sep 17 21:17:23.908176 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2617/5315] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:23 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:24.229797 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5c8e6b29-22f7-4eac-8912-adf8f7b891c4 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:24.249827 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5c8e6b29-22f7-4eac-8912-adf8f7b891c4 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:24.251610 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5c8e6b29-22f7-4eac-8912-adf8f7b891c4 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:24.254891 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5c8e6b29-22f7-4eac-8912-adf8f7b891c4 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1721 microversion: 2.20 time: 0.414195 Sep 17 21:17:24.256049 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2699/5316] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:17:23 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1721 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:17:24.505146 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-94256611-4955-4598-be8c-a4c5b7f558f7 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:24.506447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-94256611-4955-4598-be8c-a4c5b7f558f7 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] [instance: 4cf30912-b358-44af-ae25-2ce3f03ffd19] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:24.520481 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-94256611-4955-4598-be8c-a4c5b7f558f7 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:24.523299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-94256611-4955-4598-be8c-a4c5b7f558f7 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:24.524605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-94256611-4955-4598-be8c-a4c5b7f558f7 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:24.525646 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-94256611-4955-4598-be8c-a4c5b7f558f7 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:24.526357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-94256611-4955-4598-be8c-a4c5b7f558f7 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:24.527207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-94256611-4955-4598-be8c-a4c5b7f558f7 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:24.923711 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-94256611-4955-4598-be8c-a4c5b7f558f7 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6cec0e04954a3eba096b48a7cd2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f16a815901466791a114b9a19cc763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:24.934334 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-05d4683d-8772-4d4b-89a3-c0d7eab4bcce tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:24.935568 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-05d4683d-8772-4d4b-89a3-c0d7eab4bcce tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:24.938329 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-94256611-4955-4598-be8c-a4c5b7f558f7 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] 10.222.0.26 "GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19" status: 200 len: 1428 microversion: 2.1 time: 0.442883 Sep 17 21:17:24.943904 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-05d4683d-8772-4d4b-89a3-c0d7eab4bcce tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:24.944615 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-05d4683d-8772-4d4b-89a3-c0d7eab4bcce tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:24.945643 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-05d4683d-8772-4d4b-89a3-c0d7eab4bcce tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:24.946527 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-05d4683d-8772-4d4b-89a3-c0d7eab4bcce tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:24.957594 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2618/5317] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:24 2022] GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19 => generated 1428 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:24.961053 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-05d4683d-8772-4d4b-89a3-c0d7eab4bcce tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:24.962952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-05d4683d-8772-4d4b-89a3-c0d7eab4bcce tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:25.281978 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4162dbc7-e473-4de6-b32b-f4c928518410 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:25.283002 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4162dbc7-e473-4de6-b32b-f4c928518410 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:25.291539 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4162dbc7-e473-4de6-b32b-f4c928518410 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:25.292305 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4162dbc7-e473-4de6-b32b-f4c928518410 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:25.293022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4162dbc7-e473-4de6-b32b-f4c928518410 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:25.294420 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4162dbc7-e473-4de6-b32b-f4c928518410 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:25.295358 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4162dbc7-e473-4de6-b32b-f4c928518410 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:25.295813 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4162dbc7-e473-4de6-b32b-f4c928518410 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:25.468491 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-05d4683d-8772-4d4b-89a3-c0d7eab4bcce tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:25.473359 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:17:25.476782 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4162dbc7-e473-4de6-b32b-f4c928518410 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:25.483326 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-05d4683d-8772-4d4b-89a3-c0d7eab4bcce tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1723 microversion: 2.1 time: 0.556112 Sep 17 21:17:25.487519 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2700/5318] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:24 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1723 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:17:25.507408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4162dbc7-e473-4de6-b32b-f4c928518410 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:25.508861 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4162dbc7-e473-4de6-b32b-f4c928518410 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:25.510104 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4162dbc7-e473-4de6-b32b-f4c928518410 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 200 len: 1654 microversion: 2.20 time: 0.233797 Sep 17 21:17:25.525864 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2619/5319] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:17:25 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 1654 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:17:25.884669 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-d975df45-6fb9-4b13-b5c8-63ab396f2f47 req-cef6ea4b-e865-46b6-b099-a2335b73a9e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "796cf34c-7dbb-444e-a74e-68139729405f", "name": "network-vif-deleted", "tag": "74223161-c2a1-4706-8b34-7e44c8bdcb2b"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:17:25.903735 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d975df45-6fb9-4b13-b5c8-63ab396f2f47 req-cef6ea4b-e865-46b6-b099-a2335b73a9e9 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:25.904584 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d975df45-6fb9-4b13-b5c8-63ab396f2f47 req-cef6ea4b-e865-46b6-b099-a2335b73a9e9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:25.905295 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d975df45-6fb9-4b13-b5c8-63ab396f2f47 req-cef6ea4b-e865-46b6-b099-a2335b73a9e9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:25.918181 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-d975df45-6fb9-4b13-b5c8-63ab396f2f47 req-cef6ea4b-e865-46b6-b099-a2335b73a9e9 service nova] Creating event network-vif-deleted:74223161-c2a1-4706-8b34-7e44c8bdcb2b for instance 796cf34c-7dbb-444e-a74e-68139729405f on nch1-master-1 Sep 17 21:17:25.924182 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-d975df45-6fb9-4b13-b5c8-63ab396f2f47 req-cef6ea4b-e865-46b6-b099-a2335b73a9e9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044620 Sep 17 21:17:25.925303 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2701/5320] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:17:25.964671 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6f31b082-c1ee-4f9f-aafc-7ecba7db0618 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:25.966213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6f31b082-c1ee-4f9f-aafc-7ecba7db0618 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] [instance: 4cf30912-b358-44af-ae25-2ce3f03ffd19] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:25.982546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6f31b082-c1ee-4f9f-aafc-7ecba7db0618 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:25.984204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6f31b082-c1ee-4f9f-aafc-7ecba7db0618 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:25.986264 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6f31b082-c1ee-4f9f-aafc-7ecba7db0618 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:25.988451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6f31b082-c1ee-4f9f-aafc-7ecba7db0618 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:25.990256 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6f31b082-c1ee-4f9f-aafc-7ecba7db0618 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:25.991323 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6f31b082-c1ee-4f9f-aafc-7ecba7db0618 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:26.331392 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6f31b082-c1ee-4f9f-aafc-7ecba7db0618 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6cec0e04954a3eba096b48a7cd2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f16a815901466791a114b9a19cc763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:26.342226 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6f31b082-c1ee-4f9f-aafc-7ecba7db0618 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] 10.222.0.26 "GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19" status: 200 len: 1607 microversion: 2.1 time: 0.381312 Sep 17 21:17:26.343253 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2620/5321] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:25 2022] GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19 => generated 1607 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:17:26.369364 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8ed9e6ad-fc82-421f-8ab2-a9e61b66d0eb tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:26.370552 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8ed9e6ad-fc82-421f-8ab2-a9e61b66d0eb tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] [instance: 4cf30912-b358-44af-ae25-2ce3f03ffd19] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:26.377178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8ed9e6ad-fc82-421f-8ab2-a9e61b66d0eb tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:26.377798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8ed9e6ad-fc82-421f-8ab2-a9e61b66d0eb tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:26.378393 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8ed9e6ad-fc82-421f-8ab2-a9e61b66d0eb tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:26.378960 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8ed9e6ad-fc82-421f-8ab2-a9e61b66d0eb tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:26.379413 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8ed9e6ad-fc82-421f-8ab2-a9e61b66d0eb tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:26.379846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8ed9e6ad-fc82-421f-8ab2-a9e61b66d0eb tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:26.512281 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5065533c-9a3e-4bcd-8fc7-75a70b4ef5e6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:26.512935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5065533c-9a3e-4bcd-8fc7-75a70b4ef5e6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:26.519656 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5065533c-9a3e-4bcd-8fc7-75a70b4ef5e6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:26.520680 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5065533c-9a3e-4bcd-8fc7-75a70b4ef5e6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:26.521179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5065533c-9a3e-4bcd-8fc7-75a70b4ef5e6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:26.522002 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5065533c-9a3e-4bcd-8fc7-75a70b4ef5e6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:26.522504 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5065533c-9a3e-4bcd-8fc7-75a70b4ef5e6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:26.522951 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5065533c-9a3e-4bcd-8fc7-75a70b4ef5e6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:27.139249 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8ed9e6ad-fc82-421f-8ab2-a9e61b66d0eb tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6cec0e04954a3eba096b48a7cd2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f16a815901466791a114b9a19cc763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:27.147956 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8ed9e6ad-fc82-421f-8ab2-a9e61b66d0eb tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] 10.222.0.26 "GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19" status: 200 len: 1607 microversion: 2.1 time: 0.784513 Sep 17 21:17:27.149097 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2702/5322] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:26 2022] GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19 => generated 1607 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:27.161904 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1e4a0af7-7477-4301-8534-12886735c839 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:27.162120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1e4a0af7-7477-4301-8534-12886735c839 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:27.173712 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e4a0af7-7477-4301-8534-12886735c839 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:27.174725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e4a0af7-7477-4301-8534-12886735c839 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:27.175271 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e4a0af7-7477-4301-8534-12886735c839 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:27.176170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e4a0af7-7477-4301-8534-12886735c839 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:27.176681 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e4a0af7-7477-4301-8534-12886735c839 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:27.177210 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e4a0af7-7477-4301-8534-12886735c839 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:27.194035 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5065533c-9a3e-4bcd-8fc7-75a70b4ef5e6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:27.194554 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-1e4a0af7-7477-4301-8534-12886735c839 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] HTTP exception thrown: Instance 796cf34c-7dbb-444e-a74e-68139729405f could not be found. Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1e4a0af7-7477-4301-8534-12886735c839 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Request method failure captured: Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f HTTP/1.1 Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjieZv9wtl_pDnkx2EwyI8BFBMJuM6DanlI2NxzpQY06zGh6UfIKVR_b4LIk8F4ufLQC3s4sfs9iVRkIsH0ZpGH5y_C_q5cAnW526d64gmcygXsBXRN_pku_PKAZrLTdzZBFxnNji7tGl8srPYGMXoLfZ6HVA-aDU0tTvt38LrAtYSs Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: X-Openstack-Nova-Api-Version: 2.20 Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 720881c6f7304aadbf069698c97dc5c5 Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1971975439 Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/720881c6f7304aadbf069698c97dc5c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/720881c6f7304aadbf069698c97dc5c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/720881c6f7304aadbf069698c97dc5c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_720881c6f7304aadbf069698c97dc5c5", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1971975439 Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 720881c6f7304aadbf069698c97dc5c5 Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1971975439 Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-AttachVolumeShelveTestJSON-1971975439-project Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 8ddb1d0a7bca457493d7ac9a58a01e64 Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1971975439-project Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 796cf34c-7dbb-444e-a74e-68139729405f could not be found. Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '796cf34c-7dbb-444e-a74e-68139729405f'} Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 796cf34c-7dbb-444e-a74e-68139729405f could not be found. Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 796cf34c-7dbb-444e-a74e-68139729405f could not be found. Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:17:27.196207 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:17:27.199869 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:17:27.199869 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:17:27.199869 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:17:27.199869 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:17:27.199869 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:17:27.199869 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:17:27.199869 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 796cf34c-7dbb-444e-a74e-68139729405f could not be found. Sep 17 21:17:27.199869 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:17:27.199869 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1e4a0af7-7477-4301-8534-12886735c839 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Returning 404 to user: Instance 796cf34c-7dbb-444e-a74e-68139729405f could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:17:27.199869 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1e4a0af7-7477-4301-8534-12886735c839 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 404 len: 111 microversion: 2.20 time: 0.047324 Sep 17 21:17:27.199869 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2703/5323] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:17:27 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:17:27.203229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cc62fd89-8005-4de8-808f-67fc02df4fd0 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:27.203898 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cc62fd89-8005-4de8-808f-67fc02df4fd0 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] [instance: 4cf30912-b358-44af-ae25-2ce3f03ffd19] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:27.212091 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc62fd89-8005-4de8-808f-67fc02df4fd0 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:27.212588 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc62fd89-8005-4de8-808f-67fc02df4fd0 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:27.213215 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc62fd89-8005-4de8-808f-67fc02df4fd0 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:27.213729 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5065533c-9a3e-4bcd-8fc7-75a70b4ef5e6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1723 microversion: 2.1 time: 0.704841 Sep 17 21:17:27.213842 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc62fd89-8005-4de8-808f-67fc02df4fd0 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:27.214363 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc62fd89-8005-4de8-808f-67fc02df4fd0 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:27.214801 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc62fd89-8005-4de8-808f-67fc02df4fd0 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:27.215737 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2621/5324] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:26 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1723 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:27.229588 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-81c254ef-278d-43c6-8077-e4af4ede50bb tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '.version_select at 0x7f25a44ef4c0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:27.283728 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-81c254ef-278d-43c6-8077-e4af4ede50bb tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1874286382" status: 204 len: 0 microversion: 2.20 time: 0.066621 Sep 17 21:17:27.285480 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2622/5325] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Sep 17 21:17:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1874286382 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 21:17:27.636343 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cc62fd89-8005-4de8-808f-67fc02df4fd0 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6cec0e04954a3eba096b48a7cd2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f16a815901466791a114b9a19cc763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:27.651247 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cc62fd89-8005-4de8-808f-67fc02df4fd0 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] 10.222.0.26 "GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19" status: 200 len: 1607 microversion: 2.1 time: 0.450254 Sep 17 21:17:27.664717 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2704/5326] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:27 2022] GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19 => generated 1607 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:28.257712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-81a5d917-ded8-4fc6-8e32-0114a28569c9 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:28.258463 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-81a5d917-ded8-4fc6-8e32-0114a28569c9 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:28.273035 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81a5d917-ded8-4fc6-8e32-0114a28569c9 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:28.274488 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81a5d917-ded8-4fc6-8e32-0114a28569c9 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:28.275189 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81a5d917-ded8-4fc6-8e32-0114a28569c9 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:28.276065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81a5d917-ded8-4fc6-8e32-0114a28569c9 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:28.276699 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81a5d917-ded8-4fc6-8e32-0114a28569c9 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:28.277180 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81a5d917-ded8-4fc6-8e32-0114a28569c9 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:28.619244 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-81a5d917-ded8-4fc6-8e32-0114a28569c9 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:28.631455 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-81a5d917-ded8-4fc6-8e32-0114a28569c9 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1723 microversion: 2.1 time: 0.393197 Sep 17 21:17:28.632106 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2623/5327] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:28 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1723 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:29.210523 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-33851664-8e50-421a-8eb2-b7e9e51d953f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Action: 'create', calling method: .version_select at 0x7f25a4ceb9d0>, body: {"keypair": {"name": "tempest-keypair-1619172093", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkcMsUQ12uAK3UG6q4FYVSexOn15EKzmUG3trj+D80HDcNFjTXGbgk8IXukGUrPUMIrLoU8uaDI4BBeFOty3SQ1f60jKoAneMgmEB16+JoTN/h5w2Idrsa3tTAA6KgyZQ=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:17:29.228109 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-33851664-8e50-421a-8eb2-b7e9e51d953f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Getting quotas for project 720881c6f7304aadbf069698c97dc5c5. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:17:29.234360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-33851664-8e50-421a-8eb2-b7e9e51d953f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Getting quotas for user 8ddb1d0a7bca457493d7ac9a58a01e64 and project 720881c6f7304aadbf069698c97dc5c5. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:17:29.266246 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-33851664-8e50-421a-8eb2-b7e9e51d953f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.059623 Sep 17 21:17:29.268700 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2705/5328] 10.222.0.26 () {62 vars in 1200 bytes} [Sat Sep 17 21:17:29 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 63 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 17 21:17:29.660652 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2ba20fa8-a5dd-4ff9-bf75-b78d4755df9f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:29.664646 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2ba20fa8-a5dd-4ff9-bf75-b78d4755df9f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:29.683537 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ba20fa8-a5dd-4ff9-bf75-b78d4755df9f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:29.684307 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ba20fa8-a5dd-4ff9-bf75-b78d4755df9f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:29.686555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ba20fa8-a5dd-4ff9-bf75-b78d4755df9f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:29.687672 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ba20fa8-a5dd-4ff9-bf75-b78d4755df9f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:29.689048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ba20fa8-a5dd-4ff9-bf75-b78d4755df9f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:29.690259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ba20fa8-a5dd-4ff9-bf75-b78d4755df9f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:30.237324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2ba20fa8-a5dd-4ff9-bf75-b78d4755df9f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:30.260314 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2ba20fa8-a5dd-4ff9-bf75-b78d4755df9f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1723 microversion: 2.1 time: 0.606867 Sep 17 21:17:30.269425 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2624/5329] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:29 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1723 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:31.297906 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c9859f8d-a858-4105-865a-85815568c8ff tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:31.299362 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c9859f8d-a858-4105-865a-85815568c8ff tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:31.311004 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9859f8d-a858-4105-865a-85815568c8ff tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:31.314783 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9859f8d-a858-4105-865a-85815568c8ff tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:31.316476 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9859f8d-a858-4105-865a-85815568c8ff tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:31.318029 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9859f8d-a858-4105-865a-85815568c8ff tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:31.319397 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9859f8d-a858-4105-865a-85815568c8ff tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:31.320987 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9859f8d-a858-4105-865a-85815568c8ff tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:32.324994 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c9859f8d-a858-4105-865a-85815568c8ff tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:32.356221 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c9859f8d-a858-4105-865a-85815568c8ff tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1723 microversion: 2.1 time: 1.063965 Sep 17 21:17:32.365799 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2706/5330] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:31 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1723 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:33.310591 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-91b9cc4c-5b61-4b61-a49f-9ea17942b89b req-64f40e30-ea21-4021-af9e-da12393c95a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cf30912-b358-44af-ae25-2ce3f03ffd19", "tag": "b1a0e827-d369-4e5b-9d28-d813cfa10e95"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:17:33.321822 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-91b9cc4c-5b61-4b61-a49f-9ea17942b89b req-64f40e30-ea21-4021-af9e-da12393c95a6 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:33.327717 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-91b9cc4c-5b61-4b61-a49f-9ea17942b89b req-64f40e30-ea21-4021-af9e-da12393c95a6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:33.328367 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-91b9cc4c-5b61-4b61-a49f-9ea17942b89b req-64f40e30-ea21-4021-af9e-da12393c95a6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:33.342051 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-91b9cc4c-5b61-4b61-a49f-9ea17942b89b req-64f40e30-ea21-4021-af9e-da12393c95a6 service nova] Creating event network-changed:b1a0e827-d369-4e5b-9d28-d813cfa10e95 for instance 4cf30912-b358-44af-ae25-2ce3f03ffd19 on nch1-master-1 Sep 17 21:17:33.347880 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-91b9cc4c-5b61-4b61-a49f-9ea17942b89b req-64f40e30-ea21-4021-af9e-da12393c95a6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041942 Sep 17 21:17:33.349206 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2625/5331] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:17:33.392698 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3ab64348-d7ca-417d-b37b-f53bcb11c396 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:33.393334 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3ab64348-d7ca-417d-b37b-f53bcb11c396 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:33.404638 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ab64348-d7ca-417d-b37b-f53bcb11c396 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:33.405149 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ab64348-d7ca-417d-b37b-f53bcb11c396 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:33.405625 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ab64348-d7ca-417d-b37b-f53bcb11c396 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:33.411047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ab64348-d7ca-417d-b37b-f53bcb11c396 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:33.412080 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ab64348-d7ca-417d-b37b-f53bcb11c396 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:33.412686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ab64348-d7ca-417d-b37b-f53bcb11c396 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:33.796929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3ab64348-d7ca-417d-b37b-f53bcb11c396 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:33.821431 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3ab64348-d7ca-417d-b37b-f53bcb11c396 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1700 microversion: 2.1 time: 0.432942 Sep 17 21:17:33.833385 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2707/5332] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:33 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1700 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:33.846319 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a3593014-5671-4322-81b7-b5ef8a1fa39c tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:17:33.860842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3593014-5671-4322-81b7-b5ef8a1fa39c tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:33.861708 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3593014-5671-4322-81b7-b5ef8a1fa39c tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:33.862316 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3593014-5671-4322-81b7-b5ef8a1fa39c tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:33.888605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:17:33.893127 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a3593014-5671-4322-81b7-b5ef8a1fa39c tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Going to try to start instance {{(pid=140523) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 17 21:17:33.947535 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a3593014-5671-4322-81b7-b5ef8a1fa39c tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "POST /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16/action" status: 202 len: 0 microversion: 2.1 time: 0.105750 Sep 17 21:17:33.948864 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2626/5333] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:17:33 2022] POST /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:17:33.958862 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8ded8843-f679-4cc4-b0cf-ab517a514a65 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:33.959861 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8ded8843-f679-4cc4-b0cf-ab517a514a65 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:33.968908 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8ded8843-f679-4cc4-b0cf-ab517a514a65 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:33.970892 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8ded8843-f679-4cc4-b0cf-ab517a514a65 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:33.971458 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8ded8843-f679-4cc4-b0cf-ab517a514a65 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:33.972222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8ded8843-f679-4cc4-b0cf-ab517a514a65 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:33.972809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8ded8843-f679-4cc4-b0cf-ab517a514a65 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:33.977298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8ded8843-f679-4cc4-b0cf-ab517a514a65 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:34.448753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8ded8843-f679-4cc4-b0cf-ab517a514a65 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:34.460673 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8ded8843-f679-4cc4-b0cf-ab517a514a65 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1709 microversion: 2.1 time: 0.507496 Sep 17 21:17:34.479305 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2708/5334] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:33 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1709 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:34.852726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-68cca895-16da-4195-962d-3116bec5afbc tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-440825795", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "50731d33-6e2a-4367-9931-32837ecb7f6a"}], "security_groups": [{"name": "tempest-securitygroup--307219829"}], "key_name": "tempest-keypair-1619172093", "user_data": "}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:17:35.045493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-68cca895-16da-4195-962d-3116bec5afbc tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] validate_networks() for [('50731d33-6e2a-4367-9931-32837ecb7f6a', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:17:35.490662 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7a8995c8-0d57-400b-b612-3b1554c5c0bd tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:35.491283 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7a8995c8-0d57-400b-b612-3b1554c5c0bd tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:35.499987 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a8995c8-0d57-400b-b612-3b1554c5c0bd tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:35.500494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a8995c8-0d57-400b-b612-3b1554c5c0bd tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:35.501058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a8995c8-0d57-400b-b612-3b1554c5c0bd tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:35.501825 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a8995c8-0d57-400b-b612-3b1554c5c0bd tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:35.502289 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a8995c8-0d57-400b-b612-3b1554c5c0bd tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:35.502723 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a8995c8-0d57-400b-b612-3b1554c5c0bd tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:35.974506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7a8995c8-0d57-400b-b612-3b1554c5c0bd tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:35.983824 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7a8995c8-0d57-400b-b612-3b1554c5c0bd tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1709 microversion: 2.1 time: 0.497469 Sep 17 21:17:35.998607 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2709/5335] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:35 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1709 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:36.444593 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-68cca895-16da-4195-962d-3116bec5afbc tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:17:36.446020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-68cca895-16da-4195-962d-3116bec5afbc tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:17:36.446659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-68cca895-16da-4195-962d-3116bec5afbc tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:17:36.447849 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-68cca895-16da-4195-962d-3116bec5afbc tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:17:36.448427 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-68cca895-16da-4195-962d-3116bec5afbc tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:17:36.462415 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68cca895-16da-4195-962d-3116bec5afbc tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:36.463187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68cca895-16da-4195-962d-3116bec5afbc tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:36.464096 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68cca895-16da-4195-962d-3116bec5afbc tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:36.465972 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68cca895-16da-4195-962d-3116bec5afbc tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:36.467210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68cca895-16da-4195-962d-3116bec5afbc tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:36.468456 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68cca895-16da-4195-962d-3116bec5afbc tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:36.502565 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-68cca895-16da-4195-962d-3116bec5afbc tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Getting quotas for project 720881c6f7304aadbf069698c97dc5c5. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:17:36.509997 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-68cca895-16da-4195-962d-3116bec5afbc tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Getting quotas for user 8ddb1d0a7bca457493d7ac9a58a01e64 and project 720881c6f7304aadbf069698c97dc5c5. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:17:36.528841 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-68cca895-16da-4195-962d-3116bec5afbc tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:17:36.536306 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-68cca895-16da-4195-962d-3116bec5afbc tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:17:36.645992 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-68cca895-16da-4195-962d-3116bec5afbc tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.810317 Sep 17 21:17:36.646690 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2627/5336] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Sep 17 21:17:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 1812 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 17 21:17:36.658367 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b061dba8-def2-4dbc-8d14-eed186d45c8d tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:36.658991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b061dba8-def2-4dbc-8d14-eed186d45c8d tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:36.797833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b061dba8-def2-4dbc-8d14-eed186d45c8d tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:36.807203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b061dba8-def2-4dbc-8d14-eed186d45c8d tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:36.814305 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b061dba8-def2-4dbc-8d14-eed186d45c8d tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:36.816983 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b061dba8-def2-4dbc-8d14-eed186d45c8d tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1281 microversion: 2.20 time: 0.162870 Sep 17 21:17:36.819269 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2710/5337] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:17:36 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1281 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:17:37.009708 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-519e349c-7b5a-4ee8-9b4c-36eeaae2fe57 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:37.010455 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-519e349c-7b5a-4ee8-9b4c-36eeaae2fe57 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:37.026734 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-519e349c-7b5a-4ee8-9b4c-36eeaae2fe57 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:37.027920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-519e349c-7b5a-4ee8-9b4c-36eeaae2fe57 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:37.032140 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-519e349c-7b5a-4ee8-9b4c-36eeaae2fe57 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:37.033165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-519e349c-7b5a-4ee8-9b4c-36eeaae2fe57 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:37.034970 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-519e349c-7b5a-4ee8-9b4c-36eeaae2fe57 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:37.035582 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-519e349c-7b5a-4ee8-9b4c-36eeaae2fe57 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:37.331329 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-519e349c-7b5a-4ee8-9b4c-36eeaae2fe57 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:37.347938 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-519e349c-7b5a-4ee8-9b4c-36eeaae2fe57 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1709 microversion: 2.1 time: 0.343470 Sep 17 21:17:37.349605 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2628/5338] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:37 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1709 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:37.846700 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1209a4a5-478b-4e35-a4af-d6e332f54008 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:37.847457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1209a4a5-478b-4e35-a4af-d6e332f54008 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:37.873638 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1209a4a5-478b-4e35-a4af-d6e332f54008 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:37.874166 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1209a4a5-478b-4e35-a4af-d6e332f54008 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:37.874615 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1209a4a5-478b-4e35-a4af-d6e332f54008 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:37.875355 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1209a4a5-478b-4e35-a4af-d6e332f54008 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:37.875819 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1209a4a5-478b-4e35-a4af-d6e332f54008 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:37.876284 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1209a4a5-478b-4e35-a4af-d6e332f54008 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:38.050920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1209a4a5-478b-4e35-a4af-d6e332f54008 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:38.073235 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1209a4a5-478b-4e35-a4af-d6e332f54008 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:38.077168 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1209a4a5-478b-4e35-a4af-d6e332f54008 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:38.078777 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1209a4a5-478b-4e35-a4af-d6e332f54008 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1333 microversion: 2.20 time: 0.236390 Sep 17 21:17:38.097706 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2711/5339] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:17:37 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1333 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:17:38.379119 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a7392260-56fd-48f2-823d-b355d4c034c5 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:38.380497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a7392260-56fd-48f2-823d-b355d4c034c5 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:38.390132 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a7392260-56fd-48f2-823d-b355d4c034c5 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:38.391250 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a7392260-56fd-48f2-823d-b355d4c034c5 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:38.392027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a7392260-56fd-48f2-823d-b355d4c034c5 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:38.393119 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a7392260-56fd-48f2-823d-b355d4c034c5 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:38.393912 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a7392260-56fd-48f2-823d-b355d4c034c5 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:38.395453 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a7392260-56fd-48f2-823d-b355d4c034c5 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:38.698113 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a7392260-56fd-48f2-823d-b355d4c034c5 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:38.709145 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a7392260-56fd-48f2-823d-b355d4c034c5 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1713 microversion: 2.1 time: 0.337640 Sep 17 21:17:38.710992 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2629/5340] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:38 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1713 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:39.110369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d5624e59-637a-47ce-a50a-35ea0fd68d7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:39.111429 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d5624e59-637a-47ce-a50a-35ea0fd68d7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:39.121634 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5624e59-637a-47ce-a50a-35ea0fd68d7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:39.122454 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5624e59-637a-47ce-a50a-35ea0fd68d7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:39.123111 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5624e59-637a-47ce-a50a-35ea0fd68d7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:39.123987 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5624e59-637a-47ce-a50a-35ea0fd68d7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:39.124646 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5624e59-637a-47ce-a50a-35ea0fd68d7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:39.125221 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5624e59-637a-47ce-a50a-35ea0fd68d7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:39.230408 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d5624e59-637a-47ce-a50a-35ea0fd68d7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:39.243785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d5624e59-637a-47ce-a50a-35ea0fd68d7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:39.247238 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d5624e59-637a-47ce-a50a-35ea0fd68d7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:39.249381 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d5624e59-637a-47ce-a50a-35ea0fd68d7e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1339 microversion: 2.20 time: 0.144141 Sep 17 21:17:39.253619 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2712/5341] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:17:39 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1339 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:17:40.283418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d20fe862-e15c-4ce9-9224-131cce5e43dd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:40.284047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d20fe862-e15c-4ce9-9224-131cce5e43dd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:40.300466 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d20fe862-e15c-4ce9-9224-131cce5e43dd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:40.301027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d20fe862-e15c-4ce9-9224-131cce5e43dd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:40.302429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d20fe862-e15c-4ce9-9224-131cce5e43dd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:40.306581 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d20fe862-e15c-4ce9-9224-131cce5e43dd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:40.309217 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d20fe862-e15c-4ce9-9224-131cce5e43dd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:40.310208 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d20fe862-e15c-4ce9-9224-131cce5e43dd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:40.441703 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d20fe862-e15c-4ce9-9224-131cce5e43dd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:40.464494 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d20fe862-e15c-4ce9-9224-131cce5e43dd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:40.469323 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d20fe862-e15c-4ce9-9224-131cce5e43dd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:40.473148 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d20fe862-e15c-4ce9-9224-131cce5e43dd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1339 microversion: 2.20 time: 0.195869 Sep 17 21:17:40.484430 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2630/5342] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:17:40 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1339 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:17:41.510396 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-78b114fa-153d-4e05-8b7b-daf7fee0be6c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:41.511092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-78b114fa-153d-4e05-8b7b-daf7fee0be6c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:41.529037 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-78b114fa-153d-4e05-8b7b-daf7fee0be6c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:41.534171 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-78b114fa-153d-4e05-8b7b-daf7fee0be6c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:41.534785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-78b114fa-153d-4e05-8b7b-daf7fee0be6c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:41.536324 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-78b114fa-153d-4e05-8b7b-daf7fee0be6c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:41.536820 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-78b114fa-153d-4e05-8b7b-daf7fee0be6c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:41.537633 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-78b114fa-153d-4e05-8b7b-daf7fee0be6c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:41.965856 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-78b114fa-153d-4e05-8b7b-daf7fee0be6c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:41.980523 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-78b114fa-153d-4e05-8b7b-daf7fee0be6c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:41.982668 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-78b114fa-153d-4e05-8b7b-daf7fee0be6c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:41.986875 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-78b114fa-153d-4e05-8b7b-daf7fee0be6c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1406 microversion: 2.20 time: 0.484061 Sep 17 21:17:41.988074 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2713/5343] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:17:41 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1406 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:17:43.013098 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6585defe-5a78-4f06-8f5e-80f0f4098264 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:43.013829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6585defe-5a78-4f06-8f5e-80f0f4098264 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:43.025086 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6585defe-5a78-4f06-8f5e-80f0f4098264 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:43.028836 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6585defe-5a78-4f06-8f5e-80f0f4098264 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:43.030065 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6585defe-5a78-4f06-8f5e-80f0f4098264 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:43.036770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6585defe-5a78-4f06-8f5e-80f0f4098264 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:43.037540 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6585defe-5a78-4f06-8f5e-80f0f4098264 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:43.038931 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6585defe-5a78-4f06-8f5e-80f0f4098264 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:43.044132 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-68a956e9-b23f-4988-a8cb-c7363040dc84 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-123567621", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "306b968f-d04a-461c-bf2a-af380824a404"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:17:43.210463 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-68a956e9-b23f-4988-a8cb-c7363040dc84 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] validate_networks() for [('306b968f-d04a-461c-bf2a-af380824a404', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:17:43.604264 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6585defe-5a78-4f06-8f5e-80f0f4098264 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:43.623401 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6585defe-5a78-4f06-8f5e-80f0f4098264 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:43.628408 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6585defe-5a78-4f06-8f5e-80f0f4098264 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:43.631033 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6585defe-5a78-4f06-8f5e-80f0f4098264 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1406 microversion: 2.20 time: 0.621033 Sep 17 21:17:43.636520 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2714/5344] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:17:43 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1406 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:17:43.947342 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-68a956e9-b23f-4988-a8cb-c7363040dc84 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:17:43.948056 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-68a956e9-b23f-4988-a8cb-c7363040dc84 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:17:43.948897 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-68a956e9-b23f-4988-a8cb-c7363040dc84 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:17:43.949488 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-68a956e9-b23f-4988-a8cb-c7363040dc84 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:17:43.950182 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-68a956e9-b23f-4988-a8cb-c7363040dc84 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:17:43.962399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68a956e9-b23f-4988-a8cb-c7363040dc84 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:43.963257 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68a956e9-b23f-4988-a8cb-c7363040dc84 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:43.963869 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68a956e9-b23f-4988-a8cb-c7363040dc84 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:43.964848 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68a956e9-b23f-4988-a8cb-c7363040dc84 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:43.965498 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68a956e9-b23f-4988-a8cb-c7363040dc84 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:43.966112 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-68a956e9-b23f-4988-a8cb-c7363040dc84 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:43.988712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-68a956e9-b23f-4988-a8cb-c7363040dc84 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Getting quotas for project 4c0548e01f2249a98e28b618ca3ab8cc. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:17:43.996883 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-68a956e9-b23f-4988-a8cb-c7363040dc84 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Getting quotas for user 47f724dca5d5409d9a3a02289c286d89 and project 4c0548e01f2249a98e28b618ca3ab8cc. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:17:44.013010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-68a956e9-b23f-4988-a8cb-c7363040dc84 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Going to run 2 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:17:44.025762 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-68a956e9-b23f-4988-a8cb-c7363040dc84 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: 079570ec-d936-4d26-9f99-980e2fc3276f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:17:44.114223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-68a956e9-b23f-4988-a8cb-c7363040dc84 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: b3ec8fad-a7fd-48d3-8766-bf6092ace8d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=079570ec-d936-4d26-9f99-980e2fc3276f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:17:44.208891 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-447d3994-d4d3-4e85-8f62-584b18682b40 req-f7730e2e-ab2e-479d-943b-4d7bbe151c80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0beab9d3-30c1-4b22-9157-31705ad3dbf7", "tag": "a96d5dc1-0855-4012-ae99-7136b223ea2b"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:17:44.214324 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-68a956e9-b23f-4988-a8cb-c7363040dc84 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.410321 Sep 17 21:17:44.216039 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2631/5345] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:17:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1413 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:17:44.228315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-94a1bbea-22ca-445a-97f4-9771799f8c32 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:44.234371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-94a1bbea-22ca-445a-97f4-9771799f8c32 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '47f724dca5d5409d9a3a02289c286d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:44.235485 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-94a1bbea-22ca-445a-97f4-9771799f8c32 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Searching by: {'deleted': False, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc'} {{(pid=140523) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:17:44.260980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-447d3994-d4d3-4e85-8f62-584b18682b40 req-f7730e2e-ab2e-479d-943b-4d7bbe151c80 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:44.261206 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-447d3994-d4d3-4e85-8f62-584b18682b40 req-f7730e2e-ab2e-479d-943b-4d7bbe151c80 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:44.274984 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-447d3994-d4d3-4e85-8f62-584b18682b40 req-f7730e2e-ab2e-479d-943b-4d7bbe151c80 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:44.289045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-94a1bbea-22ca-445a-97f4-9771799f8c32 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:44.291535 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-94a1bbea-22ca-445a-97f4-9771799f8c32 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:44.292152 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-94a1bbea-22ca-445a-97f4-9771799f8c32 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:44.293960 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-94a1bbea-22ca-445a-97f4-9771799f8c32 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:44.297075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-94a1bbea-22ca-445a-97f4-9771799f8c32 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:44.298231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-94a1bbea-22ca-445a-97f4-9771799f8c32 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:44.313186 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-447d3994-d4d3-4e85-8f62-584b18682b40 req-f7730e2e-ab2e-479d-943b-4d7bbe151c80 service nova] Creating event network-changed:a96d5dc1-0855-4012-ae99-7136b223ea2b for instance 0beab9d3-30c1-4b22-9157-31705ad3dbf7 on nch2-master-1 Sep 17 21:17:44.325244 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-447d3994-d4d3-4e85-8f62-584b18682b40 req-f7730e2e-ab2e-479d-943b-4d7bbe151c80 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127783 Sep 17 21:17:44.331939 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2715/5346] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:17:44.341566 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-94a1bbea-22ca-445a-97f4-9771799f8c32 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.118571 Sep 17 21:17:44.342838 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2632/5347] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Sep 17 21:17:44 2022] GET /compute/v2.1/servers => generated 675 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:17:44.367543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7cedd474-5e70-4a2b-bf1a-880fee3e9ba4 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:44.368410 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7cedd474-5e70-4a2b-bf1a-880fee3e9ba4 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: b3ec8fad-a7fd-48d3-8766-bf6092ace8d9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:44.491880 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7cedd474-5e70-4a2b-bf1a-880fee3e9ba4 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f724dca5d5409d9a3a02289c286d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:44.503931 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7cedd474-5e70-4a2b-bf1a-880fee3e9ba4 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers/b3ec8fad-a7fd-48d3-8766-bf6092ace8d9" status: 200 len: 1219 microversion: 2.1 time: 0.143577 Sep 17 21:17:44.506040 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2716/5348] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:44 2022] GET /compute/v2.1/servers/b3ec8fad-a7fd-48d3-8766-bf6092ace8d9 => generated 1219 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:44.662990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9a55b5a1-0efe-4040-b800-5fd7aac5c7d7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:44.663757 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9a55b5a1-0efe-4040-b800-5fd7aac5c7d7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:44.679559 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9a55b5a1-0efe-4040-b800-5fd7aac5c7d7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:44.682094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9a55b5a1-0efe-4040-b800-5fd7aac5c7d7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:44.686960 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9a55b5a1-0efe-4040-b800-5fd7aac5c7d7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:44.687884 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9a55b5a1-0efe-4040-b800-5fd7aac5c7d7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:44.688386 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9a55b5a1-0efe-4040-b800-5fd7aac5c7d7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:44.688837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9a55b5a1-0efe-4040-b800-5fd7aac5c7d7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:45.247490 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9a55b5a1-0efe-4040-b800-5fd7aac5c7d7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:45.259390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9a55b5a1-0efe-4040-b800-5fd7aac5c7d7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:45.267081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9a55b5a1-0efe-4040-b800-5fd7aac5c7d7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:45.274080 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9a55b5a1-0efe-4040-b800-5fd7aac5c7d7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1406 microversion: 2.20 time: 0.613181 Sep 17 21:17:45.280038 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2633/5349] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:17:44 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1406 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:17:45.534316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e66506fc-01ce-492b-be27-a27438c3c2fb tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:45.536106 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e66506fc-01ce-492b-be27-a27438c3c2fb tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: b3ec8fad-a7fd-48d3-8766-bf6092ace8d9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:45.543713 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:17:45.714721 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e66506fc-01ce-492b-be27-a27438c3c2fb tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f724dca5d5409d9a3a02289c286d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:45.738729 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e66506fc-01ce-492b-be27-a27438c3c2fb tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers/b3ec8fad-a7fd-48d3-8766-bf6092ace8d9" status: 200 len: 1219 microversion: 2.1 time: 0.214176 Sep 17 21:17:45.741606 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2717/5350] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:45 2022] GET /compute/v2.1/servers/b3ec8fad-a7fd-48d3-8766-bf6092ace8d9 => generated 1219 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:46.309344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-41e9b45e-c18e-4e9c-98e9-4112a9a374ce tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:46.311298 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-41e9b45e-c18e-4e9c-98e9-4112a9a374ce tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:46.325364 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-41e9b45e-c18e-4e9c-98e9-4112a9a374ce tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:46.326066 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-41e9b45e-c18e-4e9c-98e9-4112a9a374ce tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:46.326609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-41e9b45e-c18e-4e9c-98e9-4112a9a374ce tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:46.328067 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-41e9b45e-c18e-4e9c-98e9-4112a9a374ce tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:46.330197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-41e9b45e-c18e-4e9c-98e9-4112a9a374ce tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:46.336027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-41e9b45e-c18e-4e9c-98e9-4112a9a374ce tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:46.767706 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-11f0b5c4-676d-48aa-ba5d-89e8d1aa6dfd tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:46.768600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-11f0b5c4-676d-48aa-ba5d-89e8d1aa6dfd tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: b3ec8fad-a7fd-48d3-8766-bf6092ace8d9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:46.796703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-11f0b5c4-676d-48aa-ba5d-89e8d1aa6dfd tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:46.797237 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-11f0b5c4-676d-48aa-ba5d-89e8d1aa6dfd tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:46.798427 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-41e9b45e-c18e-4e9c-98e9-4112a9a374ce tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:46.800229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-11f0b5c4-676d-48aa-ba5d-89e8d1aa6dfd tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:46.801083 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-11f0b5c4-676d-48aa-ba5d-89e8d1aa6dfd tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:46.801594 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-11f0b5c4-676d-48aa-ba5d-89e8d1aa6dfd tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:46.802038 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-11f0b5c4-676d-48aa-ba5d-89e8d1aa6dfd tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:46.807181 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-41e9b45e-c18e-4e9c-98e9-4112a9a374ce tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:46.812315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-41e9b45e-c18e-4e9c-98e9-4112a9a374ce tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:46.814925 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-41e9b45e-c18e-4e9c-98e9-4112a9a374ce tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1406 microversion: 2.20 time: 0.509768 Sep 17 21:17:46.815517 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2634/5351] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:17:46 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1406 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:17:47.012041 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-11f0b5c4-676d-48aa-ba5d-89e8d1aa6dfd tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f724dca5d5409d9a3a02289c286d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:47.026849 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-11f0b5c4-676d-48aa-ba5d-89e8d1aa6dfd tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers/b3ec8fad-a7fd-48d3-8766-bf6092ace8d9" status: 200 len: 1271 microversion: 2.1 time: 0.263517 Sep 17 21:17:47.027733 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2718/5352] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:46 2022] GET /compute/v2.1/servers/b3ec8fad-a7fd-48d3-8766-bf6092ace8d9 => generated 1271 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:47.843087 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f03c456e-05af-46b4-b646-ed95f61fefb0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:47.844369 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f03c456e-05af-46b4-b646-ed95f61fefb0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:47.850808 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=1,nova_api:INSERT=9 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:17:47.857021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f03c456e-05af-46b4-b646-ed95f61fefb0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:47.858498 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f03c456e-05af-46b4-b646-ed95f61fefb0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:47.859400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f03c456e-05af-46b4-b646-ed95f61fefb0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:47.860321 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f03c456e-05af-46b4-b646-ed95f61fefb0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:47.860950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f03c456e-05af-46b4-b646-ed95f61fefb0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:47.861822 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f03c456e-05af-46b4-b646-ed95f61fefb0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:48.055093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-36a10dd9-6c02-47ce-a6b8-cd7856e34962 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:48.055711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-36a10dd9-6c02-47ce-a6b8-cd7856e34962 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: b3ec8fad-a7fd-48d3-8766-bf6092ace8d9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:48.068547 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-36a10dd9-6c02-47ce-a6b8-cd7856e34962 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:48.069291 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-36a10dd9-6c02-47ce-a6b8-cd7856e34962 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:48.074262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-36a10dd9-6c02-47ce-a6b8-cd7856e34962 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:48.075281 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-36a10dd9-6c02-47ce-a6b8-cd7856e34962 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:48.075909 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-36a10dd9-6c02-47ce-a6b8-cd7856e34962 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:48.077066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-36a10dd9-6c02-47ce-a6b8-cd7856e34962 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:48.167452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f03c456e-05af-46b4-b646-ed95f61fefb0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:48.184691 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f03c456e-05af-46b4-b646-ed95f61fefb0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:48.188814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f03c456e-05af-46b4-b646-ed95f61fefb0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:48.192910 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f03c456e-05af-46b4-b646-ed95f61fefb0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1406 microversion: 2.20 time: 0.352562 Sep 17 21:17:48.193585 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2635/5353] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:17:47 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1406 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:17:48.215831 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-36a10dd9-6c02-47ce-a6b8-cd7856e34962 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f724dca5d5409d9a3a02289c286d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:48.238074 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-36a10dd9-6c02-47ce-a6b8-cd7856e34962 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers/b3ec8fad-a7fd-48d3-8766-bf6092ace8d9" status: 200 len: 1277 microversion: 2.1 time: 0.186885 Sep 17 21:17:48.245976 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2719/5354] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:48 2022] GET /compute/v2.1/servers/b3ec8fad-a7fd-48d3-8766-bf6092ace8d9 => generated 1277 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:49.223779 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8f2bb21b-b102-4148-874f-493b3688829e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:49.224472 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8f2bb21b-b102-4148-874f-493b3688829e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:49.235608 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8f2bb21b-b102-4148-874f-493b3688829e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:49.236418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8f2bb21b-b102-4148-874f-493b3688829e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:49.237304 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8f2bb21b-b102-4148-874f-493b3688829e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:49.238228 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8f2bb21b-b102-4148-874f-493b3688829e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:49.238849 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8f2bb21b-b102-4148-874f-493b3688829e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:49.240430 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8f2bb21b-b102-4148-874f-493b3688829e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:49.266429 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1b57eed4-69b1-46e2-8fd3-860238fd6c08 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:49.269532 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1b57eed4-69b1-46e2-8fd3-860238fd6c08 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: b3ec8fad-a7fd-48d3-8766-bf6092ace8d9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:49.289337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1b57eed4-69b1-46e2-8fd3-860238fd6c08 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:49.290310 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1b57eed4-69b1-46e2-8fd3-860238fd6c08 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:49.290920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1b57eed4-69b1-46e2-8fd3-860238fd6c08 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:49.291797 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1b57eed4-69b1-46e2-8fd3-860238fd6c08 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:49.292400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1b57eed4-69b1-46e2-8fd3-860238fd6c08 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:49.292999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1b57eed4-69b1-46e2-8fd3-860238fd6c08 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:49.426541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1b57eed4-69b1-46e2-8fd3-860238fd6c08 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f724dca5d5409d9a3a02289c286d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:49.443550 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1b57eed4-69b1-46e2-8fd3-860238fd6c08 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers/b3ec8fad-a7fd-48d3-8766-bf6092ace8d9" status: 200 len: 1277 microversion: 2.1 time: 0.182953 Sep 17 21:17:49.445291 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2720/5355] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:49 2022] GET /compute/v2.1/servers/b3ec8fad-a7fd-48d3-8766-bf6092ace8d9 => generated 1277 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:49.529211 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8f2bb21b-b102-4148-874f-493b3688829e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:49.541368 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8f2bb21b-b102-4148-874f-493b3688829e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:49.547918 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8f2bb21b-b102-4148-874f-493b3688829e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:49.551623 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8f2bb21b-b102-4148-874f-493b3688829e tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1406 microversion: 2.20 time: 0.330061 Sep 17 21:17:49.553201 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2636/5356] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:17:49 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1406 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:17:50.467695 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bbf10527-0344-44e6-a14a-ff8197f1af37 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:50.471528 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bbf10527-0344-44e6-a14a-ff8197f1af37 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: b3ec8fad-a7fd-48d3-8766-bf6092ace8d9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:50.479532 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbf10527-0344-44e6-a14a-ff8197f1af37 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:50.480353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbf10527-0344-44e6-a14a-ff8197f1af37 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:50.481187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbf10527-0344-44e6-a14a-ff8197f1af37 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:50.482301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbf10527-0344-44e6-a14a-ff8197f1af37 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:50.482990 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbf10527-0344-44e6-a14a-ff8197f1af37 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:50.483622 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbf10527-0344-44e6-a14a-ff8197f1af37 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:50.525988 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-89c31f7b-5595-48ef-ba0b-c89cd354ca90 req-f4d7f614-0b38-4cad-a04e-8982c4c1cdf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0beab9d3-30c1-4b22-9157-31705ad3dbf7", "name": "network-vif-plugged", "status": "completed", "tag": "a96d5dc1-0855-4012-ae99-7136b223ea2b"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:17:50.547754 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-89c31f7b-5595-48ef-ba0b-c89cd354ca90 req-f4d7f614-0b38-4cad-a04e-8982c4c1cdf0 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:50.548675 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-89c31f7b-5595-48ef-ba0b-c89cd354ca90 req-f4d7f614-0b38-4cad-a04e-8982c4c1cdf0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:50.549365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-89c31f7b-5595-48ef-ba0b-c89cd354ca90 req-f4d7f614-0b38-4cad-a04e-8982c4c1cdf0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:50.572982 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-89c31f7b-5595-48ef-ba0b-c89cd354ca90 req-f4d7f614-0b38-4cad-a04e-8982c4c1cdf0 service nova] Creating event network-vif-plugged:a96d5dc1-0855-4012-ae99-7136b223ea2b for instance 0beab9d3-30c1-4b22-9157-31705ad3dbf7 on nch2-master-1 Sep 17 21:17:50.581396 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-89c31f7b-5595-48ef-ba0b-c89cd354ca90 req-f4d7f614-0b38-4cad-a04e-8982c4c1cdf0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058050 Sep 17 21:17:50.582904 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2637/5357] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:17:50.589962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4fb800ca-212f-4220-b39b-1f008adab182 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:50.591055 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4fb800ca-212f-4220-b39b-1f008adab182 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:50.599377 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4fb800ca-212f-4220-b39b-1f008adab182 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:50.600923 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4fb800ca-212f-4220-b39b-1f008adab182 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:50.601704 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4fb800ca-212f-4220-b39b-1f008adab182 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:50.602735 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4fb800ca-212f-4220-b39b-1f008adab182 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:50.603407 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4fb800ca-212f-4220-b39b-1f008adab182 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:50.604043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4fb800ca-212f-4220-b39b-1f008adab182 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:51.122206 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bbf10527-0344-44e6-a14a-ff8197f1af37 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f724dca5d5409d9a3a02289c286d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:51.136240 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bbf10527-0344-44e6-a14a-ff8197f1af37 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers/b3ec8fad-a7fd-48d3-8766-bf6092ace8d9" status: 200 len: 1319 microversion: 2.1 time: 0.672150 Sep 17 21:17:51.137306 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2721/5358] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:50 2022] GET /compute/v2.1/servers/b3ec8fad-a7fd-48d3-8766-bf6092ace8d9 => generated 1319 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:51.144052 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4fb800ca-212f-4220-b39b-1f008adab182 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:51.159513 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4fb800ca-212f-4220-b39b-1f008adab182 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:51.161655 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4fb800ca-212f-4220-b39b-1f008adab182 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:51.163280 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4fb800ca-212f-4220-b39b-1f008adab182 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1406 microversion: 2.20 time: 0.578692 Sep 17 21:17:51.178081 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2638/5359] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:17:50 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1406 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:17:51.535275 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-904a1fea-6dbb-44fe-93fe-074f757e8cf1 req-d89413b7-3a04-4a4e-8f29-b13da3fe555f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "079570ec-d936-4d26-9f99-980e2fc3276f", "tag": "5da03508-c020-4844-9a20-7f746a3b13e7"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:17:51.550079 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-904a1fea-6dbb-44fe-93fe-074f757e8cf1 req-d89413b7-3a04-4a4e-8f29-b13da3fe555f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:51.550905 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-904a1fea-6dbb-44fe-93fe-074f757e8cf1 req-d89413b7-3a04-4a4e-8f29-b13da3fe555f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:51.551596 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-904a1fea-6dbb-44fe-93fe-074f757e8cf1 req-d89413b7-3a04-4a4e-8f29-b13da3fe555f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:51.565708 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-904a1fea-6dbb-44fe-93fe-074f757e8cf1 req-d89413b7-3a04-4a4e-8f29-b13da3fe555f service nova] Creating event network-changed:5da03508-c020-4844-9a20-7f746a3b13e7 for instance 079570ec-d936-4d26-9f99-980e2fc3276f on nch1-master-1 Sep 17 21:17:51.570980 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-904a1fea-6dbb-44fe-93fe-074f757e8cf1 req-d89413b7-3a04-4a4e-8f29-b13da3fe555f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040617 Sep 17 21:17:51.571985 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2722/5360] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:17:52.170313 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-326b46c9-cbf8-454d-9bb9-177b310c8887 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:52.172796 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-326b46c9-cbf8-454d-9bb9-177b310c8887 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: b3ec8fad-a7fd-48d3-8766-bf6092ace8d9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:52.182823 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-326b46c9-cbf8-454d-9bb9-177b310c8887 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:52.188225 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-326b46c9-cbf8-454d-9bb9-177b310c8887 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:52.189566 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-326b46c9-cbf8-454d-9bb9-177b310c8887 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:52.190775 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8e1e67c5-2435-4ffc-8b01-f99d8359fa67 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:52.191370 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8e1e67c5-2435-4ffc-8b01-f99d8359fa67 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:52.192446 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-326b46c9-cbf8-454d-9bb9-177b310c8887 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:52.193329 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-326b46c9-cbf8-454d-9bb9-177b310c8887 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:52.194080 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-326b46c9-cbf8-454d-9bb9-177b310c8887 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:52.198233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e1e67c5-2435-4ffc-8b01-f99d8359fa67 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:52.198726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e1e67c5-2435-4ffc-8b01-f99d8359fa67 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:52.199398 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e1e67c5-2435-4ffc-8b01-f99d8359fa67 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:52.200329 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e1e67c5-2435-4ffc-8b01-f99d8359fa67 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:52.200943 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e1e67c5-2435-4ffc-8b01-f99d8359fa67 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:52.201537 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e1e67c5-2435-4ffc-8b01-f99d8359fa67 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:52.573201 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8e1e67c5-2435-4ffc-8b01-f99d8359fa67 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:52.582980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8e1e67c5-2435-4ffc-8b01-f99d8359fa67 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:52.584369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8e1e67c5-2435-4ffc-8b01-f99d8359fa67 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:52.585533 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8e1e67c5-2435-4ffc-8b01-f99d8359fa67 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1406 microversion: 2.20 time: 0.399080 Sep 17 21:17:52.590101 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-326b46c9-cbf8-454d-9bb9-177b310c8887 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f724dca5d5409d9a3a02289c286d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:52.598595 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-326b46c9-cbf8-454d-9bb9-177b310c8887 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers/b3ec8fad-a7fd-48d3-8766-bf6092ace8d9" status: 200 len: 1319 microversion: 2.1 time: 0.441490 Sep 17 21:17:52.602376 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2723/5361] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:17:52 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1406 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:17:52.610087 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2639/5362] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:52 2022] GET /compute/v2.1/servers/b3ec8fad-a7fd-48d3-8766-bf6092ace8d9 => generated 1319 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:53.622296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-1da7a709-6326-4377-a8c9-69ed4742b5f9 req-b79f2926-1871-4c73-92d5-019fe69a1c0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3ec8fad-a7fd-48d3-8766-bf6092ace8d9", "tag": "8f8fcfb2-c76e-436e-9630-58bfb4a2057e"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:17:53.623253 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-59128a1d-f254-41c4-b98a-84cda1e4a5bd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:53.623999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-59128a1d-f254-41c4-b98a-84cda1e4a5bd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:53.641924 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59128a1d-f254-41c4-b98a-84cda1e4a5bd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:53.642425 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59128a1d-f254-41c4-b98a-84cda1e4a5bd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:53.642864 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59128a1d-f254-41c4-b98a-84cda1e4a5bd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:53.643598 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59128a1d-f254-41c4-b98a-84cda1e4a5bd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:53.644047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59128a1d-f254-41c4-b98a-84cda1e4a5bd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:53.644471 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59128a1d-f254-41c4-b98a-84cda1e4a5bd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:53.647417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=100 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:17:53.652575 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-1da7a709-6326-4377-a8c9-69ed4742b5f9 req-b79f2926-1871-4c73-92d5-019fe69a1c0d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:53.653256 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-1da7a709-6326-4377-a8c9-69ed4742b5f9 req-b79f2926-1871-4c73-92d5-019fe69a1c0d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:53.653744 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-1da7a709-6326-4377-a8c9-69ed4742b5f9 req-b79f2926-1871-4c73-92d5-019fe69a1c0d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:53.668576 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-1da7a709-6326-4377-a8c9-69ed4742b5f9 req-b79f2926-1871-4c73-92d5-019fe69a1c0d service nova] Creating event network-changed:8f8fcfb2-c76e-436e-9630-58bfb4a2057e for instance b3ec8fad-a7fd-48d3-8766-bf6092ace8d9 on nch1-master-1 Sep 17 21:17:53.674543 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-1da7a709-6326-4377-a8c9-69ed4742b5f9 req-b79f2926-1871-4c73-92d5-019fe69a1c0d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056968 Sep 17 21:17:53.676621 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2640/5363] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:17:53.684478 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f888165c-93f3-49b2-8233-106a96231168 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:53.685489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f888165c-93f3-49b2-8233-106a96231168 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: b3ec8fad-a7fd-48d3-8766-bf6092ace8d9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:53.693290 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f888165c-93f3-49b2-8233-106a96231168 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:53.694792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f888165c-93f3-49b2-8233-106a96231168 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:53.695461 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f888165c-93f3-49b2-8233-106a96231168 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:53.696388 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f888165c-93f3-49b2-8233-106a96231168 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:53.697043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f888165c-93f3-49b2-8233-106a96231168 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:53.697707 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f888165c-93f3-49b2-8233-106a96231168 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:53.966122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-59128a1d-f254-41c4-b98a-84cda1e4a5bd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:53.976145 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-59128a1d-f254-41c4-b98a-84cda1e4a5bd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:53.980098 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-59128a1d-f254-41c4-b98a-84cda1e4a5bd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:53.982075 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-59128a1d-f254-41c4-b98a-84cda1e4a5bd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1598 microversion: 2.20 time: 0.372914 Sep 17 21:17:53.989449 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2724/5364] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:17:53 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1598 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:17:54.004032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f888165c-93f3-49b2-8233-106a96231168 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f724dca5d5409d9a3a02289c286d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:54.009046 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=12 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:17:54.015995 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f888165c-93f3-49b2-8233-106a96231168 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers/b3ec8fad-a7fd-48d3-8766-bf6092ace8d9" status: 200 len: 1319 microversion: 2.1 time: 0.338000 Sep 17 21:17:54.022138 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2641/5365] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:53 2022] GET /compute/v2.1/servers/b3ec8fad-a7fd-48d3-8766-bf6092ace8d9 => generated 1319 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:54.023217 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-713f0108-06c2-48cf-8dfb-1ac0d28d62bd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:54.023924 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-713f0108-06c2-48cf-8dfb-1ac0d28d62bd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:54.030575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-713f0108-06c2-48cf-8dfb-1ac0d28d62bd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:54.031289 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-713f0108-06c2-48cf-8dfb-1ac0d28d62bd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:54.031919 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-713f0108-06c2-48cf-8dfb-1ac0d28d62bd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:54.032807 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-713f0108-06c2-48cf-8dfb-1ac0d28d62bd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:54.033437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-713f0108-06c2-48cf-8dfb-1ac0d28d62bd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:54.034686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-713f0108-06c2-48cf-8dfb-1ac0d28d62bd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:54.147354 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-713f0108-06c2-48cf-8dfb-1ac0d28d62bd tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.130459 Sep 17 21:17:54.149124 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2725/5366] 10.222.0.26 () {60 vars in 1316 bytes} [Sat Sep 17 21:17:54 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7/os-interface => generated 285 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:17:55.044911 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b821cef9-9238-4ce2-a6bf-e11156ce3f75 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:55.045567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b821cef9-9238-4ce2-a6bf-e11156ce3f75 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: b3ec8fad-a7fd-48d3-8766-bf6092ace8d9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:55.051383 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:17:55.054040 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b821cef9-9238-4ce2-a6bf-e11156ce3f75 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:55.054827 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b821cef9-9238-4ce2-a6bf-e11156ce3f75 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:55.055429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b821cef9-9238-4ce2-a6bf-e11156ce3f75 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:55.056314 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b821cef9-9238-4ce2-a6bf-e11156ce3f75 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:55.057160 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b821cef9-9238-4ce2-a6bf-e11156ce3f75 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:55.057822 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b821cef9-9238-4ce2-a6bf-e11156ce3f75 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:55.374059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b821cef9-9238-4ce2-a6bf-e11156ce3f75 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f724dca5d5409d9a3a02289c286d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:55.394160 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b821cef9-9238-4ce2-a6bf-e11156ce3f75 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers/b3ec8fad-a7fd-48d3-8766-bf6092ace8d9" status: 200 len: 1319 microversion: 2.1 time: 0.353433 Sep 17 21:17:55.396820 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2642/5367] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:55 2022] GET /compute/v2.1/servers/b3ec8fad-a7fd-48d3-8766-bf6092ace8d9 => generated 1319 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:55.417267 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-688efe2a-a5e8-40c5-9cd1-64b821db7f88 req-8891de0e-8d0f-4261-bcbb-c807dc59a42b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0beab9d3-30c1-4b22-9157-31705ad3dbf7", "tag": "a96d5dc1-0855-4012-ae99-7136b223ea2b"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:17:55.433775 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-688efe2a-a5e8-40c5-9cd1-64b821db7f88 req-8891de0e-8d0f-4261-bcbb-c807dc59a42b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:55.434465 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-688efe2a-a5e8-40c5-9cd1-64b821db7f88 req-8891de0e-8d0f-4261-bcbb-c807dc59a42b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:55.435038 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-688efe2a-a5e8-40c5-9cd1-64b821db7f88 req-8891de0e-8d0f-4261-bcbb-c807dc59a42b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:55.458565 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-688efe2a-a5e8-40c5-9cd1-64b821db7f88 req-8891de0e-8d0f-4261-bcbb-c807dc59a42b service nova] Creating event network-changed:a96d5dc1-0855-4012-ae99-7136b223ea2b for instance 0beab9d3-30c1-4b22-9157-31705ad3dbf7 on nch2-master-1 Sep 17 21:17:55.464572 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-688efe2a-a5e8-40c5-9cd1-64b821db7f88 req-8891de0e-8d0f-4261-bcbb-c807dc59a42b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051945 Sep 17 21:17:55.469885 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2726/5368] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:17:56.422156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c923536d-c34b-43e6-a37e-ca71b24d7997 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:56.423163 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c923536d-c34b-43e6-a37e-ca71b24d7997 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: b3ec8fad-a7fd-48d3-8766-bf6092ace8d9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:56.432919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c923536d-c34b-43e6-a37e-ca71b24d7997 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:56.434110 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c923536d-c34b-43e6-a37e-ca71b24d7997 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:56.435119 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c923536d-c34b-43e6-a37e-ca71b24d7997 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:56.436229 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c923536d-c34b-43e6-a37e-ca71b24d7997 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:56.437054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c923536d-c34b-43e6-a37e-ca71b24d7997 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:56.437996 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c923536d-c34b-43e6-a37e-ca71b24d7997 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:56.640111 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c923536d-c34b-43e6-a37e-ca71b24d7997 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f724dca5d5409d9a3a02289c286d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:56.651302 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c923536d-c34b-43e6-a37e-ca71b24d7997 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers/b3ec8fad-a7fd-48d3-8766-bf6092ace8d9" status: 200 len: 1319 microversion: 2.1 time: 0.234529 Sep 17 21:17:56.652439 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2643/5369] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:56 2022] GET /compute/v2.1/servers/b3ec8fad-a7fd-48d3-8766-bf6092ace8d9 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:57.575799 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=10 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:17:57.587250 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-e93cf0e1-678e-4214-9c5f-edacaf63587f req-4c4e5d0f-177b-4347-8bd6-5344c79b3d70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "079570ec-d936-4d26-9f99-980e2fc3276f", "name": "network-vif-plugged", "status": "completed", "tag": "5da03508-c020-4844-9a20-7f746a3b13e7"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:17:57.603702 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e93cf0e1-678e-4214-9c5f-edacaf63587f req-4c4e5d0f-177b-4347-8bd6-5344c79b3d70 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:57.603837 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e93cf0e1-678e-4214-9c5f-edacaf63587f req-4c4e5d0f-177b-4347-8bd6-5344c79b3d70 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:57.604440 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e93cf0e1-678e-4214-9c5f-edacaf63587f req-4c4e5d0f-177b-4347-8bd6-5344c79b3d70 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:57.619391 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-e93cf0e1-678e-4214-9c5f-edacaf63587f req-4c4e5d0f-177b-4347-8bd6-5344c79b3d70 service nova] Creating event network-vif-plugged:5da03508-c020-4844-9a20-7f746a3b13e7 for instance 079570ec-d936-4d26-9f99-980e2fc3276f on nch1-master-1 Sep 17 21:17:57.624900 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-e93cf0e1-678e-4214-9c5f-edacaf63587f req-4c4e5d0f-177b-4347-8bd6-5344c79b3d70 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050274 Sep 17 21:17:57.625838 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2727/5370] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:17:57.698607 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5fe6dd67-1768-4701-b52d-f87f54762a56 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:57.699271 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5fe6dd67-1768-4701-b52d-f87f54762a56 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: b3ec8fad-a7fd-48d3-8766-bf6092ace8d9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:57.721036 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5fe6dd67-1768-4701-b52d-f87f54762a56 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:57.721946 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5fe6dd67-1768-4701-b52d-f87f54762a56 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:57.723501 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5fe6dd67-1768-4701-b52d-f87f54762a56 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:57.724510 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5fe6dd67-1768-4701-b52d-f87f54762a56 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:57.727382 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5fe6dd67-1768-4701-b52d-f87f54762a56 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:57.727842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5fe6dd67-1768-4701-b52d-f87f54762a56 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:58.028222 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5fe6dd67-1768-4701-b52d-f87f54762a56 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f724dca5d5409d9a3a02289c286d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:58.037124 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5fe6dd67-1768-4701-b52d-f87f54762a56 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers/b3ec8fad-a7fd-48d3-8766-bf6092ace8d9" status: 200 len: 1319 microversion: 2.1 time: 0.358240 Sep 17 21:17:58.038145 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2644/5371] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:57 2022] GET /compute/v2.1/servers/b3ec8fad-a7fd-48d3-8766-bf6092ace8d9 => generated 1319 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:59.061960 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-62b31995-75b6-454e-86c8-474999677451 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:17:59.062666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-62b31995-75b6-454e-86c8-474999677451 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: b3ec8fad-a7fd-48d3-8766-bf6092ace8d9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:17:59.069381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62b31995-75b6-454e-86c8-474999677451 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:59.069983 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62b31995-75b6-454e-86c8-474999677451 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:59.070463 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62b31995-75b6-454e-86c8-474999677451 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:59.071134 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62b31995-75b6-454e-86c8-474999677451 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:59.071611 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62b31995-75b6-454e-86c8-474999677451 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:59.072226 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62b31995-75b6-454e-86c8-474999677451 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:59.222715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-62b31995-75b6-454e-86c8-474999677451 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f724dca5d5409d9a3a02289c286d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:17:59.230890 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-62b31995-75b6-454e-86c8-474999677451 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers/b3ec8fad-a7fd-48d3-8766-bf6092ace8d9" status: 200 len: 1319 microversion: 2.1 time: 0.174139 Sep 17 21:17:59.234791 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2728/5372] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:17:59 2022] GET /compute/v2.1/servers/b3ec8fad-a7fd-48d3-8766-bf6092ace8d9 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:17:59.653207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-c2a1889f-ff41-4d52-9149-9a798a91268e req-227233d8-fe7a-4cfa-885b-dce5b4846c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3ec8fad-a7fd-48d3-8766-bf6092ace8d9", "name": "network-vif-plugged", "status": "completed", "tag": "8f8fcfb2-c76e-436e-9630-58bfb4a2057e"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:17:59.664254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-c2a1889f-ff41-4d52-9149-9a798a91268e req-227233d8-fe7a-4cfa-885b-dce5b4846c51 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:17:59.664757 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-c2a1889f-ff41-4d52-9149-9a798a91268e req-227233d8-fe7a-4cfa-885b-dce5b4846c51 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:17:59.665188 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-c2a1889f-ff41-4d52-9149-9a798a91268e req-227233d8-fe7a-4cfa-885b-dce5b4846c51 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:17:59.668040 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:17:59.681725 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-c2a1889f-ff41-4d52-9149-9a798a91268e req-227233d8-fe7a-4cfa-885b-dce5b4846c51 service nova] Creating event network-vif-plugged:8f8fcfb2-c76e-436e-9630-58bfb4a2057e for instance b3ec8fad-a7fd-48d3-8766-bf6092ace8d9 on nch1-master-1 Sep 17 21:17:59.687835 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-c2a1889f-ff41-4d52-9149-9a798a91268e req-227233d8-fe7a-4cfa-885b-dce5b4846c51 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038295 Sep 17 21:17:59.688813 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2645/5373] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:18:00.255666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ba2d85dc-23ba-4d25-b83b-0463d19bdfa5 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:00.256285 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ba2d85dc-23ba-4d25-b83b-0463d19bdfa5 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: b3ec8fad-a7fd-48d3-8766-bf6092ace8d9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:00.268725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ba2d85dc-23ba-4d25-b83b-0463d19bdfa5 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:00.269299 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ba2d85dc-23ba-4d25-b83b-0463d19bdfa5 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:00.269828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ba2d85dc-23ba-4d25-b83b-0463d19bdfa5 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:00.270504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ba2d85dc-23ba-4d25-b83b-0463d19bdfa5 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:00.270935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ba2d85dc-23ba-4d25-b83b-0463d19bdfa5 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:00.271357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ba2d85dc-23ba-4d25-b83b-0463d19bdfa5 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:00.434613 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ba2d85dc-23ba-4d25-b83b-0463d19bdfa5 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f724dca5d5409d9a3a02289c286d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:00.442667 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ba2d85dc-23ba-4d25-b83b-0463d19bdfa5 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers/b3ec8fad-a7fd-48d3-8766-bf6092ace8d9" status: 200 len: 1319 microversion: 2.1 time: 0.190817 Sep 17 21:18:00.443489 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2729/5374] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:00 2022] GET /compute/v2.1/servers/b3ec8fad-a7fd-48d3-8766-bf6092ace8d9 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:01.470451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b3986ba1-be50-466d-bff3-cf197b4e9c66 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:01.471637 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b3986ba1-be50-466d-bff3-cf197b4e9c66 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: b3ec8fad-a7fd-48d3-8766-bf6092ace8d9] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:01.482201 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3986ba1-be50-466d-bff3-cf197b4e9c66 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:01.483772 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3986ba1-be50-466d-bff3-cf197b4e9c66 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:01.486519 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3986ba1-be50-466d-bff3-cf197b4e9c66 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:01.490856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3986ba1-be50-466d-bff3-cf197b4e9c66 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:01.491436 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3986ba1-be50-466d-bff3-cf197b4e9c66 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:01.493573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3986ba1-be50-466d-bff3-cf197b4e9c66 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:01.705161 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b3986ba1-be50-466d-bff3-cf197b4e9c66 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f724dca5d5409d9a3a02289c286d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:01.714302 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b3986ba1-be50-466d-bff3-cf197b4e9c66 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers/b3ec8fad-a7fd-48d3-8766-bf6092ace8d9" status: 200 len: 1507 microversion: 2.1 time: 0.251576 Sep 17 21:18:01.715013 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2646/5375] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:01 2022] GET /compute/v2.1/servers/b3ec8fad-a7fd-48d3-8766-bf6092ace8d9 => generated 1507 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:01.738504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-97e64a93-7c8d-4174-8b6a-2a04b85e77cf tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:01.739258 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-97e64a93-7c8d-4174-8b6a-2a04b85e77cf tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: 079570ec-d936-4d26-9f99-980e2fc3276f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:01.753693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97e64a93-7c8d-4174-8b6a-2a04b85e77cf tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:01.753693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97e64a93-7c8d-4174-8b6a-2a04b85e77cf tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:01.753693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97e64a93-7c8d-4174-8b6a-2a04b85e77cf tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:01.753693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97e64a93-7c8d-4174-8b6a-2a04b85e77cf tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:01.753693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97e64a93-7c8d-4174-8b6a-2a04b85e77cf tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:01.753693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97e64a93-7c8d-4174-8b6a-2a04b85e77cf tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:01.942273 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-97e64a93-7c8d-4174-8b6a-2a04b85e77cf tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f724dca5d5409d9a3a02289c286d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:01.950638 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-97e64a93-7c8d-4174-8b6a-2a04b85e77cf tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers/079570ec-d936-4d26-9f99-980e2fc3276f" status: 200 len: 1507 microversion: 2.1 time: 0.217147 Sep 17 21:18:01.951480 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2730/5376] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:01 2022] GET /compute/v2.1/servers/079570ec-d936-4d26-9f99-980e2fc3276f => generated 1507 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:01.981318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ce87eb6d-ca83-4946-a3d0-80316823bd1e tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:01.982120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ce87eb6d-ca83-4946-a3d0-80316823bd1e tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: 079570ec-d936-4d26-9f99-980e2fc3276f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:01.988919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce87eb6d-ca83-4946-a3d0-80316823bd1e tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:01.989423 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce87eb6d-ca83-4946-a3d0-80316823bd1e tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:01.990059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce87eb6d-ca83-4946-a3d0-80316823bd1e tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:01.990983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce87eb6d-ca83-4946-a3d0-80316823bd1e tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:01.991834 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce87eb6d-ca83-4946-a3d0-80316823bd1e tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:01.992507 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce87eb6d-ca83-4946-a3d0-80316823bd1e tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:02.019937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ce87eb6d-ca83-4946-a3d0-80316823bd1e tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: 079570ec-d936-4d26-9f99-980e2fc3276f] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:18:02.109332 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ce87eb6d-ca83-4946-a3d0-80316823bd1e tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "DELETE /compute/v2.1/servers/079570ec-d936-4d26-9f99-980e2fc3276f" status: 204 len: 0 microversion: 2.1 time: 0.132442 Sep 17 21:18:02.113722 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2647/5377] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:18:01 2022] DELETE /compute/v2.1/servers/079570ec-d936-4d26-9f99-980e2fc3276f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:18:02.119198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-27a06331-b62f-43b4-b6b1-0ff8cb44d3f8 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:02.120073 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-27a06331-b62f-43b4-b6b1-0ff8cb44d3f8 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: b3ec8fad-a7fd-48d3-8766-bf6092ace8d9] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:02.127329 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27a06331-b62f-43b4-b6b1-0ff8cb44d3f8 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:02.127983 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27a06331-b62f-43b4-b6b1-0ff8cb44d3f8 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:02.128603 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27a06331-b62f-43b4-b6b1-0ff8cb44d3f8 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:02.129311 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27a06331-b62f-43b4-b6b1-0ff8cb44d3f8 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:02.129795 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27a06331-b62f-43b4-b6b1-0ff8cb44d3f8 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:02.130376 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27a06331-b62f-43b4-b6b1-0ff8cb44d3f8 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:02.155887 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-27a06331-b62f-43b4-b6b1-0ff8cb44d3f8 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: b3ec8fad-a7fd-48d3-8766-bf6092ace8d9] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:18:02.262908 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-27a06331-b62f-43b4-b6b1-0ff8cb44d3f8 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b3ec8fad-a7fd-48d3-8766-bf6092ace8d9" status: 204 len: 0 microversion: 2.1 time: 0.146822 Sep 17 21:18:02.263617 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2731/5378] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:18:02 2022] DELETE /compute/v2.1/servers/b3ec8fad-a7fd-48d3-8766-bf6092ace8d9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:18:02.402103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-42337c40-110e-4de1-b4eb-220fbe2101f8 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-988949167", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "306b968f-d04a-461c-bf2a-af380824a404"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:18:02.467072 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-42337c40-110e-4de1-b4eb-220fbe2101f8 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] validate_networks() for [('306b968f-d04a-461c-bf2a-af380824a404', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:18:02.864276 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cf3d962d-7605-408f-8a7c-838a1fcc2be5 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:02.865573 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cf3d962d-7605-408f-8a7c-838a1fcc2be5 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] [instance: 4cf30912-b358-44af-ae25-2ce3f03ffd19] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:02.875430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cf3d962d-7605-408f-8a7c-838a1fcc2be5 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:02.876193 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cf3d962d-7605-408f-8a7c-838a1fcc2be5 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:02.876846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cf3d962d-7605-408f-8a7c-838a1fcc2be5 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:02.877968 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cf3d962d-7605-408f-8a7c-838a1fcc2be5 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:02.878625 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cf3d962d-7605-408f-8a7c-838a1fcc2be5 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:02.879678 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cf3d962d-7605-408f-8a7c-838a1fcc2be5 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:02.917261 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cf3d962d-7605-408f-8a7c-838a1fcc2be5 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] 10.222.0.26 "GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.057953 Sep 17 21:18:02.918823 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2732/5379] 10.222.0.26 () {58 vars in 1293 bytes} [Sat Sep 17 21:18:02 2022] GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19/os-server-password => generated 116 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:18:02.984453 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-42337c40-110e-4de1-b4eb-220fbe2101f8 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:18:02.984991 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-42337c40-110e-4de1-b4eb-220fbe2101f8 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:18:02.985761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-42337c40-110e-4de1-b4eb-220fbe2101f8 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:18:02.986277 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-42337c40-110e-4de1-b4eb-220fbe2101f8 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:18:02.986787 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-42337c40-110e-4de1-b4eb-220fbe2101f8 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:18:02.996981 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-42337c40-110e-4de1-b4eb-220fbe2101f8 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:02.997650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-42337c40-110e-4de1-b4eb-220fbe2101f8 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:02.998181 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-42337c40-110e-4de1-b4eb-220fbe2101f8 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:02.999295 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-42337c40-110e-4de1-b4eb-220fbe2101f8 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:02.999753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-42337c40-110e-4de1-b4eb-220fbe2101f8 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:03.000181 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-42337c40-110e-4de1-b4eb-220fbe2101f8 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:03.018722 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-42337c40-110e-4de1-b4eb-220fbe2101f8 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Getting quotas for project 4c0548e01f2249a98e28b618ca3ab8cc. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:18:03.024139 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-42337c40-110e-4de1-b4eb-220fbe2101f8 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Getting quotas for user 47f724dca5d5409d9a3a02289c286d89 and project 4c0548e01f2249a98e28b618ca3ab8cc. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:18:03.039114 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-42337c40-110e-4de1-b4eb-220fbe2101f8 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Going to run 2 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:18:03.042857 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-42337c40-110e-4de1-b4eb-220fbe2101f8 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: 34669fba-8830-4e88-8461-e09b75c072b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:18:03.082857 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-42337c40-110e-4de1-b4eb-220fbe2101f8 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: eed0bf59-04c8-4d45-b76d-8619e59025e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=34669fba-8830-4e88-8461-e09b75c072b0,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:18:03.180927 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-42337c40-110e-4de1-b4eb-220fbe2101f8 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.782345 Sep 17 21:18:03.185215 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2648/5380] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:18:02 2022] POST /compute/v2.1/servers => generated 32 bytes in 785 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Sep 17 21:18:03.194981 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f51049fd-da5b-4739-9585-0856d59ab6f1 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:03.200535 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f51049fd-da5b-4739-9585-0856d59ab6f1 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '47f724dca5d5409d9a3a02289c286d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:03.200836 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f51049fd-da5b-4739-9585-0856d59ab6f1 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Searching by: {'deleted': False, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc'} {{(pid=140524) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:18:03.219113 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f51049fd-da5b-4739-9585-0856d59ab6f1 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:03.219856 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f51049fd-da5b-4739-9585-0856d59ab6f1 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:03.220495 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f51049fd-da5b-4739-9585-0856d59ab6f1 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:03.221671 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f51049fd-da5b-4739-9585-0856d59ab6f1 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:03.222336 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f51049fd-da5b-4739-9585-0856d59ab6f1 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:03.222959 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f51049fd-da5b-4739-9585-0856d59ab6f1 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:03.254679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.multi_cell_list [None req-f51049fd-da5b-4739-9585-0856d59ab6f1 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=140524) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 21:18:03.288953 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f51049fd-da5b-4739-9585-0856d59ab6f1 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 1333 microversion: 2.1 time: 0.098000 Sep 17 21:18:03.290306 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2733/5381] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Sep 17 21:18:03 2022] GET /compute/v2.1/servers => generated 1333 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:03.305634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-04a63bb2-1c10-46b6-b175-3103feec7799 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:03.306389 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-04a63bb2-1c10-46b6-b175-3103feec7799 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: eed0bf59-04c8-4d45-b76d-8619e59025e1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:03.380074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-04a63bb2-1c10-46b6-b175-3103feec7799 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f724dca5d5409d9a3a02289c286d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:03.388870 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-04a63bb2-1c10-46b6-b175-3103feec7799 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers/eed0bf59-04c8-4d45-b76d-8619e59025e1" status: 200 len: 1217 microversion: 2.1 time: 0.087623 Sep 17 21:18:03.390764 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2649/5382] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:03 2022] GET /compute/v2.1/servers/eed0bf59-04c8-4d45-b76d-8619e59025e1 => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:04.413418 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-be767652-02c6-43a0-b6b1-c48abae41db1 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:04.414220 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-be767652-02c6-43a0-b6b1-c48abae41db1 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: eed0bf59-04c8-4d45-b76d-8619e59025e1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:04.425208 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be767652-02c6-43a0-b6b1-c48abae41db1 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:04.426037 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be767652-02c6-43a0-b6b1-c48abae41db1 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:04.426534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be767652-02c6-43a0-b6b1-c48abae41db1 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:04.427506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be767652-02c6-43a0-b6b1-c48abae41db1 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:04.428254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be767652-02c6-43a0-b6b1-c48abae41db1 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:04.428771 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be767652-02c6-43a0-b6b1-c48abae41db1 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:04.545151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-be767652-02c6-43a0-b6b1-c48abae41db1 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f724dca5d5409d9a3a02289c286d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:04.566556 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-be767652-02c6-43a0-b6b1-c48abae41db1 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers/eed0bf59-04c8-4d45-b76d-8619e59025e1" status: 200 len: 1213 microversion: 2.1 time: 0.155904 Sep 17 21:18:04.569538 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2734/5383] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:04 2022] GET /compute/v2.1/servers/eed0bf59-04c8-4d45-b76d-8619e59025e1 => generated 1213 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:05.600533 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-48db68a6-ff6e-4be2-9907-432fd3d217bb tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:05.601398 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-48db68a6-ff6e-4be2-9907-432fd3d217bb tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: eed0bf59-04c8-4d45-b76d-8619e59025e1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:05.609338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-48db68a6-ff6e-4be2-9907-432fd3d217bb tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:05.610149 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-48db68a6-ff6e-4be2-9907-432fd3d217bb tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:05.610759 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-48db68a6-ff6e-4be2-9907-432fd3d217bb tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:05.616308 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-48db68a6-ff6e-4be2-9907-432fd3d217bb tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:05.617265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-48db68a6-ff6e-4be2-9907-432fd3d217bb tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:05.617926 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-48db68a6-ff6e-4be2-9907-432fd3d217bb tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:05.794932 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-d2497c0b-7e38-44c5-a2c5-96d8d5ce54e7 req-0528e562-012c-410c-96a1-ab89a8588b7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "079570ec-d936-4d26-9f99-980e2fc3276f", "name": "network-vif-deleted", "tag": "5da03508-c020-4844-9a20-7f746a3b13e7"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:18:05.820621 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d2497c0b-7e38-44c5-a2c5-96d8d5ce54e7 req-0528e562-012c-410c-96a1-ab89a8588b7b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:05.821872 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d2497c0b-7e38-44c5-a2c5-96d8d5ce54e7 req-0528e562-012c-410c-96a1-ab89a8588b7b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:05.822855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d2497c0b-7e38-44c5-a2c5-96d8d5ce54e7 req-0528e562-012c-410c-96a1-ab89a8588b7b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:05.852848 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-d2497c0b-7e38-44c5-a2c5-96d8d5ce54e7 req-0528e562-012c-410c-96a1-ab89a8588b7b service nova] Creating event network-vif-deleted:5da03508-c020-4844-9a20-7f746a3b13e7 for instance 079570ec-d936-4d26-9f99-980e2fc3276f on nch1-master-1 Sep 17 21:18:05.863083 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-d2497c0b-7e38-44c5-a2c5-96d8d5ce54e7 req-0528e562-012c-410c-96a1-ab89a8588b7b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071357 Sep 17 21:18:05.865404 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2735/5384] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:18:05.897068 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-48db68a6-ff6e-4be2-9907-432fd3d217bb tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f724dca5d5409d9a3a02289c286d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:05.919282 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-48db68a6-ff6e-4be2-9907-432fd3d217bb tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers/eed0bf59-04c8-4d45-b76d-8619e59025e1" status: 200 len: 1275 microversion: 2.1 time: 0.323320 Sep 17 21:18:05.921254 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2650/5385] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:05 2022] GET /compute/v2.1/servers/eed0bf59-04c8-4d45-b76d-8619e59025e1 => generated 1275 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:06.950443 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-59ea026b-5903-4b61-83bb-ffb420863ccf tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:06.951208 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-59ea026b-5903-4b61-83bb-ffb420863ccf tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: eed0bf59-04c8-4d45-b76d-8619e59025e1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:06.965618 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59ea026b-5903-4b61-83bb-ffb420863ccf tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:06.966117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59ea026b-5903-4b61-83bb-ffb420863ccf tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:06.966559 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59ea026b-5903-4b61-83bb-ffb420863ccf tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:06.972437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59ea026b-5903-4b61-83bb-ffb420863ccf tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:06.973586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59ea026b-5903-4b61-83bb-ffb420863ccf tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:06.976554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59ea026b-5903-4b61-83bb-ffb420863ccf tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:07.434343 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-59ea026b-5903-4b61-83bb-ffb420863ccf tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f724dca5d5409d9a3a02289c286d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:07.445116 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-59ea026b-5903-4b61-83bb-ffb420863ccf tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers/eed0bf59-04c8-4d45-b76d-8619e59025e1" status: 200 len: 1317 microversion: 2.1 time: 0.500513 Sep 17 21:18:07.446656 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2736/5386] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:06 2022] GET /compute/v2.1/servers/eed0bf59-04c8-4d45-b76d-8619e59025e1 => generated 1317 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:07.892333 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-a7d03267-640b-40b9-95c0-b1a97e6e43bc req-b30fe4f9-22bc-4869-84ba-eb2b955aaeca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3ec8fad-a7fd-48d3-8766-bf6092ace8d9", "name": "network-vif-deleted", "tag": "8f8fcfb2-c76e-436e-9630-58bfb4a2057e"}, {"name": "network-changed", "server_uuid": "34669fba-8830-4e88-8461-e09b75c072b0", "tag": "81ee4fec-d3f1-4680-b8cb-f5fedd7a31ec"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:18:07.909029 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-a7d03267-640b-40b9-95c0-b1a97e6e43bc req-b30fe4f9-22bc-4869-84ba-eb2b955aaeca service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:07.911653 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-a7d03267-640b-40b9-95c0-b1a97e6e43bc req-b30fe4f9-22bc-4869-84ba-eb2b955aaeca service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:07.913541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-a7d03267-640b-40b9-95c0-b1a97e6e43bc req-b30fe4f9-22bc-4869-84ba-eb2b955aaeca service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:07.941870 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-a7d03267-640b-40b9-95c0-b1a97e6e43bc req-b30fe4f9-22bc-4869-84ba-eb2b955aaeca service nova] Creating event network-vif-deleted:8f8fcfb2-c76e-436e-9630-58bfb4a2057e for instance b3ec8fad-a7fd-48d3-8766-bf6092ace8d9 on nch1-master-1 Sep 17 21:18:07.942699 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-a7d03267-640b-40b9-95c0-b1a97e6e43bc req-b30fe4f9-22bc-4869-84ba-eb2b955aaeca service nova] Creating event network-changed:81ee4fec-d3f1-4680-b8cb-f5fedd7a31ec for instance 34669fba-8830-4e88-8461-e09b75c072b0 on nch2-master-1 Sep 17 21:18:07.968203 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-a7d03267-640b-40b9-95c0-b1a97e6e43bc req-b30fe4f9-22bc-4869-84ba-eb2b955aaeca service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.078774 Sep 17 21:18:07.969161 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2651/5387] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:18:08.120567 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-35d0b1a1-01d4-4e07-9960-71614ab489f9 req-7cb3441c-f540-41fa-a8c8-085713c6fac8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eed0bf59-04c8-4d45-b76d-8619e59025e1", "tag": "fefcf11b-3c9f-4f46-bc99-101aea15ac5b"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:18:08.135864 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-35d0b1a1-01d4-4e07-9960-71614ab489f9 req-7cb3441c-f540-41fa-a8c8-085713c6fac8 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:08.136225 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-35d0b1a1-01d4-4e07-9960-71614ab489f9 req-7cb3441c-f540-41fa-a8c8-085713c6fac8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:08.145100 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-35d0b1a1-01d4-4e07-9960-71614ab489f9 req-7cb3441c-f540-41fa-a8c8-085713c6fac8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:08.165378 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-35d0b1a1-01d4-4e07-9960-71614ab489f9 req-7cb3441c-f540-41fa-a8c8-085713c6fac8 service nova] Creating event network-changed:fefcf11b-3c9f-4f46-bc99-101aea15ac5b for instance eed0bf59-04c8-4d45-b76d-8619e59025e1 on nch1-master-1 Sep 17 21:18:08.183533 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-35d0b1a1-01d4-4e07-9960-71614ab489f9 req-7cb3441c-f540-41fa-a8c8-085713c6fac8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067284 Sep 17 21:18:08.184385 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2737/5388] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:18:08.473556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a246a4ed-a111-4eaa-97a2-95d8bc5d6899 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:08.474463 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a246a4ed-a111-4eaa-97a2-95d8bc5d6899 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: eed0bf59-04c8-4d45-b76d-8619e59025e1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:08.484493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a246a4ed-a111-4eaa-97a2-95d8bc5d6899 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:08.489370 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a246a4ed-a111-4eaa-97a2-95d8bc5d6899 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:08.490048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a246a4ed-a111-4eaa-97a2-95d8bc5d6899 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:08.491009 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a246a4ed-a111-4eaa-97a2-95d8bc5d6899 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:08.492140 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a246a4ed-a111-4eaa-97a2-95d8bc5d6899 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:08.493608 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a246a4ed-a111-4eaa-97a2-95d8bc5d6899 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:08.945824 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a246a4ed-a111-4eaa-97a2-95d8bc5d6899 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f724dca5d5409d9a3a02289c286d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:08.979292 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a246a4ed-a111-4eaa-97a2-95d8bc5d6899 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers/eed0bf59-04c8-4d45-b76d-8619e59025e1" status: 200 len: 1317 microversion: 2.1 time: 0.510335 Sep 17 21:18:08.986827 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2652/5389] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:08 2022] GET /compute/v2.1/servers/eed0bf59-04c8-4d45-b76d-8619e59025e1 => generated 1317 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:10.027150 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ea2d8f8f-7eee-4caa-9ee8-54fda8e403b7 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:10.028938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ea2d8f8f-7eee-4caa-9ee8-54fda8e403b7 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: eed0bf59-04c8-4d45-b76d-8619e59025e1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:10.046541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea2d8f8f-7eee-4caa-9ee8-54fda8e403b7 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:10.047183 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea2d8f8f-7eee-4caa-9ee8-54fda8e403b7 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:10.048740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea2d8f8f-7eee-4caa-9ee8-54fda8e403b7 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:10.049802 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea2d8f8f-7eee-4caa-9ee8-54fda8e403b7 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:10.050872 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea2d8f8f-7eee-4caa-9ee8-54fda8e403b7 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:10.051571 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ea2d8f8f-7eee-4caa-9ee8-54fda8e403b7 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:10.481225 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ea2d8f8f-7eee-4caa-9ee8-54fda8e403b7 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f724dca5d5409d9a3a02289c286d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:10.513959 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ea2d8f8f-7eee-4caa-9ee8-54fda8e403b7 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers/eed0bf59-04c8-4d45-b76d-8619e59025e1" status: 200 len: 1317 microversion: 2.1 time: 0.481364 Sep 17 21:18:10.515095 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2738/5390] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:10 2022] GET /compute/v2.1/servers/eed0bf59-04c8-4d45-b76d-8619e59025e1 => generated 1317 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:11.133727 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-00ece85b-0319-4874-8d20-2ca7af1fee1b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:11.134665 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-00ece85b-0319-4874-8d20-2ca7af1fee1b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:11.146456 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00ece85b-0319-4874-8d20-2ca7af1fee1b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:11.147602 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00ece85b-0319-4874-8d20-2ca7af1fee1b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:11.148103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00ece85b-0319-4874-8d20-2ca7af1fee1b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:11.148937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00ece85b-0319-4874-8d20-2ca7af1fee1b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:11.149900 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00ece85b-0319-4874-8d20-2ca7af1fee1b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:11.150327 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00ece85b-0319-4874-8d20-2ca7af1fee1b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:11.255455 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-00ece85b-0319-4874-8d20-2ca7af1fee1b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lazy-loading 'services' on Instance uuid 3fa19be0-63c9-4071-979b-b23744235f16 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:18:11.357887 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-00ece85b-0319-4874-8d20-2ca7af1fee1b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16/os-volume_attachments/779942d3-ce89-44ed-bbfc-e00719495d8e" status: 202 len: 0 microversion: 2.1 time: 0.228977 Sep 17 21:18:11.360149 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2653/5391] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Sep 17 21:18:11 2022] DELETE /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16/os-volume_attachments/779942d3-ce89-44ed-bbfc-e00719495d8e => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:18:11.545906 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2613f068-c0ea-4eda-9a3a-edb321c20e12 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:11.547243 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2613f068-c0ea-4eda-9a3a-edb321c20e12 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: eed0bf59-04c8-4d45-b76d-8619e59025e1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:11.554829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2613f068-c0ea-4eda-9a3a-edb321c20e12 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:11.555470 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2613f068-c0ea-4eda-9a3a-edb321c20e12 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:11.556092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2613f068-c0ea-4eda-9a3a-edb321c20e12 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:11.557042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2613f068-c0ea-4eda-9a3a-edb321c20e12 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:11.557818 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2613f068-c0ea-4eda-9a3a-edb321c20e12 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:11.558398 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2613f068-c0ea-4eda-9a3a-edb321c20e12 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:11.836624 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2613f068-c0ea-4eda-9a3a-edb321c20e12 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f724dca5d5409d9a3a02289c286d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:11.848465 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2613f068-c0ea-4eda-9a3a-edb321c20e12 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers/eed0bf59-04c8-4d45-b76d-8619e59025e1" status: 200 len: 1317 microversion: 2.1 time: 0.306887 Sep 17 21:18:11.862773 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2739/5392] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:11 2022] GET /compute/v2.1/servers/eed0bf59-04c8-4d45-b76d-8619e59025e1 => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:12.536663 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d6b9113d-6643-49a4-b610-bb202b233f74 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:18:12.547795 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d6b9113d-6643-49a4-b610-bb202b233f74 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:12.549967 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d6b9113d-6643-49a4-b610-bb202b233f74 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:12.550724 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d6b9113d-6643-49a4-b610-bb202b233f74 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:12.577373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d6b9113d-6643-49a4-b610-bb202b233f74 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Going to try to stop instance {{(pid=140523) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 17 21:18:12.626646 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d6b9113d-6643-49a4-b610-bb202b233f74 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "POST /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16/action" status: 202 len: 0 microversion: 2.1 time: 0.095948 Sep 17 21:18:12.627454 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2654/5393] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:18:12 2022] POST /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:18:12.638577 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1f44cf03-e813-42f8-9b77-48e2515f284a tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:12.640107 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1f44cf03-e813-42f8-9b77-48e2515f284a tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:12.650926 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f44cf03-e813-42f8-9b77-48e2515f284a tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:12.651733 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f44cf03-e813-42f8-9b77-48e2515f284a tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:12.652348 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f44cf03-e813-42f8-9b77-48e2515f284a tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:12.653956 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f44cf03-e813-42f8-9b77-48e2515f284a tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:12.654420 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f44cf03-e813-42f8-9b77-48e2515f284a tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:12.654989 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f44cf03-e813-42f8-9b77-48e2515f284a tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:12.804406 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1f44cf03-e813-42f8-9b77-48e2515f284a tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:12.813136 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1f44cf03-e813-42f8-9b77-48e2515f284a tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1677 microversion: 2.1 time: 0.180483 Sep 17 21:18:12.814602 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2740/5394] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:12 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:18:12.874955 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0c3f7a7e-8f95-4f21-a621-bfd317060dc9 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:12.875676 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0c3f7a7e-8f95-4f21-a621-bfd317060dc9 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: eed0bf59-04c8-4d45-b76d-8619e59025e1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:12.883774 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c3f7a7e-8f95-4f21-a621-bfd317060dc9 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:12.884270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c3f7a7e-8f95-4f21-a621-bfd317060dc9 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:12.884990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c3f7a7e-8f95-4f21-a621-bfd317060dc9 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:12.885538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c3f7a7e-8f95-4f21-a621-bfd317060dc9 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:12.886779 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c3f7a7e-8f95-4f21-a621-bfd317060dc9 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:12.887236 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c3f7a7e-8f95-4f21-a621-bfd317060dc9 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:13.009860 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:18:13.049246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0c3f7a7e-8f95-4f21-a621-bfd317060dc9 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f724dca5d5409d9a3a02289c286d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:13.058553 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0c3f7a7e-8f95-4f21-a621-bfd317060dc9 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers/eed0bf59-04c8-4d45-b76d-8619e59025e1" status: 200 len: 1317 microversion: 2.1 time: 0.187909 Sep 17 21:18:13.060617 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2655/5395] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:12 2022] GET /compute/v2.1/servers/eed0bf59-04c8-4d45-b76d-8619e59025e1 => generated 1317 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:13.479351 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-e1793c3c-379c-4f39-adf6-df0cfaba415b req-983a390a-a12a-437e-ba7d-d85cc3261cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed0bf59-04c8-4d45-b76d-8619e59025e1", "name": "network-vif-plugged", "status": "completed", "tag": "fefcf11b-3c9f-4f46-bc99-101aea15ac5b"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:18:13.485484 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:18:13.491299 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e1793c3c-379c-4f39-adf6-df0cfaba415b req-983a390a-a12a-437e-ba7d-d85cc3261cb2 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:13.492256 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e1793c3c-379c-4f39-adf6-df0cfaba415b req-983a390a-a12a-437e-ba7d-d85cc3261cb2 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:13.492977 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e1793c3c-379c-4f39-adf6-df0cfaba415b req-983a390a-a12a-437e-ba7d-d85cc3261cb2 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:13.512506 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-e1793c3c-379c-4f39-adf6-df0cfaba415b req-983a390a-a12a-437e-ba7d-d85cc3261cb2 service nova] Creating event network-vif-plugged:fefcf11b-3c9f-4f46-bc99-101aea15ac5b for instance eed0bf59-04c8-4d45-b76d-8619e59025e1 on nch1-master-1 Sep 17 21:18:13.518324 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-e1793c3c-379c-4f39-adf6-df0cfaba415b req-983a390a-a12a-437e-ba7d-d85cc3261cb2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042953 Sep 17 21:18:13.519504 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2741/5396] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:18:13.836297 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8a6e0aff-037b-49f6-b441-8c399d2dd44f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:13.837639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8a6e0aff-037b-49f6-b441-8c399d2dd44f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:13.839668 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=8 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:18:13.849747 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8a6e0aff-037b-49f6-b441-8c399d2dd44f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:13.850901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8a6e0aff-037b-49f6-b441-8c399d2dd44f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:13.852130 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8a6e0aff-037b-49f6-b441-8c399d2dd44f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:13.855825 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8a6e0aff-037b-49f6-b441-8c399d2dd44f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:13.857547 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8a6e0aff-037b-49f6-b441-8c399d2dd44f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:13.858228 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8a6e0aff-037b-49f6-b441-8c399d2dd44f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:14.015964 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8a6e0aff-037b-49f6-b441-8c399d2dd44f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:14.025117 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8a6e0aff-037b-49f6-b441-8c399d2dd44f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1677 microversion: 2.1 time: 0.192492 Sep 17 21:18:14.027550 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2656/5397] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:13 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1677 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:14.085413 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-eab1fe78-27e7-4af4-b23d-43845620ba53 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:14.086140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-eab1fe78-27e7-4af4-b23d-43845620ba53 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: eed0bf59-04c8-4d45-b76d-8619e59025e1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:14.099492 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eab1fe78-27e7-4af4-b23d-43845620ba53 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:14.100577 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eab1fe78-27e7-4af4-b23d-43845620ba53 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:14.101258 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eab1fe78-27e7-4af4-b23d-43845620ba53 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:14.103138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eab1fe78-27e7-4af4-b23d-43845620ba53 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:14.103743 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eab1fe78-27e7-4af4-b23d-43845620ba53 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:14.104455 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eab1fe78-27e7-4af4-b23d-43845620ba53 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:14.270908 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-eab1fe78-27e7-4af4-b23d-43845620ba53 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f724dca5d5409d9a3a02289c286d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:14.273349 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:18:14.284579 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-eab1fe78-27e7-4af4-b23d-43845620ba53 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers/eed0bf59-04c8-4d45-b76d-8619e59025e1" status: 200 len: 1317 microversion: 2.1 time: 0.204066 Sep 17 21:18:14.285330 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2742/5398] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:14 2022] GET /compute/v2.1/servers/eed0bf59-04c8-4d45-b76d-8619e59025e1 => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:15.049938 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e657410e-78f1-49b5-9106-37bfe5e54b87 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:15.050567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e657410e-78f1-49b5-9106-37bfe5e54b87 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:15.057337 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e657410e-78f1-49b5-9106-37bfe5e54b87 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:15.057871 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e657410e-78f1-49b5-9106-37bfe5e54b87 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:15.058318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e657410e-78f1-49b5-9106-37bfe5e54b87 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:15.059377 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e657410e-78f1-49b5-9106-37bfe5e54b87 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:15.059845 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e657410e-78f1-49b5-9106-37bfe5e54b87 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:15.060283 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e657410e-78f1-49b5-9106-37bfe5e54b87 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:15.201892 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e657410e-78f1-49b5-9106-37bfe5e54b87 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:15.210262 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e657410e-78f1-49b5-9106-37bfe5e54b87 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1677 microversion: 2.1 time: 0.164396 Sep 17 21:18:15.210796 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2657/5399] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:15 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:15.312660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-27369328-f63f-4e53-9769-07e2004cfafb tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:15.313276 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-27369328-f63f-4e53-9769-07e2004cfafb tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: eed0bf59-04c8-4d45-b76d-8619e59025e1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:15.320687 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27369328-f63f-4e53-9769-07e2004cfafb tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:15.321182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27369328-f63f-4e53-9769-07e2004cfafb tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:15.321662 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27369328-f63f-4e53-9769-07e2004cfafb tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:15.322364 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27369328-f63f-4e53-9769-07e2004cfafb tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:15.322818 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27369328-f63f-4e53-9769-07e2004cfafb tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:15.323234 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27369328-f63f-4e53-9769-07e2004cfafb tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:15.459092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-27369328-f63f-4e53-9769-07e2004cfafb tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f724dca5d5409d9a3a02289c286d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:15.472427 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-27369328-f63f-4e53-9769-07e2004cfafb tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers/eed0bf59-04c8-4d45-b76d-8619e59025e1" status: 200 len: 1505 microversion: 2.1 time: 0.163919 Sep 17 21:18:15.473085 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2743/5400] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:15 2022] GET /compute/v2.1/servers/eed0bf59-04c8-4d45-b76d-8619e59025e1 => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:15.495094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fd345363-1ee9-4353-bd0d-04f109cf0eb3 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:15.495750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fd345363-1ee9-4353-bd0d-04f109cf0eb3 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: 34669fba-8830-4e88-8461-e09b75c072b0] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:15.501798 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd345363-1ee9-4353-bd0d-04f109cf0eb3 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:15.502262 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd345363-1ee9-4353-bd0d-04f109cf0eb3 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:15.502710 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd345363-1ee9-4353-bd0d-04f109cf0eb3 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:15.503413 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd345363-1ee9-4353-bd0d-04f109cf0eb3 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:15.503883 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd345363-1ee9-4353-bd0d-04f109cf0eb3 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:15.504312 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd345363-1ee9-4353-bd0d-04f109cf0eb3 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:15.536669 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-81f7d61a-1cf8-4a48-bef1-4403405f065a req-9a5bfced-5ca3-467c-b4ea-77bad5e20fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34669fba-8830-4e88-8461-e09b75c072b0", "name": "network-vif-plugged", "status": "completed", "tag": "81ee4fec-d3f1-4680-b8cb-f5fedd7a31ec"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:18:15.547188 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-81f7d61a-1cf8-4a48-bef1-4403405f065a req-9a5bfced-5ca3-467c-b4ea-77bad5e20fc7 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:15.548013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-81f7d61a-1cf8-4a48-bef1-4403405f065a req-9a5bfced-5ca3-467c-b4ea-77bad5e20fc7 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:15.548616 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-81f7d61a-1cf8-4a48-bef1-4403405f065a req-9a5bfced-5ca3-467c-b4ea-77bad5e20fc7 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:15.561011 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-81f7d61a-1cf8-4a48-bef1-4403405f065a req-9a5bfced-5ca3-467c-b4ea-77bad5e20fc7 service nova] Creating event network-vif-plugged:81ee4fec-d3f1-4680-b8cb-f5fedd7a31ec for instance 34669fba-8830-4e88-8461-e09b75c072b0 on nch2-master-1 Sep 17 21:18:15.567722 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-81f7d61a-1cf8-4a48-bef1-4403405f065a req-9a5bfced-5ca3-467c-b4ea-77bad5e20fc7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033435 Sep 17 21:18:15.568333 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2744/5401] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:18:15.661357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fd345363-1ee9-4353-bd0d-04f109cf0eb3 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f724dca5d5409d9a3a02289c286d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:15.673040 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fd345363-1ee9-4353-bd0d-04f109cf0eb3 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers/34669fba-8830-4e88-8461-e09b75c072b0" status: 200 len: 1317 microversion: 2.1 time: 0.181267 Sep 17 21:18:15.677321 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2658/5402] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:15 2022] GET /compute/v2.1/servers/34669fba-8830-4e88-8461-e09b75c072b0 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:18:16.234544 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2b5652e9-46a2-4873-8ae0-866317013424 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:16.235290 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2b5652e9-46a2-4873-8ae0-866317013424 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:16.237281 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:18:16.243686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b5652e9-46a2-4873-8ae0-866317013424 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:16.244186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b5652e9-46a2-4873-8ae0-866317013424 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:16.245006 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b5652e9-46a2-4873-8ae0-866317013424 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:16.245792 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b5652e9-46a2-4873-8ae0-866317013424 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:16.246259 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b5652e9-46a2-4873-8ae0-866317013424 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:16.246692 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b5652e9-46a2-4873-8ae0-866317013424 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:16.385377 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2b5652e9-46a2-4873-8ae0-866317013424 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:16.393934 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2b5652e9-46a2-4873-8ae0-866317013424 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1677 microversion: 2.1 time: 0.163817 Sep 17 21:18:16.394522 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2745/5403] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:16 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:16.698436 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-84868531-5bae-4b73-bc22-9215edca26b4 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:16.698999 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-84868531-5bae-4b73-bc22-9215edca26b4 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: 34669fba-8830-4e88-8461-e09b75c072b0] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:16.706335 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84868531-5bae-4b73-bc22-9215edca26b4 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:16.706861 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84868531-5bae-4b73-bc22-9215edca26b4 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:16.707285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84868531-5bae-4b73-bc22-9215edca26b4 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:16.708002 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84868531-5bae-4b73-bc22-9215edca26b4 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:16.708468 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84868531-5bae-4b73-bc22-9215edca26b4 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:16.708902 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84868531-5bae-4b73-bc22-9215edca26b4 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:16.851942 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-84868531-5bae-4b73-bc22-9215edca26b4 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f724dca5d5409d9a3a02289c286d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:16.860537 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-84868531-5bae-4b73-bc22-9215edca26b4 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers/34669fba-8830-4e88-8461-e09b75c072b0" status: 200 len: 1317 microversion: 2.1 time: 0.166749 Sep 17 21:18:16.861139 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2659/5404] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:16 2022] GET /compute/v2.1/servers/34669fba-8830-4e88-8461-e09b75c072b0 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:17.417162 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9c76af2b-3446-4d61-a5c0-b3eda434efb2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:17.417761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9c76af2b-3446-4d61-a5c0-b3eda434efb2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:17.425105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9c76af2b-3446-4d61-a5c0-b3eda434efb2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:17.426203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9c76af2b-3446-4d61-a5c0-b3eda434efb2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:17.426684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9c76af2b-3446-4d61-a5c0-b3eda434efb2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:17.427425 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9c76af2b-3446-4d61-a5c0-b3eda434efb2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:17.427878 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9c76af2b-3446-4d61-a5c0-b3eda434efb2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:17.428343 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9c76af2b-3446-4d61-a5c0-b3eda434efb2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:17.561696 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9c76af2b-3446-4d61-a5c0-b3eda434efb2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:17.569970 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9c76af2b-3446-4d61-a5c0-b3eda434efb2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1677 microversion: 2.1 time: 0.156769 Sep 17 21:18:17.570568 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2746/5405] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:17 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:17.884287 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-476cb955-bbbf-48de-9ef3-1eef47196b42 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:17.884883 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-476cb955-bbbf-48de-9ef3-1eef47196b42 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: 34669fba-8830-4e88-8461-e09b75c072b0] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:17.892287 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-476cb955-bbbf-48de-9ef3-1eef47196b42 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:17.892812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-476cb955-bbbf-48de-9ef3-1eef47196b42 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:17.893259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-476cb955-bbbf-48de-9ef3-1eef47196b42 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:17.894004 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-476cb955-bbbf-48de-9ef3-1eef47196b42 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:17.894470 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-476cb955-bbbf-48de-9ef3-1eef47196b42 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:17.894913 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-476cb955-bbbf-48de-9ef3-1eef47196b42 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:18.041110 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-476cb955-bbbf-48de-9ef3-1eef47196b42 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f724dca5d5409d9a3a02289c286d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:18.054510 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-476cb955-bbbf-48de-9ef3-1eef47196b42 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers/34669fba-8830-4e88-8461-e09b75c072b0" status: 200 len: 1505 microversion: 2.1 time: 0.173579 Sep 17 21:18:18.055440 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2660/5406] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:17 2022] GET /compute/v2.1/servers/34669fba-8830-4e88-8461-e09b75c072b0 => generated 1505 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:18.096711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4a6de4ae-512c-442b-9913-432bac6f734e tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:18.097190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4a6de4ae-512c-442b-9913-432bac6f734e tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: 34669fba-8830-4e88-8461-e09b75c072b0] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:18.105530 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a6de4ae-512c-442b-9913-432bac6f734e tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:18.106021 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a6de4ae-512c-442b-9913-432bac6f734e tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:18.106460 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a6de4ae-512c-442b-9913-432bac6f734e tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:18.107219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a6de4ae-512c-442b-9913-432bac6f734e tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:18.107672 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a6de4ae-512c-442b-9913-432bac6f734e tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:18.108117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a6de4ae-512c-442b-9913-432bac6f734e tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:18.135747 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4a6de4ae-512c-442b-9913-432bac6f734e tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: 34669fba-8830-4e88-8461-e09b75c072b0] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:18:18.220746 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4a6de4ae-512c-442b-9913-432bac6f734e tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "DELETE /compute/v2.1/servers/34669fba-8830-4e88-8461-e09b75c072b0" status: 204 len: 0 microversion: 2.1 time: 0.134366 Sep 17 21:18:18.221956 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2747/5407] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:18:18 2022] DELETE /compute/v2.1/servers/34669fba-8830-4e88-8461-e09b75c072b0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:18:18.234430 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fd59d21a-2b4b-46c0-89a7-727bfdc42cd9 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:18.235025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fd59d21a-2b4b-46c0-89a7-727bfdc42cd9 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: eed0bf59-04c8-4d45-b76d-8619e59025e1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:18.237018 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:18:18.242491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd59d21a-2b4b-46c0-89a7-727bfdc42cd9 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:18.242946 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd59d21a-2b4b-46c0-89a7-727bfdc42cd9 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:18.243412 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd59d21a-2b4b-46c0-89a7-727bfdc42cd9 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:18.244103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd59d21a-2b4b-46c0-89a7-727bfdc42cd9 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:18.244932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd59d21a-2b4b-46c0-89a7-727bfdc42cd9 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:18.245371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd59d21a-2b4b-46c0-89a7-727bfdc42cd9 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:18.262252 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:18:18.274845 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fd59d21a-2b4b-46c0-89a7-727bfdc42cd9 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: eed0bf59-04c8-4d45-b76d-8619e59025e1] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:18:18.374734 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fd59d21a-2b4b-46c0-89a7-727bfdc42cd9 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "DELETE /compute/v2.1/servers/eed0bf59-04c8-4d45-b76d-8619e59025e1" status: 204 len: 0 microversion: 2.1 time: 0.143695 Sep 17 21:18:18.375421 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2661/5408] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:18:18 2022] DELETE /compute/v2.1/servers/eed0bf59-04c8-4d45-b76d-8619e59025e1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:18:18.384293 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7789c39f-79f4-44cd-b49e-a9038e832d02 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:18.385035 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7789c39f-79f4-44cd-b49e-a9038e832d02 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: 34669fba-8830-4e88-8461-e09b75c072b0] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:18.391579 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7789c39f-79f4-44cd-b49e-a9038e832d02 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:18.392018 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7789c39f-79f4-44cd-b49e-a9038e832d02 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:18.392435 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7789c39f-79f4-44cd-b49e-a9038e832d02 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:18.393138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7789c39f-79f4-44cd-b49e-a9038e832d02 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:18.393841 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7789c39f-79f4-44cd-b49e-a9038e832d02 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:18.394111 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7789c39f-79f4-44cd-b49e-a9038e832d02 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:18.548726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7789c39f-79f4-44cd-b49e-a9038e832d02 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f724dca5d5409d9a3a02289c286d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:18.557966 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7789c39f-79f4-44cd-b49e-a9038e832d02 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers/34669fba-8830-4e88-8461-e09b75c072b0" status: 200 len: 1511 microversion: 2.1 time: 0.177909 Sep 17 21:18:18.559028 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2748/5409] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:18 2022] GET /compute/v2.1/servers/34669fba-8830-4e88-8461-e09b75c072b0 => generated 1511 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:18.595677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-53b43fc5-eedb-4a3b-8677-ed7c9796f73b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:18.597136 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-53b43fc5-eedb-4a3b-8677-ed7c9796f73b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:18.603476 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53b43fc5-eedb-4a3b-8677-ed7c9796f73b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:18.604040 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53b43fc5-eedb-4a3b-8677-ed7c9796f73b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:18.604673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53b43fc5-eedb-4a3b-8677-ed7c9796f73b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:18.605479 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53b43fc5-eedb-4a3b-8677-ed7c9796f73b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:18.605999 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53b43fc5-eedb-4a3b-8677-ed7c9796f73b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:18.606499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53b43fc5-eedb-4a3b-8677-ed7c9796f73b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:18.774660 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-53b43fc5-eedb-4a3b-8677-ed7c9796f73b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:18.782826 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-53b43fc5-eedb-4a3b-8677-ed7c9796f73b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1677 microversion: 2.1 time: 0.192736 Sep 17 21:18:18.783563 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2662/5410] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:18 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1677 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:19.580501 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a716e562-5621-45ac-8ef1-ab0acb8d50f6 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:19.581092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a716e562-5621-45ac-8ef1-ab0acb8d50f6 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: 34669fba-8830-4e88-8461-e09b75c072b0] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:19.588430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a716e562-5621-45ac-8ef1-ab0acb8d50f6 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:19.588890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a716e562-5621-45ac-8ef1-ab0acb8d50f6 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:19.589560 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a716e562-5621-45ac-8ef1-ab0acb8d50f6 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:19.590269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a716e562-5621-45ac-8ef1-ab0acb8d50f6 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:19.590726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a716e562-5621-45ac-8ef1-ab0acb8d50f6 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:19.591156 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a716e562-5621-45ac-8ef1-ab0acb8d50f6 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:19.776582 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a716e562-5621-45ac-8ef1-ab0acb8d50f6 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f724dca5d5409d9a3a02289c286d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:19.788324 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a716e562-5621-45ac-8ef1-ab0acb8d50f6 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers/34669fba-8830-4e88-8461-e09b75c072b0" status: 200 len: 1511 microversion: 2.1 time: 0.211800 Sep 17 21:18:19.789105 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2749/5411] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:19 2022] GET /compute/v2.1/servers/34669fba-8830-4e88-8461-e09b75c072b0 => generated 1511 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:19.810723 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3fbe7498-ee2d-4b8e-98d1-a616a1e3b0c0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:19.811924 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3fbe7498-ee2d-4b8e-98d1-a616a1e3b0c0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:19.818614 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3fbe7498-ee2d-4b8e-98d1-a616a1e3b0c0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:19.819397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3fbe7498-ee2d-4b8e-98d1-a616a1e3b0c0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:19.819948 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3fbe7498-ee2d-4b8e-98d1-a616a1e3b0c0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:19.820725 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3fbe7498-ee2d-4b8e-98d1-a616a1e3b0c0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:19.821352 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3fbe7498-ee2d-4b8e-98d1-a616a1e3b0c0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:19.821978 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3fbe7498-ee2d-4b8e-98d1-a616a1e3b0c0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:20.064335 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3fbe7498-ee2d-4b8e-98d1-a616a1e3b0c0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:20.082296 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3fbe7498-ee2d-4b8e-98d1-a616a1e3b0c0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1677 microversion: 2.1 time: 0.278588 Sep 17 21:18:20.084895 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2663/5412] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:19 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1677 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:20.150841 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-5dc911f5-de63-49df-881d-cc05158daca4 req-212170e0-2ff1-4def-b190-21ec05574245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34669fba-8830-4e88-8461-e09b75c072b0", "name": "network-vif-deleted", "tag": "81ee4fec-d3f1-4680-b8cb-f5fedd7a31ec"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:18:20.174716 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-5dc911f5-de63-49df-881d-cc05158daca4 req-212170e0-2ff1-4def-b190-21ec05574245 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:20.176101 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-5dc911f5-de63-49df-881d-cc05158daca4 req-212170e0-2ff1-4def-b190-21ec05574245 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:20.176782 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-5dc911f5-de63-49df-881d-cc05158daca4 req-212170e0-2ff1-4def-b190-21ec05574245 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:20.193871 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-5dc911f5-de63-49df-881d-cc05158daca4 req-212170e0-2ff1-4def-b190-21ec05574245 service nova] Creating event network-vif-deleted:81ee4fec-d3f1-4680-b8cb-f5fedd7a31ec for instance 34669fba-8830-4e88-8461-e09b75c072b0 on nch2-master-1 Sep 17 21:18:20.202421 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-5dc911f5-de63-49df-881d-cc05158daca4 req-212170e0-2ff1-4def-b190-21ec05574245 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054555 Sep 17 21:18:20.203910 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2750/5413] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:18:20.537184 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-d2648d96-4d9b-460a-9813-45126079cb0a req-0f15dc72-6c79-452d-ad5c-db8b492196c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eed0bf59-04c8-4d45-b76d-8619e59025e1", "name": "network-vif-deleted", "tag": "fefcf11b-3c9f-4f46-bc99-101aea15ac5b"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:18:20.556398 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d2648d96-4d9b-460a-9813-45126079cb0a req-0f15dc72-6c79-452d-ad5c-db8b492196c6 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:20.556920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d2648d96-4d9b-460a-9813-45126079cb0a req-0f15dc72-6c79-452d-ad5c-db8b492196c6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:20.557375 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d2648d96-4d9b-460a-9813-45126079cb0a req-0f15dc72-6c79-452d-ad5c-db8b492196c6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:20.574862 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-d2648d96-4d9b-460a-9813-45126079cb0a req-0f15dc72-6c79-452d-ad5c-db8b492196c6 service nova] Creating event network-vif-deleted:fefcf11b-3c9f-4f46-bc99-101aea15ac5b for instance eed0bf59-04c8-4d45-b76d-8619e59025e1 on nch1-master-1 Sep 17 21:18:20.580733 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-d2648d96-4d9b-460a-9813-45126079cb0a req-0f15dc72-6c79-452d-ad5c-db8b492196c6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049341 Sep 17 21:18:20.582766 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2664/5414] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:18:20.817038 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7e79d0d2-44fb-4184-a8fb-ae8cfaf446b3 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:20.818448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7e79d0d2-44fb-4184-a8fb-ae8cfaf446b3 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: 34669fba-8830-4e88-8461-e09b75c072b0] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:20.829330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e79d0d2-44fb-4184-a8fb-ae8cfaf446b3 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:20.830008 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e79d0d2-44fb-4184-a8fb-ae8cfaf446b3 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:20.830457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e79d0d2-44fb-4184-a8fb-ae8cfaf446b3 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:20.831366 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e79d0d2-44fb-4184-a8fb-ae8cfaf446b3 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:20.831703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e79d0d2-44fb-4184-a8fb-ae8cfaf446b3 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:20.832446 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e79d0d2-44fb-4184-a8fb-ae8cfaf446b3 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:20.917430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e79d0d2-44fb-4184-a8fb-ae8cfaf446b3 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:20.918019 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e79d0d2-44fb-4184-a8fb-ae8cfaf446b3 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:20.918433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e79d0d2-44fb-4184-a8fb-ae8cfaf446b3 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:20.921061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-7e79d0d2-44fb-4184-a8fb-ae8cfaf446b3 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lazy-loading 'fault' on Instance uuid 34669fba-8830-4e88-8461-e09b75c072b0 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:18:20.990336 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7e79d0d2-44fb-4184-a8fb-ae8cfaf446b3 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f724dca5d5409d9a3a02289c286d89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c0548e01f2249a98e28b618ca3ab8cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:21.002358 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7e79d0d2-44fb-4184-a8fb-ae8cfaf446b3 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers/34669fba-8830-4e88-8461-e09b75c072b0" status: 200 len: 1307 microversion: 2.1 time: 0.191226 Sep 17 21:18:21.004310 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2751/5415] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:20 2022] GET /compute/v2.1/servers/34669fba-8830-4e88-8461-e09b75c072b0 => generated 1307 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:21.110168 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-87fbcd23-f976-4730-98a5-5d61b58fb604 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:21.110798 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-87fbcd23-f976-4730-98a5-5d61b58fb604 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:21.117824 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87fbcd23-f976-4730-98a5-5d61b58fb604 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:21.118330 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87fbcd23-f976-4730-98a5-5d61b58fb604 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:21.118987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87fbcd23-f976-4730-98a5-5d61b58fb604 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:21.120079 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87fbcd23-f976-4730-98a5-5d61b58fb604 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:21.120546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87fbcd23-f976-4730-98a5-5d61b58fb604 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:21.120995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87fbcd23-f976-4730-98a5-5d61b58fb604 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:21.288465 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-87fbcd23-f976-4730-98a5-5d61b58fb604 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:21.297412 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-87fbcd23-f976-4730-98a5-5d61b58fb604 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1677 microversion: 2.1 time: 0.192848 Sep 17 21:18:21.298286 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2665/5416] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:21 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1677 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:22.026258 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ce4b2746-9692-439e-9c15-740a860a937f tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:22.027901 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ce4b2746-9692-439e-9c15-740a860a937f tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: 34669fba-8830-4e88-8461-e09b75c072b0] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:22.035024 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce4b2746-9692-439e-9c15-740a860a937f tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:22.035783 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce4b2746-9692-439e-9c15-740a860a937f tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:22.036381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce4b2746-9692-439e-9c15-740a860a937f tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:22.037260 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce4b2746-9692-439e-9c15-740a860a937f tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:22.037743 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce4b2746-9692-439e-9c15-740a860a937f tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:22.038252 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ce4b2746-9692-439e-9c15-740a860a937f tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:22.052439 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-ce4b2746-9692-439e-9c15-740a860a937f tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] HTTP exception thrown: Instance 34669fba-8830-4e88-8461-e09b75c072b0 could not be found. Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ce4b2746-9692-439e-9c15-740a860a937f tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Request method failure captured: Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/34669fba-8830-4e88-8461-e09b75c072b0 HTTP/1.1 Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjl2Z0leYJw4R9xgd96ROjXoSyCaityjWloTjEt_pMCmi3TSq13BIjUz1kyt1Pqhv92Ar5Mtu-avXqvQ3ldRI2CNTuV-g0-J9HgBAT1257ot5OE_LpB4gBSHuC96uU3GdmO7CYm5ih5Nmb5nkCCX9VMdXEMX-2YqlgZQjRC2tfwRut4 Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 4c0548e01f2249a98e28b618ca3ab8cc Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-MultipleCreateTestJSON-1875053557 Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4c0548e01f2249a98e28b618ca3ab8cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4c0548e01f2249a98e28b618ca3ab8cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4c0548e01f2249a98e28b618ca3ab8cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4c0548e01f2249a98e28b618ca3ab8cc", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-MultipleCreateTestJSON-1875053557 Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 4c0548e01f2249a98e28b618ca3ab8cc Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1875053557 Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-MultipleCreateTestJSON-1875053557-project Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 47f724dca5d5409d9a3a02289c286d89 Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-MultipleCreateTestJSON-1875053557-project Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 34669fba-8830-4e88-8461-e09b75c072b0 could not be found. Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '34669fba-8830-4e88-8461-e09b75c072b0'} Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34669fba-8830-4e88-8461-e09b75c072b0 could not be found. Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34669fba-8830-4e88-8461-e09b75c072b0 could not be found. Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:18:22.054826 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:18:22.059421 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:18:22.059421 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:18:22.059421 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:18:22.059421 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:18:22.059421 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:18:22.059421 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34669fba-8830-4e88-8461-e09b75c072b0 could not be found. Sep 17 21:18:22.059421 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:18:22.059421 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ce4b2746-9692-439e-9c15-740a860a937f tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Returning 404 to user: Instance 34669fba-8830-4e88-8461-e09b75c072b0 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:18:22.059421 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ce4b2746-9692-439e-9c15-740a860a937f tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers/34669fba-8830-4e88-8461-e09b75c072b0" status: 404 len: 111 microversion: 2.1 time: 0.034041 Sep 17 21:18:22.065306 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5f45c86b-2577-4fe5-9a7e-9015faec5974 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:22.066098 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5f45c86b-2577-4fe5-9a7e-9015faec5974 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] [instance: eed0bf59-04c8-4d45-b76d-8619e59025e1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:22.068911 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2752/5417] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:22 2022] GET /compute/v2.1/servers/34669fba-8830-4e88-8461-e09b75c072b0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:18:22.072792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5f45c86b-2577-4fe5-9a7e-9015faec5974 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:22.073205 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5f45c86b-2577-4fe5-9a7e-9015faec5974 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:22.073688 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5f45c86b-2577-4fe5-9a7e-9015faec5974 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:22.074407 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5f45c86b-2577-4fe5-9a7e-9015faec5974 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:22.075030 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5f45c86b-2577-4fe5-9a7e-9015faec5974 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:22.075778 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5f45c86b-2577-4fe5-9a7e-9015faec5974 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:22.091685 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-5f45c86b-2577-4fe5-9a7e-9015faec5974 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] HTTP exception thrown: Instance eed0bf59-04c8-4d45-b76d-8619e59025e1 could not be found. Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5f45c86b-2577-4fe5-9a7e-9015faec5974 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Request method failure captured: Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/eed0bf59-04c8-4d45-b76d-8619e59025e1 HTTP/1.1 Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjl2Z0leYJw4R9xgd96ROjXoSyCaityjWloTjEt_pMCmi3TSq13BIjUz1kyt1Pqhv92Ar5Mtu-avXqvQ3ldRI2CNTuV-g0-J9HgBAT1257ot5OE_LpB4gBSHuC96uU3GdmO7CYm5ih5Nmb5nkCCX9VMdXEMX-2YqlgZQjRC2tfwRut4 Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 4c0548e01f2249a98e28b618ca3ab8cc Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-MultipleCreateTestJSON-1875053557 Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4c0548e01f2249a98e28b618ca3ab8cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4c0548e01f2249a98e28b618ca3ab8cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4c0548e01f2249a98e28b618ca3ab8cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4c0548e01f2249a98e28b618ca3ab8cc", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-MultipleCreateTestJSON-1875053557 Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 4c0548e01f2249a98e28b618ca3ab8cc Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1875053557 Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-MultipleCreateTestJSON-1875053557-project Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 47f724dca5d5409d9a3a02289c286d89 Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-MultipleCreateTestJSON-1875053557-project Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance eed0bf59-04c8-4d45-b76d-8619e59025e1 could not be found. Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'eed0bf59-04c8-4d45-b76d-8619e59025e1'} Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eed0bf59-04c8-4d45-b76d-8619e59025e1 could not be found. Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eed0bf59-04c8-4d45-b76d-8619e59025e1 could not be found. Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:18:22.094689 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:18:22.099173 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:18:22.099173 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:18:22.099173 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:18:22.099173 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:18:22.099173 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:18:22.099173 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eed0bf59-04c8-4d45-b76d-8619e59025e1 could not be found. Sep 17 21:18:22.099173 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:18:22.099173 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5f45c86b-2577-4fe5-9a7e-9015faec5974 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] Returning 404 to user: Instance eed0bf59-04c8-4d45-b76d-8619e59025e1 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:18:22.100008 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5f45c86b-2577-4fe5-9a7e-9015faec5974 tempest-MultipleCreateTestJSON-1875053557 tempest-MultipleCreateTestJSON-1875053557-project] 10.222.0.26 "GET /compute/v2.1/servers/eed0bf59-04c8-4d45-b76d-8619e59025e1" status: 404 len: 111 microversion: 2.1 time: 0.038832 Sep 17 21:18:22.103144 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2666/5418] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:22 2022] GET /compute/v2.1/servers/eed0bf59-04c8-4d45-b76d-8619e59025e1 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:18:22.322263 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ad40a665-7a2a-44b2-986a-6b3ca69ee1cb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:22.323030 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ad40a665-7a2a-44b2-986a-6b3ca69ee1cb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:22.329792 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad40a665-7a2a-44b2-986a-6b3ca69ee1cb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:22.330555 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad40a665-7a2a-44b2-986a-6b3ca69ee1cb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:22.331154 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad40a665-7a2a-44b2-986a-6b3ca69ee1cb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:22.339954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad40a665-7a2a-44b2-986a-6b3ca69ee1cb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:22.341219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad40a665-7a2a-44b2-986a-6b3ca69ee1cb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:22.342006 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad40a665-7a2a-44b2-986a-6b3ca69ee1cb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:22.591568 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ad40a665-7a2a-44b2-986a-6b3ca69ee1cb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:22.602104 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ad40a665-7a2a-44b2-986a-6b3ca69ee1cb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1677 microversion: 2.1 time: 0.283877 Sep 17 21:18:22.602944 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2753/5419] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:22 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1677 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:23.631847 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c0c64f96-8a88-415b-b6c7-ed856e344b9e tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:23.633375 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c0c64f96-8a88-415b-b6c7-ed856e344b9e tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:23.642252 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0c64f96-8a88-415b-b6c7-ed856e344b9e tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:23.643116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0c64f96-8a88-415b-b6c7-ed856e344b9e tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:23.643837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0c64f96-8a88-415b-b6c7-ed856e344b9e tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:23.644674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0c64f96-8a88-415b-b6c7-ed856e344b9e tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:23.645379 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0c64f96-8a88-415b-b6c7-ed856e344b9e tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:23.646147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0c64f96-8a88-415b-b6c7-ed856e344b9e tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:23.816483 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c0c64f96-8a88-415b-b6c7-ed856e344b9e tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:23.828548 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c0c64f96-8a88-415b-b6c7-ed856e344b9e tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1654 microversion: 2.1 time: 0.203175 Sep 17 21:18:23.829310 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2667/5420] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:23 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1654 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:23.852810 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-62b63c9a-3b2a-407c-8a2d-a71877eca123 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:18:23.861804 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62b63c9a-3b2a-407c-8a2d-a71877eca123 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:23.862544 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62b63c9a-3b2a-407c-8a2d-a71877eca123 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:23.863171 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62b63c9a-3b2a-407c-8a2d-a71877eca123 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:23.890771 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-62b63c9a-3b2a-407c-8a2d-a71877eca123 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Going to try to start instance {{(pid=140524) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 17 21:18:23.956762 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-62b63c9a-3b2a-407c-8a2d-a71877eca123 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "POST /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16/action" status: 202 len: 0 microversion: 2.1 time: 0.108525 Sep 17 21:18:23.957735 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2754/5421] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:18:23 2022] POST /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:18:23.978763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c22b2241-bb89-491a-89e3-435c1d383c3a tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:23.980177 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c22b2241-bb89-491a-89e3-435c1d383c3a tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:23.995791 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c22b2241-bb89-491a-89e3-435c1d383c3a tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:23.996429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c22b2241-bb89-491a-89e3-435c1d383c3a tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:23.997111 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c22b2241-bb89-491a-89e3-435c1d383c3a tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:23.998014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c22b2241-bb89-491a-89e3-435c1d383c3a tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:23.998715 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c22b2241-bb89-491a-89e3-435c1d383c3a tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:23.999378 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c22b2241-bb89-491a-89e3-435c1d383c3a tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:24.184757 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c22b2241-bb89-491a-89e3-435c1d383c3a tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:24.193679 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c22b2241-bb89-491a-89e3-435c1d383c3a tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1663 microversion: 2.1 time: 0.229029 Sep 17 21:18:24.194928 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2668/5422] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:23 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1663 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:25.218399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1c7b2187-53cf-4353-8733-018b29378890 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:25.219121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1c7b2187-53cf-4353-8733-018b29378890 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:25.225651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c7b2187-53cf-4353-8733-018b29378890 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:25.226661 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c7b2187-53cf-4353-8733-018b29378890 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:25.227427 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c7b2187-53cf-4353-8733-018b29378890 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:25.228373 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c7b2187-53cf-4353-8733-018b29378890 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:25.229030 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c7b2187-53cf-4353-8733-018b29378890 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:25.229716 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c7b2187-53cf-4353-8733-018b29378890 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:25.422724 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1c7b2187-53cf-4353-8733-018b29378890 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:25.431986 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1c7b2187-53cf-4353-8733-018b29378890 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1663 microversion: 2.1 time: 0.218776 Sep 17 21:18:25.434051 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2755/5423] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:25 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1663 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:26.479929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-091557a0-9aeb-48b1-a845-0d6420ed31d6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:26.479929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-091557a0-9aeb-48b1-a845-0d6420ed31d6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:26.498149 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-091557a0-9aeb-48b1-a845-0d6420ed31d6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:26.498749 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-091557a0-9aeb-48b1-a845-0d6420ed31d6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:26.499351 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-091557a0-9aeb-48b1-a845-0d6420ed31d6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:26.500240 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-091557a0-9aeb-48b1-a845-0d6420ed31d6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:26.500708 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-091557a0-9aeb-48b1-a845-0d6420ed31d6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:26.501148 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-091557a0-9aeb-48b1-a845-0d6420ed31d6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:26.664917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-091557a0-9aeb-48b1-a845-0d6420ed31d6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:26.681033 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-091557a0-9aeb-48b1-a845-0d6420ed31d6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1667 microversion: 2.1 time: 0.213553 Sep 17 21:18:26.682841 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2669/5424] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:26 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1667 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:32.356360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-75895f07-2e96-48d7-9a74-6b80b5aacac3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:32.358047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-75895f07-2e96-48d7-9a74-6b80b5aacac3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:32.374815 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75895f07-2e96-48d7-9a74-6b80b5aacac3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:32.375550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75895f07-2e96-48d7-9a74-6b80b5aacac3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:32.376015 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75895f07-2e96-48d7-9a74-6b80b5aacac3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:32.376780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75895f07-2e96-48d7-9a74-6b80b5aacac3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:32.377240 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75895f07-2e96-48d7-9a74-6b80b5aacac3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:32.379755 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75895f07-2e96-48d7-9a74-6b80b5aacac3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:32.455692 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-75895f07-2e96-48d7-9a74-6b80b5aacac3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7/ips" status: 200 len: 151 microversion: 2.20 time: 0.102669 Sep 17 21:18:32.459100 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2756/5425] 10.222.0.26 () {60 vars in 1289 bytes} [Sat Sep 17 21:18:32 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7/ips => generated 151 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:18:33.163660 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-61cd0098-f674-4fc5-8895-40295e2a1274 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-625311608", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "849653d6-cb9b-4810-a9c9-87607a2aaddd"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:18:33.261897 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-61cd0098-f674-4fc5-8895-40295e2a1274 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] validate_networks() for [('849653d6-cb9b-4810-a9c9-87607a2aaddd', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:18:33.814920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-61cd0098-f674-4fc5-8895-40295e2a1274 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:18:33.825404 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-61cd0098-f674-4fc5-8895-40295e2a1274 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:18:33.826079 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-61cd0098-f674-4fc5-8895-40295e2a1274 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:18:33.826658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-61cd0098-f674-4fc5-8895-40295e2a1274 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:18:33.827319 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-61cd0098-f674-4fc5-8895-40295e2a1274 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:18:33.839099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-61cd0098-f674-4fc5-8895-40295e2a1274 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:33.840310 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-61cd0098-f674-4fc5-8895-40295e2a1274 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:33.841347 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-61cd0098-f674-4fc5-8895-40295e2a1274 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:33.842238 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-61cd0098-f674-4fc5-8895-40295e2a1274 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:33.842806 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-61cd0098-f674-4fc5-8895-40295e2a1274 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:33.843355 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-61cd0098-f674-4fc5-8895-40295e2a1274 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:33.873503 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-61cd0098-f674-4fc5-8895-40295e2a1274 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Getting quotas for project a37593cb29164fa2bbb0a54a758fa3bd. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:18:33.880800 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-61cd0098-f674-4fc5-8895-40295e2a1274 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Getting quotas for user f08edf449e334897a129a1d26aedb507 and project a37593cb29164fa2bbb0a54a758fa3bd. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:18:33.895084 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-61cd0098-f674-4fc5-8895-40295e2a1274 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:18:33.897714 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-61cd0098-f674-4fc5-8895-40295e2a1274 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] [instance: ea17d90d-7045-4ead-aa25-ed7bcf513681] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:18:33.947505 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-61cd0098-f674-4fc5-8895-40295e2a1274 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.079470 Sep 17 21:18:33.948567 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2670/5426] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:18:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:18:33.960300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2feb91b8-a9c3-4f5e-b37e-cc0e680fb464 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:33.961742 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2feb91b8-a9c3-4f5e-b37e-cc0e680fb464 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] [instance: ea17d90d-7045-4ead-aa25-ed7bcf513681] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:34.059694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2feb91b8-a9c3-4f5e-b37e-cc0e680fb464 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08edf449e334897a129a1d26aedb507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37593cb29164fa2bbb0a54a758fa3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:34.082229 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2feb91b8-a9c3-4f5e-b37e-cc0e680fb464 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] 10.222.0.26 "GET /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681" status: 200 len: 1224 microversion: 2.1 time: 0.122897 Sep 17 21:18:34.084819 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2757/5427] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:33 2022] GET /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681 => generated 1224 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:34.574077 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5c85b8ed-d714-42c9-9227-531319626415 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:18:34.575094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5c85b8ed-d714-42c9-9227-531319626415 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:34.584425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c85b8ed-d714-42c9-9227-531319626415 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:34.584931 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c85b8ed-d714-42c9-9227-531319626415 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:34.585414 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c85b8ed-d714-42c9-9227-531319626415 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:34.587882 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c85b8ed-d714-42c9-9227-531319626415 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:34.587882 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c85b8ed-d714-42c9-9227-531319626415 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:34.591691 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c85b8ed-d714-42c9-9227-531319626415 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:34.646403 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-5c85b8ed-d714-42c9-9227-531319626415 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lazy-loading 'flavor' on Instance uuid 0beab9d3-30c1-4b22-9157-31705ad3dbf7 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:18:34.967298 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5c85b8ed-d714-42c9-9227-531319626415 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "POST /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7/action" status: 202 len: 0 microversion: 2.20 time: 0.399331 Sep 17 21:18:34.968702 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2671/5428] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Sep 17 21:18:34 2022] POST /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:18:34.977729 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4ff09916-fd60-4517-bd60-c540c00075c0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:34.978466 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4ff09916-fd60-4517-bd60-c540c00075c0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:35.003121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ff09916-fd60-4517-bd60-c540c00075c0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:35.005262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ff09916-fd60-4517-bd60-c540c00075c0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:35.006055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ff09916-fd60-4517-bd60-c540c00075c0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:35.007899 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ff09916-fd60-4517-bd60-c540c00075c0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:35.008542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ff09916-fd60-4517-bd60-c540c00075c0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:35.009615 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ff09916-fd60-4517-bd60-c540c00075c0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:35.109388 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dc1e3d00-04b2-4b74-913d-c2dd871a8597 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:35.110945 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dc1e3d00-04b2-4b74-913d-c2dd871a8597 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] [instance: ea17d90d-7045-4ead-aa25-ed7bcf513681] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:35.139586 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dc1e3d00-04b2-4b74-913d-c2dd871a8597 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:35.141203 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dc1e3d00-04b2-4b74-913d-c2dd871a8597 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:35.141933 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dc1e3d00-04b2-4b74-913d-c2dd871a8597 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:35.143676 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dc1e3d00-04b2-4b74-913d-c2dd871a8597 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:35.144404 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dc1e3d00-04b2-4b74-913d-c2dd871a8597 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:35.145150 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dc1e3d00-04b2-4b74-913d-c2dd871a8597 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:35.271118 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dc1e3d00-04b2-4b74-913d-c2dd871a8597 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08edf449e334897a129a1d26aedb507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37593cb29164fa2bbb0a54a758fa3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:35.280210 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dc1e3d00-04b2-4b74-913d-c2dd871a8597 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] 10.222.0.26 "GET /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681" status: 200 len: 1276 microversion: 2.1 time: 0.176728 Sep 17 21:18:35.280923 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2672/5429] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:35 2022] GET /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681 => generated 1276 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:18:35.294789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4ff09916-fd60-4517-bd60-c540c00075c0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:35.304612 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4ff09916-fd60-4517-bd60-c540c00075c0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:35.306374 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4ff09916-fd60-4517-bd60-c540c00075c0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:35.307726 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4ff09916-fd60-4517-bd60-c540c00075c0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1722 microversion: 2.20 time: 0.334222 Sep 17 21:18:35.308372 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2758/5430] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:18:34 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1722 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:18:36.308622 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-27494de3-4b81-40a5-a68a-7f5ea7c57a56 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:36.309964 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-27494de3-4b81-40a5-a68a-7f5ea7c57a56 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] [instance: ea17d90d-7045-4ead-aa25-ed7bcf513681] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:36.329679 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-27494de3-4b81-40a5-a68a-7f5ea7c57a56 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:36.330394 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-27494de3-4b81-40a5-a68a-7f5ea7c57a56 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:36.338337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-03f07cdd-f941-4764-b3f7-2426cf83077c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:36.339799 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-03f07cdd-f941-4764-b3f7-2426cf83077c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:36.346347 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-27494de3-4b81-40a5-a68a-7f5ea7c57a56 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:36.348280 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-27494de3-4b81-40a5-a68a-7f5ea7c57a56 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:36.349676 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-27494de3-4b81-40a5-a68a-7f5ea7c57a56 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:36.354244 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-27494de3-4b81-40a5-a68a-7f5ea7c57a56 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:36.358206 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03f07cdd-f941-4764-b3f7-2426cf83077c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:36.359671 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03f07cdd-f941-4764-b3f7-2426cf83077c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:36.360125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03f07cdd-f941-4764-b3f7-2426cf83077c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:36.363079 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03f07cdd-f941-4764-b3f7-2426cf83077c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:36.364092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03f07cdd-f941-4764-b3f7-2426cf83077c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:36.365115 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03f07cdd-f941-4764-b3f7-2426cf83077c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:36.856122 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-27494de3-4b81-40a5-a68a-7f5ea7c57a56 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08edf449e334897a129a1d26aedb507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37593cb29164fa2bbb0a54a758fa3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:36.868765 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-03f07cdd-f941-4764-b3f7-2426cf83077c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:36.870326 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-27494de3-4b81-40a5-a68a-7f5ea7c57a56 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] 10.222.0.26 "GET /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681" status: 200 len: 1324 microversion: 2.1 time: 0.568970 Sep 17 21:18:36.871297 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2673/5431] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:36 2022] GET /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681 => generated 1324 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:36.886123 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:18:36.894893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-03f07cdd-f941-4764-b3f7-2426cf83077c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:36.897273 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-03f07cdd-f941-4764-b3f7-2426cf83077c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:36.899270 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-03f07cdd-f941-4764-b3f7-2426cf83077c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1722 microversion: 2.20 time: 0.566514 Sep 17 21:18:36.900165 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2759/5432] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:18:36 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1722 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:18:37.878701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-65a0aca5-74bb-4317-88ce-bc7011c4a8e4 req-fb40f688-e679-4dbf-befd-87e2be14e82f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea17d90d-7045-4ead-aa25-ed7bcf513681", "tag": "cad2d37d-09b8-48bb-91e5-99327a796dee"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:18:37.898777 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-81b4fd18-c7ec-4a04-9b90-f123084dd3a5 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:37.900140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-81b4fd18-c7ec-4a04-9b90-f123084dd3a5 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] [instance: ea17d90d-7045-4ead-aa25-ed7bcf513681] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:37.918686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-65a0aca5-74bb-4317-88ce-bc7011c4a8e4 req-fb40f688-e679-4dbf-befd-87e2be14e82f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:37.921199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-65a0aca5-74bb-4317-88ce-bc7011c4a8e4 req-fb40f688-e679-4dbf-befd-87e2be14e82f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:37.922009 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-65a0aca5-74bb-4317-88ce-bc7011c4a8e4 req-fb40f688-e679-4dbf-befd-87e2be14e82f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:37.935478 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-81b4fd18-c7ec-4a04-9b90-f123084dd3a5 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:37.936857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-81b4fd18-c7ec-4a04-9b90-f123084dd3a5 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:37.937304 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-81b4fd18-c7ec-4a04-9b90-f123084dd3a5 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:37.940679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-81b4fd18-c7ec-4a04-9b90-f123084dd3a5 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:37.940812 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-65a0aca5-74bb-4317-88ce-bc7011c4a8e4 req-fb40f688-e679-4dbf-befd-87e2be14e82f service nova] Creating event network-changed:cad2d37d-09b8-48bb-91e5-99327a796dee for instance ea17d90d-7045-4ead-aa25-ed7bcf513681 on nch1-master-1 Sep 17 21:18:37.943045 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-81b4fd18-c7ec-4a04-9b90-f123084dd3a5 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:37.943850 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-81b4fd18-c7ec-4a04-9b90-f123084dd3a5 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:37.947292 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-65a0aca5-74bb-4317-88ce-bc7011c4a8e4 req-fb40f688-e679-4dbf-befd-87e2be14e82f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074471 Sep 17 21:18:37.948030 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2674/5433] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:18:37.959621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-89963fec-fe92-4159-9810-87b22488d9a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:37.960493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-89963fec-fe92-4159-9810-87b22488d9a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:37.972542 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89963fec-fe92-4159-9810-87b22488d9a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:37.973209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89963fec-fe92-4159-9810-87b22488d9a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:37.973991 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89963fec-fe92-4159-9810-87b22488d9a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:37.976792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89963fec-fe92-4159-9810-87b22488d9a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:37.976792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89963fec-fe92-4159-9810-87b22488d9a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:37.976792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89963fec-fe92-4159-9810-87b22488d9a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:38.306803 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-89963fec-fe92-4159-9810-87b22488d9a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:38.323355 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-89963fec-fe92-4159-9810-87b22488d9a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:38.327286 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-89963fec-fe92-4159-9810-87b22488d9a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:38.328809 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-89963fec-fe92-4159-9810-87b22488d9a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1722 microversion: 2.20 time: 0.379456 Sep 17 21:18:38.329400 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2675/5434] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:18:37 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1722 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:18:38.357044 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-81b4fd18-c7ec-4a04-9b90-f123084dd3a5 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08edf449e334897a129a1d26aedb507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37593cb29164fa2bbb0a54a758fa3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:38.368134 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-81b4fd18-c7ec-4a04-9b90-f123084dd3a5 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] 10.222.0.26 "GET /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681" status: 200 len: 1324 microversion: 2.1 time: 0.474750 Sep 17 21:18:38.369014 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2760/5435] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:37 2022] GET /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681 => generated 1324 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:39.356454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-09e5ef13-f866-42cc-bf23-21d1b755c450 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:39.357042 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-09e5ef13-f866-42cc-bf23-21d1b755c450 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:39.364454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09e5ef13-f866-42cc-bf23-21d1b755c450 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:39.364956 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09e5ef13-f866-42cc-bf23-21d1b755c450 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:39.365396 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09e5ef13-f866-42cc-bf23-21d1b755c450 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:39.366148 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09e5ef13-f866-42cc-bf23-21d1b755c450 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:39.366603 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09e5ef13-f866-42cc-bf23-21d1b755c450 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:39.367034 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09e5ef13-f866-42cc-bf23-21d1b755c450 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:39.392105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f3853a80-4282-4e99-9273-3027f6ad81e6 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:39.394432 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f3853a80-4282-4e99-9273-3027f6ad81e6 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] [instance: ea17d90d-7045-4ead-aa25-ed7bcf513681] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:39.402936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3853a80-4282-4e99-9273-3027f6ad81e6 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:39.403678 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3853a80-4282-4e99-9273-3027f6ad81e6 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:39.404127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3853a80-4282-4e99-9273-3027f6ad81e6 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:39.404850 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3853a80-4282-4e99-9273-3027f6ad81e6 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:39.405311 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3853a80-4282-4e99-9273-3027f6ad81e6 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:39.405786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3853a80-4282-4e99-9273-3027f6ad81e6 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:39.664315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-09e5ef13-f866-42cc-bf23-21d1b755c450 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:39.674884 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-09e5ef13-f866-42cc-bf23-21d1b755c450 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:39.677006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-09e5ef13-f866-42cc-bf23-21d1b755c450 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:39.678674 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-09e5ef13-f866-42cc-bf23-21d1b755c450 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1722 microversion: 2.20 time: 0.326421 Sep 17 21:18:39.699759 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2676/5436] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:18:39 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1722 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:18:39.739339 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f3853a80-4282-4e99-9273-3027f6ad81e6 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08edf449e334897a129a1d26aedb507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37593cb29164fa2bbb0a54a758fa3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:39.749030 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f3853a80-4282-4e99-9273-3027f6ad81e6 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] 10.222.0.26 "GET /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681" status: 200 len: 1324 microversion: 2.1 time: 0.360719 Sep 17 21:18:39.750283 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2761/5437] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:39 2022] GET /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681 => generated 1324 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:18:40.706147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3466dd47-aa9c-4e3b-82f4-26178963b63c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:40.707898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3466dd47-aa9c-4e3b-82f4-26178963b63c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:40.717319 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3466dd47-aa9c-4e3b-82f4-26178963b63c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:40.718224 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3466dd47-aa9c-4e3b-82f4-26178963b63c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:40.719349 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3466dd47-aa9c-4e3b-82f4-26178963b63c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:40.720356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3466dd47-aa9c-4e3b-82f4-26178963b63c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:40.721167 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3466dd47-aa9c-4e3b-82f4-26178963b63c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:40.722023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3466dd47-aa9c-4e3b-82f4-26178963b63c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:40.725560 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:18:40.772058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8c028e82-7198-42c8-9478-0b0fd78c43c2 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:40.773729 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8c028e82-7198-42c8-9478-0b0fd78c43c2 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] [instance: ea17d90d-7045-4ead-aa25-ed7bcf513681] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:40.786344 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c028e82-7198-42c8-9478-0b0fd78c43c2 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:40.790213 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c028e82-7198-42c8-9478-0b0fd78c43c2 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:40.792540 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c028e82-7198-42c8-9478-0b0fd78c43c2 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:40.795435 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c028e82-7198-42c8-9478-0b0fd78c43c2 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:40.796170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c028e82-7198-42c8-9478-0b0fd78c43c2 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:40.798097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c028e82-7198-42c8-9478-0b0fd78c43c2 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:40.997841 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3466dd47-aa9c-4e3b-82f4-26178963b63c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:41.015515 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3466dd47-aa9c-4e3b-82f4-26178963b63c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:41.016965 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3466dd47-aa9c-4e3b-82f4-26178963b63c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:41.025716 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3466dd47-aa9c-4e3b-82f4-26178963b63c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1722 microversion: 2.20 time: 0.324182 Sep 17 21:18:41.026432 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2677/5438] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:18:40 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1722 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:18:41.069233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8c028e82-7198-42c8-9478-0b0fd78c43c2 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08edf449e334897a129a1d26aedb507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37593cb29164fa2bbb0a54a758fa3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:41.077830 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8c028e82-7198-42c8-9478-0b0fd78c43c2 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] 10.222.0.26 "GET /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681" status: 200 len: 1324 microversion: 2.1 time: 0.309582 Sep 17 21:18:41.093861 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2762/5439] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:40 2022] GET /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681 => generated 1324 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:42.066397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-413a8026-27b0-4ce7-b6e0-18d87e9fb540 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:42.067027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-413a8026-27b0-4ce7-b6e0-18d87e9fb540 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:42.078834 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-413a8026-27b0-4ce7-b6e0-18d87e9fb540 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:42.079457 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-413a8026-27b0-4ce7-b6e0-18d87e9fb540 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:42.079907 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-413a8026-27b0-4ce7-b6e0-18d87e9fb540 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:42.080837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-413a8026-27b0-4ce7-b6e0-18d87e9fb540 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:42.081305 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-413a8026-27b0-4ce7-b6e0-18d87e9fb540 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:42.082104 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-413a8026-27b0-4ce7-b6e0-18d87e9fb540 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:42.102675 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-44347531-6c53-4497-9288-0978bcf5d400 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:42.103623 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-44347531-6c53-4497-9288-0978bcf5d400 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] [instance: ea17d90d-7045-4ead-aa25-ed7bcf513681] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:42.135385 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-44347531-6c53-4497-9288-0978bcf5d400 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:42.142843 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-44347531-6c53-4497-9288-0978bcf5d400 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:42.143455 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-44347531-6c53-4497-9288-0978bcf5d400 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:42.144877 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-44347531-6c53-4497-9288-0978bcf5d400 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:42.144877 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-44347531-6c53-4497-9288-0978bcf5d400 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:42.145391 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-44347531-6c53-4497-9288-0978bcf5d400 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:42.353107 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-413a8026-27b0-4ce7-b6e0-18d87e9fb540 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:42.365680 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-413a8026-27b0-4ce7-b6e0-18d87e9fb540 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:42.368020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-413a8026-27b0-4ce7-b6e0-18d87e9fb540 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:42.369795 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-413a8026-27b0-4ce7-b6e0-18d87e9fb540 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1722 microversion: 2.20 time: 0.307009 Sep 17 21:18:42.371243 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2678/5440] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:18:42 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1722 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:18:42.379390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-44347531-6c53-4497-9288-0978bcf5d400 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08edf449e334897a129a1d26aedb507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37593cb29164fa2bbb0a54a758fa3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:42.403093 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-44347531-6c53-4497-9288-0978bcf5d400 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] 10.222.0.26 "GET /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681" status: 200 len: 1324 microversion: 2.1 time: 0.304744 Sep 17 21:18:42.403763 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2763/5441] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:42 2022] GET /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681 => generated 1324 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:43.411254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b80b013e-6078-4e69-a58f-421bc4ecfe6c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:43.411872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b80b013e-6078-4e69-a58f-421bc4ecfe6c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:43.419562 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b80b013e-6078-4e69-a58f-421bc4ecfe6c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:43.420060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b80b013e-6078-4e69-a58f-421bc4ecfe6c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:43.420506 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b80b013e-6078-4e69-a58f-421bc4ecfe6c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:43.421228 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b80b013e-6078-4e69-a58f-421bc4ecfe6c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:43.421826 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b80b013e-6078-4e69-a58f-421bc4ecfe6c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:43.422267 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b80b013e-6078-4e69-a58f-421bc4ecfe6c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:43.436366 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0e74d30d-1850-4bde-850b-6931095aa688 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:43.437057 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0e74d30d-1850-4bde-850b-6931095aa688 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] [instance: ea17d90d-7045-4ead-aa25-ed7bcf513681] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:43.452901 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0e74d30d-1850-4bde-850b-6931095aa688 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:43.453498 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0e74d30d-1850-4bde-850b-6931095aa688 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:43.453940 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0e74d30d-1850-4bde-850b-6931095aa688 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:43.458062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0e74d30d-1850-4bde-850b-6931095aa688 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:43.458508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0e74d30d-1850-4bde-850b-6931095aa688 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:43.459431 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0e74d30d-1850-4bde-850b-6931095aa688 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:43.677609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b80b013e-6078-4e69-a58f-421bc4ecfe6c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:43.696763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b80b013e-6078-4e69-a58f-421bc4ecfe6c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:43.699297 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b80b013e-6078-4e69-a58f-421bc4ecfe6c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:43.704133 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b80b013e-6078-4e69-a58f-421bc4ecfe6c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1722 microversion: 2.20 time: 0.296929 Sep 17 21:18:43.705327 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2679/5442] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:18:43 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:18:43.710363 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-1d59e54a-b7bf-4d35-b9b4-87824f8f52e8 req-8853832f-a870-4706-a6d1-1be61f1e9841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea17d90d-7045-4ead-aa25-ed7bcf513681", "name": "network-vif-plugged", "status": "completed", "tag": "cad2d37d-09b8-48bb-91e5-99327a796dee"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:18:43.721199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-1d59e54a-b7bf-4d35-b9b4-87824f8f52e8 req-8853832f-a870-4706-a6d1-1be61f1e9841 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:43.722076 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-1d59e54a-b7bf-4d35-b9b4-87824f8f52e8 req-8853832f-a870-4706-a6d1-1be61f1e9841 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:43.723003 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-1d59e54a-b7bf-4d35-b9b4-87824f8f52e8 req-8853832f-a870-4706-a6d1-1be61f1e9841 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:43.725136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0e74d30d-1850-4bde-850b-6931095aa688 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08edf449e334897a129a1d26aedb507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37593cb29164fa2bbb0a54a758fa3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:43.734309 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0e74d30d-1850-4bde-850b-6931095aa688 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] 10.222.0.26 "GET /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681" status: 200 len: 1324 microversion: 2.1 time: 0.302275 Sep 17 21:18:43.737689 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2764/5443] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:43 2022] GET /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681 => generated 1324 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:43.739959 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-1d59e54a-b7bf-4d35-b9b4-87824f8f52e8 req-8853832f-a870-4706-a6d1-1be61f1e9841 service nova] Creating event network-vif-plugged:cad2d37d-09b8-48bb-91e5-99327a796dee for instance ea17d90d-7045-4ead-aa25-ed7bcf513681 on nch1-master-1 Sep 17 21:18:43.746034 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-1d59e54a-b7bf-4d35-b9b4-87824f8f52e8 req-8853832f-a870-4706-a6d1-1be61f1e9841 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039235 Sep 17 21:18:43.747528 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2680/5444] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:18:44.754209 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6c82d523-e98c-43da-b01f-ce77af845f20 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:44.760107 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6c82d523-e98c-43da-b01f-ce77af845f20 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:44.767713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9615f71d-8523-4b91-9302-b71fadc54b25 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:44.770887 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9615f71d-8523-4b91-9302-b71fadc54b25 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] [instance: ea17d90d-7045-4ead-aa25-ed7bcf513681] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:44.772625 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:18:44.775911 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:18:44.779147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:18:44.783253 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6c82d523-e98c-43da-b01f-ce77af845f20 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:44.784028 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6c82d523-e98c-43da-b01f-ce77af845f20 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:44.784197 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6c82d523-e98c-43da-b01f-ce77af845f20 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:44.789010 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6c82d523-e98c-43da-b01f-ce77af845f20 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:44.789797 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6c82d523-e98c-43da-b01f-ce77af845f20 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:44.790628 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6c82d523-e98c-43da-b01f-ce77af845f20 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:44.795303 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9615f71d-8523-4b91-9302-b71fadc54b25 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:44.796712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9615f71d-8523-4b91-9302-b71fadc54b25 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:44.799070 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9615f71d-8523-4b91-9302-b71fadc54b25 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:44.801119 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9615f71d-8523-4b91-9302-b71fadc54b25 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:44.802692 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9615f71d-8523-4b91-9302-b71fadc54b25 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:44.805344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9615f71d-8523-4b91-9302-b71fadc54b25 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:45.134633 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6c82d523-e98c-43da-b01f-ce77af845f20 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:45.150426 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6c82d523-e98c-43da-b01f-ce77af845f20 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:45.154942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6c82d523-e98c-43da-b01f-ce77af845f20 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:45.158232 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6c82d523-e98c-43da-b01f-ce77af845f20 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1722 microversion: 2.20 time: 0.421008 Sep 17 21:18:45.174205 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2765/5445] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:18:44 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1722 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:18:45.211437 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9615f71d-8523-4b91-9302-b71fadc54b25 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08edf449e334897a129a1d26aedb507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37593cb29164fa2bbb0a54a758fa3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:45.220948 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9615f71d-8523-4b91-9302-b71fadc54b25 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] 10.222.0.26 "GET /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681" status: 200 len: 1324 microversion: 2.1 time: 0.462356 Sep 17 21:18:45.221588 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2681/5446] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:44 2022] GET /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681 => generated 1324 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:18:46.191095 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c1da5e34-bdf3-413f-ad56-1a3e9470329f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:46.197113 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c1da5e34-bdf3-413f-ad56-1a3e9470329f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:46.203847 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1da5e34-bdf3-413f-ad56-1a3e9470329f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:46.204356 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1da5e34-bdf3-413f-ad56-1a3e9470329f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:46.205701 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1da5e34-bdf3-413f-ad56-1a3e9470329f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:46.205701 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1da5e34-bdf3-413f-ad56-1a3e9470329f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:46.206260 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1da5e34-bdf3-413f-ad56-1a3e9470329f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:46.206660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1da5e34-bdf3-413f-ad56-1a3e9470329f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:46.245042 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-850d1044-2672-4d50-b675-457b65c0ecb5 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:46.245794 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-850d1044-2672-4d50-b675-457b65c0ecb5 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] [instance: ea17d90d-7045-4ead-aa25-ed7bcf513681] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:46.253283 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-850d1044-2672-4d50-b675-457b65c0ecb5 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:46.253825 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-850d1044-2672-4d50-b675-457b65c0ecb5 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:46.254278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-850d1044-2672-4d50-b675-457b65c0ecb5 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:46.255057 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-850d1044-2672-4d50-b675-457b65c0ecb5 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:46.255529 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-850d1044-2672-4d50-b675-457b65c0ecb5 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:46.255929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-850d1044-2672-4d50-b675-457b65c0ecb5 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:46.442183 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c1da5e34-bdf3-413f-ad56-1a3e9470329f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:46.452685 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c1da5e34-bdf3-413f-ad56-1a3e9470329f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:46.454546 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c1da5e34-bdf3-413f-ad56-1a3e9470329f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:46.455979 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c1da5e34-bdf3-413f-ad56-1a3e9470329f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1743 microversion: 2.20 time: 0.269928 Sep 17 21:18:46.464922 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2766/5447] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:18:46 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1743 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:18:46.500490 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-850d1044-2672-4d50-b675-457b65c0ecb5 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08edf449e334897a129a1d26aedb507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37593cb29164fa2bbb0a54a758fa3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:46.511199 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-850d1044-2672-4d50-b675-457b65c0ecb5 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] 10.222.0.26 "GET /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681" status: 200 len: 1522 microversion: 2.1 time: 0.270537 Sep 17 21:18:46.512224 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2682/5448] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:46 2022] GET /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681 => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:46.538878 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-21ef3dd7-2916-4808-b584-d209c759ff99 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:46.539430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-21ef3dd7-2916-4808-b584-d209c759ff99 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] [instance: ea17d90d-7045-4ead-aa25-ed7bcf513681] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:46.541628 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:18:46.557675 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-21ef3dd7-2916-4808-b584-d209c759ff99 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:46.562690 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-21ef3dd7-2916-4808-b584-d209c759ff99 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:46.563279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-21ef3dd7-2916-4808-b584-d209c759ff99 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:46.564358 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-21ef3dd7-2916-4808-b584-d209c759ff99 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:46.565066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-21ef3dd7-2916-4808-b584-d209c759ff99 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:46.565604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-21ef3dd7-2916-4808-b584-d209c759ff99 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:46.597665 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-21ef3dd7-2916-4808-b584-d209c759ff99 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] HTTP exception thrown: Instance is not a member of specified network Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-21ef3dd7-2916-4808-b584-d209c759ff99 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Request method failure captured: Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681/ips/invalid HTTP/1.1 Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjmoVdDfhMbpUX3GjmvSKWiyRFTyemcccadS5ekNPyh4bikN0TkOScwoUS-__6gjV9vMdkpEGvTDa9kx_0DH6W5xHt7NzVpeMj21WZWK-OkzSrUMnV_vqaQfWomxeGwvrCisQ2ni8EpsH-Da57OOr59h9XGWIQEjgjIprAGgMJjVHbg Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: a37593cb29164fa2bbb0a54a758fa3bd Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-156835004 Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a37593cb29164fa2bbb0a54a758fa3bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a37593cb29164fa2bbb0a54a758fa3bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a37593cb29164fa2bbb0a54a758fa3bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a37593cb29164fa2bbb0a54a758fa3bd", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-156835004 Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: a37593cb29164fa2bbb0a54a758fa3bd Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-156835004 Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerAddressesNegativeTestJSON-156835004-project Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: f08edf449e334897a129a1d26aedb507 Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-156835004-project Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance is not a member of specified network Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'server_id': 'ea17d90d-7045-4ead-aa25-ed7bcf513681', 'id': 'invalid'} Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Sep 17 21:18:46.611640 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:18:46.619113 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-21ef3dd7-2916-4808-b584-d209c759ff99 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Returning 404 to user: Instance is not a member of specified network {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:18:46.619113 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-21ef3dd7-2916-4808-b584-d209c759ff99 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] 10.222.0.26 "GET /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.082584 Sep 17 21:18:46.619113 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2767/5449] 10.222.0.26 () {58 vars in 1272 bytes} [Sat Sep 17 21:18:46 2022] GET /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681/ips/invalid => generated 91 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 17 21:18:46.625677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6dc293f0-ba6b-4bce-bf67-542cfc0e5f84 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:46.626173 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6dc293f0-ba6b-4bce-bf67-542cfc0e5f84 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Failed to fetch instance by id 999 {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 17 21:18:46.626951 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-6dc293f0-ba6b-4bce-bf67-542cfc0e5f84 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] HTTP exception thrown: Instance 999 could not be found. Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6dc293f0-ba6b-4bce-bf67-542cfc0e5f84 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Request method failure captured: Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjmoVdDfhMbpUX3GjmvSKWiyRFTyemcccadS5ekNPyh4bikN0TkOScwoUS-__6gjV9vMdkpEGvTDa9kx_0DH6W5xHt7NzVpeMj21WZWK-OkzSrUMnV_vqaQfWomxeGwvrCisQ2ni8EpsH-Da57OOr59h9XGWIQEjgjIprAGgMJjVHbg Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: a37593cb29164fa2bbb0a54a758fa3bd Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-156835004 Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a37593cb29164fa2bbb0a54a758fa3bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a37593cb29164fa2bbb0a54a758fa3bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a37593cb29164fa2bbb0a54a758fa3bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a37593cb29164fa2bbb0a54a758fa3bd", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-156835004 Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: a37593cb29164fa2bbb0a54a758fa3bd Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-156835004 Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerAddressesNegativeTestJSON-156835004-project Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: f08edf449e334897a129a1d26aedb507 Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-156835004-project Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 999 could not be found. Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'server_id': '999'} Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 17 21:18:46.629032 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:18:46.633099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6dc293f0-ba6b-4bce-bf67-542cfc0e5f84 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Returning 404 to user: Instance 999 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:18:46.633099 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6dc293f0-ba6b-4bce-bf67-542cfc0e5f84 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] 10.222.0.26 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.009437 Sep 17 21:18:46.633099 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2683/5450] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Sep 17 21:18:46 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 17 21:18:46.640353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f6508989-b1b5-4eba-876e-c1f5af7f0145 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:46.640869 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f6508989-b1b5-4eba-876e-c1f5af7f0145 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] [instance: ea17d90d-7045-4ead-aa25-ed7bcf513681] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:46.647384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6508989-b1b5-4eba-876e-c1f5af7f0145 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:46.647912 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6508989-b1b5-4eba-876e-c1f5af7f0145 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:46.648353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6508989-b1b5-4eba-876e-c1f5af7f0145 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:46.649033 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6508989-b1b5-4eba-876e-c1f5af7f0145 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:46.649507 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6508989-b1b5-4eba-876e-c1f5af7f0145 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:46.649938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6508989-b1b5-4eba-876e-c1f5af7f0145 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:46.677085 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f6508989-b1b5-4eba-876e-c1f5af7f0145 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] [instance: ea17d90d-7045-4ead-aa25-ed7bcf513681] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:18:46.774551 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f6508989-b1b5-4eba-876e-c1f5af7f0145 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681" status: 204 len: 0 microversion: 2.1 time: 0.136480 Sep 17 21:18:46.777550 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2768/5451] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:18:46 2022] DELETE /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:18:46.783773 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-04aa48f0-1c58-4cf8-8599-c94287d5634e tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:46.784406 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-04aa48f0-1c58-4cf8-8599-c94287d5634e tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] [instance: ea17d90d-7045-4ead-aa25-ed7bcf513681] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:46.790844 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04aa48f0-1c58-4cf8-8599-c94287d5634e tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:46.791341 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04aa48f0-1c58-4cf8-8599-c94287d5634e tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:46.792052 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04aa48f0-1c58-4cf8-8599-c94287d5634e tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:46.792867 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04aa48f0-1c58-4cf8-8599-c94287d5634e tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:46.793405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04aa48f0-1c58-4cf8-8599-c94287d5634e tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:46.793947 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04aa48f0-1c58-4cf8-8599-c94287d5634e tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:46.936024 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-04aa48f0-1c58-4cf8-8599-c94287d5634e tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08edf449e334897a129a1d26aedb507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37593cb29164fa2bbb0a54a758fa3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:46.943429 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-04aa48f0-1c58-4cf8-8599-c94287d5634e tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] 10.222.0.26 "GET /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681" status: 200 len: 1528 microversion: 2.1 time: 0.163628 Sep 17 21:18:46.944054 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2684/5452] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:46 2022] GET /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681 => generated 1528 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:47.487151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-705c73b1-2658-4306-9714-8cc58bcb561c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:47.487855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-705c73b1-2658-4306-9714-8cc58bcb561c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:47.500195 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-705c73b1-2658-4306-9714-8cc58bcb561c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:47.500695 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-705c73b1-2658-4306-9714-8cc58bcb561c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:47.501374 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-705c73b1-2658-4306-9714-8cc58bcb561c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:47.502129 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-705c73b1-2658-4306-9714-8cc58bcb561c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:47.502785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-705c73b1-2658-4306-9714-8cc58bcb561c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:47.503570 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-705c73b1-2658-4306-9714-8cc58bcb561c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:47.704109 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-705c73b1-2658-4306-9714-8cc58bcb561c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:47.713045 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-705c73b1-2658-4306-9714-8cc58bcb561c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:47.714544 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-705c73b1-2658-4306-9714-8cc58bcb561c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:47.715737 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-705c73b1-2658-4306-9714-8cc58bcb561c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1743 microversion: 2.20 time: 0.234200 Sep 17 21:18:47.716310 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2769/5453] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:18:47 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1743 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:18:47.967258 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a945fe64-8bee-4506-8e1b-067e02b5438c tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:47.968656 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a945fe64-8bee-4506-8e1b-067e02b5438c tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] [instance: ea17d90d-7045-4ead-aa25-ed7bcf513681] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:47.976252 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a945fe64-8bee-4506-8e1b-067e02b5438c tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:47.977067 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a945fe64-8bee-4506-8e1b-067e02b5438c tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:47.977500 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a945fe64-8bee-4506-8e1b-067e02b5438c tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:47.978521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a945fe64-8bee-4506-8e1b-067e02b5438c tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:47.979045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a945fe64-8bee-4506-8e1b-067e02b5438c tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:47.979558 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a945fe64-8bee-4506-8e1b-067e02b5438c tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:48.203897 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a945fe64-8bee-4506-8e1b-067e02b5438c tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08edf449e334897a129a1d26aedb507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37593cb29164fa2bbb0a54a758fa3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:48.219553 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a945fe64-8bee-4506-8e1b-067e02b5438c tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] 10.222.0.26 "GET /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681" status: 200 len: 1528 microversion: 2.1 time: 0.256091 Sep 17 21:18:48.220212 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2685/5454] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:47 2022] GET /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681 => generated 1528 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:48.756000 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-58a3272e-9954-4c06-b4b7-137668fb9901 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:48.757551 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-58a3272e-9954-4c06-b4b7-137668fb9901 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:48.767952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58a3272e-9954-4c06-b4b7-137668fb9901 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:48.768700 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58a3272e-9954-4c06-b4b7-137668fb9901 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:48.769375 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58a3272e-9954-4c06-b4b7-137668fb9901 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:48.770494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58a3272e-9954-4c06-b4b7-137668fb9901 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:48.784083 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58a3272e-9954-4c06-b4b7-137668fb9901 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:48.784763 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58a3272e-9954-4c06-b4b7-137668fb9901 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:48.951506 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-72d65b22-510d-4de5-bde7-9a943e5d9c05 req-1cb78f2e-eea1-4235-b1a6-83c465bb1bfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea17d90d-7045-4ead-aa25-ed7bcf513681", "name": "network-vif-deleted", "tag": "cad2d37d-09b8-48bb-91e5-99327a796dee"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:18:48.978384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:18:48.988025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-72d65b22-510d-4de5-bde7-9a943e5d9c05 req-1cb78f2e-eea1-4235-b1a6-83c465bb1bfa service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:48.988025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-72d65b22-510d-4de5-bde7-9a943e5d9c05 req-1cb78f2e-eea1-4235-b1a6-83c465bb1bfa service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:48.988338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-72d65b22-510d-4de5-bde7-9a943e5d9c05 req-1cb78f2e-eea1-4235-b1a6-83c465bb1bfa service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:49.023587 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-72d65b22-510d-4de5-bde7-9a943e5d9c05 req-1cb78f2e-eea1-4235-b1a6-83c465bb1bfa service nova] Creating event network-vif-deleted:cad2d37d-09b8-48bb-91e5-99327a796dee for instance ea17d90d-7045-4ead-aa25-ed7bcf513681 on nch1-master-1 Sep 17 21:18:49.039416 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-72d65b22-510d-4de5-bde7-9a943e5d9c05 req-1cb78f2e-eea1-4235-b1a6-83c465bb1bfa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097588 Sep 17 21:18:49.042657 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2686/5455] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:18:49.130098 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-58a3272e-9954-4c06-b4b7-137668fb9901 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:49.140350 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-58a3272e-9954-4c06-b4b7-137668fb9901 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:49.142534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-58a3272e-9954-4c06-b4b7-137668fb9901 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:49.144021 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-58a3272e-9954-4c06-b4b7-137668fb9901 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1738 microversion: 2.20 time: 0.403790 Sep 17 21:18:49.145179 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2770/5456] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:18:48 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1738 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:18:49.256132 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-99341860-19b3-4fda-91e3-5ef16d6a4a50 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:49.257210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-99341860-19b3-4fda-91e3-5ef16d6a4a50 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] [instance: ea17d90d-7045-4ead-aa25-ed7bcf513681] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:49.291113 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99341860-19b3-4fda-91e3-5ef16d6a4a50 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:49.292112 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99341860-19b3-4fda-91e3-5ef16d6a4a50 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:49.294805 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99341860-19b3-4fda-91e3-5ef16d6a4a50 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:49.295659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99341860-19b3-4fda-91e3-5ef16d6a4a50 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:49.296330 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99341860-19b3-4fda-91e3-5ef16d6a4a50 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:49.296605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99341860-19b3-4fda-91e3-5ef16d6a4a50 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:49.347700 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99341860-19b3-4fda-91e3-5ef16d6a4a50 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:49.348318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99341860-19b3-4fda-91e3-5ef16d6a4a50 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:49.348988 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99341860-19b3-4fda-91e3-5ef16d6a4a50 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:49.349691 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-99341860-19b3-4fda-91e3-5ef16d6a4a50 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lazy-loading 'fault' on Instance uuid ea17d90d-7045-4ead-aa25-ed7bcf513681 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:18:49.429676 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-99341860-19b3-4fda-91e3-5ef16d6a4a50 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f08edf449e334897a129a1d26aedb507', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37593cb29164fa2bbb0a54a758fa3bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:49.440997 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-99341860-19b3-4fda-91e3-5ef16d6a4a50 tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] 10.222.0.26 "GET /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681" status: 200 len: 1314 microversion: 2.1 time: 0.194278 Sep 17 21:18:49.441979 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2687/5457] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:49 2022] GET /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:50.175744 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-17ab642e-c6a8-4c0d-ba3a-e3c9e3b7f087 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:50.176338 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-17ab642e-c6a8-4c0d-ba3a-e3c9e3b7f087 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:50.185907 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17ab642e-c6a8-4c0d-ba3a-e3c9e3b7f087 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:50.186412 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17ab642e-c6a8-4c0d-ba3a-e3c9e3b7f087 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:50.186861 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17ab642e-c6a8-4c0d-ba3a-e3c9e3b7f087 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:50.187168 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-0ef5e5f6-ef20-4e80-bc35-6bdbe33ca33f req-033ac831-16c5-4833-a0ea-18b7ebad2057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0beab9d3-30c1-4b22-9157-31705ad3dbf7", "name": "network-vif-plugged", "status": "completed", "tag": "a96d5dc1-0855-4012-ae99-7136b223ea2b"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:18:50.187673 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17ab642e-c6a8-4c0d-ba3a-e3c9e3b7f087 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:50.188029 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17ab642e-c6a8-4c0d-ba3a-e3c9e3b7f087 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:50.188523 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17ab642e-c6a8-4c0d-ba3a-e3c9e3b7f087 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:50.213072 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-0ef5e5f6-ef20-4e80-bc35-6bdbe33ca33f req-033ac831-16c5-4833-a0ea-18b7ebad2057 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:50.213877 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-0ef5e5f6-ef20-4e80-bc35-6bdbe33ca33f req-033ac831-16c5-4833-a0ea-18b7ebad2057 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:50.216033 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-0ef5e5f6-ef20-4e80-bc35-6bdbe33ca33f req-033ac831-16c5-4833-a0ea-18b7ebad2057 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:50.256728 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-0ef5e5f6-ef20-4e80-bc35-6bdbe33ca33f req-033ac831-16c5-4833-a0ea-18b7ebad2057 service nova] Creating event network-vif-plugged:a96d5dc1-0855-4012-ae99-7136b223ea2b for instance 0beab9d3-30c1-4b22-9157-31705ad3dbf7 on nch2-master-1 Sep 17 21:18:50.269383 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-0ef5e5f6-ef20-4e80-bc35-6bdbe33ca33f req-033ac831-16c5-4833-a0ea-18b7ebad2057 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086986 Sep 17 21:18:50.270050 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2688/5458] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:18:50.361832 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-17ab642e-c6a8-4c0d-ba3a-e3c9e3b7f087 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:50.371959 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-17ab642e-c6a8-4c0d-ba3a-e3c9e3b7f087 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:50.373398 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-17ab642e-c6a8-4c0d-ba3a-e3c9e3b7f087 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:50.374601 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-17ab642e-c6a8-4c0d-ba3a-e3c9e3b7f087 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1738 microversion: 2.20 time: 0.204175 Sep 17 21:18:50.375177 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2771/5459] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:18:50 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:18:50.469845 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-17d8a575-5842-4a99-a90e-d65d7d42c26b tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:50.470828 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-17d8a575-5842-4a99-a90e-d65d7d42c26b tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] [instance: ea17d90d-7045-4ead-aa25-ed7bcf513681] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:50.478026 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17d8a575-5842-4a99-a90e-d65d7d42c26b tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:50.478741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17d8a575-5842-4a99-a90e-d65d7d42c26b tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:50.479400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17d8a575-5842-4a99-a90e-d65d7d42c26b tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:50.480123 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17d8a575-5842-4a99-a90e-d65d7d42c26b tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:50.480750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17d8a575-5842-4a99-a90e-d65d7d42c26b tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:50.481366 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17d8a575-5842-4a99-a90e-d65d7d42c26b tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:50.499614 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-17d8a575-5842-4a99-a90e-d65d7d42c26b tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] HTTP exception thrown: Instance ea17d90d-7045-4ead-aa25-ed7bcf513681 could not be found. Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-17d8a575-5842-4a99-a90e-d65d7d42c26b tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Request method failure captured: Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681 HTTP/1.1 Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjmoVdDfhMbpUX3GjmvSKWiyRFTyemcccadS5ekNPyh4bikN0TkOScwoUS-__6gjV9vMdkpEGvTDa9kx_0DH6W5xHt7NzVpeMj21WZWK-OkzSrUMnV_vqaQfWomxeGwvrCisQ2ni8EpsH-Da57OOr59h9XGWIQEjgjIprAGgMJjVHbg Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: a37593cb29164fa2bbb0a54a758fa3bd Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-156835004 Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a37593cb29164fa2bbb0a54a758fa3bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a37593cb29164fa2bbb0a54a758fa3bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a37593cb29164fa2bbb0a54a758fa3bd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a37593cb29164fa2bbb0a54a758fa3bd", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-156835004 Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: a37593cb29164fa2bbb0a54a758fa3bd Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-156835004 Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerAddressesNegativeTestJSON-156835004-project Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: f08edf449e334897a129a1d26aedb507 Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-156835004-project Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance ea17d90d-7045-4ead-aa25-ed7bcf513681 could not be found. Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'ea17d90d-7045-4ead-aa25-ed7bcf513681'} Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea17d90d-7045-4ead-aa25-ed7bcf513681 could not be found. Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea17d90d-7045-4ead-aa25-ed7bcf513681 could not be found. Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:18:50.501854 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:18:50.506213 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:18:50.506213 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:18:50.506213 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:18:50.506213 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:18:50.506213 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:18:50.506213 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:18:50.506213 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea17d90d-7045-4ead-aa25-ed7bcf513681 could not be found. Sep 17 21:18:50.506213 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:18:50.508672 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-17d8a575-5842-4a99-a90e-d65d7d42c26b tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] Returning 404 to user: Instance ea17d90d-7045-4ead-aa25-ed7bcf513681 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:18:50.510041 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-17d8a575-5842-4a99-a90e-d65d7d42c26b tempest-ServerAddressesNegativeTestJSON-156835004 tempest-ServerAddressesNegativeTestJSON-156835004-project] 10.222.0.26 "GET /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681" status: 404 len: 111 microversion: 2.1 time: 0.044242 Sep 17 21:18:50.511488 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2689/5460] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:50 2022] GET /compute/v2.1/servers/ea17d90d-7045-4ead-aa25-ed7bcf513681 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:18:51.400448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-158ed958-ed07-4c9e-93ef-20c864d918da tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:51.401065 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-158ed958-ed07-4c9e-93ef-20c864d918da tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:51.423306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-158ed958-ed07-4c9e-93ef-20c864d918da tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:51.423974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-158ed958-ed07-4c9e-93ef-20c864d918da tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:51.424596 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-158ed958-ed07-4c9e-93ef-20c864d918da tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:51.425497 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-158ed958-ed07-4c9e-93ef-20c864d918da tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:51.426097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-158ed958-ed07-4c9e-93ef-20c864d918da tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:51.426671 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-158ed958-ed07-4c9e-93ef-20c864d918da tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:51.737716 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-158ed958-ed07-4c9e-93ef-20c864d918da tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:51.751122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-158ed958-ed07-4c9e-93ef-20c864d918da tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:51.752910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-158ed958-ed07-4c9e-93ef-20c864d918da tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:51.754183 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-158ed958-ed07-4c9e-93ef-20c864d918da tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1738 microversion: 2.20 time: 0.357759 Sep 17 21:18:51.771509 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2772/5461] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:18:51 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1738 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:18:52.787832 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-92f9e2f5-eee5-4ca0-876b-636a34bb8658 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:52.788693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-92f9e2f5-eee5-4ca0-876b-636a34bb8658 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:52.806777 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92f9e2f5-eee5-4ca0-876b-636a34bb8658 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:52.808051 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92f9e2f5-eee5-4ca0-876b-636a34bb8658 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:52.809612 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92f9e2f5-eee5-4ca0-876b-636a34bb8658 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:52.811326 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92f9e2f5-eee5-4ca0-876b-636a34bb8658 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:52.812054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92f9e2f5-eee5-4ca0-876b-636a34bb8658 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:52.813834 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92f9e2f5-eee5-4ca0-876b-636a34bb8658 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:53.091672 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ad1cc596-3b18-4750-b775-2f9f945ccdf2 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-676829072", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "b78fcdef-7b60-4535-8d96-62fe1ad80fcd"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:18:53.167703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-ad1cc596-3b18-4750-b775-2f9f945ccdf2 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] validate_networks() for [('b78fcdef-7b60-4535-8d96-62fe1ad80fcd', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:18:53.227946 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-92f9e2f5-eee5-4ca0-876b-636a34bb8658 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:53.238527 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-92f9e2f5-eee5-4ca0-876b-636a34bb8658 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:53.241361 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-92f9e2f5-eee5-4ca0-876b-636a34bb8658 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:53.243643 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-92f9e2f5-eee5-4ca0-876b-636a34bb8658 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1738 microversion: 2.20 time: 0.459702 Sep 17 21:18:53.260455 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2690/5462] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:18:52 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1738 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:18:54.153888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-ad1cc596-3b18-4750-b775-2f9f945ccdf2 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:18:54.154457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-ad1cc596-3b18-4750-b775-2f9f945ccdf2 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:18:54.154842 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-ad1cc596-3b18-4750-b775-2f9f945ccdf2 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:18:54.155254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-ad1cc596-3b18-4750-b775-2f9f945ccdf2 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:18:54.155671 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-ad1cc596-3b18-4750-b775-2f9f945ccdf2 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:18:54.169252 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad1cc596-3b18-4750-b775-2f9f945ccdf2 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:54.177152 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad1cc596-3b18-4750-b775-2f9f945ccdf2 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:54.177812 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad1cc596-3b18-4750-b775-2f9f945ccdf2 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:54.178810 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad1cc596-3b18-4750-b775-2f9f945ccdf2 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:54.180513 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad1cc596-3b18-4750-b775-2f9f945ccdf2 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:54.182833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ad1cc596-3b18-4750-b775-2f9f945ccdf2 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:54.216752 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-ad1cc596-3b18-4750-b775-2f9f945ccdf2 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Getting quotas for project 335955c0be3743eda2541b7d04ed2e06. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:18:54.233625 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-ad1cc596-3b18-4750-b775-2f9f945ccdf2 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Getting quotas for user fd15b9d354eb44b0bfa83bcdcf5c1384 and project 335955c0be3743eda2541b7d04ed2e06. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:18:54.251575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ad1cc596-3b18-4750-b775-2f9f945ccdf2 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:18:54.254015 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ad1cc596-3b18-4750-b775-2f9f945ccdf2 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 56765273-f0e8-4db1-99a2-d789fa273a62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:18:54.288183 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4f02cd6f-008f-4b07-afd1-f95e721f0d25 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:54.289486 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4f02cd6f-008f-4b07-afd1-f95e721f0d25 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:54.320673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f02cd6f-008f-4b07-afd1-f95e721f0d25 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:54.321373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f02cd6f-008f-4b07-afd1-f95e721f0d25 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:54.321868 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f02cd6f-008f-4b07-afd1-f95e721f0d25 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:54.322645 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f02cd6f-008f-4b07-afd1-f95e721f0d25 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:54.323108 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f02cd6f-008f-4b07-afd1-f95e721f0d25 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:54.323543 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f02cd6f-008f-4b07-afd1-f95e721f0d25 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:54.363287 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ad1cc596-3b18-4750-b775-2f9f945ccdf2 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.275563 Sep 17 21:18:54.365822 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2773/5463] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:18:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:18:54.380004 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-115ba2bb-099c-4b82-8c7b-a5aaecde5396 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:54.382810 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-115ba2bb-099c-4b82-8c7b-a5aaecde5396 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 56765273-f0e8-4db1-99a2-d789fa273a62] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:54.468175 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-115ba2bb-099c-4b82-8c7b-a5aaecde5396 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd15b9d354eb44b0bfa83bcdcf5c1384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335955c0be3743eda2541b7d04ed2e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:54.476826 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-115ba2bb-099c-4b82-8c7b-a5aaecde5396 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "GET /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62" status: 200 len: 1218 microversion: 2.1 time: 0.102747 Sep 17 21:18:54.481297 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2774/5464] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:54 2022] GET /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62 => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:18:54.617275 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4f02cd6f-008f-4b07-afd1-f95e721f0d25 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:54.634637 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4f02cd6f-008f-4b07-afd1-f95e721f0d25 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:54.640242 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4f02cd6f-008f-4b07-afd1-f95e721f0d25 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:54.641896 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4f02cd6f-008f-4b07-afd1-f95e721f0d25 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1738 microversion: 2.20 time: 0.358422 Sep 17 21:18:54.648361 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2691/5465] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:18:54 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1738 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:18:55.519443 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7f2cdd7a-079d-4a6d-a824-fe53c090886c tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:55.520946 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7f2cdd7a-079d-4a6d-a824-fe53c090886c tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 56765273-f0e8-4db1-99a2-d789fa273a62] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:55.535150 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7f2cdd7a-079d-4a6d-a824-fe53c090886c tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:55.541356 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7f2cdd7a-079d-4a6d-a824-fe53c090886c tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:55.542403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7f2cdd7a-079d-4a6d-a824-fe53c090886c tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:55.543923 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7f2cdd7a-079d-4a6d-a824-fe53c090886c tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:55.544572 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7f2cdd7a-079d-4a6d-a824-fe53c090886c tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:55.545170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7f2cdd7a-079d-4a6d-a824-fe53c090886c tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:55.693597 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ea89a82a-52f0-4d8a-abb9-1cc714198407 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:55.695048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ea89a82a-52f0-4d8a-abb9-1cc714198407 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:55.704928 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea89a82a-52f0-4d8a-abb9-1cc714198407 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:55.705944 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea89a82a-52f0-4d8a-abb9-1cc714198407 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:55.706646 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea89a82a-52f0-4d8a-abb9-1cc714198407 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:55.707602 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea89a82a-52f0-4d8a-abb9-1cc714198407 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:55.708256 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea89a82a-52f0-4d8a-abb9-1cc714198407 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:55.708884 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea89a82a-52f0-4d8a-abb9-1cc714198407 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:55.754028 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7f2cdd7a-079d-4a6d-a824-fe53c090886c tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd15b9d354eb44b0bfa83bcdcf5c1384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335955c0be3743eda2541b7d04ed2e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:55.763870 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7f2cdd7a-079d-4a6d-a824-fe53c090886c tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "GET /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62" status: 200 len: 1214 microversion: 2.1 time: 0.248244 Sep 17 21:18:55.764483 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2775/5466] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:55 2022] GET /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62 => generated 1214 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:56.050997 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ea89a82a-52f0-4d8a-abb9-1cc714198407 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:56.067363 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ea89a82a-52f0-4d8a-abb9-1cc714198407 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:56.074530 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ea89a82a-52f0-4d8a-abb9-1cc714198407 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:56.076993 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ea89a82a-52f0-4d8a-abb9-1cc714198407 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1738 microversion: 2.20 time: 0.406626 Sep 17 21:18:56.080363 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2692/5467] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:18:55 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1738 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:18:56.791189 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4cc4d272-93c0-4b23-85ad-46b26a0c47bb tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:56.791858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4cc4d272-93c0-4b23-85ad-46b26a0c47bb tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 56765273-f0e8-4db1-99a2-d789fa273a62] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:56.805188 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4cc4d272-93c0-4b23-85ad-46b26a0c47bb tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:56.806233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4cc4d272-93c0-4b23-85ad-46b26a0c47bb tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:56.806849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4cc4d272-93c0-4b23-85ad-46b26a0c47bb tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:56.807722 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4cc4d272-93c0-4b23-85ad-46b26a0c47bb tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:56.809428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4cc4d272-93c0-4b23-85ad-46b26a0c47bb tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:56.809891 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4cc4d272-93c0-4b23-85ad-46b26a0c47bb tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:56.909937 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4cc4d272-93c0-4b23-85ad-46b26a0c47bb tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd15b9d354eb44b0bfa83bcdcf5c1384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335955c0be3743eda2541b7d04ed2e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:56.916441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:18:56.922287 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4cc4d272-93c0-4b23-85ad-46b26a0c47bb tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "GET /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62" status: 200 len: 1276 microversion: 2.1 time: 0.135877 Sep 17 21:18:56.923197 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2776/5468] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:56 2022] GET /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:57.110075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4e40a036-7d5b-4c91-8d7b-dc11996f09e5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:57.111470 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4e40a036-7d5b-4c91-8d7b-dc11996f09e5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:57.122912 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e40a036-7d5b-4c91-8d7b-dc11996f09e5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:57.130301 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e40a036-7d5b-4c91-8d7b-dc11996f09e5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:57.134185 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e40a036-7d5b-4c91-8d7b-dc11996f09e5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:57.135237 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e40a036-7d5b-4c91-8d7b-dc11996f09e5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:57.136291 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e40a036-7d5b-4c91-8d7b-dc11996f09e5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:57.138319 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4e40a036-7d5b-4c91-8d7b-dc11996f09e5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:57.605125 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4e40a036-7d5b-4c91-8d7b-dc11996f09e5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:57.619834 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4e40a036-7d5b-4c91-8d7b-dc11996f09e5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:57.628763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4e40a036-7d5b-4c91-8d7b-dc11996f09e5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:57.630210 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4e40a036-7d5b-4c91-8d7b-dc11996f09e5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1738 microversion: 2.20 time: 0.526941 Sep 17 21:18:57.631409 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2693/5469] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:18:57 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1738 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:18:57.954848 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-997c7513-5225-4e4d-ad33-8e219b1274b6 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:57.958271 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-997c7513-5225-4e4d-ad33-8e219b1274b6 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 56765273-f0e8-4db1-99a2-d789fa273a62] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:57.976165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-997c7513-5225-4e4d-ad33-8e219b1274b6 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:57.977083 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-997c7513-5225-4e4d-ad33-8e219b1274b6 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:57.997117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-997c7513-5225-4e4d-ad33-8e219b1274b6 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:58.004235 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-997c7513-5225-4e4d-ad33-8e219b1274b6 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:58.005471 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-997c7513-5225-4e4d-ad33-8e219b1274b6 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:58.006340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-997c7513-5225-4e4d-ad33-8e219b1274b6 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:58.369987 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-997c7513-5225-4e4d-ad33-8e219b1274b6 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd15b9d354eb44b0bfa83bcdcf5c1384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335955c0be3743eda2541b7d04ed2e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:58.395024 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-997c7513-5225-4e4d-ad33-8e219b1274b6 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "GET /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62" status: 200 len: 1318 microversion: 2.1 time: 0.446173 Sep 17 21:18:58.398282 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2777/5470] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:57 2022] GET /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62 => generated 1318 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:58.659243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fccc8866-9861-4d9e-ac3f-12255191e3fa tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:58.659871 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fccc8866-9861-4d9e-ac3f-12255191e3fa tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:58.681426 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fccc8866-9861-4d9e-ac3f-12255191e3fa tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:58.684753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fccc8866-9861-4d9e-ac3f-12255191e3fa tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:58.694846 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fccc8866-9861-4d9e-ac3f-12255191e3fa tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:58.696046 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fccc8866-9861-4d9e-ac3f-12255191e3fa tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:58.697005 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fccc8866-9861-4d9e-ac3f-12255191e3fa tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:58.697579 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fccc8866-9861-4d9e-ac3f-12255191e3fa tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:59.137328 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-3a3c63f0-e4b0-4276-8b3a-efa874bd4b67 req-a2d152b6-7c15-49a0-ace0-a670855e985d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56765273-f0e8-4db1-99a2-d789fa273a62", "tag": "02eb02f8-39c1-456b-90bf-42549827ed36"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:18:59.190275 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-3a3c63f0-e4b0-4276-8b3a-efa874bd4b67 req-a2d152b6-7c15-49a0-ace0-a670855e985d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:59.193670 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-3a3c63f0-e4b0-4276-8b3a-efa874bd4b67 req-a2d152b6-7c15-49a0-ace0-a670855e985d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:59.194435 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-3a3c63f0-e4b0-4276-8b3a-efa874bd4b67 req-a2d152b6-7c15-49a0-ace0-a670855e985d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:59.236535 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-3a3c63f0-e4b0-4276-8b3a-efa874bd4b67 req-a2d152b6-7c15-49a0-ace0-a670855e985d service nova] Creating event network-changed:02eb02f8-39c1-456b-90bf-42549827ed36 for instance 56765273-f0e8-4db1-99a2-d789fa273a62 on nch1-master-1 Sep 17 21:18:59.242024 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fccc8866-9861-4d9e-ac3f-12255191e3fa tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:59.259681 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fccc8866-9861-4d9e-ac3f-12255191e3fa tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:59.266982 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-3a3c63f0-e4b0-4276-8b3a-efa874bd4b67 req-a2d152b6-7c15-49a0-ace0-a670855e985d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.491876 Sep 17 21:18:59.269043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fccc8866-9861-4d9e-ac3f-12255191e3fa tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:59.270545 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fccc8866-9861-4d9e-ac3f-12255191e3fa tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1738 microversion: 2.20 time: 0.615716 Sep 17 21:18:59.272977 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2778/5471] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:18:59.276003 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2694/5472] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:18:58 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1738 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:18:59.429566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1c87dfe0-8a31-431b-b4f3-a6c940014eb7 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:59.430657 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1c87dfe0-8a31-431b-b4f3-a6c940014eb7 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 56765273-f0e8-4db1-99a2-d789fa273a62] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:59.442704 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c87dfe0-8a31-431b-b4f3-a6c940014eb7 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:59.445548 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c87dfe0-8a31-431b-b4f3-a6c940014eb7 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:59.446539 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c87dfe0-8a31-431b-b4f3-a6c940014eb7 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:59.449359 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c87dfe0-8a31-431b-b4f3-a6c940014eb7 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:59.451300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c87dfe0-8a31-431b-b4f3-a6c940014eb7 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:59.452137 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c87dfe0-8a31-431b-b4f3-a6c940014eb7 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:59.764994 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1c87dfe0-8a31-431b-b4f3-a6c940014eb7 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd15b9d354eb44b0bfa83bcdcf5c1384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335955c0be3743eda2541b7d04ed2e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:18:59.786323 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1c87dfe0-8a31-431b-b4f3-a6c940014eb7 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "GET /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62" status: 200 len: 1318 microversion: 2.1 time: 0.364509 Sep 17 21:18:59.794796 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2779/5473] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:18:59 2022] GET /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62 => generated 1318 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:18:59.928467 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-510bd39c-6f3a-44aa-90c5-a3eeec4408bb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:18:59.933712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-510bd39c-6f3a-44aa-90c5-a3eeec4408bb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:18:59.941094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-510bd39c-6f3a-44aa-90c5-a3eeec4408bb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:59.941748 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-510bd39c-6f3a-44aa-90c5-a3eeec4408bb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:59.942235 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-510bd39c-6f3a-44aa-90c5-a3eeec4408bb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:18:59.943037 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-510bd39c-6f3a-44aa-90c5-a3eeec4408bb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:18:59.943564 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-510bd39c-6f3a-44aa-90c5-a3eeec4408bb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:18:59.944061 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-510bd39c-6f3a-44aa-90c5-a3eeec4408bb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:00.001237 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-510bd39c-6f3a-44aa-90c5-a3eeec4408bb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080534 Sep 17 21:19:00.002535 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2695/5474] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 17 21:18:59 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:19:00.101248 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-49ecde1f-9176-4331-b425-9bae3a582157 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:00.101913 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-49ecde1f-9176-4331-b425-9bae3a582157 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:00.111954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49ecde1f-9176-4331-b425-9bae3a582157 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:00.112541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49ecde1f-9176-4331-b425-9bae3a582157 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:00.113038 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49ecde1f-9176-4331-b425-9bae3a582157 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:00.114125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49ecde1f-9176-4331-b425-9bae3a582157 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:00.115119 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49ecde1f-9176-4331-b425-9bae3a582157 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:00.115613 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-49ecde1f-9176-4331-b425-9bae3a582157 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:00.151007 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-49ecde1f-9176-4331-b425-9bae3a582157 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:19:00.258175 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-49ecde1f-9176-4331-b425-9bae3a582157 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 204 len: 0 microversion: 2.1 time: 0.162262 Sep 17 21:19:00.259644 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2780/5475] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:19:00 2022] DELETE /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:19:00.277213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-88fb0942-70ee-4c08-b355-0b40dea18dc7 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:00.278226 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-88fb0942-70ee-4c08-b355-0b40dea18dc7 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:00.286358 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-88fb0942-70ee-4c08-b355-0b40dea18dc7 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:00.287495 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-88fb0942-70ee-4c08-b355-0b40dea18dc7 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:00.288379 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-88fb0942-70ee-4c08-b355-0b40dea18dc7 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:00.289236 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-88fb0942-70ee-4c08-b355-0b40dea18dc7 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:00.289837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-88fb0942-70ee-4c08-b355-0b40dea18dc7 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:00.290374 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-88fb0942-70ee-4c08-b355-0b40dea18dc7 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:00.302757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-96ee82ec-c53b-4b83-a3f2-5eed1ce97e3c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:00.303478 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-96ee82ec-c53b-4b83-a3f2-5eed1ce97e3c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:00.310767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-96ee82ec-c53b-4b83-a3f2-5eed1ce97e3c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:00.312139 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-96ee82ec-c53b-4b83-a3f2-5eed1ce97e3c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:00.312789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-96ee82ec-c53b-4b83-a3f2-5eed1ce97e3c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:00.314086 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-96ee82ec-c53b-4b83-a3f2-5eed1ce97e3c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:00.315490 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-96ee82ec-c53b-4b83-a3f2-5eed1ce97e3c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:00.316084 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-96ee82ec-c53b-4b83-a3f2-5eed1ce97e3c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:00.539821 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-96ee82ec-c53b-4b83-a3f2-5eed1ce97e3c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:00.549283 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-96ee82ec-c53b-4b83-a3f2-5eed1ce97e3c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:00.551083 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-96ee82ec-c53b-4b83-a3f2-5eed1ce97e3c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:00.552295 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-96ee82ec-c53b-4b83-a3f2-5eed1ce97e3c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1738 microversion: 2.20 time: 0.255057 Sep 17 21:19:00.573078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-88fb0942-70ee-4c08-b355-0b40dea18dc7 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:00.575137 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2781/5476] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:19:00 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1738 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:19:00.583681 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-88fb0942-70ee-4c08-b355-0b40dea18dc7 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1673 microversion: 2.1 time: 0.319585 Sep 17 21:19:00.585725 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2696/5477] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:00 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1673 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:19:00.669848 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-03c313f9-4150-496a-8222-9a64bb86b167 tempest-VolumesTestJSON-354820453 tempest-VolumesTestJSON-354820453-project] Calling method '.version_select at 0x7f25a4c91d30>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:00.735246 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-03c313f9-4150-496a-8222-9a64bb86b167 tempest-VolumesTestJSON-354820453 tempest-VolumesTestJSON-354820453-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/d9859c2a-bfcd-40d1-96d6-cd78ba924621" status: 200 len: 343 microversion: 2.1 time: 0.069435 Sep 17 21:19:00.736879 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2782/5478] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Sep 17 21:19:00 2022] GET /compute/v2.1/os-volumes/d9859c2a-bfcd-40d1-96d6-cd78ba924621 => generated 343 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:19:00.813520 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-25209417-dd5f-49fe-b3c1-46765acfea88 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:00.814255 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-25209417-dd5f-49fe-b3c1-46765acfea88 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 56765273-f0e8-4db1-99a2-d789fa273a62] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:00.822543 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25209417-dd5f-49fe-b3c1-46765acfea88 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:00.823354 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25209417-dd5f-49fe-b3c1-46765acfea88 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:00.824005 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25209417-dd5f-49fe-b3c1-46765acfea88 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:00.825065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25209417-dd5f-49fe-b3c1-46765acfea88 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:00.825758 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25209417-dd5f-49fe-b3c1-46765acfea88 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:00.826399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25209417-dd5f-49fe-b3c1-46765acfea88 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:00.852899 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=100 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:19:01.142042 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-25209417-dd5f-49fe-b3c1-46765acfea88 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd15b9d354eb44b0bfa83bcdcf5c1384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335955c0be3743eda2541b7d04ed2e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:01.180022 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-25209417-dd5f-49fe-b3c1-46765acfea88 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "GET /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62" status: 200 len: 1318 microversion: 2.1 time: 0.370815 Sep 17 21:19:01.186789 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2697/5479] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:00 2022] GET /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62 => generated 1318 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:19:01.585099 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6e21d476-7d87-462d-94b3-745c159b6144 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:01.586827 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6e21d476-7d87-462d-94b3-745c159b6144 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:01.602460 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6e21d476-7d87-462d-94b3-745c159b6144 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:01.606727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6e21d476-7d87-462d-94b3-745c159b6144 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:01.607411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6e21d476-7d87-462d-94b3-745c159b6144 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:01.608731 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6e21d476-7d87-462d-94b3-745c159b6144 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:01.610057 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6e21d476-7d87-462d-94b3-745c159b6144 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:01.612295 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6e21d476-7d87-462d-94b3-745c159b6144 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:01.613628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4bbd3c72-5e3c-4e75-bc97-6be03c2b8932 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:01.614358 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4bbd3c72-5e3c-4e75-bc97-6be03c2b8932 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:01.631985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bbd3c72-5e3c-4e75-bc97-6be03c2b8932 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:01.633187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bbd3c72-5e3c-4e75-bc97-6be03c2b8932 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:01.634446 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bbd3c72-5e3c-4e75-bc97-6be03c2b8932 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:01.635437 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bbd3c72-5e3c-4e75-bc97-6be03c2b8932 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:01.637618 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bbd3c72-5e3c-4e75-bc97-6be03c2b8932 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:01.638470 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bbd3c72-5e3c-4e75-bc97-6be03c2b8932 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:02.063085 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4bbd3c72-5e3c-4e75-bc97-6be03c2b8932 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:02.068145 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6e21d476-7d87-462d-94b3-745c159b6144 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:02.071594 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4bbd3c72-5e3c-4e75-bc97-6be03c2b8932 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1673 microversion: 2.1 time: 0.462512 Sep 17 21:19:02.074630 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2698/5480] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:01 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1673 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:19:02.078254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6e21d476-7d87-462d-94b3-745c159b6144 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:02.080736 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6e21d476-7d87-462d-94b3-745c159b6144 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:02.086812 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6e21d476-7d87-462d-94b3-745c159b6144 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1738 microversion: 2.20 time: 0.508539 Sep 17 21:19:02.087588 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2783/5481] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:19:01 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1738 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:19:02.216795 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f91da921-8dbf-45a3-b953-e0851f3c7ab3 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:02.217832 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f91da921-8dbf-45a3-b953-e0851f3c7ab3 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 56765273-f0e8-4db1-99a2-d789fa273a62] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:02.227144 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f91da921-8dbf-45a3-b953-e0851f3c7ab3 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:02.227716 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f91da921-8dbf-45a3-b953-e0851f3c7ab3 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:02.228373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f91da921-8dbf-45a3-b953-e0851f3c7ab3 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:02.229532 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f91da921-8dbf-45a3-b953-e0851f3c7ab3 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:02.230262 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f91da921-8dbf-45a3-b953-e0851f3c7ab3 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:02.230716 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f91da921-8dbf-45a3-b953-e0851f3c7ab3 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:02.292072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d0bd8390-b0c1-4d8e-aacb-4084281b07ec tempest-VolumesTestJSON-354820453 tempest-VolumesTestJSON-354820453-project] Calling method '.version_select at 0x7f259fc91ca0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:02.392170 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d0bd8390-b0c1-4d8e-aacb-4084281b07ec tempest-VolumesTestJSON-354820453 tempest-VolumesTestJSON-354820453-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/acc2cf8b-8729-4738-a90a-506bf1efae19" status: 200 len: 344 microversion: 2.1 time: 0.105423 Sep 17 21:19:02.392766 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2784/5482] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Sep 17 21:19:02 2022] GET /compute/v2.1/os-volumes/acc2cf8b-8729-4738-a90a-506bf1efae19 => generated 344 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:19:02.581180 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f91da921-8dbf-45a3-b953-e0851f3c7ab3 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd15b9d354eb44b0bfa83bcdcf5c1384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335955c0be3743eda2541b7d04ed2e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:02.590273 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f91da921-8dbf-45a3-b953-e0851f3c7ab3 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "GET /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62" status: 200 len: 1318 microversion: 2.1 time: 0.379432 Sep 17 21:19:02.590864 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2699/5483] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:02 2022] GET /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62 => generated 1318 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:19:03.104011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d36e97f5-59c1-41d2-98c5-0a65dc90a742 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:03.104644 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d36e97f5-59c1-41d2-98c5-0a65dc90a742 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:03.115172 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b0eb1f1e-ca06-4aec-81fe-7a82a96efc51 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:03.117374 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b0eb1f1e-ca06-4aec-81fe-7a82a96efc51 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:03.120602 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d36e97f5-59c1-41d2-98c5-0a65dc90a742 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:03.121105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d36e97f5-59c1-41d2-98c5-0a65dc90a742 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:03.122499 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d36e97f5-59c1-41d2-98c5-0a65dc90a742 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:03.123961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d36e97f5-59c1-41d2-98c5-0a65dc90a742 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:03.126777 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d36e97f5-59c1-41d2-98c5-0a65dc90a742 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:03.129292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d36e97f5-59c1-41d2-98c5-0a65dc90a742 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:03.142995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0eb1f1e-ca06-4aec-81fe-7a82a96efc51 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:03.143518 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0eb1f1e-ca06-4aec-81fe-7a82a96efc51 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:03.144654 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0eb1f1e-ca06-4aec-81fe-7a82a96efc51 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:03.147192 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0eb1f1e-ca06-4aec-81fe-7a82a96efc51 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:03.148269 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0eb1f1e-ca06-4aec-81fe-7a82a96efc51 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:03.149644 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0eb1f1e-ca06-4aec-81fe-7a82a96efc51 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:03.489743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b0eb1f1e-ca06-4aec-81fe-7a82a96efc51 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:03.492592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d36e97f5-59c1-41d2-98c5-0a65dc90a742 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:03.505148 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d36e97f5-59c1-41d2-98c5-0a65dc90a742 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1673 microversion: 2.1 time: 0.411005 Sep 17 21:19:03.506512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b0eb1f1e-ca06-4aec-81fe-7a82a96efc51 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:03.508488 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2785/5484] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:03 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1673 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:19:03.511409 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b0eb1f1e-ca06-4aec-81fe-7a82a96efc51 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:03.513322 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b0eb1f1e-ca06-4aec-81fe-7a82a96efc51 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1738 microversion: 2.20 time: 0.403679 Sep 17 21:19:03.532146 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2700/5485] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:19:03 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1738 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:19:03.619804 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a7cdfd0c-2548-4e5e-b5b6-392a34fb072d tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:03.619804 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a7cdfd0c-2548-4e5e-b5b6-392a34fb072d tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 56765273-f0e8-4db1-99a2-d789fa273a62] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:03.630683 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7cdfd0c-2548-4e5e-b5b6-392a34fb072d tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:03.631183 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7cdfd0c-2548-4e5e-b5b6-392a34fb072d tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:03.631853 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7cdfd0c-2548-4e5e-b5b6-392a34fb072d tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:03.633225 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7cdfd0c-2548-4e5e-b5b6-392a34fb072d tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:03.634263 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7cdfd0c-2548-4e5e-b5b6-392a34fb072d tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:03.635252 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7cdfd0c-2548-4e5e-b5b6-392a34fb072d tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:03.939687 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8e2579c6-bcc5-467a-9d56-87b5724ce0e8 tempest-VolumesTestJSON-354820453 tempest-VolumesTestJSON-354820453-project] Calling method '.version_select at 0x7f25a516a550>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:03.968565 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a7cdfd0c-2548-4e5e-b5b6-392a34fb072d tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd15b9d354eb44b0bfa83bcdcf5c1384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335955c0be3743eda2541b7d04ed2e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:03.986398 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a7cdfd0c-2548-4e5e-b5b6-392a34fb072d tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "GET /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62" status: 200 len: 1318 microversion: 2.1 time: 0.373495 Sep 17 21:19:03.988642 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2786/5486] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:03 2022] GET /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62 => generated 1318 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:19:04.026350 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-17681258-736e-4fcf-9fca-0d0722a5c83b req-67895491-fc0f-402e-a30f-040b70f84f2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56765273-f0e8-4db1-99a2-d789fa273a62", "name": "network-vif-plugged", "status": "completed", "tag": "02eb02f8-39c1-456b-90bf-42549827ed36"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:19:04.053418 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-17681258-736e-4fcf-9fca-0d0722a5c83b req-67895491-fc0f-402e-a30f-040b70f84f2b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:04.054229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-17681258-736e-4fcf-9fca-0d0722a5c83b req-67895491-fc0f-402e-a30f-040b70f84f2b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:04.055224 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-17681258-736e-4fcf-9fca-0d0722a5c83b req-67895491-fc0f-402e-a30f-040b70f84f2b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:04.085166 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-17681258-736e-4fcf-9fca-0d0722a5c83b req-67895491-fc0f-402e-a30f-040b70f84f2b service nova] Creating event network-vif-plugged:02eb02f8-39c1-456b-90bf-42549827ed36 for instance 56765273-f0e8-4db1-99a2-d789fa273a62 on nch1-master-1 Sep 17 21:19:04.093743 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8e2579c6-bcc5-467a-9d56-87b5724ce0e8 tempest-VolumesTestJSON-354820453 tempest-VolumesTestJSON-354820453-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3d594660-2431-4012-8be5-67ec0dd33f0e" status: 200 len: 344 microversion: 2.1 time: 0.159029 Sep 17 21:19:04.094894 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2701/5487] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Sep 17 21:19:03 2022] GET /compute/v2.1/os-volumes/3d594660-2431-4012-8be5-67ec0dd33f0e => generated 344 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:19:04.096925 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-17681258-736e-4fcf-9fca-0d0722a5c83b req-67895491-fc0f-402e-a30f-040b70f84f2b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074235 Sep 17 21:19:04.097828 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2787/5488] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 17 21:19:04.111162 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2992178b-8040-448c-9111-f71179e07fcf tempest-VolumesTestJSON-354820453 tempest-VolumesTestJSON-354820453-project] Calling method '.version_select at 0x7f25a488dee0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:04.296580 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2992178b-8040-448c-9111-f71179e07fcf tempest-VolumesTestJSON-354820453 tempest-VolumesTestJSON-354820453-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1014 microversion: 2.1 time: 0.190234 Sep 17 21:19:04.297255 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2702/5489] 10.222.0.26 () {58 vars in 1134 bytes} [Sat Sep 17 21:19:04 2022] GET /compute/v2.1/os-volumes => generated 1014 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:19:04.317000 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:19:04.321957 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-208d2bd8-c3e0-453e-861b-f06659e7ef92 tempest-VolumesTestJSON-354820453 tempest-VolumesTestJSON-354820453-project] Calling method '.version_select at 0x7f259fcd9ca0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:04.475536 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=8 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:19:04.508282 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-af80d59a-2dfd-4989-be38-2016a2f5f801 req-521bf32f-ce04-4622-802c-07682075d2f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fa19be0-63c9-4071-979b-b23744235f16", "name": "network-vif-deleted", "tag": "42ddec5f-4dce-48d9-a03c-50a2244f6f0b"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:19:04.515654 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-208d2bd8-c3e0-453e-861b-f06659e7ef92 tempest-VolumesTestJSON-354820453 tempest-VolumesTestJSON-354820453-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 681 microversion: 2.1 time: 0.200264 Sep 17 21:19:04.527269 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2788/5490] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Sep 17 21:19:04 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 681 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:19:04.533478 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-53788eec-a2fb-4802-b17e-95153fd7cafb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:04.534632 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-53788eec-a2fb-4802-b17e-95153fd7cafb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:04.543173 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-af80d59a-2dfd-4989-be38-2016a2f5f801 req-521bf32f-ce04-4622-802c-07682075d2f8 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:04.544143 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-af80d59a-2dfd-4989-be38-2016a2f5f801 req-521bf32f-ce04-4622-802c-07682075d2f8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:04.544827 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-af80d59a-2dfd-4989-be38-2016a2f5f801 req-521bf32f-ce04-4622-802c-07682075d2f8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:04.556063 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53788eec-a2fb-4802-b17e-95153fd7cafb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:04.556950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53788eec-a2fb-4802-b17e-95153fd7cafb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:04.561659 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53788eec-a2fb-4802-b17e-95153fd7cafb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:04.562516 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53788eec-a2fb-4802-b17e-95153fd7cafb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:04.563007 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53788eec-a2fb-4802-b17e-95153fd7cafb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:04.563454 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53788eec-a2fb-4802-b17e-95153fd7cafb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:04.584688 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-af80d59a-2dfd-4989-be38-2016a2f5f801 req-521bf32f-ce04-4622-802c-07682075d2f8 service nova] Creating event network-vif-deleted:42ddec5f-4dce-48d9-a03c-50a2244f6f0b for instance 3fa19be0-63c9-4071-979b-b23744235f16 on nch2-master-1 Sep 17 21:19:04.597378 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-af80d59a-2dfd-4989-be38-2016a2f5f801 req-521bf32f-ce04-4622-802c-07682075d2f8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094052 Sep 17 21:19:04.600292 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2703/5491] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:19:04.616746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2075286b-1554-4f5a-9c7a-4c90f4a73a65 tempest-VolumesTestJSON-354820453 tempest-VolumesTestJSON-354820453-project] Calling method '.version_select at 0x7f25a44d7040>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:04.761322 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-53788eec-a2fb-4802-b17e-95153fd7cafb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:04.783880 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-53788eec-a2fb-4802-b17e-95153fd7cafb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 200 len: 1323 microversion: 2.1 time: 0.255412 Sep 17 21:19:04.785406 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2789/5492] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:04 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 1323 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:19:04.792973 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-409612ad-eeee-48e6-a390-dc44c13f3312 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:04.793788 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-409612ad-eeee-48e6-a390-dc44c13f3312 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:04.800699 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-409612ad-eeee-48e6-a390-dc44c13f3312 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:04.801452 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-409612ad-eeee-48e6-a390-dc44c13f3312 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:04.802117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-409612ad-eeee-48e6-a390-dc44c13f3312 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:04.802994 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-409612ad-eeee-48e6-a390-dc44c13f3312 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:04.804468 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-409612ad-eeee-48e6-a390-dc44c13f3312 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:04.805072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-409612ad-eeee-48e6-a390-dc44c13f3312 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:04.831755 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2075286b-1554-4f5a-9c7a-4c90f4a73a65 tempest-VolumesTestJSON-354820453 tempest-VolumesTestJSON-354820453-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1014 microversion: 2.1 time: 0.227534 Sep 17 21:19:04.832517 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2704/5493] 10.222.0.26 () {58 vars in 1134 bytes} [Sat Sep 17 21:19:04 2022] GET /compute/v2.1/os-volumes => generated 1014 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:19:04.846916 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-26bb26f5-1919-4dc2-963e-df7d4379418a tempest-VolumesTestJSON-354820453 tempest-VolumesTestJSON-354820453-project] Calling method '.version_select at 0x7f25a51f3af0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:04.986045 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-26bb26f5-1919-4dc2-963e-df7d4379418a tempest-VolumesTestJSON-354820453 tempest-VolumesTestJSON-354820453-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 347 microversion: 2.1 time: 0.143120 Sep 17 21:19:04.987125 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2705/5494] 10.222.0.26 () {58 vars in 1167 bytes} [Sat Sep 17 21:19:04 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 347 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:19:05.005514 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6eda3724-3537-413d-9227-fae209035a2e tempest-VolumesTestJSON-354820453 tempest-VolumesTestJSON-354820453-project] Calling method '.version_select at 0x7f25a45161f0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:05.017747 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-409612ad-eeee-48e6-a390-dc44c13f3312 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:05.028427 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-409612ad-eeee-48e6-a390-dc44c13f3312 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:05.030311 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-409612ad-eeee-48e6-a390-dc44c13f3312 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:05.031628 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-409612ad-eeee-48e6-a390-dc44c13f3312 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1738 microversion: 2.20 time: 0.244169 Sep 17 21:19:05.047172 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2790/5495] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:19:04 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1738 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:19:05.074725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-edda935f-e068-4ada-b806-b52621f501b8 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:05.075586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-edda935f-e068-4ada-b806-b52621f501b8 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 56765273-f0e8-4db1-99a2-d789fa273a62] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:05.085772 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-edda935f-e068-4ada-b806-b52621f501b8 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:05.086349 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-edda935f-e068-4ada-b806-b52621f501b8 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:05.086738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-edda935f-e068-4ada-b806-b52621f501b8 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:05.087470 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-edda935f-e068-4ada-b806-b52621f501b8 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:05.087931 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-edda935f-e068-4ada-b806-b52621f501b8 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:05.088336 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-edda935f-e068-4ada-b806-b52621f501b8 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:05.196985 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6eda3724-3537-413d-9227-fae209035a2e tempest-VolumesTestJSON-354820453 tempest-VolumesTestJSON-354820453-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 681 microversion: 2.1 time: 0.197316 Sep 17 21:19:05.197615 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2706/5496] 10.222.0.26 () {58 vars in 1170 bytes} [Sat Sep 17 21:19:04 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 681 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:19:05.213890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-698b5ac9-44d3-4aeb-b365-e0feea44a2fd tempest-VolumesTestJSON-354820453 tempest-VolumesTestJSON-354820453-project] Calling method '.version_select at 0x7f25a5b2cd30>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:05.362673 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-edda935f-e068-4ada-b806-b52621f501b8 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd15b9d354eb44b0bfa83bcdcf5c1384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335955c0be3743eda2541b7d04ed2e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:05.376607 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-edda935f-e068-4ada-b806-b52621f501b8 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "GET /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62" status: 200 len: 1318 microversion: 2.1 time: 0.325267 Sep 17 21:19:05.391424 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2791/5497] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:05 2022] GET /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62 => generated 1318 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:19:05.444731 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-698b5ac9-44d3-4aeb-b365-e0feea44a2fd tempest-VolumesTestJSON-354820453 tempest-VolumesTestJSON-354820453-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1014 microversion: 2.1 time: 0.234665 Sep 17 21:19:05.456102 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2707/5498] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Sep 17 21:19:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1014 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:19:05.462577 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3c6f2c9d-8183-4e43-a81e-72c1585c4b96 tempest-VolumesTestJSON-354820453 tempest-VolumesTestJSON-354820453-project] Calling method '.version_select at 0x7f259fd61c10>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:05.588494 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3c6f2c9d-8183-4e43-a81e-72c1585c4b96 tempest-VolumesTestJSON-354820453 tempest-VolumesTestJSON-354820453-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 347 microversion: 2.1 time: 0.130781 Sep 17 21:19:05.598070 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2792/5499] 10.222.0.26 () {58 vars in 1188 bytes} [Sat Sep 17 21:19:05 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 347 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:19:05.603596 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c8a3ac8e-3cc1-40d1-93c0-476db20a3adf tempest-VolumesTestJSON-354820453 tempest-VolumesTestJSON-354820453-project] Calling method '.version_select at 0x7f25a44d7af0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:05.693389 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c8a3ac8e-3cc1-40d1-93c0-476db20a3adf tempest-VolumesTestJSON-354820453 tempest-VolumesTestJSON-354820453-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1014 microversion: 2.1 time: 0.093851 Sep 17 21:19:05.704534 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2708/5500] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Sep 17 21:19:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1014 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:19:05.810916 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2f006801-2d7c-4977-a147-0f03fbc253f1 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:05.811554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2f006801-2d7c-4977-a147-0f03fbc253f1 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:05.819842 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f006801-2d7c-4977-a147-0f03fbc253f1 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:05.820352 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f006801-2d7c-4977-a147-0f03fbc253f1 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:05.820800 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f006801-2d7c-4977-a147-0f03fbc253f1 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:05.821899 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f006801-2d7c-4977-a147-0f03fbc253f1 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:05.822368 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f006801-2d7c-4977-a147-0f03fbc253f1 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:05.822805 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2f006801-2d7c-4977-a147-0f03fbc253f1 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:05.839761 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-2f006801-2d7c-4977-a147-0f03fbc253f1 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] HTTP exception thrown: Instance 3fa19be0-63c9-4071-979b-b23744235f16 could not be found. Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2f006801-2d7c-4977-a147-0f03fbc253f1 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Request method failure captured: Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 HTTP/1.1 Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjkWPfVVCWlCt5C_zYZ3ifOv8PEEqQ88FQiqA6A5GoGefnn7DLiqPrB51iFwWp6Nb5TtO-f0hN7F78Xmv_gVYHx4yPsnrp3hdW0YUGXuGWt1tLj5tFXW8h2TviF7TmFsXVoTis_HSLUBmcfbs9_0oM0dRSc6SsIXep29VXVufDgp2oc Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 8d3fab3adf0c425680c91af8afcc516f Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-AttachVolumeTestJSON-890686982 Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d3fab3adf0c425680c91af8afcc516f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8d3fab3adf0c425680c91af8afcc516f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d3fab3adf0c425680c91af8afcc516f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8d3fab3adf0c425680c91af8afcc516f", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-AttachVolumeTestJSON-890686982 Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 8d3fab3adf0c425680c91af8afcc516f Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-AttachVolumeTestJSON-890686982 Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-AttachVolumeTestJSON-890686982-project Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 7ff5b886208a44c0891c2d1ba65dc083 Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-AttachVolumeTestJSON-890686982-project Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 3fa19be0-63c9-4071-979b-b23744235f16 could not be found. Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '3fa19be0-63c9-4071-979b-b23744235f16'} Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fa19be0-63c9-4071-979b-b23744235f16 could not be found. Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fa19be0-63c9-4071-979b-b23744235f16 could not be found. Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:19:05.841818 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:19:05.845856 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:19:05.845856 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:19:05.845856 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:19:05.845856 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:19:05.845856 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:19:05.845856 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fa19be0-63c9-4071-979b-b23744235f16 could not be found. Sep 17 21:19:05.845856 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:19:05.848541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2f006801-2d7c-4977-a147-0f03fbc253f1 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Returning 404 to user: Instance 3fa19be0-63c9-4071-979b-b23744235f16 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:19:05.849648 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2f006801-2d7c-4977-a147-0f03fbc253f1 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 404 len: 111 microversion: 2.1 time: 0.045360 Sep 17 21:19:05.851073 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2793/5501] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:05 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:19:05.860274 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9dd65a27-1808-454a-89ed-da7fd55eda46 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '.version_select at 0x7f25a488d280>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:05.896758 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9dd65a27-1808-454a-89ed-da7fd55eda46 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1856299699" status: 202 len: 0 microversion: 2.1 time: 0.041324 Sep 17 21:19:05.897745 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2709/5502] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Sep 17 21:19:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1856299699 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:19:06.079860 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-30b8ffca-63c0-4a18-b431-02a2972a5ec5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:06.081421 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-30b8ffca-63c0-4a18-b431-02a2972a5ec5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:06.092269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-30b8ffca-63c0-4a18-b431-02a2972a5ec5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:06.093952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-30b8ffca-63c0-4a18-b431-02a2972a5ec5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:06.094546 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-30b8ffca-63c0-4a18-b431-02a2972a5ec5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:06.095558 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-30b8ffca-63c0-4a18-b431-02a2972a5ec5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:06.096218 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-30b8ffca-63c0-4a18-b431-02a2972a5ec5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:06.096959 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-30b8ffca-63c0-4a18-b431-02a2972a5ec5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:06.334022 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-30b8ffca-63c0-4a18-b431-02a2972a5ec5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:06.346757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-30b8ffca-63c0-4a18-b431-02a2972a5ec5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:06.348215 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-30b8ffca-63c0-4a18-b431-02a2972a5ec5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:06.351914 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-30b8ffca-63c0-4a18-b431-02a2972a5ec5 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1720 microversion: 2.20 time: 0.277260 Sep 17 21:19:06.352527 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2794/5503] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:19:06 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1720 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:19:06.404741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-17b0e1f5-3fec-4719-9b04-005ed8eca1cd tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:06.405838 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-17b0e1f5-3fec-4719-9b04-005ed8eca1cd tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 56765273-f0e8-4db1-99a2-d789fa273a62] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:06.420575 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17b0e1f5-3fec-4719-9b04-005ed8eca1cd tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:06.421250 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17b0e1f5-3fec-4719-9b04-005ed8eca1cd tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:06.421927 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17b0e1f5-3fec-4719-9b04-005ed8eca1cd tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:06.422850 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17b0e1f5-3fec-4719-9b04-005ed8eca1cd tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:06.426606 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17b0e1f5-3fec-4719-9b04-005ed8eca1cd tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:06.427697 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17b0e1f5-3fec-4719-9b04-005ed8eca1cd tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:06.696824 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-17b0e1f5-3fec-4719-9b04-005ed8eca1cd tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd15b9d354eb44b0bfa83bcdcf5c1384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335955c0be3743eda2541b7d04ed2e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:06.705823 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-17b0e1f5-3fec-4719-9b04-005ed8eca1cd tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "GET /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62" status: 200 len: 1507 microversion: 2.1 time: 0.306333 Sep 17 21:19:06.706543 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2710/5504] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:06 2022] GET /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62 => generated 1507 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:19:07.301383 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5160dbe4-be45-4410-8771-17a1af30c7de tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Action: 'create', calling method: .version_select at 0x7f259fd05940>, body: {"keypair": {"name": "tempest-keypair-1922633971", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmgOGYmp84z5O99NCqug9aaQwTtUFbCaTe+52V4PT8oOX6Z+ho5qNNsim/qY4rX9aPZaihe/SuTDAt1Dm7QkGhBqmomg5CsocOSKX9fVGLbDk8Fq23NXfh3WkeUouA0IQ=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:19:07.333610 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-5160dbe4-be45-4410-8771-17a1af30c7de tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Getting quotas for project 8d3fab3adf0c425680c91af8afcc516f. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:19:07.342092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-5160dbe4-be45-4410-8771-17a1af30c7de tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Getting quotas for user 7ff5b886208a44c0891c2d1ba65dc083 and project 8d3fab3adf0c425680c91af8afcc516f. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:19:07.375689 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5160dbe4-be45-4410-8771-17a1af30c7de tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.078979 Sep 17 21:19:07.377921 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2795/5505] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:19:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:19:07.655773 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a48dbb02-786d-4e01-8394-1ff325154887 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:07.656707 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a48dbb02-786d-4e01-8394-1ff325154887 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:07.664605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a48dbb02-786d-4e01-8394-1ff325154887 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:07.665316 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a48dbb02-786d-4e01-8394-1ff325154887 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:07.665917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a48dbb02-786d-4e01-8394-1ff325154887 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:07.674378 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a48dbb02-786d-4e01-8394-1ff325154887 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:07.675694 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a48dbb02-786d-4e01-8394-1ff325154887 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:07.676388 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a48dbb02-786d-4e01-8394-1ff325154887 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:07.889835 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a48dbb02-786d-4e01-8394-1ff325154887 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:07.900351 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a48dbb02-786d-4e01-8394-1ff325154887 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:07.905472 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a48dbb02-786d-4e01-8394-1ff325154887 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:07.907898 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a48dbb02-786d-4e01-8394-1ff325154887 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1720 microversion: 2.20 time: 0.527819 Sep 17 21:19:07.909022 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2711/5506] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:19:07 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1720 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:19:08.936139 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2fd6f9c3-53d2-48ff-8da1-3d2b9fcbf265 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:08.936914 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2fd6f9c3-53d2-48ff-8da1-3d2b9fcbf265 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:08.944302 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2fd6f9c3-53d2-48ff-8da1-3d2b9fcbf265 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:08.944735 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2fd6f9c3-53d2-48ff-8da1-3d2b9fcbf265 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:08.945200 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2fd6f9c3-53d2-48ff-8da1-3d2b9fcbf265 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:08.945952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2fd6f9c3-53d2-48ff-8da1-3d2b9fcbf265 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:08.946585 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2fd6f9c3-53d2-48ff-8da1-3d2b9fcbf265 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:08.946995 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2fd6f9c3-53d2-48ff-8da1-3d2b9fcbf265 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:09.107622 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e549672d-5a24-4c18-a8e7-cf5662df4ab0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-469155469", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "edb1c384-fe19-4c45-ae46-f262434e13af"}], "security_groups": [{"name": "tempest-securitygroup--318753910"}], "key_name": "tempest-keypair-1922633971", "user_data": "}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:19:09.111786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2fd6f9c3-53d2-48ff-8da1-3d2b9fcbf265 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:09.122388 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2fd6f9c3-53d2-48ff-8da1-3d2b9fcbf265 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:09.123875 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2fd6f9c3-53d2-48ff-8da1-3d2b9fcbf265 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:09.125528 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2fd6f9c3-53d2-48ff-8da1-3d2b9fcbf265 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1723 microversion: 2.20 time: 0.195237 Sep 17 21:19:09.126780 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2796/5507] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:19:08 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:19:09.161731 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d6916e6d-c954-4c62-a86a-4a14cd264c15 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7b28ecd-7573-4b77-a5cd-36f4afa22ac4"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:19:09.161731 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d6916e6d-c954-4c62-a86a-4a14cd264c15 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:09.161731 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d6916e6d-c954-4c62-a86a-4a14cd264c15 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:09.161731 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d6916e6d-c954-4c62-a86a-4a14cd264c15 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:09.162122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d6916e6d-c954-4c62-a86a-4a14cd264c15 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:09.162777 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d6916e6d-c954-4c62-a86a-4a14cd264c15 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:09.163258 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d6916e6d-c954-4c62-a86a-4a14cd264c15 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:09.163684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d6916e6d-c954-4c62-a86a-4a14cd264c15 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:09.296447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-e549672d-5a24-4c18-a8e7-cf5662df4ab0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] validate_networks() for [('edb1c384-fe19-4c45-ae46-f262434e13af', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:19:09.568316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:19:09.733993 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d6916e6d-c954-4c62-a86a-4a14cd264c15 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "POST /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.585771 Sep 17 21:19:09.735921 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2797/5508] 10.222.0.26 () {62 vars in 1364 bytes} [Sat Sep 17 21:19:09 2022] POST /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7/os-volume_attachments => generated 188 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 17 21:19:09.751660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a608543a-2222-4a5b-8482-29f6a713879b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f21f3370-6eb4-457e-9061-0f3b2e826e13", "device": "/dev/sdb"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:19:09.755869 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a608543a-2222-4a5b-8482-29f6a713879b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 56765273-f0e8-4db1-99a2-d789fa273a62] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:09.772556 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a608543a-2222-4a5b-8482-29f6a713879b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:09.773726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a608543a-2222-4a5b-8482-29f6a713879b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:09.774575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a608543a-2222-4a5b-8482-29f6a713879b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:09.775700 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a608543a-2222-4a5b-8482-29f6a713879b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:09.776369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a608543a-2222-4a5b-8482-29f6a713879b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:09.777318 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a608543a-2222-4a5b-8482-29f6a713879b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:09.870650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-e549672d-5a24-4c18-a8e7-cf5662df4ab0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:19:09.871175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-e549672d-5a24-4c18-a8e7-cf5662df4ab0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:19:09.871779 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-e549672d-5a24-4c18-a8e7-cf5662df4ab0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:19:09.872849 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-e549672d-5a24-4c18-a8e7-cf5662df4ab0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:19:09.873614 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-e549672d-5a24-4c18-a8e7-cf5662df4ab0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:19:09.897839 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e549672d-5a24-4c18-a8e7-cf5662df4ab0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:09.898663 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e549672d-5a24-4c18-a8e7-cf5662df4ab0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:09.899311 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e549672d-5a24-4c18-a8e7-cf5662df4ab0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:09.900285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e549672d-5a24-4c18-a8e7-cf5662df4ab0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:09.900971 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e549672d-5a24-4c18-a8e7-cf5662df4ab0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:09.901834 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e549672d-5a24-4c18-a8e7-cf5662df4ab0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:09.923630 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-e549672d-5a24-4c18-a8e7-cf5662df4ab0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Getting quotas for project 8d3fab3adf0c425680c91af8afcc516f. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:19:09.929944 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-e549672d-5a24-4c18-a8e7-cf5662df4ab0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Getting quotas for user 7ff5b886208a44c0891c2d1ba65dc083 and project 8d3fab3adf0c425680c91af8afcc516f. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:19:09.946855 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e549672d-5a24-4c18-a8e7-cf5662df4ab0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:19:09.949789 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e549672d-5a24-4c18-a8e7-cf5662df4ab0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:19:10.005921 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e549672d-5a24-4c18-a8e7-cf5662df4ab0 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.905382 Sep 17 21:19:10.006713 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2712/5509] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:19:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:19:10.018894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-392d0ccd-adee-4740-956a-0f6fca920533 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:10.019805 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-392d0ccd-adee-4740-956a-0f6fca920533 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:10.027707 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-392d0ccd-adee-4740-956a-0f6fca920533 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:10.028652 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-392d0ccd-adee-4740-956a-0f6fca920533 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:10.029316 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-392d0ccd-adee-4740-956a-0f6fca920533 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:10.030408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-392d0ccd-adee-4740-956a-0f6fca920533 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:10.031088 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-392d0ccd-adee-4740-956a-0f6fca920533 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:10.031868 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-392d0ccd-adee-4740-956a-0f6fca920533 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:10.194935 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a608543a-2222-4a5b-8482-29f6a713879b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "POST /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.457293 Sep 17 21:19:10.196160 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2798/5510] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 17 21:19:09 2022] POST /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62/os-volume_attachments => generated 194 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:19:10.207361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3d644099-d14f-4ed2-bd91-ab47802be5e2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:10.208684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3d644099-d14f-4ed2-bd91-ab47802be5e2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:10.334986 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3d644099-d14f-4ed2-bd91-ab47802be5e2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:10.345720 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3d644099-d14f-4ed2-bd91-ab47802be5e2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61" status: 200 len: 1237 microversion: 2.1 time: 0.147038 Sep 17 21:19:10.350299 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2799/5511] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:10 2022] GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 => generated 1237 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:19:10.357959 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-b276cc74-4445-4b76-a382-62fe647d4453 req-c12aaa59-a5bd-4e52-bbd6-905db38b9b44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0beab9d3-30c1-4b22-9157-31705ad3dbf7", "name": "network-vif-unplugged", "status": "completed", "tag": "a96d5dc1-0855-4012-ae99-7136b223ea2b"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:19:10.383239 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b276cc74-4445-4b76-a382-62fe647d4453 req-c12aaa59-a5bd-4e52-bbd6-905db38b9b44 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:10.385928 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b276cc74-4445-4b76-a382-62fe647d4453 req-c12aaa59-a5bd-4e52-bbd6-905db38b9b44 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:10.387404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b276cc74-4445-4b76-a382-62fe647d4453 req-c12aaa59-a5bd-4e52-bbd6-905db38b9b44 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:10.412221 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.compute.server_external_events [req-b276cc74-4445-4b76-a382-62fe647d4453 req-c12aaa59-a5bd-4e52-bbd6-905db38b9b44 service nova] Unable to find a host for instance 0beab9d3-30c1-4b22-9157-31705ad3dbf7. Dropping event network-vif-unplugged {{(pid=140524) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 17 21:19:10.414744 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-b276cc74-4445-4b76-a382-62fe647d4453 req-c12aaa59-a5bd-4e52-bbd6-905db38b9b44 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.062067 Sep 17 21:19:10.419450 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2800/5512] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 68 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 17 21:19:10.488820 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-392d0ccd-adee-4740-956a-0f6fca920533 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7/os-volume_attachments/e7b28ecd-7573-4b77-a5cd-36f4afa22ac4" status: 202 len: 0 microversion: 2.20 time: 0.480340 Sep 17 21:19:10.489690 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2713/5513] 10.222.0.26 () {60 vars in 1457 bytes} [Sat Sep 17 21:19:10 2022] DELETE /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7/os-volume_attachments/e7b28ecd-7573-4b77-a5cd-36f4afa22ac4 => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:19:10.578625 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c69bec04-7abd-467c-b15c-3a8a0f8960d3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:19:10.579216 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c69bec04-7abd-467c-b15c-3a8a0f8960d3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:10.581719 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:19:10.594455 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c69bec04-7abd-467c-b15c-3a8a0f8960d3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:10.594950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c69bec04-7abd-467c-b15c-3a8a0f8960d3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:10.595394 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c69bec04-7abd-467c-b15c-3a8a0f8960d3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:10.596138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c69bec04-7abd-467c-b15c-3a8a0f8960d3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:10.596588 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c69bec04-7abd-467c-b15c-3a8a0f8960d3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:10.597411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c69bec04-7abd-467c-b15c-3a8a0f8960d3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:10.631910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c69bec04-7abd-467c-b15c-3a8a0f8960d3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=140524) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 17 21:19:10.748961 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c69bec04-7abd-467c-b15c-3a8a0f8960d3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "POST /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7/action" status: 202 len: 0 microversion: 2.20 time: 0.174325 Sep 17 21:19:10.752542 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2801/5514] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Sep 17 21:19:10 2022] POST /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:19:10.770589 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ffa00dc5-f21f-4c49-aedc-3b490bf71a17 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:10.771179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ffa00dc5-f21f-4c49-aedc-3b490bf71a17 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:10.782476 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ffa00dc5-f21f-4c49-aedc-3b490bf71a17 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:10.786483 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ffa00dc5-f21f-4c49-aedc-3b490bf71a17 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:10.787134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ffa00dc5-f21f-4c49-aedc-3b490bf71a17 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:10.789814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ffa00dc5-f21f-4c49-aedc-3b490bf71a17 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:10.790875 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ffa00dc5-f21f-4c49-aedc-3b490bf71a17 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:10.792223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ffa00dc5-f21f-4c49-aedc-3b490bf71a17 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:11.054712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ffa00dc5-f21f-4c49-aedc-3b490bf71a17 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:11.065815 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ffa00dc5-f21f-4c49-aedc-3b490bf71a17 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:11.068214 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ffa00dc5-f21f-4c49-aedc-3b490bf71a17 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:11.069982 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ffa00dc5-f21f-4c49-aedc-3b490bf71a17 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1671 microversion: 2.20 time: 0.312738 Sep 17 21:19:11.073415 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2714/5515] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:19:10 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1671 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:19:11.373520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-522a046b-15ca-457f-9231-24db096fbe53 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:11.378764 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-522a046b-15ca-457f-9231-24db096fbe53 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:11.391650 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-522a046b-15ca-457f-9231-24db096fbe53 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:11.392079 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-522a046b-15ca-457f-9231-24db096fbe53 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:11.392625 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-522a046b-15ca-457f-9231-24db096fbe53 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:11.393425 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-522a046b-15ca-457f-9231-24db096fbe53 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:11.394066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-522a046b-15ca-457f-9231-24db096fbe53 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:11.394592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-522a046b-15ca-457f-9231-24db096fbe53 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:11.511265 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-522a046b-15ca-457f-9231-24db096fbe53 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:11.527059 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-522a046b-15ca-457f-9231-24db096fbe53 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61" status: 200 len: 1289 microversion: 2.1 time: 0.158520 Sep 17 21:19:11.530893 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2802/5516] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:11 2022] GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 => generated 1289 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:19:12.096901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ec75b093-d6ec-4b1a-92a3-1f4e37332dbb tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:12.097608 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ec75b093-d6ec-4b1a-92a3-1f4e37332dbb tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:12.106221 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec75b093-d6ec-4b1a-92a3-1f4e37332dbb tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:12.106785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec75b093-d6ec-4b1a-92a3-1f4e37332dbb tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:12.107302 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec75b093-d6ec-4b1a-92a3-1f4e37332dbb tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:12.108103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec75b093-d6ec-4b1a-92a3-1f4e37332dbb tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:12.108621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec75b093-d6ec-4b1a-92a3-1f4e37332dbb tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:12.109133 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec75b093-d6ec-4b1a-92a3-1f4e37332dbb tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:12.272225 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ec75b093-d6ec-4b1a-92a3-1f4e37332dbb tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:12.296953 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ec75b093-d6ec-4b1a-92a3-1f4e37332dbb tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:12.300986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ec75b093-d6ec-4b1a-92a3-1f4e37332dbb tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:12.303178 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ec75b093-d6ec-4b1a-92a3-1f4e37332dbb tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1729 microversion: 2.20 time: 0.210347 Sep 17 21:19:12.311533 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2715/5517] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:19:12 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1729 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:19:12.553896 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-94d90d92-2b0e-4201-a4db-b0bb155a90af tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:12.555228 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-94d90d92-2b0e-4201-a4db-b0bb155a90af tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:12.562536 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94d90d92-2b0e-4201-a4db-b0bb155a90af tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:12.563391 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94d90d92-2b0e-4201-a4db-b0bb155a90af tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:12.563882 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94d90d92-2b0e-4201-a4db-b0bb155a90af tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:12.564674 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94d90d92-2b0e-4201-a4db-b0bb155a90af tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:12.565441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94d90d92-2b0e-4201-a4db-b0bb155a90af tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:12.566086 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94d90d92-2b0e-4201-a4db-b0bb155a90af tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:12.884740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-94d90d92-2b0e-4201-a4db-b0bb155a90af tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:12.902619 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-94d90d92-2b0e-4201-a4db-b0bb155a90af tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61" status: 200 len: 1362 microversion: 2.1 time: 0.349766 Sep 17 21:19:12.903854 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2803/5518] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:12 2022] GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 => generated 1362 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:19:13.331556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-46205513-fad1-49e2-ae01-d13c8502abd8 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:13.332185 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-46205513-fad1-49e2-ae01-d13c8502abd8 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:13.339421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46205513-fad1-49e2-ae01-d13c8502abd8 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:13.340184 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46205513-fad1-49e2-ae01-d13c8502abd8 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:13.340739 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46205513-fad1-49e2-ae01-d13c8502abd8 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:13.341558 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46205513-fad1-49e2-ae01-d13c8502abd8 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:13.342246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46205513-fad1-49e2-ae01-d13c8502abd8 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:13.343038 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46205513-fad1-49e2-ae01-d13c8502abd8 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:13.542645 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-46205513-fad1-49e2-ae01-d13c8502abd8 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:13.554259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-46205513-fad1-49e2-ae01-d13c8502abd8 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:13.560902 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-46205513-fad1-49e2-ae01-d13c8502abd8 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:13.562564 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-46205513-fad1-49e2-ae01-d13c8502abd8 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1729 microversion: 2.20 time: 0.235011 Sep 17 21:19:13.567825 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2716/5519] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:19:13 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1729 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:19:13.763686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-6fd3117e-48ac-4817-90b6-ea06f06acc0e req-780bab65-4dbf-4359-a1a5-9de3f5c20936 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff94fcaa-27d3-4f58-9a5e-0a541c19ad61", "tag": "1dacec68-f949-4dcc-93b9-cb5f545bef6d"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:19:13.798578 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6fd3117e-48ac-4817-90b6-ea06f06acc0e req-780bab65-4dbf-4359-a1a5-9de3f5c20936 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:13.799095 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6fd3117e-48ac-4817-90b6-ea06f06acc0e req-780bab65-4dbf-4359-a1a5-9de3f5c20936 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:13.804785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6fd3117e-48ac-4817-90b6-ea06f06acc0e req-780bab65-4dbf-4359-a1a5-9de3f5c20936 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:13.816495 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-6fd3117e-48ac-4817-90b6-ea06f06acc0e req-780bab65-4dbf-4359-a1a5-9de3f5c20936 service nova] Creating event network-changed:1dacec68-f949-4dcc-93b9-cb5f545bef6d for instance ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 on nch2-master-1 Sep 17 21:19:13.839229 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-6fd3117e-48ac-4817-90b6-ea06f06acc0e req-780bab65-4dbf-4359-a1a5-9de3f5c20936 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082086 Sep 17 21:19:13.844020 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2804/5520] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:19:13.939614 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-55a14765-a5f1-4d0b-a098-7fa5c65d4da2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:13.940243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-55a14765-a5f1-4d0b-a098-7fa5c65d4da2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:13.949415 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55a14765-a5f1-4d0b-a098-7fa5c65d4da2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:13.950390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55a14765-a5f1-4d0b-a098-7fa5c65d4da2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:13.950390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55a14765-a5f1-4d0b-a098-7fa5c65d4da2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:13.951093 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55a14765-a5f1-4d0b-a098-7fa5c65d4da2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:13.951552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55a14765-a5f1-4d0b-a098-7fa5c65d4da2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:13.952024 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55a14765-a5f1-4d0b-a098-7fa5c65d4da2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:14.140093 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-55a14765-a5f1-4d0b-a098-7fa5c65d4da2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:14.149856 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-55a14765-a5f1-4d0b-a098-7fa5c65d4da2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61" status: 200 len: 1362 microversion: 2.1 time: 0.215074 Sep 17 21:19:14.151563 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2717/5521] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:13 2022] GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:19:14.606006 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-48a906a7-1b94-4c3c-89b5-50e23eb02f0a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:14.606712 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-48a906a7-1b94-4c3c-89b5-50e23eb02f0a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:14.613360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-48a906a7-1b94-4c3c-89b5-50e23eb02f0a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:14.613784 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-48a906a7-1b94-4c3c-89b5-50e23eb02f0a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:14.614219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-48a906a7-1b94-4c3c-89b5-50e23eb02f0a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:14.614905 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-48a906a7-1b94-4c3c-89b5-50e23eb02f0a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:14.615538 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-48a906a7-1b94-4c3c-89b5-50e23eb02f0a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:14.615996 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-48a906a7-1b94-4c3c-89b5-50e23eb02f0a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:14.773255 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-48a906a7-1b94-4c3c-89b5-50e23eb02f0a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:14.784553 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-48a906a7-1b94-4c3c-89b5-50e23eb02f0a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:14.786128 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-48a906a7-1b94-4c3c-89b5-50e23eb02f0a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:14.787973 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-48a906a7-1b94-4c3c-89b5-50e23eb02f0a tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1729 microversion: 2.20 time: 0.186909 Sep 17 21:19:14.788601 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2805/5522] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:19:14 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:19:15.176139 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4b106f8c-e20f-4be0-a927-5edda7887dc6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:15.176764 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4b106f8c-e20f-4be0-a927-5edda7887dc6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:15.185738 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b106f8c-e20f-4be0-a927-5edda7887dc6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:15.186429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b106f8c-e20f-4be0-a927-5edda7887dc6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:15.186872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b106f8c-e20f-4be0-a927-5edda7887dc6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:15.187772 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b106f8c-e20f-4be0-a927-5edda7887dc6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:15.188234 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b106f8c-e20f-4be0-a927-5edda7887dc6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:15.188858 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b106f8c-e20f-4be0-a927-5edda7887dc6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:15.450390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4b106f8c-e20f-4be0-a927-5edda7887dc6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:15.470799 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4b106f8c-e20f-4be0-a927-5edda7887dc6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61" status: 200 len: 1362 microversion: 2.1 time: 0.300507 Sep 17 21:19:15.475575 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2718/5523] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:15 2022] GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 => generated 1362 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:19:15.816930 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a33594cc-f061-4794-94f7-74df7b078bf0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:15.818305 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a33594cc-f061-4794-94f7-74df7b078bf0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:15.840047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a33594cc-f061-4794-94f7-74df7b078bf0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:15.844185 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a33594cc-f061-4794-94f7-74df7b078bf0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:15.845080 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a33594cc-f061-4794-94f7-74df7b078bf0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:15.846060 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a33594cc-f061-4794-94f7-74df7b078bf0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:15.850138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a33594cc-f061-4794-94f7-74df7b078bf0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:15.850931 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a33594cc-f061-4794-94f7-74df7b078bf0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:16.117156 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a33594cc-f061-4794-94f7-74df7b078bf0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:16.142304 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a33594cc-f061-4794-94f7-74df7b078bf0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:16.148064 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a33594cc-f061-4794-94f7-74df7b078bf0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:16.149819 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a33594cc-f061-4794-94f7-74df7b078bf0 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1729 microversion: 2.20 time: 0.338469 Sep 17 21:19:16.157087 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2806/5524] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:19:15 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1729 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:19:16.496576 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0db332de-084c-4a60-b8d1-3297def4dc63 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:16.497775 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0db332de-084c-4a60-b8d1-3297def4dc63 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:16.510027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0db332de-084c-4a60-b8d1-3297def4dc63 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:16.511736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0db332de-084c-4a60-b8d1-3297def4dc63 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:16.513969 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0db332de-084c-4a60-b8d1-3297def4dc63 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:16.517373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0db332de-084c-4a60-b8d1-3297def4dc63 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:16.518155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0db332de-084c-4a60-b8d1-3297def4dc63 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:16.518905 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0db332de-084c-4a60-b8d1-3297def4dc63 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:16.754311 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0db332de-084c-4a60-b8d1-3297def4dc63 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:16.768780 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0db332de-084c-4a60-b8d1-3297def4dc63 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61" status: 200 len: 1362 microversion: 2.1 time: 0.277972 Sep 17 21:19:16.772861 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2719/5525] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:16 2022] GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 => generated 1362 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:19:17.185386 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4a544fd6-593e-4259-882c-5ea41bebb5a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:17.186110 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4a544fd6-593e-4259-882c-5ea41bebb5a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:17.195707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a544fd6-593e-4259-882c-5ea41bebb5a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:17.196520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a544fd6-593e-4259-882c-5ea41bebb5a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:17.197190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a544fd6-593e-4259-882c-5ea41bebb5a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:17.198313 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a544fd6-593e-4259-882c-5ea41bebb5a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:17.198932 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a544fd6-593e-4259-882c-5ea41bebb5a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:17.199575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a544fd6-593e-4259-882c-5ea41bebb5a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:17.593744 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4a544fd6-593e-4259-882c-5ea41bebb5a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:17.604776 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4a544fd6-593e-4259-882c-5ea41bebb5a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:17.607317 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4a544fd6-593e-4259-882c-5ea41bebb5a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:17.608717 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4a544fd6-593e-4259-882c-5ea41bebb5a3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1729 microversion: 2.20 time: 0.429322 Sep 17 21:19:17.609831 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2807/5526] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:19:17 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1729 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:19:17.796703 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3da201ee-fa7b-4901-a2e4-a9f28282d1cf tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:17.798194 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3da201ee-fa7b-4901-a2e4-a9f28282d1cf tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:17.820981 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3da201ee-fa7b-4901-a2e4-a9f28282d1cf tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:17.822963 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3da201ee-fa7b-4901-a2e4-a9f28282d1cf tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:17.823915 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3da201ee-fa7b-4901-a2e4-a9f28282d1cf tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:17.824867 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3da201ee-fa7b-4901-a2e4-a9f28282d1cf tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:17.825680 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3da201ee-fa7b-4901-a2e4-a9f28282d1cf tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:17.826362 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3da201ee-fa7b-4901-a2e4-a9f28282d1cf tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:17.922326 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:19:18.184452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3da201ee-fa7b-4901-a2e4-a9f28282d1cf tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:18.198491 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3da201ee-fa7b-4901-a2e4-a9f28282d1cf tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61" status: 200 len: 1362 microversion: 2.1 time: 0.402220 Sep 17 21:19:18.199190 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2720/5527] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:17 2022] GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 => generated 1362 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:19:18.459968 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-192aefc3-e1f8-4f13-9f87-4a967c85cc79 req-915ef609-e6de-4a5c-bdc7-518363e9ebde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff94fcaa-27d3-4f58-9a5e-0a541c19ad61", "name": "network-vif-plugged", "status": "completed", "tag": "1dacec68-f949-4dcc-93b9-cb5f545bef6d"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:19:18.485056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-192aefc3-e1f8-4f13-9f87-4a967c85cc79 req-915ef609-e6de-4a5c-bdc7-518363e9ebde service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:18.487277 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-192aefc3-e1f8-4f13-9f87-4a967c85cc79 req-915ef609-e6de-4a5c-bdc7-518363e9ebde service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:18.492913 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-192aefc3-e1f8-4f13-9f87-4a967c85cc79 req-915ef609-e6de-4a5c-bdc7-518363e9ebde service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:18.528872 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-192aefc3-e1f8-4f13-9f87-4a967c85cc79 req-915ef609-e6de-4a5c-bdc7-518363e9ebde service nova] Creating event network-vif-plugged:1dacec68-f949-4dcc-93b9-cb5f545bef6d for instance ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 on nch2-master-1 Sep 17 21:19:18.545002 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-192aefc3-e1f8-4f13-9f87-4a967c85cc79 req-915ef609-e6de-4a5c-bdc7-518363e9ebde service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089153 Sep 17 21:19:18.549452 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2808/5528] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:19:18.638380 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d1e6b685-e2cc-4081-b78a-84ee67f6cab7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:18.639234 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d1e6b685-e2cc-4081-b78a-84ee67f6cab7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:18.663018 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1e6b685-e2cc-4081-b78a-84ee67f6cab7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:18.663614 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1e6b685-e2cc-4081-b78a-84ee67f6cab7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:18.666943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1e6b685-e2cc-4081-b78a-84ee67f6cab7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:18.670513 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1e6b685-e2cc-4081-b78a-84ee67f6cab7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:18.672733 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1e6b685-e2cc-4081-b78a-84ee67f6cab7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:18.675058 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1e6b685-e2cc-4081-b78a-84ee67f6cab7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:19.004207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d1e6b685-e2cc-4081-b78a-84ee67f6cab7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:19.019104 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d1e6b685-e2cc-4081-b78a-84ee67f6cab7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:19.024192 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d1e6b685-e2cc-4081-b78a-84ee67f6cab7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:19.027352 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d1e6b685-e2cc-4081-b78a-84ee67f6cab7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1729 microversion: 2.20 time: 0.394057 Sep 17 21:19:19.030348 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2721/5529] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:19:18 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1729 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:19:19.225444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fca9d74e-c9f4-4def-9c12-55d6f7d2b3ca tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:19.226357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fca9d74e-c9f4-4def-9c12-55d6f7d2b3ca tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:19.252732 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fca9d74e-c9f4-4def-9c12-55d6f7d2b3ca tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:19.253262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fca9d74e-c9f4-4def-9c12-55d6f7d2b3ca tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:19.253774 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fca9d74e-c9f4-4def-9c12-55d6f7d2b3ca tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:19.254625 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fca9d74e-c9f4-4def-9c12-55d6f7d2b3ca tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:19.255096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fca9d74e-c9f4-4def-9c12-55d6f7d2b3ca tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:19.255698 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fca9d74e-c9f4-4def-9c12-55d6f7d2b3ca tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:19.543977 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fca9d74e-c9f4-4def-9c12-55d6f7d2b3ca tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:19.561825 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fca9d74e-c9f4-4def-9c12-55d6f7d2b3ca tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61" status: 200 len: 1362 microversion: 2.1 time: 0.343617 Sep 17 21:19:19.563488 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2809/5530] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:19 2022] GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 => generated 1362 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:19:20.063109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c46aaeda-821c-4e7f-ae6a-9f731c73d2da tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:20.065234 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c46aaeda-821c-4e7f-ae6a-9f731c73d2da tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:20.070263 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:19:20.072564 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:19:20.074090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:19:20.087926 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c46aaeda-821c-4e7f-ae6a-9f731c73d2da tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:20.088787 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c46aaeda-821c-4e7f-ae6a-9f731c73d2da tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:20.089639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c46aaeda-821c-4e7f-ae6a-9f731c73d2da tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:20.090850 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c46aaeda-821c-4e7f-ae6a-9f731c73d2da tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:20.091681 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c46aaeda-821c-4e7f-ae6a-9f731c73d2da tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:20.092425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c46aaeda-821c-4e7f-ae6a-9f731c73d2da tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:20.408366 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c46aaeda-821c-4e7f-ae6a-9f731c73d2da tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:20.418630 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c46aaeda-821c-4e7f-ae6a-9f731c73d2da tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:20.435201 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c46aaeda-821c-4e7f-ae6a-9f731c73d2da tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:20.436443 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c46aaeda-821c-4e7f-ae6a-9f731c73d2da tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1729 microversion: 2.20 time: 0.379993 Sep 17 21:19:20.437050 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2722/5531] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:19:20 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1729 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:19:20.589643 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a33d6960-aab2-41d2-b884-08773491a9b5 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:20.591332 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a33d6960-aab2-41d2-b884-08773491a9b5 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:20.597483 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=6 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:19:20.615327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a33d6960-aab2-41d2-b884-08773491a9b5 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:20.617117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a33d6960-aab2-41d2-b884-08773491a9b5 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:20.617700 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a33d6960-aab2-41d2-b884-08773491a9b5 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:20.618496 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a33d6960-aab2-41d2-b884-08773491a9b5 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:20.619402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a33d6960-aab2-41d2-b884-08773491a9b5 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:20.619918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a33d6960-aab2-41d2-b884-08773491a9b5 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:20.893194 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a33d6960-aab2-41d2-b884-08773491a9b5 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:20.903502 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a33d6960-aab2-41d2-b884-08773491a9b5 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61" status: 200 len: 1362 microversion: 2.1 time: 0.319827 Sep 17 21:19:20.904666 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2810/5532] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:20 2022] GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 => generated 1362 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:19:21.470740 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3876af75-9653-4a4f-8e80-2f88fa98794b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:21.471736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3876af75-9653-4a4f-8e80-2f88fa98794b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:21.513593 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3876af75-9653-4a4f-8e80-2f88fa98794b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:21.515364 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3876af75-9653-4a4f-8e80-2f88fa98794b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:21.516280 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3876af75-9653-4a4f-8e80-2f88fa98794b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:21.517187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3876af75-9653-4a4f-8e80-2f88fa98794b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:21.517739 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3876af75-9653-4a4f-8e80-2f88fa98794b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:21.518192 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3876af75-9653-4a4f-8e80-2f88fa98794b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:21.701383 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3876af75-9653-4a4f-8e80-2f88fa98794b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:21.711985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3876af75-9653-4a4f-8e80-2f88fa98794b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:21.713839 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3876af75-9653-4a4f-8e80-2f88fa98794b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:21.715307 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3876af75-9653-4a4f-8e80-2f88fa98794b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1729 microversion: 2.20 time: 0.250216 Sep 17 21:19:21.716069 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2723/5533] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:19:21 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1729 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:19:21.931527 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3fde7408-73ce-47a2-af19-fff2f46c7e41 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:21.933045 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3fde7408-73ce-47a2-af19-fff2f46c7e41 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:21.941711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3fde7408-73ce-47a2-af19-fff2f46c7e41 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:21.942583 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3fde7408-73ce-47a2-af19-fff2f46c7e41 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:21.943397 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3fde7408-73ce-47a2-af19-fff2f46c7e41 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:21.944583 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3fde7408-73ce-47a2-af19-fff2f46c7e41 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:21.945265 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3fde7408-73ce-47a2-af19-fff2f46c7e41 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:21.945992 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3fde7408-73ce-47a2-af19-fff2f46c7e41 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:22.183077 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3fde7408-73ce-47a2-af19-fff2f46c7e41 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:22.194297 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3fde7408-73ce-47a2-af19-fff2f46c7e41 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61" status: 200 len: 1362 microversion: 2.1 time: 0.266847 Sep 17 21:19:22.195462 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2811/5534] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:21 2022] GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 => generated 1362 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:19:22.744589 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-32569203-e88d-4694-bc58-b4bdb51aff44 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:22.745329 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-32569203-e88d-4694-bc58-b4bdb51aff44 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:22.753765 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32569203-e88d-4694-bc58-b4bdb51aff44 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:22.755095 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32569203-e88d-4694-bc58-b4bdb51aff44 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:22.756796 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32569203-e88d-4694-bc58-b4bdb51aff44 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:22.757810 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32569203-e88d-4694-bc58-b4bdb51aff44 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:22.758563 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32569203-e88d-4694-bc58-b4bdb51aff44 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:22.759193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32569203-e88d-4694-bc58-b4bdb51aff44 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:22.974372 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-32569203-e88d-4694-bc58-b4bdb51aff44 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:22.989388 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-32569203-e88d-4694-bc58-b4bdb51aff44 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:22.991835 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-32569203-e88d-4694-bc58-b4bdb51aff44 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:22.994697 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-32569203-e88d-4694-bc58-b4bdb51aff44 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1729 microversion: 2.20 time: 0.256132 Sep 17 21:19:22.996277 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2724/5535] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:19:22 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1729 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:19:23.218184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cce38e01-d963-49ee-be59-79d6701f4285 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:23.218806 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cce38e01-d963-49ee-be59-79d6701f4285 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:23.229405 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cce38e01-d963-49ee-be59-79d6701f4285 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:23.230232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cce38e01-d963-49ee-be59-79d6701f4285 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:23.230681 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cce38e01-d963-49ee-be59-79d6701f4285 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:23.248806 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cce38e01-d963-49ee-be59-79d6701f4285 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:23.249152 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cce38e01-d963-49ee-be59-79d6701f4285 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:23.249638 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cce38e01-d963-49ee-be59-79d6701f4285 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:23.484848 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cce38e01-d963-49ee-be59-79d6701f4285 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:23.495443 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cce38e01-d963-49ee-be59-79d6701f4285 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61" status: 200 len: 1362 microversion: 2.1 time: 0.281313 Sep 17 21:19:23.496015 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2812/5536] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:23 2022] GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 => generated 1362 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:19:24.026891 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fb3e2871-91f5-4722-a713-fbd0d4d4bc7c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:24.027546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fb3e2871-91f5-4722-a713-fbd0d4d4bc7c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:24.034576 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb3e2871-91f5-4722-a713-fbd0d4d4bc7c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:24.035060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb3e2871-91f5-4722-a713-fbd0d4d4bc7c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:24.035499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb3e2871-91f5-4722-a713-fbd0d4d4bc7c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:24.036408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb3e2871-91f5-4722-a713-fbd0d4d4bc7c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:24.036942 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb3e2871-91f5-4722-a713-fbd0d4d4bc7c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:24.037615 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fb3e2871-91f5-4722-a713-fbd0d4d4bc7c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:24.184451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fb3e2871-91f5-4722-a713-fbd0d4d4bc7c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:24.195975 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fb3e2871-91f5-4722-a713-fbd0d4d4bc7c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:24.197438 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fb3e2871-91f5-4722-a713-fbd0d4d4bc7c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:24.198881 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fb3e2871-91f5-4722-a713-fbd0d4d4bc7c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1729 microversion: 2.20 time: 0.177129 Sep 17 21:19:24.201509 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2725/5537] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:19:24 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:19:24.519221 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6e41d666-b1b1-4d1f-a572-f8199c73d628 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:24.519768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6e41d666-b1b1-4d1f-a572-f8199c73d628 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:24.527565 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6e41d666-b1b1-4d1f-a572-f8199c73d628 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:24.528069 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6e41d666-b1b1-4d1f-a572-f8199c73d628 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:24.528510 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6e41d666-b1b1-4d1f-a572-f8199c73d628 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:24.529228 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6e41d666-b1b1-4d1f-a572-f8199c73d628 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:24.529712 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6e41d666-b1b1-4d1f-a572-f8199c73d628 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:24.530146 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6e41d666-b1b1-4d1f-a572-f8199c73d628 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:24.550180 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:19:25.037227 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6e41d666-b1b1-4d1f-a572-f8199c73d628 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:25.046185 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6e41d666-b1b1-4d1f-a572-f8199c73d628 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61" status: 200 len: 1362 microversion: 2.1 time: 0.530569 Sep 17 21:19:25.053942 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2813/5538] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:24 2022] GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 => generated 1362 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:19:25.225401 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-96546aa8-a4c9-4676-82be-79982698d93c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:25.226897 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-96546aa8-a4c9-4676-82be-79982698d93c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:25.234761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-96546aa8-a4c9-4676-82be-79982698d93c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:25.235491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-96546aa8-a4c9-4676-82be-79982698d93c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:25.236326 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-96546aa8-a4c9-4676-82be-79982698d93c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:25.237751 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-96546aa8-a4c9-4676-82be-79982698d93c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:25.238433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-96546aa8-a4c9-4676-82be-79982698d93c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:25.239208 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-96546aa8-a4c9-4676-82be-79982698d93c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:25.412218 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-96546aa8-a4c9-4676-82be-79982698d93c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:25.420593 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-96546aa8-a4c9-4676-82be-79982698d93c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:25.422075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-96546aa8-a4c9-4676-82be-79982698d93c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:25.423306 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-96546aa8-a4c9-4676-82be-79982698d93c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1729 microversion: 2.20 time: 0.202973 Sep 17 21:19:25.423899 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2726/5539] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:19:25 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1729 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:19:26.075466 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-97d7df03-37bc-498d-b52b-8365ae9a238e tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:26.077035 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-97d7df03-37bc-498d-b52b-8365ae9a238e tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:26.085438 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97d7df03-37bc-498d-b52b-8365ae9a238e tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:26.086194 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97d7df03-37bc-498d-b52b-8365ae9a238e tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:26.086938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97d7df03-37bc-498d-b52b-8365ae9a238e tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:26.087824 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97d7df03-37bc-498d-b52b-8365ae9a238e tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:26.088525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97d7df03-37bc-498d-b52b-8365ae9a238e tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:26.089168 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97d7df03-37bc-498d-b52b-8365ae9a238e tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:26.279407 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-97d7df03-37bc-498d-b52b-8365ae9a238e tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:26.287343 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-97d7df03-37bc-498d-b52b-8365ae9a238e tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61" status: 200 len: 1547 microversion: 2.1 time: 0.216501 Sep 17 21:19:26.301888 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2814/5540] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:19:26 2022] GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 => generated 1547 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:19:26.310565 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-74c045f3-d3c6-4147-a958-44307a4e69c6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:26.311617 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-74c045f3-d3c6-4147-a958-44307a4e69c6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:26.319551 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74c045f3-d3c6-4147-a958-44307a4e69c6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:26.320443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74c045f3-d3c6-4147-a958-44307a4e69c6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:26.322307 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74c045f3-d3c6-4147-a958-44307a4e69c6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:26.323231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74c045f3-d3c6-4147-a958-44307a4e69c6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:26.323846 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74c045f3-d3c6-4147-a958-44307a4e69c6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:26.324437 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74c045f3-d3c6-4147-a958-44307a4e69c6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:26.449652 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a14ca3f6-de89-4d73-b24a-ad29fe795fe2 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:26.450250 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a14ca3f6-de89-4d73-b24a-ad29fe795fe2 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:26.459236 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a14ca3f6-de89-4d73-b24a-ad29fe795fe2 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:26.459782 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a14ca3f6-de89-4d73-b24a-ad29fe795fe2 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:26.460212 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a14ca3f6-de89-4d73-b24a-ad29fe795fe2 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:26.460931 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a14ca3f6-de89-4d73-b24a-ad29fe795fe2 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:26.461381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a14ca3f6-de89-4d73-b24a-ad29fe795fe2 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:26.461956 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a14ca3f6-de89-4d73-b24a-ad29fe795fe2 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:26.467689 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-74c045f3-d3c6-4147-a958-44307a4e69c6 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.161037 Sep 17 21:19:26.468296 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2727/5541] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Sep 17 21:19:26 2022] GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61/os-interface => generated 284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:19:26.711489 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a14ca3f6-de89-4d73-b24a-ad29fe795fe2 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:26.722296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a14ca3f6-de89-4d73-b24a-ad29fe795fe2 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:26.724309 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a14ca3f6-de89-4d73-b24a-ad29fe795fe2 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:26.726943 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a14ca3f6-de89-4d73-b24a-ad29fe795fe2 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1729 microversion: 2.20 time: 0.280188 Sep 17 21:19:26.728646 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2815/5542] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:19:26 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1729 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 17 21:19:27.758233 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2eb1ed22-e8c8-4c37-925f-46a83a785fac tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:27.759780 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2eb1ed22-e8c8-4c37-925f-46a83a785fac tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:27.768446 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2eb1ed22-e8c8-4c37-925f-46a83a785fac tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:27.769119 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2eb1ed22-e8c8-4c37-925f-46a83a785fac tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:27.769929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2eb1ed22-e8c8-4c37-925f-46a83a785fac tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:27.770848 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2eb1ed22-e8c8-4c37-925f-46a83a785fac tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:27.771322 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2eb1ed22-e8c8-4c37-925f-46a83a785fac tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:27.771830 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2eb1ed22-e8c8-4c37-925f-46a83a785fac tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:27.946210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2eb1ed22-e8c8-4c37-925f-46a83a785fac tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:27.956089 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2eb1ed22-e8c8-4c37-925f-46a83a785fac tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:27.962110 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2eb1ed22-e8c8-4c37-925f-46a83a785fac tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:27.963593 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2eb1ed22-e8c8-4c37-925f-46a83a785fac tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1729 microversion: 2.20 time: 0.211034 Sep 17 21:19:27.974364 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2728/5543] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:19:27 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1729 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:19:28.171687 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-7f792067-a82d-4255-b924-5e11ff397604 req-e9aef064-ff0f-42db-8d90-17fab629e42f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff94fcaa-27d3-4f58-9a5e-0a541c19ad61", "tag": "1dacec68-f949-4dcc-93b9-cb5f545bef6d"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:19:28.183638 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7f792067-a82d-4255-b924-5e11ff397604 req-e9aef064-ff0f-42db-8d90-17fab629e42f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:28.184280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7f792067-a82d-4255-b924-5e11ff397604 req-e9aef064-ff0f-42db-8d90-17fab629e42f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:28.184546 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7f792067-a82d-4255-b924-5e11ff397604 req-e9aef064-ff0f-42db-8d90-17fab629e42f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:28.198922 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-7f792067-a82d-4255-b924-5e11ff397604 req-e9aef064-ff0f-42db-8d90-17fab629e42f service nova] Creating event network-changed:1dacec68-f949-4dcc-93b9-cb5f545bef6d for instance ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 on nch2-master-1 Sep 17 21:19:28.204831 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-7f792067-a82d-4255-b924-5e11ff397604 req-e9aef064-ff0f-42db-8d90-17fab629e42f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037698 Sep 17 21:19:28.205691 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2816/5544] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:19:28.573597 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-9017c225-0f05-4276-acad-921c9da2016b req-1c244dd7-d028-4d80-9f99-187484cb80d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0beab9d3-30c1-4b22-9157-31705ad3dbf7", "name": "network-vif-plugged", "status": "completed", "tag": "a96d5dc1-0855-4012-ae99-7136b223ea2b"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:19:28.590509 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-9017c225-0f05-4276-acad-921c9da2016b req-1c244dd7-d028-4d80-9f99-187484cb80d6 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:28.591658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-9017c225-0f05-4276-acad-921c9da2016b req-1c244dd7-d028-4d80-9f99-187484cb80d6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:28.592512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-9017c225-0f05-4276-acad-921c9da2016b req-1c244dd7-d028-4d80-9f99-187484cb80d6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:28.612451 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-9017c225-0f05-4276-acad-921c9da2016b req-1c244dd7-d028-4d80-9f99-187484cb80d6 service nova] Creating event network-vif-plugged:a96d5dc1-0855-4012-ae99-7136b223ea2b for instance 0beab9d3-30c1-4b22-9157-31705ad3dbf7 on nch2-master-1 Sep 17 21:19:28.619327 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-9017c225-0f05-4276-acad-921c9da2016b req-1c244dd7-d028-4d80-9f99-187484cb80d6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049935 Sep 17 21:19:28.620360 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2729/5545] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:19:28.993304 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-eeaae28c-6587-48ce-bfba-b1b17d21b73d tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:28.995010 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-eeaae28c-6587-48ce-bfba-b1b17d21b73d tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:29.002633 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eeaae28c-6587-48ce-bfba-b1b17d21b73d tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:29.003330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eeaae28c-6587-48ce-bfba-b1b17d21b73d tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:29.004385 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eeaae28c-6587-48ce-bfba-b1b17d21b73d tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:29.005621 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eeaae28c-6587-48ce-bfba-b1b17d21b73d tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:29.006238 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eeaae28c-6587-48ce-bfba-b1b17d21b73d tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:29.006865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eeaae28c-6587-48ce-bfba-b1b17d21b73d tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:29.202876 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-eeaae28c-6587-48ce-bfba-b1b17d21b73d tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:29.214562 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-eeaae28c-6587-48ce-bfba-b1b17d21b73d tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:29.217738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-eeaae28c-6587-48ce-bfba-b1b17d21b73d tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:29.219287 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-eeaae28c-6587-48ce-bfba-b1b17d21b73d tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1729 microversion: 2.20 time: 0.231771 Sep 17 21:19:29.220084 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2817/5546] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:19:28 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1729 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:19:30.248347 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-eda0a162-676d-4e02-a255-f4156a1cae17 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:30.249199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-eda0a162-676d-4e02-a255-f4156a1cae17 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:30.260319 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eda0a162-676d-4e02-a255-f4156a1cae17 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:30.264419 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eda0a162-676d-4e02-a255-f4156a1cae17 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:30.265088 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eda0a162-676d-4e02-a255-f4156a1cae17 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:30.268600 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eda0a162-676d-4e02-a255-f4156a1cae17 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:30.269183 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eda0a162-676d-4e02-a255-f4156a1cae17 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:30.269778 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eda0a162-676d-4e02-a255-f4156a1cae17 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:30.496272 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-eda0a162-676d-4e02-a255-f4156a1cae17 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:30.507156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-eda0a162-676d-4e02-a255-f4156a1cae17 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:30.508840 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-eda0a162-676d-4e02-a255-f4156a1cae17 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:30.510100 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-eda0a162-676d-4e02-a255-f4156a1cae17 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1729 microversion: 2.20 time: 0.266335 Sep 17 21:19:30.512943 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2730/5547] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:19:30 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1729 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:19:31.546423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-aba9780c-5406-4cdb-8c10-6a35a2473ba9 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:19:31.547391 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-aba9780c-5406-4cdb-8c10-6a35a2473ba9 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:19:31.555707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aba9780c-5406-4cdb-8c10-6a35a2473ba9 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:31.556275 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aba9780c-5406-4cdb-8c10-6a35a2473ba9 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:31.556734 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aba9780c-5406-4cdb-8c10-6a35a2473ba9 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:31.557528 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aba9780c-5406-4cdb-8c10-6a35a2473ba9 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:19:31.558162 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aba9780c-5406-4cdb-8c10-6a35a2473ba9 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:19:31.558880 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aba9780c-5406-4cdb-8c10-6a35a2473ba9 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:19:31.720119 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-aba9780c-5406-4cdb-8c10-6a35a2473ba9 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:31.729739 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-aba9780c-5406-4cdb-8c10-6a35a2473ba9 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:31.731224 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-aba9780c-5406-4cdb-8c10-6a35a2473ba9 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:19:31.732419 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-aba9780c-5406-4cdb-8c10-6a35a2473ba9 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1716 microversion: 2.20 time: 0.191974 Sep 17 21:19:31.734026 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2818/5548] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:19:31 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1716 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:20:02.745919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e75a63df-d4df-4596-8e14-833fbd806c59 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:02.746521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e75a63df-d4df-4596-8e14-833fbd806c59 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:02.754421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=17 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:20:02.755203 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=56 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:20:02.771241 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e75a63df-d4df-4596-8e14-833fbd806c59 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:02.771751 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e75a63df-d4df-4596-8e14-833fbd806c59 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:02.772337 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e75a63df-d4df-4596-8e14-833fbd806c59 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:02.773104 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e75a63df-d4df-4596-8e14-833fbd806c59 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:02.773601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e75a63df-d4df-4596-8e14-833fbd806c59 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:02.774031 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e75a63df-d4df-4596-8e14-833fbd806c59 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:02.836152 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e75a63df-d4df-4596-8e14-833fbd806c59 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61/ips" status: 200 len: 145 microversion: 2.1 time: 0.094638 Sep 17 21:20:02.840573 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2731/5549] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Sep 17 21:20:02 2022] GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61/ips => generated 145 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:20:03.114609 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a6bf69c4-53a2-43bd-bb8b-d16a71207713 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Action: 'create', calling method: .version_select at 0x7f25a40db700>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1557770465", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5sJUzsjCbGsB39y8IwOPsJEoBsslzOW3N6qOYxx1H3b+WAhg/kN5GvluJxERPct9sbczVh/m78Eo8YaFck60VELzp9tUk3lHd5fv4SygFwfA6k7AuUgA+ehabEnDM2Yg=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:20:03.129525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:20:03.130940 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=29 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:20:03.150019 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-a6bf69c4-53a2-43bd-bb8b-d16a71207713 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Getting quotas for project 0608df66a18a4fb3855b6cd557ab2998. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:20:03.163008 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-a6bf69c4-53a2-43bd-bb8b-d16a71207713 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Getting quotas for user 2fc6b11f473e4231adf4278688619f24 and project 0608df66a18a4fb3855b6cd557ab2998. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:20:03.222293 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a6bf69c4-53a2-43bd-bb8b-d16a71207713 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.112056 Sep 17 21:20:03.223605 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2819/5550] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:20:03 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:20:04.342982 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1b174f0e-05e2-48c6-b131-cb2c94fed909 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b705eb5-8de6-4864-836d-ce99f20a165c"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:20:04.346126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1b174f0e-05e2-48c6-b131-cb2c94fed909 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:04.353957 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b174f0e-05e2-48c6-b131-cb2c94fed909 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:04.354471 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b174f0e-05e2-48c6-b131-cb2c94fed909 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:04.354927 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b174f0e-05e2-48c6-b131-cb2c94fed909 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:04.355666 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b174f0e-05e2-48c6-b131-cb2c94fed909 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:04.356287 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b174f0e-05e2-48c6-b131-cb2c94fed909 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:04.356731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b174f0e-05e2-48c6-b131-cb2c94fed909 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:04.590829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1e125c97-e228-4e11-831a-376919577e2f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:04.594988 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1e125c97-e228-4e11-831a-376919577e2f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:04.603320 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e125c97-e228-4e11-831a-376919577e2f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:04.604103 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e125c97-e228-4e11-831a-376919577e2f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:04.605829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e125c97-e228-4e11-831a-376919577e2f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:04.606775 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e125c97-e228-4e11-831a-376919577e2f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:04.607524 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e125c97-e228-4e11-831a-376919577e2f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:04.609273 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e125c97-e228-4e11-831a-376919577e2f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:04.665982 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1e125c97-e228-4e11-831a-376919577e2f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.082176 Sep 17 21:20:04.684684 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2820/5551] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Sep 17 21:20:04 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7/os-volume_attachments => generated 25 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:20:04.726514 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-81af656b-ad38-461a-8e28-fc62e211df16 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1555221618", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "05bd5a8b-edd2-4b1d-9809-fdc19779bbc9"}], "key_name": "tempest-TestNetworkBasicOps-1557770465", "security_groups": [{"name": "tempest-secgroup-smoke-1318344093"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:20:04.902476 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1b174f0e-05e2-48c6-b131-cb2c94fed909 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "POST /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.563484 Sep 17 21:20:04.904396 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2732/5552] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 17 21:20:04 2022] POST /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61/os-volume_attachments => generated 194 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:20:04.924340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3d91ff27-94ac-40b3-b00e-8fff736d269c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:04.926487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3d91ff27-94ac-40b3-b00e-8fff736d269c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:04.927936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-81af656b-ad38-461a-8e28-fc62e211df16 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] validate_networks() for [('05bd5a8b-edd2-4b1d-9809-fdc19779bbc9', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:20:04.934721 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3d91ff27-94ac-40b3-b00e-8fff736d269c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:04.935580 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3d91ff27-94ac-40b3-b00e-8fff736d269c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:04.936276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3d91ff27-94ac-40b3-b00e-8fff736d269c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:04.937232 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3d91ff27-94ac-40b3-b00e-8fff736d269c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:04.938495 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3d91ff27-94ac-40b3-b00e-8fff736d269c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:04.939179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3d91ff27-94ac-40b3-b00e-8fff736d269c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:05.020129 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3d91ff27-94ac-40b3-b00e-8fff736d269c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:20:05.162433 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3d91ff27-94ac-40b3-b00e-8fff736d269c tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 204 len: 0 microversion: 2.20 time: 0.256228 Sep 17 21:20:05.163082 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2733/5553] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 17 21:20:04 2022] DELETE /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 21:20:05.187399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d6ee5c9a-b4ad-4c9f-8ed1-c29e70463742 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:05.190359 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d6ee5c9a-b4ad-4c9f-8ed1-c29e70463742 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:05.208121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d6ee5c9a-b4ad-4c9f-8ed1-c29e70463742 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:05.208944 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d6ee5c9a-b4ad-4c9f-8ed1-c29e70463742 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:05.209739 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d6ee5c9a-b4ad-4c9f-8ed1-c29e70463742 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:05.210705 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d6ee5c9a-b4ad-4c9f-8ed1-c29e70463742 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:05.211340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d6ee5c9a-b4ad-4c9f-8ed1-c29e70463742 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:05.212086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d6ee5c9a-b4ad-4c9f-8ed1-c29e70463742 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:05.649073 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d6ee5c9a-b4ad-4c9f-8ed1-c29e70463742 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:20:05.666734 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d6ee5c9a-b4ad-4c9f-8ed1-c29e70463742 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:20:05.678919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d6ee5c9a-b4ad-4c9f-8ed1-c29e70463742 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:20:05.681249 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d6ee5c9a-b4ad-4c9f-8ed1-c29e70463742 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1722 microversion: 2.20 time: 0.513595 Sep 17 21:20:05.682547 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2734/5554] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:20:05 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1722 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:20:05.767332 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-81af656b-ad38-461a-8e28-fc62e211df16 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:20:05.769777 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-81af656b-ad38-461a-8e28-fc62e211df16 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:20:05.770582 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-81af656b-ad38-461a-8e28-fc62e211df16 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:20:05.771222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-81af656b-ad38-461a-8e28-fc62e211df16 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:20:05.771960 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-81af656b-ad38-461a-8e28-fc62e211df16 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:20:05.782999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-81af656b-ad38-461a-8e28-fc62e211df16 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:05.784307 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-81af656b-ad38-461a-8e28-fc62e211df16 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:05.784915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-81af656b-ad38-461a-8e28-fc62e211df16 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:05.785706 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-81af656b-ad38-461a-8e28-fc62e211df16 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:05.786650 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-81af656b-ad38-461a-8e28-fc62e211df16 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:05.787235 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-81af656b-ad38-461a-8e28-fc62e211df16 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:05.807759 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-81af656b-ad38-461a-8e28-fc62e211df16 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Getting quotas for project 0608df66a18a4fb3855b6cd557ab2998. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:20:05.819701 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-81af656b-ad38-461a-8e28-fc62e211df16 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Getting quotas for user 2fc6b11f473e4231adf4278688619f24 and project 0608df66a18a4fb3855b6cd557ab2998. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:20:05.838824 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-81af656b-ad38-461a-8e28-fc62e211df16 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:20:05.841587 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-81af656b-ad38-461a-8e28-fc62e211df16 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: b51655a7-eac5-4574-a0f8-7fe0e6947e06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:20:05.914539 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-81af656b-ad38-461a-8e28-fc62e211df16 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.205156 Sep 17 21:20:05.922408 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2821/5555] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:20:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 1213 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:20:05.927428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fa14e351-f0fe-4202-baab-d90ee120324d tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:05.928248 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fa14e351-f0fe-4202-baab-d90ee120324d tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: b51655a7-eac5-4574-a0f8-7fe0e6947e06] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:06.093755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fa14e351-f0fe-4202-baab-d90ee120324d tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:20:06.101849 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fa14e351-f0fe-4202-baab-d90ee120324d tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/b51655a7-eac5-4574-a0f8-7fe0e6947e06" status: 200 len: 1249 microversion: 2.1 time: 0.178356 Sep 17 21:20:06.117186 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2735/5556] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:20:05 2022] GET /compute/v2.1/servers/b51655a7-eac5-4574-a0f8-7fe0e6947e06 => generated 1249 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:20:06.710394 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-aed152a8-07b8-455c-8f3d-c4aa1989fce3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:06.711031 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-aed152a8-07b8-455c-8f3d-c4aa1989fce3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:06.727800 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aed152a8-07b8-455c-8f3d-c4aa1989fce3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:06.728325 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aed152a8-07b8-455c-8f3d-c4aa1989fce3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:06.728776 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aed152a8-07b8-455c-8f3d-c4aa1989fce3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:06.729540 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aed152a8-07b8-455c-8f3d-c4aa1989fce3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:06.730006 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aed152a8-07b8-455c-8f3d-c4aa1989fce3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:06.730438 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aed152a8-07b8-455c-8f3d-c4aa1989fce3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:07.014400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-aed152a8-07b8-455c-8f3d-c4aa1989fce3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:20:07.023050 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-aed152a8-07b8-455c-8f3d-c4aa1989fce3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:20:07.024808 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-aed152a8-07b8-455c-8f3d-c4aa1989fce3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:20:07.026221 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-aed152a8-07b8-455c-8f3d-c4aa1989fce3 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1722 microversion: 2.20 time: 0.320729 Sep 17 21:20:07.026954 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2822/5557] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:20:06 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1722 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:20:07.131801 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5b410689-917c-4a8a-a00e-1c3d91680375 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:07.136563 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5b410689-917c-4a8a-a00e-1c3d91680375 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: b51655a7-eac5-4574-a0f8-7fe0e6947e06] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:07.158889 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b410689-917c-4a8a-a00e-1c3d91680375 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:07.159410 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b410689-917c-4a8a-a00e-1c3d91680375 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:07.159854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b410689-917c-4a8a-a00e-1c3d91680375 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:07.160588 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b410689-917c-4a8a-a00e-1c3d91680375 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:07.161052 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b410689-917c-4a8a-a00e-1c3d91680375 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:07.161569 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5b410689-917c-4a8a-a00e-1c3d91680375 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:07.231050 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5b410689-917c-4a8a-a00e-1c3d91680375 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:20:07.239694 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5b410689-917c-4a8a-a00e-1c3d91680375 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/b51655a7-eac5-4574-a0f8-7fe0e6947e06" status: 200 len: 1301 microversion: 2.1 time: 0.112262 Sep 17 21:20:07.241439 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2736/5558] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:20:07 2022] GET /compute/v2.1/servers/b51655a7-eac5-4574-a0f8-7fe0e6947e06 => generated 1301 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:20:07.790372 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-89c140a6-d0a2-4ba4-ade4-a19058e1bcb7 req-f7202511-6aa0-404a-af37-e227b6194ba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0beab9d3-30c1-4b22-9157-31705ad3dbf7", "name": "network-vif-deleted", "tag": "a96d5dc1-0855-4012-ae99-7136b223ea2b"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:20:07.807351 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-89c140a6-d0a2-4ba4-ade4-a19058e1bcb7 req-f7202511-6aa0-404a-af37-e227b6194ba1 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:07.807891 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-89c140a6-d0a2-4ba4-ade4-a19058e1bcb7 req-f7202511-6aa0-404a-af37-e227b6194ba1 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:07.811346 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-89c140a6-d0a2-4ba4-ade4-a19058e1bcb7 req-f7202511-6aa0-404a-af37-e227b6194ba1 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:07.832943 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-89c140a6-d0a2-4ba4-ade4-a19058e1bcb7 req-f7202511-6aa0-404a-af37-e227b6194ba1 service nova] Creating event network-vif-deleted:a96d5dc1-0855-4012-ae99-7136b223ea2b for instance 0beab9d3-30c1-4b22-9157-31705ad3dbf7 on nch2-master-1 Sep 17 21:20:07.842424 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-89c140a6-d0a2-4ba4-ade4-a19058e1bcb7 req-f7202511-6aa0-404a-af37-e227b6194ba1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055944 Sep 17 21:20:07.843872 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2823/5559] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:20:08.054127 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-01d254e1-70cc-45c5-af13-414852723a97 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:08.055204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-01d254e1-70cc-45c5-af13-414852723a97 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:08.064331 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01d254e1-70cc-45c5-af13-414852723a97 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:08.066266 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01d254e1-70cc-45c5-af13-414852723a97 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:08.066923 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01d254e1-70cc-45c5-af13-414852723a97 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:08.068434 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01d254e1-70cc-45c5-af13-414852723a97 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:08.069416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01d254e1-70cc-45c5-af13-414852723a97 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:08.071613 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01d254e1-70cc-45c5-af13-414852723a97 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:08.135441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01d254e1-70cc-45c5-af13-414852723a97 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:08.136694 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01d254e1-70cc-45c5-af13-414852723a97 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:08.137406 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01d254e1-70cc-45c5-af13-414852723a97 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:08.138195 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-01d254e1-70cc-45c5-af13-414852723a97 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lazy-loading 'fault' on Instance uuid 0beab9d3-30c1-4b22-9157-31705ad3dbf7 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:20:08.201566 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-01d254e1-70cc-45c5-af13-414852723a97 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:20:08.211504 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-01d254e1-70cc-45c5-af13-414852723a97 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:20:08.213655 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-01d254e1-70cc-45c5-af13-414852723a97 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ddb1d0a7bca457493d7ac9a58a01e64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720881c6f7304aadbf069698c97dc5c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:20:08.215874 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-01d254e1-70cc-45c5-af13-414852723a97 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 200 len: 1371 microversion: 2.20 time: 0.165847 Sep 17 21:20:08.216824 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2737/5560] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:20:08 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 17 21:20:08.266521 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c8b9dbdd-1b88-452e-b01e-4cba5ba88bfb tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:08.267244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c8b9dbdd-1b88-452e-b01e-4cba5ba88bfb tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: b51655a7-eac5-4574-a0f8-7fe0e6947e06] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:08.274859 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8b9dbdd-1b88-452e-b01e-4cba5ba88bfb tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:08.275640 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8b9dbdd-1b88-452e-b01e-4cba5ba88bfb tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:08.276251 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8b9dbdd-1b88-452e-b01e-4cba5ba88bfb tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:08.277133 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8b9dbdd-1b88-452e-b01e-4cba5ba88bfb tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:08.277798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8b9dbdd-1b88-452e-b01e-4cba5ba88bfb tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:08.278387 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8b9dbdd-1b88-452e-b01e-4cba5ba88bfb tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:08.360628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b9db2462-ba71-4ece-95fc-f728935d26c1 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:08.376682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b9db2462-ba71-4ece-95fc-f728935d26c1 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:08.395356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b9db2462-ba71-4ece-95fc-f728935d26c1 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:08.400328 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b9db2462-ba71-4ece-95fc-f728935d26c1 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:08.400987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b9db2462-ba71-4ece-95fc-f728935d26c1 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:08.403656 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b9db2462-ba71-4ece-95fc-f728935d26c1 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:08.405442 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b9db2462-ba71-4ece-95fc-f728935d26c1 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:08.406952 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b9db2462-ba71-4ece-95fc-f728935d26c1 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:08.507022 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b9db2462-ba71-4ece-95fc-f728935d26c1 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150445 Sep 17 21:20:08.513840 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2738/5561] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 17 21:20:08 2022] GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:20:08.528213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-238d5ddb-9de3-4312-9c13-aaf363867564 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:08.528999 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-238d5ddb-9de3-4312-9c13-aaf363867564 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:08.550011 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-238d5ddb-9de3-4312-9c13-aaf363867564 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:08.550894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-238d5ddb-9de3-4312-9c13-aaf363867564 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:08.553025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-238d5ddb-9de3-4312-9c13-aaf363867564 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:08.554654 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-238d5ddb-9de3-4312-9c13-aaf363867564 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:08.556484 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-238d5ddb-9de3-4312-9c13-aaf363867564 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:08.558175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-238d5ddb-9de3-4312-9c13-aaf363867564 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:08.611444 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-238d5ddb-9de3-4312-9c13-aaf363867564 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61/os-volume_attachments/2b705eb5-8de6-4864-836d-ce99f20a165c" status: 200 len: 194 microversion: 2.1 time: 0.092030 Sep 17 21:20:08.613549 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2739/5562] 10.222.0.26 () {58 vars in 1413 bytes} [Sat Sep 17 21:20:08 2022] GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61/os-volume_attachments/2b705eb5-8de6-4864-836d-ce99f20a165c => generated 194 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:20:08.674049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c8b9dbdd-1b88-452e-b01e-4cba5ba88bfb tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:20:08.683945 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c8b9dbdd-1b88-452e-b01e-4cba5ba88bfb tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/b51655a7-eac5-4574-a0f8-7fe0e6947e06" status: 200 len: 1375 microversion: 2.1 time: 0.422991 Sep 17 21:20:08.692035 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2824/5563] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:20:08 2022] GET /compute/v2.1/servers/b51655a7-eac5-4574-a0f8-7fe0e6947e06 => generated 1375 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:20:09.246209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6d5107e7-8a61-47fc-b742-7c8b5d125c03 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:09.247554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6d5107e7-8a61-47fc-b742-7c8b5d125c03 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:09.261117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d5107e7-8a61-47fc-b742-7c8b5d125c03 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:09.263455 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d5107e7-8a61-47fc-b742-7c8b5d125c03 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:09.264038 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d5107e7-8a61-47fc-b742-7c8b5d125c03 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:09.265110 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d5107e7-8a61-47fc-b742-7c8b5d125c03 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:09.265762 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d5107e7-8a61-47fc-b742-7c8b5d125c03 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:09.266113 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d5107e7-8a61-47fc-b742-7c8b5d125c03 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:09.304370 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-6d5107e7-8a61-47fc-b742-7c8b5d125c03 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] HTTP exception thrown: Instance 0beab9d3-30c1-4b22-9157-31705ad3dbf7 could not be found. Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6d5107e7-8a61-47fc-b742-7c8b5d125c03 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Request method failure captured: Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 HTTP/1.1 Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjieZv9wtl_pDnkx2EwyI8BFBMJuM6DanlI2NxzpQY06zGh6UfIKVR_b4LIk8F4ufLQC3s4sfs9iVRkIsH0ZpGH5y_C_q5cAnW526d64gmcygXsBXRN_pku_PKAZrLTdzZBFxnNji7tGl8srPYGMXoLfZ6HVA-aDU0tTvt38LrAtYSs Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: X-Openstack-Nova-Api-Version: 2.20 Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 720881c6f7304aadbf069698c97dc5c5 Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1971975439 Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/720881c6f7304aadbf069698c97dc5c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/720881c6f7304aadbf069698c97dc5c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/720881c6f7304aadbf069698c97dc5c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_720881c6f7304aadbf069698c97dc5c5", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1971975439 Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 720881c6f7304aadbf069698c97dc5c5 Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1971975439 Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-AttachVolumeShelveTestJSON-1971975439-project Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 8ddb1d0a7bca457493d7ac9a58a01e64 Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1971975439-project Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 0beab9d3-30c1-4b22-9157-31705ad3dbf7 could not be found. Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '0beab9d3-30c1-4b22-9157-31705ad3dbf7'} Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0beab9d3-30c1-4b22-9157-31705ad3dbf7 could not be found. Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0beab9d3-30c1-4b22-9157-31705ad3dbf7 could not be found. Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:09.306422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:09.310553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:09.310553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:09.310553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:20:09.310553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:20:09.310553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:20:09.310553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:20:09.310553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0beab9d3-30c1-4b22-9157-31705ad3dbf7 could not be found. Sep 17 21:20:09.310553 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:09.310553 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6d5107e7-8a61-47fc-b742-7c8b5d125c03 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Returning 404 to user: Instance 0beab9d3-30c1-4b22-9157-31705ad3dbf7 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:20:09.310553 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6d5107e7-8a61-47fc-b742-7c8b5d125c03 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 404 len: 111 microversion: 2.20 time: 0.066390 Sep 17 21:20:09.310553 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2740/5564] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:20:09 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:20:09.319448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-265e6963-af57-417e-91e6-242a9f5dbf4f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '.version_select at 0x7f259fceb3a0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:09.358121 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-265e6963-af57-417e-91e6-242a9f5dbf4f tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1619172093" status: 204 len: 0 microversion: 2.20 time: 0.043507 Sep 17 21:20:09.358941 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2825/5565] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Sep 17 21:20:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1619172093 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 17 21:20:09.543317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-f94126bd-e7d6-4c86-95b2-61d99570d819 req-3eebfe33-9d03-482b-bd35-40c3abf5d8ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b51655a7-eac5-4574-a0f8-7fe0e6947e06", "tag": "07c49d2c-b8e9-4258-b933-a4640b94a728"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:20:09.566450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f94126bd-e7d6-4c86-95b2-61d99570d819 req-3eebfe33-9d03-482b-bd35-40c3abf5d8ea service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:09.567093 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f94126bd-e7d6-4c86-95b2-61d99570d819 req-3eebfe33-9d03-482b-bd35-40c3abf5d8ea service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:09.567815 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f94126bd-e7d6-4c86-95b2-61d99570d819 req-3eebfe33-9d03-482b-bd35-40c3abf5d8ea service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:09.584473 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-f94126bd-e7d6-4c86-95b2-61d99570d819 req-3eebfe33-9d03-482b-bd35-40c3abf5d8ea service nova] Creating event network-changed:07c49d2c-b8e9-4258-b933-a4640b94a728 for instance b51655a7-eac5-4574-a0f8-7fe0e6947e06 on nch1-master-1 Sep 17 21:20:09.590870 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-f94126bd-e7d6-4c86-95b2-61d99570d819 req-3eebfe33-9d03-482b-bd35-40c3abf5d8ea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051393 Sep 17 21:20:09.592196 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2741/5566] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:20:09.715725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-beec0b1d-936c-4f5d-afc8-81aadfe221e5 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:09.716500 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-beec0b1d-936c-4f5d-afc8-81aadfe221e5 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: b51655a7-eac5-4574-a0f8-7fe0e6947e06] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:09.725844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-beec0b1d-936c-4f5d-afc8-81aadfe221e5 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:09.732983 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-beec0b1d-936c-4f5d-afc8-81aadfe221e5 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:09.733947 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-beec0b1d-936c-4f5d-afc8-81aadfe221e5 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:09.735064 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-beec0b1d-936c-4f5d-afc8-81aadfe221e5 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:09.735755 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-beec0b1d-936c-4f5d-afc8-81aadfe221e5 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:09.737389 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-beec0b1d-936c-4f5d-afc8-81aadfe221e5 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:10.181546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-066a6211-5b2f-42c1-99b1-fc260c3b14b5 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97fd9efa-2583-43e8-ae8f-bced2696518e"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:20:10.184142 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-066a6211-5b2f-42c1-99b1-fc260c3b14b5 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:10.193352 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-066a6211-5b2f-42c1-99b1-fc260c3b14b5 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:10.193930 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-066a6211-5b2f-42c1-99b1-fc260c3b14b5 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:10.194414 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-066a6211-5b2f-42c1-99b1-fc260c3b14b5 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:10.195164 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-066a6211-5b2f-42c1-99b1-fc260c3b14b5 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:10.195612 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-066a6211-5b2f-42c1-99b1-fc260c3b14b5 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:10.196048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-066a6211-5b2f-42c1-99b1-fc260c3b14b5 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:10.519027 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-beec0b1d-936c-4f5d-afc8-81aadfe221e5 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:20:10.519501 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-066a6211-5b2f-42c1-99b1-fc260c3b14b5 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "POST /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.341411 Sep 17 21:20:10.519911 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2742/5567] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 17 21:20:10 2022] POST /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61/os-volume_attachments => generated 194 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:20:10.552702 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-beec0b1d-936c-4f5d-afc8-81aadfe221e5 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/b51655a7-eac5-4574-a0f8-7fe0e6947e06" status: 200 len: 1375 microversion: 2.1 time: 0.840830 Sep 17 21:20:10.553746 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2826/5568] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:20:09 2022] GET /compute/v2.1/servers/b51655a7-eac5-4574-a0f8-7fe0e6947e06 => generated 1375 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:20:11.579294 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-aafaae38-037c-450e-9b27-cfe972c66327 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:11.580020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-aafaae38-037c-450e-9b27-cfe972c66327 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: b51655a7-eac5-4574-a0f8-7fe0e6947e06] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:11.589356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aafaae38-037c-450e-9b27-cfe972c66327 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:11.589895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aafaae38-037c-450e-9b27-cfe972c66327 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:11.590561 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aafaae38-037c-450e-9b27-cfe972c66327 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:11.591843 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aafaae38-037c-450e-9b27-cfe972c66327 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:11.593119 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aafaae38-037c-450e-9b27-cfe972c66327 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:11.593929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aafaae38-037c-450e-9b27-cfe972c66327 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:11.859853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-aafaae38-037c-450e-9b27-cfe972c66327 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:20:11.869648 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-aafaae38-037c-450e-9b27-cfe972c66327 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/b51655a7-eac5-4574-a0f8-7fe0e6947e06" status: 200 len: 1375 microversion: 2.1 time: 0.297419 Sep 17 21:20:11.870925 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2743/5569] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:20:11 2022] GET /compute/v2.1/servers/b51655a7-eac5-4574-a0f8-7fe0e6947e06 => generated 1375 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:20:12.178925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c518e213-7ad1-41f4-9ab2-865704068b8b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:12.180030 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c518e213-7ad1-41f4-9ab2-865704068b8b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:12.186825 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c518e213-7ad1-41f4-9ab2-865704068b8b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:12.187598 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c518e213-7ad1-41f4-9ab2-865704068b8b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:12.188113 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c518e213-7ad1-41f4-9ab2-865704068b8b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:12.188894 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c518e213-7ad1-41f4-9ab2-865704068b8b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:12.189599 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c518e213-7ad1-41f4-9ab2-865704068b8b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:12.190233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c518e213-7ad1-41f4-9ab2-865704068b8b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:12.204337 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-c518e213-7ad1-41f4-9ab2-865704068b8b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] HTTP exception thrown: Instance 0beab9d3-30c1-4b22-9157-31705ad3dbf7 could not be found. Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c518e213-7ad1-41f4-9ab2-865704068b8b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Request method failure captured: Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 HTTP/1.1 Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjieZv9wtl_pDnkx2EwyI8BFBMJuM6DanlI2NxzpQY06zGh6UfIKVR_b4LIk8F4ufLQC3s4sfs9iVRkIsH0ZpGH5y_C_q5cAnW526d64gmcygXsBXRN_pku_PKAZrLTdzZBFxnNji7tGl8srPYGMXoLfZ6HVA-aDU0tTvt38LrAtYSs Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: X-Openstack-Nova-Api-Version: 2.20 Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 720881c6f7304aadbf069698c97dc5c5 Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1971975439 Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/720881c6f7304aadbf069698c97dc5c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/720881c6f7304aadbf069698c97dc5c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/720881c6f7304aadbf069698c97dc5c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_720881c6f7304aadbf069698c97dc5c5", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1971975439 Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 720881c6f7304aadbf069698c97dc5c5 Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1971975439 Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-AttachVolumeShelveTestJSON-1971975439-project Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 8ddb1d0a7bca457493d7ac9a58a01e64 Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1971975439-project Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 0beab9d3-30c1-4b22-9157-31705ad3dbf7 could not be found. Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '0beab9d3-30c1-4b22-9157-31705ad3dbf7'} Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0beab9d3-30c1-4b22-9157-31705ad3dbf7 could not be found. Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:20:12.206507 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:20:12.210692 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0beab9d3-30c1-4b22-9157-31705ad3dbf7 could not be found. Sep 17 21:20:12.210692 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:12.210692 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:12.210692 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:12.210692 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:12.210692 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:20:12.210692 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:20:12.210692 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:20:12.210692 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:20:12.210692 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0beab9d3-30c1-4b22-9157-31705ad3dbf7 could not be found. Sep 17 21:20:12.210692 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:12.210692 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c518e213-7ad1-41f4-9ab2-865704068b8b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Returning 404 to user: Instance 0beab9d3-30c1-4b22-9157-31705ad3dbf7 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:20:12.210692 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c518e213-7ad1-41f4-9ab2-865704068b8b tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 404 len: 111 microversion: 2.20 time: 0.033309 Sep 17 21:20:12.211955 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2827/5570] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 17 21:20:12 2022] DELETE /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:20:12.216820 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ddec6d13-0c09-4baf-80aa-0a24490ad3cb tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:12.217441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ddec6d13-0c09-4baf-80aa-0a24490ad3cb tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 0beab9d3-30c1-4b22-9157-31705ad3dbf7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:12.223565 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ddec6d13-0c09-4baf-80aa-0a24490ad3cb tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:12.224058 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ddec6d13-0c09-4baf-80aa-0a24490ad3cb tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:12.224498 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ddec6d13-0c09-4baf-80aa-0a24490ad3cb tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:12.225350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ddec6d13-0c09-4baf-80aa-0a24490ad3cb tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:12.225827 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ddec6d13-0c09-4baf-80aa-0a24490ad3cb tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:12.226267 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ddec6d13-0c09-4baf-80aa-0a24490ad3cb tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:12.241859 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-ddec6d13-0c09-4baf-80aa-0a24490ad3cb tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] HTTP exception thrown: Instance 0beab9d3-30c1-4b22-9157-31705ad3dbf7 could not be found. Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ddec6d13-0c09-4baf-80aa-0a24490ad3cb tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Request method failure captured: Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 HTTP/1.1 Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjieZv9wtl_pDnkx2EwyI8BFBMJuM6DanlI2NxzpQY06zGh6UfIKVR_b4LIk8F4ufLQC3s4sfs9iVRkIsH0ZpGH5y_C_q5cAnW526d64gmcygXsBXRN_pku_PKAZrLTdzZBFxnNji7tGl8srPYGMXoLfZ6HVA-aDU0tTvt38LrAtYSs Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: X-Openstack-Nova-Api-Version: 2.20 Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 720881c6f7304aadbf069698c97dc5c5 Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1971975439 Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/720881c6f7304aadbf069698c97dc5c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/720881c6f7304aadbf069698c97dc5c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/720881c6f7304aadbf069698c97dc5c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_720881c6f7304aadbf069698c97dc5c5", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1971975439 Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 720881c6f7304aadbf069698c97dc5c5 Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1971975439 Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-AttachVolumeShelveTestJSON-1971975439-project Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 8ddb1d0a7bca457493d7ac9a58a01e64 Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1971975439-project Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 0beab9d3-30c1-4b22-9157-31705ad3dbf7 could not be found. Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '0beab9d3-30c1-4b22-9157-31705ad3dbf7'} Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0beab9d3-30c1-4b22-9157-31705ad3dbf7 could not be found. Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0beab9d3-30c1-4b22-9157-31705ad3dbf7 could not be found. Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:12.244762 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:12.248611 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:12.248611 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:12.248611 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:20:12.248611 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:20:12.248611 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:20:12.248611 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:20:12.248611 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0beab9d3-30c1-4b22-9157-31705ad3dbf7 could not be found. Sep 17 21:20:12.248611 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:12.248611 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ddec6d13-0c09-4baf-80aa-0a24490ad3cb tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Returning 404 to user: Instance 0beab9d3-30c1-4b22-9157-31705ad3dbf7 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:20:12.248611 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ddec6d13-0c09-4baf-80aa-0a24490ad3cb tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7" status: 404 len: 111 microversion: 2.20 time: 0.033654 Sep 17 21:20:12.249800 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2744/5571] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:20:12 2022] GET /compute/v2.1/servers/0beab9d3-30c1-4b22-9157-31705ad3dbf7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 17 21:20:12.894328 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-06e749bc-6bb3-49d5-a52f-1e98d9bab46b tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:12.895253 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-06e749bc-6bb3-49d5-a52f-1e98d9bab46b tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: b51655a7-eac5-4574-a0f8-7fe0e6947e06] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:12.904728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06e749bc-6bb3-49d5-a52f-1e98d9bab46b tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:12.905245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06e749bc-6bb3-49d5-a52f-1e98d9bab46b tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:12.909910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06e749bc-6bb3-49d5-a52f-1e98d9bab46b tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:12.910687 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06e749bc-6bb3-49d5-a52f-1e98d9bab46b tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:12.911326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06e749bc-6bb3-49d5-a52f-1e98d9bab46b tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:12.913087 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-06e749bc-6bb3-49d5-a52f-1e98d9bab46b tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:13.055278 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-06e749bc-6bb3-49d5-a52f-1e98d9bab46b tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:20:13.063624 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-06e749bc-6bb3-49d5-a52f-1e98d9bab46b tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/b51655a7-eac5-4574-a0f8-7fe0e6947e06" status: 200 len: 1375 microversion: 2.1 time: 0.173234 Sep 17 21:20:13.064196 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2828/5572] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:20:12 2022] GET /compute/v2.1/servers/b51655a7-eac5-4574-a0f8-7fe0e6947e06 => generated 1375 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:20:13.405798 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e726586d-2925-46f3-9404-cc440efce7c4 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:13.406341 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e726586d-2925-46f3-9404-cc440efce7c4 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:13.413334 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e726586d-2925-46f3-9404-cc440efce7c4 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:13.413865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e726586d-2925-46f3-9404-cc440efce7c4 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:13.414331 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e726586d-2925-46f3-9404-cc440efce7c4 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:13.415048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e726586d-2925-46f3-9404-cc440efce7c4 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:13.415497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e726586d-2925-46f3-9404-cc440efce7c4 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:13.415929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e726586d-2925-46f3-9404-cc440efce7c4 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:13.430671 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-e726586d-2925-46f3-9404-cc440efce7c4 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] HTTP exception thrown: Instance 796cf34c-7dbb-444e-a74e-68139729405f could not be found. Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e726586d-2925-46f3-9404-cc440efce7c4 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Request method failure captured: Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f HTTP/1.1 Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjieZv9wtl_pDnkx2EwyI8BFBMJuM6DanlI2NxzpQY06zGh6UfIKVR_b4LIk8F4ufLQC3s4sfs9iVRkIsH0ZpGH5y_C_q5cAnW526d64gmcygXsBXRN_pku_PKAZrLTdzZBFxnNji7tGl8srPYGMXoLfZ6HVA-aDU0tTvt38LrAtYSs Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: X-Openstack-Nova-Api-Version: 2.20 Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 720881c6f7304aadbf069698c97dc5c5 Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1971975439 Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/720881c6f7304aadbf069698c97dc5c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/720881c6f7304aadbf069698c97dc5c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/720881c6f7304aadbf069698c97dc5c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_720881c6f7304aadbf069698c97dc5c5", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1971975439 Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 720881c6f7304aadbf069698c97dc5c5 Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1971975439 Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-AttachVolumeShelveTestJSON-1971975439-project Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 8ddb1d0a7bca457493d7ac9a58a01e64 Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1971975439-project Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 796cf34c-7dbb-444e-a74e-68139729405f could not be found. Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '796cf34c-7dbb-444e-a74e-68139729405f'} Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 796cf34c-7dbb-444e-a74e-68139729405f could not be found. Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:20:13.432603 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:20:13.437709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 796cf34c-7dbb-444e-a74e-68139729405f could not be found. Sep 17 21:20:13.437709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:13.437709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:13.437709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:13.437709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:13.437709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:20:13.437709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:20:13.437709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:20:13.437709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:20:13.437709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 796cf34c-7dbb-444e-a74e-68139729405f could not be found. Sep 17 21:20:13.437709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:13.437709 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e726586d-2925-46f3-9404-cc440efce7c4 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Returning 404 to user: Instance 796cf34c-7dbb-444e-a74e-68139729405f could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:20:13.437709 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e726586d-2925-46f3-9404-cc440efce7c4 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "DELETE /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 404 len: 111 microversion: 2.20 time: 0.032300 Sep 17 21:20:13.438720 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2745/5573] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Sep 17 21:20:13 2022] DELETE /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:20:13.443993 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4d7a6d80-800d-4310-a6a6-655eaae1b8a7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:13.444568 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4d7a6d80-800d-4310-a6a6-655eaae1b8a7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] [instance: 796cf34c-7dbb-444e-a74e-68139729405f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:13.451905 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d7a6d80-800d-4310-a6a6-655eaae1b8a7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:13.452404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d7a6d80-800d-4310-a6a6-655eaae1b8a7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:13.452846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d7a6d80-800d-4310-a6a6-655eaae1b8a7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:13.453665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d7a6d80-800d-4310-a6a6-655eaae1b8a7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:13.454125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d7a6d80-800d-4310-a6a6-655eaae1b8a7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:13.454565 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d7a6d80-800d-4310-a6a6-655eaae1b8a7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:13.468145 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-4d7a6d80-800d-4310-a6a6-655eaae1b8a7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] HTTP exception thrown: Instance 796cf34c-7dbb-444e-a74e-68139729405f could not be found. Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4d7a6d80-800d-4310-a6a6-655eaae1b8a7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Request method failure captured: Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f HTTP/1.1 Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjieZv9wtl_pDnkx2EwyI8BFBMJuM6DanlI2NxzpQY06zGh6UfIKVR_b4LIk8F4ufLQC3s4sfs9iVRkIsH0ZpGH5y_C_q5cAnW526d64gmcygXsBXRN_pku_PKAZrLTdzZBFxnNji7tGl8srPYGMXoLfZ6HVA-aDU0tTvt38LrAtYSs Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: X-Openstack-Nova-Api-Version: 2.20 Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 720881c6f7304aadbf069698c97dc5c5 Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1971975439 Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/720881c6f7304aadbf069698c97dc5c5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/720881c6f7304aadbf069698c97dc5c5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/720881c6f7304aadbf069698c97dc5c5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_720881c6f7304aadbf069698c97dc5c5", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1971975439 Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 720881c6f7304aadbf069698c97dc5c5 Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1971975439 Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-AttachVolumeShelveTestJSON-1971975439-project Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 8ddb1d0a7bca457493d7ac9a58a01e64 Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1971975439-project Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 796cf34c-7dbb-444e-a74e-68139729405f could not be found. Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '796cf34c-7dbb-444e-a74e-68139729405f'} Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 796cf34c-7dbb-444e-a74e-68139729405f could not be found. Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 796cf34c-7dbb-444e-a74e-68139729405f could not be found. Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:13.469740 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:13.477653 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:13.477653 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:13.477653 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:20:13.477653 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:20:13.477653 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:20:13.477653 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:20:13.477653 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 796cf34c-7dbb-444e-a74e-68139729405f could not be found. Sep 17 21:20:13.477653 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:13.477653 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4d7a6d80-800d-4310-a6a6-655eaae1b8a7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] Returning 404 to user: Instance 796cf34c-7dbb-444e-a74e-68139729405f could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:20:13.477653 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4d7a6d80-800d-4310-a6a6-655eaae1b8a7 tempest-AttachVolumeShelveTestJSON-1971975439 tempest-AttachVolumeShelveTestJSON-1971975439-project] 10.222.0.26 "GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f" status: 404 len: 111 microversion: 2.20 time: 0.031173 Sep 17 21:20:13.477653 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2829/5574] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Sep 17 21:20:13 2022] GET /compute/v2.1/servers/796cf34c-7dbb-444e-a74e-68139729405f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:20:13.872110 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bd271415-5e28-43a7-b8f7-5fc0006ca271 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:13.874457 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bd271415-5e28-43a7-b8f7-5fc0006ca271 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:13.880678 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd271415-5e28-43a7-b8f7-5fc0006ca271 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:13.881182 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd271415-5e28-43a7-b8f7-5fc0006ca271 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:13.881754 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd271415-5e28-43a7-b8f7-5fc0006ca271 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:13.882494 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd271415-5e28-43a7-b8f7-5fc0006ca271 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:13.882959 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd271415-5e28-43a7-b8f7-5fc0006ca271 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:13.883393 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bd271415-5e28-43a7-b8f7-5fc0006ca271 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:13.913700 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:20:13.919553 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bd271415-5e28-43a7-b8f7-5fc0006ca271 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051927 Sep 17 21:20:13.920756 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2746/5575] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 17 21:20:13 2022] GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:20:14.064212 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6d67c9df-682a-4def-b5c2-c410f353f5bb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:14.065685 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6d67c9df-682a-4def-b5c2-c410f353f5bb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:14.073131 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6d67c9df-682a-4def-b5c2-c410f353f5bb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:14.073838 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6d67c9df-682a-4def-b5c2-c410f353f5bb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:14.074392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6d67c9df-682a-4def-b5c2-c410f353f5bb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:14.075512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6d67c9df-682a-4def-b5c2-c410f353f5bb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:14.076236 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6d67c9df-682a-4def-b5c2-c410f353f5bb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:14.077100 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6d67c9df-682a-4def-b5c2-c410f353f5bb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:14.088443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6bb1c54a-352f-4438-84ac-5354cf94711c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:14.089484 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6bb1c54a-352f-4438-84ac-5354cf94711c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: b51655a7-eac5-4574-a0f8-7fe0e6947e06] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:14.099515 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6bb1c54a-352f-4438-84ac-5354cf94711c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:14.100665 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6bb1c54a-352f-4438-84ac-5354cf94711c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:14.103185 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6bb1c54a-352f-4438-84ac-5354cf94711c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:14.104223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6bb1c54a-352f-4438-84ac-5354cf94711c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:14.104862 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6bb1c54a-352f-4438-84ac-5354cf94711c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:14.106028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6bb1c54a-352f-4438-84ac-5354cf94711c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:14.119518 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6d67c9df-682a-4def-b5c2-c410f353f5bb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61/os-volume_attachments/2b705eb5-8de6-4864-836d-ce99f20a165c" status: 200 len: 194 microversion: 2.1 time: 0.060154 Sep 17 21:20:14.127047 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2830/5576] 10.222.0.26 () {58 vars in 1413 bytes} [Sat Sep 17 21:20:14 2022] GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61/os-volume_attachments/2b705eb5-8de6-4864-836d-ce99f20a165c => generated 194 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:20:14.134012 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e4318ef5-04dc-4155-818b-6ab1dfc92bdc tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:14.135150 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e4318ef5-04dc-4155-818b-6ab1dfc92bdc tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:14.142830 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e4318ef5-04dc-4155-818b-6ab1dfc92bdc tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:14.143453 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e4318ef5-04dc-4155-818b-6ab1dfc92bdc tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:14.144008 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e4318ef5-04dc-4155-818b-6ab1dfc92bdc tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:14.144915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e4318ef5-04dc-4155-818b-6ab1dfc92bdc tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:14.145496 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e4318ef5-04dc-4155-818b-6ab1dfc92bdc tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:14.145956 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e4318ef5-04dc-4155-818b-6ab1dfc92bdc tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:14.241128 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-e4318ef5-04dc-4155-818b-6ab1dfc92bdc tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lazy-loading 'services' on Instance uuid ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:20:14.321224 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e4318ef5-04dc-4155-818b-6ab1dfc92bdc tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61/os-volume_attachments/2b705eb5-8de6-4864-836d-ce99f20a165c" status: 202 len: 0 microversion: 2.1 time: 0.191136 Sep 17 21:20:14.321370 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2831/5577] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Sep 17 21:20:14 2022] DELETE /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61/os-volume_attachments/2b705eb5-8de6-4864-836d-ce99f20a165c => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:20:14.557967 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6bb1c54a-352f-4438-84ac-5354cf94711c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:20:14.568523 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6bb1c54a-352f-4438-84ac-5354cf94711c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/b51655a7-eac5-4574-a0f8-7fe0e6947e06" status: 200 len: 1375 microversion: 2.1 time: 0.485754 Sep 17 21:20:14.569403 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2747/5578] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:20:14 2022] GET /compute/v2.1/servers/b51655a7-eac5-4574-a0f8-7fe0e6947e06 => generated 1375 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:20:15.502424 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1be47de5-9ce5-40a4-8234-e6f3e16ccc21 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:15.503741 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1be47de5-9ce5-40a4-8234-e6f3e16ccc21 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:15.514751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1be47de5-9ce5-40a4-8234-e6f3e16ccc21 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:15.519517 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1be47de5-9ce5-40a4-8234-e6f3e16ccc21 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:15.520188 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1be47de5-9ce5-40a4-8234-e6f3e16ccc21 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:15.520929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1be47de5-9ce5-40a4-8234-e6f3e16ccc21 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:15.521389 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1be47de5-9ce5-40a4-8234-e6f3e16ccc21 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:15.521838 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1be47de5-9ce5-40a4-8234-e6f3e16ccc21 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:15.560148 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1be47de5-9ce5-40a4-8234-e6f3e16ccc21 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61/os-volume_attachments/97fd9efa-2583-43e8-ae8f-bced2696518e" status: 200 len: 194 microversion: 2.1 time: 0.066786 Sep 17 21:20:15.560765 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2832/5579] 10.222.0.26 () {58 vars in 1413 bytes} [Sat Sep 17 21:20:15 2022] GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61/os-volume_attachments/97fd9efa-2583-43e8-ae8f-bced2696518e => generated 194 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:20:15.571451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-56b446ad-7eff-4d5e-b092-a9738461f745 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:15.571946 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-56b446ad-7eff-4d5e-b092-a9738461f745 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:15.578825 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56b446ad-7eff-4d5e-b092-a9738461f745 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:15.579317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56b446ad-7eff-4d5e-b092-a9738461f745 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:15.579934 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56b446ad-7eff-4d5e-b092-a9738461f745 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:15.580833 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56b446ad-7eff-4d5e-b092-a9738461f745 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:15.581298 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56b446ad-7eff-4d5e-b092-a9738461f745 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:15.581755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56b446ad-7eff-4d5e-b092-a9738461f745 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:15.595789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3f549202-95e2-4a4d-b1ce-e2d22acf0a1b tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:15.596576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3f549202-95e2-4a4d-b1ce-e2d22acf0a1b tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: b51655a7-eac5-4574-a0f8-7fe0e6947e06] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:15.606541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f549202-95e2-4a4d-b1ce-e2d22acf0a1b tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:15.607201 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f549202-95e2-4a4d-b1ce-e2d22acf0a1b tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:15.608061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f549202-95e2-4a4d-b1ce-e2d22acf0a1b tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:15.609366 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f549202-95e2-4a4d-b1ce-e2d22acf0a1b tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:15.610114 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f549202-95e2-4a4d-b1ce-e2d22acf0a1b tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:15.610815 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f549202-95e2-4a4d-b1ce-e2d22acf0a1b tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:15.685523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-56b446ad-7eff-4d5e-b092-a9738461f745 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lazy-loading 'services' on Instance uuid ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:20:15.777778 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-56b446ad-7eff-4d5e-b092-a9738461f745 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61/os-volume_attachments/97fd9efa-2583-43e8-ae8f-bced2696518e" status: 202 len: 0 microversion: 2.1 time: 0.209799 Sep 17 21:20:15.782888 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2748/5580] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Sep 17 21:20:15 2022] DELETE /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61/os-volume_attachments/97fd9efa-2583-43e8-ae8f-bced2696518e => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:20:15.798511 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:20:15.833817 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=10 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:20:16.106608 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:20:16.113203 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-20950971-fd67-4d44-ac99-b9acabe70ada req-ac534749-0430-4a6c-8b5f-931eac86adb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b51655a7-eac5-4574-a0f8-7fe0e6947e06", "name": "network-vif-plugged", "status": "completed", "tag": "07c49d2c-b8e9-4258-b933-a4640b94a728"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:20:16.128129 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-20950971-fd67-4d44-ac99-b9acabe70ada req-ac534749-0430-4a6c-8b5f-931eac86adb5 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:16.128629 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-20950971-fd67-4d44-ac99-b9acabe70ada req-ac534749-0430-4a6c-8b5f-931eac86adb5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:16.129076 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-20950971-fd67-4d44-ac99-b9acabe70ada req-ac534749-0430-4a6c-8b5f-931eac86adb5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:16.142656 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-20950971-fd67-4d44-ac99-b9acabe70ada req-ac534749-0430-4a6c-8b5f-931eac86adb5 service nova] Creating event network-vif-plugged:07c49d2c-b8e9-4258-b933-a4640b94a728 for instance b51655a7-eac5-4574-a0f8-7fe0e6947e06 on nch1-master-1 Sep 17 21:20:16.148321 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-20950971-fd67-4d44-ac99-b9acabe70ada req-ac534749-0430-4a6c-8b5f-931eac86adb5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042509 Sep 17 21:20:16.149710 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2749/5581] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:20:16.388693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3f549202-95e2-4a4d-b1ce-e2d22acf0a1b tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:20:16.399438 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3f549202-95e2-4a4d-b1ce-e2d22acf0a1b tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/b51655a7-eac5-4574-a0f8-7fe0e6947e06" status: 200 len: 1375 microversion: 2.1 time: 0.807794 Sep 17 21:20:16.400271 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2833/5582] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:20:15 2022] GET /compute/v2.1/servers/b51655a7-eac5-4574-a0f8-7fe0e6947e06 => generated 1375 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:20:16.997892 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ce5fac71-01b0-4396-bc02-a1c4b608b25d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:17.000399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ce5fac71-01b0-4396-bc02-a1c4b608b25d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:17.021718 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce5fac71-01b0-4396-bc02-a1c4b608b25d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:17.022354 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce5fac71-01b0-4396-bc02-a1c4b608b25d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:17.022808 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce5fac71-01b0-4396-bc02-a1c4b608b25d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:17.026277 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce5fac71-01b0-4396-bc02-a1c4b608b25d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:17.026951 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce5fac71-01b0-4396-bc02-a1c4b608b25d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:17.030716 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce5fac71-01b0-4396-bc02-a1c4b608b25d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:17.100952 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ce5fac71-01b0-4396-bc02-a1c4b608b25d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106244 Sep 17 21:20:17.101841 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2750/5583] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 17 21:20:16 2022] GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61/os-volume_attachments => generated 25 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:20:17.240307 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f8ee4529-a545-4a6c-85e6-82aec4466e91 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:17.242686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f8ee4529-a545-4a6c-85e6-82aec4466e91 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:17.250856 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8ee4529-a545-4a6c-85e6-82aec4466e91 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:17.251285 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8ee4529-a545-4a6c-85e6-82aec4466e91 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:17.251756 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8ee4529-a545-4a6c-85e6-82aec4466e91 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:17.252477 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8ee4529-a545-4a6c-85e6-82aec4466e91 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:17.265728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8ee4529-a545-4a6c-85e6-82aec4466e91 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:17.266482 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8ee4529-a545-4a6c-85e6-82aec4466e91 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:17.321525 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f8ee4529-a545-4a6c-85e6-82aec4466e91 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085897 Sep 17 21:20:17.322274 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2834/5584] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 17 21:20:17 2022] GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:20:17.395363 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ab46a872-ac83-45b9-b0ae-a9f79626320f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:17.395926 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ab46a872-ac83-45b9-b0ae-a9f79626320f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:17.403617 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab46a872-ac83-45b9-b0ae-a9f79626320f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:17.404331 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab46a872-ac83-45b9-b0ae-a9f79626320f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:17.404707 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab46a872-ac83-45b9-b0ae-a9f79626320f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:17.405488 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab46a872-ac83-45b9-b0ae-a9f79626320f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:17.406179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab46a872-ac83-45b9-b0ae-a9f79626320f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:17.406865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab46a872-ac83-45b9-b0ae-a9f79626320f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:17.421941 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1250beb1-fd30-4732-8242-423da482ea8c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:17.422561 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1250beb1-fd30-4732-8242-423da482ea8c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: b51655a7-eac5-4574-a0f8-7fe0e6947e06] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:17.435030 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1250beb1-fd30-4732-8242-423da482ea8c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:17.435518 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1250beb1-fd30-4732-8242-423da482ea8c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:17.435966 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1250beb1-fd30-4732-8242-423da482ea8c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:17.436690 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1250beb1-fd30-4732-8242-423da482ea8c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:17.437147 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1250beb1-fd30-4732-8242-423da482ea8c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:17.443604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1250beb1-fd30-4732-8242-423da482ea8c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:17.464356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ab46a872-ac83-45b9-b0ae-a9f79626320f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:20:17.599598 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ab46a872-ac83-45b9-b0ae-a9f79626320f tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61" status: 204 len: 0 microversion: 2.1 time: 0.207412 Sep 17 21:20:17.601669 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2751/5585] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:20:17 2022] DELETE /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:20:17.625950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-db3fb02a-69f3-46e3-ab96-39a5c25340fb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:17.627495 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-db3fb02a-69f3-46e3-ab96-39a5c25340fb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:17.638331 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db3fb02a-69f3-46e3-ab96-39a5c25340fb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:17.639017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db3fb02a-69f3-46e3-ab96-39a5c25340fb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:17.639685 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db3fb02a-69f3-46e3-ab96-39a5c25340fb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:17.640761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db3fb02a-69f3-46e3-ab96-39a5c25340fb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:17.641477 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db3fb02a-69f3-46e3-ab96-39a5c25340fb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:17.642102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db3fb02a-69f3-46e3-ab96-39a5c25340fb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:17.829775 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1250beb1-fd30-4732-8242-423da482ea8c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:20:17.840217 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1250beb1-fd30-4732-8242-423da482ea8c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/b51655a7-eac5-4574-a0f8-7fe0e6947e06" status: 200 len: 1375 microversion: 2.1 time: 0.422169 Sep 17 21:20:17.841273 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2835/5586] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:20:17 2022] GET /compute/v2.1/servers/b51655a7-eac5-4574-a0f8-7fe0e6947e06 => generated 1375 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:20:17.970388 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-db3fb02a-69f3-46e3-ab96-39a5c25340fb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:20:17.983591 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-db3fb02a-69f3-46e3-ab96-39a5c25340fb tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61" status: 200 len: 1672 microversion: 2.1 time: 0.362351 Sep 17 21:20:17.984185 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2752/5587] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:20:17 2022] GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 => generated 1672 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:20:18.864446 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6ac29836-17b5-497c-b2c8-86c6ec694daa tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:18.865718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6ac29836-17b5-497c-b2c8-86c6ec694daa tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: b51655a7-eac5-4574-a0f8-7fe0e6947e06] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:18.878724 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ac29836-17b5-497c-b2c8-86c6ec694daa tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:18.879286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ac29836-17b5-497c-b2c8-86c6ec694daa tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:18.879657 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ac29836-17b5-497c-b2c8-86c6ec694daa tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:18.880374 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ac29836-17b5-497c-b2c8-86c6ec694daa tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:18.880900 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ac29836-17b5-497c-b2c8-86c6ec694daa tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:18.881327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6ac29836-17b5-497c-b2c8-86c6ec694daa tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:19.011715 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-55a99def-f68c-4245-a30e-95feeab50a60 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:19.015698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-55a99def-f68c-4245-a30e-95feeab50a60 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:19.028900 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55a99def-f68c-4245-a30e-95feeab50a60 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:19.029593 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55a99def-f68c-4245-a30e-95feeab50a60 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:19.031292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55a99def-f68c-4245-a30e-95feeab50a60 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:19.033003 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55a99def-f68c-4245-a30e-95feeab50a60 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:19.034243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55a99def-f68c-4245-a30e-95feeab50a60 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:19.035128 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55a99def-f68c-4245-a30e-95feeab50a60 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:19.041093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6ac29836-17b5-497c-b2c8-86c6ec694daa tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:20:19.053421 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6ac29836-17b5-497c-b2c8-86c6ec694daa tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/b51655a7-eac5-4574-a0f8-7fe0e6947e06" status: 200 len: 1547 microversion: 2.1 time: 0.193092 Sep 17 21:20:19.057621 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2836/5588] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:20:18 2022] GET /compute/v2.1/servers/b51655a7-eac5-4574-a0f8-7fe0e6947e06 => generated 1547 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:20:19.079290 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e9800470-c2b3-4c7b-9978-6f52765ef1b5 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:19.080043 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e9800470-c2b3-4c7b-9978-6f52765ef1b5 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: b51655a7-eac5-4574-a0f8-7fe0e6947e06] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:19.092659 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9800470-c2b3-4c7b-9978-6f52765ef1b5 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:19.093163 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9800470-c2b3-4c7b-9978-6f52765ef1b5 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:19.093643 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9800470-c2b3-4c7b-9978-6f52765ef1b5 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:19.094374 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9800470-c2b3-4c7b-9978-6f52765ef1b5 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:19.094822 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9800470-c2b3-4c7b-9978-6f52765ef1b5 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:19.095268 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9800470-c2b3-4c7b-9978-6f52765ef1b5 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:19.325039 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-55a99def-f68c-4245-a30e-95feeab50a60 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:20:19.333869 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-55a99def-f68c-4245-a30e-95feeab50a60 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61" status: 200 len: 1672 microversion: 2.1 time: 0.329522 Sep 17 21:20:19.335102 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e9800470-c2b3-4c7b-9978-6f52765ef1b5 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:20:19.347062 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e9800470-c2b3-4c7b-9978-6f52765ef1b5 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/b51655a7-eac5-4574-a0f8-7fe0e6947e06" status: 200 len: 1547 microversion: 2.1 time: 0.271659 Sep 17 21:20:19.348905 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2753/5589] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:20:19 2022] GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 => generated 1672 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:20:19.353689 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2837/5590] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:20:19 2022] GET /compute/v2.1/servers/b51655a7-eac5-4574-a0f8-7fe0e6947e06 => generated 1547 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:20:20.359121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-75ffd48e-9774-4ad4-b166-0560f3309196 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:20.359936 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-75ffd48e-9774-4ad4-b166-0560f3309196 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:20.371851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75ffd48e-9774-4ad4-b166-0560f3309196 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:20.373836 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75ffd48e-9774-4ad4-b166-0560f3309196 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:20.376146 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75ffd48e-9774-4ad4-b166-0560f3309196 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:20.377640 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75ffd48e-9774-4ad4-b166-0560f3309196 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:20.379148 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75ffd48e-9774-4ad4-b166-0560f3309196 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:20.379755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75ffd48e-9774-4ad4-b166-0560f3309196 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:20.485039 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-75ffd48e-9774-4ad4-b166-0560f3309196 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ff5b886208a44c0891c2d1ba65dc083', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d3fab3adf0c425680c91af8afcc516f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:20:20.497505 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-75ffd48e-9774-4ad4-b166-0560f3309196 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61" status: 200 len: 1605 microversion: 2.1 time: 0.141624 Sep 17 21:20:20.497754 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2754/5591] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:20:20 2022] GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 => generated 1605 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:20:20.651705 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-60b0b1f9-5beb-45ed-b292-a1a226f4e26d req-fcfc0b55-f387-48be-99dc-8d4ac042c36a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff94fcaa-27d3-4f58-9a5e-0a541c19ad61", "name": "network-vif-deleted", "tag": "1dacec68-f949-4dcc-93b9-cb5f545bef6d"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:20:20.665429 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-60b0b1f9-5beb-45ed-b292-a1a226f4e26d req-fcfc0b55-f387-48be-99dc-8d4ac042c36a service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:20.677292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-60b0b1f9-5beb-45ed-b292-a1a226f4e26d req-fcfc0b55-f387-48be-99dc-8d4ac042c36a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:20.681862 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-60b0b1f9-5beb-45ed-b292-a1a226f4e26d req-fcfc0b55-f387-48be-99dc-8d4ac042c36a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:20.725879 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-60b0b1f9-5beb-45ed-b292-a1a226f4e26d req-fcfc0b55-f387-48be-99dc-8d4ac042c36a service nova] Creating event network-vif-deleted:1dacec68-f949-4dcc-93b9-cb5f545bef6d for instance ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 on nch2-master-1 Sep 17 21:20:20.738254 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-60b0b1f9-5beb-45ed-b292-a1a226f4e26d req-fcfc0b55-f387-48be-99dc-8d4ac042c36a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095039 Sep 17 21:20:20.742185 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2838/5592] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:20:21.401701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e73b181f-b327-4c7a-93e1-a98d7ac2e15d tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] Action: 'create', calling method: .version_select at 0x7f25a5071af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2141890098"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:20:21.526816 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9786fe64-e1c2-4146-be92-c03ff4a619f2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:21.527859 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9786fe64-e1c2-4146-be92-c03ff4a619f2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:21.541174 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9786fe64-e1c2-4146-be92-c03ff4a619f2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:21.542954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9786fe64-e1c2-4146-be92-c03ff4a619f2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:21.544299 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9786fe64-e1c2-4146-be92-c03ff4a619f2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:21.546484 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9786fe64-e1c2-4146-be92-c03ff4a619f2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:21.547653 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9786fe64-e1c2-4146-be92-c03ff4a619f2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:21.550327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9786fe64-e1c2-4146-be92-c03ff4a619f2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:21.588657 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-9786fe64-e1c2-4146-be92-c03ff4a619f2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] HTTP exception thrown: Instance ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 could not be found. Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9786fe64-e1c2-4146-be92-c03ff4a619f2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Request method failure captured: Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 HTTP/1.1 Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjkWPfVVCWlCt5C_zYZ3ifOv8PEEqQ88FQiqA6A5GoGefnn7DLiqPrB51iFwWp6Nb5TtO-f0hN7F78Xmv_gVYHx4yPsnrp3hdW0YUGXuGWt1tLj5tFXW8h2TviF7TmFsXVoTis_HSLUBmcfbs9_0oM0dRSc6SsIXep29VXVufDgp2oc Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 8d3fab3adf0c425680c91af8afcc516f Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-AttachVolumeTestJSON-890686982 Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d3fab3adf0c425680c91af8afcc516f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8d3fab3adf0c425680c91af8afcc516f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d3fab3adf0c425680c91af8afcc516f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8d3fab3adf0c425680c91af8afcc516f", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-AttachVolumeTestJSON-890686982 Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 8d3fab3adf0c425680c91af8afcc516f Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-AttachVolumeTestJSON-890686982 Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-AttachVolumeTestJSON-890686982-project Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 7ff5b886208a44c0891c2d1ba65dc083 Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-AttachVolumeTestJSON-890686982-project Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 could not be found. Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'ff94fcaa-27d3-4f58-9a5e-0a541c19ad61'} Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 could not be found. Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 could not be found. Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:21.593312 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:21.597927 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:21.597927 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:20:21.597927 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:20:21.597927 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:20:21.597927 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:20:21.597927 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 could not be found. Sep 17 21:20:21.597927 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:21.597927 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9786fe64-e1c2-4146-be92-c03ff4a619f2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Returning 404 to user: Instance ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:20:21.597927 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9786fe64-e1c2-4146-be92-c03ff4a619f2 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61" status: 404 len: 111 microversion: 2.1 time: 0.073791 Sep 17 21:20:21.598659 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2839/5593] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:20:21 2022] GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 21:20:21.608980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f1cb6a85-8114-4aae-a8f9-50c8c8719fc8 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '.version_select at 0x7f25a41f1700>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:21.654978 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f1cb6a85-8114-4aae-a8f9-50c8c8719fc8 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1922633971" status: 202 len: 0 microversion: 2.1 time: 0.052472 Sep 17 21:20:21.658513 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2840/5594] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Sep 17 21:20:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1922633971 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:20:21.917237 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e73b181f-b327-4c7a-93e1-a98d7ac2e15d tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 338 microversion: 2.1 time: 0.955700 Sep 17 21:20:21.917956 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2755/5595] 10.222.0.26 () {60 vars in 1155 bytes} [Sat Sep 17 21:20:20 2022] POST /compute/v2.1/os-volumes => generated 338 bytes in 957 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 17 21:20:21.931856 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-46997a4d-05c2-4100-9f53-4b27000710d5 tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] Calling method '.version_select at 0x7f25a40960d0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:22.064442 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-46997a4d-05c2-4100-9f53-4b27000710d5 tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b" status: 200 len: 338 microversion: 2.1 time: 0.137267 Sep 17 21:20:22.066159 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2841/5596] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Sep 17 21:20:21 2022] GET /compute/v2.1/os-volumes/90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b => generated 338 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:20:22.281869 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-39a0260c-7b44-4970-81c8-253e34836680 req-f10a1db5-3191-4dd0-80f7-becf781492a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b51655a7-eac5-4574-a0f8-7fe0e6947e06", "tag": "07c49d2c-b8e9-4258-b933-a4640b94a728"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:20:22.303916 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-39a0260c-7b44-4970-81c8-253e34836680 req-f10a1db5-3191-4dd0-80f7-becf781492a4 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:22.304467 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-39a0260c-7b44-4970-81c8-253e34836680 req-f10a1db5-3191-4dd0-80f7-becf781492a4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:22.304922 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-39a0260c-7b44-4970-81c8-253e34836680 req-f10a1db5-3191-4dd0-80f7-becf781492a4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:22.332696 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-39a0260c-7b44-4970-81c8-253e34836680 req-f10a1db5-3191-4dd0-80f7-becf781492a4 service nova] Creating event network-changed:07c49d2c-b8e9-4258-b933-a4640b94a728 for instance b51655a7-eac5-4574-a0f8-7fe0e6947e06 on nch1-master-1 Sep 17 21:20:22.345585 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-39a0260c-7b44-4970-81c8-253e34836680 req-f10a1db5-3191-4dd0-80f7-becf781492a4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068561 Sep 17 21:20:22.346230 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2756/5597] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:20:23.082207 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-efb2800a-1db4-4282-b3ca-22af8c31d07d tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] Calling method '.version_select at 0x7f25a40db310>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:23.145187 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-efb2800a-1db4-4282-b3ca-22af8c31d07d tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b" status: 200 len: 339 microversion: 2.1 time: 0.068542 Sep 17 21:20:23.145919 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2842/5598] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Sep 17 21:20:23 2022] GET /compute/v2.1/os-volumes/90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b => generated 339 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:20:23.161047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-66db7bd9-7ff2-41b3-8cd8-2ea0110a1fbb tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] Action: 'create', calling method: .version_select at 0x7f25a5071af0>, body: {"snapshot": {"volume_id": "90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-473523684"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:20:23.418141 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-66db7bd9-7ff2-41b3-8cd8-2ea0110a1fbb tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.262137 Sep 17 21:20:23.426057 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2757/5599] 10.222.0.26 () {60 vars in 1162 bytes} [Sat Sep 17 21:20:23 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:20:23.430794 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fa88644b-ac32-47f8-bdc3-eff10b8c5e22 tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] Calling method '.version_select at 0x7f25a4cebaf0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:23.500232 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fa88644b-ac32-47f8-bdc3-eff10b8c5e22 tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/175be0c3-8086-4664-b498-1d003eda5f30" status: 200 len: 286 microversion: 2.1 time: 0.072597 Sep 17 21:20:23.502903 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2843/5600] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Sep 17 21:20:23 2022] GET /compute/v2.1/os-snapshots/175be0c3-8086-4664-b498-1d003eda5f30 => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:20:23.512618 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8240abf1-100a-4589-922c-88592c1adf12 tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] Calling method '.version_select at 0x7f25a4849a60>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:23.583870 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8240abf1-100a-4589-922c-88592c1adf12 tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.075606 Sep 17 21:20:23.584736 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2758/5601] 10.222.0.26 () {58 vars in 1140 bytes} [Sat Sep 17 21:20:23 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:20:23.599369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-17b99d1a-6c75-4c2b-a0b0-b16af8dc155e tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] Calling method '.version_select at 0x7f25a42650d0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:23.648454 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-17b99d1a-6c75-4c2b-a0b0-b16af8dc155e tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/175be0c3-8086-4664-b498-1d003eda5f30" status: 200 len: 286 microversion: 2.1 time: 0.055082 Sep 17 21:20:23.649328 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2844/5602] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Sep 17 21:20:23 2022] GET /compute/v2.1/os-snapshots/175be0c3-8086-4664-b498-1d003eda5f30 => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:20:24.666152 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d50adfab-e731-47da-a031-bba3dfa06b04 tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] Calling method '.version_select at 0x7f25a5b2c5e0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:24.703922 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d50adfab-e731-47da-a031-bba3dfa06b04 tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/175be0c3-8086-4664-b498-1d003eda5f30" status: 200 len: 287 microversion: 2.1 time: 0.046078 Sep 17 21:20:24.704588 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2759/5603] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Sep 17 21:20:24 2022] GET /compute/v2.1/os-snapshots/175be0c3-8086-4664-b498-1d003eda5f30 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:20:24.723444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b2d5c7f1-fdbe-40c7-a4b4-498a5b382926 tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] Calling method '.version_select at 0x7f25a9ffe4c0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:24.805942 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b2d5c7f1-fdbe-40c7-a4b4-498a5b382926 tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/175be0c3-8086-4664-b498-1d003eda5f30" status: 202 len: 0 microversion: 2.1 time: 0.091101 Sep 17 21:20:24.806783 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2845/5604] 10.222.0.26 () {58 vars in 1254 bytes} [Sat Sep 17 21:20:24 2022] DELETE /compute/v2.1/os-snapshots/175be0c3-8086-4664-b498-1d003eda5f30 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:20:24.815303 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2265e76c-338b-4cd5-ab9c-d9bb07d36310 tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] Calling method '.version_select at 0x7f25a5842280>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:24.849772 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2265e76c-338b-4cd5-ab9c-d9bb07d36310 tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/175be0c3-8086-4664-b498-1d003eda5f30" status: 200 len: 286 microversion: 2.1 time: 0.038349 Sep 17 21:20:24.853547 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2760/5605] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Sep 17 21:20:24 2022] GET /compute/v2.1/os-snapshots/175be0c3-8086-4664-b498-1d003eda5f30 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:20:25.490980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-723f92ae-4bcf-4e22-8482-ecd300868c8d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:25.491495 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-723f92ae-4bcf-4e22-8482-ecd300868c8d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:25.498365 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-723f92ae-4bcf-4e22-8482-ecd300868c8d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:25.498871 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-723f92ae-4bcf-4e22-8482-ecd300868c8d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:25.499318 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-723f92ae-4bcf-4e22-8482-ecd300868c8d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:25.500062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-723f92ae-4bcf-4e22-8482-ecd300868c8d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:25.500553 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-723f92ae-4bcf-4e22-8482-ecd300868c8d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:25.501028 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-723f92ae-4bcf-4e22-8482-ecd300868c8d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:25.515743 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-723f92ae-4bcf-4e22-8482-ecd300868c8d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] HTTP exception thrown: Instance ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 could not be found. Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-723f92ae-4bcf-4e22-8482-ecd300868c8d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Request method failure captured: Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 HTTP/1.1 Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjkWPfVVCWlCt5C_zYZ3ifOv8PEEqQ88FQiqA6A5GoGefnn7DLiqPrB51iFwWp6Nb5TtO-f0hN7F78Xmv_gVYHx4yPsnrp3hdW0YUGXuGWt1tLj5tFXW8h2TviF7TmFsXVoTis_HSLUBmcfbs9_0oM0dRSc6SsIXep29VXVufDgp2oc Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 8d3fab3adf0c425680c91af8afcc516f Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-AttachVolumeTestJSON-890686982 Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d3fab3adf0c425680c91af8afcc516f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8d3fab3adf0c425680c91af8afcc516f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d3fab3adf0c425680c91af8afcc516f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8d3fab3adf0c425680c91af8afcc516f", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-AttachVolumeTestJSON-890686982 Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 8d3fab3adf0c425680c91af8afcc516f Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-AttachVolumeTestJSON-890686982 Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-AttachVolumeTestJSON-890686982-project Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 7ff5b886208a44c0891c2d1ba65dc083 Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-AttachVolumeTestJSON-890686982-project Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 could not be found. Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'ff94fcaa-27d3-4f58-9a5e-0a541c19ad61'} Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 could not be found. Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:20:25.517747 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:20:25.521737 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 could not be found. Sep 17 21:20:25.521737 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:25.521737 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:25.521737 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:25.521737 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:25.521737 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:20:25.521737 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:20:25.521737 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:20:25.521737 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:20:25.521737 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 could not be found. Sep 17 21:20:25.521737 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:25.521737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-723f92ae-4bcf-4e22-8482-ecd300868c8d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Returning 404 to user: Instance ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:20:25.521737 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-723f92ae-4bcf-4e22-8482-ecd300868c8d tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61" status: 404 len: 111 microversion: 2.1 time: 0.032320 Sep 17 21:20:25.521737 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2846/5606] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:20:25 2022] DELETE /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:20:25.530376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-776cc9fc-3ecc-4b6d-a977-e605c35caeaa tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:25.531553 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-776cc9fc-3ecc-4b6d-a977-e605c35caeaa tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: ff94fcaa-27d3-4f58-9a5e-0a541c19ad61] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:25.539877 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-776cc9fc-3ecc-4b6d-a977-e605c35caeaa tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:25.540736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-776cc9fc-3ecc-4b6d-a977-e605c35caeaa tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:25.541572 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-776cc9fc-3ecc-4b6d-a977-e605c35caeaa tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:25.542388 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-776cc9fc-3ecc-4b6d-a977-e605c35caeaa tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:25.542839 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-776cc9fc-3ecc-4b6d-a977-e605c35caeaa tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:25.543348 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-776cc9fc-3ecc-4b6d-a977-e605c35caeaa tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:25.559498 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-776cc9fc-3ecc-4b6d-a977-e605c35caeaa tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] HTTP exception thrown: Instance ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 could not be found. Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-776cc9fc-3ecc-4b6d-a977-e605c35caeaa tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Request method failure captured: Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 HTTP/1.1 Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjkWPfVVCWlCt5C_zYZ3ifOv8PEEqQ88FQiqA6A5GoGefnn7DLiqPrB51iFwWp6Nb5TtO-f0hN7F78Xmv_gVYHx4yPsnrp3hdW0YUGXuGWt1tLj5tFXW8h2TviF7TmFsXVoTis_HSLUBmcfbs9_0oM0dRSc6SsIXep29VXVufDgp2oc Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 8d3fab3adf0c425680c91af8afcc516f Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-AttachVolumeTestJSON-890686982 Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d3fab3adf0c425680c91af8afcc516f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8d3fab3adf0c425680c91af8afcc516f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d3fab3adf0c425680c91af8afcc516f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8d3fab3adf0c425680c91af8afcc516f", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-AttachVolumeTestJSON-890686982 Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 8d3fab3adf0c425680c91af8afcc516f Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-AttachVolumeTestJSON-890686982 Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-AttachVolumeTestJSON-890686982-project Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 7ff5b886208a44c0891c2d1ba65dc083 Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-AttachVolumeTestJSON-890686982-project Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 could not be found. Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'ff94fcaa-27d3-4f58-9a5e-0a541c19ad61'} Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 could not be found. Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 could not be found. Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:25.561218 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:25.565166 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:25.565166 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:20:25.565166 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:20:25.565166 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:20:25.565166 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:20:25.565166 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 could not be found. Sep 17 21:20:25.565166 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:25.565166 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-776cc9fc-3ecc-4b6d-a977-e605c35caeaa tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Returning 404 to user: Instance ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:20:25.565166 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-776cc9fc-3ecc-4b6d-a977-e605c35caeaa tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61" status: 404 len: 111 microversion: 2.1 time: 0.037156 Sep 17 21:20:25.565166 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2761/5607] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:20:25 2022] GET /compute/v2.1/servers/ff94fcaa-27d3-4f58-9a5e-0a541c19ad61 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:20:25.865716 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-76a6c565-40cd-41c0-a2fc-f93ec2578d7d tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] Calling method '.version_select at 0x7f25a41f1790>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:25.895383 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-76a6c565-40cd-41c0-a2fc-f93ec2578d7d tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] HTTP exception thrown: Snapshot 175be0c3-8086-4664-b498-1d003eda5f30 could not be found. Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-76a6c565-40cd-41c0-a2fc-f93ec2578d7d tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] Request method failure captured: Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/os-snapshots/175be0c3-8086-4664-b498-1d003eda5f30 HTTP/1.1 Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjoUzdi7wEb96eEVGSFTavoLNk_Ue5B04QpvSgK2nrMqgGcObeo0OgZ1BBWM4aGK78HZOsAnbV6mKRD0QbB-3aInyvTfR5SafjraV63AIqnwKM_Xvueie1B_N52G2YMzSJBOo9MTjdmMlkyUWcVXSLPeGE7JDgyFP3_rfABmppmAi10 Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: f2fd0343346a41008083043c91e87aab Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-474974175 Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f2fd0343346a41008083043c91e87aab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f2fd0343346a41008083043c91e87aab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f2fd0343346a41008083043c91e87aab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f2fd0343346a41008083043c91e87aab", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-VolumesSnapshotsTestJSON-474974175 Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: f2fd0343346a41008083043c91e87aab Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-474974175 Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-VolumesSnapshotsTestJSON-474974175-project Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: b3f951e315234c69b0c1294ddac832ef Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-VolumesSnapshotsTestJSON-474974175-project Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: exception: Snapshot 175be0c3-8086-4664-b498-1d003eda5f30 could not be found. Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '175be0c3-8086-4664-b498-1d003eda5f30'} Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 175be0c3-8086-4664-b498-1d003eda5f30 could not be found. (HTTP 404) (Request-ID: req-7ed3c8ce-c099-4096-b530-67466f005393) Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 17 21:20:25.914755 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 175be0c3-8086-4664-b498-1d003eda5f30 could not be found. Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 175be0c3-8086-4664-b498-1d003eda5f30 could not be found. Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 175be0c3-8086-4664-b498-1d003eda5f30 could not be found. Sep 17 21:20:25.919768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:25.923785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-76a6c565-40cd-41c0-a2fc-f93ec2578d7d tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] Returning 404 to user: Snapshot 175be0c3-8086-4664-b498-1d003eda5f30 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:20:25.924672 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-76a6c565-40cd-41c0-a2fc-f93ec2578d7d tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/175be0c3-8086-4664-b498-1d003eda5f30" status: 404 len: 111 microversion: 2.1 time: 0.064286 Sep 17 21:20:25.925257 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2847/5608] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Sep 17 21:20:25 2022] GET /compute/v2.1/os-snapshots/175be0c3-8086-4664-b498-1d003eda5f30 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:20:25.934156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-038fd41a-a27f-4a98-af0d-53aab19b0e3e tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] Calling method '.version_select at 0x7f25a51e19d0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:26.007346 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-038fd41a-a27f-4a98-af0d-53aab19b0e3e tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b" status: 202 len: 0 microversion: 2.1 time: 0.077248 Sep 17 21:20:26.007844 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2762/5609] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Sep 17 21:20:25 2022] DELETE /compute/v2.1/os-volumes/90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 17 21:20:26.016782 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a16b7ff7-d22c-4867-844b-0116e567d441 tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] Calling method '.version_select at 0x7f25a4096790>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:26.083683 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a16b7ff7-d22c-4867-844b-0116e567d441 tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b" status: 200 len: 338 microversion: 2.1 time: 0.071274 Sep 17 21:20:26.084808 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2848/5610] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Sep 17 21:20:26 2022] GET /compute/v2.1/os-volumes/90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b => generated 338 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:20:26.727353 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a6d5192f-9643-4ba4-baa7-892b518045d8 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:26.727868 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a6d5192f-9643-4ba4-baa7-892b518045d8 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:26.734814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6d5192f-9643-4ba4-baa7-892b518045d8 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:26.735321 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6d5192f-9643-4ba4-baa7-892b518045d8 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:26.735760 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6d5192f-9643-4ba4-baa7-892b518045d8 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:26.736493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6d5192f-9643-4ba4-baa7-892b518045d8 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:26.736983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6d5192f-9643-4ba4-baa7-892b518045d8 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:26.737406 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a6d5192f-9643-4ba4-baa7-892b518045d8 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:26.753135 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-a6d5192f-9643-4ba4-baa7-892b518045d8 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] HTTP exception thrown: Instance 3fa19be0-63c9-4071-979b-b23744235f16 could not be found. Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a6d5192f-9643-4ba4-baa7-892b518045d8 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Request method failure captured: Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 HTTP/1.1 Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjkWPfVVCWlCt5C_zYZ3ifOv8PEEqQ88FQiqA6A5GoGefnn7DLiqPrB51iFwWp6Nb5TtO-f0hN7F78Xmv_gVYHx4yPsnrp3hdW0YUGXuGWt1tLj5tFXW8h2TviF7TmFsXVoTis_HSLUBmcfbs9_0oM0dRSc6SsIXep29VXVufDgp2oc Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 8d3fab3adf0c425680c91af8afcc516f Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-AttachVolumeTestJSON-890686982 Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d3fab3adf0c425680c91af8afcc516f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8d3fab3adf0c425680c91af8afcc516f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d3fab3adf0c425680c91af8afcc516f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8d3fab3adf0c425680c91af8afcc516f", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-AttachVolumeTestJSON-890686982 Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 8d3fab3adf0c425680c91af8afcc516f Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-AttachVolumeTestJSON-890686982 Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-AttachVolumeTestJSON-890686982-project Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 7ff5b886208a44c0891c2d1ba65dc083 Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-AttachVolumeTestJSON-890686982-project Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 3fa19be0-63c9-4071-979b-b23744235f16 could not be found. Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '3fa19be0-63c9-4071-979b-b23744235f16'} Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fa19be0-63c9-4071-979b-b23744235f16 could not be found. Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:20:26.755057 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:20:26.760271 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fa19be0-63c9-4071-979b-b23744235f16 could not be found. Sep 17 21:20:26.760271 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:26.760271 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:26.760271 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:26.760271 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:26.760271 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:20:26.760271 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:20:26.760271 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:20:26.760271 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:20:26.760271 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fa19be0-63c9-4071-979b-b23744235f16 could not be found. Sep 17 21:20:26.760271 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:26.760271 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a6d5192f-9643-4ba4-baa7-892b518045d8 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Returning 404 to user: Instance 3fa19be0-63c9-4071-979b-b23744235f16 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:20:26.760271 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a6d5192f-9643-4ba4-baa7-892b518045d8 tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 404 len: 111 microversion: 2.1 time: 0.033034 Sep 17 21:20:26.760271 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2763/5611] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:20:26 2022] DELETE /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:20:26.767394 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4d217f14-83d8-4dd8-b1fc-5a9c7db02c5b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:26.770222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4d217f14-83d8-4dd8-b1fc-5a9c7db02c5b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] [instance: 3fa19be0-63c9-4071-979b-b23744235f16] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:26.776772 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d217f14-83d8-4dd8-b1fc-5a9c7db02c5b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:26.777395 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d217f14-83d8-4dd8-b1fc-5a9c7db02c5b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:26.778111 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d217f14-83d8-4dd8-b1fc-5a9c7db02c5b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:26.778999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d217f14-83d8-4dd8-b1fc-5a9c7db02c5b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:26.779546 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d217f14-83d8-4dd8-b1fc-5a9c7db02c5b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:26.780063 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d217f14-83d8-4dd8-b1fc-5a9c7db02c5b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:26.794847 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-4d217f14-83d8-4dd8-b1fc-5a9c7db02c5b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] HTTP exception thrown: Instance 3fa19be0-63c9-4071-979b-b23744235f16 could not be found. Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4d217f14-83d8-4dd8-b1fc-5a9c7db02c5b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Request method failure captured: Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 HTTP/1.1 Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjkWPfVVCWlCt5C_zYZ3ifOv8PEEqQ88FQiqA6A5GoGefnn7DLiqPrB51iFwWp6Nb5TtO-f0hN7F78Xmv_gVYHx4yPsnrp3hdW0YUGXuGWt1tLj5tFXW8h2TviF7TmFsXVoTis_HSLUBmcfbs9_0oM0dRSc6SsIXep29VXVufDgp2oc Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 8d3fab3adf0c425680c91af8afcc516f Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-AttachVolumeTestJSON-890686982 Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d3fab3adf0c425680c91af8afcc516f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8d3fab3adf0c425680c91af8afcc516f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d3fab3adf0c425680c91af8afcc516f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8d3fab3adf0c425680c91af8afcc516f", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-AttachVolumeTestJSON-890686982 Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 8d3fab3adf0c425680c91af8afcc516f Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-AttachVolumeTestJSON-890686982 Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-AttachVolumeTestJSON-890686982-project Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 7ff5b886208a44c0891c2d1ba65dc083 Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-AttachVolumeTestJSON-890686982-project Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 3fa19be0-63c9-4071-979b-b23744235f16 could not be found. Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '3fa19be0-63c9-4071-979b-b23744235f16'} Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fa19be0-63c9-4071-979b-b23744235f16 could not be found. Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fa19be0-63c9-4071-979b-b23744235f16 could not be found. Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:26.796431 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:26.801268 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:26.801268 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:20:26.801268 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:20:26.801268 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:20:26.801268 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:20:26.801268 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fa19be0-63c9-4071-979b-b23744235f16 could not be found. Sep 17 21:20:26.801268 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:26.801268 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4d217f14-83d8-4dd8-b1fc-5a9c7db02c5b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] Returning 404 to user: Instance 3fa19be0-63c9-4071-979b-b23744235f16 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:20:26.801268 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4d217f14-83d8-4dd8-b1fc-5a9c7db02c5b tempest-AttachVolumeTestJSON-890686982 tempest-AttachVolumeTestJSON-890686982-project] 10.222.0.26 "GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16" status: 404 len: 111 microversion: 2.1 time: 0.035615 Sep 17 21:20:26.809519 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2849/5612] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:20:26 2022] GET /compute/v2.1/servers/3fa19be0-63c9-4071-979b-b23744235f16 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:20:27.099227 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-47b9da4b-df0e-423d-b25d-3c5cac5579e4 tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] Calling method '.version_select at 0x7f25a481a550>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:27.131497 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-47b9da4b-df0e-423d-b25d-3c5cac5579e4 tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] HTTP exception thrown: Volume 90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b could not be found. Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-47b9da4b-df0e-423d-b25d-3c5cac5579e4 tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] Request method failure captured: Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/os-volumes/90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b HTTP/1.1 Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjoUzdi7wEb96eEVGSFTavoLNk_Ue5B04QpvSgK2nrMqgGcObeo0OgZ1BBWM4aGK78HZOsAnbV6mKRD0QbB-3aInyvTfR5SafjraV63AIqnwKM_Xvueie1B_N52G2YMzSJBOo9MTjdmMlkyUWcVXSLPeGE7JDgyFP3_rfABmppmAi10 Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: f2fd0343346a41008083043c91e87aab Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-474974175 Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f2fd0343346a41008083043c91e87aab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f2fd0343346a41008083043c91e87aab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f2fd0343346a41008083043c91e87aab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f2fd0343346a41008083043c91e87aab", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-VolumesSnapshotsTestJSON-474974175 Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: f2fd0343346a41008083043c91e87aab Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-474974175 Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-VolumesSnapshotsTestJSON-474974175-project Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: b3f951e315234c69b0c1294ddac832ef Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-VolumesSnapshotsTestJSON-474974175-project Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: exception: Volume 90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b could not be found. Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b'} Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b could not be found. (HTTP 404) (Request-ID: req-d7df6803-9d51-4b9c-89a8-20bd20dabf62) Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 17 21:20:27.133750 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b could not be found. Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b could not be found. Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b could not be found. Sep 17 21:20:27.137809 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:27.141880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-47b9da4b-df0e-423d-b25d-3c5cac5579e4 tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] Returning 404 to user: Volume 90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:20:27.142976 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-47b9da4b-df0e-423d-b25d-3c5cac5579e4 tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b" status: 404 len: 109 microversion: 2.1 time: 0.047786 Sep 17 21:20:27.144001 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2764/5613] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Sep 17 21:20:27 2022] GET /compute/v2.1/os-volumes/90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:20:27.156166 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4a48f0a1-58fa-4c7a-8059-8ac32e836008 tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] Calling method '.version_select at 0x7f25a4265550>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:27.189784 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-4a48f0a1-58fa-4c7a-8059-8ac32e836008 tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] HTTP exception thrown: Volume 90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b could not be found. Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4a48f0a1-58fa-4c7a-8059-8ac32e836008 tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] Request method failure captured: Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/os-volumes/90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b HTTP/1.1 Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjoUzdi7wEb96eEVGSFTavoLNk_Ue5B04QpvSgK2nrMqgGcObeo0OgZ1BBWM4aGK78HZOsAnbV6mKRD0QbB-3aInyvTfR5SafjraV63AIqnwKM_Xvueie1B_N52G2YMzSJBOo9MTjdmMlkyUWcVXSLPeGE7JDgyFP3_rfABmppmAi10 Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: f2fd0343346a41008083043c91e87aab Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-474974175 Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f2fd0343346a41008083043c91e87aab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f2fd0343346a41008083043c91e87aab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f2fd0343346a41008083043c91e87aab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f2fd0343346a41008083043c91e87aab", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-VolumesSnapshotsTestJSON-474974175 Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: f2fd0343346a41008083043c91e87aab Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-474974175 Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-VolumesSnapshotsTestJSON-474974175-project Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: b3f951e315234c69b0c1294ddac832ef Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-VolumesSnapshotsTestJSON-474974175-project Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: method: Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: exception: Volume 90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b could not be found. Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b'} Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b could not be found. (HTTP 404) (Request-ID: req-68801b33-d820-43d2-8faa-7496b1134c90) Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 17 21:20:27.193316 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b could not be found. Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b could not be found. Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b could not be found. Sep 17 21:20:27.198081 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:27.202775 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4a48f0a1-58fa-4c7a-8059-8ac32e836008 tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] Returning 404 to user: Volume 90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:20:27.204348 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4a48f0a1-58fa-4c7a-8059-8ac32e836008 tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b" status: 404 len: 109 microversion: 2.1 time: 0.052502 Sep 17 21:20:27.205885 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2850/5614] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Sep 17 21:20:27 2022] DELETE /compute/v2.1/os-volumes/90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:20:27.217147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-25614941-a148-4e74-a761-12f12e5368e4 tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] Calling method '.version_select at 0x7f25a481d4c0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:27.249625 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-25614941-a148-4e74-a761-12f12e5368e4 tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] HTTP exception thrown: Volume 90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b could not be found. Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-25614941-a148-4e74-a761-12f12e5368e4 tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] Request method failure captured: Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/os-volumes/90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b HTTP/1.1 Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjoUzdi7wEb96eEVGSFTavoLNk_Ue5B04QpvSgK2nrMqgGcObeo0OgZ1BBWM4aGK78HZOsAnbV6mKRD0QbB-3aInyvTfR5SafjraV63AIqnwKM_Xvueie1B_N52G2YMzSJBOo9MTjdmMlkyUWcVXSLPeGE7JDgyFP3_rfABmppmAi10 Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: f2fd0343346a41008083043c91e87aab Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-474974175 Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f2fd0343346a41008083043c91e87aab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f2fd0343346a41008083043c91e87aab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f2fd0343346a41008083043c91e87aab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f2fd0343346a41008083043c91e87aab", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-VolumesSnapshotsTestJSON-474974175 Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: f2fd0343346a41008083043c91e87aab Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-474974175 Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-VolumesSnapshotsTestJSON-474974175-project Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: b3f951e315234c69b0c1294ddac832ef Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-VolumesSnapshotsTestJSON-474974175-project Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: method: Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: exception: Volume 90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b could not be found. Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b'} Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b could not be found. (HTTP 404) (Request-ID: req-46b8fadc-15e7-4df0-bea4-89dff3ad49e7) Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 17 21:20:27.251900 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b could not be found. Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b could not be found. Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b could not be found. Sep 17 21:20:27.255791 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:20:27.260317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-25614941-a148-4e74-a761-12f12e5368e4 tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] Returning 404 to user: Volume 90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:20:27.261376 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-25614941-a148-4e74-a761-12f12e5368e4 tempest-VolumesSnapshotsTestJSON-474974175 tempest-VolumesSnapshotsTestJSON-474974175-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b" status: 404 len: 109 microversion: 2.1 time: 0.052185 Sep 17 21:20:27.262195 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2765/5615] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Sep 17 21:20:27 2022] GET /compute/v2.1/os-volumes/90a7bd6c-2c29-45f5-a97f-cfde9a3fd96b => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:20:42.751498 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:20:42.752917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:20:42.758423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3c528e99-fd1f-4040-b6a7-252aea79f318 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:20:42.761020 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3c528e99-fd1f-4040-b6a7-252aea79f318 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: b51655a7-eac5-4574-a0f8-7fe0e6947e06] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:42.769393 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c528e99-fd1f-4040-b6a7-252aea79f318 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:42.770300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c528e99-fd1f-4040-b6a7-252aea79f318 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:42.770897 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c528e99-fd1f-4040-b6a7-252aea79f318 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:42.771967 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c528e99-fd1f-4040-b6a7-252aea79f318 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:42.772599 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c528e99-fd1f-4040-b6a7-252aea79f318 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:42.773183 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c528e99-fd1f-4040-b6a7-252aea79f318 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:42.839538 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3c528e99-fd1f-4040-b6a7-252aea79f318 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "POST /compute/v2.1/servers/b51655a7-eac5-4574-a0f8-7fe0e6947e06/action" status: 200 len: 24569 microversion: 2.1 time: 0.089877 Sep 17 21:20:42.841502 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2851/5616] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:20:42 2022] POST /compute/v2.1/servers/b51655a7-eac5-4574-a0f8-7fe0e6947e06/action => generated 24569 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:20:52.071742 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:20:52.072557 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:20:52.079356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9effa8ab-137e-4166-a17c-48e8a1483b77 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:52.079877 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9effa8ab-137e-4166-a17c-48e8a1483b77 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 56765273-f0e8-4db1-99a2-d789fa273a62] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:52.104658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9effa8ab-137e-4166-a17c-48e8a1483b77 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:52.105295 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9effa8ab-137e-4166-a17c-48e8a1483b77 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:52.106696 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9effa8ab-137e-4166-a17c-48e8a1483b77 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:52.107560 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9effa8ab-137e-4166-a17c-48e8a1483b77 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:52.108161 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9effa8ab-137e-4166-a17c-48e8a1483b77 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:52.108601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9effa8ab-137e-4166-a17c-48e8a1483b77 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:52.501178 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-9effa8ab-137e-4166-a17c-48e8a1483b77 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lazy-loading 'services' on Instance uuid 56765273-f0e8-4db1-99a2-d789fa273a62 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:20:52.620836 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9effa8ab-137e-4166-a17c-48e8a1483b77 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "DELETE /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62/os-volume_attachments/f21f3370-6eb4-457e-9061-0f3b2e826e13" status: 202 len: 0 microversion: 2.1 time: 0.551858 Sep 17 21:20:52.625380 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2766/5617] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Sep 17 21:20:52 2022] DELETE /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62/os-volume_attachments/f21f3370-6eb4-457e-9061-0f3b2e826e13 => generated 0 bytes in 557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:20:53.892255 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f705ec84-4cbf-432c-83ea-7873763d459b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:53.894217 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f705ec84-4cbf-432c-83ea-7873763d459b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 56765273-f0e8-4db1-99a2-d789fa273a62] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:53.899961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=4 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:20:53.901094 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:20:53.906641 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f705ec84-4cbf-432c-83ea-7873763d459b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:53.907370 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f705ec84-4cbf-432c-83ea-7873763d459b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:53.907963 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f705ec84-4cbf-432c-83ea-7873763d459b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:53.909005 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f705ec84-4cbf-432c-83ea-7873763d459b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:53.909669 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f705ec84-4cbf-432c-83ea-7873763d459b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:53.910310 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f705ec84-4cbf-432c-83ea-7873763d459b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:53.943515 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f705ec84-4cbf-432c-83ea-7873763d459b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 56765273-f0e8-4db1-99a2-d789fa273a62] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:20:54.055698 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f705ec84-4cbf-432c-83ea-7873763d459b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "DELETE /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62" status: 204 len: 0 microversion: 2.1 time: 0.166885 Sep 17 21:20:54.056937 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2852/5618] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:20:53 2022] DELETE /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:20:54.067938 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a80b4f1f-1d72-4a86-bbf5-70f36c8d16bb tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:54.069443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a80b4f1f-1d72-4a86-bbf5-70f36c8d16bb tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 56765273-f0e8-4db1-99a2-d789fa273a62] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:54.078814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a80b4f1f-1d72-4a86-bbf5-70f36c8d16bb tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:54.079619 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a80b4f1f-1d72-4a86-bbf5-70f36c8d16bb tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:54.082080 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a80b4f1f-1d72-4a86-bbf5-70f36c8d16bb tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:54.083025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a80b4f1f-1d72-4a86-bbf5-70f36c8d16bb tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:54.083655 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a80b4f1f-1d72-4a86-bbf5-70f36c8d16bb tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:54.084310 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a80b4f1f-1d72-4a86-bbf5-70f36c8d16bb tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:54.389008 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a80b4f1f-1d72-4a86-bbf5-70f36c8d16bb tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd15b9d354eb44b0bfa83bcdcf5c1384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335955c0be3743eda2541b7d04ed2e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:20:54.397551 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a80b4f1f-1d72-4a86-bbf5-70f36c8d16bb tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "GET /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62" status: 200 len: 1513 microversion: 2.1 time: 0.335860 Sep 17 21:20:54.398746 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2767/5619] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:20:54 2022] GET /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62 => generated 1513 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:20:55.420994 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c9df0b42-34a7-46d5-89aa-a20bc4e23615 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:55.421640 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c9df0b42-34a7-46d5-89aa-a20bc4e23615 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 56765273-f0e8-4db1-99a2-d789fa273a62] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:55.428734 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9df0b42-34a7-46d5-89aa-a20bc4e23615 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:55.429535 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9df0b42-34a7-46d5-89aa-a20bc4e23615 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:55.430162 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9df0b42-34a7-46d5-89aa-a20bc4e23615 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:55.431047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9df0b42-34a7-46d5-89aa-a20bc4e23615 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:55.431668 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9df0b42-34a7-46d5-89aa-a20bc4e23615 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:55.432290 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9df0b42-34a7-46d5-89aa-a20bc4e23615 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:56.328241 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c9df0b42-34a7-46d5-89aa-a20bc4e23615 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd15b9d354eb44b0bfa83bcdcf5c1384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335955c0be3743eda2541b7d04ed2e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:20:56.341393 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c9df0b42-34a7-46d5-89aa-a20bc4e23615 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "GET /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62" status: 200 len: 1513 microversion: 2.1 time: 0.924403 Sep 17 21:20:56.343315 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2853/5620] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:20:55 2022] GET /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62 => generated 1513 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:20:57.038989 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-835e1137-cc92-4672-86aa-c7872424a5e8 req-4de09a31-3f52-416b-9b39-d9b174c6ed20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56765273-f0e8-4db1-99a2-d789fa273a62", "name": "network-vif-deleted", "tag": "02eb02f8-39c1-456b-90bf-42549827ed36"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:20:57.064998 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-835e1137-cc92-4672-86aa-c7872424a5e8 req-4de09a31-3f52-416b-9b39-d9b174c6ed20 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:57.066195 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-835e1137-cc92-4672-86aa-c7872424a5e8 req-4de09a31-3f52-416b-9b39-d9b174c6ed20 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:57.066888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-835e1137-cc92-4672-86aa-c7872424a5e8 req-4de09a31-3f52-416b-9b39-d9b174c6ed20 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:57.088390 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-835e1137-cc92-4672-86aa-c7872424a5e8 req-4de09a31-3f52-416b-9b39-d9b174c6ed20 service nova] Creating event network-vif-deleted:02eb02f8-39c1-456b-90bf-42549827ed36 for instance 56765273-f0e8-4db1-99a2-d789fa273a62 on nch1-master-1 Sep 17 21:20:57.112049 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-835e1137-cc92-4672-86aa-c7872424a5e8 req-4de09a31-3f52-416b-9b39-d9b174c6ed20 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075136 Sep 17 21:20:57.116237 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2768/5621] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:20:57.233633 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-06da4f84-3bac-4c5e-b522-ed35be2a2f3f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Action: 'create', calling method: .version_select at 0x7f25a53b8280>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1125234150", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAtKk81DRX08NMzZ2cw50QTRZc15ynU6orTNbmhiT+dkfF2cPsIXAbLtgY1m2vYKCOKoyRP0uQgiaDgLCMZ837Mn/THHF2E2/EqZJalnw+LpBl0iun0oH6huVRLw7nXNAw=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:20:57.262087 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-06da4f84-3bac-4c5e-b522-ed35be2a2f3f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Getting quotas for project 0608df66a18a4fb3855b6cd557ab2998. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:20:57.277225 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-06da4f84-3bac-4c5e-b522-ed35be2a2f3f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Getting quotas for user 2fc6b11f473e4231adf4278688619f24 and project 0608df66a18a4fb3855b6cd557ab2998. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:20:57.308157 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-06da4f84-3bac-4c5e-b522-ed35be2a2f3f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.078649 Sep 17 21:20:57.308778 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2854/5622] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:20:57 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:20:57.373594 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-df907588-f358-4162-95f5-175db10169e3 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:57.379597 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-df907588-f358-4162-95f5-175db10169e3 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 56765273-f0e8-4db1-99a2-d789fa273a62] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:57.409444 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df907588-f358-4162-95f5-175db10169e3 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:57.411028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df907588-f358-4162-95f5-175db10169e3 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:57.413139 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df907588-f358-4162-95f5-175db10169e3 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:57.416798 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df907588-f358-4162-95f5-175db10169e3 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:57.418390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df907588-f358-4162-95f5-175db10169e3 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:57.420557 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df907588-f358-4162-95f5-175db10169e3 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:57.514136 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df907588-f358-4162-95f5-175db10169e3 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:57.514983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df907588-f358-4162-95f5-175db10169e3 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:57.515673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-df907588-f358-4162-95f5-175db10169e3 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:57.516351 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-df907588-f358-4162-95f5-175db10169e3 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lazy-loading 'fault' on Instance uuid 56765273-f0e8-4db1-99a2-d789fa273a62 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:20:57.585077 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-df907588-f358-4162-95f5-175db10169e3 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd15b9d354eb44b0bfa83bcdcf5c1384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335955c0be3743eda2541b7d04ed2e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:20:57.600229 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-df907588-f358-4162-95f5-175db10169e3 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "GET /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62" status: 200 len: 1308 microversion: 2.1 time: 0.232857 Sep 17 21:20:57.619270 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2769/5623] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:20:57 2022] GET /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62 => generated 1308 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:20:58.632720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-17403ef6-a2d5-4762-bcdc-3829b75d407b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:20:58.634051 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-17403ef6-a2d5-4762-bcdc-3829b75d407b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 56765273-f0e8-4db1-99a2-d789fa273a62] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:20:58.642796 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17403ef6-a2d5-4762-bcdc-3829b75d407b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:58.647469 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17403ef6-a2d5-4762-bcdc-3829b75d407b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:58.648272 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17403ef6-a2d5-4762-bcdc-3829b75d407b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:58.651112 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17403ef6-a2d5-4762-bcdc-3829b75d407b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:20:58.651749 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17403ef6-a2d5-4762-bcdc-3829b75d407b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:20:58.652901 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17403ef6-a2d5-4762-bcdc-3829b75d407b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:20:58.702406 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-17403ef6-a2d5-4762-bcdc-3829b75d407b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] HTTP exception thrown: Instance 56765273-f0e8-4db1-99a2-d789fa273a62 could not be found. Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-17403ef6-a2d5-4762-bcdc-3829b75d407b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Request method failure captured: Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62 HTTP/1.1 Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjmrne0NLF_LbZ5mPxWoH_GRl_7sl8Y6b-gsF0wGB4m53fMH3cSJp-sfPpPUR6drvc5spau-CC8WoZidlQM4ze6F6MIL7XpEYKnuCqNwv55EfxZH7e32DM650Yd3OVGBLNYYrX11gl1Gik1fmqwzKo-GP4aDpevf1FqvsEMZC7preVw Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 335955c0be3743eda2541b7d04ed2e06 Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2104722578 Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/335955c0be3743eda2541b7d04ed2e06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/335955c0be3743eda2541b7d04ed2e06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/335955c0be3743eda2541b7d04ed2e06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_335955c0be3743eda2541b7d04ed2e06", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-VolumesSnapshotTestJSON-2104722578 Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 335955c0be3743eda2541b7d04ed2e06 Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2104722578 Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-VolumesSnapshotTestJSON-2104722578-project Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: fd15b9d354eb44b0bfa83bcdcf5c1384 Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-VolumesSnapshotTestJSON-2104722578-project Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 56765273-f0e8-4db1-99a2-d789fa273a62 could not be found. Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '56765273-f0e8-4db1-99a2-d789fa273a62'} Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56765273-f0e8-4db1-99a2-d789fa273a62 could not be found. Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56765273-f0e8-4db1-99a2-d789fa273a62 could not be found. Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:20:58.704087 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:58.708681 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:20:58.708681 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:20:58.708681 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:20:58.708681 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:20:58.708681 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:20:58.708681 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56765273-f0e8-4db1-99a2-d789fa273a62 could not be found. Sep 17 21:20:58.708681 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:20:58.708681 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-17403ef6-a2d5-4762-bcdc-3829b75d407b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Returning 404 to user: Instance 56765273-f0e8-4db1-99a2-d789fa273a62 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:20:58.708681 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-17403ef6-a2d5-4762-bcdc-3829b75d407b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "GET /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62" status: 404 len: 111 microversion: 2.1 time: 0.078156 Sep 17 21:20:58.708681 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2855/5624] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:20:58 2022] GET /compute/v2.1/servers/56765273-f0e8-4db1-99a2-d789fa273a62 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 21:20:59.828709 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a50b7b59-8e36-46ba-8999-4631aff9d274 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2116178663", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "103912a4-9bb0-4b81-8444-457bcfb751da"}], "key_name": "tempest-TestNetworkBasicOps-1125234150", "security_groups": [{"name": "tempest-secgroup-smoke-1677484036"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:21:00.028824 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-a50b7b59-8e36-46ba-8999-4631aff9d274 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] validate_networks() for [('103912a4-9bb0-4b81-8444-457bcfb751da', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:21:01.606190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a50b7b59-8e36-46ba-8999-4631aff9d274 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:21:01.606762 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a50b7b59-8e36-46ba-8999-4631aff9d274 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:21:01.607273 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a50b7b59-8e36-46ba-8999-4631aff9d274 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:21:01.607728 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a50b7b59-8e36-46ba-8999-4631aff9d274 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:21:01.608619 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a50b7b59-8e36-46ba-8999-4631aff9d274 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:21:01.631891 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a50b7b59-8e36-46ba-8999-4631aff9d274 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:01.634411 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a50b7b59-8e36-46ba-8999-4631aff9d274 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:01.635035 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a50b7b59-8e36-46ba-8999-4631aff9d274 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:01.636641 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a50b7b59-8e36-46ba-8999-4631aff9d274 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:01.640537 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a50b7b59-8e36-46ba-8999-4631aff9d274 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:01.642437 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a50b7b59-8e36-46ba-8999-4631aff9d274 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:01.692204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-a50b7b59-8e36-46ba-8999-4631aff9d274 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Getting quotas for project 0608df66a18a4fb3855b6cd557ab2998. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:21:01.703167 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-a50b7b59-8e36-46ba-8999-4631aff9d274 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Getting quotas for user 2fc6b11f473e4231adf4278688619f24 and project 0608df66a18a4fb3855b6cd557ab2998. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:21:01.726619 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a50b7b59-8e36-46ba-8999-4631aff9d274 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:21:01.730353 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a50b7b59-8e36-46ba-8999-4631aff9d274 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: 2653f39d-6b50-4a7c-b5c3-b792fe277e39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:21:01.820706 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a50b7b59-8e36-46ba-8999-4631aff9d274 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.996417 Sep 17 21:21:01.842277 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2770/5625] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:20:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 2003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:21:01.842769 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-85ff6915-8ac2-4730-bc33-f3849a38841f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:01.843955 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-85ff6915-8ac2-4730-bc33-f3849a38841f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: 2653f39d-6b50-4a7c-b5c3-b792fe277e39] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:21:01.926799 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-85ff6915-8ac2-4730-bc33-f3849a38841f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:21:01.940261 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-85ff6915-8ac2-4730-bc33-f3849a38841f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/2653f39d-6b50-4a7c-b5c3-b792fe277e39" status: 200 len: 1249 microversion: 2.1 time: 0.101036 Sep 17 21:21:01.941393 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2856/5626] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:21:01 2022] GET /compute/v2.1/servers/2653f39d-6b50-4a7c-b5c3-b792fe277e39 => generated 1249 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:21:02.968362 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-74209744-b9af-4530-808a-e21a6a33da85 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:02.969000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-74209744-b9af-4530-808a-e21a6a33da85 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: 2653f39d-6b50-4a7c-b5c3-b792fe277e39] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:21:02.989678 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74209744-b9af-4530-808a-e21a6a33da85 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:02.992283 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74209744-b9af-4530-808a-e21a6a33da85 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:02.993634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74209744-b9af-4530-808a-e21a6a33da85 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:02.995753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74209744-b9af-4530-808a-e21a6a33da85 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:02.996457 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74209744-b9af-4530-808a-e21a6a33da85 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:02.997075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74209744-b9af-4530-808a-e21a6a33da85 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:03.139397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-74209744-b9af-4530-808a-e21a6a33da85 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:21:03.148762 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-74209744-b9af-4530-808a-e21a6a33da85 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/2653f39d-6b50-4a7c-b5c3-b792fe277e39" status: 200 len: 1309 microversion: 2.1 time: 0.186851 Sep 17 21:21:03.163360 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2771/5627] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:21:02 2022] GET /compute/v2.1/servers/2653f39d-6b50-4a7c-b5c3-b792fe277e39 => generated 1309 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:21:04.085228 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7990b5b0-f5f5-4b2a-b0a7-ed7290154f47 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1659737747", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "b78fcdef-7b60-4535-8d96-62fe1ad80fcd"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:21:04.152886 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-7990b5b0-f5f5-4b2a-b0a7-ed7290154f47 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] validate_networks() for [('b78fcdef-7b60-4535-8d96-62fe1ad80fcd', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:21:04.176847 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-60c03de3-f14a-4240-a424-c53cb14b8e62 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:04.177987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-60c03de3-f14a-4240-a424-c53cb14b8e62 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: 2653f39d-6b50-4a7c-b5c3-b792fe277e39] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:21:04.184663 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60c03de3-f14a-4240-a424-c53cb14b8e62 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:04.185892 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60c03de3-f14a-4240-a424-c53cb14b8e62 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:04.186359 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60c03de3-f14a-4240-a424-c53cb14b8e62 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:04.187680 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60c03de3-f14a-4240-a424-c53cb14b8e62 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:04.188158 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60c03de3-f14a-4240-a424-c53cb14b8e62 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:04.188597 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60c03de3-f14a-4240-a424-c53cb14b8e62 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:04.292540 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-60c03de3-f14a-4240-a424-c53cb14b8e62 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:21:04.308566 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-60c03de3-f14a-4240-a424-c53cb14b8e62 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/2653f39d-6b50-4a7c-b5c3-b792fe277e39" status: 200 len: 1307 microversion: 2.1 time: 0.133764 Sep 17 21:21:04.309178 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2772/5628] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:21:04 2022] GET /compute/v2.1/servers/2653f39d-6b50-4a7c-b5c3-b792fe277e39 => generated 1307 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:21:04.631815 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-7990b5b0-f5f5-4b2a-b0a7-ed7290154f47 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:21:04.632244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-7990b5b0-f5f5-4b2a-b0a7-ed7290154f47 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:21:04.633014 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-7990b5b0-f5f5-4b2a-b0a7-ed7290154f47 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:21:04.633787 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-7990b5b0-f5f5-4b2a-b0a7-ed7290154f47 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:21:04.635202 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-7990b5b0-f5f5-4b2a-b0a7-ed7290154f47 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:21:04.646551 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7990b5b0-f5f5-4b2a-b0a7-ed7290154f47 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:04.647495 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7990b5b0-f5f5-4b2a-b0a7-ed7290154f47 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:04.647987 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7990b5b0-f5f5-4b2a-b0a7-ed7290154f47 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:04.648731 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7990b5b0-f5f5-4b2a-b0a7-ed7290154f47 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:04.650227 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7990b5b0-f5f5-4b2a-b0a7-ed7290154f47 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:04.651187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7990b5b0-f5f5-4b2a-b0a7-ed7290154f47 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:04.671303 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-7990b5b0-f5f5-4b2a-b0a7-ed7290154f47 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Getting quotas for project 335955c0be3743eda2541b7d04ed2e06. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:21:04.680769 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-7990b5b0-f5f5-4b2a-b0a7-ed7290154f47 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Getting quotas for user fd15b9d354eb44b0bfa83bcdcf5c1384 and project 335955c0be3743eda2541b7d04ed2e06. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:21:04.695477 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7990b5b0-f5f5-4b2a-b0a7-ed7290154f47 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:21:04.697878 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7990b5b0-f5f5-4b2a-b0a7-ed7290154f47 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 1c627545-2251-49ec-90d8-fa8b5aa77f01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:21:04.747834 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7990b5b0-f5f5-4b2a-b0a7-ed7290154f47 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.666495 Sep 17 21:21:04.749055 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2857/5629] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:21:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:21:04.762309 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-42c0c475-9c82-4094-ad00-2d317dc2a919 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:04.763107 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-42c0c475-9c82-4094-ad00-2d317dc2a919 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 1c627545-2251-49ec-90d8-fa8b5aa77f01] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:21:04.914886 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-42c0c475-9c82-4094-ad00-2d317dc2a919 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd15b9d354eb44b0bfa83bcdcf5c1384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335955c0be3743eda2541b7d04ed2e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:21:04.925349 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-42c0c475-9c82-4094-ad00-2d317dc2a919 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "GET /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01" status: 200 len: 1219 microversion: 2.1 time: 0.168175 Sep 17 21:21:04.937483 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2773/5630] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:21:04 2022] GET /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01 => generated 1219 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:21:05.332994 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-76e8cd42-c343-4e70-867a-419c2bfb4712 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:05.333822 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-76e8cd42-c343-4e70-867a-419c2bfb4712 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: 2653f39d-6b50-4a7c-b5c3-b792fe277e39] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:21:05.350619 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76e8cd42-c343-4e70-867a-419c2bfb4712 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:05.350911 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76e8cd42-c343-4e70-867a-419c2bfb4712 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:05.354297 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76e8cd42-c343-4e70-867a-419c2bfb4712 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:05.355086 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76e8cd42-c343-4e70-867a-419c2bfb4712 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:05.355557 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76e8cd42-c343-4e70-867a-419c2bfb4712 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:05.355990 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-76e8cd42-c343-4e70-867a-419c2bfb4712 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:05.597059 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-76e8cd42-c343-4e70-867a-419c2bfb4712 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:21:05.606831 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-76e8cd42-c343-4e70-867a-419c2bfb4712 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/2653f39d-6b50-4a7c-b5c3-b792fe277e39" status: 200 len: 1375 microversion: 2.1 time: 0.277953 Sep 17 21:21:05.610269 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2858/5631] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:21:05 2022] GET /compute/v2.1/servers/2653f39d-6b50-4a7c-b5c3-b792fe277e39 => generated 1375 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:21:05.953254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cc378448-78cb-42c7-aa6a-7cd2649bec87 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:05.955164 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cc378448-78cb-42c7-aa6a-7cd2649bec87 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 1c627545-2251-49ec-90d8-fa8b5aa77f01] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:21:05.964622 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc378448-78cb-42c7-aa6a-7cd2649bec87 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:05.968788 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc378448-78cb-42c7-aa6a-7cd2649bec87 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:05.969708 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc378448-78cb-42c7-aa6a-7cd2649bec87 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:05.970710 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc378448-78cb-42c7-aa6a-7cd2649bec87 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:05.971691 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc378448-78cb-42c7-aa6a-7cd2649bec87 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:05.972617 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cc378448-78cb-42c7-aa6a-7cd2649bec87 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:06.149155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cc378448-78cb-42c7-aa6a-7cd2649bec87 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd15b9d354eb44b0bfa83bcdcf5c1384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335955c0be3743eda2541b7d04ed2e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:21:06.166913 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cc378448-78cb-42c7-aa6a-7cd2649bec87 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "GET /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01" status: 200 len: 1271 microversion: 2.1 time: 0.215884 Sep 17 21:21:06.169940 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2774/5632] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:21:05 2022] GET /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01 => generated 1271 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:21:06.574528 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-5bf5de72-66dd-4363-81fa-1b9b2c5b38e5 req-ef02ee63-f37b-4bf8-a476-302446e67c67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2653f39d-6b50-4a7c-b5c3-b792fe277e39", "tag": "ea77b9b8-d37c-4ded-a7e6-e40e17999f9a"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:21:06.597710 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-5bf5de72-66dd-4363-81fa-1b9b2c5b38e5 req-ef02ee63-f37b-4bf8-a476-302446e67c67 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:06.599752 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-5bf5de72-66dd-4363-81fa-1b9b2c5b38e5 req-ef02ee63-f37b-4bf8-a476-302446e67c67 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:06.603441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-5bf5de72-66dd-4363-81fa-1b9b2c5b38e5 req-ef02ee63-f37b-4bf8-a476-302446e67c67 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:06.637508 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0f3b4fdb-6a86-486f-9c79-320a09bd0f7a tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:06.638155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0f3b4fdb-6a86-486f-9c79-320a09bd0f7a tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: 2653f39d-6b50-4a7c-b5c3-b792fe277e39] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:21:06.639021 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-5bf5de72-66dd-4363-81fa-1b9b2c5b38e5 req-ef02ee63-f37b-4bf8-a476-302446e67c67 service nova] Creating event network-changed:ea77b9b8-d37c-4ded-a7e6-e40e17999f9a for instance 2653f39d-6b50-4a7c-b5c3-b792fe277e39 on nch2-master-1 Sep 17 21:21:06.644512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0f3b4fdb-6a86-486f-9c79-320a09bd0f7a tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:06.645018 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0f3b4fdb-6a86-486f-9c79-320a09bd0f7a tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:06.645502 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0f3b4fdb-6a86-486f-9c79-320a09bd0f7a tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:06.646297 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0f3b4fdb-6a86-486f-9c79-320a09bd0f7a tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:06.646767 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0f3b4fdb-6a86-486f-9c79-320a09bd0f7a tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:06.647203 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0f3b4fdb-6a86-486f-9c79-320a09bd0f7a tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:06.653502 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-5bf5de72-66dd-4363-81fa-1b9b2c5b38e5 req-ef02ee63-f37b-4bf8-a476-302446e67c67 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083757 Sep 17 21:21:06.656438 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2859/5633] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:21:07.200931 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7e2aa599-c306-4f29-92bf-2f8ecd97ca01 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:07.201916 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7e2aa599-c306-4f29-92bf-2f8ecd97ca01 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 1c627545-2251-49ec-90d8-fa8b5aa77f01] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:21:07.212849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e2aa599-c306-4f29-92bf-2f8ecd97ca01 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:07.213416 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e2aa599-c306-4f29-92bf-2f8ecd97ca01 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:07.217112 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e2aa599-c306-4f29-92bf-2f8ecd97ca01 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:07.218075 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e2aa599-c306-4f29-92bf-2f8ecd97ca01 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:07.219419 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e2aa599-c306-4f29-92bf-2f8ecd97ca01 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:07.220017 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e2aa599-c306-4f29-92bf-2f8ecd97ca01 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:07.402047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0f3b4fdb-6a86-486f-9c79-320a09bd0f7a tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:21:07.410358 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0f3b4fdb-6a86-486f-9c79-320a09bd0f7a tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/2653f39d-6b50-4a7c-b5c3-b792fe277e39" status: 200 len: 1375 microversion: 2.1 time: 0.777401 Sep 17 21:21:07.411060 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7e2aa599-c306-4f29-92bf-2f8ecd97ca01 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd15b9d354eb44b0bfa83bcdcf5c1384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335955c0be3743eda2541b7d04ed2e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:21:07.421663 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2775/5634] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:21:06 2022] GET /compute/v2.1/servers/2653f39d-6b50-4a7c-b5c3-b792fe277e39 => generated 1375 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:21:07.429042 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7e2aa599-c306-4f29-92bf-2f8ecd97ca01 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "GET /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01" status: 200 len: 1277 microversion: 2.1 time: 0.232571 Sep 17 21:21:07.430039 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2860/5635] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:21:07 2022] GET /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01 => generated 1277 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:21:08.436859 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-63cae433-f4f5-46b1-a442-fc2cc77e6546 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:08.438327 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-63cae433-f4f5-46b1-a442-fc2cc77e6546 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: 2653f39d-6b50-4a7c-b5c3-b792fe277e39] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:21:08.449995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-63cae433-f4f5-46b1-a442-fc2cc77e6546 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:08.451023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-63cae433-f4f5-46b1-a442-fc2cc77e6546 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:08.451831 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-63cae433-f4f5-46b1-a442-fc2cc77e6546 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:08.453409 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-63cae433-f4f5-46b1-a442-fc2cc77e6546 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:08.453877 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-50ab9959-93c5-4219-991f-dc4a29acfc5c tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:08.454502 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-50ab9959-93c5-4219-991f-dc4a29acfc5c tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 1c627545-2251-49ec-90d8-fa8b5aa77f01] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:21:08.455105 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-63cae433-f4f5-46b1-a442-fc2cc77e6546 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:08.455707 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-63cae433-f4f5-46b1-a442-fc2cc77e6546 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:08.466697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50ab9959-93c5-4219-991f-dc4a29acfc5c tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:08.467557 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50ab9959-93c5-4219-991f-dc4a29acfc5c tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:08.468247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50ab9959-93c5-4219-991f-dc4a29acfc5c tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:08.469265 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50ab9959-93c5-4219-991f-dc4a29acfc5c tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:08.470229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50ab9959-93c5-4219-991f-dc4a29acfc5c tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:08.470884 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50ab9959-93c5-4219-991f-dc4a29acfc5c tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:08.869303 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-63cae433-f4f5-46b1-a442-fc2cc77e6546 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:21:08.883855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-50ab9959-93c5-4219-991f-dc4a29acfc5c tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd15b9d354eb44b0bfa83bcdcf5c1384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335955c0be3743eda2541b7d04ed2e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:21:08.884615 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-63cae433-f4f5-46b1-a442-fc2cc77e6546 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/2653f39d-6b50-4a7c-b5c3-b792fe277e39" status: 200 len: 1375 microversion: 2.1 time: 0.452950 Sep 17 21:21:08.886790 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2776/5636] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:21:08 2022] GET /compute/v2.1/servers/2653f39d-6b50-4a7c-b5c3-b792fe277e39 => generated 1375 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:21:08.895428 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-50ab9959-93c5-4219-991f-dc4a29acfc5c tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "GET /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01" status: 200 len: 1319 microversion: 2.1 time: 0.445401 Sep 17 21:21:08.896050 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2861/5637] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:21:08 2022] GET /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01 => generated 1319 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:21:09.678179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-5c8e059b-28ae-4af3-b388-9801e47eb4cb req-1c7fb60a-feab-4226-8b97-a11c4de8094d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c627545-2251-49ec-90d8-fa8b5aa77f01", "tag": "1904fe73-eb2e-4440-86db-9a7eab284519"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:21:09.712787 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-5c8e059b-28ae-4af3-b388-9801e47eb4cb req-1c7fb60a-feab-4226-8b97-a11c4de8094d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:09.713287 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-5c8e059b-28ae-4af3-b388-9801e47eb4cb req-1c7fb60a-feab-4226-8b97-a11c4de8094d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:09.713755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-5c8e059b-28ae-4af3-b388-9801e47eb4cb req-1c7fb60a-feab-4226-8b97-a11c4de8094d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:09.732243 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-5c8e059b-28ae-4af3-b388-9801e47eb4cb req-1c7fb60a-feab-4226-8b97-a11c4de8094d service nova] Creating event network-changed:1904fe73-eb2e-4440-86db-9a7eab284519 for instance 1c627545-2251-49ec-90d8-fa8b5aa77f01 on nch1-master-1 Sep 17 21:21:09.748656 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-5c8e059b-28ae-4af3-b388-9801e47eb4cb req-1c7fb60a-feab-4226-8b97-a11c4de8094d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083954 Sep 17 21:21:09.752285 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2777/5638] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:21:09.908450 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cbcdcd9c-84d5-4268-9dcd-8c5c47738736 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:09.909263 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cbcdcd9c-84d5-4268-9dcd-8c5c47738736 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: 2653f39d-6b50-4a7c-b5c3-b792fe277e39] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:21:09.921278 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbcdcd9c-84d5-4268-9dcd-8c5c47738736 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:09.923294 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbcdcd9c-84d5-4268-9dcd-8c5c47738736 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:09.924383 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dd345387-1742-4eed-89a9-729ce03fd1ab tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:09.925176 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dd345387-1742-4eed-89a9-729ce03fd1ab tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 1c627545-2251-49ec-90d8-fa8b5aa77f01] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:21:09.925628 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbcdcd9c-84d5-4268-9dcd-8c5c47738736 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:09.926701 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbcdcd9c-84d5-4268-9dcd-8c5c47738736 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:09.933794 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbcdcd9c-84d5-4268-9dcd-8c5c47738736 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:09.934676 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbcdcd9c-84d5-4268-9dcd-8c5c47738736 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:09.939158 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd345387-1742-4eed-89a9-729ce03fd1ab tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:09.939675 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd345387-1742-4eed-89a9-729ce03fd1ab tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:09.940301 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd345387-1742-4eed-89a9-729ce03fd1ab tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:09.947011 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd345387-1742-4eed-89a9-729ce03fd1ab tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:09.947925 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd345387-1742-4eed-89a9-729ce03fd1ab tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:09.949267 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd345387-1742-4eed-89a9-729ce03fd1ab tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:10.236951 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dd345387-1742-4eed-89a9-729ce03fd1ab tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd15b9d354eb44b0bfa83bcdcf5c1384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335955c0be3743eda2541b7d04ed2e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:21:10.248524 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dd345387-1742-4eed-89a9-729ce03fd1ab tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "GET /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01" status: 200 len: 1319 microversion: 2.1 time: 0.330484 Sep 17 21:21:10.249683 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2778/5639] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:21:09 2022] GET /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01 => generated 1319 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:21:10.320040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cbcdcd9c-84d5-4268-9dcd-8c5c47738736 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:21:10.331310 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cbcdcd9c-84d5-4268-9dcd-8c5c47738736 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/2653f39d-6b50-4a7c-b5c3-b792fe277e39" status: 200 len: 1375 microversion: 2.1 time: 0.426623 Sep 17 21:21:10.332542 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2862/5640] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:21:09 2022] GET /compute/v2.1/servers/2653f39d-6b50-4a7c-b5c3-b792fe277e39 => generated 1375 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:21:10.835763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-3703cf99-5c1b-4295-92b0-0a5ecd1c0151 req-921659ee-7a73-4c2c-86e6-9c8ac7193fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2653f39d-6b50-4a7c-b5c3-b792fe277e39", "name": "network-vif-plugged", "status": "completed", "tag": "ea77b9b8-d37c-4ded-a7e6-e40e17999f9a"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:21:10.846615 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-3703cf99-5c1b-4295-92b0-0a5ecd1c0151 req-921659ee-7a73-4c2c-86e6-9c8ac7193fa7 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:10.847183 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-3703cf99-5c1b-4295-92b0-0a5ecd1c0151 req-921659ee-7a73-4c2c-86e6-9c8ac7193fa7 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:10.847617 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-3703cf99-5c1b-4295-92b0-0a5ecd1c0151 req-921659ee-7a73-4c2c-86e6-9c8ac7193fa7 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:10.859358 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-3703cf99-5c1b-4295-92b0-0a5ecd1c0151 req-921659ee-7a73-4c2c-86e6-9c8ac7193fa7 service nova] Creating event network-vif-plugged:ea77b9b8-d37c-4ded-a7e6-e40e17999f9a for instance 2653f39d-6b50-4a7c-b5c3-b792fe277e39 on nch2-master-1 Sep 17 21:21:10.864575 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-3703cf99-5c1b-4295-92b0-0a5ecd1c0151 req-921659ee-7a73-4c2c-86e6-9c8ac7193fa7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032601 Sep 17 21:21:10.865254 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2779/5641] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:21:11.275187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d291a557-1ef6-4a13-b991-bfad3896fd19 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:11.276027 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d291a557-1ef6-4a13-b991-bfad3896fd19 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 1c627545-2251-49ec-90d8-fa8b5aa77f01] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:21:11.288529 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d291a557-1ef6-4a13-b991-bfad3896fd19 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:11.292798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d291a557-1ef6-4a13-b991-bfad3896fd19 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:11.293649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d291a557-1ef6-4a13-b991-bfad3896fd19 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:11.294439 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d291a557-1ef6-4a13-b991-bfad3896fd19 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:11.300626 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d291a557-1ef6-4a13-b991-bfad3896fd19 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:11.301220 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d291a557-1ef6-4a13-b991-bfad3896fd19 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:11.366853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c0e98237-432d-4034-bd33-1020632c2e1c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:11.367992 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c0e98237-432d-4034-bd33-1020632c2e1c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: 2653f39d-6b50-4a7c-b5c3-b792fe277e39] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:21:11.378929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0e98237-432d-4034-bd33-1020632c2e1c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:11.379439 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0e98237-432d-4034-bd33-1020632c2e1c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:11.382039 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0e98237-432d-4034-bd33-1020632c2e1c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:11.382823 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0e98237-432d-4034-bd33-1020632c2e1c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:11.383882 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0e98237-432d-4034-bd33-1020632c2e1c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:11.386332 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0e98237-432d-4034-bd33-1020632c2e1c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:11.606352 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d291a557-1ef6-4a13-b991-bfad3896fd19 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd15b9d354eb44b0bfa83bcdcf5c1384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335955c0be3743eda2541b7d04ed2e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:21:11.616255 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d291a557-1ef6-4a13-b991-bfad3896fd19 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "GET /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01" status: 200 len: 1319 microversion: 2.1 time: 0.347700 Sep 17 21:21:11.630874 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2863/5642] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:21:11 2022] GET /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01 => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:21:11.670022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:21:11.779713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c0e98237-432d-4034-bd33-1020632c2e1c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:21:11.796041 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c0e98237-432d-4034-bd33-1020632c2e1c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/2653f39d-6b50-4a7c-b5c3-b792fe277e39" status: 200 len: 1375 microversion: 2.1 time: 0.432349 Sep 17 21:21:11.798895 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2780/5643] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:21:11 2022] GET /compute/v2.1/servers/2653f39d-6b50-4a7c-b5c3-b792fe277e39 => generated 1375 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:21:12.644812 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bc585066-6297-4bce-8a54-2a88bcd2275a tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:12.647204 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bc585066-6297-4bce-8a54-2a88bcd2275a tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 1c627545-2251-49ec-90d8-fa8b5aa77f01] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:21:12.662188 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc585066-6297-4bce-8a54-2a88bcd2275a tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:12.662974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc585066-6297-4bce-8a54-2a88bcd2275a tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:12.666554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc585066-6297-4bce-8a54-2a88bcd2275a tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:12.670267 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc585066-6297-4bce-8a54-2a88bcd2275a tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:12.671173 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc585066-6297-4bce-8a54-2a88bcd2275a tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:12.672798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc585066-6297-4bce-8a54-2a88bcd2275a tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:12.824823 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d82069f7-0905-47a4-aa80-122a12efcb96 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:12.826501 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d82069f7-0905-47a4-aa80-122a12efcb96 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: 2653f39d-6b50-4a7c-b5c3-b792fe277e39] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:21:12.865721 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d82069f7-0905-47a4-aa80-122a12efcb96 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:12.869119 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d82069f7-0905-47a4-aa80-122a12efcb96 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:12.869863 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d82069f7-0905-47a4-aa80-122a12efcb96 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:12.870776 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d82069f7-0905-47a4-aa80-122a12efcb96 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:12.874785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d82069f7-0905-47a4-aa80-122a12efcb96 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:12.875832 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d82069f7-0905-47a4-aa80-122a12efcb96 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:13.120032 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bc585066-6297-4bce-8a54-2a88bcd2275a tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd15b9d354eb44b0bfa83bcdcf5c1384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335955c0be3743eda2541b7d04ed2e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:21:13.137572 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bc585066-6297-4bce-8a54-2a88bcd2275a tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "GET /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01" status: 200 len: 1319 microversion: 2.1 time: 0.499052 Sep 17 21:21:13.139235 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2864/5644] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:21:12 2022] GET /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01 => generated 1319 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:21:13.192500 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d82069f7-0905-47a4-aa80-122a12efcb96 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:21:13.201446 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d82069f7-0905-47a4-aa80-122a12efcb96 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/2653f39d-6b50-4a7c-b5c3-b792fe277e39" status: 200 len: 1548 microversion: 2.1 time: 0.380643 Sep 17 21:21:13.202567 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2781/5645] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:21:12 2022] GET /compute/v2.1/servers/2653f39d-6b50-4a7c-b5c3-b792fe277e39 => generated 1548 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:21:13.229521 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-97f7649e-4f77-4f98-8c93-6101a8174db8 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:13.230056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-97f7649e-4f77-4f98-8c93-6101a8174db8 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: 2653f39d-6b50-4a7c-b5c3-b792fe277e39] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:21:13.237338 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97f7649e-4f77-4f98-8c93-6101a8174db8 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:13.238595 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97f7649e-4f77-4f98-8c93-6101a8174db8 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:13.239242 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97f7649e-4f77-4f98-8c93-6101a8174db8 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:13.240790 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97f7649e-4f77-4f98-8c93-6101a8174db8 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:13.241432 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97f7649e-4f77-4f98-8c93-6101a8174db8 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:13.243389 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97f7649e-4f77-4f98-8c93-6101a8174db8 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:13.455298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-97f7649e-4f77-4f98-8c93-6101a8174db8 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:21:13.466687 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-97f7649e-4f77-4f98-8c93-6101a8174db8 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/2653f39d-6b50-4a7c-b5c3-b792fe277e39" status: 200 len: 1548 microversion: 2.1 time: 0.246182 Sep 17 21:21:13.468180 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2865/5646] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:21:13 2022] GET /compute/v2.1/servers/2653f39d-6b50-4a7c-b5c3-b792fe277e39 => generated 1548 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:21:14.163494 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6655ef3a-e99d-4995-ad37-e401d1582f2a tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:14.165623 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6655ef3a-e99d-4995-ad37-e401d1582f2a tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 1c627545-2251-49ec-90d8-fa8b5aa77f01] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:21:14.179921 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6655ef3a-e99d-4995-ad37-e401d1582f2a tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:14.182137 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6655ef3a-e99d-4995-ad37-e401d1582f2a tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:14.185084 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6655ef3a-e99d-4995-ad37-e401d1582f2a tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:14.186360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6655ef3a-e99d-4995-ad37-e401d1582f2a tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:14.191954 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6655ef3a-e99d-4995-ad37-e401d1582f2a tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:14.193669 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6655ef3a-e99d-4995-ad37-e401d1582f2a tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:14.406301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-71c4b706-dfd3-4861-b438-7cb411f9a655 req-ab0bf112-e1c5-49f7-ab25-8c044bf1b4d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c627545-2251-49ec-90d8-fa8b5aa77f01", "name": "network-vif-plugged", "status": "completed", "tag": "1904fe73-eb2e-4440-86db-9a7eab284519"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:21:14.425389 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-71c4b706-dfd3-4861-b438-7cb411f9a655 req-ab0bf112-e1c5-49f7-ab25-8c044bf1b4d0 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:14.431248 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-71c4b706-dfd3-4861-b438-7cb411f9a655 req-ab0bf112-e1c5-49f7-ab25-8c044bf1b4d0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:14.433128 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-71c4b706-dfd3-4861-b438-7cb411f9a655 req-ab0bf112-e1c5-49f7-ab25-8c044bf1b4d0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:14.464906 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6655ef3a-e99d-4995-ad37-e401d1582f2a tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd15b9d354eb44b0bfa83bcdcf5c1384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335955c0be3743eda2541b7d04ed2e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:21:14.484356 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-71c4b706-dfd3-4861-b438-7cb411f9a655 req-ab0bf112-e1c5-49f7-ab25-8c044bf1b4d0 service nova] Creating event network-vif-plugged:1904fe73-eb2e-4440-86db-9a7eab284519 for instance 1c627545-2251-49ec-90d8-fa8b5aa77f01 on nch1-master-1 Sep 17 21:21:14.484665 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6655ef3a-e99d-4995-ad37-e401d1582f2a tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "GET /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01" status: 200 len: 1319 microversion: 2.1 time: 0.326144 Sep 17 21:21:14.487213 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2782/5647] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:21:14 2022] GET /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01 => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:21:14.534476 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-71c4b706-dfd3-4861-b438-7cb411f9a655 req-ab0bf112-e1c5-49f7-ab25-8c044bf1b4d0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132022 Sep 17 21:21:14.535766 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2866/5648] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:21:15.510710 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-271e8534-bbb5-48bb-971e-b9f3a020d63b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:15.510710 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-271e8534-bbb5-48bb-971e-b9f3a020d63b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 1c627545-2251-49ec-90d8-fa8b5aa77f01] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:21:15.522832 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=8 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:21:15.530400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-271e8534-bbb5-48bb-971e-b9f3a020d63b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:15.530917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-271e8534-bbb5-48bb-971e-b9f3a020d63b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:15.531378 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-271e8534-bbb5-48bb-971e-b9f3a020d63b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:15.532120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-271e8534-bbb5-48bb-971e-b9f3a020d63b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:15.540684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-271e8534-bbb5-48bb-971e-b9f3a020d63b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:15.542247 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-271e8534-bbb5-48bb-971e-b9f3a020d63b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:16.091397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-271e8534-bbb5-48bb-971e-b9f3a020d63b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd15b9d354eb44b0bfa83bcdcf5c1384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335955c0be3743eda2541b7d04ed2e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:21:16.099938 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-271e8534-bbb5-48bb-971e-b9f3a020d63b tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "GET /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01" status: 200 len: 1319 microversion: 2.1 time: 0.594413 Sep 17 21:21:16.113170 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2783/5649] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:21:15 2022] GET /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01 => generated 1319 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:21:17.140115 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:21:17.141676 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=12 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:21:17.147735 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9c3e9e9d-172b-4312-ae6e-197ed2266aed tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:17.148688 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9c3e9e9d-172b-4312-ae6e-197ed2266aed tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 1c627545-2251-49ec-90d8-fa8b5aa77f01] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:21:17.172196 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9c3e9e9d-172b-4312-ae6e-197ed2266aed tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:17.172815 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9c3e9e9d-172b-4312-ae6e-197ed2266aed tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:17.173343 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9c3e9e9d-172b-4312-ae6e-197ed2266aed tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:17.174218 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9c3e9e9d-172b-4312-ae6e-197ed2266aed tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:17.174888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9c3e9e9d-172b-4312-ae6e-197ed2266aed tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:17.176747 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9c3e9e9d-172b-4312-ae6e-197ed2266aed tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:17.648696 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2b7db993-9034-452c-9ba2-4bfeae0a00c3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-22684703 tempest-PortsAdminExtendedAttrsIpV6TestJSON-22684703-project-admin] Calling method '.version_select at 0x7f25a44ef040>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:17.651264 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b7db993-9034-452c-9ba2-4bfeae0a00c3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-22684703 tempest-PortsAdminExtendedAttrsIpV6TestJSON-22684703-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:17.652040 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b7db993-9034-452c-9ba2-4bfeae0a00c3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-22684703 tempest-PortsAdminExtendedAttrsIpV6TestJSON-22684703-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:17.652737 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b7db993-9034-452c-9ba2-4bfeae0a00c3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-22684703 tempest-PortsAdminExtendedAttrsIpV6TestJSON-22684703-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:17.702227 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b7db993-9034-452c-9ba2-4bfeae0a00c3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-22684703 tempest-PortsAdminExtendedAttrsIpV6TestJSON-22684703-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:17.703104 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b7db993-9034-452c-9ba2-4bfeae0a00c3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-22684703 tempest-PortsAdminExtendedAttrsIpV6TestJSON-22684703-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:17.705083 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b7db993-9034-452c-9ba2-4bfeae0a00c3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-22684703 tempest-PortsAdminExtendedAttrsIpV6TestJSON-22684703-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:17.734852 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b7db993-9034-452c-9ba2-4bfeae0a00c3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-22684703 tempest-PortsAdminExtendedAttrsIpV6TestJSON-22684703-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:17.735778 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b7db993-9034-452c-9ba2-4bfeae0a00c3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-22684703 tempest-PortsAdminExtendedAttrsIpV6TestJSON-22684703-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:17.736417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b7db993-9034-452c-9ba2-4bfeae0a00c3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-22684703 tempest-PortsAdminExtendedAttrsIpV6TestJSON-22684703-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:17.744383 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2b7db993-9034-452c-9ba2-4bfeae0a00c3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-22684703 tempest-PortsAdminExtendedAttrsIpV6TestJSON-22684703-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.362419 Sep 17 21:21:17.745775 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2784/5650] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 21:21:17 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:21:18.046226 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9c3e9e9d-172b-4312-ae6e-197ed2266aed tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd15b9d354eb44b0bfa83bcdcf5c1384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335955c0be3743eda2541b7d04ed2e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:21:18.064239 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9c3e9e9d-172b-4312-ae6e-197ed2266aed tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "GET /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01" status: 200 len: 1507 microversion: 2.1 time: 0.924960 Sep 17 21:21:18.075188 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2867/5651] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:21:17 2022] GET /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01 => generated 1507 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:21:18.094557 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ad2484ce-9e3d-413d-8d16-d682916b076d tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b712483-f63f-4381-9968-4e3fa55f72b6", "device": "/dev/sdb"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:21:18.097595 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ad2484ce-9e3d-413d-8d16-d682916b076d tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 1c627545-2251-49ec-90d8-fa8b5aa77f01] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:21:18.114442 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad2484ce-9e3d-413d-8d16-d682916b076d tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:18.115257 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad2484ce-9e3d-413d-8d16-d682916b076d tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:18.115883 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad2484ce-9e3d-413d-8d16-d682916b076d tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:18.116799 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad2484ce-9e3d-413d-8d16-d682916b076d tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:18.117424 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad2484ce-9e3d-413d-8d16-d682916b076d tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:18.118418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad2484ce-9e3d-413d-8d16-d682916b076d tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:18.138999 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:21:18.461570 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ad2484ce-9e3d-413d-8d16-d682916b076d tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "POST /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.371445 Sep 17 21:21:18.463967 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2785/5652] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 17 21:21:18 2022] POST /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01/os-volume_attachments => generated 194 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:21:40.974906 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-57a515fc-c90f-4aad-a59e-294379fb6975 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:40.981640 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-57a515fc-c90f-4aad-a59e-294379fb6975 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: 2653f39d-6b50-4a7c-b5c3-b792fe277e39] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:21:40.985525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:21:40.986407 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:21:41.004198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57a515fc-c90f-4aad-a59e-294379fb6975 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:41.004698 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57a515fc-c90f-4aad-a59e-294379fb6975 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:41.005298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57a515fc-c90f-4aad-a59e-294379fb6975 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:41.006803 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57a515fc-c90f-4aad-a59e-294379fb6975 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:41.007439 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57a515fc-c90f-4aad-a59e-294379fb6975 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:41.007987 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-57a515fc-c90f-4aad-a59e-294379fb6975 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:41.072381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-57a515fc-c90f-4aad-a59e-294379fb6975 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: 2653f39d-6b50-4a7c-b5c3-b792fe277e39] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:21:41.238335 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-57a515fc-c90f-4aad-a59e-294379fb6975 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2653f39d-6b50-4a7c-b5c3-b792fe277e39" status: 204 len: 0 microversion: 2.1 time: 0.275247 Sep 17 21:21:41.239533 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2868/5653] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:21:40 2022] DELETE /compute/v2.1/servers/2653f39d-6b50-4a7c-b5c3-b792fe277e39 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:21:41.246425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:21:41.247274 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=9,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:21:41.251927 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-eace5014-38fd-4bce-8957-b74603d43a03 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:41.252899 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-eace5014-38fd-4bce-8957-b74603d43a03 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: 2653f39d-6b50-4a7c-b5c3-b792fe277e39] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:21:41.261139 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eace5014-38fd-4bce-8957-b74603d43a03 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:41.261817 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eace5014-38fd-4bce-8957-b74603d43a03 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:41.262493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eace5014-38fd-4bce-8957-b74603d43a03 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:41.263188 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eace5014-38fd-4bce-8957-b74603d43a03 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:41.263753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eace5014-38fd-4bce-8957-b74603d43a03 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:41.264254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eace5014-38fd-4bce-8957-b74603d43a03 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:41.613487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-eace5014-38fd-4bce-8957-b74603d43a03 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:21:41.623755 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-eace5014-38fd-4bce-8957-b74603d43a03 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/2653f39d-6b50-4a7c-b5c3-b792fe277e39" status: 200 len: 1554 microversion: 2.1 time: 0.379228 Sep 17 21:21:41.624383 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2786/5654] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:21:41 2022] GET /compute/v2.1/servers/2653f39d-6b50-4a7c-b5c3-b792fe277e39 => generated 1554 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:21:42.652167 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-034a9775-c134-41ea-b2f3-d1c370e3e74a tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:42.652917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-034a9775-c134-41ea-b2f3-d1c370e3e74a tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: 2653f39d-6b50-4a7c-b5c3-b792fe277e39] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:21:42.668814 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-034a9775-c134-41ea-b2f3-d1c370e3e74a tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:42.672165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-034a9775-c134-41ea-b2f3-d1c370e3e74a tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:42.675945 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-034a9775-c134-41ea-b2f3-d1c370e3e74a tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:42.677164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-034a9775-c134-41ea-b2f3-d1c370e3e74a tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:42.679075 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-034a9775-c134-41ea-b2f3-d1c370e3e74a tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:42.679785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-034a9775-c134-41ea-b2f3-d1c370e3e74a tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:43.284968 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-034a9775-c134-41ea-b2f3-d1c370e3e74a tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:21:43.307950 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-034a9775-c134-41ea-b2f3-d1c370e3e74a tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/2653f39d-6b50-4a7c-b5c3-b792fe277e39" status: 200 len: 1554 microversion: 2.1 time: 0.659799 Sep 17 21:21:43.309580 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2869/5655] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:21:42 2022] GET /compute/v2.1/servers/2653f39d-6b50-4a7c-b5c3-b792fe277e39 => generated 1554 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:21:43.653787 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-26be0873-7eee-436a-888f-76196ea1637f req-7b188622-b082-4d66-9717-cfd23efdfcbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2653f39d-6b50-4a7c-b5c3-b792fe277e39", "name": "network-vif-deleted", "tag": "ea77b9b8-d37c-4ded-a7e6-e40e17999f9a"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:21:43.668386 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-26be0873-7eee-436a-888f-76196ea1637f req-7b188622-b082-4d66-9717-cfd23efdfcbf service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:43.668931 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-26be0873-7eee-436a-888f-76196ea1637f req-7b188622-b082-4d66-9717-cfd23efdfcbf service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:43.670516 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-26be0873-7eee-436a-888f-76196ea1637f req-7b188622-b082-4d66-9717-cfd23efdfcbf service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:43.690903 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-26be0873-7eee-436a-888f-76196ea1637f req-7b188622-b082-4d66-9717-cfd23efdfcbf service nova] Creating event network-vif-deleted:ea77b9b8-d37c-4ded-a7e6-e40e17999f9a for instance 2653f39d-6b50-4a7c-b5c3-b792fe277e39 on nch2-master-1 Sep 17 21:21:43.698336 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-26be0873-7eee-436a-888f-76196ea1637f req-7b188622-b082-4d66-9717-cfd23efdfcbf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.298817 Sep 17 21:21:43.699207 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2787/5656] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:21:44.332640 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e042ce52-1626-41bf-9d7c-089715ce9451 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:44.334089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e042ce52-1626-41bf-9d7c-089715ce9451 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: 2653f39d-6b50-4a7c-b5c3-b792fe277e39] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:21:44.341973 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e042ce52-1626-41bf-9d7c-089715ce9451 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:44.342836 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e042ce52-1626-41bf-9d7c-089715ce9451 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:44.343762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e042ce52-1626-41bf-9d7c-089715ce9451 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:44.344667 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e042ce52-1626-41bf-9d7c-089715ce9451 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:44.345448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e042ce52-1626-41bf-9d7c-089715ce9451 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:44.345996 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e042ce52-1626-41bf-9d7c-089715ce9451 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:44.363932 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-e042ce52-1626-41bf-9d7c-089715ce9451 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] HTTP exception thrown: Instance 2653f39d-6b50-4a7c-b5c3-b792fe277e39 could not be found. Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e042ce52-1626-41bf-9d7c-089715ce9451 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Request method failure captured: Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/2653f39d-6b50-4a7c-b5c3-b792fe277e39 HTTP/1.1 Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjn6kl7FvnXMu3Kc7wevyIR3UQRPPoh-JGa9N-pWneCYHgEKoUAaSh1eBMCF-nrFPAoUjd-S_kj7rG2dQUdDwp79l_hD4mLbeh5CGyRKTo8qwbUeOE2LfQLWeJuCLodOk10yeKZ7Q3k-Qr462LoegF6ffChr7XnJD8PyE62AshHScSk Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 0608df66a18a4fb3855b6cd557ab2998 Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-TestNetworkBasicOps-17232086 Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0608df66a18a4fb3855b6cd557ab2998"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0608df66a18a4fb3855b6cd557ab2998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0608df66a18a4fb3855b6cd557ab2998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0608df66a18a4fb3855b6cd557ab2998", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-TestNetworkBasicOps-17232086 Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 0608df66a18a4fb3855b6cd557ab2998 Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-TestNetworkBasicOps-17232086 Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-TestNetworkBasicOps-17232086-project Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 2fc6b11f473e4231adf4278688619f24 Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-TestNetworkBasicOps-17232086-project Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 2653f39d-6b50-4a7c-b5c3-b792fe277e39 could not be found. Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '2653f39d-6b50-4a7c-b5c3-b792fe277e39'} Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2653f39d-6b50-4a7c-b5c3-b792fe277e39 could not be found. Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2653f39d-6b50-4a7c-b5c3-b792fe277e39 could not be found. Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:21:44.366894 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:21:44.373842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:21:44.373842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:21:44.373842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:21:44.373842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:21:44.373842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:21:44.373842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2653f39d-6b50-4a7c-b5c3-b792fe277e39 could not be found. Sep 17 21:21:44.373842 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:21:44.373842 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e042ce52-1626-41bf-9d7c-089715ce9451 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Returning 404 to user: Instance 2653f39d-6b50-4a7c-b5c3-b792fe277e39 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:21:44.373842 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e042ce52-1626-41bf-9d7c-089715ce9451 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/2653f39d-6b50-4a7c-b5c3-b792fe277e39" status: 404 len: 111 microversion: 2.1 time: 0.043293 Sep 17 21:21:44.373842 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2870/5657] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:21:44 2022] GET /compute/v2.1/servers/2653f39d-6b50-4a7c-b5c3-b792fe277e39 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:21:44.848937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2901ab64-e6e9-4fb8-a58c-a361cda97f3f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '.version_select at 0x7f25a5842a60>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:44.907199 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2901ab64-e6e9-4fb8-a58c-a361cda97f3f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1125234150" status: 202 len: 0 microversion: 2.1 time: 0.062809 Sep 17 21:21:44.909750 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2788/5658] 10.222.0.26 () {58 vars in 1257 bytes} [Sat Sep 17 21:21:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1125234150 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:21:49.041226 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0b20fe9e-ffa1-4c33-a014-bee9f848acf3 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:49.041797 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0b20fe9e-ffa1-4c33-a014-bee9f848acf3 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: b51655a7-eac5-4574-a0f8-7fe0e6947e06] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:21:49.047655 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-44d90cfc-6f87-4b75-8a13-c97e3051838e req-a5abde3a-9398-40d9-b4c7-cf0ee7886953 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b51655a7-eac5-4574-a0f8-7fe0e6947e06", "tag": "07c49d2c-b8e9-4258-b933-a4640b94a728"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:21:49.072918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b20fe9e-ffa1-4c33-a014-bee9f848acf3 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:49.073442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b20fe9e-ffa1-4c33-a014-bee9f848acf3 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:49.073965 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b20fe9e-ffa1-4c33-a014-bee9f848acf3 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:49.074676 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b20fe9e-ffa1-4c33-a014-bee9f848acf3 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:49.075139 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b20fe9e-ffa1-4c33-a014-bee9f848acf3 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:49.075584 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b20fe9e-ffa1-4c33-a014-bee9f848acf3 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:49.085344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-44d90cfc-6f87-4b75-8a13-c97e3051838e req-a5abde3a-9398-40d9-b4c7-cf0ee7886953 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:49.085344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-44d90cfc-6f87-4b75-8a13-c97e3051838e req-a5abde3a-9398-40d9-b4c7-cf0ee7886953 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:49.085344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-44d90cfc-6f87-4b75-8a13-c97e3051838e req-a5abde3a-9398-40d9-b4c7-cf0ee7886953 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:49.110283 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-44d90cfc-6f87-4b75-8a13-c97e3051838e req-a5abde3a-9398-40d9-b4c7-cf0ee7886953 service nova] Creating event network-changed:07c49d2c-b8e9-4258-b933-a4640b94a728 for instance b51655a7-eac5-4574-a0f8-7fe0e6947e06 on nch1-master-1 Sep 17 21:21:49.125815 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-44d90cfc-6f87-4b75-8a13-c97e3051838e req-a5abde3a-9398-40d9-b4c7-cf0ee7886953 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078287 Sep 17 21:21:49.133074 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2789/5659] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:21:49.146198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0b20fe9e-ffa1-4c33-a014-bee9f848acf3 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: b51655a7-eac5-4574-a0f8-7fe0e6947e06] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:21:49.349281 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0b20fe9e-ffa1-4c33-a014-bee9f848acf3 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b51655a7-eac5-4574-a0f8-7fe0e6947e06" status: 204 len: 0 microversion: 2.1 time: 0.311424 Sep 17 21:21:49.350189 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2871/5660] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:21:49 2022] DELETE /compute/v2.1/servers/b51655a7-eac5-4574-a0f8-7fe0e6947e06 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:21:49.363628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dcf6b113-1fd5-449b-b5e8-f6ed7c94c05b tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:49.365324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dcf6b113-1fd5-449b-b5e8-f6ed7c94c05b tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: b51655a7-eac5-4574-a0f8-7fe0e6947e06] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:21:49.399240 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dcf6b113-1fd5-449b-b5e8-f6ed7c94c05b tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:49.403047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dcf6b113-1fd5-449b-b5e8-f6ed7c94c05b tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:49.404036 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dcf6b113-1fd5-449b-b5e8-f6ed7c94c05b tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:49.405102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dcf6b113-1fd5-449b-b5e8-f6ed7c94c05b tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:49.405797 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dcf6b113-1fd5-449b-b5e8-f6ed7c94c05b tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:49.408473 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dcf6b113-1fd5-449b-b5e8-f6ed7c94c05b tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:50.054594 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dcf6b113-1fd5-449b-b5e8-f6ed7c94c05b tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:21:50.063644 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dcf6b113-1fd5-449b-b5e8-f6ed7c94c05b tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/b51655a7-eac5-4574-a0f8-7fe0e6947e06" status: 200 len: 1671 microversion: 2.1 time: 0.707046 Sep 17 21:21:50.079209 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2790/5661] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:21:49 2022] GET /compute/v2.1/servers/b51655a7-eac5-4574-a0f8-7fe0e6947e06 => generated 1671 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:21:51.089684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5fccabbd-18ab-4fec-98c9-f718640fe638 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:51.090552 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5fccabbd-18ab-4fec-98c9-f718640fe638 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: b51655a7-eac5-4574-a0f8-7fe0e6947e06] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:21:51.108987 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5fccabbd-18ab-4fec-98c9-f718640fe638 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:51.110719 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5fccabbd-18ab-4fec-98c9-f718640fe638 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:51.111950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5fccabbd-18ab-4fec-98c9-f718640fe638 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:51.112972 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5fccabbd-18ab-4fec-98c9-f718640fe638 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:51.113694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5fccabbd-18ab-4fec-98c9-f718640fe638 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:51.114329 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5fccabbd-18ab-4fec-98c9-f718640fe638 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:51.450629 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5fccabbd-18ab-4fec-98c9-f718640fe638 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:21:51.461322 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5fccabbd-18ab-4fec-98c9-f718640fe638 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/b51655a7-eac5-4574-a0f8-7fe0e6947e06" status: 200 len: 1671 microversion: 2.1 time: 0.375967 Sep 17 21:21:51.464583 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2872/5662] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:21:51 2022] GET /compute/v2.1/servers/b51655a7-eac5-4574-a0f8-7fe0e6947e06 => generated 1671 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:21:51.788122 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-089c61e7-52b5-43b8-b83f-d2fb7588c61c req-7d0608fc-b484-432d-ab85-62dd4f074a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b51655a7-eac5-4574-a0f8-7fe0e6947e06", "name": "network-vif-deleted", "tag": "07c49d2c-b8e9-4258-b933-a4640b94a728"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:21:51.798030 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-089c61e7-52b5-43b8-b83f-d2fb7588c61c req-7d0608fc-b484-432d-ab85-62dd4f074a0f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:51.798531 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-089c61e7-52b5-43b8-b83f-d2fb7588c61c req-7d0608fc-b484-432d-ab85-62dd4f074a0f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:51.798981 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-089c61e7-52b5-43b8-b83f-d2fb7588c61c req-7d0608fc-b484-432d-ab85-62dd4f074a0f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:51.812174 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-089c61e7-52b5-43b8-b83f-d2fb7588c61c req-7d0608fc-b484-432d-ab85-62dd4f074a0f service nova] Creating event network-vif-deleted:07c49d2c-b8e9-4258-b933-a4640b94a728 for instance b51655a7-eac5-4574-a0f8-7fe0e6947e06 on nch1-master-1 Sep 17 21:21:51.818642 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-089c61e7-52b5-43b8-b83f-d2fb7588c61c req-7d0608fc-b484-432d-ab85-62dd4f074a0f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035231 Sep 17 21:21:51.819330 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2791/5663] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:21:52.491380 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-012074ab-69e4-4479-9bc3-b97c0d85a734 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:52.493122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-012074ab-69e4-4479-9bc3-b97c0d85a734 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: b51655a7-eac5-4574-a0f8-7fe0e6947e06] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:21:52.501057 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-012074ab-69e4-4479-9bc3-b97c0d85a734 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:52.501808 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-012074ab-69e4-4479-9bc3-b97c0d85a734 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:52.502512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-012074ab-69e4-4479-9bc3-b97c0d85a734 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:52.503243 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-012074ab-69e4-4479-9bc3-b97c0d85a734 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:21:52.503728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-012074ab-69e4-4479-9bc3-b97c0d85a734 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:21:52.504359 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-012074ab-69e4-4479-9bc3-b97c0d85a734 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:21:52.543137 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-012074ab-69e4-4479-9bc3-b97c0d85a734 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] HTTP exception thrown: Instance b51655a7-eac5-4574-a0f8-7fe0e6947e06 could not be found. Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-012074ab-69e4-4479-9bc3-b97c0d85a734 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Request method failure captured: Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/b51655a7-eac5-4574-a0f8-7fe0e6947e06 HTTP/1.1 Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjn6kl7FvnXMu3Kc7wevyIR3UQRPPoh-JGa9N-pWneCYHgEKoUAaSh1eBMCF-nrFPAoUjd-S_kj7rG2dQUdDwp79l_hD4mLbeh5CGyRKTo8qwbUeOE2LfQLWeJuCLodOk10yeKZ7Q3k-Qr462LoegF6ffChr7XnJD8PyE62AshHScSk Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 0608df66a18a4fb3855b6cd557ab2998 Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-TestNetworkBasicOps-17232086 Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0608df66a18a4fb3855b6cd557ab2998"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0608df66a18a4fb3855b6cd557ab2998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0608df66a18a4fb3855b6cd557ab2998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0608df66a18a4fb3855b6cd557ab2998", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-TestNetworkBasicOps-17232086 Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 0608df66a18a4fb3855b6cd557ab2998 Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-TestNetworkBasicOps-17232086 Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-TestNetworkBasicOps-17232086-project Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 2fc6b11f473e4231adf4278688619f24 Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-TestNetworkBasicOps-17232086-project Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance b51655a7-eac5-4574-a0f8-7fe0e6947e06 could not be found. Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'b51655a7-eac5-4574-a0f8-7fe0e6947e06'} Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b51655a7-eac5-4574-a0f8-7fe0e6947e06 could not be found. Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b51655a7-eac5-4574-a0f8-7fe0e6947e06 could not be found. Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:21:52.545143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:21:52.552791 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:21:52.552791 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:21:52.552791 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:21:52.552791 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:21:52.552791 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:21:52.552791 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b51655a7-eac5-4574-a0f8-7fe0e6947e06 could not be found. Sep 17 21:21:52.552791 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:21:52.552791 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-012074ab-69e4-4479-9bc3-b97c0d85a734 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Returning 404 to user: Instance b51655a7-eac5-4574-a0f8-7fe0e6947e06 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:21:52.555028 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-012074ab-69e4-4479-9bc3-b97c0d85a734 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/b51655a7-eac5-4574-a0f8-7fe0e6947e06" status: 404 len: 111 microversion: 2.1 time: 0.066235 Sep 17 21:21:52.555028 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2873/5664] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:21:52 2022] GET /compute/v2.1/servers/b51655a7-eac5-4574-a0f8-7fe0e6947e06 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:21:52.833121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-42b6873e-7114-4e68-bbb1-6a4f943b10b0 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '.version_select at 0x7f25a4fc4310>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:21:52.859717 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-42b6873e-7114-4e68-bbb1-6a4f943b10b0 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1557770465" status: 202 len: 0 microversion: 2.1 time: 0.031957 Sep 17 21:21:52.861409 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2792/5665] 10.222.0.26 () {58 vars in 1257 bytes} [Sat Sep 17 21:21:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1557770465 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:22:06.787529 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:22:06.787938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:22:07.067497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-45f27bf2-da3e-4e0c-84f0-014d04ef8e06 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Action: 'create', calling method: .version_select at 0x7f25a510b160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-705621159", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBErfCD5L0ICCB2gw7dEwGEUONihuDNovNVqbljjbX//QAnaHo+/bbQg9I1VR3v/fCrTwQ8CBfP34IowaaLJfTuHX5qjD875FqHKgmPrmnr80/WlIiZYm2jmfPLwAv/sdRA=="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:22:07.087197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=18 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:22:07.087885 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:22:07.135761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f50f39c8-3e8f-41c4-a44b-efa8b1c50064 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:07.136101 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f50f39c8-3e8f-41c4-a44b-efa8b1c50064 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] [instance: 4cf30912-b358-44af-ae25-2ce3f03ffd19] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:07.146593 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f50f39c8-3e8f-41c4-a44b-efa8b1c50064 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:07.147763 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f50f39c8-3e8f-41c4-a44b-efa8b1c50064 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:07.148396 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f50f39c8-3e8f-41c4-a44b-efa8b1c50064 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:07.150503 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f50f39c8-3e8f-41c4-a44b-efa8b1c50064 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:07.151245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f50f39c8-3e8f-41c4-a44b-efa8b1c50064 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:07.151929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f50f39c8-3e8f-41c4-a44b-efa8b1c50064 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:07.155089 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-45f27bf2-da3e-4e0c-84f0-014d04ef8e06 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Getting quotas for project 0608df66a18a4fb3855b6cd557ab2998. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:22:07.182027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-45f27bf2-da3e-4e0c-84f0-014d04ef8e06 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Getting quotas for user 2fc6b11f473e4231adf4278688619f24 and project 0608df66a18a4fb3855b6cd557ab2998. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:22:07.198069 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f50f39c8-3e8f-41c4-a44b-efa8b1c50064 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] [instance: 4cf30912-b358-44af-ae25-2ce3f03ffd19] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:22:07.253934 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-45f27bf2-da3e-4e0c-84f0-014d04ef8e06 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.190664 Sep 17 21:22:07.262476 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2793/5666] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:22:07 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:22:07.479350 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f50f39c8-3e8f-41c4-a44b-efa8b1c50064 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19" status: 204 len: 0 microversion: 2.1 time: 0.699226 Sep 17 21:22:07.484886 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2874/5667] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:22:06 2022] DELETE /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:22:07.490383 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8a75d77c-e419-41f2-a8e1-20dfcc02de2a tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:07.491147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8a75d77c-e419-41f2-a8e1-20dfcc02de2a tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] [instance: 4cf30912-b358-44af-ae25-2ce3f03ffd19] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:07.500069 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8a75d77c-e419-41f2-a8e1-20dfcc02de2a tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:07.500572 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8a75d77c-e419-41f2-a8e1-20dfcc02de2a tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:07.501023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8a75d77c-e419-41f2-a8e1-20dfcc02de2a tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:07.501776 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8a75d77c-e419-41f2-a8e1-20dfcc02de2a tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:07.521484 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8a75d77c-e419-41f2-a8e1-20dfcc02de2a tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:07.521484 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8a75d77c-e419-41f2-a8e1-20dfcc02de2a tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:07.912868 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8a75d77c-e419-41f2-a8e1-20dfcc02de2a tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6cec0e04954a3eba096b48a7cd2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f16a815901466791a114b9a19cc763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:22:07.928090 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8a75d77c-e419-41f2-a8e1-20dfcc02de2a tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] 10.222.0.26 "GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19" status: 200 len: 1732 microversion: 2.1 time: 0.441656 Sep 17 21:22:07.928814 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2794/5668] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:07 2022] GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19 => generated 1732 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:22:08.953643 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-015ab3b2-091e-438d-808d-64a70c38feb4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:08.954282 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-015ab3b2-091e-438d-808d-64a70c38feb4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] [instance: 4cf30912-b358-44af-ae25-2ce3f03ffd19] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:08.969362 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-015ab3b2-091e-438d-808d-64a70c38feb4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:08.969916 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-015ab3b2-091e-438d-808d-64a70c38feb4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:08.970372 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-015ab3b2-091e-438d-808d-64a70c38feb4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:08.971119 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-015ab3b2-091e-438d-808d-64a70c38feb4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:08.971584 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-015ab3b2-091e-438d-808d-64a70c38feb4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:08.972022 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-015ab3b2-091e-438d-808d-64a70c38feb4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:09.518704 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-015ab3b2-091e-438d-808d-64a70c38feb4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6cec0e04954a3eba096b48a7cd2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f16a815901466791a114b9a19cc763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:22:09.546508 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-015ab3b2-091e-438d-808d-64a70c38feb4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] 10.222.0.26 "GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19" status: 200 len: 1732 microversion: 2.1 time: 0.598053 Sep 17 21:22:09.574965 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2875/5669] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:08 2022] GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19 => generated 1732 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:22:10.615102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5ad56bf8-4d16-44c6-98c6-c5be29346c0a tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:10.617626 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5ad56bf8-4d16-44c6-98c6-c5be29346c0a tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] [instance: 4cf30912-b358-44af-ae25-2ce3f03ffd19] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:10.635817 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ad56bf8-4d16-44c6-98c6-c5be29346c0a tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:10.638006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ad56bf8-4d16-44c6-98c6-c5be29346c0a tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:10.639338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ad56bf8-4d16-44c6-98c6-c5be29346c0a tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:10.640278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ad56bf8-4d16-44c6-98c6-c5be29346c0a tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:10.641799 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ad56bf8-4d16-44c6-98c6-c5be29346c0a tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:10.645311 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5ad56bf8-4d16-44c6-98c6-c5be29346c0a tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:11.200105 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5ad56bf8-4d16-44c6-98c6-c5be29346c0a tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6cec0e04954a3eba096b48a7cd2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f16a815901466791a114b9a19cc763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:22:11.224358 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5ad56bf8-4d16-44c6-98c6-c5be29346c0a tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] 10.222.0.26 "GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19" status: 200 len: 1732 microversion: 2.1 time: 0.623265 Sep 17 21:22:11.251315 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2795/5670] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:10 2022] GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19 => generated 1732 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:22:12.255417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8f54254c-d28a-4a34-9779-0f98423f89b4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:12.264687 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8f54254c-d28a-4a34-9779-0f98423f89b4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] [instance: 4cf30912-b358-44af-ae25-2ce3f03ffd19] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:12.295281 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f54254c-d28a-4a34-9779-0f98423f89b4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:12.298709 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f54254c-d28a-4a34-9779-0f98423f89b4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:12.302405 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f54254c-d28a-4a34-9779-0f98423f89b4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:12.305201 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f54254c-d28a-4a34-9779-0f98423f89b4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:12.306612 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f54254c-d28a-4a34-9779-0f98423f89b4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:12.307692 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f54254c-d28a-4a34-9779-0f98423f89b4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:12.417271 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8f54254c-d28a-4a34-9779-0f98423f89b4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6cec0e04954a3eba096b48a7cd2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f16a815901466791a114b9a19cc763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:22:12.451329 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8f54254c-d28a-4a34-9779-0f98423f89b4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] 10.222.0.26 "GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19" status: 200 len: 1664 microversion: 2.1 time: 0.202582 Sep 17 21:22:12.451940 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2876/5671] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:12 2022] GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19 => generated 1664 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:22:12.941989 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-11af91a9-5c6f-425d-8b45-ee4b8921d132 req-6b5f18b1-49f7-41cb-a09c-9440ec519b79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cf30912-b358-44af-ae25-2ce3f03ffd19", "name": "network-vif-deleted", "tag": "b1a0e827-d369-4e5b-9d28-d813cfa10e95"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:22:12.960839 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-11af91a9-5c6f-425d-8b45-ee4b8921d132 req-6b5f18b1-49f7-41cb-a09c-9440ec519b79 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:12.961734 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-11af91a9-5c6f-425d-8b45-ee4b8921d132 req-6b5f18b1-49f7-41cb-a09c-9440ec519b79 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:12.962359 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-11af91a9-5c6f-425d-8b45-ee4b8921d132 req-6b5f18b1-49f7-41cb-a09c-9440ec519b79 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:12.988522 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-11af91a9-5c6f-425d-8b45-ee4b8921d132 req-6b5f18b1-49f7-41cb-a09c-9440ec519b79 service nova] Creating event network-vif-deleted:b1a0e827-d369-4e5b-9d28-d813cfa10e95 for instance 4cf30912-b358-44af-ae25-2ce3f03ffd19 on nch1-master-1 Sep 17 21:22:12.994525 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-11af91a9-5c6f-425d-8b45-ee4b8921d132 req-6b5f18b1-49f7-41cb-a09c-9440ec519b79 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056511 Sep 17 21:22:12.995746 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2796/5672] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:22:13.479186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9d70b039-49c0-4b09-88ba-ee5f6289e3d4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:13.480741 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9d70b039-49c0-4b09-88ba-ee5f6289e3d4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] [instance: 4cf30912-b358-44af-ae25-2ce3f03ffd19] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:13.496363 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d70b039-49c0-4b09-88ba-ee5f6289e3d4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:13.497030 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d70b039-49c0-4b09-88ba-ee5f6289e3d4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:13.497583 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d70b039-49c0-4b09-88ba-ee5f6289e3d4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:13.498527 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d70b039-49c0-4b09-88ba-ee5f6289e3d4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:13.499072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d70b039-49c0-4b09-88ba-ee5f6289e3d4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:13.500695 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d70b039-49c0-4b09-88ba-ee5f6289e3d4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:13.596072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d70b039-49c0-4b09-88ba-ee5f6289e3d4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:13.597133 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d70b039-49c0-4b09-88ba-ee5f6289e3d4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:13.599710 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9d70b039-49c0-4b09-88ba-ee5f6289e3d4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:13.601796 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-9d70b039-49c0-4b09-88ba-ee5f6289e3d4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lazy-loading 'fault' on Instance uuid 4cf30912-b358-44af-ae25-2ce3f03ffd19 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:22:13.658384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f68dcde1-6de7-4278-bf8b-fd29c6080d4e tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-238911335", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "62bdbf7c-ebd7-46ef-afd7-3d664fe1cb57"}], "key_name": "tempest-TestNetworkBasicOps-705621159", "security_groups": [{"name": "tempest-secgroup-smoke-2116494219"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:22:13.729849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9d70b039-49c0-4b09-88ba-ee5f6289e3d4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df6cec0e04954a3eba096b48a7cd2189', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f16a815901466791a114b9a19cc763', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:22:13.748431 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9d70b039-49c0-4b09-88ba-ee5f6289e3d4 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] 10.222.0.26 "GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19" status: 200 len: 1388 microversion: 2.1 time: 0.272195 Sep 17 21:22:13.768128 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2877/5673] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:13 2022] GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19 => generated 1388 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:22:13.903167 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-f68dcde1-6de7-4278-bf8b-fd29c6080d4e tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] validate_networks() for [('62bdbf7c-ebd7-46ef-afd7-3d664fe1cb57', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:22:14.721611 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-f68dcde1-6de7-4278-bf8b-fd29c6080d4e tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:22:14.722276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-f68dcde1-6de7-4278-bf8b-fd29c6080d4e tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:22:14.722738 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-f68dcde1-6de7-4278-bf8b-fd29c6080d4e tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:22:14.723163 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-f68dcde1-6de7-4278-bf8b-fd29c6080d4e tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:22:14.723640 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-f68dcde1-6de7-4278-bf8b-fd29c6080d4e tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:22:14.743647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f68dcde1-6de7-4278-bf8b-fd29c6080d4e tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:14.744032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f68dcde1-6de7-4278-bf8b-fd29c6080d4e tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:14.751133 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f68dcde1-6de7-4278-bf8b-fd29c6080d4e tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:14.755037 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f68dcde1-6de7-4278-bf8b-fd29c6080d4e tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:14.755616 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f68dcde1-6de7-4278-bf8b-fd29c6080d4e tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:14.756134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f68dcde1-6de7-4278-bf8b-fd29c6080d4e tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:14.789694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8841289d-1be8-4ac1-a1fb-e6ef9d0f35a6 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:14.791684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8841289d-1be8-4ac1-a1fb-e6ef9d0f35a6 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] [instance: 4cf30912-b358-44af-ae25-2ce3f03ffd19] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:14.805524 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-f68dcde1-6de7-4278-bf8b-fd29c6080d4e tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Getting quotas for project 0608df66a18a4fb3855b6cd557ab2998. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:22:14.816382 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-f68dcde1-6de7-4278-bf8b-fd29c6080d4e tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Getting quotas for user 2fc6b11f473e4231adf4278688619f24 and project 0608df66a18a4fb3855b6cd557ab2998. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:22:14.822995 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8841289d-1be8-4ac1-a1fb-e6ef9d0f35a6 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:14.824561 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8841289d-1be8-4ac1-a1fb-e6ef9d0f35a6 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:14.825569 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8841289d-1be8-4ac1-a1fb-e6ef9d0f35a6 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:14.826658 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8841289d-1be8-4ac1-a1fb-e6ef9d0f35a6 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:14.827337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8841289d-1be8-4ac1-a1fb-e6ef9d0f35a6 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:14.828352 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8841289d-1be8-4ac1-a1fb-e6ef9d0f35a6 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:14.839653 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f68dcde1-6de7-4278-bf8b-fd29c6080d4e tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:22:14.843493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f68dcde1-6de7-4278-bf8b-fd29c6080d4e tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:22:14.855408 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-8841289d-1be8-4ac1-a1fb-e6ef9d0f35a6 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] HTTP exception thrown: Instance 4cf30912-b358-44af-ae25-2ce3f03ffd19 could not be found. Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8841289d-1be8-4ac1-a1fb-e6ef9d0f35a6 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Request method failure captured: Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19 HTTP/1.1 Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjlGMU-KeEmYVuWLSkGCWn_epoRJMwY_GULK-3F2bo1kevX14sTCyKP2fFx8ScZesu6JBUssHflFJM7TfxY_-ikZRaiT0dZPJl6nOdGxpZyyASYZfc6rX_zpOCYNZd9Pvoxe52QnBm-MuH5Pw9s3PuSYa1rDxFfGwinN2yFfZesqTZw Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 09f16a815901466791a114b9a19cc763 Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-TestServerBasicOps-2044948529 Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09f16a815901466791a114b9a19cc763"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/09f16a815901466791a114b9a19cc763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09f16a815901466791a114b9a19cc763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_09f16a815901466791a114b9a19cc763", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-TestServerBasicOps-2044948529 Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 09f16a815901466791a114b9a19cc763 Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-TestServerBasicOps-2044948529 Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-TestServerBasicOps-2044948529-project Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: df6cec0e04954a3eba096b48a7cd2189 Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-TestServerBasicOps-2044948529-project Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 4cf30912-b358-44af-ae25-2ce3f03ffd19 could not be found. Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '4cf30912-b358-44af-ae25-2ce3f03ffd19'} Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cf30912-b358-44af-ae25-2ce3f03ffd19 could not be found. Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cf30912-b358-44af-ae25-2ce3f03ffd19 could not be found. Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:22:14.858433 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:22:14.864187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:22:14.864187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:22:14.864187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:22:14.864187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:22:14.864187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:22:14.864187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cf30912-b358-44af-ae25-2ce3f03ffd19 could not be found. Sep 17 21:22:14.864187 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:22:14.864187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8841289d-1be8-4ac1-a1fb-e6ef9d0f35a6 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Returning 404 to user: Instance 4cf30912-b358-44af-ae25-2ce3f03ffd19 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:22:14.868095 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8841289d-1be8-4ac1-a1fb-e6ef9d0f35a6 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] 10.222.0.26 "GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19" status: 404 len: 111 microversion: 2.1 time: 0.093565 Sep 17 21:22:14.868095 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2878/5674] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:14 2022] GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:22:14.935840 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f68dcde1-6de7-4278-bf8b-fd29c6080d4e tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.282002 Sep 17 21:22:14.942803 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2797/5675] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:22:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1284 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:22:14.950246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c779df08-ae3c-4015-b429-2845c85a8055 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:14.951458 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c779df08-ae3c-4015-b429-2845c85a8055 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:15.136265 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c779df08-ae3c-4015-b429-2845c85a8055 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:22:15.144286 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c779df08-ae3c-4015-b429-2845c85a8055 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383" status: 200 len: 1247 microversion: 2.1 time: 0.198985 Sep 17 21:22:15.144871 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2879/5676] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:14 2022] GET /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383 => generated 1247 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:22:15.947537 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-29b05d8f-155b-42af-8e57-ba24e429225b tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:15.948603 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-29b05d8f-155b-42af-8e57-ba24e429225b tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] [instance: 4cf30912-b358-44af-ae25-2ce3f03ffd19] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:15.960607 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-29b05d8f-155b-42af-8e57-ba24e429225b tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:15.961265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-29b05d8f-155b-42af-8e57-ba24e429225b tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:15.964362 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-29b05d8f-155b-42af-8e57-ba24e429225b tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:15.964362 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-29b05d8f-155b-42af-8e57-ba24e429225b tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:15.964362 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-29b05d8f-155b-42af-8e57-ba24e429225b tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:15.964362 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-29b05d8f-155b-42af-8e57-ba24e429225b tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:15.980307 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-29b05d8f-155b-42af-8e57-ba24e429225b tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] HTTP exception thrown: Instance 4cf30912-b358-44af-ae25-2ce3f03ffd19 could not be found. Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-29b05d8f-155b-42af-8e57-ba24e429225b tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Request method failure captured: Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19 HTTP/1.1 Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjlGMU-KeEmYVuWLSkGCWn_epoRJMwY_GULK-3F2bo1kevX14sTCyKP2fFx8ScZesu6JBUssHflFJM7TfxY_-ikZRaiT0dZPJl6nOdGxpZyyASYZfc6rX_zpOCYNZd9Pvoxe52QnBm-MuH5Pw9s3PuSYa1rDxFfGwinN2yFfZesqTZw Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 09f16a815901466791a114b9a19cc763 Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-TestServerBasicOps-2044948529 Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09f16a815901466791a114b9a19cc763"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/09f16a815901466791a114b9a19cc763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09f16a815901466791a114b9a19cc763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_09f16a815901466791a114b9a19cc763", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-TestServerBasicOps-2044948529 Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 09f16a815901466791a114b9a19cc763 Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-TestServerBasicOps-2044948529 Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-TestServerBasicOps-2044948529-project Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: df6cec0e04954a3eba096b48a7cd2189 Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-TestServerBasicOps-2044948529-project Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 4cf30912-b358-44af-ae25-2ce3f03ffd19 could not be found. Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '4cf30912-b358-44af-ae25-2ce3f03ffd19'} Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cf30912-b358-44af-ae25-2ce3f03ffd19 could not be found. Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:22:15.982552 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:22:15.989909 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cf30912-b358-44af-ae25-2ce3f03ffd19 could not be found. Sep 17 21:22:15.989909 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:22:15.989909 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:22:15.989909 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:22:15.989909 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:22:15.989909 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:22:15.989909 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:22:15.989909 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:22:15.989909 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:22:15.989909 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cf30912-b358-44af-ae25-2ce3f03ffd19 could not be found. Sep 17 21:22:15.989909 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:22:15.992303 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-29b05d8f-155b-42af-8e57-ba24e429225b tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Returning 404 to user: Instance 4cf30912-b358-44af-ae25-2ce3f03ffd19 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:22:15.993408 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-29b05d8f-155b-42af-8e57-ba24e429225b tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19" status: 404 len: 111 microversion: 2.1 time: 0.050212 Sep 17 21:22:15.994484 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2798/5677] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:22:15 2022] DELETE /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 21:22:16.003136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-225b36c4-c4ef-41da-8613-ded466afa4af tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:16.004533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-225b36c4-c4ef-41da-8613-ded466afa4af tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] [instance: 4cf30912-b358-44af-ae25-2ce3f03ffd19] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:16.022638 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-225b36c4-c4ef-41da-8613-ded466afa4af tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:16.023915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-225b36c4-c4ef-41da-8613-ded466afa4af tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:16.024656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-225b36c4-c4ef-41da-8613-ded466afa4af tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:16.027684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-225b36c4-c4ef-41da-8613-ded466afa4af tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:16.028873 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-225b36c4-c4ef-41da-8613-ded466afa4af tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:16.029360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-225b36c4-c4ef-41da-8613-ded466afa4af tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:16.051059 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-225b36c4-c4ef-41da-8613-ded466afa4af tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] HTTP exception thrown: Instance 4cf30912-b358-44af-ae25-2ce3f03ffd19 could not be found. Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-225b36c4-c4ef-41da-8613-ded466afa4af tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Request method failure captured: Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19 HTTP/1.1 Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjlGMU-KeEmYVuWLSkGCWn_epoRJMwY_GULK-3F2bo1kevX14sTCyKP2fFx8ScZesu6JBUssHflFJM7TfxY_-ikZRaiT0dZPJl6nOdGxpZyyASYZfc6rX_zpOCYNZd9Pvoxe52QnBm-MuH5Pw9s3PuSYa1rDxFfGwinN2yFfZesqTZw Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 09f16a815901466791a114b9a19cc763 Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-TestServerBasicOps-2044948529 Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09f16a815901466791a114b9a19cc763"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/09f16a815901466791a114b9a19cc763"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/09f16a815901466791a114b9a19cc763"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_09f16a815901466791a114b9a19cc763", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-TestServerBasicOps-2044948529 Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 09f16a815901466791a114b9a19cc763 Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-TestServerBasicOps-2044948529 Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-TestServerBasicOps-2044948529-project Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: df6cec0e04954a3eba096b48a7cd2189 Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-TestServerBasicOps-2044948529-project Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 4cf30912-b358-44af-ae25-2ce3f03ffd19 could not be found. Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '4cf30912-b358-44af-ae25-2ce3f03ffd19'} Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cf30912-b358-44af-ae25-2ce3f03ffd19 could not be found. Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cf30912-b358-44af-ae25-2ce3f03ffd19 could not be found. Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:22:16.052915 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:22:16.058597 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:22:16.058597 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:22:16.058597 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:22:16.058597 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:22:16.058597 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:22:16.058597 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cf30912-b358-44af-ae25-2ce3f03ffd19 could not be found. Sep 17 21:22:16.058597 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:22:16.059865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-225b36c4-c4ef-41da-8613-ded466afa4af tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Returning 404 to user: Instance 4cf30912-b358-44af-ae25-2ce3f03ffd19 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:22:16.061102 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-225b36c4-c4ef-41da-8613-ded466afa4af tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] 10.222.0.26 "GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19" status: 404 len: 111 microversion: 2.1 time: 0.062275 Sep 17 21:22:16.061908 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2880/5678] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:15 2022] GET /compute/v2.1/servers/4cf30912-b358-44af-ae25-2ce3f03ffd19 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:22:16.168798 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8d895c37-0a92-4a7b-ba29-2850cafb3b35 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:16.169751 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8d895c37-0a92-4a7b-ba29-2850cafb3b35 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:16.176146 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8d895c37-0a92-4a7b-ba29-2850cafb3b35 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:16.177009 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8d895c37-0a92-4a7b-ba29-2850cafb3b35 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:16.177721 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8d895c37-0a92-4a7b-ba29-2850cafb3b35 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:16.179009 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8d895c37-0a92-4a7b-ba29-2850cafb3b35 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:16.179536 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8d895c37-0a92-4a7b-ba29-2850cafb3b35 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:16.180167 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8d895c37-0a92-4a7b-ba29-2850cafb3b35 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:16.279977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8d895c37-0a92-4a7b-ba29-2850cafb3b35 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:22:16.300783 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8d895c37-0a92-4a7b-ba29-2850cafb3b35 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383" status: 200 len: 1299 microversion: 2.1 time: 0.135851 Sep 17 21:22:16.301417 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2799/5679] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:16 2022] GET /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383 => generated 1299 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:22:16.378458 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c7297651-a719-4ac8-ac8f-3abbc9f09cd2 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] Calling method '.version_select at 0x7f25a418c700>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:16.401190 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c7297651-a719-4ac8-ac8f-3abbc9f09cd2 tempest-TestServerBasicOps-2044948529 tempest-TestServerBasicOps-2044948529-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-637496389" status: 202 len: 0 microversion: 2.1 time: 0.027358 Sep 17 21:22:16.402013 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2881/5680] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Sep 17 21:22:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-637496389 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:22:17.324425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-570a1bea-0bee-475b-b6af-fe758d84ade3 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:17.325063 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-570a1bea-0bee-475b-b6af-fe758d84ade3 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:17.332663 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-570a1bea-0bee-475b-b6af-fe758d84ade3 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:17.333894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-570a1bea-0bee-475b-b6af-fe758d84ade3 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:17.334306 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-570a1bea-0bee-475b-b6af-fe758d84ade3 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:17.335267 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-570a1bea-0bee-475b-b6af-fe758d84ade3 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:17.335974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-570a1bea-0bee-475b-b6af-fe758d84ade3 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:17.336634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-570a1bea-0bee-475b-b6af-fe758d84ade3 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:17.416972 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-570a1bea-0bee-475b-b6af-fe758d84ade3 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:22:17.426226 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-570a1bea-0bee-475b-b6af-fe758d84ade3 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383" status: 200 len: 1305 microversion: 2.1 time: 0.105859 Sep 17 21:22:17.427869 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2800/5681] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:17 2022] GET /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383 => generated 1305 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:22:18.453375 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-746bf064-8b04-4adf-8188-814e4b4fff5f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:18.454130 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-746bf064-8b04-4adf-8188-814e4b4fff5f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:18.478855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-746bf064-8b04-4adf-8188-814e4b4fff5f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:18.479818 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-746bf064-8b04-4adf-8188-814e4b4fff5f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:18.480398 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-746bf064-8b04-4adf-8188-814e4b4fff5f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:18.481281 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-746bf064-8b04-4adf-8188-814e4b4fff5f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:18.481843 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-746bf064-8b04-4adf-8188-814e4b4fff5f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:18.483829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-746bf064-8b04-4adf-8188-814e4b4fff5f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:18.782775 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-746bf064-8b04-4adf-8188-814e4b4fff5f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:22:18.793070 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-746bf064-8b04-4adf-8188-814e4b4fff5f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383" status: 200 len: 1373 microversion: 2.1 time: 0.345791 Sep 17 21:22:18.794059 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2882/5682] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:18 2022] GET /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383 => generated 1373 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:22:19.818712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-729ac18a-2335-4d3a-bf36-c86b09892d6f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:19.819365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-729ac18a-2335-4d3a-bf36-c86b09892d6f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:19.829009 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-729ac18a-2335-4d3a-bf36-c86b09892d6f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:19.834508 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-729ac18a-2335-4d3a-bf36-c86b09892d6f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:19.836458 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-729ac18a-2335-4d3a-bf36-c86b09892d6f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:19.837677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-729ac18a-2335-4d3a-bf36-c86b09892d6f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:19.843366 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-729ac18a-2335-4d3a-bf36-c86b09892d6f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:19.844568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-729ac18a-2335-4d3a-bf36-c86b09892d6f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:20.098578 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-729ac18a-2335-4d3a-bf36-c86b09892d6f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:22:20.108164 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-729ac18a-2335-4d3a-bf36-c86b09892d6f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383" status: 200 len: 1373 microversion: 2.1 time: 0.293882 Sep 17 21:22:20.109318 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2801/5683] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:19 2022] GET /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383 => generated 1373 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:22:21.135466 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1c8b6bb1-0496-4ff1-b17f-c558102eb7b6 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:21.136909 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1c8b6bb1-0496-4ff1-b17f-c558102eb7b6 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:21.154261 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c8b6bb1-0496-4ff1-b17f-c558102eb7b6 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:21.162311 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c8b6bb1-0496-4ff1-b17f-c558102eb7b6 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:21.168069 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c8b6bb1-0496-4ff1-b17f-c558102eb7b6 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:21.175144 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c8b6bb1-0496-4ff1-b17f-c558102eb7b6 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:21.175833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c8b6bb1-0496-4ff1-b17f-c558102eb7b6 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:21.178411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c8b6bb1-0496-4ff1-b17f-c558102eb7b6 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:21.250399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-5e6d0358-6ba2-4eeb-911d-e9a7bb16f576 req-5cb6182b-f794-4b0c-a056-050cfb38e2ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383", "tag": "4a75b065-d53b-4fb0-88bc-df555ba2333e"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:22:21.272338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-5e6d0358-6ba2-4eeb-911d-e9a7bb16f576 req-5cb6182b-f794-4b0c-a056-050cfb38e2ed service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:21.273142 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-5e6d0358-6ba2-4eeb-911d-e9a7bb16f576 req-5cb6182b-f794-4b0c-a056-050cfb38e2ed service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:21.273817 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-5e6d0358-6ba2-4eeb-911d-e9a7bb16f576 req-5cb6182b-f794-4b0c-a056-050cfb38e2ed service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:21.298877 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-5e6d0358-6ba2-4eeb-911d-e9a7bb16f576 req-5cb6182b-f794-4b0c-a056-050cfb38e2ed service nova] Creating event network-changed:4a75b065-d53b-4fb0-88bc-df555ba2333e for instance e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383 on nch2-master-1 Sep 17 21:22:21.308560 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-5e6d0358-6ba2-4eeb-911d-e9a7bb16f576 req-5cb6182b-f794-4b0c-a056-050cfb38e2ed service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064162 Sep 17 21:22:21.317944 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2802/5684] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:22:21.689780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1c8b6bb1-0496-4ff1-b17f-c558102eb7b6 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:22:21.707984 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1c8b6bb1-0496-4ff1-b17f-c558102eb7b6 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383" status: 200 len: 1373 microversion: 2.1 time: 0.577271 Sep 17 21:22:21.711044 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2883/5685] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:21 2022] GET /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383 => generated 1373 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:22:22.742894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-28c5eab3-e3ab-469e-99af-3d317564ffdc tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:22.747706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-28c5eab3-e3ab-469e-99af-3d317564ffdc tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:22.762240 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-28c5eab3-e3ab-469e-99af-3d317564ffdc tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:22.762920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-28c5eab3-e3ab-469e-99af-3d317564ffdc tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:22.763722 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-28c5eab3-e3ab-469e-99af-3d317564ffdc tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:22.764630 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-28c5eab3-e3ab-469e-99af-3d317564ffdc tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:22.765180 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-28c5eab3-e3ab-469e-99af-3d317564ffdc tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:22.765953 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-28c5eab3-e3ab-469e-99af-3d317564ffdc tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:23.678861 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-28c5eab3-e3ab-469e-99af-3d317564ffdc tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:22:23.697173 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-28c5eab3-e3ab-469e-99af-3d317564ffdc tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383" status: 200 len: 1373 microversion: 2.1 time: 0.962049 Sep 17 21:22:23.710515 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2803/5686] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:22 2022] GET /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383 => generated 1373 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:22:24.724153 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a0584376-7d57-4180-b0b0-53177a2a962f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:24.725514 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a0584376-7d57-4180-b0b0-53177a2a962f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:24.732731 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0584376-7d57-4180-b0b0-53177a2a962f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:24.733500 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0584376-7d57-4180-b0b0-53177a2a962f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:24.734172 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0584376-7d57-4180-b0b0-53177a2a962f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:24.735120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0584376-7d57-4180-b0b0-53177a2a962f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:24.735787 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0584376-7d57-4180-b0b0-53177a2a962f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:24.736407 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0584376-7d57-4180-b0b0-53177a2a962f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:25.144480 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:22:25.335639 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a0584376-7d57-4180-b0b0-53177a2a962f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:22:25.358549 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a0584376-7d57-4180-b0b0-53177a2a962f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383" status: 200 len: 1373 microversion: 2.1 time: 0.639095 Sep 17 21:22:25.376707 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2884/5687] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:24 2022] GET /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383 => generated 1373 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:22:26.383253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c0519af8-48c3-478a-b4dd-0b79c329f289 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:26.384006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c0519af8-48c3-478a-b4dd-0b79c329f289 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:26.387237 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:22:26.389741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=10 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:22:26.399915 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0519af8-48c3-478a-b4dd-0b79c329f289 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:26.400729 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0519af8-48c3-478a-b4dd-0b79c329f289 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:26.401395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0519af8-48c3-478a-b4dd-0b79c329f289 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:26.402344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0519af8-48c3-478a-b4dd-0b79c329f289 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:26.403006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0519af8-48c3-478a-b4dd-0b79c329f289 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:26.403683 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0519af8-48c3-478a-b4dd-0b79c329f289 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:27.409404 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c0519af8-48c3-478a-b4dd-0b79c329f289 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:22:27.421727 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c0519af8-48c3-478a-b4dd-0b79c329f289 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383" status: 200 len: 1373 microversion: 2.1 time: 1.039700 Sep 17 21:22:27.441898 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2804/5688] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:26 2022] GET /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383 => generated 1373 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:22:27.816903 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-3c27d111-0e38-4c36-bf5c-4006d50e0cac req-64cde897-9d59-4ef1-bd80-2586e71137d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383", "name": "network-vif-plugged", "status": "completed", "tag": "4a75b065-d53b-4fb0-88bc-df555ba2333e"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:22:27.834821 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-3c27d111-0e38-4c36-bf5c-4006d50e0cac req-64cde897-9d59-4ef1-bd80-2586e71137d9 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:27.835732 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-3c27d111-0e38-4c36-bf5c-4006d50e0cac req-64cde897-9d59-4ef1-bd80-2586e71137d9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:27.836370 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-3c27d111-0e38-4c36-bf5c-4006d50e0cac req-64cde897-9d59-4ef1-bd80-2586e71137d9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:27.863141 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-3c27d111-0e38-4c36-bf5c-4006d50e0cac req-64cde897-9d59-4ef1-bd80-2586e71137d9 service nova] Creating event network-vif-plugged:4a75b065-d53b-4fb0-88bc-df555ba2333e for instance e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383 on nch2-master-1 Sep 17 21:22:27.879882 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-3c27d111-0e38-4c36-bf5c-4006d50e0cac req-64cde897-9d59-4ef1-bd80-2586e71137d9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.335208 Sep 17 21:22:27.880974 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2885/5689] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:22:28.450301 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b11b4da4-d8cf-4f22-aa8c-cb9302458241 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:28.452051 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b11b4da4-d8cf-4f22-aa8c-cb9302458241 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:28.470716 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b11b4da4-d8cf-4f22-aa8c-cb9302458241 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:28.474458 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b11b4da4-d8cf-4f22-aa8c-cb9302458241 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:28.476351 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b11b4da4-d8cf-4f22-aa8c-cb9302458241 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:28.479474 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b11b4da4-d8cf-4f22-aa8c-cb9302458241 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:28.486724 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b11b4da4-d8cf-4f22-aa8c-cb9302458241 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:28.488207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b11b4da4-d8cf-4f22-aa8c-cb9302458241 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:28.931184 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b11b4da4-d8cf-4f22-aa8c-cb9302458241 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:22:28.947295 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b11b4da4-d8cf-4f22-aa8c-cb9302458241 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383" status: 200 len: 1373 microversion: 2.1 time: 0.495350 Sep 17 21:22:28.961765 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2805/5690] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:28 2022] GET /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383 => generated 1373 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:22:29.979544 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ab951e68-350d-4a45-963f-f663f927d94f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:29.981791 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ab951e68-350d-4a45-963f-f663f927d94f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:29.996541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ab951e68-350d-4a45-963f-f663f927d94f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:29.998755 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ab951e68-350d-4a45-963f-f663f927d94f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:29.999488 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ab951e68-350d-4a45-963f-f663f927d94f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:30.000683 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ab951e68-350d-4a45-963f-f663f927d94f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:30.001892 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ab951e68-350d-4a45-963f-f663f927d94f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:30.002976 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ab951e68-350d-4a45-963f-f663f927d94f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:30.679266 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ab951e68-350d-4a45-963f-f663f927d94f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:22:30.689803 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ab951e68-350d-4a45-963f-f663f927d94f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383" status: 200 len: 1544 microversion: 2.1 time: 0.720934 Sep 17 21:22:30.691411 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2886/5691] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:29 2022] GET /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383 => generated 1544 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:22:30.716517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-da4c2e25-c58e-4346-9ebb-f404d7873d1f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:30.718638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-da4c2e25-c58e-4346-9ebb-f404d7873d1f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:30.729769 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da4c2e25-c58e-4346-9ebb-f404d7873d1f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:30.730514 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da4c2e25-c58e-4346-9ebb-f404d7873d1f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:30.731168 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da4c2e25-c58e-4346-9ebb-f404d7873d1f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:30.732095 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da4c2e25-c58e-4346-9ebb-f404d7873d1f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:30.732733 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da4c2e25-c58e-4346-9ebb-f404d7873d1f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:30.733343 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da4c2e25-c58e-4346-9ebb-f404d7873d1f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:30.984573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-da4c2e25-c58e-4346-9ebb-f404d7873d1f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:22:31.000596 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-da4c2e25-c58e-4346-9ebb-f404d7873d1f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383" status: 200 len: 1544 microversion: 2.1 time: 0.286436 Sep 17 21:22:31.001240 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2806/5692] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:30 2022] GET /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383 => generated 1544 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:22:36.380280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-8eb135b1-6d67-4356-a500-abb134a7ddf3 req-a77ecc32-acab-4001-b16f-2f7a3b7953a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383", "tag": "4a75b065-d53b-4fb0-88bc-df555ba2333e"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:22:36.413192 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8eb135b1-6d67-4356-a500-abb134a7ddf3 req-a77ecc32-acab-4001-b16f-2f7a3b7953a8 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:36.416187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8eb135b1-6d67-4356-a500-abb134a7ddf3 req-a77ecc32-acab-4001-b16f-2f7a3b7953a8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:36.422165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8eb135b1-6d67-4356-a500-abb134a7ddf3 req-a77ecc32-acab-4001-b16f-2f7a3b7953a8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:36.435677 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-8eb135b1-6d67-4356-a500-abb134a7ddf3 req-a77ecc32-acab-4001-b16f-2f7a3b7953a8 service nova] Creating event network-changed:4a75b065-d53b-4fb0-88bc-df555ba2333e for instance e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383 on nch2-master-1 Sep 17 21:22:36.441654 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-8eb135b1-6d67-4356-a500-abb134a7ddf3 req-a77ecc32-acab-4001-b16f-2f7a3b7953a8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065338 Sep 17 21:22:36.443188 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2887/5693] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:22:41.987778 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=4 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:22:41.988539 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=62 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:22:42.148374 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-11d9cf7b-388a-460e-9253-c247160b38fc tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:42.150183 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11d9cf7b-388a-460e-9253-c247160b38fc tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:42.150682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11d9cf7b-388a-460e-9253-c247160b38fc tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:42.151134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11d9cf7b-388a-460e-9253-c247160b38fc tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:42.151885 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11d9cf7b-388a-460e-9253-c247160b38fc tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:42.152351 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11d9cf7b-388a-460e-9253-c247160b38fc tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:42.152827 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-11d9cf7b-388a-460e-9253-c247160b38fc tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:42.207201 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-11d9cf7b-388a-460e-9253-c247160b38fc tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.224982 Sep 17 21:22:42.223314 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2807/5694] 10.222.0.26 () {58 vars in 1185 bytes} [Sat Sep 17 21:22:41 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:22:42.382168 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-94ac1bf6-66e7-47f1-bb4b-97ce8126304f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-84322997", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "f5d62f8e-9c57-4056-9340-bf4e70942547"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:22:42.405131 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:22:42.512407 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-94ac1bf6-66e7-47f1-bb4b-97ce8126304f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] validate_networks() for [('f5d62f8e-9c57-4056-9340-bf4e70942547', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:22:44.122615 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-94ac1bf6-66e7-47f1-bb4b-97ce8126304f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:22:44.123364 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-94ac1bf6-66e7-47f1-bb4b-97ce8126304f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:22:44.123511 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-94ac1bf6-66e7-47f1-bb4b-97ce8126304f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:22:44.123926 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-94ac1bf6-66e7-47f1-bb4b-97ce8126304f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:22:44.124538 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-94ac1bf6-66e7-47f1-bb4b-97ce8126304f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:22:44.134697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94ac1bf6-66e7-47f1-bb4b-97ce8126304f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:44.135704 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94ac1bf6-66e7-47f1-bb4b-97ce8126304f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:44.136377 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94ac1bf6-66e7-47f1-bb4b-97ce8126304f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:44.137437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94ac1bf6-66e7-47f1-bb4b-97ce8126304f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:44.138152 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94ac1bf6-66e7-47f1-bb4b-97ce8126304f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:44.138809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94ac1bf6-66e7-47f1-bb4b-97ce8126304f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:44.146327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:22:44.165032 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-94ac1bf6-66e7-47f1-bb4b-97ce8126304f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Getting quotas for project 718efb2481024b278d50730fec729eeb. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:22:44.172168 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-94ac1bf6-66e7-47f1-bb4b-97ce8126304f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Getting quotas for user 70b0d8337e20432584f80476b46453f0 and project 718efb2481024b278d50730fec729eeb. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:22:44.193851 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-94ac1bf6-66e7-47f1-bb4b-97ce8126304f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:22:44.201984 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-94ac1bf6-66e7-47f1-bb4b-97ce8126304f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 7600edde-2420-4f54-8700-57b6662aab82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:22:44.281919 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-94ac1bf6-66e7-47f1-bb4b-97ce8126304f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.907078 Sep 17 21:22:44.283269 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2888/5695] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:22:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:22:44.294243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a616027a-93b5-4d7d-9cc3-c37af0e93bf3 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:44.295613 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a616027a-93b5-4d7d-9cc3-c37af0e93bf3 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 7600edde-2420-4f54-8700-57b6662aab82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:44.403989 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a616027a-93b5-4d7d-9cc3-c37af0e93bf3 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82" status: 200 len: 1327 microversion: 2.1 time: 0.113459 Sep 17 21:22:44.431120 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2808/5696] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:44 2022] GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82 => generated 1327 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:22:45.439323 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b2d90955-1e00-499d-b9f1-2f74e51afd28 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:45.440008 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b2d90955-1e00-499d-b9f1-2f74e51afd28 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 7600edde-2420-4f54-8700-57b6662aab82] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:45.477027 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b2d90955-1e00-499d-b9f1-2f74e51afd28 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:45.477757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b2d90955-1e00-499d-b9f1-2f74e51afd28 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:45.478325 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b2d90955-1e00-499d-b9f1-2f74e51afd28 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:45.484329 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b2d90955-1e00-499d-b9f1-2f74e51afd28 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:45.485137 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b2d90955-1e00-499d-b9f1-2f74e51afd28 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:45.486090 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b2d90955-1e00-499d-b9f1-2f74e51afd28 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:45.702903 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b2d90955-1e00-499d-b9f1-2f74e51afd28 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82" status: 200 len: 1344 microversion: 2.1 time: 0.265883 Sep 17 21:22:45.703798 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2889/5697] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:45 2022] GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82 => generated 1344 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:22:46.734430 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c1fbd247-a6a9-4513-8db2-989d6205ccf6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:46.735800 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c1fbd247-a6a9-4513-8db2-989d6205ccf6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 7600edde-2420-4f54-8700-57b6662aab82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:46.748218 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c1fbd247-a6a9-4513-8db2-989d6205ccf6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:46.749109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c1fbd247-a6a9-4513-8db2-989d6205ccf6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:46.750384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c1fbd247-a6a9-4513-8db2-989d6205ccf6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:46.754344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c1fbd247-a6a9-4513-8db2-989d6205ccf6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:46.755121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c1fbd247-a6a9-4513-8db2-989d6205ccf6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:46.755797 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c1fbd247-a6a9-4513-8db2-989d6205ccf6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:47.004909 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c1fbd247-a6a9-4513-8db2-989d6205ccf6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82" status: 200 len: 1432 microversion: 2.1 time: 0.273660 Sep 17 21:22:47.007375 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2809/5698] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:46 2022] GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82 => generated 1432 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:22:48.039056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bc4ff248-7a6d-4041-9423-99b5676ffb20 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:48.040694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bc4ff248-7a6d-4041-9423-99b5676ffb20 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 7600edde-2420-4f54-8700-57b6662aab82] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:48.071645 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc4ff248-7a6d-4041-9423-99b5676ffb20 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:48.081107 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc4ff248-7a6d-4041-9423-99b5676ffb20 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:48.089082 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc4ff248-7a6d-4041-9423-99b5676ffb20 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:48.095324 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc4ff248-7a6d-4041-9423-99b5676ffb20 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:48.096233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc4ff248-7a6d-4041-9423-99b5676ffb20 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:48.096953 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc4ff248-7a6d-4041-9423-99b5676ffb20 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:48.417664 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bc4ff248-7a6d-4041-9423-99b5676ffb20 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82" status: 200 len: 1420 microversion: 2.1 time: 0.376978 Sep 17 21:22:48.433378 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2890/5699] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:48 2022] GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82 => generated 1420 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:22:49.440636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e1550ac0-3e27-4d50-b2c5-aeddd003588a tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:49.441268 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e1550ac0-3e27-4d50-b2c5-aeddd003588a tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 7600edde-2420-4f54-8700-57b6662aab82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:49.455052 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e1550ac0-3e27-4d50-b2c5-aeddd003588a tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:49.455840 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e1550ac0-3e27-4d50-b2c5-aeddd003588a tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:49.456456 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e1550ac0-3e27-4d50-b2c5-aeddd003588a tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:49.457949 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e1550ac0-3e27-4d50-b2c5-aeddd003588a tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:49.458610 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e1550ac0-3e27-4d50-b2c5-aeddd003588a tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:49.459864 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e1550ac0-3e27-4d50-b2c5-aeddd003588a tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:49.779725 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e1550ac0-3e27-4d50-b2c5-aeddd003588a tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82" status: 200 len: 1462 microversion: 2.1 time: 0.342820 Sep 17 21:22:49.783439 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2810/5700] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:49 2022] GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82 => generated 1462 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:22:50.807492 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f3c00ff5-f014-4382-9ca8-e2f6901c3718 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:50.809393 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f3c00ff5-f014-4382-9ca8-e2f6901c3718 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 7600edde-2420-4f54-8700-57b6662aab82] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:50.819244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3c00ff5-f014-4382-9ca8-e2f6901c3718 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:50.819924 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3c00ff5-f014-4382-9ca8-e2f6901c3718 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:50.820696 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3c00ff5-f014-4382-9ca8-e2f6901c3718 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:50.822207 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3c00ff5-f014-4382-9ca8-e2f6901c3718 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:50.822914 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3c00ff5-f014-4382-9ca8-e2f6901c3718 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:50.823544 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3c00ff5-f014-4382-9ca8-e2f6901c3718 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:51.158937 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f3c00ff5-f014-4382-9ca8-e2f6901c3718 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82" status: 200 len: 1462 microversion: 2.1 time: 0.353017 Sep 17 21:22:51.159948 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2891/5701] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:50 2022] GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82 => generated 1462 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:22:51.763698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-4d252992-1f59-4912-8f80-d7ccaf257f4c req-fc5b6e22-70f7-434c-93c3-2c2714e6ffe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7600edde-2420-4f54-8700-57b6662aab82", "tag": "ec948612-ee79-439b-bdd8-78951ea065a1"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:22:51.791366 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-4d252992-1f59-4912-8f80-d7ccaf257f4c req-fc5b6e22-70f7-434c-93c3-2c2714e6ffe3 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:51.793125 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-4d252992-1f59-4912-8f80-d7ccaf257f4c req-fc5b6e22-70f7-434c-93c3-2c2714e6ffe3 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:51.797408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-4d252992-1f59-4912-8f80-d7ccaf257f4c req-fc5b6e22-70f7-434c-93c3-2c2714e6ffe3 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:51.814470 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-4d252992-1f59-4912-8f80-d7ccaf257f4c req-fc5b6e22-70f7-434c-93c3-2c2714e6ffe3 service nova] Creating event network-changed:ec948612-ee79-439b-bdd8-78951ea065a1 for instance 7600edde-2420-4f54-8700-57b6662aab82 on nch1-master-1 Sep 17 21:22:51.821435 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-4d252992-1f59-4912-8f80-d7ccaf257f4c req-fc5b6e22-70f7-434c-93c3-2c2714e6ffe3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062282 Sep 17 21:22:51.822852 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2811/5702] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:22:52.193513 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d584e015-1acd-453b-b1b7-56d9a73467b4 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:52.196063 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d584e015-1acd-453b-b1b7-56d9a73467b4 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 7600edde-2420-4f54-8700-57b6662aab82] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:52.211839 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d584e015-1acd-453b-b1b7-56d9a73467b4 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:52.212607 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d584e015-1acd-453b-b1b7-56d9a73467b4 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:52.213371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d584e015-1acd-453b-b1b7-56d9a73467b4 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:52.214417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d584e015-1acd-453b-b1b7-56d9a73467b4 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:52.215170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d584e015-1acd-453b-b1b7-56d9a73467b4 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:52.220816 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d584e015-1acd-453b-b1b7-56d9a73467b4 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:52.844080 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d584e015-1acd-453b-b1b7-56d9a73467b4 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82" status: 200 len: 1462 microversion: 2.1 time: 0.660118 Sep 17 21:22:52.844689 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2892/5703] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:52 2022] GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82 => generated 1462 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:22:53.869805 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-effcb3d4-4724-4795-80a3-52beddafea0a tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:53.870546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-effcb3d4-4724-4795-80a3-52beddafea0a tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 7600edde-2420-4f54-8700-57b6662aab82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:53.881672 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:22:53.884389 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-effcb3d4-4724-4795-80a3-52beddafea0a tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:53.884895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-effcb3d4-4724-4795-80a3-52beddafea0a tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:53.892710 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-effcb3d4-4724-4795-80a3-52beddafea0a tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:53.893783 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-effcb3d4-4724-4795-80a3-52beddafea0a tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:53.894296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-effcb3d4-4724-4795-80a3-52beddafea0a tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:53.895320 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-effcb3d4-4724-4795-80a3-52beddafea0a tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:54.333274 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-effcb3d4-4724-4795-80a3-52beddafea0a tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82" status: 200 len: 1462 microversion: 2.1 time: 0.466427 Sep 17 21:22:54.334000 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2812/5704] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:53 2022] GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82 => generated 1462 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:22:55.208648 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5cdc053d-b4b4-4992-9d13-6f672e95f7ae tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:22:55.211832 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5cdc053d-b4b4-4992-9d13-6f672e95f7ae tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:55.235112 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:22:55.236267 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=6 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:22:55.242689 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5cdc053d-b4b4-4992-9d13-6f672e95f7ae tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:55.243284 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5cdc053d-b4b4-4992-9d13-6f672e95f7ae tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:55.249140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5cdc053d-b4b4-4992-9d13-6f672e95f7ae tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:55.249140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5cdc053d-b4b4-4992-9d13-6f672e95f7ae tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:55.249140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5cdc053d-b4b4-4992-9d13-6f672e95f7ae tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:55.249140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5cdc053d-b4b4-4992-9d13-6f672e95f7ae tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:55.318928 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5cdc053d-b4b4-4992-9d13-6f672e95f7ae tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "POST /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383/action" status: 200 len: 24539 microversion: 2.1 time: 0.115201 Sep 17 21:22:55.319618 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2893/5705] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:22:55 2022] POST /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383/action => generated 24539 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:22:55.358495 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b9232d24-ddfb-456b-8d82-40656367e5cc tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:55.360316 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b9232d24-ddfb-456b-8d82-40656367e5cc tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 7600edde-2420-4f54-8700-57b6662aab82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:55.364711 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:22:55.371511 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b9232d24-ddfb-456b-8d82-40656367e5cc tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:55.371943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b9232d24-ddfb-456b-8d82-40656367e5cc tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:55.372376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b9232d24-ddfb-456b-8d82-40656367e5cc tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:55.373743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b9232d24-ddfb-456b-8d82-40656367e5cc tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:55.374532 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b9232d24-ddfb-456b-8d82-40656367e5cc tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:55.375001 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b9232d24-ddfb-456b-8d82-40656367e5cc tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:55.909708 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b9232d24-ddfb-456b-8d82-40656367e5cc tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82" status: 200 len: 1462 microversion: 2.1 time: 0.556781 Sep 17 21:22:55.911195 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2813/5706] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:55 2022] GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82 => generated 1462 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:22:56.935985 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4098c9d7-e5f4-4572-af3b-ba822f2e594b tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:56.937628 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4098c9d7-e5f4-4572-af3b-ba822f2e594b tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 7600edde-2420-4f54-8700-57b6662aab82] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:56.964709 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4098c9d7-e5f4-4572-af3b-ba822f2e594b tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:56.966333 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4098c9d7-e5f4-4572-af3b-ba822f2e594b tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:56.966986 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4098c9d7-e5f4-4572-af3b-ba822f2e594b tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:56.968709 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4098c9d7-e5f4-4572-af3b-ba822f2e594b tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:56.969413 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4098c9d7-e5f4-4572-af3b-ba822f2e594b tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:56.970096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4098c9d7-e5f4-4572-af3b-ba822f2e594b tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:57.318842 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4098c9d7-e5f4-4572-af3b-ba822f2e594b tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82" status: 200 len: 1462 microversion: 2.1 time: 0.389317 Sep 17 21:22:57.319665 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2894/5707] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:56 2022] GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82 => generated 1462 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:22:57.756600 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-95a1e785-a875-45d7-b5e0-325d9cb1aa4d tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:57.757696 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-95a1e785-a875-45d7-b5e0-325d9cb1aa4d tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 1c627545-2251-49ec-90d8-fa8b5aa77f01] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:57.778221 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95a1e785-a875-45d7-b5e0-325d9cb1aa4d tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:57.778775 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95a1e785-a875-45d7-b5e0-325d9cb1aa4d tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:57.779238 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95a1e785-a875-45d7-b5e0-325d9cb1aa4d tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:57.780016 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95a1e785-a875-45d7-b5e0-325d9cb1aa4d tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:57.780480 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95a1e785-a875-45d7-b5e0-325d9cb1aa4d tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:57.781101 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95a1e785-a875-45d7-b5e0-325d9cb1aa4d tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:57.928665 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-95a1e785-a875-45d7-b5e0-325d9cb1aa4d tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lazy-loading 'services' on Instance uuid 1c627545-2251-49ec-90d8-fa8b5aa77f01 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:22:58.121666 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-95a1e785-a875-45d7-b5e0-325d9cb1aa4d tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01/os-volume_attachments/5b712483-f63f-4381-9968-4e3fa55f72b6" status: 202 len: 0 microversion: 2.1 time: 0.368809 Sep 17 21:22:58.122919 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2814/5708] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Sep 17 21:22:57 2022] DELETE /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01/os-volume_attachments/5b712483-f63f-4381-9968-4e3fa55f72b6 => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:22:58.347210 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6f24c81d-ee67-4249-811d-dba4d53b2ec5 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:58.349604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6f24c81d-ee67-4249-811d-dba4d53b2ec5 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 7600edde-2420-4f54-8700-57b6662aab82] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:58.360761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f24c81d-ee67-4249-811d-dba4d53b2ec5 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:58.361896 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f24c81d-ee67-4249-811d-dba4d53b2ec5 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:58.362899 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f24c81d-ee67-4249-811d-dba4d53b2ec5 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:58.363958 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f24c81d-ee67-4249-811d-dba4d53b2ec5 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:58.364651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f24c81d-ee67-4249-811d-dba4d53b2ec5 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:58.365331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6f24c81d-ee67-4249-811d-dba4d53b2ec5 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:58.717690 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6f24c81d-ee67-4249-811d-dba4d53b2ec5 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82" status: 200 len: 1462 microversion: 2.1 time: 0.377098 Sep 17 21:22:58.719029 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2895/5709] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:58 2022] GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82 => generated 1462 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:22:59.290866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b609de1b-5de7-48e6-82d8-726424fc8b96 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:59.293241 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b609de1b-5de7-48e6-82d8-726424fc8b96 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 1c627545-2251-49ec-90d8-fa8b5aa77f01] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:59.310652 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b609de1b-5de7-48e6-82d8-726424fc8b96 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:59.311415 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b609de1b-5de7-48e6-82d8-726424fc8b96 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:59.312977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b609de1b-5de7-48e6-82d8-726424fc8b96 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:59.315034 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b609de1b-5de7-48e6-82d8-726424fc8b96 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:59.315996 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b609de1b-5de7-48e6-82d8-726424fc8b96 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:59.316747 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b609de1b-5de7-48e6-82d8-726424fc8b96 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:59.386699 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b609de1b-5de7-48e6-82d8-726424fc8b96 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 1c627545-2251-49ec-90d8-fa8b5aa77f01] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:22:59.601326 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b609de1b-5de7-48e6-82d8-726424fc8b96 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01" status: 204 len: 0 microversion: 2.1 time: 0.313812 Sep 17 21:22:59.602669 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2815/5710] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:22:59 2022] DELETE /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:22:59.612494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b578167d-305a-43ce-94fa-05ca2515c5a0 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:59.613160 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b578167d-305a-43ce-94fa-05ca2515c5a0 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 1c627545-2251-49ec-90d8-fa8b5aa77f01] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:59.631228 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b578167d-305a-43ce-94fa-05ca2515c5a0 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:59.631987 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b578167d-305a-43ce-94fa-05ca2515c5a0 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:59.632603 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b578167d-305a-43ce-94fa-05ca2515c5a0 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:59.638198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b578167d-305a-43ce-94fa-05ca2515c5a0 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:59.638965 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b578167d-305a-43ce-94fa-05ca2515c5a0 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:59.642010 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b578167d-305a-43ce-94fa-05ca2515c5a0 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:59.717785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-5b2ea40c-7214-4f5d-acaf-2ce86ceafad8 req-67e288a2-5b21-4e14-a47c-5d406df4a27b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7600edde-2420-4f54-8700-57b6662aab82", "name": "network-vif-plugged", "status": "completed", "tag": "ec948612-ee79-439b-bdd8-78951ea065a1"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:22:59.748922 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-5b2ea40c-7214-4f5d-acaf-2ce86ceafad8 req-67e288a2-5b21-4e14-a47c-5d406df4a27b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:59.750458 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-5b2ea40c-7214-4f5d-acaf-2ce86ceafad8 req-67e288a2-5b21-4e14-a47c-5d406df4a27b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:59.750920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-5b2ea40c-7214-4f5d-acaf-2ce86ceafad8 req-67e288a2-5b21-4e14-a47c-5d406df4a27b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:59.778427 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-5b2ea40c-7214-4f5d-acaf-2ce86ceafad8 req-67e288a2-5b21-4e14-a47c-5d406df4a27b service nova] Creating event network-vif-plugged:ec948612-ee79-439b-bdd8-78951ea065a1 for instance 7600edde-2420-4f54-8700-57b6662aab82 on nch1-master-1 Sep 17 21:22:59.784493 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-5b2ea40c-7214-4f5d-acaf-2ce86ceafad8 req-67e288a2-5b21-4e14-a47c-5d406df4a27b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088215 Sep 17 21:22:59.785950 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2816/5711] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:22:59.792147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8c374305-4bcf-423b-966e-615f9b3ec319 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:22:59.793123 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8c374305-4bcf-423b-966e-615f9b3ec319 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 7600edde-2420-4f54-8700-57b6662aab82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:22:59.803500 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c374305-4bcf-423b-966e-615f9b3ec319 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:59.805417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c374305-4bcf-423b-966e-615f9b3ec319 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:59.806074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c374305-4bcf-423b-966e-615f9b3ec319 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:22:59.807701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c374305-4bcf-423b-966e-615f9b3ec319 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:22:59.809517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c374305-4bcf-423b-966e-615f9b3ec319 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:22:59.811491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c374305-4bcf-423b-966e-615f9b3ec319 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:00.011919 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b578167d-305a-43ce-94fa-05ca2515c5a0 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd15b9d354eb44b0bfa83bcdcf5c1384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335955c0be3743eda2541b7d04ed2e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:23:00.024171 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b578167d-305a-43ce-94fa-05ca2515c5a0 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "GET /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01" status: 200 len: 1513 microversion: 2.1 time: 0.415994 Sep 17 21:23:00.025846 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2896/5712] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:59 2022] GET /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01 => generated 1513 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:00.047614 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8c374305-4bcf-423b-966e-615f9b3ec319 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82" status: 200 len: 1462 microversion: 2.1 time: 0.260019 Sep 17 21:23:00.048988 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2817/5713] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:22:59 2022] GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82 => generated 1462 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:01.049489 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c3702d24-356c-4636-8b9f-82b9e5035684 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:01.050723 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c3702d24-356c-4636-8b9f-82b9e5035684 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 1c627545-2251-49ec-90d8-fa8b5aa77f01] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:01.072757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3702d24-356c-4636-8b9f-82b9e5035684 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:01.073653 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3702d24-356c-4636-8b9f-82b9e5035684 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:01.074322 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3702d24-356c-4636-8b9f-82b9e5035684 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:01.076296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7fa9a8ba-0f7b-4ee1-a90c-39373701b596 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:01.076999 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7fa9a8ba-0f7b-4ee1-a90c-39373701b596 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 7600edde-2420-4f54-8700-57b6662aab82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:01.077233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3702d24-356c-4636-8b9f-82b9e5035684 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:01.080052 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3702d24-356c-4636-8b9f-82b9e5035684 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:01.080732 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3702d24-356c-4636-8b9f-82b9e5035684 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:01.091357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7fa9a8ba-0f7b-4ee1-a90c-39373701b596 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:01.091862 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7fa9a8ba-0f7b-4ee1-a90c-39373701b596 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:01.092510 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7fa9a8ba-0f7b-4ee1-a90c-39373701b596 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:01.094057 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7fa9a8ba-0f7b-4ee1-a90c-39373701b596 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:01.094720 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7fa9a8ba-0f7b-4ee1-a90c-39373701b596 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:01.095376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7fa9a8ba-0f7b-4ee1-a90c-39373701b596 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:01.357000 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c3702d24-356c-4636-8b9f-82b9e5035684 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd15b9d354eb44b0bfa83bcdcf5c1384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335955c0be3743eda2541b7d04ed2e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:23:01.366075 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7fa9a8ba-0f7b-4ee1-a90c-39373701b596 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82" status: 200 len: 1462 microversion: 2.1 time: 0.295814 Sep 17 21:23:01.374127 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2818/5714] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:01 2022] GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82 => generated 1462 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:01.383020 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c3702d24-356c-4636-8b9f-82b9e5035684 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "GET /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01" status: 200 len: 1513 microversion: 2.1 time: 0.338581 Sep 17 21:23:01.383625 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2897/5715] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:01 2022] GET /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01 => generated 1513 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:01.869691 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-75aa6660-5c79-457a-be0a-c32a0cf40485 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:23:01.878836 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-75aa6660-5c79-457a-be0a-c32a0cf40485 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:01.889879 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75aa6660-5c79-457a-be0a-c32a0cf40485 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:01.891747 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75aa6660-5c79-457a-be0a-c32a0cf40485 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:01.892272 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75aa6660-5c79-457a-be0a-c32a0cf40485 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:01.893634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75aa6660-5c79-457a-be0a-c32a0cf40485 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:01.894175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75aa6660-5c79-457a-be0a-c32a0cf40485 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:01.894772 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75aa6660-5c79-457a-be0a-c32a0cf40485 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:01.983996 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-75aa6660-5c79-457a-be0a-c32a0cf40485 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "POST /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383/action" status: 200 len: 32613 microversion: 2.1 time: 0.124274 Sep 17 21:23:01.985088 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2819/5716] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:23:01 2022] POST /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383/action => generated 32613 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:23:02.412959 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-eacc061e-ad8a-40b9-9ee0-27fd73b52f8c tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:02.415296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-eacc061e-ad8a-40b9-9ee0-27fd73b52f8c tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 7600edde-2420-4f54-8700-57b6662aab82] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:02.421054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5bd18d27-1288-4abf-b936-0a89aa3a9161 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:02.422166 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5bd18d27-1288-4abf-b936-0a89aa3a9161 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 1c627545-2251-49ec-90d8-fa8b5aa77f01] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:02.429003 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eacc061e-ad8a-40b9-9ee0-27fd73b52f8c tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:02.429829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eacc061e-ad8a-40b9-9ee0-27fd73b52f8c tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:02.433633 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eacc061e-ad8a-40b9-9ee0-27fd73b52f8c tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:02.435415 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eacc061e-ad8a-40b9-9ee0-27fd73b52f8c tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:02.436084 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eacc061e-ad8a-40b9-9ee0-27fd73b52f8c tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:02.446310 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5bd18d27-1288-4abf-b936-0a89aa3a9161 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:02.448953 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5bd18d27-1288-4abf-b936-0a89aa3a9161 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:02.449980 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5bd18d27-1288-4abf-b936-0a89aa3a9161 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:02.450979 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eacc061e-ad8a-40b9-9ee0-27fd73b52f8c tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:02.453501 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5bd18d27-1288-4abf-b936-0a89aa3a9161 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:02.454400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5bd18d27-1288-4abf-b936-0a89aa3a9161 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:02.456358 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5bd18d27-1288-4abf-b936-0a89aa3a9161 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:03.426814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5bd18d27-1288-4abf-b936-0a89aa3a9161 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd15b9d354eb44b0bfa83bcdcf5c1384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335955c0be3743eda2541b7d04ed2e06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:23:03.437761 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5bd18d27-1288-4abf-b936-0a89aa3a9161 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "GET /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01" status: 200 len: 1471 microversion: 2.1 time: 1.024380 Sep 17 21:23:03.439530 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2820/5717] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:02 2022] GET /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01 => generated 1471 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:03.446932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-8f5c78dd-a979-4430-a054-5575d856dad9 req-3d114318-121b-41fd-bbe7-748ac862a941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c627545-2251-49ec-90d8-fa8b5aa77f01", "name": "network-vif-deleted", "tag": "1904fe73-eb2e-4440-86db-9a7eab284519"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:23:03.470792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8f5c78dd-a979-4430-a054-5575d856dad9 req-3d114318-121b-41fd-bbe7-748ac862a941 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:03.472586 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8f5c78dd-a979-4430-a054-5575d856dad9 req-3d114318-121b-41fd-bbe7-748ac862a941 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:03.473166 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8f5c78dd-a979-4430-a054-5575d856dad9 req-3d114318-121b-41fd-bbe7-748ac862a941 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:03.490730 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-8f5c78dd-a979-4430-a054-5575d856dad9 req-3d114318-121b-41fd-bbe7-748ac862a941 service nova] Creating event network-vif-deleted:1904fe73-eb2e-4440-86db-9a7eab284519 for instance 1c627545-2251-49ec-90d8-fa8b5aa77f01 on nch1-master-1 Sep 17 21:23:03.500836 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-8f5c78dd-a979-4430-a054-5575d856dad9 req-3d114318-121b-41fd-bbe7-748ac862a941 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059424 Sep 17 21:23:03.501591 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2821/5718] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:23:03.686419 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-eacc061e-ad8a-40b9-9ee0-27fd73b52f8c tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82" status: 200 len: 1647 microversion: 2.1 time: 1.280447 Sep 17 21:23:03.708725 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2898/5719] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:02 2022] GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82 => generated 1647 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:03.712460 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c96f90d5-64c0-4dc7-9bb5-8d629f8837b3 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:03.713239 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c96f90d5-64c0-4dc7-9bb5-8d629f8837b3 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 7600edde-2420-4f54-8700-57b6662aab82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:03.721516 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c96f90d5-64c0-4dc7-9bb5-8d629f8837b3 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:03.722028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c96f90d5-64c0-4dc7-9bb5-8d629f8837b3 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:03.722479 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c96f90d5-64c0-4dc7-9bb5-8d629f8837b3 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:03.723906 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c96f90d5-64c0-4dc7-9bb5-8d629f8837b3 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:03.724623 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c96f90d5-64c0-4dc7-9bb5-8d629f8837b3 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:03.725067 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c96f90d5-64c0-4dc7-9bb5-8d629f8837b3 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:04.068829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-330b971d-7700-4e28-a55c-b62b9b1c62d3 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:04.069739 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-330b971d-7700-4e28-a55c-b62b9b1c62d3 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:04.078720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-330b971d-7700-4e28-a55c-b62b9b1c62d3 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:04.079505 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-330b971d-7700-4e28-a55c-b62b9b1c62d3 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:04.080225 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-330b971d-7700-4e28-a55c-b62b9b1c62d3 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:04.082570 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-330b971d-7700-4e28-a55c-b62b9b1c62d3 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:04.083364 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-330b971d-7700-4e28-a55c-b62b9b1c62d3 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:04.084554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-330b971d-7700-4e28-a55c-b62b9b1c62d3 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:04.126858 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c96f90d5-64c0-4dc7-9bb5-8d629f8837b3 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82" status: 200 len: 1647 microversion: 2.1 time: 0.419303 Sep 17 21:23:04.127558 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2822/5720] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:03 2022] GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82 => generated 1647 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:23:04.148016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-330b971d-7700-4e28-a55c-b62b9b1c62d3 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:23:04.161189 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b20b9c7f-7e64-4b65-9340-5e6847bcd4c3 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:04.161865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b20b9c7f-7e64-4b65-9340-5e6847bcd4c3 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 7600edde-2420-4f54-8700-57b6662aab82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:04.174492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b20b9c7f-7e64-4b65-9340-5e6847bcd4c3 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:04.175001 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b20b9c7f-7e64-4b65-9340-5e6847bcd4c3 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:04.175457 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b20b9c7f-7e64-4b65-9340-5e6847bcd4c3 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:04.176268 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b20b9c7f-7e64-4b65-9340-5e6847bcd4c3 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:04.176743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b20b9c7f-7e64-4b65-9340-5e6847bcd4c3 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:04.180941 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b20b9c7f-7e64-4b65-9340-5e6847bcd4c3 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:04.305913 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-330b971d-7700-4e28-a55c-b62b9b1c62d3 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383" status: 204 len: 0 microversion: 2.1 time: 0.242669 Sep 17 21:23:04.313799 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2899/5721] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:23:04 2022] DELETE /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:23:04.320855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f7e862b6-43df-4a19-9f78-e957473540a2 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:04.321683 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f7e862b6-43df-4a19-9f78-e957473540a2 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:04.329390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7e862b6-43df-4a19-9f78-e957473540a2 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:04.330232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7e862b6-43df-4a19-9f78-e957473540a2 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:04.330747 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7e862b6-43df-4a19-9f78-e957473540a2 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:04.331739 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7e862b6-43df-4a19-9f78-e957473540a2 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:04.332402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7e862b6-43df-4a19-9f78-e957473540a2 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:04.333128 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7e862b6-43df-4a19-9f78-e957473540a2 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:04.490969 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b20b9c7f-7e64-4b65-9340-5e6847bcd4c3 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82" status: 200 len: 1647 microversion: 2.1 time: 0.340275 Sep 17 21:23:04.491954 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2823/5722] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:04 2022] GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82 => generated 1647 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:04.496880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-70c81f44-4a42-4770-9a70-e0c071feba55 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:04.497947 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-70c81f44-4a42-4770-9a70-e0c071feba55 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] [instance: 1c627545-2251-49ec-90d8-fa8b5aa77f01] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:04.504531 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-70c81f44-4a42-4770-9a70-e0c071feba55 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:04.505245 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-70c81f44-4a42-4770-9a70-e0c071feba55 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:04.505992 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-70c81f44-4a42-4770-9a70-e0c071feba55 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:04.506895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-70c81f44-4a42-4770-9a70-e0c071feba55 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:04.507524 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-70c81f44-4a42-4770-9a70-e0c071feba55 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:04.508126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-70c81f44-4a42-4770-9a70-e0c071feba55 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:04.525061 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-70c81f44-4a42-4770-9a70-e0c071feba55 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] HTTP exception thrown: Instance 1c627545-2251-49ec-90d8-fa8b5aa77f01 could not be found. Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-70c81f44-4a42-4770-9a70-e0c071feba55 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Request method failure captured: Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01 HTTP/1.1 Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjmrne0NLF_LbZ5mPxWoH_GRl_7sl8Y6b-gsF0wGB4m53fMH3cSJp-sfPpPUR6drvc5spau-CC8WoZidlQM4ze6F6MIL7XpEYKnuCqNwv55EfxZH7e32DM650Yd3OVGBLNYYrX11gl1Gik1fmqwzKo-GP4aDpevf1FqvsEMZC7preVw Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 335955c0be3743eda2541b7d04ed2e06 Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2104722578 Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/335955c0be3743eda2541b7d04ed2e06"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/335955c0be3743eda2541b7d04ed2e06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/335955c0be3743eda2541b7d04ed2e06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_335955c0be3743eda2541b7d04ed2e06", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-VolumesSnapshotTestJSON-2104722578 Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 335955c0be3743eda2541b7d04ed2e06 Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2104722578 Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-VolumesSnapshotTestJSON-2104722578-project Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: fd15b9d354eb44b0bfa83bcdcf5c1384 Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-VolumesSnapshotTestJSON-2104722578-project Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 1c627545-2251-49ec-90d8-fa8b5aa77f01 could not be found. Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '1c627545-2251-49ec-90d8-fa8b5aa77f01'} Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c627545-2251-49ec-90d8-fa8b5aa77f01 could not be found. Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c627545-2251-49ec-90d8-fa8b5aa77f01 could not be found. Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:23:04.527031 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:23:04.532471 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:23:04.532471 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:23:04.532471 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:23:04.532471 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:23:04.532471 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:23:04.532471 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c627545-2251-49ec-90d8-fa8b5aa77f01 could not be found. Sep 17 21:23:04.532471 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:23:04.534165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-70c81f44-4a42-4770-9a70-e0c071feba55 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] Returning 404 to user: Instance 1c627545-2251-49ec-90d8-fa8b5aa77f01 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:23:04.535240 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-70c81f44-4a42-4770-9a70-e0c071feba55 tempest-VolumesSnapshotTestJSON-2104722578 tempest-VolumesSnapshotTestJSON-2104722578-project] 10.222.0.26 "GET /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01" status: 404 len: 111 microversion: 2.1 time: 0.042086 Sep 17 21:23:04.546013 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2824/5723] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:04 2022] GET /compute/v2.1/servers/1c627545-2251-49ec-90d8-fa8b5aa77f01 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:23:04.674701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-664bb22f-5b71-4b82-97bc-e15e35eaaf4b tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-920716031", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "f5d62f8e-9c57-4056-9340-bf4e70942547"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:23:04.717734 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f7e862b6-43df-4a19-9f78-e957473540a2 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:23:04.748426 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f7e862b6-43df-4a19-9f78-e957473540a2 tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383" status: 200 len: 1669 microversion: 2.1 time: 0.433629 Sep 17 21:23:04.749043 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2900/5724] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:04 2022] GET /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383 => generated 1669 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:04.872637 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-664bb22f-5b71-4b82-97bc-e15e35eaaf4b tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] validate_networks() for [('f5d62f8e-9c57-4056-9340-bf4e70942547', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:23:05.746094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-664bb22f-5b71-4b82-97bc-e15e35eaaf4b tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:23:05.746896 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-664bb22f-5b71-4b82-97bc-e15e35eaaf4b tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:23:05.747027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-664bb22f-5b71-4b82-97bc-e15e35eaaf4b tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:23:05.747651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-664bb22f-5b71-4b82-97bc-e15e35eaaf4b tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:23:05.748481 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-664bb22f-5b71-4b82-97bc-e15e35eaaf4b tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:23:05.759341 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-664bb22f-5b71-4b82-97bc-e15e35eaaf4b tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:05.760297 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-664bb22f-5b71-4b82-97bc-e15e35eaaf4b tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:05.760918 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-664bb22f-5b71-4b82-97bc-e15e35eaaf4b tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:05.761875 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-664bb22f-5b71-4b82-97bc-e15e35eaaf4b tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:05.762570 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-664bb22f-5b71-4b82-97bc-e15e35eaaf4b tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:05.763226 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-664bb22f-5b71-4b82-97bc-e15e35eaaf4b tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:05.780571 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a710676f-4752-44d3-8e44-89803d82143c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:05.781300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a710676f-4752-44d3-8e44-89803d82143c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:05.793421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-664bb22f-5b71-4b82-97bc-e15e35eaaf4b tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Getting quotas for project 718efb2481024b278d50730fec729eeb. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:23:05.800978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a710676f-4752-44d3-8e44-89803d82143c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:05.802319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a710676f-4752-44d3-8e44-89803d82143c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:05.802598 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-664bb22f-5b71-4b82-97bc-e15e35eaaf4b tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Getting quotas for user 70b0d8337e20432584f80476b46453f0 and project 718efb2481024b278d50730fec729eeb. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:23:05.803035 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a710676f-4752-44d3-8e44-89803d82143c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:05.803764 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a710676f-4752-44d3-8e44-89803d82143c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:05.808161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a710676f-4752-44d3-8e44-89803d82143c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:05.808659 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a710676f-4752-44d3-8e44-89803d82143c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:05.817505 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-664bb22f-5b71-4b82-97bc-e15e35eaaf4b tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:23:05.819970 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-664bb22f-5b71-4b82-97bc-e15e35eaaf4b tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 08252884-b260-4efa-9c3f-d8e6bbb33ff4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:23:05.919793 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-664bb22f-5b71-4b82-97bc-e15e35eaaf4b tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.247088 Sep 17 21:23:05.924183 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2825/5725] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:23:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1254 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:23:05.935337 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-d6638d7a-91f4-498b-aa75-7a52cd9f0c18 req-e90de951-13b4-4af2-9b9a-03850f6b6ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383", "tag": "4a75b065-d53b-4fb0-88bc-df555ba2333e"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:23:05.952241 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d6638d7a-91f4-498b-aa75-7a52cd9f0c18 req-e90de951-13b4-4af2-9b9a-03850f6b6ef9 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:05.953933 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d6638d7a-91f4-498b-aa75-7a52cd9f0c18 req-e90de951-13b4-4af2-9b9a-03850f6b6ef9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:05.954686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d6638d7a-91f4-498b-aa75-7a52cd9f0c18 req-e90de951-13b4-4af2-9b9a-03850f6b6ef9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:05.974483 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-d6638d7a-91f4-498b-aa75-7a52cd9f0c18 req-e90de951-13b4-4af2-9b9a-03850f6b6ef9 service nova] Creating event network-changed:4a75b065-d53b-4fb0-88bc-df555ba2333e for instance e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383 on nch2-master-1 Sep 17 21:23:05.980275 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-d6638d7a-91f4-498b-aa75-7a52cd9f0c18 req-e90de951-13b4-4af2-9b9a-03850f6b6ef9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053401 Sep 17 21:23:05.981386 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2826/5726] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:23:05.988761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7634de06-c829-4c09-bcff-89b5c9d6099b tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:05.990372 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7634de06-c829-4c09-bcff-89b5c9d6099b tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 08252884-b260-4efa-9c3f-d8e6bbb33ff4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:06.161990 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7634de06-c829-4c09-bcff-89b5c9d6099b tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4" status: 200 len: 1328 microversion: 2.1 time: 0.174235 Sep 17 21:23:06.162876 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2827/5727] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:05 2022] GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4 => generated 1328 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:06.232229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a710676f-4752-44d3-8e44-89803d82143c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:23:06.250345 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a710676f-4752-44d3-8e44-89803d82143c tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383" status: 200 len: 1669 microversion: 2.1 time: 0.475256 Sep 17 21:23:06.268691 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2901/5728] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:05 2022] GET /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383 => generated 1669 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:07.188554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9e26ee76-5c76-438f-bfd3-04da71eb24f4 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:07.189260 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9e26ee76-5c76-438f-bfd3-04da71eb24f4 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 08252884-b260-4efa-9c3f-d8e6bbb33ff4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:07.197416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e26ee76-5c76-438f-bfd3-04da71eb24f4 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:07.198109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e26ee76-5c76-438f-bfd3-04da71eb24f4 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:07.198740 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e26ee76-5c76-438f-bfd3-04da71eb24f4 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:07.199447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e26ee76-5c76-438f-bfd3-04da71eb24f4 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:07.199968 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e26ee76-5c76-438f-bfd3-04da71eb24f4 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:07.200587 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e26ee76-5c76-438f-bfd3-04da71eb24f4 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:07.204689 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:23:07.274116 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9e26ee76-5c76-438f-bfd3-04da71eb24f4 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4" status: 200 len: 1415 microversion: 2.1 time: 0.089389 Sep 17 21:23:07.281942 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2828/5729] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:07 2022] GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4 => generated 1415 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:07.292415 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c7a17ed7-77b6-4e60-83a1-6336ea2e888f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:07.293629 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c7a17ed7-77b6-4e60-83a1-6336ea2e888f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:07.302970 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c7a17ed7-77b6-4e60-83a1-6336ea2e888f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:07.303624 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c7a17ed7-77b6-4e60-83a1-6336ea2e888f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:07.304564 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c7a17ed7-77b6-4e60-83a1-6336ea2e888f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:07.305398 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c7a17ed7-77b6-4e60-83a1-6336ea2e888f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:07.305984 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c7a17ed7-77b6-4e60-83a1-6336ea2e888f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:07.306668 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c7a17ed7-77b6-4e60-83a1-6336ea2e888f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:07.344430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c7a17ed7-77b6-4e60-83a1-6336ea2e888f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:07.345181 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c7a17ed7-77b6-4e60-83a1-6336ea2e888f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:07.345854 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c7a17ed7-77b6-4e60-83a1-6336ea2e888f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:07.346318 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-c7a17ed7-77b6-4e60-83a1-6336ea2e888f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lazy-loading 'fault' on Instance uuid e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:23:07.419279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c7a17ed7-77b6-4e60-83a1-6336ea2e888f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fc6b11f473e4231adf4278688619f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0608df66a18a4fb3855b6cd557ab2998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:23:07.430262 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c7a17ed7-77b6-4e60-83a1-6336ea2e888f tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383" status: 200 len: 1337 microversion: 2.1 time: 0.141976 Sep 17 21:23:07.431276 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2902/5730] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:07 2022] GET /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383 => generated 1337 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:08.016012 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-4df8b90b-843e-4623-bbf5-ed02f633ab3f req-15a9582f-a4d8-458d-9580-8291033f62ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383", "name": "network-vif-deleted", "tag": "4a75b065-d53b-4fb0-88bc-df555ba2333e"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:23:08.034421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-4df8b90b-843e-4623-bbf5-ed02f633ab3f req-15a9582f-a4d8-458d-9580-8291033f62ee service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:08.035243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-4df8b90b-843e-4623-bbf5-ed02f633ab3f req-15a9582f-a4d8-458d-9580-8291033f62ee service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:08.035942 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-4df8b90b-843e-4623-bbf5-ed02f633ab3f req-15a9582f-a4d8-458d-9580-8291033f62ee service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:08.048803 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-4df8b90b-843e-4623-bbf5-ed02f633ab3f req-15a9582f-a4d8-458d-9580-8291033f62ee service nova] Creating event network-vif-deleted:4a75b065-d53b-4fb0-88bc-df555ba2333e for instance e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383 on nch2-master-1 Sep 17 21:23:08.054562 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-4df8b90b-843e-4623-bbf5-ed02f633ab3f req-15a9582f-a4d8-458d-9580-8291033f62ee service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043670 Sep 17 21:23:08.055507 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2829/5731] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:23:08.299173 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3aef84c0-5e0b-4b72-a8e4-c53709c1eb8f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:08.299889 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3aef84c0-5e0b-4b72-a8e4-c53709c1eb8f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 08252884-b260-4efa-9c3f-d8e6bbb33ff4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:08.307131 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3aef84c0-5e0b-4b72-a8e4-c53709c1eb8f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:08.307732 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3aef84c0-5e0b-4b72-a8e4-c53709c1eb8f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:08.308240 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3aef84c0-5e0b-4b72-a8e4-c53709c1eb8f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:08.309189 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3aef84c0-5e0b-4b72-a8e4-c53709c1eb8f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:08.309688 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3aef84c0-5e0b-4b72-a8e4-c53709c1eb8f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:08.310123 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3aef84c0-5e0b-4b72-a8e4-c53709c1eb8f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:08.379353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:23:08.387195 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3aef84c0-5e0b-4b72-a8e4-c53709c1eb8f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4" status: 200 len: 1421 microversion: 2.1 time: 0.093353 Sep 17 21:23:08.387999 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2903/5732] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:08 2022] GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4 => generated 1421 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:08.457681 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-82b6138d-f197-460a-875f-6d53122b910a tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:08.460051 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-82b6138d-f197-460a-875f-6d53122b910a tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] [instance: e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:08.470273 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82b6138d-f197-460a-875f-6d53122b910a tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:08.470884 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82b6138d-f197-460a-875f-6d53122b910a tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:08.471581 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82b6138d-f197-460a-875f-6d53122b910a tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:08.472405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82b6138d-f197-460a-875f-6d53122b910a tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:08.473156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82b6138d-f197-460a-875f-6d53122b910a tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:08.473696 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82b6138d-f197-460a-875f-6d53122b910a tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:08.492267 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-82b6138d-f197-460a-875f-6d53122b910a tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] HTTP exception thrown: Instance e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383 could not be found. Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-82b6138d-f197-460a-875f-6d53122b910a tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Request method failure captured: Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383 HTTP/1.1 Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjn6kl7FvnXMu3Kc7wevyIR3UQRPPoh-JGa9N-pWneCYHgEKoUAaSh1eBMCF-nrFPAoUjd-S_kj7rG2dQUdDwp79l_hD4mLbeh5CGyRKTo8qwbUeOE2LfQLWeJuCLodOk10yeKZ7Q3k-Qr462LoegF6ffChr7XnJD8PyE62AshHScSk Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 0608df66a18a4fb3855b6cd557ab2998 Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-TestNetworkBasicOps-17232086 Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0608df66a18a4fb3855b6cd557ab2998"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0608df66a18a4fb3855b6cd557ab2998"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0608df66a18a4fb3855b6cd557ab2998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0608df66a18a4fb3855b6cd557ab2998", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-TestNetworkBasicOps-17232086 Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 0608df66a18a4fb3855b6cd557ab2998 Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-TestNetworkBasicOps-17232086 Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-TestNetworkBasicOps-17232086-project Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 2fc6b11f473e4231adf4278688619f24 Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-TestNetworkBasicOps-17232086-project Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383 could not be found. Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383'} Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383 could not be found. Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383 could not be found. Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:23:08.494198 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:23:08.498722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:23:08.498722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:23:08.498722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:23:08.498722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:23:08.498722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:23:08.498722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383 could not be found. Sep 17 21:23:08.498722 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:23:08.498722 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-82b6138d-f197-460a-875f-6d53122b910a tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Returning 404 to user: Instance e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:23:08.498722 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-82b6138d-f197-460a-875f-6d53122b910a tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "GET /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383" status: 404 len: 111 microversion: 2.1 time: 0.043409 Sep 17 21:23:08.500399 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2830/5733] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:08 2022] GET /compute/v2.1/servers/e3b4f23b-9a2a-40c3-a735-9b5fc1cbc383 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:23:08.972385 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-22e4a672-e0ac-4be7-9720-ee75319d4d4b tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] Calling method '.version_select at 0x7f25a541e310>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:09.017369 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-22e4a672-e0ac-4be7-9720-ee75319d4d4b tempest-TestNetworkBasicOps-17232086 tempest-TestNetworkBasicOps-17232086-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-705621159" status: 202 len: 0 microversion: 2.1 time: 0.046791 Sep 17 21:23:09.018696 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2904/5734] 10.222.0.26 () {58 vars in 1254 bytes} [Sat Sep 17 21:23:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-705621159 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:23:09.411742 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d7bc2fe5-ab1f-4119-95cb-5716de2bc631 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:09.412561 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d7bc2fe5-ab1f-4119-95cb-5716de2bc631 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 08252884-b260-4efa-9c3f-d8e6bbb33ff4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:09.420659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d7bc2fe5-ab1f-4119-95cb-5716de2bc631 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:09.425293 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d7bc2fe5-ab1f-4119-95cb-5716de2bc631 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:09.425904 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d7bc2fe5-ab1f-4119-95cb-5716de2bc631 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:09.434703 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d7bc2fe5-ab1f-4119-95cb-5716de2bc631 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:09.435817 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d7bc2fe5-ab1f-4119-95cb-5716de2bc631 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:09.436708 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d7bc2fe5-ab1f-4119-95cb-5716de2bc631 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:09.712086 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d7bc2fe5-ab1f-4119-95cb-5716de2bc631 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4" status: 200 len: 1463 microversion: 2.1 time: 0.303493 Sep 17 21:23:09.712762 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2831/5735] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:09 2022] GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4 => generated 1463 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:10.742575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3b90c2d6-ee5a-4712-b9fd-01eaa127cde0 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:10.744237 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3b90c2d6-ee5a-4712-b9fd-01eaa127cde0 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 08252884-b260-4efa-9c3f-d8e6bbb33ff4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:10.756789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b90c2d6-ee5a-4712-b9fd-01eaa127cde0 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:10.757894 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b90c2d6-ee5a-4712-b9fd-01eaa127cde0 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:10.758641 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b90c2d6-ee5a-4712-b9fd-01eaa127cde0 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:10.759456 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b90c2d6-ee5a-4712-b9fd-01eaa127cde0 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:10.760136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b90c2d6-ee5a-4712-b9fd-01eaa127cde0 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:10.762013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b90c2d6-ee5a-4712-b9fd-01eaa127cde0 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:11.046268 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3b90c2d6-ee5a-4712-b9fd-01eaa127cde0 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4" status: 200 len: 1463 microversion: 2.1 time: 0.313737 Sep 17 21:23:11.047586 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2905/5736] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:10 2022] GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4 => generated 1463 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:12.071342 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e07620c1-2404-4dbc-b548-e0a8959393ac tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:12.072536 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e07620c1-2404-4dbc-b548-e0a8959393ac tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 08252884-b260-4efa-9c3f-d8e6bbb33ff4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:12.079874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:23:12.081959 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e07620c1-2404-4dbc-b548-e0a8959393ac tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:12.083020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e07620c1-2404-4dbc-b548-e0a8959393ac tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:12.083707 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e07620c1-2404-4dbc-b548-e0a8959393ac tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:12.084616 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e07620c1-2404-4dbc-b548-e0a8959393ac tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:12.085273 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e07620c1-2404-4dbc-b548-e0a8959393ac tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:12.085925 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e07620c1-2404-4dbc-b548-e0a8959393ac tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:12.214566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-4e14b484-1f7b-4b1c-b88c-b5825de107e9 req-7a7b67d6-05a0-4174-b4bd-1e751552c50b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08252884-b260-4efa-9c3f-d8e6bbb33ff4", "tag": "2d1b6a72-cbbf-4d52-9455-ab6ff90e4033"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:23:12.232763 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4e14b484-1f7b-4b1c-b88c-b5825de107e9 req-7a7b67d6-05a0-4174-b4bd-1e751552c50b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:12.233500 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4e14b484-1f7b-4b1c-b88c-b5825de107e9 req-7a7b67d6-05a0-4174-b4bd-1e751552c50b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:12.234425 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4e14b484-1f7b-4b1c-b88c-b5825de107e9 req-7a7b67d6-05a0-4174-b4bd-1e751552c50b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:12.252906 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-4e14b484-1f7b-4b1c-b88c-b5825de107e9 req-7a7b67d6-05a0-4174-b4bd-1e751552c50b service nova] Creating event network-changed:2d1b6a72-cbbf-4d52-9455-ab6ff90e4033 for instance 08252884-b260-4efa-9c3f-d8e6bbb33ff4 on nch2-master-1 Sep 17 21:23:12.259680 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-4e14b484-1f7b-4b1c-b88c-b5825de107e9 req-7a7b67d6-05a0-4174-b4bd-1e751552c50b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049170 Sep 17 21:23:12.265980 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2906/5737] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:23:12.314370 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e07620c1-2404-4dbc-b548-e0a8959393ac tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4" status: 200 len: 1463 microversion: 2.1 time: 0.246638 Sep 17 21:23:12.326016 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2832/5738] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:12 2022] GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4 => generated 1463 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:13.342703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9241c369-4371-43ae-aebf-9533234ee178 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:13.343736 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9241c369-4371-43ae-aebf-9533234ee178 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 08252884-b260-4efa-9c3f-d8e6bbb33ff4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:13.351581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:23:13.353833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9241c369-4371-43ae-aebf-9533234ee178 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:13.354486 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9241c369-4371-43ae-aebf-9533234ee178 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:13.355095 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9241c369-4371-43ae-aebf-9533234ee178 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:13.355952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9241c369-4371-43ae-aebf-9533234ee178 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:13.356518 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9241c369-4371-43ae-aebf-9533234ee178 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:13.357271 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9241c369-4371-43ae-aebf-9533234ee178 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:13.738985 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9241c369-4371-43ae-aebf-9533234ee178 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4" status: 200 len: 1463 microversion: 2.1 time: 0.403905 Sep 17 21:23:13.740959 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2907/5739] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:13 2022] GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4 => generated 1463 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:23:14.767943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-00cb8114-9f05-40fb-a98f-3ef0b0fe01bd tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:14.770953 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-00cb8114-9f05-40fb-a98f-3ef0b0fe01bd tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 08252884-b260-4efa-9c3f-d8e6bbb33ff4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:14.797164 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00cb8114-9f05-40fb-a98f-3ef0b0fe01bd tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:14.801980 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00cb8114-9f05-40fb-a98f-3ef0b0fe01bd tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:14.804930 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00cb8114-9f05-40fb-a98f-3ef0b0fe01bd tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:14.807241 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00cb8114-9f05-40fb-a98f-3ef0b0fe01bd tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:14.810385 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00cb8114-9f05-40fb-a98f-3ef0b0fe01bd tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:14.812858 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00cb8114-9f05-40fb-a98f-3ef0b0fe01bd tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:15.556316 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-00cb8114-9f05-40fb-a98f-3ef0b0fe01bd tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4" status: 200 len: 1463 microversion: 2.1 time: 0.785764 Sep 17 21:23:15.557276 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2833/5740] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:14 2022] GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4 => generated 1463 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:16.584839 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ac89ac6f-368d-4783-ae7b-1ba9ca1d4136 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:16.585968 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ac89ac6f-368d-4783-ae7b-1ba9ca1d4136 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 08252884-b260-4efa-9c3f-d8e6bbb33ff4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:16.602798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac89ac6f-368d-4783-ae7b-1ba9ca1d4136 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:16.604592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac89ac6f-368d-4783-ae7b-1ba9ca1d4136 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:16.605515 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac89ac6f-368d-4783-ae7b-1ba9ca1d4136 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:16.608087 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac89ac6f-368d-4783-ae7b-1ba9ca1d4136 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:16.608565 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac89ac6f-368d-4783-ae7b-1ba9ca1d4136 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:16.609002 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ac89ac6f-368d-4783-ae7b-1ba9ca1d4136 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:17.425924 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ac89ac6f-368d-4783-ae7b-1ba9ca1d4136 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4" status: 200 len: 1463 microversion: 2.1 time: 0.846308 Sep 17 21:23:17.443448 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2908/5741] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:16 2022] GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4 => generated 1463 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:18.454009 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a57cf145-0578-4506-87a0-3c39be33dfbf tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:18.463480 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a57cf145-0578-4506-87a0-3c39be33dfbf tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 08252884-b260-4efa-9c3f-d8e6bbb33ff4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:18.469805 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:23:18.472371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=8 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:23:18.500698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a57cf145-0578-4506-87a0-3c39be33dfbf tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:18.501903 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a57cf145-0578-4506-87a0-3c39be33dfbf tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:18.502558 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a57cf145-0578-4506-87a0-3c39be33dfbf tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:18.504941 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a57cf145-0578-4506-87a0-3c39be33dfbf tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:18.509447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a57cf145-0578-4506-87a0-3c39be33dfbf tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:18.509447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a57cf145-0578-4506-87a0-3c39be33dfbf tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:19.037215 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a57cf145-0578-4506-87a0-3c39be33dfbf tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4" status: 200 len: 1463 microversion: 2.1 time: 0.587188 Sep 17 21:23:19.049489 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2834/5742] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:18 2022] GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4 => generated 1463 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:19.382787 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-f916c729-95b9-455c-b1a6-fe1a1090868a req-7d0b70b8-0986-46d5-a8ae-10eb7338c17d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08252884-b260-4efa-9c3f-d8e6bbb33ff4", "name": "network-vif-plugged", "status": "completed", "tag": "2d1b6a72-cbbf-4d52-9455-ab6ff90e4033"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:23:19.414117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f916c729-95b9-455c-b1a6-fe1a1090868a req-7d0b70b8-0986-46d5-a8ae-10eb7338c17d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:19.416962 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f916c729-95b9-455c-b1a6-fe1a1090868a req-7d0b70b8-0986-46d5-a8ae-10eb7338c17d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:19.420049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f916c729-95b9-455c-b1a6-fe1a1090868a req-7d0b70b8-0986-46d5-a8ae-10eb7338c17d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:19.441189 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-f916c729-95b9-455c-b1a6-fe1a1090868a req-7d0b70b8-0986-46d5-a8ae-10eb7338c17d service nova] Creating event network-vif-plugged:2d1b6a72-cbbf-4d52-9455-ab6ff90e4033 for instance 08252884-b260-4efa-9c3f-d8e6bbb33ff4 on nch2-master-1 Sep 17 21:23:19.449122 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-f916c729-95b9-455c-b1a6-fe1a1090868a req-7d0b70b8-0986-46d5-a8ae-10eb7338c17d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070157 Sep 17 21:23:19.451030 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2909/5743] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:23:20.064170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bcd0a59a-5c2d-40bd-b772-587221dd03fd tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:20.068296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bcd0a59a-5c2d-40bd-b772-587221dd03fd tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 08252884-b260-4efa-9c3f-d8e6bbb33ff4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:20.078541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bcd0a59a-5c2d-40bd-b772-587221dd03fd tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:20.080970 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bcd0a59a-5c2d-40bd-b772-587221dd03fd tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:20.081693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bcd0a59a-5c2d-40bd-b772-587221dd03fd tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:20.083315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bcd0a59a-5c2d-40bd-b772-587221dd03fd tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:20.084480 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bcd0a59a-5c2d-40bd-b772-587221dd03fd tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:20.085126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bcd0a59a-5c2d-40bd-b772-587221dd03fd tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:20.418713 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bcd0a59a-5c2d-40bd-b772-587221dd03fd tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4" status: 200 len: 1463 microversion: 2.1 time: 0.357913 Sep 17 21:23:20.436462 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2835/5744] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:20 2022] GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4 => generated 1463 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:21.446389 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-28d5f81d-0f27-4d03-b8fd-0c9a34c07484 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:21.447724 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-28d5f81d-0f27-4d03-b8fd-0c9a34c07484 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 08252884-b260-4efa-9c3f-d8e6bbb33ff4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:21.454542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28d5f81d-0f27-4d03-b8fd-0c9a34c07484 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:21.455381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28d5f81d-0f27-4d03-b8fd-0c9a34c07484 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:21.456067 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28d5f81d-0f27-4d03-b8fd-0c9a34c07484 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:21.457660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28d5f81d-0f27-4d03-b8fd-0c9a34c07484 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:21.458364 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28d5f81d-0f27-4d03-b8fd-0c9a34c07484 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:21.459309 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28d5f81d-0f27-4d03-b8fd-0c9a34c07484 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:21.701985 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-28d5f81d-0f27-4d03-b8fd-0c9a34c07484 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4" status: 200 len: 1647 microversion: 2.1 time: 0.261039 Sep 17 21:23:21.713747 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2910/5745] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:21 2022] GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4 => generated 1647 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:21.726601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d6dc3828-cad7-4216-a822-2d56b871e704 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:21.727404 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d6dc3828-cad7-4216-a822-2d56b871e704 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 08252884-b260-4efa-9c3f-d8e6bbb33ff4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:21.734742 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d6dc3828-cad7-4216-a822-2d56b871e704 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:21.735244 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d6dc3828-cad7-4216-a822-2d56b871e704 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:21.735741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d6dc3828-cad7-4216-a822-2d56b871e704 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:21.736531 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d6dc3828-cad7-4216-a822-2d56b871e704 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:21.736982 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d6dc3828-cad7-4216-a822-2d56b871e704 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:21.737415 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d6dc3828-cad7-4216-a822-2d56b871e704 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:21.977174 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d6dc3828-cad7-4216-a822-2d56b871e704 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4" status: 200 len: 1647 microversion: 2.1 time: 0.254655 Sep 17 21:23:21.977845 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2836/5746] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:21 2022] GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4 => generated 1647 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:22.000193 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f3bbd303-4513-40ea-9fac-e4b67fc9dde0 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:22.000832 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f3bbd303-4513-40ea-9fac-e4b67fc9dde0 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 08252884-b260-4efa-9c3f-d8e6bbb33ff4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:22.008286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3bbd303-4513-40ea-9fac-e4b67fc9dde0 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:22.009172 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3bbd303-4513-40ea-9fac-e4b67fc9dde0 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:22.009826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3bbd303-4513-40ea-9fac-e4b67fc9dde0 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:22.010562 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3bbd303-4513-40ea-9fac-e4b67fc9dde0 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:22.011102 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3bbd303-4513-40ea-9fac-e4b67fc9dde0 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:22.011542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f3bbd303-4513-40ea-9fac-e4b67fc9dde0 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:22.183303 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f3bbd303-4513-40ea-9fac-e4b67fc9dde0 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4" status: 200 len: 1647 microversion: 2.1 time: 0.186861 Sep 17 21:23:22.184276 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2911/5747] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:21 2022] GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4 => generated 1647 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:22.209147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2602a9d7-3259-4772-81a9-50ebb515fa66 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:22.209990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2602a9d7-3259-4772-81a9-50ebb515fa66 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 08252884-b260-4efa-9c3f-d8e6bbb33ff4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:22.217080 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2602a9d7-3259-4772-81a9-50ebb515fa66 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:22.218729 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2602a9d7-3259-4772-81a9-50ebb515fa66 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:22.219463 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2602a9d7-3259-4772-81a9-50ebb515fa66 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:22.220464 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2602a9d7-3259-4772-81a9-50ebb515fa66 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:22.221157 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2602a9d7-3259-4772-81a9-50ebb515fa66 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:22.221860 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2602a9d7-3259-4772-81a9-50ebb515fa66 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:22.256529 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2602a9d7-3259-4772-81a9-50ebb515fa66 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 08252884-b260-4efa-9c3f-d8e6bbb33ff4] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:23:22.360386 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2602a9d7-3259-4772-81a9-50ebb515fa66 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "DELETE /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4" status: 204 len: 0 microversion: 2.1 time: 0.156816 Sep 17 21:23:22.373604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b37e70f2-eff3-47c9-aa65-3c8f3aee19f7 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:22.375739 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b37e70f2-eff3-47c9-aa65-3c8f3aee19f7 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 08252884-b260-4efa-9c3f-d8e6bbb33ff4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:22.381551 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2837/5748] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:23:22 2022] DELETE /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:23:22.389016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b37e70f2-eff3-47c9-aa65-3c8f3aee19f7 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:22.390216 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b37e70f2-eff3-47c9-aa65-3c8f3aee19f7 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:22.390678 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b37e70f2-eff3-47c9-aa65-3c8f3aee19f7 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:22.391405 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b37e70f2-eff3-47c9-aa65-3c8f3aee19f7 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:22.391867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b37e70f2-eff3-47c9-aa65-3c8f3aee19f7 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:22.392292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b37e70f2-eff3-47c9-aa65-3c8f3aee19f7 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:22.704533 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b37e70f2-eff3-47c9-aa65-3c8f3aee19f7 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4" status: 200 len: 1653 microversion: 2.1 time: 0.335352 Sep 17 21:23:22.707568 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2912/5749] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:22 2022] GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4 => generated 1653 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:23.732622 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-803b7c73-5a82-43da-a6fc-78cb8e7accb5 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:23.734579 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-803b7c73-5a82-43da-a6fc-78cb8e7accb5 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 08252884-b260-4efa-9c3f-d8e6bbb33ff4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:23.769416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-803b7c73-5a82-43da-a6fc-78cb8e7accb5 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:23.773200 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-803b7c73-5a82-43da-a6fc-78cb8e7accb5 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:23.775100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-803b7c73-5a82-43da-a6fc-78cb8e7accb5 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:23.777088 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-803b7c73-5a82-43da-a6fc-78cb8e7accb5 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:23.777816 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-803b7c73-5a82-43da-a6fc-78cb8e7accb5 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:23.778173 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-803b7c73-5a82-43da-a6fc-78cb8e7accb5 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:24.225686 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-803b7c73-5a82-43da-a6fc-78cb8e7accb5 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4" status: 200 len: 1653 microversion: 2.1 time: 0.498421 Sep 17 21:23:24.226972 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2838/5750] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:23 2022] GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4 => generated 1653 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:24.584561 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-f0c6ac70-8e03-4d83-a774-809f2182d44c req-8e209b54-9b22-4e0b-934c-2ed96efa9bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08252884-b260-4efa-9c3f-d8e6bbb33ff4", "name": "network-vif-deleted", "tag": "2d1b6a72-cbbf-4d52-9455-ab6ff90e4033"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:23:24.608590 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f0c6ac70-8e03-4d83-a774-809f2182d44c req-8e209b54-9b22-4e0b-934c-2ed96efa9bb0 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:24.609133 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f0c6ac70-8e03-4d83-a774-809f2182d44c req-8e209b54-9b22-4e0b-934c-2ed96efa9bb0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:24.609725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f0c6ac70-8e03-4d83-a774-809f2182d44c req-8e209b54-9b22-4e0b-934c-2ed96efa9bb0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:24.673250 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-f0c6ac70-8e03-4d83-a774-809f2182d44c req-8e209b54-9b22-4e0b-934c-2ed96efa9bb0 service nova] Creating event network-vif-deleted:2d1b6a72-cbbf-4d52-9455-ab6ff90e4033 for instance 08252884-b260-4efa-9c3f-d8e6bbb33ff4 on nch2-master-1 Sep 17 21:23:24.690436 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-f0c6ac70-8e03-4d83-a774-809f2182d44c req-8e209b54-9b22-4e0b-934c-2ed96efa9bb0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106284 Sep 17 21:23:24.697803 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2913/5751] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:23:25.250119 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c3e30a1b-e967-4723-8012-976aafcb8683 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:25.251635 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c3e30a1b-e967-4723-8012-976aafcb8683 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 08252884-b260-4efa-9c3f-d8e6bbb33ff4] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:25.265368 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3e30a1b-e967-4723-8012-976aafcb8683 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:25.266305 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3e30a1b-e967-4723-8012-976aafcb8683 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:25.266976 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3e30a1b-e967-4723-8012-976aafcb8683 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:25.267948 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3e30a1b-e967-4723-8012-976aafcb8683 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:25.268513 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3e30a1b-e967-4723-8012-976aafcb8683 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:25.269389 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3e30a1b-e967-4723-8012-976aafcb8683 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:25.343531 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3e30a1b-e967-4723-8012-976aafcb8683 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:25.344043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3e30a1b-e967-4723-8012-976aafcb8683 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:25.344614 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c3e30a1b-e967-4723-8012-976aafcb8683 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:25.345356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-c3e30a1b-e967-4723-8012-976aafcb8683 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lazy-loading 'fault' on Instance uuid 08252884-b260-4efa-9c3f-d8e6bbb33ff4 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:23:25.452303 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c3e30a1b-e967-4723-8012-976aafcb8683 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4" status: 200 len: 1453 microversion: 2.1 time: 0.205317 Sep 17 21:23:25.461149 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2839/5752] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:25 2022] GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4 => generated 1453 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:26.479699 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-aa172819-9f77-4f8e-a683-f5bbaee60ac6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:26.481630 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-aa172819-9f77-4f8e-a683-f5bbaee60ac6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 08252884-b260-4efa-9c3f-d8e6bbb33ff4] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:26.496040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa172819-9f77-4f8e-a683-f5bbaee60ac6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:26.496864 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa172819-9f77-4f8e-a683-f5bbaee60ac6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:26.498447 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa172819-9f77-4f8e-a683-f5bbaee60ac6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:26.500184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa172819-9f77-4f8e-a683-f5bbaee60ac6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:26.500838 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa172819-9f77-4f8e-a683-f5bbaee60ac6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:26.501431 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa172819-9f77-4f8e-a683-f5bbaee60ac6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:26.529214 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-aa172819-9f77-4f8e-a683-f5bbaee60ac6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] HTTP exception thrown: Instance 08252884-b260-4efa-9c3f-d8e6bbb33ff4 could not be found. Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-aa172819-9f77-4f8e-a683-f5bbaee60ac6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Request method failure captured: Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4 HTTP/1.1 Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjqhiUboJjH-p7KZksjYVxHHlIZghcbgKgYHnq8KiiLfTRVEsSek8zKSmaLnPJ9xl4HEv7PIODP_GBEhOWxNtI10vicXqjsbtOeQ5kZiwfC0QBevta_iZZYJonNKqgKhNmVvUScbxPfH0pqrDSADbA5dya3oFZUFFwt150lR7xbT3UA Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 718efb2481024b278d50730fec729eeb Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-TestServerMultinode-204785424 Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: X-Role: admin,member,reader Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: admin,member,reader Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/718efb2481024b278d50730fec729eeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/718efb2481024b278d50730fec729eeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/718efb2481024b278d50730fec729eeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_718efb2481024b278d50730fec729eeb", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-TestServerMultinode-204785424 Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 718efb2481024b278d50730fec729eeb Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-TestServerMultinode-204785424 Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-TestServerMultinode-204785424-project-admin Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 70b0d8337e20432584f80476b46453f0 Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-TestServerMultinode-204785424-project-admin Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 08252884-b260-4efa-9c3f-d8e6bbb33ff4 could not be found. Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '08252884-b260-4efa-9c3f-d8e6bbb33ff4'} Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08252884-b260-4efa-9c3f-d8e6bbb33ff4 could not be found. Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08252884-b260-4efa-9c3f-d8e6bbb33ff4 could not be found. Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:23:26.531768 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:23:26.537428 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:23:26.537428 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:23:26.537428 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:23:26.537428 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:23:26.537428 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:23:26.537428 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08252884-b260-4efa-9c3f-d8e6bbb33ff4 could not be found. Sep 17 21:23:26.537428 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:23:26.541092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-aa172819-9f77-4f8e-a683-f5bbaee60ac6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Returning 404 to user: Instance 08252884-b260-4efa-9c3f-d8e6bbb33ff4 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:23:26.542234 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-aa172819-9f77-4f8e-a683-f5bbaee60ac6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4" status: 404 len: 111 microversion: 2.1 time: 0.067914 Sep 17 21:23:26.543395 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2914/5753] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:26 2022] GET /compute/v2.1/servers/08252884-b260-4efa-9c3f-d8e6bbb33ff4 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:23:26.553748 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-40811db9-44dd-4e2c-9354-49c24f7058df tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:26.554362 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-40811db9-44dd-4e2c-9354-49c24f7058df tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 7600edde-2420-4f54-8700-57b6662aab82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:26.564265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-40811db9-44dd-4e2c-9354-49c24f7058df tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:26.564866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-40811db9-44dd-4e2c-9354-49c24f7058df tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:26.565385 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-40811db9-44dd-4e2c-9354-49c24f7058df tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:26.566239 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-40811db9-44dd-4e2c-9354-49c24f7058df tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:26.566824 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-40811db9-44dd-4e2c-9354-49c24f7058df tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:26.567335 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-40811db9-44dd-4e2c-9354-49c24f7058df tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:26.596175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-40811db9-44dd-4e2c-9354-49c24f7058df tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 7600edde-2420-4f54-8700-57b6662aab82] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:23:26.735095 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-40811db9-44dd-4e2c-9354-49c24f7058df tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "DELETE /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82" status: 204 len: 0 microversion: 2.1 time: 0.184577 Sep 17 21:23:26.736114 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2840/5754] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:23:26 2022] DELETE /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:23:26.747558 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7d0a8dad-05ec-438b-b1fc-9e3c345e9ff2 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:26.748638 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7d0a8dad-05ec-438b-b1fc-9e3c345e9ff2 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 7600edde-2420-4f54-8700-57b6662aab82] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:26.757370 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d0a8dad-05ec-438b-b1fc-9e3c345e9ff2 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:26.758020 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d0a8dad-05ec-438b-b1fc-9e3c345e9ff2 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:26.758687 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d0a8dad-05ec-438b-b1fc-9e3c345e9ff2 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:26.759696 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d0a8dad-05ec-438b-b1fc-9e3c345e9ff2 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:26.760879 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d0a8dad-05ec-438b-b1fc-9e3c345e9ff2 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:26.761549 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d0a8dad-05ec-438b-b1fc-9e3c345e9ff2 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:26.932348 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7d0a8dad-05ec-438b-b1fc-9e3c345e9ff2 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82" status: 200 len: 1653 microversion: 2.1 time: 0.190212 Sep 17 21:23:26.938605 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2915/5755] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:26 2022] GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82 => generated 1653 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:23:27.964220 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-db3dec94-ca86-4f63-ad2c-aed4973ca45f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:27.965618 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-db3dec94-ca86-4f63-ad2c-aed4973ca45f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 7600edde-2420-4f54-8700-57b6662aab82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:27.973501 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db3dec94-ca86-4f63-ad2c-aed4973ca45f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:27.974652 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db3dec94-ca86-4f63-ad2c-aed4973ca45f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:27.975306 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db3dec94-ca86-4f63-ad2c-aed4973ca45f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:27.976191 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db3dec94-ca86-4f63-ad2c-aed4973ca45f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:27.976662 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db3dec94-ca86-4f63-ad2c-aed4973ca45f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:27.977100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-db3dec94-ca86-4f63-ad2c-aed4973ca45f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:28.266702 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-db3dec94-ca86-4f63-ad2c-aed4973ca45f tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82" status: 200 len: 1653 microversion: 2.1 time: 0.304293 Sep 17 21:23:28.266702 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2841/5756] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:27 2022] GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82 => generated 1653 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:28.919016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-c6fac81d-dbf7-4354-b569-975f86c1bbd7 req-bc5a482b-0ef2-49ff-ae81-933d247b6dda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7600edde-2420-4f54-8700-57b6662aab82", "name": "network-vif-deleted", "tag": "ec948612-ee79-439b-bdd8-78951ea065a1"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:23:28.971168 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c6fac81d-dbf7-4354-b569-975f86c1bbd7 req-bc5a482b-0ef2-49ff-ae81-933d247b6dda service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:28.971669 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c6fac81d-dbf7-4354-b569-975f86c1bbd7 req-bc5a482b-0ef2-49ff-ae81-933d247b6dda service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:28.972110 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c6fac81d-dbf7-4354-b569-975f86c1bbd7 req-bc5a482b-0ef2-49ff-ae81-933d247b6dda service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:28.994443 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-c6fac81d-dbf7-4354-b569-975f86c1bbd7 req-bc5a482b-0ef2-49ff-ae81-933d247b6dda service nova] Creating event network-vif-deleted:ec948612-ee79-439b-bdd8-78951ea065a1 for instance 7600edde-2420-4f54-8700-57b6662aab82 on nch1-master-1 Sep 17 21:23:29.021283 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-c6fac81d-dbf7-4354-b569-975f86c1bbd7 req-bc5a482b-0ef2-49ff-ae81-933d247b6dda service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107984 Sep 17 21:23:29.022126 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2916/5757] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:23:29.299131 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-99c7dc7b-9c4a-4151-93c1-226ef5b658e6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:29.300774 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-99c7dc7b-9c4a-4151-93c1-226ef5b658e6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 7600edde-2420-4f54-8700-57b6662aab82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:29.326761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99c7dc7b-9c4a-4151-93c1-226ef5b658e6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:29.327373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99c7dc7b-9c4a-4151-93c1-226ef5b658e6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:29.328033 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99c7dc7b-9c4a-4151-93c1-226ef5b658e6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:29.328886 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99c7dc7b-9c4a-4151-93c1-226ef5b658e6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:29.329847 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99c7dc7b-9c4a-4151-93c1-226ef5b658e6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:29.332123 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99c7dc7b-9c4a-4151-93c1-226ef5b658e6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:29.383003 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:23:29.418311 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99c7dc7b-9c4a-4151-93c1-226ef5b658e6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:29.424261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99c7dc7b-9c4a-4151-93c1-226ef5b658e6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:29.425044 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99c7dc7b-9c4a-4151-93c1-226ef5b658e6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:29.428048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-99c7dc7b-9c4a-4151-93c1-226ef5b658e6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lazy-loading 'fault' on Instance uuid 7600edde-2420-4f54-8700-57b6662aab82 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:23:29.562329 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-99c7dc7b-9c4a-4151-93c1-226ef5b658e6 tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82" status: 200 len: 1452 microversion: 2.1 time: 0.274619 Sep 17 21:23:29.564859 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2842/5758] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:29 2022] GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82 => generated 1452 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:30.591139 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-47cac2c0-daa2-4013-9863-3830573558aa tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:30.593222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-47cac2c0-daa2-4013-9863-3830573558aa tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] [instance: 7600edde-2420-4f54-8700-57b6662aab82] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:30.614949 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-47cac2c0-daa2-4013-9863-3830573558aa tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:30.615734 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-47cac2c0-daa2-4013-9863-3830573558aa tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:30.616517 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-47cac2c0-daa2-4013-9863-3830573558aa tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:30.617268 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-47cac2c0-daa2-4013-9863-3830573558aa tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:30.620833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-47cac2c0-daa2-4013-9863-3830573558aa tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:30.624280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-47cac2c0-daa2-4013-9863-3830573558aa tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:30.668008 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-47cac2c0-daa2-4013-9863-3830573558aa tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] HTTP exception thrown: Instance 7600edde-2420-4f54-8700-57b6662aab82 could not be found. Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-47cac2c0-daa2-4013-9863-3830573558aa tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Request method failure captured: Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82 HTTP/1.1 Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjqhiUboJjH-p7KZksjYVxHHlIZghcbgKgYHnq8KiiLfTRVEsSek8zKSmaLnPJ9xl4HEv7PIODP_GBEhOWxNtI10vicXqjsbtOeQ5kZiwfC0QBevta_iZZYJonNKqgKhNmVvUScbxPfH0pqrDSADbA5dya3oFZUFFwt150lR7xbT3UA Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 718efb2481024b278d50730fec729eeb Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-TestServerMultinode-204785424 Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: X-Role: admin,member,reader Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: admin,member,reader Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/718efb2481024b278d50730fec729eeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/718efb2481024b278d50730fec729eeb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/718efb2481024b278d50730fec729eeb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_718efb2481024b278d50730fec729eeb", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-TestServerMultinode-204785424 Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 718efb2481024b278d50730fec729eeb Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-TestServerMultinode-204785424 Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-TestServerMultinode-204785424-project-admin Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 70b0d8337e20432584f80476b46453f0 Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-TestServerMultinode-204785424-project-admin Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 7600edde-2420-4f54-8700-57b6662aab82 could not be found. Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '7600edde-2420-4f54-8700-57b6662aab82'} Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7600edde-2420-4f54-8700-57b6662aab82 could not be found. Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7600edde-2420-4f54-8700-57b6662aab82 could not be found. Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:23:30.670111 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:23:30.674857 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:23:30.674857 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:23:30.674857 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:23:30.674857 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:23:30.674857 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:23:30.674857 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7600edde-2420-4f54-8700-57b6662aab82 could not be found. Sep 17 21:23:30.674857 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:23:30.679538 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-47cac2c0-daa2-4013-9863-3830573558aa tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] Returning 404 to user: Instance 7600edde-2420-4f54-8700-57b6662aab82 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:23:30.680642 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-47cac2c0-daa2-4013-9863-3830573558aa tempest-TestServerMultinode-204785424 tempest-TestServerMultinode-204785424-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82" status: 404 len: 111 microversion: 2.1 time: 0.093813 Sep 17 21:23:30.694818 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2917/5759] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:30 2022] GET /compute/v2.1/servers/7600edde-2420-4f54-8700-57b6662aab82 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:23:39.823189 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:23:39.823948 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=4 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:23:40.054573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-020ec6f1-0b6b-4e11-aeda-2b9631f33904 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1784027742", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "9f1e27da-8451-455c-8788-46ffff804091"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:23:40.134726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-020ec6f1-0b6b-4e11-aeda-2b9631f33904 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] validate_networks() for [('9f1e27da-8451-455c-8788-46ffff804091', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:23:41.539363 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-020ec6f1-0b6b-4e11-aeda-2b9631f33904 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:23:41.540581 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-020ec6f1-0b6b-4e11-aeda-2b9631f33904 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:23:41.542183 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-020ec6f1-0b6b-4e11-aeda-2b9631f33904 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:23:41.542884 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-020ec6f1-0b6b-4e11-aeda-2b9631f33904 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:23:41.543500 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-020ec6f1-0b6b-4e11-aeda-2b9631f33904 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:23:41.567099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-020ec6f1-0b6b-4e11-aeda-2b9631f33904 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:41.567795 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-020ec6f1-0b6b-4e11-aeda-2b9631f33904 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:41.569540 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-020ec6f1-0b6b-4e11-aeda-2b9631f33904 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:41.570764 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-020ec6f1-0b6b-4e11-aeda-2b9631f33904 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:41.571393 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-020ec6f1-0b6b-4e11-aeda-2b9631f33904 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:41.573120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-020ec6f1-0b6b-4e11-aeda-2b9631f33904 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:41.601237 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-020ec6f1-0b6b-4e11-aeda-2b9631f33904 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Getting quotas for project 81468f9a5a5d4b63bf62e9fe4bd19b56. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:23:41.607569 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-020ec6f1-0b6b-4e11-aeda-2b9631f33904 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Getting quotas for user 2c778820854d4636ac34bd86ab7fbaff and project 81468f9a5a5d4b63bf62e9fe4bd19b56. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:23:41.630911 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-020ec6f1-0b6b-4e11-aeda-2b9631f33904 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:23:41.636258 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-020ec6f1-0b6b-4e11-aeda-2b9631f33904 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] [instance: 5a6c60fd-7d16-4795-ba00-e257ca43f28c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:23:41.733652 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-020ec6f1-0b6b-4e11-aeda-2b9631f33904 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.915752 Sep 17 21:23:41.737437 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2843/5760] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:23:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:23:41.749810 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a9a54fff-43fa-4291-a305-33c497f7a6ec tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:41.752022 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a9a54fff-43fa-4291-a305-33c497f7a6ec tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] [instance: 5a6c60fd-7d16-4795-ba00-e257ca43f28c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:41.759401 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=21 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:23:41.760322 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=55 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:23:41.884433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a9a54fff-43fa-4291-a305-33c497f7a6ec tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c778820854d4636ac34bd86ab7fbaff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81468f9a5a5d4b63bf62e9fe4bd19b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:23:41.905750 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a9a54fff-43fa-4291-a305-33c497f7a6ec tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] 10.222.0.26 "GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c" status: 200 len: 1215 microversion: 2.1 time: 0.158213 Sep 17 21:23:41.907431 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2918/5761] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:41 2022] GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c => generated 1215 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:42.934919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7e1b460e-ad15-4312-aed3-4d8a117c8b60 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:42.936400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7e1b460e-ad15-4312-aed3-4d8a117c8b60 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] [instance: 5a6c60fd-7d16-4795-ba00-e257ca43f28c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:42.946081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7e1b460e-ad15-4312-aed3-4d8a117c8b60 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:42.947168 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7e1b460e-ad15-4312-aed3-4d8a117c8b60 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:42.947926 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7e1b460e-ad15-4312-aed3-4d8a117c8b60 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:42.948910 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7e1b460e-ad15-4312-aed3-4d8a117c8b60 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:42.949677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7e1b460e-ad15-4312-aed3-4d8a117c8b60 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:42.950344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7e1b460e-ad15-4312-aed3-4d8a117c8b60 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:43.192814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7e1b460e-ad15-4312-aed3-4d8a117c8b60 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c778820854d4636ac34bd86ab7fbaff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81468f9a5a5d4b63bf62e9fe4bd19b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:23:43.203709 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7e1b460e-ad15-4312-aed3-4d8a117c8b60 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] 10.222.0.26 "GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c" status: 200 len: 1267 microversion: 2.1 time: 0.273956 Sep 17 21:23:43.218026 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2844/5762] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:42 2022] GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c => generated 1267 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:44.228828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ffe5a335-51c2-469f-84ce-9a1b83cd693b tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:44.230873 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ffe5a335-51c2-469f-84ce-9a1b83cd693b tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] [instance: 5a6c60fd-7d16-4795-ba00-e257ca43f28c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:44.240561 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ffe5a335-51c2-469f-84ce-9a1b83cd693b tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:44.241957 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ffe5a335-51c2-469f-84ce-9a1b83cd693b tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:44.242857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ffe5a335-51c2-469f-84ce-9a1b83cd693b tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:44.243965 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ffe5a335-51c2-469f-84ce-9a1b83cd693b tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:44.244688 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ffe5a335-51c2-469f-84ce-9a1b83cd693b tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:44.245308 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ffe5a335-51c2-469f-84ce-9a1b83cd693b tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:44.618543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ffe5a335-51c2-469f-84ce-9a1b83cd693b tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c778820854d4636ac34bd86ab7fbaff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81468f9a5a5d4b63bf62e9fe4bd19b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:23:44.627148 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ffe5a335-51c2-469f-84ce-9a1b83cd693b tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] 10.222.0.26 "GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c" status: 200 len: 1273 microversion: 2.1 time: 0.403271 Sep 17 21:23:44.627540 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2919/5763] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:44 2022] GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c => generated 1273 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:45.653762 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4fe4902a-4579-4348-9835-9a0b492715b3 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:45.656542 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4fe4902a-4579-4348-9835-9a0b492715b3 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] [instance: 5a6c60fd-7d16-4795-ba00-e257ca43f28c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:45.664885 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4fe4902a-4579-4348-9835-9a0b492715b3 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:45.665757 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4fe4902a-4579-4348-9835-9a0b492715b3 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:45.666437 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4fe4902a-4579-4348-9835-9a0b492715b3 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:45.674607 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4fe4902a-4579-4348-9835-9a0b492715b3 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:45.675439 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4fe4902a-4579-4348-9835-9a0b492715b3 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:45.676199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4fe4902a-4579-4348-9835-9a0b492715b3 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:45.904424 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4fe4902a-4579-4348-9835-9a0b492715b3 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c778820854d4636ac34bd86ab7fbaff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81468f9a5a5d4b63bf62e9fe4bd19b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:23:45.914327 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4fe4902a-4579-4348-9835-9a0b492715b3 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] 10.222.0.26 "GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c" status: 200 len: 1315 microversion: 2.1 time: 0.268121 Sep 17 21:23:45.914951 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2845/5764] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:45 2022] GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:46.938783 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-27aca98d-8b54-4d1f-82e9-094a8f7d86d5 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:46.939411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-27aca98d-8b54-4d1f-82e9-094a8f7d86d5 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] [instance: 5a6c60fd-7d16-4795-ba00-e257ca43f28c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:46.949030 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27aca98d-8b54-4d1f-82e9-094a8f7d86d5 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:46.949455 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27aca98d-8b54-4d1f-82e9-094a8f7d86d5 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:46.949939 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27aca98d-8b54-4d1f-82e9-094a8f7d86d5 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:46.950655 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27aca98d-8b54-4d1f-82e9-094a8f7d86d5 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:46.956383 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27aca98d-8b54-4d1f-82e9-094a8f7d86d5 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:46.957213 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27aca98d-8b54-4d1f-82e9-094a8f7d86d5 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:47.296169 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-27aca98d-8b54-4d1f-82e9-094a8f7d86d5 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c778820854d4636ac34bd86ab7fbaff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81468f9a5a5d4b63bf62e9fe4bd19b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:23:47.306092 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-27aca98d-8b54-4d1f-82e9-094a8f7d86d5 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] 10.222.0.26 "GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c" status: 200 len: 1315 microversion: 2.1 time: 0.370745 Sep 17 21:23:47.306092 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2920/5765] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:46 2022] GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c => generated 1315 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:48.091264 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-fa196c1a-a66a-4b37-99a2-92e42252876c req-79ef679e-4d86-412e-8168-11fcde532b2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a6c60fd-7d16-4795-ba00-e257ca43f28c", "tag": "fd286100-b884-4544-99f7-9b92bb066410"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:23:48.130118 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-fa196c1a-a66a-4b37-99a2-92e42252876c req-79ef679e-4d86-412e-8168-11fcde532b2d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:48.130618 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-fa196c1a-a66a-4b37-99a2-92e42252876c req-79ef679e-4d86-412e-8168-11fcde532b2d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:48.131066 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-fa196c1a-a66a-4b37-99a2-92e42252876c req-79ef679e-4d86-412e-8168-11fcde532b2d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:48.166166 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-fa196c1a-a66a-4b37-99a2-92e42252876c req-79ef679e-4d86-412e-8168-11fcde532b2d service nova] Creating event network-changed:fd286100-b884-4544-99f7-9b92bb066410 for instance 5a6c60fd-7d16-4795-ba00-e257ca43f28c on nch1-master-1 Sep 17 21:23:48.172439 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-fa196c1a-a66a-4b37-99a2-92e42252876c req-79ef679e-4d86-412e-8168-11fcde532b2d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084909 Sep 17 21:23:48.173972 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2846/5766] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:23:48.334010 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3edc959c-0204-44c6-88bf-07bfe3c497cf tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:48.336492 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3edc959c-0204-44c6-88bf-07bfe3c497cf tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] [instance: 5a6c60fd-7d16-4795-ba00-e257ca43f28c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:48.350505 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3edc959c-0204-44c6-88bf-07bfe3c497cf tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:48.351394 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3edc959c-0204-44c6-88bf-07bfe3c497cf tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:48.354989 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3edc959c-0204-44c6-88bf-07bfe3c497cf tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:48.356774 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3edc959c-0204-44c6-88bf-07bfe3c497cf tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:48.358839 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3edc959c-0204-44c6-88bf-07bfe3c497cf tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:48.359390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3edc959c-0204-44c6-88bf-07bfe3c497cf tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:48.628450 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3edc959c-0204-44c6-88bf-07bfe3c497cf tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c778820854d4636ac34bd86ab7fbaff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81468f9a5a5d4b63bf62e9fe4bd19b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:23:48.640723 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3edc959c-0204-44c6-88bf-07bfe3c497cf tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] 10.222.0.26 "GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c" status: 200 len: 1315 microversion: 2.1 time: 0.316375 Sep 17 21:23:48.645579 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2921/5767] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:48 2022] GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:49.670645 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-55ecc606-94e1-4ec5-afe3-bf4f25e21c2f tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:49.671429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-55ecc606-94e1-4ec5-afe3-bf4f25e21c2f tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] [instance: 5a6c60fd-7d16-4795-ba00-e257ca43f28c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:49.682677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55ecc606-94e1-4ec5-afe3-bf4f25e21c2f tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:49.683300 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55ecc606-94e1-4ec5-afe3-bf4f25e21c2f tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:49.683740 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55ecc606-94e1-4ec5-afe3-bf4f25e21c2f tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:49.684407 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55ecc606-94e1-4ec5-afe3-bf4f25e21c2f tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:49.684872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55ecc606-94e1-4ec5-afe3-bf4f25e21c2f tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:49.685315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55ecc606-94e1-4ec5-afe3-bf4f25e21c2f tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:49.970203 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-55ecc606-94e1-4ec5-afe3-bf4f25e21c2f tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c778820854d4636ac34bd86ab7fbaff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81468f9a5a5d4b63bf62e9fe4bd19b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:23:49.978435 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-55ecc606-94e1-4ec5-afe3-bf4f25e21c2f tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] 10.222.0.26 "GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c" status: 200 len: 1315 microversion: 2.1 time: 0.314020 Sep 17 21:23:49.989000 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2847/5768] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:49 2022] GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:51.002390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f65f5186-8fda-4001-bfbb-a25a06da76a2 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:51.003002 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f65f5186-8fda-4001-bfbb-a25a06da76a2 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] [instance: 5a6c60fd-7d16-4795-ba00-e257ca43f28c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:51.015305 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f65f5186-8fda-4001-bfbb-a25a06da76a2 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:51.015828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f65f5186-8fda-4001-bfbb-a25a06da76a2 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:51.016279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f65f5186-8fda-4001-bfbb-a25a06da76a2 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:51.017001 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f65f5186-8fda-4001-bfbb-a25a06da76a2 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:51.017489 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f65f5186-8fda-4001-bfbb-a25a06da76a2 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:51.017922 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f65f5186-8fda-4001-bfbb-a25a06da76a2 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:51.224746 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f65f5186-8fda-4001-bfbb-a25a06da76a2 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c778820854d4636ac34bd86ab7fbaff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81468f9a5a5d4b63bf62e9fe4bd19b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:23:51.233740 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f65f5186-8fda-4001-bfbb-a25a06da76a2 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] 10.222.0.26 "GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c" status: 200 len: 1315 microversion: 2.1 time: 0.235126 Sep 17 21:23:51.234460 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2922/5769] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:50 2022] GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:52.258078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f2e9092d-66ac-49a5-916a-d5902146b024 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:52.258706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f2e9092d-66ac-49a5-916a-d5902146b024 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] [instance: 5a6c60fd-7d16-4795-ba00-e257ca43f28c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:52.265299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:23:52.266677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:23:52.268418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2e9092d-66ac-49a5-916a-d5902146b024 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:52.269172 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2e9092d-66ac-49a5-916a-d5902146b024 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:52.270118 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2e9092d-66ac-49a5-916a-d5902146b024 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:52.271346 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2e9092d-66ac-49a5-916a-d5902146b024 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:52.272049 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2e9092d-66ac-49a5-916a-d5902146b024 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:52.272736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2e9092d-66ac-49a5-916a-d5902146b024 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:52.498064 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f2e9092d-66ac-49a5-916a-d5902146b024 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c778820854d4636ac34bd86ab7fbaff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81468f9a5a5d4b63bf62e9fe4bd19b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:23:52.513068 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f2e9092d-66ac-49a5-916a-d5902146b024 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] 10.222.0.26 "GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c" status: 200 len: 1315 microversion: 2.1 time: 0.258797 Sep 17 21:23:52.514159 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2848/5770] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:52 2022] GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:53.345720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-06582000-943f-4d62-800d-6bccf6999af6 req-77f3c066-ad98-4d35-879d-b739f715ad23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a6c60fd-7d16-4795-ba00-e257ca43f28c", "name": "network-vif-plugged", "status": "completed", "tag": "fd286100-b884-4544-99f7-9b92bb066410"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:23:53.361083 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:23:53.365412 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-06582000-943f-4d62-800d-6bccf6999af6 req-77f3c066-ad98-4d35-879d-b739f715ad23 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:53.365772 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-06582000-943f-4d62-800d-6bccf6999af6 req-77f3c066-ad98-4d35-879d-b739f715ad23 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:53.366756 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-06582000-943f-4d62-800d-6bccf6999af6 req-77f3c066-ad98-4d35-879d-b739f715ad23 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:53.400457 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-06582000-943f-4d62-800d-6bccf6999af6 req-77f3c066-ad98-4d35-879d-b739f715ad23 service nova] Creating event network-vif-plugged:fd286100-b884-4544-99f7-9b92bb066410 for instance 5a6c60fd-7d16-4795-ba00-e257ca43f28c on nch1-master-1 Sep 17 21:23:53.415802 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-06582000-943f-4d62-800d-6bccf6999af6 req-77f3c066-ad98-4d35-879d-b739f715ad23 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069921 Sep 17 21:23:53.423368 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2923/5771] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:23:53.538368 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ea103922-cb21-4547-94f9-b7bc2fbb735a tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:53.539639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ea103922-cb21-4547-94f9-b7bc2fbb735a tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] [instance: 5a6c60fd-7d16-4795-ba00-e257ca43f28c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:53.561372 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea103922-cb21-4547-94f9-b7bc2fbb735a tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:53.562358 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea103922-cb21-4547-94f9-b7bc2fbb735a tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:53.562834 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea103922-cb21-4547-94f9-b7bc2fbb735a tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:53.563674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea103922-cb21-4547-94f9-b7bc2fbb735a tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:53.564117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea103922-cb21-4547-94f9-b7bc2fbb735a tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:53.566886 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ea103922-cb21-4547-94f9-b7bc2fbb735a tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:54.198110 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ea103922-cb21-4547-94f9-b7bc2fbb735a tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c778820854d4636ac34bd86ab7fbaff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81468f9a5a5d4b63bf62e9fe4bd19b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:23:54.210961 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ea103922-cb21-4547-94f9-b7bc2fbb735a tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] 10.222.0.26 "GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c" status: 200 len: 1315 microversion: 2.1 time: 0.677878 Sep 17 21:23:54.211771 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2849/5772] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:53 2022] GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c => generated 1315 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:23:55.238941 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4e2996be-b77b-4840-9ea2-dcb138b49a5d tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:55.239649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4e2996be-b77b-4840-9ea2-dcb138b49a5d tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] [instance: 5a6c60fd-7d16-4795-ba00-e257ca43f28c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:55.248037 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e2996be-b77b-4840-9ea2-dcb138b49a5d tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:55.248801 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e2996be-b77b-4840-9ea2-dcb138b49a5d tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:55.249499 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e2996be-b77b-4840-9ea2-dcb138b49a5d tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:55.250411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e2996be-b77b-4840-9ea2-dcb138b49a5d tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:55.251034 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e2996be-b77b-4840-9ea2-dcb138b49a5d tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:55.251646 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e2996be-b77b-4840-9ea2-dcb138b49a5d tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:55.642157 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4e2996be-b77b-4840-9ea2-dcb138b49a5d tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c778820854d4636ac34bd86ab7fbaff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81468f9a5a5d4b63bf62e9fe4bd19b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:23:55.663915 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4e2996be-b77b-4840-9ea2-dcb138b49a5d tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] 10.222.0.26 "GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c" status: 200 len: 1503 microversion: 2.1 time: 0.430186 Sep 17 21:23:55.669942 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2924/5773] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:55 2022] GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c => generated 1503 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:55.699275 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ae6e21dd-d865-43ce-96ed-48f2e7e70022 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:55.700627 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ae6e21dd-d865-43ce-96ed-48f2e7e70022 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] [instance: 5a6c60fd-7d16-4795-ba00-e257ca43f28c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:55.716882 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ae6e21dd-d865-43ce-96ed-48f2e7e70022 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:55.719814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ae6e21dd-d865-43ce-96ed-48f2e7e70022 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:55.720455 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ae6e21dd-d865-43ce-96ed-48f2e7e70022 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:55.738667 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ae6e21dd-d865-43ce-96ed-48f2e7e70022 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:55.739418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ae6e21dd-d865-43ce-96ed-48f2e7e70022 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:55.741337 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ae6e21dd-d865-43ce-96ed-48f2e7e70022 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:56.097564 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ae6e21dd-d865-43ce-96ed-48f2e7e70022 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c778820854d4636ac34bd86ab7fbaff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81468f9a5a5d4b63bf62e9fe4bd19b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:23:56.116275 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ae6e21dd-d865-43ce-96ed-48f2e7e70022 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] 10.222.0.26 "GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c" status: 200 len: 1503 microversion: 2.1 time: 0.421154 Sep 17 21:23:56.118535 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2850/5774] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:55 2022] GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c => generated 1503 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:23:56.146432 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f01a4377-5ea3-4113-9186-8ee6437797ae tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:23:56.147342 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f01a4377-5ea3-4113-9186-8ee6437797ae tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] [instance: 5a6c60fd-7d16-4795-ba00-e257ca43f28c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:56.157023 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f01a4377-5ea3-4113-9186-8ee6437797ae tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:56.157562 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f01a4377-5ea3-4113-9186-8ee6437797ae tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:56.158089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f01a4377-5ea3-4113-9186-8ee6437797ae tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:56.158763 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f01a4377-5ea3-4113-9186-8ee6437797ae tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:56.159176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f01a4377-5ea3-4113-9186-8ee6437797ae tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:56.159610 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f01a4377-5ea3-4113-9186-8ee6437797ae tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:56.208053 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-f01a4377-5ea3-4113-9186-8ee6437797ae tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lazy-loading 'flavor' on Instance uuid 5a6c60fd-7d16-4795-ba00-e257ca43f28c {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:23:56.325797 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f01a4377-5ea3-4113-9186-8ee6437797ae tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] 10.222.0.26 "POST /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c/action" status: 202 len: 0 microversion: 2.1 time: 0.183647 Sep 17 21:23:56.328433 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2925/5775] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:23:56 2022] POST /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:23:56.337220 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c6804000-132c-4491-bb62-e305b1a5feb2 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:56.338090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c6804000-132c-4491-bb62-e305b1a5feb2 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] [instance: 5a6c60fd-7d16-4795-ba00-e257ca43f28c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:56.346667 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c6804000-132c-4491-bb62-e305b1a5feb2 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:56.347578 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c6804000-132c-4491-bb62-e305b1a5feb2 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:56.348198 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c6804000-132c-4491-bb62-e305b1a5feb2 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:56.349939 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c6804000-132c-4491-bb62-e305b1a5feb2 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:56.350666 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c6804000-132c-4491-bb62-e305b1a5feb2 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:56.351674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c6804000-132c-4491-bb62-e305b1a5feb2 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:56.750321 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c6804000-132c-4491-bb62-e305b1a5feb2 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c778820854d4636ac34bd86ab7fbaff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81468f9a5a5d4b63bf62e9fe4bd19b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:23:56.768548 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c6804000-132c-4491-bb62-e305b1a5feb2 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] 10.222.0.26 "GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c" status: 200 len: 1511 microversion: 2.1 time: 0.435585 Sep 17 21:23:56.769978 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2851/5776] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:56 2022] GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c => generated 1511 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:57.800391 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-483d9cbb-74eb-4ece-bc05-1a116d9507bb tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:57.802708 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-483d9cbb-74eb-4ece-bc05-1a116d9507bb tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] [instance: 5a6c60fd-7d16-4795-ba00-e257ca43f28c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:57.832129 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-483d9cbb-74eb-4ece-bc05-1a116d9507bb tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:57.837916 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-483d9cbb-74eb-4ece-bc05-1a116d9507bb tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:57.839589 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-483d9cbb-74eb-4ece-bc05-1a116d9507bb tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:57.840914 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-483d9cbb-74eb-4ece-bc05-1a116d9507bb tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:57.841587 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-483d9cbb-74eb-4ece-bc05-1a116d9507bb tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:57.842176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-483d9cbb-74eb-4ece-bc05-1a116d9507bb tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:58.063836 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-483d9cbb-74eb-4ece-bc05-1a116d9507bb tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c778820854d4636ac34bd86ab7fbaff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81468f9a5a5d4b63bf62e9fe4bd19b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:23:58.073613 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-483d9cbb-74eb-4ece-bc05-1a116d9507bb tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] 10.222.0.26 "GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c" status: 200 len: 1494 microversion: 2.1 time: 0.280442 Sep 17 21:23:58.075299 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2926/5777] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:57 2022] GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c => generated 1494 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:58.104038 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e7723e01-4c64-4e3d-9670-47b910b8aead tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:23:58.104916 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e7723e01-4c64-4e3d-9670-47b910b8aead tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] [instance: 5a6c60fd-7d16-4795-ba00-e257ca43f28c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:58.113810 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7723e01-4c64-4e3d-9670-47b910b8aead tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:58.114836 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7723e01-4c64-4e3d-9670-47b910b8aead tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:58.115307 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7723e01-4c64-4e3d-9670-47b910b8aead tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:58.116559 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7723e01-4c64-4e3d-9670-47b910b8aead tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:58.117032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7723e01-4c64-4e3d-9670-47b910b8aead tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:58.117499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7723e01-4c64-4e3d-9670-47b910b8aead tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:58.218467 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e7723e01-4c64-4e3d-9670-47b910b8aead tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] 10.222.0.26 "POST /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c/action" status: 202 len: 0 microversion: 2.1 time: 0.121336 Sep 17 21:23:58.223587 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2852/5778] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:23:58 2022] POST /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:23:58.227905 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c899257a-e338-4ad8-8262-3fd44e150dca tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:58.228748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c899257a-e338-4ad8-8262-3fd44e150dca tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] [instance: 5a6c60fd-7d16-4795-ba00-e257ca43f28c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:58.238209 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c899257a-e338-4ad8-8262-3fd44e150dca tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:58.239911 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c899257a-e338-4ad8-8262-3fd44e150dca tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:58.241723 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c899257a-e338-4ad8-8262-3fd44e150dca tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:58.242868 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c899257a-e338-4ad8-8262-3fd44e150dca tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:58.243694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c899257a-e338-4ad8-8262-3fd44e150dca tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:58.243984 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c899257a-e338-4ad8-8262-3fd44e150dca tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:58.466758 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c899257a-e338-4ad8-8262-3fd44e150dca tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c778820854d4636ac34bd86ab7fbaff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81468f9a5a5d4b63bf62e9fe4bd19b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:23:58.479799 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c899257a-e338-4ad8-8262-3fd44e150dca tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] 10.222.0.26 "GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c" status: 200 len: 1500 microversion: 2.1 time: 0.255772 Sep 17 21:23:58.480910 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2927/5779] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:58 2022] GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c => generated 1500 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:23:59.506999 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6ee08ad2-21d7-4154-9b6e-773b4a54edac tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:23:59.507693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6ee08ad2-21d7-4154-9b6e-773b4a54edac tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] [instance: 5a6c60fd-7d16-4795-ba00-e257ca43f28c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:23:59.522758 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6ee08ad2-21d7-4154-9b6e-773b4a54edac tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:59.523182 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6ee08ad2-21d7-4154-9b6e-773b4a54edac tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:59.523633 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6ee08ad2-21d7-4154-9b6e-773b4a54edac tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:59.524360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6ee08ad2-21d7-4154-9b6e-773b4a54edac tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:23:59.524830 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6ee08ad2-21d7-4154-9b6e-773b4a54edac tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:23:59.525270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6ee08ad2-21d7-4154-9b6e-773b4a54edac tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:23:59.842414 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6ee08ad2-21d7-4154-9b6e-773b4a54edac tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c778820854d4636ac34bd86ab7fbaff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81468f9a5a5d4b63bf62e9fe4bd19b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:23:59.860929 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6ee08ad2-21d7-4154-9b6e-773b4a54edac tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] 10.222.0.26 "GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c" status: 200 len: 1500 microversion: 2.1 time: 0.359074 Sep 17 21:23:59.862174 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2853/5780] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:23:59 2022] GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c => generated 1500 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:00.893536 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-04d4feb3-78de-497b-8890-04478af89ed9 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:00.895289 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-04d4feb3-78de-497b-8890-04478af89ed9 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] [instance: 5a6c60fd-7d16-4795-ba00-e257ca43f28c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:00.909991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-04d4feb3-78de-497b-8890-04478af89ed9 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:00.910963 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-04d4feb3-78de-497b-8890-04478af89ed9 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:00.911771 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-04d4feb3-78de-497b-8890-04478af89ed9 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:00.913106 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-04d4feb3-78de-497b-8890-04478af89ed9 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:00.913935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-04d4feb3-78de-497b-8890-04478af89ed9 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:00.915359 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-04d4feb3-78de-497b-8890-04478af89ed9 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:01.180916 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-04d4feb3-78de-497b-8890-04478af89ed9 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c778820854d4636ac34bd86ab7fbaff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81468f9a5a5d4b63bf62e9fe4bd19b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:01.198438 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-04d4feb3-78de-497b-8890-04478af89ed9 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] 10.222.0.26 "GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c" status: 200 len: 1503 microversion: 2.1 time: 0.315167 Sep 17 21:24:01.205504 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2928/5781] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:00 2022] GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c => generated 1503 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:01.227963 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0493dd1e-4461-4d6c-82bc-ae6831d74c0e tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:24:01.228525 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0493dd1e-4461-4d6c-82bc-ae6831d74c0e tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] [instance: 5a6c60fd-7d16-4795-ba00-e257ca43f28c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:01.239503 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0493dd1e-4461-4d6c-82bc-ae6831d74c0e tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:01.241625 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0493dd1e-4461-4d6c-82bc-ae6831d74c0e tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:01.242275 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0493dd1e-4461-4d6c-82bc-ae6831d74c0e tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:01.243271 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0493dd1e-4461-4d6c-82bc-ae6831d74c0e tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:01.244023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0493dd1e-4461-4d6c-82bc-ae6831d74c0e tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:01.244644 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0493dd1e-4461-4d6c-82bc-ae6831d74c0e tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:01.295954 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-0493dd1e-4461-4d6c-82bc-ae6831d74c0e tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lazy-loading 'flavor' on Instance uuid 5a6c60fd-7d16-4795-ba00-e257ca43f28c {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:24:01.409392 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0493dd1e-4461-4d6c-82bc-ae6831d74c0e tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] 10.222.0.26 "POST /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c/action" status: 202 len: 0 microversion: 2.1 time: 0.185163 Sep 17 21:24:01.410998 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2854/5782] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:24:01 2022] POST /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:24:01.419207 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2400851c-c873-4daf-9fdd-0a984a340241 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:01.420387 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2400851c-c873-4daf-9fdd-0a984a340241 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] [instance: 5a6c60fd-7d16-4795-ba00-e257ca43f28c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:01.430789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2400851c-c873-4daf-9fdd-0a984a340241 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:01.431760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2400851c-c873-4daf-9fdd-0a984a340241 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:01.442642 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2400851c-c873-4daf-9fdd-0a984a340241 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:01.443622 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2400851c-c873-4daf-9fdd-0a984a340241 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:01.444183 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2400851c-c873-4daf-9fdd-0a984a340241 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:01.444717 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2400851c-c873-4daf-9fdd-0a984a340241 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:01.934655 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2400851c-c873-4daf-9fdd-0a984a340241 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c778820854d4636ac34bd86ab7fbaff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81468f9a5a5d4b63bf62e9fe4bd19b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:01.959979 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2400851c-c873-4daf-9fdd-0a984a340241 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] 10.222.0.26 "GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c" status: 200 len: 1511 microversion: 2.1 time: 0.544662 Sep 17 21:24:01.962417 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2929/5783] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:01 2022] GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c => generated 1511 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:02.986692 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3f7ed42b-79f2-438a-98b9-521122fde0d4 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:02.988733 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3f7ed42b-79f2-438a-98b9-521122fde0d4 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] [instance: 5a6c60fd-7d16-4795-ba00-e257ca43f28c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:03.004624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f7ed42b-79f2-438a-98b9-521122fde0d4 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:03.005546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f7ed42b-79f2-438a-98b9-521122fde0d4 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:03.006497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f7ed42b-79f2-438a-98b9-521122fde0d4 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:03.007685 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f7ed42b-79f2-438a-98b9-521122fde0d4 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:03.008291 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f7ed42b-79f2-438a-98b9-521122fde0d4 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:03.008865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f7ed42b-79f2-438a-98b9-521122fde0d4 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:03.978130 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3f7ed42b-79f2-438a-98b9-521122fde0d4 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c778820854d4636ac34bd86ab7fbaff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81468f9a5a5d4b63bf62e9fe4bd19b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:03.998741 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3f7ed42b-79f2-438a-98b9-521122fde0d4 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] 10.222.0.26 "GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c" status: 200 len: 1494 microversion: 2.1 time: 1.017457 Sep 17 21:24:04.003731 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2855/5784] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:02 2022] GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c => generated 1494 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:04.030200 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-130ff9eb-bbf5-4399-8b4b-3135837b06a8 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:24:04.031383 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-130ff9eb-bbf5-4399-8b4b-3135837b06a8 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] [instance: 5a6c60fd-7d16-4795-ba00-e257ca43f28c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:04.041156 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-130ff9eb-bbf5-4399-8b4b-3135837b06a8 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:04.045599 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-130ff9eb-bbf5-4399-8b4b-3135837b06a8 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:04.046258 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-130ff9eb-bbf5-4399-8b4b-3135837b06a8 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:04.047444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-130ff9eb-bbf5-4399-8b4b-3135837b06a8 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:04.048923 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-130ff9eb-bbf5-4399-8b4b-3135837b06a8 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:04.049538 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-130ff9eb-bbf5-4399-8b4b-3135837b06a8 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:04.205035 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-130ff9eb-bbf5-4399-8b4b-3135837b06a8 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] 10.222.0.26 "POST /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c/action" status: 202 len: 0 microversion: 2.1 time: 0.178624 Sep 17 21:24:04.213797 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2930/5785] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:24:04 2022] POST /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:24:04.215130 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c9decc20-04a8-45f2-adf6-3bd06d5edaaa tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:04.216033 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c9decc20-04a8-45f2-adf6-3bd06d5edaaa tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] [instance: 5a6c60fd-7d16-4795-ba00-e257ca43f28c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:04.229802 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c9decc20-04a8-45f2-adf6-3bd06d5edaaa tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:04.230528 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c9decc20-04a8-45f2-adf6-3bd06d5edaaa tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:04.232547 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c9decc20-04a8-45f2-adf6-3bd06d5edaaa tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:04.236161 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c9decc20-04a8-45f2-adf6-3bd06d5edaaa tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:04.237051 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c9decc20-04a8-45f2-adf6-3bd06d5edaaa tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:04.237559 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c9decc20-04a8-45f2-adf6-3bd06d5edaaa tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:04.659204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c9decc20-04a8-45f2-adf6-3bd06d5edaaa tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c778820854d4636ac34bd86ab7fbaff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81468f9a5a5d4b63bf62e9fe4bd19b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:04.681777 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c9decc20-04a8-45f2-adf6-3bd06d5edaaa tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] 10.222.0.26 "GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c" status: 200 len: 1500 microversion: 2.1 time: 0.470723 Sep 17 21:24:04.682422 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2856/5786] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:04 2022] GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c => generated 1500 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:05.707837 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f5d8ecb2-20f8-4e27-ae9a-018803cb3287 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:05.709334 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f5d8ecb2-20f8-4e27-ae9a-018803cb3287 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] [instance: 5a6c60fd-7d16-4795-ba00-e257ca43f28c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:05.720573 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f5d8ecb2-20f8-4e27-ae9a-018803cb3287 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:05.721406 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f5d8ecb2-20f8-4e27-ae9a-018803cb3287 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:05.722165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f5d8ecb2-20f8-4e27-ae9a-018803cb3287 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:05.723524 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f5d8ecb2-20f8-4e27-ae9a-018803cb3287 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:05.724241 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f5d8ecb2-20f8-4e27-ae9a-018803cb3287 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:05.725526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f5d8ecb2-20f8-4e27-ae9a-018803cb3287 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:05.954495 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f5d8ecb2-20f8-4e27-ae9a-018803cb3287 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c778820854d4636ac34bd86ab7fbaff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81468f9a5a5d4b63bf62e9fe4bd19b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:05.965516 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f5d8ecb2-20f8-4e27-ae9a-018803cb3287 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] 10.222.0.26 "GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c" status: 200 len: 1500 microversion: 2.1 time: 0.263313 Sep 17 21:24:05.967457 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2931/5787] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:05 2022] GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c => generated 1500 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:06.999654 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8927168e-020f-4a4f-92d0-5af479fa765d tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:07.006875 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8927168e-020f-4a4f-92d0-5af479fa765d tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] [instance: 5a6c60fd-7d16-4795-ba00-e257ca43f28c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:07.021587 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8927168e-020f-4a4f-92d0-5af479fa765d tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:07.025643 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8927168e-020f-4a4f-92d0-5af479fa765d tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:07.028474 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8927168e-020f-4a4f-92d0-5af479fa765d tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:07.029443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8927168e-020f-4a4f-92d0-5af479fa765d tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:07.030219 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8927168e-020f-4a4f-92d0-5af479fa765d tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:07.030854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8927168e-020f-4a4f-92d0-5af479fa765d tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:07.343514 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8927168e-020f-4a4f-92d0-5af479fa765d tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c778820854d4636ac34bd86ab7fbaff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81468f9a5a5d4b63bf62e9fe4bd19b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:07.360916 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8927168e-020f-4a4f-92d0-5af479fa765d tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] 10.222.0.26 "GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c" status: 200 len: 1503 microversion: 2.1 time: 0.363053 Sep 17 21:24:07.369529 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2857/5788] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:06 2022] GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c => generated 1503 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:07.387347 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3d2c0cf2-aabc-4c58-bcbb-3c2acf9ff69f tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:07.387875 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3d2c0cf2-aabc-4c58-bcbb-3c2acf9ff69f tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] [instance: 5a6c60fd-7d16-4795-ba00-e257ca43f28c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:07.410974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d2c0cf2-aabc-4c58-bcbb-3c2acf9ff69f tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:07.411500 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d2c0cf2-aabc-4c58-bcbb-3c2acf9ff69f tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:07.411948 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d2c0cf2-aabc-4c58-bcbb-3c2acf9ff69f tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:07.412691 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d2c0cf2-aabc-4c58-bcbb-3c2acf9ff69f tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:07.413503 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d2c0cf2-aabc-4c58-bcbb-3c2acf9ff69f tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:07.413949 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d2c0cf2-aabc-4c58-bcbb-3c2acf9ff69f tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:07.484151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3d2c0cf2-aabc-4c58-bcbb-3c2acf9ff69f tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] [instance: 5a6c60fd-7d16-4795-ba00-e257ca43f28c] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:24:07.554369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:24:07.682969 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3d2c0cf2-aabc-4c58-bcbb-3c2acf9ff69f tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c" status: 204 len: 0 microversion: 2.1 time: 0.301175 Sep 17 21:24:07.684578 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2932/5789] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:24:07 2022] DELETE /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:24:07.702333 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d0df7eac-f1f2-4e18-89c4-eb8c3bbe2c6b tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:07.706215 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d0df7eac-f1f2-4e18-89c4-eb8c3bbe2c6b tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] [instance: 5a6c60fd-7d16-4795-ba00-e257ca43f28c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:07.732346 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d0df7eac-f1f2-4e18-89c4-eb8c3bbe2c6b tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:07.732957 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d0df7eac-f1f2-4e18-89c4-eb8c3bbe2c6b tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:07.733408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d0df7eac-f1f2-4e18-89c4-eb8c3bbe2c6b tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:07.734182 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d0df7eac-f1f2-4e18-89c4-eb8c3bbe2c6b tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:07.734652 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d0df7eac-f1f2-4e18-89c4-eb8c3bbe2c6b tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:07.735067 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d0df7eac-f1f2-4e18-89c4-eb8c3bbe2c6b tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:07.740569 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:24:08.460462 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d0df7eac-f1f2-4e18-89c4-eb8c3bbe2c6b tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c778820854d4636ac34bd86ab7fbaff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81468f9a5a5d4b63bf62e9fe4bd19b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:08.473683 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d0df7eac-f1f2-4e18-89c4-eb8c3bbe2c6b tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] 10.222.0.26 "GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c" status: 200 len: 1509 microversion: 2.1 time: 0.780944 Sep 17 21:24:08.477659 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2858/5790] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:07 2022] GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c => generated 1509 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:09.506978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2d1ec52f-dc50-477e-98c6-6244bb875c97 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:09.507819 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2d1ec52f-dc50-477e-98c6-6244bb875c97 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] [instance: 5a6c60fd-7d16-4795-ba00-e257ca43f28c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:09.528323 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2d1ec52f-dc50-477e-98c6-6244bb875c97 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:09.528838 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2d1ec52f-dc50-477e-98c6-6244bb875c97 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:09.529290 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2d1ec52f-dc50-477e-98c6-6244bb875c97 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:09.530056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2d1ec52f-dc50-477e-98c6-6244bb875c97 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:09.530526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2d1ec52f-dc50-477e-98c6-6244bb875c97 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:09.530963 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2d1ec52f-dc50-477e-98c6-6244bb875c97 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:09.760357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2d1ec52f-dc50-477e-98c6-6244bb875c97 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c778820854d4636ac34bd86ab7fbaff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81468f9a5a5d4b63bf62e9fe4bd19b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:09.774452 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2d1ec52f-dc50-477e-98c6-6244bb875c97 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] 10.222.0.26 "GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c" status: 200 len: 1509 microversion: 2.1 time: 0.277378 Sep 17 21:24:09.775225 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2933/5791] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:09 2022] GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c => generated 1509 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:10.800773 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f8149faf-9efd-4805-970b-0ab76b3f55d3 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:10.802107 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f8149faf-9efd-4805-970b-0ab76b3f55d3 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] [instance: 5a6c60fd-7d16-4795-ba00-e257ca43f28c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:10.809701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:24:10.811902 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8149faf-9efd-4805-970b-0ab76b3f55d3 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:10.813321 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8149faf-9efd-4805-970b-0ab76b3f55d3 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:10.813658 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-5efd0c00-b49f-4dfc-a6a3-ab637de4034a req-2974c976-cdad-46df-92b8-2290e33d09d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a6c60fd-7d16-4795-ba00-e257ca43f28c", "name": "network-vif-deleted", "tag": "fd286100-b884-4544-99f7-9b92bb066410"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:24:10.814946 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8149faf-9efd-4805-970b-0ab76b3f55d3 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:10.816114 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8149faf-9efd-4805-970b-0ab76b3f55d3 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:10.816840 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8149faf-9efd-4805-970b-0ab76b3f55d3 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:10.817774 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8149faf-9efd-4805-970b-0ab76b3f55d3 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:10.830783 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-5efd0c00-b49f-4dfc-a6a3-ab637de4034a req-2974c976-cdad-46df-92b8-2290e33d09d0 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:10.832099 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-5efd0c00-b49f-4dfc-a6a3-ab637de4034a req-2974c976-cdad-46df-92b8-2290e33d09d0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:10.834947 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-5efd0c00-b49f-4dfc-a6a3-ab637de4034a req-2974c976-cdad-46df-92b8-2290e33d09d0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:10.859004 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-5efd0c00-b49f-4dfc-a6a3-ab637de4034a req-2974c976-cdad-46df-92b8-2290e33d09d0 service nova] Creating event network-vif-deleted:fd286100-b884-4544-99f7-9b92bb066410 for instance 5a6c60fd-7d16-4795-ba00-e257ca43f28c on nch1-master-1 Sep 17 21:24:10.867499 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-5efd0c00-b49f-4dfc-a6a3-ab637de4034a req-2974c976-cdad-46df-92b8-2290e33d09d0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060693 Sep 17 21:24:10.868809 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2934/5792] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:24:10.922753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f8149faf-9efd-4805-970b-0ab76b3f55d3 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c778820854d4636ac34bd86ab7fbaff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81468f9a5a5d4b63bf62e9fe4bd19b56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:10.933031 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f8149faf-9efd-4805-970b-0ab76b3f55d3 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] 10.222.0.26 "GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c" status: 200 len: 1467 microversion: 2.1 time: 0.137020 Sep 17 21:24:10.938483 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2859/5793] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:10 2022] GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c => generated 1467 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:11.966758 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-64d10df0-7bbc-44c0-b7e0-fa733ca42e64 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:11.967485 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-64d10df0-7bbc-44c0-b7e0-fa733ca42e64 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] [instance: 5a6c60fd-7d16-4795-ba00-e257ca43f28c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:11.971402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:24:11.984449 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64d10df0-7bbc-44c0-b7e0-fa733ca42e64 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:11.985788 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64d10df0-7bbc-44c0-b7e0-fa733ca42e64 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:11.986859 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64d10df0-7bbc-44c0-b7e0-fa733ca42e64 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:11.988255 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64d10df0-7bbc-44c0-b7e0-fa733ca42e64 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:11.989115 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64d10df0-7bbc-44c0-b7e0-fa733ca42e64 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:11.989847 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64d10df0-7bbc-44c0-b7e0-fa733ca42e64 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:12.011680 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-64d10df0-7bbc-44c0-b7e0-fa733ca42e64 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] HTTP exception thrown: Instance 5a6c60fd-7d16-4795-ba00-e257ca43f28c could not be found. Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-64d10df0-7bbc-44c0-b7e0-fa733ca42e64 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Request method failure captured: Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c HTTP/1.1 Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjrZgqqAEjAsOZi8xG3H07ZA69iI2lpUmcZ3gBSipYpMzLrG9AjyjnQY6wuTXY19aeyLqnoo2L4rL8V09ba1MHoULiCvpjIiImKXJT0atlnO-MZpMdwYk-G0jFKP4zdm830xiwj2AEg73qG5AB88y4osBnwEtPQc2jMw4_-BEWfknf0 Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 81468f9a5a5d4b63bf62e9fe4bd19b56 Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-TestServerAdvancedOps-372101663 Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/81468f9a5a5d4b63bf62e9fe4bd19b56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/81468f9a5a5d4b63bf62e9fe4bd19b56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/81468f9a5a5d4b63bf62e9fe4bd19b56"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_81468f9a5a5d4b63bf62e9fe4bd19b56", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-TestServerAdvancedOps-372101663 Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 81468f9a5a5d4b63bf62e9fe4bd19b56 Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-TestServerAdvancedOps-372101663 Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-TestServerAdvancedOps-372101663-project Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 2c778820854d4636ac34bd86ab7fbaff Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-TestServerAdvancedOps-372101663-project Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 5a6c60fd-7d16-4795-ba00-e257ca43f28c could not be found. Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '5a6c60fd-7d16-4795-ba00-e257ca43f28c'} Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a6c60fd-7d16-4795-ba00-e257ca43f28c could not be found. Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a6c60fd-7d16-4795-ba00-e257ca43f28c could not be found. Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:24:12.013488 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:24:12.016886 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:24:12.016886 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:24:12.016886 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:24:12.016886 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:24:12.016886 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:24:12.016886 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a6c60fd-7d16-4795-ba00-e257ca43f28c could not be found. Sep 17 21:24:12.016886 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:24:12.016886 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-64d10df0-7bbc-44c0-b7e0-fa733ca42e64 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] Returning 404 to user: Instance 5a6c60fd-7d16-4795-ba00-e257ca43f28c could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:24:12.016886 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-64d10df0-7bbc-44c0-b7e0-fa733ca42e64 tempest-TestServerAdvancedOps-372101663 tempest-TestServerAdvancedOps-372101663-project] 10.222.0.26 "GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c" status: 404 len: 111 microversion: 2.1 time: 0.054438 Sep 17 21:24:12.016886 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2935/5794] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:11 2022] GET /compute/v2.1/servers/5a6c60fd-7d16-4795-ba00-e257ca43f28c => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:24:15.018176 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-56866dc7-2ec7-48a1-910f-628df52c8e64 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-146089417", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "303db74d-f9c3-4861-abcb-10785db341f5", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "277ba9f5-743a-4949-b45f-d5582af5f04e"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:24:15.174756 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-56866dc7-2ec7-48a1-910f-628df52c8e64 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] validate_networks() for [('277ba9f5-743a-4949-b45f-d5582af5f04e', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:24:15.784422 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-56866dc7-2ec7-48a1-910f-628df52c8e64 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:24:15.784929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-56866dc7-2ec7-48a1-910f-628df52c8e64 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:24:15.785534 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-56866dc7-2ec7-48a1-910f-628df52c8e64 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:24:15.798406 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-56866dc7-2ec7-48a1-910f-628df52c8e64 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:24:15.799258 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-56866dc7-2ec7-48a1-910f-628df52c8e64 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:24:15.839712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56866dc7-2ec7-48a1-910f-628df52c8e64 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:15.842133 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56866dc7-2ec7-48a1-910f-628df52c8e64 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:15.844874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56866dc7-2ec7-48a1-910f-628df52c8e64 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:15.845978 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56866dc7-2ec7-48a1-910f-628df52c8e64 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:15.848462 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56866dc7-2ec7-48a1-910f-628df52c8e64 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:15.850060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-56866dc7-2ec7-48a1-910f-628df52c8e64 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:15.895519 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-56866dc7-2ec7-48a1-910f-628df52c8e64 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Getting quotas for project b99d2a0b4d7e40a38e682fc147e968af. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:24:15.906025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-56866dc7-2ec7-48a1-910f-628df52c8e64 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Getting quotas for user 342e60103c9b45bcb348b6f8bcd686ca and project b99d2a0b4d7e40a38e682fc147e968af. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:24:15.923585 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-56866dc7-2ec7-48a1-910f-628df52c8e64 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:24:15.926716 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-56866dc7-2ec7-48a1-910f-628df52c8e64 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 58cab697-23ce-42e4-8bdb-2be39771e90c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='303db74d-f9c3-4861-abcb-10785db341f5',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:24:16.062116 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-56866dc7-2ec7-48a1-910f-628df52c8e64 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.047915 Sep 17 21:24:16.076930 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2860/5795] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:24:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:24:16.081070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-db0527ad-4e2e-439d-bbb6-60595b5046c3 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:16.084847 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-db0527ad-4e2e-439d-bbb6-60595b5046c3 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 58cab697-23ce-42e4-8bdb-2be39771e90c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:16.216906 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-db0527ad-4e2e-439d-bbb6-60595b5046c3 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:16.227603 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-db0527ad-4e2e-439d-bbb6-60595b5046c3 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c" status: 200 len: 1056 microversion: 2.1 time: 0.150384 Sep 17 21:24:16.245848 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2936/5796] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:16 2022] GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c => generated 1056 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:17.254627 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0acc0b3c-ed7f-4bcc-9f7a-e505f649060d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:17.255265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0acc0b3c-ed7f-4bcc-9f7a-e505f649060d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 58cab697-23ce-42e4-8bdb-2be39771e90c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:17.264161 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0acc0b3c-ed7f-4bcc-9f7a-e505f649060d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:17.264812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0acc0b3c-ed7f-4bcc-9f7a-e505f649060d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:17.265746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0acc0b3c-ed7f-4bcc-9f7a-e505f649060d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:17.266590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0acc0b3c-ed7f-4bcc-9f7a-e505f649060d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:17.267162 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0acc0b3c-ed7f-4bcc-9f7a-e505f649060d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:17.267716 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0acc0b3c-ed7f-4bcc-9f7a-e505f649060d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:17.351333 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0acc0b3c-ed7f-4bcc-9f7a-e505f649060d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:17.361087 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0acc0b3c-ed7f-4bcc-9f7a-e505f649060d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c" status: 200 len: 1126 microversion: 2.1 time: 0.110438 Sep 17 21:24:17.366593 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2861/5797] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:17 2022] GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c => generated 1126 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:18.386378 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-63cffcd1-61e7-416e-bbec-912c39bae3c8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:18.387003 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-63cffcd1-61e7-416e-bbec-912c39bae3c8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 58cab697-23ce-42e4-8bdb-2be39771e90c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:18.402740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-63cffcd1-61e7-416e-bbec-912c39bae3c8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:18.403362 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-63cffcd1-61e7-416e-bbec-912c39bae3c8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:18.403816 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-63cffcd1-61e7-416e-bbec-912c39bae3c8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:18.404560 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-63cffcd1-61e7-416e-bbec-912c39bae3c8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:18.407954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-63cffcd1-61e7-416e-bbec-912c39bae3c8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:18.408428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-63cffcd1-61e7-416e-bbec-912c39bae3c8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:18.739950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-63cffcd1-61e7-416e-bbec-912c39bae3c8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:18.756762 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-63cffcd1-61e7-416e-bbec-912c39bae3c8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c" status: 200 len: 1168 microversion: 2.1 time: 0.374655 Sep 17 21:24:18.757360 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2937/5798] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:18 2022] GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c => generated 1168 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:19.270397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-855d943a-2cd7-4f7f-b2bf-840ef2f91490 req-26bbe1c1-a482-471b-b0ca-40e073e40abf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58cab697-23ce-42e4-8bdb-2be39771e90c", "tag": "45424c10-5aa3-4f10-b076-4564bb25e7c7"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:24:19.292343 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-855d943a-2cd7-4f7f-b2bf-840ef2f91490 req-26bbe1c1-a482-471b-b0ca-40e073e40abf service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:19.294168 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-855d943a-2cd7-4f7f-b2bf-840ef2f91490 req-26bbe1c1-a482-471b-b0ca-40e073e40abf service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:19.296021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-855d943a-2cd7-4f7f-b2bf-840ef2f91490 req-26bbe1c1-a482-471b-b0ca-40e073e40abf service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:19.310668 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-855d943a-2cd7-4f7f-b2bf-840ef2f91490 req-26bbe1c1-a482-471b-b0ca-40e073e40abf service nova] Creating event network-changed:45424c10-5aa3-4f10-b076-4564bb25e7c7 for instance 58cab697-23ce-42e4-8bdb-2be39771e90c on nch1-master-1 Sep 17 21:24:19.316835 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-855d943a-2cd7-4f7f-b2bf-840ef2f91490 req-26bbe1c1-a482-471b-b0ca-40e073e40abf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053427 Sep 17 21:24:19.318294 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2862/5799] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:24:19.781335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b6dab6cb-61e2-4cc8-9726-0df6f8c79272 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:19.781991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b6dab6cb-61e2-4cc8-9726-0df6f8c79272 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 58cab697-23ce-42e4-8bdb-2be39771e90c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:19.790075 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b6dab6cb-61e2-4cc8-9726-0df6f8c79272 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:19.794924 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b6dab6cb-61e2-4cc8-9726-0df6f8c79272 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:19.795457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b6dab6cb-61e2-4cc8-9726-0df6f8c79272 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:19.796228 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b6dab6cb-61e2-4cc8-9726-0df6f8c79272 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:19.796942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b6dab6cb-61e2-4cc8-9726-0df6f8c79272 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:19.797563 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b6dab6cb-61e2-4cc8-9726-0df6f8c79272 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:20.404647 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b6dab6cb-61e2-4cc8-9726-0df6f8c79272 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:20.415604 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b6dab6cb-61e2-4cc8-9726-0df6f8c79272 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c" status: 200 len: 1168 microversion: 2.1 time: 0.638575 Sep 17 21:24:20.416541 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2938/5800] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:19 2022] GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c => generated 1168 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:21.440528 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a2c7207c-2a9c-4e4e-b062-34240769742e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:21.441932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a2c7207c-2a9c-4e4e-b062-34240769742e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 58cab697-23ce-42e4-8bdb-2be39771e90c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:21.461346 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2c7207c-2a9c-4e4e-b062-34240769742e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:21.462270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2c7207c-2a9c-4e4e-b062-34240769742e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:21.463023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2c7207c-2a9c-4e4e-b062-34240769742e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:21.465073 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2c7207c-2a9c-4e4e-b062-34240769742e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:21.466390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2c7207c-2a9c-4e4e-b062-34240769742e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:21.467212 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2c7207c-2a9c-4e4e-b062-34240769742e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:21.700295 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a2c7207c-2a9c-4e4e-b062-34240769742e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:21.713175 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a2c7207c-2a9c-4e4e-b062-34240769742e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c" status: 200 len: 1168 microversion: 2.1 time: 0.277960 Sep 17 21:24:21.714727 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2863/5801] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:21 2022] GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c => generated 1168 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:22.740480 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-86db289b-8d77-4168-8517-f877cbfa0ce2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:22.742040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-86db289b-8d77-4168-8517-f877cbfa0ce2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 58cab697-23ce-42e4-8bdb-2be39771e90c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:22.750022 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-86db289b-8d77-4168-8517-f877cbfa0ce2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:22.750569 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-86db289b-8d77-4168-8517-f877cbfa0ce2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:22.751003 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-86db289b-8d77-4168-8517-f877cbfa0ce2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:22.751843 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-86db289b-8d77-4168-8517-f877cbfa0ce2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:22.752318 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-86db289b-8d77-4168-8517-f877cbfa0ce2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:22.752757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-86db289b-8d77-4168-8517-f877cbfa0ce2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:22.898816 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-86db289b-8d77-4168-8517-f877cbfa0ce2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:22.909618 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-86db289b-8d77-4168-8517-f877cbfa0ce2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c" status: 200 len: 1202 microversion: 2.1 time: 0.174634 Sep 17 21:24:22.910532 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2939/5802] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:22 2022] GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c => generated 1202 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:23.934535 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dfa0460b-9928-42af-92fd-50daccb847bd tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:23.935173 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dfa0460b-9928-42af-92fd-50daccb847bd tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 58cab697-23ce-42e4-8bdb-2be39771e90c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:23.949335 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfa0460b-9928-42af-92fd-50daccb847bd tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:23.949863 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfa0460b-9928-42af-92fd-50daccb847bd tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:23.958726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfa0460b-9928-42af-92fd-50daccb847bd tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:23.961010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfa0460b-9928-42af-92fd-50daccb847bd tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:23.962085 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfa0460b-9928-42af-92fd-50daccb847bd tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:23.964615 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfa0460b-9928-42af-92fd-50daccb847bd tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:24.177430 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dfa0460b-9928-42af-92fd-50daccb847bd tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:24.186021 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dfa0460b-9928-42af-92fd-50daccb847bd tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c" status: 200 len: 1202 microversion: 2.1 time: 0.257632 Sep 17 21:24:24.186631 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2864/5803] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:23 2022] GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c => generated 1202 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:25.210416 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3947995c-898d-46c2-9ca7-a5757548edb2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:25.211104 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3947995c-898d-46c2-9ca7-a5757548edb2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 58cab697-23ce-42e4-8bdb-2be39771e90c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:25.228133 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3947995c-898d-46c2-9ca7-a5757548edb2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:25.229296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3947995c-898d-46c2-9ca7-a5757548edb2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:25.229933 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3947995c-898d-46c2-9ca7-a5757548edb2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:25.231070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3947995c-898d-46c2-9ca7-a5757548edb2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:25.231726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3947995c-898d-46c2-9ca7-a5757548edb2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:25.232391 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3947995c-898d-46c2-9ca7-a5757548edb2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:25.506749 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3947995c-898d-46c2-9ca7-a5757548edb2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:25.519991 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3947995c-898d-46c2-9ca7-a5757548edb2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c" status: 200 len: 1202 microversion: 2.1 time: 0.313290 Sep 17 21:24:25.534759 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2940/5804] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:25 2022] GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c => generated 1202 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:26.547280 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0f297af7-8783-42be-a87d-0c0e85deb988 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:26.548589 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0f297af7-8783-42be-a87d-0c0e85deb988 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 58cab697-23ce-42e4-8bdb-2be39771e90c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:26.555802 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:24:26.556686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:24:26.559120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0f297af7-8783-42be-a87d-0c0e85deb988 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:26.559876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0f297af7-8783-42be-a87d-0c0e85deb988 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:26.560434 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0f297af7-8783-42be-a87d-0c0e85deb988 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:26.561520 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0f297af7-8783-42be-a87d-0c0e85deb988 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:26.562100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0f297af7-8783-42be-a87d-0c0e85deb988 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:26.562619 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0f297af7-8783-42be-a87d-0c0e85deb988 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:26.742903 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0f297af7-8783-42be-a87d-0c0e85deb988 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:26.752444 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0f297af7-8783-42be-a87d-0c0e85deb988 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c" status: 200 len: 1202 microversion: 2.1 time: 0.209623 Sep 17 21:24:26.753047 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2865/5805] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:26 2022] GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c => generated 1202 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:27.450770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-7f42fda4-4cf9-4745-8d7b-0be71550dd3f req-f8b65a26-85bd-4cea-862d-a63ea4483251 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58cab697-23ce-42e4-8bdb-2be39771e90c", "name": "network-vif-plugged", "status": "completed", "tag": "45424c10-5aa3-4f10-b076-4564bb25e7c7"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:24:27.481671 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:24:27.485849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7f42fda4-4cf9-4745-8d7b-0be71550dd3f req-f8b65a26-85bd-4cea-862d-a63ea4483251 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:27.487160 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7f42fda4-4cf9-4745-8d7b-0be71550dd3f req-f8b65a26-85bd-4cea-862d-a63ea4483251 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:27.487968 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7f42fda4-4cf9-4745-8d7b-0be71550dd3f req-f8b65a26-85bd-4cea-862d-a63ea4483251 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:27.509284 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-7f42fda4-4cf9-4745-8d7b-0be71550dd3f req-f8b65a26-85bd-4cea-862d-a63ea4483251 service nova] Creating event network-vif-plugged:45424c10-5aa3-4f10-b076-4564bb25e7c7 for instance 58cab697-23ce-42e4-8bdb-2be39771e90c on nch1-master-1 Sep 17 21:24:27.517027 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-7f42fda4-4cf9-4745-8d7b-0be71550dd3f req-f8b65a26-85bd-4cea-862d-a63ea4483251 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070416 Sep 17 21:24:27.522008 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2941/5806] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:24:27.779324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8eb00263-c7c5-4b12-9865-8c75bd1ccda5 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:27.781133 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8eb00263-c7c5-4b12-9865-8c75bd1ccda5 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 58cab697-23ce-42e4-8bdb-2be39771e90c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:27.790544 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8eb00263-c7c5-4b12-9865-8c75bd1ccda5 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:27.791352 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8eb00263-c7c5-4b12-9865-8c75bd1ccda5 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:27.792065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8eb00263-c7c5-4b12-9865-8c75bd1ccda5 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:27.793073 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8eb00263-c7c5-4b12-9865-8c75bd1ccda5 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:27.795216 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8eb00263-c7c5-4b12-9865-8c75bd1ccda5 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:27.796072 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8eb00263-c7c5-4b12-9865-8c75bd1ccda5 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:28.068257 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8eb00263-c7c5-4b12-9865-8c75bd1ccda5 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:28.079033 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8eb00263-c7c5-4b12-9865-8c75bd1ccda5 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c" status: 200 len: 1202 microversion: 2.1 time: 0.305608 Sep 17 21:24:28.079734 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2866/5807] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:27 2022] GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c => generated 1202 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:29.104308 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1e163506-0a80-4761-a283-2be1490cb982 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:29.105219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1e163506-0a80-4761-a283-2be1490cb982 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 58cab697-23ce-42e4-8bdb-2be39771e90c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:29.111914 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e163506-0a80-4761-a283-2be1490cb982 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:29.112559 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e163506-0a80-4761-a283-2be1490cb982 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:29.113343 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e163506-0a80-4761-a283-2be1490cb982 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:29.114338 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e163506-0a80-4761-a283-2be1490cb982 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:29.115089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e163506-0a80-4761-a283-2be1490cb982 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:29.116043 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e163506-0a80-4761-a283-2be1490cb982 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:29.282956 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1e163506-0a80-4761-a283-2be1490cb982 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:29.291531 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1e163506-0a80-4761-a283-2be1490cb982 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c" status: 200 len: 1390 microversion: 2.1 time: 0.193265 Sep 17 21:24:29.292131 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2942/5808] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:29 2022] GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c => generated 1390 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:29.314545 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d38b8178-4c2e-4368-99d6-5aeaf3db5cf0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:29.315937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d38b8178-4c2e-4368-99d6-5aeaf3db5cf0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 58cab697-23ce-42e4-8bdb-2be39771e90c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:29.323460 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d38b8178-4c2e-4368-99d6-5aeaf3db5cf0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:29.324270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d38b8178-4c2e-4368-99d6-5aeaf3db5cf0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:29.324933 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d38b8178-4c2e-4368-99d6-5aeaf3db5cf0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:29.325696 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d38b8178-4c2e-4368-99d6-5aeaf3db5cf0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:29.326279 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d38b8178-4c2e-4368-99d6-5aeaf3db5cf0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:29.326730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d38b8178-4c2e-4368-99d6-5aeaf3db5cf0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:29.485358 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d38b8178-4c2e-4368-99d6-5aeaf3db5cf0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:29.494427 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d38b8178-4c2e-4368-99d6-5aeaf3db5cf0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c" status: 200 len: 1390 microversion: 2.1 time: 0.183882 Sep 17 21:24:29.495190 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2867/5809] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:29 2022] GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c => generated 1390 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:29.516339 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bdc3ff98-ead9-4180-98a7-f190c0353031 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:29.517149 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bdc3ff98-ead9-4180-98a7-f190c0353031 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 58cab697-23ce-42e4-8bdb-2be39771e90c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:29.523968 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bdc3ff98-ead9-4180-98a7-f190c0353031 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:29.524471 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bdc3ff98-ead9-4180-98a7-f190c0353031 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:29.524917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bdc3ff98-ead9-4180-98a7-f190c0353031 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:29.525662 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bdc3ff98-ead9-4180-98a7-f190c0353031 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:29.526282 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bdc3ff98-ead9-4180-98a7-f190c0353031 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:29.526873 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bdc3ff98-ead9-4180-98a7-f190c0353031 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:29.669749 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bdc3ff98-ead9-4180-98a7-f190c0353031 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:29.682065 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bdc3ff98-ead9-4180-98a7-f190c0353031 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c" status: 200 len: 1390 microversion: 2.1 time: 0.169581 Sep 17 21:24:29.683023 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2943/5810] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:29 2022] GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c => generated 1390 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:29.768972 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-29b261aa-9c14-443f-a82f-926a260147bc tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:29.769760 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-29b261aa-9c14-443f-a82f-926a260147bc tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 58cab697-23ce-42e4-8bdb-2be39771e90c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:29.776370 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-29b261aa-9c14-443f-a82f-926a260147bc tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:29.776969 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-29b261aa-9c14-443f-a82f-926a260147bc tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:29.777682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-29b261aa-9c14-443f-a82f-926a260147bc tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:29.778521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-29b261aa-9c14-443f-a82f-926a260147bc tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:29.779003 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-29b261aa-9c14-443f-a82f-926a260147bc tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:29.779433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-29b261aa-9c14-443f-a82f-926a260147bc tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:29.812333 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-29b261aa-9c14-443f-a82f-926a260147bc tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 58cab697-23ce-42e4-8bdb-2be39771e90c] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:24:29.932684 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-29b261aa-9c14-443f-a82f-926a260147bc tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "DELETE /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c" status: 204 len: 0 microversion: 2.1 time: 0.167338 Sep 17 21:24:29.933532 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2868/5811] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:24:29 2022] DELETE /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:24:29.944095 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ff7256c7-46a5-4ce7-bf59-aa607373c74f tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:29.945161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ff7256c7-46a5-4ce7-bf59-aa607373c74f tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 58cab697-23ce-42e4-8bdb-2be39771e90c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:29.953831 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff7256c7-46a5-4ce7-bf59-aa607373c74f tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:29.954831 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff7256c7-46a5-4ce7-bf59-aa607373c74f tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:29.955423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff7256c7-46a5-4ce7-bf59-aa607373c74f tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:29.956390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff7256c7-46a5-4ce7-bf59-aa607373c74f tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:29.957016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff7256c7-46a5-4ce7-bf59-aa607373c74f tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:29.957778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff7256c7-46a5-4ce7-bf59-aa607373c74f tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:30.106936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ff7256c7-46a5-4ce7-bf59-aa607373c74f tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:30.116386 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ff7256c7-46a5-4ce7-bf59-aa607373c74f tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c" status: 200 len: 1396 microversion: 2.1 time: 0.178463 Sep 17 21:24:30.123654 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2944/5812] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:29 2022] GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c => generated 1396 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:24:31.141078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a259c8f0-4d28-4da2-b9c9-30825fc01a55 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:31.141785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a259c8f0-4d28-4da2-b9c9-30825fc01a55 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 58cab697-23ce-42e4-8bdb-2be39771e90c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:31.148745 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a259c8f0-4d28-4da2-b9c9-30825fc01a55 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:31.149310 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a259c8f0-4d28-4da2-b9c9-30825fc01a55 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:31.149781 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a259c8f0-4d28-4da2-b9c9-30825fc01a55 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:31.150546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a259c8f0-4d28-4da2-b9c9-30825fc01a55 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:31.151039 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a259c8f0-4d28-4da2-b9c9-30825fc01a55 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:31.151658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a259c8f0-4d28-4da2-b9c9-30825fc01a55 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:31.302085 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a259c8f0-4d28-4da2-b9c9-30825fc01a55 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:31.320657 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a259c8f0-4d28-4da2-b9c9-30825fc01a55 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c" status: 200 len: 1396 microversion: 2.1 time: 0.183882 Sep 17 21:24:31.321376 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2869/5813] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:31 2022] GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c => generated 1396 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:32.259069 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-0de4db1e-57f7-411d-911c-3987875a0861 req-7148d01f-3ca3-4efe-8502-a9c290018a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58cab697-23ce-42e4-8bdb-2be39771e90c", "name": "network-vif-deleted", "tag": "45424c10-5aa3-4f10-b076-4564bb25e7c7"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:24:32.310059 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-0de4db1e-57f7-411d-911c-3987875a0861 req-7148d01f-3ca3-4efe-8502-a9c290018a0f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:32.311048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-0de4db1e-57f7-411d-911c-3987875a0861 req-7148d01f-3ca3-4efe-8502-a9c290018a0f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:32.311677 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-0de4db1e-57f7-411d-911c-3987875a0861 req-7148d01f-3ca3-4efe-8502-a9c290018a0f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:32.326294 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-0de4db1e-57f7-411d-911c-3987875a0861 req-7148d01f-3ca3-4efe-8502-a9c290018a0f service nova] Creating event network-vif-deleted:45424c10-5aa3-4f10-b076-4564bb25e7c7 for instance 58cab697-23ce-42e4-8bdb-2be39771e90c on nch1-master-1 Sep 17 21:24:32.333575 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-0de4db1e-57f7-411d-911c-3987875a0861 req-7148d01f-3ca3-4efe-8502-a9c290018a0f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089423 Sep 17 21:24:32.335911 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2945/5814] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:24:32.344502 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-663b7ab1-3317-47b1-911a-4146b46d2e65 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:32.345746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-663b7ab1-3317-47b1-911a-4146b46d2e65 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 58cab697-23ce-42e4-8bdb-2be39771e90c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:32.354198 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-663b7ab1-3317-47b1-911a-4146b46d2e65 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:32.354704 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-663b7ab1-3317-47b1-911a-4146b46d2e65 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:32.362815 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-663b7ab1-3317-47b1-911a-4146b46d2e65 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:32.364320 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-663b7ab1-3317-47b1-911a-4146b46d2e65 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:32.365002 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-663b7ab1-3317-47b1-911a-4146b46d2e65 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:32.366020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-663b7ab1-3317-47b1-911a-4146b46d2e65 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:32.624512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-663b7ab1-3317-47b1-911a-4146b46d2e65 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:32.638358 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-663b7ab1-3317-47b1-911a-4146b46d2e65 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c" status: 200 len: 1187 microversion: 2.1 time: 0.297883 Sep 17 21:24:32.639091 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2870/5815] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:32 2022] GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c => generated 1187 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:33.669417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-096306cf-73bb-4760-8096-ed1522baef21 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:33.670212 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-096306cf-73bb-4760-8096-ed1522baef21 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 58cab697-23ce-42e4-8bdb-2be39771e90c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:33.689390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-096306cf-73bb-4760-8096-ed1522baef21 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:33.691547 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-096306cf-73bb-4760-8096-ed1522baef21 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:33.692132 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-096306cf-73bb-4760-8096-ed1522baef21 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:33.692884 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-096306cf-73bb-4760-8096-ed1522baef21 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:33.693377 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-096306cf-73bb-4760-8096-ed1522baef21 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:33.693855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-096306cf-73bb-4760-8096-ed1522baef21 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:33.713917 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-096306cf-73bb-4760-8096-ed1522baef21 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] HTTP exception thrown: Instance 58cab697-23ce-42e4-8bdb-2be39771e90c could not be found. Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-096306cf-73bb-4760-8096-ed1522baef21 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Request method failure captured: Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c HTTP/1.1 Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjrvOiuthjFaTfhYt50z8pDXrt-HPwrf96uRwuVJ9ynjuC5bmjoCBf4y3MnbEYBpakcf75RXFUI631TlKrccQPyNjX9J3nTlRjiuxC83ZWT1CdEDSXZAvO47o2oB0JdJR88NFg3ylqlbHTdxn4s4t3eWhyXUxZZiXUGmNIvQFsnF9s0 Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: b99d2a0b4d7e40a38e682fc147e968af Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-TestVolumeBootPattern-747170341 Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b99d2a0b4d7e40a38e682fc147e968af", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-TestVolumeBootPattern-747170341 Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: b99d2a0b4d7e40a38e682fc147e968af Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-TestVolumeBootPattern-747170341 Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-TestVolumeBootPattern-747170341-project Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 342e60103c9b45bcb348b6f8bcd686ca Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-TestVolumeBootPattern-747170341-project Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 58cab697-23ce-42e4-8bdb-2be39771e90c could not be found. Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '58cab697-23ce-42e4-8bdb-2be39771e90c'} Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58cab697-23ce-42e4-8bdb-2be39771e90c could not be found. Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58cab697-23ce-42e4-8bdb-2be39771e90c could not be found. Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:24:33.717183 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:24:33.721314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:24:33.721314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:24:33.721314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:24:33.721314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:24:33.721314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:24:33.721314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58cab697-23ce-42e4-8bdb-2be39771e90c could not be found. Sep 17 21:24:33.721314 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:24:33.721314 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-096306cf-73bb-4760-8096-ed1522baef21 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Returning 404 to user: Instance 58cab697-23ce-42e4-8bdb-2be39771e90c could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:24:33.721314 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-096306cf-73bb-4760-8096-ed1522baef21 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c" status: 404 len: 111 microversion: 2.1 time: 0.061346 Sep 17 21:24:33.721314 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2946/5816] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:33 2022] GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:24:33.757617 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9d3b9e77-06b6-4514-94df-3e0a8f99260c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:33.758381 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9d3b9e77-06b6-4514-94df-3e0a8f99260c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 58cab697-23ce-42e4-8bdb-2be39771e90c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:33.767029 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d3b9e77-06b6-4514-94df-3e0a8f99260c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:33.768529 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d3b9e77-06b6-4514-94df-3e0a8f99260c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:33.769881 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d3b9e77-06b6-4514-94df-3e0a8f99260c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:33.770962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d3b9e77-06b6-4514-94df-3e0a8f99260c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:33.771652 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d3b9e77-06b6-4514-94df-3e0a8f99260c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:33.772347 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d3b9e77-06b6-4514-94df-3e0a8f99260c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:33.794683 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-9d3b9e77-06b6-4514-94df-3e0a8f99260c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] HTTP exception thrown: Instance 58cab697-23ce-42e4-8bdb-2be39771e90c could not be found. Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9d3b9e77-06b6-4514-94df-3e0a8f99260c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Request method failure captured: Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c HTTP/1.1 Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjrvOiuthjFaTfhYt50z8pDXrt-HPwrf96uRwuVJ9ynjuC5bmjoCBf4y3MnbEYBpakcf75RXFUI631TlKrccQPyNjX9J3nTlRjiuxC83ZWT1CdEDSXZAvO47o2oB0JdJR88NFg3ylqlbHTdxn4s4t3eWhyXUxZZiXUGmNIvQFsnF9s0 Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: b99d2a0b4d7e40a38e682fc147e968af Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-TestVolumeBootPattern-747170341 Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b99d2a0b4d7e40a38e682fc147e968af", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-TestVolumeBootPattern-747170341 Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: b99d2a0b4d7e40a38e682fc147e968af Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-TestVolumeBootPattern-747170341 Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-TestVolumeBootPattern-747170341-project Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 342e60103c9b45bcb348b6f8bcd686ca Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-TestVolumeBootPattern-747170341-project Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 58cab697-23ce-42e4-8bdb-2be39771e90c could not be found. Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '58cab697-23ce-42e4-8bdb-2be39771e90c'} Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58cab697-23ce-42e4-8bdb-2be39771e90c could not be found. Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:24:33.797532 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:24:33.803597 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58cab697-23ce-42e4-8bdb-2be39771e90c could not be found. Sep 17 21:24:33.803597 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:24:33.803597 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:24:33.803597 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:24:33.803597 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:24:33.803597 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:24:33.803597 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:24:33.803597 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:24:33.803597 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:24:33.803597 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58cab697-23ce-42e4-8bdb-2be39771e90c could not be found. Sep 17 21:24:33.803597 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:24:33.804708 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9d3b9e77-06b6-4514-94df-3e0a8f99260c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Returning 404 to user: Instance 58cab697-23ce-42e4-8bdb-2be39771e90c could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:24:33.808510 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9d3b9e77-06b6-4514-94df-3e0a8f99260c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "DELETE /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c" status: 404 len: 111 microversion: 2.1 time: 0.056976 Sep 17 21:24:33.809406 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2871/5817] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:24:33 2022] DELETE /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:24:33.818216 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8fbf1c14-5573-4ad2-a9d0-cd88edadad5d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:33.818846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8fbf1c14-5573-4ad2-a9d0-cd88edadad5d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 58cab697-23ce-42e4-8bdb-2be39771e90c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:33.827497 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8fbf1c14-5573-4ad2-a9d0-cd88edadad5d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:33.828266 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8fbf1c14-5573-4ad2-a9d0-cd88edadad5d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:33.828895 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8fbf1c14-5573-4ad2-a9d0-cd88edadad5d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:33.829719 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8fbf1c14-5573-4ad2-a9d0-cd88edadad5d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:33.830328 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8fbf1c14-5573-4ad2-a9d0-cd88edadad5d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:33.830906 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8fbf1c14-5573-4ad2-a9d0-cd88edadad5d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:33.859505 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-8fbf1c14-5573-4ad2-a9d0-cd88edadad5d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] HTTP exception thrown: Instance 58cab697-23ce-42e4-8bdb-2be39771e90c could not be found. Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8fbf1c14-5573-4ad2-a9d0-cd88edadad5d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Request method failure captured: Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c HTTP/1.1 Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjrvOiuthjFaTfhYt50z8pDXrt-HPwrf96uRwuVJ9ynjuC5bmjoCBf4y3MnbEYBpakcf75RXFUI631TlKrccQPyNjX9J3nTlRjiuxC83ZWT1CdEDSXZAvO47o2oB0JdJR88NFg3ylqlbHTdxn4s4t3eWhyXUxZZiXUGmNIvQFsnF9s0 Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: b99d2a0b4d7e40a38e682fc147e968af Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-TestVolumeBootPattern-747170341 Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b99d2a0b4d7e40a38e682fc147e968af", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-TestVolumeBootPattern-747170341 Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: b99d2a0b4d7e40a38e682fc147e968af Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-TestVolumeBootPattern-747170341 Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-TestVolumeBootPattern-747170341-project Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 342e60103c9b45bcb348b6f8bcd686ca Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-TestVolumeBootPattern-747170341-project Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 58cab697-23ce-42e4-8bdb-2be39771e90c could not be found. Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '58cab697-23ce-42e4-8bdb-2be39771e90c'} Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58cab697-23ce-42e4-8bdb-2be39771e90c could not be found. Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58cab697-23ce-42e4-8bdb-2be39771e90c could not be found. Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:24:33.864943 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:24:33.871276 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:24:33.871276 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:24:33.871276 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:24:33.871276 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:24:33.871276 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:24:33.871276 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58cab697-23ce-42e4-8bdb-2be39771e90c could not be found. Sep 17 21:24:33.871276 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:24:33.873390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8fbf1c14-5573-4ad2-a9d0-cd88edadad5d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Returning 404 to user: Instance 58cab697-23ce-42e4-8bdb-2be39771e90c could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:24:33.874943 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8fbf1c14-5573-4ad2-a9d0-cd88edadad5d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c" status: 404 len: 111 microversion: 2.1 time: 0.060838 Sep 17 21:24:33.876454 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2947/5818] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:33 2022] GET /compute/v2.1/servers/58cab697-23ce-42e4-8bdb-2be39771e90c => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:24:40.217294 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-230c3804-2461-4081-99d3-ec3a174f1f7a tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-437273506", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "181d1f0d-1ec7-49df-8b5b-e3c264fefd29", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "277ba9f5-743a-4949-b45f-d5582af5f04e"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:24:40.280366 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-230c3804-2461-4081-99d3-ec3a174f1f7a tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] validate_networks() for [('277ba9f5-743a-4949-b45f-d5582af5f04e', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:24:40.791168 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-230c3804-2461-4081-99d3-ec3a174f1f7a tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:24:40.792046 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-230c3804-2461-4081-99d3-ec3a174f1f7a tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:24:40.792635 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-230c3804-2461-4081-99d3-ec3a174f1f7a tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:24:40.793157 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-230c3804-2461-4081-99d3-ec3a174f1f7a tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:24:40.793814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-230c3804-2461-4081-99d3-ec3a174f1f7a tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:24:40.804168 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-230c3804-2461-4081-99d3-ec3a174f1f7a tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:40.804865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-230c3804-2461-4081-99d3-ec3a174f1f7a tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:40.805406 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-230c3804-2461-4081-99d3-ec3a174f1f7a tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:40.813519 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-230c3804-2461-4081-99d3-ec3a174f1f7a tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:40.814517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-230c3804-2461-4081-99d3-ec3a174f1f7a tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:40.815077 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-230c3804-2461-4081-99d3-ec3a174f1f7a tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:40.822766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:24:40.836123 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-230c3804-2461-4081-99d3-ec3a174f1f7a tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Getting quotas for project b99d2a0b4d7e40a38e682fc147e968af. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:24:40.842585 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-230c3804-2461-4081-99d3-ec3a174f1f7a tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Getting quotas for user 342e60103c9b45bcb348b6f8bcd686ca and project b99d2a0b4d7e40a38e682fc147e968af. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:24:40.918728 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-230c3804-2461-4081-99d3-ec3a174f1f7a tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:24:40.921431 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-230c3804-2461-4081-99d3-ec3a174f1f7a tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='181d1f0d-1ec7-49df-8b5b-e3c264fefd29',volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:24:41.051935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:24:41.118809 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-230c3804-2461-4081-99d3-ec3a174f1f7a tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.903632 Sep 17 21:24:41.121715 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2872/5819] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:24:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:24:41.135928 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-11e5b13c-3add-4af5-b7a9-b5a70f8be3b3 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:41.136649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-11e5b13c-3add-4af5-b7a9-b5a70f8be3b3 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:41.218181 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-11e5b13c-3add-4af5-b7a9-b5a70f8be3b3 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:41.230809 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-11e5b13c-3add-4af5-b7a9-b5a70f8be3b3 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe" status: 200 len: 1070 microversion: 2.1 time: 0.099257 Sep 17 21:24:41.231580 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2948/5820] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:41 2022] GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe => generated 1070 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:42.258620 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-41b92a1d-ca8d-4e08-b829-68a99084ed91 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:42.259398 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-41b92a1d-ca8d-4e08-b829-68a99084ed91 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:42.266376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-41b92a1d-ca8d-4e08-b829-68a99084ed91 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:42.267327 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-41b92a1d-ca8d-4e08-b829-68a99084ed91 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:42.267950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-41b92a1d-ca8d-4e08-b829-68a99084ed91 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:42.268757 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-41b92a1d-ca8d-4e08-b829-68a99084ed91 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:42.269231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-41b92a1d-ca8d-4e08-b829-68a99084ed91 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:42.269698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-41b92a1d-ca8d-4e08-b829-68a99084ed91 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:42.347887 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-41b92a1d-ca8d-4e08-b829-68a99084ed91 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:42.356301 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-41b92a1d-ca8d-4e08-b829-68a99084ed91 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe" status: 200 len: 1168 microversion: 2.1 time: 0.104614 Sep 17 21:24:42.357750 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2873/5821] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:42 2022] GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe => generated 1168 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:43.383821 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b8f92819-46f2-459c-80b2-461c7d1b9896 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:43.384951 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b8f92819-46f2-459c-80b2-461c7d1b9896 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:43.401213 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=32 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:24:43.407345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b8f92819-46f2-459c-80b2-461c7d1b9896 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:43.408515 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b8f92819-46f2-459c-80b2-461c7d1b9896 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:43.410095 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b8f92819-46f2-459c-80b2-461c7d1b9896 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:43.411205 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b8f92819-46f2-459c-80b2-461c7d1b9896 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:43.413533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b8f92819-46f2-459c-80b2-461c7d1b9896 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:43.414199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b8f92819-46f2-459c-80b2-461c7d1b9896 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:43.434169 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=65,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:24:43.580447 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b8f92819-46f2-459c-80b2-461c7d1b9896 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:43.600320 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b8f92819-46f2-459c-80b2-461c7d1b9896 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe" status: 200 len: 1186 microversion: 2.1 time: 0.223596 Sep 17 21:24:43.600970 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2949/5822] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:43 2022] GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe => generated 1186 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:44.627955 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d457439b-db35-4755-b56f-05aa16eb6ec4 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:44.629194 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d457439b-db35-4755-b56f-05aa16eb6ec4 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:44.637094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d457439b-db35-4755-b56f-05aa16eb6ec4 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:44.638032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d457439b-db35-4755-b56f-05aa16eb6ec4 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:44.638683 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d457439b-db35-4755-b56f-05aa16eb6ec4 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:44.639713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d457439b-db35-4755-b56f-05aa16eb6ec4 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:44.640186 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d457439b-db35-4755-b56f-05aa16eb6ec4 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:44.640630 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d457439b-db35-4755-b56f-05aa16eb6ec4 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:44.914907 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d457439b-db35-4755-b56f-05aa16eb6ec4 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:44.925160 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d457439b-db35-4755-b56f-05aa16eb6ec4 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe" status: 200 len: 1216 microversion: 2.1 time: 0.301246 Sep 17 21:24:44.937452 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2874/5823] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:44 2022] GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe => generated 1216 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:45.321388 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-8b29608a-24f5-4418-bda8-33384676bb56 req-82a40370-c362-44de-af9e-bd59c3acbd03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe", "tag": "32a6e8de-dd72-4be7-aa3b-50aa59a855b1"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:24:45.339784 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8b29608a-24f5-4418-bda8-33384676bb56 req-82a40370-c362-44de-af9e-bd59c3acbd03 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:45.340517 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8b29608a-24f5-4418-bda8-33384676bb56 req-82a40370-c362-44de-af9e-bd59c3acbd03 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:45.341113 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8b29608a-24f5-4418-bda8-33384676bb56 req-82a40370-c362-44de-af9e-bd59c3acbd03 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:45.358451 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-8b29608a-24f5-4418-bda8-33384676bb56 req-82a40370-c362-44de-af9e-bd59c3acbd03 service nova] Creating event network-changed:32a6e8de-dd72-4be7-aa3b-50aa59a855b1 for instance ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe on nch1-master-1 Sep 17 21:24:45.364687 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-8b29608a-24f5-4418-bda8-33384676bb56 req-82a40370-c362-44de-af9e-bd59c3acbd03 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048392 Sep 17 21:24:45.366565 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2950/5824] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:24:45.948628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b334ed87-574e-42da-9ad0-7d5a8b2e0d90 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:45.949253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b334ed87-574e-42da-9ad0-7d5a8b2e0d90 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:45.961980 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b334ed87-574e-42da-9ad0-7d5a8b2e0d90 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:45.962499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b334ed87-574e-42da-9ad0-7d5a8b2e0d90 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:45.963390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b334ed87-574e-42da-9ad0-7d5a8b2e0d90 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:45.967637 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b334ed87-574e-42da-9ad0-7d5a8b2e0d90 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:45.968359 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b334ed87-574e-42da-9ad0-7d5a8b2e0d90 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:45.969132 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b334ed87-574e-42da-9ad0-7d5a8b2e0d90 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:46.179377 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b334ed87-574e-42da-9ad0-7d5a8b2e0d90 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:46.195562 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b334ed87-574e-42da-9ad0-7d5a8b2e0d90 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe" status: 200 len: 1216 microversion: 2.1 time: 0.250878 Sep 17 21:24:46.200141 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2875/5825] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:45 2022] GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe => generated 1216 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:47.223999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2ffb62f5-a1c4-4661-809d-add220f413d7 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:47.224657 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2ffb62f5-a1c4-4661-809d-add220f413d7 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:47.235377 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ffb62f5-a1c4-4661-809d-add220f413d7 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:47.235763 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ffb62f5-a1c4-4661-809d-add220f413d7 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:47.236217 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ffb62f5-a1c4-4661-809d-add220f413d7 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:47.236940 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ffb62f5-a1c4-4661-809d-add220f413d7 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:47.237440 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ffb62f5-a1c4-4661-809d-add220f413d7 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:47.237904 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ffb62f5-a1c4-4661-809d-add220f413d7 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:47.474998 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2ffb62f5-a1c4-4661-809d-add220f413d7 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:47.482974 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2ffb62f5-a1c4-4661-809d-add220f413d7 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe" status: 200 len: 1216 microversion: 2.1 time: 0.263345 Sep 17 21:24:47.483561 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2951/5826] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:47 2022] GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe => generated 1216 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:48.506982 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-724d902c-6803-4e2b-8402-f1d2de0fe67d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:48.507554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-724d902c-6803-4e2b-8402-f1d2de0fe67d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:48.515337 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-724d902c-6803-4e2b-8402-f1d2de0fe67d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:48.515857 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-724d902c-6803-4e2b-8402-f1d2de0fe67d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:48.516301 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-724d902c-6803-4e2b-8402-f1d2de0fe67d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:48.517008 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-724d902c-6803-4e2b-8402-f1d2de0fe67d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:48.517501 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-724d902c-6803-4e2b-8402-f1d2de0fe67d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:48.517956 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-724d902c-6803-4e2b-8402-f1d2de0fe67d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:48.661596 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-724d902c-6803-4e2b-8402-f1d2de0fe67d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:48.676782 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-724d902c-6803-4e2b-8402-f1d2de0fe67d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe" status: 200 len: 1216 microversion: 2.1 time: 0.173931 Sep 17 21:24:48.677415 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2876/5827] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:48 2022] GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe => generated 1216 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:49.700384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6abbb5b5-3563-4a14-acb3-f14c1e62c74d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:49.701007 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6abbb5b5-3563-4a14-acb3-f14c1e62c74d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:49.710087 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6abbb5b5-3563-4a14-acb3-f14c1e62c74d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:49.710422 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6abbb5b5-3563-4a14-acb3-f14c1e62c74d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:49.711023 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6abbb5b5-3563-4a14-acb3-f14c1e62c74d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:49.711933 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6abbb5b5-3563-4a14-acb3-f14c1e62c74d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:49.712392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6abbb5b5-3563-4a14-acb3-f14c1e62c74d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:49.712821 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6abbb5b5-3563-4a14-acb3-f14c1e62c74d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:49.960878 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6abbb5b5-3563-4a14-acb3-f14c1e62c74d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:49.970537 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6abbb5b5-3563-4a14-acb3-f14c1e62c74d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe" status: 200 len: 1216 microversion: 2.1 time: 0.274150 Sep 17 21:24:49.971120 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2952/5828] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:49 2022] GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe => generated 1216 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:50.994196 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fc56cca5-cd36-42b1-b712-6a0a79ec52ba tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:50.994822 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fc56cca5-cd36-42b1-b712-6a0a79ec52ba tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:50.997664 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:24:50.998761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:24:51.005068 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc56cca5-cd36-42b1-b712-6a0a79ec52ba tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:51.005597 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc56cca5-cd36-42b1-b712-6a0a79ec52ba tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:51.006046 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc56cca5-cd36-42b1-b712-6a0a79ec52ba tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:51.006769 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc56cca5-cd36-42b1-b712-6a0a79ec52ba tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:51.007231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc56cca5-cd36-42b1-b712-6a0a79ec52ba tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:51.007904 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc56cca5-cd36-42b1-b712-6a0a79ec52ba tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:51.223702 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fc56cca5-cd36-42b1-b712-6a0a79ec52ba tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:51.239346 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fc56cca5-cd36-42b1-b712-6a0a79ec52ba tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe" status: 200 len: 1216 microversion: 2.1 time: 0.249385 Sep 17 21:24:51.239946 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2877/5829] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:50 2022] GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe => generated 1216 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:51.379240 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-72b05e42-8e6f-4e36-a95e-ce18c32ece01 req-f1ffd528-d4fc-43dd-8a9e-2eec6a69f69d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe", "name": "network-vif-plugged", "status": "completed", "tag": "32a6e8de-dd72-4be7-aa3b-50aa59a855b1"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:24:51.390723 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:24:51.396991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-72b05e42-8e6f-4e36-a95e-ce18c32ece01 req-f1ffd528-d4fc-43dd-8a9e-2eec6a69f69d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:51.397622 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-72b05e42-8e6f-4e36-a95e-ce18c32ece01 req-f1ffd528-d4fc-43dd-8a9e-2eec6a69f69d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:51.398168 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-72b05e42-8e6f-4e36-a95e-ce18c32ece01 req-f1ffd528-d4fc-43dd-8a9e-2eec6a69f69d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:51.411172 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-72b05e42-8e6f-4e36-a95e-ce18c32ece01 req-f1ffd528-d4fc-43dd-8a9e-2eec6a69f69d service nova] Creating event network-vif-plugged:32a6e8de-dd72-4be7-aa3b-50aa59a855b1 for instance ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe on nch1-master-1 Sep 17 21:24:51.416380 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-72b05e42-8e6f-4e36-a95e-ce18c32ece01 req-f1ffd528-d4fc-43dd-8a9e-2eec6a69f69d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041248 Sep 17 21:24:51.417091 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2953/5830] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:24:52.264038 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bb9875a7-0147-4584-9276-6b5231201a0c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:52.264674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bb9875a7-0147-4584-9276-6b5231201a0c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:52.272121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bb9875a7-0147-4584-9276-6b5231201a0c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:52.272628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bb9875a7-0147-4584-9276-6b5231201a0c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:52.273072 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bb9875a7-0147-4584-9276-6b5231201a0c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:52.273819 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bb9875a7-0147-4584-9276-6b5231201a0c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:52.274316 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bb9875a7-0147-4584-9276-6b5231201a0c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:52.274719 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bb9875a7-0147-4584-9276-6b5231201a0c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:52.507548 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bb9875a7-0147-4584-9276-6b5231201a0c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:52.523044 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bb9875a7-0147-4584-9276-6b5231201a0c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe" status: 200 len: 1216 microversion: 2.1 time: 0.262154 Sep 17 21:24:52.525270 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2878/5831] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:52 2022] GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe => generated 1216 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:53.550346 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-75b0c767-9ff2-41e5-a1ba-46ff6ec72beb tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:53.551110 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-75b0c767-9ff2-41e5-a1ba-46ff6ec72beb tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:53.557870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75b0c767-9ff2-41e5-a1ba-46ff6ec72beb tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:53.558373 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75b0c767-9ff2-41e5-a1ba-46ff6ec72beb tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:53.558838 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75b0c767-9ff2-41e5-a1ba-46ff6ec72beb tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:53.559548 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75b0c767-9ff2-41e5-a1ba-46ff6ec72beb tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:53.560011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75b0c767-9ff2-41e5-a1ba-46ff6ec72beb tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:53.560447 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75b0c767-9ff2-41e5-a1ba-46ff6ec72beb tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:53.732255 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-75b0c767-9ff2-41e5-a1ba-46ff6ec72beb tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:53.741986 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-75b0c767-9ff2-41e5-a1ba-46ff6ec72beb tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe" status: 200 len: 1403 microversion: 2.1 time: 0.196758 Sep 17 21:24:53.742714 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2954/5832] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:53 2022] GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe => generated 1403 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:53.766140 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0ec40303-db2a-4997-a461-aabde15a359a tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:53.766763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0ec40303-db2a-4997-a461-aabde15a359a tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:53.774037 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ec40303-db2a-4997-a461-aabde15a359a tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:53.774666 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ec40303-db2a-4997-a461-aabde15a359a tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:53.775161 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ec40303-db2a-4997-a461-aabde15a359a tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:53.775914 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ec40303-db2a-4997-a461-aabde15a359a tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:53.776469 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ec40303-db2a-4997-a461-aabde15a359a tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:53.776921 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ec40303-db2a-4997-a461-aabde15a359a tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:53.943599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0ec40303-db2a-4997-a461-aabde15a359a tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:53.952398 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0ec40303-db2a-4997-a461-aabde15a359a tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe" status: 200 len: 1403 microversion: 2.1 time: 0.190629 Sep 17 21:24:53.953002 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2879/5833] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:53 2022] GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe => generated 1403 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:53.977252 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5b8f0207-1f4d-4698-979a-19374f40641e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-11584328"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:24:53.979649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5b8f0207-1f4d-4698-979a-19374f40641e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:53.986006 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b8f0207-1f4d-4698-979a-19374f40641e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:53.986498 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b8f0207-1f4d-4698-979a-19374f40641e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:53.986953 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b8f0207-1f4d-4698-979a-19374f40641e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:53.987719 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b8f0207-1f4d-4698-979a-19374f40641e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:53.988182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b8f0207-1f4d-4698-979a-19374f40641e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:53.988617 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b8f0207-1f4d-4698-979a-19374f40641e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:54.128397 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.compute.api [None req-5b8f0207-1f4d-4698-979a-19374f40641e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe] Attempting to quiesce instance before volume snapshot. Sep 17 21:24:54.198605 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.compute.api [None req-5b8f0207-1f4d-4698-979a-19374f40641e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Sep 17 21:24:54.279600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5b8f0207-1f4d-4698-979a-19374f40641e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe] Creating snapshot from volume 181d1f0d-1ec7-49df-8b5b-e3c264fefd29. {{(pid=140524) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Sep 17 21:24:55.472648 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5b8f0207-1f4d-4698-979a-19374f40641e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "POST /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe/action" status: 202 len: 0 microversion: 2.1 time: 1.499211 Sep 17 21:24:55.478737 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2955/5834] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:24:53 2022] POST /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe/action => generated 0 bytes in 1501 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 17 21:24:56.737605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1391a48a-6688-4cac-a043-1162dcd732fe tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-899031269", "imageRef": "d5a35b4a-8531-47b9-a777-2f4a20a1c82f", "flavorRef": "452", "networks": [{"uuid": "277ba9f5-743a-4949-b45f-d5582af5f04e"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:24:56.804014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-1391a48a-6688-4cac-a043-1162dcd732fe tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] validate_networks() for [('277ba9f5-743a-4949-b45f-d5582af5f04e', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:24:57.487695 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-1391a48a-6688-4cac-a043-1162dcd732fe tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:24:57.488124 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-1391a48a-6688-4cac-a043-1162dcd732fe tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:24:57.488820 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-1391a48a-6688-4cac-a043-1162dcd732fe tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:24:57.489714 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-1391a48a-6688-4cac-a043-1162dcd732fe tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:24:57.491037 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-1391a48a-6688-4cac-a043-1162dcd732fe tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:24:57.502334 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1391a48a-6688-4cac-a043-1162dcd732fe tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:57.503256 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1391a48a-6688-4cac-a043-1162dcd732fe tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:57.504337 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1391a48a-6688-4cac-a043-1162dcd732fe tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:57.505301 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1391a48a-6688-4cac-a043-1162dcd732fe tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:57.505958 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1391a48a-6688-4cac-a043-1162dcd732fe tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:57.506642 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1391a48a-6688-4cac-a043-1162dcd732fe tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:57.529686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-1391a48a-6688-4cac-a043-1162dcd732fe tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Getting quotas for project b99d2a0b4d7e40a38e682fc147e968af. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:24:57.536361 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-1391a48a-6688-4cac-a043-1162dcd732fe tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Getting quotas for user 342e60103c9b45bcb348b6f8bcd686ca and project b99d2a0b4d7e40a38e682fc147e968af. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:24:57.550231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1391a48a-6688-4cac-a043-1162dcd732fe tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:24:57.553238 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1391a48a-6688-4cac-a043-1162dcd732fe tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 61f234b4-d902-48c0-a882-4c644c389ee7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='ebc81b3f-de04-4713-a1ca-0d2e7f8eb20f',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:24:57.659213 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1391a48a-6688-4cac-a043-1162dcd732fe tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.925509 Sep 17 21:24:57.666561 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2880/5835] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:24:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:24:57.675082 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-196cdbb7-1385-4e96-a324-bcca921ec8e0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:57.677760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-196cdbb7-1385-4e96-a324-bcca921ec8e0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 61f234b4-d902-48c0-a882-4c644c389ee7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:57.822503 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-196cdbb7-1385-4e96-a324-bcca921ec8e0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:57.837086 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-196cdbb7-1385-4e96-a324-bcca921ec8e0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7" status: 200 len: 1229 microversion: 2.1 time: 0.169221 Sep 17 21:24:57.841530 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2956/5836] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:57 2022] GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7 => generated 1229 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:58.861010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bf77c13b-92fd-4691-8ca9-8e5febd9a0a8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:58.861669 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bf77c13b-92fd-4691-8ca9-8e5febd9a0a8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 61f234b4-d902-48c0-a882-4c644c389ee7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:58.870049 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf77c13b-92fd-4691-8ca9-8e5febd9a0a8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:58.870555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf77c13b-92fd-4691-8ca9-8e5febd9a0a8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:58.871034 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf77c13b-92fd-4691-8ca9-8e5febd9a0a8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:58.871988 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf77c13b-92fd-4691-8ca9-8e5febd9a0a8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:24:58.872459 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf77c13b-92fd-4691-8ca9-8e5febd9a0a8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:24:58.872897 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf77c13b-92fd-4691-8ca9-8e5febd9a0a8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:24:58.950416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bf77c13b-92fd-4691-8ca9-8e5febd9a0a8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:24:58.959737 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bf77c13b-92fd-4691-8ca9-8e5febd9a0a8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7" status: 200 len: 1289 microversion: 2.1 time: 0.102803 Sep 17 21:24:58.960333 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2881/5837] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:58 2022] GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7 => generated 1289 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:24:59.983473 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-aaf37df7-1ed5-4da4-822b-ae1fa7937e93 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:24:59.984982 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-aaf37df7-1ed5-4da4-822b-ae1fa7937e93 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 61f234b4-d902-48c0-a882-4c644c389ee7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:24:59.999494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aaf37df7-1ed5-4da4-822b-ae1fa7937e93 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:00.000022 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aaf37df7-1ed5-4da4-822b-ae1fa7937e93 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:00.001003 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aaf37df7-1ed5-4da4-822b-ae1fa7937e93 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:00.002365 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aaf37df7-1ed5-4da4-822b-ae1fa7937e93 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:00.003457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aaf37df7-1ed5-4da4-822b-ae1fa7937e93 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:00.004121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aaf37df7-1ed5-4da4-822b-ae1fa7937e93 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:00.135245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-aaf37df7-1ed5-4da4-822b-ae1fa7937e93 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:25:00.143759 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-aaf37df7-1ed5-4da4-822b-ae1fa7937e93 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7" status: 200 len: 1299 microversion: 2.1 time: 0.164383 Sep 17 21:25:00.145195 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2957/5838] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:24:59 2022] GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7 => generated 1299 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:25:01.181427 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-648bdf1b-c6d1-489d-9681-ceba9632e159 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:25:01.182685 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-648bdf1b-c6d1-489d-9681-ceba9632e159 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 61f234b4-d902-48c0-a882-4c644c389ee7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:25:01.194184 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-648bdf1b-c6d1-489d-9681-ceba9632e159 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:01.195154 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-648bdf1b-c6d1-489d-9681-ceba9632e159 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:01.196214 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-648bdf1b-c6d1-489d-9681-ceba9632e159 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:01.197165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-648bdf1b-c6d1-489d-9681-ceba9632e159 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:01.197889 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-648bdf1b-c6d1-489d-9681-ceba9632e159 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:01.198993 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-648bdf1b-c6d1-489d-9681-ceba9632e159 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:01.508960 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-648bdf1b-c6d1-489d-9681-ceba9632e159 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:25:01.523452 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-648bdf1b-c6d1-489d-9681-ceba9632e159 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7" status: 200 len: 1341 microversion: 2.1 time: 0.358016 Sep 17 21:25:01.524145 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2882/5839] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:25:01 2022] GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7 => generated 1341 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:25:02.548914 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2e799957-2a9e-4cd0-a759-2e95372fe9ac tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:25:02.549934 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2e799957-2a9e-4cd0-a759-2e95372fe9ac tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 61f234b4-d902-48c0-a882-4c644c389ee7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:25:02.557542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e799957-2a9e-4cd0-a759-2e95372fe9ac tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:02.558134 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e799957-2a9e-4cd0-a759-2e95372fe9ac tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:02.558749 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e799957-2a9e-4cd0-a759-2e95372fe9ac tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:02.559538 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e799957-2a9e-4cd0-a759-2e95372fe9ac tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:02.560295 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e799957-2a9e-4cd0-a759-2e95372fe9ac tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:02.560734 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2e799957-2a9e-4cd0-a759-2e95372fe9ac tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:02.623629 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-bbe99a08-75e4-45ce-8b1f-812bd860d885 req-cec32a07-28b9-494c-a286-2195ac8139bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61f234b4-d902-48c0-a882-4c644c389ee7", "tag": "0d338dd4-eebb-4e8a-bbf6-af6f7cb3d1c6"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:25:02.650744 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-bbe99a08-75e4-45ce-8b1f-812bd860d885 req-cec32a07-28b9-494c-a286-2195ac8139bc service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:02.654201 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-bbe99a08-75e4-45ce-8b1f-812bd860d885 req-cec32a07-28b9-494c-a286-2195ac8139bc service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:02.655297 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-bbe99a08-75e4-45ce-8b1f-812bd860d885 req-cec32a07-28b9-494c-a286-2195ac8139bc service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:02.674315 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-bbe99a08-75e4-45ce-8b1f-812bd860d885 req-cec32a07-28b9-494c-a286-2195ac8139bc service nova] Creating event network-changed:0d338dd4-eebb-4e8a-bbf6-af6f7cb3d1c6 for instance 61f234b4-d902-48c0-a882-4c644c389ee7 on nch2-master-1 Sep 17 21:25:02.684459 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-bbe99a08-75e4-45ce-8b1f-812bd860d885 req-cec32a07-28b9-494c-a286-2195ac8139bc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076720 Sep 17 21:25:02.685871 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2883/5840] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:25:02.819644 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2e799957-2a9e-4cd0-a759-2e95372fe9ac tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:25:02.834777 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2e799957-2a9e-4cd0-a759-2e95372fe9ac tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7" status: 200 len: 1341 microversion: 2.1 time: 0.290215 Sep 17 21:25:02.836208 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2958/5841] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:25:02 2022] GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7 => generated 1341 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:25:03.862773 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-151b31a7-5d9f-4ee9-b035-60a328dbffc8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:25:03.863668 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-151b31a7-5d9f-4ee9-b035-60a328dbffc8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 61f234b4-d902-48c0-a882-4c644c389ee7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:25:03.881782 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-151b31a7-5d9f-4ee9-b035-60a328dbffc8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:03.882446 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-151b31a7-5d9f-4ee9-b035-60a328dbffc8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:03.883078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-151b31a7-5d9f-4ee9-b035-60a328dbffc8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:03.883940 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-151b31a7-5d9f-4ee9-b035-60a328dbffc8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:03.884512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-151b31a7-5d9f-4ee9-b035-60a328dbffc8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:03.885058 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-151b31a7-5d9f-4ee9-b035-60a328dbffc8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:04.332442 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-151b31a7-5d9f-4ee9-b035-60a328dbffc8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:25:04.347639 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-151b31a7-5d9f-4ee9-b035-60a328dbffc8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7" status: 200 len: 1387 microversion: 2.1 time: 0.490110 Sep 17 21:25:04.350353 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2884/5842] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:25:03 2022] GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7 => generated 1387 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:25:05.378885 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ab481c38-1fec-4feb-a964-afdff2a1be6b tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:25:05.379690 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ab481c38-1fec-4feb-a964-afdff2a1be6b tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 61f234b4-d902-48c0-a882-4c644c389ee7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:25:05.390774 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ab481c38-1fec-4feb-a964-afdff2a1be6b tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:05.392471 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ab481c38-1fec-4feb-a964-afdff2a1be6b tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:05.393819 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ab481c38-1fec-4feb-a964-afdff2a1be6b tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:05.394784 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ab481c38-1fec-4feb-a964-afdff2a1be6b tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:05.395901 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ab481c38-1fec-4feb-a964-afdff2a1be6b tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:05.396886 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ab481c38-1fec-4feb-a964-afdff2a1be6b tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:05.667607 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ab481c38-1fec-4feb-a964-afdff2a1be6b tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:25:05.690622 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ab481c38-1fec-4feb-a964-afdff2a1be6b tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7" status: 200 len: 1375 microversion: 2.1 time: 0.313471 Sep 17 21:25:05.693824 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2959/5843] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:25:05 2022] GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7 => generated 1375 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:25:06.717776 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d8986e1d-ef42-4aef-8983-6a1cf54251a8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:25:06.719072 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d8986e1d-ef42-4aef-8983-6a1cf54251a8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 61f234b4-d902-48c0-a882-4c644c389ee7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:25:06.728103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8986e1d-ef42-4aef-8983-6a1cf54251a8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:06.728907 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8986e1d-ef42-4aef-8983-6a1cf54251a8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:06.729577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8986e1d-ef42-4aef-8983-6a1cf54251a8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:06.731126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8986e1d-ef42-4aef-8983-6a1cf54251a8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:06.731811 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8986e1d-ef42-4aef-8983-6a1cf54251a8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:06.732591 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8986e1d-ef42-4aef-8983-6a1cf54251a8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:06.980377 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d8986e1d-ef42-4aef-8983-6a1cf54251a8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:25:06.989070 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d8986e1d-ef42-4aef-8983-6a1cf54251a8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7" status: 200 len: 1375 microversion: 2.1 time: 0.275967 Sep 17 21:25:06.992657 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2885/5844] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:25:06 2022] GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7 => generated 1375 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:25:08.013272 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-97ddf91f-f345-4c4e-8edb-e0315309d7ba tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:25:08.014497 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-97ddf91f-f345-4c4e-8edb-e0315309d7ba tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 61f234b4-d902-48c0-a882-4c644c389ee7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:25:08.023070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:25:08.031899 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97ddf91f-f345-4c4e-8edb-e0315309d7ba tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:08.032887 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97ddf91f-f345-4c4e-8edb-e0315309d7ba tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:08.035469 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97ddf91f-f345-4c4e-8edb-e0315309d7ba tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:08.036461 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97ddf91f-f345-4c4e-8edb-e0315309d7ba tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:08.039282 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97ddf91f-f345-4c4e-8edb-e0315309d7ba tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:08.041707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97ddf91f-f345-4c4e-8edb-e0315309d7ba tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:08.230778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-97ddf91f-f345-4c4e-8edb-e0315309d7ba tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:25:08.241715 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-97ddf91f-f345-4c4e-8edb-e0315309d7ba tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7" status: 200 len: 1375 microversion: 2.1 time: 0.232879 Sep 17 21:25:08.242533 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2960/5845] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:25:08 2022] GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7 => generated 1375 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:25:09.268158 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-73d56eaf-076f-414a-8630-9dedd08bc635 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:25:09.269488 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-73d56eaf-076f-414a-8630-9dedd08bc635 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 61f234b4-d902-48c0-a882-4c644c389ee7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:25:09.275795 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:25:09.277322 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:25:09.283985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73d56eaf-076f-414a-8630-9dedd08bc635 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:09.284882 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73d56eaf-076f-414a-8630-9dedd08bc635 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:09.285550 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73d56eaf-076f-414a-8630-9dedd08bc635 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:09.286509 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73d56eaf-076f-414a-8630-9dedd08bc635 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:09.287130 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73d56eaf-076f-414a-8630-9dedd08bc635 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:09.287722 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73d56eaf-076f-414a-8630-9dedd08bc635 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:09.601358 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-73d56eaf-076f-414a-8630-9dedd08bc635 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:25:09.611369 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-73d56eaf-076f-414a-8630-9dedd08bc635 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7" status: 200 len: 1375 microversion: 2.1 time: 0.347028 Sep 17 21:25:09.612639 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2886/5846] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:25:09 2022] GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7 => generated 1375 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:25:10.635215 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-22c3e24b-fae0-4094-be58-0fc3e03e6672 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:25:10.635891 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-22c3e24b-fae0-4094-be58-0fc3e03e6672 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 61f234b4-d902-48c0-a882-4c644c389ee7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:25:10.650297 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-22c3e24b-fae0-4094-be58-0fc3e03e6672 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:10.651860 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-22c3e24b-fae0-4094-be58-0fc3e03e6672 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:10.656217 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-22c3e24b-fae0-4094-be58-0fc3e03e6672 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:10.657772 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-22c3e24b-fae0-4094-be58-0fc3e03e6672 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:10.660256 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-22c3e24b-fae0-4094-be58-0fc3e03e6672 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:10.660954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-22c3e24b-fae0-4094-be58-0fc3e03e6672 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:10.972981 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-22c3e24b-fae0-4094-be58-0fc3e03e6672 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:25:10.989935 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-22c3e24b-fae0-4094-be58-0fc3e03e6672 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7" status: 200 len: 1375 microversion: 2.1 time: 0.353987 Sep 17 21:25:10.991833 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2961/5847] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:25:10 2022] GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7 => generated 1375 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:25:12.019937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-571af119-c964-4416-90d7-fbb7b54f1bf8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:25:12.022458 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-571af119-c964-4416-90d7-fbb7b54f1bf8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 61f234b4-d902-48c0-a882-4c644c389ee7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:25:12.036029 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=40 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:25:12.040123 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-571af119-c964-4416-90d7-fbb7b54f1bf8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:12.040901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-571af119-c964-4416-90d7-fbb7b54f1bf8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:12.044179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-571af119-c964-4416-90d7-fbb7b54f1bf8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:12.058361 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-571af119-c964-4416-90d7-fbb7b54f1bf8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:12.060609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-571af119-c964-4416-90d7-fbb7b54f1bf8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:12.061302 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-571af119-c964-4416-90d7-fbb7b54f1bf8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:12.091720 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=78 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:25:12.265898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-571af119-c964-4416-90d7-fbb7b54f1bf8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:25:12.278564 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-571af119-c964-4416-90d7-fbb7b54f1bf8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7" status: 200 len: 1375 microversion: 2.1 time: 0.265906 Sep 17 21:25:12.295698 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2887/5848] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:25:12 2022] GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7 => generated 1375 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:25:12.363345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-8415f1a9-5116-4521-adce-87483ff92d26 req-1506b6ad-ef01-4add-9601-31c87a767c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61f234b4-d902-48c0-a882-4c644c389ee7", "name": "network-vif-plugged", "status": "completed", "tag": "0d338dd4-eebb-4e8a-bbf6-af6f7cb3d1c6"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:25:12.387089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8415f1a9-5116-4521-adce-87483ff92d26 req-1506b6ad-ef01-4add-9601-31c87a767c84 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:12.389505 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8415f1a9-5116-4521-adce-87483ff92d26 req-1506b6ad-ef01-4add-9601-31c87a767c84 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:12.390185 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8415f1a9-5116-4521-adce-87483ff92d26 req-1506b6ad-ef01-4add-9601-31c87a767c84 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:12.417802 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-8415f1a9-5116-4521-adce-87483ff92d26 req-1506b6ad-ef01-4add-9601-31c87a767c84 service nova] Creating event network-vif-plugged:0d338dd4-eebb-4e8a-bbf6-af6f7cb3d1c6 for instance 61f234b4-d902-48c0-a882-4c644c389ee7 on nch2-master-1 Sep 17 21:25:12.432936 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-8415f1a9-5116-4521-adce-87483ff92d26 req-1506b6ad-ef01-4add-9601-31c87a767c84 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074492 Sep 17 21:25:12.439792 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2962/5849] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:25:13.322668 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c42e523d-b6bf-4bec-8256-60c8bb137f49 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:25:13.323499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c42e523d-b6bf-4bec-8256-60c8bb137f49 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 61f234b4-d902-48c0-a882-4c644c389ee7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:25:13.350106 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c42e523d-b6bf-4bec-8256-60c8bb137f49 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:13.353021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c42e523d-b6bf-4bec-8256-60c8bb137f49 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:13.353934 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c42e523d-b6bf-4bec-8256-60c8bb137f49 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:13.357733 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c42e523d-b6bf-4bec-8256-60c8bb137f49 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:13.358544 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c42e523d-b6bf-4bec-8256-60c8bb137f49 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:13.359209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c42e523d-b6bf-4bec-8256-60c8bb137f49 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:13.649338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c42e523d-b6bf-4bec-8256-60c8bb137f49 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:25:13.661765 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c42e523d-b6bf-4bec-8256-60c8bb137f49 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7" status: 200 len: 1375 microversion: 2.1 time: 0.360573 Sep 17 21:25:13.663323 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2888/5850] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:25:13 2022] GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7 => generated 1375 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:25:14.696684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-829cb63c-2ca8-4a48-914b-6a786f117511 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:25:14.697605 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-829cb63c-2ca8-4a48-914b-6a786f117511 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 61f234b4-d902-48c0-a882-4c644c389ee7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:25:14.705811 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=30 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:25:14.708494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-829cb63c-2ca8-4a48-914b-6a786f117511 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:14.709428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-829cb63c-2ca8-4a48-914b-6a786f117511 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:14.710404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-829cb63c-2ca8-4a48-914b-6a786f117511 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:14.711234 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-829cb63c-2ca8-4a48-914b-6a786f117511 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:14.712068 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-829cb63c-2ca8-4a48-914b-6a786f117511 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:14.712557 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-829cb63c-2ca8-4a48-914b-6a786f117511 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:14.718820 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=74,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:25:14.912437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-829cb63c-2ca8-4a48-914b-6a786f117511 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:25:14.930210 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-829cb63c-2ca8-4a48-914b-6a786f117511 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7" status: 200 len: 1563 microversion: 2.1 time: 0.244556 Sep 17 21:25:14.931584 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2963/5851] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:25:14 2022] GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7 => generated 1563 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:25:14.959889 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3f17d1e2-1371-423a-8d9f-6c7d85294008 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:25:14.961778 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3f17d1e2-1371-423a-8d9f-6c7d85294008 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 61f234b4-d902-48c0-a882-4c644c389ee7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:25:14.970928 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f17d1e2-1371-423a-8d9f-6c7d85294008 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:14.971744 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f17d1e2-1371-423a-8d9f-6c7d85294008 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:14.972207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f17d1e2-1371-423a-8d9f-6c7d85294008 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:14.973094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f17d1e2-1371-423a-8d9f-6c7d85294008 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:14.973781 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f17d1e2-1371-423a-8d9f-6c7d85294008 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:14.974652 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f17d1e2-1371-423a-8d9f-6c7d85294008 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:15.464466 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3f17d1e2-1371-423a-8d9f-6c7d85294008 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:25:15.481672 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3f17d1e2-1371-423a-8d9f-6c7d85294008 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7" status: 200 len: 1563 microversion: 2.1 time: 0.528175 Sep 17 21:25:15.482555 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2889/5852] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:25:14 2022] GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7 => generated 1563 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:25:15.590799 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fedd767e-d2e5-4de9-bf5d-3eb739207e35 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:25:15.591608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fedd767e-d2e5-4de9-bf5d-3eb739207e35 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 61f234b4-d902-48c0-a882-4c644c389ee7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:25:15.604600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fedd767e-d2e5-4de9-bf5d-3eb739207e35 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:15.606350 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fedd767e-d2e5-4de9-bf5d-3eb739207e35 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:15.607884 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fedd767e-d2e5-4de9-bf5d-3eb739207e35 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:15.616051 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fedd767e-d2e5-4de9-bf5d-3eb739207e35 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:15.620943 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fedd767e-d2e5-4de9-bf5d-3eb739207e35 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:15.621775 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fedd767e-d2e5-4de9-bf5d-3eb739207e35 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:15.694336 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fedd767e-d2e5-4de9-bf5d-3eb739207e35 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 61f234b4-d902-48c0-a882-4c644c389ee7] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:25:15.905424 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fedd767e-d2e5-4de9-bf5d-3eb739207e35 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "DELETE /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7" status: 204 len: 0 microversion: 2.1 time: 0.328211 Sep 17 21:25:15.907365 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2964/5853] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:25:15 2022] DELETE /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:25:15.916699 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-21d9eaf3-4348-400e-83d9-60a947c06d4c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:25:15.917611 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-21d9eaf3-4348-400e-83d9-60a947c06d4c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 61f234b4-d902-48c0-a882-4c644c389ee7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:25:15.925395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21d9eaf3-4348-400e-83d9-60a947c06d4c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:15.925929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21d9eaf3-4348-400e-83d9-60a947c06d4c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:15.926382 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21d9eaf3-4348-400e-83d9-60a947c06d4c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:15.927108 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21d9eaf3-4348-400e-83d9-60a947c06d4c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:15.927752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21d9eaf3-4348-400e-83d9-60a947c06d4c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:15.928194 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21d9eaf3-4348-400e-83d9-60a947c06d4c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:16.127855 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-21d9eaf3-4348-400e-83d9-60a947c06d4c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:25:16.151923 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-21d9eaf3-4348-400e-83d9-60a947c06d4c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7" status: 200 len: 1569 microversion: 2.1 time: 0.239739 Sep 17 21:25:16.155154 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2890/5854] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:25:15 2022] GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7 => generated 1569 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:25:17.179855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2b4b627f-b716-417f-a068-45dee4c8d0a9 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:25:17.181066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2b4b627f-b716-417f-a068-45dee4c8d0a9 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 61f234b4-d902-48c0-a882-4c644c389ee7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:25:17.196551 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b4b627f-b716-417f-a068-45dee4c8d0a9 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:17.196997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b4b627f-b716-417f-a068-45dee4c8d0a9 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:17.197486 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b4b627f-b716-417f-a068-45dee4c8d0a9 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:17.198390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b4b627f-b716-417f-a068-45dee4c8d0a9 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:17.201587 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b4b627f-b716-417f-a068-45dee4c8d0a9 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:17.202048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b4b627f-b716-417f-a068-45dee4c8d0a9 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:17.559172 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2b4b627f-b716-417f-a068-45dee4c8d0a9 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:25:17.571102 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2b4b627f-b716-417f-a068-45dee4c8d0a9 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7" status: 200 len: 1569 microversion: 2.1 time: 0.395824 Sep 17 21:25:17.576149 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2965/5855] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:25:17 2022] GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7 => generated 1569 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:25:18.260260 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-8a23c7d7-024f-4bd1-b430-dc62f5f26532 req-d6c32a10-f4e9-4593-b4c5-7e4246880fcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61f234b4-d902-48c0-a882-4c644c389ee7", "name": "network-vif-deleted", "tag": "0d338dd4-eebb-4e8a-bbf6-af6f7cb3d1c6"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:25:18.287635 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8a23c7d7-024f-4bd1-b430-dc62f5f26532 req-d6c32a10-f4e9-4593-b4c5-7e4246880fcc service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:18.301733 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8a23c7d7-024f-4bd1-b430-dc62f5f26532 req-d6c32a10-f4e9-4593-b4c5-7e4246880fcc service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:18.302413 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8a23c7d7-024f-4bd1-b430-dc62f5f26532 req-d6c32a10-f4e9-4593-b4c5-7e4246880fcc service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:18.327192 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-8a23c7d7-024f-4bd1-b430-dc62f5f26532 req-d6c32a10-f4e9-4593-b4c5-7e4246880fcc service nova] Creating event network-vif-deleted:0d338dd4-eebb-4e8a-bbf6-af6f7cb3d1c6 for instance 61f234b4-d902-48c0-a882-4c644c389ee7 on nch2-master-1 Sep 17 21:25:18.334906 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-8a23c7d7-024f-4bd1-b430-dc62f5f26532 req-d6c32a10-f4e9-4593-b4c5-7e4246880fcc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080030 Sep 17 21:25:18.336235 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2891/5856] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:25:18.605584 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-23102a81-8969-482e-8b8d-44fac02be121 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:25:18.606897 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-23102a81-8969-482e-8b8d-44fac02be121 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 61f234b4-d902-48c0-a882-4c644c389ee7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:25:18.625870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23102a81-8969-482e-8b8d-44fac02be121 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:18.626449 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23102a81-8969-482e-8b8d-44fac02be121 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:18.626921 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23102a81-8969-482e-8b8d-44fac02be121 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:18.627791 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23102a81-8969-482e-8b8d-44fac02be121 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:18.630289 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23102a81-8969-482e-8b8d-44fac02be121 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:18.631724 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23102a81-8969-482e-8b8d-44fac02be121 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:18.811379 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-23102a81-8969-482e-8b8d-44fac02be121 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:25:18.832406 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-23102a81-8969-482e-8b8d-44fac02be121 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7" status: 200 len: 1360 microversion: 2.1 time: 0.234104 Sep 17 21:25:18.834136 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2966/5857] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:25:18 2022] GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7 => generated 1360 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:25:19.865506 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bcaab46a-35b1-49a0-81c7-b93aa85ab657 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:25:19.866671 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bcaab46a-35b1-49a0-81c7-b93aa85ab657 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 61f234b4-d902-48c0-a882-4c644c389ee7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:25:19.877392 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bcaab46a-35b1-49a0-81c7-b93aa85ab657 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:19.879146 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bcaab46a-35b1-49a0-81c7-b93aa85ab657 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:19.883304 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bcaab46a-35b1-49a0-81c7-b93aa85ab657 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:19.884087 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bcaab46a-35b1-49a0-81c7-b93aa85ab657 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:19.884582 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bcaab46a-35b1-49a0-81c7-b93aa85ab657 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:19.885015 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bcaab46a-35b1-49a0-81c7-b93aa85ab657 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:19.924047 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-bcaab46a-35b1-49a0-81c7-b93aa85ab657 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] HTTP exception thrown: Instance 61f234b4-d902-48c0-a882-4c644c389ee7 could not be found. Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bcaab46a-35b1-49a0-81c7-b93aa85ab657 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Request method failure captured: Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7 HTTP/1.1 Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjrvOiuthjFaTfhYt50z8pDXrt-HPwrf96uRwuVJ9ynjuC5bmjoCBf4y3MnbEYBpakcf75RXFUI631TlKrccQPyNjX9J3nTlRjiuxC83ZWT1CdEDSXZAvO47o2oB0JdJR88NFg3ylqlbHTdxn4s4t3eWhyXUxZZiXUGmNIvQFsnF9s0 Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: b99d2a0b4d7e40a38e682fc147e968af Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-TestVolumeBootPattern-747170341 Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b99d2a0b4d7e40a38e682fc147e968af", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-TestVolumeBootPattern-747170341 Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: b99d2a0b4d7e40a38e682fc147e968af Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-TestVolumeBootPattern-747170341 Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-TestVolumeBootPattern-747170341-project Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 342e60103c9b45bcb348b6f8bcd686ca Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-TestVolumeBootPattern-747170341-project Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 61f234b4-d902-48c0-a882-4c644c389ee7 could not be found. Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '61f234b4-d902-48c0-a882-4c644c389ee7'} Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61f234b4-d902-48c0-a882-4c644c389ee7 could not be found. Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61f234b4-d902-48c0-a882-4c644c389ee7 could not be found. Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:25:19.927427 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:25:19.934209 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:25:19.934209 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:25:19.934209 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:25:19.934209 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:25:19.934209 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:25:19.934209 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61f234b4-d902-48c0-a882-4c644c389ee7 could not be found. Sep 17 21:25:19.934209 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:25:19.935960 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bcaab46a-35b1-49a0-81c7-b93aa85ab657 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Returning 404 to user: Instance 61f234b4-d902-48c0-a882-4c644c389ee7 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:25:19.938449 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bcaab46a-35b1-49a0-81c7-b93aa85ab657 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7" status: 404 len: 111 microversion: 2.1 time: 0.080771 Sep 17 21:25:19.942839 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2892/5858] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:25:19 2022] GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:25:51.355058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5b8e37a3-4dcf-4597-ad94-46704d178e59 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:25:51.355758 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5b8e37a3-4dcf-4597-ad94-46704d178e59 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:25:51.363858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:25:51.365046 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:25:51.371136 ncdv-master-1 devstack@n-api.service[140524]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 17 21:25:51.389083 ncdv-master-1 devstack@n-api.service[140524]: Sat Sep 17 21:25:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe (ip 10.222.0.26) !!! Sep 17 21:25:51.391971 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b8e37a3-4dcf-4597-ad94-46704d178e59 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:51.392957 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b8e37a3-4dcf-4597-ad94-46704d178e59 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:51.393681 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b8e37a3-4dcf-4597-ad94-46704d178e59 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:51.394576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b8e37a3-4dcf-4597-ad94-46704d178e59 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:51.395205 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b8e37a3-4dcf-4597-ad94-46704d178e59 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:51.395829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5b8e37a3-4dcf-4597-ad94-46704d178e59 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:51.449943 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5b8e37a3-4dcf-4597-ad94-46704d178e59 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:25:51.624541 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5b8e37a3-4dcf-4597-ad94-46704d178e59 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe" status: 204 len: 0 microversion: 2.1 time: 0.273717 Sep 17 21:25:51.625814 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2967/5859] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:25:51 2022] DELETE /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:25:51.631954 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=11 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:25:51.633076 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=27 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:25:51.637725 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-49f3ef0c-03bd-47d1-9c78-cb5c1cfe1eb1 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:25:51.638452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-49f3ef0c-03bd-47d1-9c78-cb5c1cfe1eb1 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:25:51.651314 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49f3ef0c-03bd-47d1-9c78-cb5c1cfe1eb1 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:51.652108 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49f3ef0c-03bd-47d1-9c78-cb5c1cfe1eb1 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:51.652775 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49f3ef0c-03bd-47d1-9c78-cb5c1cfe1eb1 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:51.654544 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49f3ef0c-03bd-47d1-9c78-cb5c1cfe1eb1 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:51.657060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49f3ef0c-03bd-47d1-9c78-cb5c1cfe1eb1 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:51.657768 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49f3ef0c-03bd-47d1-9c78-cb5c1cfe1eb1 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:52.052788 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-49f3ef0c-03bd-47d1-9c78-cb5c1cfe1eb1 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:25:52.063508 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-49f3ef0c-03bd-47d1-9c78-cb5c1cfe1eb1 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe" status: 200 len: 1409 microversion: 2.1 time: 0.432815 Sep 17 21:25:52.064681 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2893/5860] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:25:51 2022] GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe => generated 1409 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:25:53.098937 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ed805d1d-3416-4daf-9de0-22a6fb6c8602 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:25:53.100601 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ed805d1d-3416-4daf-9de0-22a6fb6c8602 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:25:53.116587 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed805d1d-3416-4daf-9de0-22a6fb6c8602 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:53.117575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed805d1d-3416-4daf-9de0-22a6fb6c8602 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:53.118263 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed805d1d-3416-4daf-9de0-22a6fb6c8602 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:53.119259 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed805d1d-3416-4daf-9de0-22a6fb6c8602 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:53.119961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed805d1d-3416-4daf-9de0-22a6fb6c8602 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:53.120648 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed805d1d-3416-4daf-9de0-22a6fb6c8602 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:53.444319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ed805d1d-3416-4daf-9de0-22a6fb6c8602 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:25:53.454282 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ed805d1d-3416-4daf-9de0-22a6fb6c8602 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe" status: 200 len: 1409 microversion: 2.1 time: 0.364306 Sep 17 21:25:53.455640 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2968/5861] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:25:53 2022] GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe => generated 1409 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:25:54.487640 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8fb32e00-0c58-41d1-bb14-b65ddbd009fa tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:25:54.489110 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8fb32e00-0c58-41d1-bb14-b65ddbd009fa tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:25:54.508693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8fb32e00-0c58-41d1-bb14-b65ddbd009fa tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:54.512090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8fb32e00-0c58-41d1-bb14-b65ddbd009fa tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:54.513682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8fb32e00-0c58-41d1-bb14-b65ddbd009fa tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:54.517107 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8fb32e00-0c58-41d1-bb14-b65ddbd009fa tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:54.522126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8fb32e00-0c58-41d1-bb14-b65ddbd009fa tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:54.522949 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8fb32e00-0c58-41d1-bb14-b65ddbd009fa tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:55.446047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8fb32e00-0c58-41d1-bb14-b65ddbd009fa tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:25:55.463026 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8fb32e00-0c58-41d1-bb14-b65ddbd009fa tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe" status: 200 len: 1367 microversion: 2.1 time: 0.980264 Sep 17 21:25:55.465176 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2894/5862] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:25:54 2022] GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe => generated 1367 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:25:55.516196 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-0c9b6eae-e657-4e96-8d61-756ab01a79dc req-1b36ca0b-cfd7-4227-9033-a5ff3e243fa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe", "name": "network-vif-deleted", "tag": "32a6e8de-dd72-4be7-aa3b-50aa59a855b1"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:25:55.576536 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-0c9b6eae-e657-4e96-8d61-756ab01a79dc req-1b36ca0b-cfd7-4227-9033-a5ff3e243fa5 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:55.577408 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-0c9b6eae-e657-4e96-8d61-756ab01a79dc req-1b36ca0b-cfd7-4227-9033-a5ff3e243fa5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:55.578453 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-0c9b6eae-e657-4e96-8d61-756ab01a79dc req-1b36ca0b-cfd7-4227-9033-a5ff3e243fa5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:55.598594 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-0c9b6eae-e657-4e96-8d61-756ab01a79dc req-1b36ca0b-cfd7-4227-9033-a5ff3e243fa5 service nova] Creating event network-vif-deleted:32a6e8de-dd72-4be7-aa3b-50aa59a855b1 for instance ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe on nch1-master-1 Sep 17 21:25:55.605641 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-0c9b6eae-e657-4e96-8d61-756ab01a79dc req-1b36ca0b-cfd7-4227-9033-a5ff3e243fa5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098168 Sep 17 21:25:55.606976 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2969/5863] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:25:56.489280 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b748422f-cdd4-4c68-92d9-1e99fca67771 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:25:56.490966 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b748422f-cdd4-4c68-92d9-1e99fca67771 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:25:56.499679 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b748422f-cdd4-4c68-92d9-1e99fca67771 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:56.500392 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b748422f-cdd4-4c68-92d9-1e99fca67771 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:56.500997 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b748422f-cdd4-4c68-92d9-1e99fca67771 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:56.502010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b748422f-cdd4-4c68-92d9-1e99fca67771 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:56.502675 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b748422f-cdd4-4c68-92d9-1e99fca67771 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:56.504112 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b748422f-cdd4-4c68-92d9-1e99fca67771 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:56.586545 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b748422f-cdd4-4c68-92d9-1e99fca67771 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:56.587257 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b748422f-cdd4-4c68-92d9-1e99fca67771 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:56.587909 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b748422f-cdd4-4c68-92d9-1e99fca67771 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:56.589070 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-b748422f-cdd4-4c68-92d9-1e99fca67771 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lazy-loading 'fault' on Instance uuid ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:25:56.655415 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b748422f-cdd4-4c68-92d9-1e99fca67771 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:25:56.666187 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b748422f-cdd4-4c68-92d9-1e99fca67771 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe" status: 200 len: 1160 microversion: 2.1 time: 0.181018 Sep 17 21:25:56.667670 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2895/5864] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:25:56 2022] GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe => generated 1160 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:25:57.698301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-01bd44dd-8578-422f-b9ca-5790633b2b77 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:25:57.699682 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-01bd44dd-8578-422f-b9ca-5790633b2b77 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:25:57.707771 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-01bd44dd-8578-422f-b9ca-5790633b2b77 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:57.708506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-01bd44dd-8578-422f-b9ca-5790633b2b77 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:57.709279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-01bd44dd-8578-422f-b9ca-5790633b2b77 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:57.710236 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-01bd44dd-8578-422f-b9ca-5790633b2b77 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:57.710890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-01bd44dd-8578-422f-b9ca-5790633b2b77 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:57.711512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-01bd44dd-8578-422f-b9ca-5790633b2b77 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:57.730701 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-01bd44dd-8578-422f-b9ca-5790633b2b77 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] HTTP exception thrown: Instance ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe could not be found. Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-01bd44dd-8578-422f-b9ca-5790633b2b77 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Request method failure captured: Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe HTTP/1.1 Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjrvOiuthjFaTfhYt50z8pDXrt-HPwrf96uRwuVJ9ynjuC5bmjoCBf4y3MnbEYBpakcf75RXFUI631TlKrccQPyNjX9J3nTlRjiuxC83ZWT1CdEDSXZAvO47o2oB0JdJR88NFg3ylqlbHTdxn4s4t3eWhyXUxZZiXUGmNIvQFsnF9s0 Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: b99d2a0b4d7e40a38e682fc147e968af Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-TestVolumeBootPattern-747170341 Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b99d2a0b4d7e40a38e682fc147e968af", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-TestVolumeBootPattern-747170341 Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: b99d2a0b4d7e40a38e682fc147e968af Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-TestVolumeBootPattern-747170341 Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-TestVolumeBootPattern-747170341-project Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 342e60103c9b45bcb348b6f8bcd686ca Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-TestVolumeBootPattern-747170341-project Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe could not be found. Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe'} Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe could not be found. Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe could not be found. Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:25:57.733155 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:25:57.737014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:25:57.737014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:25:57.737014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:25:57.737014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:25:57.737014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:25:57.737014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe could not be found. Sep 17 21:25:57.737014 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:25:57.740483 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-01bd44dd-8578-422f-b9ca-5790633b2b77 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Returning 404 to user: Instance ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:25:57.741822 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-01bd44dd-8578-422f-b9ca-5790633b2b77 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe" status: 404 len: 111 microversion: 2.1 time: 0.051148 Sep 17 21:25:57.742869 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2970/5865] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:25:57 2022] GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:25:58.888269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-85fe9f8d-94ac-4fb8-930d-28c3b9499712 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:25:58.892699 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-11c0fd97-2e53-46a5-b56e-9e263609cf79 tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1435696691", "availability_zone": "foo_zone"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:25:58.894517 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-85fe9f8d-94ac-4fb8-930d-28c3b9499712 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 61f234b4-d902-48c0-a882-4c644c389ee7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:25:58.898133 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.aggregate [None req-11c0fd97-2e53-46a5-b56e-9e263609cf79 tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] Generated uuid 67a419e4-b6a6-4ac6-8229-d7a1181ff30c for aggregate {{(pid=140523) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 17 21:25:58.906090 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85fe9f8d-94ac-4fb8-930d-28c3b9499712 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:58.908381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85fe9f8d-94ac-4fb8-930d-28c3b9499712 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:58.909267 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85fe9f8d-94ac-4fb8-930d-28c3b9499712 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:58.910687 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85fe9f8d-94ac-4fb8-930d-28c3b9499712 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:58.913160 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85fe9f8d-94ac-4fb8-930d-28c3b9499712 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:58.913954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85fe9f8d-94ac-4fb8-930d-28c3b9499712 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:58.931062 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-85fe9f8d-94ac-4fb8-930d-28c3b9499712 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] HTTP exception thrown: Instance 61f234b4-d902-48c0-a882-4c644c389ee7 could not be found. Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-85fe9f8d-94ac-4fb8-930d-28c3b9499712 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Request method failure captured: Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7 HTTP/1.1 Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjrvOiuthjFaTfhYt50z8pDXrt-HPwrf96uRwuVJ9ynjuC5bmjoCBf4y3MnbEYBpakcf75RXFUI631TlKrccQPyNjX9J3nTlRjiuxC83ZWT1CdEDSXZAvO47o2oB0JdJR88NFg3ylqlbHTdxn4s4t3eWhyXUxZZiXUGmNIvQFsnF9s0 Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: b99d2a0b4d7e40a38e682fc147e968af Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-TestVolumeBootPattern-747170341 Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b99d2a0b4d7e40a38e682fc147e968af", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-TestVolumeBootPattern-747170341 Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: b99d2a0b4d7e40a38e682fc147e968af Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-TestVolumeBootPattern-747170341 Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-TestVolumeBootPattern-747170341-project Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 342e60103c9b45bcb348b6f8bcd686ca Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-TestVolumeBootPattern-747170341-project Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 61f234b4-d902-48c0-a882-4c644c389ee7 could not be found. Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '61f234b4-d902-48c0-a882-4c644c389ee7'} Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61f234b4-d902-48c0-a882-4c644c389ee7 could not be found. Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:25:58.933361 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:25:58.937103 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61f234b4-d902-48c0-a882-4c644c389ee7 could not be found. Sep 17 21:25:58.937103 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:25:58.937103 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:25:58.937103 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:25:58.937103 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:25:58.937103 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:25:58.937103 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:25:58.937103 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:25:58.937103 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:25:58.937103 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61f234b4-d902-48c0-a882-4c644c389ee7 could not be found. Sep 17 21:25:58.937103 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:25:58.940684 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-11c0fd97-2e53-46a5-b56e-9e263609cf79 tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.121680 Sep 17 21:25:58.941904 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2896/5866] 10.222.0.26 () {60 vars in 1164 bytes} [Sat Sep 17 21:25:58 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:25:58.948193 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-85fe9f8d-94ac-4fb8-930d-28c3b9499712 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Returning 404 to user: Instance 61f234b4-d902-48c0-a882-4c644c389ee7 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:25:58.948193 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-85fe9f8d-94ac-4fb8-930d-28c3b9499712 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "DELETE /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7" status: 404 len: 111 microversion: 2.1 time: 0.061247 Sep 17 21:25:58.948193 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2971/5867] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:25:58 2022] DELETE /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:25:58.953509 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c4d8cecd-de74-4bc2-b0f6-7234dfe07407 tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:25:58.953833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a8b3945c-6831-42e5-95e3-56c4c7a2fc1c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:25:58.954483 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a8b3945c-6831-42e5-95e3-56c4c7a2fc1c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 61f234b4-d902-48c0-a882-4c644c389ee7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:25:58.961002 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8b3945c-6831-42e5-95e3-56c4c7a2fc1c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:58.961609 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8b3945c-6831-42e5-95e3-56c4c7a2fc1c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:58.962277 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8b3945c-6831-42e5-95e3-56c4c7a2fc1c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:58.962922 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8b3945c-6831-42e5-95e3-56c4c7a2fc1c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:58.963406 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8b3945c-6831-42e5-95e3-56c4c7a2fc1c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:58.963858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8b3945c-6831-42e5-95e3-56c4c7a2fc1c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-a8b3945c-6831-42e5-95e3-56c4c7a2fc1c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] HTTP exception thrown: Instance 61f234b4-d902-48c0-a882-4c644c389ee7 could not be found. Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a8b3945c-6831-42e5-95e3-56c4c7a2fc1c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Request method failure captured: Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7 HTTP/1.1 Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjrvOiuthjFaTfhYt50z8pDXrt-HPwrf96uRwuVJ9ynjuC5bmjoCBf4y3MnbEYBpakcf75RXFUI631TlKrccQPyNjX9J3nTlRjiuxC83ZWT1CdEDSXZAvO47o2oB0JdJR88NFg3ylqlbHTdxn4s4t3eWhyXUxZZiXUGmNIvQFsnF9s0 Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: b99d2a0b4d7e40a38e682fc147e968af Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-TestVolumeBootPattern-747170341 Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b99d2a0b4d7e40a38e682fc147e968af", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-TestVolumeBootPattern-747170341 Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: b99d2a0b4d7e40a38e682fc147e968af Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-TestVolumeBootPattern-747170341 Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-TestVolumeBootPattern-747170341-project Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 342e60103c9b45bcb348b6f8bcd686ca Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-TestVolumeBootPattern-747170341-project Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 61f234b4-d902-48c0-a882-4c644c389ee7 could not be found. Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '61f234b4-d902-48c0-a882-4c644c389ee7'} Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61f234b4-d902-48c0-a882-4c644c389ee7 could not be found. Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:25:58.984263 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:25:58.991988 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61f234b4-d902-48c0-a882-4c644c389ee7 could not be found. Sep 17 21:25:58.991988 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:25:58.991988 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:25:58.991988 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:25:58.991988 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:25:58.991988 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:25:58.991988 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:25:58.991988 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:25:58.991988 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:25:58.991988 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61f234b4-d902-48c0-a882-4c644c389ee7 could not be found. Sep 17 21:25:58.991988 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:25:58.991988 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a8b3945c-6831-42e5-95e3-56c4c7a2fc1c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Returning 404 to user: Instance 61f234b4-d902-48c0-a882-4c644c389ee7 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:25:58.991988 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a8b3945c-6831-42e5-95e3-56c4c7a2fc1c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7" status: 404 len: 111 microversion: 2.1 time: 0.036454 Sep 17 21:25:59.002606 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c4d8cecd-de74-4bc2-b0f6-7234dfe07407 tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.050052 Sep 17 21:25:59.003833 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2897/5868] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Sep 17 21:25:58 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:25:59.005760 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2972/5869] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:25:58 2022] GET /compute/v2.1/servers/61f234b4-d902-48c0-a882-4c644c389ee7 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 21:25:59.041038 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9c06ab18-1709-4981-bddd-ec3302f70ad7 tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:25:59.046998 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9c06ab18-1709-4981-bddd-ec3302f70ad7 tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:59.047704 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9c06ab18-1709-4981-bddd-ec3302f70ad7 tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:59.048398 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9c06ab18-1709-4981-bddd-ec3302f70ad7 tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:59.049268 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9c06ab18-1709-4981-bddd-ec3302f70ad7 tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:59.049795 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9c06ab18-1709-4981-bddd-ec3302f70ad7 tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:59.050632 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9c06ab18-1709-4981-bddd-ec3302f70ad7 tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:59.098052 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9c06ab18-1709-4981-bddd-ec3302f70ad7 tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.070566 Sep 17 21:25:59.102013 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2898/5870] 10.222.0.26 () {58 vars in 1176 bytes} [Sat Sep 17 21:25:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:25:59.113666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d5d06f87-18bf-4bbc-9662-c21a56576fa9 tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:25:59.122098 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d5d06f87-18bf-4bbc-9662-c21a56576fa9 tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.012294 Sep 17 21:25:59.123281 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2973/5871] 10.222.0.26 () {58 vars in 1143 bytes} [Sat Sep 17 21:25:59 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:25:59.135587 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-789cd465-55dd-4fe2-b30d-9decc078189a tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch2-master-1"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:25:59.153952 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-789cd465-55dd-4fe2-b30d-9decc078189a tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:59.155085 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-789cd465-55dd-4fe2-b30d-9decc078189a tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:59.155612 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-789cd465-55dd-4fe2-b30d-9decc078189a tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:59.468798 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-789cd465-55dd-4fe2-b30d-9decc078189a tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.337215 Sep 17 21:25:59.475560 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2899/5872] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Sep 17 21:25:59 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:25:59.480849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e633b9f8-770f-4afd-8b1a-384388c45202 tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:25:59.489247 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e633b9f8-770f-4afd-8b1a-384388c45202 tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.012218 Sep 17 21:25:59.490272 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2974/5873] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Sep 17 21:25:59 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:25:59.502587 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-97f1ee31-1622-427f-be8b-0e0726550a0b tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-704564012", "availability_zone": "foo_zone"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:25:59.564968 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-97f1ee31-1622-427f-be8b-0e0726550a0b tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.066631 Sep 17 21:25:59.565709 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2900/5874] 10.222.0.26 () {60 vars in 1173 bytes} [Sat Sep 17 21:25:59 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:25:59.576954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-563b362a-bc54-44d8-9a7c-cabeb9888911 tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:25:59.611663 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-563b362a-bc54-44d8-9a7c-cabeb9888911 tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.038355 Sep 17 21:25:59.623989 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-23803343-a7c3-447e-9a19-0cf19d182124 tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:25:59.624528 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2975/5875] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Sep 17 21:25:59 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:25:59.644905 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e83a6d89-6278-4dbd-9b0f-130bc1ca85f7 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:25:59.645523 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e83a6d89-6278-4dbd-9b0f-130bc1ca85f7 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:25:59.651783 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-23803343-a7c3-447e-9a19-0cf19d182124 tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.031628 Sep 17 21:25:59.653138 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2901/5876] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Sep 17 21:25:59 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:25:59.654621 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e83a6d89-6278-4dbd-9b0f-130bc1ca85f7 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:59.655140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e83a6d89-6278-4dbd-9b0f-130bc1ca85f7 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:59.655600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e83a6d89-6278-4dbd-9b0f-130bc1ca85f7 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:59.656330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e83a6d89-6278-4dbd-9b0f-130bc1ca85f7 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:59.656806 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e83a6d89-6278-4dbd-9b0f-130bc1ca85f7 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:59.657251 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e83a6d89-6278-4dbd-9b0f-130bc1ca85f7 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:59.666021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ecb49905-d991-4acc-b4a1-f2e792eb6497 tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch2-master-1"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:25:59.672700 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-e83a6d89-6278-4dbd-9b0f-130bc1ca85f7 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] HTTP exception thrown: Instance ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe could not be found. Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e83a6d89-6278-4dbd-9b0f-130bc1ca85f7 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Request method failure captured: Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe HTTP/1.1 Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjrvOiuthjFaTfhYt50z8pDXrt-HPwrf96uRwuVJ9ynjuC5bmjoCBf4y3MnbEYBpakcf75RXFUI631TlKrccQPyNjX9J3nTlRjiuxC83ZWT1CdEDSXZAvO47o2oB0JdJR88NFg3ylqlbHTdxn4s4t3eWhyXUxZZiXUGmNIvQFsnF9s0 Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: b99d2a0b4d7e40a38e682fc147e968af Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-TestVolumeBootPattern-747170341 Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b99d2a0b4d7e40a38e682fc147e968af", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-TestVolumeBootPattern-747170341 Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: b99d2a0b4d7e40a38e682fc147e968af Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-TestVolumeBootPattern-747170341 Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-TestVolumeBootPattern-747170341-project Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 342e60103c9b45bcb348b6f8bcd686ca Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-TestVolumeBootPattern-747170341-project Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe could not be found. Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe'} Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe could not be found. Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:25:59.674699 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:25:59.678128 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe could not be found. Sep 17 21:25:59.678128 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:25:59.678128 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:25:59.678128 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:25:59.678128 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:25:59.678128 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:25:59.678128 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:25:59.678128 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:25:59.678128 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:25:59.678128 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe could not be found. Sep 17 21:25:59.678128 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:25:59.679450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ecb49905-d991-4acc-b4a1-f2e792eb6497 tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:59.679450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ecb49905-d991-4acc-b4a1-f2e792eb6497 tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:59.679450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ecb49905-d991-4acc-b4a1-f2e792eb6497 tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:59.679846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e83a6d89-6278-4dbd-9b0f-130bc1ca85f7 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Returning 404 to user: Instance ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:25:59.679846 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e83a6d89-6278-4dbd-9b0f-130bc1ca85f7 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe" status: 404 len: 111 microversion: 2.1 time: 0.041664 Sep 17 21:25:59.680374 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2976/5877] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:25:59 2022] DELETE /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:25:59.690770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7f297ebb-d964-4023-81f6-8a3412ba34f0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:25:59.691416 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7f297ebb-d964-4023-81f6-8a3412ba34f0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:25:59.698662 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7f297ebb-d964-4023-81f6-8a3412ba34f0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:59.699171 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7f297ebb-d964-4023-81f6-8a3412ba34f0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:59.699630 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7f297ebb-d964-4023-81f6-8a3412ba34f0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:59.700358 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7f297ebb-d964-4023-81f6-8a3412ba34f0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:25:59.700857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7f297ebb-d964-4023-81f6-8a3412ba34f0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:25:59.701300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7f297ebb-d964-4023-81f6-8a3412ba34f0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:25:59.719922 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-7f297ebb-d964-4023-81f6-8a3412ba34f0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] HTTP exception thrown: Instance ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe could not be found. Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7f297ebb-d964-4023-81f6-8a3412ba34f0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Request method failure captured: Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe HTTP/1.1 Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjrvOiuthjFaTfhYt50z8pDXrt-HPwrf96uRwuVJ9ynjuC5bmjoCBf4y3MnbEYBpakcf75RXFUI631TlKrccQPyNjX9J3nTlRjiuxC83ZWT1CdEDSXZAvO47o2oB0JdJR88NFg3ylqlbHTdxn4s4t3eWhyXUxZZiXUGmNIvQFsnF9s0 Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: b99d2a0b4d7e40a38e682fc147e968af Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-TestVolumeBootPattern-747170341 Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b99d2a0b4d7e40a38e682fc147e968af", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-TestVolumeBootPattern-747170341 Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: b99d2a0b4d7e40a38e682fc147e968af Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-TestVolumeBootPattern-747170341 Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-TestVolumeBootPattern-747170341-project Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 342e60103c9b45bcb348b6f8bcd686ca Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-TestVolumeBootPattern-747170341-project Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe could not be found. Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe'} Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe could not be found. Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe could not be found. Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:25:59.721942 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:25:59.725554 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:25:59.725554 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:25:59.725554 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:25:59.725554 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:25:59.725554 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:25:59.725554 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe could not be found. Sep 17 21:25:59.725554 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:25:59.728105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7f297ebb-d964-4023-81f6-8a3412ba34f0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Returning 404 to user: Instance ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:25:59.729663 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7f297ebb-d964-4023-81f6-8a3412ba34f0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe" status: 404 len: 111 microversion: 2.1 time: 0.042882 Sep 17 21:25:59.730744 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2977/5878] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:25:59 2022] GET /compute/v2.1/servers/ed64bf8c-a1b6-4f9f-87d2-b8a251e9fafe => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:25:59.848304 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-056e4297-78b2-404b-a02f-c5ffa3df9b74 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Action: 'create', calling method: .version_select at 0x7f25a418c1f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1399000875", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQS0coUwSvCNJENcK12YjQRBXPoi2HpYQEEXvja5V2Lhh42dsUqjPIM+7zoeMuqEqz/g4rAoxJ0CToOcRQ9bHGwQvaM7aB7i16nRd4y4GdA4pWyXoc5p5XnRAGxiN3tjw=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:25:59.865359 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ecb49905-d991-4acc-b4a1-f2e792eb6497 tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.204004 Sep 17 21:25:59.866074 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2902/5879] 10.222.0.26 () {60 vars in 1194 bytes} [Sat Sep 17 21:25:59 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:25:59.878020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f175695c-765d-4340-9920-9c66fc6c01d9 tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:25:59.886343 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-056e4297-78b2-404b-a02f-c5ffa3df9b74 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Getting quotas for project b99d2a0b4d7e40a38e682fc147e968af. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:25:59.895511 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-056e4297-78b2-404b-a02f-c5ffa3df9b74 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Getting quotas for user 342e60103c9b45bcb348b6f8bcd686ca and project b99d2a0b4d7e40a38e682fc147e968af. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:25:59.910809 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f175695c-765d-4340-9920-9c66fc6c01d9 tempest-TestAggregatesBasicOps-842654813 tempest-TestAggregatesBasicOps-842654813-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.036961 Sep 17 21:25:59.916361 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2903/5880] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Sep 17 21:25:59 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 17 21:25:59.958256 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-056e4297-78b2-404b-a02f-c5ffa3df9b74 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.117853 Sep 17 21:25:59.959176 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2978/5881] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:25:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:26:05.774120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b6dbf603-b60b-4575-86ad-d339834958c8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2056398153", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1399000875", "security_groups": [{"name": "tempest-secgroup-smoke-1270477296"}], "block_device_mapping_v2": [{"uuid": "43df5366-32dd-4c44-ad36-15410ac6ac72", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "277ba9f5-743a-4949-b45f-d5582af5f04e"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:26:05.946648 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-b6dbf603-b60b-4575-86ad-d339834958c8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] validate_networks() for [('277ba9f5-743a-4949-b45f-d5582af5f04e', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:26:06.425705 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-b6dbf603-b60b-4575-86ad-d339834958c8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:26:06.426261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-b6dbf603-b60b-4575-86ad-d339834958c8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:26:06.426746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-b6dbf603-b60b-4575-86ad-d339834958c8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:26:06.427163 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-b6dbf603-b60b-4575-86ad-d339834958c8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:26:06.427588 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-b6dbf603-b60b-4575-86ad-d339834958c8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:26:06.437486 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6dbf603-b60b-4575-86ad-d339834958c8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:06.438011 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6dbf603-b60b-4575-86ad-d339834958c8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:06.438456 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6dbf603-b60b-4575-86ad-d339834958c8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:06.439266 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6dbf603-b60b-4575-86ad-d339834958c8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:06.439923 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6dbf603-b60b-4575-86ad-d339834958c8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:06.440552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6dbf603-b60b-4575-86ad-d339834958c8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:06.458624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-b6dbf603-b60b-4575-86ad-d339834958c8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Getting quotas for project b99d2a0b4d7e40a38e682fc147e968af. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:26:06.464393 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-b6dbf603-b60b-4575-86ad-d339834958c8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Getting quotas for user 342e60103c9b45bcb348b6f8bcd686ca and project b99d2a0b4d7e40a38e682fc147e968af. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:26:06.539364 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b6dbf603-b60b-4575-86ad-d339834958c8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:26:06.541563 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b6dbf603-b60b-4575-86ad-d339834958c8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='43df5366-32dd-4c44-ad36-15410ac6ac72',volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:26:06.699159 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b6dbf603-b60b-4575-86ad-d339834958c8 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.930993 Sep 17 21:26:06.699831 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2904/5882] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:26:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:26:06.712793 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1e7dda9b-70f0-461e-8789-e8663da5861e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:06.713433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1e7dda9b-70f0-461e-8789-e8663da5861e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:06.869351 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1e7dda9b-70f0-461e-8789-e8663da5861e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:06.877208 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1e7dda9b-70f0-461e-8789-e8663da5861e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec" status: 200 len: 1095 microversion: 2.1 time: 0.169363 Sep 17 21:26:06.878846 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2979/5883] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:06 2022] GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec => generated 1095 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:26:07.356971 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-268b4726-3489-4567-8039-56fe449b13c4 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Action: 'create', calling method: .version_select at 0x7f25a4f6bb80>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1973280609", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAvujGhMKLMp1wGv+VVR9aQZ8GvPTM3Iz1V34bSB98TzDGVjudZ1pVek6TLfy8lap4wLEF7C13jcsaU0qmLRtRy7jH8HAC7yelzSIk3PJzCLwAb/gD6ePgMLYtM52MpYg=="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:26:07.377099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-268b4726-3489-4567-8039-56fe449b13c4 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Getting quotas for project 6e1785b5f4714605b2a35e03c123d54d. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:26:07.384119 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-268b4726-3489-4567-8039-56fe449b13c4 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Getting quotas for user 23df9a93a08b41f9b3573c1e6a85e60e and project 6e1785b5f4714605b2a35e03c123d54d. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:26:07.411719 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-268b4726-3489-4567-8039-56fe449b13c4 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.059887 Sep 17 21:26:07.412623 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2905/5884] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:26:07 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:26:07.902085 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-415511e3-71b6-404a-a172-faba77b583a2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:07.902717 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-415511e3-71b6-404a-a172-faba77b583a2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:07.913950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-415511e3-71b6-404a-a172-faba77b583a2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:07.926327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-415511e3-71b6-404a-a172-faba77b583a2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:07.927086 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-415511e3-71b6-404a-a172-faba77b583a2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:07.927868 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-415511e3-71b6-404a-a172-faba77b583a2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:07.928502 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-415511e3-71b6-404a-a172-faba77b583a2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:07.929119 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-415511e3-71b6-404a-a172-faba77b583a2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:08.023442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-415511e3-71b6-404a-a172-faba77b583a2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:08.034385 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-415511e3-71b6-404a-a172-faba77b583a2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec" status: 200 len: 1211 microversion: 2.1 time: 0.136150 Sep 17 21:26:08.045830 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2980/5885] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:07 2022] GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec => generated 1211 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:26:08.916859 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4f5b5fcc-5605-43c8-8f02-53038a09729b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1195710527", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "bdf805c4-767e-4378-a2eb-85d92fa21105", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1973280609", "security_groups": [{"name": "tempest-secgroup-smoke-1371900674"}], "networks": [{"uuid": "120b4a75-ff10-4463-be01-86df9c5e26ba"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:26:09.061755 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-19b37054-7fb7-4354-8e1f-08e612188ac2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:09.063142 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-19b37054-7fb7-4354-8e1f-08e612188ac2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:09.082190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-19b37054-7fb7-4354-8e1f-08e612188ac2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:09.082715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-19b37054-7fb7-4354-8e1f-08e612188ac2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:09.083480 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-19b37054-7fb7-4354-8e1f-08e612188ac2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:09.086256 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-4f5b5fcc-5605-43c8-8f02-53038a09729b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] validate_networks() for [('120b4a75-ff10-4463-be01-86df9c5e26ba', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:26:09.086576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-19b37054-7fb7-4354-8e1f-08e612188ac2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:09.087987 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-19b37054-7fb7-4354-8e1f-08e612188ac2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:09.088519 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-19b37054-7fb7-4354-8e1f-08e612188ac2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:09.425896 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-19b37054-7fb7-4354-8e1f-08e612188ac2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:09.439043 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-19b37054-7fb7-4354-8e1f-08e612188ac2 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec" status: 200 len: 1279 microversion: 2.1 time: 0.383902 Sep 17 21:26:09.459339 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2981/5886] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:09 2022] GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec => generated 1279 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:26:09.759984 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-4f5b5fcc-5605-43c8-8f02-53038a09729b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:26:09.760445 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-4f5b5fcc-5605-43c8-8f02-53038a09729b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:26:09.760939 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-4f5b5fcc-5605-43c8-8f02-53038a09729b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:26:09.761350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-4f5b5fcc-5605-43c8-8f02-53038a09729b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:26:09.761811 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-4f5b5fcc-5605-43c8-8f02-53038a09729b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:26:09.770870 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f5b5fcc-5605-43c8-8f02-53038a09729b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:09.771302 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f5b5fcc-5605-43c8-8f02-53038a09729b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:09.771749 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f5b5fcc-5605-43c8-8f02-53038a09729b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:09.772495 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f5b5fcc-5605-43c8-8f02-53038a09729b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:09.772957 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f5b5fcc-5605-43c8-8f02-53038a09729b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:09.773418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f5b5fcc-5605-43c8-8f02-53038a09729b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:09.785270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=8,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:26:09.792522 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-4f5b5fcc-5605-43c8-8f02-53038a09729b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Getting quotas for project 6e1785b5f4714605b2a35e03c123d54d. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:26:09.798953 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-4f5b5fcc-5605-43c8-8f02-53038a09729b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Getting quotas for user 23df9a93a08b41f9b3573c1e6a85e60e and project 6e1785b5f4714605b2a35e03c123d54d. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:26:09.860876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4f5b5fcc-5605-43c8-8f02-53038a09729b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:26:09.863147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4f5b5fcc-5605-43c8-8f02-53038a09729b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] [instance: b0a4b2da-c517-417d-8901-cbe5033e28d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bdf805c4-767e-4378-a2eb-85d92fa21105',volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:26:10.042503 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4f5b5fcc-5605-43c8-8f02-53038a09729b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.129930 Sep 17 21:26:10.047014 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2906/5887] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:26:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1135 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:26:10.057450 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-26347f90-f37f-412e-be8e-a5131fb0e470 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:10.058113 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-26347f90-f37f-412e-be8e-a5131fb0e470 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] [instance: b0a4b2da-c517-417d-8901-cbe5033e28d7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:10.461508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-26347f90-f37f-412e-be8e-a5131fb0e470 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9a93a08b41f9b3573c1e6a85e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1785b5f4714605b2a35e03c123d54d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:10.468188 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dd8d7071-5d6d-437b-b059-ffc4d5ac4350 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:10.468906 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dd8d7071-5d6d-437b-b059-ffc4d5ac4350 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:10.469271 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-26347f90-f37f-412e-be8e-a5131fb0e470 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] 10.222.0.26 "GET /compute/v2.1/servers/b0a4b2da-c517-417d-8901-cbe5033e28d7" status: 200 len: 1099 microversion: 2.1 time: 0.415914 Sep 17 21:26:10.469915 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2982/5888] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:10 2022] GET /compute/v2.1/servers/b0a4b2da-c517-417d-8901-cbe5033e28d7 => generated 1099 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:26:10.490916 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd8d7071-5d6d-437b-b059-ffc4d5ac4350 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:10.491548 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd8d7071-5d6d-437b-b059-ffc4d5ac4350 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:10.493079 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd8d7071-5d6d-437b-b059-ffc4d5ac4350 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:10.495472 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd8d7071-5d6d-437b-b059-ffc4d5ac4350 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:10.496443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd8d7071-5d6d-437b-b059-ffc4d5ac4350 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:10.497808 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd8d7071-5d6d-437b-b059-ffc4d5ac4350 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:10.515619 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-683dccc4-5c32-4c54-963f-87b6a60e8347 req-f13241f8-b294-4365-a6fb-e627d76e4a2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24e01588-ddb5-4c16-bd5a-dd6988b0d3ec", "tag": "8d2fb4fb-9253-4202-b576-2aced08f4489"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:26:10.530036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-683dccc4-5c32-4c54-963f-87b6a60e8347 req-f13241f8-b294-4365-a6fb-e627d76e4a2e service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:10.530826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-683dccc4-5c32-4c54-963f-87b6a60e8347 req-f13241f8-b294-4365-a6fb-e627d76e4a2e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:10.531433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-683dccc4-5c32-4c54-963f-87b6a60e8347 req-f13241f8-b294-4365-a6fb-e627d76e4a2e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:10.544123 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-683dccc4-5c32-4c54-963f-87b6a60e8347 req-f13241f8-b294-4365-a6fb-e627d76e4a2e service nova] Creating event network-changed:8d2fb4fb-9253-4202-b576-2aced08f4489 for instance 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec on nch1-master-1 Sep 17 21:26:10.551058 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-683dccc4-5c32-4c54-963f-87b6a60e8347 req-f13241f8-b294-4365-a6fb-e627d76e4a2e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039261 Sep 17 21:26:10.552463 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2983/5889] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:26:10.801984 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dd8d7071-5d6d-437b-b059-ffc4d5ac4350 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:10.812642 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dd8d7071-5d6d-437b-b059-ffc4d5ac4350 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec" status: 200 len: 1267 microversion: 2.1 time: 0.349694 Sep 17 21:26:10.826588 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2907/5890] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:10 2022] GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec => generated 1267 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:26:11.495634 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-556dcd4c-97e1-41b3-bcb0-dcd187c6b662 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:11.496442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-556dcd4c-97e1-41b3-bcb0-dcd187c6b662 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] [instance: b0a4b2da-c517-417d-8901-cbe5033e28d7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:11.510506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-556dcd4c-97e1-41b3-bcb0-dcd187c6b662 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:11.510940 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-556dcd4c-97e1-41b3-bcb0-dcd187c6b662 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:11.511671 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-556dcd4c-97e1-41b3-bcb0-dcd187c6b662 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:11.512415 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-556dcd4c-97e1-41b3-bcb0-dcd187c6b662 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:11.512891 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-556dcd4c-97e1-41b3-bcb0-dcd187c6b662 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:11.513341 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-556dcd4c-97e1-41b3-bcb0-dcd187c6b662 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:11.638887 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-556dcd4c-97e1-41b3-bcb0-dcd187c6b662 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9a93a08b41f9b3573c1e6a85e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1785b5f4714605b2a35e03c123d54d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:11.649830 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-556dcd4c-97e1-41b3-bcb0-dcd187c6b662 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] 10.222.0.26 "GET /compute/v2.1/servers/b0a4b2da-c517-417d-8901-cbe5033e28d7" status: 200 len: 1215 microversion: 2.1 time: 0.160546 Sep 17 21:26:11.650998 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2984/5891] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:11 2022] GET /compute/v2.1/servers/b0a4b2da-c517-417d-8901-cbe5033e28d7 => generated 1215 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:26:11.837979 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2ec05801-af16-4fe1-a97e-dadff6e3bcd1 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:11.838594 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2ec05801-af16-4fe1-a97e-dadff6e3bcd1 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:11.845525 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ec05801-af16-4fe1-a97e-dadff6e3bcd1 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:11.846154 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ec05801-af16-4fe1-a97e-dadff6e3bcd1 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:11.846600 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ec05801-af16-4fe1-a97e-dadff6e3bcd1 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:11.847312 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ec05801-af16-4fe1-a97e-dadff6e3bcd1 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:11.847767 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ec05801-af16-4fe1-a97e-dadff6e3bcd1 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:11.848195 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ec05801-af16-4fe1-a97e-dadff6e3bcd1 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:12.022653 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2ec05801-af16-4fe1-a97e-dadff6e3bcd1 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:12.033627 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2ec05801-af16-4fe1-a97e-dadff6e3bcd1 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec" status: 200 len: 1267 microversion: 2.1 time: 0.199234 Sep 17 21:26:12.034492 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2908/5892] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:11 2022] GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec => generated 1267 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:26:12.676152 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a73cb25a-6d89-4737-8afb-aa9fda19ae71 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:12.678040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a73cb25a-6d89-4737-8afb-aa9fda19ae71 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] [instance: b0a4b2da-c517-417d-8901-cbe5033e28d7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:12.690726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a73cb25a-6d89-4737-8afb-aa9fda19ae71 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:12.691578 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a73cb25a-6d89-4737-8afb-aa9fda19ae71 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:12.692298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a73cb25a-6d89-4737-8afb-aa9fda19ae71 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:12.696121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a73cb25a-6d89-4737-8afb-aa9fda19ae71 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:12.696682 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a73cb25a-6d89-4737-8afb-aa9fda19ae71 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:12.697250 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a73cb25a-6d89-4737-8afb-aa9fda19ae71 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:12.910506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a73cb25a-6d89-4737-8afb-aa9fda19ae71 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9a93a08b41f9b3573c1e6a85e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1785b5f4714605b2a35e03c123d54d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:12.919649 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a73cb25a-6d89-4737-8afb-aa9fda19ae71 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] 10.222.0.26 "GET /compute/v2.1/servers/b0a4b2da-c517-417d-8901-cbe5033e28d7" status: 200 len: 1283 microversion: 2.1 time: 0.249147 Sep 17 21:26:12.920558 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2985/5893] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:12 2022] GET /compute/v2.1/servers/b0a4b2da-c517-417d-8901-cbe5033e28d7 => generated 1283 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:26:13.056849 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a8b7badc-8f86-4f93-8516-97e16040a256 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:13.057714 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a8b7badc-8f86-4f93-8516-97e16040a256 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:13.066289 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a8b7badc-8f86-4f93-8516-97e16040a256 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:13.066858 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a8b7badc-8f86-4f93-8516-97e16040a256 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:13.067383 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a8b7badc-8f86-4f93-8516-97e16040a256 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:13.068201 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a8b7badc-8f86-4f93-8516-97e16040a256 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:13.068735 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a8b7badc-8f86-4f93-8516-97e16040a256 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:13.069396 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a8b7badc-8f86-4f93-8516-97e16040a256 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:13.234731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a8b7badc-8f86-4f93-8516-97e16040a256 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:13.243932 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a8b7badc-8f86-4f93-8516-97e16040a256 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec" status: 200 len: 1267 microversion: 2.1 time: 0.191033 Sep 17 21:26:13.259896 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2909/5894] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:13 2022] GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec => generated 1267 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:26:13.829312 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-c6e353ac-e7dd-4c7a-be22-683bfae93f19 req-9b6d96f5-295c-49c0-825d-d48eab216e79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0a4b2da-c517-417d-8901-cbe5033e28d7", "tag": "8648a291-058c-47d2-8ccb-575b1f6dea9c"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:26:13.845049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c6e353ac-e7dd-4c7a-be22-683bfae93f19 req-9b6d96f5-295c-49c0-825d-d48eab216e79 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:13.846350 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c6e353ac-e7dd-4c7a-be22-683bfae93f19 req-9b6d96f5-295c-49c0-825d-d48eab216e79 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:13.846992 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c6e353ac-e7dd-4c7a-be22-683bfae93f19 req-9b6d96f5-295c-49c0-825d-d48eab216e79 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:13.859377 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-c6e353ac-e7dd-4c7a-be22-683bfae93f19 req-9b6d96f5-295c-49c0-825d-d48eab216e79 service nova] Creating event network-changed:8648a291-058c-47d2-8ccb-575b1f6dea9c for instance b0a4b2da-c517-417d-8901-cbe5033e28d7 on nch2-master-1 Sep 17 21:26:13.864797 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-c6e353ac-e7dd-4c7a-be22-683bfae93f19 req-9b6d96f5-295c-49c0-825d-d48eab216e79 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038960 Sep 17 21:26:13.865810 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2986/5895] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:26:13.944916 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7c2425e1-0729-41d3-b8b9-ed2d1c8a0c0d tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:13.946375 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7c2425e1-0729-41d3-b8b9-ed2d1c8a0c0d tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] [instance: b0a4b2da-c517-417d-8901-cbe5033e28d7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:13.954223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7c2425e1-0729-41d3-b8b9-ed2d1c8a0c0d tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:13.954934 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7c2425e1-0729-41d3-b8b9-ed2d1c8a0c0d tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:13.955645 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7c2425e1-0729-41d3-b8b9-ed2d1c8a0c0d tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:13.956621 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7c2425e1-0729-41d3-b8b9-ed2d1c8a0c0d tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:13.957615 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7c2425e1-0729-41d3-b8b9-ed2d1c8a0c0d tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:13.958254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7c2425e1-0729-41d3-b8b9-ed2d1c8a0c0d tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:14.101752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b800ea14-5d90-415c-9b14-7361944a3c3a tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Action: 'create', calling method: .version_select at 0x7f25a48e0af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1118169949", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCSETr7xbi0oPrb67Ya0yu4sxE01ma93qylQWnfUQ68ptfI6skzPUuHGFq200qu/Z+vif+g/9wVqS6Pm+79G5x6LB2sZeabmZSUPt5r4SanV3fGOcjMWVp25PC6WFYU4mQ=="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:26:14.127078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-b800ea14-5d90-415c-9b14-7361944a3c3a tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Getting quotas for project b67de414e1aa4fde9ed87336f30c2767. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:26:14.135095 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7c2425e1-0729-41d3-b8b9-ed2d1c8a0c0d tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9a93a08b41f9b3573c1e6a85e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1785b5f4714605b2a35e03c123d54d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:14.137376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-b800ea14-5d90-415c-9b14-7361944a3c3a tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Getting quotas for user 3cb55865ecad4c05adc52a1aacd2aa10 and project b67de414e1aa4fde9ed87336f30c2767. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:26:14.144609 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7c2425e1-0729-41d3-b8b9-ed2d1c8a0c0d tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] 10.222.0.26 "GET /compute/v2.1/servers/b0a4b2da-c517-417d-8901-cbe5033e28d7" status: 200 len: 1271 microversion: 2.1 time: 0.204679 Sep 17 21:26:14.158970 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2987/5896] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:13 2022] GET /compute/v2.1/servers/b0a4b2da-c517-417d-8901-cbe5033e28d7 => generated 1271 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:26:14.168277 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b800ea14-5d90-415c-9b14-7361944a3c3a tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.285582 Sep 17 21:26:14.169510 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2910/5897] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:26:13 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:26:14.269247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3ed59bd9-4c9c-4e5d-b0b2-f52837a4a080 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:14.270780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3ed59bd9-4c9c-4e5d-b0b2-f52837a4a080 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:14.280345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ed59bd9-4c9c-4e5d-b0b2-f52837a4a080 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:14.281140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ed59bd9-4c9c-4e5d-b0b2-f52837a4a080 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:14.281678 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ed59bd9-4c9c-4e5d-b0b2-f52837a4a080 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:14.282780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ed59bd9-4c9c-4e5d-b0b2-f52837a4a080 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:14.283500 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ed59bd9-4c9c-4e5d-b0b2-f52837a4a080 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:14.284114 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ed59bd9-4c9c-4e5d-b0b2-f52837a4a080 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:14.519821 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3ed59bd9-4c9c-4e5d-b0b2-f52837a4a080 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:14.528283 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3ed59bd9-4c9c-4e5d-b0b2-f52837a4a080 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec" status: 200 len: 1267 microversion: 2.1 time: 0.264389 Sep 17 21:26:14.528881 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2988/5898] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:14 2022] GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec => generated 1267 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:26:15.170503 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-19527fde-a93c-42ad-ba76-b218aae7c2c7 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:15.171431 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-19527fde-a93c-42ad-ba76-b218aae7c2c7 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] [instance: b0a4b2da-c517-417d-8901-cbe5033e28d7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:15.178217 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-19527fde-a93c-42ad-ba76-b218aae7c2c7 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:15.178816 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-19527fde-a93c-42ad-ba76-b218aae7c2c7 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:15.179384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-19527fde-a93c-42ad-ba76-b218aae7c2c7 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:15.180268 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-19527fde-a93c-42ad-ba76-b218aae7c2c7 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:15.181003 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-19527fde-a93c-42ad-ba76-b218aae7c2c7 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:15.181701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-19527fde-a93c-42ad-ba76-b218aae7c2c7 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:15.386826 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-19527fde-a93c-42ad-ba76-b218aae7c2c7 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9a93a08b41f9b3573c1e6a85e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1785b5f4714605b2a35e03c123d54d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:15.396929 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-19527fde-a93c-42ad-ba76-b218aae7c2c7 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] 10.222.0.26 "GET /compute/v2.1/servers/b0a4b2da-c517-417d-8901-cbe5033e28d7" status: 200 len: 1271 microversion: 2.1 time: 0.231693 Sep 17 21:26:15.397648 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2911/5899] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:15 2022] GET /compute/v2.1/servers/b0a4b2da-c517-417d-8901-cbe5033e28d7 => generated 1271 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:26:15.551797 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-39cc0d76-c733-44f5-afad-df56e1550510 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:15.552350 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-39cc0d76-c733-44f5-afad-df56e1550510 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:15.559927 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39cc0d76-c733-44f5-afad-df56e1550510 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:15.560536 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39cc0d76-c733-44f5-afad-df56e1550510 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:15.561062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39cc0d76-c733-44f5-afad-df56e1550510 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:15.561925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39cc0d76-c733-44f5-afad-df56e1550510 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:15.562553 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39cc0d76-c733-44f5-afad-df56e1550510 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:15.563266 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39cc0d76-c733-44f5-afad-df56e1550510 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:15.734726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-39cc0d76-c733-44f5-afad-df56e1550510 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:15.744915 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-39cc0d76-c733-44f5-afad-df56e1550510 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec" status: 200 len: 1267 microversion: 2.1 time: 0.197809 Sep 17 21:26:15.757495 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2989/5900] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:15 2022] GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:26:15.774809 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-90ead054-ded5-40dc-83d7-a4419bd32d09 req-05eb673b-9bf3-40a4-98d8-f924d56a8c6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24e01588-ddb5-4c16-bd5a-dd6988b0d3ec", "name": "network-vif-plugged", "status": "completed", "tag": "8d2fb4fb-9253-4202-b576-2aced08f4489"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:26:15.786153 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-90ead054-ded5-40dc-83d7-a4419bd32d09 req-05eb673b-9bf3-40a4-98d8-f924d56a8c6d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:15.786885 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-90ead054-ded5-40dc-83d7-a4419bd32d09 req-05eb673b-9bf3-40a4-98d8-f924d56a8c6d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:15.787340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-90ead054-ded5-40dc-83d7-a4419bd32d09 req-05eb673b-9bf3-40a4-98d8-f924d56a8c6d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:15.799795 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-90ead054-ded5-40dc-83d7-a4419bd32d09 req-05eb673b-9bf3-40a4-98d8-f924d56a8c6d service nova] Creating event network-vif-plugged:8d2fb4fb-9253-4202-b576-2aced08f4489 for instance 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec on nch1-master-1 Sep 17 21:26:15.806564 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-90ead054-ded5-40dc-83d7-a4419bd32d09 req-05eb673b-9bf3-40a4-98d8-f924d56a8c6d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035608 Sep 17 21:26:15.807616 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2912/5901] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:26:16.420684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a430a37e-d62f-4b82-b3ce-e26934233e41 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:16.421326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a430a37e-d62f-4b82-b3ce-e26934233e41 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] [instance: b0a4b2da-c517-417d-8901-cbe5033e28d7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:16.427605 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a430a37e-d62f-4b82-b3ce-e26934233e41 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:16.428173 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a430a37e-d62f-4b82-b3ce-e26934233e41 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:16.428636 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a430a37e-d62f-4b82-b3ce-e26934233e41 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:16.429350 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a430a37e-d62f-4b82-b3ce-e26934233e41 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:16.429885 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a430a37e-d62f-4b82-b3ce-e26934233e41 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:16.430335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a430a37e-d62f-4b82-b3ce-e26934233e41 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:16.639529 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a430a37e-d62f-4b82-b3ce-e26934233e41 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9a93a08b41f9b3573c1e6a85e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1785b5f4714605b2a35e03c123d54d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:16.648051 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a430a37e-d62f-4b82-b3ce-e26934233e41 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] 10.222.0.26 "GET /compute/v2.1/servers/b0a4b2da-c517-417d-8901-cbe5033e28d7" status: 200 len: 1271 microversion: 2.1 time: 0.231467 Sep 17 21:26:16.648654 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2990/5902] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:16 2022] GET /compute/v2.1/servers/b0a4b2da-c517-417d-8901-cbe5033e28d7 => generated 1271 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:26:16.770185 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-92623eca-bd6f-4795-966f-5336ed192060 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:16.770895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-92623eca-bd6f-4795-966f-5336ed192060 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:16.777851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92623eca-bd6f-4795-966f-5336ed192060 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:16.778356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92623eca-bd6f-4795-966f-5336ed192060 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:16.778828 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92623eca-bd6f-4795-966f-5336ed192060 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:16.779523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92623eca-bd6f-4795-966f-5336ed192060 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:16.779986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92623eca-bd6f-4795-966f-5336ed192060 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:16.780431 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92623eca-bd6f-4795-966f-5336ed192060 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:17.013455 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-92623eca-bd6f-4795-966f-5336ed192060 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:17.021899 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-92623eca-bd6f-4795-966f-5336ed192060 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec" status: 200 len: 1267 microversion: 2.1 time: 0.257104 Sep 17 21:26:17.022704 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2913/5903] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:16 2022] GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec => generated 1267 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:26:17.673034 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d623a178-b445-4bb8-88f8-90f8a212966b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:17.675173 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d623a178-b445-4bb8-88f8-90f8a212966b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] [instance: b0a4b2da-c517-417d-8901-cbe5033e28d7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:17.686583 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d623a178-b445-4bb8-88f8-90f8a212966b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:17.687477 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d623a178-b445-4bb8-88f8-90f8a212966b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:17.688147 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d623a178-b445-4bb8-88f8-90f8a212966b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:17.689107 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d623a178-b445-4bb8-88f8-90f8a212966b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:17.689982 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d623a178-b445-4bb8-88f8-90f8a212966b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:17.690913 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d623a178-b445-4bb8-88f8-90f8a212966b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:18.044917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-71b155fb-cd43-49a8-8dda-5f12636c0315 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:18.045571 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-71b155fb-cd43-49a8-8dda-5f12636c0315 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:18.060931 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-71b155fb-cd43-49a8-8dda-5f12636c0315 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:18.062090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-71b155fb-cd43-49a8-8dda-5f12636c0315 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:18.063401 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-71b155fb-cd43-49a8-8dda-5f12636c0315 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:18.064618 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-71b155fb-cd43-49a8-8dda-5f12636c0315 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:18.065253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-71b155fb-cd43-49a8-8dda-5f12636c0315 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:18.066173 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-71b155fb-cd43-49a8-8dda-5f12636c0315 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:18.122746 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d623a178-b445-4bb8-88f8-90f8a212966b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9a93a08b41f9b3573c1e6a85e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1785b5f4714605b2a35e03c123d54d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:18.156404 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d623a178-b445-4bb8-88f8-90f8a212966b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] 10.222.0.26 "GET /compute/v2.1/servers/b0a4b2da-c517-417d-8901-cbe5033e28d7" status: 200 len: 1271 microversion: 2.1 time: 0.466905 Sep 17 21:26:18.174487 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2991/5904] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:17 2022] GET /compute/v2.1/servers/b0a4b2da-c517-417d-8901-cbe5033e28d7 => generated 1271 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:26:18.217732 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-71b155fb-cd43-49a8-8dda-5f12636c0315 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:18.226297 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-71b155fb-cd43-49a8-8dda-5f12636c0315 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec" status: 200 len: 1454 microversion: 2.1 time: 0.185375 Sep 17 21:26:18.226888 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2914/5905] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:18 2022] GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec => generated 1454 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:26:18.251929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7bc22844-7349-47a5-8474-fde137616962 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:18.252525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7bc22844-7349-47a5-8474-fde137616962 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:18.259428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7bc22844-7349-47a5-8474-fde137616962 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:18.259952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7bc22844-7349-47a5-8474-fde137616962 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:18.260402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7bc22844-7349-47a5-8474-fde137616962 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:18.261137 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7bc22844-7349-47a5-8474-fde137616962 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:18.261641 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7bc22844-7349-47a5-8474-fde137616962 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:18.262180 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7bc22844-7349-47a5-8474-fde137616962 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:18.407003 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7bc22844-7349-47a5-8474-fde137616962 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:18.415784 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7bc22844-7349-47a5-8474-fde137616962 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec" status: 200 len: 1454 microversion: 2.1 time: 0.169797 Sep 17 21:26:18.416555 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2992/5906] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:18 2022] GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec => generated 1454 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:26:19.182824 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-04b9a1c5-442d-407d-98a6-fe5a4d071f54 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:19.184062 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-04b9a1c5-442d-407d-98a6-fe5a4d071f54 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] [instance: b0a4b2da-c517-417d-8901-cbe5033e28d7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:19.191838 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04b9a1c5-442d-407d-98a6-fe5a4d071f54 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:19.192685 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04b9a1c5-442d-407d-98a6-fe5a4d071f54 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:19.193333 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04b9a1c5-442d-407d-98a6-fe5a4d071f54 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:19.194643 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04b9a1c5-442d-407d-98a6-fe5a4d071f54 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:19.195299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04b9a1c5-442d-407d-98a6-fe5a4d071f54 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:19.196119 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04b9a1c5-442d-407d-98a6-fe5a4d071f54 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:19.463690 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-04b9a1c5-442d-407d-98a6-fe5a4d071f54 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9a93a08b41f9b3573c1e6a85e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1785b5f4714605b2a35e03c123d54d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:19.474411 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-04b9a1c5-442d-407d-98a6-fe5a4d071f54 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] 10.222.0.26 "GET /compute/v2.1/servers/b0a4b2da-c517-417d-8901-cbe5033e28d7" status: 200 len: 1271 microversion: 2.1 time: 0.295278 Sep 17 21:26:19.475091 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2915/5907] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:19 2022] GET /compute/v2.1/servers/b0a4b2da-c517-417d-8901-cbe5033e28d7 => generated 1271 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:26:20.275385 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-6354eb52-a762-417d-9089-90432b018cdf req-5f90458b-472e-4668-9ef3-9728cfd2b356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0a4b2da-c517-417d-8901-cbe5033e28d7", "name": "network-vif-plugged", "status": "completed", "tag": "8648a291-058c-47d2-8ccb-575b1f6dea9c"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:26:20.287067 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6354eb52-a762-417d-9089-90432b018cdf req-5f90458b-472e-4668-9ef3-9728cfd2b356 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:20.287801 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6354eb52-a762-417d-9089-90432b018cdf req-5f90458b-472e-4668-9ef3-9728cfd2b356 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:20.288720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6354eb52-a762-417d-9089-90432b018cdf req-5f90458b-472e-4668-9ef3-9728cfd2b356 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:20.293843 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:26:20.307386 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-6354eb52-a762-417d-9089-90432b018cdf req-5f90458b-472e-4668-9ef3-9728cfd2b356 service nova] Creating event network-vif-plugged:8648a291-058c-47d2-8ccb-575b1f6dea9c for instance b0a4b2da-c517-417d-8901-cbe5033e28d7 on nch2-master-1 Sep 17 21:26:20.320748 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-6354eb52-a762-417d-9089-90432b018cdf req-5f90458b-472e-4668-9ef3-9728cfd2b356 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051285 Sep 17 21:26:20.322422 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2993/5908] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:26:20.501962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a0a81020-7f90-49fb-8f53-2123cecf408b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:20.503202 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a0a81020-7f90-49fb-8f53-2123cecf408b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] [instance: b0a4b2da-c517-417d-8901-cbe5033e28d7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:20.523295 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:26:20.551296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=8 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:26:20.559837 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-093653ae-aa16-4a3a-8d60-b23c2231244e req-6e20455b-3bf8-4abc-ac70-f0211b2c6491 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24e01588-ddb5-4c16-bd5a-dd6988b0d3ec", "tag": "8d2fb4fb-9253-4202-b576-2aced08f4489"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:26:20.591880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0a81020-7f90-49fb-8f53-2123cecf408b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:20.594627 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0a81020-7f90-49fb-8f53-2123cecf408b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:20.595111 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0a81020-7f90-49fb-8f53-2123cecf408b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:20.595904 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0a81020-7f90-49fb-8f53-2123cecf408b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:20.596371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0a81020-7f90-49fb-8f53-2123cecf408b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:20.596856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0a81020-7f90-49fb-8f53-2123cecf408b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:20.610478 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-093653ae-aa16-4a3a-8d60-b23c2231244e req-6e20455b-3bf8-4abc-ac70-f0211b2c6491 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:20.611003 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-093653ae-aa16-4a3a-8d60-b23c2231244e req-6e20455b-3bf8-4abc-ac70-f0211b2c6491 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:20.611548 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-093653ae-aa16-4a3a-8d60-b23c2231244e req-6e20455b-3bf8-4abc-ac70-f0211b2c6491 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:20.644859 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-093653ae-aa16-4a3a-8d60-b23c2231244e req-6e20455b-3bf8-4abc-ac70-f0211b2c6491 service nova] Creating event network-changed:8d2fb4fb-9253-4202-b576-2aced08f4489 for instance 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec on nch1-master-1 Sep 17 21:26:20.664959 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-093653ae-aa16-4a3a-8d60-b23c2231244e req-6e20455b-3bf8-4abc-ac70-f0211b2c6491 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114399 Sep 17 21:26:20.665665 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2994/5909] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:26:20.950411 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a0a81020-7f90-49fb-8f53-2123cecf408b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9a93a08b41f9b3573c1e6a85e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1785b5f4714605b2a35e03c123d54d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:20.969450 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a0a81020-7f90-49fb-8f53-2123cecf408b tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] 10.222.0.26 "GET /compute/v2.1/servers/b0a4b2da-c517-417d-8901-cbe5033e28d7" status: 200 len: 1271 microversion: 2.1 time: 0.474486 Sep 17 21:26:20.991848 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2916/5910] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:20 2022] GET /compute/v2.1/servers/b0a4b2da-c517-417d-8901-cbe5033e28d7 => generated 1271 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:26:21.749161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a737d865-2444-41c3-ba28-fb6bd90dce19 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1348719370", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "69ab13aa-4f5c-4210-a4bf-e8c070153ec9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1118169949", "security_groups": [{"name": "tempest-secgroup-smoke-1472388989"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:26:21.759286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:26:21.886696 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-a737d865-2444-41c3-ba28-fb6bd90dce19 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] validate_networks() for [('69ab13aa-4f5c-4210-a4bf-e8c070153ec9', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:26:21.999983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-20d62972-6dec-42ee-9796-c8a87fc2193d tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:22.001314 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-20d62972-6dec-42ee-9796-c8a87fc2193d tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] [instance: b0a4b2da-c517-417d-8901-cbe5033e28d7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:22.009863 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20d62972-6dec-42ee-9796-c8a87fc2193d tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:22.010653 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20d62972-6dec-42ee-9796-c8a87fc2193d tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:22.011278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20d62972-6dec-42ee-9796-c8a87fc2193d tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:22.012599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20d62972-6dec-42ee-9796-c8a87fc2193d tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:22.013224 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20d62972-6dec-42ee-9796-c8a87fc2193d tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:22.013973 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20d62972-6dec-42ee-9796-c8a87fc2193d tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:22.031004 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=85 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:26:22.207480 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-20d62972-6dec-42ee-9796-c8a87fc2193d tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9a93a08b41f9b3573c1e6a85e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1785b5f4714605b2a35e03c123d54d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:22.218239 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-20d62972-6dec-42ee-9796-c8a87fc2193d tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] 10.222.0.26 "GET /compute/v2.1/servers/b0a4b2da-c517-417d-8901-cbe5033e28d7" status: 200 len: 1461 microversion: 2.1 time: 0.222703 Sep 17 21:26:22.221811 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2917/5911] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:21 2022] GET /compute/v2.1/servers/b0a4b2da-c517-417d-8901-cbe5033e28d7 => generated 1461 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:26:22.243078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cbd45d5a-cf3d-4fd5-bebc-a03f6bc9d210 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:22.244444 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cbd45d5a-cf3d-4fd5-bebc-a03f6bc9d210 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] [instance: b0a4b2da-c517-417d-8901-cbe5033e28d7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:22.252789 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbd45d5a-cf3d-4fd5-bebc-a03f6bc9d210 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:22.253592 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbd45d5a-cf3d-4fd5-bebc-a03f6bc9d210 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:22.254675 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbd45d5a-cf3d-4fd5-bebc-a03f6bc9d210 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:22.256312 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbd45d5a-cf3d-4fd5-bebc-a03f6bc9d210 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:22.256947 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbd45d5a-cf3d-4fd5-bebc-a03f6bc9d210 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:22.257853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbd45d5a-cf3d-4fd5-bebc-a03f6bc9d210 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:22.520628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cbd45d5a-cf3d-4fd5-bebc-a03f6bc9d210 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9a93a08b41f9b3573c1e6a85e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1785b5f4714605b2a35e03c123d54d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:22.529981 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cbd45d5a-cf3d-4fd5-bebc-a03f6bc9d210 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] 10.222.0.26 "GET /compute/v2.1/servers/b0a4b2da-c517-417d-8901-cbe5033e28d7" status: 200 len: 1461 microversion: 2.1 time: 0.292046 Sep 17 21:26:22.530971 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2918/5912] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:22 2022] GET /compute/v2.1/servers/b0a4b2da-c517-417d-8901-cbe5033e28d7 => generated 1461 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:26:22.564051 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-a737d865-2444-41c3-ba28-fb6bd90dce19 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:26:22.565108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-a737d865-2444-41c3-ba28-fb6bd90dce19 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:26:22.565949 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-a737d865-2444-41c3-ba28-fb6bd90dce19 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:26:22.566471 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-a737d865-2444-41c3-ba28-fb6bd90dce19 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:26:22.567205 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-a737d865-2444-41c3-ba28-fb6bd90dce19 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:26:22.585956 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a737d865-2444-41c3-ba28-fb6bd90dce19 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:22.586872 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a737d865-2444-41c3-ba28-fb6bd90dce19 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:22.587548 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a737d865-2444-41c3-ba28-fb6bd90dce19 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:22.588542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a737d865-2444-41c3-ba28-fb6bd90dce19 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:22.589770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a737d865-2444-41c3-ba28-fb6bd90dce19 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:22.591020 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a737d865-2444-41c3-ba28-fb6bd90dce19 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:22.616984 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-a737d865-2444-41c3-ba28-fb6bd90dce19 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Getting quotas for project b67de414e1aa4fde9ed87336f30c2767. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:26:22.625084 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-a737d865-2444-41c3-ba28-fb6bd90dce19 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Getting quotas for user 3cb55865ecad4c05adc52a1aacd2aa10 and project b67de414e1aa4fde9ed87336f30c2767. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:26:22.643709 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a737d865-2444-41c3-ba28-fb6bd90dce19 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:26:22.646901 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a737d865-2444-41c3-ba28-fb6bd90dce19 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:26:22.712229 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a737d865-2444-41c3-ba28-fb6bd90dce19 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.973162 Sep 17 21:26:22.713563 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2995/5913] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:26:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:26:22.726628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-109a376a-28a1-4c6a-9c07-516d741d546b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:22.727518 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-109a376a-28a1-4c6a-9c07-516d741d546b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:22.812700 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-109a376a-28a1-4c6a-9c07-516d741d546b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:22.822553 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-109a376a-28a1-4c6a-9c07-516d741d546b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1267 microversion: 2.1 time: 0.100873 Sep 17 21:26:22.823626 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2919/5914] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:22 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1267 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:26:23.851810 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-90d5831f-85b1-4101-b5e7-7ed204e48167 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:23.853240 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-90d5831f-85b1-4101-b5e7-7ed204e48167 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:23.861780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90d5831f-85b1-4101-b5e7-7ed204e48167 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:23.862724 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90d5831f-85b1-4101-b5e7-7ed204e48167 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:23.863412 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90d5831f-85b1-4101-b5e7-7ed204e48167 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:23.864757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90d5831f-85b1-4101-b5e7-7ed204e48167 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:23.865722 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90d5831f-85b1-4101-b5e7-7ed204e48167 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:23.866399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90d5831f-85b1-4101-b5e7-7ed204e48167 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:24.137026 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-90d5831f-85b1-4101-b5e7-7ed204e48167 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:24.151092 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-90d5831f-85b1-4101-b5e7-7ed204e48167 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1319 microversion: 2.1 time: 0.303538 Sep 17 21:26:24.153887 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2996/5915] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:23 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:26:25.182604 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e983fbe2-de09-4b4f-8530-cbbc6911f34e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:25.184575 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e983fbe2-de09-4b4f-8530-cbbc6911f34e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:25.205308 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e983fbe2-de09-4b4f-8530-cbbc6911f34e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:25.206726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e983fbe2-de09-4b4f-8530-cbbc6911f34e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:25.208657 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e983fbe2-de09-4b4f-8530-cbbc6911f34e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:25.210052 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e983fbe2-de09-4b4f-8530-cbbc6911f34e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:25.211543 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e983fbe2-de09-4b4f-8530-cbbc6911f34e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:25.212330 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e983fbe2-de09-4b4f-8530-cbbc6911f34e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:25.407183 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-07fc2e3a-3325-4cb3-8bbf-94a61554393b req-37c85d41-3a58-49b3-bf3b-66728f9a5345 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0a4b2da-c517-417d-8901-cbe5033e28d7", "tag": "8648a291-058c-47d2-8ccb-575b1f6dea9c"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:26:25.434672 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-07fc2e3a-3325-4cb3-8bbf-94a61554393b req-37c85d41-3a58-49b3-bf3b-66728f9a5345 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:25.435490 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-07fc2e3a-3325-4cb3-8bbf-94a61554393b req-37c85d41-3a58-49b3-bf3b-66728f9a5345 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:25.436244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-07fc2e3a-3325-4cb3-8bbf-94a61554393b req-37c85d41-3a58-49b3-bf3b-66728f9a5345 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:25.469476 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-07fc2e3a-3325-4cb3-8bbf-94a61554393b req-37c85d41-3a58-49b3-bf3b-66728f9a5345 service nova] Creating event network-changed:8648a291-058c-47d2-8ccb-575b1f6dea9c for instance b0a4b2da-c517-417d-8901-cbe5033e28d7 on nch2-master-1 Sep 17 21:26:25.475603 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-07fc2e3a-3325-4cb3-8bbf-94a61554393b req-37c85d41-3a58-49b3-bf3b-66728f9a5345 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177636 Sep 17 21:26:25.476911 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2997/5916] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:26:25.734865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e983fbe2-de09-4b4f-8530-cbbc6911f34e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:25.748316 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e983fbe2-de09-4b4f-8530-cbbc6911f34e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1393 microversion: 2.1 time: 0.572565 Sep 17 21:26:25.751469 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2920/5917] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:25 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1393 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:26:26.740737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-397a65ca-49b3-40dc-8f88-0efdf9f721e2 req-d9408db1-ca88-4bc4-a434-5294a4bf08a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a5abc16-dc2e-4c3f-b919-8d1400909144", "tag": "0b6a3229-ce0d-4f57-a3b9-cb997ef0f1b8"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:26:26.751959 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-397a65ca-49b3-40dc-8f88-0efdf9f721e2 req-d9408db1-ca88-4bc4-a434-5294a4bf08a2 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:26.752456 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-397a65ca-49b3-40dc-8f88-0efdf9f721e2 req-d9408db1-ca88-4bc4-a434-5294a4bf08a2 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:26.752900 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-397a65ca-49b3-40dc-8f88-0efdf9f721e2 req-d9408db1-ca88-4bc4-a434-5294a4bf08a2 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:26.766226 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-397a65ca-49b3-40dc-8f88-0efdf9f721e2 req-d9408db1-ca88-4bc4-a434-5294a4bf08a2 service nova] Creating event network-changed:0b6a3229-ce0d-4f57-a3b9-cb997ef0f1b8 for instance 1a5abc16-dc2e-4c3f-b919-8d1400909144 on nch1-master-1 Sep 17 21:26:26.772687 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-397a65ca-49b3-40dc-8f88-0efdf9f721e2 req-d9408db1-ca88-4bc4-a434-5294a4bf08a2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039600 Sep 17 21:26:26.773840 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2998/5918] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:26:26.774313 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-04aa8cb3-6d8c-4147-859f-aefec5e1255d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:26.775024 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-04aa8cb3-6d8c-4147-859f-aefec5e1255d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:26.782875 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04aa8cb3-6d8c-4147-859f-aefec5e1255d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:26.783444 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04aa8cb3-6d8c-4147-859f-aefec5e1255d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:26.783890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04aa8cb3-6d8c-4147-859f-aefec5e1255d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:26.784607 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04aa8cb3-6d8c-4147-859f-aefec5e1255d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:26.785165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04aa8cb3-6d8c-4147-859f-aefec5e1255d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:26.785652 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-04aa8cb3-6d8c-4147-859f-aefec5e1255d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:26.925023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-04aa8cb3-6d8c-4147-859f-aefec5e1255d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:26.934147 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-04aa8cb3-6d8c-4147-859f-aefec5e1255d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1393 microversion: 2.1 time: 0.163751 Sep 17 21:26:26.941055 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2921/5919] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:26 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1393 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:26:27.517978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-3bfbb474-707a-48c8-a496-9fa575f8582e req-247a60a5-4d16-4271-b8e6-c4cf1c08fac9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0a4b2da-c517-417d-8901-cbe5033e28d7", "tag": "8648a291-058c-47d2-8ccb-575b1f6dea9c"}, {"name": "network-changed", "server_uuid": "b0a4b2da-c517-417d-8901-cbe5033e28d7", "tag": "8648a291-058c-47d2-8ccb-575b1f6dea9c"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:26:27.528770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-3bfbb474-707a-48c8-a496-9fa575f8582e req-247a60a5-4d16-4271-b8e6-c4cf1c08fac9 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:27.529282 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-3bfbb474-707a-48c8-a496-9fa575f8582e req-247a60a5-4d16-4271-b8e6-c4cf1c08fac9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:27.529799 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-3bfbb474-707a-48c8-a496-9fa575f8582e req-247a60a5-4d16-4271-b8e6-c4cf1c08fac9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:27.543881 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-3bfbb474-707a-48c8-a496-9fa575f8582e req-247a60a5-4d16-4271-b8e6-c4cf1c08fac9 service nova] Creating event network-changed:8648a291-058c-47d2-8ccb-575b1f6dea9c for instance b0a4b2da-c517-417d-8901-cbe5033e28d7 on nch2-master-1 Sep 17 21:26:27.544420 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-3bfbb474-707a-48c8-a496-9fa575f8582e req-247a60a5-4d16-4271-b8e6-c4cf1c08fac9 service nova] Creating event network-changed:8648a291-058c-47d2-8ccb-575b1f6dea9c for instance b0a4b2da-c517-417d-8901-cbe5033e28d7 on nch2-master-1 Sep 17 21:26:27.549663 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-3bfbb474-707a-48c8-a496-9fa575f8582e req-247a60a5-4d16-4271-b8e6-c4cf1c08fac9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035761 Sep 17 21:26:27.550265 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 2999/5920] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:26:27.956594 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f30f9084-b72e-4776-b8f9-196b11d016f7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:27.957245 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f30f9084-b72e-4776-b8f9-196b11d016f7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:27.965391 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f30f9084-b72e-4776-b8f9-196b11d016f7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:27.966144 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f30f9084-b72e-4776-b8f9-196b11d016f7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:27.966601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f30f9084-b72e-4776-b8f9-196b11d016f7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:27.967313 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f30f9084-b72e-4776-b8f9-196b11d016f7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:27.967772 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f30f9084-b72e-4776-b8f9-196b11d016f7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:27.968183 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f30f9084-b72e-4776-b8f9-196b11d016f7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:28.130426 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f30f9084-b72e-4776-b8f9-196b11d016f7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:28.141892 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f30f9084-b72e-4776-b8f9-196b11d016f7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1393 microversion: 2.1 time: 0.189290 Sep 17 21:26:28.143925 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2922/5921] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:27 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1393 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:26:29.175335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3b201b5b-5990-4366-9562-e93a9ce8c77d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:29.176087 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3b201b5b-5990-4366-9562-e93a9ce8c77d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:29.183686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b201b5b-5990-4366-9562-e93a9ce8c77d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:29.184197 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b201b5b-5990-4366-9562-e93a9ce8c77d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:29.184632 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b201b5b-5990-4366-9562-e93a9ce8c77d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:29.185357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b201b5b-5990-4366-9562-e93a9ce8c77d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:29.185847 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b201b5b-5990-4366-9562-e93a9ce8c77d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:29.186283 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3b201b5b-5990-4366-9562-e93a9ce8c77d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:29.328722 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3b201b5b-5990-4366-9562-e93a9ce8c77d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:29.336787 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3b201b5b-5990-4366-9562-e93a9ce8c77d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1393 microversion: 2.1 time: 0.168992 Sep 17 21:26:29.337371 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3000/5922] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:29 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1393 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:26:30.363369 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dcb5fe95-e9eb-42ec-a2f8-6c771b52f53c tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:30.365290 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dcb5fe95-e9eb-42ec-a2f8-6c771b52f53c tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:30.375783 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dcb5fe95-e9eb-42ec-a2f8-6c771b52f53c tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:30.376507 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dcb5fe95-e9eb-42ec-a2f8-6c771b52f53c tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:30.377160 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dcb5fe95-e9eb-42ec-a2f8-6c771b52f53c tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:30.378281 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dcb5fe95-e9eb-42ec-a2f8-6c771b52f53c tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:30.378933 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dcb5fe95-e9eb-42ec-a2f8-6c771b52f53c tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:30.379587 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dcb5fe95-e9eb-42ec-a2f8-6c771b52f53c tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:30.520211 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dcb5fe95-e9eb-42ec-a2f8-6c771b52f53c tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:30.528296 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dcb5fe95-e9eb-42ec-a2f8-6c771b52f53c tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1393 microversion: 2.1 time: 0.171513 Sep 17 21:26:30.528870 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2923/5923] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:30 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1393 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:26:31.551736 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0ac1e4e6-5d1d-43c8-b12b-6440e70f5849 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:31.552333 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0ac1e4e6-5d1d-43c8-b12b-6440e70f5849 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:31.560627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0ac1e4e6-5d1d-43c8-b12b-6440e70f5849 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:31.561267 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0ac1e4e6-5d1d-43c8-b12b-6440e70f5849 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:31.561815 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0ac1e4e6-5d1d-43c8-b12b-6440e70f5849 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:31.562631 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0ac1e4e6-5d1d-43c8-b12b-6440e70f5849 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:31.563160 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0ac1e4e6-5d1d-43c8-b12b-6440e70f5849 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:31.563631 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0ac1e4e6-5d1d-43c8-b12b-6440e70f5849 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:31.709764 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0ac1e4e6-5d1d-43c8-b12b-6440e70f5849 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:31.717691 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0ac1e4e6-5d1d-43c8-b12b-6440e70f5849 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1393 microversion: 2.1 time: 0.170553 Sep 17 21:26:31.718304 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3001/5924] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:31 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1393 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:26:31.787595 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-37a8994b-28bb-40f1-8416-f0bd1e238264 req-b11b5755-afe8-4718-ac47-27fb5746fd56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a5abc16-dc2e-4c3f-b919-8d1400909144", "name": "network-vif-plugged", "status": "completed", "tag": "0b6a3229-ce0d-4f57-a3b9-cb997ef0f1b8"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:26:31.798820 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-37a8994b-28bb-40f1-8416-f0bd1e238264 req-b11b5755-afe8-4718-ac47-27fb5746fd56 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:31.799333 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-37a8994b-28bb-40f1-8416-f0bd1e238264 req-b11b5755-afe8-4718-ac47-27fb5746fd56 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:31.799844 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-37a8994b-28bb-40f1-8416-f0bd1e238264 req-b11b5755-afe8-4718-ac47-27fb5746fd56 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:31.811839 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-37a8994b-28bb-40f1-8416-f0bd1e238264 req-b11b5755-afe8-4718-ac47-27fb5746fd56 service nova] Creating event network-vif-plugged:0b6a3229-ce0d-4f57-a3b9-cb997ef0f1b8 for instance 1a5abc16-dc2e-4c3f-b919-8d1400909144 on nch1-master-1 Sep 17 21:26:31.816950 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-37a8994b-28bb-40f1-8416-f0bd1e238264 req-b11b5755-afe8-4718-ac47-27fb5746fd56 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033286 Sep 17 21:26:31.817849 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2924/5925] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:26:32.741297 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6a45263f-53ea-408a-af05-aba4dd694174 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:32.742959 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6a45263f-53ea-408a-af05-aba4dd694174 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:32.745287 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:26:32.746068 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=6 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:26:32.753584 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a45263f-53ea-408a-af05-aba4dd694174 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:32.754171 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a45263f-53ea-408a-af05-aba4dd694174 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:32.757944 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a45263f-53ea-408a-af05-aba4dd694174 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:32.757944 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a45263f-53ea-408a-af05-aba4dd694174 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:32.757944 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a45263f-53ea-408a-af05-aba4dd694174 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:32.757944 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6a45263f-53ea-408a-af05-aba4dd694174 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:32.899127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6a45263f-53ea-408a-af05-aba4dd694174 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:32.907329 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6a45263f-53ea-408a-af05-aba4dd694174 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1393 microversion: 2.1 time: 0.170703 Sep 17 21:26:32.907913 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3002/5926] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:32 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1393 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:26:33.929914 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=22 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:26:33.934601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-325ac492-5d6c-468c-9b67-2c635cb86faf tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:33.935454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-325ac492-5d6c-468c-9b67-2c635cb86faf tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:33.942250 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-325ac492-5d6c-468c-9b67-2c635cb86faf tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:33.942747 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-325ac492-5d6c-468c-9b67-2c635cb86faf tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:33.943196 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-325ac492-5d6c-468c-9b67-2c635cb86faf tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:33.943900 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-325ac492-5d6c-468c-9b67-2c635cb86faf tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:33.944360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-325ac492-5d6c-468c-9b67-2c635cb86faf tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:33.944793 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-325ac492-5d6c-468c-9b67-2c635cb86faf tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:34.082573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-325ac492-5d6c-468c-9b67-2c635cb86faf tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:34.091768 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-325ac492-5d6c-468c-9b67-2c635cb86faf tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1566 microversion: 2.1 time: 0.163591 Sep 17 21:26:34.092482 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2925/5927] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:33 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:26:34.123797 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5e2b2d1b-52ba-43a0-baf1-1e58fa6b3378 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:34.124442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5e2b2d1b-52ba-43a0-baf1-1e58fa6b3378 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:34.131906 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e2b2d1b-52ba-43a0-baf1-1e58fa6b3378 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:34.132418 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e2b2d1b-52ba-43a0-baf1-1e58fa6b3378 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:34.132874 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e2b2d1b-52ba-43a0-baf1-1e58fa6b3378 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:34.133650 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e2b2d1b-52ba-43a0-baf1-1e58fa6b3378 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:34.134117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e2b2d1b-52ba-43a0-baf1-1e58fa6b3378 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:34.134594 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5e2b2d1b-52ba-43a0-baf1-1e58fa6b3378 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:34.269219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5e2b2d1b-52ba-43a0-baf1-1e58fa6b3378 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:34.277339 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5e2b2d1b-52ba-43a0-baf1-1e58fa6b3378 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1566 microversion: 2.1 time: 0.157699 Sep 17 21:26:34.277918 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3003/5928] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:34 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:26:36.205239 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3a9ff2cc-d663-49f0-badc-c32d102ebf9e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:26:36.206004 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3a9ff2cc-d663-49f0-badc-c32d102ebf9e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:36.208812 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-bf79975c-e136-4c40-a7b6-0bf35a834790 req-f4a693e7-6d58-44c8-8ccd-59607dddebb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a5abc16-dc2e-4c3f-b919-8d1400909144", "tag": "0b6a3229-ce0d-4f57-a3b9-cb997ef0f1b8"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:26:36.213115 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3a9ff2cc-d663-49f0-badc-c32d102ebf9e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:36.214114 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3a9ff2cc-d663-49f0-badc-c32d102ebf9e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:36.215033 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3a9ff2cc-d663-49f0-badc-c32d102ebf9e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:36.216200 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3a9ff2cc-d663-49f0-badc-c32d102ebf9e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:36.216908 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3a9ff2cc-d663-49f0-badc-c32d102ebf9e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:36.217415 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3a9ff2cc-d663-49f0-badc-c32d102ebf9e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:36.220207 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-bf79975c-e136-4c40-a7b6-0bf35a834790 req-f4a693e7-6d58-44c8-8ccd-59607dddebb6 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:36.220900 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-bf79975c-e136-4c40-a7b6-0bf35a834790 req-f4a693e7-6d58-44c8-8ccd-59607dddebb6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:36.221544 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-bf79975c-e136-4c40-a7b6-0bf35a834790 req-f4a693e7-6d58-44c8-8ccd-59607dddebb6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:36.239977 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-bf79975c-e136-4c40-a7b6-0bf35a834790 req-f4a693e7-6d58-44c8-8ccd-59607dddebb6 service nova] Creating event network-changed:0b6a3229-ce0d-4f57-a3b9-cb997ef0f1b8 for instance 1a5abc16-dc2e-4c3f-b919-8d1400909144 on nch1-master-1 Sep 17 21:26:36.246561 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-bf79975c-e136-4c40-a7b6-0bf35a834790 req-f4a693e7-6d58-44c8-8ccd-59607dddebb6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042040 Sep 17 21:26:36.247201 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3004/5929] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:26:36.363552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3a9ff2cc-d663-49f0-badc-c32d102ebf9e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:26:36.372567 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3a9ff2cc-d663-49f0-badc-c32d102ebf9e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1566 microversion: 2.1 time: 0.171638 Sep 17 21:26:36.373190 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2926/5930] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:26:36 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1566 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:26:59.641804 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0a06715a-2760-4189-99fe-1dc0175d9104 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:26:59.644649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0a06715a-2760-4189-99fe-1dc0175d9104 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:26:59.647205 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:26:59.648013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=42 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:26:59.656416 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a06715a-2760-4189-99fe-1dc0175d9104 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:59.657058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a06715a-2760-4189-99fe-1dc0175d9104 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:59.657656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a06715a-2760-4189-99fe-1dc0175d9104 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:59.658512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a06715a-2760-4189-99fe-1dc0175d9104 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:26:59.659117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a06715a-2760-4189-99fe-1dc0175d9104 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:26:59.659648 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a06715a-2760-4189-99fe-1dc0175d9104 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:26:59.714287 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0a06715a-2760-4189-99fe-1dc0175d9104 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "POST /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144/action" status: 200 len: 24569 microversion: 2.1 time: 0.077580 Sep 17 21:26:59.714972 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3005/5931] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:26:59 2022] POST /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144/action => generated 24569 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:27:08.070692 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6ced1e0c-444e-43eb-a3cf-913953d61663 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:27:08.072477 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-57f4be97-aca8-4200-9c7d-c2cdad338ce1 req-73e43196-0226-4e4d-bc71-f43b528fb833 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0a4b2da-c517-417d-8901-cbe5033e28d7", "tag": "8648a291-058c-47d2-8ccb-575b1f6dea9c"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:27:08.075466 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6ced1e0c-444e-43eb-a3cf-913953d61663 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] [instance: b0a4b2da-c517-417d-8901-cbe5033e28d7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:27:08.078045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:27:08.078690 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=49 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:27:08.096078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-57f4be97-aca8-4200-9c7d-c2cdad338ce1 req-73e43196-0226-4e4d-bc71-f43b528fb833 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:08.096601 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-57f4be97-aca8-4200-9c7d-c2cdad338ce1 req-73e43196-0226-4e4d-bc71-f43b528fb833 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:08.097053 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-57f4be97-aca8-4200-9c7d-c2cdad338ce1 req-73e43196-0226-4e4d-bc71-f43b528fb833 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:08.098133 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6ced1e0c-444e-43eb-a3cf-913953d61663 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:08.098423 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6ced1e0c-444e-43eb-a3cf-913953d61663 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:08.098826 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6ced1e0c-444e-43eb-a3cf-913953d61663 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:08.099652 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6ced1e0c-444e-43eb-a3cf-913953d61663 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:08.100139 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6ced1e0c-444e-43eb-a3cf-913953d61663 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:08.100647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6ced1e0c-444e-43eb-a3cf-913953d61663 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:08.123307 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-57f4be97-aca8-4200-9c7d-c2cdad338ce1 req-73e43196-0226-4e4d-bc71-f43b528fb833 service nova] Creating event network-changed:8648a291-058c-47d2-8ccb-575b1f6dea9c for instance b0a4b2da-c517-417d-8901-cbe5033e28d7 on nch2-master-1 Sep 17 21:27:08.131487 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-57f4be97-aca8-4200-9c7d-c2cdad338ce1 req-73e43196-0226-4e4d-bc71-f43b528fb833 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068467 Sep 17 21:27:08.138978 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3006/5932] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:27:08.149972 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6ced1e0c-444e-43eb-a3cf-913953d61663 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] [instance: b0a4b2da-c517-417d-8901-cbe5033e28d7] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:27:08.269215 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6ced1e0c-444e-43eb-a3cf-913953d61663 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b0a4b2da-c517-417d-8901-cbe5033e28d7" status: 204 len: 0 microversion: 2.1 time: 0.207962 Sep 17 21:27:08.273783 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2927/5933] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:27:08 2022] DELETE /compute/v2.1/servers/b0a4b2da-c517-417d-8901-cbe5033e28d7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:27:08.283681 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4775d371-d2b8-4d96-9946-6cf4cc633e56 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:27:08.284455 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4775d371-d2b8-4d96-9946-6cf4cc633e56 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] [instance: b0a4b2da-c517-417d-8901-cbe5033e28d7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:27:08.291623 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4775d371-d2b8-4d96-9946-6cf4cc633e56 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:08.292227 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4775d371-d2b8-4d96-9946-6cf4cc633e56 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:08.292763 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4775d371-d2b8-4d96-9946-6cf4cc633e56 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:08.293541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4775d371-d2b8-4d96-9946-6cf4cc633e56 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:08.294091 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4775d371-d2b8-4d96-9946-6cf4cc633e56 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:08.294538 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4775d371-d2b8-4d96-9946-6cf4cc633e56 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:08.458707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4775d371-d2b8-4d96-9946-6cf4cc633e56 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9a93a08b41f9b3573c1e6a85e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1785b5f4714605b2a35e03c123d54d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:27:08.468222 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4775d371-d2b8-4d96-9946-6cf4cc633e56 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] 10.222.0.26 "GET /compute/v2.1/servers/b0a4b2da-c517-417d-8901-cbe5033e28d7" status: 200 len: 1585 microversion: 2.1 time: 0.192661 Sep 17 21:27:08.469731 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3007/5934] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:27:08 2022] GET /compute/v2.1/servers/b0a4b2da-c517-417d-8901-cbe5033e28d7 => generated 1585 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:27:09.497215 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-018dbd2a-943a-4673-b815-3e561e90de05 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:27:09.500044 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-018dbd2a-943a-4673-b815-3e561e90de05 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] [instance: b0a4b2da-c517-417d-8901-cbe5033e28d7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:27:09.508332 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-018dbd2a-943a-4673-b815-3e561e90de05 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:09.508826 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-018dbd2a-943a-4673-b815-3e561e90de05 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:09.509273 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-018dbd2a-943a-4673-b815-3e561e90de05 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:09.510043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-018dbd2a-943a-4673-b815-3e561e90de05 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:09.510495 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-018dbd2a-943a-4673-b815-3e561e90de05 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:09.510916 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-018dbd2a-943a-4673-b815-3e561e90de05 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:09.651041 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-018dbd2a-943a-4673-b815-3e561e90de05 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9a93a08b41f9b3573c1e6a85e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1785b5f4714605b2a35e03c123d54d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:27:09.659615 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-018dbd2a-943a-4673-b815-3e561e90de05 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] 10.222.0.26 "GET /compute/v2.1/servers/b0a4b2da-c517-417d-8901-cbe5033e28d7" status: 200 len: 1585 microversion: 2.1 time: 0.167462 Sep 17 21:27:09.660220 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2928/5935] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:27:09 2022] GET /compute/v2.1/servers/b0a4b2da-c517-417d-8901-cbe5033e28d7 => generated 1585 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:27:10.285550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-e4c32b20-1848-45f2-b9fb-4b0096626caf req-c263a5e4-817f-4577-be41-f1057b314caf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0a4b2da-c517-417d-8901-cbe5033e28d7", "name": "network-vif-deleted", "tag": "8648a291-058c-47d2-8ccb-575b1f6dea9c"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:27:10.296725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e4c32b20-1848-45f2-b9fb-4b0096626caf req-c263a5e4-817f-4577-be41-f1057b314caf service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:10.297233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e4c32b20-1848-45f2-b9fb-4b0096626caf req-c263a5e4-817f-4577-be41-f1057b314caf service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:10.297732 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e4c32b20-1848-45f2-b9fb-4b0096626caf req-c263a5e4-817f-4577-be41-f1057b314caf service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:10.309744 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-e4c32b20-1848-45f2-b9fb-4b0096626caf req-c263a5e4-817f-4577-be41-f1057b314caf service nova] Creating event network-vif-deleted:8648a291-058c-47d2-8ccb-575b1f6dea9c for instance b0a4b2da-c517-417d-8901-cbe5033e28d7 on nch2-master-1 Sep 17 21:27:10.314897 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-e4c32b20-1848-45f2-b9fb-4b0096626caf req-c263a5e4-817f-4577-be41-f1057b314caf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033277 Sep 17 21:27:10.315498 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3008/5936] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:27:10.634648 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-00691dac-9b3d-465b-a2ec-c7d628268792 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:27:10.635943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-00691dac-9b3d-465b-a2ec-c7d628268792 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:27:10.643738 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00691dac-9b3d-465b-a2ec-c7d628268792 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:10.644243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00691dac-9b3d-465b-a2ec-c7d628268792 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:10.644699 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00691dac-9b3d-465b-a2ec-c7d628268792 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:10.645447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00691dac-9b3d-465b-a2ec-c7d628268792 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:10.645939 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00691dac-9b3d-465b-a2ec-c7d628268792 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:10.646380 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00691dac-9b3d-465b-a2ec-c7d628268792 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:10.685518 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b56f0173-d864-4da1-a146-08c68aed6068 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:27:10.686535 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b56f0173-d864-4da1-a146-08c68aed6068 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] [instance: b0a4b2da-c517-417d-8901-cbe5033e28d7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:27:10.694656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b56f0173-d864-4da1-a146-08c68aed6068 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:10.695379 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b56f0173-d864-4da1-a146-08c68aed6068 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:10.696525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b56f0173-d864-4da1-a146-08c68aed6068 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:10.697536 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b56f0173-d864-4da1-a146-08c68aed6068 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:10.698248 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b56f0173-d864-4da1-a146-08c68aed6068 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:10.698942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b56f0173-d864-4da1-a146-08c68aed6068 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:10.733033 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b56f0173-d864-4da1-a146-08c68aed6068 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:10.733593 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b56f0173-d864-4da1-a146-08c68aed6068 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:10.734063 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b56f0173-d864-4da1-a146-08c68aed6068 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:10.734531 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-b56f0173-d864-4da1-a146-08c68aed6068 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lazy-loading 'fault' on Instance uuid b0a4b2da-c517-417d-8901-cbe5033e28d7 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:27:10.784741 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b56f0173-d864-4da1-a146-08c68aed6068 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9a93a08b41f9b3573c1e6a85e60e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1785b5f4714605b2a35e03c123d54d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:27:10.793321 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b56f0173-d864-4da1-a146-08c68aed6068 tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] 10.222.0.26 "GET /compute/v2.1/servers/b0a4b2da-c517-417d-8901-cbe5033e28d7" status: 200 len: 1235 microversion: 2.1 time: 0.112989 Sep 17 21:27:10.794164 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3009/5937] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:27:10 2022] GET /compute/v2.1/servers/b0a4b2da-c517-417d-8901-cbe5033e28d7 => generated 1235 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:27:10.927697 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-00691dac-9b3d-465b-a2ec-c7d628268792 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1836 microversion: 2.1 time: 0.296785 Sep 17 21:27:10.928311 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2929/5938] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:27:10 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1836 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:27:10.950932 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ecee28c8-8f1a-4389-a036-1958bc508950 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:27:10.951585 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ecee28c8-8f1a-4389-a036-1958bc508950 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:27:10.957724 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ecee28c8-8f1a-4389-a036-1958bc508950 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:10.958226 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ecee28c8-8f1a-4389-a036-1958bc508950 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:10.958683 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ecee28c8-8f1a-4389-a036-1958bc508950 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:10.959388 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ecee28c8-8f1a-4389-a036-1958bc508950 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:10.959857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ecee28c8-8f1a-4389-a036-1958bc508950 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:10.960299 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ecee28c8-8f1a-4389-a036-1958bc508950 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:11.097106 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ecee28c8-8f1a-4389-a036-1958bc508950 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:27:11.105320 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ecee28c8-8f1a-4389-a036-1958bc508950 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1685 microversion: 2.1 time: 0.158428 Sep 17 21:27:11.105930 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3010/5939] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:27:10 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:27:11.211328 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9ec79a30-cd3c-4a88-b2c8-1b550547a187 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:27:11.213635 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9ec79a30-cd3c-4a88-b2c8-1b550547a187 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:27:11.220013 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9ec79a30-cd3c-4a88-b2c8-1b550547a187 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:11.220503 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9ec79a30-cd3c-4a88-b2c8-1b550547a187 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:11.220946 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9ec79a30-cd3c-4a88-b2c8-1b550547a187 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:11.221702 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9ec79a30-cd3c-4a88-b2c8-1b550547a187 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:11.222157 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9ec79a30-cd3c-4a88-b2c8-1b550547a187 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:11.222623 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9ec79a30-cd3c-4a88-b2c8-1b550547a187 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:11.275526 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9ec79a30-cd3c-4a88-b2c8-1b550547a187 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "POST /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144/action" status: 200 len: 32640 microversion: 2.1 time: 0.068058 Sep 17 21:27:11.276321 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2930/5940] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:27:11 2022] POST /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144/action => generated 32640 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:27:11.455812 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-191e6bb1-2430-481a-aa05-d95349532b8e tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:27:11.456576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-191e6bb1-2430-481a-aa05-d95349532b8e tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:27:11.465862 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-191e6bb1-2430-481a-aa05-d95349532b8e tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:11.466509 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-191e6bb1-2430-481a-aa05-d95349532b8e tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:11.467088 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-191e6bb1-2430-481a-aa05-d95349532b8e tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:11.468144 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-191e6bb1-2430-481a-aa05-d95349532b8e tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:11.468625 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-191e6bb1-2430-481a-aa05-d95349532b8e tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:11.469078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-191e6bb1-2430-481a-aa05-d95349532b8e tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:11.510624 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-191e6bb1-2430-481a-aa05-d95349532b8e tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c2f8e397465f45a08b807d5240c07729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94968a8495d447d9adf019219816f9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:27:11.511257 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-191e6bb1-2430-481a-aa05-d95349532b8e tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] flavor_id is None. Assuming migration. {{(pid=140524) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 17 21:27:11.511711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-191e6bb1-2430-481a-aa05-d95349532b8e tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140524) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 17 21:27:11.759235 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-191e6bb1-2430-481a-aa05-d95349532b8e tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144/action" status: 202 len: 0 microversion: 2.1 time: 0.308201 Sep 17 21:27:11.759798 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3011/5941] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:27:11 2022] POST /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:27:11.768921 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ec8d672f-37c6-458e-ba12-1d6382b5c1cc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:27:11.769760 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ec8d672f-37c6-458e-ba12-1d6382b5c1cc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:27:11.777787 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec8d672f-37c6-458e-ba12-1d6382b5c1cc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:11.778365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec8d672f-37c6-458e-ba12-1d6382b5c1cc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:11.778881 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec8d672f-37c6-458e-ba12-1d6382b5c1cc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:11.779721 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec8d672f-37c6-458e-ba12-1d6382b5c1cc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:11.780190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec8d672f-37c6-458e-ba12-1d6382b5c1cc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:11.780926 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ec8d672f-37c6-458e-ba12-1d6382b5c1cc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:11.821540 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-14f2d378-9c5b-4a43-8a90-5399b55b289a tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:27:11.822164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-14f2d378-9c5b-4a43-8a90-5399b55b289a tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] [instance: b0a4b2da-c517-417d-8901-cbe5033e28d7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:27:11.829287 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14f2d378-9c5b-4a43-8a90-5399b55b289a tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:11.830015 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14f2d378-9c5b-4a43-8a90-5399b55b289a tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:11.830610 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14f2d378-9c5b-4a43-8a90-5399b55b289a tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:11.831382 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14f2d378-9c5b-4a43-8a90-5399b55b289a tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:11.831910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14f2d378-9c5b-4a43-8a90-5399b55b289a tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:11.832436 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-14f2d378-9c5b-4a43-8a90-5399b55b289a tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:11.856350 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-14f2d378-9c5b-4a43-8a90-5399b55b289a tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] HTTP exception thrown: Instance b0a4b2da-c517-417d-8901-cbe5033e28d7 could not be found. Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-14f2d378-9c5b-4a43-8a90-5399b55b289a tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Request method failure captured: Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/b0a4b2da-c517-417d-8901-cbe5033e28d7 HTTP/1.1 Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjtRBTZcpxc9CM-1A52oSw3ZXgADSesFqZ2LuofMEO0uNqv21KE6LKdw5tfDqUWbNamnGLx17efhboJc7MPIIg1EmOjLkpFpf0OlTH9dMdld0zDgHBWoTiE6itu_B__TMcg9_ByseDmwXU-UDfLHIgcyz3WEbUV9N1NMI00Vpw7-I14 Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 6e1785b5f4714605b2a35e03c123d54d Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-TestVolumeBackupRestore-2137501954 Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6e1785b5f4714605b2a35e03c123d54d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6e1785b5f4714605b2a35e03c123d54d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6e1785b5f4714605b2a35e03c123d54d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6e1785b5f4714605b2a35e03c123d54d", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-TestVolumeBackupRestore-2137501954 Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 6e1785b5f4714605b2a35e03c123d54d Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-TestVolumeBackupRestore-2137501954 Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-TestVolumeBackupRestore-2137501954-project Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 23df9a93a08b41f9b3573c1e6a85e60e Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-TestVolumeBackupRestore-2137501954-project Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance b0a4b2da-c517-417d-8901-cbe5033e28d7 could not be found. Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'b0a4b2da-c517-417d-8901-cbe5033e28d7'} Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0a4b2da-c517-417d-8901-cbe5033e28d7 could not be found. Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0a4b2da-c517-417d-8901-cbe5033e28d7 could not be found. Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:27:11.858125 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:27:11.863357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:27:11.863357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:27:11.863357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:27:11.863357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:27:11.863357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:27:11.863357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0a4b2da-c517-417d-8901-cbe5033e28d7 could not be found. Sep 17 21:27:11.863357 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:27:11.863357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-14f2d378-9c5b-4a43-8a90-5399b55b289a tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Returning 404 to user: Instance b0a4b2da-c517-417d-8901-cbe5033e28d7 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:27:11.863357 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-14f2d378-9c5b-4a43-8a90-5399b55b289a tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] 10.222.0.26 "GET /compute/v2.1/servers/b0a4b2da-c517-417d-8901-cbe5033e28d7" status: 404 len: 111 microversion: 2.1 time: 0.043833 Sep 17 21:27:11.863357 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3012/5942] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:27:11 2022] GET /compute/v2.1/servers/b0a4b2da-c517-417d-8901-cbe5033e28d7 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:27:11.984436 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ec8d672f-37c6-458e-ba12-1d6382b5c1cc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:27:11.995811 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ec8d672f-37c6-458e-ba12-1d6382b5c1cc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1694 microversion: 2.1 time: 0.231264 Sep 17 21:27:11.996800 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2931/5943] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:27:11 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1694 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:27:12.043464 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f1c024db-150a-454f-9542-e0b4ffedfb0a tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] Calling method '.version_select at 0x7f25a579e310>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:27:12.067912 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f1c024db-150a-454f-9542-e0b4ffedfb0a tempest-TestVolumeBackupRestore-2137501954 tempest-TestVolumeBackupRestore-2137501954-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1973280609" status: 202 len: 0 microversion: 2.1 time: 0.028574 Sep 17 21:27:12.068533 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3013/5944] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Sep 17 21:27:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1973280609 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:27:13.021620 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f1bd3a26-1cdf-4787-8e55-9c3e21cef1e5 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:27:13.022970 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f1bd3a26-1cdf-4787-8e55-9c3e21cef1e5 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:27:13.032070 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1bd3a26-1cdf-4787-8e55-9c3e21cef1e5 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:13.032605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1bd3a26-1cdf-4787-8e55-9c3e21cef1e5 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:13.033047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1bd3a26-1cdf-4787-8e55-9c3e21cef1e5 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:13.033785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1bd3a26-1cdf-4787-8e55-9c3e21cef1e5 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:13.034245 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1bd3a26-1cdf-4787-8e55-9c3e21cef1e5 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:13.034677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f1bd3a26-1cdf-4787-8e55-9c3e21cef1e5 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:13.194065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f1bd3a26-1cdf-4787-8e55-9c3e21cef1e5 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:27:13.202968 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f1bd3a26-1cdf-4787-8e55-9c3e21cef1e5 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1694 microversion: 2.1 time: 0.186437 Sep 17 21:27:13.204569 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2932/5945] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:27:13 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1694 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:27:14.229952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0a6b5ba4-6195-4e3f-ad2a-6f2f70cb72a2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:27:14.230416 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0a6b5ba4-6195-4e3f-ad2a-6f2f70cb72a2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:27:14.237690 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a6b5ba4-6195-4e3f-ad2a-6f2f70cb72a2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:14.238205 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a6b5ba4-6195-4e3f-ad2a-6f2f70cb72a2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:14.238646 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a6b5ba4-6195-4e3f-ad2a-6f2f70cb72a2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:14.239729 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a6b5ba4-6195-4e3f-ad2a-6f2f70cb72a2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:14.240202 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a6b5ba4-6195-4e3f-ad2a-6f2f70cb72a2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:14.240678 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0a6b5ba4-6195-4e3f-ad2a-6f2f70cb72a2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:14.377982 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0a6b5ba4-6195-4e3f-ad2a-6f2f70cb72a2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:27:14.386301 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0a6b5ba4-6195-4e3f-ad2a-6f2f70cb72a2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1699 microversion: 2.1 time: 0.162117 Sep 17 21:27:14.386871 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3014/5946] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:27:14 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1699 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:27:15.413753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5c1ed52a-edaa-45bf-a1cb-9b2f76bf591b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:27:15.414713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5c1ed52a-edaa-45bf-a1cb-9b2f76bf591b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:27:15.425236 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c1ed52a-edaa-45bf-a1cb-9b2f76bf591b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:15.425766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c1ed52a-edaa-45bf-a1cb-9b2f76bf591b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:15.426215 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c1ed52a-edaa-45bf-a1cb-9b2f76bf591b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:15.426927 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c1ed52a-edaa-45bf-a1cb-9b2f76bf591b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:15.427386 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c1ed52a-edaa-45bf-a1cb-9b2f76bf591b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:15.427830 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c1ed52a-edaa-45bf-a1cb-9b2f76bf591b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:15.562780 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5c1ed52a-edaa-45bf-a1cb-9b2f76bf591b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:27:15.570981 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5c1ed52a-edaa-45bf-a1cb-9b2f76bf591b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1699 microversion: 2.1 time: 0.163938 Sep 17 21:27:15.571574 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2933/5947] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:27:15 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1699 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:27:16.596642 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-842ce2eb-1be6-4223-b8ee-006b6f90a33e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:27:16.597307 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-842ce2eb-1be6-4223-b8ee-006b6f90a33e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:27:16.604505 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-842ce2eb-1be6-4223-b8ee-006b6f90a33e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:16.604957 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-842ce2eb-1be6-4223-b8ee-006b6f90a33e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:16.605413 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-842ce2eb-1be6-4223-b8ee-006b6f90a33e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:16.606202 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-842ce2eb-1be6-4223-b8ee-006b6f90a33e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:16.606687 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-842ce2eb-1be6-4223-b8ee-006b6f90a33e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:16.607133 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-842ce2eb-1be6-4223-b8ee-006b6f90a33e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:16.743530 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-842ce2eb-1be6-4223-b8ee-006b6f90a33e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:27:16.752184 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-842ce2eb-1be6-4223-b8ee-006b6f90a33e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1699 microversion: 2.1 time: 0.159733 Sep 17 21:27:16.752757 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3015/5948] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:27:16 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1699 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:27:17.776325 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-eb291409-f558-4120-8529-0f0011936ac1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:27:17.776958 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-eb291409-f558-4120-8529-0f0011936ac1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:27:17.785037 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eb291409-f558-4120-8529-0f0011936ac1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:17.785579 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eb291409-f558-4120-8529-0f0011936ac1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:17.786028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eb291409-f558-4120-8529-0f0011936ac1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:17.786758 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eb291409-f558-4120-8529-0f0011936ac1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:17.787235 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eb291409-f558-4120-8529-0f0011936ac1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:17.787713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eb291409-f558-4120-8529-0f0011936ac1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:17.970883 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-eb291409-f558-4120-8529-0f0011936ac1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:27:17.980393 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-eb291409-f558-4120-8529-0f0011936ac1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1699 microversion: 2.1 time: 0.207987 Sep 17 21:27:17.981200 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2934/5949] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:27:17 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1699 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:27:19.004857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8d90336f-fc5f-48b1-8ecf-57369ea2871b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:27:19.006314 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8d90336f-fc5f-48b1-8ecf-57369ea2871b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:27:19.014565 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d90336f-fc5f-48b1-8ecf-57369ea2871b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:19.015081 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d90336f-fc5f-48b1-8ecf-57369ea2871b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:19.015554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d90336f-fc5f-48b1-8ecf-57369ea2871b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:19.016299 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d90336f-fc5f-48b1-8ecf-57369ea2871b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:19.016788 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d90336f-fc5f-48b1-8ecf-57369ea2871b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:19.017321 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d90336f-fc5f-48b1-8ecf-57369ea2871b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:19.153480 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8d90336f-fc5f-48b1-8ecf-57369ea2871b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:27:19.161497 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8d90336f-fc5f-48b1-8ecf-57369ea2871b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1699 microversion: 2.1 time: 0.160874 Sep 17 21:27:19.162329 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3016/5950] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:27:18 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1699 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:27:20.184665 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f37df37b-d5c2-4dee-b400-234ef77e1c47 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:27:20.185215 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f37df37b-d5c2-4dee-b400-234ef77e1c47 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:27:20.193052 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f37df37b-d5c2-4dee-b400-234ef77e1c47 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:20.193610 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f37df37b-d5c2-4dee-b400-234ef77e1c47 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:20.194054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f37df37b-d5c2-4dee-b400-234ef77e1c47 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:20.194767 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f37df37b-d5c2-4dee-b400-234ef77e1c47 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:20.195233 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f37df37b-d5c2-4dee-b400-234ef77e1c47 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:20.195694 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f37df37b-d5c2-4dee-b400-234ef77e1c47 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:20.342673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f37df37b-d5c2-4dee-b400-234ef77e1c47 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:27:20.351565 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f37df37b-d5c2-4dee-b400-234ef77e1c47 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1699 microversion: 2.1 time: 0.171050 Sep 17 21:27:20.352162 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2935/5951] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:27:20 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1699 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:27:21.376775 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3d0f6724-b9ac-40aa-9861-43c5ed42ee7b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:27:21.377640 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3d0f6724-b9ac-40aa-9861-43c5ed42ee7b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:27:21.387286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d0f6724-b9ac-40aa-9861-43c5ed42ee7b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:21.387896 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d0f6724-b9ac-40aa-9861-43c5ed42ee7b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:21.388330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d0f6724-b9ac-40aa-9861-43c5ed42ee7b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:21.389254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d0f6724-b9ac-40aa-9861-43c5ed42ee7b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:21.389752 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d0f6724-b9ac-40aa-9861-43c5ed42ee7b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:21.390178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d0f6724-b9ac-40aa-9861-43c5ed42ee7b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:21.874521 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3d0f6724-b9ac-40aa-9861-43c5ed42ee7b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:27:21.893426 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3d0f6724-b9ac-40aa-9861-43c5ed42ee7b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1699 microversion: 2.1 time: 0.521259 Sep 17 21:27:21.894081 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3017/5952] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:27:21 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1699 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:27:22.917198 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3095298f-99c2-4f10-9080-02e67f1a0769 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:27:22.917865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3095298f-99c2-4f10-9080-02e67f1a0769 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:27:22.925636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3095298f-99c2-4f10-9080-02e67f1a0769 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:22.926132 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3095298f-99c2-4f10-9080-02e67f1a0769 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:22.926568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3095298f-99c2-4f10-9080-02e67f1a0769 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:22.927275 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3095298f-99c2-4f10-9080-02e67f1a0769 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:22.927941 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3095298f-99c2-4f10-9080-02e67f1a0769 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:22.928381 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3095298f-99c2-4f10-9080-02e67f1a0769 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:23.145832 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3095298f-99c2-4f10-9080-02e67f1a0769 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:27:23.154585 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3095298f-99c2-4f10-9080-02e67f1a0769 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1699 microversion: 2.1 time: 0.241138 Sep 17 21:27:23.155185 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2936/5953] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:27:22 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1699 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:27:24.182769 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-028acad2-c4ad-496b-b3c7-7099e3cbf9c6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:27:24.183671 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-028acad2-c4ad-496b-b3c7-7099e3cbf9c6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:27:24.193282 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-028acad2-c4ad-496b-b3c7-7099e3cbf9c6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:24.193995 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-028acad2-c4ad-496b-b3c7-7099e3cbf9c6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:24.194460 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-028acad2-c4ad-496b-b3c7-7099e3cbf9c6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:24.195227 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-028acad2-c4ad-496b-b3c7-7099e3cbf9c6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:24.195705 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-028acad2-c4ad-496b-b3c7-7099e3cbf9c6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:24.196152 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-028acad2-c4ad-496b-b3c7-7099e3cbf9c6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:24.342428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-028acad2-c4ad-496b-b3c7-7099e3cbf9c6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:27:24.354778 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-028acad2-c4ad-496b-b3c7-7099e3cbf9c6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1699 microversion: 2.1 time: 0.178607 Sep 17 21:27:24.355554 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3018/5954] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:27:24 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1699 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:27:25.383654 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ca557baa-3b1f-4703-80da-b770d4342ec5 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:27:25.384675 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ca557baa-3b1f-4703-80da-b770d4342ec5 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:27:25.396434 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ca557baa-3b1f-4703-80da-b770d4342ec5 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:25.397340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ca557baa-3b1f-4703-80da-b770d4342ec5 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:25.398125 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ca557baa-3b1f-4703-80da-b770d4342ec5 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:25.399272 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ca557baa-3b1f-4703-80da-b770d4342ec5 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:25.400034 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ca557baa-3b1f-4703-80da-b770d4342ec5 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:25.400840 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ca557baa-3b1f-4703-80da-b770d4342ec5 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:25.542467 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ca557baa-3b1f-4703-80da-b770d4342ec5 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:27:25.554776 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ca557baa-3b1f-4703-80da-b770d4342ec5 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1699 microversion: 2.1 time: 0.177499 Sep 17 21:27:25.555568 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2937/5955] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:27:25 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1699 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:27:26.324965 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-cbf026b3-203d-4477-aebc-9ef920be01f3 req-2b1ec8fb-f041-4da7-9ddb-d5d92aa8e791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a5abc16-dc2e-4c3f-b919-8d1400909144", "name": "network-vif-unplugged", "status": "completed", "tag": "0b6a3229-ce0d-4f57-a3b9-cb997ef0f1b8"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:27:26.339115 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-cbf026b3-203d-4477-aebc-9ef920be01f3 req-2b1ec8fb-f041-4da7-9ddb-d5d92aa8e791 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:26.339611 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-cbf026b3-203d-4477-aebc-9ef920be01f3 req-2b1ec8fb-f041-4da7-9ddb-d5d92aa8e791 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:26.340221 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-cbf026b3-203d-4477-aebc-9ef920be01f3 req-2b1ec8fb-f041-4da7-9ddb-d5d92aa8e791 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:26.357615 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-cbf026b3-203d-4477-aebc-9ef920be01f3 req-2b1ec8fb-f041-4da7-9ddb-d5d92aa8e791 service nova] Creating event network-vif-unplugged:0b6a3229-ce0d-4f57-a3b9-cb997ef0f1b8 for instance 1a5abc16-dc2e-4c3f-b919-8d1400909144 on nch2-master-1 Sep 17 21:27:26.364208 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [req-cbf026b3-203d-4477-aebc-9ef920be01f3 req-2b1ec8fb-f041-4da7-9ddb-d5d92aa8e791 service nova] Instance 1a5abc16-dc2e-4c3f-b919-8d1400909144 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140524) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 21:27:26.376083 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-cbf026b3-203d-4477-aebc-9ef920be01f3 req-2b1ec8fb-f041-4da7-9ddb-d5d92aa8e791 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054795 Sep 17 21:27:26.377160 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3019/5956] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:27:26.582669 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6e42ad5a-2108-478c-8e9f-dbab02e4d16d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:27:26.583281 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6e42ad5a-2108-478c-8e9f-dbab02e4d16d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:27:26.590823 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6e42ad5a-2108-478c-8e9f-dbab02e4d16d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:26.591326 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6e42ad5a-2108-478c-8e9f-dbab02e4d16d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:26.591764 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6e42ad5a-2108-478c-8e9f-dbab02e4d16d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:26.592471 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6e42ad5a-2108-478c-8e9f-dbab02e4d16d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:26.592929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6e42ad5a-2108-478c-8e9f-dbab02e4d16d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:26.593357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6e42ad5a-2108-478c-8e9f-dbab02e4d16d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:26.792641 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6e42ad5a-2108-478c-8e9f-dbab02e4d16d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:27:26.800984 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6e42ad5a-2108-478c-8e9f-dbab02e4d16d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1698 microversion: 2.1 time: 0.222487 Sep 17 21:27:26.801585 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2938/5957] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:27:26 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1698 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:27:27.830874 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a7a70f42-2c5a-4430-995b-8813799da837 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:27:27.831778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a7a70f42-2c5a-4430-995b-8813799da837 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:27:27.840441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7a70f42-2c5a-4430-995b-8813799da837 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:27.841060 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7a70f42-2c5a-4430-995b-8813799da837 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:27.841696 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7a70f42-2c5a-4430-995b-8813799da837 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:27.842607 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7a70f42-2c5a-4430-995b-8813799da837 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:27.843196 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7a70f42-2c5a-4430-995b-8813799da837 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:27.843750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7a70f42-2c5a-4430-995b-8813799da837 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:27.984693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a7a70f42-2c5a-4430-995b-8813799da837 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:27:27.993283 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a7a70f42-2c5a-4430-995b-8813799da837 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1696 microversion: 2.1 time: 0.168031 Sep 17 21:27:27.993912 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3020/5958] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:27:27 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1696 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:27:28.406963 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-ae1cc78c-8e2c-499e-a9db-1005c79978d2 req-a6a3fb5f-7e2f-455f-a72d-2e8edb168e47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a5abc16-dc2e-4c3f-b919-8d1400909144", "tag": "0b6a3229-ce0d-4f57-a3b9-cb997ef0f1b8"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:27:28.418814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-ae1cc78c-8e2c-499e-a9db-1005c79978d2 req-a6a3fb5f-7e2f-455f-a72d-2e8edb168e47 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:28.419304 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-ae1cc78c-8e2c-499e-a9db-1005c79978d2 req-a6a3fb5f-7e2f-455f-a72d-2e8edb168e47 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:28.419739 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-ae1cc78c-8e2c-499e-a9db-1005c79978d2 req-a6a3fb5f-7e2f-455f-a72d-2e8edb168e47 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:28.431856 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-ae1cc78c-8e2c-499e-a9db-1005c79978d2 req-a6a3fb5f-7e2f-455f-a72d-2e8edb168e47 service nova] Creating event network-changed:0b6a3229-ce0d-4f57-a3b9-cb997ef0f1b8 for instance 1a5abc16-dc2e-4c3f-b919-8d1400909144 on nch2-master-1 Sep 17 21:27:28.437699 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [req-ae1cc78c-8e2c-499e-a9db-1005c79978d2 req-a6a3fb5f-7e2f-455f-a72d-2e8edb168e47 service nova] Instance 1a5abc16-dc2e-4c3f-b919-8d1400909144 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140523) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 21:27:28.448552 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-ae1cc78c-8e2c-499e-a9db-1005c79978d2 req-a6a3fb5f-7e2f-455f-a72d-2e8edb168e47 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048090 Sep 17 21:27:28.449143 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2939/5959] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:27:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:27:29.016742 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-81122ba9-9b6c-44d6-9587-bf9fba3a049b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:27:29.017404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-81122ba9-9b6c-44d6-9587-bf9fba3a049b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:27:29.024946 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-81122ba9-9b6c-44d6-9587-bf9fba3a049b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:29.025454 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-81122ba9-9b6c-44d6-9587-bf9fba3a049b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:29.025936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-81122ba9-9b6c-44d6-9587-bf9fba3a049b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:29.026655 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-81122ba9-9b6c-44d6-9587-bf9fba3a049b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:29.027123 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-81122ba9-9b6c-44d6-9587-bf9fba3a049b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:29.027571 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-81122ba9-9b6c-44d6-9587-bf9fba3a049b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:29.246159 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-81122ba9-9b6c-44d6-9587-bf9fba3a049b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:27:29.254492 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-81122ba9-9b6c-44d6-9587-bf9fba3a049b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1696 microversion: 2.1 time: 0.241776 Sep 17 21:27:29.255053 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3021/5960] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:27:29 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1696 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:27:30.279960 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-45cecc03-0ffa-4627-b788-11cad37d7fe0 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:27:30.280741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-45cecc03-0ffa-4627-b788-11cad37d7fe0 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:27:30.287271 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45cecc03-0ffa-4627-b788-11cad37d7fe0 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:30.287785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45cecc03-0ffa-4627-b788-11cad37d7fe0 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:30.288226 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45cecc03-0ffa-4627-b788-11cad37d7fe0 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:30.288938 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45cecc03-0ffa-4627-b788-11cad37d7fe0 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:30.289394 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45cecc03-0ffa-4627-b788-11cad37d7fe0 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:30.289861 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45cecc03-0ffa-4627-b788-11cad37d7fe0 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:30.431170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-45cecc03-0ffa-4627-b788-11cad37d7fe0 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:27:30.439203 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-45cecc03-0ffa-4627-b788-11cad37d7fe0 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1693 microversion: 2.1 time: 0.164851 Sep 17 21:27:30.439795 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2940/5961] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:27:30 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:27:30.462193 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b22ce831-98b2-47d2-afb1-ed2678737976 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:27:30.462886 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b22ce831-98b2-47d2-afb1-ed2678737976 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:27:30.465933 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:27:30.471400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b22ce831-98b2-47d2-afb1-ed2678737976 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:30.472044 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b22ce831-98b2-47d2-afb1-ed2678737976 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:30.472575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b22ce831-98b2-47d2-afb1-ed2678737976 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:30.473315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b22ce831-98b2-47d2-afb1-ed2678737976 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:30.473824 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b22ce831-98b2-47d2-afb1-ed2678737976 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:30.474275 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b22ce831-98b2-47d2-afb1-ed2678737976 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:30.479100 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:27:30.538014 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b22ce831-98b2-47d2-afb1-ed2678737976 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "POST /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144/action" status: 204 len: 0 microversion: 2.1 time: 0.079694 Sep 17 21:27:30.538656 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3022/5962] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:27:30 2022] POST /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:27:30.547832 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4c637e82-1f84-4152-9b51-cf9233ef345b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:27:30.548545 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4c637e82-1f84-4152-9b51-cf9233ef345b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:27:30.555503 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c637e82-1f84-4152-9b51-cf9233ef345b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:30.555993 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c637e82-1f84-4152-9b51-cf9233ef345b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:30.556707 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c637e82-1f84-4152-9b51-cf9233ef345b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:30.557724 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c637e82-1f84-4152-9b51-cf9233ef345b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:30.558263 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c637e82-1f84-4152-9b51-cf9233ef345b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:30.558822 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c637e82-1f84-4152-9b51-cf9233ef345b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:30.700460 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4c637e82-1f84-4152-9b51-cf9233ef345b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:27:30.708482 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4c637e82-1f84-4152-9b51-cf9233ef345b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1693 microversion: 2.1 time: 0.165588 Sep 17 21:27:30.709154 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2941/5963] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:27:30 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1693 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:27:31.736056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-18947e9d-dc42-44d5-9099-2d3ee0ca5f5b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:27:31.736750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-18947e9d-dc42-44d5-9099-2d3ee0ca5f5b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:27:31.747523 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18947e9d-dc42-44d5-9099-2d3ee0ca5f5b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:31.748006 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18947e9d-dc42-44d5-9099-2d3ee0ca5f5b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:31.748495 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18947e9d-dc42-44d5-9099-2d3ee0ca5f5b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:31.751993 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18947e9d-dc42-44d5-9099-2d3ee0ca5f5b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:31.754747 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18947e9d-dc42-44d5-9099-2d3ee0ca5f5b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:31.757509 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-18947e9d-dc42-44d5-9099-2d3ee0ca5f5b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:31.900030 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-18947e9d-dc42-44d5-9099-2d3ee0ca5f5b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:27:31.908612 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-18947e9d-dc42-44d5-9099-2d3ee0ca5f5b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1693 microversion: 2.1 time: 0.180213 Sep 17 21:27:31.909227 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3023/5964] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:27:31 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1693 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:27:32.348373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-02047dc4-ac63-499d-bed4-4ca8618bf3e7 req-c03e7e6c-74e8-4b9f-8d12-067157c3fe38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a5abc16-dc2e-4c3f-b919-8d1400909144", "name": "network-vif-plugged", "status": "completed", "tag": "0b6a3229-ce0d-4f57-a3b9-cb997ef0f1b8"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:27:32.358534 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-02047dc4-ac63-499d-bed4-4ca8618bf3e7 req-c03e7e6c-74e8-4b9f-8d12-067157c3fe38 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:32.359013 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-02047dc4-ac63-499d-bed4-4ca8618bf3e7 req-c03e7e6c-74e8-4b9f-8d12-067157c3fe38 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:32.359446 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-02047dc4-ac63-499d-bed4-4ca8618bf3e7 req-c03e7e6c-74e8-4b9f-8d12-067157c3fe38 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:32.371499 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-02047dc4-ac63-499d-bed4-4ca8618bf3e7 req-c03e7e6c-74e8-4b9f-8d12-067157c3fe38 service nova] Creating event network-vif-plugged:0b6a3229-ce0d-4f57-a3b9-cb997ef0f1b8 for instance 1a5abc16-dc2e-4c3f-b919-8d1400909144 on nch2-master-1 Sep 17 21:27:32.376765 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-02047dc4-ac63-499d-bed4-4ca8618bf3e7 req-c03e7e6c-74e8-4b9f-8d12-067157c3fe38 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224195 Sep 17 21:27:32.377369 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2942/5965] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:27:32.931597 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4aaaaa42-279c-4d1f-9f75-8e2bd4245028 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:27:32.932253 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4aaaaa42-279c-4d1f-9f75-8e2bd4245028 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:27:32.939766 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4aaaaa42-279c-4d1f-9f75-8e2bd4245028 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:32.940279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4aaaaa42-279c-4d1f-9f75-8e2bd4245028 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:32.940738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4aaaaa42-279c-4d1f-9f75-8e2bd4245028 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:32.941488 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4aaaaa42-279c-4d1f-9f75-8e2bd4245028 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:32.941942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4aaaaa42-279c-4d1f-9f75-8e2bd4245028 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:32.942424 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4aaaaa42-279c-4d1f-9f75-8e2bd4245028 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:33.079994 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4aaaaa42-279c-4d1f-9f75-8e2bd4245028 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:27:33.088271 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4aaaaa42-279c-4d1f-9f75-8e2bd4245028 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1685 microversion: 2.1 time: 0.160757 Sep 17 21:27:33.088831 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3024/5966] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:27:32 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:27:55.315504 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:27:55.316369 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:27:55.322270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ced0b751-ae9c-4255-a962-0d55e1e52448 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:27:55.324766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ced0b751-ae9c-4255-a962-0d55e1e52448 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:27:55.335057 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ced0b751-ae9c-4255-a962-0d55e1e52448 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:55.335590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ced0b751-ae9c-4255-a962-0d55e1e52448 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:55.336075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ced0b751-ae9c-4255-a962-0d55e1e52448 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:55.336946 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ced0b751-ae9c-4255-a962-0d55e1e52448 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:27:55.337398 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ced0b751-ae9c-4255-a962-0d55e1e52448 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:27:55.337864 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ced0b751-ae9c-4255-a962-0d55e1e52448 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:27:55.397935 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ced0b751-ae9c-4255-a962-0d55e1e52448 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "POST /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144/action" status: 200 len: 24573 microversion: 2.1 time: 0.084467 Sep 17 21:27:55.398570 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2943/5967] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:27:55 2022] POST /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144/action => generated 24573 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:28:01.638963 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3f9c74db-4af2-44a3-a1ed-013e3d6e84a1 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:01.639921 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3f9c74db-4af2-44a3-a1ed-013e3d6e84a1 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:01.644188 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=5 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:28:01.645210 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:28:01.654937 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f9c74db-4af2-44a3-a1ed-013e3d6e84a1 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:01.655442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f9c74db-4af2-44a3-a1ed-013e3d6e84a1 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:01.655901 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f9c74db-4af2-44a3-a1ed-013e3d6e84a1 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:01.656610 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f9c74db-4af2-44a3-a1ed-013e3d6e84a1 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:01.657083 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f9c74db-4af2-44a3-a1ed-013e3d6e84a1 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:01.657536 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3f9c74db-4af2-44a3-a1ed-013e3d6e84a1 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:01.792557 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3f9c74db-4af2-44a3-a1ed-013e3d6e84a1 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1836 microversion: 2.1 time: 0.159466 Sep 17 21:28:01.793190 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3025/5968] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:28:01 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1836 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:28:03.059852 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-49575ef9-3499-4e87-a71e-978c63baa7da tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:03.060477 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-49575ef9-3499-4e87-a71e-978c63baa7da tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:03.068973 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49575ef9-3499-4e87-a71e-978c63baa7da tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:03.069573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49575ef9-3499-4e87-a71e-978c63baa7da tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:03.070510 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49575ef9-3499-4e87-a71e-978c63baa7da tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:03.071118 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49575ef9-3499-4e87-a71e-978c63baa7da tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:03.071658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49575ef9-3499-4e87-a71e-978c63baa7da tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:03.072161 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-49575ef9-3499-4e87-a71e-978c63baa7da tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:03.099126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-49575ef9-3499-4e87-a71e-978c63baa7da tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:28:03.136047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-77021142-3077-463d-81ef-df22da3be024 req-95a13e8c-4248-4bdc-9875-d05f700b0a85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a5abc16-dc2e-4c3f-b919-8d1400909144", "tag": "0b6a3229-ce0d-4f57-a3b9-cb997ef0f1b8"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:28:03.147110 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-77021142-3077-463d-81ef-df22da3be024 req-95a13e8c-4248-4bdc-9875-d05f700b0a85 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:03.147626 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-77021142-3077-463d-81ef-df22da3be024 req-95a13e8c-4248-4bdc-9875-d05f700b0a85 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:03.148058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-77021142-3077-463d-81ef-df22da3be024 req-95a13e8c-4248-4bdc-9875-d05f700b0a85 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:03.163974 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-77021142-3077-463d-81ef-df22da3be024 req-95a13e8c-4248-4bdc-9875-d05f700b0a85 service nova] Creating event network-changed:0b6a3229-ce0d-4f57-a3b9-cb997ef0f1b8 for instance 1a5abc16-dc2e-4c3f-b919-8d1400909144 on nch2-master-1 Sep 17 21:28:03.169944 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-77021142-3077-463d-81ef-df22da3be024 req-95a13e8c-4248-4bdc-9875-d05f700b0a85 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112302 Sep 17 21:28:03.173744 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3026/5969] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:28:03.197555 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-49575ef9-3499-4e87-a71e-978c63baa7da tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 204 len: 0 microversion: 2.1 time: 0.141711 Sep 17 21:28:03.198496 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2944/5970] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:28:03 2022] DELETE /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:28:03.207946 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1e365b22-6ade-4ed7-8f44-5dabc034d934 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:03.208671 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1e365b22-6ade-4ed7-8f44-5dabc034d934 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:03.215654 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e365b22-6ade-4ed7-8f44-5dabc034d934 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:03.216159 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e365b22-6ade-4ed7-8f44-5dabc034d934 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:03.216834 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e365b22-6ade-4ed7-8f44-5dabc034d934 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:03.217597 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e365b22-6ade-4ed7-8f44-5dabc034d934 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:03.218234 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e365b22-6ade-4ed7-8f44-5dabc034d934 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:03.218710 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e365b22-6ade-4ed7-8f44-5dabc034d934 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:03.364182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1e365b22-6ade-4ed7-8f44-5dabc034d934 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:28:03.372405 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1e365b22-6ade-4ed7-8f44-5dabc034d934 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1691 microversion: 2.1 time: 0.169016 Sep 17 21:28:03.373696 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3027/5971] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:28:03 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:28:04.397501 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4f7901d0-4f63-4c11-9ae6-82c20315a7b8 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:04.398607 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4f7901d0-4f63-4c11-9ae6-82c20315a7b8 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:04.406818 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f7901d0-4f63-4c11-9ae6-82c20315a7b8 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:04.407312 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f7901d0-4f63-4c11-9ae6-82c20315a7b8 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:04.407748 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f7901d0-4f63-4c11-9ae6-82c20315a7b8 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:04.408456 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f7901d0-4f63-4c11-9ae6-82c20315a7b8 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:04.409003 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f7901d0-4f63-4c11-9ae6-82c20315a7b8 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:04.409341 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4f7901d0-4f63-4c11-9ae6-82c20315a7b8 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:04.637096 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4f7901d0-4f63-4c11-9ae6-82c20315a7b8 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:28:04.647356 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4f7901d0-4f63-4c11-9ae6-82c20315a7b8 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 200 len: 1691 microversion: 2.1 time: 0.254134 Sep 17 21:28:04.647926 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2945/5972] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:28:04 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 1691 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:28:05.185262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-80dfe817-c81e-45fd-9b43-917dfa7b80a7 req-0fac6ab9-a5d3-4646-886c-317b5b1644f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a5abc16-dc2e-4c3f-b919-8d1400909144", "name": "network-vif-deleted", "tag": "0b6a3229-ce0d-4f57-a3b9-cb997ef0f1b8"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:28:05.196102 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-80dfe817-c81e-45fd-9b43-917dfa7b80a7 req-0fac6ab9-a5d3-4646-886c-317b5b1644f8 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:05.196616 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-80dfe817-c81e-45fd-9b43-917dfa7b80a7 req-0fac6ab9-a5d3-4646-886c-317b5b1644f8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:05.197076 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-80dfe817-c81e-45fd-9b43-917dfa7b80a7 req-0fac6ab9-a5d3-4646-886c-317b5b1644f8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:05.209692 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-80dfe817-c81e-45fd-9b43-917dfa7b80a7 req-0fac6ab9-a5d3-4646-886c-317b5b1644f8 service nova] Creating event network-vif-deleted:0b6a3229-ce0d-4f57-a3b9-cb997ef0f1b8 for instance 1a5abc16-dc2e-4c3f-b919-8d1400909144 on nch2-master-1 Sep 17 21:28:05.215005 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-80dfe817-c81e-45fd-9b43-917dfa7b80a7 req-0fac6ab9-a5d3-4646-886c-317b5b1644f8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033437 Sep 17 21:28:05.215626 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3028/5973] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:28:05.671379 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9524845a-3ac0-4b3a-81ce-960c86b28d3f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:05.671972 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9524845a-3ac0-4b3a-81ce-960c86b28d3f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 1a5abc16-dc2e-4c3f-b919-8d1400909144] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:05.679933 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9524845a-3ac0-4b3a-81ce-960c86b28d3f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:05.680444 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9524845a-3ac0-4b3a-81ce-960c86b28d3f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:05.680876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9524845a-3ac0-4b3a-81ce-960c86b28d3f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:05.681633 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9524845a-3ac0-4b3a-81ce-960c86b28d3f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:05.682101 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9524845a-3ac0-4b3a-81ce-960c86b28d3f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:05.682542 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9524845a-3ac0-4b3a-81ce-960c86b28d3f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:05.697751 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-9524845a-3ac0-4b3a-81ce-960c86b28d3f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] HTTP exception thrown: Instance 1a5abc16-dc2e-4c3f-b919-8d1400909144 could not be found. Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9524845a-3ac0-4b3a-81ce-960c86b28d3f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Request method failure captured: Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 HTTP/1.1 Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjt1HGD-AGecBeXKG-Tv1X03jkbjY02aJ3vfhgY7AyhVE2LrBQ6rG6j8P8XaKvJajIa-Tr-B_mPCCFATHv-I927Mv8bDNOk0IIJoeqei7Daucjc-FPiGYYkt6YVWEtLmPt9TcFJzteSZ58GSfRYwBLV5RLbestURdkZQMGtWKaf5y9w Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: b67de414e1aa4fde9ed87336f30c2767 Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1107857406 Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b67de414e1aa4fde9ed87336f30c2767"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b67de414e1aa4fde9ed87336f30c2767"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b67de414e1aa4fde9ed87336f30c2767"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b67de414e1aa4fde9ed87336f30c2767", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1107857406 Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: b67de414e1aa4fde9ed87336f30c2767 Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1107857406 Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-TestNetworkAdvancedServerOps-1107857406-project Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 3cb55865ecad4c05adc52a1aacd2aa10 Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1107857406-project Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 1a5abc16-dc2e-4c3f-b919-8d1400909144 could not be found. Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '1a5abc16-dc2e-4c3f-b919-8d1400909144'} Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a5abc16-dc2e-4c3f-b919-8d1400909144 could not be found. Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a5abc16-dc2e-4c3f-b919-8d1400909144 could not be found. Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:28:05.699567 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:28:05.704180 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:28:05.704180 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:28:05.704180 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:28:05.704180 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:28:05.704180 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:28:05.704180 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:28:05.704180 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a5abc16-dc2e-4c3f-b919-8d1400909144 could not be found. Sep 17 21:28:05.704180 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:28:05.704180 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9524845a-3ac0-4b3a-81ce-960c86b28d3f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Returning 404 to user: Instance 1a5abc16-dc2e-4c3f-b919-8d1400909144 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:28:05.704180 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9524845a-3ac0-4b3a-81ce-960c86b28d3f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144" status: 404 len: 111 microversion: 2.1 time: 0.033806 Sep 17 21:28:05.704180 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2946/5974] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:28:05 2022] GET /compute/v2.1/servers/1a5abc16-dc2e-4c3f-b919-8d1400909144 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:28:09.236123 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f3cb0458-e202-4277-9d72-fb3d72c24303 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '.version_select at 0x7f25a9f8e670>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:09.262981 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f3cb0458-e202-4277-9d72-fb3d72c24303 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1118169949" status: 202 len: 0 microversion: 2.1 time: 0.035918 Sep 17 21:28:09.263769 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3029/5975] 10.222.0.26 () {58 vars in 1284 bytes} [Sat Sep 17 21:28:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1118169949 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:28:09.294191 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9c670af2-b45a-4dab-92e5-ff1b7704cbb2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Action: 'create', calling method: .version_select at 0x7f25a45f8700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1919570747", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNq5de5+xhECV1vfDshlaBceddoLH4zcFg0fLLNYYIkCWDKZZpPcFpLc2tum1cYxcaYP8odfYa962W49f05ZgvepalnlReNWq60dhJZ/DK2Sv3VaMpEJE3dp8Yyj5opybg=="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:28:09.312249 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-9c670af2-b45a-4dab-92e5-ff1b7704cbb2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Getting quotas for project b67de414e1aa4fde9ed87336f30c2767. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:28:09.318005 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-9c670af2-b45a-4dab-92e5-ff1b7704cbb2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Getting quotas for user 3cb55865ecad4c05adc52a1aacd2aa10 and project b67de414e1aa4fde9ed87336f30c2767. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:28:09.343328 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9c670af2-b45a-4dab-92e5-ff1b7704cbb2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054103 Sep 17 21:28:09.344119 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2947/5976] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:28:09 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:28:15.332996 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=16 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:28:15.338049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9f414793-a038-4231-98e4-11f3a9c628ef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1977715539", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "c02bd4ac-17c2-4d8b-b841-0e40699e9e71"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1919570747", "security_groups": [{"name": "tempest-secgroup-smoke-1774431817"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:28:15.468827 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-9f414793-a038-4231-98e4-11f3a9c628ef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] validate_networks() for [('c02bd4ac-17c2-4d8b-b841-0e40699e9e71', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:28:15.974838 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-9f414793-a038-4231-98e4-11f3a9c628ef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:28:15.975480 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-9f414793-a038-4231-98e4-11f3a9c628ef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:28:15.976135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-9f414793-a038-4231-98e4-11f3a9c628ef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:28:15.976720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-9f414793-a038-4231-98e4-11f3a9c628ef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:28:15.977305 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-9f414793-a038-4231-98e4-11f3a9c628ef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:28:15.990060 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9f414793-a038-4231-98e4-11f3a9c628ef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:15.991013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9f414793-a038-4231-98e4-11f3a9c628ef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:15.991470 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9f414793-a038-4231-98e4-11f3a9c628ef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:15.992667 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9f414793-a038-4231-98e4-11f3a9c628ef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:15.993173 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9f414793-a038-4231-98e4-11f3a9c628ef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:15.994245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9f414793-a038-4231-98e4-11f3a9c628ef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:16.015366 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-9f414793-a038-4231-98e4-11f3a9c628ef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Getting quotas for project b67de414e1aa4fde9ed87336f30c2767. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:28:16.021012 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-9f414793-a038-4231-98e4-11f3a9c628ef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Getting quotas for user 3cb55865ecad4c05adc52a1aacd2aa10 and project b67de414e1aa4fde9ed87336f30c2767. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:28:16.037754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9f414793-a038-4231-98e4-11f3a9c628ef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:28:16.040276 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9f414793-a038-4231-98e4-11f3a9c628ef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:28:16.098733 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9f414793-a038-4231-98e4-11f3a9c628ef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.766774 Sep 17 21:28:16.100533 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3030/5977] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:28:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:28:16.113355 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8b12bf7d-6964-4421-b0ed-fb766ad8981c tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:16.114610 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8b12bf7d-6964-4421-b0ed-fb766ad8981c tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:16.122746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:28:16.197950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8b12bf7d-6964-4421-b0ed-fb766ad8981c tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:28:16.207073 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8b12bf7d-6964-4421-b0ed-fb766ad8981c tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1267 microversion: 2.1 time: 0.099416 Sep 17 21:28:16.207901 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2948/5978] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:28:16 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1267 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:28:17.231652 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8d7e11f7-ce69-41c8-86aa-20b6aa408ed4 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:17.232265 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8d7e11f7-ce69-41c8-86aa-20b6aa408ed4 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:17.241698 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d7e11f7-ce69-41c8-86aa-20b6aa408ed4 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:17.242215 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d7e11f7-ce69-41c8-86aa-20b6aa408ed4 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:17.242751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d7e11f7-ce69-41c8-86aa-20b6aa408ed4 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:17.243471 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d7e11f7-ce69-41c8-86aa-20b6aa408ed4 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:17.244177 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d7e11f7-ce69-41c8-86aa-20b6aa408ed4 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:17.244813 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d7e11f7-ce69-41c8-86aa-20b6aa408ed4 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:17.322902 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8d7e11f7-ce69-41c8-86aa-20b6aa408ed4 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:28:17.331836 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8d7e11f7-ce69-41c8-86aa-20b6aa408ed4 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1327 microversion: 2.1 time: 0.104086 Sep 17 21:28:17.337891 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3031/5979] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:28:17 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1327 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:28:18.355489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-20aec7d9-804e-4fdd-ab8c-5044798e62db tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:18.356112 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-20aec7d9-804e-4fdd-ab8c-5044798e62db tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:18.363899 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20aec7d9-804e-4fdd-ab8c-5044798e62db tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:18.364395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20aec7d9-804e-4fdd-ab8c-5044798e62db tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:18.364842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20aec7d9-804e-4fdd-ab8c-5044798e62db tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:18.365595 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20aec7d9-804e-4fdd-ab8c-5044798e62db tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:18.366063 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20aec7d9-804e-4fdd-ab8c-5044798e62db tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:18.366498 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20aec7d9-804e-4fdd-ab8c-5044798e62db tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:18.503961 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-20aec7d9-804e-4fdd-ab8c-5044798e62db tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:28:18.512081 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-20aec7d9-804e-4fdd-ab8c-5044798e62db tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1393 microversion: 2.1 time: 0.160681 Sep 17 21:28:18.512693 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2949/5980] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:28:18 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:28:18.792603 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-3cc7c219-3402-4449-a705-c33411775682 req-72443f1c-eb49-46f4-b7c2-657952c0cd99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79ba1cf6-9ca8-49de-95ac-bab9ee572c82", "tag": "5744f71f-5b9f-4347-b063-bae68953657c"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:28:18.803211 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-3cc7c219-3402-4449-a705-c33411775682 req-72443f1c-eb49-46f4-b7c2-657952c0cd99 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:18.803713 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-3cc7c219-3402-4449-a705-c33411775682 req-72443f1c-eb49-46f4-b7c2-657952c0cd99 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:18.804166 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-3cc7c219-3402-4449-a705-c33411775682 req-72443f1c-eb49-46f4-b7c2-657952c0cd99 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:18.816239 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-3cc7c219-3402-4449-a705-c33411775682 req-72443f1c-eb49-46f4-b7c2-657952c0cd99 service nova] Creating event network-changed:5744f71f-5b9f-4347-b063-bae68953657c for instance 79ba1cf6-9ca8-49de-95ac-bab9ee572c82 on nch2-master-1 Sep 17 21:28:18.821744 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-3cc7c219-3402-4449-a705-c33411775682 req-72443f1c-eb49-46f4-b7c2-657952c0cd99 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033154 Sep 17 21:28:18.822552 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3032/5981] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:28:19.538906 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-66249840-3528-4b4d-b9b0-41e3306c0084 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:19.539851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-66249840-3528-4b4d-b9b0-41e3306c0084 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:19.551912 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-66249840-3528-4b4d-b9b0-41e3306c0084 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:19.552942 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-66249840-3528-4b4d-b9b0-41e3306c0084 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:19.553721 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-66249840-3528-4b4d-b9b0-41e3306c0084 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:19.554882 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-66249840-3528-4b4d-b9b0-41e3306c0084 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:19.555636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-66249840-3528-4b4d-b9b0-41e3306c0084 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:19.556393 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-66249840-3528-4b4d-b9b0-41e3306c0084 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:19.702523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-66249840-3528-4b4d-b9b0-41e3306c0084 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:28:19.710786 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-66249840-3528-4b4d-b9b0-41e3306c0084 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1393 microversion: 2.1 time: 0.178761 Sep 17 21:28:19.711379 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2950/5982] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:28:19 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1393 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:28:20.737443 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1c1cac22-a1de-4f1d-9382-0e17ceebbf71 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:20.738416 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1c1cac22-a1de-4f1d-9382-0e17ceebbf71 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:20.747328 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c1cac22-a1de-4f1d-9382-0e17ceebbf71 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:20.747995 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c1cac22-a1de-4f1d-9382-0e17ceebbf71 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:20.748597 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c1cac22-a1de-4f1d-9382-0e17ceebbf71 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:20.749546 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c1cac22-a1de-4f1d-9382-0e17ceebbf71 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:20.750210 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c1cac22-a1de-4f1d-9382-0e17ceebbf71 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:20.750805 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1c1cac22-a1de-4f1d-9382-0e17ceebbf71 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:20.894754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1c1cac22-a1de-4f1d-9382-0e17ceebbf71 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:28:20.903154 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1c1cac22-a1de-4f1d-9382-0e17ceebbf71 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1393 microversion: 2.1 time: 0.173108 Sep 17 21:28:20.903739 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3033/5983] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:28:20 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1393 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:28:21.926572 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b43142af-6f80-49ee-81f4-2d6b0bdaf522 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:21.927127 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b43142af-6f80-49ee-81f4-2d6b0bdaf522 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:21.934795 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b43142af-6f80-49ee-81f4-2d6b0bdaf522 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:21.935282 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b43142af-6f80-49ee-81f4-2d6b0bdaf522 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:21.935725 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b43142af-6f80-49ee-81f4-2d6b0bdaf522 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:21.936428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b43142af-6f80-49ee-81f4-2d6b0bdaf522 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:21.936883 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b43142af-6f80-49ee-81f4-2d6b0bdaf522 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:21.937315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b43142af-6f80-49ee-81f4-2d6b0bdaf522 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:22.077665 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b43142af-6f80-49ee-81f4-2d6b0bdaf522 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:28:22.089372 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b43142af-6f80-49ee-81f4-2d6b0bdaf522 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1393 microversion: 2.1 time: 0.166757 Sep 17 21:28:22.090173 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2951/5984] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:28:21 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:28:23.117158 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-53ac4231-ea1f-4fa5-80e9-9fef3a749204 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:23.118235 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-53ac4231-ea1f-4fa5-80e9-9fef3a749204 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:23.131405 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53ac4231-ea1f-4fa5-80e9-9fef3a749204 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:23.132296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53ac4231-ea1f-4fa5-80e9-9fef3a749204 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:23.133055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53ac4231-ea1f-4fa5-80e9-9fef3a749204 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:23.134284 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53ac4231-ea1f-4fa5-80e9-9fef3a749204 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:23.135065 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53ac4231-ea1f-4fa5-80e9-9fef3a749204 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:23.135811 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-53ac4231-ea1f-4fa5-80e9-9fef3a749204 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:23.288476 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-53ac4231-ea1f-4fa5-80e9-9fef3a749204 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:28:23.296690 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-53ac4231-ea1f-4fa5-80e9-9fef3a749204 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1393 microversion: 2.1 time: 0.187137 Sep 17 21:28:23.297270 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3034/5985] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:28:23 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1393 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:28:24.319880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-133d1a2c-5a6f-49c2-b71c-56d0aabb9fe7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:24.320564 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-133d1a2c-5a6f-49c2-b71c-56d0aabb9fe7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:24.328845 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-133d1a2c-5a6f-49c2-b71c-56d0aabb9fe7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:24.330601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-133d1a2c-5a6f-49c2-b71c-56d0aabb9fe7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:24.330601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-133d1a2c-5a6f-49c2-b71c-56d0aabb9fe7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:24.330846 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-133d1a2c-5a6f-49c2-b71c-56d0aabb9fe7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:24.331192 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-133d1a2c-5a6f-49c2-b71c-56d0aabb9fe7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:24.331626 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-133d1a2c-5a6f-49c2-b71c-56d0aabb9fe7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:24.440346 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-f316879d-9650-4466-8c41-b1244fc70fdd req-cb71ace9-3372-4d13-9f0e-3f43302b3763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ba1cf6-9ca8-49de-95ac-bab9ee572c82", "name": "network-vif-plugged", "status": "completed", "tag": "5744f71f-5b9f-4347-b063-bae68953657c"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:28:24.454165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f316879d-9650-4466-8c41-b1244fc70fdd req-cb71ace9-3372-4d13-9f0e-3f43302b3763 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:24.454682 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f316879d-9650-4466-8c41-b1244fc70fdd req-cb71ace9-3372-4d13-9f0e-3f43302b3763 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:24.455169 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f316879d-9650-4466-8c41-b1244fc70fdd req-cb71ace9-3372-4d13-9f0e-3f43302b3763 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:24.469907 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-133d1a2c-5a6f-49c2-b71c-56d0aabb9fe7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:28:24.478731 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-133d1a2c-5a6f-49c2-b71c-56d0aabb9fe7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1393 microversion: 2.1 time: 0.162796 Sep 17 21:28:24.479326 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2952/5986] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:28:24 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:28:24.481744 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-f316879d-9650-4466-8c41-b1244fc70fdd req-cb71ace9-3372-4d13-9f0e-3f43302b3763 service nova] Creating event network-vif-plugged:5744f71f-5b9f-4347-b063-bae68953657c for instance 79ba1cf6-9ca8-49de-95ac-bab9ee572c82 on nch2-master-1 Sep 17 21:28:24.487459 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-f316879d-9650-4466-8c41-b1244fc70fdd req-cb71ace9-3372-4d13-9f0e-3f43302b3763 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051067 Sep 17 21:28:24.488390 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3035/5987] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:28:25.506205 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8c7b5010-7680-4570-b221-f86574ca33cf tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:25.507251 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8c7b5010-7680-4570-b221-f86574ca33cf tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:25.511510 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:28:25.520639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c7b5010-7680-4570-b221-f86574ca33cf tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:25.521540 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c7b5010-7680-4570-b221-f86574ca33cf tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:25.522288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c7b5010-7680-4570-b221-f86574ca33cf tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:25.523448 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c7b5010-7680-4570-b221-f86574ca33cf tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:25.524209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c7b5010-7680-4570-b221-f86574ca33cf tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:25.524919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c7b5010-7680-4570-b221-f86574ca33cf tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:25.666001 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8c7b5010-7680-4570-b221-f86574ca33cf tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:28:25.675457 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8c7b5010-7680-4570-b221-f86574ca33cf tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1393 microversion: 2.1 time: 0.175334 Sep 17 21:28:25.676932 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2953/5988] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:28:25 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1393 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:28:26.174302 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:28:26.175295 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=6 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:28:26.180523 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cbbf1726-22a4-44fa-9d29-6425b5858b78 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:26.181267 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cbbf1726-22a4-44fa-9d29-6425b5858b78 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:26.190324 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbbf1726-22a4-44fa-9d29-6425b5858b78 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:26.190951 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbbf1726-22a4-44fa-9d29-6425b5858b78 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:26.191519 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbbf1726-22a4-44fa-9d29-6425b5858b78 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:26.192409 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbbf1726-22a4-44fa-9d29-6425b5858b78 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:26.192996 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbbf1726-22a4-44fa-9d29-6425b5858b78 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:26.193594 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cbbf1726-22a4-44fa-9d29-6425b5858b78 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:26.220167 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cbbf1726-22a4-44fa-9d29-6425b5858b78 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:28:26.306029 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cbbf1726-22a4-44fa-9d29-6425b5858b78 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "DELETE /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec" status: 204 len: 0 microversion: 2.1 time: 0.133472 Sep 17 21:28:26.306485 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3036/5989] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:28:26 2022] DELETE /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:28:26.315015 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-409ecd65-93c5-4359-bd6f-52ab375e7881 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:26.315614 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-409ecd65-93c5-4359-bd6f-52ab375e7881 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:26.317818 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:28:26.324013 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-409ecd65-93c5-4359-bd6f-52ab375e7881 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:26.324512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-409ecd65-93c5-4359-bd6f-52ab375e7881 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:26.324984 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-409ecd65-93c5-4359-bd6f-52ab375e7881 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:26.325765 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-409ecd65-93c5-4359-bd6f-52ab375e7881 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:26.326241 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-409ecd65-93c5-4359-bd6f-52ab375e7881 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:26.326667 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-409ecd65-93c5-4359-bd6f-52ab375e7881 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:26.466615 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-409ecd65-93c5-4359-bd6f-52ab375e7881 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:28:26.474929 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-409ecd65-93c5-4359-bd6f-52ab375e7881 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec" status: 200 len: 1579 microversion: 2.1 time: 0.163931 Sep 17 21:28:26.475507 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2954/5990] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:28:26 2022] GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec => generated 1579 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:28:26.700736 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8e334981-b1b9-4b4d-97c9-11b07fed6189 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:26.701483 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8e334981-b1b9-4b4d-97c9-11b07fed6189 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:26.708187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e334981-b1b9-4b4d-97c9-11b07fed6189 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:26.708724 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e334981-b1b9-4b4d-97c9-11b07fed6189 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:26.709180 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e334981-b1b9-4b4d-97c9-11b07fed6189 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:26.709935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e334981-b1b9-4b4d-97c9-11b07fed6189 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:26.710412 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e334981-b1b9-4b4d-97c9-11b07fed6189 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:26.710858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e334981-b1b9-4b4d-97c9-11b07fed6189 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:26.850724 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8e334981-b1b9-4b4d-97c9-11b07fed6189 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:28:26.858963 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8e334981-b1b9-4b4d-97c9-11b07fed6189 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1564 microversion: 2.1 time: 0.162758 Sep 17 21:28:26.859548 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3037/5991] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:28:26 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:28:26.881625 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8c1969e7-18c5-45ed-a615-9808ad48790b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:26.882251 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8c1969e7-18c5-45ed-a615-9808ad48790b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:26.889665 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c1969e7-18c5-45ed-a615-9808ad48790b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:26.890162 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c1969e7-18c5-45ed-a615-9808ad48790b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:26.890610 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c1969e7-18c5-45ed-a615-9808ad48790b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:26.891314 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c1969e7-18c5-45ed-a615-9808ad48790b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:26.891811 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c1969e7-18c5-45ed-a615-9808ad48790b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:26.892204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c1969e7-18c5-45ed-a615-9808ad48790b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:27.032716 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8c1969e7-18c5-45ed-a615-9808ad48790b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:28:27.041068 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8c1969e7-18c5-45ed-a615-9808ad48790b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1564 microversion: 2.1 time: 0.163407 Sep 17 21:28:27.041688 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2955/5992] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:28:26 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:28:27.498791 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b1984695-b0f4-45e0-a61c-030439edbd9c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:27.499620 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b1984695-b0f4-45e0-a61c-030439edbd9c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:27.506728 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1984695-b0f4-45e0-a61c-030439edbd9c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:27.507261 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1984695-b0f4-45e0-a61c-030439edbd9c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:27.507708 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1984695-b0f4-45e0-a61c-030439edbd9c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:27.508456 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1984695-b0f4-45e0-a61c-030439edbd9c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:27.509212 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1984695-b0f4-45e0-a61c-030439edbd9c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:27.510698 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1984695-b0f4-45e0-a61c-030439edbd9c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:27.734623 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b1984695-b0f4-45e0-a61c-030439edbd9c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:28:27.743284 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b1984695-b0f4-45e0-a61c-030439edbd9c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec" status: 200 len: 1579 microversion: 2.1 time: 0.248532 Sep 17 21:28:27.743879 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3038/5993] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:28:27 2022] GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec => generated 1579 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:28:28.655702 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-f8f4f5cc-197a-4af7-8ba9-4c58e11476fe req-ca19c436-e4dd-4136-ac98-900479671c76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24e01588-ddb5-4c16-bd5a-dd6988b0d3ec", "name": "network-vif-deleted", "tag": "8d2fb4fb-9253-4202-b576-2aced08f4489"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:28:28.668498 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f8f4f5cc-197a-4af7-8ba9-4c58e11476fe req-ca19c436-e4dd-4136-ac98-900479671c76 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:28.669330 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f8f4f5cc-197a-4af7-8ba9-4c58e11476fe req-ca19c436-e4dd-4136-ac98-900479671c76 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:28.669911 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f8f4f5cc-197a-4af7-8ba9-4c58e11476fe req-ca19c436-e4dd-4136-ac98-900479671c76 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:28.696113 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-f8f4f5cc-197a-4af7-8ba9-4c58e11476fe req-ca19c436-e4dd-4136-ac98-900479671c76 service nova] Creating event network-vif-deleted:8d2fb4fb-9253-4202-b576-2aced08f4489 for instance 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec on nch1-master-1 Sep 17 21:28:28.720304 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-f8f4f5cc-197a-4af7-8ba9-4c58e11476fe req-ca19c436-e4dd-4136-ac98-900479671c76 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062811 Sep 17 21:28:28.722625 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2956/5994] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:28:28.776462 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-16b4a293-ae0e-40f3-abc1-33e3ec74ab24 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:28.779881 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-16b4a293-ae0e-40f3-abc1-33e3ec74ab24 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:28.801961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-16b4a293-ae0e-40f3-abc1-33e3ec74ab24 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:28.801961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-16b4a293-ae0e-40f3-abc1-33e3ec74ab24 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:28.801961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-16b4a293-ae0e-40f3-abc1-33e3ec74ab24 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:28.805244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-16b4a293-ae0e-40f3-abc1-33e3ec74ab24 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:28.807617 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-16b4a293-ae0e-40f3-abc1-33e3ec74ab24 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:28.809327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-16b4a293-ae0e-40f3-abc1-33e3ec74ab24 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:28.931295 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dd0d27f0-84d9-480a-b0b8-dacc2cd8e0a5 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:28.932322 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dd0d27f0-84d9-480a-b0b8-dacc2cd8e0a5 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:28.933153 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-16b4a293-ae0e-40f3-abc1-33e3ec74ab24 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:28:28.944138 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-16b4a293-ae0e-40f3-abc1-33e3ec74ab24 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec" status: 200 len: 1226 microversion: 2.1 time: 0.180878 Sep 17 21:28:28.945319 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3039/5995] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:28:28 2022] GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec => generated 1226 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:28:28.946558 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd0d27f0-84d9-480a-b0b8-dacc2cd8e0a5 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:28.947197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd0d27f0-84d9-480a-b0b8-dacc2cd8e0a5 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:28.947638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd0d27f0-84d9-480a-b0b8-dacc2cd8e0a5 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:28.948489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd0d27f0-84d9-480a-b0b8-dacc2cd8e0a5 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:28.949370 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd0d27f0-84d9-480a-b0b8-dacc2cd8e0a5 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:28.950050 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dd0d27f0-84d9-480a-b0b8-dacc2cd8e0a5 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:28.968289 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-907166f6-c237-4b74-a2f9-45fd4030a4c0 req-7f01e259-0f06-4094-9386-7228f27f3601 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79ba1cf6-9ca8-49de-95ac-bab9ee572c82", "tag": "5744f71f-5b9f-4347-b063-bae68953657c"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:28:28.992178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-907166f6-c237-4b74-a2f9-45fd4030a4c0 req-7f01e259-0f06-4094-9386-7228f27f3601 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:28.992975 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-907166f6-c237-4b74-a2f9-45fd4030a4c0 req-7f01e259-0f06-4094-9386-7228f27f3601 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:28.994022 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-907166f6-c237-4b74-a2f9-45fd4030a4c0 req-7f01e259-0f06-4094-9386-7228f27f3601 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:29.021400 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-907166f6-c237-4b74-a2f9-45fd4030a4c0 req-7f01e259-0f06-4094-9386-7228f27f3601 service nova] Creating event network-changed:5744f71f-5b9f-4347-b063-bae68953657c for instance 79ba1cf6-9ca8-49de-95ac-bab9ee572c82 on nch2-master-1 Sep 17 21:28:29.040197 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-907166f6-c237-4b74-a2f9-45fd4030a4c0 req-7f01e259-0f06-4094-9386-7228f27f3601 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075877 Sep 17 21:28:29.042235 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3040/5996] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:28:29.184374 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dd0d27f0-84d9-480a-b0b8-dacc2cd8e0a5 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:28:29.194709 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dd0d27f0-84d9-480a-b0b8-dacc2cd8e0a5 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1564 microversion: 2.1 time: 0.267717 Sep 17 21:28:29.198142 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2957/5997] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:28:28 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1564 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:28:29.974656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3c0f7461-92bd-4202-aef2-f342635ab3e4 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:29.975457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3c0f7461-92bd-4202-aef2-f342635ab3e4 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:29.982499 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c0f7461-92bd-4202-aef2-f342635ab3e4 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:29.983080 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c0f7461-92bd-4202-aef2-f342635ab3e4 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:29.983725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c0f7461-92bd-4202-aef2-f342635ab3e4 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:29.984463 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c0f7461-92bd-4202-aef2-f342635ab3e4 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:29.984935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c0f7461-92bd-4202-aef2-f342635ab3e4 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:29.985372 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c0f7461-92bd-4202-aef2-f342635ab3e4 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:30.000130 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-3c0f7461-92bd-4202-aef2-f342635ab3e4 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] HTTP exception thrown: Instance 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec could not be found. Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3c0f7461-92bd-4202-aef2-f342635ab3e4 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Request method failure captured: Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec HTTP/1.1 Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjrvOiuthjFaTfhYt50z8pDXrt-HPwrf96uRwuVJ9ynjuC5bmjoCBf4y3MnbEYBpakcf75RXFUI631TlKrccQPyNjX9J3nTlRjiuxC83ZWT1CdEDSXZAvO47o2oB0JdJR88NFg3ylqlbHTdxn4s4t3eWhyXUxZZiXUGmNIvQFsnF9s0 Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: b99d2a0b4d7e40a38e682fc147e968af Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-TestVolumeBootPattern-747170341 Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b99d2a0b4d7e40a38e682fc147e968af", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-TestVolumeBootPattern-747170341 Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: b99d2a0b4d7e40a38e682fc147e968af Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-TestVolumeBootPattern-747170341 Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-TestVolumeBootPattern-747170341-project Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 342e60103c9b45bcb348b6f8bcd686ca Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-TestVolumeBootPattern-747170341-project Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec could not be found. Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '24e01588-ddb5-4c16-bd5a-dd6988b0d3ec'} Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec could not be found. Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec could not be found. Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:28:30.001917 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:28:30.010184 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:28:30.010184 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:28:30.010184 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:28:30.010184 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:28:30.010184 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:28:30.010184 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec could not be found. Sep 17 21:28:30.010184 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:28:30.010184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3c0f7461-92bd-4202-aef2-f342635ab3e4 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Returning 404 to user: Instance 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:28:30.010184 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3c0f7461-92bd-4202-aef2-f342635ab3e4 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec" status: 404 len: 111 microversion: 2.1 time: 0.034410 Sep 17 21:28:30.010184 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3041/5998] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:28:29 2022] GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:28:30.111973 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9d017a1d-a633-4368-8395-e9be239b80f3 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-403684840", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1399000875", "security_groups": [{"name": "tempest-secgroup-smoke-1270477296"}], "block_device_mapping_v2": [{"uuid": "43df5366-32dd-4c44-ad36-15410ac6ac72", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "277ba9f5-743a-4949-b45f-d5582af5f04e"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:28:30.233509 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-9d017a1d-a633-4368-8395-e9be239b80f3 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] validate_networks() for [('277ba9f5-743a-4949-b45f-d5582af5f04e', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:28:30.751249 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-9d017a1d-a633-4368-8395-e9be239b80f3 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:28:30.751681 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-9d017a1d-a633-4368-8395-e9be239b80f3 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:28:30.752197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-9d017a1d-a633-4368-8395-e9be239b80f3 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:28:30.752615 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-9d017a1d-a633-4368-8395-e9be239b80f3 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:28:30.753042 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-9d017a1d-a633-4368-8395-e9be239b80f3 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:28:30.762663 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d017a1d-a633-4368-8395-e9be239b80f3 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:30.763154 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d017a1d-a633-4368-8395-e9be239b80f3 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:30.763601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d017a1d-a633-4368-8395-e9be239b80f3 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:30.764346 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d017a1d-a633-4368-8395-e9be239b80f3 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:30.764807 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d017a1d-a633-4368-8395-e9be239b80f3 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:30.765242 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d017a1d-a633-4368-8395-e9be239b80f3 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:30.782901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-9d017a1d-a633-4368-8395-e9be239b80f3 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Getting quotas for project b99d2a0b4d7e40a38e682fc147e968af. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:28:30.788384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-9d017a1d-a633-4368-8395-e9be239b80f3 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Getting quotas for user 342e60103c9b45bcb348b6f8bcd686ca and project b99d2a0b4d7e40a38e682fc147e968af. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:28:30.848112 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9d017a1d-a633-4368-8395-e9be239b80f3 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:28:30.850306 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9d017a1d-a633-4368-8395-e9be239b80f3 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 25004b14-902f-4ec6-80a5-b3aefb14d11f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='43df5366-32dd-4c44-ad36-15410ac6ac72',volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:28:30.992861 ncdv-master-1 devstack@n-api.service[140523]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9d017a1d-a633-4368-8395-e9be239b80f3 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [1dae77a6-953b-4891-800c-ed4c5c269ed6] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 17 21:28:32.001876 ncdv-master-1 devstack@n-api.service[140523]: INFO oslo.messaging._drivers.impl_rabbit [None req-9d017a1d-a633-4368-8395-e9be239b80f3 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [1dae77a6-953b-4891-800c-ed4c5c269ed6] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 50112. Sep 17 21:28:32.007436 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9d017a1d-a633-4368-8395-e9be239b80f3 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.900705 Sep 17 21:28:32.008453 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2958/5999] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:28:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 1903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 17 21:28:32.020239 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e21789f2-c185-4d36-bc54-1b42b22e4f13 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:32.020955 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e21789f2-c185-4d36-bc54-1b42b22e4f13 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 25004b14-902f-4ec6-80a5-b3aefb14d11f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:32.023905 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:28:32.085890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e21789f2-c185-4d36-bc54-1b42b22e4f13 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:28:32.097116 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e21789f2-c185-4d36-bc54-1b42b22e4f13 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/25004b14-902f-4ec6-80a5-b3aefb14d11f" status: 200 len: 1094 microversion: 2.1 time: 0.080971 Sep 17 21:28:32.097730 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3042/6000] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:28:32 2022] GET /compute/v2.1/servers/25004b14-902f-4ec6-80a5-b3aefb14d11f => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:28:33.123535 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5be08407-b484-4d11-be32-0d9150aae66c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:33.124223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5be08407-b484-4d11-be32-0d9150aae66c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 25004b14-902f-4ec6-80a5-b3aefb14d11f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:33.130481 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5be08407-b484-4d11-be32-0d9150aae66c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:33.130997 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5be08407-b484-4d11-be32-0d9150aae66c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:33.131422 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5be08407-b484-4d11-be32-0d9150aae66c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:33.132168 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5be08407-b484-4d11-be32-0d9150aae66c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:33.132624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5be08407-b484-4d11-be32-0d9150aae66c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:33.133056 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5be08407-b484-4d11-be32-0d9150aae66c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:33.197649 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5be08407-b484-4d11-be32-0d9150aae66c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:28:33.206084 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5be08407-b484-4d11-be32-0d9150aae66c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/25004b14-902f-4ec6-80a5-b3aefb14d11f" status: 200 len: 1210 microversion: 2.1 time: 0.087536 Sep 17 21:28:33.206861 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2959/6001] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:28:33 2022] GET /compute/v2.1/servers/25004b14-902f-4ec6-80a5-b3aefb14d11f => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:28:34.229825 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4ca70fb0-16b8-40da-b725-dc4e364cfb53 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:34.230557 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4ca70fb0-16b8-40da-b725-dc4e364cfb53 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 25004b14-902f-4ec6-80a5-b3aefb14d11f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:34.238977 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ca70fb0-16b8-40da-b725-dc4e364cfb53 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:34.239517 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ca70fb0-16b8-40da-b725-dc4e364cfb53 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:34.239989 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ca70fb0-16b8-40da-b725-dc4e364cfb53 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:34.240745 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ca70fb0-16b8-40da-b725-dc4e364cfb53 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:34.241417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ca70fb0-16b8-40da-b725-dc4e364cfb53 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:34.242066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4ca70fb0-16b8-40da-b725-dc4e364cfb53 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:34.386882 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4ca70fb0-16b8-40da-b725-dc4e364cfb53 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:28:34.400967 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4ca70fb0-16b8-40da-b725-dc4e364cfb53 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/25004b14-902f-4ec6-80a5-b3aefb14d11f" status: 200 len: 1278 microversion: 2.1 time: 0.175070 Sep 17 21:28:34.405538 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3043/6002] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:28:34 2022] GET /compute/v2.1/servers/25004b14-902f-4ec6-80a5-b3aefb14d11f => generated 1278 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:28:34.489622 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-ba21e352-202a-4200-b835-e55aec74c821 req-0991cdcd-a532-48f9-bc4d-e10ca4db4c10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25004b14-902f-4ec6-80a5-b3aefb14d11f", "tag": "b86106a9-835a-4042-8fff-a05757a7677a"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:28:34.500980 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-ba21e352-202a-4200-b835-e55aec74c821 req-0991cdcd-a532-48f9-bc4d-e10ca4db4c10 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:34.501454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-ba21e352-202a-4200-b835-e55aec74c821 req-0991cdcd-a532-48f9-bc4d-e10ca4db4c10 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:34.501926 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-ba21e352-202a-4200-b835-e55aec74c821 req-0991cdcd-a532-48f9-bc4d-e10ca4db4c10 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:34.514610 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-ba21e352-202a-4200-b835-e55aec74c821 req-0991cdcd-a532-48f9-bc4d-e10ca4db4c10 service nova] Creating event network-changed:b86106a9-835a-4042-8fff-a05757a7677a for instance 25004b14-902f-4ec6-80a5-b3aefb14d11f on nch1-master-1 Sep 17 21:28:34.519578 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-ba21e352-202a-4200-b835-e55aec74c821 req-0991cdcd-a532-48f9-bc4d-e10ca4db4c10 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034777 Sep 17 21:28:34.520194 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2960/6003] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:28:35.424477 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-612c3f0e-a252-4a09-a6c6-5433dbc5445d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:35.425060 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-612c3f0e-a252-4a09-a6c6-5433dbc5445d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 25004b14-902f-4ec6-80a5-b3aefb14d11f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:35.432594 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-612c3f0e-a252-4a09-a6c6-5433dbc5445d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:35.433105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-612c3f0e-a252-4a09-a6c6-5433dbc5445d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:35.433589 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-612c3f0e-a252-4a09-a6c6-5433dbc5445d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:35.434306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-612c3f0e-a252-4a09-a6c6-5433dbc5445d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:35.434775 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-612c3f0e-a252-4a09-a6c6-5433dbc5445d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:35.435213 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-612c3f0e-a252-4a09-a6c6-5433dbc5445d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:35.569936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-612c3f0e-a252-4a09-a6c6-5433dbc5445d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:28:35.578495 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-612c3f0e-a252-4a09-a6c6-5433dbc5445d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/25004b14-902f-4ec6-80a5-b3aefb14d11f" status: 200 len: 1266 microversion: 2.1 time: 0.158064 Sep 17 21:28:35.579118 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3044/6004] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:28:35 2022] GET /compute/v2.1/servers/25004b14-902f-4ec6-80a5-b3aefb14d11f => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:28:36.607349 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-330a558e-aa54-46f7-9878-5d41c5a05c4c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:36.607937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-330a558e-aa54-46f7-9878-5d41c5a05c4c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 25004b14-902f-4ec6-80a5-b3aefb14d11f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:36.615136 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-330a558e-aa54-46f7-9878-5d41c5a05c4c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:36.615633 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-330a558e-aa54-46f7-9878-5d41c5a05c4c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:36.616082 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-330a558e-aa54-46f7-9878-5d41c5a05c4c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:36.616790 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-330a558e-aa54-46f7-9878-5d41c5a05c4c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:36.617251 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-330a558e-aa54-46f7-9878-5d41c5a05c4c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:36.617729 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-330a558e-aa54-46f7-9878-5d41c5a05c4c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:36.753538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-330a558e-aa54-46f7-9878-5d41c5a05c4c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:28:36.763304 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-330a558e-aa54-46f7-9878-5d41c5a05c4c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/25004b14-902f-4ec6-80a5-b3aefb14d11f" status: 200 len: 1266 microversion: 2.1 time: 0.163312 Sep 17 21:28:36.763921 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2961/6005] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:28:36 2022] GET /compute/v2.1/servers/25004b14-902f-4ec6-80a5-b3aefb14d11f => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:28:37.788670 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-15e8706e-6442-4366-aa75-e546f4bf4c7c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:37.789290 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-15e8706e-6442-4366-aa75-e546f4bf4c7c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 25004b14-902f-4ec6-80a5-b3aefb14d11f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:37.798646 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-15e8706e-6442-4366-aa75-e546f4bf4c7c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:37.799151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-15e8706e-6442-4366-aa75-e546f4bf4c7c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:37.799608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-15e8706e-6442-4366-aa75-e546f4bf4c7c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:37.800327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-15e8706e-6442-4366-aa75-e546f4bf4c7c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:37.800797 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-15e8706e-6442-4366-aa75-e546f4bf4c7c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:37.801241 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-15e8706e-6442-4366-aa75-e546f4bf4c7c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:37.940106 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-15e8706e-6442-4366-aa75-e546f4bf4c7c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:28:37.948498 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-15e8706e-6442-4366-aa75-e546f4bf4c7c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/25004b14-902f-4ec6-80a5-b3aefb14d11f" status: 200 len: 1266 microversion: 2.1 time: 0.165373 Sep 17 21:28:37.949053 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3045/6006] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:28:37 2022] GET /compute/v2.1/servers/25004b14-902f-4ec6-80a5-b3aefb14d11f => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:28:38.971865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d07d0ed8-792f-4ecc-bbe4-c312a557f78f tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:38.972441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d07d0ed8-792f-4ecc-bbe4-c312a557f78f tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 25004b14-902f-4ec6-80a5-b3aefb14d11f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:38.980017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d07d0ed8-792f-4ecc-bbe4-c312a557f78f tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:38.980515 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d07d0ed8-792f-4ecc-bbe4-c312a557f78f tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:38.980950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d07d0ed8-792f-4ecc-bbe4-c312a557f78f tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:38.981694 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d07d0ed8-792f-4ecc-bbe4-c312a557f78f tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:38.982177 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d07d0ed8-792f-4ecc-bbe4-c312a557f78f tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:38.982606 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d07d0ed8-792f-4ecc-bbe4-c312a557f78f tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:39.118943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d07d0ed8-792f-4ecc-bbe4-c312a557f78f tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:28:39.127174 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d07d0ed8-792f-4ecc-bbe4-c312a557f78f tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/25004b14-902f-4ec6-80a5-b3aefb14d11f" status: 200 len: 1266 microversion: 2.1 time: 0.159305 Sep 17 21:28:39.127754 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2962/6007] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:28:38 2022] GET /compute/v2.1/servers/25004b14-902f-4ec6-80a5-b3aefb14d11f => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:28:40.154679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-58c46664-f97c-4b1b-b283-7c6acfb2cffd tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:40.155951 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-58c46664-f97c-4b1b-b283-7c6acfb2cffd tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 25004b14-902f-4ec6-80a5-b3aefb14d11f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:40.167933 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58c46664-f97c-4b1b-b283-7c6acfb2cffd tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:40.168780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58c46664-f97c-4b1b-b283-7c6acfb2cffd tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:40.169616 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58c46664-f97c-4b1b-b283-7c6acfb2cffd tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:40.170935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58c46664-f97c-4b1b-b283-7c6acfb2cffd tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:40.171420 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58c46664-f97c-4b1b-b283-7c6acfb2cffd tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:40.171904 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58c46664-f97c-4b1b-b283-7c6acfb2cffd tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:40.318944 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-58c46664-f97c-4b1b-b283-7c6acfb2cffd tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:28:40.327491 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-58c46664-f97c-4b1b-b283-7c6acfb2cffd tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/25004b14-902f-4ec6-80a5-b3aefb14d11f" status: 200 len: 1266 microversion: 2.1 time: 0.179503 Sep 17 21:28:40.328079 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3046/6008] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:28:40 2022] GET /compute/v2.1/servers/25004b14-902f-4ec6-80a5-b3aefb14d11f => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:28:40.547775 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-5a4bd09e-dbfe-4883-8f8d-edbad345b80f req-1cc9708e-6dba-4dcd-a13b-b2d22eca64c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25004b14-902f-4ec6-80a5-b3aefb14d11f", "name": "network-vif-plugged", "status": "completed", "tag": "b86106a9-835a-4042-8fff-a05757a7677a"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:28:40.559113 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-5a4bd09e-dbfe-4883-8f8d-edbad345b80f req-1cc9708e-6dba-4dcd-a13b-b2d22eca64c4 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:40.559600 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-5a4bd09e-dbfe-4883-8f8d-edbad345b80f req-1cc9708e-6dba-4dcd-a13b-b2d22eca64c4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:40.560028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-5a4bd09e-dbfe-4883-8f8d-edbad345b80f req-1cc9708e-6dba-4dcd-a13b-b2d22eca64c4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:40.571380 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-5a4bd09e-dbfe-4883-8f8d-edbad345b80f req-1cc9708e-6dba-4dcd-a13b-b2d22eca64c4 service nova] Creating event network-vif-plugged:b86106a9-835a-4042-8fff-a05757a7677a for instance 25004b14-902f-4ec6-80a5-b3aefb14d11f on nch1-master-1 Sep 17 21:28:40.576394 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-5a4bd09e-dbfe-4883-8f8d-edbad345b80f req-1cc9708e-6dba-4dcd-a13b-b2d22eca64c4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033012 Sep 17 21:28:40.577004 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2963/6009] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:28:41.354952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1f2b9bf4-aa9c-43fc-9f82-e2243977afbb tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:41.356037 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1f2b9bf4-aa9c-43fc-9f82-e2243977afbb tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 25004b14-902f-4ec6-80a5-b3aefb14d11f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:41.369141 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f2b9bf4-aa9c-43fc-9f82-e2243977afbb tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:41.370040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f2b9bf4-aa9c-43fc-9f82-e2243977afbb tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:41.370798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f2b9bf4-aa9c-43fc-9f82-e2243977afbb tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:41.371986 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f2b9bf4-aa9c-43fc-9f82-e2243977afbb tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:41.372772 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f2b9bf4-aa9c-43fc-9f82-e2243977afbb tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:41.373520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f2b9bf4-aa9c-43fc-9f82-e2243977afbb tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:41.511718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1f2b9bf4-aa9c-43fc-9f82-e2243977afbb tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:28:41.520541 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1f2b9bf4-aa9c-43fc-9f82-e2243977afbb tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/25004b14-902f-4ec6-80a5-b3aefb14d11f" status: 200 len: 1266 microversion: 2.1 time: 0.172128 Sep 17 21:28:41.521192 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3047/6010] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:28:41 2022] GET /compute/v2.1/servers/25004b14-902f-4ec6-80a5-b3aefb14d11f => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:28:42.550376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:28:42.552371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:28:42.561353 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4b5ee772-22bf-4fb0-a905-fe681049c00c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:42.562662 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4b5ee772-22bf-4fb0-a905-fe681049c00c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 25004b14-902f-4ec6-80a5-b3aefb14d11f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:42.570146 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b5ee772-22bf-4fb0-a905-fe681049c00c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:42.570637 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b5ee772-22bf-4fb0-a905-fe681049c00c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:42.571409 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b5ee772-22bf-4fb0-a905-fe681049c00c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:42.572113 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b5ee772-22bf-4fb0-a905-fe681049c00c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:42.572574 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b5ee772-22bf-4fb0-a905-fe681049c00c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:42.573008 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b5ee772-22bf-4fb0-a905-fe681049c00c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:42.715135 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4b5ee772-22bf-4fb0-a905-fe681049c00c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:28:42.723942 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4b5ee772-22bf-4fb0-a905-fe681049c00c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/25004b14-902f-4ec6-80a5-b3aefb14d11f" status: 200 len: 1453 microversion: 2.1 time: 0.175687 Sep 17 21:28:42.724527 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2964/6011] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:28:42 2022] GET /compute/v2.1/servers/25004b14-902f-4ec6-80a5-b3aefb14d11f => generated 1453 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:28:42.746636 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fde4b169-0242-4e63-b3c1-fcbcc5793963 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:28:42.747277 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fde4b169-0242-4e63-b3c1-fcbcc5793963 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 25004b14-902f-4ec6-80a5-b3aefb14d11f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:42.749353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:28:42.755158 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fde4b169-0242-4e63-b3c1-fcbcc5793963 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:42.755670 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fde4b169-0242-4e63-b3c1-fcbcc5793963 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:42.756125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fde4b169-0242-4e63-b3c1-fcbcc5793963 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:42.756847 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fde4b169-0242-4e63-b3c1-fcbcc5793963 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:42.757320 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fde4b169-0242-4e63-b3c1-fcbcc5793963 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:42.757794 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fde4b169-0242-4e63-b3c1-fcbcc5793963 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:42.900474 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fde4b169-0242-4e63-b3c1-fcbcc5793963 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:28:42.908842 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fde4b169-0242-4e63-b3c1-fcbcc5793963 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/25004b14-902f-4ec6-80a5-b3aefb14d11f" status: 200 len: 1453 microversion: 2.1 time: 0.166057 Sep 17 21:28:42.909420 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3048/6012] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:28:42 2022] GET /compute/v2.1/servers/25004b14-902f-4ec6-80a5-b3aefb14d11f => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:28:44.905366 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-734f99aa-37ae-4fc8-8ef7-4640b805356d req-5ba37d27-9ae6-44bf-a56e-3ac65c06d58c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25004b14-902f-4ec6-80a5-b3aefb14d11f", "tag": "b86106a9-835a-4042-8fff-a05757a7677a"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:28:44.915583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-734f99aa-37ae-4fc8-8ef7-4640b805356d req-5ba37d27-9ae6-44bf-a56e-3ac65c06d58c service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:44.916060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-734f99aa-37ae-4fc8-8ef7-4640b805356d req-5ba37d27-9ae6-44bf-a56e-3ac65c06d58c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:44.916490 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-734f99aa-37ae-4fc8-8ef7-4640b805356d req-5ba37d27-9ae6-44bf-a56e-3ac65c06d58c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:44.933757 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-734f99aa-37ae-4fc8-8ef7-4640b805356d req-5ba37d27-9ae6-44bf-a56e-3ac65c06d58c service nova] Creating event network-changed:b86106a9-835a-4042-8fff-a05757a7677a for instance 25004b14-902f-4ec6-80a5-b3aefb14d11f on nch1-master-1 Sep 17 21:28:44.940377 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-734f99aa-37ae-4fc8-8ef7-4640b805356d req-5ba37d27-9ae6-44bf-a56e-3ac65c06d58c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038692 Sep 17 21:28:44.941087 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2965/6013] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:28:50.492110 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2096783c-32b0-41a4-8703-de563e7dd035 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:28:50.494566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2096783c-32b0-41a4-8703-de563e7dd035 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:28:50.502118 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2096783c-32b0-41a4-8703-de563e7dd035 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:50.502617 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2096783c-32b0-41a4-8703-de563e7dd035 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:50.503080 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2096783c-32b0-41a4-8703-de563e7dd035 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:50.503801 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2096783c-32b0-41a4-8703-de563e7dd035 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:28:50.504278 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2096783c-32b0-41a4-8703-de563e7dd035 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:28:50.504714 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2096783c-32b0-41a4-8703-de563e7dd035 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:28:50.507152 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:28:50.558654 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2096783c-32b0-41a4-8703-de563e7dd035 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "POST /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82/action" status: 200 len: 24568 microversion: 2.1 time: 0.070464 Sep 17 21:28:50.559316 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3049/6014] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:28:50 2022] POST /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82/action => generated 24568 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:29:01.614790 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:29:01.615775 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=82 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:29:01.622169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8b8c4b54-a636-465c-84db-1f3c7eb51bb6 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:29:01.623255 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8b8c4b54-a636-465c-84db-1f3c7eb51bb6 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:29:01.632632 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8b8c4b54-a636-465c-84db-1f3c7eb51bb6 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:01.633120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8b8c4b54-a636-465c-84db-1f3c7eb51bb6 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:01.633588 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8b8c4b54-a636-465c-84db-1f3c7eb51bb6 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:01.634292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8b8c4b54-a636-465c-84db-1f3c7eb51bb6 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:01.634750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8b8c4b54-a636-465c-84db-1f3c7eb51bb6 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:01.635181 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8b8c4b54-a636-465c-84db-1f3c7eb51bb6 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:01.771494 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8b8c4b54-a636-465c-84db-1f3c7eb51bb6 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1833 microversion: 2.1 time: 0.160330 Sep 17 21:29:01.772053 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2966/6015] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:29:01 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1833 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:29:01.795854 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b9238da0-c2ed-4df1-88bb-d8b74039f495 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:29:01.796573 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b9238da0-c2ed-4df1-88bb-d8b74039f495 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:29:01.799210 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=17 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:29:01.799869 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:29:01.806178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9238da0-c2ed-4df1-88bb-d8b74039f495 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:01.806678 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9238da0-c2ed-4df1-88bb-d8b74039f495 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:01.807128 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9238da0-c2ed-4df1-88bb-d8b74039f495 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:01.807896 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9238da0-c2ed-4df1-88bb-d8b74039f495 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:01.808364 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9238da0-c2ed-4df1-88bb-d8b74039f495 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:01.808804 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9238da0-c2ed-4df1-88bb-d8b74039f495 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:01.955657 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b9238da0-c2ed-4df1-88bb-d8b74039f495 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:29:01.968448 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b9238da0-c2ed-4df1-88bb-d8b74039f495 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1682 microversion: 2.1 time: 0.176833 Sep 17 21:29:01.969208 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3050/6016] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:29:01 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:29:02.076025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cb383dd7-3792-4e21-8be7-519cb7487017 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:29:02.078282 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cb383dd7-3792-4e21-8be7-519cb7487017 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:29:02.084716 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb383dd7-3792-4e21-8be7-519cb7487017 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:02.085192 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb383dd7-3792-4e21-8be7-519cb7487017 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:02.085671 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb383dd7-3792-4e21-8be7-519cb7487017 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:02.086400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb383dd7-3792-4e21-8be7-519cb7487017 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:02.086862 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb383dd7-3792-4e21-8be7-519cb7487017 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:02.087300 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb383dd7-3792-4e21-8be7-519cb7487017 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:02.139185 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cb383dd7-3792-4e21-8be7-519cb7487017 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "POST /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82/action" status: 200 len: 32638 microversion: 2.1 time: 0.067084 Sep 17 21:29:02.139865 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2967/6017] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:29:02 2022] POST /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82/action => generated 32638 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:29:02.306748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-815d413e-2f6c-4712-9101-cc52ef642ae9 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:29:02.307367 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-815d413e-2f6c-4712-9101-cc52ef642ae9 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:29:02.314751 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-815d413e-2f6c-4712-9101-cc52ef642ae9 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:02.315261 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-815d413e-2f6c-4712-9101-cc52ef642ae9 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:02.315724 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-815d413e-2f6c-4712-9101-cc52ef642ae9 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:02.316421 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-815d413e-2f6c-4712-9101-cc52ef642ae9 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:02.316927 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-815d413e-2f6c-4712-9101-cc52ef642ae9 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:02.317399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-815d413e-2f6c-4712-9101-cc52ef642ae9 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:02.345619 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-815d413e-2f6c-4712-9101-cc52ef642ae9 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'c2f8e397465f45a08b807d5240c07729', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f94968a8495d447d9adf019219816f9c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:29:02.346225 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-815d413e-2f6c-4712-9101-cc52ef642ae9 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] flavor_id is None. Assuming migration. {{(pid=140524) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 17 21:29:02.346690 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-815d413e-2f6c-4712-9101-cc52ef642ae9 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=140524) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 17 21:29:02.469960 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-815d413e-2f6c-4712-9101-cc52ef642ae9 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82/action" status: 202 len: 0 microversion: 2.1 time: 0.167093 Sep 17 21:29:02.470560 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3051/6018] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:29:02 2022] POST /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:29:02.479516 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-aedb2841-893b-41c0-bdef-a5de0581d45b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:29:02.480221 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-aedb2841-893b-41c0-bdef-a5de0581d45b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:29:02.487680 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aedb2841-893b-41c0-bdef-a5de0581d45b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:02.488168 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aedb2841-893b-41c0-bdef-a5de0581d45b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:02.488604 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aedb2841-893b-41c0-bdef-a5de0581d45b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:02.489309 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aedb2841-893b-41c0-bdef-a5de0581d45b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:02.489788 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aedb2841-893b-41c0-bdef-a5de0581d45b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:02.490215 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aedb2841-893b-41c0-bdef-a5de0581d45b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:02.660829 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-aedb2841-893b-41c0-bdef-a5de0581d45b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:29:02.669284 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-aedb2841-893b-41c0-bdef-a5de0581d45b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1691 microversion: 2.1 time: 0.193975 Sep 17 21:29:02.669909 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2968/6019] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:29:02 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1691 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:29:03.694299 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b1c7df5e-b012-4ca3-a15f-2883d3d6ccbc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:29:03.694946 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b1c7df5e-b012-4ca3-a15f-2883d3d6ccbc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:29:03.701873 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1c7df5e-b012-4ca3-a15f-2883d3d6ccbc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:03.702380 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1c7df5e-b012-4ca3-a15f-2883d3d6ccbc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:03.702846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1c7df5e-b012-4ca3-a15f-2883d3d6ccbc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:03.703563 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1c7df5e-b012-4ca3-a15f-2883d3d6ccbc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:03.704040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1c7df5e-b012-4ca3-a15f-2883d3d6ccbc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:03.704489 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1c7df5e-b012-4ca3-a15f-2883d3d6ccbc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:03.861694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b1c7df5e-b012-4ca3-a15f-2883d3d6ccbc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:29:03.870159 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b1c7df5e-b012-4ca3-a15f-2883d3d6ccbc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1691 microversion: 2.1 time: 0.181154 Sep 17 21:29:03.870755 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3052/6020] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:29:03 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1691 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:29:04.893759 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ad9be1bd-5ecf-498e-b4e5-6de5d728e671 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:29:04.894363 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ad9be1bd-5ecf-498e-b4e5-6de5d728e671 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:29:04.903161 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad9be1bd-5ecf-498e-b4e5-6de5d728e671 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:04.903667 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad9be1bd-5ecf-498e-b4e5-6de5d728e671 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:04.904152 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad9be1bd-5ecf-498e-b4e5-6de5d728e671 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:04.904901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad9be1bd-5ecf-498e-b4e5-6de5d728e671 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:04.905363 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad9be1bd-5ecf-498e-b4e5-6de5d728e671 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:04.905872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad9be1bd-5ecf-498e-b4e5-6de5d728e671 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:05.050603 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ad9be1bd-5ecf-498e-b4e5-6de5d728e671 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:29:05.058979 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ad9be1bd-5ecf-498e-b4e5-6de5d728e671 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1696 microversion: 2.1 time: 0.169394 Sep 17 21:29:05.059561 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2969/6021] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:29:04 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1696 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:29:06.087494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-eb60fe7b-d058-4563-b424-3b3d2b6fd029 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:29:06.088134 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-eb60fe7b-d058-4563-b424-3b3d2b6fd029 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:29:06.094794 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eb60fe7b-d058-4563-b424-3b3d2b6fd029 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:06.095308 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eb60fe7b-d058-4563-b424-3b3d2b6fd029 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:06.095787 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eb60fe7b-d058-4563-b424-3b3d2b6fd029 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:06.096513 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eb60fe7b-d058-4563-b424-3b3d2b6fd029 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:06.097072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eb60fe7b-d058-4563-b424-3b3d2b6fd029 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:06.097635 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eb60fe7b-d058-4563-b424-3b3d2b6fd029 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:06.243218 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-eb60fe7b-d058-4563-b424-3b3d2b6fd029 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:29:06.251503 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-eb60fe7b-d058-4563-b424-3b3d2b6fd029 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1696 microversion: 2.1 time: 0.171390 Sep 17 21:29:06.252095 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3053/6022] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:29:06 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:29:07.276035 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dc7db408-41ca-4dc3-9f68-d8e2a7460de4 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:29:07.276650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dc7db408-41ca-4dc3-9f68-d8e2a7460de4 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:29:07.284032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dc7db408-41ca-4dc3-9f68-d8e2a7460de4 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:07.284527 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dc7db408-41ca-4dc3-9f68-d8e2a7460de4 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:07.284976 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dc7db408-41ca-4dc3-9f68-d8e2a7460de4 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:07.285713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dc7db408-41ca-4dc3-9f68-d8e2a7460de4 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:07.286169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dc7db408-41ca-4dc3-9f68-d8e2a7460de4 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:07.286600 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dc7db408-41ca-4dc3-9f68-d8e2a7460de4 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:07.444167 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dc7db408-41ca-4dc3-9f68-d8e2a7460de4 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:29:07.452999 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dc7db408-41ca-4dc3-9f68-d8e2a7460de4 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1696 microversion: 2.1 time: 0.180958 Sep 17 21:29:07.453696 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2970/6023] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:29:07 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1696 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:29:08.477742 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4f12b1d6-383c-4ec5-b779-2799c0fa4c50 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:29:08.478339 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4f12b1d6-383c-4ec5-b779-2799c0fa4c50 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:29:08.486036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f12b1d6-383c-4ec5-b779-2799c0fa4c50 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:08.486547 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f12b1d6-383c-4ec5-b779-2799c0fa4c50 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:08.487102 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f12b1d6-383c-4ec5-b779-2799c0fa4c50 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:08.487870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f12b1d6-383c-4ec5-b779-2799c0fa4c50 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:08.488308 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f12b1d6-383c-4ec5-b779-2799c0fa4c50 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:08.488755 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f12b1d6-383c-4ec5-b779-2799c0fa4c50 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:08.634267 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4f12b1d6-383c-4ec5-b779-2799c0fa4c50 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:29:08.642787 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4f12b1d6-383c-4ec5-b779-2799c0fa4c50 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1696 microversion: 2.1 time: 0.169389 Sep 17 21:29:08.643479 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3054/6024] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:29:08 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1696 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:29:09.668131 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1759e692-2ff5-4df6-aea9-3d41d0daf689 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:29:09.668761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1759e692-2ff5-4df6-aea9-3d41d0daf689 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:29:09.676422 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1759e692-2ff5-4df6-aea9-3d41d0daf689 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:09.676980 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1759e692-2ff5-4df6-aea9-3d41d0daf689 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:09.677673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1759e692-2ff5-4df6-aea9-3d41d0daf689 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:09.678356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1759e692-2ff5-4df6-aea9-3d41d0daf689 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:09.678819 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1759e692-2ff5-4df6-aea9-3d41d0daf689 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:09.679253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1759e692-2ff5-4df6-aea9-3d41d0daf689 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:09.820356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1759e692-2ff5-4df6-aea9-3d41d0daf689 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:29:09.829157 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1759e692-2ff5-4df6-aea9-3d41d0daf689 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1696 microversion: 2.1 time: 0.165227 Sep 17 21:29:09.829803 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2971/6025] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:29:09 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:29:10.853478 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-716e8f42-8b93-41bf-b26e-5f6599da9594 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:29:10.854152 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-716e8f42-8b93-41bf-b26e-5f6599da9594 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:29:10.862681 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-716e8f42-8b93-41bf-b26e-5f6599da9594 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:10.863246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-716e8f42-8b93-41bf-b26e-5f6599da9594 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:10.863753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-716e8f42-8b93-41bf-b26e-5f6599da9594 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:10.864585 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-716e8f42-8b93-41bf-b26e-5f6599da9594 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:10.865121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-716e8f42-8b93-41bf-b26e-5f6599da9594 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:10.865654 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-716e8f42-8b93-41bf-b26e-5f6599da9594 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:11.002329 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-716e8f42-8b93-41bf-b26e-5f6599da9594 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:29:11.010809 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-716e8f42-8b93-41bf-b26e-5f6599da9594 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1696 microversion: 2.1 time: 0.161931 Sep 17 21:29:11.011362 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3055/6026] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:29:10 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:29:12.037081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a2129f2c-71b5-41b6-83ba-138308d4c8e1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:29:12.037892 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a2129f2c-71b5-41b6-83ba-138308d4c8e1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:29:12.048205 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2129f2c-71b5-41b6-83ba-138308d4c8e1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:12.049224 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2129f2c-71b5-41b6-83ba-138308d4c8e1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:12.049343 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2129f2c-71b5-41b6-83ba-138308d4c8e1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:12.050078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2129f2c-71b5-41b6-83ba-138308d4c8e1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:12.050538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2129f2c-71b5-41b6-83ba-138308d4c8e1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:12.050992 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2129f2c-71b5-41b6-83ba-138308d4c8e1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:12.194189 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a2129f2c-71b5-41b6-83ba-138308d4c8e1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:29:12.202510 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a2129f2c-71b5-41b6-83ba-138308d4c8e1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1696 microversion: 2.1 time: 0.171241 Sep 17 21:29:12.203079 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2972/6027] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:29:12 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:29:13.227186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7d4dc864-bf77-47d8-be16-905aea84c523 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:29:13.227878 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7d4dc864-bf77-47d8-be16-905aea84c523 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:29:13.236061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d4dc864-bf77-47d8-be16-905aea84c523 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:13.236637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d4dc864-bf77-47d8-be16-905aea84c523 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:13.237105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d4dc864-bf77-47d8-be16-905aea84c523 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:13.237870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d4dc864-bf77-47d8-be16-905aea84c523 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:13.238349 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d4dc864-bf77-47d8-be16-905aea84c523 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:13.238986 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d4dc864-bf77-47d8-be16-905aea84c523 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:13.382317 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7d4dc864-bf77-47d8-be16-905aea84c523 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:29:13.390196 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7d4dc864-bf77-47d8-be16-905aea84c523 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1696 microversion: 2.1 time: 0.167339 Sep 17 21:29:13.390785 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3056/6028] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:29:13 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:29:14.415031 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-89f14d7f-8c24-4b7e-89f6-8b9042a93c70 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:29:14.415750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-89f14d7f-8c24-4b7e-89f6-8b9042a93c70 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:29:14.424295 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89f14d7f-8c24-4b7e-89f6-8b9042a93c70 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:14.424784 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89f14d7f-8c24-4b7e-89f6-8b9042a93c70 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:14.425226 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89f14d7f-8c24-4b7e-89f6-8b9042a93c70 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:14.426048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89f14d7f-8c24-4b7e-89f6-8b9042a93c70 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:14.426504 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89f14d7f-8c24-4b7e-89f6-8b9042a93c70 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:14.426942 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-89f14d7f-8c24-4b7e-89f6-8b9042a93c70 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:14.567789 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-89f14d7f-8c24-4b7e-89f6-8b9042a93c70 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:29:14.575967 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-89f14d7f-8c24-4b7e-89f6-8b9042a93c70 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1696 microversion: 2.1 time: 0.165627 Sep 17 21:29:14.576557 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2973/6029] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:29:14 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:29:15.603388 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-27d8d83f-fb1b-4621-be17-342a3e23cf75 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:29:15.604425 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-27d8d83f-fb1b-4621-be17-342a3e23cf75 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:29:15.615245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27d8d83f-fb1b-4621-be17-342a3e23cf75 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:15.615756 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27d8d83f-fb1b-4621-be17-342a3e23cf75 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:15.616209 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27d8d83f-fb1b-4621-be17-342a3e23cf75 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:15.616927 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27d8d83f-fb1b-4621-be17-342a3e23cf75 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:15.617430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27d8d83f-fb1b-4621-be17-342a3e23cf75 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:15.617884 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27d8d83f-fb1b-4621-be17-342a3e23cf75 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:15.759718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-27d8d83f-fb1b-4621-be17-342a3e23cf75 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:29:15.768467 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-27d8d83f-fb1b-4621-be17-342a3e23cf75 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1696 microversion: 2.1 time: 0.171675 Sep 17 21:29:15.769280 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3057/6030] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:29:15 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1696 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:29:16.797365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b9fca93d-194f-426e-97c0-0d9ea183c32b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:29:16.798775 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b9fca93d-194f-426e-97c0-0d9ea183c32b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:29:16.810245 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b9fca93d-194f-426e-97c0-0d9ea183c32b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:16.811121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b9fca93d-194f-426e-97c0-0d9ea183c32b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:16.811867 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b9fca93d-194f-426e-97c0-0d9ea183c32b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:16.813045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b9fca93d-194f-426e-97c0-0d9ea183c32b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:16.813872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b9fca93d-194f-426e-97c0-0d9ea183c32b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:16.814605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b9fca93d-194f-426e-97c0-0d9ea183c32b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:16.957221 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b9fca93d-194f-426e-97c0-0d9ea183c32b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:29:16.965519 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b9fca93d-194f-426e-97c0-0d9ea183c32b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1696 microversion: 2.1 time: 0.174805 Sep 17 21:29:16.966156 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2974/6031] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:29:16 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1696 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:29:17.993350 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4e4ea0d4-a732-4cbb-84c1-f9989814deb8 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:29:17.994299 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4e4ea0d4-a732-4cbb-84c1-f9989814deb8 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:29:18.006335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e4ea0d4-a732-4cbb-84c1-f9989814deb8 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:18.007191 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e4ea0d4-a732-4cbb-84c1-f9989814deb8 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:18.007957 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e4ea0d4-a732-4cbb-84c1-f9989814deb8 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:18.009146 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e4ea0d4-a732-4cbb-84c1-f9989814deb8 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:18.009992 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e4ea0d4-a732-4cbb-84c1-f9989814deb8 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:18.010740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e4ea0d4-a732-4cbb-84c1-f9989814deb8 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:18.151561 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4e4ea0d4-a732-4cbb-84c1-f9989814deb8 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:29:18.160224 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4e4ea0d4-a732-4cbb-84c1-f9989814deb8 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1696 microversion: 2.1 time: 0.173728 Sep 17 21:29:18.160807 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3058/6032] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:29:17 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1696 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:29:19.188334 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4541d5c9-041f-441b-b13e-1732b4940a3c tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:29:19.189336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4541d5c9-041f-441b-b13e-1732b4940a3c tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:29:19.197658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4541d5c9-041f-441b-b13e-1732b4940a3c tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:19.198173 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4541d5c9-041f-441b-b13e-1732b4940a3c tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:19.198602 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4541d5c9-041f-441b-b13e-1732b4940a3c tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:19.199324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4541d5c9-041f-441b-b13e-1732b4940a3c tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:19.199772 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4541d5c9-041f-441b-b13e-1732b4940a3c tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:19.200207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4541d5c9-041f-441b-b13e-1732b4940a3c tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:19.351259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4541d5c9-041f-441b-b13e-1732b4940a3c tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:29:19.363862 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4541d5c9-041f-441b-b13e-1732b4940a3c tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1696 microversion: 2.1 time: 0.182321 Sep 17 21:29:19.364429 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2975/6033] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:29:19 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1696 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:29:20.391515 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e9706f5c-c8a4-47a3-8d29-09fd4d8b46d0 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:29:20.392526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e9706f5c-c8a4-47a3-8d29-09fd4d8b46d0 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:29:20.404576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9706f5c-c8a4-47a3-8d29-09fd4d8b46d0 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:20.405515 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9706f5c-c8a4-47a3-8d29-09fd4d8b46d0 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:20.406397 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9706f5c-c8a4-47a3-8d29-09fd4d8b46d0 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:20.407593 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9706f5c-c8a4-47a3-8d29-09fd4d8b46d0 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:20.408390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9706f5c-c8a4-47a3-8d29-09fd4d8b46d0 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:20.409139 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9706f5c-c8a4-47a3-8d29-09fd4d8b46d0 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:20.545809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e9706f5c-c8a4-47a3-8d29-09fd4d8b46d0 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:29:20.557804 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e9706f5c-c8a4-47a3-8d29-09fd4d8b46d0 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1696 microversion: 2.1 time: 0.172589 Sep 17 21:29:20.558598 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3059/6034] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:29:20 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1696 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:29:21.581250 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a51e97a0-0012-467b-a3be-ba1327d1e721 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:29:21.582022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a51e97a0-0012-467b-a3be-ba1327d1e721 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:29:21.589592 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a51e97a0-0012-467b-a3be-ba1327d1e721 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:21.590082 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a51e97a0-0012-467b-a3be-ba1327d1e721 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:21.590541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a51e97a0-0012-467b-a3be-ba1327d1e721 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:21.591213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a51e97a0-0012-467b-a3be-ba1327d1e721 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:21.591668 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a51e97a0-0012-467b-a3be-ba1327d1e721 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:21.592096 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a51e97a0-0012-467b-a3be-ba1327d1e721 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:21.730498 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a51e97a0-0012-467b-a3be-ba1327d1e721 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:29:21.739100 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a51e97a0-0012-467b-a3be-ba1327d1e721 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1695 microversion: 2.1 time: 0.161840 Sep 17 21:29:21.739694 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2976/6035] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:29:21 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:29:21.807672 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-23ed04b7-a714-4430-b7dc-dd03b9fd4d40 req-fdde5194-fd06-4b8a-85ac-2ce64c855a4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ba1cf6-9ca8-49de-95ac-bab9ee572c82", "name": "network-vif-unplugged", "status": "completed", "tag": "5744f71f-5b9f-4347-b063-bae68953657c"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:29:21.820480 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-23ed04b7-a714-4430-b7dc-dd03b9fd4d40 req-fdde5194-fd06-4b8a-85ac-2ce64c855a4c service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:21.821116 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-23ed04b7-a714-4430-b7dc-dd03b9fd4d40 req-fdde5194-fd06-4b8a-85ac-2ce64c855a4c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:21.821668 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-23ed04b7-a714-4430-b7dc-dd03b9fd4d40 req-fdde5194-fd06-4b8a-85ac-2ce64c855a4c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:21.838220 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-23ed04b7-a714-4430-b7dc-dd03b9fd4d40 req-fdde5194-fd06-4b8a-85ac-2ce64c855a4c service nova] Creating event network-vif-unplugged:5744f71f-5b9f-4347-b063-bae68953657c for instance 79ba1cf6-9ca8-49de-95ac-bab9ee572c82 on nch1-master-1 Sep 17 21:29:21.843902 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [req-23ed04b7-a714-4430-b7dc-dd03b9fd4d40 req-fdde5194-fd06-4b8a-85ac-2ce64c855a4c service nova] Instance 79ba1cf6-9ca8-49de-95ac-bab9ee572c82 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140524) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 21:29:21.855931 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-23ed04b7-a714-4430-b7dc-dd03b9fd4d40 req-fdde5194-fd06-4b8a-85ac-2ce64c855a4c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052225 Sep 17 21:29:21.856563 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3060/6036] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:29:22.762710 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-af27f839-985e-4344-9188-93de64ffe901 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:29:22.763342 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-af27f839-985e-4344-9188-93de64ffe901 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:29:22.770715 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af27f839-985e-4344-9188-93de64ffe901 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:22.771206 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af27f839-985e-4344-9188-93de64ffe901 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:22.771616 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af27f839-985e-4344-9188-93de64ffe901 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:22.772355 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af27f839-985e-4344-9188-93de64ffe901 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:22.772798 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af27f839-985e-4344-9188-93de64ffe901 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:22.773227 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af27f839-985e-4344-9188-93de64ffe901 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:22.908204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-af27f839-985e-4344-9188-93de64ffe901 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:29:22.916817 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-af27f839-985e-4344-9188-93de64ffe901 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1695 microversion: 2.1 time: 0.158019 Sep 17 21:29:22.917423 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2977/6037] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:29:22 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1695 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:29:23.879112 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-43cf6374-08c6-467b-8084-3a00a9f7e83c req-9bc5707b-5e8e-4c2b-bc9e-ea1cb30a2ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79ba1cf6-9ca8-49de-95ac-bab9ee572c82", "tag": "5744f71f-5b9f-4347-b063-bae68953657c"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:29:23.890963 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-43cf6374-08c6-467b-8084-3a00a9f7e83c req-9bc5707b-5e8e-4c2b-bc9e-ea1cb30a2ff7 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:23.891487 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-43cf6374-08c6-467b-8084-3a00a9f7e83c req-9bc5707b-5e8e-4c2b-bc9e-ea1cb30a2ff7 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:23.891961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-43cf6374-08c6-467b-8084-3a00a9f7e83c req-9bc5707b-5e8e-4c2b-bc9e-ea1cb30a2ff7 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:23.904331 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-43cf6374-08c6-467b-8084-3a00a9f7e83c req-9bc5707b-5e8e-4c2b-bc9e-ea1cb30a2ff7 service nova] Creating event network-changed:5744f71f-5b9f-4347-b063-bae68953657c for instance 79ba1cf6-9ca8-49de-95ac-bab9ee572c82 on nch1-master-1 Sep 17 21:29:23.910024 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [req-43cf6374-08c6-467b-8084-3a00a9f7e83c req-9bc5707b-5e8e-4c2b-bc9e-ea1cb30a2ff7 service nova] Instance 79ba1cf6-9ca8-49de-95ac-bab9ee572c82 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140524) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 21:29:23.921198 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-43cf6374-08c6-467b-8084-3a00a9f7e83c req-9bc5707b-5e8e-4c2b-bc9e-ea1cb30a2ff7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046464 Sep 17 21:29:23.921762 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3061/6038] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:29:23.940908 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9d1da972-c07e-474e-8f06-290d11a98fd3 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:29:23.941560 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9d1da972-c07e-474e-8f06-290d11a98fd3 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:29:23.949056 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d1da972-c07e-474e-8f06-290d11a98fd3 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:23.949552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d1da972-c07e-474e-8f06-290d11a98fd3 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:23.949995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d1da972-c07e-474e-8f06-290d11a98fd3 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:23.950710 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d1da972-c07e-474e-8f06-290d11a98fd3 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:23.951183 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d1da972-c07e-474e-8f06-290d11a98fd3 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:23.951617 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9d1da972-c07e-474e-8f06-290d11a98fd3 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:24.104619 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9d1da972-c07e-474e-8f06-290d11a98fd3 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:29:24.113857 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9d1da972-c07e-474e-8f06-290d11a98fd3 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1693 microversion: 2.1 time: 0.177395 Sep 17 21:29:24.114541 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2978/6039] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:29:23 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1693 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:29:25.139473 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8f29cc37-f4c8-4f03-801e-49b6b4037e55 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:29:25.140305 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8f29cc37-f4c8-4f03-801e-49b6b4037e55 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:29:25.147241 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f29cc37-f4c8-4f03-801e-49b6b4037e55 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:25.147733 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f29cc37-f4c8-4f03-801e-49b6b4037e55 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:25.148169 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f29cc37-f4c8-4f03-801e-49b6b4037e55 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:25.148927 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f29cc37-f4c8-4f03-801e-49b6b4037e55 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:25.149404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f29cc37-f4c8-4f03-801e-49b6b4037e55 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:25.149865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f29cc37-f4c8-4f03-801e-49b6b4037e55 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:25.283648 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8f29cc37-f4c8-4f03-801e-49b6b4037e55 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:29:25.291677 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8f29cc37-f4c8-4f03-801e-49b6b4037e55 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1690 microversion: 2.1 time: 0.157534 Sep 17 21:29:25.292262 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3062/6040] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:29:25 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:29:25.316179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0690cc1d-c74c-4caf-a827-d3a0c05d652e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:29:25.316741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0690cc1d-c74c-4caf-a827-d3a0c05d652e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:29:25.323877 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0690cc1d-c74c-4caf-a827-d3a0c05d652e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:25.324370 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0690cc1d-c74c-4caf-a827-d3a0c05d652e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:25.324839 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0690cc1d-c74c-4caf-a827-d3a0c05d652e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:25.325565 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0690cc1d-c74c-4caf-a827-d3a0c05d652e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:25.326023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0690cc1d-c74c-4caf-a827-d3a0c05d652e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:25.326450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0690cc1d-c74c-4caf-a827-d3a0c05d652e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:25.438724 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0690cc1d-c74c-4caf-a827-d3a0c05d652e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "POST /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82/action" status: 202 len: 0 microversion: 2.1 time: 0.126430 Sep 17 21:29:25.439321 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2979/6041] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:29:25 2022] POST /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:29:25.447764 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9a9113a1-f192-4de7-aeba-2bed1b628fd4 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:29:25.448406 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9a9113a1-f192-4de7-aeba-2bed1b628fd4 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:29:25.454848 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9a9113a1-f192-4de7-aeba-2bed1b628fd4 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:25.455745 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9a9113a1-f192-4de7-aeba-2bed1b628fd4 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:25.456264 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9a9113a1-f192-4de7-aeba-2bed1b628fd4 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:25.457138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9a9113a1-f192-4de7-aeba-2bed1b628fd4 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:25.457704 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9a9113a1-f192-4de7-aeba-2bed1b628fd4 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:25.458180 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9a9113a1-f192-4de7-aeba-2bed1b628fd4 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:25.593933 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9a9113a1-f192-4de7-aeba-2bed1b628fd4 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:29:25.602045 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9a9113a1-f192-4de7-aeba-2bed1b628fd4 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1689 microversion: 2.1 time: 0.158237 Sep 17 21:29:25.602636 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3063/6042] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:29:25 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:29:26.627717 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-318ad9b1-73c7-4c53-bd6d-afb4f2391b98 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:29:26.628608 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-318ad9b1-73c7-4c53-bd6d-afb4f2391b98 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:29:26.635801 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-318ad9b1-73c7-4c53-bd6d-afb4f2391b98 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:26.636311 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-318ad9b1-73c7-4c53-bd6d-afb4f2391b98 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:26.636748 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-318ad9b1-73c7-4c53-bd6d-afb4f2391b98 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:26.637455 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-318ad9b1-73c7-4c53-bd6d-afb4f2391b98 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:26.637945 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-318ad9b1-73c7-4c53-bd6d-afb4f2391b98 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:26.638480 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-318ad9b1-73c7-4c53-bd6d-afb4f2391b98 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:26.768305 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-07a3cc17-5d1b-40a9-aae4-d9a01cc45482 req-aebfcc0e-4f6f-4e6d-935e-c747a40baf72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ba1cf6-9ca8-49de-95ac-bab9ee572c82", "name": "network-vif-plugged", "status": "completed", "tag": "5744f71f-5b9f-4347-b063-bae68953657c"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:29:26.785835 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-07a3cc17-5d1b-40a9-aae4-d9a01cc45482 req-aebfcc0e-4f6f-4e6d-935e-c747a40baf72 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:26.786318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-318ad9b1-73c7-4c53-bd6d-afb4f2391b98 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:29:26.786534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-07a3cc17-5d1b-40a9-aae4-d9a01cc45482 req-aebfcc0e-4f6f-4e6d-935e-c747a40baf72 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:26.787107 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-07a3cc17-5d1b-40a9-aae4-d9a01cc45482 req-aebfcc0e-4f6f-4e6d-935e-c747a40baf72 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:26.794914 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-318ad9b1-73c7-4c53-bd6d-afb4f2391b98 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1689 microversion: 2.1 time: 0.172625 Sep 17 21:29:26.795719 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2980/6043] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:29:26 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:29:26.800412 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-07a3cc17-5d1b-40a9-aae4-d9a01cc45482 req-aebfcc0e-4f6f-4e6d-935e-c747a40baf72 service nova] Creating event network-vif-plugged:5744f71f-5b9f-4347-b063-bae68953657c for instance 79ba1cf6-9ca8-49de-95ac-bab9ee572c82 on nch1-master-1 Sep 17 21:29:26.806357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [req-07a3cc17-5d1b-40a9-aae4-d9a01cc45482 req-aebfcc0e-4f6f-4e6d-935e-c747a40baf72 service nova] Instance 79ba1cf6-9ca8-49de-95ac-bab9ee572c82 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140524) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 21:29:26.817237 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-07a3cc17-5d1b-40a9-aae4-d9a01cc45482 req-aebfcc0e-4f6f-4e6d-935e-c747a40baf72 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053646 Sep 17 21:29:26.817910 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3064/6044] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:29:27.821004 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ce904051-1dfb-4804-a0eb-4e2dfea5622f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:29:27.821850 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ce904051-1dfb-4804-a0eb-4e2dfea5622f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:29:27.832350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce904051-1dfb-4804-a0eb-4e2dfea5622f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:27.833558 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce904051-1dfb-4804-a0eb-4e2dfea5622f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:27.834001 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce904051-1dfb-4804-a0eb-4e2dfea5622f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:27.834714 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce904051-1dfb-4804-a0eb-4e2dfea5622f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:27.835169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce904051-1dfb-4804-a0eb-4e2dfea5622f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:27.835595 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce904051-1dfb-4804-a0eb-4e2dfea5622f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:27.839622 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:29:27.976673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ce904051-1dfb-4804-a0eb-4e2dfea5622f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:29:27.985590 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ce904051-1dfb-4804-a0eb-4e2dfea5622f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1689 microversion: 2.1 time: 0.170676 Sep 17 21:29:27.986157 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2981/6045] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:29:27 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:29:28.845082 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-a0a04340-9e15-401d-a0e4-0c00edf7db67 req-3d81e943-3872-4072-86b7-62b06ea37f26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ba1cf6-9ca8-49de-95ac-bab9ee572c82", "name": "network-vif-unplugged", "status": "completed", "tag": "5744f71f-5b9f-4347-b063-bae68953657c"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:29:28.856404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a0a04340-9e15-401d-a0e4-0c00edf7db67 req-3d81e943-3872-4072-86b7-62b06ea37f26 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:28.856933 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a0a04340-9e15-401d-a0e4-0c00edf7db67 req-3d81e943-3872-4072-86b7-62b06ea37f26 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:28.857453 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a0a04340-9e15-401d-a0e4-0c00edf7db67 req-3d81e943-3872-4072-86b7-62b06ea37f26 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:28.870284 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-a0a04340-9e15-401d-a0e4-0c00edf7db67 req-3d81e943-3872-4072-86b7-62b06ea37f26 service nova] Creating event network-vif-unplugged:5744f71f-5b9f-4347-b063-bae68953657c for instance 79ba1cf6-9ca8-49de-95ac-bab9ee572c82 on nch2-master-1 Sep 17 21:29:28.875718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [req-a0a04340-9e15-401d-a0e4-0c00edf7db67 req-3d81e943-3872-4072-86b7-62b06ea37f26 service nova] Instance 79ba1cf6-9ca8-49de-95ac-bab9ee572c82 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140524) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 21:29:28.887329 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-a0a04340-9e15-401d-a0e4-0c00edf7db67 req-3d81e943-3872-4072-86b7-62b06ea37f26 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046538 Sep 17 21:29:28.888597 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3065/6046] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:29:29.008678 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cefc3f1a-4745-475f-bc7b-38977426e6b7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:29:29.009257 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cefc3f1a-4745-475f-bc7b-38977426e6b7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:29:29.016496 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cefc3f1a-4745-475f-bc7b-38977426e6b7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:29.016997 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cefc3f1a-4745-475f-bc7b-38977426e6b7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:29.017505 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cefc3f1a-4745-475f-bc7b-38977426e6b7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:29.018210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cefc3f1a-4745-475f-bc7b-38977426e6b7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:29.018676 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cefc3f1a-4745-475f-bc7b-38977426e6b7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:29.019107 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cefc3f1a-4745-475f-bc7b-38977426e6b7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:29.167260 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cefc3f1a-4745-475f-bc7b-38977426e6b7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:29:29.175502 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cefc3f1a-4745-475f-bc7b-38977426e6b7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1689 microversion: 2.1 time: 0.170857 Sep 17 21:29:29.176098 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2982/6047] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:29:29 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:29:30.200236 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cf3a57ea-7034-4be0-966c-4f3021c5f9b7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:29:30.201055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cf3a57ea-7034-4be0-966c-4f3021c5f9b7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:29:30.208913 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cf3a57ea-7034-4be0-966c-4f3021c5f9b7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:30.209419 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cf3a57ea-7034-4be0-966c-4f3021c5f9b7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:30.209917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cf3a57ea-7034-4be0-966c-4f3021c5f9b7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:30.210643 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cf3a57ea-7034-4be0-966c-4f3021c5f9b7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:30.211121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cf3a57ea-7034-4be0-966c-4f3021c5f9b7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:30.211567 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cf3a57ea-7034-4be0-966c-4f3021c5f9b7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:30.215763 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:29:30.350099 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cf3a57ea-7034-4be0-966c-4f3021c5f9b7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:29:30.361830 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cf3a57ea-7034-4be0-966c-4f3021c5f9b7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1689 microversion: 2.1 time: 0.165875 Sep 17 21:29:30.362526 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3066/6048] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:29:30 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:29:30.904099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-b6e9fe2b-6524-4fc8-83f0-b14d4324ebb8 req-ea794270-3093-43ea-9c56-1f4e2c86e953 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79ba1cf6-9ca8-49de-95ac-bab9ee572c82", "tag": "5744f71f-5b9f-4347-b063-bae68953657c"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:29:30.915805 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b6e9fe2b-6524-4fc8-83f0-b14d4324ebb8 req-ea794270-3093-43ea-9c56-1f4e2c86e953 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:30.916287 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b6e9fe2b-6524-4fc8-83f0-b14d4324ebb8 req-ea794270-3093-43ea-9c56-1f4e2c86e953 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:30.916730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b6e9fe2b-6524-4fc8-83f0-b14d4324ebb8 req-ea794270-3093-43ea-9c56-1f4e2c86e953 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:30.932866 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-b6e9fe2b-6524-4fc8-83f0-b14d4324ebb8 req-ea794270-3093-43ea-9c56-1f4e2c86e953 service nova] Creating event network-changed:5744f71f-5b9f-4347-b063-bae68953657c for instance 79ba1cf6-9ca8-49de-95ac-bab9ee572c82 on nch2-master-1 Sep 17 21:29:30.943428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [req-b6e9fe2b-6524-4fc8-83f0-b14d4324ebb8 req-ea794270-3093-43ea-9c56-1f4e2c86e953 service nova] Instance 79ba1cf6-9ca8-49de-95ac-bab9ee572c82 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140523) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 21:29:30.959585 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-b6e9fe2b-6524-4fc8-83f0-b14d4324ebb8 req-ea794270-3093-43ea-9c56-1f4e2c86e953 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059248 Sep 17 21:29:30.960131 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2983/6049] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:29:31.387969 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-59554e4c-e89d-4d7c-942c-eaff5c485499 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:29:31.390149 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-59554e4c-e89d-4d7c-942c-eaff5c485499 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:29:31.399774 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59554e4c-e89d-4d7c-942c-eaff5c485499 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:31.400754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59554e4c-e89d-4d7c-942c-eaff5c485499 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:31.401790 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59554e4c-e89d-4d7c-942c-eaff5c485499 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:31.402771 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59554e4c-e89d-4d7c-942c-eaff5c485499 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:31.404207 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59554e4c-e89d-4d7c-942c-eaff5c485499 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:31.404970 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-59554e4c-e89d-4d7c-942c-eaff5c485499 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:31.573020 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-59554e4c-e89d-4d7c-942c-eaff5c485499 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:29:31.582950 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-59554e4c-e89d-4d7c-942c-eaff5c485499 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1689 microversion: 2.1 time: 0.199538 Sep 17 21:29:31.583940 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3067/6050] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:29:31 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1689 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:29:32.610109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-08611f5f-ded7-404b-943e-e635e2a07796 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:29:32.611663 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-08611f5f-ded7-404b-943e-e635e2a07796 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:29:32.613888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=41 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:29:32.620730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08611f5f-ded7-404b-943e-e635e2a07796 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:32.621223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08611f5f-ded7-404b-943e-e635e2a07796 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:32.621694 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08611f5f-ded7-404b-943e-e635e2a07796 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:32.622457 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08611f5f-ded7-404b-943e-e635e2a07796 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:32.622863 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08611f5f-ded7-404b-943e-e635e2a07796 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:32.623406 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08611f5f-ded7-404b-943e-e635e2a07796 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:32.772641 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-08611f5f-ded7-404b-943e-e635e2a07796 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:29:32.782474 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-08611f5f-ded7-404b-943e-e635e2a07796 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1682 microversion: 2.1 time: 0.177894 Sep 17 21:29:32.783221 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2984/6051] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:29:32 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:29:34.952647 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-475e1c26-36a3-42a2-8ffd-de78f36a7f11 req-def836ff-8a49-49a3-8442-68342a9a8ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ba1cf6-9ca8-49de-95ac-bab9ee572c82", "name": "network-vif-plugged", "status": "completed", "tag": "5744f71f-5b9f-4347-b063-bae68953657c"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:29:34.959951 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=39 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:29:34.964393 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-475e1c26-36a3-42a2-8ffd-de78f36a7f11 req-def836ff-8a49-49a3-8442-68342a9a8ad4 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:34.964896 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-475e1c26-36a3-42a2-8ffd-de78f36a7f11 req-def836ff-8a49-49a3-8442-68342a9a8ad4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:34.965417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-475e1c26-36a3-42a2-8ffd-de78f36a7f11 req-def836ff-8a49-49a3-8442-68342a9a8ad4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:34.980945 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-475e1c26-36a3-42a2-8ffd-de78f36a7f11 req-def836ff-8a49-49a3-8442-68342a9a8ad4 service nova] Creating event network-vif-plugged:5744f71f-5b9f-4347-b063-bae68953657c for instance 79ba1cf6-9ca8-49de-95ac-bab9ee572c82 on nch2-master-1 Sep 17 21:29:34.986999 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-475e1c26-36a3-42a2-8ffd-de78f36a7f11 req-def836ff-8a49-49a3-8442-68342a9a8ad4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038776 Sep 17 21:29:34.987914 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3068/6052] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:29:57.002303 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c8f5b926-0bb4-46db-a3c6-62183d7f50ee tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:29:57.004518 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c8f5b926-0bb4-46db-a3c6-62183d7f50ee tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:29:57.007418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:29:57.008299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=21 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:29:57.013659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8f5b926-0bb4-46db-a3c6-62183d7f50ee tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:57.014149 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8f5b926-0bb4-46db-a3c6-62183d7f50ee tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:57.014584 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8f5b926-0bb4-46db-a3c6-62183d7f50ee tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:57.015290 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8f5b926-0bb4-46db-a3c6-62183d7f50ee tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:29:57.015743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8f5b926-0bb4-46db-a3c6-62183d7f50ee tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:29:57.016166 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c8f5b926-0bb4-46db-a3c6-62183d7f50ee tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:29:57.073226 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c8f5b926-0bb4-46db-a3c6-62183d7f50ee tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "POST /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82/action" status: 200 len: 63246 microversion: 2.1 time: 0.074807 Sep 17 21:29:57.073948 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2985/6053] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:29:56 2022] POST /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82/action => generated 63246 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:30:03.320230 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=12 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:30:03.321504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:30:03.328281 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7d69d7bd-683b-4fd0-be55-edc81e03631f tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:30:03.329604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7d69d7bd-683b-4fd0-be55-edc81e03631f tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:30:03.341522 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d69d7bd-683b-4fd0-be55-edc81e03631f tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:03.342336 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d69d7bd-683b-4fd0-be55-edc81e03631f tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:03.342770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d69d7bd-683b-4fd0-be55-edc81e03631f tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:03.343526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d69d7bd-683b-4fd0-be55-edc81e03631f tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:03.343996 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d69d7bd-683b-4fd0-be55-edc81e03631f tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:03.344427 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d69d7bd-683b-4fd0-be55-edc81e03631f tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:03.483854 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7d69d7bd-683b-4fd0-be55-edc81e03631f tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1833 microversion: 2.1 time: 0.167644 Sep 17 21:30:03.484431 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3069/6054] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:30:03 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1833 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:30:04.691223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-a24776c5-dca7-4f02-9358-8f1470767f05 req-5e7f8894-8c39-4c01-94fa-c2ae4d4cac33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79ba1cf6-9ca8-49de-95ac-bab9ee572c82", "tag": "5744f71f-5b9f-4347-b063-bae68953657c"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:30:04.700499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-95a00b74-1b4d-4e20-b89c-aca2b96a659d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:30:04.701104 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-95a00b74-1b4d-4e20-b89c-aca2b96a659d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:30:04.708539 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a24776c5-dca7-4f02-9358-8f1470767f05 req-5e7f8894-8c39-4c01-94fa-c2ae4d4cac33 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:04.708972 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95a00b74-1b4d-4e20-b89c-aca2b96a659d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:04.709095 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a24776c5-dca7-4f02-9358-8f1470767f05 req-5e7f8894-8c39-4c01-94fa-c2ae4d4cac33 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:04.709470 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95a00b74-1b4d-4e20-b89c-aca2b96a659d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:04.709600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a24776c5-dca7-4f02-9358-8f1470767f05 req-5e7f8894-8c39-4c01-94fa-c2ae4d4cac33 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:04.709933 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95a00b74-1b4d-4e20-b89c-aca2b96a659d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:04.710642 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95a00b74-1b4d-4e20-b89c-aca2b96a659d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:04.711098 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95a00b74-1b4d-4e20-b89c-aca2b96a659d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:04.711560 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95a00b74-1b4d-4e20-b89c-aca2b96a659d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:04.721040 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-a24776c5-dca7-4f02-9358-8f1470767f05 req-5e7f8894-8c39-4c01-94fa-c2ae4d4cac33 service nova] Creating event network-changed:5744f71f-5b9f-4347-b063-bae68953657c for instance 79ba1cf6-9ca8-49de-95ac-bab9ee572c82 on nch2-master-1 Sep 17 21:30:04.726723 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-a24776c5-dca7-4f02-9358-8f1470767f05 req-5e7f8894-8c39-4c01-94fa-c2ae4d4cac33 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039073 Sep 17 21:30:04.727531 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3070/6055] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:30:04.739569 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-95a00b74-1b4d-4e20-b89c-aca2b96a659d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:30:04.827034 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-95a00b74-1b4d-4e20-b89c-aca2b96a659d tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "DELETE /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 204 len: 0 microversion: 2.1 time: 0.143584 Sep 17 21:30:04.828307 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2986/6056] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:30:04 2022] DELETE /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:30:04.838506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2ec2d569-bcfd-4267-92f3-38078bc42ed1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:30:04.839924 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2ec2d569-bcfd-4267-92f3-38078bc42ed1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:30:04.846806 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ec2d569-bcfd-4267-92f3-38078bc42ed1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:04.847598 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ec2d569-bcfd-4267-92f3-38078bc42ed1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:04.848276 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ec2d569-bcfd-4267-92f3-38078bc42ed1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:04.849270 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ec2d569-bcfd-4267-92f3-38078bc42ed1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:04.849822 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ec2d569-bcfd-4267-92f3-38078bc42ed1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:04.850273 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2ec2d569-bcfd-4267-92f3-38078bc42ed1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:04.992806 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2ec2d569-bcfd-4267-92f3-38078bc42ed1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:30:05.002375 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2ec2d569-bcfd-4267-92f3-38078bc42ed1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1688 microversion: 2.1 time: 0.168422 Sep 17 21:30:05.002953 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3071/6057] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:30:04 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:30:06.027329 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7c0bb2b1-171e-4534-8ae7-c6bd2e14c658 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:30:06.028126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7c0bb2b1-171e-4534-8ae7-c6bd2e14c658 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:30:06.035741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c0bb2b1-171e-4534-8ae7-c6bd2e14c658 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:06.036232 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c0bb2b1-171e-4534-8ae7-c6bd2e14c658 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:06.036674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c0bb2b1-171e-4534-8ae7-c6bd2e14c658 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:06.037380 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c0bb2b1-171e-4534-8ae7-c6bd2e14c658 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:06.037918 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c0bb2b1-171e-4534-8ae7-c6bd2e14c658 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:06.038358 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c0bb2b1-171e-4534-8ae7-c6bd2e14c658 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:06.242544 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7c0bb2b1-171e-4534-8ae7-c6bd2e14c658 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:30:06.251817 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7c0bb2b1-171e-4534-8ae7-c6bd2e14c658 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 200 len: 1688 microversion: 2.1 time: 0.228854 Sep 17 21:30:06.252445 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2987/6058] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:30:06 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 1688 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:30:06.743213 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-39d91ebf-8cbf-4d73-999f-91539391554e req-e00ff457-ff63-4ac1-9b51-ac2145be533a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ba1cf6-9ca8-49de-95ac-bab9ee572c82", "name": "network-vif-deleted", "tag": "5744f71f-5b9f-4347-b063-bae68953657c"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:30:06.754041 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-39d91ebf-8cbf-4d73-999f-91539391554e req-e00ff457-ff63-4ac1-9b51-ac2145be533a service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:06.754548 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-39d91ebf-8cbf-4d73-999f-91539391554e req-e00ff457-ff63-4ac1-9b51-ac2145be533a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:06.755004 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-39d91ebf-8cbf-4d73-999f-91539391554e req-e00ff457-ff63-4ac1-9b51-ac2145be533a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:06.766926 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-39d91ebf-8cbf-4d73-999f-91539391554e req-e00ff457-ff63-4ac1-9b51-ac2145be533a service nova] Creating event network-vif-deleted:5744f71f-5b9f-4347-b063-bae68953657c for instance 79ba1cf6-9ca8-49de-95ac-bab9ee572c82 on nch2-master-1 Sep 17 21:30:06.771818 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-39d91ebf-8cbf-4d73-999f-91539391554e req-e00ff457-ff63-4ac1-9b51-ac2145be533a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032728 Sep 17 21:30:06.772424 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3072/6059] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:30:07.275855 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a1513a7b-b202-41a5-b0d4-ba9f24341af6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:30:07.276430 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a1513a7b-b202-41a5-b0d4-ba9f24341af6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 79ba1cf6-9ca8-49de-95ac-bab9ee572c82] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:30:07.284039 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1513a7b-b202-41a5-b0d4-ba9f24341af6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:07.284512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1513a7b-b202-41a5-b0d4-ba9f24341af6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:07.284963 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1513a7b-b202-41a5-b0d4-ba9f24341af6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:07.285679 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1513a7b-b202-41a5-b0d4-ba9f24341af6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:07.286173 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1513a7b-b202-41a5-b0d4-ba9f24341af6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:07.286606 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1513a7b-b202-41a5-b0d4-ba9f24341af6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:07.300896 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-a1513a7b-b202-41a5-b0d4-ba9f24341af6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] HTTP exception thrown: Instance 79ba1cf6-9ca8-49de-95ac-bab9ee572c82 could not be found. Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a1513a7b-b202-41a5-b0d4-ba9f24341af6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Request method failure captured: Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 HTTP/1.1 Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjt1HGD-AGecBeXKG-Tv1X03jkbjY02aJ3vfhgY7AyhVE2LrBQ6rG6j8P8XaKvJajIa-Tr-B_mPCCFATHv-I927Mv8bDNOk0IIJoeqei7Daucjc-FPiGYYkt6YVWEtLmPt9TcFJzteSZ58GSfRYwBLV5RLbestURdkZQMGtWKaf5y9w Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: b67de414e1aa4fde9ed87336f30c2767 Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1107857406 Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b67de414e1aa4fde9ed87336f30c2767"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b67de414e1aa4fde9ed87336f30c2767"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b67de414e1aa4fde9ed87336f30c2767"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b67de414e1aa4fde9ed87336f30c2767", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1107857406 Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: b67de414e1aa4fde9ed87336f30c2767 Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1107857406 Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-TestNetworkAdvancedServerOps-1107857406-project Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 3cb55865ecad4c05adc52a1aacd2aa10 Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1107857406-project Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 79ba1cf6-9ca8-49de-95ac-bab9ee572c82 could not be found. Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '79ba1cf6-9ca8-49de-95ac-bab9ee572c82'} Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79ba1cf6-9ca8-49de-95ac-bab9ee572c82 could not be found. Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79ba1cf6-9ca8-49de-95ac-bab9ee572c82 could not be found. Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:30:07.302588 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:30:07.307234 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:30:07.307234 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:30:07.307234 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:30:07.307234 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:30:07.307234 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:30:07.307234 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:30:07.307234 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79ba1cf6-9ca8-49de-95ac-bab9ee572c82 could not be found. Sep 17 21:30:07.307234 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:30:07.307234 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a1513a7b-b202-41a5-b0d4-ba9f24341af6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Returning 404 to user: Instance 79ba1cf6-9ca8-49de-95ac-bab9ee572c82 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:30:07.307234 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a1513a7b-b202-41a5-b0d4-ba9f24341af6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82" status: 404 len: 111 microversion: 2.1 time: 0.032271 Sep 17 21:30:07.307234 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2988/6060] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:30:07 2022] GET /compute/v2.1/servers/79ba1cf6-9ca8-49de-95ac-bab9ee572c82 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:30:10.427530 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d8aad815-3132-488e-bef6-3dfdc5d297d8 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '.version_select at 0x7f25aa012310>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:30:10.464351 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d8aad815-3132-488e-bef6-3dfdc5d297d8 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1919570747" status: 202 len: 0 microversion: 2.1 time: 0.046405 Sep 17 21:30:10.465144 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3073/6061] 10.222.0.26 () {58 vars in 1284 bytes} [Sat Sep 17 21:30:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1919570747 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:30:10.499423 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4c69c618-c4ab-418c-b7df-1ba377f39657 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Action: 'create', calling method: .version_select at 0x7f25a4782ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1010769091", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPuzYoc30WXwGVdgcQ/q5+Rewg3msjlZurx7jguHzVwcz7poYwc5nX/igCr+kMRPddl3E3YcUCFQwwpbroZFz7h56W+TfKo+LM7Ol46eYhtZ1/XSoJmgvldwkjIYhaW6Jw=="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:30:10.518365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-4c69c618-c4ab-418c-b7df-1ba377f39657 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Getting quotas for project b67de414e1aa4fde9ed87336f30c2767. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:30:10.523829 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-4c69c618-c4ab-418c-b7df-1ba377f39657 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Getting quotas for user 3cb55865ecad4c05adc52a1aacd2aa10 and project b67de414e1aa4fde9ed87336f30c2767. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:30:10.549110 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4c69c618-c4ab-418c-b7df-1ba377f39657 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053636 Sep 17 21:30:10.549762 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2989/6062] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:30:10 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:30:16.511942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b9e5a1ac-cceb-486f-9fcc-4cb2918208f6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-357622874", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "145998f0-46bd-46b3-bc22-cbb790b6bb65"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1010769091", "security_groups": [{"name": "tempest-secgroup-smoke-1475716552"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:30:16.651566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-b9e5a1ac-cceb-486f-9fcc-4cb2918208f6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] validate_networks() for [('145998f0-46bd-46b3-bc22-cbb790b6bb65', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:30:16.759564 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=16 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:30:17.059025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-b9e5a1ac-cceb-486f-9fcc-4cb2918208f6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:30:17.059476 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-b9e5a1ac-cceb-486f-9fcc-4cb2918208f6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:30:17.060147 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-b9e5a1ac-cceb-486f-9fcc-4cb2918208f6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:30:17.060606 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-b9e5a1ac-cceb-486f-9fcc-4cb2918208f6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:30:17.061078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-b9e5a1ac-cceb-486f-9fcc-4cb2918208f6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:30:17.071025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9e5a1ac-cceb-486f-9fcc-4cb2918208f6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:17.071476 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9e5a1ac-cceb-486f-9fcc-4cb2918208f6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:17.072137 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9e5a1ac-cceb-486f-9fcc-4cb2918208f6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:17.072898 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9e5a1ac-cceb-486f-9fcc-4cb2918208f6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:17.073378 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9e5a1ac-cceb-486f-9fcc-4cb2918208f6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:17.073884 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b9e5a1ac-cceb-486f-9fcc-4cb2918208f6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:17.092680 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-b9e5a1ac-cceb-486f-9fcc-4cb2918208f6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Getting quotas for project b67de414e1aa4fde9ed87336f30c2767. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:30:17.098532 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-b9e5a1ac-cceb-486f-9fcc-4cb2918208f6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Getting quotas for user 3cb55865ecad4c05adc52a1aacd2aa10 and project b67de414e1aa4fde9ed87336f30c2767. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:30:17.112481 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b9e5a1ac-cceb-486f-9fcc-4cb2918208f6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:30:17.115033 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b9e5a1ac-cceb-486f-9fcc-4cb2918208f6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 4af069a8-88b7-4088-900a-44c6887ff651] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:30:17.165903 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b9e5a1ac-cceb-486f-9fcc-4cb2918208f6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.659753 Sep 17 21:30:17.166786 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3074/6063] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:30:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:30:17.178860 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a774eaef-1985-47ad-9549-7470ad5addf0 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:30:17.179491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a774eaef-1985-47ad-9549-7470ad5addf0 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 4af069a8-88b7-4088-900a-44c6887ff651] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:30:17.248585 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a774eaef-1985-47ad-9549-7470ad5addf0 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:30:17.255689 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a774eaef-1985-47ad-9549-7470ad5addf0 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651" status: 200 len: 1266 microversion: 2.1 time: 0.081543 Sep 17 21:30:17.269654 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2990/6064] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:30:17 2022] GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651 => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:30:18.280396 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8e9f3fac-7487-426e-9d89-1a7f8c432c83 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:30:18.281786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8e9f3fac-7487-426e-9d89-1a7f8c432c83 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 4af069a8-88b7-4088-900a-44c6887ff651] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:30:18.289698 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e9f3fac-7487-426e-9d89-1a7f8c432c83 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:18.290615 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e9f3fac-7487-426e-9d89-1a7f8c432c83 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:18.291298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e9f3fac-7487-426e-9d89-1a7f8c432c83 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:18.292275 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e9f3fac-7487-426e-9d89-1a7f8c432c83 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:18.292969 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e9f3fac-7487-426e-9d89-1a7f8c432c83 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:18.293687 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e9f3fac-7487-426e-9d89-1a7f8c432c83 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:18.376881 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8e9f3fac-7487-426e-9d89-1a7f8c432c83 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:30:18.385216 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8e9f3fac-7487-426e-9d89-1a7f8c432c83 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651" status: 200 len: 1336 microversion: 2.1 time: 0.109823 Sep 17 21:30:18.386054 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3075/6065] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:30:18 2022] GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651 => generated 1336 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:30:19.408481 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-98f58a51-dceb-4868-a8c5-942fb70f9c2e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:30:19.409104 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-98f58a51-dceb-4868-a8c5-942fb70f9c2e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 4af069a8-88b7-4088-900a-44c6887ff651] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:30:19.411478 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:30:19.419280 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98f58a51-dceb-4868-a8c5-942fb70f9c2e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:19.419712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98f58a51-dceb-4868-a8c5-942fb70f9c2e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:19.420161 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98f58a51-dceb-4868-a8c5-942fb70f9c2e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:19.421076 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98f58a51-dceb-4868-a8c5-942fb70f9c2e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:19.421573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98f58a51-dceb-4868-a8c5-942fb70f9c2e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:19.422198 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-98f58a51-dceb-4868-a8c5-942fb70f9c2e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:19.672750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-98f58a51-dceb-4868-a8c5-942fb70f9c2e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:30:19.683265 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-98f58a51-dceb-4868-a8c5-942fb70f9c2e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651" status: 200 len: 1392 microversion: 2.1 time: 0.278765 Sep 17 21:30:19.684035 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2991/6066] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:30:19 2022] GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651 => generated 1392 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:30:19.910965 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-86b50af9-c42f-429b-86bc-7d15f7473a0e req-3b996f59-1a63-46eb-9517-316aca0f7578 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4af069a8-88b7-4088-900a-44c6887ff651", "tag": "06f19c44-9c1b-4a48-b97c-525b823591c3"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:30:19.934161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-86b50af9-c42f-429b-86bc-7d15f7473a0e req-3b996f59-1a63-46eb-9517-316aca0f7578 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:19.937963 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-86b50af9-c42f-429b-86bc-7d15f7473a0e req-3b996f59-1a63-46eb-9517-316aca0f7578 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:19.939027 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-86b50af9-c42f-429b-86bc-7d15f7473a0e req-3b996f59-1a63-46eb-9517-316aca0f7578 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:19.951137 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-86b50af9-c42f-429b-86bc-7d15f7473a0e req-3b996f59-1a63-46eb-9517-316aca0f7578 service nova] Creating event network-changed:06f19c44-9c1b-4a48-b97c-525b823591c3 for instance 4af069a8-88b7-4088-900a-44c6887ff651 on nch2-master-1 Sep 17 21:30:19.958679 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-86b50af9-c42f-429b-86bc-7d15f7473a0e req-3b996f59-1a63-46eb-9517-316aca0f7578 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051727 Sep 17 21:30:19.959475 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3076/6067] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:30:20.708738 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6d4a17e9-2157-49a0-a71b-a3c95c35904f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:30:20.709359 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6d4a17e9-2157-49a0-a71b-a3c95c35904f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 4af069a8-88b7-4088-900a-44c6887ff651] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:30:20.716346 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d4a17e9-2157-49a0-a71b-a3c95c35904f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:20.716839 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d4a17e9-2157-49a0-a71b-a3c95c35904f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:20.717275 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d4a17e9-2157-49a0-a71b-a3c95c35904f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:20.718012 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d4a17e9-2157-49a0-a71b-a3c95c35904f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:20.718466 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d4a17e9-2157-49a0-a71b-a3c95c35904f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:20.718898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6d4a17e9-2157-49a0-a71b-a3c95c35904f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:20.872900 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6d4a17e9-2157-49a0-a71b-a3c95c35904f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:30:20.884894 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6d4a17e9-2157-49a0-a71b-a3c95c35904f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651" status: 200 len: 1392 microversion: 2.1 time: 0.179775 Sep 17 21:30:20.885726 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2992/6068] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:30:20 2022] GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651 => generated 1392 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:30:21.909719 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-72fb928e-2024-4ad1-b5ef-716f357f6ba6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:30:21.910460 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-72fb928e-2024-4ad1-b5ef-716f357f6ba6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 4af069a8-88b7-4088-900a-44c6887ff651] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:30:21.917279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72fb928e-2024-4ad1-b5ef-716f357f6ba6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:21.917811 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72fb928e-2024-4ad1-b5ef-716f357f6ba6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:21.918262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72fb928e-2024-4ad1-b5ef-716f357f6ba6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:21.918976 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72fb928e-2024-4ad1-b5ef-716f357f6ba6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:21.919442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72fb928e-2024-4ad1-b5ef-716f357f6ba6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:21.919878 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72fb928e-2024-4ad1-b5ef-716f357f6ba6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:22.080635 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-72fb928e-2024-4ad1-b5ef-716f357f6ba6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:30:22.088967 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-72fb928e-2024-4ad1-b5ef-716f357f6ba6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651" status: 200 len: 1392 microversion: 2.1 time: 0.184690 Sep 17 21:30:22.089579 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3077/6069] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:30:21 2022] GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651 => generated 1392 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:30:23.112714 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9975aaf6-659f-4558-8800-3df4b72db346 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:30:23.113332 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9975aaf6-659f-4558-8800-3df4b72db346 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 4af069a8-88b7-4088-900a-44c6887ff651] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:30:23.120796 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9975aaf6-659f-4558-8800-3df4b72db346 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:23.121291 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9975aaf6-659f-4558-8800-3df4b72db346 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:23.121766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9975aaf6-659f-4558-8800-3df4b72db346 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:23.122471 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9975aaf6-659f-4558-8800-3df4b72db346 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:23.122932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9975aaf6-659f-4558-8800-3df4b72db346 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:23.123365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9975aaf6-659f-4558-8800-3df4b72db346 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:23.269236 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9975aaf6-659f-4558-8800-3df4b72db346 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:30:23.277178 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9975aaf6-659f-4558-8800-3df4b72db346 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651" status: 200 len: 1392 microversion: 2.1 time: 0.168491 Sep 17 21:30:23.277758 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2993/6070] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:30:23 2022] GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:30:24.301037 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f7bcb93f-87ea-4c72-ab46-723bd2c050d3 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:30:24.301705 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f7bcb93f-87ea-4c72-ab46-723bd2c050d3 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 4af069a8-88b7-4088-900a-44c6887ff651] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:30:24.309448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7bcb93f-87ea-4c72-ab46-723bd2c050d3 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:24.309993 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7bcb93f-87ea-4c72-ab46-723bd2c050d3 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:24.310455 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7bcb93f-87ea-4c72-ab46-723bd2c050d3 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:24.311212 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7bcb93f-87ea-4c72-ab46-723bd2c050d3 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:24.311689 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7bcb93f-87ea-4c72-ab46-723bd2c050d3 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:24.312141 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7bcb93f-87ea-4c72-ab46-723bd2c050d3 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:24.446139 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f7bcb93f-87ea-4c72-ab46-723bd2c050d3 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:30:24.454595 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f7bcb93f-87ea-4c72-ab46-723bd2c050d3 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651" status: 200 len: 1392 microversion: 2.1 time: 0.157727 Sep 17 21:30:24.455187 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3078/6071] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:30:24 2022] GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:30:25.059616 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-b16f3ba2-8713-4b75-af21-1eb0f69042a0 req-fc2d12e8-1023-4eb9-805f-66f3ba0e0f7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4af069a8-88b7-4088-900a-44c6887ff651", "name": "network-vif-plugged", "status": "completed", "tag": "06f19c44-9c1b-4a48-b97c-525b823591c3"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:30:25.070893 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b16f3ba2-8713-4b75-af21-1eb0f69042a0 req-fc2d12e8-1023-4eb9-805f-66f3ba0e0f7e service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:25.071379 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b16f3ba2-8713-4b75-af21-1eb0f69042a0 req-fc2d12e8-1023-4eb9-805f-66f3ba0e0f7e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:25.071817 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b16f3ba2-8713-4b75-af21-1eb0f69042a0 req-fc2d12e8-1023-4eb9-805f-66f3ba0e0f7e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:25.084236 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-b16f3ba2-8713-4b75-af21-1eb0f69042a0 req-fc2d12e8-1023-4eb9-805f-66f3ba0e0f7e service nova] Creating event network-vif-plugged:06f19c44-9c1b-4a48-b97c-525b823591c3 for instance 4af069a8-88b7-4088-900a-44c6887ff651 on nch2-master-1 Sep 17 21:30:25.089392 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-b16f3ba2-8713-4b75-af21-1eb0f69042a0 req-fc2d12e8-1023-4eb9-805f-66f3ba0e0f7e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033647 Sep 17 21:30:25.090112 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2994/6072] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:30:25.490350 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8bc6bde3-091d-4115-8873-098ba5a397fc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:30:25.491218 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8bc6bde3-091d-4115-8873-098ba5a397fc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 4af069a8-88b7-4088-900a-44c6887ff651] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:30:25.501370 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bc6bde3-091d-4115-8873-098ba5a397fc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:25.501917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bc6bde3-091d-4115-8873-098ba5a397fc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:25.502384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bc6bde3-091d-4115-8873-098ba5a397fc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:25.503107 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bc6bde3-091d-4115-8873-098ba5a397fc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:25.503584 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bc6bde3-091d-4115-8873-098ba5a397fc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:25.504033 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bc6bde3-091d-4115-8873-098ba5a397fc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:25.651042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8bc6bde3-091d-4115-8873-098ba5a397fc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:30:25.660489 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8bc6bde3-091d-4115-8873-098ba5a397fc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651" status: 200 len: 1392 microversion: 2.1 time: 0.177050 Sep 17 21:30:25.661080 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3079/6073] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:30:25 2022] GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651 => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:30:26.684324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e584e6dd-43cc-4568-8274-c459785ea3b2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:30:26.685670 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e584e6dd-43cc-4568-8274-c459785ea3b2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 4af069a8-88b7-4088-900a-44c6887ff651] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:30:26.694943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e584e6dd-43cc-4568-8274-c459785ea3b2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:26.695160 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e584e6dd-43cc-4568-8274-c459785ea3b2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:26.695424 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e584e6dd-43cc-4568-8274-c459785ea3b2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:26.696156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e584e6dd-43cc-4568-8274-c459785ea3b2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:26.696637 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e584e6dd-43cc-4568-8274-c459785ea3b2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:26.697276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e584e6dd-43cc-4568-8274-c459785ea3b2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:26.836555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e584e6dd-43cc-4568-8274-c459785ea3b2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:30:26.844717 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e584e6dd-43cc-4568-8274-c459785ea3b2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651" status: 200 len: 1564 microversion: 2.1 time: 0.165302 Sep 17 21:30:26.845308 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2995/6074] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:30:26 2022] GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651 => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:30:26.867693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d9e08444-33db-4411-ad03-7c4865d4a719 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:30:26.868332 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d9e08444-33db-4411-ad03-7c4865d4a719 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 4af069a8-88b7-4088-900a-44c6887ff651] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:30:26.875785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d9e08444-33db-4411-ad03-7c4865d4a719 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:26.876309 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d9e08444-33db-4411-ad03-7c4865d4a719 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:26.876767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d9e08444-33db-4411-ad03-7c4865d4a719 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:26.877504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d9e08444-33db-4411-ad03-7c4865d4a719 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:26.878014 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d9e08444-33db-4411-ad03-7c4865d4a719 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:26.878467 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d9e08444-33db-4411-ad03-7c4865d4a719 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:27.019529 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d9e08444-33db-4411-ad03-7c4865d4a719 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:30:27.030973 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d9e08444-33db-4411-ad03-7c4865d4a719 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651" status: 200 len: 1564 microversion: 2.1 time: 0.167229 Sep 17 21:30:27.031583 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3080/6075] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:30:26 2022] GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651 => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:30:27.517294 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-421444f3-24c4-4446-9e30-6fca79f31c0b tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2004362943", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1399000875", "security_groups": [{"name": "tempest-secgroup-smoke-1270477296"}], "block_device_mapping_v2": [{"uuid": "6a0cfe92-0d9c-46d1-91d9-ddfcb8b8ceac", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "277ba9f5-743a-4949-b45f-d5582af5f04e"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:30:27.528483 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:30:27.529375 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:30:27.642827 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-421444f3-24c4-4446-9e30-6fca79f31c0b tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] validate_networks() for [('277ba9f5-743a-4949-b45f-d5582af5f04e', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:30:28.034383 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-421444f3-24c4-4446-9e30-6fca79f31c0b tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:30:28.034997 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-421444f3-24c4-4446-9e30-6fca79f31c0b tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:30:28.035360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-421444f3-24c4-4446-9e30-6fca79f31c0b tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:30:28.035785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-421444f3-24c4-4446-9e30-6fca79f31c0b tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:30:28.036206 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-421444f3-24c4-4446-9e30-6fca79f31c0b tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:30:28.046191 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-421444f3-24c4-4446-9e30-6fca79f31c0b tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:28.046691 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-421444f3-24c4-4446-9e30-6fca79f31c0b tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:28.048085 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-421444f3-24c4-4446-9e30-6fca79f31c0b tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:28.048861 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-421444f3-24c4-4446-9e30-6fca79f31c0b tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:28.049324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-421444f3-24c4-4446-9e30-6fca79f31c0b tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:28.049816 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-421444f3-24c4-4446-9e30-6fca79f31c0b tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:28.068210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-421444f3-24c4-4446-9e30-6fca79f31c0b tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Getting quotas for project b99d2a0b4d7e40a38e682fc147e968af. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:30:28.074022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-421444f3-24c4-4446-9e30-6fca79f31c0b tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Getting quotas for user 342e60103c9b45bcb348b6f8bcd686ca and project b99d2a0b4d7e40a38e682fc147e968af. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:30:28.135745 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-421444f3-24c4-4446-9e30-6fca79f31c0b tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:30:28.137937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-421444f3-24c4-4446-9e30-6fca79f31c0b tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 4c826814-8c96-4caf-b84c-b2f6b547fdc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6a0cfe92-0d9c-46d1-91d9-ddfcb8b8ceac',volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:30:28.276729 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-421444f3-24c4-4446-9e30-6fca79f31c0b tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.763709 Sep 17 21:30:28.277482 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2996/6076] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:30:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:30:28.290980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-79769e8a-bc84-4b33-8aa4-b0a688df5f8d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:30:28.291801 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-79769e8a-bc84-4b33-8aa4-b0a688df5f8d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 4c826814-8c96-4caf-b84c-b2f6b547fdc7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:30:28.295355 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:30:28.296147 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=6 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:30:28.355672 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-79769e8a-bc84-4b33-8aa4-b0a688df5f8d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:30:28.372142 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-79769e8a-bc84-4b33-8aa4-b0a688df5f8d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7" status: 200 len: 1095 microversion: 2.1 time: 0.086300 Sep 17 21:30:28.387069 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3081/6077] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:30:28 2022] GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7 => generated 1095 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:30:29.078468 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f46ecbed-5ef9-41d6-91af-447449729382 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:30:29.079839 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f46ecbed-5ef9-41d6-91af-447449729382 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 4af069a8-88b7-4088-900a-44c6887ff651] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:30:29.088093 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f46ecbed-5ef9-41d6-91af-447449729382 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:29.088872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f46ecbed-5ef9-41d6-91af-447449729382 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:29.089501 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f46ecbed-5ef9-41d6-91af-447449729382 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:29.090568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f46ecbed-5ef9-41d6-91af-447449729382 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:29.091206 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f46ecbed-5ef9-41d6-91af-447449729382 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:29.091824 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f46ecbed-5ef9-41d6-91af-447449729382 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:29.093770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-e5b0e008-bae2-44a7-8d63-8250214b4669 req-9164f7a4-b1d4-49c1-99d1-485ce7a56f31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4af069a8-88b7-4088-900a-44c6887ff651", "tag": "06f19c44-9c1b-4a48-b97c-525b823591c3"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:30:29.106225 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e5b0e008-bae2-44a7-8d63-8250214b4669 req-9164f7a4-b1d4-49c1-99d1-485ce7a56f31 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:29.106750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e5b0e008-bae2-44a7-8d63-8250214b4669 req-9164f7a4-b1d4-49c1-99d1-485ce7a56f31 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:29.107578 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e5b0e008-bae2-44a7-8d63-8250214b4669 req-9164f7a4-b1d4-49c1-99d1-485ce7a56f31 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:29.123352 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-e5b0e008-bae2-44a7-8d63-8250214b4669 req-9164f7a4-b1d4-49c1-99d1-485ce7a56f31 service nova] Creating event network-changed:06f19c44-9c1b-4a48-b97c-525b823591c3 for instance 4af069a8-88b7-4088-900a-44c6887ff651 on nch2-master-1 Sep 17 21:30:29.129239 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-e5b0e008-bae2-44a7-8d63-8250214b4669 req-9164f7a4-b1d4-49c1-99d1-485ce7a56f31 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044091 Sep 17 21:30:29.133619 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3082/6078] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:30:29.350831 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f46ecbed-5ef9-41d6-91af-447449729382 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:30:29.362847 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f46ecbed-5ef9-41d6-91af-447449729382 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651" status: 200 len: 1564 microversion: 2.1 time: 0.290008 Sep 17 21:30:29.363453 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2997/6079] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:30:29 2022] GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651 => generated 1564 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:30:29.396359 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-741de77c-a697-4515-926c-5ce799582b89 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:30:29.398074 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-741de77c-a697-4515-926c-5ce799582b89 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 4c826814-8c96-4caf-b84c-b2f6b547fdc7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:30:29.406730 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-741de77c-a697-4515-926c-5ce799582b89 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:29.407986 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-741de77c-a697-4515-926c-5ce799582b89 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:29.408691 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-741de77c-a697-4515-926c-5ce799582b89 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:29.409682 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-741de77c-a697-4515-926c-5ce799582b89 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:29.410365 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-741de77c-a697-4515-926c-5ce799582b89 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:29.411065 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-741de77c-a697-4515-926c-5ce799582b89 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:29.509539 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-741de77c-a697-4515-926c-5ce799582b89 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:30:29.523574 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-741de77c-a697-4515-926c-5ce799582b89 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7" status: 200 len: 1201 microversion: 2.1 time: 0.131718 Sep 17 21:30:29.525917 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3083/6080] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:30:29 2022] GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7 => generated 1201 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:30:30.549338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-63eca5fb-8344-4042-baa1-3a415d46a9a9 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:30:30.550687 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-63eca5fb-8344-4042-baa1-3a415d46a9a9 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 4c826814-8c96-4caf-b84c-b2f6b547fdc7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:30:30.558402 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-63eca5fb-8344-4042-baa1-3a415d46a9a9 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:30.559140 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-63eca5fb-8344-4042-baa1-3a415d46a9a9 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:30.559817 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-63eca5fb-8344-4042-baa1-3a415d46a9a9 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:30.560638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-63eca5fb-8344-4042-baa1-3a415d46a9a9 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:30.561265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-63eca5fb-8344-4042-baa1-3a415d46a9a9 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:30.561888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-63eca5fb-8344-4042-baa1-3a415d46a9a9 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:30.718373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-63eca5fb-8344-4042-baa1-3a415d46a9a9 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:30:30.732068 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-63eca5fb-8344-4042-baa1-3a415d46a9a9 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7" status: 200 len: 1279 microversion: 2.1 time: 0.186553 Sep 17 21:30:30.733256 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2998/6081] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:30:30 2022] GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7 => generated 1279 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:30:31.166585 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-05665052-1b7d-4b07-af0b-78af02a2b9a0 req-f2d272d9-d6a4-4348-9db7-bcb38a4e644b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c826814-8c96-4caf-b84c-b2f6b547fdc7", "tag": "1e78390b-08e4-4d6a-bc94-b7f2e5a1f7ec"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:30:31.177978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-05665052-1b7d-4b07-af0b-78af02a2b9a0 req-f2d272d9-d6a4-4348-9db7-bcb38a4e644b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:31.178544 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-05665052-1b7d-4b07-af0b-78af02a2b9a0 req-f2d272d9-d6a4-4348-9db7-bcb38a4e644b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:31.178998 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-05665052-1b7d-4b07-af0b-78af02a2b9a0 req-f2d272d9-d6a4-4348-9db7-bcb38a4e644b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:31.190567 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-05665052-1b7d-4b07-af0b-78af02a2b9a0 req-f2d272d9-d6a4-4348-9db7-bcb38a4e644b service nova] Creating event network-changed:1e78390b-08e4-4d6a-bc94-b7f2e5a1f7ec for instance 4c826814-8c96-4caf-b84c-b2f6b547fdc7 on nch1-master-1 Sep 17 21:30:31.196042 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-05665052-1b7d-4b07-af0b-78af02a2b9a0 req-f2d272d9-d6a4-4348-9db7-bcb38a4e644b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038439 Sep 17 21:30:31.196807 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3084/6082] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:30:31.760519 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-548c0778-b9c5-4940-aca4-99b9c7a98646 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:30:31.761527 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-548c0778-b9c5-4940-aca4-99b9c7a98646 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 4c826814-8c96-4caf-b84c-b2f6b547fdc7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:30:31.770049 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-548c0778-b9c5-4940-aca4-99b9c7a98646 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:31.770556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-548c0778-b9c5-4940-aca4-99b9c7a98646 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:31.771001 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-548c0778-b9c5-4940-aca4-99b9c7a98646 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:31.771716 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-548c0778-b9c5-4940-aca4-99b9c7a98646 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:31.772179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-548c0778-b9c5-4940-aca4-99b9c7a98646 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:31.772612 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-548c0778-b9c5-4940-aca4-99b9c7a98646 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:31.915601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-548c0778-b9c5-4940-aca4-99b9c7a98646 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:30:31.923836 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-548c0778-b9c5-4940-aca4-99b9c7a98646 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7" status: 200 len: 1267 microversion: 2.1 time: 0.169961 Sep 17 21:30:31.924459 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 2999/6083] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:30:31 2022] GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:30:32.954204 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7726eb7d-9593-4ba7-869f-928655d4b53d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:30:32.955261 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7726eb7d-9593-4ba7-869f-928655d4b53d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 4c826814-8c96-4caf-b84c-b2f6b547fdc7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:30:32.966197 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7726eb7d-9593-4ba7-869f-928655d4b53d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:32.967037 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7726eb7d-9593-4ba7-869f-928655d4b53d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:32.967745 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7726eb7d-9593-4ba7-869f-928655d4b53d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:32.968516 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7726eb7d-9593-4ba7-869f-928655d4b53d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:32.969001 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7726eb7d-9593-4ba7-869f-928655d4b53d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:32.969449 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7726eb7d-9593-4ba7-869f-928655d4b53d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:33.118621 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7726eb7d-9593-4ba7-869f-928655d4b53d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:30:33.126969 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7726eb7d-9593-4ba7-869f-928655d4b53d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7" status: 200 len: 1267 microversion: 2.1 time: 0.181718 Sep 17 21:30:33.127567 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3085/6084] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:30:32 2022] GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:30:34.154092 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dc378ba2-d0ee-483f-aa94-97e3c375c359 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:30:34.155147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dc378ba2-d0ee-483f-aa94-97e3c375c359 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 4c826814-8c96-4caf-b84c-b2f6b547fdc7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:30:34.166518 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dc378ba2-d0ee-483f-aa94-97e3c375c359 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:34.167321 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dc378ba2-d0ee-483f-aa94-97e3c375c359 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:34.168064 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dc378ba2-d0ee-483f-aa94-97e3c375c359 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:34.169247 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dc378ba2-d0ee-483f-aa94-97e3c375c359 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:34.170006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dc378ba2-d0ee-483f-aa94-97e3c375c359 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:34.170717 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dc378ba2-d0ee-483f-aa94-97e3c375c359 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:34.309270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dc378ba2-d0ee-483f-aa94-97e3c375c359 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:30:34.317284 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dc378ba2-d0ee-483f-aa94-97e3c375c359 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7" status: 200 len: 1267 microversion: 2.1 time: 0.169781 Sep 17 21:30:34.317895 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3000/6085] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:30:34 2022] GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:30:35.340453 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-71367561-9da4-4efd-84d3-70e71144c47d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:30:35.341108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-71367561-9da4-4efd-84d3-70e71144c47d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 4c826814-8c96-4caf-b84c-b2f6b547fdc7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:30:35.344071 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:30:35.349774 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71367561-9da4-4efd-84d3-70e71144c47d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:35.350279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71367561-9da4-4efd-84d3-70e71144c47d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:35.350732 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71367561-9da4-4efd-84d3-70e71144c47d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:35.351448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71367561-9da4-4efd-84d3-70e71144c47d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:35.351906 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71367561-9da4-4efd-84d3-70e71144c47d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:35.352386 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-71367561-9da4-4efd-84d3-70e71144c47d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:35.490302 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-71367561-9da4-4efd-84d3-70e71144c47d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:30:35.501834 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-71367561-9da4-4efd-84d3-70e71144c47d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7" status: 200 len: 1267 microversion: 2.1 time: 0.165408 Sep 17 21:30:35.502462 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3086/6086] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:30:35 2022] GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:30:36.525555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-32b9fb04-0b61-4749-9e1e-7a855f0e2d81 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:30:36.526362 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-32b9fb04-0b61-4749-9e1e-7a855f0e2d81 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 4c826814-8c96-4caf-b84c-b2f6b547fdc7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:30:36.536642 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32b9fb04-0b61-4749-9e1e-7a855f0e2d81 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:36.537300 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32b9fb04-0b61-4749-9e1e-7a855f0e2d81 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:36.538013 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32b9fb04-0b61-4749-9e1e-7a855f0e2d81 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:36.539000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32b9fb04-0b61-4749-9e1e-7a855f0e2d81 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:36.539704 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32b9fb04-0b61-4749-9e1e-7a855f0e2d81 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:36.540390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32b9fb04-0b61-4749-9e1e-7a855f0e2d81 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:36.688659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-32b9fb04-0b61-4749-9e1e-7a855f0e2d81 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:30:36.696954 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-32b9fb04-0b61-4749-9e1e-7a855f0e2d81 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7" status: 200 len: 1267 microversion: 2.1 time: 0.176351 Sep 17 21:30:36.697590 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3001/6087] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:30:36 2022] GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:30:37.719447 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1952ebed-791d-4a32-b3cf-715bb3eeec3d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:30:37.720066 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1952ebed-791d-4a32-b3cf-715bb3eeec3d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 4c826814-8c96-4caf-b84c-b2f6b547fdc7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:30:37.727594 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1952ebed-791d-4a32-b3cf-715bb3eeec3d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:37.728142 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1952ebed-791d-4a32-b3cf-715bb3eeec3d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:37.728613 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1952ebed-791d-4a32-b3cf-715bb3eeec3d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:37.729335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1952ebed-791d-4a32-b3cf-715bb3eeec3d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:37.729850 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1952ebed-791d-4a32-b3cf-715bb3eeec3d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:37.730306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1952ebed-791d-4a32-b3cf-715bb3eeec3d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:37.865047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1952ebed-791d-4a32-b3cf-715bb3eeec3d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:30:37.873630 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1952ebed-791d-4a32-b3cf-715bb3eeec3d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7" status: 200 len: 1267 microversion: 2.1 time: 0.158328 Sep 17 21:30:37.874503 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3087/6088] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:30:37 2022] GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:30:38.899237 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cd8a81da-935a-4e85-b389-04edffcff519 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:30:38.900020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cd8a81da-935a-4e85-b389-04edffcff519 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 4c826814-8c96-4caf-b84c-b2f6b547fdc7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:30:38.903614 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:30:38.904493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:30:38.911567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd8a81da-935a-4e85-b389-04edffcff519 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:38.912058 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd8a81da-935a-4e85-b389-04edffcff519 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:38.912500 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd8a81da-935a-4e85-b389-04edffcff519 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:38.914085 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd8a81da-935a-4e85-b389-04edffcff519 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:38.914898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd8a81da-935a-4e85-b389-04edffcff519 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:38.915336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd8a81da-935a-4e85-b389-04edffcff519 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:39.054189 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cd8a81da-935a-4e85-b389-04edffcff519 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:30:39.062374 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cd8a81da-935a-4e85-b389-04edffcff519 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7" status: 200 len: 1267 microversion: 2.1 time: 0.168613 Sep 17 21:30:39.063013 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3002/6089] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:30:38 2022] GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:30:39.079246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-c0e8d8e3-229d-4a60-a020-30aa6b80c817 req-b0712335-4aee-4162-8e81-cfa6a82538a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c826814-8c96-4caf-b84c-b2f6b547fdc7", "name": "network-vif-plugged", "status": "completed", "tag": "1e78390b-08e4-4d6a-bc94-b7f2e5a1f7ec"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:30:39.084437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:30:39.093641 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c0e8d8e3-229d-4a60-a020-30aa6b80c817 req-b0712335-4aee-4162-8e81-cfa6a82538a5 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:39.094250 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c0e8d8e3-229d-4a60-a020-30aa6b80c817 req-b0712335-4aee-4162-8e81-cfa6a82538a5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:39.094699 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c0e8d8e3-229d-4a60-a020-30aa6b80c817 req-b0712335-4aee-4162-8e81-cfa6a82538a5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:39.106013 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-c0e8d8e3-229d-4a60-a020-30aa6b80c817 req-b0712335-4aee-4162-8e81-cfa6a82538a5 service nova] Creating event network-vif-plugged:1e78390b-08e4-4d6a-bc94-b7f2e5a1f7ec for instance 4c826814-8c96-4caf-b84c-b2f6b547fdc7 on nch1-master-1 Sep 17 21:30:39.111471 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-c0e8d8e3-229d-4a60-a020-30aa6b80c817 req-b0712335-4aee-4162-8e81-cfa6a82538a5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036125 Sep 17 21:30:39.112494 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3088/6090] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:30:40.086456 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ef7949c1-74da-49f6-b44f-a5d67a0f99db tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:30:40.087065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ef7949c1-74da-49f6-b44f-a5d67a0f99db tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 4c826814-8c96-4caf-b84c-b2f6b547fdc7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:30:40.095090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef7949c1-74da-49f6-b44f-a5d67a0f99db tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:40.095583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef7949c1-74da-49f6-b44f-a5d67a0f99db tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:40.096079 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef7949c1-74da-49f6-b44f-a5d67a0f99db tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:40.096855 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef7949c1-74da-49f6-b44f-a5d67a0f99db tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:40.097376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef7949c1-74da-49f6-b44f-a5d67a0f99db tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:40.097897 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef7949c1-74da-49f6-b44f-a5d67a0f99db tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:40.246471 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ef7949c1-74da-49f6-b44f-a5d67a0f99db tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:30:40.254811 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ef7949c1-74da-49f6-b44f-a5d67a0f99db tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7" status: 200 len: 1267 microversion: 2.1 time: 0.172941 Sep 17 21:30:40.255954 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3003/6091] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:30:40 2022] GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:30:41.284464 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a15fe42f-591e-4055-b0a3-f01304784ffa tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:30:41.285197 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a15fe42f-591e-4055-b0a3-f01304784ffa tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 4c826814-8c96-4caf-b84c-b2f6b547fdc7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:30:41.292883 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a15fe42f-591e-4055-b0a3-f01304784ffa tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:41.293394 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a15fe42f-591e-4055-b0a3-f01304784ffa tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:41.293896 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a15fe42f-591e-4055-b0a3-f01304784ffa tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:41.294621 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a15fe42f-591e-4055-b0a3-f01304784ffa tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:41.295104 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a15fe42f-591e-4055-b0a3-f01304784ffa tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:41.295565 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a15fe42f-591e-4055-b0a3-f01304784ffa tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:41.428486 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a15fe42f-591e-4055-b0a3-f01304784ffa tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:30:41.436903 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a15fe42f-591e-4055-b0a3-f01304784ffa tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7" status: 200 len: 1455 microversion: 2.1 time: 0.158194 Sep 17 21:30:41.437496 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3089/6092] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:30:41 2022] GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7 => generated 1455 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:30:41.459723 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a8ebf2fe-0fb1-4f0e-8d6f-2b4a7d1e1d8d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:30:41.460359 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a8ebf2fe-0fb1-4f0e-8d6f-2b4a7d1e1d8d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 4c826814-8c96-4caf-b84c-b2f6b547fdc7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:30:41.467822 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a8ebf2fe-0fb1-4f0e-8d6f-2b4a7d1e1d8d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:41.468329 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a8ebf2fe-0fb1-4f0e-8d6f-2b4a7d1e1d8d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:41.468781 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a8ebf2fe-0fb1-4f0e-8d6f-2b4a7d1e1d8d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:41.469565 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a8ebf2fe-0fb1-4f0e-8d6f-2b4a7d1e1d8d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:41.470043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a8ebf2fe-0fb1-4f0e-8d6f-2b4a7d1e1d8d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:41.470481 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a8ebf2fe-0fb1-4f0e-8d6f-2b4a7d1e1d8d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:41.615253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a8ebf2fe-0fb1-4f0e-8d6f-2b4a7d1e1d8d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:30:41.624162 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a8ebf2fe-0fb1-4f0e-8d6f-2b4a7d1e1d8d tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7" status: 200 len: 1455 microversion: 2.1 time: 0.168705 Sep 17 21:30:41.624730 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3004/6093] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:30:41 2022] GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7 => generated 1455 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:30:43.666099 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-2936aaf8-dfb0-4c73-a269-0cc5960784c8 req-e9163ca6-deed-4767-8c1c-58533837f945 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c826814-8c96-4caf-b84c-b2f6b547fdc7", "tag": "1e78390b-08e4-4d6a-bc94-b7f2e5a1f7ec"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:30:43.676314 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-2936aaf8-dfb0-4c73-a269-0cc5960784c8 req-e9163ca6-deed-4767-8c1c-58533837f945 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:43.676815 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-2936aaf8-dfb0-4c73-a269-0cc5960784c8 req-e9163ca6-deed-4767-8c1c-58533837f945 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:43.677251 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-2936aaf8-dfb0-4c73-a269-0cc5960784c8 req-e9163ca6-deed-4767-8c1c-58533837f945 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:43.688798 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-2936aaf8-dfb0-4c73-a269-0cc5960784c8 req-e9163ca6-deed-4767-8c1c-58533837f945 service nova] Creating event network-changed:1e78390b-08e4-4d6a-bc94-b7f2e5a1f7ec for instance 4c826814-8c96-4caf-b84c-b2f6b547fdc7 on nch1-master-1 Sep 17 21:30:43.694142 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-2936aaf8-dfb0-4c73-a269-0cc5960784c8 req-e9163ca6-deed-4767-8c1c-58533837f945 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031875 Sep 17 21:30:43.694801 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3090/6094] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:30:50.697425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7724de88-ee70-4523-aa11-1131a9d320a7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:30:50.700221 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7724de88-ee70-4523-aa11-1131a9d320a7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 4af069a8-88b7-4088-900a-44c6887ff651] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:30:50.708042 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7724de88-ee70-4523-aa11-1131a9d320a7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:50.708539 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7724de88-ee70-4523-aa11-1131a9d320a7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:50.709061 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7724de88-ee70-4523-aa11-1131a9d320a7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:50.710065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7724de88-ee70-4523-aa11-1131a9d320a7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:30:50.710561 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7724de88-ee70-4523-aa11-1131a9d320a7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:30:50.711230 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7724de88-ee70-4523-aa11-1131a9d320a7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:30:50.714544 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=77 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:30:50.778943 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7724de88-ee70-4523-aa11-1131a9d320a7 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "POST /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651/action" status: 200 len: 24568 microversion: 2.1 time: 0.086380 Sep 17 21:30:50.779684 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3005/6095] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:30:50 2022] POST /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651/action => generated 24568 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:31:01.724647 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-297e21b6-9de3-4bd0-9850-47fc8135ff26 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:31:01.726070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-297e21b6-9de3-4bd0-9850-47fc8135ff26 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 4af069a8-88b7-4088-900a-44c6887ff651] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:31:01.728971 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=9 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:31:01.729657 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=72 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:31:01.736587 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-297e21b6-9de3-4bd0-9850-47fc8135ff26 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:01.737105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-297e21b6-9de3-4bd0-9850-47fc8135ff26 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:01.737699 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-297e21b6-9de3-4bd0-9850-47fc8135ff26 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:01.738623 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-297e21b6-9de3-4bd0-9850-47fc8135ff26 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:01.739093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-297e21b6-9de3-4bd0-9850-47fc8135ff26 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:01.739620 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-297e21b6-9de3-4bd0-9850-47fc8135ff26 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:01.883775 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-297e21b6-9de3-4bd0-9850-47fc8135ff26 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:31:01.892073 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-297e21b6-9de3-4bd0-9850-47fc8135ff26 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651" status: 200 len: 1683 microversion: 2.1 time: 0.172392 Sep 17 21:31:01.892667 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3091/6096] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:31:01 2022] GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651 => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:31:02.004523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f571a04f-e27b-48bd-8481-e12534ed2604 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:31:02.006869 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f571a04f-e27b-48bd-8481-e12534ed2604 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 4af069a8-88b7-4088-900a-44c6887ff651] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:31:02.009874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:31:02.010507 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:31:02.016635 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f571a04f-e27b-48bd-8481-e12534ed2604 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:02.017153 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f571a04f-e27b-48bd-8481-e12534ed2604 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:02.017653 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f571a04f-e27b-48bd-8481-e12534ed2604 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:02.018376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f571a04f-e27b-48bd-8481-e12534ed2604 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:02.018869 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f571a04f-e27b-48bd-8481-e12534ed2604 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:02.019307 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f571a04f-e27b-48bd-8481-e12534ed2604 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:02.073705 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f571a04f-e27b-48bd-8481-e12534ed2604 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "POST /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651/action" status: 200 len: 32641 microversion: 2.1 time: 0.074922 Sep 17 21:31:02.074529 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3006/6097] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:31:01 2022] POST /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651/action => generated 32641 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:31:02.233499 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-245387ff-1910-4eac-9b7d-1b4955d4c38e tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:31:02.234038 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-245387ff-1910-4eac-9b7d-1b4955d4c38e tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] [instance: 4af069a8-88b7-4088-900a-44c6887ff651] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:31:02.240734 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-245387ff-1910-4eac-9b7d-1b4955d4c38e tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:02.241262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-245387ff-1910-4eac-9b7d-1b4955d4c38e tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:02.241757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-245387ff-1910-4eac-9b7d-1b4955d4c38e tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:02.242497 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-245387ff-1910-4eac-9b7d-1b4955d4c38e tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:02.242948 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-245387ff-1910-4eac-9b7d-1b4955d4c38e tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:02.243391 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-245387ff-1910-4eac-9b7d-1b4955d4c38e tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:02.381024 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-245387ff-1910-4eac-9b7d-1b4955d4c38e tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651" status: 200 len: 1834 microversion: 2.1 time: 0.151789 Sep 17 21:31:02.381729 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3092/6098] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:31:02 2022] GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651 => generated 1834 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:31:02.412235 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-05c151a7-74ae-4f64-b983-0ae03848b649 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:31:02.414922 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-05c151a7-74ae-4f64-b983-0ae03848b649 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] [instance: 4af069a8-88b7-4088-900a-44c6887ff651] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:31:02.422514 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-05c151a7-74ae-4f64-b983-0ae03848b649 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:02.423039 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-05c151a7-74ae-4f64-b983-0ae03848b649 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:02.423486 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-05c151a7-74ae-4f64-b983-0ae03848b649 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:02.424251 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-05c151a7-74ae-4f64-b983-0ae03848b649 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:02.424707 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-05c151a7-74ae-4f64-b983-0ae03848b649 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:02.425337 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-05c151a7-74ae-4f64-b983-0ae03848b649 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:02.462846 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-05c151a7-74ae-4f64-b983-0ae03848b649 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lazy-loading 'flavor' on Instance uuid 4af069a8-88b7-4088-900a-44c6887ff651 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:31:02.476729 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-05c151a7-74ae-4f64-b983-0ae03848b649 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] [instance: 4af069a8-88b7-4088-900a-44c6887ff651] Going to try to live migrate instance to another host {{(pid=140523) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 17 21:31:04.135041 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-05c151a7-74ae-4f64-b983-0ae03848b649 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651/action" status: 202 len: 0 microversion: 2.1 time: 1.727281 Sep 17 21:31:04.135948 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3007/6099] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:31:02 2022] POST /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651/action => generated 0 bytes in 1729 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:31:04.146648 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ba730b01-5be1-4ccf-9626-fd7f1b20a925 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:31:04.147558 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ba730b01-5be1-4ccf-9626-fd7f1b20a925 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 4af069a8-88b7-4088-900a-44c6887ff651] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:31:04.155187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ba730b01-5be1-4ccf-9626-fd7f1b20a925 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:04.155764 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ba730b01-5be1-4ccf-9626-fd7f1b20a925 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:04.156256 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ba730b01-5be1-4ccf-9626-fd7f1b20a925 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:04.157106 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ba730b01-5be1-4ccf-9626-fd7f1b20a925 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:04.157626 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ba730b01-5be1-4ccf-9626-fd7f1b20a925 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:04.158073 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ba730b01-5be1-4ccf-9626-fd7f1b20a925 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:04.301703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ba730b01-5be1-4ccf-9626-fd7f1b20a925 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:31:04.311828 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ba730b01-5be1-4ccf-9626-fd7f1b20a925 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651" status: 200 len: 1693 microversion: 2.1 time: 0.170253 Sep 17 21:31:04.312496 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3093/6100] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:31:04 2022] GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651 => generated 1693 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:31:05.245568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-17e3faa2-cca2-4b22-9bfc-d26fcdb8f0bb req-ea1d222e-cb35-4e30-b62d-0621ee38312d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4af069a8-88b7-4088-900a-44c6887ff651", "name": "network-vif-unplugged", "status": "completed", "tag": "06f19c44-9c1b-4a48-b97c-525b823591c3"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:31:05.256618 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-17e3faa2-cca2-4b22-9bfc-d26fcdb8f0bb req-ea1d222e-cb35-4e30-b62d-0621ee38312d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:05.257107 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-17e3faa2-cca2-4b22-9bfc-d26fcdb8f0bb req-ea1d222e-cb35-4e30-b62d-0621ee38312d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:05.257568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-17e3faa2-cca2-4b22-9bfc-d26fcdb8f0bb req-ea1d222e-cb35-4e30-b62d-0621ee38312d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:05.269143 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-17e3faa2-cca2-4b22-9bfc-d26fcdb8f0bb req-ea1d222e-cb35-4e30-b62d-0621ee38312d service nova] Creating event network-vif-unplugged:06f19c44-9c1b-4a48-b97c-525b823591c3 for instance 4af069a8-88b7-4088-900a-44c6887ff651 on nch2-master-1 Sep 17 21:31:05.274259 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-17e3faa2-cca2-4b22-9bfc-d26fcdb8f0bb req-ea1d222e-cb35-4e30-b62d-0621ee38312d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032582 Sep 17 21:31:05.275182 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3008/6101] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:31:05.336429 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a4f190d9-a8bc-4271-9028-42288ae8614f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:31:05.342152 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a4f190d9-a8bc-4271-9028-42288ae8614f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 4af069a8-88b7-4088-900a-44c6887ff651] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:31:05.360110 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a4f190d9-a8bc-4271-9028-42288ae8614f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:05.364317 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a4f190d9-a8bc-4271-9028-42288ae8614f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:05.364790 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a4f190d9-a8bc-4271-9028-42288ae8614f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:05.365574 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a4f190d9-a8bc-4271-9028-42288ae8614f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:05.366060 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a4f190d9-a8bc-4271-9028-42288ae8614f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:05.366538 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a4f190d9-a8bc-4271-9028-42288ae8614f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:05.523272 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a4f190d9-a8bc-4271-9028-42288ae8614f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:31:05.532466 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a4f190d9-a8bc-4271-9028-42288ae8614f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651" status: 200 len: 1693 microversion: 2.1 time: 0.200521 Sep 17 21:31:05.533684 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3094/6102] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:31:05 2022] GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651 => generated 1693 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:31:06.558075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-968494d0-6fa1-4d47-bc06-97a28f1ecd36 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:31:06.558813 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-968494d0-6fa1-4d47-bc06-97a28f1ecd36 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 4af069a8-88b7-4088-900a-44c6887ff651] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:31:06.565486 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-968494d0-6fa1-4d47-bc06-97a28f1ecd36 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:06.566051 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-968494d0-6fa1-4d47-bc06-97a28f1ecd36 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:06.566495 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-968494d0-6fa1-4d47-bc06-97a28f1ecd36 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:06.567321 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-968494d0-6fa1-4d47-bc06-97a28f1ecd36 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:06.567871 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-968494d0-6fa1-4d47-bc06-97a28f1ecd36 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:06.568302 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-968494d0-6fa1-4d47-bc06-97a28f1ecd36 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:06.813097 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-968494d0-6fa1-4d47-bc06-97a28f1ecd36 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:31:06.821446 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-968494d0-6fa1-4d47-bc06-97a28f1ecd36 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651" status: 200 len: 1693 microversion: 2.1 time: 0.268596 Sep 17 21:31:06.822077 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3009/6103] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:31:06 2022] GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651 => generated 1693 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:31:07.289453 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-50a16988-8acb-41af-97e4-cef95e288182 req-9fa42b39-dc29-4cea-a1a6-375eb39149f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4af069a8-88b7-4088-900a-44c6887ff651", "tag": "06f19c44-9c1b-4a48-b97c-525b823591c3"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:31:07.300385 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-50a16988-8acb-41af-97e4-cef95e288182 req-9fa42b39-dc29-4cea-a1a6-375eb39149f8 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:07.300892 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-50a16988-8acb-41af-97e4-cef95e288182 req-9fa42b39-dc29-4cea-a1a6-375eb39149f8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:07.301350 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-50a16988-8acb-41af-97e4-cef95e288182 req-9fa42b39-dc29-4cea-a1a6-375eb39149f8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:07.312789 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-50a16988-8acb-41af-97e4-cef95e288182 req-9fa42b39-dc29-4cea-a1a6-375eb39149f8 service nova] Creating event network-changed:06f19c44-9c1b-4a48-b97c-525b823591c3 for instance 4af069a8-88b7-4088-900a-44c6887ff651 on nch2-master-1 Sep 17 21:31:07.317928 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-50a16988-8acb-41af-97e4-cef95e288182 req-9fa42b39-dc29-4cea-a1a6-375eb39149f8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032268 Sep 17 21:31:07.318504 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3095/6104] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:31:07.845513 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1037192f-c055-4769-91db-f2368daa4c03 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:31:07.846137 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1037192f-c055-4769-91db-f2368daa4c03 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 4af069a8-88b7-4088-900a-44c6887ff651] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:31:07.853912 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1037192f-c055-4769-91db-f2368daa4c03 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:07.854405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1037192f-c055-4769-91db-f2368daa4c03 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:07.854848 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1037192f-c055-4769-91db-f2368daa4c03 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:07.855563 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1037192f-c055-4769-91db-f2368daa4c03 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:07.856389 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1037192f-c055-4769-91db-f2368daa4c03 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:07.856814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1037192f-c055-4769-91db-f2368daa4c03 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:08.008136 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1037192f-c055-4769-91db-f2368daa4c03 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:31:08.017106 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1037192f-c055-4769-91db-f2368daa4c03 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651" status: 200 len: 1693 microversion: 2.1 time: 0.176336 Sep 17 21:31:08.017841 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3010/6105] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:31:07 2022] GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651 => generated 1693 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:31:09.043538 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-352b013e-5417-41ed-8e84-c2eb82527277 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:31:09.044834 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-352b013e-5417-41ed-8e84-c2eb82527277 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 4af069a8-88b7-4088-900a-44c6887ff651] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:31:09.052581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-352b013e-5417-41ed-8e84-c2eb82527277 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:09.053134 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-352b013e-5417-41ed-8e84-c2eb82527277 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:09.053687 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-352b013e-5417-41ed-8e84-c2eb82527277 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:09.054548 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-352b013e-5417-41ed-8e84-c2eb82527277 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:09.055088 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-352b013e-5417-41ed-8e84-c2eb82527277 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:09.055575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-352b013e-5417-41ed-8e84-c2eb82527277 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:09.267726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-352b013e-5417-41ed-8e84-c2eb82527277 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:31:09.276690 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-352b013e-5417-41ed-8e84-c2eb82527277 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651" status: 200 len: 1693 microversion: 2.1 time: 0.237852 Sep 17 21:31:09.277487 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3096/6106] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:31:09 2022] GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651 => generated 1693 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:31:10.305601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a00a7c32-51c0-46fc-b2c9-ba775eed4004 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:31:10.306576 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a00a7c32-51c0-46fc-b2c9-ba775eed4004 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 4af069a8-88b7-4088-900a-44c6887ff651] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:31:10.315748 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a00a7c32-51c0-46fc-b2c9-ba775eed4004 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:10.316235 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a00a7c32-51c0-46fc-b2c9-ba775eed4004 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:10.316671 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a00a7c32-51c0-46fc-b2c9-ba775eed4004 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:10.317368 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a00a7c32-51c0-46fc-b2c9-ba775eed4004 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:10.317862 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a00a7c32-51c0-46fc-b2c9-ba775eed4004 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:10.318290 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a00a7c32-51c0-46fc-b2c9-ba775eed4004 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:10.462700 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a00a7c32-51c0-46fc-b2c9-ba775eed4004 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:31:10.470891 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a00a7c32-51c0-46fc-b2c9-ba775eed4004 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651" status: 200 len: 1693 microversion: 2.1 time: 0.171861 Sep 17 21:31:10.471472 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3011/6107] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:31:10 2022] GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651 => generated 1693 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:31:11.495476 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-84cd78c2-4902-45fc-8066-20ae8033204f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:31:11.496178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-84cd78c2-4902-45fc-8066-20ae8033204f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 4af069a8-88b7-4088-900a-44c6887ff651] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:31:11.503574 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84cd78c2-4902-45fc-8066-20ae8033204f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:11.504094 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84cd78c2-4902-45fc-8066-20ae8033204f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:11.504529 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84cd78c2-4902-45fc-8066-20ae8033204f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:11.505301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84cd78c2-4902-45fc-8066-20ae8033204f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:11.505796 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84cd78c2-4902-45fc-8066-20ae8033204f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:11.506243 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84cd78c2-4902-45fc-8066-20ae8033204f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:11.643345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-84cd78c2-4902-45fc-8066-20ae8033204f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:31:11.651763 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-84cd78c2-4902-45fc-8066-20ae8033204f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651" status: 200 len: 1693 microversion: 2.1 time: 0.160401 Sep 17 21:31:11.652365 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3097/6108] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:31:11 2022] GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:31:12.675243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-513b1408-9ffa-4a34-b1b3-c917cbf0b263 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:31:12.675848 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-513b1408-9ffa-4a34-b1b3-c917cbf0b263 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 4af069a8-88b7-4088-900a-44c6887ff651] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:31:12.683494 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-513b1408-9ffa-4a34-b1b3-c917cbf0b263 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:12.683997 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-513b1408-9ffa-4a34-b1b3-c917cbf0b263 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:12.684447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-513b1408-9ffa-4a34-b1b3-c917cbf0b263 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:12.685183 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-513b1408-9ffa-4a34-b1b3-c917cbf0b263 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:12.685731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-513b1408-9ffa-4a34-b1b3-c917cbf0b263 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:12.686164 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-513b1408-9ffa-4a34-b1b3-c917cbf0b263 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:12.823788 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-513b1408-9ffa-4a34-b1b3-c917cbf0b263 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:31:12.832071 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-513b1408-9ffa-4a34-b1b3-c917cbf0b263 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651" status: 200 len: 1683 microversion: 2.1 time: 0.160777 Sep 17 21:31:12.832992 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3012/6109] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:31:12 2022] GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:31:12.855722 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cea06e5b-1a92-456d-b19d-4c7797ff8707 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:31:12.857444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cea06e5b-1a92-456d-b19d-4c7797ff8707 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] [instance: 4af069a8-88b7-4088-900a-44c6887ff651] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:31:12.864845 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cea06e5b-1a92-456d-b19d-4c7797ff8707 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:12.865363 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cea06e5b-1a92-456d-b19d-4c7797ff8707 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:12.865857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cea06e5b-1a92-456d-b19d-4c7797ff8707 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:12.866589 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cea06e5b-1a92-456d-b19d-4c7797ff8707 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:12.867296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cea06e5b-1a92-456d-b19d-4c7797ff8707 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:12.867889 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cea06e5b-1a92-456d-b19d-4c7797ff8707 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:13.005328 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cea06e5b-1a92-456d-b19d-4c7797ff8707 tempest-TestNetworkAdvancedServerOps-2140306600 tempest-TestNetworkAdvancedServerOps-2140306600-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651" status: 200 len: 1834 microversion: 2.1 time: 0.153849 Sep 17 21:31:13.005944 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3098/6110] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:31:12 2022] GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651 => generated 1834 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:31:13.030726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b09c3bda-5854-485c-95ad-9d65a4d6f053 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:31:13.031356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b09c3bda-5854-485c-95ad-9d65a4d6f053 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 4af069a8-88b7-4088-900a-44c6887ff651] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:31:13.037905 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b09c3bda-5854-485c-95ad-9d65a4d6f053 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:13.038404 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b09c3bda-5854-485c-95ad-9d65a4d6f053 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:13.038852 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b09c3bda-5854-485c-95ad-9d65a4d6f053 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:13.039561 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b09c3bda-5854-485c-95ad-9d65a4d6f053 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:13.040022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b09c3bda-5854-485c-95ad-9d65a4d6f053 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:13.040455 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b09c3bda-5854-485c-95ad-9d65a4d6f053 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:13.175677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b09c3bda-5854-485c-95ad-9d65a4d6f053 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:31:13.183917 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b09c3bda-5854-485c-95ad-9d65a4d6f053 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651" status: 200 len: 1683 microversion: 2.1 time: 0.158487 Sep 17 21:31:13.184490 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3013/6111] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:31:13 2022] GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:31:13.283705 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4f9329e4-0f1c-4219-884e-7193f9e4b81a tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:31:13.286130 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4f9329e4-0f1c-4219-884e-7193f9e4b81a tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 4af069a8-88b7-4088-900a-44c6887ff651] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:31:13.292627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f9329e4-0f1c-4219-884e-7193f9e4b81a tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:13.293194 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f9329e4-0f1c-4219-884e-7193f9e4b81a tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:13.293716 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f9329e4-0f1c-4219-884e-7193f9e4b81a tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:13.294480 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f9329e4-0f1c-4219-884e-7193f9e4b81a tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:13.294963 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f9329e4-0f1c-4219-884e-7193f9e4b81a tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:13.295415 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f9329e4-0f1c-4219-884e-7193f9e4b81a tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:13.350330 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4f9329e4-0f1c-4219-884e-7193f9e4b81a tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "POST /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651/action" status: 200 len: 38666 microversion: 2.1 time: 0.070681 Sep 17 21:31:13.351007 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3099/6112] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:31:13 2022] POST /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651/action => generated 38666 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:31:14.369616 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-98f04789-701f-4bc3-847b-d29c9ee89918 req-e04f1ffa-d7a7-481b-ba62-88d2d2efc631 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4af069a8-88b7-4088-900a-44c6887ff651", "tag": "06f19c44-9c1b-4a48-b97c-525b823591c3"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:31:14.380856 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-98f04789-701f-4bc3-847b-d29c9ee89918 req-e04f1ffa-d7a7-481b-ba62-88d2d2efc631 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:14.381366 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-98f04789-701f-4bc3-847b-d29c9ee89918 req-e04f1ffa-d7a7-481b-ba62-88d2d2efc631 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:14.381849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-98f04789-701f-4bc3-847b-d29c9ee89918 req-e04f1ffa-d7a7-481b-ba62-88d2d2efc631 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:14.394899 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-98f04789-701f-4bc3-847b-d29c9ee89918 req-e04f1ffa-d7a7-481b-ba62-88d2d2efc631 service nova] Creating event network-changed:06f19c44-9c1b-4a48-b97c-525b823591c3 for instance 4af069a8-88b7-4088-900a-44c6887ff651 on nch1-master-1 Sep 17 21:31:14.399855 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-98f04789-701f-4bc3-847b-d29c9ee89918 req-e04f1ffa-d7a7-481b-ba62-88d2d2efc631 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034378 Sep 17 21:31:14.400848 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3100/6113] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:31:14.432098 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8ece593e-0666-49c6-9941-dd125c6425af tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:31:14.432690 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8ece593e-0666-49c6-9941-dd125c6425af tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 4af069a8-88b7-4088-900a-44c6887ff651] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:31:14.439118 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ece593e-0666-49c6-9941-dd125c6425af tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:14.439808 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ece593e-0666-49c6-9941-dd125c6425af tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:14.440261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ece593e-0666-49c6-9941-dd125c6425af tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:14.440982 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ece593e-0666-49c6-9941-dd125c6425af tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:14.441493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ece593e-0666-49c6-9941-dd125c6425af tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:14.441928 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8ece593e-0666-49c6-9941-dd125c6425af tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:14.469335 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8ece593e-0666-49c6-9941-dd125c6425af tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 4af069a8-88b7-4088-900a-44c6887ff651] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:31:14.571562 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8ece593e-0666-49c6-9941-dd125c6425af tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651" status: 204 len: 0 microversion: 2.1 time: 0.206910 Sep 17 21:31:14.575387 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3014/6114] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:31:14 2022] DELETE /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:31:14.581714 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e713a118-5cb4-4a57-aed3-802d67a96cfa tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:31:14.583428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e713a118-5cb4-4a57-aed3-802d67a96cfa tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 4af069a8-88b7-4088-900a-44c6887ff651] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:31:14.592361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e713a118-5cb4-4a57-aed3-802d67a96cfa tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:14.593170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e713a118-5cb4-4a57-aed3-802d67a96cfa tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:14.594387 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e713a118-5cb4-4a57-aed3-802d67a96cfa tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:14.595897 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e713a118-5cb4-4a57-aed3-802d67a96cfa tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:14.596579 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e713a118-5cb4-4a57-aed3-802d67a96cfa tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:14.597730 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e713a118-5cb4-4a57-aed3-802d67a96cfa tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:14.743634 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e713a118-5cb4-4a57-aed3-802d67a96cfa tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:31:14.752163 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e713a118-5cb4-4a57-aed3-802d67a96cfa tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651" status: 200 len: 1689 microversion: 2.1 time: 0.175171 Sep 17 21:31:14.753091 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3101/6115] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:31:14 2022] GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651 => generated 1689 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:31:15.578391 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-7527343d-b280-4cad-916e-6931fcc56fe0 req-30a745fa-376f-434c-bca4-e8beb7cfbe23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4af069a8-88b7-4088-900a-44c6887ff651", "name": "network-vif-deleted", "tag": "06f19c44-9c1b-4a48-b97c-525b823591c3"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:31:15.590450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-7527343d-b280-4cad-916e-6931fcc56fe0 req-30a745fa-376f-434c-bca4-e8beb7cfbe23 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:15.590943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-7527343d-b280-4cad-916e-6931fcc56fe0 req-30a745fa-376f-434c-bca4-e8beb7cfbe23 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:15.591388 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-7527343d-b280-4cad-916e-6931fcc56fe0 req-30a745fa-376f-434c-bca4-e8beb7cfbe23 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:15.602819 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-7527343d-b280-4cad-916e-6931fcc56fe0 req-30a745fa-376f-434c-bca4-e8beb7cfbe23 service nova] Creating event network-vif-deleted:06f19c44-9c1b-4a48-b97c-525b823591c3 for instance 4af069a8-88b7-4088-900a-44c6887ff651 on nch1-master-1 Sep 17 21:31:15.608158 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-7527343d-b280-4cad-916e-6931fcc56fe0 req-30a745fa-376f-434c-bca4-e8beb7cfbe23 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033987 Sep 17 21:31:15.608805 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3015/6116] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:31:15.776318 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1fc73eb7-5689-453f-8bff-5287fa262f80 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:31:15.777058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1fc73eb7-5689-453f-8bff-5287fa262f80 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: 4af069a8-88b7-4088-900a-44c6887ff651] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:31:15.784742 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1fc73eb7-5689-453f-8bff-5287fa262f80 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:15.785574 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1fc73eb7-5689-453f-8bff-5287fa262f80 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:15.786058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1fc73eb7-5689-453f-8bff-5287fa262f80 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:15.786829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1fc73eb7-5689-453f-8bff-5287fa262f80 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:15.787345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1fc73eb7-5689-453f-8bff-5287fa262f80 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:15.787802 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1fc73eb7-5689-453f-8bff-5287fa262f80 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:15.803146 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-1fc73eb7-5689-453f-8bff-5287fa262f80 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] HTTP exception thrown: Instance 4af069a8-88b7-4088-900a-44c6887ff651 could not be found. Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1fc73eb7-5689-453f-8bff-5287fa262f80 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Request method failure captured: Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651 HTTP/1.1 Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjt1HGD-AGecBeXKG-Tv1X03jkbjY02aJ3vfhgY7AyhVE2LrBQ6rG6j8P8XaKvJajIa-Tr-B_mPCCFATHv-I927Mv8bDNOk0IIJoeqei7Daucjc-FPiGYYkt6YVWEtLmPt9TcFJzteSZ58GSfRYwBLV5RLbestURdkZQMGtWKaf5y9w Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: b67de414e1aa4fde9ed87336f30c2767 Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1107857406 Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b67de414e1aa4fde9ed87336f30c2767"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b67de414e1aa4fde9ed87336f30c2767"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b67de414e1aa4fde9ed87336f30c2767"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b67de414e1aa4fde9ed87336f30c2767", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1107857406 Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: b67de414e1aa4fde9ed87336f30c2767 Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1107857406 Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-TestNetworkAdvancedServerOps-1107857406-project Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 3cb55865ecad4c05adc52a1aacd2aa10 Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1107857406-project Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 4af069a8-88b7-4088-900a-44c6887ff651 could not be found. Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '4af069a8-88b7-4088-900a-44c6887ff651'} Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4af069a8-88b7-4088-900a-44c6887ff651 could not be found. Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4af069a8-88b7-4088-900a-44c6887ff651 could not be found. Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:31:15.805305 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:31:15.809933 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:31:15.809933 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:31:15.809933 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:31:15.809933 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:31:15.809933 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:31:15.809933 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:31:15.809933 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4af069a8-88b7-4088-900a-44c6887ff651 could not be found. Sep 17 21:31:15.809933 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:31:15.809933 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1fc73eb7-5689-453f-8bff-5287fa262f80 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Returning 404 to user: Instance 4af069a8-88b7-4088-900a-44c6887ff651 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:31:15.809933 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1fc73eb7-5689-453f-8bff-5287fa262f80 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651" status: 404 len: 111 microversion: 2.1 time: 0.034843 Sep 17 21:31:15.809933 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3102/6117] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:31:15 2022] GET /compute/v2.1/servers/4af069a8-88b7-4088-900a-44c6887ff651 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:31:19.591226 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-358f1dcd-3aee-47eb-b15c-b7192911cef9 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '.version_select at 0x7f25a45f81f0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:31:19.617085 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-358f1dcd-3aee-47eb-b15c-b7192911cef9 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1010769091" status: 202 len: 0 microversion: 2.1 time: 0.031721 Sep 17 21:31:19.617773 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3016/6118] 10.222.0.26 () {58 vars in 1284 bytes} [Sat Sep 17 21:31:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1010769091 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:31:19.645675 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0701c581-f3f2-4b67-b14f-e1f8ba1128da tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Action: 'create', calling method: .version_select at 0x7f25a9f8e160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1576570525", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAA8FNFwTPZOpT3VdJTzIYkeuY7NzyVqeqv3rPhyjN32lTp0/Xk2bH/qhq0p8Eh4xALlW2aiICBiKtFutKaqR1WKkc1/vEyjAj2Kf44rdRorpuSUjToqgYr1xq7Exdh+A=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:31:19.662009 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-0701c581-f3f2-4b67-b14f-e1f8ba1128da tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Getting quotas for project b67de414e1aa4fde9ed87336f30c2767. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:31:19.668117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-0701c581-f3f2-4b67-b14f-e1f8ba1128da tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Getting quotas for user 3cb55865ecad4c05adc52a1aacd2aa10 and project b67de414e1aa4fde9ed87336f30c2767. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:31:19.694553 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0701c581-f3f2-4b67-b14f-e1f8ba1128da tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052855 Sep 17 21:31:19.695180 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3103/6119] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:31:19 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:31:25.562338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a2621e08-cada-48ba-ab4d-5aaefeda6268 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1464063005", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "8026ffa5-bb4b-437f-bd1e-a62dd38763d1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1576570525", "security_groups": [{"name": "tempest-secgroup-smoke-494173465"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:31:25.596043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:31:25.679706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-a2621e08-cada-48ba-ab4d-5aaefeda6268 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] validate_networks() for [('8026ffa5-bb4b-437f-bd1e-a62dd38763d1', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:31:26.154173 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a2621e08-cada-48ba-ab4d-5aaefeda6268 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:31:26.154854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a2621e08-cada-48ba-ab4d-5aaefeda6268 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:31:26.155547 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a2621e08-cada-48ba-ab4d-5aaefeda6268 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:31:26.156250 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a2621e08-cada-48ba-ab4d-5aaefeda6268 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:31:26.157501 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a2621e08-cada-48ba-ab4d-5aaefeda6268 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:31:26.170203 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2621e08-cada-48ba-ab4d-5aaefeda6268 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:26.171227 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2621e08-cada-48ba-ab4d-5aaefeda6268 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:26.172016 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2621e08-cada-48ba-ab4d-5aaefeda6268 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:26.174205 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2621e08-cada-48ba-ab4d-5aaefeda6268 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:26.175105 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2621e08-cada-48ba-ab4d-5aaefeda6268 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:26.175802 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2621e08-cada-48ba-ab4d-5aaefeda6268 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:26.200006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-a2621e08-cada-48ba-ab4d-5aaefeda6268 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Getting quotas for project b67de414e1aa4fde9ed87336f30c2767. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:31:26.206837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-a2621e08-cada-48ba-ab4d-5aaefeda6268 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Getting quotas for user 3cb55865ecad4c05adc52a1aacd2aa10 and project b67de414e1aa4fde9ed87336f30c2767. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:31:26.223625 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a2621e08-cada-48ba-ab4d-5aaefeda6268 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:31:26.226353 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a2621e08-cada-48ba-ab4d-5aaefeda6268 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:31:26.278014 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a2621e08-cada-48ba-ab4d-5aaefeda6268 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.720940 Sep 17 21:31:26.278772 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3017/6120] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:31:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:31:26.290938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4edcc268-5689-42c1-9804-c021ae3fe956 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:31:26.292211 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4edcc268-5689-42c1-9804-c021ae3fe956 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:31:26.299208 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=58 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:31:26.355128 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4edcc268-5689-42c1-9804-c021ae3fe956 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:31:26.363230 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4edcc268-5689-42c1-9804-c021ae3fe956 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f" status: 200 len: 1267 microversion: 2.1 time: 0.076146 Sep 17 21:31:26.378085 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3104/6121] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:31:26 2022] GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f => generated 1267 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:31:27.388761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5c4c9de7-ac80-4955-abc2-3f3c16fce6b6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:31:27.390165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5c4c9de7-ac80-4955-abc2-3f3c16fce6b6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:31:27.402565 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c4c9de7-ac80-4955-abc2-3f3c16fce6b6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:27.403473 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c4c9de7-ac80-4955-abc2-3f3c16fce6b6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:27.404278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c4c9de7-ac80-4955-abc2-3f3c16fce6b6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:27.405339 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c4c9de7-ac80-4955-abc2-3f3c16fce6b6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:27.406291 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c4c9de7-ac80-4955-abc2-3f3c16fce6b6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:27.406946 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c4c9de7-ac80-4955-abc2-3f3c16fce6b6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:27.498377 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5c4c9de7-ac80-4955-abc2-3f3c16fce6b6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:31:27.507203 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5c4c9de7-ac80-4955-abc2-3f3c16fce6b6 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f" status: 200 len: 1337 microversion: 2.1 time: 0.123258 Sep 17 21:31:27.507828 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3018/6122] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:31:27 2022] GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f => generated 1337 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:31:28.531418 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-51023abf-8938-48cf-b8ac-0100af9f4b4e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:31:28.532288 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-51023abf-8938-48cf-b8ac-0100af9f4b4e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:31:28.539765 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-51023abf-8938-48cf-b8ac-0100af9f4b4e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:28.540280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-51023abf-8938-48cf-b8ac-0100af9f4b4e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:28.540742 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-51023abf-8938-48cf-b8ac-0100af9f4b4e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:28.541493 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-51023abf-8938-48cf-b8ac-0100af9f4b4e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:28.541997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-51023abf-8938-48cf-b8ac-0100af9f4b4e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:28.542441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-51023abf-8938-48cf-b8ac-0100af9f4b4e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:28.762102 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-51023abf-8938-48cf-b8ac-0100af9f4b4e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:31:28.770766 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-51023abf-8938-48cf-b8ac-0100af9f4b4e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f" status: 200 len: 1392 microversion: 2.1 time: 0.243671 Sep 17 21:31:28.771361 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3105/6123] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:31:28 2022] GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f => generated 1392 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:31:29.070751 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-8a88fac1-fd8b-4e26-a451-06b9b92fda83 req-8713cd03-2878-41bf-afb7-b9365a534cf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce118d7c-fad6-455f-80d2-d7af56ea215f", "tag": "a7fc0e28-4c80-4bca-96ab-e903898defc6"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:31:29.080575 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8a88fac1-fd8b-4e26-a451-06b9b92fda83 req-8713cd03-2878-41bf-afb7-b9365a534cf5 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:29.081065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8a88fac1-fd8b-4e26-a451-06b9b92fda83 req-8713cd03-2878-41bf-afb7-b9365a534cf5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:29.081882 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8a88fac1-fd8b-4e26-a451-06b9b92fda83 req-8713cd03-2878-41bf-afb7-b9365a534cf5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:29.093214 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-8a88fac1-fd8b-4e26-a451-06b9b92fda83 req-8713cd03-2878-41bf-afb7-b9365a534cf5 service nova] Creating event network-changed:a7fc0e28-4c80-4bca-96ab-e903898defc6 for instance ce118d7c-fad6-455f-80d2-d7af56ea215f on nch2-master-1 Sep 17 21:31:29.098728 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-8a88fac1-fd8b-4e26-a451-06b9b92fda83 req-8713cd03-2878-41bf-afb7-b9365a534cf5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097820 Sep 17 21:31:29.099355 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3019/6124] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:31:29.798466 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1aa1ef57-4faf-45a2-a544-069b5db1fa40 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:31:29.799525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1aa1ef57-4faf-45a2-a544-069b5db1fa40 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:31:29.811321 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1aa1ef57-4faf-45a2-a544-069b5db1fa40 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:29.812167 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1aa1ef57-4faf-45a2-a544-069b5db1fa40 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:29.812775 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1aa1ef57-4faf-45a2-a544-069b5db1fa40 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:29.813509 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1aa1ef57-4faf-45a2-a544-069b5db1fa40 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:29.814014 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1aa1ef57-4faf-45a2-a544-069b5db1fa40 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:29.814461 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1aa1ef57-4faf-45a2-a544-069b5db1fa40 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:29.962954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1aa1ef57-4faf-45a2-a544-069b5db1fa40 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:31:29.971150 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1aa1ef57-4faf-45a2-a544-069b5db1fa40 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f" status: 200 len: 1392 microversion: 2.1 time: 0.179435 Sep 17 21:31:29.971731 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3106/6125] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:31:29 2022] GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f => generated 1392 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:31:30.997254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9963ceb2-af9f-4114-ad54-a4c798b41d41 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:31:30.997995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9963ceb2-af9f-4114-ad54-a4c798b41d41 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:31:31.005315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9963ceb2-af9f-4114-ad54-a4c798b41d41 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:31.005905 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9963ceb2-af9f-4114-ad54-a4c798b41d41 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:31.006459 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9963ceb2-af9f-4114-ad54-a4c798b41d41 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:31.007278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9963ceb2-af9f-4114-ad54-a4c798b41d41 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:31.007744 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9963ceb2-af9f-4114-ad54-a4c798b41d41 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:31.008182 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9963ceb2-af9f-4114-ad54-a4c798b41d41 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:31.153728 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9963ceb2-af9f-4114-ad54-a4c798b41d41 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:31:31.162844 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9963ceb2-af9f-4114-ad54-a4c798b41d41 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f" status: 200 len: 1392 microversion: 2.1 time: 0.171728 Sep 17 21:31:31.163466 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3020/6126] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:31:30 2022] GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:31:32.192348 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-79b21acb-ad21-4c35-859f-75df08d7d203 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:31:32.192953 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-79b21acb-ad21-4c35-859f-75df08d7d203 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:31:32.194950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:31:32.202142 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79b21acb-ad21-4c35-859f-75df08d7d203 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:32.202746 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79b21acb-ad21-4c35-859f-75df08d7d203 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:32.203216 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79b21acb-ad21-4c35-859f-75df08d7d203 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:32.204321 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79b21acb-ad21-4c35-859f-75df08d7d203 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:32.204810 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79b21acb-ad21-4c35-859f-75df08d7d203 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:32.205269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-79b21acb-ad21-4c35-859f-75df08d7d203 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:32.356612 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-79b21acb-ad21-4c35-859f-75df08d7d203 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:31:32.367125 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-79b21acb-ad21-4c35-859f-75df08d7d203 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f" status: 200 len: 1392 microversion: 2.1 time: 0.180728 Sep 17 21:31:32.377718 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3107/6127] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:31:32 2022] GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f => generated 1392 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:31:33.391143 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-14b05720-a073-47d6-95cf-2a1a29bde90a tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:31:33.391830 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-14b05720-a073-47d6-95cf-2a1a29bde90a tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:31:33.394468 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:31:33.402441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-14b05720-a073-47d6-95cf-2a1a29bde90a tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:33.402441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-14b05720-a073-47d6-95cf-2a1a29bde90a tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:33.404898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-14b05720-a073-47d6-95cf-2a1a29bde90a tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:33.404898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-14b05720-a073-47d6-95cf-2a1a29bde90a tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:33.404898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-14b05720-a073-47d6-95cf-2a1a29bde90a tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:33.404898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-14b05720-a073-47d6-95cf-2a1a29bde90a tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:33.557654 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-14b05720-a073-47d6-95cf-2a1a29bde90a tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:31:33.567534 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-14b05720-a073-47d6-95cf-2a1a29bde90a tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f" status: 200 len: 1392 microversion: 2.1 time: 0.180531 Sep 17 21:31:33.568420 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3021/6128] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:31:33 2022] GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f => generated 1392 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:31:34.592592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a0762e62-7c49-4369-9548-32d551e456cb tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:31:34.593403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a0762e62-7c49-4369-9548-32d551e456cb tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:31:34.601542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0762e62-7c49-4369-9548-32d551e456cb tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:34.602132 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0762e62-7c49-4369-9548-32d551e456cb tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:34.602796 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0762e62-7c49-4369-9548-32d551e456cb tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:34.603765 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0762e62-7c49-4369-9548-32d551e456cb tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:34.604244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0762e62-7c49-4369-9548-32d551e456cb tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:34.604813 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0762e62-7c49-4369-9548-32d551e456cb tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:34.760476 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a0762e62-7c49-4369-9548-32d551e456cb tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:31:34.769498 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a0762e62-7c49-4369-9548-32d551e456cb tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f" status: 200 len: 1392 microversion: 2.1 time: 0.181629 Sep 17 21:31:34.770098 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3108/6129] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:31:34 2022] GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f => generated 1392 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:31:35.279449 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-3f5e5397-e4cf-4b16-99a0-1bf70349feea req-25c8aa9b-0c01-4299-8d06-660fbdc888a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce118d7c-fad6-455f-80d2-d7af56ea215f", "name": "network-vif-plugged", "status": "completed", "tag": "a7fc0e28-4c80-4bca-96ab-e903898defc6"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:31:35.291322 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-3f5e5397-e4cf-4b16-99a0-1bf70349feea req-25c8aa9b-0c01-4299-8d06-660fbdc888a6 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:35.291757 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-3f5e5397-e4cf-4b16-99a0-1bf70349feea req-25c8aa9b-0c01-4299-8d06-660fbdc888a6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:35.292245 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-3f5e5397-e4cf-4b16-99a0-1bf70349feea req-25c8aa9b-0c01-4299-8d06-660fbdc888a6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:35.305416 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-3f5e5397-e4cf-4b16-99a0-1bf70349feea req-25c8aa9b-0c01-4299-8d06-660fbdc888a6 service nova] Creating event network-vif-plugged:a7fc0e28-4c80-4bca-96ab-e903898defc6 for instance ce118d7c-fad6-455f-80d2-d7af56ea215f on nch2-master-1 Sep 17 21:31:35.311521 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-3f5e5397-e4cf-4b16-99a0-1bf70349feea req-25c8aa9b-0c01-4299-8d06-660fbdc888a6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035984 Sep 17 21:31:35.312433 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3022/6130] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:31:35.795392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9254bab3-21ba-499a-94a1-34d97bd38be2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:31:35.796811 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9254bab3-21ba-499a-94a1-34d97bd38be2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:31:35.806041 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9254bab3-21ba-499a-94a1-34d97bd38be2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:35.806660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9254bab3-21ba-499a-94a1-34d97bd38be2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:35.807202 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9254bab3-21ba-499a-94a1-34d97bd38be2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:35.808061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9254bab3-21ba-499a-94a1-34d97bd38be2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:35.808586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9254bab3-21ba-499a-94a1-34d97bd38be2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:35.809098 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9254bab3-21ba-499a-94a1-34d97bd38be2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:35.963218 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9254bab3-21ba-499a-94a1-34d97bd38be2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:31:35.972023 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9254bab3-21ba-499a-94a1-34d97bd38be2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f" status: 200 len: 1392 microversion: 2.1 time: 0.181114 Sep 17 21:31:35.972727 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3109/6131] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:31:35 2022] GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f => generated 1392 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:31:36.996954 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:31:36.997693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:31:37.003837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-47d0ed3b-0957-42d2-a2b6-765747f2d158 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:31:37.004545 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-47d0ed3b-0957-42d2-a2b6-765747f2d158 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:31:37.013025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47d0ed3b-0957-42d2-a2b6-765747f2d158 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:37.013645 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47d0ed3b-0957-42d2-a2b6-765747f2d158 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:37.014213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47d0ed3b-0957-42d2-a2b6-765747f2d158 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:37.014935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47d0ed3b-0957-42d2-a2b6-765747f2d158 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:37.015416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47d0ed3b-0957-42d2-a2b6-765747f2d158 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:37.016108 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47d0ed3b-0957-42d2-a2b6-765747f2d158 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:37.158130 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-47d0ed3b-0957-42d2-a2b6-765747f2d158 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:31:37.166357 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-47d0ed3b-0957-42d2-a2b6-765747f2d158 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f" status: 200 len: 1564 microversion: 2.1 time: 0.170666 Sep 17 21:31:37.166955 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3023/6132] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:31:36 2022] GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f => generated 1564 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:31:37.188859 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5a873d2d-90e5-48d7-a119-282c323ef9cc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:31:37.189499 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5a873d2d-90e5-48d7-a119-282c323ef9cc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:31:37.191523 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=6 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:31:37.197956 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a873d2d-90e5-48d7-a119-282c323ef9cc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:37.198458 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a873d2d-90e5-48d7-a119-282c323ef9cc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:37.198918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a873d2d-90e5-48d7-a119-282c323ef9cc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:37.199634 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a873d2d-90e5-48d7-a119-282c323ef9cc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:37.200109 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a873d2d-90e5-48d7-a119-282c323ef9cc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:37.200554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a873d2d-90e5-48d7-a119-282c323ef9cc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:37.334229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5a873d2d-90e5-48d7-a119-282c323ef9cc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:31:37.342375 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5a873d2d-90e5-48d7-a119-282c323ef9cc tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f" status: 200 len: 1564 microversion: 2.1 time: 0.157596 Sep 17 21:31:37.342990 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3110/6133] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:31:37 2022] GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:31:39.041246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-7515dcdf-217c-46e3-a5d5-3dd88ef7f21d req-5c72d9dd-39be-40d5-a5e6-3144ea674391 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce118d7c-fad6-455f-80d2-d7af56ea215f", "tag": "a7fc0e28-4c80-4bca-96ab-e903898defc6"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:31:39.048660 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ce686145-b1d0-4145-9ca5-cea249d43ec2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:31:39.049266 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ce686145-b1d0-4145-9ca5-cea249d43ec2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:31:39.056254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce686145-b1d0-4145-9ca5-cea249d43ec2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:39.056742 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce686145-b1d0-4145-9ca5-cea249d43ec2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:39.057179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce686145-b1d0-4145-9ca5-cea249d43ec2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:39.058335 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce686145-b1d0-4145-9ca5-cea249d43ec2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:39.058430 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce686145-b1d0-4145-9ca5-cea249d43ec2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:39.058887 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ce686145-b1d0-4145-9ca5-cea249d43ec2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:39.068461 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7515dcdf-217c-46e3-a5d5-3dd88ef7f21d req-5c72d9dd-39be-40d5-a5e6-3144ea674391 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:31:39.069137 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7515dcdf-217c-46e3-a5d5-3dd88ef7f21d req-5c72d9dd-39be-40d5-a5e6-3144ea674391 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:31:39.069793 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7515dcdf-217c-46e3-a5d5-3dd88ef7f21d req-5c72d9dd-39be-40d5-a5e6-3144ea674391 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:31:39.081624 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-7515dcdf-217c-46e3-a5d5-3dd88ef7f21d req-5c72d9dd-39be-40d5-a5e6-3144ea674391 service nova] Creating event network-changed:a7fc0e28-4c80-4bca-96ab-e903898defc6 for instance ce118d7c-fad6-455f-80d2-d7af56ea215f on nch2-master-1 Sep 17 21:31:39.087230 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-7515dcdf-217c-46e3-a5d5-3dd88ef7f21d req-5c72d9dd-39be-40d5-a5e6-3144ea674391 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049800 Sep 17 21:31:39.088426 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3111/6134] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:31:39.297648 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ce686145-b1d0-4145-9ca5-cea249d43ec2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:31:39.307341 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ce686145-b1d0-4145-9ca5-cea249d43ec2 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f" status: 200 len: 1564 microversion: 2.1 time: 0.272490 Sep 17 21:31:39.308235 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3024/6135] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:31:39 2022] GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f => generated 1564 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:32:02.586335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=9 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:32:02.587110 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=38 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:32:02.591443 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-97d1fce6-1ed4-405d-95da-db0ca645c825 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:32:02.593811 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-97d1fce6-1ed4-405d-95da-db0ca645c825 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:32:02.601183 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97d1fce6-1ed4-405d-95da-db0ca645c825 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:02.601722 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97d1fce6-1ed4-405d-95da-db0ca645c825 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:02.602193 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97d1fce6-1ed4-405d-95da-db0ca645c825 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:02.602911 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97d1fce6-1ed4-405d-95da-db0ca645c825 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:02.603383 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97d1fce6-1ed4-405d-95da-db0ca645c825 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:02.603831 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-97d1fce6-1ed4-405d-95da-db0ca645c825 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:02.658613 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-97d1fce6-1ed4-405d-95da-db0ca645c825 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "POST /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f/action" status: 200 len: 24564 microversion: 2.1 time: 0.074482 Sep 17 21:32:02.659259 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3112/6136] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:32:02 2022] POST /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f/action => generated 24564 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:32:09.079166 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-21e0b497-bdc0-456f-96b9-cebe0168abef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:32:09.082181 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-21e0b497-bdc0-456f-96b9-cebe0168abef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:32:09.084619 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=7 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:32:09.085361 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=36 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:32:09.092979 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21e0b497-bdc0-456f-96b9-cebe0168abef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:09.093513 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21e0b497-bdc0-456f-96b9-cebe0168abef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:09.094036 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21e0b497-bdc0-456f-96b9-cebe0168abef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:09.094820 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21e0b497-bdc0-456f-96b9-cebe0168abef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:09.095328 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21e0b497-bdc0-456f-96b9-cebe0168abef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:09.095801 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21e0b497-bdc0-456f-96b9-cebe0168abef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:09.176096 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-21e0b497-bdc0-456f-96b9-cebe0168abef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:32:09.176518 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-21e0b497-bdc0-456f-96b9-cebe0168abef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:32:09.177000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-21e0b497-bdc0-456f-96b9-cebe0168abef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:32:09.177405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-21e0b497-bdc0-456f-96b9-cebe0168abef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:32:09.177922 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-21e0b497-bdc0-456f-96b9-cebe0168abef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:32:09.248626 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-21e0b497-bdc0-456f-96b9-cebe0168abef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:32:09.255304 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21e0b497-bdc0-456f-96b9-cebe0168abef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:09.256155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21e0b497-bdc0-456f-96b9-cebe0168abef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:09.256290 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21e0b497-bdc0-456f-96b9-cebe0168abef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:09.257052 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21e0b497-bdc0-456f-96b9-cebe0168abef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:09.257552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21e0b497-bdc0-456f-96b9-cebe0168abef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:09.258028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-21e0b497-bdc0-456f-96b9-cebe0168abef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:09.284796 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-21e0b497-bdc0-456f-96b9-cebe0168abef tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "POST /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f/action" status: 202 len: 1138 microversion: 2.1 time: 0.211160 Sep 17 21:32:09.293686 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3025/6137] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:32:09 2022] POST /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f/action => generated 1138 bytes in 221 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 17 21:32:09.304695 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-37c988d4-01b1-4b95-970f-d01dc9f30795 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:32:09.305419 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-37c988d4-01b1-4b95-970f-d01dc9f30795 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:32:09.313920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-37c988d4-01b1-4b95-970f-d01dc9f30795 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:09.314722 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-37c988d4-01b1-4b95-970f-d01dc9f30795 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:09.315203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-37c988d4-01b1-4b95-970f-d01dc9f30795 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:09.315961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-37c988d4-01b1-4b95-970f-d01dc9f30795 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:09.316439 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-37c988d4-01b1-4b95-970f-d01dc9f30795 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:09.316963 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-37c988d4-01b1-4b95-970f-d01dc9f30795 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:09.459163 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-37c988d4-01b1-4b95-970f-d01dc9f30795 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:32:09.467452 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-37c988d4-01b1-4b95-970f-d01dc9f30795 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f" status: 200 len: 1692 microversion: 2.1 time: 0.167081 Sep 17 21:32:09.468074 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3113/6138] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:32:09 2022] GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f => generated 1692 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:32:10.495542 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f5e6d4f8-8f61-4b5e-b69d-f41b57e22572 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:32:10.496490 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f5e6d4f8-8f61-4b5e-b69d-f41b57e22572 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:32:10.508646 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f5e6d4f8-8f61-4b5e-b69d-f41b57e22572 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:10.509517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f5e6d4f8-8f61-4b5e-b69d-f41b57e22572 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:10.510269 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f5e6d4f8-8f61-4b5e-b69d-f41b57e22572 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:10.511450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f5e6d4f8-8f61-4b5e-b69d-f41b57e22572 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:10.512240 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f5e6d4f8-8f61-4b5e-b69d-f41b57e22572 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:10.512965 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f5e6d4f8-8f61-4b5e-b69d-f41b57e22572 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:10.661333 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f5e6d4f8-8f61-4b5e-b69d-f41b57e22572 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:32:10.671142 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f5e6d4f8-8f61-4b5e-b69d-f41b57e22572 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f" status: 200 len: 1692 microversion: 2.1 time: 0.182176 Sep 17 21:32:10.671719 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3026/6139] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:32:10 2022] GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f => generated 1692 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:32:11.695935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-082460ac-a626-4f82-bbc5-a281c7f5c41f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:32:11.696577 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-082460ac-a626-4f82-bbc5-a281c7f5c41f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:32:11.704782 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-082460ac-a626-4f82-bbc5-a281c7f5c41f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:11.705290 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-082460ac-a626-4f82-bbc5-a281c7f5c41f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:11.705888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-082460ac-a626-4f82-bbc5-a281c7f5c41f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:11.706609 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-082460ac-a626-4f82-bbc5-a281c7f5c41f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:11.707089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-082460ac-a626-4f82-bbc5-a281c7f5c41f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:11.707539 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-082460ac-a626-4f82-bbc5-a281c7f5c41f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:11.849368 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-082460ac-a626-4f82-bbc5-a281c7f5c41f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:32:11.858100 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-082460ac-a626-4f82-bbc5-a281c7f5c41f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f" status: 200 len: 1692 microversion: 2.1 time: 0.166177 Sep 17 21:32:11.858758 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3114/6140] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:32:11 2022] GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:32:12.882332 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-59187ac0-e9e8-4164-abae-8c767db8420b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:32:12.882916 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-59187ac0-e9e8-4164-abae-8c767db8420b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:32:12.890347 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59187ac0-e9e8-4164-abae-8c767db8420b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:12.890830 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59187ac0-e9e8-4164-abae-8c767db8420b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:12.891273 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59187ac0-e9e8-4164-abae-8c767db8420b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:12.891973 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59187ac0-e9e8-4164-abae-8c767db8420b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:12.892432 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59187ac0-e9e8-4164-abae-8c767db8420b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:12.892862 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59187ac0-e9e8-4164-abae-8c767db8420b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:13.037874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-59187ac0-e9e8-4164-abae-8c767db8420b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:32:13.049812 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-59187ac0-e9e8-4164-abae-8c767db8420b tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f" status: 200 len: 1692 microversion: 2.1 time: 0.171266 Sep 17 21:32:13.050622 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3027/6141] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:32:12 2022] GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f => generated 1692 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:32:14.080789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b83ad20e-5727-40ed-a3c8-39e40decf231 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:32:14.081748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b83ad20e-5727-40ed-a3c8-39e40decf231 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:32:14.092753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b83ad20e-5727-40ed-a3c8-39e40decf231 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:14.093263 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b83ad20e-5727-40ed-a3c8-39e40decf231 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:14.093765 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b83ad20e-5727-40ed-a3c8-39e40decf231 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:14.094494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b83ad20e-5727-40ed-a3c8-39e40decf231 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:14.094997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b83ad20e-5727-40ed-a3c8-39e40decf231 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:14.095445 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b83ad20e-5727-40ed-a3c8-39e40decf231 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:14.244433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b83ad20e-5727-40ed-a3c8-39e40decf231 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:32:14.255200 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b83ad20e-5727-40ed-a3c8-39e40decf231 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f" status: 200 len: 1692 microversion: 2.1 time: 0.181248 Sep 17 21:32:14.256055 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3115/6142] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:32:14 2022] GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f => generated 1692 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:32:15.283128 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3c514dc9-02c5-4636-8671-c5e7ee11d514 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:32:15.283697 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3c514dc9-02c5-4636-8671-c5e7ee11d514 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:32:15.290650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3c514dc9-02c5-4636-8671-c5e7ee11d514 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:15.291143 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3c514dc9-02c5-4636-8671-c5e7ee11d514 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:15.291581 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3c514dc9-02c5-4636-8671-c5e7ee11d514 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:15.292281 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3c514dc9-02c5-4636-8671-c5e7ee11d514 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:15.292737 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3c514dc9-02c5-4636-8671-c5e7ee11d514 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:15.293161 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3c514dc9-02c5-4636-8671-c5e7ee11d514 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:15.427655 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3c514dc9-02c5-4636-8671-c5e7ee11d514 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:32:15.437399 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3c514dc9-02c5-4636-8671-c5e7ee11d514 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f" status: 200 len: 1692 microversion: 2.1 time: 0.158344 Sep 17 21:32:15.438009 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3028/6143] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:32:15 2022] GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:32:16.464606 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8801f0ad-1ece-4d59-8226-25392c98baac tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:32:16.465666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8801f0ad-1ece-4d59-8226-25392c98baac tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:32:16.478240 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8801f0ad-1ece-4d59-8226-25392c98baac tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:16.479487 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8801f0ad-1ece-4d59-8226-25392c98baac tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:16.480335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8801f0ad-1ece-4d59-8226-25392c98baac tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:16.481701 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8801f0ad-1ece-4d59-8226-25392c98baac tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:16.482188 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8801f0ad-1ece-4d59-8226-25392c98baac tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:16.482641 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8801f0ad-1ece-4d59-8226-25392c98baac tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:16.621634 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8801f0ad-1ece-4d59-8226-25392c98baac tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:32:16.629727 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8801f0ad-1ece-4d59-8226-25392c98baac tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f" status: 200 len: 1692 microversion: 2.1 time: 0.171805 Sep 17 21:32:16.630298 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3116/6144] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:32:16 2022] GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f => generated 1692 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:32:17.656523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-02692802-91cd-425d-8eb3-96579ff9288f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:32:17.657191 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-02692802-91cd-425d-8eb3-96579ff9288f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:32:17.665435 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02692802-91cd-425d-8eb3-96579ff9288f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:17.666016 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02692802-91cd-425d-8eb3-96579ff9288f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:17.666509 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02692802-91cd-425d-8eb3-96579ff9288f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:17.667302 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02692802-91cd-425d-8eb3-96579ff9288f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:17.667868 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02692802-91cd-425d-8eb3-96579ff9288f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:17.668361 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-02692802-91cd-425d-8eb3-96579ff9288f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:17.806330 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-02692802-91cd-425d-8eb3-96579ff9288f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:32:17.814428 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-02692802-91cd-425d-8eb3-96579ff9288f tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f" status: 200 len: 1692 microversion: 2.1 time: 0.163471 Sep 17 21:32:17.815013 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3029/6145] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:32:17 2022] GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:32:18.838569 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-30f6e27d-884c-49b5-9b1b-7fa2f6ff002e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:32:18.839172 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-30f6e27d-884c-49b5-9b1b-7fa2f6ff002e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:32:18.847072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-30f6e27d-884c-49b5-9b1b-7fa2f6ff002e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:18.847592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-30f6e27d-884c-49b5-9b1b-7fa2f6ff002e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:18.848045 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-30f6e27d-884c-49b5-9b1b-7fa2f6ff002e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:18.848742 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-30f6e27d-884c-49b5-9b1b-7fa2f6ff002e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:18.849209 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-30f6e27d-884c-49b5-9b1b-7fa2f6ff002e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:18.849704 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-30f6e27d-884c-49b5-9b1b-7fa2f6ff002e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:19.315418 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-30f6e27d-884c-49b5-9b1b-7fa2f6ff002e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:32:19.323434 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-30f6e27d-884c-49b5-9b1b-7fa2f6ff002e tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f" status: 200 len: 1692 microversion: 2.1 time: 0.489063 Sep 17 21:32:19.324022 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3117/6146] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:32:18 2022] GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f => generated 1692 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:32:20.350562 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d04e423a-4945-4213-b337-d6fcfca9abb1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:32:20.351638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d04e423a-4945-4213-b337-d6fcfca9abb1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:32:20.361646 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d04e423a-4945-4213-b337-d6fcfca9abb1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:20.362138 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d04e423a-4945-4213-b337-d6fcfca9abb1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:20.362578 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d04e423a-4945-4213-b337-d6fcfca9abb1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:20.363291 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d04e423a-4945-4213-b337-d6fcfca9abb1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:20.363749 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d04e423a-4945-4213-b337-d6fcfca9abb1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:20.364177 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d04e423a-4945-4213-b337-d6fcfca9abb1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:20.505942 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d04e423a-4945-4213-b337-d6fcfca9abb1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:32:20.517881 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d04e423a-4945-4213-b337-d6fcfca9abb1 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f" status: 200 len: 1692 microversion: 2.1 time: 0.173807 Sep 17 21:32:20.518709 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3030/6147] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:32:20 2022] GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f => generated 1692 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:32:21.546372 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-898cf66d-b3e9-4ecd-911e-91db0dfac070 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:32:21.547524 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-898cf66d-b3e9-4ecd-911e-91db0dfac070 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:32:21.554871 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-898cf66d-b3e9-4ecd-911e-91db0dfac070 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:21.555421 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-898cf66d-b3e9-4ecd-911e-91db0dfac070 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:21.555849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-898cf66d-b3e9-4ecd-911e-91db0dfac070 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:21.556582 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-898cf66d-b3e9-4ecd-911e-91db0dfac070 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:21.557056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-898cf66d-b3e9-4ecd-911e-91db0dfac070 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:21.557526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-898cf66d-b3e9-4ecd-911e-91db0dfac070 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:21.699171 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-898cf66d-b3e9-4ecd-911e-91db0dfac070 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:32:21.707797 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-898cf66d-b3e9-4ecd-911e-91db0dfac070 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f" status: 200 len: 1698 microversion: 2.1 time: 0.168208 Sep 17 21:32:21.708397 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3118/6148] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:32:21 2022] GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f => generated 1698 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:32:22.740469 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7d85d0e4-cfd3-49c3-9090-4d3fa36b7452 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:32:22.741122 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7d85d0e4-cfd3-49c3-9090-4d3fa36b7452 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:32:22.748971 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7d85d0e4-cfd3-49c3-9090-4d3fa36b7452 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:22.749505 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7d85d0e4-cfd3-49c3-9090-4d3fa36b7452 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:22.749990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7d85d0e4-cfd3-49c3-9090-4d3fa36b7452 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:22.750727 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7d85d0e4-cfd3-49c3-9090-4d3fa36b7452 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:22.751512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7d85d0e4-cfd3-49c3-9090-4d3fa36b7452 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:22.751949 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7d85d0e4-cfd3-49c3-9090-4d3fa36b7452 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:22.896726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7d85d0e4-cfd3-49c3-9090-4d3fa36b7452 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:32:22.904884 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7d85d0e4-cfd3-49c3-9090-4d3fa36b7452 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f" status: 200 len: 1698 microversion: 2.1 time: 0.168585 Sep 17 21:32:22.905497 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3031/6149] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:32:22 2022] GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f => generated 1698 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:32:23.928727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-05ea15ad-8ae4-4701-b001-e76544cfdccb tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:32:23.929373 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-05ea15ad-8ae4-4701-b001-e76544cfdccb tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:32:23.936967 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-05ea15ad-8ae4-4701-b001-e76544cfdccb tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:23.937519 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-05ea15ad-8ae4-4701-b001-e76544cfdccb tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:23.937988 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-05ea15ad-8ae4-4701-b001-e76544cfdccb tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:23.938721 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-05ea15ad-8ae4-4701-b001-e76544cfdccb tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:23.939198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-05ea15ad-8ae4-4701-b001-e76544cfdccb tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:23.939648 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-05ea15ad-8ae4-4701-b001-e76544cfdccb tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:24.080520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-05ea15ad-8ae4-4701-b001-e76544cfdccb tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:32:24.092546 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-05ea15ad-8ae4-4701-b001-e76544cfdccb tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f" status: 200 len: 1683 microversion: 2.1 time: 0.167684 Sep 17 21:32:24.093450 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3119/6150] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:32:23 2022] GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:32:25.453677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-2fbc50e0-ae48-49aa-9b81-d01200b60d70 req-87186dd8-154b-42fa-95db-121406803d5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce118d7c-fad6-455f-80d2-d7af56ea215f", "name": "network-vif-plugged", "status": "completed", "tag": "a7fc0e28-4c80-4bca-96ab-e903898defc6"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:32:25.465665 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2fbc50e0-ae48-49aa-9b81-d01200b60d70 req-87186dd8-154b-42fa-95db-121406803d5a service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:25.466150 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2fbc50e0-ae48-49aa-9b81-d01200b60d70 req-87186dd8-154b-42fa-95db-121406803d5a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:25.467018 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2fbc50e0-ae48-49aa-9b81-d01200b60d70 req-87186dd8-154b-42fa-95db-121406803d5a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:25.479804 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-2fbc50e0-ae48-49aa-9b81-d01200b60d70 req-87186dd8-154b-42fa-95db-121406803d5a service nova] Creating event network-vif-plugged:a7fc0e28-4c80-4bca-96ab-e903898defc6 for instance ce118d7c-fad6-455f-80d2-d7af56ea215f on nch2-master-1 Sep 17 21:32:25.485360 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-2fbc50e0-ae48-49aa-9b81-d01200b60d70 req-87186dd8-154b-42fa-95db-121406803d5a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036414 Sep 17 21:32:25.486208 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3032/6151] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:32:25.585162 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f210a889-8148-4fc0-92ac-fbf9fc7848a0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:32:25.585715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f210a889-8148-4fc0-92ac-fbf9fc7848a0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 4c826814-8c96-4caf-b84c-b2f6b547fdc7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:32:25.587497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-d7822b78-21a0-4b92-8da3-2863bf80b3e9 req-c79c91d8-3e9a-463c-a640-5a64cbfda66f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c826814-8c96-4caf-b84c-b2f6b547fdc7", "tag": "1e78390b-08e4-4d6a-bc94-b7f2e5a1f7ec"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:32:25.592686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f210a889-8148-4fc0-92ac-fbf9fc7848a0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:25.593708 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f210a889-8148-4fc0-92ac-fbf9fc7848a0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:25.594427 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f210a889-8148-4fc0-92ac-fbf9fc7848a0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:25.595214 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f210a889-8148-4fc0-92ac-fbf9fc7848a0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:25.595938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f210a889-8148-4fc0-92ac-fbf9fc7848a0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:25.596434 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f210a889-8148-4fc0-92ac-fbf9fc7848a0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:25.597727 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d7822b78-21a0-4b92-8da3-2863bf80b3e9 req-c79c91d8-3e9a-463c-a640-5a64cbfda66f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:25.598220 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d7822b78-21a0-4b92-8da3-2863bf80b3e9 req-c79c91d8-3e9a-463c-a640-5a64cbfda66f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:25.598662 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d7822b78-21a0-4b92-8da3-2863bf80b3e9 req-c79c91d8-3e9a-463c-a640-5a64cbfda66f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:25.610451 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-d7822b78-21a0-4b92-8da3-2863bf80b3e9 req-c79c91d8-3e9a-463c-a640-5a64cbfda66f service nova] Creating event network-changed:1e78390b-08e4-4d6a-bc94-b7f2e5a1f7ec for instance 4c826814-8c96-4caf-b84c-b2f6b547fdc7 on nch1-master-1 Sep 17 21:32:25.615605 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-d7822b78-21a0-4b92-8da3-2863bf80b3e9 req-c79c91d8-3e9a-463c-a640-5a64cbfda66f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032169 Sep 17 21:32:25.616409 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3033/6152] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:32:25.631279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f210a889-8148-4fc0-92ac-fbf9fc7848a0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 4c826814-8c96-4caf-b84c-b2f6b547fdc7] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:32:25.732435 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f210a889-8148-4fc0-92ac-fbf9fc7848a0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7" status: 204 len: 0 microversion: 2.1 time: 0.151340 Sep 17 21:32:25.736683 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3120/6153] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:32:25 2022] DELETE /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:32:25.742653 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5603765f-668f-4b2a-8124-f3f259b70376 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:32:25.743361 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5603765f-668f-4b2a-8124-f3f259b70376 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 4c826814-8c96-4caf-b84c-b2f6b547fdc7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:32:25.750692 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5603765f-668f-4b2a-8124-f3f259b70376 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:25.751191 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5603765f-668f-4b2a-8124-f3f259b70376 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:25.751632 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5603765f-668f-4b2a-8124-f3f259b70376 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:25.752352 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5603765f-668f-4b2a-8124-f3f259b70376 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:25.752796 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5603765f-668f-4b2a-8124-f3f259b70376 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:25.753351 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5603765f-668f-4b2a-8124-f3f259b70376 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:25.896155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5603765f-668f-4b2a-8124-f3f259b70376 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:32:25.904313 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5603765f-668f-4b2a-8124-f3f259b70376 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7" status: 200 len: 1580 microversion: 2.1 time: 0.166054 Sep 17 21:32:25.905125 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3034/6154] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:32:25 2022] GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7 => generated 1580 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:32:26.930528 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-00032790-4961-4cb3-8737-25812ff085bf tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:32:26.931125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-00032790-4961-4cb3-8737-25812ff085bf tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 4c826814-8c96-4caf-b84c-b2f6b547fdc7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:32:26.939270 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00032790-4961-4cb3-8737-25812ff085bf tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:26.939820 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00032790-4961-4cb3-8737-25812ff085bf tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:26.940279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00032790-4961-4cb3-8737-25812ff085bf tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:26.941009 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00032790-4961-4cb3-8737-25812ff085bf tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:26.941488 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00032790-4961-4cb3-8737-25812ff085bf tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:26.942122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-00032790-4961-4cb3-8737-25812ff085bf tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:27.080242 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-00032790-4961-4cb3-8737-25812ff085bf tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:32:27.088649 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-00032790-4961-4cb3-8737-25812ff085bf tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7" status: 200 len: 1580 microversion: 2.1 time: 0.162722 Sep 17 21:32:27.089262 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3121/6155] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:32:26 2022] GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7 => generated 1580 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:32:27.759981 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-9d36c6e1-547c-4ccb-baf7-72c9c1427600 req-3577c82f-ed41-4da3-bfa3-01192e160bce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c826814-8c96-4caf-b84c-b2f6b547fdc7", "name": "network-vif-deleted", "tag": "1e78390b-08e4-4d6a-bc94-b7f2e5a1f7ec"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:32:27.770761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-9d36c6e1-547c-4ccb-baf7-72c9c1427600 req-3577c82f-ed41-4da3-bfa3-01192e160bce service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:27.771253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-9d36c6e1-547c-4ccb-baf7-72c9c1427600 req-3577c82f-ed41-4da3-bfa3-01192e160bce service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:27.771673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-9d36c6e1-547c-4ccb-baf7-72c9c1427600 req-3577c82f-ed41-4da3-bfa3-01192e160bce service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:27.783219 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-9d36c6e1-547c-4ccb-baf7-72c9c1427600 req-3577c82f-ed41-4da3-bfa3-01192e160bce service nova] Creating event network-vif-deleted:1e78390b-08e4-4d6a-bc94-b7f2e5a1f7ec for instance 4c826814-8c96-4caf-b84c-b2f6b547fdc7 on nch1-master-1 Sep 17 21:32:27.787993 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-9d36c6e1-547c-4ccb-baf7-72c9c1427600 req-3577c82f-ed41-4da3-bfa3-01192e160bce service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031784 Sep 17 21:32:27.788595 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3035/6156] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:32:28.113029 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8f0989fc-5e77-4628-a5c1-8889f1f562e6 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:32:28.113699 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8f0989fc-5e77-4628-a5c1-8889f1f562e6 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 4c826814-8c96-4caf-b84c-b2f6b547fdc7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:32:28.120518 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f0989fc-5e77-4628-a5c1-8889f1f562e6 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:28.121015 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f0989fc-5e77-4628-a5c1-8889f1f562e6 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:28.121500 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f0989fc-5e77-4628-a5c1-8889f1f562e6 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:28.122447 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f0989fc-5e77-4628-a5c1-8889f1f562e6 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:28.122936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f0989fc-5e77-4628-a5c1-8889f1f562e6 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:28.123383 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f0989fc-5e77-4628-a5c1-8889f1f562e6 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:28.157562 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f0989fc-5e77-4628-a5c1-8889f1f562e6 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:28.158195 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f0989fc-5e77-4628-a5c1-8889f1f562e6 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:28.158742 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f0989fc-5e77-4628-a5c1-8889f1f562e6 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:28.159304 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-8f0989fc-5e77-4628-a5c1-8889f1f562e6 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lazy-loading 'fault' on Instance uuid 4c826814-8c96-4caf-b84c-b2f6b547fdc7 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:32:28.201384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8f0989fc-5e77-4628-a5c1-8889f1f562e6 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:32:28.209898 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8f0989fc-5e77-4628-a5c1-8889f1f562e6 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7" status: 200 len: 1231 microversion: 2.1 time: 0.101212 Sep 17 21:32:28.210524 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3122/6157] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:32:28 2022] GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7 => generated 1231 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:32:29.239277 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ed9d6ea5-6933-42ab-8b3e-f3b4e676e144 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:32:29.240028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ed9d6ea5-6933-42ab-8b3e-f3b4e676e144 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 4c826814-8c96-4caf-b84c-b2f6b547fdc7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:32:29.246487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ed9d6ea5-6933-42ab-8b3e-f3b4e676e144 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:29.246982 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ed9d6ea5-6933-42ab-8b3e-f3b4e676e144 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:29.247428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ed9d6ea5-6933-42ab-8b3e-f3b4e676e144 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:29.248142 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ed9d6ea5-6933-42ab-8b3e-f3b4e676e144 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:29.248606 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ed9d6ea5-6933-42ab-8b3e-f3b4e676e144 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:29.249022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ed9d6ea5-6933-42ab-8b3e-f3b4e676e144 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:29.263714 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-ed9d6ea5-6933-42ab-8b3e-f3b4e676e144 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] HTTP exception thrown: Instance 4c826814-8c96-4caf-b84c-b2f6b547fdc7 could not be found. Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ed9d6ea5-6933-42ab-8b3e-f3b4e676e144 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Request method failure captured: Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7 HTTP/1.1 Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjrvOiuthjFaTfhYt50z8pDXrt-HPwrf96uRwuVJ9ynjuC5bmjoCBf4y3MnbEYBpakcf75RXFUI631TlKrccQPyNjX9J3nTlRjiuxC83ZWT1CdEDSXZAvO47o2oB0JdJR88NFg3ylqlbHTdxn4s4t3eWhyXUxZZiXUGmNIvQFsnF9s0 Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: b99d2a0b4d7e40a38e682fc147e968af Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-TestVolumeBootPattern-747170341 Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b99d2a0b4d7e40a38e682fc147e968af", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-TestVolumeBootPattern-747170341 Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: b99d2a0b4d7e40a38e682fc147e968af Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-TestVolumeBootPattern-747170341 Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-TestVolumeBootPattern-747170341-project Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 342e60103c9b45bcb348b6f8bcd686ca Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-TestVolumeBootPattern-747170341-project Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 4c826814-8c96-4caf-b84c-b2f6b547fdc7 could not be found. Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '4c826814-8c96-4caf-b84c-b2f6b547fdc7'} Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c826814-8c96-4caf-b84c-b2f6b547fdc7 could not be found. Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c826814-8c96-4caf-b84c-b2f6b547fdc7 could not be found. Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:32:29.265383 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:32:29.270280 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:32:29.270280 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:32:29.270280 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:32:29.270280 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:32:29.270280 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:32:29.270280 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c826814-8c96-4caf-b84c-b2f6b547fdc7 could not be found. Sep 17 21:32:29.270280 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:32:29.270280 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ed9d6ea5-6933-42ab-8b3e-f3b4e676e144 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Returning 404 to user: Instance 4c826814-8c96-4caf-b84c-b2f6b547fdc7 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:32:29.270280 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ed9d6ea5-6933-42ab-8b3e-f3b4e676e144 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7" status: 404 len: 111 microversion: 2.1 time: 0.035132 Sep 17 21:32:29.270280 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3036/6158] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:32:29 2022] GET /compute/v2.1/servers/4c826814-8c96-4caf-b84c-b2f6b547fdc7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:32:48.328267 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d6f3347a-2c28-485c-b876-309dd9d06472 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:32:48.330617 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d6f3347a-2c28-485c-b876-309dd9d06472 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:32:48.333627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:32:48.334382 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:32:48.342083 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d6f3347a-2c28-485c-b876-309dd9d06472 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:48.342591 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d6f3347a-2c28-485c-b876-309dd9d06472 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:48.343048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d6f3347a-2c28-485c-b876-309dd9d06472 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:48.343790 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d6f3347a-2c28-485c-b876-309dd9d06472 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:48.344268 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d6f3347a-2c28-485c-b876-309dd9d06472 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:48.344724 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d6f3347a-2c28-485c-b876-309dd9d06472 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:48.400664 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d6f3347a-2c28-485c-b876-309dd9d06472 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "POST /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f/action" status: 200 len: 24572 microversion: 2.1 time: 0.076381 Sep 17 21:32:48.401220 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3123/6159] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:32:48 2022] POST /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f/action => generated 24572 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:32:55.679928 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b0b43ad3-dceb-4eef-b818-04a026435275 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:32:55.680465 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b0b43ad3-dceb-4eef-b818-04a026435275 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:32:55.682668 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-231ccecd-46dd-4e10-96a8-32e9b907a83e req-49a17fde-6188-4b66-9380-55b3167cc1e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce118d7c-fad6-455f-80d2-d7af56ea215f", "tag": "a7fc0e28-4c80-4bca-96ab-e903898defc6"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:32:55.683109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=28 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:32:55.683796 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:32:55.690682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0b43ad3-dceb-4eef-b818-04a026435275 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:55.691689 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0b43ad3-dceb-4eef-b818-04a026435275 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:55.692451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0b43ad3-dceb-4eef-b818-04a026435275 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:55.693598 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0b43ad3-dceb-4eef-b818-04a026435275 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:55.694912 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0b43ad3-dceb-4eef-b818-04a026435275 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:55.695353 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b0b43ad3-dceb-4eef-b818-04a026435275 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:55.697581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-231ccecd-46dd-4e10-96a8-32e9b907a83e req-49a17fde-6188-4b66-9380-55b3167cc1e8 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:55.697744 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-231ccecd-46dd-4e10-96a8-32e9b907a83e req-49a17fde-6188-4b66-9380-55b3167cc1e8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:55.698216 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-231ccecd-46dd-4e10-96a8-32e9b907a83e req-49a17fde-6188-4b66-9380-55b3167cc1e8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:55.711875 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-231ccecd-46dd-4e10-96a8-32e9b907a83e req-49a17fde-6188-4b66-9380-55b3167cc1e8 service nova] Creating event network-changed:a7fc0e28-4c80-4bca-96ab-e903898defc6 for instance ce118d7c-fad6-455f-80d2-d7af56ea215f on nch2-master-1 Sep 17 21:32:55.717315 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-231ccecd-46dd-4e10-96a8-32e9b907a83e req-49a17fde-6188-4b66-9380-55b3167cc1e8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038634 Sep 17 21:32:55.718382 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3124/6160] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:32:55.726939 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b0b43ad3-dceb-4eef-b818-04a026435275 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:32:55.819064 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b0b43ad3-dceb-4eef-b818-04a026435275 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f" status: 204 len: 0 microversion: 2.1 time: 0.143632 Sep 17 21:32:55.820043 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3037/6161] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:32:55 2022] DELETE /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:32:55.829746 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-223eda8a-8aa9-4b47-8e94-fc39aba43937 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:32:55.830471 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-223eda8a-8aa9-4b47-8e94-fc39aba43937 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:32:55.837141 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-223eda8a-8aa9-4b47-8e94-fc39aba43937 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:55.837667 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-223eda8a-8aa9-4b47-8e94-fc39aba43937 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:55.838119 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-223eda8a-8aa9-4b47-8e94-fc39aba43937 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:55.838852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-223eda8a-8aa9-4b47-8e94-fc39aba43937 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:55.839320 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-223eda8a-8aa9-4b47-8e94-fc39aba43937 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:55.839829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-223eda8a-8aa9-4b47-8e94-fc39aba43937 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:55.995574 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-223eda8a-8aa9-4b47-8e94-fc39aba43937 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:32:56.003848 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-223eda8a-8aa9-4b47-8e94-fc39aba43937 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f" status: 200 len: 1689 microversion: 2.1 time: 0.179080 Sep 17 21:32:56.004478 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3125/6162] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:32:55 2022] GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f => generated 1689 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:32:57.031695 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-80b59312-e0e1-410c-bede-b560c73cafaf tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:32:57.032513 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-80b59312-e0e1-410c-bede-b560c73cafaf tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:32:57.040818 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-80b59312-e0e1-410c-bede-b560c73cafaf tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:57.041357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-80b59312-e0e1-410c-bede-b560c73cafaf tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:57.041817 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-80b59312-e0e1-410c-bede-b560c73cafaf tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:57.042526 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-80b59312-e0e1-410c-bede-b560c73cafaf tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:57.042987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-80b59312-e0e1-410c-bede-b560c73cafaf tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:57.043418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-80b59312-e0e1-410c-bede-b560c73cafaf tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:57.269770 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-80b59312-e0e1-410c-bede-b560c73cafaf tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:32:57.278310 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-80b59312-e0e1-410c-bede-b560c73cafaf tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f" status: 200 len: 1689 microversion: 2.1 time: 0.253577 Sep 17 21:32:57.293899 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3038/6163] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:32:57 2022] GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f => generated 1689 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:32:57.700906 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-d26465dc-b523-4584-9057-5db00c7c8450 req-e20bccf7-016f-4be8-95da-e5fdac2c8252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce118d7c-fad6-455f-80d2-d7af56ea215f", "name": "network-vif-deleted", "tag": "a7fc0e28-4c80-4bca-96ab-e903898defc6"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:32:57.712713 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d26465dc-b523-4584-9057-5db00c7c8450 req-e20bccf7-016f-4be8-95da-e5fdac2c8252 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:57.713987 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d26465dc-b523-4584-9057-5db00c7c8450 req-e20bccf7-016f-4be8-95da-e5fdac2c8252 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:57.714464 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-d26465dc-b523-4584-9057-5db00c7c8450 req-e20bccf7-016f-4be8-95da-e5fdac2c8252 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:57.727085 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-d26465dc-b523-4584-9057-5db00c7c8450 req-e20bccf7-016f-4be8-95da-e5fdac2c8252 service nova] Creating event network-vif-deleted:a7fc0e28-4c80-4bca-96ab-e903898defc6 for instance ce118d7c-fad6-455f-80d2-d7af56ea215f on nch2-master-1 Sep 17 21:32:57.733909 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-d26465dc-b523-4584-9057-5db00c7c8450 req-e20bccf7-016f-4be8-95da-e5fdac2c8252 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036948 Sep 17 21:32:57.734519 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3126/6164] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:32:58.305323 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4584757c-aee6-4acd-8b0a-5b93736422ac tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:32:58.305973 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4584757c-aee6-4acd-8b0a-5b93736422ac tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:32:58.314073 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4584757c-aee6-4acd-8b0a-5b93736422ac tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:58.314557 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4584757c-aee6-4acd-8b0a-5b93736422ac tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:58.314987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4584757c-aee6-4acd-8b0a-5b93736422ac tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:58.316028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4584757c-aee6-4acd-8b0a-5b93736422ac tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:58.316468 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4584757c-aee6-4acd-8b0a-5b93736422ac tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:58.316900 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4584757c-aee6-4acd-8b0a-5b93736422ac tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:58.349902 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4584757c-aee6-4acd-8b0a-5b93736422ac tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:58.350401 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4584757c-aee6-4acd-8b0a-5b93736422ac tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:58.350844 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4584757c-aee6-4acd-8b0a-5b93736422ac tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:58.351299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-4584757c-aee6-4acd-8b0a-5b93736422ac tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lazy-loading 'fault' on Instance uuid ce118d7c-fad6-455f-80d2-d7af56ea215f {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:32:58.393598 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4584757c-aee6-4acd-8b0a-5b93736422ac tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cb55865ecad4c05adc52a1aacd2aa10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b67de414e1aa4fde9ed87336f30c2767', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:32:58.401567 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4584757c-aee6-4acd-8b0a-5b93736422ac tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f" status: 200 len: 1357 microversion: 2.1 time: 0.100578 Sep 17 21:32:58.402142 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3039/6165] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:32:58 2022] GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f => generated 1357 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:32:59.430014 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2da953b9-9e09-4537-afd1-f67e32527348 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:32:59.431187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2da953b9-9e09-4537-afd1-f67e32527348 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] [instance: ce118d7c-fad6-455f-80d2-d7af56ea215f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:32:59.443120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2da953b9-9e09-4537-afd1-f67e32527348 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:59.443617 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2da953b9-9e09-4537-afd1-f67e32527348 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:59.444080 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2da953b9-9e09-4537-afd1-f67e32527348 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:59.444785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2da953b9-9e09-4537-afd1-f67e32527348 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:32:59.445259 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2da953b9-9e09-4537-afd1-f67e32527348 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:32:59.445737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2da953b9-9e09-4537-afd1-f67e32527348 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:32:59.459408 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-2da953b9-9e09-4537-afd1-f67e32527348 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] HTTP exception thrown: Instance ce118d7c-fad6-455f-80d2-d7af56ea215f could not be found. Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2da953b9-9e09-4537-afd1-f67e32527348 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Request method failure captured: Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f HTTP/1.1 Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjt1HGD-AGecBeXKG-Tv1X03jkbjY02aJ3vfhgY7AyhVE2LrBQ6rG6j8P8XaKvJajIa-Tr-B_mPCCFATHv-I927Mv8bDNOk0IIJoeqei7Daucjc-FPiGYYkt6YVWEtLmPt9TcFJzteSZ58GSfRYwBLV5RLbestURdkZQMGtWKaf5y9w Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: b67de414e1aa4fde9ed87336f30c2767 Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1107857406 Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b67de414e1aa4fde9ed87336f30c2767"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b67de414e1aa4fde9ed87336f30c2767"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b67de414e1aa4fde9ed87336f30c2767"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b67de414e1aa4fde9ed87336f30c2767", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1107857406 Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: b67de414e1aa4fde9ed87336f30c2767 Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1107857406 Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-TestNetworkAdvancedServerOps-1107857406-project Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 3cb55865ecad4c05adc52a1aacd2aa10 Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1107857406-project Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance ce118d7c-fad6-455f-80d2-d7af56ea215f could not be found. Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'ce118d7c-fad6-455f-80d2-d7af56ea215f'} Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce118d7c-fad6-455f-80d2-d7af56ea215f could not be found. Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce118d7c-fad6-455f-80d2-d7af56ea215f could not be found. Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:32:59.461043 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:32:59.465557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:32:59.465557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:32:59.465557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:32:59.465557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:32:59.465557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:32:59.465557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:32:59.465557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce118d7c-fad6-455f-80d2-d7af56ea215f could not be found. Sep 17 21:32:59.465557 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:32:59.465557 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2da953b9-9e09-4537-afd1-f67e32527348 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Returning 404 to user: Instance ce118d7c-fad6-455f-80d2-d7af56ea215f could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:32:59.465557 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2da953b9-9e09-4537-afd1-f67e32527348 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f" status: 404 len: 111 microversion: 2.1 time: 0.039590 Sep 17 21:32:59.465557 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3127/6166] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:32:59 2022] GET /compute/v2.1/servers/ce118d7c-fad6-455f-80d2-d7af56ea215f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:33:02.610296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d1c69cbe-f4a9-46e2-be87-20115eaca909 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:02.610913 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d1c69cbe-f4a9-46e2-be87-20115eaca909 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 25004b14-902f-4ec6-80a5-b3aefb14d11f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:33:02.623974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1c69cbe-f4a9-46e2-be87-20115eaca909 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:02.624714 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1c69cbe-f4a9-46e2-be87-20115eaca909 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:02.625157 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1c69cbe-f4a9-46e2-be87-20115eaca909 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:02.625913 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1c69cbe-f4a9-46e2-be87-20115eaca909 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:02.626576 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1c69cbe-f4a9-46e2-be87-20115eaca909 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:02.627705 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d1c69cbe-f4a9-46e2-be87-20115eaca909 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:02.628253 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-8e774a72-fdbd-4095-ae12-fa21324ca2f8 req-c8fa3358-9507-4e32-95b7-f9f8b79cf312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25004b14-902f-4ec6-80a5-b3aefb14d11f", "tag": "b86106a9-835a-4042-8fff-a05757a7677a"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:33:02.647913 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8e774a72-fdbd-4095-ae12-fa21324ca2f8 req-c8fa3358-9507-4e32-95b7-f9f8b79cf312 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:02.648492 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8e774a72-fdbd-4095-ae12-fa21324ca2f8 req-c8fa3358-9507-4e32-95b7-f9f8b79cf312 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:02.649143 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-8e774a72-fdbd-4095-ae12-fa21324ca2f8 req-c8fa3358-9507-4e32-95b7-f9f8b79cf312 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:02.661585 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-8e774a72-fdbd-4095-ae12-fa21324ca2f8 req-c8fa3358-9507-4e32-95b7-f9f8b79cf312 service nova] Creating event network-changed:b86106a9-835a-4042-8fff-a05757a7677a for instance 25004b14-902f-4ec6-80a5-b3aefb14d11f on nch1-master-1 Sep 17 21:33:02.663102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d1c69cbe-f4a9-46e2-be87-20115eaca909 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 25004b14-902f-4ec6-80a5-b3aefb14d11f] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:33:02.667865 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-8e774a72-fdbd-4095-ae12-fa21324ca2f8 req-c8fa3358-9507-4e32-95b7-f9f8b79cf312 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043733 Sep 17 21:33:02.669073 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3128/6167] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:33:02.771351 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d1c69cbe-f4a9-46e2-be87-20115eaca909 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "DELETE /compute/v2.1/servers/25004b14-902f-4ec6-80a5-b3aefb14d11f" status: 204 len: 0 microversion: 2.1 time: 0.174396 Sep 17 21:33:02.772360 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3040/6168] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:33:02 2022] DELETE /compute/v2.1/servers/25004b14-902f-4ec6-80a5-b3aefb14d11f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:33:02.781301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b32e0af3-8267-4f12-b227-836e26cf7455 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:02.782043 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b32e0af3-8267-4f12-b227-836e26cf7455 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 25004b14-902f-4ec6-80a5-b3aefb14d11f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:33:02.788496 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b32e0af3-8267-4f12-b227-836e26cf7455 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:02.789005 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b32e0af3-8267-4f12-b227-836e26cf7455 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:02.789707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b32e0af3-8267-4f12-b227-836e26cf7455 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:02.790585 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b32e0af3-8267-4f12-b227-836e26cf7455 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:02.791219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b32e0af3-8267-4f12-b227-836e26cf7455 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:02.791812 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b32e0af3-8267-4f12-b227-836e26cf7455 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:03.053336 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b32e0af3-8267-4f12-b227-836e26cf7455 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:33:03.063058 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b32e0af3-8267-4f12-b227-836e26cf7455 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/25004b14-902f-4ec6-80a5-b3aefb14d11f" status: 200 len: 1578 microversion: 2.1 time: 0.286000 Sep 17 21:33:03.063912 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3129/6169] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:33:02 2022] GET /compute/v2.1/servers/25004b14-902f-4ec6-80a5-b3aefb14d11f => generated 1578 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:33:03.485746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ed637f70-4b7e-42ab-b30c-7351f9477eb5 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] Calling method '.version_select at 0x7f25a46adee0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:03.510210 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ed637f70-4b7e-42ab-b30c-7351f9477eb5 tempest-TestNetworkAdvancedServerOps-1107857406 tempest-TestNetworkAdvancedServerOps-1107857406-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1576570525" status: 202 len: 0 microversion: 2.1 time: 0.029912 Sep 17 21:33:03.511312 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3041/6170] 10.222.0.26 () {58 vars in 1284 bytes} [Sat Sep 17 21:33:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1576570525 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:33:04.087837 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5c6b0144-d005-4077-8f8c-bd8e8c65f1e0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:04.088686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5c6b0144-d005-4077-8f8c-bd8e8c65f1e0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 25004b14-902f-4ec6-80a5-b3aefb14d11f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:33:04.095195 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c6b0144-d005-4077-8f8c-bd8e8c65f1e0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:04.095705 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c6b0144-d005-4077-8f8c-bd8e8c65f1e0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:04.096158 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c6b0144-d005-4077-8f8c-bd8e8c65f1e0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:04.096879 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c6b0144-d005-4077-8f8c-bd8e8c65f1e0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:04.097351 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c6b0144-d005-4077-8f8c-bd8e8c65f1e0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:04.097832 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c6b0144-d005-4077-8f8c-bd8e8c65f1e0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:04.247869 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5c6b0144-d005-4077-8f8c-bd8e8c65f1e0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:33:04.256549 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5c6b0144-d005-4077-8f8c-bd8e8c65f1e0 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/25004b14-902f-4ec6-80a5-b3aefb14d11f" status: 200 len: 1578 microversion: 2.1 time: 0.173693 Sep 17 21:33:04.257171 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3130/6171] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:33:04 2022] GET /compute/v2.1/servers/25004b14-902f-4ec6-80a5-b3aefb14d11f => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:33:05.074522 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-6ba7c1af-d400-401a-a895-6841b5eaebaf req-129ad5e9-c818-4a1d-9444-f44337f1320c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25004b14-902f-4ec6-80a5-b3aefb14d11f", "name": "network-vif-deleted", "tag": "b86106a9-835a-4042-8fff-a05757a7677a"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:33:05.089771 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-6ba7c1af-d400-401a-a895-6841b5eaebaf req-129ad5e9-c818-4a1d-9444-f44337f1320c service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:05.090318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-6ba7c1af-d400-401a-a895-6841b5eaebaf req-129ad5e9-c818-4a1d-9444-f44337f1320c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:05.090717 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-6ba7c1af-d400-401a-a895-6841b5eaebaf req-129ad5e9-c818-4a1d-9444-f44337f1320c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:05.106152 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-6ba7c1af-d400-401a-a895-6841b5eaebaf req-129ad5e9-c818-4a1d-9444-f44337f1320c service nova] Creating event network-vif-deleted:b86106a9-835a-4042-8fff-a05757a7677a for instance 25004b14-902f-4ec6-80a5-b3aefb14d11f on nch1-master-1 Sep 17 21:33:05.113652 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-6ba7c1af-d400-401a-a895-6841b5eaebaf req-129ad5e9-c818-4a1d-9444-f44337f1320c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.282266 Sep 17 21:33:05.114810 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3042/6172] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:33:05.280956 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-07c013df-2ffd-4c5a-8b11-bc77bfb50c1c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:05.281821 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-07c013df-2ffd-4c5a-8b11-bc77bfb50c1c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 25004b14-902f-4ec6-80a5-b3aefb14d11f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:33:05.289853 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-07c013df-2ffd-4c5a-8b11-bc77bfb50c1c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:05.290543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-07c013df-2ffd-4c5a-8b11-bc77bfb50c1c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:05.291111 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-07c013df-2ffd-4c5a-8b11-bc77bfb50c1c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:05.291986 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-07c013df-2ffd-4c5a-8b11-bc77bfb50c1c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:05.292580 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-07c013df-2ffd-4c5a-8b11-bc77bfb50c1c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:05.293141 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-07c013df-2ffd-4c5a-8b11-bc77bfb50c1c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:05.329952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-07c013df-2ffd-4c5a-8b11-bc77bfb50c1c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:05.330508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-07c013df-2ffd-4c5a-8b11-bc77bfb50c1c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:05.330941 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-07c013df-2ffd-4c5a-8b11-bc77bfb50c1c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:05.331428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-07c013df-2ffd-4c5a-8b11-bc77bfb50c1c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lazy-loading 'fault' on Instance uuid 25004b14-902f-4ec6-80a5-b3aefb14d11f {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:33:05.392937 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-07c013df-2ffd-4c5a-8b11-bc77bfb50c1c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '342e60103c9b45bcb348b6f8bcd686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99d2a0b4d7e40a38e682fc147e968af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:33:05.402988 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-07c013df-2ffd-4c5a-8b11-bc77bfb50c1c tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/25004b14-902f-4ec6-80a5-b3aefb14d11f" status: 200 len: 1230 microversion: 2.1 time: 0.126109 Sep 17 21:33:05.412550 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3131/6173] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:33:05 2022] GET /compute/v2.1/servers/25004b14-902f-4ec6-80a5-b3aefb14d11f => generated 1230 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:33:06.440324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-72db09d0-c845-4e44-a6f7-d311bc217259 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:06.441525 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-72db09d0-c845-4e44-a6f7-d311bc217259 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 25004b14-902f-4ec6-80a5-b3aefb14d11f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:33:06.452179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-72db09d0-c845-4e44-a6f7-d311bc217259 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:06.452986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-72db09d0-c845-4e44-a6f7-d311bc217259 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:06.453777 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-72db09d0-c845-4e44-a6f7-d311bc217259 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:06.454933 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-72db09d0-c845-4e44-a6f7-d311bc217259 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:06.455693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-72db09d0-c845-4e44-a6f7-d311bc217259 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:06.456409 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-72db09d0-c845-4e44-a6f7-d311bc217259 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:06.470873 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-72db09d0-c845-4e44-a6f7-d311bc217259 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] HTTP exception thrown: Instance 25004b14-902f-4ec6-80a5-b3aefb14d11f could not be found. Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-72db09d0-c845-4e44-a6f7-d311bc217259 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Request method failure captured: Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/25004b14-902f-4ec6-80a5-b3aefb14d11f HTTP/1.1 Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjrvOiuthjFaTfhYt50z8pDXrt-HPwrf96uRwuVJ9ynjuC5bmjoCBf4y3MnbEYBpakcf75RXFUI631TlKrccQPyNjX9J3nTlRjiuxC83ZWT1CdEDSXZAvO47o2oB0JdJR88NFg3ylqlbHTdxn4s4t3eWhyXUxZZiXUGmNIvQFsnF9s0 Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: b99d2a0b4d7e40a38e682fc147e968af Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-TestVolumeBootPattern-747170341 Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b99d2a0b4d7e40a38e682fc147e968af", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-TestVolumeBootPattern-747170341 Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: b99d2a0b4d7e40a38e682fc147e968af Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-TestVolumeBootPattern-747170341 Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-TestVolumeBootPattern-747170341-project Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 342e60103c9b45bcb348b6f8bcd686ca Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-TestVolumeBootPattern-747170341-project Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 25004b14-902f-4ec6-80a5-b3aefb14d11f could not be found. Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '25004b14-902f-4ec6-80a5-b3aefb14d11f'} Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25004b14-902f-4ec6-80a5-b3aefb14d11f could not be found. Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25004b14-902f-4ec6-80a5-b3aefb14d11f could not be found. Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:33:06.472495 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:33:06.477230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:33:06.477230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:33:06.477230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:33:06.477230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:33:06.477230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:33:06.477230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25004b14-902f-4ec6-80a5-b3aefb14d11f could not be found. Sep 17 21:33:06.477230 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:33:06.477230 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-72db09d0-c845-4e44-a6f7-d311bc217259 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Returning 404 to user: Instance 25004b14-902f-4ec6-80a5-b3aefb14d11f could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:33:06.477230 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-72db09d0-c845-4e44-a6f7-d311bc217259 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/25004b14-902f-4ec6-80a5-b3aefb14d11f" status: 404 len: 111 microversion: 2.1 time: 0.042249 Sep 17 21:33:06.477230 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3043/6174] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:33:06 2022] GET /compute/v2.1/servers/25004b14-902f-4ec6-80a5-b3aefb14d11f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:33:06.924475 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c7511eb3-3e0a-4188-a3f9-16d36a26a138 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:06.924990 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c7511eb3-3e0a-4188-a3f9-16d36a26a138 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:33:06.932479 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c7511eb3-3e0a-4188-a3f9-16d36a26a138 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:06.932977 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c7511eb3-3e0a-4188-a3f9-16d36a26a138 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:06.933434 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c7511eb3-3e0a-4188-a3f9-16d36a26a138 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:06.934170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c7511eb3-3e0a-4188-a3f9-16d36a26a138 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:06.934640 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c7511eb3-3e0a-4188-a3f9-16d36a26a138 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:06.935080 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c7511eb3-3e0a-4188-a3f9-16d36a26a138 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:06.949397 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-c7511eb3-3e0a-4188-a3f9-16d36a26a138 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] HTTP exception thrown: Instance 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec could not be found. Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c7511eb3-3e0a-4188-a3f9-16d36a26a138 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Request method failure captured: Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec HTTP/1.1 Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJjrvOiuthjFaTfhYt50z8pDXrt-HPwrf96uRwuVJ9ynjuC5bmjoCBf4y3MnbEYBpakcf75RXFUI631TlKrccQPyNjX9J3nTlRjiuxC83ZWT1CdEDSXZAvO47o2oB0JdJR88NFg3ylqlbHTdxn4s4t3eWhyXUxZZiXUGmNIvQFsnF9s0 Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: b99d2a0b4d7e40a38e682fc147e968af Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-TestVolumeBootPattern-747170341 Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b99d2a0b4d7e40a38e682fc147e968af", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-TestVolumeBootPattern-747170341 Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: b99d2a0b4d7e40a38e682fc147e968af Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-TestVolumeBootPattern-747170341 Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-TestVolumeBootPattern-747170341-project Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 342e60103c9b45bcb348b6f8bcd686ca Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-TestVolumeBootPattern-747170341-project Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec could not be found. Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '24e01588-ddb5-4c16-bd5a-dd6988b0d3ec'} Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec could not be found. Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:33:06.951046 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:33:06.955788 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec could not be found. Sep 17 21:33:06.955788 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:33:06.955788 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:33:06.955788 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:33:06.955788 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:33:06.955788 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:33:06.955788 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:33:06.955788 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:33:06.955788 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:33:06.955788 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec could not be found. Sep 17 21:33:06.955788 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:33:06.955788 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c7511eb3-3e0a-4188-a3f9-16d36a26a138 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Returning 404 to user: Instance 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:33:06.955788 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c7511eb3-3e0a-4188-a3f9-16d36a26a138 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "DELETE /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec" status: 404 len: 111 microversion: 2.1 time: 0.032006 Sep 17 21:33:06.955788 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3132/6175] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:33:06 2022] DELETE /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:33:06.965294 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4483abf0-574f-406f-96d7-50fc9de7aa2e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:06.965958 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4483abf0-574f-406f-96d7-50fc9de7aa2e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] [instance: 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:33:06.972479 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4483abf0-574f-406f-96d7-50fc9de7aa2e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:06.972971 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4483abf0-574f-406f-96d7-50fc9de7aa2e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:06.973558 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4483abf0-574f-406f-96d7-50fc9de7aa2e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:06.974265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4483abf0-574f-406f-96d7-50fc9de7aa2e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:06.974693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4483abf0-574f-406f-96d7-50fc9de7aa2e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:06.975131 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4483abf0-574f-406f-96d7-50fc9de7aa2e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:06.989419 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-4483abf0-574f-406f-96d7-50fc9de7aa2e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] HTTP exception thrown: Instance 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec could not be found. Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4483abf0-574f-406f-96d7-50fc9de7aa2e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Request method failure captured: Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec HTTP/1.1 Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJjrvOiuthjFaTfhYt50z8pDXrt-HPwrf96uRwuVJ9ynjuC5bmjoCBf4y3MnbEYBpakcf75RXFUI631TlKrccQPyNjX9J3nTlRjiuxC83ZWT1CdEDSXZAvO47o2oB0JdJR88NFg3ylqlbHTdxn4s4t3eWhyXUxZZiXUGmNIvQFsnF9s0 Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: b99d2a0b4d7e40a38e682fc147e968af Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-TestVolumeBootPattern-747170341 Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b99d2a0b4d7e40a38e682fc147e968af"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b99d2a0b4d7e40a38e682fc147e968af", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-TestVolumeBootPattern-747170341 Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: b99d2a0b4d7e40a38e682fc147e968af Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-TestVolumeBootPattern-747170341 Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-TestVolumeBootPattern-747170341-project Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 342e60103c9b45bcb348b6f8bcd686ca Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-TestVolumeBootPattern-747170341-project Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec could not be found. Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '24e01588-ddb5-4c16-bd5a-dd6988b0d3ec'} Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec could not be found. Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec could not be found. Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:33:06.991013 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:33:06.995753 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:33:06.995753 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:33:06.995753 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:33:06.995753 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:33:06.995753 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:33:06.995753 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec could not be found. Sep 17 21:33:06.995753 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:33:06.995753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4483abf0-574f-406f-96d7-50fc9de7aa2e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Returning 404 to user: Instance 24e01588-ddb5-4c16-bd5a-dd6988b0d3ec could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:33:06.995753 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4483abf0-574f-406f-96d7-50fc9de7aa2e tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec" status: 404 len: 111 microversion: 2.1 time: 0.031092 Sep 17 21:33:06.995753 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3044/6176] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:33:06 2022] GET /compute/v2.1/servers/24e01588-ddb5-4c16-bd5a-dd6988b0d3ec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:33:08.304501 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0e42c6ba-fbc1-476c-a241-7988dae34b88 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] Calling method '.version_select at 0x7f25a40993a0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:08.330432 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0e42c6ba-fbc1-476c-a241-7988dae34b88 tempest-TestVolumeBootPattern-747170341 tempest-TestVolumeBootPattern-747170341-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1399000875" status: 202 len: 0 microversion: 2.1 time: 0.029752 Sep 17 21:33:08.332460 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3133/6177] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Sep 17 21:33:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1399000875 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:33:27.759131 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:33:27.759933 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:33:27.880488 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c441a834-de38-4665-8703-130c7d446ba0 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-916311360", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:33:27.933105 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-c441a834-de38-4665-8703-130c7d446ba0 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] validate_networks() for None {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:33:28.215626 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-c441a834-de38-4665-8703-130c7d446ba0 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:33:28.216062 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-c441a834-de38-4665-8703-130c7d446ba0 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:33:28.216556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-c441a834-de38-4665-8703-130c7d446ba0 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:33:28.216974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-c441a834-de38-4665-8703-130c7d446ba0 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:33:28.217403 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-c441a834-de38-4665-8703-130c7d446ba0 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:33:28.227489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c441a834-de38-4665-8703-130c7d446ba0 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:28.228074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c441a834-de38-4665-8703-130c7d446ba0 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:28.228524 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c441a834-de38-4665-8703-130c7d446ba0 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:28.229322 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c441a834-de38-4665-8703-130c7d446ba0 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:28.229807 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c441a834-de38-4665-8703-130c7d446ba0 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:28.230243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c441a834-de38-4665-8703-130c7d446ba0 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:28.248232 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-c441a834-de38-4665-8703-130c7d446ba0 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Getting quotas for project f0364086523d46e7833d803ba0ee5437. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:33:28.253828 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-c441a834-de38-4665-8703-130c7d446ba0 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Getting quotas for user 5e669e81ae1a4a16b5fc70a3a06e2ccd and project f0364086523d46e7833d803ba0ee5437. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:33:28.267825 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c441a834-de38-4665-8703-130c7d446ba0 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:33:28.270281 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c441a834-de38-4665-8703-130c7d446ba0 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] [instance: d3107acb-97a2-4915-80be-2b58c3a823f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:33:28.317398 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c441a834-de38-4665-8703-130c7d446ba0 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563876 Sep 17 21:33:28.318086 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3045/6178] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:33:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:33:28.331368 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ce78368b-e12e-4af6-bdd8-036776e1a652 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:28.332034 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ce78368b-e12e-4af6-bdd8-036776e1a652 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] [instance: d3107acb-97a2-4915-80be-2b58c3a823f7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:33:28.335730 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=40 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:33:28.336365 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:33:28.391266 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ce78368b-e12e-4af6-bdd8-036776e1a652 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e669e81ae1a4a16b5fc70a3a06e2ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0364086523d46e7833d803ba0ee5437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:33:28.398940 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ce78368b-e12e-4af6-bdd8-036776e1a652 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] 10.222.0.26 "GET /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7" status: 200 len: 1221 microversion: 2.1 time: 0.071753 Sep 17 21:33:28.399517 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3134/6179] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:33:28 2022] GET /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7 => generated 1221 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:33:29.423581 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a2804bf1-b4c5-48ca-87ff-a1a4316a9815 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:29.424205 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a2804bf1-b4c5-48ca-87ff-a1a4316a9815 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] [instance: d3107acb-97a2-4915-80be-2b58c3a823f7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:33:29.431448 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2804bf1-b4c5-48ca-87ff-a1a4316a9815 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:29.431945 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2804bf1-b4c5-48ca-87ff-a1a4316a9815 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:29.432360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2804bf1-b4c5-48ca-87ff-a1a4316a9815 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:29.433302 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2804bf1-b4c5-48ca-87ff-a1a4316a9815 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:29.433798 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2804bf1-b4c5-48ca-87ff-a1a4316a9815 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:29.434240 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2804bf1-b4c5-48ca-87ff-a1a4316a9815 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:29.509115 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a2804bf1-b4c5-48ca-87ff-a1a4316a9815 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e669e81ae1a4a16b5fc70a3a06e2ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0364086523d46e7833d803ba0ee5437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:33:29.518201 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a2804bf1-b4c5-48ca-87ff-a1a4316a9815 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] 10.222.0.26 "GET /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7" status: 200 len: 1273 microversion: 2.1 time: 0.099537 Sep 17 21:33:29.518815 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3046/6180] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:33:29 2022] GET /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7 => generated 1273 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:33:30.542761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-dd021292-5039-43ab-9c6f-9fcc0cbc644d tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:30.543344 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-dd021292-5039-43ab-9c6f-9fcc0cbc644d tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] [instance: d3107acb-97a2-4915-80be-2b58c3a823f7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:33:30.550853 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd021292-5039-43ab-9c6f-9fcc0cbc644d tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:30.551382 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd021292-5039-43ab-9c6f-9fcc0cbc644d tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:30.551870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd021292-5039-43ab-9c6f-9fcc0cbc644d tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:30.552627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd021292-5039-43ab-9c6f-9fcc0cbc644d tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:30.553103 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd021292-5039-43ab-9c6f-9fcc0cbc644d tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:30.553587 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd021292-5039-43ab-9c6f-9fcc0cbc644d tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:30.691347 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-dd021292-5039-43ab-9c6f-9fcc0cbc644d tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e669e81ae1a4a16b5fc70a3a06e2ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0364086523d46e7833d803ba0ee5437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:33:30.698165 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-dd021292-5039-43ab-9c6f-9fcc0cbc644d tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] 10.222.0.26 "GET /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7" status: 200 len: 1321 microversion: 2.1 time: 0.159460 Sep 17 21:33:30.698967 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3135/6181] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:33:30 2022] GET /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:33:31.170651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-bfbe9f74-a40c-43a7-b24f-84eadc8d9d06 req-17a28df0-dcb0-4175-b982-4a71a99249ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3107acb-97a2-4915-80be-2b58c3a823f7", "tag": "f5fda4a4-81cb-4d70-ad98-f92916cdfaa6"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:33:31.185039 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-bfbe9f74-a40c-43a7-b24f-84eadc8d9d06 req-17a28df0-dcb0-4175-b982-4a71a99249ab service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:31.186275 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-bfbe9f74-a40c-43a7-b24f-84eadc8d9d06 req-17a28df0-dcb0-4175-b982-4a71a99249ab service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:31.186468 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-bfbe9f74-a40c-43a7-b24f-84eadc8d9d06 req-17a28df0-dcb0-4175-b982-4a71a99249ab service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:31.203334 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-bfbe9f74-a40c-43a7-b24f-84eadc8d9d06 req-17a28df0-dcb0-4175-b982-4a71a99249ab service nova] Creating event network-changed:f5fda4a4-81cb-4d70-ad98-f92916cdfaa6 for instance d3107acb-97a2-4915-80be-2b58c3a823f7 on nch1-master-1 Sep 17 21:33:31.208534 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-bfbe9f74-a40c-43a7-b24f-84eadc8d9d06 req-17a28df0-dcb0-4175-b982-4a71a99249ab service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041544 Sep 17 21:33:31.209192 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3047/6182] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:33:31.721381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-603b1145-ae46-4c5b-ace8-489aa3abd8bc tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:31.722058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-603b1145-ae46-4c5b-ace8-489aa3abd8bc tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] [instance: d3107acb-97a2-4915-80be-2b58c3a823f7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:33:31.730051 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-603b1145-ae46-4c5b-ace8-489aa3abd8bc tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:31.730582 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-603b1145-ae46-4c5b-ace8-489aa3abd8bc tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:31.731055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-603b1145-ae46-4c5b-ace8-489aa3abd8bc tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:31.731773 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-603b1145-ae46-4c5b-ace8-489aa3abd8bc tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:31.732267 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-603b1145-ae46-4c5b-ace8-489aa3abd8bc tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:31.732717 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-603b1145-ae46-4c5b-ace8-489aa3abd8bc tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:31.869871 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-603b1145-ae46-4c5b-ace8-489aa3abd8bc tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e669e81ae1a4a16b5fc70a3a06e2ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0364086523d46e7833d803ba0ee5437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:33:31.877834 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-603b1145-ae46-4c5b-ace8-489aa3abd8bc tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] 10.222.0.26 "GET /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7" status: 200 len: 1321 microversion: 2.1 time: 0.160474 Sep 17 21:33:31.878418 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3136/6183] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:33:31 2022] GET /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:33:32.901848 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-726f72ec-bd7d-4b29-8205-5d1a3f93b7bd tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:32.903066 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-726f72ec-bd7d-4b29-8205-5d1a3f93b7bd tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] [instance: d3107acb-97a2-4915-80be-2b58c3a823f7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:33:32.909720 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-726f72ec-bd7d-4b29-8205-5d1a3f93b7bd tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:32.910246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-726f72ec-bd7d-4b29-8205-5d1a3f93b7bd tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:32.910693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-726f72ec-bd7d-4b29-8205-5d1a3f93b7bd tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:32.911399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-726f72ec-bd7d-4b29-8205-5d1a3f93b7bd tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:32.911865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-726f72ec-bd7d-4b29-8205-5d1a3f93b7bd tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:32.912304 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-726f72ec-bd7d-4b29-8205-5d1a3f93b7bd tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:33.048427 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-726f72ec-bd7d-4b29-8205-5d1a3f93b7bd tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e669e81ae1a4a16b5fc70a3a06e2ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0364086523d46e7833d803ba0ee5437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:33:33.060678 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-726f72ec-bd7d-4b29-8205-5d1a3f93b7bd tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] 10.222.0.26 "GET /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7" status: 200 len: 1321 microversion: 2.1 time: 0.163649 Sep 17 21:33:33.061440 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3048/6184] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:33:32 2022] GET /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:33:34.091440 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-62fe2e41-364b-4f13-afc6-c825af4f5b72 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:34.092323 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-62fe2e41-364b-4f13-afc6-c825af4f5b72 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] [instance: d3107acb-97a2-4915-80be-2b58c3a823f7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:33:34.100856 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62fe2e41-364b-4f13-afc6-c825af4f5b72 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:34.101452 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62fe2e41-364b-4f13-afc6-c825af4f5b72 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:34.102378 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62fe2e41-364b-4f13-afc6-c825af4f5b72 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:34.103228 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62fe2e41-364b-4f13-afc6-c825af4f5b72 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:34.103780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62fe2e41-364b-4f13-afc6-c825af4f5b72 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:34.104346 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62fe2e41-364b-4f13-afc6-c825af4f5b72 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:34.247543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-62fe2e41-364b-4f13-afc6-c825af4f5b72 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e669e81ae1a4a16b5fc70a3a06e2ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0364086523d46e7833d803ba0ee5437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:33:34.256404 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-62fe2e41-364b-4f13-afc6-c825af4f5b72 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] 10.222.0.26 "GET /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7" status: 200 len: 1321 microversion: 2.1 time: 0.170878 Sep 17 21:33:34.256965 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3137/6185] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:33:34 2022] GET /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:33:35.283242 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-712911f4-9e13-4b8a-b0b8-da286d120a0f tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:35.284233 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-712911f4-9e13-4b8a-b0b8-da286d120a0f tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] [instance: d3107acb-97a2-4915-80be-2b58c3a823f7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:33:35.294746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-712911f4-9e13-4b8a-b0b8-da286d120a0f tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:35.295243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-712911f4-9e13-4b8a-b0b8-da286d120a0f tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:35.295694 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-712911f4-9e13-4b8a-b0b8-da286d120a0f tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:35.296405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-712911f4-9e13-4b8a-b0b8-da286d120a0f tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:35.296875 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-712911f4-9e13-4b8a-b0b8-da286d120a0f tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:35.297315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-712911f4-9e13-4b8a-b0b8-da286d120a0f tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:35.433264 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-712911f4-9e13-4b8a-b0b8-da286d120a0f tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e669e81ae1a4a16b5fc70a3a06e2ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0364086523d46e7833d803ba0ee5437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:33:35.441287 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-712911f4-9e13-4b8a-b0b8-da286d120a0f tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] 10.222.0.26 "GET /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7" status: 200 len: 1321 microversion: 2.1 time: 0.164776 Sep 17 21:33:35.441909 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3049/6186] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:33:35 2022] GET /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:33:36.467311 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-39361657-3507-4709-bbc2-41b59668c148 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:36.467902 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-39361657-3507-4709-bbc2-41b59668c148 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] [instance: d3107acb-97a2-4915-80be-2b58c3a823f7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:33:36.475428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39361657-3507-4709-bbc2-41b59668c148 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:36.475921 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39361657-3507-4709-bbc2-41b59668c148 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:36.476380 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39361657-3507-4709-bbc2-41b59668c148 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:36.477450 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39361657-3507-4709-bbc2-41b59668c148 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:36.477969 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39361657-3507-4709-bbc2-41b59668c148 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:36.478410 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39361657-3507-4709-bbc2-41b59668c148 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:36.614001 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-39361657-3507-4709-bbc2-41b59668c148 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e669e81ae1a4a16b5fc70a3a06e2ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0364086523d46e7833d803ba0ee5437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:33:36.624648 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-39361657-3507-4709-bbc2-41b59668c148 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] 10.222.0.26 "GET /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7" status: 200 len: 1321 microversion: 2.1 time: 0.162471 Sep 17 21:33:36.625570 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3138/6187] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:33:36 2022] GET /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:33:37.653412 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-faa3b7e0-9cce-4560-99a2-d647003b5209 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:37.654525 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-faa3b7e0-9cce-4560-99a2-d647003b5209 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] [instance: d3107acb-97a2-4915-80be-2b58c3a823f7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:33:37.666455 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-faa3b7e0-9cce-4560-99a2-d647003b5209 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:37.667403 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-faa3b7e0-9cce-4560-99a2-d647003b5209 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:37.667887 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-faa3b7e0-9cce-4560-99a2-d647003b5209 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:37.668634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-faa3b7e0-9cce-4560-99a2-d647003b5209 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:37.669081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-faa3b7e0-9cce-4560-99a2-d647003b5209 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:37.669552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-faa3b7e0-9cce-4560-99a2-d647003b5209 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:37.804530 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-faa3b7e0-9cce-4560-99a2-d647003b5209 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e669e81ae1a4a16b5fc70a3a06e2ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0364086523d46e7833d803ba0ee5437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:33:37.812559 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-faa3b7e0-9cce-4560-99a2-d647003b5209 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] 10.222.0.26 "GET /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7" status: 200 len: 1321 microversion: 2.1 time: 0.165913 Sep 17 21:33:37.813108 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3050/6188] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:33:37 2022] GET /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:33:37.933407 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-f37639a1-ad1d-4470-9fb4-495281f6585b req-19604c1b-6587-4ee3-95de-fb96de4ca70d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3107acb-97a2-4915-80be-2b58c3a823f7", "name": "network-vif-plugged", "status": "completed", "tag": "f5fda4a4-81cb-4d70-ad98-f92916cdfaa6"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:33:37.943047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f37639a1-ad1d-4470-9fb4-495281f6585b req-19604c1b-6587-4ee3-95de-fb96de4ca70d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:37.943556 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f37639a1-ad1d-4470-9fb4-495281f6585b req-19604c1b-6587-4ee3-95de-fb96de4ca70d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:37.944008 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f37639a1-ad1d-4470-9fb4-495281f6585b req-19604c1b-6587-4ee3-95de-fb96de4ca70d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:37.955345 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-f37639a1-ad1d-4470-9fb4-495281f6585b req-19604c1b-6587-4ee3-95de-fb96de4ca70d service nova] Creating event network-vif-plugged:f5fda4a4-81cb-4d70-ad98-f92916cdfaa6 for instance d3107acb-97a2-4915-80be-2b58c3a823f7 on nch1-master-1 Sep 17 21:33:37.960660 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-f37639a1-ad1d-4470-9fb4-495281f6585b req-19604c1b-6587-4ee3-95de-fb96de4ca70d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103056 Sep 17 21:33:37.961284 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3139/6189] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:33:38.834957 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4c5bb7e1-3c22-410c-8211-e03135a4938b tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:38.836181 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4c5bb7e1-3c22-410c-8211-e03135a4938b tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] [instance: d3107acb-97a2-4915-80be-2b58c3a823f7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:33:38.839327 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:33:38.840306 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:33:38.846299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c5bb7e1-3c22-410c-8211-e03135a4938b tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:38.846792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c5bb7e1-3c22-410c-8211-e03135a4938b tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:38.847238 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c5bb7e1-3c22-410c-8211-e03135a4938b tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:38.847994 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c5bb7e1-3c22-410c-8211-e03135a4938b tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:38.848444 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c5bb7e1-3c22-410c-8211-e03135a4938b tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:38.848877 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c5bb7e1-3c22-410c-8211-e03135a4938b tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:38.982376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4c5bb7e1-3c22-410c-8211-e03135a4938b tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e669e81ae1a4a16b5fc70a3a06e2ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0364086523d46e7833d803ba0ee5437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:33:38.990463 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4c5bb7e1-3c22-410c-8211-e03135a4938b tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] 10.222.0.26 "GET /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7" status: 200 len: 1321 microversion: 2.1 time: 0.159429 Sep 17 21:33:38.991363 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3051/6190] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:33:38 2022] GET /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:33:40.019058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-935b682d-6e4a-4019-8847-c3055de52946 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:40.020245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-935b682d-6e4a-4019-8847-c3055de52946 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] [instance: d3107acb-97a2-4915-80be-2b58c3a823f7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:33:40.023588 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:33:40.031555 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-935b682d-6e4a-4019-8847-c3055de52946 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:40.032055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-935b682d-6e4a-4019-8847-c3055de52946 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:40.032513 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-935b682d-6e4a-4019-8847-c3055de52946 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:40.033240 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-935b682d-6e4a-4019-8847-c3055de52946 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:40.033732 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-935b682d-6e4a-4019-8847-c3055de52946 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:40.034174 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-935b682d-6e4a-4019-8847-c3055de52946 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:40.183325 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-935b682d-6e4a-4019-8847-c3055de52946 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e669e81ae1a4a16b5fc70a3a06e2ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0364086523d46e7833d803ba0ee5437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:33:40.191883 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-935b682d-6e4a-4019-8847-c3055de52946 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] 10.222.0.26 "GET /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7" status: 200 len: 1471 microversion: 2.1 time: 0.180202 Sep 17 21:33:40.192434 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3140/6191] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:33:40 2022] GET /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7 => generated 1471 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:33:40.270918 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2be609ce-5da3-41f9-95c7-b2d15f68eb3a tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Calling method '.version_select at 0x7f25a45f8820>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:40.339099 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2be609ce-5da3-41f9-95c7-b2d15f68eb3a tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/1de6248b363b4cd186d7de7fc0827f1d" status: 200 len: 371 microversion: 2.1 time: 0.125311 Sep 17 21:33:40.339671 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3052/6192] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Sep 17 21:33:40 2022] GET /compute/v2.1/os-quota-sets/1de6248b363b4cd186d7de7fc0827f1d => generated 371 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:33:40.352137 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8f8123c9-63a1-4041-b74a-12f9cd019b3a tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-439455315", "id": 1267741229, "os-flavor-access:is_public": "True"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:33:40.372994 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8f8123c9-63a1-4041-b74a-12f9cd019b3a tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.025023 Sep 17 21:33:40.373596 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3141/6193] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:33:40 2022] POST /compute/v2.1/flavors => generated 437 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:33:40.386086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-99528656-1e06-4a2c-abfa-da39ff14684b tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1267741229"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:33:40.388381 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-99528656-1e06-4a2c-abfa-da39ff14684b tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] [instance: d3107acb-97a2-4915-80be-2b58c3a823f7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:33:40.394593 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99528656-1e06-4a2c-abfa-da39ff14684b tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:40.395089 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99528656-1e06-4a2c-abfa-da39ff14684b tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:40.395534 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99528656-1e06-4a2c-abfa-da39ff14684b tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:40.396242 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99528656-1e06-4a2c-abfa-da39ff14684b tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:40.396730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99528656-1e06-4a2c-abfa-da39ff14684b tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:40.397193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99528656-1e06-4a2c-abfa-da39ff14684b tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:40.596582 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-99528656-1e06-4a2c-abfa-da39ff14684b tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0ed3b0bcdf1b4716a39a225c80c000d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de6248b363b4cd186d7de7fc0827f1d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:33:40.603460 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-99528656-1e06-4a2c-abfa-da39ff14684b tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] [instance: d3107acb-97a2-4915-80be-2b58c3a823f7] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-439455315 {{(pid=140523) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 17 21:33:40.610754 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99528656-1e06-4a2c-abfa-da39ff14684b tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:40.611251 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99528656-1e06-4a2c-abfa-da39ff14684b tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:40.611699 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99528656-1e06-4a2c-abfa-da39ff14684b tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:40.612473 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99528656-1e06-4a2c-abfa-da39ff14684b tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:40.612937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99528656-1e06-4a2c-abfa-da39ff14684b tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:40.613373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-99528656-1e06-4a2c-abfa-da39ff14684b tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:40.634522 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-99528656-1e06-4a2c-abfa-da39ff14684b tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Getting quotas for project f0364086523d46e7833d803ba0ee5437. Resources: {'cores', 'ram'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:33:40.639938 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-99528656-1e06-4a2c-abfa-da39ff14684b tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Getting quotas for user 5e669e81ae1a4a16b5fc70a3a06e2ccd and project f0364086523d46e7833d803ba0ee5437. Resources: {'cores', 'ram'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:33:40.652805 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.compute.api [None req-99528656-1e06-4a2c-abfa-da39ff14684b tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] ram quota exceeded for 1de6248b363b4cd186d7de7fc0827f1d, tried to resize instance. Sep 17 21:33:40.653389 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-99528656-1e06-4a2c-abfa-da39ff14684b tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-99528656-1e06-4a2c-abfa-da39ff14684b tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Request method failure captured: Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7/action HTTP/1.1 Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 39 Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJj0nlXGkfuEZx7dYVeBJZzAUHI00PXtLqgyCrYl_AkhLSjWtIcQsPCplZb3eGs5ehwE1ZPDeNR7ouywhiyaX5qm5qm0yf3fGLto3sZmn3rIJNNM0K-aFhwVJjz0WOxh5jlzDBxnayWWAeSc81TaXc9i-DrXlCaDaEaBxiKFDSarFjxc Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 1de6248b363b4cd186d7de7fc0827f1d Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1371865185 Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: X-Role: admin,member,reader Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: admin,member,reader Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1de6248b363b4cd186d7de7fc0827f1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1de6248b363b4cd186d7de7fc0827f1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1de6248b363b4cd186d7de7fc0827f1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1de6248b363b4cd186d7de7fc0827f1d", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1371865185 Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 1de6248b363b4cd186d7de7fc0827f1d Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1371865185 Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersAdminNegativeTestJSON-1371865185-project-admin Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 0ed3b0bcdf1b4716a39a225c80c000d0 Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1371865185-project-admin Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: {"resize": {"flavorRef": "1267741229"}} Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'd3107acb-97a2-4915-80be-2b58c3a823f7', 'body': {'resize': {'flavorRef': '1267741229'}}} Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 21:33:40.655517 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-99528656-1e06-4a2c-abfa-da39ff14684b tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-99528656-1e06-4a2c-abfa-da39ff14684b tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7/action" status: 403 len: 118 microversion: 2.1 time: 0.274797 Sep 17 21:33:40.660205 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3053/6194] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:33:40 2022] POST /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7/action => generated 118 bytes in 276 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:33:40.666251 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8a4b4b68-fdef-4383-b16f-5d2d213e5914 tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:40.686433 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8a4b4b68-fdef-4383-b16f-5d2d213e5914 tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1267741229" status: 202 len: 0 microversion: 2.1 time: 0.023872 Sep 17 21:33:40.687283 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3142/6195] 10.222.0.26 () {58 vars in 1161 bytes} [Sat Sep 17 21:33:40 2022] DELETE /compute/v2.1/flavors/1267741229 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:33:40.695363 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6528558d-d8a5-474d-a0f8-14ea24a85e1a tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:40.716417 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6528558d-d8a5-474d-a0f8-14ea24a85e1a tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024771 Sep 17 21:33:40.717050 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3054/6196] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 21:33:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:33:40.738242 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5b3fd03b-e8ec-4116-a4a4-5a07d1482201 tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Calling method '.version_select at 0x7f25a57d70d0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:40.811494 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5b3fd03b-e8ec-4116-a4a4-5a07d1482201 tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/1de6248b363b4cd186d7de7fc0827f1d" status: 200 len: 371 microversion: 2.1 time: 0.077008 Sep 17 21:33:40.812081 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3143/6197] 10.222.0.26 () {58 vars in 1242 bytes} [Sat Sep 17 21:33:40 2022] GET /compute/v2.1/os-quota-sets/1de6248b363b4cd186d7de7fc0827f1d => generated 371 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:33:40.824204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8557c6d9-0b47-4626-89e5-1373ad91ed51 tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-2013405517", "id": 1166995449, "os-flavor-access:is_public": "True"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:33:40.844200 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8557c6d9-0b47-4626-89e5-1373ad91ed51 tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.023780 Sep 17 21:33:40.844788 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3055/6198] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:33:40 2022] POST /compute/v2.1/flavors => generated 437 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:33:40.857750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-445db484-f4f8-415d-ba4d-285c3b9aacf4 tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1166995449"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:33:40.860129 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-445db484-f4f8-415d-ba4d-285c3b9aacf4 tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] [instance: d3107acb-97a2-4915-80be-2b58c3a823f7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:33:40.866506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-445db484-f4f8-415d-ba4d-285c3b9aacf4 tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:40.867014 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-445db484-f4f8-415d-ba4d-285c3b9aacf4 tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:40.867471 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-445db484-f4f8-415d-ba4d-285c3b9aacf4 tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:40.868189 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-445db484-f4f8-415d-ba4d-285c3b9aacf4 tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:40.868663 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-445db484-f4f8-415d-ba4d-285c3b9aacf4 tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:40.869112 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-445db484-f4f8-415d-ba4d-285c3b9aacf4 tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:41.013488 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-445db484-f4f8-415d-ba4d-285c3b9aacf4 tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0ed3b0bcdf1b4716a39a225c80c000d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1de6248b363b4cd186d7de7fc0827f1d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:33:41.019895 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-445db484-f4f8-415d-ba4d-285c3b9aacf4 tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] [instance: d3107acb-97a2-4915-80be-2b58c3a823f7] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-2013405517 {{(pid=140524) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 17 21:33:41.027732 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-445db484-f4f8-415d-ba4d-285c3b9aacf4 tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:41.028228 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-445db484-f4f8-415d-ba4d-285c3b9aacf4 tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:41.028680 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-445db484-f4f8-415d-ba4d-285c3b9aacf4 tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:41.029420 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-445db484-f4f8-415d-ba4d-285c3b9aacf4 tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:41.029917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-445db484-f4f8-415d-ba4d-285c3b9aacf4 tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:41.030357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-445db484-f4f8-415d-ba4d-285c3b9aacf4 tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:41.055972 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-445db484-f4f8-415d-ba4d-285c3b9aacf4 tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Getting quotas for project f0364086523d46e7833d803ba0ee5437. Resources: {'cores', 'ram'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:33:41.061364 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-445db484-f4f8-415d-ba4d-285c3b9aacf4 tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Getting quotas for user 5e669e81ae1a4a16b5fc70a3a06e2ccd and project f0364086523d46e7833d803ba0ee5437. Resources: {'cores', 'ram'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:33:41.074415 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.compute.api [None req-445db484-f4f8-415d-ba4d-285c3b9aacf4 tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] cores quota exceeded for 1de6248b363b4cd186d7de7fc0827f1d, tried to resize instance. Sep 17 21:33:41.074969 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-445db484-f4f8-415d-ba4d-285c3b9aacf4 tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-445db484-f4f8-415d-ba4d-285c3b9aacf4 tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Request method failure captured: Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7/action HTTP/1.1 Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 39 Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJj0nlXGkfuEZx7dYVeBJZzAUHI00PXtLqgyCrYl_AkhLSjWtIcQsPCplZb3eGs5ehwE1ZPDeNR7ouywhiyaX5qm5qm0yf3fGLto3sZmn3rIJNNM0K-aFhwVJjz0WOxh5jlzDBxnayWWAeSc81TaXc9i-DrXlCaDaEaBxiKFDSarFjxc Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 1de6248b363b4cd186d7de7fc0827f1d Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1371865185 Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: X-Role: admin,member,reader Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: admin,member,reader Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1de6248b363b4cd186d7de7fc0827f1d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1de6248b363b4cd186d7de7fc0827f1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1de6248b363b4cd186d7de7fc0827f1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1de6248b363b4cd186d7de7fc0827f1d", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1371865185 Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 1de6248b363b4cd186d7de7fc0827f1d Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1371865185 Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersAdminNegativeTestJSON-1371865185-project-admin Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 0ed3b0bcdf1b4716a39a225c80c000d0 Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1371865185-project-admin Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: {"resize": {"flavorRef": "1166995449"}} Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'd3107acb-97a2-4915-80be-2b58c3a823f7', 'body': {'resize': {'flavorRef': '1166995449'}}} Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 21:33:41.077061 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-445db484-f4f8-415d-ba4d-285c3b9aacf4 tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-445db484-f4f8-415d-ba4d-285c3b9aacf4 tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7/action" status: 403 len: 113 microversion: 2.1 time: 0.224881 Sep 17 21:33:41.082025 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3144/6199] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:33:40 2022] POST /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7/action => generated 113 bytes in 226 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 17 21:33:41.087507 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c12c2374-2d81-4561-b29b-e251beae4e31 tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:41.108013 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c12c2374-2d81-4561-b29b-e251beae4e31 tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1166995449" status: 202 len: 0 microversion: 2.1 time: 0.024229 Sep 17 21:33:41.108559 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3056/6200] 10.222.0.26 () {58 vars in 1161 bytes} [Sat Sep 17 21:33:41 2022] DELETE /compute/v2.1/flavors/1166995449 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 17 21:33:41.116791 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fda85360-bd00-40ea-b902-676dd9b307df tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:41.137163 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fda85360-bd00-40ea-b902-676dd9b307df tempest-ServersAdminNegativeTestJSON-1371865185 tempest-ServersAdminNegativeTestJSON-1371865185-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024191 Sep 17 21:33:41.137756 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3145/6201] 10.222.0.26 () {58 vars in 1146 bytes} [Sat Sep 17 21:33:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:33:41.158439 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-81703410-7304-4ac6-8235-3290b5c79deb tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:41.158937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-81703410-7304-4ac6-8235-3290b5c79deb tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] [instance: d3107acb-97a2-4915-80be-2b58c3a823f7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:33:41.165107 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81703410-7304-4ac6-8235-3290b5c79deb tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:41.165636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81703410-7304-4ac6-8235-3290b5c79deb tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:41.166074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81703410-7304-4ac6-8235-3290b5c79deb tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:41.166769 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81703410-7304-4ac6-8235-3290b5c79deb tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:41.167301 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81703410-7304-4ac6-8235-3290b5c79deb tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:41.167746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81703410-7304-4ac6-8235-3290b5c79deb tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:41.193880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-81703410-7304-4ac6-8235-3290b5c79deb tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] [instance: d3107acb-97a2-4915-80be-2b58c3a823f7] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:33:41.275434 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-81703410-7304-4ac6-8235-3290b5c79deb tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7" status: 204 len: 0 microversion: 2.1 time: 0.120605 Sep 17 21:33:41.276344 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3057/6202] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:33:41 2022] DELETE /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:33:41.284778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-571f2403-ab72-48c2-94ac-2ea544d2e1ab tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:41.285441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-571f2403-ab72-48c2-94ac-2ea544d2e1ab tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] [instance: d3107acb-97a2-4915-80be-2b58c3a823f7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:33:41.291693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-571f2403-ab72-48c2-94ac-2ea544d2e1ab tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:41.292265 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-571f2403-ab72-48c2-94ac-2ea544d2e1ab tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:41.292764 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-571f2403-ab72-48c2-94ac-2ea544d2e1ab tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:41.293531 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-571f2403-ab72-48c2-94ac-2ea544d2e1ab tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:41.293972 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-571f2403-ab72-48c2-94ac-2ea544d2e1ab tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:41.294402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-571f2403-ab72-48c2-94ac-2ea544d2e1ab tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:41.423890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-571f2403-ab72-48c2-94ac-2ea544d2e1ab tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e669e81ae1a4a16b5fc70a3a06e2ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0364086523d46e7833d803ba0ee5437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:33:41.432234 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-571f2403-ab72-48c2-94ac-2ea544d2e1ab tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] 10.222.0.26 "GET /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7" status: 200 len: 1477 microversion: 2.1 time: 0.151542 Sep 17 21:33:41.432837 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3146/6203] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:33:41 2022] GET /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7 => generated 1477 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:33:42.456528 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1852ad95-4b53-4f56-a602-e5e432c79f34 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:42.457256 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1852ad95-4b53-4f56-a602-e5e432c79f34 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] [instance: d3107acb-97a2-4915-80be-2b58c3a823f7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:33:42.464638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1852ad95-4b53-4f56-a602-e5e432c79f34 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:42.465134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1852ad95-4b53-4f56-a602-e5e432c79f34 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:42.465614 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1852ad95-4b53-4f56-a602-e5e432c79f34 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:42.466354 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1852ad95-4b53-4f56-a602-e5e432c79f34 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:42.466851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1852ad95-4b53-4f56-a602-e5e432c79f34 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:42.467342 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1852ad95-4b53-4f56-a602-e5e432c79f34 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:42.605247 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1852ad95-4b53-4f56-a602-e5e432c79f34 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e669e81ae1a4a16b5fc70a3a06e2ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0364086523d46e7833d803ba0ee5437', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:33:42.613807 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1852ad95-4b53-4f56-a602-e5e432c79f34 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] 10.222.0.26 "GET /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7" status: 200 len: 1477 microversion: 2.1 time: 0.161606 Sep 17 21:33:42.614424 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3058/6204] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:33:42 2022] GET /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7 => generated 1477 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:33:43.003187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-e7dba99b-b0ef-4a90-8a5b-3ee771de981f req-72809db9-7c88-47cb-9427-e8e9a73af348 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3107acb-97a2-4915-80be-2b58c3a823f7", "name": "network-vif-deleted", "tag": "f5fda4a4-81cb-4d70-ad98-f92916cdfaa6"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:33:43.017036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e7dba99b-b0ef-4a90-8a5b-3ee771de981f req-72809db9-7c88-47cb-9427-e8e9a73af348 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:43.017575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e7dba99b-b0ef-4a90-8a5b-3ee771de981f req-72809db9-7c88-47cb-9427-e8e9a73af348 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:43.018881 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e7dba99b-b0ef-4a90-8a5b-3ee771de981f req-72809db9-7c88-47cb-9427-e8e9a73af348 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:43.033253 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-e7dba99b-b0ef-4a90-8a5b-3ee771de981f req-72809db9-7c88-47cb-9427-e8e9a73af348 service nova] Creating event network-vif-deleted:f5fda4a4-81cb-4d70-ad98-f92916cdfaa6 for instance d3107acb-97a2-4915-80be-2b58c3a823f7 on nch1-master-1 Sep 17 21:33:43.039230 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-e7dba99b-b0ef-4a90-8a5b-3ee771de981f req-72809db9-7c88-47cb-9427-e8e9a73af348 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039459 Sep 17 21:33:43.040731 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3147/6205] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:33:43.637398 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-78006931-b1db-4d7b-a2fa-03992a78ad28 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:43.638041 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-78006931-b1db-4d7b-a2fa-03992a78ad28 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] [instance: d3107acb-97a2-4915-80be-2b58c3a823f7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:33:43.645605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-78006931-b1db-4d7b-a2fa-03992a78ad28 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:43.646114 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-78006931-b1db-4d7b-a2fa-03992a78ad28 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:43.646596 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-78006931-b1db-4d7b-a2fa-03992a78ad28 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:43.647261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-78006931-b1db-4d7b-a2fa-03992a78ad28 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:43.647721 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-78006931-b1db-4d7b-a2fa-03992a78ad28 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:43.648158 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-78006931-b1db-4d7b-a2fa-03992a78ad28 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:43.662149 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-78006931-b1db-4d7b-a2fa-03992a78ad28 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] HTTP exception thrown: Instance d3107acb-97a2-4915-80be-2b58c3a823f7 could not be found. Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-78006931-b1db-4d7b-a2fa-03992a78ad28 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Request method failure captured: Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7 HTTP/1.1 Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJj0nd5nMTD_G9Pnpyc_N-XIfluaKZzWmW6_sTg7XvE5UKllf2__LuUf06EeL6cQGEUZoym5VnVbYTTLXhMuMCywbMR2rFegYxgzCg0lmANqmFMKeEDtEn_JSGIVwNdK1Wp7RV2HkGv9xclSQMGK4gw3xjRlPJnCRoidzqS87aSo8QVk Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: f0364086523d46e7833d803ba0ee5437 Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-955816082 Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f0364086523d46e7833d803ba0ee5437"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f0364086523d46e7833d803ba0ee5437"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f0364086523d46e7833d803ba0ee5437"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f0364086523d46e7833d803ba0ee5437", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersAdminNegativeTestJSON-955816082 Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: f0364086523d46e7833d803ba0ee5437 Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-955816082 Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersAdminNegativeTestJSON-955816082-project Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 5e669e81ae1a4a16b5fc70a3a06e2ccd Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersAdminNegativeTestJSON-955816082-project Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance d3107acb-97a2-4915-80be-2b58c3a823f7 could not be found. Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'd3107acb-97a2-4915-80be-2b58c3a823f7'} Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3107acb-97a2-4915-80be-2b58c3a823f7 could not be found. Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3107acb-97a2-4915-80be-2b58c3a823f7 could not be found. Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:33:43.663797 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:33:43.668422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:33:43.668422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:33:43.668422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:33:43.668422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:33:43.668422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:33:43.668422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:33:43.668422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3107acb-97a2-4915-80be-2b58c3a823f7 could not be found. Sep 17 21:33:43.668422 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:33:43.668422 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-78006931-b1db-4d7b-a2fa-03992a78ad28 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] Returning 404 to user: Instance d3107acb-97a2-4915-80be-2b58c3a823f7 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:33:43.668422 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-78006931-b1db-4d7b-a2fa-03992a78ad28 tempest-ServersAdminNegativeTestJSON-955816082 tempest-ServersAdminNegativeTestJSON-955816082-project] 10.222.0.26 "GET /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7" status: 404 len: 111 microversion: 2.1 time: 0.031901 Sep 17 21:33:43.668422 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3059/6206] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:33:43 2022] GET /compute/v2.1/servers/d3107acb-97a2-4915-80be-2b58c3a823f7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:33:49.706355 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e22a98c6-1a05-49ad-a15d-a710b845e9bc tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1580344801", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "e44bf543-e9f1-4ab1-90bc-7ddf25fa0c76"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:33:49.761867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-e22a98c6-1a05-49ad-a15d-a710b845e9bc tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] validate_networks() for [('e44bf543-e9f1-4ab1-90bc-7ddf25fa0c76', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:33:50.488295 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-e22a98c6-1a05-49ad-a15d-a710b845e9bc tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:33:50.488943 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-e22a98c6-1a05-49ad-a15d-a710b845e9bc tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:33:50.489695 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-e22a98c6-1a05-49ad-a15d-a710b845e9bc tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:33:50.490120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-e22a98c6-1a05-49ad-a15d-a710b845e9bc tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:33:50.490563 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-e22a98c6-1a05-49ad-a15d-a710b845e9bc tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:33:50.500168 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e22a98c6-1a05-49ad-a15d-a710b845e9bc tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:50.500684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e22a98c6-1a05-49ad-a15d-a710b845e9bc tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:50.501134 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e22a98c6-1a05-49ad-a15d-a710b845e9bc tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:50.501912 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e22a98c6-1a05-49ad-a15d-a710b845e9bc tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:50.502387 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e22a98c6-1a05-49ad-a15d-a710b845e9bc tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:50.502827 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e22a98c6-1a05-49ad-a15d-a710b845e9bc tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:50.520741 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-e22a98c6-1a05-49ad-a15d-a710b845e9bc tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Getting quotas for project dd3d716a01034337b002a97e8c430162. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:33:50.526881 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-e22a98c6-1a05-49ad-a15d-a710b845e9bc tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Getting quotas for user 22aaf576a5134ec4a09550ccf2c98235 and project dd3d716a01034337b002a97e8c430162. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:33:50.540232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e22a98c6-1a05-49ad-a15d-a710b845e9bc tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:33:50.542738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e22a98c6-1a05-49ad-a15d-a710b845e9bc tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:33:50.592684 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e22a98c6-1a05-49ad-a15d-a710b845e9bc tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.016748 Sep 17 21:33:50.593356 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3148/6207] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:33:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:33:50.605311 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cb239a6f-5097-4f16-99f4-60b0f1a0f6b4 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:50.605911 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cb239a6f-5097-4f16-99f4-60b0f1a0f6b4 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:33:50.611785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:33:50.629100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:33:50.661997 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cb239a6f-5097-4f16-99f4-60b0f1a0f6b4 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:33:50.669032 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cb239a6f-5097-4f16-99f4-60b0f1a0f6b4 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1215 microversion: 2.1 time: 0.068077 Sep 17 21:33:50.669841 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3060/6208] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:33:50 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1215 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:33:51.692990 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4cf1b5c2-efaf-44a9-b253-5d1f84867f53 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:51.694791 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4cf1b5c2-efaf-44a9-b253-5d1f84867f53 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:33:51.755698 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4cf1b5c2-efaf-44a9-b253-5d1f84867f53 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:33:51.763290 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4cf1b5c2-efaf-44a9-b253-5d1f84867f53 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1215 microversion: 2.1 time: 0.075208 Sep 17 21:33:51.764003 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3149/6209] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:33:51 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1215 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:33:52.786644 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-435b9e6d-7836-44ca-9412-882f5d1a1ec2 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:52.787262 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-435b9e6d-7836-44ca-9412-882f5d1a1ec2 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:33:52.870086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-435b9e6d-7836-44ca-9412-882f5d1a1ec2 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:33:52.877745 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-435b9e6d-7836-44ca-9412-882f5d1a1ec2 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1215 microversion: 2.1 time: 0.094859 Sep 17 21:33:52.878375 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3061/6210] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:33:52 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1215 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:33:53.903767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8115ef2f-ffb7-4107-85fb-36cdf4ce280b tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:53.904396 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8115ef2f-ffb7-4107-85fb-36cdf4ce280b tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:33:53.998360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8115ef2f-ffb7-4107-85fb-36cdf4ce280b tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:33:54.009258 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8115ef2f-ffb7-4107-85fb-36cdf4ce280b tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1215 microversion: 2.1 time: 0.111413 Sep 17 21:33:54.010295 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3150/6211] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:33:53 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1215 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:33:55.033094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7258b433-58c9-4755-807c-ca0fa90f2d17 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:55.038941 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7258b433-58c9-4755-807c-ca0fa90f2d17 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:33:55.041326 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:33:55.049039 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7258b433-58c9-4755-807c-ca0fa90f2d17 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:55.049677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7258b433-58c9-4755-807c-ca0fa90f2d17 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:55.050206 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7258b433-58c9-4755-807c-ca0fa90f2d17 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:55.051002 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7258b433-58c9-4755-807c-ca0fa90f2d17 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:55.051539 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7258b433-58c9-4755-807c-ca0fa90f2d17 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:55.052179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7258b433-58c9-4755-807c-ca0fa90f2d17 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:55.122582 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7258b433-58c9-4755-807c-ca0fa90f2d17 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:33:55.131200 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7258b433-58c9-4755-807c-ca0fa90f2d17 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1285 microversion: 2.1 time: 0.102430 Sep 17 21:33:55.131727 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3062/6212] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:33:55 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:33:56.156048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5d56f87f-89b0-4b95-b997-496c1d3767a3 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:56.157338 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5d56f87f-89b0-4b95-b997-496c1d3767a3 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:33:56.165652 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d56f87f-89b0-4b95-b997-496c1d3767a3 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:56.166449 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d56f87f-89b0-4b95-b997-496c1d3767a3 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:56.167094 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d56f87f-89b0-4b95-b997-496c1d3767a3 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:56.167984 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d56f87f-89b0-4b95-b997-496c1d3767a3 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:56.168608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d56f87f-89b0-4b95-b997-496c1d3767a3 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:56.169203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5d56f87f-89b0-4b95-b997-496c1d3767a3 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:56.317389 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5d56f87f-89b0-4b95-b997-496c1d3767a3 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:33:56.325285 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5d56f87f-89b0-4b95-b997-496c1d3767a3 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1315 microversion: 2.1 time: 0.173904 Sep 17 21:33:56.325907 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3151/6213] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:33:56 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:33:56.845655 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-c79d8333-0ea3-4ac9-a1ff-19bd95370cab req-8752a34c-275b-4302-9415-f8ca7928b880 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "827c3104-85d9-428f-96bd-69e80f8a3877", "tag": "9b3ade63-7cf9-407f-b193-ce174cef4dcc"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:33:56.859203 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-c79d8333-0ea3-4ac9-a1ff-19bd95370cab req-8752a34c-275b-4302-9415-f8ca7928b880 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:56.859690 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-c79d8333-0ea3-4ac9-a1ff-19bd95370cab req-8752a34c-275b-4302-9415-f8ca7928b880 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:56.860145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-c79d8333-0ea3-4ac9-a1ff-19bd95370cab req-8752a34c-275b-4302-9415-f8ca7928b880 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:56.874728 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-c79d8333-0ea3-4ac9-a1ff-19bd95370cab req-8752a34c-275b-4302-9415-f8ca7928b880 service nova] Creating event network-changed:9b3ade63-7cf9-407f-b193-ce174cef4dcc for instance 827c3104-85d9-428f-96bd-69e80f8a3877 on nch1-master-1 Sep 17 21:33:56.879634 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-c79d8333-0ea3-4ac9-a1ff-19bd95370cab req-8752a34c-275b-4302-9415-f8ca7928b880 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039382 Sep 17 21:33:56.880246 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3063/6214] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:33:57.350548 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b8042239-a688-4855-a55b-11d1ed56c30b tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:57.351557 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b8042239-a688-4855-a55b-11d1ed56c30b tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:33:57.359230 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b8042239-a688-4855-a55b-11d1ed56c30b tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:57.359727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b8042239-a688-4855-a55b-11d1ed56c30b tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:57.360205 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b8042239-a688-4855-a55b-11d1ed56c30b tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:57.360908 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b8042239-a688-4855-a55b-11d1ed56c30b tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:57.361416 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b8042239-a688-4855-a55b-11d1ed56c30b tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:57.361885 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b8042239-a688-4855-a55b-11d1ed56c30b tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:57.495097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b8042239-a688-4855-a55b-11d1ed56c30b tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:33:57.503479 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b8042239-a688-4855-a55b-11d1ed56c30b tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1315 microversion: 2.1 time: 0.156981 Sep 17 21:33:57.504047 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3152/6215] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:33:57 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:33:58.527496 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-39c80644-1d53-4089-a26d-e3bca321b1a0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:58.528273 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-39c80644-1d53-4089-a26d-e3bca321b1a0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:33:58.530494 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:33:58.536301 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-39c80644-1d53-4089-a26d-e3bca321b1a0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:58.536802 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-39c80644-1d53-4089-a26d-e3bca321b1a0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:58.537243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-39c80644-1d53-4089-a26d-e3bca321b1a0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:58.537986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-39c80644-1d53-4089-a26d-e3bca321b1a0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:58.538444 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-39c80644-1d53-4089-a26d-e3bca321b1a0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:58.538881 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-39c80644-1d53-4089-a26d-e3bca321b1a0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:58.682934 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-39c80644-1d53-4089-a26d-e3bca321b1a0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:33:58.692247 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-39c80644-1d53-4089-a26d-e3bca321b1a0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1315 microversion: 2.1 time: 0.169922 Sep 17 21:33:58.692936 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3064/6216] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:33:58 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:33:59.717549 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-dd0a1e56-2b72-48db-902d-60048dbc0378 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:33:59.718075 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-dd0a1e56-2b72-48db-902d-60048dbc0378 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:33:59.721010 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:33:59.728187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd0a1e56-2b72-48db-902d-60048dbc0378 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:59.728886 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd0a1e56-2b72-48db-902d-60048dbc0378 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:59.729395 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd0a1e56-2b72-48db-902d-60048dbc0378 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:59.730178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd0a1e56-2b72-48db-902d-60048dbc0378 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:33:59.730656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd0a1e56-2b72-48db-902d-60048dbc0378 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:33:59.731102 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd0a1e56-2b72-48db-902d-60048dbc0378 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:33:59.734678 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=68 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:33:59.876027 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-dd0a1e56-2b72-48db-902d-60048dbc0378 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:33:59.885491 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-dd0a1e56-2b72-48db-902d-60048dbc0378 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1315 microversion: 2.1 time: 0.172104 Sep 17 21:33:59.886177 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3153/6217] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:33:59 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:00.912676 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5c1495d3-d921-429d-ab91-a8d3757f13f6 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:00.913679 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5c1495d3-d921-429d-ab91-a8d3757f13f6 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:00.926086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c1495d3-d921-429d-ab91-a8d3757f13f6 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:00.926913 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c1495d3-d921-429d-ab91-a8d3757f13f6 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:00.927692 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c1495d3-d921-429d-ab91-a8d3757f13f6 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:00.928936 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c1495d3-d921-429d-ab91-a8d3757f13f6 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:00.929776 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c1495d3-d921-429d-ab91-a8d3757f13f6 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:00.930511 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5c1495d3-d921-429d-ab91-a8d3757f13f6 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:01.067105 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5c1495d3-d921-429d-ab91-a8d3757f13f6 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:01.076030 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5c1495d3-d921-429d-ab91-a8d3757f13f6 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1315 microversion: 2.1 time: 0.169860 Sep 17 21:34:01.076668 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3065/6218] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:00 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:01.967284 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-cc60d416-05ff-4e35-888e-4df9ef0c7104 req-fff5de64-2793-4080-9469-7bc7e09854ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "827c3104-85d9-428f-96bd-69e80f8a3877", "name": "network-vif-plugged", "status": "completed", "tag": "9b3ade63-7cf9-407f-b193-ce174cef4dcc"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:34:01.972841 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=5 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:34:01.981680 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-cc60d416-05ff-4e35-888e-4df9ef0c7104 req-fff5de64-2793-4080-9469-7bc7e09854ef service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:01.982190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-cc60d416-05ff-4e35-888e-4df9ef0c7104 req-fff5de64-2793-4080-9469-7bc7e09854ef service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:01.983043 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-cc60d416-05ff-4e35-888e-4df9ef0c7104 req-fff5de64-2793-4080-9469-7bc7e09854ef service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:01.994863 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-cc60d416-05ff-4e35-888e-4df9ef0c7104 req-fff5de64-2793-4080-9469-7bc7e09854ef service nova] Creating event network-vif-plugged:9b3ade63-7cf9-407f-b193-ce174cef4dcc for instance 827c3104-85d9-428f-96bd-69e80f8a3877 on nch1-master-1 Sep 17 21:34:02.000073 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-cc60d416-05ff-4e35-888e-4df9ef0c7104 req-fff5de64-2793-4080-9469-7bc7e09854ef service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036761 Sep 17 21:34:02.001042 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3154/6219] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:34:02.099534 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-236bc6b4-c73a-4fa0-acdb-d351d0cc0dba tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:02.100127 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-236bc6b4-c73a-4fa0-acdb-d351d0cc0dba tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:02.108698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-236bc6b4-c73a-4fa0-acdb-d351d0cc0dba tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:02.109211 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-236bc6b4-c73a-4fa0-acdb-d351d0cc0dba tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:02.109832 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-236bc6b4-c73a-4fa0-acdb-d351d0cc0dba tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:02.110403 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-236bc6b4-c73a-4fa0-acdb-d351d0cc0dba tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:02.110889 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-236bc6b4-c73a-4fa0-acdb-d351d0cc0dba tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:02.111331 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-236bc6b4-c73a-4fa0-acdb-d351d0cc0dba tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:02.247186 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-236bc6b4-c73a-4fa0-acdb-d351d0cc0dba tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:02.258537 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-236bc6b4-c73a-4fa0-acdb-d351d0cc0dba tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1315 microversion: 2.1 time: 0.163053 Sep 17 21:34:02.259179 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3066/6220] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:02 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:03.284320 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f7410a12-694f-478d-871b-4cbf1c3a7512 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:03.285048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f7410a12-694f-478d-871b-4cbf1c3a7512 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:03.293069 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7410a12-694f-478d-871b-4cbf1c3a7512 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:03.293617 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7410a12-694f-478d-871b-4cbf1c3a7512 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:03.294079 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7410a12-694f-478d-871b-4cbf1c3a7512 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:03.294795 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7410a12-694f-478d-871b-4cbf1c3a7512 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:03.295268 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7410a12-694f-478d-871b-4cbf1c3a7512 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:03.295716 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f7410a12-694f-478d-871b-4cbf1c3a7512 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:03.430554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f7410a12-694f-478d-871b-4cbf1c3a7512 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:03.440403 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f7410a12-694f-478d-871b-4cbf1c3a7512 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1501 microversion: 2.1 time: 0.160584 Sep 17 21:34:03.440955 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3155/6221] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:03 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1501 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:03.463214 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6bdf40e0-d3d1-4399-a94e-f092fec511c1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:34:03.465519 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6bdf40e0-d3d1-4399-a94e-f092fec511c1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:03.467557 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=4 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:34:03.473781 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6bdf40e0-d3d1-4399-a94e-f092fec511c1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:03.474273 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6bdf40e0-d3d1-4399-a94e-f092fec511c1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:03.474714 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6bdf40e0-d3d1-4399-a94e-f092fec511c1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:03.475413 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6bdf40e0-d3d1-4399-a94e-f092fec511c1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:03.476266 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6bdf40e0-d3d1-4399-a94e-f092fec511c1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:03.476697 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6bdf40e0-d3d1-4399-a94e-f092fec511c1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:03.506074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6bdf40e0-d3d1-4399-a94e-f092fec511c1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:03.511649 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6bdf40e0-d3d1-4399-a94e-f092fec511c1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Old instance type m1.heat2, new instance type m1.heat {{(pid=140523) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 17 21:34:03.518412 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-6bdf40e0-d3d1-4399-a94e-f092fec511c1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:34:03.518836 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-6bdf40e0-d3d1-4399-a94e-f092fec511c1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:34:03.519318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-6bdf40e0-d3d1-4399-a94e-f092fec511c1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:34:03.519731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-6bdf40e0-d3d1-4399-a94e-f092fec511c1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:34:03.520143 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-6bdf40e0-d3d1-4399-a94e-f092fec511c1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:34:03.587883 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6bdf40e0-d3d1-4399-a94e-f092fec511c1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "POST /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877/action" status: 202 len: 0 microversion: 2.1 time: 0.128711 Sep 17 21:34:03.588760 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3067/6222] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:34:03 2022] POST /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:34:03.598221 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-31e7acba-a58c-4f0d-ba21-32518f3429d9 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:03.599087 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-31e7acba-a58c-4f0d-ba21-32518f3429d9 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:03.606208 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31e7acba-a58c-4f0d-ba21-32518f3429d9 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:03.606793 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31e7acba-a58c-4f0d-ba21-32518f3429d9 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:03.607257 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31e7acba-a58c-4f0d-ba21-32518f3429d9 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:03.608117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31e7acba-a58c-4f0d-ba21-32518f3429d9 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:03.608596 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31e7acba-a58c-4f0d-ba21-32518f3429d9 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:03.609052 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31e7acba-a58c-4f0d-ba21-32518f3429d9 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:03.782815 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-31e7acba-a58c-4f0d-ba21-32518f3429d9 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:03.790871 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-31e7acba-a58c-4f0d-ba21-32518f3429d9 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1510 microversion: 2.1 time: 0.197299 Sep 17 21:34:03.791475 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3156/6223] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:03 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1510 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:04.815131 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3fc84435-dbd4-4f81-8f5f-14a7f95d0ccf tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:04.815823 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3fc84435-dbd4-4f81-8f5f-14a7f95d0ccf tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:04.823121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3fc84435-dbd4-4f81-8f5f-14a7f95d0ccf tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:04.823646 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3fc84435-dbd4-4f81-8f5f-14a7f95d0ccf tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:04.824074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3fc84435-dbd4-4f81-8f5f-14a7f95d0ccf tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:04.824787 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3fc84435-dbd4-4f81-8f5f-14a7f95d0ccf tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:04.825250 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3fc84435-dbd4-4f81-8f5f-14a7f95d0ccf tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:04.825791 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3fc84435-dbd4-4f81-8f5f-14a7f95d0ccf tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:04.961303 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3fc84435-dbd4-4f81-8f5f-14a7f95d0ccf tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:04.969998 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3fc84435-dbd4-4f81-8f5f-14a7f95d0ccf tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1510 microversion: 2.1 time: 0.160005 Sep 17 21:34:04.970728 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3068/6224] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:04 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:05.994864 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7276d506-3314-4374-be9a-f501500a369e tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:05.995454 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7276d506-3314-4374-be9a-f501500a369e tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:05.997806 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=12 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:34:06.005570 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7276d506-3314-4374-be9a-f501500a369e tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:06.006205 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7276d506-3314-4374-be9a-f501500a369e tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:06.006670 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7276d506-3314-4374-be9a-f501500a369e tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:06.007402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7276d506-3314-4374-be9a-f501500a369e tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:06.007875 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7276d506-3314-4374-be9a-f501500a369e tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:06.008318 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7276d506-3314-4374-be9a-f501500a369e tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:06.153559 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7276d506-3314-4374-be9a-f501500a369e tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:06.161932 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7276d506-3314-4374-be9a-f501500a369e tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1510 microversion: 2.1 time: 0.171136 Sep 17 21:34:06.162527 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3157/6225] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:05 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:07.189884 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8c3b7da3-7957-41fd-85fc-32999fcd3e49 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:07.190736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8c3b7da3-7957-41fd-85fc-32999fcd3e49 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:07.200254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c3b7da3-7957-41fd-85fc-32999fcd3e49 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:07.200898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c3b7da3-7957-41fd-85fc-32999fcd3e49 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:07.201507 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c3b7da3-7957-41fd-85fc-32999fcd3e49 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:07.202444 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c3b7da3-7957-41fd-85fc-32999fcd3e49 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:07.203051 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c3b7da3-7957-41fd-85fc-32999fcd3e49 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:07.203698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8c3b7da3-7957-41fd-85fc-32999fcd3e49 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:07.345813 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8c3b7da3-7957-41fd-85fc-32999fcd3e49 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:07.358509 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8c3b7da3-7957-41fd-85fc-32999fcd3e49 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1515 microversion: 2.1 time: 0.175208 Sep 17 21:34:07.359464 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3069/6226] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:07 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1515 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:08.387368 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-20b993e8-d678-4705-ab4e-3c78c76683e5 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:08.388384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-20b993e8-d678-4705-ab4e-3c78c76683e5 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:08.400153 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-20b993e8-d678-4705-ab4e-3c78c76683e5 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:08.400993 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-20b993e8-d678-4705-ab4e-3c78c76683e5 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:08.401815 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-20b993e8-d678-4705-ab4e-3c78c76683e5 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:08.402996 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-20b993e8-d678-4705-ab4e-3c78c76683e5 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:08.403841 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-20b993e8-d678-4705-ab4e-3c78c76683e5 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:08.404689 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-20b993e8-d678-4705-ab4e-3c78c76683e5 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:08.554376 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-20b993e8-d678-4705-ab4e-3c78c76683e5 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:08.562411 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-20b993e8-d678-4705-ab4e-3c78c76683e5 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1515 microversion: 2.1 time: 0.181813 Sep 17 21:34:08.562978 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3158/6227] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:08 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1515 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:09.586484 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-79b207c6-5462-4a70-871a-34e6e63e7749 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:09.587102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-79b207c6-5462-4a70-871a-34e6e63e7749 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:09.594514 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79b207c6-5462-4a70-871a-34e6e63e7749 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:09.595027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79b207c6-5462-4a70-871a-34e6e63e7749 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:09.595461 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79b207c6-5462-4a70-871a-34e6e63e7749 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:09.596195 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79b207c6-5462-4a70-871a-34e6e63e7749 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:09.596632 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79b207c6-5462-4a70-871a-34e6e63e7749 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:09.597083 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-79b207c6-5462-4a70-871a-34e6e63e7749 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:09.738758 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-79b207c6-5462-4a70-871a-34e6e63e7749 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:09.750700 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-79b207c6-5462-4a70-871a-34e6e63e7749 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1515 microversion: 2.1 time: 0.167933 Sep 17 21:34:09.751530 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3070/6228] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:09 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:10.778324 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ab1ab4c0-6c8f-46e1-a269-7598bcf41e68 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:10.779402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ab1ab4c0-6c8f-46e1-a269-7598bcf41e68 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:10.788148 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ab1ab4c0-6c8f-46e1-a269-7598bcf41e68 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:10.788657 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ab1ab4c0-6c8f-46e1-a269-7598bcf41e68 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:10.789117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ab1ab4c0-6c8f-46e1-a269-7598bcf41e68 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:10.789894 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ab1ab4c0-6c8f-46e1-a269-7598bcf41e68 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:10.790346 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ab1ab4c0-6c8f-46e1-a269-7598bcf41e68 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:10.790809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ab1ab4c0-6c8f-46e1-a269-7598bcf41e68 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:10.924094 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ab1ab4c0-6c8f-46e1-a269-7598bcf41e68 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:10.932594 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ab1ab4c0-6c8f-46e1-a269-7598bcf41e68 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1515 microversion: 2.1 time: 0.161087 Sep 17 21:34:10.933179 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3159/6229] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:10 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:11.967328 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-095d73c3-e9d6-4de1-afc4-a155be3644c1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:11.968832 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-095d73c3-e9d6-4de1-afc4-a155be3644c1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:11.978786 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-095d73c3-e9d6-4de1-afc4-a155be3644c1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:11.979489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-095d73c3-e9d6-4de1-afc4-a155be3644c1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:11.980121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-095d73c3-e9d6-4de1-afc4-a155be3644c1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:11.981120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-095d73c3-e9d6-4de1-afc4-a155be3644c1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:11.981864 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-095d73c3-e9d6-4de1-afc4-a155be3644c1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:11.982489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-095d73c3-e9d6-4de1-afc4-a155be3644c1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:12.127615 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-095d73c3-e9d6-4de1-afc4-a155be3644c1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:12.136282 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-095d73c3-e9d6-4de1-afc4-a155be3644c1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1515 microversion: 2.1 time: 0.174655 Sep 17 21:34:12.136860 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3071/6230] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:11 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:13.163686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7745afa5-406d-46d7-bee3-687ce77037f0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:13.164740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7745afa5-406d-46d7-bee3-687ce77037f0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:13.174962 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7745afa5-406d-46d7-bee3-687ce77037f0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:13.175471 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7745afa5-406d-46d7-bee3-687ce77037f0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:13.175932 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7745afa5-406d-46d7-bee3-687ce77037f0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:13.176650 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7745afa5-406d-46d7-bee3-687ce77037f0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:13.177124 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7745afa5-406d-46d7-bee3-687ce77037f0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:13.177610 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7745afa5-406d-46d7-bee3-687ce77037f0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:13.317668 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7745afa5-406d-46d7-bee3-687ce77037f0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:13.325730 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7745afa5-406d-46d7-bee3-687ce77037f0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1515 microversion: 2.1 time: 0.169023 Sep 17 21:34:13.326331 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3160/6231] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:13 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:14.350414 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-42a1ac4f-2cb3-4325-83bf-00fc0d9a6a1f tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:14.351377 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-42a1ac4f-2cb3-4325-83bf-00fc0d9a6a1f tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:14.359543 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-42a1ac4f-2cb3-4325-83bf-00fc0d9a6a1f tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:14.360036 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-42a1ac4f-2cb3-4325-83bf-00fc0d9a6a1f tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:14.362811 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-42a1ac4f-2cb3-4325-83bf-00fc0d9a6a1f tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:14.363571 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-42a1ac4f-2cb3-4325-83bf-00fc0d9a6a1f tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:14.364029 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-42a1ac4f-2cb3-4325-83bf-00fc0d9a6a1f tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:14.364460 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-42a1ac4f-2cb3-4325-83bf-00fc0d9a6a1f tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:14.506346 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-42a1ac4f-2cb3-4325-83bf-00fc0d9a6a1f tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:14.516601 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-42a1ac4f-2cb3-4325-83bf-00fc0d9a6a1f tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1515 microversion: 2.1 time: 0.169840 Sep 17 21:34:14.517201 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3072/6232] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:14 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:15.544151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c3b1dba6-a6d4-461a-bfc9-6329bb50acb1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:15.545232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c3b1dba6-a6d4-461a-bfc9-6329bb50acb1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:15.554676 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3b1dba6-a6d4-461a-bfc9-6329bb50acb1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:15.555175 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3b1dba6-a6d4-461a-bfc9-6329bb50acb1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:15.555631 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3b1dba6-a6d4-461a-bfc9-6329bb50acb1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:15.556352 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3b1dba6-a6d4-461a-bfc9-6329bb50acb1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:15.556827 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3b1dba6-a6d4-461a-bfc9-6329bb50acb1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:15.557266 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c3b1dba6-a6d4-461a-bfc9-6329bb50acb1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:15.691722 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c3b1dba6-a6d4-461a-bfc9-6329bb50acb1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:15.701132 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c3b1dba6-a6d4-461a-bfc9-6329bb50acb1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1515 microversion: 2.1 time: 0.163590 Sep 17 21:34:15.701740 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3161/6233] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:15 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:16.725453 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-20f41122-b7fd-465a-a164-9602e976e3ca tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:16.726478 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-20f41122-b7fd-465a-a164-9602e976e3ca tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:16.733972 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20f41122-b7fd-465a-a164-9602e976e3ca tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:16.734469 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20f41122-b7fd-465a-a164-9602e976e3ca tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:16.734903 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20f41122-b7fd-465a-a164-9602e976e3ca tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:16.735613 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20f41122-b7fd-465a-a164-9602e976e3ca tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:16.736067 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20f41122-b7fd-465a-a164-9602e976e3ca tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:16.736492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-20f41122-b7fd-465a-a164-9602e976e3ca tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:16.875454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-20f41122-b7fd-465a-a164-9602e976e3ca tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:16.883761 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-20f41122-b7fd-465a-a164-9602e976e3ca tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1515 microversion: 2.1 time: 0.162445 Sep 17 21:34:16.884338 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3073/6234] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:16 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:17.920190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d817f9c8-282c-4216-bcfc-4a6264bdc5ea tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:17.921274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d817f9c8-282c-4216-bcfc-4a6264bdc5ea tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:17.930398 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d817f9c8-282c-4216-bcfc-4a6264bdc5ea tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:17.930903 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d817f9c8-282c-4216-bcfc-4a6264bdc5ea tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:17.931362 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d817f9c8-282c-4216-bcfc-4a6264bdc5ea tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:17.932121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d817f9c8-282c-4216-bcfc-4a6264bdc5ea tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:17.932604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d817f9c8-282c-4216-bcfc-4a6264bdc5ea tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:17.933044 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d817f9c8-282c-4216-bcfc-4a6264bdc5ea tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:18.067815 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d817f9c8-282c-4216-bcfc-4a6264bdc5ea tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:18.076141 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d817f9c8-282c-4216-bcfc-4a6264bdc5ea tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1515 microversion: 2.1 time: 0.162784 Sep 17 21:34:18.076731 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3162/6235] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:17 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:19.104175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-19f6da0f-5f01-4d25-bd9a-b735072a614a tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:19.105046 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-19f6da0f-5f01-4d25-bd9a-b735072a614a tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:19.115336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-19f6da0f-5f01-4d25-bd9a-b735072a614a tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:19.115828 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-19f6da0f-5f01-4d25-bd9a-b735072a614a tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:19.116273 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-19f6da0f-5f01-4d25-bd9a-b735072a614a tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:19.116973 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-19f6da0f-5f01-4d25-bd9a-b735072a614a tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:19.117432 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-19f6da0f-5f01-4d25-bd9a-b735072a614a tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:19.117898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-19f6da0f-5f01-4d25-bd9a-b735072a614a tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:19.259485 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-19f6da0f-5f01-4d25-bd9a-b735072a614a tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:19.271532 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-19f6da0f-5f01-4d25-bd9a-b735072a614a tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1515 microversion: 2.1 time: 0.174636 Sep 17 21:34:19.272110 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3074/6236] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:19 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:20.299272 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-eba29623-9807-4cee-9409-5d6b34b8b3b0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:20.300148 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-eba29623-9807-4cee-9409-5d6b34b8b3b0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:20.312264 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eba29623-9807-4cee-9409-5d6b34b8b3b0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:20.313106 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eba29623-9807-4cee-9409-5d6b34b8b3b0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:20.313961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eba29623-9807-4cee-9409-5d6b34b8b3b0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:20.315159 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eba29623-9807-4cee-9409-5d6b34b8b3b0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:20.315993 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eba29623-9807-4cee-9409-5d6b34b8b3b0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:20.316463 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eba29623-9807-4cee-9409-5d6b34b8b3b0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:20.474524 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-eba29623-9807-4cee-9409-5d6b34b8b3b0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:20.482888 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-eba29623-9807-4cee-9409-5d6b34b8b3b0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1515 microversion: 2.1 time: 0.190512 Sep 17 21:34:20.483457 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3163/6237] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:20 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1515 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:21.510604 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1abe24df-e361-4b7b-8c8b-22787dd51ce5 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:21.511541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1abe24df-e361-4b7b-8c8b-22787dd51ce5 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:21.522072 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1abe24df-e361-4b7b-8c8b-22787dd51ce5 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:21.522555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1abe24df-e361-4b7b-8c8b-22787dd51ce5 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:21.522990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1abe24df-e361-4b7b-8c8b-22787dd51ce5 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:21.523684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1abe24df-e361-4b7b-8c8b-22787dd51ce5 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:21.524138 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1abe24df-e361-4b7b-8c8b-22787dd51ce5 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:21.524562 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1abe24df-e361-4b7b-8c8b-22787dd51ce5 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:21.659400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1abe24df-e361-4b7b-8c8b-22787dd51ce5 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:21.667590 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1abe24df-e361-4b7b-8c8b-22787dd51ce5 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1515 microversion: 2.1 time: 0.163578 Sep 17 21:34:21.668205 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3075/6238] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:21 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:22.691311 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a3fc1eb2-a6e4-4670-8066-86027937cae0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:22.691917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a3fc1eb2-a6e4-4670-8066-86027937cae0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:22.699657 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a3fc1eb2-a6e4-4670-8066-86027937cae0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:22.700167 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a3fc1eb2-a6e4-4670-8066-86027937cae0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:22.700656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a3fc1eb2-a6e4-4670-8066-86027937cae0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:22.701385 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a3fc1eb2-a6e4-4670-8066-86027937cae0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:22.701900 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a3fc1eb2-a6e4-4670-8066-86027937cae0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:22.702351 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a3fc1eb2-a6e4-4670-8066-86027937cae0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:22.844246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a3fc1eb2-a6e4-4670-8066-86027937cae0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:22.852994 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a3fc1eb2-a6e4-4670-8066-86027937cae0 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1515 microversion: 2.1 time: 0.165865 Sep 17 21:34:22.853593 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3164/6239] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:22 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:23.878993 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b625787a-d0bc-4dcd-96dc-359865aed460 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:23.879860 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b625787a-d0bc-4dcd-96dc-359865aed460 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:23.890103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b625787a-d0bc-4dcd-96dc-359865aed460 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:23.890806 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b625787a-d0bc-4dcd-96dc-359865aed460 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:23.891430 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b625787a-d0bc-4dcd-96dc-359865aed460 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:23.892422 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b625787a-d0bc-4dcd-96dc-359865aed460 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:23.893069 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b625787a-d0bc-4dcd-96dc-359865aed460 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:23.893731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b625787a-d0bc-4dcd-96dc-359865aed460 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:24.037903 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b625787a-d0bc-4dcd-96dc-359865aed460 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:24.049768 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b625787a-d0bc-4dcd-96dc-359865aed460 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1515 microversion: 2.1 time: 0.176103 Sep 17 21:34:24.050512 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3076/6240] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:23 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:25.080590 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-694a0b4a-3c0c-403d-834b-86837058856c tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:25.081498 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-694a0b4a-3c0c-403d-834b-86837058856c tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:25.091605 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-694a0b4a-3c0c-403d-834b-86837058856c tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:25.092319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-694a0b4a-3c0c-403d-834b-86837058856c tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:25.092963 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-694a0b4a-3c0c-403d-834b-86837058856c tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:25.094045 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-694a0b4a-3c0c-403d-834b-86837058856c tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:25.094714 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-694a0b4a-3c0c-403d-834b-86837058856c tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:25.095374 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-694a0b4a-3c0c-403d-834b-86837058856c tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:25.234353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-694a0b4a-3c0c-403d-834b-86837058856c tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:25.242746 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-694a0b4a-3c0c-403d-834b-86837058856c tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1515 microversion: 2.1 time: 0.167858 Sep 17 21:34:25.243333 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3165/6241] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:25 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:26.270769 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7bf89043-bc94-47f8-970f-0987757513dd tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:26.271613 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7bf89043-bc94-47f8-970f-0987757513dd tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:26.283579 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7bf89043-bc94-47f8-970f-0987757513dd tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:26.284393 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7bf89043-bc94-47f8-970f-0987757513dd tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:26.285008 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7bf89043-bc94-47f8-970f-0987757513dd tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:26.285750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7bf89043-bc94-47f8-970f-0987757513dd tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:26.286207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7bf89043-bc94-47f8-970f-0987757513dd tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:26.286598 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7bf89043-bc94-47f8-970f-0987757513dd tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:26.289180 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:34:26.428296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7bf89043-bc94-47f8-970f-0987757513dd tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:26.436451 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7bf89043-bc94-47f8-970f-0987757513dd tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1515 microversion: 2.1 time: 0.172589 Sep 17 21:34:26.437051 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3077/6242] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:26 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:27.463630 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bd34e3cf-588c-4f1e-96ed-1dbc25ed9b9a tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:27.464675 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bd34e3cf-588c-4f1e-96ed-1dbc25ed9b9a tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:27.476170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd34e3cf-588c-4f1e-96ed-1dbc25ed9b9a tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:27.476994 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd34e3cf-588c-4f1e-96ed-1dbc25ed9b9a tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:27.477816 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd34e3cf-588c-4f1e-96ed-1dbc25ed9b9a tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:27.478991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd34e3cf-588c-4f1e-96ed-1dbc25ed9b9a tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:27.479768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd34e3cf-588c-4f1e-96ed-1dbc25ed9b9a tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:27.480605 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bd34e3cf-588c-4f1e-96ed-1dbc25ed9b9a tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:27.623123 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bd34e3cf-588c-4f1e-96ed-1dbc25ed9b9a tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:27.631285 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bd34e3cf-588c-4f1e-96ed-1dbc25ed9b9a tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1515 microversion: 2.1 time: 0.174550 Sep 17 21:34:27.631873 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3166/6243] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:27 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:28.654882 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-80620507-148d-414e-a8bd-2fc14f467f3e tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:28.655505 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-80620507-148d-414e-a8bd-2fc14f467f3e tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:28.658314 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=32 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:34:28.664005 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-80620507-148d-414e-a8bd-2fc14f467f3e tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:28.664498 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-80620507-148d-414e-a8bd-2fc14f467f3e tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:28.664940 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-80620507-148d-414e-a8bd-2fc14f467f3e tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:28.665682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-80620507-148d-414e-a8bd-2fc14f467f3e tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:28.666176 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-80620507-148d-414e-a8bd-2fc14f467f3e tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:28.666580 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-80620507-148d-414e-a8bd-2fc14f467f3e tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:28.814230 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-80620507-148d-414e-a8bd-2fc14f467f3e tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:28.822596 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-80620507-148d-414e-a8bd-2fc14f467f3e tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1515 microversion: 2.1 time: 0.171661 Sep 17 21:34:28.823202 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3078/6244] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:28 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:29.849664 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d99d402f-0502-469a-a6b6-6ea6dbc74223 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:29.850908 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d99d402f-0502-469a-a6b6-6ea6dbc74223 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:29.855497 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=28 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:34:29.863850 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d99d402f-0502-469a-a6b6-6ea6dbc74223 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:29.864389 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d99d402f-0502-469a-a6b6-6ea6dbc74223 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:29.864925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d99d402f-0502-469a-a6b6-6ea6dbc74223 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:29.865729 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d99d402f-0502-469a-a6b6-6ea6dbc74223 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:29.866201 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d99d402f-0502-469a-a6b6-6ea6dbc74223 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:29.866645 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d99d402f-0502-469a-a6b6-6ea6dbc74223 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:29.869304 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=80 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:34:30.009089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d99d402f-0502-469a-a6b6-6ea6dbc74223 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:30.022161 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d99d402f-0502-469a-a6b6-6ea6dbc74223 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1515 microversion: 2.1 time: 0.178784 Sep 17 21:34:30.023043 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3167/6245] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:29 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1515 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:31.050119 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b716f263-66ea-4e21-9a48-b269e214f174 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:31.051065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b716f263-66ea-4e21-9a48-b269e214f174 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:31.062998 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b716f263-66ea-4e21-9a48-b269e214f174 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:31.063814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b716f263-66ea-4e21-9a48-b269e214f174 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:31.064568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b716f263-66ea-4e21-9a48-b269e214f174 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:31.066191 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b716f263-66ea-4e21-9a48-b269e214f174 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:31.066658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b716f263-66ea-4e21-9a48-b269e214f174 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:31.067090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b716f263-66ea-4e21-9a48-b269e214f174 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:31.205503 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b716f263-66ea-4e21-9a48-b269e214f174 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:31.214152 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b716f263-66ea-4e21-9a48-b269e214f174 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1515 microversion: 2.1 time: 0.170821 Sep 17 21:34:31.214734 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3079/6246] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:31 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:32.242327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c2966c58-e261-4774-a09c-ac017b935541 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:32.243237 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c2966c58-e261-4774-a09c-ac017b935541 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:32.254561 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c2966c58-e261-4774-a09c-ac017b935541 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:32.255074 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c2966c58-e261-4774-a09c-ac017b935541 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:32.255534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c2966c58-e261-4774-a09c-ac017b935541 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:32.256247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c2966c58-e261-4774-a09c-ac017b935541 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:32.256720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c2966c58-e261-4774-a09c-ac017b935541 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:32.257165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c2966c58-e261-4774-a09c-ac017b935541 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:32.401253 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c2966c58-e261-4774-a09c-ac017b935541 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:32.409747 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c2966c58-e261-4774-a09c-ac017b935541 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1515 microversion: 2.1 time: 0.174118 Sep 17 21:34:32.410336 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3168/6247] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:32 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:33.442744 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f0cdefc7-9827-4d05-a8d9-7240224be1b3 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:33.443356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f0cdefc7-9827-4d05-a8d9-7240224be1b3 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:33.450771 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0cdefc7-9827-4d05-a8d9-7240224be1b3 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:33.451281 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0cdefc7-9827-4d05-a8d9-7240224be1b3 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:33.451718 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0cdefc7-9827-4d05-a8d9-7240224be1b3 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:33.452419 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0cdefc7-9827-4d05-a8d9-7240224be1b3 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:33.452876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0cdefc7-9827-4d05-a8d9-7240224be1b3 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:33.453303 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f0cdefc7-9827-4d05-a8d9-7240224be1b3 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:33.587039 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f0cdefc7-9827-4d05-a8d9-7240224be1b3 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:33.595333 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f0cdefc7-9827-4d05-a8d9-7240224be1b3 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1514 microversion: 2.1 time: 0.156614 Sep 17 21:34:33.595924 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3080/6248] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:33 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:33.606926 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-3d343e9f-0cf9-4af3-81c0-8847965b233b req-d6cac03b-0777-4fbb-9cd2-f491a9d0e6e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "827c3104-85d9-428f-96bd-69e80f8a3877", "name": "network-vif-unplugged", "status": "completed", "tag": "9b3ade63-7cf9-407f-b193-ce174cef4dcc"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:34:33.618011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-3d343e9f-0cf9-4af3-81c0-8847965b233b req-d6cac03b-0777-4fbb-9cd2-f491a9d0e6e2 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:33.618566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-3d343e9f-0cf9-4af3-81c0-8847965b233b req-d6cac03b-0777-4fbb-9cd2-f491a9d0e6e2 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:33.619011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-3d343e9f-0cf9-4af3-81c0-8847965b233b req-d6cac03b-0777-4fbb-9cd2-f491a9d0e6e2 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:33.631116 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-3d343e9f-0cf9-4af3-81c0-8847965b233b req-d6cac03b-0777-4fbb-9cd2-f491a9d0e6e2 service nova] Creating event network-vif-unplugged:9b3ade63-7cf9-407f-b193-ce174cef4dcc for instance 827c3104-85d9-428f-96bd-69e80f8a3877 on nch2-master-1 Sep 17 21:34:33.636416 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [req-3d343e9f-0cf9-4af3-81c0-8847965b233b req-d6cac03b-0777-4fbb-9cd2-f491a9d0e6e2 service nova] Instance 827c3104-85d9-428f-96bd-69e80f8a3877 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140524) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 21:34:33.647923 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-3d343e9f-0cf9-4af3-81c0-8847965b233b req-d6cac03b-0777-4fbb-9cd2-f491a9d0e6e2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044786 Sep 17 21:34:33.648971 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3169/6249] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:34:34.620253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f184240c-b433-45ab-b336-b67bbc4fa7f1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:34.620841 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f184240c-b433-45ab-b336-b67bbc4fa7f1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:34.628902 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f184240c-b433-45ab-b336-b67bbc4fa7f1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:34.629394 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f184240c-b433-45ab-b336-b67bbc4fa7f1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:34.629868 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f184240c-b433-45ab-b336-b67bbc4fa7f1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:34.630580 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f184240c-b433-45ab-b336-b67bbc4fa7f1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:34.631043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f184240c-b433-45ab-b336-b67bbc4fa7f1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:34.631478 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f184240c-b433-45ab-b336-b67bbc4fa7f1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:34.778141 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f184240c-b433-45ab-b336-b67bbc4fa7f1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:34.787395 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f184240c-b433-45ab-b336-b67bbc4fa7f1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1514 microversion: 2.1 time: 0.171581 Sep 17 21:34:34.787987 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3081/6250] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:34 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:35.666292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-c4a477ec-d49e-4fa6-8233-b73ae06bff05 req-16cecbe6-8259-430a-8f26-4549f14697f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "827c3104-85d9-428f-96bd-69e80f8a3877", "tag": "9b3ade63-7cf9-407f-b193-ce174cef4dcc"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:34:35.678153 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c4a477ec-d49e-4fa6-8233-b73ae06bff05 req-16cecbe6-8259-430a-8f26-4549f14697f8 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:35.678653 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c4a477ec-d49e-4fa6-8233-b73ae06bff05 req-16cecbe6-8259-430a-8f26-4549f14697f8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:35.679099 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c4a477ec-d49e-4fa6-8233-b73ae06bff05 req-16cecbe6-8259-430a-8f26-4549f14697f8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:35.692231 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-c4a477ec-d49e-4fa6-8233-b73ae06bff05 req-16cecbe6-8259-430a-8f26-4549f14697f8 service nova] Creating event network-changed:9b3ade63-7cf9-407f-b193-ce174cef4dcc for instance 827c3104-85d9-428f-96bd-69e80f8a3877 on nch2-master-1 Sep 17 21:34:35.699164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [req-c4a477ec-d49e-4fa6-8233-b73ae06bff05 req-16cecbe6-8259-430a-8f26-4549f14697f8 service nova] Instance 827c3104-85d9-428f-96bd-69e80f8a3877 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140524) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 21:34:35.712587 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-c4a477ec-d49e-4fa6-8233-b73ae06bff05 req-16cecbe6-8259-430a-8f26-4549f14697f8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051666 Sep 17 21:34:35.713237 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3170/6251] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:34:35.810874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-af952dc1-a876-42f4-98e2-36439668b7a7 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:35.811519 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-af952dc1-a876-42f4-98e2-36439668b7a7 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:35.818648 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af952dc1-a876-42f4-98e2-36439668b7a7 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:35.819142 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af952dc1-a876-42f4-98e2-36439668b7a7 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:35.819577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af952dc1-a876-42f4-98e2-36439668b7a7 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:35.820280 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af952dc1-a876-42f4-98e2-36439668b7a7 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:35.820732 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af952dc1-a876-42f4-98e2-36439668b7a7 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:35.821140 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af952dc1-a876-42f4-98e2-36439668b7a7 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:35.958358 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-af952dc1-a876-42f4-98e2-36439668b7a7 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:35.966690 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-af952dc1-a876-42f4-98e2-36439668b7a7 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1512 microversion: 2.1 time: 0.159643 Sep 17 21:34:35.967327 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3082/6252] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:35 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:36.998234 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-34cae265-f8e6-491e-9c9c-f455b82bca75 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:36.999427 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-34cae265-f8e6-491e-9c9c-f455b82bca75 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:37.010008 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-34cae265-f8e6-491e-9c9c-f455b82bca75 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:37.010804 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-34cae265-f8e6-491e-9c9c-f455b82bca75 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:37.014273 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-34cae265-f8e6-491e-9c9c-f455b82bca75 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:37.015494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-34cae265-f8e6-491e-9c9c-f455b82bca75 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:37.017260 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-34cae265-f8e6-491e-9c9c-f455b82bca75 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:37.018072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-34cae265-f8e6-491e-9c9c-f455b82bca75 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:37.166203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-34cae265-f8e6-491e-9c9c-f455b82bca75 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:37.178671 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-34cae265-f8e6-491e-9c9c-f455b82bca75 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1509 microversion: 2.1 time: 0.188816 Sep 17 21:34:37.179587 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3171/6253] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:36 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1509 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:37.205829 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-52a79cbe-bf89-45ef-9ea1-71a887bc572f tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:37.206358 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-52a79cbe-bf89-45ef-9ea1-71a887bc572f tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:37.213497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-52a79cbe-bf89-45ef-9ea1-71a887bc572f tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:37.213979 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-52a79cbe-bf89-45ef-9ea1-71a887bc572f tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:37.214417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-52a79cbe-bf89-45ef-9ea1-71a887bc572f tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:37.215118 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-52a79cbe-bf89-45ef-9ea1-71a887bc572f tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:37.215566 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-52a79cbe-bf89-45ef-9ea1-71a887bc572f tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:37.215988 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-52a79cbe-bf89-45ef-9ea1-71a887bc572f tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:37.242716 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-52a79cbe-bf89-45ef-9ea1-71a887bc572f tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:34:37.296013 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.compute.api [None req-52a79cbe-bf89-45ef-9ea1-71a887bc572f tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Found an unconfirmed migration during delete, id: 16, status: finished Sep 17 21:34:38.765173 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-52a79cbe-bf89-45ef-9ea1-71a887bc572f tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "DELETE /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 204 len: 0 microversion: 2.1 time: 1.562752 Sep 17 21:34:38.766256 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3083/6254] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:34:37 2022] DELETE /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 0 bytes in 1565 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:34:38.775208 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8252304b-9711-49b3-a811-10c998ba5bc1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:38.775838 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8252304b-9711-49b3-a811-10c998ba5bc1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:38.783160 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8252304b-9711-49b3-a811-10c998ba5bc1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:38.783680 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8252304b-9711-49b3-a811-10c998ba5bc1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:38.784142 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8252304b-9711-49b3-a811-10c998ba5bc1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:38.784867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8252304b-9711-49b3-a811-10c998ba5bc1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:38.785348 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8252304b-9711-49b3-a811-10c998ba5bc1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:38.785828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8252304b-9711-49b3-a811-10c998ba5bc1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:38.918707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8252304b-9711-49b3-a811-10c998ba5bc1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:38.927531 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8252304b-9711-49b3-a811-10c998ba5bc1 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1501 microversion: 2.1 time: 0.156349 Sep 17 21:34:38.928376 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3172/6255] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:38 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1501 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:39.952080 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e7b62289-70bb-4313-9f56-59fde2e8f0d7 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:39.952785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e7b62289-70bb-4313-9f56-59fde2e8f0d7 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:39.960143 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7b62289-70bb-4313-9f56-59fde2e8f0d7 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:39.960651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7b62289-70bb-4313-9f56-59fde2e8f0d7 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:39.961099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7b62289-70bb-4313-9f56-59fde2e8f0d7 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:39.961840 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7b62289-70bb-4313-9f56-59fde2e8f0d7 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:39.962336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7b62289-70bb-4313-9f56-59fde2e8f0d7 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:39.962775 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7b62289-70bb-4313-9f56-59fde2e8f0d7 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:40.101624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e7b62289-70bb-4313-9f56-59fde2e8f0d7 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22aaf576a5134ec4a09550ccf2c98235', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd3d716a01034337b002a97e8c430162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:40.102675 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-fbb31a78-9a33-4a21-acf7-10c31432b72f req-dfb4c6f2-6614-4b13-bc4a-029dad851634 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "827c3104-85d9-428f-96bd-69e80f8a3877", "name": "network-vif-plugged", "status": "completed", "tag": "9b3ade63-7cf9-407f-b193-ce174cef4dcc"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:34:40.111458 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e7b62289-70bb-4313-9f56-59fde2e8f0d7 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 200 len: 1501 microversion: 2.1 time: 0.163756 Sep 17 21:34:40.112144 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3084/6256] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:39 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 1501 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:40.125720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-fbb31a78-9a33-4a21-acf7-10c31432b72f req-dfb4c6f2-6614-4b13-bc4a-029dad851634 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:40.125720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-fbb31a78-9a33-4a21-acf7-10c31432b72f req-dfb4c6f2-6614-4b13-bc4a-029dad851634 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:40.125720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-fbb31a78-9a33-4a21-acf7-10c31432b72f req-dfb4c6f2-6614-4b13-bc4a-029dad851634 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:40.134724 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-fbb31a78-9a33-4a21-acf7-10c31432b72f req-dfb4c6f2-6614-4b13-bc4a-029dad851634 service nova] Creating event network-vif-plugged:9b3ade63-7cf9-407f-b193-ce174cef4dcc for instance 827c3104-85d9-428f-96bd-69e80f8a3877 on nch2-master-1 Sep 17 21:34:40.139783 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-fbb31a78-9a33-4a21-acf7-10c31432b72f req-dfb4c6f2-6614-4b13-bc4a-029dad851634 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042679 Sep 17 21:34:40.140459 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3173/6257] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:34:40.545362 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-1dac3a98-cb4d-4f39-bcea-149b142ec32e req-b4fcb1f9-668f-418b-b76f-51bd388a73e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "827c3104-85d9-428f-96bd-69e80f8a3877", "name": "network-vif-deleted", "tag": "9b3ade63-7cf9-407f-b193-ce174cef4dcc"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:34:40.555900 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-1dac3a98-cb4d-4f39-bcea-149b142ec32e req-b4fcb1f9-668f-418b-b76f-51bd388a73e6 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:40.556618 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-1dac3a98-cb4d-4f39-bcea-149b142ec32e req-b4fcb1f9-668f-418b-b76f-51bd388a73e6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:40.557093 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-1dac3a98-cb4d-4f39-bcea-149b142ec32e req-b4fcb1f9-668f-418b-b76f-51bd388a73e6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:40.568901 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-1dac3a98-cb4d-4f39-bcea-149b142ec32e req-b4fcb1f9-668f-418b-b76f-51bd388a73e6 service nova] Creating event network-vif-deleted:9b3ade63-7cf9-407f-b193-ce174cef4dcc for instance 827c3104-85d9-428f-96bd-69e80f8a3877 on nch2-master-1 Sep 17 21:34:40.573876 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-1dac3a98-cb4d-4f39-bcea-149b142ec32e req-b4fcb1f9-668f-418b-b76f-51bd388a73e6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032742 Sep 17 21:34:40.574504 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3085/6258] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:34:41.142013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5afc3528-2407-4d92-b312-1366ef2a1b84 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:41.144079 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5afc3528-2407-4d92-b312-1366ef2a1b84 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:41.150662 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5afc3528-2407-4d92-b312-1366ef2a1b84 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:41.151168 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5afc3528-2407-4d92-b312-1366ef2a1b84 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:41.151625 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5afc3528-2407-4d92-b312-1366ef2a1b84 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:41.152341 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5afc3528-2407-4d92-b312-1366ef2a1b84 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:41.152813 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5afc3528-2407-4d92-b312-1366ef2a1b84 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:41.153285 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5afc3528-2407-4d92-b312-1366ef2a1b84 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:41.169824 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-5afc3528-2407-4d92-b312-1366ef2a1b84 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] HTTP exception thrown: Instance 827c3104-85d9-428f-96bd-69e80f8a3877 could not be found. Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5afc3528-2407-4d92-b312-1366ef2a1b84 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Request method failure captured: Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 HTTP/1.1 Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJj09eh1Oj0aL1PyYc0gt4QRRONoLoOCHfRG6pazudy5vjlrrRuPM-dnwkxU3XYlaFdRyJsxPvNEB5Ce6C1WBn1NskQNWJVNRrzl6OHE5MuenS3_LYeZFhzsUKACImpZh0pCk3YysDMVb01PZOsNbfM2iXUvzOjA6L_mMTaPkRtU3BO0 Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: dd3d716a01034337b002a97e8c430162 Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-DeleteServersTestJSON-1390971173 Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dd3d716a01034337b002a97e8c430162"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dd3d716a01034337b002a97e8c430162"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dd3d716a01034337b002a97e8c430162"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dd3d716a01034337b002a97e8c430162", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-DeleteServersTestJSON-1390971173 Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: dd3d716a01034337b002a97e8c430162 Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-DeleteServersTestJSON-1390971173 Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-DeleteServersTestJSON-1390971173-project Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 22aaf576a5134ec4a09550ccf2c98235 Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-DeleteServersTestJSON-1390971173-project Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 827c3104-85d9-428f-96bd-69e80f8a3877 could not be found. Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '827c3104-85d9-428f-96bd-69e80f8a3877'} Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 827c3104-85d9-428f-96bd-69e80f8a3877 could not be found. Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 827c3104-85d9-428f-96bd-69e80f8a3877 could not be found. Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:34:41.171481 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:34:41.176394 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:34:41.176394 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:34:41.176394 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:34:41.176394 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:34:41.176394 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:34:41.176394 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 827c3104-85d9-428f-96bd-69e80f8a3877 could not be found. Sep 17 21:34:41.176394 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:34:41.176394 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5afc3528-2407-4d92-b312-1366ef2a1b84 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Returning 404 to user: Instance 827c3104-85d9-428f-96bd-69e80f8a3877 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:34:41.176394 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5afc3528-2407-4d92-b312-1366ef2a1b84 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 404 len: 111 microversion: 2.1 time: 0.039697 Sep 17 21:34:41.176394 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3174/6259] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:41 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:34:41.189032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c4aa15a2-e640-4bac-ac08-9f9f90170103 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:41.189687 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c4aa15a2-e640-4bac-ac08-9f9f90170103 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:41.197007 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c4aa15a2-e640-4bac-ac08-9f9f90170103 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:41.197567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c4aa15a2-e640-4bac-ac08-9f9f90170103 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:41.198020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c4aa15a2-e640-4bac-ac08-9f9f90170103 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:41.198731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c4aa15a2-e640-4bac-ac08-9f9f90170103 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:41.199185 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c4aa15a2-e640-4bac-ac08-9f9f90170103 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:41.199616 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c4aa15a2-e640-4bac-ac08-9f9f90170103 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:41.213274 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-c4aa15a2-e640-4bac-ac08-9f9f90170103 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] HTTP exception thrown: Instance 827c3104-85d9-428f-96bd-69e80f8a3877 could not be found. Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c4aa15a2-e640-4bac-ac08-9f9f90170103 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Request method failure captured: Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 HTTP/1.1 Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJj09eh1Oj0aL1PyYc0gt4QRRONoLoOCHfRG6pazudy5vjlrrRuPM-dnwkxU3XYlaFdRyJsxPvNEB5Ce6C1WBn1NskQNWJVNRrzl6OHE5MuenS3_LYeZFhzsUKACImpZh0pCk3YysDMVb01PZOsNbfM2iXUvzOjA6L_mMTaPkRtU3BO0 Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: dd3d716a01034337b002a97e8c430162 Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-DeleteServersTestJSON-1390971173 Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dd3d716a01034337b002a97e8c430162"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dd3d716a01034337b002a97e8c430162"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dd3d716a01034337b002a97e8c430162"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dd3d716a01034337b002a97e8c430162", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-DeleteServersTestJSON-1390971173 Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: dd3d716a01034337b002a97e8c430162 Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-DeleteServersTestJSON-1390971173 Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-DeleteServersTestJSON-1390971173-project Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 22aaf576a5134ec4a09550ccf2c98235 Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-DeleteServersTestJSON-1390971173-project Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 827c3104-85d9-428f-96bd-69e80f8a3877 could not be found. Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '827c3104-85d9-428f-96bd-69e80f8a3877'} Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 827c3104-85d9-428f-96bd-69e80f8a3877 could not be found. Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:34:41.214941 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:34:41.218993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 827c3104-85d9-428f-96bd-69e80f8a3877 could not be found. Sep 17 21:34:41.218993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:34:41.218993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:34:41.218993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:34:41.218993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:34:41.218993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:34:41.218993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:34:41.218993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:34:41.218993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:34:41.218993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 827c3104-85d9-428f-96bd-69e80f8a3877 could not be found. Sep 17 21:34:41.218993 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:34:41.218993 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c4aa15a2-e640-4bac-ac08-9f9f90170103 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Returning 404 to user: Instance 827c3104-85d9-428f-96bd-69e80f8a3877 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:34:41.218993 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c4aa15a2-e640-4bac-ac08-9f9f90170103 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "DELETE /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 404 len: 111 microversion: 2.1 time: 0.031560 Sep 17 21:34:41.218993 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3086/6260] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:34:41 2022] DELETE /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:34:41.225415 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5fe5f6c7-d781-40bb-97d0-c923b33dc175 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:41.226090 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5fe5f6c7-d781-40bb-97d0-c923b33dc175 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] [instance: 827c3104-85d9-428f-96bd-69e80f8a3877] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:41.232557 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5fe5f6c7-d781-40bb-97d0-c923b33dc175 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:41.233074 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5fe5f6c7-d781-40bb-97d0-c923b33dc175 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:41.233550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5fe5f6c7-d781-40bb-97d0-c923b33dc175 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:41.234267 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5fe5f6c7-d781-40bb-97d0-c923b33dc175 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:41.234752 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5fe5f6c7-d781-40bb-97d0-c923b33dc175 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:41.235197 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5fe5f6c7-d781-40bb-97d0-c923b33dc175 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:41.248969 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-5fe5f6c7-d781-40bb-97d0-c923b33dc175 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] HTTP exception thrown: Instance 827c3104-85d9-428f-96bd-69e80f8a3877 could not be found. Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5fe5f6c7-d781-40bb-97d0-c923b33dc175 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Request method failure captured: Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 HTTP/1.1 Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJj09eh1Oj0aL1PyYc0gt4QRRONoLoOCHfRG6pazudy5vjlrrRuPM-dnwkxU3XYlaFdRyJsxPvNEB5Ce6C1WBn1NskQNWJVNRrzl6OHE5MuenS3_LYeZFhzsUKACImpZh0pCk3YysDMVb01PZOsNbfM2iXUvzOjA6L_mMTaPkRtU3BO0 Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: dd3d716a01034337b002a97e8c430162 Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-DeleteServersTestJSON-1390971173 Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dd3d716a01034337b002a97e8c430162"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dd3d716a01034337b002a97e8c430162"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dd3d716a01034337b002a97e8c430162"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dd3d716a01034337b002a97e8c430162", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-DeleteServersTestJSON-1390971173 Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: dd3d716a01034337b002a97e8c430162 Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-DeleteServersTestJSON-1390971173 Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-DeleteServersTestJSON-1390971173-project Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 22aaf576a5134ec4a09550ccf2c98235 Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-DeleteServersTestJSON-1390971173-project Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 827c3104-85d9-428f-96bd-69e80f8a3877 could not be found. Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '827c3104-85d9-428f-96bd-69e80f8a3877'} Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 827c3104-85d9-428f-96bd-69e80f8a3877 could not be found. Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 827c3104-85d9-428f-96bd-69e80f8a3877 could not be found. Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:34:41.250551 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:34:41.255358 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:34:41.255358 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:34:41.255358 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:34:41.255358 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:34:41.255358 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:34:41.255358 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 827c3104-85d9-428f-96bd-69e80f8a3877 could not be found. Sep 17 21:34:41.255358 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:34:41.255358 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5fe5f6c7-d781-40bb-97d0-c923b33dc175 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] Returning 404 to user: Instance 827c3104-85d9-428f-96bd-69e80f8a3877 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:34:41.255358 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5fe5f6c7-d781-40bb-97d0-c923b33dc175 tempest-DeleteServersTestJSON-1390971173 tempest-DeleteServersTestJSON-1390971173-project] 10.222.0.26 "GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877" status: 404 len: 111 microversion: 2.1 time: 0.030904 Sep 17 21:34:41.255358 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3175/6261] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:41 2022] GET /compute/v2.1/servers/827c3104-85d9-428f-96bd-69e80f8a3877 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:34:49.965120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-aea24a12-ad9f-4777-8492-0d6faace6e06 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1517049477", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "15428757-7faf-42e8-b5e5-905607f6e4b3"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:34:50.026734 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-aea24a12-ad9f-4777-8492-0d6faace6e06 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] validate_networks() for [('15428757-7faf-42e8-b5e5-905607f6e4b3', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:34:50.467334 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-aea24a12-ad9f-4777-8492-0d6faace6e06 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:34:50.467804 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-aea24a12-ad9f-4777-8492-0d6faace6e06 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:34:50.468276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-aea24a12-ad9f-4777-8492-0d6faace6e06 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:34:50.468676 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-aea24a12-ad9f-4777-8492-0d6faace6e06 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:34:50.469088 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-aea24a12-ad9f-4777-8492-0d6faace6e06 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:34:50.479275 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aea24a12-ad9f-4777-8492-0d6faace6e06 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:50.479757 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aea24a12-ad9f-4777-8492-0d6faace6e06 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:50.480199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aea24a12-ad9f-4777-8492-0d6faace6e06 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:50.480926 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aea24a12-ad9f-4777-8492-0d6faace6e06 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:50.481377 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aea24a12-ad9f-4777-8492-0d6faace6e06 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:50.481827 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aea24a12-ad9f-4777-8492-0d6faace6e06 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:50.502816 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-aea24a12-ad9f-4777-8492-0d6faace6e06 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Getting quotas for project 2412712d1e76496a892826131215475f. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:34:50.508944 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-aea24a12-ad9f-4777-8492-0d6faace6e06 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Getting quotas for user da549e8947e445fea05a3969c98c732e and project 2412712d1e76496a892826131215475f. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:34:50.523700 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-aea24a12-ad9f-4777-8492-0d6faace6e06 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:34:50.526103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-aea24a12-ad9f-4777-8492-0d6faace6e06 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:34:50.576110 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-aea24a12-ad9f-4777-8492-0d6faace6e06 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.738490 Sep 17 21:34:50.581658 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3087/6262] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:34:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:34:50.588597 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8f6f3fc8-adfb-46f2-8ccb-87eb5157604e tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:50.589232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8f6f3fc8-adfb-46f2-8ccb-87eb5157604e tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:50.677169 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8f6f3fc8-adfb-46f2-8ccb-87eb5157604e tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:50.685371 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8f6f3fc8-adfb-46f2-8ccb-87eb5157604e tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1218 microversion: 2.1 time: 0.100698 Sep 17 21:34:50.688078 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3176/6263] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:50 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:34:51.711045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-aff2b694-5c84-48b8-ab37-550f75eb2677 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:51.711649 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-aff2b694-5c84-48b8-ab37-550f75eb2677 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:51.719265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aff2b694-5c84-48b8-ab37-550f75eb2677 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:51.719728 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aff2b694-5c84-48b8-ab37-550f75eb2677 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:51.720469 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aff2b694-5c84-48b8-ab37-550f75eb2677 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:51.721511 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aff2b694-5c84-48b8-ab37-550f75eb2677 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:51.722164 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aff2b694-5c84-48b8-ab37-550f75eb2677 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:51.722900 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aff2b694-5c84-48b8-ab37-550f75eb2677 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:51.790791 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-aff2b694-5c84-48b8-ab37-550f75eb2677 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:51.798808 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-aff2b694-5c84-48b8-ab37-550f75eb2677 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1278 microversion: 2.1 time: 0.092096 Sep 17 21:34:51.799398 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3088/6264] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:51 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1278 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:52.821778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a054a54b-b5d2-4fd6-a426-c0076e509aa5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:52.823114 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a054a54b-b5d2-4fd6-a426-c0076e509aa5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:52.825427 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=37 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:34:52.834371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a054a54b-b5d2-4fd6-a426-c0076e509aa5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:52.834884 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a054a54b-b5d2-4fd6-a426-c0076e509aa5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:52.835328 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a054a54b-b5d2-4fd6-a426-c0076e509aa5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:52.836247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a054a54b-b5d2-4fd6-a426-c0076e509aa5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:52.836919 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a054a54b-b5d2-4fd6-a426-c0076e509aa5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:52.837348 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a054a54b-b5d2-4fd6-a426-c0076e509aa5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:52.984995 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a054a54b-b5d2-4fd6-a426-c0076e509aa5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:52.993146 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a054a54b-b5d2-4fd6-a426-c0076e509aa5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1318 microversion: 2.1 time: 0.175427 Sep 17 21:34:52.993782 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3177/6265] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:52 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:53.107932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-29b4c099-d963-4c81-8dea-e8ebf72d1290 req-ae2b091f-1b1b-48b8-bfc7-a361d44cc9fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57d6a97c-6bfd-4c8b-814c-ae62587bba75", "tag": "70e9091e-4457-4be7-adb6-07ae91e512f6"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:34:53.131082 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-29b4c099-d963-4c81-8dea-e8ebf72d1290 req-ae2b091f-1b1b-48b8-bfc7-a361d44cc9fa service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:53.131863 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-29b4c099-d963-4c81-8dea-e8ebf72d1290 req-ae2b091f-1b1b-48b8-bfc7-a361d44cc9fa service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:53.135705 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-29b4c099-d963-4c81-8dea-e8ebf72d1290 req-ae2b091f-1b1b-48b8-bfc7-a361d44cc9fa service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:53.153073 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-29b4c099-d963-4c81-8dea-e8ebf72d1290 req-ae2b091f-1b1b-48b8-bfc7-a361d44cc9fa service nova] Creating event network-changed:70e9091e-4457-4be7-adb6-07ae91e512f6 for instance 57d6a97c-6bfd-4c8b-814c-ae62587bba75 on nch2-master-1 Sep 17 21:34:53.159119 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-29b4c099-d963-4c81-8dea-e8ebf72d1290 req-ae2b091f-1b1b-48b8-bfc7-a361d44cc9fa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054546 Sep 17 21:34:53.160525 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3089/6266] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:34:54.016557 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-85281172-c51a-40ce-a677-5947e5117499 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:54.017197 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-85281172-c51a-40ce-a677-5947e5117499 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:54.026390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85281172-c51a-40ce-a677-5947e5117499 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:54.027270 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85281172-c51a-40ce-a677-5947e5117499 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:54.027982 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85281172-c51a-40ce-a677-5947e5117499 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:54.028612 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85281172-c51a-40ce-a677-5947e5117499 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:54.029116 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85281172-c51a-40ce-a677-5947e5117499 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:54.029727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85281172-c51a-40ce-a677-5947e5117499 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:54.173834 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-85281172-c51a-40ce-a677-5947e5117499 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:54.182149 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-85281172-c51a-40ce-a677-5947e5117499 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1318 microversion: 2.1 time: 0.169568 Sep 17 21:34:54.182827 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3178/6267] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:54 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:55.210608 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-33a18582-1528-4a94-a97e-3b8c3ef6ef45 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:55.211651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-33a18582-1528-4a94-a97e-3b8c3ef6ef45 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:55.223450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-33a18582-1528-4a94-a97e-3b8c3ef6ef45 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:55.223944 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-33a18582-1528-4a94-a97e-3b8c3ef6ef45 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:55.224399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-33a18582-1528-4a94-a97e-3b8c3ef6ef45 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:55.225487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-33a18582-1528-4a94-a97e-3b8c3ef6ef45 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:55.226058 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-33a18582-1528-4a94-a97e-3b8c3ef6ef45 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:55.226490 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-33a18582-1528-4a94-a97e-3b8c3ef6ef45 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:55.367306 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-33a18582-1528-4a94-a97e-3b8c3ef6ef45 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:55.375700 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-33a18582-1528-4a94-a97e-3b8c3ef6ef45 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1318 microversion: 2.1 time: 0.172444 Sep 17 21:34:55.376296 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3090/6268] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:55 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:56.399559 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-62f2309f-7c55-4e37-8f20-be377abafca7 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:56.400214 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-62f2309f-7c55-4e37-8f20-be377abafca7 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:56.407696 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62f2309f-7c55-4e37-8f20-be377abafca7 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:56.408212 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62f2309f-7c55-4e37-8f20-be377abafca7 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:56.408702 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62f2309f-7c55-4e37-8f20-be377abafca7 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:56.409403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62f2309f-7c55-4e37-8f20-be377abafca7 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:56.410161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62f2309f-7c55-4e37-8f20-be377abafca7 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:56.410649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-62f2309f-7c55-4e37-8f20-be377abafca7 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:56.547304 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-62f2309f-7c55-4e37-8f20-be377abafca7 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:56.560004 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-62f2309f-7c55-4e37-8f20-be377abafca7 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1318 microversion: 2.1 time: 0.164428 Sep 17 21:34:56.560603 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3179/6269] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:56 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:57.587639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-75788508-dda2-4e17-999d-477a97c2f620 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:57.588673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-75788508-dda2-4e17-999d-477a97c2f620 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:57.599866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75788508-dda2-4e17-999d-477a97c2f620 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:57.600386 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75788508-dda2-4e17-999d-477a97c2f620 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:57.600834 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75788508-dda2-4e17-999d-477a97c2f620 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:57.601576 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75788508-dda2-4e17-999d-477a97c2f620 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:57.602045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75788508-dda2-4e17-999d-477a97c2f620 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:57.602478 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-75788508-dda2-4e17-999d-477a97c2f620 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:57.605213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:34:57.744353 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-75788508-dda2-4e17-999d-477a97c2f620 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:57.752276 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-75788508-dda2-4e17-999d-477a97c2f620 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1318 microversion: 2.1 time: 0.171352 Sep 17 21:34:57.752895 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3091/6270] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:57 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:58.145314 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-e9841506-bf3d-4237-b90d-4933d8608082 req-b198f571-191d-40c4-9f90-8308681cbd3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d6a97c-6bfd-4c8b-814c-ae62587bba75", "name": "network-vif-plugged", "status": "completed", "tag": "70e9091e-4457-4be7-adb6-07ae91e512f6"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:34:58.156128 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e9841506-bf3d-4237-b90d-4933d8608082 req-b198f571-191d-40c4-9f90-8308681cbd3c service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:58.156638 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e9841506-bf3d-4237-b90d-4933d8608082 req-b198f571-191d-40c4-9f90-8308681cbd3c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:58.157361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-e9841506-bf3d-4237-b90d-4933d8608082 req-b198f571-191d-40c4-9f90-8308681cbd3c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:58.171371 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-e9841506-bf3d-4237-b90d-4933d8608082 req-b198f571-191d-40c4-9f90-8308681cbd3c service nova] Creating event network-vif-plugged:70e9091e-4457-4be7-adb6-07ae91e512f6 for instance 57d6a97c-6bfd-4c8b-814c-ae62587bba75 on nch2-master-1 Sep 17 21:34:58.176875 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-e9841506-bf3d-4237-b90d-4933d8608082 req-b198f571-191d-40c4-9f90-8308681cbd3c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035668 Sep 17 21:34:58.177750 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3180/6271] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:34:58.775820 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cf0d5c35-cd87-4e27-99a1-f1c1d4285a2d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:58.776403 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cf0d5c35-cd87-4e27-99a1-f1c1d4285a2d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:58.779343 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:34:58.785993 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf0d5c35-cd87-4e27-99a1-f1c1d4285a2d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:58.786486 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf0d5c35-cd87-4e27-99a1-f1c1d4285a2d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:58.786945 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf0d5c35-cd87-4e27-99a1-f1c1d4285a2d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:58.787657 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf0d5c35-cd87-4e27-99a1-f1c1d4285a2d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:58.788119 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf0d5c35-cd87-4e27-99a1-f1c1d4285a2d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:58.788551 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf0d5c35-cd87-4e27-99a1-f1c1d4285a2d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:58.931426 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cf0d5c35-cd87-4e27-99a1-f1c1d4285a2d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:34:58.940639 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cf0d5c35-cd87-4e27-99a1-f1c1d4285a2d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1318 microversion: 2.1 time: 0.168741 Sep 17 21:34:58.941370 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3092/6272] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:58 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:34:59.969815 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4f14caac-7ff1-4216-8228-f369724408f9 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:34:59.970998 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4f14caac-7ff1-4216-8228-f369724408f9 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:34:59.973696 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=30 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:34:59.980107 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f14caac-7ff1-4216-8228-f369724408f9 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:59.980615 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f14caac-7ff1-4216-8228-f369724408f9 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:59.981074 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f14caac-7ff1-4216-8228-f369724408f9 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:34:59.981846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f14caac-7ff1-4216-8228-f369724408f9 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:34:59.982347 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f14caac-7ff1-4216-8228-f369724408f9 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:34:59.982765 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f14caac-7ff1-4216-8228-f369724408f9 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:00.118000 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4f14caac-7ff1-4216-8228-f369724408f9 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:00.130260 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4f14caac-7ff1-4216-8228-f369724408f9 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1508 microversion: 2.1 time: 0.168970 Sep 17 21:35:00.131070 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3181/6273] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:34:59 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:00.158278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d9c9ff59-c7d7-4d42-82bc-cde825513323 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:00.158903 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d9c9ff59-c7d7-4d42-82bc-cde825513323 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:00.165965 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d9c9ff59-c7d7-4d42-82bc-cde825513323 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:00.166567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d9c9ff59-c7d7-4d42-82bc-cde825513323 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:00.167010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d9c9ff59-c7d7-4d42-82bc-cde825513323 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:00.167747 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d9c9ff59-c7d7-4d42-82bc-cde825513323 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:00.168204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d9c9ff59-c7d7-4d42-82bc-cde825513323 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:00.168636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d9c9ff59-c7d7-4d42-82bc-cde825513323 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:00.297549 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d9c9ff59-c7d7-4d42-82bc-cde825513323 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:00.306132 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d9c9ff59-c7d7-4d42-82bc-cde825513323 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1508 microversion: 2.1 time: 0.151933 Sep 17 21:35:00.306766 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3093/6274] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:00 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:00.328370 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2eff0db6-7249-433d-a5ca-f888e537b3ce tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:35:00.330947 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2eff0db6-7249-433d-a5ca-f888e537b3ce tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:00.337312 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2eff0db6-7249-433d-a5ca-f888e537b3ce tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:00.337854 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2eff0db6-7249-433d-a5ca-f888e537b3ce tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:00.338306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2eff0db6-7249-433d-a5ca-f888e537b3ce tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:00.339018 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2eff0db6-7249-433d-a5ca-f888e537b3ce tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:00.339490 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2eff0db6-7249-433d-a5ca-f888e537b3ce tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:00.339925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2eff0db6-7249-433d-a5ca-f888e537b3ce tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:00.410812 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2eff0db6-7249-433d-a5ca-f888e537b3ce tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "PUT /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1080 microversion: 2.1 time: 0.086267 Sep 17 21:35:00.411445 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3182/6275] 10.222.0.26 () {60 vars in 1256 bytes} [Sat Sep 17 21:35:00 2022] PUT /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1080 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:00.430476 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2ccb2250-988c-4f4e-94ea-632c29e4592a tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:00.431095 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2ccb2250-988c-4f4e-94ea-632c29e4592a tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:00.437670 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ccb2250-988c-4f4e-94ea-632c29e4592a tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:00.438160 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ccb2250-988c-4f4e-94ea-632c29e4592a tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:00.438600 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ccb2250-988c-4f4e-94ea-632c29e4592a tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:00.439294 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ccb2250-988c-4f4e-94ea-632c29e4592a tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:00.439751 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ccb2250-988c-4f4e-94ea-632c29e4592a tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:00.440154 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ccb2250-988c-4f4e-94ea-632c29e4592a tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:00.489668 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:35:00.517577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:35:00.582607 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2ccb2250-988c-4f4e-94ea-632c29e4592a tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:00.591152 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2ccb2250-988c-4f4e-94ea-632c29e4592a tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1506 microversion: 2.1 time: 0.164527 Sep 17 21:35:00.591744 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3094/6276] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:00 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:00.613750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-040b33aa-1ab2-4c86-9d73-935885ad6176 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:00.614385 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-040b33aa-1ab2-4c86-9d73-935885ad6176 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:00.620944 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-040b33aa-1ab2-4c86-9d73-935885ad6176 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:00.621444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-040b33aa-1ab2-4c86-9d73-935885ad6176 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:00.621929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-040b33aa-1ab2-4c86-9d73-935885ad6176 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:00.622646 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-040b33aa-1ab2-4c86-9d73-935885ad6176 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:00.623120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-040b33aa-1ab2-4c86-9d73-935885ad6176 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:00.623566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-040b33aa-1ab2-4c86-9d73-935885ad6176 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:00.684347 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:35:00.754910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-040b33aa-1ab2-4c86-9d73-935885ad6176 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:00.763326 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-040b33aa-1ab2-4c86-9d73-935885ad6176 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1506 microversion: 2.1 time: 0.153533 Sep 17 21:35:00.763984 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3183/6277] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:00 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:00.785868 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e9ec2c2e-f8a5-4b8d-a75b-c47e95fb7b64 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:35:00.788100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e9ec2c2e-f8a5-4b8d-a75b-c47e95fb7b64 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:00.794365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9ec2c2e-f8a5-4b8d-a75b-c47e95fb7b64 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:00.794857 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9ec2c2e-f8a5-4b8d-a75b-c47e95fb7b64 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:00.795300 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9ec2c2e-f8a5-4b8d-a75b-c47e95fb7b64 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:00.797168 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9ec2c2e-f8a5-4b8d-a75b-c47e95fb7b64 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:00.797666 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9ec2c2e-f8a5-4b8d-a75b-c47e95fb7b64 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:00.798100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9ec2c2e-f8a5-4b8d-a75b-c47e95fb7b64 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:00.838470 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e9ec2c2e-f8a5-4b8d-a75b-c47e95fb7b64 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:00.844208 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e9ec2c2e-f8a5-4b8d-a75b-c47e95fb7b64 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Old instance type m1.heat2, new instance type m1.heat {{(pid=140523) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 17 21:35:00.851423 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-e9ec2c2e-f8a5-4b8d-a75b-c47e95fb7b64 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:35:00.851854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-e9ec2c2e-f8a5-4b8d-a75b-c47e95fb7b64 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:35:00.852334 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-e9ec2c2e-f8a5-4b8d-a75b-c47e95fb7b64 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:35:00.852750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-e9ec2c2e-f8a5-4b8d-a75b-c47e95fb7b64 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:35:00.853171 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-e9ec2c2e-f8a5-4b8d-a75b-c47e95fb7b64 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:35:00.925744 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e9ec2c2e-f8a5-4b8d-a75b-c47e95fb7b64 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "POST /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75/action" status: 202 len: 0 microversion: 2.1 time: 0.143888 Sep 17 21:35:00.930109 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3095/6278] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:35:00 2022] POST /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:35:00.935492 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8550e12d-5c45-425d-bbed-5cfd34c99cbe tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:00.936110 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8550e12d-5c45-425d-bbed-5cfd34c99cbe tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:00.942351 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8550e12d-5c45-425d-bbed-5cfd34c99cbe tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:00.942861 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8550e12d-5c45-425d-bbed-5cfd34c99cbe tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:00.943307 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8550e12d-5c45-425d-bbed-5cfd34c99cbe tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:00.944017 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8550e12d-5c45-425d-bbed-5cfd34c99cbe tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:00.944484 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8550e12d-5c45-425d-bbed-5cfd34c99cbe tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:00.944925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8550e12d-5c45-425d-bbed-5cfd34c99cbe tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:01.131044 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8550e12d-5c45-425d-bbed-5cfd34c99cbe tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:01.139106 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8550e12d-5c45-425d-bbed-5cfd34c99cbe tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1517 microversion: 2.1 time: 0.207579 Sep 17 21:35:01.147490 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3184/6279] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:00 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1517 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:02.164470 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c1c1bc18-bebb-4bee-aacd-006567f84ef1 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:02.165411 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c1c1bc18-bebb-4bee-aacd-006567f84ef1 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:02.173299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c1c1bc18-bebb-4bee-aacd-006567f84ef1 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:02.173957 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c1c1bc18-bebb-4bee-aacd-006567f84ef1 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:02.174576 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c1c1bc18-bebb-4bee-aacd-006567f84ef1 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:02.175453 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c1c1bc18-bebb-4bee-aacd-006567f84ef1 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:02.175917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c1c1bc18-bebb-4bee-aacd-006567f84ef1 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:02.176438 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c1c1bc18-bebb-4bee-aacd-006567f84ef1 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:02.308952 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c1c1bc18-bebb-4bee-aacd-006567f84ef1 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:02.317205 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c1c1bc18-bebb-4bee-aacd-006567f84ef1 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1517 microversion: 2.1 time: 0.158176 Sep 17 21:35:02.317894 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3096/6280] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:02 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:03.344762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2be534a5-d0e0-4bd4-a0f7-073357fe45c2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:03.345929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2be534a5-d0e0-4bd4-a0f7-073357fe45c2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:03.358176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2be534a5-d0e0-4bd4-a0f7-073357fe45c2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:03.359031 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2be534a5-d0e0-4bd4-a0f7-073357fe45c2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:03.359790 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2be534a5-d0e0-4bd4-a0f7-073357fe45c2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:03.360984 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2be534a5-d0e0-4bd4-a0f7-073357fe45c2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:03.361839 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2be534a5-d0e0-4bd4-a0f7-073357fe45c2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:03.362584 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2be534a5-d0e0-4bd4-a0f7-073357fe45c2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:03.500239 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2be534a5-d0e0-4bd4-a0f7-073357fe45c2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:03.508831 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2be534a5-d0e0-4bd4-a0f7-073357fe45c2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1522 microversion: 2.1 time: 0.170767 Sep 17 21:35:03.509428 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3185/6281] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:03 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:04.536706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bb1d252f-ec67-4cdc-8d66-40e9e77830b0 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:04.538032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bb1d252f-ec67-4cdc-8d66-40e9e77830b0 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:04.550139 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bb1d252f-ec67-4cdc-8d66-40e9e77830b0 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:04.550989 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bb1d252f-ec67-4cdc-8d66-40e9e77830b0 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:04.551808 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bb1d252f-ec67-4cdc-8d66-40e9e77830b0 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:04.552525 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bb1d252f-ec67-4cdc-8d66-40e9e77830b0 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:04.552993 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bb1d252f-ec67-4cdc-8d66-40e9e77830b0 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:04.553427 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bb1d252f-ec67-4cdc-8d66-40e9e77830b0 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:04.690056 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bb1d252f-ec67-4cdc-8d66-40e9e77830b0 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:04.698462 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bb1d252f-ec67-4cdc-8d66-40e9e77830b0 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1522 microversion: 2.1 time: 0.168313 Sep 17 21:35:04.699100 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3097/6282] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:04 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:05.722153 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c29e2500-4051-4683-881f-db3c33a6d45a tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:05.722782 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c29e2500-4051-4683-881f-db3c33a6d45a tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:05.730631 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c29e2500-4051-4683-881f-db3c33a6d45a tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:05.731128 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c29e2500-4051-4683-881f-db3c33a6d45a tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:05.731568 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c29e2500-4051-4683-881f-db3c33a6d45a tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:05.732289 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c29e2500-4051-4683-881f-db3c33a6d45a tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:05.732753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c29e2500-4051-4683-881f-db3c33a6d45a tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:05.733192 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c29e2500-4051-4683-881f-db3c33a6d45a tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:05.872893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c29e2500-4051-4683-881f-db3c33a6d45a tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:05.881165 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c29e2500-4051-4683-881f-db3c33a6d45a tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1522 microversion: 2.1 time: 0.163114 Sep 17 21:35:05.881808 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3186/6283] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:05 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:06.917228 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c74e007c-bac0-45e1-a5c1-b8c889f30fe8 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:06.918759 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c74e007c-bac0-45e1-a5c1-b8c889f30fe8 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:06.927280 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c74e007c-bac0-45e1-a5c1-b8c889f30fe8 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:06.928195 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c74e007c-bac0-45e1-a5c1-b8c889f30fe8 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:06.928982 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c74e007c-bac0-45e1-a5c1-b8c889f30fe8 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:06.930278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c74e007c-bac0-45e1-a5c1-b8c889f30fe8 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:06.932130 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c74e007c-bac0-45e1-a5c1-b8c889f30fe8 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:06.933006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c74e007c-bac0-45e1-a5c1-b8c889f30fe8 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:07.073931 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c74e007c-bac0-45e1-a5c1-b8c889f30fe8 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:07.082242 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c74e007c-bac0-45e1-a5c1-b8c889f30fe8 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1522 microversion: 2.1 time: 0.171507 Sep 17 21:35:07.082823 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3098/6284] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:06 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:08.110219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-553fae9d-91b9-4f18-934e-eacdb39acce5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:08.111271 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-553fae9d-91b9-4f18-934e-eacdb39acce5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:08.122945 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-553fae9d-91b9-4f18-934e-eacdb39acce5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:08.123780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-553fae9d-91b9-4f18-934e-eacdb39acce5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:08.124538 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-553fae9d-91b9-4f18-934e-eacdb39acce5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:08.125835 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-553fae9d-91b9-4f18-934e-eacdb39acce5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:08.126551 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-553fae9d-91b9-4f18-934e-eacdb39acce5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:08.127296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-553fae9d-91b9-4f18-934e-eacdb39acce5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:08.264679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-553fae9d-91b9-4f18-934e-eacdb39acce5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:08.273323 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-553fae9d-91b9-4f18-934e-eacdb39acce5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1522 microversion: 2.1 time: 0.169745 Sep 17 21:35:08.273978 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3187/6285] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:08 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:09.296685 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4b0ec82c-24e7-4b4f-80e2-fb35c7a59c03 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:09.297342 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4b0ec82c-24e7-4b4f-80e2-fb35c7a59c03 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:09.305967 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b0ec82c-24e7-4b4f-80e2-fb35c7a59c03 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:09.306463 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b0ec82c-24e7-4b4f-80e2-fb35c7a59c03 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:09.306911 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b0ec82c-24e7-4b4f-80e2-fb35c7a59c03 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:09.307624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b0ec82c-24e7-4b4f-80e2-fb35c7a59c03 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:09.308095 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b0ec82c-24e7-4b4f-80e2-fb35c7a59c03 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:09.308535 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b0ec82c-24e7-4b4f-80e2-fb35c7a59c03 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:09.443550 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4b0ec82c-24e7-4b4f-80e2-fb35c7a59c03 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:09.451738 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4b0ec82c-24e7-4b4f-80e2-fb35c7a59c03 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1522 microversion: 2.1 time: 0.159194 Sep 17 21:35:09.452318 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3099/6286] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:09 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:10.479855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d242c695-03c2-4e4d-ab20-0be90fe1e136 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:10.480909 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d242c695-03c2-4e4d-ab20-0be90fe1e136 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:10.492920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d242c695-03c2-4e4d-ab20-0be90fe1e136 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:10.493853 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d242c695-03c2-4e4d-ab20-0be90fe1e136 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:10.494722 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d242c695-03c2-4e4d-ab20-0be90fe1e136 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:10.495954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d242c695-03c2-4e4d-ab20-0be90fe1e136 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:10.499445 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d242c695-03c2-4e4d-ab20-0be90fe1e136 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:10.500215 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d242c695-03c2-4e4d-ab20-0be90fe1e136 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:10.636384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d242c695-03c2-4e4d-ab20-0be90fe1e136 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:10.644371 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d242c695-03c2-4e4d-ab20-0be90fe1e136 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1522 microversion: 2.1 time: 0.171487 Sep 17 21:35:10.644960 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3188/6287] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:10 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:11.667752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dc3afddd-5de6-4652-b4cd-cfccee8ffaa0 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:11.668368 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dc3afddd-5de6-4652-b4cd-cfccee8ffaa0 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:11.675828 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dc3afddd-5de6-4652-b4cd-cfccee8ffaa0 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:11.676317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dc3afddd-5de6-4652-b4cd-cfccee8ffaa0 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:11.676757 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dc3afddd-5de6-4652-b4cd-cfccee8ffaa0 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:11.677496 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dc3afddd-5de6-4652-b4cd-cfccee8ffaa0 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:11.677996 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dc3afddd-5de6-4652-b4cd-cfccee8ffaa0 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:11.678417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dc3afddd-5de6-4652-b4cd-cfccee8ffaa0 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:11.816529 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dc3afddd-5de6-4652-b4cd-cfccee8ffaa0 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:11.825003 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dc3afddd-5de6-4652-b4cd-cfccee8ffaa0 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1522 microversion: 2.1 time: 0.161172 Sep 17 21:35:11.825598 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3100/6288] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:11 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:12.853040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ff9e61e2-eff2-49ba-a93d-af0f577a4c3b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:12.854085 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ff9e61e2-eff2-49ba-a93d-af0f577a4c3b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:12.865420 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff9e61e2-eff2-49ba-a93d-af0f577a4c3b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:12.866097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff9e61e2-eff2-49ba-a93d-af0f577a4c3b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:12.866523 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff9e61e2-eff2-49ba-a93d-af0f577a4c3b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:12.867265 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff9e61e2-eff2-49ba-a93d-af0f577a4c3b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:12.867801 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff9e61e2-eff2-49ba-a93d-af0f577a4c3b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:12.868295 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff9e61e2-eff2-49ba-a93d-af0f577a4c3b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:13.008110 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ff9e61e2-eff2-49ba-a93d-af0f577a4c3b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:13.017181 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ff9e61e2-eff2-49ba-a93d-af0f577a4c3b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1522 microversion: 2.1 time: 0.170790 Sep 17 21:35:13.017837 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3189/6289] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:12 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:14.044020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3f4e08ee-c268-4519-a8b1-dcef40d63737 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:14.044966 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3f4e08ee-c268-4519-a8b1-dcef40d63737 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:14.055848 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f4e08ee-c268-4519-a8b1-dcef40d63737 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:14.056589 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f4e08ee-c268-4519-a8b1-dcef40d63737 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:14.057261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f4e08ee-c268-4519-a8b1-dcef40d63737 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:14.058375 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f4e08ee-c268-4519-a8b1-dcef40d63737 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:14.059077 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f4e08ee-c268-4519-a8b1-dcef40d63737 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:14.059735 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3f4e08ee-c268-4519-a8b1-dcef40d63737 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:14.207227 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3f4e08ee-c268-4519-a8b1-dcef40d63737 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:14.215520 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3f4e08ee-c268-4519-a8b1-dcef40d63737 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1522 microversion: 2.1 time: 0.177670 Sep 17 21:35:14.216122 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3101/6290] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:14 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:15.243747 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-03604d24-34ce-4605-b2ec-061814e2a1d2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:15.244598 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-03604d24-34ce-4605-b2ec-061814e2a1d2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:15.256938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03604d24-34ce-4605-b2ec-061814e2a1d2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:15.257948 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03604d24-34ce-4605-b2ec-061814e2a1d2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:15.258715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03604d24-34ce-4605-b2ec-061814e2a1d2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:15.259873 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03604d24-34ce-4605-b2ec-061814e2a1d2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:15.260666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03604d24-34ce-4605-b2ec-061814e2a1d2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:15.261388 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-03604d24-34ce-4605-b2ec-061814e2a1d2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:15.398875 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-03604d24-34ce-4605-b2ec-061814e2a1d2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:15.410665 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-03604d24-34ce-4605-b2ec-061814e2a1d2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1522 microversion: 2.1 time: 0.173714 Sep 17 21:35:15.411468 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3190/6291] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:15 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:16.438415 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c61fe1ce-1fe0-4aae-b89e-3a6ba04bf2e5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:16.439395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c61fe1ce-1fe0-4aae-b89e-3a6ba04bf2e5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:16.450546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c61fe1ce-1fe0-4aae-b89e-3a6ba04bf2e5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:16.451362 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c61fe1ce-1fe0-4aae-b89e-3a6ba04bf2e5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:16.452090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c61fe1ce-1fe0-4aae-b89e-3a6ba04bf2e5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:16.453253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c61fe1ce-1fe0-4aae-b89e-3a6ba04bf2e5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:16.454068 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c61fe1ce-1fe0-4aae-b89e-3a6ba04bf2e5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:16.454783 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c61fe1ce-1fe0-4aae-b89e-3a6ba04bf2e5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:16.590871 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c61fe1ce-1fe0-4aae-b89e-3a6ba04bf2e5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:16.598982 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c61fe1ce-1fe0-4aae-b89e-3a6ba04bf2e5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1522 microversion: 2.1 time: 0.167225 Sep 17 21:35:16.599953 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3102/6292] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:16 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:17.626991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b009775e-e75c-4ae9-828a-72613e4a59cd tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:17.628072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b009775e-e75c-4ae9-828a-72613e4a59cd tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:17.638342 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b009775e-e75c-4ae9-828a-72613e4a59cd tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:17.638847 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b009775e-e75c-4ae9-828a-72613e4a59cd tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:17.639305 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b009775e-e75c-4ae9-828a-72613e4a59cd tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:17.640024 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b009775e-e75c-4ae9-828a-72613e4a59cd tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:17.640495 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b009775e-e75c-4ae9-828a-72613e4a59cd tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:17.640935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b009775e-e75c-4ae9-828a-72613e4a59cd tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:17.785366 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b009775e-e75c-4ae9-828a-72613e4a59cd tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:17.794026 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b009775e-e75c-4ae9-828a-72613e4a59cd tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1522 microversion: 2.1 time: 0.173788 Sep 17 21:35:17.794615 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3191/6293] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:17 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:18.822516 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ee50b890-0cef-4e8e-8957-b623dc385fc2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:18.823533 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ee50b890-0cef-4e8e-8957-b623dc385fc2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:18.836420 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee50b890-0cef-4e8e-8957-b623dc385fc2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:18.837238 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee50b890-0cef-4e8e-8957-b623dc385fc2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:18.837974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee50b890-0cef-4e8e-8957-b623dc385fc2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:18.839180 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee50b890-0cef-4e8e-8957-b623dc385fc2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:18.839961 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee50b890-0cef-4e8e-8957-b623dc385fc2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:18.840716 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee50b890-0cef-4e8e-8957-b623dc385fc2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:18.972872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ee50b890-0cef-4e8e-8957-b623dc385fc2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:18.981519 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ee50b890-0cef-4e8e-8957-b623dc385fc2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1522 microversion: 2.1 time: 0.166435 Sep 17 21:35:18.982098 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3103/6294] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:18 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:20.009316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-90d21403-94e1-4cf9-980a-234dcc426983 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:20.010501 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-90d21403-94e1-4cf9-980a-234dcc426983 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:20.019362 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90d21403-94e1-4cf9-980a-234dcc426983 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:20.019902 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90d21403-94e1-4cf9-980a-234dcc426983 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:20.020362 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90d21403-94e1-4cf9-980a-234dcc426983 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:20.021091 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90d21403-94e1-4cf9-980a-234dcc426983 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:20.021607 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90d21403-94e1-4cf9-980a-234dcc426983 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:20.022058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90d21403-94e1-4cf9-980a-234dcc426983 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:20.158933 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-90d21403-94e1-4cf9-980a-234dcc426983 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:20.170594 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-90d21403-94e1-4cf9-980a-234dcc426983 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1522 microversion: 2.1 time: 0.167681 Sep 17 21:35:20.171386 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3192/6295] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:20 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:21.200174 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6fd8285d-a3e9-4e64-809f-d68dc9b81470 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:21.201123 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6fd8285d-a3e9-4e64-809f-d68dc9b81470 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:21.210537 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fd8285d-a3e9-4e64-809f-d68dc9b81470 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:21.211166 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fd8285d-a3e9-4e64-809f-d68dc9b81470 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:21.211986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fd8285d-a3e9-4e64-809f-d68dc9b81470 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:21.213166 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fd8285d-a3e9-4e64-809f-d68dc9b81470 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:21.213945 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fd8285d-a3e9-4e64-809f-d68dc9b81470 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:21.214636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6fd8285d-a3e9-4e64-809f-d68dc9b81470 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:21.353649 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6fd8285d-a3e9-4e64-809f-d68dc9b81470 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:21.362005 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6fd8285d-a3e9-4e64-809f-d68dc9b81470 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1522 microversion: 2.1 time: 0.170580 Sep 17 21:35:21.362561 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3104/6296] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:21 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:22.398044 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b8f2a5aa-2e25-462b-97e1-16b178bd6d1b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:22.399097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b8f2a5aa-2e25-462b-97e1-16b178bd6d1b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:22.408893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b8f2a5aa-2e25-462b-97e1-16b178bd6d1b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:22.409403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b8f2a5aa-2e25-462b-97e1-16b178bd6d1b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:22.409893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b8f2a5aa-2e25-462b-97e1-16b178bd6d1b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:22.410673 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b8f2a5aa-2e25-462b-97e1-16b178bd6d1b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:22.411146 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b8f2a5aa-2e25-462b-97e1-16b178bd6d1b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:22.411592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b8f2a5aa-2e25-462b-97e1-16b178bd6d1b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:22.430499 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:35:22.546010 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b8f2a5aa-2e25-462b-97e1-16b178bd6d1b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:22.554144 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b8f2a5aa-2e25-462b-97e1-16b178bd6d1b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1522 microversion: 2.1 time: 0.162796 Sep 17 21:35:22.554743 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3193/6297] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:22 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:23.578662 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e658a0ad-358c-43d1-acb2-3b5a484ac0ca tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:23.579373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e658a0ad-358c-43d1-acb2-3b5a484ac0ca tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:23.589343 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e658a0ad-358c-43d1-acb2-3b5a484ac0ca tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:23.590078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e658a0ad-358c-43d1-acb2-3b5a484ac0ca tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:23.590699 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e658a0ad-358c-43d1-acb2-3b5a484ac0ca tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:23.591662 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e658a0ad-358c-43d1-acb2-3b5a484ac0ca tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:23.592310 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e658a0ad-358c-43d1-acb2-3b5a484ac0ca tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:23.592897 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e658a0ad-358c-43d1-acb2-3b5a484ac0ca tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:23.737146 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e658a0ad-358c-43d1-acb2-3b5a484ac0ca tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:23.745494 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e658a0ad-358c-43d1-acb2-3b5a484ac0ca tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1522 microversion: 2.1 time: 0.171716 Sep 17 21:35:23.746343 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3105/6298] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:23 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:24.773316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-036526bf-1b8b-4f82-9aa9-592903ae8fdb tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:24.774449 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-036526bf-1b8b-4f82-9aa9-592903ae8fdb tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:24.778098 ncdv-master-1 devstack@n-api.service[140524]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 17 21:35:24.778379 ncdv-master-1 devstack@n-api.service[140524]: Sat Sep 17 21:35:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 (ip 10.222.0.26) !!! Sep 17 21:35:24.789650 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-036526bf-1b8b-4f82-9aa9-592903ae8fdb tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:24.790169 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-036526bf-1b8b-4f82-9aa9-592903ae8fdb tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:24.790630 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-036526bf-1b8b-4f82-9aa9-592903ae8fdb tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:24.791355 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-036526bf-1b8b-4f82-9aa9-592903ae8fdb tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:24.791828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-036526bf-1b8b-4f82-9aa9-592903ae8fdb tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:24.792275 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-036526bf-1b8b-4f82-9aa9-592903ae8fdb tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:24.926064 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-036526bf-1b8b-4f82-9aa9-592903ae8fdb tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:24.934202 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-036526bf-1b8b-4f82-9aa9-592903ae8fdb tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1522 microversion: 2.1 time: 0.167516 Sep 17 21:35:24.934794 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3194/6299] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:24 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:25.964708 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-238c640d-b651-4ea7-853c-5fc433816a65 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:25.965445 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-238c640d-b651-4ea7-853c-5fc433816a65 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:25.974882 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-238c640d-b651-4ea7-853c-5fc433816a65 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:25.975487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-238c640d-b651-4ea7-853c-5fc433816a65 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:25.976033 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-238c640d-b651-4ea7-853c-5fc433816a65 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:25.976900 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-238c640d-b651-4ea7-853c-5fc433816a65 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:25.977495 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-238c640d-b651-4ea7-853c-5fc433816a65 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:25.978122 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-238c640d-b651-4ea7-853c-5fc433816a65 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:25.994189 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:35:26.123067 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-238c640d-b651-4ea7-853c-5fc433816a65 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:26.131774 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-238c640d-b651-4ea7-853c-5fc433816a65 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1522 microversion: 2.1 time: 0.177359 Sep 17 21:35:26.132368 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3106/6300] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:25 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:27.159527 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6cae7827-00ee-4376-97c6-dde6f795392f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:27.160550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6cae7827-00ee-4376-97c6-dde6f795392f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:27.172302 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6cae7827-00ee-4376-97c6-dde6f795392f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:27.173154 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6cae7827-00ee-4376-97c6-dde6f795392f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:27.174213 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6cae7827-00ee-4376-97c6-dde6f795392f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:27.175122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6cae7827-00ee-4376-97c6-dde6f795392f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:27.175591 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6cae7827-00ee-4376-97c6-dde6f795392f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:27.176064 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6cae7827-00ee-4376-97c6-dde6f795392f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:27.314190 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6cae7827-00ee-4376-97c6-dde6f795392f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:27.322186 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6cae7827-00ee-4376-97c6-dde6f795392f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1522 microversion: 2.1 time: 0.169455 Sep 17 21:35:27.322822 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3195/6301] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:27 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:28.345885 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7abbaefb-22fc-4f89-8b79-ec1f97ba211c tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:28.346440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7abbaefb-22fc-4f89-8b79-ec1f97ba211c tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:28.354586 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7abbaefb-22fc-4f89-8b79-ec1f97ba211c tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:28.355081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7abbaefb-22fc-4f89-8b79-ec1f97ba211c tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:28.355523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7abbaefb-22fc-4f89-8b79-ec1f97ba211c tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:28.356231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7abbaefb-22fc-4f89-8b79-ec1f97ba211c tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:28.356752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7abbaefb-22fc-4f89-8b79-ec1f97ba211c tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:28.357191 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7abbaefb-22fc-4f89-8b79-ec1f97ba211c tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:28.492581 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7abbaefb-22fc-4f89-8b79-ec1f97ba211c tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:28.501044 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7abbaefb-22fc-4f89-8b79-ec1f97ba211c tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1522 microversion: 2.1 time: 0.159354 Sep 17 21:35:28.501657 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3107/6302] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:28 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:29.529052 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-edcf2342-6880-49ca-afb3-6e792170d04f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:29.530119 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-edcf2342-6880-49ca-afb3-6e792170d04f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:29.541969 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-edcf2342-6880-49ca-afb3-6e792170d04f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:29.542809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-edcf2342-6880-49ca-afb3-6e792170d04f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:29.543576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-edcf2342-6880-49ca-afb3-6e792170d04f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:29.544803 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-edcf2342-6880-49ca-afb3-6e792170d04f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:29.545633 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-edcf2342-6880-49ca-afb3-6e792170d04f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:29.546345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-edcf2342-6880-49ca-afb3-6e792170d04f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:29.678806 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-edcf2342-6880-49ca-afb3-6e792170d04f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:29.687636 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-edcf2342-6880-49ca-afb3-6e792170d04f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1522 microversion: 2.1 time: 0.165229 Sep 17 21:35:29.689553 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3196/6303] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:29 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:30.577199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-e1970770-88a2-41da-bd2e-91d1561ef323 req-d092ceff-8c57-47f7-9203-0f14beb83296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d6a97c-6bfd-4c8b-814c-ae62587bba75", "name": "network-vif-unplugged", "status": "completed", "tag": "70e9091e-4457-4be7-adb6-07ae91e512f6"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:35:30.583105 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=36 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:35:30.590115 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-e1970770-88a2-41da-bd2e-91d1561ef323 req-d092ceff-8c57-47f7-9203-0f14beb83296 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:30.590680 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-e1970770-88a2-41da-bd2e-91d1561ef323 req-d092ceff-8c57-47f7-9203-0f14beb83296 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:30.591152 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-e1970770-88a2-41da-bd2e-91d1561ef323 req-d092ceff-8c57-47f7-9203-0f14beb83296 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:30.604265 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-e1970770-88a2-41da-bd2e-91d1561ef323 req-d092ceff-8c57-47f7-9203-0f14beb83296 service nova] Creating event network-vif-unplugged:70e9091e-4457-4be7-adb6-07ae91e512f6 for instance 57d6a97c-6bfd-4c8b-814c-ae62587bba75 on nch1-master-1 Sep 17 21:35:30.610021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [req-e1970770-88a2-41da-bd2e-91d1561ef323 req-d092ceff-8c57-47f7-9203-0f14beb83296 service nova] Instance 57d6a97c-6bfd-4c8b-814c-ae62587bba75 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140523) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 21:35:30.621316 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-e1970770-88a2-41da-bd2e-91d1561ef323 req-d092ceff-8c57-47f7-9203-0f14beb83296 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048380 Sep 17 21:35:30.622165 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3108/6304] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:35:30.711303 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3859bd4d-7678-4cc1-b115-71aa133c21d5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:30.711961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3859bd4d-7678-4cc1-b115-71aa133c21d5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:30.714829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=32 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:35:30.720249 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3859bd4d-7678-4cc1-b115-71aa133c21d5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:30.720775 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3859bd4d-7678-4cc1-b115-71aa133c21d5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:30.721255 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3859bd4d-7678-4cc1-b115-71aa133c21d5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:30.722119 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3859bd4d-7678-4cc1-b115-71aa133c21d5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:30.722616 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3859bd4d-7678-4cc1-b115-71aa133c21d5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:30.723063 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3859bd4d-7678-4cc1-b115-71aa133c21d5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:30.857272 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3859bd4d-7678-4cc1-b115-71aa133c21d5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:30.867995 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3859bd4d-7678-4cc1-b115-71aa133c21d5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1521 microversion: 2.1 time: 0.160530 Sep 17 21:35:30.868686 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3197/6305] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:30 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:31.895779 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7391f510-124a-48e1-b04a-5003183be6ee tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:31.896474 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7391f510-124a-48e1-b04a-5003183be6ee tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:31.904537 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7391f510-124a-48e1-b04a-5003183be6ee tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:31.905042 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7391f510-124a-48e1-b04a-5003183be6ee tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:31.905491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7391f510-124a-48e1-b04a-5003183be6ee tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:31.906231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7391f510-124a-48e1-b04a-5003183be6ee tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:31.906684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7391f510-124a-48e1-b04a-5003183be6ee tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:31.907333 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7391f510-124a-48e1-b04a-5003183be6ee tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:32.056638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7391f510-124a-48e1-b04a-5003183be6ee tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:32.064763 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7391f510-124a-48e1-b04a-5003183be6ee tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1519 microversion: 2.1 time: 0.175023 Sep 17 21:35:32.065366 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3109/6306] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:31 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:32.638391 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-20d9ba53-9365-46d0-b650-53a898f481f2 req-d3982c84-5330-4e0f-a138-c4cfa6a7cd3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57d6a97c-6bfd-4c8b-814c-ae62587bba75", "tag": "70e9091e-4457-4be7-adb6-07ae91e512f6"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:35:32.650732 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-20d9ba53-9365-46d0-b650-53a898f481f2 req-d3982c84-5330-4e0f-a138-c4cfa6a7cd3d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:32.651374 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-20d9ba53-9365-46d0-b650-53a898f481f2 req-d3982c84-5330-4e0f-a138-c4cfa6a7cd3d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:32.651827 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-20d9ba53-9365-46d0-b650-53a898f481f2 req-d3982c84-5330-4e0f-a138-c4cfa6a7cd3d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:32.664447 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-20d9ba53-9365-46d0-b650-53a898f481f2 req-d3982c84-5330-4e0f-a138-c4cfa6a7cd3d service nova] Creating event network-changed:70e9091e-4457-4be7-adb6-07ae91e512f6 for instance 57d6a97c-6bfd-4c8b-814c-ae62587bba75 on nch1-master-1 Sep 17 21:35:32.670349 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [req-20d9ba53-9365-46d0-b650-53a898f481f2 req-d3982c84-5330-4e0f-a138-c4cfa6a7cd3d service nova] Instance 57d6a97c-6bfd-4c8b-814c-ae62587bba75 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140524) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 21:35:32.682301 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-20d9ba53-9365-46d0-b650-53a898f481f2 req-d3982c84-5330-4e0f-a138-c4cfa6a7cd3d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047619 Sep 17 21:35:32.682932 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3198/6307] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:35:33.089815 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-06e505a2-d563-4b39-a31f-30cdc5f94af0 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:33.090444 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-06e505a2-d563-4b39-a31f-30cdc5f94af0 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:33.097962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06e505a2-d563-4b39-a31f-30cdc5f94af0 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:33.098450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06e505a2-d563-4b39-a31f-30cdc5f94af0 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:33.099233 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06e505a2-d563-4b39-a31f-30cdc5f94af0 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:33.099939 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06e505a2-d563-4b39-a31f-30cdc5f94af0 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:33.100389 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06e505a2-d563-4b39-a31f-30cdc5f94af0 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:33.100818 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-06e505a2-d563-4b39-a31f-30cdc5f94af0 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:33.232402 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-06e505a2-d563-4b39-a31f-30cdc5f94af0 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:33.240454 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-06e505a2-d563-4b39-a31f-30cdc5f94af0 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1516 microversion: 2.1 time: 0.155781 Sep 17 21:35:33.241072 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3110/6308] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:33 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:33.263998 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-42c112b9-a315-4e7c-94db-7e0b5763f6c1 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:35:33.264636 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-42c112b9-a315-4e7c-94db-7e0b5763f6c1 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:33.271149 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42c112b9-a315-4e7c-94db-7e0b5763f6c1 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:33.271653 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42c112b9-a315-4e7c-94db-7e0b5763f6c1 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:33.272102 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42c112b9-a315-4e7c-94db-7e0b5763f6c1 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:33.272811 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42c112b9-a315-4e7c-94db-7e0b5763f6c1 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:33.273276 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42c112b9-a315-4e7c-94db-7e0b5763f6c1 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:33.273743 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-42c112b9-a315-4e7c-94db-7e0b5763f6c1 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:33.333316 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-42c112b9-a315-4e7c-94db-7e0b5763f6c1 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "POST /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75/action" status: 204 len: 0 microversion: 2.1 time: 0.073611 Sep 17 21:35:33.334015 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3199/6309] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:35:33 2022] POST /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:35:33.342229 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f2721506-55c5-468d-b2cf-e2826318670b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:33.343088 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f2721506-55c5-468d-b2cf-e2826318670b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:33.350156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2721506-55c5-468d-b2cf-e2826318670b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:33.350909 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2721506-55c5-468d-b2cf-e2826318670b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:33.351573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2721506-55c5-468d-b2cf-e2826318670b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:33.352480 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2721506-55c5-468d-b2cf-e2826318670b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:33.353139 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2721506-55c5-468d-b2cf-e2826318670b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:33.353660 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f2721506-55c5-468d-b2cf-e2826318670b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:33.616954 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f2721506-55c5-468d-b2cf-e2826318670b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:33.625659 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f2721506-55c5-468d-b2cf-e2826318670b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1516 microversion: 2.1 time: 0.287279 Sep 17 21:35:33.626467 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3111/6310] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:33 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1516 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:34.650747 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9096a479-1ad9-4268-9c5c-4b460c3aa767 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:34.651591 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9096a479-1ad9-4268-9c5c-4b460c3aa767 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:34.658484 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9096a479-1ad9-4268-9c5c-4b460c3aa767 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:34.658998 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9096a479-1ad9-4268-9c5c-4b460c3aa767 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:34.659444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9096a479-1ad9-4268-9c5c-4b460c3aa767 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:34.660202 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9096a479-1ad9-4268-9c5c-4b460c3aa767 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:34.660671 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9096a479-1ad9-4268-9c5c-4b460c3aa767 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:34.661193 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9096a479-1ad9-4268-9c5c-4b460c3aa767 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:34.818051 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9096a479-1ad9-4268-9c5c-4b460c3aa767 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:34.825938 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9096a479-1ad9-4268-9c5c-4b460c3aa767 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1508 microversion: 2.1 time: 0.180507 Sep 17 21:35:34.826513 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3200/6311] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:34 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1508 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:34.848399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b207a371-bdc7-46a6-a48b-d980f96aa566 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:34.849363 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b207a371-bdc7-46a6-a48b-d980f96aa566 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:34.856400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b207a371-bdc7-46a6-a48b-d980f96aa566 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:34.856888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b207a371-bdc7-46a6-a48b-d980f96aa566 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:34.857330 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b207a371-bdc7-46a6-a48b-d980f96aa566 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:34.858091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b207a371-bdc7-46a6-a48b-d980f96aa566 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:34.858552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b207a371-bdc7-46a6-a48b-d980f96aa566 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:34.858984 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b207a371-bdc7-46a6-a48b-d980f96aa566 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:34.992167 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b207a371-bdc7-46a6-a48b-d980f96aa566 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:35.000895 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b207a371-bdc7-46a6-a48b-d980f96aa566 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1508 microversion: 2.1 time: 0.156300 Sep 17 21:35:35.001569 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3112/6312] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:34 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:35.044852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ec086d6b-790d-4629-b1d7-4145e7ff46b1 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Action: 'create', calling method: .version_select at 0x7f259ff3ba60>, body: {"keypair": {"name": "tempest-keypair-1799595118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEdJHvG8t2brsc8DIjUzvjLNv1ieFgAcBtW0qEkyzPXSqFIhpj3foLUut1O5N4frsCvFwXE4Eq0XyJopBGVcwSjWHzE/kFra2AAH1/Hi71cd11PJ9aEBXI2V+hRzWsA8nQ=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:35:35.068764 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-ec086d6b-790d-4629-b1d7-4145e7ff46b1 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Getting quotas for project 2412712d1e76496a892826131215475f. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:35:35.074302 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-ec086d6b-790d-4629-b1d7-4145e7ff46b1 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Getting quotas for user da549e8947e445fea05a3969c98c732e and project 2412712d1e76496a892826131215475f. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:35:35.114253 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ec086d6b-790d-4629-b1d7-4145e7ff46b1 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.073170 Sep 17 21:35:35.115152 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3201/6313] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:35:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:35:36.342421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-25d1f919-9407-4a0c-a074-38f67e09c193 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:36.343046 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-25d1f919-9407-4a0c-a074-38f67e09c193 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:36.350473 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25d1f919-9407-4a0c-a074-38f67e09c193 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:36.351935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25d1f919-9407-4a0c-a074-38f67e09c193 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:36.352382 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25d1f919-9407-4a0c-a074-38f67e09c193 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:36.353120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25d1f919-9407-4a0c-a074-38f67e09c193 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:36.353609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25d1f919-9407-4a0c-a074-38f67e09c193 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:36.354021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25d1f919-9407-4a0c-a074-38f67e09c193 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:36.485038 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-db33801e-f849-40ae-85a3-8a0968197f00 req-6d330ce5-3c06-4412-b1f6-16f36249bbe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d6a97c-6bfd-4c8b-814c-ae62587bba75", "name": "network-vif-plugged", "status": "completed", "tag": "70e9091e-4457-4be7-adb6-07ae91e512f6"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:35:36.497936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-db33801e-f849-40ae-85a3-8a0968197f00 req-6d330ce5-3c06-4412-b1f6-16f36249bbe4 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:36.498565 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-db33801e-f849-40ae-85a3-8a0968197f00 req-6d330ce5-3c06-4412-b1f6-16f36249bbe4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:36.499150 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-db33801e-f849-40ae-85a3-8a0968197f00 req-6d330ce5-3c06-4412-b1f6-16f36249bbe4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:36.502902 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-25d1f919-9407-4a0c-a074-38f67e09c193 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:36.511058 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-db33801e-f849-40ae-85a3-8a0968197f00 req-6d330ce5-3c06-4412-b1f6-16f36249bbe4 service nova] Creating event network-vif-plugged:70e9091e-4457-4be7-adb6-07ae91e512f6 for instance 57d6a97c-6bfd-4c8b-814c-ae62587bba75 on nch1-master-1 Sep 17 21:35:36.511247 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-25d1f919-9407-4a0c-a074-38f67e09c193 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 200 len: 1508 microversion: 2.1 time: 0.172835 Sep 17 21:35:36.511658 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3113/6314] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:36 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:36.525780 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-db33801e-f849-40ae-85a3-8a0968197f00 req-6d330ce5-3c06-4412-b1f6-16f36249bbe4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042685 Sep 17 21:35:36.525780 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3202/6315] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:35:36.534687 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bf4c9d75-b94e-450a-a239-1fb5161fd0fb tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:36.535301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bf4c9d75-b94e-450a-a239-1fb5161fd0fb tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:36.542607 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf4c9d75-b94e-450a-a239-1fb5161fd0fb tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:36.543117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf4c9d75-b94e-450a-a239-1fb5161fd0fb tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:36.543690 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf4c9d75-b94e-450a-a239-1fb5161fd0fb tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:36.544286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf4c9d75-b94e-450a-a239-1fb5161fd0fb tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:36.544769 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf4c9d75-b94e-450a-a239-1fb5161fd0fb tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:36.545214 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bf4c9d75-b94e-450a-a239-1fb5161fd0fb tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:36.574871 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bf4c9d75-b94e-450a-a239-1fb5161fd0fb tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:35:36.663245 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bf4c9d75-b94e-450a-a239-1fb5161fd0fb tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "DELETE /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 204 len: 0 microversion: 2.1 time: 0.132658 Sep 17 21:35:36.663856 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3203/6316] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:35:36 2022] DELETE /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 17 21:35:36.749356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f4db77ce-86d8-4aea-998f-f164eedda6a3 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1454605987", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "15428757-7faf-42e8-b5e5-905607f6e4b3"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:35:36.806409 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-f4db77ce-86d8-4aea-998f-f164eedda6a3 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] validate_networks() for [('15428757-7faf-42e8-b5e5-905607f6e4b3', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:35:37.202278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-f4db77ce-86d8-4aea-998f-f164eedda6a3 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:35:37.202706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-f4db77ce-86d8-4aea-998f-f164eedda6a3 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:35:37.203246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-f4db77ce-86d8-4aea-998f-f164eedda6a3 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:35:37.203658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-f4db77ce-86d8-4aea-998f-f164eedda6a3 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:35:37.204073 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-f4db77ce-86d8-4aea-998f-f164eedda6a3 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:35:37.213861 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f4db77ce-86d8-4aea-998f-f164eedda6a3 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:37.214347 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f4db77ce-86d8-4aea-998f-f164eedda6a3 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:37.214785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f4db77ce-86d8-4aea-998f-f164eedda6a3 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:37.215520 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f4db77ce-86d8-4aea-998f-f164eedda6a3 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:37.215974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f4db77ce-86d8-4aea-998f-f164eedda6a3 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:37.216400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f4db77ce-86d8-4aea-998f-f164eedda6a3 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:37.234492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-f4db77ce-86d8-4aea-998f-f164eedda6a3 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Getting quotas for project 2412712d1e76496a892826131215475f. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:35:37.240150 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-f4db77ce-86d8-4aea-998f-f164eedda6a3 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Getting quotas for user da549e8947e445fea05a3969c98c732e and project 2412712d1e76496a892826131215475f. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:35:37.254159 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f4db77ce-86d8-4aea-998f-f164eedda6a3 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:35:37.256406 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f4db77ce-86d8-4aea-998f-f164eedda6a3 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:35:37.303771 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f4db77ce-86d8-4aea-998f-f164eedda6a3 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.558303 Sep 17 21:35:37.304428 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3114/6317] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:35:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:35:37.316841 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5d490263-2aec-4dd5-8166-4e640173f9ff tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:37.317701 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5d490263-2aec-4dd5-8166-4e640173f9ff tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:37.373543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5d490263-2aec-4dd5-8166-4e640173f9ff tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:37.380660 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5d490263-2aec-4dd5-8166-4e640173f9ff tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1218 microversion: 2.1 time: 0.068526 Sep 17 21:35:37.381237 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3204/6318] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:37 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:38.405206 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b1b2e719-05ec-40a2-aa71-07d81b44803e tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:38.406642 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b1b2e719-05ec-40a2-aa71-07d81b44803e tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:38.414833 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b1b2e719-05ec-40a2-aa71-07d81b44803e tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:38.415552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b1b2e719-05ec-40a2-aa71-07d81b44803e tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:38.416197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b1b2e719-05ec-40a2-aa71-07d81b44803e tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:38.416926 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b1b2e719-05ec-40a2-aa71-07d81b44803e tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:38.418304 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b1b2e719-05ec-40a2-aa71-07d81b44803e tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:38.418945 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b1b2e719-05ec-40a2-aa71-07d81b44803e tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:38.501633 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b1b2e719-05ec-40a2-aa71-07d81b44803e tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:38.511512 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b1b2e719-05ec-40a2-aa71-07d81b44803e tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1278 microversion: 2.1 time: 0.111508 Sep 17 21:35:38.512683 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3115/6319] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:38 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1278 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:38.543100 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-318e1d24-d801-43fc-998f-3f8a6028f015 req-6c166721-ccdd-4d2c-a9d5-8dd92c3724b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d6a97c-6bfd-4c8b-814c-ae62587bba75", "name": "network-vif-deleted", "tag": "70e9091e-4457-4be7-adb6-07ae91e512f6"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:35:38.554904 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-318e1d24-d801-43fc-998f-3f8a6028f015 req-6c166721-ccdd-4d2c-a9d5-8dd92c3724b0 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:38.555412 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-318e1d24-d801-43fc-998f-3f8a6028f015 req-6c166721-ccdd-4d2c-a9d5-8dd92c3724b0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:38.555870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-318e1d24-d801-43fc-998f-3f8a6028f015 req-6c166721-ccdd-4d2c-a9d5-8dd92c3724b0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:38.566900 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-318e1d24-d801-43fc-998f-3f8a6028f015 req-6c166721-ccdd-4d2c-a9d5-8dd92c3724b0 service nova] Creating event network-vif-deleted:70e9091e-4457-4be7-adb6-07ae91e512f6 for instance 57d6a97c-6bfd-4c8b-814c-ae62587bba75 on nch1-master-1 Sep 17 21:35:38.572896 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-318e1d24-d801-43fc-998f-3f8a6028f015 req-6c166721-ccdd-4d2c-a9d5-8dd92c3724b0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033412 Sep 17 21:35:38.575325 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3205/6320] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:35:39.535912 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2fec7135-d545-4743-b2d7-4246435a4942 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:39.536624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2fec7135-d545-4743-b2d7-4246435a4942 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:39.544967 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2fec7135-d545-4743-b2d7-4246435a4942 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:39.545651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2fec7135-d545-4743-b2d7-4246435a4942 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:39.546196 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2fec7135-d545-4743-b2d7-4246435a4942 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:39.547019 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2fec7135-d545-4743-b2d7-4246435a4942 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:39.547617 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2fec7135-d545-4743-b2d7-4246435a4942 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:39.548166 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2fec7135-d545-4743-b2d7-4246435a4942 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:39.687476 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2fec7135-d545-4743-b2d7-4246435a4942 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:39.697050 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2fec7135-d545-4743-b2d7-4246435a4942 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1318 microversion: 2.1 time: 0.165254 Sep 17 21:35:39.697800 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3116/6321] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:39 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:35:40.603103 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-b53edab4-ef83-4213-b08c-d215ba860048 req-ec4a3187-7efd-4f10-953d-296f4012a7ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64812704-330f-49d3-9db4-6f90b796a0ac", "tag": "b38457fd-85db-45ce-bf49-d6f9601976f5"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:35:40.613662 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b53edab4-ef83-4213-b08c-d215ba860048 req-ec4a3187-7efd-4f10-953d-296f4012a7ec service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:40.614183 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b53edab4-ef83-4213-b08c-d215ba860048 req-ec4a3187-7efd-4f10-953d-296f4012a7ec service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:40.614633 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b53edab4-ef83-4213-b08c-d215ba860048 req-ec4a3187-7efd-4f10-953d-296f4012a7ec service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:40.626027 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-b53edab4-ef83-4213-b08c-d215ba860048 req-ec4a3187-7efd-4f10-953d-296f4012a7ec service nova] Creating event network-changed:b38457fd-85db-45ce-bf49-d6f9601976f5 for instance 64812704-330f-49d3-9db4-6f90b796a0ac on nch1-master-1 Sep 17 21:35:40.630937 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-b53edab4-ef83-4213-b08c-d215ba860048 req-ec4a3187-7efd-4f10-953d-296f4012a7ec service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033496 Sep 17 21:35:40.631571 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3206/6322] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:35:40.720595 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-81c4293b-e657-413d-ab71-34d23ef504fc tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:40.721324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-81c4293b-e657-413d-ab71-34d23ef504fc tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:40.729120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81c4293b-e657-413d-ab71-34d23ef504fc tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:40.729636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81c4293b-e657-413d-ab71-34d23ef504fc tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:40.730141 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81c4293b-e657-413d-ab71-34d23ef504fc tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:40.730903 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81c4293b-e657-413d-ab71-34d23ef504fc tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:40.731318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81c4293b-e657-413d-ab71-34d23ef504fc tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:40.731753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-81c4293b-e657-413d-ab71-34d23ef504fc tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:40.866236 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-81c4293b-e657-413d-ab71-34d23ef504fc tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:40.875256 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-81c4293b-e657-413d-ab71-34d23ef504fc tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1318 microversion: 2.1 time: 0.158747 Sep 17 21:35:40.875865 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3117/6323] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:40 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:41.899275 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c1c61878-d49b-4aba-be32-110badecee1d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:41.899991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c1c61878-d49b-4aba-be32-110badecee1d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:41.907168 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1c61878-d49b-4aba-be32-110badecee1d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:41.907717 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1c61878-d49b-4aba-be32-110badecee1d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:41.908171 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1c61878-d49b-4aba-be32-110badecee1d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:41.909102 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1c61878-d49b-4aba-be32-110badecee1d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:41.909598 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1c61878-d49b-4aba-be32-110badecee1d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:41.910276 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c1c61878-d49b-4aba-be32-110badecee1d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:42.043606 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c1c61878-d49b-4aba-be32-110badecee1d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:42.054098 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c1c61878-d49b-4aba-be32-110badecee1d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1318 microversion: 2.1 time: 0.159418 Sep 17 21:35:42.054685 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3207/6324] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:41 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:43.081580 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fbb5cad4-9297-457d-8c1a-6e612bd42584 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:43.082508 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fbb5cad4-9297-457d-8c1a-6e612bd42584 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:43.094307 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fbb5cad4-9297-457d-8c1a-6e612bd42584 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:43.095132 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fbb5cad4-9297-457d-8c1a-6e612bd42584 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:43.095917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fbb5cad4-9297-457d-8c1a-6e612bd42584 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:43.097075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fbb5cad4-9297-457d-8c1a-6e612bd42584 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:43.097897 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fbb5cad4-9297-457d-8c1a-6e612bd42584 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:43.098968 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fbb5cad4-9297-457d-8c1a-6e612bd42584 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:43.248179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fbb5cad4-9297-457d-8c1a-6e612bd42584 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:43.256625 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fbb5cad4-9297-457d-8c1a-6e612bd42584 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1318 microversion: 2.1 time: 0.181816 Sep 17 21:35:43.257214 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3118/6325] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:43 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:44.283615 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-08a11623-e2c5-42da-9aee-1344ec062ec5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:44.284685 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-08a11623-e2c5-42da-9aee-1344ec062ec5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:44.292696 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-08a11623-e2c5-42da-9aee-1344ec062ec5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:44.293208 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-08a11623-e2c5-42da-9aee-1344ec062ec5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:44.293675 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-08a11623-e2c5-42da-9aee-1344ec062ec5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:44.294427 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-08a11623-e2c5-42da-9aee-1344ec062ec5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:44.294937 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-08a11623-e2c5-42da-9aee-1344ec062ec5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:44.296999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-08a11623-e2c5-42da-9aee-1344ec062ec5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:44.434533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-08a11623-e2c5-42da-9aee-1344ec062ec5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:44.442681 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-08a11623-e2c5-42da-9aee-1344ec062ec5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1318 microversion: 2.1 time: 0.165978 Sep 17 21:35:44.443250 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3208/6326] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:44 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:45.465949 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e24e339a-9fc4-46e1-a820-567bd7bf1cf8 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:45.466580 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e24e339a-9fc4-46e1-a820-567bd7bf1cf8 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:45.474568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e24e339a-9fc4-46e1-a820-567bd7bf1cf8 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:45.475065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e24e339a-9fc4-46e1-a820-567bd7bf1cf8 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:45.475507 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e24e339a-9fc4-46e1-a820-567bd7bf1cf8 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:45.476219 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e24e339a-9fc4-46e1-a820-567bd7bf1cf8 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:45.476799 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e24e339a-9fc4-46e1-a820-567bd7bf1cf8 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:45.477323 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e24e339a-9fc4-46e1-a820-567bd7bf1cf8 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:45.616831 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e24e339a-9fc4-46e1-a820-567bd7bf1cf8 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:45.625153 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e24e339a-9fc4-46e1-a820-567bd7bf1cf8 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1318 microversion: 2.1 time: 0.163239 Sep 17 21:35:45.625782 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3119/6327] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:45 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:46.648328 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a7a377e9-c9fe-4220-8547-1582e1dad08d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:46.648979 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a7a377e9-c9fe-4220-8547-1582e1dad08d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:46.657695 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7a377e9-c9fe-4220-8547-1582e1dad08d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:46.658234 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7a377e9-c9fe-4220-8547-1582e1dad08d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:46.658679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7a377e9-c9fe-4220-8547-1582e1dad08d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:46.659410 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7a377e9-c9fe-4220-8547-1582e1dad08d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:46.659885 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7a377e9-c9fe-4220-8547-1582e1dad08d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:46.660329 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7a377e9-c9fe-4220-8547-1582e1dad08d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:46.680088 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-ec13e961-af33-4132-a582-939c0eebceeb req-e1326995-fca3-497c-b18f-c9057928c29f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64812704-330f-49d3-9db4-6f90b796a0ac", "name": "network-vif-plugged", "status": "completed", "tag": "b38457fd-85db-45ce-bf49-d6f9601976f5"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:35:46.695375 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-ec13e961-af33-4132-a582-939c0eebceeb req-e1326995-fca3-497c-b18f-c9057928c29f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:46.696134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-ec13e961-af33-4132-a582-939c0eebceeb req-e1326995-fca3-497c-b18f-c9057928c29f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:46.696649 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-ec13e961-af33-4132-a582-939c0eebceeb req-e1326995-fca3-497c-b18f-c9057928c29f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:46.711733 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-ec13e961-af33-4132-a582-939c0eebceeb req-e1326995-fca3-497c-b18f-c9057928c29f service nova] Creating event network-vif-plugged:b38457fd-85db-45ce-bf49-d6f9601976f5 for instance 64812704-330f-49d3-9db4-6f90b796a0ac on nch1-master-1 Sep 17 21:35:46.716929 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-ec13e961-af33-4132-a582-939c0eebceeb req-e1326995-fca3-497c-b18f-c9057928c29f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041891 Sep 17 21:35:46.717576 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3120/6328] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:35:46.806982 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a7a377e9-c9fe-4220-8547-1582e1dad08d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:46.815070 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a7a377e9-c9fe-4220-8547-1582e1dad08d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1318 microversion: 2.1 time: 0.170986 Sep 17 21:35:46.815648 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3209/6329] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:46 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:47.835163 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:35:47.835997 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:35:47.840901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4fbcb5ab-2dba-45af-903c-1d946a7d5e08 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:47.841653 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4fbcb5ab-2dba-45af-903c-1d946a7d5e08 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:47.849263 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4fbcb5ab-2dba-45af-903c-1d946a7d5e08 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:47.849796 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4fbcb5ab-2dba-45af-903c-1d946a7d5e08 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:47.850300 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4fbcb5ab-2dba-45af-903c-1d946a7d5e08 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:47.851099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4fbcb5ab-2dba-45af-903c-1d946a7d5e08 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:47.851561 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4fbcb5ab-2dba-45af-903c-1d946a7d5e08 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:47.851997 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4fbcb5ab-2dba-45af-903c-1d946a7d5e08 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:47.985907 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4fbcb5ab-2dba-45af-903c-1d946a7d5e08 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:47.998044 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4fbcb5ab-2dba-45af-903c-1d946a7d5e08 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1508 microversion: 2.1 time: 0.163630 Sep 17 21:35:47.998929 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3121/6330] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:47 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:48.021513 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2cac25d4-a87a-4194-ab76-5e6576b382ca tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:48.022211 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2cac25d4-a87a-4194-ab76-5e6576b382ca tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:48.024283 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=6 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:35:48.031693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2cac25d4-a87a-4194-ab76-5e6576b382ca tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:48.032431 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2cac25d4-a87a-4194-ab76-5e6576b382ca tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:48.033113 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2cac25d4-a87a-4194-ab76-5e6576b382ca tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:48.034299 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2cac25d4-a87a-4194-ab76-5e6576b382ca tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:48.034893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2cac25d4-a87a-4194-ab76-5e6576b382ca tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:48.035346 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2cac25d4-a87a-4194-ab76-5e6576b382ca tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:48.168048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2cac25d4-a87a-4194-ab76-5e6576b382ca tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:48.176051 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2cac25d4-a87a-4194-ab76-5e6576b382ca tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1508 microversion: 2.1 time: 0.158456 Sep 17 21:35:48.176641 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3210/6331] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:48 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:48.198148 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3fb16ad9-7683-4cff-9526-402e8be320f5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:35:48.200540 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3fb16ad9-7683-4cff-9526-402e8be320f5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:48.206914 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3fb16ad9-7683-4cff-9526-402e8be320f5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:48.207502 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3fb16ad9-7683-4cff-9526-402e8be320f5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:48.207942 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3fb16ad9-7683-4cff-9526-402e8be320f5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:48.208635 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3fb16ad9-7683-4cff-9526-402e8be320f5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:48.209092 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3fb16ad9-7683-4cff-9526-402e8be320f5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:48.209576 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3fb16ad9-7683-4cff-9526-402e8be320f5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:48.238362 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3fb16ad9-7683-4cff-9526-402e8be320f5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:48.243831 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3fb16ad9-7683-4cff-9526-402e8be320f5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Old instance type m1.heat2, new instance type m1.heat {{(pid=140523) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 17 21:35:48.250519 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-3fb16ad9-7683-4cff-9526-402e8be320f5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:35:48.250935 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-3fb16ad9-7683-4cff-9526-402e8be320f5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:35:48.251404 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-3fb16ad9-7683-4cff-9526-402e8be320f5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:35:48.251808 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-3fb16ad9-7683-4cff-9526-402e8be320f5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:35:48.252223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-3fb16ad9-7683-4cff-9526-402e8be320f5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:35:48.329021 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3fb16ad9-7683-4cff-9526-402e8be320f5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "POST /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac/action" status: 202 len: 0 microversion: 2.1 time: 0.134854 Sep 17 21:35:48.329698 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3122/6332] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:35:48 2022] POST /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:35:48.338273 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-10e4354d-453a-4b8e-82bf-2443a6a9fbab tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:48.338912 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-10e4354d-453a-4b8e-82bf-2443a6a9fbab tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:48.345342 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10e4354d-453a-4b8e-82bf-2443a6a9fbab tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:48.345875 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10e4354d-453a-4b8e-82bf-2443a6a9fbab tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:48.346332 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10e4354d-453a-4b8e-82bf-2443a6a9fbab tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:48.347058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10e4354d-453a-4b8e-82bf-2443a6a9fbab tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:48.347534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10e4354d-453a-4b8e-82bf-2443a6a9fbab tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:48.347977 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-10e4354d-453a-4b8e-82bf-2443a6a9fbab tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:48.502571 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-10e4354d-453a-4b8e-82bf-2443a6a9fbab tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:48.504897 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:35:48.511834 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-10e4354d-453a-4b8e-82bf-2443a6a9fbab tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1515 microversion: 2.1 time: 0.177633 Sep 17 21:35:48.512433 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3211/6333] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:48 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:49.537874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1896e68e-4bd3-482e-afba-dfd6de1f0864 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:49.538995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1896e68e-4bd3-482e-afba-dfd6de1f0864 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:49.550713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1896e68e-4bd3-482e-afba-dfd6de1f0864 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:49.551261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1896e68e-4bd3-482e-afba-dfd6de1f0864 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:49.552121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1896e68e-4bd3-482e-afba-dfd6de1f0864 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:49.552920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1896e68e-4bd3-482e-afba-dfd6de1f0864 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:49.553377 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1896e68e-4bd3-482e-afba-dfd6de1f0864 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:49.553831 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1896e68e-4bd3-482e-afba-dfd6de1f0864 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:49.571856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:35:49.695204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1896e68e-4bd3-482e-afba-dfd6de1f0864 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:49.703236 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1896e68e-4bd3-482e-afba-dfd6de1f0864 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1515 microversion: 2.1 time: 0.171173 Sep 17 21:35:49.703831 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3123/6334] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:49 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:50.728050 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b1c5f36e-0ecc-43ea-ade5-e067fd4681a6 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:50.728667 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b1c5f36e-0ecc-43ea-ade5-e067fd4681a6 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:50.739069 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1c5f36e-0ecc-43ea-ade5-e067fd4681a6 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:50.739592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1c5f36e-0ecc-43ea-ade5-e067fd4681a6 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:50.740055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1c5f36e-0ecc-43ea-ade5-e067fd4681a6 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:50.740776 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1c5f36e-0ecc-43ea-ade5-e067fd4681a6 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:50.741250 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1c5f36e-0ecc-43ea-ade5-e067fd4681a6 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:50.741725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b1c5f36e-0ecc-43ea-ade5-e067fd4681a6 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:50.887784 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b1c5f36e-0ecc-43ea-ade5-e067fd4681a6 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:50.895870 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b1c5f36e-0ecc-43ea-ade5-e067fd4681a6 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1520 microversion: 2.1 time: 0.172874 Sep 17 21:35:50.896456 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3212/6335] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:50 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:51.919882 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cbbffbdd-a067-43e8-bff3-95e335e44c62 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:51.920487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cbbffbdd-a067-43e8-bff3-95e335e44c62 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:51.928374 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbbffbdd-a067-43e8-bff3-95e335e44c62 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:51.928946 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbbffbdd-a067-43e8-bff3-95e335e44c62 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:51.929360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbbffbdd-a067-43e8-bff3-95e335e44c62 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:51.930112 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbbffbdd-a067-43e8-bff3-95e335e44c62 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:51.930590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbbffbdd-a067-43e8-bff3-95e335e44c62 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:51.931159 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cbbffbdd-a067-43e8-bff3-95e335e44c62 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:52.070049 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cbbffbdd-a067-43e8-bff3-95e335e44c62 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:52.079966 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cbbffbdd-a067-43e8-bff3-95e335e44c62 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1520 microversion: 2.1 time: 0.163908 Sep 17 21:35:52.080729 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3124/6336] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:51 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:53.108653 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-68e3a0b1-42ea-4fda-9df0-f62a3c9c12f1 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:53.109597 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-68e3a0b1-42ea-4fda-9df0-f62a3c9c12f1 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:53.120280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68e3a0b1-42ea-4fda-9df0-f62a3c9c12f1 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:53.120781 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68e3a0b1-42ea-4fda-9df0-f62a3c9c12f1 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:53.121231 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68e3a0b1-42ea-4fda-9df0-f62a3c9c12f1 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:53.121984 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68e3a0b1-42ea-4fda-9df0-f62a3c9c12f1 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:53.122450 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68e3a0b1-42ea-4fda-9df0-f62a3c9c12f1 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:53.122888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-68e3a0b1-42ea-4fda-9df0-f62a3c9c12f1 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:53.273319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-68e3a0b1-42ea-4fda-9df0-f62a3c9c12f1 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:53.281693 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-68e3a0b1-42ea-4fda-9df0-f62a3c9c12f1 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1520 microversion: 2.1 time: 0.179838 Sep 17 21:35:53.282285 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3213/6337] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:53 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:54.308518 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-685bd95e-768e-4168-ba23-06bfac9f9617 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:54.309079 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-685bd95e-768e-4168-ba23-06bfac9f9617 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:54.316392 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-685bd95e-768e-4168-ba23-06bfac9f9617 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:54.316879 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-685bd95e-768e-4168-ba23-06bfac9f9617 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:54.317325 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-685bd95e-768e-4168-ba23-06bfac9f9617 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:54.318053 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-685bd95e-768e-4168-ba23-06bfac9f9617 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:54.318503 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-685bd95e-768e-4168-ba23-06bfac9f9617 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:54.318931 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-685bd95e-768e-4168-ba23-06bfac9f9617 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:54.459190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-685bd95e-768e-4168-ba23-06bfac9f9617 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:54.467472 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-685bd95e-768e-4168-ba23-06bfac9f9617 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1520 microversion: 2.1 time: 0.165208 Sep 17 21:35:54.468062 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3125/6338] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:54 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:55.495400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-61586c96-090e-4cab-8618-e553a6bf541a tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:55.496397 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-61586c96-090e-4cab-8618-e553a6bf541a tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:55.508727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-61586c96-090e-4cab-8618-e553a6bf541a tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:55.509634 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-61586c96-090e-4cab-8618-e553a6bf541a tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:55.510411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-61586c96-090e-4cab-8618-e553a6bf541a tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:55.511322 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-61586c96-090e-4cab-8618-e553a6bf541a tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:55.511805 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-61586c96-090e-4cab-8618-e553a6bf541a tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:55.512247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-61586c96-090e-4cab-8618-e553a6bf541a tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:55.644917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-61586c96-090e-4cab-8618-e553a6bf541a tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:55.657105 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-61586c96-090e-4cab-8618-e553a6bf541a tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1520 microversion: 2.1 time: 0.168249 Sep 17 21:35:55.657977 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3214/6339] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:55 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:56.683905 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-45c4a420-041d-4e06-8816-dfc854ca9605 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:56.684571 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-45c4a420-041d-4e06-8816-dfc854ca9605 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:56.692364 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45c4a420-041d-4e06-8816-dfc854ca9605 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:56.693128 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45c4a420-041d-4e06-8816-dfc854ca9605 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:56.693270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45c4a420-041d-4e06-8816-dfc854ca9605 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:56.694057 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45c4a420-041d-4e06-8816-dfc854ca9605 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:56.694511 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45c4a420-041d-4e06-8816-dfc854ca9605 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:56.694963 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45c4a420-041d-4e06-8816-dfc854ca9605 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:56.830828 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-45c4a420-041d-4e06-8816-dfc854ca9605 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:56.843544 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-45c4a420-041d-4e06-8816-dfc854ca9605 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1520 microversion: 2.1 time: 0.163383 Sep 17 21:35:56.844190 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3126/6340] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:56 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:57.878210 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1a9d2767-f478-4431-8731-b526966bedd9 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:57.879241 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1a9d2767-f478-4431-8731-b526966bedd9 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:57.889518 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a9d2767-f478-4431-8731-b526966bedd9 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:57.890049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a9d2767-f478-4431-8731-b526966bedd9 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:57.890483 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a9d2767-f478-4431-8731-b526966bedd9 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:57.891222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a9d2767-f478-4431-8731-b526966bedd9 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:57.891691 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a9d2767-f478-4431-8731-b526966bedd9 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:57.892128 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1a9d2767-f478-4431-8731-b526966bedd9 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:58.034389 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1a9d2767-f478-4431-8731-b526966bedd9 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:58.042616 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1a9d2767-f478-4431-8731-b526966bedd9 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1520 microversion: 2.1 time: 0.172282 Sep 17 21:35:58.043202 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3215/6341] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:57 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:35:59.070232 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-86031a3f-8382-40fd-921b-69b7be3c8f72 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:35:59.071064 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-86031a3f-8382-40fd-921b-69b7be3c8f72 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:35:59.080130 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-86031a3f-8382-40fd-921b-69b7be3c8f72 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:59.080617 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-86031a3f-8382-40fd-921b-69b7be3c8f72 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:59.081055 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-86031a3f-8382-40fd-921b-69b7be3c8f72 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:59.081786 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-86031a3f-8382-40fd-921b-69b7be3c8f72 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:35:59.082245 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-86031a3f-8382-40fd-921b-69b7be3c8f72 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:35:59.082678 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-86031a3f-8382-40fd-921b-69b7be3c8f72 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:35:59.211966 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-86031a3f-8382-40fd-921b-69b7be3c8f72 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:35:59.220058 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-86031a3f-8382-40fd-921b-69b7be3c8f72 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1520 microversion: 2.1 time: 0.156552 Sep 17 21:35:59.220633 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3127/6342] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:35:59 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:36:00.245511 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-38f977ef-3af0-406f-867c-1d399e50cb53 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:00.246104 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-38f977ef-3af0-406f-867c-1d399e50cb53 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:00.253969 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-38f977ef-3af0-406f-867c-1d399e50cb53 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:00.254511 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-38f977ef-3af0-406f-867c-1d399e50cb53 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:00.255068 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-38f977ef-3af0-406f-867c-1d399e50cb53 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:00.255831 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-38f977ef-3af0-406f-867c-1d399e50cb53 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:00.256282 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-38f977ef-3af0-406f-867c-1d399e50cb53 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:00.256727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-38f977ef-3af0-406f-867c-1d399e50cb53 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:00.395656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-38f977ef-3af0-406f-867c-1d399e50cb53 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:36:00.403662 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-38f977ef-3af0-406f-867c-1d399e50cb53 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1520 microversion: 2.1 time: 0.162757 Sep 17 21:36:00.404241 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3216/6343] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:00 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:36:01.427052 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-eba3097a-ec36-4af7-9133-178f45967766 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:01.427685 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-eba3097a-ec36-4af7-9133-178f45967766 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:01.430468 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:36:01.436119 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eba3097a-ec36-4af7-9133-178f45967766 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:01.436602 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eba3097a-ec36-4af7-9133-178f45967766 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:01.437042 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eba3097a-ec36-4af7-9133-178f45967766 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:01.437774 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eba3097a-ec36-4af7-9133-178f45967766 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:01.438258 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eba3097a-ec36-4af7-9133-178f45967766 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:01.438688 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-eba3097a-ec36-4af7-9133-178f45967766 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:01.582154 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-eba3097a-ec36-4af7-9133-178f45967766 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:36:01.590583 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-eba3097a-ec36-4af7-9133-178f45967766 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1520 microversion: 2.1 time: 0.167583 Sep 17 21:36:01.591172 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3128/6344] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:01 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:36:02.614133 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4b734f02-9167-4e7c-84a9-d3a133011c7d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:02.614753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4b734f02-9167-4e7c-84a9-d3a133011c7d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:02.617738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:36:02.623411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b734f02-9167-4e7c-84a9-d3a133011c7d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:02.623936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b734f02-9167-4e7c-84a9-d3a133011c7d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:02.624396 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b734f02-9167-4e7c-84a9-d3a133011c7d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:02.625120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b734f02-9167-4e7c-84a9-d3a133011c7d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:02.625614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b734f02-9167-4e7c-84a9-d3a133011c7d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:02.626064 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b734f02-9167-4e7c-84a9-d3a133011c7d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:02.759656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4b734f02-9167-4e7c-84a9-d3a133011c7d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:36:02.767684 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4b734f02-9167-4e7c-84a9-d3a133011c7d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1520 microversion: 2.1 time: 0.157621 Sep 17 21:36:02.768276 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3217/6345] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:02 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:36:03.795123 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9dc07215-d614-45a7-95a2-303055d0d3bc tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:03.795828 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9dc07215-d614-45a7-95a2-303055d0d3bc tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:03.803502 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9dc07215-d614-45a7-95a2-303055d0d3bc tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:03.804051 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9dc07215-d614-45a7-95a2-303055d0d3bc tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:03.804542 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9dc07215-d614-45a7-95a2-303055d0d3bc tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:03.805318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9dc07215-d614-45a7-95a2-303055d0d3bc tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:03.805869 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9dc07215-d614-45a7-95a2-303055d0d3bc tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:03.806359 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9dc07215-d614-45a7-95a2-303055d0d3bc tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:03.947636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9dc07215-d614-45a7-95a2-303055d0d3bc tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:36:03.956859 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9dc07215-d614-45a7-95a2-303055d0d3bc tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1520 microversion: 2.1 time: 0.168203 Sep 17 21:36:03.957482 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3129/6346] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:03 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:36:04.984821 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0791bb10-c7c6-4e22-b638-35accf18d659 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:04.985799 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0791bb10-c7c6-4e22-b638-35accf18d659 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:04.997486 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0791bb10-c7c6-4e22-b638-35accf18d659 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:04.998006 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0791bb10-c7c6-4e22-b638-35accf18d659 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:04.998462 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0791bb10-c7c6-4e22-b638-35accf18d659 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:04.999171 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0791bb10-c7c6-4e22-b638-35accf18d659 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:04.999647 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0791bb10-c7c6-4e22-b638-35accf18d659 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:05.000088 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0791bb10-c7c6-4e22-b638-35accf18d659 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:05.129877 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0791bb10-c7c6-4e22-b638-35accf18d659 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:36:05.137971 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0791bb10-c7c6-4e22-b638-35accf18d659 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1520 microversion: 2.1 time: 0.159953 Sep 17 21:36:05.138563 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3218/6347] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:04 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:36:06.165406 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f31095a0-0457-40f5-b273-ac4553e0496f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:06.166455 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f31095a0-0457-40f5-b273-ac4553e0496f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:06.174825 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f31095a0-0457-40f5-b273-ac4553e0496f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:06.175312 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f31095a0-0457-40f5-b273-ac4553e0496f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:06.175752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f31095a0-0457-40f5-b273-ac4553e0496f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:06.176447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f31095a0-0457-40f5-b273-ac4553e0496f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:06.176898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f31095a0-0457-40f5-b273-ac4553e0496f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:06.177324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f31095a0-0457-40f5-b273-ac4553e0496f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:06.325108 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f31095a0-0457-40f5-b273-ac4553e0496f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:36:06.333443 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f31095a0-0457-40f5-b273-ac4553e0496f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1520 microversion: 2.1 time: 0.174579 Sep 17 21:36:06.334063 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3130/6348] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:06 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:36:07.360116 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0b904f61-f5f1-42f7-affa-482bad247f8c tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:07.360733 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0b904f61-f5f1-42f7-affa-482bad247f8c tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:07.368199 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b904f61-f5f1-42f7-affa-482bad247f8c tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:07.368710 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b904f61-f5f1-42f7-affa-482bad247f8c tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:07.369162 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b904f61-f5f1-42f7-affa-482bad247f8c tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:07.369918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b904f61-f5f1-42f7-affa-482bad247f8c tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:07.370392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b904f61-f5f1-42f7-affa-482bad247f8c tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:07.370827 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b904f61-f5f1-42f7-affa-482bad247f8c tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:07.502900 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0b904f61-f5f1-42f7-affa-482bad247f8c tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:36:07.511062 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0b904f61-f5f1-42f7-affa-482bad247f8c tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1520 microversion: 2.1 time: 0.155552 Sep 17 21:36:07.511639 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3219/6349] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:07 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:36:08.538229 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d2ace5bd-8c61-4f30-bba2-b8b4a16e73fd tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:08.539186 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d2ace5bd-8c61-4f30-bba2-b8b4a16e73fd tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:08.550075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2ace5bd-8c61-4f30-bba2-b8b4a16e73fd tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:08.550818 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2ace5bd-8c61-4f30-bba2-b8b4a16e73fd tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:08.551493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2ace5bd-8c61-4f30-bba2-b8b4a16e73fd tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:08.552561 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2ace5bd-8c61-4f30-bba2-b8b4a16e73fd tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:08.553261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2ace5bd-8c61-4f30-bba2-b8b4a16e73fd tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:08.553966 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2ace5bd-8c61-4f30-bba2-b8b4a16e73fd tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:08.799571 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d2ace5bd-8c61-4f30-bba2-b8b4a16e73fd tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:36:08.809913 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d2ace5bd-8c61-4f30-bba2-b8b4a16e73fd tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1520 microversion: 2.1 time: 0.277870 Sep 17 21:36:08.810498 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3131/6350] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:08 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:36:09.837977 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c7abfde5-9609-4f32-8778-76226abcb98b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:09.838864 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c7abfde5-9609-4f32-8778-76226abcb98b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:09.851392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c7abfde5-9609-4f32-8778-76226abcb98b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:09.852229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c7abfde5-9609-4f32-8778-76226abcb98b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:09.853000 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c7abfde5-9609-4f32-8778-76226abcb98b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:09.854212 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c7abfde5-9609-4f32-8778-76226abcb98b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:09.855011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c7abfde5-9609-4f32-8778-76226abcb98b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:09.855757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c7abfde5-9609-4f32-8778-76226abcb98b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:09.859109 ncdv-master-1 devstack@n-api.service[140524]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 17 21:36:09.859276 ncdv-master-1 devstack@n-api.service[140524]: Sat Sep 17 21:36:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac (ip 10.222.0.26) !!! Sep 17 21:36:10.051458 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c7abfde5-9609-4f32-8778-76226abcb98b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:36:10.060132 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c7abfde5-9609-4f32-8778-76226abcb98b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1520 microversion: 2.1 time: 0.229023 Sep 17 21:36:10.060775 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3220/6351] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:09 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:36:11.087877 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2381df68-e9fc-4e7a-be95-851850fd44af tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:11.088745 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2381df68-e9fc-4e7a-be95-851850fd44af tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:11.097135 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2381df68-e9fc-4e7a-be95-851850fd44af tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:11.097655 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2381df68-e9fc-4e7a-be95-851850fd44af tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:11.098451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2381df68-e9fc-4e7a-be95-851850fd44af tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:11.099148 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2381df68-e9fc-4e7a-be95-851850fd44af tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:11.099611 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2381df68-e9fc-4e7a-be95-851850fd44af tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:11.100033 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2381df68-e9fc-4e7a-be95-851850fd44af tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:11.503573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2381df68-e9fc-4e7a-be95-851850fd44af tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:36:11.512110 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2381df68-e9fc-4e7a-be95-851850fd44af tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1520 microversion: 2.1 time: 0.431034 Sep 17 21:36:11.512681 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3132/6352] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:11 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1520 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:36:12.540221 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d7c76040-72cd-44c7-b1a5-ea40a3b468ea tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:12.541270 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d7c76040-72cd-44c7-b1a5-ea40a3b468ea tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:12.552107 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d7c76040-72cd-44c7-b1a5-ea40a3b468ea tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:12.552945 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d7c76040-72cd-44c7-b1a5-ea40a3b468ea tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:12.553776 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d7c76040-72cd-44c7-b1a5-ea40a3b468ea tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:12.554943 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d7c76040-72cd-44c7-b1a5-ea40a3b468ea tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:12.555724 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d7c76040-72cd-44c7-b1a5-ea40a3b468ea tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:12.556448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d7c76040-72cd-44c7-b1a5-ea40a3b468ea tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:12.701938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d7c76040-72cd-44c7-b1a5-ea40a3b468ea tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:36:12.710125 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d7c76040-72cd-44c7-b1a5-ea40a3b468ea tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1520 microversion: 2.1 time: 0.176857 Sep 17 21:36:12.710720 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3221/6353] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:12 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:36:13.733471 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1fdd688a-a983-431b-82b7-3bf3be6822e2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:13.734114 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1fdd688a-a983-431b-82b7-3bf3be6822e2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:13.741495 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1fdd688a-a983-431b-82b7-3bf3be6822e2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:13.742027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1fdd688a-a983-431b-82b7-3bf3be6822e2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:13.742499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1fdd688a-a983-431b-82b7-3bf3be6822e2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:13.743202 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1fdd688a-a983-431b-82b7-3bf3be6822e2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:13.743645 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1fdd688a-a983-431b-82b7-3bf3be6822e2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:13.744073 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1fdd688a-a983-431b-82b7-3bf3be6822e2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:13.877542 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1fdd688a-a983-431b-82b7-3bf3be6822e2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:36:13.885515 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1fdd688a-a983-431b-82b7-3bf3be6822e2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1520 microversion: 2.1 time: 0.156101 Sep 17 21:36:13.886112 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3133/6354] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:13 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:36:14.910562 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8df7fdfd-bc1a-40cc-8eec-42491f1cc706 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:14.911272 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8df7fdfd-bc1a-40cc-8eec-42491f1cc706 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:14.918441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8df7fdfd-bc1a-40cc-8eec-42491f1cc706 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:14.918944 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8df7fdfd-bc1a-40cc-8eec-42491f1cc706 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:14.919397 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8df7fdfd-bc1a-40cc-8eec-42491f1cc706 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:14.920110 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8df7fdfd-bc1a-40cc-8eec-42491f1cc706 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:14.920572 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8df7fdfd-bc1a-40cc-8eec-42491f1cc706 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:14.921013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8df7fdfd-bc1a-40cc-8eec-42491f1cc706 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:15.057355 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8df7fdfd-bc1a-40cc-8eec-42491f1cc706 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:36:15.065765 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8df7fdfd-bc1a-40cc-8eec-42491f1cc706 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1520 microversion: 2.1 time: 0.159576 Sep 17 21:36:15.066352 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3222/6355] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:14 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:36:16.093317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-95c3c893-a942-428c-b7f5-01e12e75c33b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:16.094501 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-95c3c893-a942-428c-b7f5-01e12e75c33b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:16.106332 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95c3c893-a942-428c-b7f5-01e12e75c33b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:16.107132 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95c3c893-a942-428c-b7f5-01e12e75c33b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:16.107870 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95c3c893-a942-428c-b7f5-01e12e75c33b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:16.109029 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95c3c893-a942-428c-b7f5-01e12e75c33b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:16.109832 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95c3c893-a942-428c-b7f5-01e12e75c33b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:16.110265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95c3c893-a942-428c-b7f5-01e12e75c33b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:16.249332 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-95c3c893-a942-428c-b7f5-01e12e75c33b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:36:16.257667 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-95c3c893-a942-428c-b7f5-01e12e75c33b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1520 microversion: 2.1 time: 0.171201 Sep 17 21:36:16.258283 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3134/6356] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:16 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:36:17.280966 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-11e73d78-cc06-42d0-96cc-a1405b30e4ab tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:17.281833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-11e73d78-cc06-42d0-96cc-a1405b30e4ab tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:17.289350 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-11e73d78-cc06-42d0-96cc-a1405b30e4ab tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:17.289915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-11e73d78-cc06-42d0-96cc-a1405b30e4ab tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:17.290383 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-11e73d78-cc06-42d0-96cc-a1405b30e4ab tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:17.291149 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-11e73d78-cc06-42d0-96cc-a1405b30e4ab tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:17.291629 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-11e73d78-cc06-42d0-96cc-a1405b30e4ab tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:17.292074 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-11e73d78-cc06-42d0-96cc-a1405b30e4ab tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:17.610865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-11e73d78-cc06-42d0-96cc-a1405b30e4ab tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:36:17.619202 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-11e73d78-cc06-42d0-96cc-a1405b30e4ab tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1519 microversion: 2.1 time: 0.342410 Sep 17 21:36:17.619798 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3223/6357] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:17 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1519 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:36:17.780069 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-205002a4-a33e-4e98-bfd1-fc4600e8a8d7 req-b1862b49-8909-4478-8940-16ace96deb5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64812704-330f-49d3-9db4-6f90b796a0ac", "name": "network-vif-unplugged", "status": "completed", "tag": "b38457fd-85db-45ce-bf49-d6f9601976f5"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:36:17.790895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-205002a4-a33e-4e98-bfd1-fc4600e8a8d7 req-b1862b49-8909-4478-8940-16ace96deb5b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:17.791405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-205002a4-a33e-4e98-bfd1-fc4600e8a8d7 req-b1862b49-8909-4478-8940-16ace96deb5b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:17.791860 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-205002a4-a33e-4e98-bfd1-fc4600e8a8d7 req-b1862b49-8909-4478-8940-16ace96deb5b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:17.804083 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-205002a4-a33e-4e98-bfd1-fc4600e8a8d7 req-b1862b49-8909-4478-8940-16ace96deb5b service nova] Creating event network-vif-unplugged:b38457fd-85db-45ce-bf49-d6f9601976f5 for instance 64812704-330f-49d3-9db4-6f90b796a0ac on nch2-master-1 Sep 17 21:36:17.809722 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [req-205002a4-a33e-4e98-bfd1-fc4600e8a8d7 req-b1862b49-8909-4478-8940-16ace96deb5b service nova] Instance 64812704-330f-49d3-9db4-6f90b796a0ac is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140523) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 21:36:17.821238 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-205002a4-a33e-4e98-bfd1-fc4600e8a8d7 req-b1862b49-8909-4478-8940-16ace96deb5b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045035 Sep 17 21:36:17.822186 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3135/6358] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:36:18.644642 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e2ed8e4c-8e0c-48af-b9b6-002e2f8a5e03 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:18.645607 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e2ed8e4c-8e0c-48af-b9b6-002e2f8a5e03 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:18.653771 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2ed8e4c-8e0c-48af-b9b6-002e2f8a5e03 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:18.654283 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2ed8e4c-8e0c-48af-b9b6-002e2f8a5e03 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:18.654914 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2ed8e4c-8e0c-48af-b9b6-002e2f8a5e03 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:18.655657 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2ed8e4c-8e0c-48af-b9b6-002e2f8a5e03 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:18.656187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2ed8e4c-8e0c-48af-b9b6-002e2f8a5e03 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:18.656644 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e2ed8e4c-8e0c-48af-b9b6-002e2f8a5e03 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:18.792399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e2ed8e4c-8e0c-48af-b9b6-002e2f8a5e03 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:36:18.805651 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e2ed8e4c-8e0c-48af-b9b6-002e2f8a5e03 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1519 microversion: 2.1 time: 0.166021 Sep 17 21:36:18.806481 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3224/6359] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:18 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:36:19.838379 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-403df6a6-5710-4a15-be09-9c8fed831d9b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:19.839534 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-403df6a6-5710-4a15-be09-9c8fed831d9b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:19.845940 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-7975d311-b75e-4129-8e6b-c4eb6b1074a7 req-8c0b8385-b397-467a-a189-0ba75130aca9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64812704-330f-49d3-9db4-6f90b796a0ac", "tag": "b38457fd-85db-45ce-bf49-d6f9601976f5"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:36:19.850597 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-403df6a6-5710-4a15-be09-9c8fed831d9b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:19.851410 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-403df6a6-5710-4a15-be09-9c8fed831d9b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:19.852137 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-403df6a6-5710-4a15-be09-9c8fed831d9b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:19.853289 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-403df6a6-5710-4a15-be09-9c8fed831d9b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:19.854098 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-403df6a6-5710-4a15-be09-9c8fed831d9b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:19.854794 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-403df6a6-5710-4a15-be09-9c8fed831d9b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:19.859588 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=74 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:36:19.862665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7975d311-b75e-4129-8e6b-c4eb6b1074a7 req-8c0b8385-b397-467a-a189-0ba75130aca9 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:19.863564 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7975d311-b75e-4129-8e6b-c4eb6b1074a7 req-8c0b8385-b397-467a-a189-0ba75130aca9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:19.864012 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-7975d311-b75e-4129-8e6b-c4eb6b1074a7 req-8c0b8385-b397-467a-a189-0ba75130aca9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:19.876992 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-7975d311-b75e-4129-8e6b-c4eb6b1074a7 req-8c0b8385-b397-467a-a189-0ba75130aca9 service nova] Creating event network-changed:b38457fd-85db-45ce-bf49-d6f9601976f5 for instance 64812704-330f-49d3-9db4-6f90b796a0ac on nch2-master-1 Sep 17 21:36:19.882915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [req-7975d311-b75e-4129-8e6b-c4eb6b1074a7 req-8c0b8385-b397-467a-a189-0ba75130aca9 service nova] Instance 64812704-330f-49d3-9db4-6f90b796a0ac is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140524) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 21:36:19.894784 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-7975d311-b75e-4129-8e6b-c4eb6b1074a7 req-8c0b8385-b397-467a-a189-0ba75130aca9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055180 Sep 17 21:36:19.895412 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3225/6360] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:36:20.033252 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-403df6a6-5710-4a15-be09-9c8fed831d9b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:36:20.050588 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-403df6a6-5710-4a15-be09-9c8fed831d9b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1517 microversion: 2.1 time: 0.221236 Sep 17 21:36:20.051190 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3136/6361] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:19 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1517 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:36:21.076301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-faac6d78-1653-4cec-9ea9-5f6944ad7227 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:21.076938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-faac6d78-1653-4cec-9ea9-5f6944ad7227 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:21.084252 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-faac6d78-1653-4cec-9ea9-5f6944ad7227 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:21.084789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-faac6d78-1653-4cec-9ea9-5f6944ad7227 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:21.085274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-faac6d78-1653-4cec-9ea9-5f6944ad7227 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:21.086069 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-faac6d78-1653-4cec-9ea9-5f6944ad7227 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:21.086649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-faac6d78-1653-4cec-9ea9-5f6944ad7227 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:21.087128 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-faac6d78-1653-4cec-9ea9-5f6944ad7227 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:21.090008 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=84 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:36:21.231288 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-faac6d78-1653-4cec-9ea9-5f6944ad7227 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:36:21.239715 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-faac6d78-1653-4cec-9ea9-5f6944ad7227 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1514 microversion: 2.1 time: 0.169046 Sep 17 21:36:21.240304 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3226/6362] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:21 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:36:21.272607 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-235bb8b7-9f85-45d1-aa3a-81cbf24ad2bb tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:36:21.273170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-235bb8b7-9f85-45d1-aa3a-81cbf24ad2bb tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:21.280596 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-235bb8b7-9f85-45d1-aa3a-81cbf24ad2bb tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:21.281101 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-235bb8b7-9f85-45d1-aa3a-81cbf24ad2bb tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:21.281585 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-235bb8b7-9f85-45d1-aa3a-81cbf24ad2bb tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:21.282299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-235bb8b7-9f85-45d1-aa3a-81cbf24ad2bb tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:21.282765 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-235bb8b7-9f85-45d1-aa3a-81cbf24ad2bb tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:21.283203 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-235bb8b7-9f85-45d1-aa3a-81cbf24ad2bb tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:21.344448 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-235bb8b7-9f85-45d1-aa3a-81cbf24ad2bb tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "POST /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac/action" status: 204 len: 0 microversion: 2.1 time: 0.075664 Sep 17 21:36:21.345021 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3137/6363] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:36:21 2022] POST /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:36:21.353871 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bbf52b84-bba5-4a6c-ae99-93d975ddd2a5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:21.354507 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bbf52b84-bba5-4a6c-ae99-93d975ddd2a5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:21.360640 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbf52b84-bba5-4a6c-ae99-93d975ddd2a5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:21.361173 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbf52b84-bba5-4a6c-ae99-93d975ddd2a5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:21.361637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbf52b84-bba5-4a6c-ae99-93d975ddd2a5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:21.362417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbf52b84-bba5-4a6c-ae99-93d975ddd2a5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:21.362834 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbf52b84-bba5-4a6c-ae99-93d975ddd2a5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:21.363281 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bbf52b84-bba5-4a6c-ae99-93d975ddd2a5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:21.495380 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bbf52b84-bba5-4a6c-ae99-93d975ddd2a5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:36:21.504123 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bbf52b84-bba5-4a6c-ae99-93d975ddd2a5 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1514 microversion: 2.1 time: 0.154125 Sep 17 21:36:21.504725 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3227/6364] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:21 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:36:22.524278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-d3aa2ed4-f6a1-4759-bcaa-9a2d852e58c8 req-d8d8f1d6-ba5b-4228-a633-80e7a1fd7f6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64812704-330f-49d3-9db4-6f90b796a0ac", "name": "network-vif-plugged", "status": "completed", "tag": "b38457fd-85db-45ce-bf49-d6f9601976f5"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:36:22.529152 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-04919cec-80b3-4a24-b376-05f7fa059ae9 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:22.529987 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-04919cec-80b3-4a24-b376-05f7fa059ae9 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:22.537987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d3aa2ed4-f6a1-4759-bcaa-9a2d852e58c8 req-d8d8f1d6-ba5b-4228-a633-80e7a1fd7f6a service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:22.538701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d3aa2ed4-f6a1-4759-bcaa-9a2d852e58c8 req-d8d8f1d6-ba5b-4228-a633-80e7a1fd7f6a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:22.539015 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-04919cec-80b3-4a24-b376-05f7fa059ae9 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:22.539398 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-d3aa2ed4-f6a1-4759-bcaa-9a2d852e58c8 req-d8d8f1d6-ba5b-4228-a633-80e7a1fd7f6a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:22.539622 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-04919cec-80b3-4a24-b376-05f7fa059ae9 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:22.540096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-04919cec-80b3-4a24-b376-05f7fa059ae9 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:22.540908 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-04919cec-80b3-4a24-b376-05f7fa059ae9 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:22.541415 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-04919cec-80b3-4a24-b376-05f7fa059ae9 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:22.542098 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-04919cec-80b3-4a24-b376-05f7fa059ae9 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:22.553064 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-d3aa2ed4-f6a1-4759-bcaa-9a2d852e58c8 req-d8d8f1d6-ba5b-4228-a633-80e7a1fd7f6a service nova] Creating event network-vif-plugged:b38457fd-85db-45ce-bf49-d6f9601976f5 for instance 64812704-330f-49d3-9db4-6f90b796a0ac on nch2-master-1 Sep 17 21:36:22.560000 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-d3aa2ed4-f6a1-4759-bcaa-9a2d852e58c8 req-d8d8f1d6-ba5b-4228-a633-80e7a1fd7f6a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040379 Sep 17 21:36:22.561005 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3138/6365] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:36:22.712884 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-04919cec-80b3-4a24-b376-05f7fa059ae9 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:36:22.720928 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-04919cec-80b3-4a24-b376-05f7fa059ae9 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1506 microversion: 2.1 time: 0.197093 Sep 17 21:36:22.721539 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3228/6366] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:22 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1506 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:36:22.744238 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-60b5f4a4-fdec-49d3-b423-71d9e07edc77 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:22.744950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-60b5f4a4-fdec-49d3-b423-71d9e07edc77 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:22.752014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60b5f4a4-fdec-49d3-b423-71d9e07edc77 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:22.752511 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60b5f4a4-fdec-49d3-b423-71d9e07edc77 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:22.752982 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60b5f4a4-fdec-49d3-b423-71d9e07edc77 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:22.753760 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60b5f4a4-fdec-49d3-b423-71d9e07edc77 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:22.754209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60b5f4a4-fdec-49d3-b423-71d9e07edc77 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:22.754643 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60b5f4a4-fdec-49d3-b423-71d9e07edc77 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:22.894669 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-60b5f4a4-fdec-49d3-b423-71d9e07edc77 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:36:22.902666 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-60b5f4a4-fdec-49d3-b423-71d9e07edc77 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1506 microversion: 2.1 time: 0.162673 Sep 17 21:36:22.903237 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3139/6367] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:22 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:36:22.925244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4f926c6d-a96f-4a98-92b7-20ccf752e4e2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:22.925944 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4f926c6d-a96f-4a98-92b7-20ccf752e4e2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:22.932625 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f926c6d-a96f-4a98-92b7-20ccf752e4e2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:22.933127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f926c6d-a96f-4a98-92b7-20ccf752e4e2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:22.933642 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f926c6d-a96f-4a98-92b7-20ccf752e4e2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:22.934358 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f926c6d-a96f-4a98-92b7-20ccf752e4e2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:22.934828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f926c6d-a96f-4a98-92b7-20ccf752e4e2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:22.935269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4f926c6d-a96f-4a98-92b7-20ccf752e4e2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:23.078921 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4f926c6d-a96f-4a98-92b7-20ccf752e4e2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:36:23.087003 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4f926c6d-a96f-4a98-92b7-20ccf752e4e2 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1506 microversion: 2.1 time: 0.165835 Sep 17 21:36:23.087613 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3229/6368] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:22 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:36:23.110173 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-aef21d04-68fe-4c23-b799-1839c74aea5f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:23.110679 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-aef21d04-68fe-4c23-b799-1839c74aea5f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:23.117129 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aef21d04-68fe-4c23-b799-1839c74aea5f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:23.117651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aef21d04-68fe-4c23-b799-1839c74aea5f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:23.118091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aef21d04-68fe-4c23-b799-1839c74aea5f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:23.118797 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aef21d04-68fe-4c23-b799-1839c74aea5f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:23.119252 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aef21d04-68fe-4c23-b799-1839c74aea5f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:23.119670 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aef21d04-68fe-4c23-b799-1839c74aea5f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:23.144979 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-aef21d04-68fe-4c23-b799-1839c74aea5f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:36:23.229708 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-aef21d04-68fe-4c23-b799-1839c74aea5f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "DELETE /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 204 len: 0 microversion: 2.1 time: 0.123230 Sep 17 21:36:23.230398 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3140/6369] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:36:23 2022] DELETE /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:36:23.246615 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4cf9038f-8efb-4725-9fc2-68bc32bf0d77 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:23.247140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4cf9038f-8efb-4725-9fc2-68bc32bf0d77 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:23.253946 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4cf9038f-8efb-4725-9fc2-68bc32bf0d77 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:23.254453 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4cf9038f-8efb-4725-9fc2-68bc32bf0d77 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:23.254912 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4cf9038f-8efb-4725-9fc2-68bc32bf0d77 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:23.255630 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4cf9038f-8efb-4725-9fc2-68bc32bf0d77 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:23.256104 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4cf9038f-8efb-4725-9fc2-68bc32bf0d77 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:23.256547 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4cf9038f-8efb-4725-9fc2-68bc32bf0d77 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:23.282227 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4cf9038f-8efb-4725-9fc2-68bc32bf0d77 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:36:23.326628 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.compute.api [None req-4cf9038f-8efb-4725-9fc2-68bc32bf0d77 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Instance is already in deleting state, ignoring this request Sep 17 21:36:23.327474 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4cf9038f-8efb-4725-9fc2-68bc32bf0d77 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "DELETE /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 204 len: 0 microversion: 2.1 time: 0.084823 Sep 17 21:36:23.328106 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3230/6370] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:36:23 2022] DELETE /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:36:23.337248 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0894c56a-6975-4584-b6f6-a99c3c98aeb4 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:23.338005 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0894c56a-6975-4584-b6f6-a99c3c98aeb4 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:23.344305 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0894c56a-6975-4584-b6f6-a99c3c98aeb4 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:23.344784 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0894c56a-6975-4584-b6f6-a99c3c98aeb4 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:23.345219 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0894c56a-6975-4584-b6f6-a99c3c98aeb4 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:23.345947 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0894c56a-6975-4584-b6f6-a99c3c98aeb4 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:23.346397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0894c56a-6975-4584-b6f6-a99c3c98aeb4 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:23.346823 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0894c56a-6975-4584-b6f6-a99c3c98aeb4 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:23.487567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0894c56a-6975-4584-b6f6-a99c3c98aeb4 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:36:23.499756 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0894c56a-6975-4584-b6f6-a99c3c98aeb4 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1512 microversion: 2.1 time: 0.166657 Sep 17 21:36:23.500622 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3141/6371] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:23 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:36:24.533311 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7bcabb4f-a4a4-4bdb-b5e0-a2279530dc35 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:24.533950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7bcabb4f-a4a4-4bdb-b5e0-a2279530dc35 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:24.541521 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7bcabb4f-a4a4-4bdb-b5e0-a2279530dc35 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:24.542053 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7bcabb4f-a4a4-4bdb-b5e0-a2279530dc35 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:24.542507 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7bcabb4f-a4a4-4bdb-b5e0-a2279530dc35 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:24.543235 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7bcabb4f-a4a4-4bdb-b5e0-a2279530dc35 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:24.543702 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7bcabb4f-a4a4-4bdb-b5e0-a2279530dc35 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:24.544139 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7bcabb4f-a4a4-4bdb-b5e0-a2279530dc35 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:24.760099 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7bcabb4f-a4a4-4bdb-b5e0-a2279530dc35 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da549e8947e445fea05a3969c98c732e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2412712d1e76496a892826131215475f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:36:24.768874 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7bcabb4f-a4a4-4bdb-b5e0-a2279530dc35 tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 200 len: 1512 microversion: 2.1 time: 0.241672 Sep 17 21:36:24.769515 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3231/6372] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:24 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 1512 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:36:25.078462 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-cc16890b-8097-4c4f-930a-d89341e6fdc3 req-06d94bfc-6156-4d7c-a70c-848749417380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64812704-330f-49d3-9db4-6f90b796a0ac", "name": "network-vif-deleted", "tag": "b38457fd-85db-45ce-bf49-d6f9601976f5"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:36:25.091007 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-cc16890b-8097-4c4f-930a-d89341e6fdc3 req-06d94bfc-6156-4d7c-a70c-848749417380 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:25.091531 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-cc16890b-8097-4c4f-930a-d89341e6fdc3 req-06d94bfc-6156-4d7c-a70c-848749417380 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:25.092089 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-cc16890b-8097-4c4f-930a-d89341e6fdc3 req-06d94bfc-6156-4d7c-a70c-848749417380 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:25.105290 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-cc16890b-8097-4c4f-930a-d89341e6fdc3 req-06d94bfc-6156-4d7c-a70c-848749417380 service nova] Creating event network-vif-deleted:b38457fd-85db-45ce-bf49-d6f9601976f5 for instance 64812704-330f-49d3-9db4-6f90b796a0ac on nch2-master-1 Sep 17 21:36:25.110705 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-cc16890b-8097-4c4f-930a-d89341e6fdc3 req-06d94bfc-6156-4d7c-a70c-848749417380 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035854 Sep 17 21:36:25.111712 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3142/6373] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:36:25.792983 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0c9193a6-c4a8-47c2-bdf8-8309311cc34b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:25.793765 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0c9193a6-c4a8-47c2-bdf8-8309311cc34b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 64812704-330f-49d3-9db4-6f90b796a0ac] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:25.801295 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c9193a6-c4a8-47c2-bdf8-8309311cc34b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:25.801838 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c9193a6-c4a8-47c2-bdf8-8309311cc34b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:25.802300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c9193a6-c4a8-47c2-bdf8-8309311cc34b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:25.803025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c9193a6-c4a8-47c2-bdf8-8309311cc34b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:25.803509 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c9193a6-c4a8-47c2-bdf8-8309311cc34b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:25.804079 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0c9193a6-c4a8-47c2-bdf8-8309311cc34b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:25.818417 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-0c9193a6-c4a8-47c2-bdf8-8309311cc34b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] HTTP exception thrown: Instance 64812704-330f-49d3-9db4-6f90b796a0ac could not be found. Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0c9193a6-c4a8-47c2-bdf8-8309311cc34b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Request method failure captured: Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac HTTP/1.1 Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJj153hEtHpg-JTsIn-6VPOptOKdhjs8iNUZ47KvG28QRJQ-MPhL6LqN4sicbGQJUb2R-wYNbgaQ_Q88BSCFQ6gwA8BaNHzYFlirN7nzlauyP2VztmGo8K6eum9A0IQdH1gng2JjFxtEY9rBzSexWq194zUSJcfTw3Yle_ByX0KWM0Z0 Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 2412712d1e76496a892826131215475f Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerDiskConfigTestJSON-110815762 Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2412712d1e76496a892826131215475f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2412712d1e76496a892826131215475f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2412712d1e76496a892826131215475f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2412712d1e76496a892826131215475f", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerDiskConfigTestJSON-110815762 Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 2412712d1e76496a892826131215475f Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-110815762 Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerDiskConfigTestJSON-110815762-project Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: da549e8947e445fea05a3969c98c732e Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerDiskConfigTestJSON-110815762-project Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 64812704-330f-49d3-9db4-6f90b796a0ac could not be found. Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '64812704-330f-49d3-9db4-6f90b796a0ac'} Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64812704-330f-49d3-9db4-6f90b796a0ac could not be found. Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64812704-330f-49d3-9db4-6f90b796a0ac could not be found. Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:36:25.820136 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:36:25.825623 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:36:25.825623 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:36:25.825623 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:36:25.825623 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:36:25.825623 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:36:25.825623 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64812704-330f-49d3-9db4-6f90b796a0ac could not be found. Sep 17 21:36:25.825623 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:36:25.825623 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0c9193a6-c4a8-47c2-bdf8-8309311cc34b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Returning 404 to user: Instance 64812704-330f-49d3-9db4-6f90b796a0ac could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:36:25.825623 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0c9193a6-c4a8-47c2-bdf8-8309311cc34b tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac" status: 404 len: 111 microversion: 2.1 time: 0.032876 Sep 17 21:36:25.825623 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3232/6374] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:25 2022] GET /compute/v2.1/servers/64812704-330f-49d3-9db4-6f90b796a0ac => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:36:25.831687 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d57521b1-0fef-40c0-95ea-353298d2495f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '.version_select at 0x7f25a46379d0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:25.854210 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d57521b1-0fef-40c0-95ea-353298d2495f tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1799595118" status: 202 len: 0 microversion: 2.1 time: 0.026961 Sep 17 21:36:25.855153 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3143/6375] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Sep 17 21:36:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1799595118 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:36:26.490456 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-676653b8-af1e-4729-beb7-413b38b20d5e tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:26.491005 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-676653b8-af1e-4729-beb7-413b38b20d5e tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:26.497655 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-676653b8-af1e-4729-beb7-413b38b20d5e tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:26.498145 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-676653b8-af1e-4729-beb7-413b38b20d5e tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:26.498680 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-676653b8-af1e-4729-beb7-413b38b20d5e tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:26.499399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-676653b8-af1e-4729-beb7-413b38b20d5e tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:26.499876 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-676653b8-af1e-4729-beb7-413b38b20d5e tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:26.500322 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-676653b8-af1e-4729-beb7-413b38b20d5e tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:26.514348 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-676653b8-af1e-4729-beb7-413b38b20d5e tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] HTTP exception thrown: Instance 57d6a97c-6bfd-4c8b-814c-ae62587bba75 could not be found. Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-676653b8-af1e-4729-beb7-413b38b20d5e tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Request method failure captured: Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 HTTP/1.1 Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJj153hEtHpg-JTsIn-6VPOptOKdhjs8iNUZ47KvG28QRJQ-MPhL6LqN4sicbGQJUb2R-wYNbgaQ_Q88BSCFQ6gwA8BaNHzYFlirN7nzlauyP2VztmGo8K6eum9A0IQdH1gng2JjFxtEY9rBzSexWq194zUSJcfTw3Yle_ByX0KWM0Z0 Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 2412712d1e76496a892826131215475f Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerDiskConfigTestJSON-110815762 Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2412712d1e76496a892826131215475f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2412712d1e76496a892826131215475f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2412712d1e76496a892826131215475f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2412712d1e76496a892826131215475f", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerDiskConfigTestJSON-110815762 Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 2412712d1e76496a892826131215475f Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-110815762 Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerDiskConfigTestJSON-110815762-project Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: da549e8947e445fea05a3969c98c732e Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerDiskConfigTestJSON-110815762-project Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 57d6a97c-6bfd-4c8b-814c-ae62587bba75 could not be found. Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '57d6a97c-6bfd-4c8b-814c-ae62587bba75'} Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57d6a97c-6bfd-4c8b-814c-ae62587bba75 could not be found. Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:36:26.515910 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:36:26.520692 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57d6a97c-6bfd-4c8b-814c-ae62587bba75 could not be found. Sep 17 21:36:26.520692 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:36:26.520692 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:36:26.520692 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:36:26.520692 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:36:26.520692 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:36:26.520692 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:36:26.520692 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:36:26.520692 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:36:26.520692 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57d6a97c-6bfd-4c8b-814c-ae62587bba75 could not be found. Sep 17 21:36:26.520692 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:36:26.520692 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-676653b8-af1e-4729-beb7-413b38b20d5e tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Returning 404 to user: Instance 57d6a97c-6bfd-4c8b-814c-ae62587bba75 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:36:26.520692 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-676653b8-af1e-4729-beb7-413b38b20d5e tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "DELETE /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 404 len: 111 microversion: 2.1 time: 0.030989 Sep 17 21:36:26.521678 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3233/6376] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:36:26 2022] DELETE /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:36:26.527814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2ccc1e63-ede9-44de-8d7d-ac076870bc0d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:26.528560 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2ccc1e63-ede9-44de-8d7d-ac076870bc0d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] [instance: 57d6a97c-6bfd-4c8b-814c-ae62587bba75] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:26.535601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ccc1e63-ede9-44de-8d7d-ac076870bc0d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:26.536089 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ccc1e63-ede9-44de-8d7d-ac076870bc0d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:26.536540 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ccc1e63-ede9-44de-8d7d-ac076870bc0d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:26.537249 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ccc1e63-ede9-44de-8d7d-ac076870bc0d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:26.537733 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ccc1e63-ede9-44de-8d7d-ac076870bc0d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:26.538159 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2ccc1e63-ede9-44de-8d7d-ac076870bc0d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:26.551987 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-2ccc1e63-ede9-44de-8d7d-ac076870bc0d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] HTTP exception thrown: Instance 57d6a97c-6bfd-4c8b-814c-ae62587bba75 could not be found. Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2ccc1e63-ede9-44de-8d7d-ac076870bc0d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Request method failure captured: Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 HTTP/1.1 Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJj153hEtHpg-JTsIn-6VPOptOKdhjs8iNUZ47KvG28QRJQ-MPhL6LqN4sicbGQJUb2R-wYNbgaQ_Q88BSCFQ6gwA8BaNHzYFlirN7nzlauyP2VztmGo8K6eum9A0IQdH1gng2JjFxtEY9rBzSexWq194zUSJcfTw3Yle_ByX0KWM0Z0 Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 2412712d1e76496a892826131215475f Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerDiskConfigTestJSON-110815762 Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2412712d1e76496a892826131215475f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2412712d1e76496a892826131215475f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2412712d1e76496a892826131215475f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2412712d1e76496a892826131215475f", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerDiskConfigTestJSON-110815762 Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 2412712d1e76496a892826131215475f Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-110815762 Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerDiskConfigTestJSON-110815762-project Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: da549e8947e445fea05a3969c98c732e Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerDiskConfigTestJSON-110815762-project Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 57d6a97c-6bfd-4c8b-814c-ae62587bba75 could not be found. Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '57d6a97c-6bfd-4c8b-814c-ae62587bba75'} Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57d6a97c-6bfd-4c8b-814c-ae62587bba75 could not be found. Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57d6a97c-6bfd-4c8b-814c-ae62587bba75 could not be found. Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:36:26.553687 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:36:26.558435 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:36:26.558435 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:36:26.558435 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:36:26.558435 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:36:26.558435 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:36:26.558435 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57d6a97c-6bfd-4c8b-814c-ae62587bba75 could not be found. Sep 17 21:36:26.558435 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:36:26.558435 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2ccc1e63-ede9-44de-8d7d-ac076870bc0d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] Returning 404 to user: Instance 57d6a97c-6bfd-4c8b-814c-ae62587bba75 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:36:26.558435 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2ccc1e63-ede9-44de-8d7d-ac076870bc0d tempest-ServerDiskConfigTestJSON-110815762 tempest-ServerDiskConfigTestJSON-110815762-project] 10.222.0.26 "GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75" status: 404 len: 111 microversion: 2.1 time: 0.032307 Sep 17 21:36:26.558435 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3144/6377] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:26 2022] GET /compute/v2.1/servers/57d6a97c-6bfd-4c8b-814c-ae62587bba75 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:36:35.407648 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8cdfa426-7b5f-44b7-8952-bf7a72416f6b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Action: 'create', calling method: .version_select at 0x7f259fee6790>, body: {"keypair": {"name": "tempest-keypair-1377054705", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZxGg9CayicnAbyY343/qvfnBlakLubYBJL5Y4Aa+D7lPBgb/BnmBIg5fc403i7BarpQbcypW3LsCSRX7pqIb2f7fH5jaKy+4J3mE4GRbnvolDQkBbPOolaj30x2LHk0w=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:36:35.412990 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=34 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:36:35.425333 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-8cdfa426-7b5f-44b7-8952-bf7a72416f6b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Getting quotas for project ad243abc13a14aa08c717d4105e24f4f. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:36:35.431026 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-8cdfa426-7b5f-44b7-8952-bf7a72416f6b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Getting quotas for user d20f8598dfec4de7b496a64e023e7a15 and project ad243abc13a14aa08c717d4105e24f4f. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:36:35.458101 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8cdfa426-7b5f-44b7-8952-bf7a72416f6b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.172295 Sep 17 21:36:35.458730 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3234/6378] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:36:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:36:36.753453 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bccdea86-b3a0-45f6-86e9-a0dcd49e232a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1610022714", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "595473ed-8f19-4b14-b9d1-04243f9c5e91"}], "security_groups": [{"name": "tempest-securitygroup--262220769"}], "key_name": "tempest-keypair-1377054705", "user_data": "}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:36:36.764486 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:36:36.765396 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:36:36.863204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-bccdea86-b3a0-45f6-86e9-a0dcd49e232a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] validate_networks() for [('595473ed-8f19-4b14-b9d1-04243f9c5e91', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:36:37.247091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-bccdea86-b3a0-45f6-86e9-a0dcd49e232a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:36:37.247774 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-bccdea86-b3a0-45f6-86e9-a0dcd49e232a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:36:37.248265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-bccdea86-b3a0-45f6-86e9-a0dcd49e232a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:36:37.248718 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-bccdea86-b3a0-45f6-86e9-a0dcd49e232a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:36:37.249375 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-bccdea86-b3a0-45f6-86e9-a0dcd49e232a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:36:37.259872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bccdea86-b3a0-45f6-86e9-a0dcd49e232a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:37.260492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bccdea86-b3a0-45f6-86e9-a0dcd49e232a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:37.261006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bccdea86-b3a0-45f6-86e9-a0dcd49e232a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:37.261850 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bccdea86-b3a0-45f6-86e9-a0dcd49e232a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:37.262456 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bccdea86-b3a0-45f6-86e9-a0dcd49e232a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:37.262894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bccdea86-b3a0-45f6-86e9-a0dcd49e232a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:37.280517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-bccdea86-b3a0-45f6-86e9-a0dcd49e232a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Getting quotas for project ad243abc13a14aa08c717d4105e24f4f. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:36:37.286021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-bccdea86-b3a0-45f6-86e9-a0dcd49e232a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Getting quotas for user d20f8598dfec4de7b496a64e023e7a15 and project ad243abc13a14aa08c717d4105e24f4f. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:36:37.300578 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bccdea86-b3a0-45f6-86e9-a0dcd49e232a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:36:37.301854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bccdea86-b3a0-45f6-86e9-a0dcd49e232a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:36:37.349048 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bccdea86-b3a0-45f6-86e9-a0dcd49e232a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.600146 Sep 17 21:36:37.349925 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3145/6379] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:36:36 2022] POST /compute/v2.1/servers => generated 408 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:36:37.358717 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:36:37.363691 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-abb5c1e1-018d-4b0a-8dd9-6bafe400ca18 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:37.364335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-abb5c1e1-018d-4b0a-8dd9-6bafe400ca18 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:37.425514 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-abb5c1e1-018d-4b0a-8dd9-6bafe400ca18 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:36:37.435051 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-abb5c1e1-018d-4b0a-8dd9-6bafe400ca18 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1239 microversion: 2.1 time: 0.077749 Sep 17 21:36:37.436669 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3235/6380] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:37 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1239 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:36:38.459899 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-28ebe2ed-3321-4444-9c4c-ee42542a345d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:38.460525 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-28ebe2ed-3321-4444-9c4c-ee42542a345d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:38.480865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-28ebe2ed-3321-4444-9c4c-ee42542a345d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:38.481949 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-28ebe2ed-3321-4444-9c4c-ee42542a345d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:38.482807 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-28ebe2ed-3321-4444-9c4c-ee42542a345d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:38.484249 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-28ebe2ed-3321-4444-9c4c-ee42542a345d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:38.485068 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-28ebe2ed-3321-4444-9c4c-ee42542a345d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:38.486007 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-28ebe2ed-3321-4444-9c4c-ee42542a345d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:38.580626 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-28ebe2ed-3321-4444-9c4c-ee42542a345d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:36:38.591068 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-28ebe2ed-3321-4444-9c4c-ee42542a345d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1299 microversion: 2.1 time: 0.136209 Sep 17 21:36:38.592033 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3146/6381] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:38 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1299 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:36:39.615092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1f63962e-d052-4a50-bd20-92eedfd776bc tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:39.615723 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1f63962e-d052-4a50-bd20-92eedfd776bc tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:39.623393 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f63962e-d052-4a50-bd20-92eedfd776bc tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:39.624345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f63962e-d052-4a50-bd20-92eedfd776bc tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:39.625056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f63962e-d052-4a50-bd20-92eedfd776bc tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:39.626182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f63962e-d052-4a50-bd20-92eedfd776bc tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:39.626910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f63962e-d052-4a50-bd20-92eedfd776bc tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:39.627467 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f63962e-d052-4a50-bd20-92eedfd776bc tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:39.893853 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1f63962e-d052-4a50-bd20-92eedfd776bc tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:36:39.904115 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1f63962e-d052-4a50-bd20-92eedfd776bc tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1364 microversion: 2.1 time: 0.293009 Sep 17 21:36:39.904735 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3236/6382] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:39 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1364 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:36:40.480349 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-6d89fe37-64f8-4bf7-8181-4cd94d4e6b68 req-37add09e-52f9-4cdc-a216-5a4b2dd2861d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb9ed0d4-926d-4875-a885-f6400220fd50", "tag": "fbc6976d-9081-4409-8beb-d67bacef2971"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:36:40.490209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-6d89fe37-64f8-4bf7-8181-4cd94d4e6b68 req-37add09e-52f9-4cdc-a216-5a4b2dd2861d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:40.490694 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-6d89fe37-64f8-4bf7-8181-4cd94d4e6b68 req-37add09e-52f9-4cdc-a216-5a4b2dd2861d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:40.491460 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-6d89fe37-64f8-4bf7-8181-4cd94d4e6b68 req-37add09e-52f9-4cdc-a216-5a4b2dd2861d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:40.503185 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-6d89fe37-64f8-4bf7-8181-4cd94d4e6b68 req-37add09e-52f9-4cdc-a216-5a4b2dd2861d service nova] Creating event network-changed:fbc6976d-9081-4409-8beb-d67bacef2971 for instance bb9ed0d4-926d-4875-a885-f6400220fd50 on nch2-master-1 Sep 17 21:36:40.508332 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-6d89fe37-64f8-4bf7-8181-4cd94d4e6b68 req-37add09e-52f9-4cdc-a216-5a4b2dd2861d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116944 Sep 17 21:36:40.508969 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3147/6383] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:36:40.929518 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c4796fd7-f56a-424c-82fa-f0f6f0080fcb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:40.930429 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c4796fd7-f56a-424c-82fa-f0f6f0080fcb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:40.940315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4796fd7-f56a-424c-82fa-f0f6f0080fcb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:40.941040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4796fd7-f56a-424c-82fa-f0f6f0080fcb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:40.941726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4796fd7-f56a-424c-82fa-f0f6f0080fcb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:40.942718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4796fd7-f56a-424c-82fa-f0f6f0080fcb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:40.943384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4796fd7-f56a-424c-82fa-f0f6f0080fcb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:40.944021 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4796fd7-f56a-424c-82fa-f0f6f0080fcb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:41.092314 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c4796fd7-f56a-424c-82fa-f0f6f0080fcb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:36:41.101027 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c4796fd7-f56a-424c-82fa-f0f6f0080fcb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1364 microversion: 2.1 time: 0.176870 Sep 17 21:36:41.101646 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3237/6384] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:40 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:36:42.124575 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ceac7f29-62ce-4701-b01a-14a5241f2326 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:42.125282 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ceac7f29-62ce-4701-b01a-14a5241f2326 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:42.133009 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ceac7f29-62ce-4701-b01a-14a5241f2326 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:42.133534 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ceac7f29-62ce-4701-b01a-14a5241f2326 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:42.133994 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ceac7f29-62ce-4701-b01a-14a5241f2326 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:42.134751 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ceac7f29-62ce-4701-b01a-14a5241f2326 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:42.135210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ceac7f29-62ce-4701-b01a-14a5241f2326 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:42.135640 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ceac7f29-62ce-4701-b01a-14a5241f2326 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:42.272047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ceac7f29-62ce-4701-b01a-14a5241f2326 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:36:42.280368 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ceac7f29-62ce-4701-b01a-14a5241f2326 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1364 microversion: 2.1 time: 0.160239 Sep 17 21:36:42.280932 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3148/6385] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:42 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:36:43.303845 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8dc571e5-f8ec-4e68-8291-12d77e4f5da3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:43.304534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8dc571e5-f8ec-4e68-8291-12d77e4f5da3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:43.311579 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8dc571e5-f8ec-4e68-8291-12d77e4f5da3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:43.312088 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8dc571e5-f8ec-4e68-8291-12d77e4f5da3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:43.312548 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8dc571e5-f8ec-4e68-8291-12d77e4f5da3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:43.313340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8dc571e5-f8ec-4e68-8291-12d77e4f5da3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:43.313856 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8dc571e5-f8ec-4e68-8291-12d77e4f5da3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:43.314297 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8dc571e5-f8ec-4e68-8291-12d77e4f5da3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:43.445454 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8dc571e5-f8ec-4e68-8291-12d77e4f5da3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:36:43.453801 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8dc571e5-f8ec-4e68-8291-12d77e4f5da3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1364 microversion: 2.1 time: 0.154141 Sep 17 21:36:43.454386 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3238/6386] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:43 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:36:44.476863 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f31f55fc-c8a8-40cf-9a61-b18e7c04cae3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:44.477514 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f31f55fc-c8a8-40cf-9a61-b18e7c04cae3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:44.484722 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f31f55fc-c8a8-40cf-9a61-b18e7c04cae3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:44.485224 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f31f55fc-c8a8-40cf-9a61-b18e7c04cae3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:44.485772 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f31f55fc-c8a8-40cf-9a61-b18e7c04cae3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:44.486487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f31f55fc-c8a8-40cf-9a61-b18e7c04cae3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:44.486928 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f31f55fc-c8a8-40cf-9a61-b18e7c04cae3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:44.487392 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f31f55fc-c8a8-40cf-9a61-b18e7c04cae3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:44.565225 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-3da57e67-c4e0-4230-9d39-a1ad9a4e9f0d req-04a63542-36c9-4f3a-8e7f-6608892c2f32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb9ed0d4-926d-4875-a885-f6400220fd50", "name": "network-vif-plugged", "status": "completed", "tag": "fbc6976d-9081-4409-8beb-d67bacef2971"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:36:44.578941 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-3da57e67-c4e0-4230-9d39-a1ad9a4e9f0d req-04a63542-36c9-4f3a-8e7f-6608892c2f32 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:44.579518 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-3da57e67-c4e0-4230-9d39-a1ad9a4e9f0d req-04a63542-36c9-4f3a-8e7f-6608892c2f32 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:44.580220 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-3da57e67-c4e0-4230-9d39-a1ad9a4e9f0d req-04a63542-36c9-4f3a-8e7f-6608892c2f32 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:44.592307 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-3da57e67-c4e0-4230-9d39-a1ad9a4e9f0d req-04a63542-36c9-4f3a-8e7f-6608892c2f32 service nova] Creating event network-vif-plugged:fbc6976d-9081-4409-8beb-d67bacef2971 for instance bb9ed0d4-926d-4875-a885-f6400220fd50 on nch2-master-1 Sep 17 21:36:44.597748 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-3da57e67-c4e0-4230-9d39-a1ad9a4e9f0d req-04a63542-36c9-4f3a-8e7f-6608892c2f32 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035804 Sep 17 21:36:44.598360 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3239/6387] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:36:44.650885 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f31f55fc-c8a8-40cf-9a61-b18e7c04cae3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:36:44.659133 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f31f55fc-c8a8-40cf-9a61-b18e7c04cae3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1364 microversion: 2.1 time: 0.186696 Sep 17 21:36:44.659717 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3149/6388] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:44 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1364 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:36:45.685828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-61544502-c9c4-461f-818f-ae86e868d50c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:45.686711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-61544502-c9c4-461f-818f-ae86e868d50c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:45.694166 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-61544502-c9c4-461f-818f-ae86e868d50c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:45.694306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-61544502-c9c4-461f-818f-ae86e868d50c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:45.694771 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-61544502-c9c4-461f-818f-ae86e868d50c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:45.695503 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-61544502-c9c4-461f-818f-ae86e868d50c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:45.695947 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-61544502-c9c4-461f-818f-ae86e868d50c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:45.696629 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-61544502-c9c4-461f-818f-ae86e868d50c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:45.839431 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-61544502-c9c4-461f-818f-ae86e868d50c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:36:45.848368 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-61544502-c9c4-461f-818f-ae86e868d50c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1364 microversion: 2.1 time: 0.168724 Sep 17 21:36:45.849124 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3240/6389] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:45 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:36:46.876122 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4db38ae8-d1da-4863-b3be-b26b6bbe1452 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:46.877148 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4db38ae8-d1da-4863-b3be-b26b6bbe1452 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:46.888213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4db38ae8-d1da-4863-b3be-b26b6bbe1452 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:46.889037 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4db38ae8-d1da-4863-b3be-b26b6bbe1452 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:46.889835 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4db38ae8-d1da-4863-b3be-b26b6bbe1452 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:46.890992 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4db38ae8-d1da-4863-b3be-b26b6bbe1452 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:46.891873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4db38ae8-d1da-4863-b3be-b26b6bbe1452 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:46.892310 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4db38ae8-d1da-4863-b3be-b26b6bbe1452 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:47.023531 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4db38ae8-d1da-4863-b3be-b26b6bbe1452 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:36:47.031688 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4db38ae8-d1da-4863-b3be-b26b6bbe1452 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1552 microversion: 2.1 time: 0.162432 Sep 17 21:36:47.032272 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3150/6390] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:36:46 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1552 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:36:47.054613 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9269aa69-b420-4f8d-a15b-e9d112c45241 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:36:47.055163 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9269aa69-b420-4f8d-a15b-e9d112c45241 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:36:47.062413 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9269aa69-b420-4f8d-a15b-e9d112c45241 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:47.062884 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9269aa69-b420-4f8d-a15b-e9d112c45241 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:47.063334 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9269aa69-b420-4f8d-a15b-e9d112c45241 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:47.064095 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9269aa69-b420-4f8d-a15b-e9d112c45241 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:47.064566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9269aa69-b420-4f8d-a15b-e9d112c45241 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:47.065003 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9269aa69-b420-4f8d-a15b-e9d112c45241 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:47.147652 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9269aa69-b420-4f8d-a15b-e9d112c45241 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097040 Sep 17 21:36:47.148261 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3241/6391] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Sep 17 21:36:47 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:36:48.108299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-2c23fb4e-1ed2-42a1-b910-e4c11e5b695c req-b609f622-b150-445c-bc3b-e5ece699655f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb9ed0d4-926d-4875-a885-f6400220fd50", "tag": "fbc6976d-9081-4409-8beb-d67bacef2971"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:36:48.113333 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:36:48.114031 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:36:48.120687 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2c23fb4e-1ed2-42a1-b910-e4c11e5b695c req-b609f622-b150-445c-bc3b-e5ece699655f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:36:48.121180 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2c23fb4e-1ed2-42a1-b910-e4c11e5b695c req-b609f622-b150-445c-bc3b-e5ece699655f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:36:48.121867 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2c23fb4e-1ed2-42a1-b910-e4c11e5b695c req-b609f622-b150-445c-bc3b-e5ece699655f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:36:48.133071 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-2c23fb4e-1ed2-42a1-b910-e4c11e5b695c req-b609f622-b150-445c-bc3b-e5ece699655f service nova] Creating event network-changed:fbc6976d-9081-4409-8beb-d67bacef2971 for instance bb9ed0d4-926d-4875-a885-f6400220fd50 on nch2-master-1 Sep 17 21:36:48.139128 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-2c23fb4e-1ed2-42a1-b910-e4c11e5b695c req-b609f622-b150-445c-bc3b-e5ece699655f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034621 Sep 17 21:36:48.139744 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3151/6392] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:37:24.242379 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=6 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:37:24.246155 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:37:24.246997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=30 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:37:24.253685 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a88ba18c-6800-4b89-8d39-783d56ad2e9c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:24.254532 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a88ba18c-6800-4b89-8d39-783d56ad2e9c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:24.264775 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a88ba18c-6800-4b89-8d39-783d56ad2e9c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:24.265506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a88ba18c-6800-4b89-8d39-783d56ad2e9c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:24.266315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a88ba18c-6800-4b89-8d39-783d56ad2e9c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:24.267034 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a88ba18c-6800-4b89-8d39-783d56ad2e9c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:24.267521 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a88ba18c-6800-4b89-8d39-783d56ad2e9c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:24.267948 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a88ba18c-6800-4b89-8d39-783d56ad2e9c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:24.407894 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a88ba18c-6800-4b89-8d39-783d56ad2e9c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:24.419241 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a88ba18c-6800-4b89-8d39-783d56ad2e9c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1670 microversion: 2.1 time: 0.178221 Sep 17 21:37:24.419995 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3242/6393] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:24 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1670 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:24.441538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:37:24.442356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=30 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:37:24.446861 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4484e807-1344-4796-829e-7dc63633975d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:24.447585 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4484e807-1344-4796-829e-7dc63633975d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:24.455365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4484e807-1344-4796-829e-7dc63633975d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:24.455897 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4484e807-1344-4796-829e-7dc63633975d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:24.456343 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4484e807-1344-4796-829e-7dc63633975d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:24.457046 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4484e807-1344-4796-829e-7dc63633975d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:24.457534 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4484e807-1344-4796-829e-7dc63633975d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:24.457973 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4484e807-1344-4796-829e-7dc63633975d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:24.598972 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4484e807-1344-4796-829e-7dc63633975d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:24.611215 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4484e807-1344-4796-829e-7dc63633975d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1670 microversion: 2.1 time: 0.171819 Sep 17 21:37:24.611951 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3152/6394] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:24 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1670 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:24.638817 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8d632e65-ad9c-4e82-aca3-8676ddf7c411 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:24.639476 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8d632e65-ad9c-4e82-aca3-8676ddf7c411 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:24.646150 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d632e65-ad9c-4e82-aca3-8676ddf7c411 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:24.646652 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d632e65-ad9c-4e82-aca3-8676ddf7c411 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:24.647102 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d632e65-ad9c-4e82-aca3-8676ddf7c411 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:24.647809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d632e65-ad9c-4e82-aca3-8676ddf7c411 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:24.648282 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d632e65-ad9c-4e82-aca3-8676ddf7c411 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:24.648722 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8d632e65-ad9c-4e82-aca3-8676ddf7c411 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:24.785885 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8d632e65-ad9c-4e82-aca3-8676ddf7c411 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:24.794679 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8d632e65-ad9c-4e82-aca3-8676ddf7c411 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1670 microversion: 2.1 time: 0.159853 Sep 17 21:37:24.795271 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3243/6395] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:24 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:24.820042 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-762a339f-82af-4ff1-ae89-7c59dc15ef37 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:37:24.823714 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-762a339f-82af-4ff1-ae89-7c59dc15ef37 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:24.831680 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-762a339f-82af-4ff1-ae89-7c59dc15ef37 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:24.832174 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-762a339f-82af-4ff1-ae89-7c59dc15ef37 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:24.832627 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-762a339f-82af-4ff1-ae89-7c59dc15ef37 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:24.833317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-762a339f-82af-4ff1-ae89-7c59dc15ef37 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:24.833814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-762a339f-82af-4ff1-ae89-7c59dc15ef37 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:24.834250 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-762a339f-82af-4ff1-ae89-7c59dc15ef37 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:24.862650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-762a339f-82af-4ff1-ae89-7c59dc15ef37 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:24.867854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-762a339f-82af-4ff1-ae89-7c59dc15ef37 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Old instance type m1.heat2, new instance type m1.heat {{(pid=140523) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 17 21:37:24.874575 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-762a339f-82af-4ff1-ae89-7c59dc15ef37 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:37:24.875021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-762a339f-82af-4ff1-ae89-7c59dc15ef37 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:37:24.875482 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-762a339f-82af-4ff1-ae89-7c59dc15ef37 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:37:24.875915 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-762a339f-82af-4ff1-ae89-7c59dc15ef37 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:37:24.876334 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-762a339f-82af-4ff1-ae89-7c59dc15ef37 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:37:24.954023 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-762a339f-82af-4ff1-ae89-7c59dc15ef37 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "POST /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50/action" status: 202 len: 0 microversion: 2.1 time: 0.139875 Sep 17 21:37:24.955014 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3153/6396] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:37:24 2022] POST /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:37:24.963125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-72b603cf-8821-4540-bd8f-a285760065e9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:24.963730 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-72b603cf-8821-4540-bd8f-a285760065e9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:24.970246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72b603cf-8821-4540-bd8f-a285760065e9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:24.970739 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72b603cf-8821-4540-bd8f-a285760065e9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:24.971558 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72b603cf-8821-4540-bd8f-a285760065e9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:24.972285 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72b603cf-8821-4540-bd8f-a285760065e9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:24.972739 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72b603cf-8821-4540-bd8f-a285760065e9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:24.973174 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-72b603cf-8821-4540-bd8f-a285760065e9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:25.126346 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-72b603cf-8821-4540-bd8f-a285760065e9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:25.134197 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-72b603cf-8821-4540-bd8f-a285760065e9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1679 microversion: 2.1 time: 0.175038 Sep 17 21:37:25.134761 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3244/6397] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:24 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:26.159389 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4c922aab-626e-4801-b9c0-dea72d56ecc1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:26.160007 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4c922aab-626e-4801-b9c0-dea72d56ecc1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:26.174015 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c922aab-626e-4801-b9c0-dea72d56ecc1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:26.174682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c922aab-626e-4801-b9c0-dea72d56ecc1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:26.175134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c922aab-626e-4801-b9c0-dea72d56ecc1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:26.175852 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c922aab-626e-4801-b9c0-dea72d56ecc1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:26.176300 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c922aab-626e-4801-b9c0-dea72d56ecc1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:26.176771 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c922aab-626e-4801-b9c0-dea72d56ecc1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:26.384372 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4c922aab-626e-4801-b9c0-dea72d56ecc1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:26.392747 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4c922aab-626e-4801-b9c0-dea72d56ecc1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1679 microversion: 2.1 time: 0.238464 Sep 17 21:37:26.393564 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3154/6398] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:26 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1679 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:27.421135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f523af47-5285-40ff-9538-e7dcde21895c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:27.422330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f523af47-5285-40ff-9538-e7dcde21895c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:27.430260 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f523af47-5285-40ff-9538-e7dcde21895c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:27.430812 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f523af47-5285-40ff-9538-e7dcde21895c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:27.431319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f523af47-5285-40ff-9538-e7dcde21895c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:27.432117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f523af47-5285-40ff-9538-e7dcde21895c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:27.432661 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f523af47-5285-40ff-9538-e7dcde21895c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:27.433157 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f523af47-5285-40ff-9538-e7dcde21895c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:27.586586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f523af47-5285-40ff-9538-e7dcde21895c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:27.597865 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f523af47-5285-40ff-9538-e7dcde21895c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1684 microversion: 2.1 time: 0.183591 Sep 17 21:37:27.598458 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3245/6399] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:27 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1684 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:28.626569 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4a4613f2-046d-4af9-8a58-6d34b257d770 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:28.627555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4a4613f2-046d-4af9-8a58-6d34b257d770 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:28.639295 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a4613f2-046d-4af9-8a58-6d34b257d770 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:28.640090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a4613f2-046d-4af9-8a58-6d34b257d770 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:28.640856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a4613f2-046d-4af9-8a58-6d34b257d770 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:28.641841 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a4613f2-046d-4af9-8a58-6d34b257d770 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:28.642305 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a4613f2-046d-4af9-8a58-6d34b257d770 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:28.642745 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a4613f2-046d-4af9-8a58-6d34b257d770 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:28.780280 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4a4613f2-046d-4af9-8a58-6d34b257d770 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:28.791773 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4a4613f2-046d-4af9-8a58-6d34b257d770 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1684 microversion: 2.1 time: 0.172011 Sep 17 21:37:28.792351 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3155/6400] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:28 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1684 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:29.818638 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d2d5653b-39cb-428a-b90a-abbb883500a0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:29.819235 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d2d5653b-39cb-428a-b90a-abbb883500a0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:29.826842 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d2d5653b-39cb-428a-b90a-abbb883500a0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:29.827470 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d2d5653b-39cb-428a-b90a-abbb883500a0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:29.827991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d2d5653b-39cb-428a-b90a-abbb883500a0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:29.828716 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d2d5653b-39cb-428a-b90a-abbb883500a0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:29.829188 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d2d5653b-39cb-428a-b90a-abbb883500a0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:29.829680 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d2d5653b-39cb-428a-b90a-abbb883500a0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:29.972060 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d2d5653b-39cb-428a-b90a-abbb883500a0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:29.980095 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d2d5653b-39cb-428a-b90a-abbb883500a0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1684 microversion: 2.1 time: 0.165582 Sep 17 21:37:29.980678 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3246/6401] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:29 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:31.008199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-abdc919a-456f-4381-87bc-3c9a94e78ee4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:31.009098 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-abdc919a-456f-4381-87bc-3c9a94e78ee4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:31.019239 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-abdc919a-456f-4381-87bc-3c9a94e78ee4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:31.019737 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-abdc919a-456f-4381-87bc-3c9a94e78ee4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:31.020175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-abdc919a-456f-4381-87bc-3c9a94e78ee4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:31.020882 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-abdc919a-456f-4381-87bc-3c9a94e78ee4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:31.021338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-abdc919a-456f-4381-87bc-3c9a94e78ee4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:31.021802 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-abdc919a-456f-4381-87bc-3c9a94e78ee4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:31.165060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-abdc919a-456f-4381-87bc-3c9a94e78ee4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:31.177974 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-abdc919a-456f-4381-87bc-3c9a94e78ee4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1684 microversion: 2.1 time: 0.176461 Sep 17 21:37:31.178748 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3156/6402] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:30 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1684 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:32.209366 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-37cb2b9f-9bbb-41d9-9047-299b48a6c0aa tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:32.210413 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-37cb2b9f-9bbb-41d9-9047-299b48a6c0aa tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:32.221793 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-37cb2b9f-9bbb-41d9-9047-299b48a6c0aa tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:32.222306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-37cb2b9f-9bbb-41d9-9047-299b48a6c0aa tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:32.222765 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-37cb2b9f-9bbb-41d9-9047-299b48a6c0aa tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:32.223496 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-37cb2b9f-9bbb-41d9-9047-299b48a6c0aa tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:32.223962 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-37cb2b9f-9bbb-41d9-9047-299b48a6c0aa tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:32.224401 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-37cb2b9f-9bbb-41d9-9047-299b48a6c0aa tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:32.361071 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-37cb2b9f-9bbb-41d9-9047-299b48a6c0aa tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:32.369199 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-37cb2b9f-9bbb-41d9-9047-299b48a6c0aa tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1684 microversion: 2.1 time: 0.165997 Sep 17 21:37:32.369803 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3247/6403] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:32 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:33.397225 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-00b64388-3afa-4981-bf7d-ccdf3b3a9dad tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:33.398427 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-00b64388-3afa-4981-bf7d-ccdf3b3a9dad tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:33.409659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00b64388-3afa-4981-bf7d-ccdf3b3a9dad tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:33.410160 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00b64388-3afa-4981-bf7d-ccdf3b3a9dad tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:33.410603 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00b64388-3afa-4981-bf7d-ccdf3b3a9dad tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:33.411346 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00b64388-3afa-4981-bf7d-ccdf3b3a9dad tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:33.411808 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00b64388-3afa-4981-bf7d-ccdf3b3a9dad tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:33.412243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00b64388-3afa-4981-bf7d-ccdf3b3a9dad tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:33.550651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-00b64388-3afa-4981-bf7d-ccdf3b3a9dad tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:33.559291 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-00b64388-3afa-4981-bf7d-ccdf3b3a9dad tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1684 microversion: 2.1 time: 0.168743 Sep 17 21:37:33.559876 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3157/6404] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:33 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:34.587712 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8f8db139-1ba7-4971-b871-7dc91da99664 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:34.588725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8f8db139-1ba7-4971-b871-7dc91da99664 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:34.601059 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f8db139-1ba7-4971-b871-7dc91da99664 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:34.601965 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f8db139-1ba7-4971-b871-7dc91da99664 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:34.602724 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f8db139-1ba7-4971-b871-7dc91da99664 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:34.603889 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f8db139-1ba7-4971-b871-7dc91da99664 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:34.604670 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f8db139-1ba7-4971-b871-7dc91da99664 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:34.605417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8f8db139-1ba7-4971-b871-7dc91da99664 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:34.754529 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8f8db139-1ba7-4971-b871-7dc91da99664 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:34.762978 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8f8db139-1ba7-4971-b871-7dc91da99664 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1684 microversion: 2.1 time: 0.182116 Sep 17 21:37:34.763559 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3248/6405] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:34 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1684 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:35.789390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-af884880-2dbf-44b8-86f9-571bf9fdea2f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:35.790115 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-af884880-2dbf-44b8-86f9-571bf9fdea2f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:35.798400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af884880-2dbf-44b8-86f9-571bf9fdea2f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:35.798949 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af884880-2dbf-44b8-86f9-571bf9fdea2f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:35.799443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af884880-2dbf-44b8-86f9-571bf9fdea2f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:35.800231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af884880-2dbf-44b8-86f9-571bf9fdea2f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:35.800748 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af884880-2dbf-44b8-86f9-571bf9fdea2f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:35.801225 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af884880-2dbf-44b8-86f9-571bf9fdea2f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:35.942442 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-af884880-2dbf-44b8-86f9-571bf9fdea2f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:35.950491 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-af884880-2dbf-44b8-86f9-571bf9fdea2f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1684 microversion: 2.1 time: 0.166441 Sep 17 21:37:35.951064 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3158/6406] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:35 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:36.978716 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3e943716-f3b3-402c-a7da-592c90c56ce8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:36.979664 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3e943716-f3b3-402c-a7da-592c90c56ce8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:36.990925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e943716-f3b3-402c-a7da-592c90c56ce8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:36.991336 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e943716-f3b3-402c-a7da-592c90c56ce8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:36.991793 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e943716-f3b3-402c-a7da-592c90c56ce8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:36.992510 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e943716-f3b3-402c-a7da-592c90c56ce8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:36.992982 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e943716-f3b3-402c-a7da-592c90c56ce8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:36.993421 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3e943716-f3b3-402c-a7da-592c90c56ce8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:37.132460 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3e943716-f3b3-402c-a7da-592c90c56ce8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:37.141041 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3e943716-f3b3-402c-a7da-592c90c56ce8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1684 microversion: 2.1 time: 0.169045 Sep 17 21:37:37.141653 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3249/6407] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:36 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1684 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:38.168154 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-69a316c0-adaa-4c12-b6c7-b58cb13711ef tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:38.169161 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-69a316c0-adaa-4c12-b6c7-b58cb13711ef tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:38.180811 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69a316c0-adaa-4c12-b6c7-b58cb13711ef tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:38.181719 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69a316c0-adaa-4c12-b6c7-b58cb13711ef tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:38.182451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69a316c0-adaa-4c12-b6c7-b58cb13711ef tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:38.183606 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69a316c0-adaa-4c12-b6c7-b58cb13711ef tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:38.184364 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69a316c0-adaa-4c12-b6c7-b58cb13711ef tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:38.185087 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69a316c0-adaa-4c12-b6c7-b58cb13711ef tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:38.332492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-69a316c0-adaa-4c12-b6c7-b58cb13711ef tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:38.341210 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-69a316c0-adaa-4c12-b6c7-b58cb13711ef tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1684 microversion: 2.1 time: 0.179805 Sep 17 21:37:38.341879 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3159/6408] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:38 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1684 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:39.254367 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-0619f88a-eadf-4028-bed7-6071642ad8e6 req-05767ce6-0a8a-488c-982c-1720bb441b15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb9ed0d4-926d-4875-a885-f6400220fd50", "name": "network-vif-unplugged", "status": "completed", "tag": "fbc6976d-9081-4409-8beb-d67bacef2971"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:37:39.266897 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-0619f88a-eadf-4028-bed7-6071642ad8e6 req-05767ce6-0a8a-488c-982c-1720bb441b15 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:39.267175 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-0619f88a-eadf-4028-bed7-6071642ad8e6 req-05767ce6-0a8a-488c-982c-1720bb441b15 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:39.267766 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-0619f88a-eadf-4028-bed7-6071642ad8e6 req-05767ce6-0a8a-488c-982c-1720bb441b15 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:39.282908 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-0619f88a-eadf-4028-bed7-6071642ad8e6 req-05767ce6-0a8a-488c-982c-1720bb441b15 service nova] Creating event network-vif-unplugged:fbc6976d-9081-4409-8beb-d67bacef2971 for instance bb9ed0d4-926d-4875-a885-f6400220fd50 on nch1-master-1 Sep 17 21:37:39.288826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [req-0619f88a-eadf-4028-bed7-6071642ad8e6 req-05767ce6-0a8a-488c-982c-1720bb441b15 service nova] Instance bb9ed0d4-926d-4875-a885-f6400220fd50 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140524) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 21:37:39.300377 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-0619f88a-eadf-4028-bed7-6071642ad8e6 req-05767ce6-0a8a-488c-982c-1720bb441b15 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050004 Sep 17 21:37:39.301040 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3250/6409] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:37:39.365812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e0f3766b-3d3d-4301-943d-34d033e6f473 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:39.367237 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e0f3766b-3d3d-4301-943d-34d033e6f473 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:39.375391 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0f3766b-3d3d-4301-943d-34d033e6f473 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:39.375888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0f3766b-3d3d-4301-943d-34d033e6f473 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:39.376337 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0f3766b-3d3d-4301-943d-34d033e6f473 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:39.377078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0f3766b-3d3d-4301-943d-34d033e6f473 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:39.377576 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0f3766b-3d3d-4301-943d-34d033e6f473 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:39.378015 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e0f3766b-3d3d-4301-943d-34d033e6f473 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:39.519116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e0f3766b-3d3d-4301-943d-34d033e6f473 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:39.527328 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e0f3766b-3d3d-4301-943d-34d033e6f473 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1683 microversion: 2.1 time: 0.165689 Sep 17 21:37:39.528075 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3160/6410] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:39 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:40.556184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d3b391cd-b884-4b46-af9b-4fd2b514c4a4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:40.557158 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d3b391cd-b884-4b46-af9b-4fd2b514c4a4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:40.565974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3b391cd-b884-4b46-af9b-4fd2b514c4a4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:40.566638 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3b391cd-b884-4b46-af9b-4fd2b514c4a4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:40.567244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3b391cd-b884-4b46-af9b-4fd2b514c4a4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:40.568260 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3b391cd-b884-4b46-af9b-4fd2b514c4a4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:40.568881 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3b391cd-b884-4b46-af9b-4fd2b514c4a4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:40.569505 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3b391cd-b884-4b46-af9b-4fd2b514c4a4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:40.711067 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d3b391cd-b884-4b46-af9b-4fd2b514c4a4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:40.719454 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d3b391cd-b884-4b46-af9b-4fd2b514c4a4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1681 microversion: 2.1 time: 0.170294 Sep 17 21:37:40.720054 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3251/6411] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:40 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:41.317029 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-23d48a8a-80dc-414b-8646-0baa05fc04ec req-2729af55-8942-4d7c-81aa-0f16f105d18a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb9ed0d4-926d-4875-a885-f6400220fd50", "tag": "fbc6976d-9081-4409-8beb-d67bacef2971"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:37:41.328512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-23d48a8a-80dc-414b-8646-0baa05fc04ec req-2729af55-8942-4d7c-81aa-0f16f105d18a service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:41.328995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-23d48a8a-80dc-414b-8646-0baa05fc04ec req-2729af55-8942-4d7c-81aa-0f16f105d18a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:41.329482 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-23d48a8a-80dc-414b-8646-0baa05fc04ec req-2729af55-8942-4d7c-81aa-0f16f105d18a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:41.342043 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-23d48a8a-80dc-414b-8646-0baa05fc04ec req-2729af55-8942-4d7c-81aa-0f16f105d18a service nova] Creating event network-changed:fbc6976d-9081-4409-8beb-d67bacef2971 for instance bb9ed0d4-926d-4875-a885-f6400220fd50 on nch1-master-1 Sep 17 21:37:41.348361 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [req-23d48a8a-80dc-414b-8646-0baa05fc04ec req-2729af55-8942-4d7c-81aa-0f16f105d18a service nova] Instance bb9ed0d4-926d-4875-a885-f6400220fd50 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140523) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 21:37:41.359997 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-23d48a8a-80dc-414b-8646-0baa05fc04ec req-2729af55-8942-4d7c-81aa-0f16f105d18a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046666 Sep 17 21:37:41.360616 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3161/6412] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:37:41.750968 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b99c5a5f-476a-4cff-8110-87dc23e522d4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:41.751607 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b99c5a5f-476a-4cff-8110-87dc23e522d4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:41.758403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b99c5a5f-476a-4cff-8110-87dc23e522d4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:41.758900 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b99c5a5f-476a-4cff-8110-87dc23e522d4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:41.759362 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b99c5a5f-476a-4cff-8110-87dc23e522d4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:41.760075 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b99c5a5f-476a-4cff-8110-87dc23e522d4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:41.760544 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b99c5a5f-476a-4cff-8110-87dc23e522d4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:41.760989 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b99c5a5f-476a-4cff-8110-87dc23e522d4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:41.987198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b99c5a5f-476a-4cff-8110-87dc23e522d4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:41.996482 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b99c5a5f-476a-4cff-8110-87dc23e522d4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1681 microversion: 2.1 time: 0.249621 Sep 17 21:37:41.997096 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3252/6413] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:41 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1681 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:37:43.021524 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fca8254e-9f0d-4b8d-ad8e-3c19e66df628 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:43.022368 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fca8254e-9f0d-4b8d-ad8e-3c19e66df628 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:43.029156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fca8254e-9f0d-4b8d-ad8e-3c19e66df628 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:43.029779 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fca8254e-9f0d-4b8d-ad8e-3c19e66df628 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:43.030299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fca8254e-9f0d-4b8d-ad8e-3c19e66df628 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:43.031090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fca8254e-9f0d-4b8d-ad8e-3c19e66df628 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:43.031624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fca8254e-9f0d-4b8d-ad8e-3c19e66df628 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:43.032063 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fca8254e-9f0d-4b8d-ad8e-3c19e66df628 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:43.167397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fca8254e-9f0d-4b8d-ad8e-3c19e66df628 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:43.175324 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fca8254e-9f0d-4b8d-ad8e-3c19e66df628 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1678 microversion: 2.1 time: 0.159134 Sep 17 21:37:43.175908 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3162/6414] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:43 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:43.198221 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a1850e88-61ee-43b7-9f55-13ea8692ff88 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:37:43.198778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a1850e88-61ee-43b7-9f55-13ea8692ff88 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:43.205922 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a1850e88-61ee-43b7-9f55-13ea8692ff88 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:43.206428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a1850e88-61ee-43b7-9f55-13ea8692ff88 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:43.206886 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a1850e88-61ee-43b7-9f55-13ea8692ff88 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:43.207599 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a1850e88-61ee-43b7-9f55-13ea8692ff88 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:43.208112 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a1850e88-61ee-43b7-9f55-13ea8692ff88 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:43.208564 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a1850e88-61ee-43b7-9f55-13ea8692ff88 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:43.272725 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a1850e88-61ee-43b7-9f55-13ea8692ff88 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "POST /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50/action" status: 204 len: 0 microversion: 2.1 time: 0.078042 Sep 17 21:37:43.273513 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3253/6415] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:37:43 2022] POST /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:37:43.282148 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-30fe9c30-28a9-4d44-99d7-594329df3266 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:43.282776 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-30fe9c30-28a9-4d44-99d7-594329df3266 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:43.289255 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30fe9c30-28a9-4d44-99d7-594329df3266 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:43.289793 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30fe9c30-28a9-4d44-99d7-594329df3266 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:43.290281 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30fe9c30-28a9-4d44-99d7-594329df3266 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:43.291038 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30fe9c30-28a9-4d44-99d7-594329df3266 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:43.291683 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30fe9c30-28a9-4d44-99d7-594329df3266 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:43.292230 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-30fe9c30-28a9-4d44-99d7-594329df3266 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:43.844448 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-30fe9c30-28a9-4d44-99d7-594329df3266 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:43.852920 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-30fe9c30-28a9-4d44-99d7-594329df3266 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1678 microversion: 2.1 time: 0.574725 Sep 17 21:37:43.853492 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3163/6416] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:43 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1678 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:44.878268 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f118af28-46f5-4b8a-89bb-ba22cf0c4d06 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:44.879102 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f118af28-46f5-4b8a-89bb-ba22cf0c4d06 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:44.886523 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f118af28-46f5-4b8a-89bb-ba22cf0c4d06 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:44.887041 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f118af28-46f5-4b8a-89bb-ba22cf0c4d06 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:44.887502 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f118af28-46f5-4b8a-89bb-ba22cf0c4d06 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:44.888223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f118af28-46f5-4b8a-89bb-ba22cf0c4d06 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:44.888699 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f118af28-46f5-4b8a-89bb-ba22cf0c4d06 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:44.889310 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f118af28-46f5-4b8a-89bb-ba22cf0c4d06 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:45.036095 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f118af28-46f5-4b8a-89bb-ba22cf0c4d06 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:45.045401 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f118af28-46f5-4b8a-89bb-ba22cf0c4d06 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1670 microversion: 2.1 time: 0.172657 Sep 17 21:37:45.046039 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3254/6417] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:44 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1670 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:45.068271 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d973e93c-f04f-488a-bb8a-0633f87a2711 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:45.068873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d973e93c-f04f-488a-bb8a-0633f87a2711 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:45.076182 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d973e93c-f04f-488a-bb8a-0633f87a2711 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:45.076866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d973e93c-f04f-488a-bb8a-0633f87a2711 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:45.077703 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d973e93c-f04f-488a-bb8a-0633f87a2711 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:45.078742 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d973e93c-f04f-488a-bb8a-0633f87a2711 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:45.079372 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d973e93c-f04f-488a-bb8a-0633f87a2711 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:45.079805 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d973e93c-f04f-488a-bb8a-0633f87a2711 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:45.088442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-5f799331-cf53-4cd5-9b3b-dbe7c0b780c4 req-a7e51d9d-d230-49be-a590-a273d0f75ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb9ed0d4-926d-4875-a885-f6400220fd50", "name": "network-vif-plugged", "status": "completed", "tag": "fbc6976d-9081-4409-8beb-d67bacef2971"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:37:45.107505 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-5f799331-cf53-4cd5-9b3b-dbe7c0b780c4 req-a7e51d9d-d230-49be-a590-a273d0f75ebd service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:45.108735 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-5f799331-cf53-4cd5-9b3b-dbe7c0b780c4 req-a7e51d9d-d230-49be-a590-a273d0f75ebd service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:45.109267 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-5f799331-cf53-4cd5-9b3b-dbe7c0b780c4 req-a7e51d9d-d230-49be-a590-a273d0f75ebd service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:45.125164 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-5f799331-cf53-4cd5-9b3b-dbe7c0b780c4 req-a7e51d9d-d230-49be-a590-a273d0f75ebd service nova] Creating event network-vif-plugged:fbc6976d-9081-4409-8beb-d67bacef2971 for instance bb9ed0d4-926d-4875-a885-f6400220fd50 on nch1-master-1 Sep 17 21:37:45.131972 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-5f799331-cf53-4cd5-9b3b-dbe7c0b780c4 req-a7e51d9d-d230-49be-a590-a273d0f75ebd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049809 Sep 17 21:37:45.132586 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3255/6418] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:37:45.223969 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d973e93c-f04f-488a-bb8a-0633f87a2711 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:45.231950 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d973e93c-f04f-488a-bb8a-0633f87a2711 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1670 microversion: 2.1 time: 0.167550 Sep 17 21:37:45.232527 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3164/6419] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:45 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1670 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:45.257769 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-75a52577-b1dc-44e6-9c91-72eaf8f10307 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:45.258497 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-75a52577-b1dc-44e6-9c91-72eaf8f10307 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:45.265347 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75a52577-b1dc-44e6-9c91-72eaf8f10307 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:45.265881 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75a52577-b1dc-44e6-9c91-72eaf8f10307 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:45.266339 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75a52577-b1dc-44e6-9c91-72eaf8f10307 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:45.267053 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75a52577-b1dc-44e6-9c91-72eaf8f10307 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:45.267526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75a52577-b1dc-44e6-9c91-72eaf8f10307 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:45.267972 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75a52577-b1dc-44e6-9c91-72eaf8f10307 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:45.407299 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-75a52577-b1dc-44e6-9c91-72eaf8f10307 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:45.415735 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-75a52577-b1dc-44e6-9c91-72eaf8f10307 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1670 microversion: 2.1 time: 0.164758 Sep 17 21:37:45.416440 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3256/6420] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:45 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1670 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:45.439169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f9cf940d-dae2-4ae2-a8dd-15487302c038 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:45.439674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f9cf940d-dae2-4ae2-a8dd-15487302c038 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:45.445869 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f9cf940d-dae2-4ae2-a8dd-15487302c038 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:45.446368 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f9cf940d-dae2-4ae2-a8dd-15487302c038 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:45.446813 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f9cf940d-dae2-4ae2-a8dd-15487302c038 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:45.447528 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f9cf940d-dae2-4ae2-a8dd-15487302c038 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:45.447991 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f9cf940d-dae2-4ae2-a8dd-15487302c038 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:45.448424 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f9cf940d-dae2-4ae2-a8dd-15487302c038 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:45.474574 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f9cf940d-dae2-4ae2-a8dd-15487302c038 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:37:45.530027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:37:45.565390 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f9cf940d-dae2-4ae2-a8dd-15487302c038 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 204 len: 0 microversion: 2.1 time: 0.129894 Sep 17 21:37:45.566383 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3165/6421] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:37:45 2022] DELETE /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:37:45.574883 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-50355dc4-3f2a-4522-97d6-c08536c0b792 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:45.575518 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-50355dc4-3f2a-4522-97d6-c08536c0b792 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:45.581956 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50355dc4-3f2a-4522-97d6-c08536c0b792 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:45.582465 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50355dc4-3f2a-4522-97d6-c08536c0b792 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:45.582977 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50355dc4-3f2a-4522-97d6-c08536c0b792 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:45.583707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50355dc4-3f2a-4522-97d6-c08536c0b792 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:45.584179 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50355dc4-3f2a-4522-97d6-c08536c0b792 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:45.584621 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-50355dc4-3f2a-4522-97d6-c08536c0b792 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:45.728504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-50355dc4-3f2a-4522-97d6-c08536c0b792 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:45.736979 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-50355dc4-3f2a-4522-97d6-c08536c0b792 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1676 microversion: 2.1 time: 0.166069 Sep 17 21:37:45.737588 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3257/6422] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:45 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:46.761555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cd69ec95-feb8-49a2-9173-753ea82f24db tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:46.762299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cd69ec95-feb8-49a2-9173-753ea82f24db tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:46.769738 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd69ec95-feb8-49a2-9173-753ea82f24db tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:46.770241 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd69ec95-feb8-49a2-9173-753ea82f24db tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:46.770693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd69ec95-feb8-49a2-9173-753ea82f24db tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:46.771407 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd69ec95-feb8-49a2-9173-753ea82f24db tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:46.771881 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd69ec95-feb8-49a2-9173-753ea82f24db tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:46.772348 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cd69ec95-feb8-49a2-9173-753ea82f24db tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:46.915193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cd69ec95-feb8-49a2-9173-753ea82f24db tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:46.923543 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cd69ec95-feb8-49a2-9173-753ea82f24db tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1676 microversion: 2.1 time: 0.166639 Sep 17 21:37:46.924106 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3166/6423] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:46 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:47.947595 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-01451ca8-87e4-40ba-afb2-fb2781565eb1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:47.948149 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-01451ca8-87e4-40ba-afb2-fb2781565eb1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:47.955446 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-01451ca8-87e4-40ba-afb2-fb2781565eb1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:47.955960 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-01451ca8-87e4-40ba-afb2-fb2781565eb1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:47.956643 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-01451ca8-87e4-40ba-afb2-fb2781565eb1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:47.957157 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-01451ca8-87e4-40ba-afb2-fb2781565eb1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:47.957661 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-01451ca8-87e4-40ba-afb2-fb2781565eb1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:47.958097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-01451ca8-87e4-40ba-afb2-fb2781565eb1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:47.974736 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:37:48.030793 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-01451ca8-87e4-40ba-afb2-fb2781565eb1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:48.041232 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-01451ca8-87e4-40ba-afb2-fb2781565eb1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 200 len: 1609 microversion: 2.1 time: 0.097678 Sep 17 21:37:48.042157 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3258/6424] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:47 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 1609 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:48.074596 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-111fca3a-d7c5-4857-af27-11753924f43e req-29328692-f3fb-4e52-87c2-9f4b3181c267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb9ed0d4-926d-4875-a885-f6400220fd50", "name": "network-vif-deleted", "tag": "fbc6976d-9081-4409-8beb-d67bacef2971"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:37:48.088924 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-111fca3a-d7c5-4857-af27-11753924f43e req-29328692-f3fb-4e52-87c2-9f4b3181c267 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:48.090244 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-111fca3a-d7c5-4857-af27-11753924f43e req-29328692-f3fb-4e52-87c2-9f4b3181c267 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:48.091342 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-111fca3a-d7c5-4857-af27-11753924f43e req-29328692-f3fb-4e52-87c2-9f4b3181c267 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:48.110537 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-111fca3a-d7c5-4857-af27-11753924f43e req-29328692-f3fb-4e52-87c2-9f4b3181c267 service nova] Creating event network-vif-deleted:fbc6976d-9081-4409-8beb-d67bacef2971 for instance bb9ed0d4-926d-4875-a885-f6400220fd50 on nch1-master-1 Sep 17 21:37:48.116146 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-111fca3a-d7c5-4857-af27-11753924f43e req-29328692-f3fb-4e52-87c2-9f4b3181c267 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045734 Sep 17 21:37:48.117346 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3167/6425] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:37:49.066122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4b8cdc7d-2259-4e45-afc8-097b7e863a7d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:49.066765 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4b8cdc7d-2259-4e45-afc8-097b7e863a7d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:49.074582 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b8cdc7d-2259-4e45-afc8-097b7e863a7d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:49.075125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b8cdc7d-2259-4e45-afc8-097b7e863a7d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:49.075808 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b8cdc7d-2259-4e45-afc8-097b7e863a7d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:49.076665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b8cdc7d-2259-4e45-afc8-097b7e863a7d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:49.077234 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b8cdc7d-2259-4e45-afc8-097b7e863a7d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:49.077699 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b8cdc7d-2259-4e45-afc8-097b7e863a7d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:49.092268 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-4b8cdc7d-2259-4e45-afc8-097b7e863a7d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] HTTP exception thrown: Instance bb9ed0d4-926d-4875-a885-f6400220fd50 could not be found. Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4b8cdc7d-2259-4e45-afc8-097b7e863a7d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Request method failure captured: Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 HTTP/1.1 Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJj3jwshgKHrmiTh9He2iymPHWHLX-Bt6aPFYMaypjQpla8PjsWm9yR1cr-rMt99yChBYg92ATksUdevYw1cssE35vglYIXszUAp944E84DQ3hBJviVnWeBZQ8d2ZXwzYz00kQH44YjF-EXnR6Tb897kEyxad5Zvgh2DN_v9yxO1e0r8 Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: ad243abc13a14aa08c717d4105e24f4f Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerActionsTestJSON-226995111 Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad243abc13a14aa08c717d4105e24f4f", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerActionsTestJSON-226995111 Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: ad243abc13a14aa08c717d4105e24f4f Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerActionsTestJSON-226995111 Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerActionsTestJSON-226995111-project Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: d20f8598dfec4de7b496a64e023e7a15 Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerActionsTestJSON-226995111-project Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance bb9ed0d4-926d-4875-a885-f6400220fd50 could not be found. Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'bb9ed0d4-926d-4875-a885-f6400220fd50'} Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb9ed0d4-926d-4875-a885-f6400220fd50 could not be found. Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb9ed0d4-926d-4875-a885-f6400220fd50 could not be found. Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:37:49.094017 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:37:49.099480 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:37:49.099480 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:37:49.099480 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:37:49.099480 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:37:49.099480 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:37:49.099480 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb9ed0d4-926d-4875-a885-f6400220fd50 could not be found. Sep 17 21:37:49.099480 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:37:49.099480 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4b8cdc7d-2259-4e45-afc8-097b7e863a7d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Returning 404 to user: Instance bb9ed0d4-926d-4875-a885-f6400220fd50 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:37:49.099480 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4b8cdc7d-2259-4e45-afc8-097b7e863a7d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 404 len: 111 microversion: 2.1 time: 0.033460 Sep 17 21:37:49.100117 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3259/6426] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:49 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:37:49.112573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d232ee5a-c212-413c-a456-eaf394911d7f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:49.113494 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d232ee5a-c212-413c-a456-eaf394911d7f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:49.120572 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d232ee5a-c212-413c-a456-eaf394911d7f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:49.121246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d232ee5a-c212-413c-a456-eaf394911d7f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:49.121725 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d232ee5a-c212-413c-a456-eaf394911d7f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:49.122435 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d232ee5a-c212-413c-a456-eaf394911d7f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:49.122899 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d232ee5a-c212-413c-a456-eaf394911d7f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:49.123333 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d232ee5a-c212-413c-a456-eaf394911d7f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:49.137919 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-d232ee5a-c212-413c-a456-eaf394911d7f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] HTTP exception thrown: Instance bb9ed0d4-926d-4875-a885-f6400220fd50 could not be found. Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d232ee5a-c212-413c-a456-eaf394911d7f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Request method failure captured: Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 HTTP/1.1 Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJj3jwshgKHrmiTh9He2iymPHWHLX-Bt6aPFYMaypjQpla8PjsWm9yR1cr-rMt99yChBYg92ATksUdevYw1cssE35vglYIXszUAp944E84DQ3hBJviVnWeBZQ8d2ZXwzYz00kQH44YjF-EXnR6Tb897kEyxad5Zvgh2DN_v9yxO1e0r8 Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: ad243abc13a14aa08c717d4105e24f4f Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerActionsTestJSON-226995111 Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad243abc13a14aa08c717d4105e24f4f", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerActionsTestJSON-226995111 Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: ad243abc13a14aa08c717d4105e24f4f Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerActionsTestJSON-226995111 Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerActionsTestJSON-226995111-project Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: d20f8598dfec4de7b496a64e023e7a15 Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerActionsTestJSON-226995111-project Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance bb9ed0d4-926d-4875-a885-f6400220fd50 could not be found. Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'bb9ed0d4-926d-4875-a885-f6400220fd50'} Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb9ed0d4-926d-4875-a885-f6400220fd50 could not be found. Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb9ed0d4-926d-4875-a885-f6400220fd50 could not be found. Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:37:49.139643 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:37:49.144709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:37:49.144709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:37:49.144709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:37:49.144709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:37:49.144709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:37:49.144709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb9ed0d4-926d-4875-a885-f6400220fd50 could not be found. Sep 17 21:37:49.144709 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:37:49.144709 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d232ee5a-c212-413c-a456-eaf394911d7f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Returning 404 to user: Instance bb9ed0d4-926d-4875-a885-f6400220fd50 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:37:49.144709 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d232ee5a-c212-413c-a456-eaf394911d7f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 404 len: 111 microversion: 2.1 time: 0.034264 Sep 17 21:37:49.150381 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3168/6427] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:49 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:37:49.190472 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2706930c-53e6-4f50-a907-a5887945d27f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-404761323", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "595473ed-8f19-4b14-b9d1-04243f9c5e91"}], "security_groups": [{"name": "tempest-securitygroup--262220769"}], "key_name": "tempest-keypair-1377054705", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:37:49.304867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-2706930c-53e6-4f50-a907-a5887945d27f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] validate_networks() for [('595473ed-8f19-4b14-b9d1-04243f9c5e91', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:37:49.695440 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-2706930c-53e6-4f50-a907-a5887945d27f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:37:49.695889 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-2706930c-53e6-4f50-a907-a5887945d27f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:37:49.696388 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-2706930c-53e6-4f50-a907-a5887945d27f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:37:49.696815 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-2706930c-53e6-4f50-a907-a5887945d27f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:37:49.697249 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-2706930c-53e6-4f50-a907-a5887945d27f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:37:49.706948 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2706930c-53e6-4f50-a907-a5887945d27f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:49.707438 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2706930c-53e6-4f50-a907-a5887945d27f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:49.707898 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2706930c-53e6-4f50-a907-a5887945d27f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:49.708657 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2706930c-53e6-4f50-a907-a5887945d27f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:49.709135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2706930c-53e6-4f50-a907-a5887945d27f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:49.709641 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2706930c-53e6-4f50-a907-a5887945d27f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:49.727710 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-2706930c-53e6-4f50-a907-a5887945d27f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Getting quotas for project ad243abc13a14aa08c717d4105e24f4f. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:37:49.733515 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-2706930c-53e6-4f50-a907-a5887945d27f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Getting quotas for user d20f8598dfec4de7b496a64e023e7a15 and project ad243abc13a14aa08c717d4105e24f4f. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:37:49.747086 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2706930c-53e6-4f50-a907-a5887945d27f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:37:49.749423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2706930c-53e6-4f50-a907-a5887945d27f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:37:49.800207 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2706930c-53e6-4f50-a907-a5887945d27f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.613579 Sep 17 21:37:49.800903 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3260/6428] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:37:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:37:49.812409 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c59a3111-304d-4e0e-a780-beafe53a1abb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:49.813059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c59a3111-304d-4e0e-a780-beafe53a1abb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:49.868334 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c59a3111-304d-4e0e-a780-beafe53a1abb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:49.875519 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c59a3111-304d-4e0e-a780-beafe53a1abb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1238 microversion: 2.1 time: 0.067024 Sep 17 21:37:49.876106 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3169/6429] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:49 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:50.900140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8b03e32c-afff-44c6-956c-61ad56bf440e tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:50.901552 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8b03e32c-afff-44c6-956c-61ad56bf440e tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:50.909758 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8b03e32c-afff-44c6-956c-61ad56bf440e tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:50.910315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8b03e32c-afff-44c6-956c-61ad56bf440e tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:50.910996 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8b03e32c-afff-44c6-956c-61ad56bf440e tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:50.911742 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8b03e32c-afff-44c6-956c-61ad56bf440e tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:50.913300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8b03e32c-afff-44c6-956c-61ad56bf440e tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:50.914005 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8b03e32c-afff-44c6-956c-61ad56bf440e tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:50.994347 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8b03e32c-afff-44c6-956c-61ad56bf440e tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:51.002520 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8b03e32c-afff-44c6-956c-61ad56bf440e tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1308 microversion: 2.1 time: 0.107862 Sep 17 21:37:51.003110 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3261/6430] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:50 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1308 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:52.026633 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3cabf827-aaa7-4c5b-8b8b-22c3334a1139 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:52.027261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3cabf827-aaa7-4c5b-8b8b-22c3334a1139 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:52.035276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3cabf827-aaa7-4c5b-8b8b-22c3334a1139 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:52.035851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3cabf827-aaa7-4c5b-8b8b-22c3334a1139 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:52.036387 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3cabf827-aaa7-4c5b-8b8b-22c3334a1139 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:52.037301 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3cabf827-aaa7-4c5b-8b8b-22c3334a1139 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:52.037770 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3cabf827-aaa7-4c5b-8b8b-22c3334a1139 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:52.038199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3cabf827-aaa7-4c5b-8b8b-22c3334a1139 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:52.275497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3cabf827-aaa7-4c5b-8b8b-22c3334a1139 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:52.283756 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3cabf827-aaa7-4c5b-8b8b-22c3334a1139 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1363 microversion: 2.1 time: 0.261062 Sep 17 21:37:52.284352 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3170/6431] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:52 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:52.435706 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-176d07d3-cbc6-48d5-ba2e-5166873301b2 req-2d439ba9-d345-49de-a24f-72f630732839 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "143f9113-e598-4087-bc18-939d798adbb1", "tag": "a1924e9b-c9d2-47bd-9482-7a8f06f58e1a"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:37:52.447632 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-176d07d3-cbc6-48d5-ba2e-5166873301b2 req-2d439ba9-d345-49de-a24f-72f630732839 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:52.448462 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-176d07d3-cbc6-48d5-ba2e-5166873301b2 req-2d439ba9-d345-49de-a24f-72f630732839 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:52.448589 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-176d07d3-cbc6-48d5-ba2e-5166873301b2 req-2d439ba9-d345-49de-a24f-72f630732839 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:52.460513 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-176d07d3-cbc6-48d5-ba2e-5166873301b2 req-2d439ba9-d345-49de-a24f-72f630732839 service nova] Creating event network-changed:a1924e9b-c9d2-47bd-9482-7a8f06f58e1a for instance 143f9113-e598-4087-bc18-939d798adbb1 on nch2-master-1 Sep 17 21:37:52.465829 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-176d07d3-cbc6-48d5-ba2e-5166873301b2 req-2d439ba9-d345-49de-a24f-72f630732839 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033985 Sep 17 21:37:52.466422 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3262/6432] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:37:53.309786 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8f64bf07-6a5a-408e-b604-f1c3296f9e0c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:53.310370 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8f64bf07-6a5a-408e-b604-f1c3296f9e0c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:53.317866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8f64bf07-6a5a-408e-b604-f1c3296f9e0c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:53.318371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8f64bf07-6a5a-408e-b604-f1c3296f9e0c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:53.318820 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8f64bf07-6a5a-408e-b604-f1c3296f9e0c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:53.319525 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8f64bf07-6a5a-408e-b604-f1c3296f9e0c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:53.320004 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8f64bf07-6a5a-408e-b604-f1c3296f9e0c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:53.320451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8f64bf07-6a5a-408e-b604-f1c3296f9e0c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:53.465045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8f64bf07-6a5a-408e-b604-f1c3296f9e0c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:53.478514 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8f64bf07-6a5a-408e-b604-f1c3296f9e0c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1363 microversion: 2.1 time: 0.172524 Sep 17 21:37:53.479250 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3171/6433] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:53 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:54.514315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e90e3eb5-1ad1-471c-b1ff-741e0df0d62a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:54.515505 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e90e3eb5-1ad1-471c-b1ff-741e0df0d62a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:54.518733 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:37:54.528447 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e90e3eb5-1ad1-471c-b1ff-741e0df0d62a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:54.529317 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e90e3eb5-1ad1-471c-b1ff-741e0df0d62a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:54.530143 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e90e3eb5-1ad1-471c-b1ff-741e0df0d62a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:54.531319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e90e3eb5-1ad1-471c-b1ff-741e0df0d62a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:54.532155 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e90e3eb5-1ad1-471c-b1ff-741e0df0d62a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:54.532897 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e90e3eb5-1ad1-471c-b1ff-741e0df0d62a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:54.677636 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e90e3eb5-1ad1-471c-b1ff-741e0df0d62a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:54.685589 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e90e3eb5-1ad1-471c-b1ff-741e0df0d62a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1363 microversion: 2.1 time: 0.180181 Sep 17 21:37:54.686172 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3263/6434] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:54 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:55.713803 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a2be5411-a0b1-420b-a1a4-b992d5fb8a57 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:55.714460 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a2be5411-a0b1-420b-a1a4-b992d5fb8a57 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:55.717446 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:37:55.723605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2be5411-a0b1-420b-a1a4-b992d5fb8a57 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:55.724115 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2be5411-a0b1-420b-a1a4-b992d5fb8a57 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:55.724566 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2be5411-a0b1-420b-a1a4-b992d5fb8a57 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:55.725297 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2be5411-a0b1-420b-a1a4-b992d5fb8a57 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:55.725804 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2be5411-a0b1-420b-a1a4-b992d5fb8a57 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:55.726247 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2be5411-a0b1-420b-a1a4-b992d5fb8a57 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:55.864317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a2be5411-a0b1-420b-a1a4-b992d5fb8a57 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:55.872597 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a2be5411-a0b1-420b-a1a4-b992d5fb8a57 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1363 microversion: 2.1 time: 0.163829 Sep 17 21:37:55.873174 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3172/6435] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:55 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:56.896665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-faa6c96b-4155-4dae-a614-060932e6c4e1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:56.897444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-faa6c96b-4155-4dae-a614-060932e6c4e1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:56.904775 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-faa6c96b-4155-4dae-a614-060932e6c4e1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:56.905216 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-faa6c96b-4155-4dae-a614-060932e6c4e1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:56.905706 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-faa6c96b-4155-4dae-a614-060932e6c4e1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:56.906438 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-faa6c96b-4155-4dae-a614-060932e6c4e1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:56.906917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-faa6c96b-4155-4dae-a614-060932e6c4e1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:56.907365 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-faa6c96b-4155-4dae-a614-060932e6c4e1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:57.035484 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-c9c03f13-a1f0-4ef4-ab73-23ef2a5f3a69 req-573ab6a9-42a3-4a8d-8fe2-56837bf277bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "143f9113-e598-4087-bc18-939d798adbb1", "name": "network-vif-plugged", "status": "completed", "tag": "a1924e9b-c9d2-47bd-9482-7a8f06f58e1a"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:37:57.047319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-faa6c96b-4155-4dae-a614-060932e6c4e1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:57.049755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-c9c03f13-a1f0-4ef4-ab73-23ef2a5f3a69 req-573ab6a9-42a3-4a8d-8fe2-56837bf277bb service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:57.050250 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-c9c03f13-a1f0-4ef4-ab73-23ef2a5f3a69 req-573ab6a9-42a3-4a8d-8fe2-56837bf277bb service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:57.050734 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-c9c03f13-a1f0-4ef4-ab73-23ef2a5f3a69 req-573ab6a9-42a3-4a8d-8fe2-56837bf277bb service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:57.056449 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-faa6c96b-4155-4dae-a614-060932e6c4e1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1363 microversion: 2.1 time: 0.162711 Sep 17 21:37:57.056449 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3264/6436] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:56 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:57.063615 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-c9c03f13-a1f0-4ef4-ab73-23ef2a5f3a69 req-573ab6a9-42a3-4a8d-8fe2-56837bf277bb service nova] Creating event network-vif-plugged:a1924e9b-c9d2-47bd-9482-7a8f06f58e1a for instance 143f9113-e598-4087-bc18-939d798adbb1 on nch2-master-1 Sep 17 21:37:57.069038 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-c9c03f13-a1f0-4ef4-ab73-23ef2a5f3a69 req-573ab6a9-42a3-4a8d-8fe2-56837bf277bb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037340 Sep 17 21:37:57.069691 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3173/6437] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:37:58.085311 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d745ddfb-c694-445c-b5b4-0c598daa8afb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:58.086050 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d745ddfb-c694-445c-b5b4-0c598daa8afb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:58.093565 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d745ddfb-c694-445c-b5b4-0c598daa8afb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:58.094064 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d745ddfb-c694-445c-b5b4-0c598daa8afb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:58.094502 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d745ddfb-c694-445c-b5b4-0c598daa8afb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:58.095250 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d745ddfb-c694-445c-b5b4-0c598daa8afb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:58.096063 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d745ddfb-c694-445c-b5b4-0c598daa8afb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:58.096505 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d745ddfb-c694-445c-b5b4-0c598daa8afb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:58.231740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d745ddfb-c694-445c-b5b4-0c598daa8afb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:58.240006 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d745ddfb-c694-445c-b5b4-0c598daa8afb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1363 microversion: 2.1 time: 0.161227 Sep 17 21:37:58.240607 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3265/6438] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:58 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:59.266032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-08058cc8-4fd6-4dae-a478-f9b21e9050b3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:59.266768 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-08058cc8-4fd6-4dae-a478-f9b21e9050b3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:59.273800 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08058cc8-4fd6-4dae-a478-f9b21e9050b3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:59.274331 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08058cc8-4fd6-4dae-a478-f9b21e9050b3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:59.274825 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08058cc8-4fd6-4dae-a478-f9b21e9050b3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:59.275594 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08058cc8-4fd6-4dae-a478-f9b21e9050b3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:59.276115 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08058cc8-4fd6-4dae-a478-f9b21e9050b3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:59.276570 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-08058cc8-4fd6-4dae-a478-f9b21e9050b3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:59.412802 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-08058cc8-4fd6-4dae-a478-f9b21e9050b3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:37:59.421564 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-08058cc8-4fd6-4dae-a478-f9b21e9050b3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1550 microversion: 2.1 time: 0.160980 Sep 17 21:37:59.422079 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3174/6439] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:37:59 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1550 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:37:59.454068 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fb66e1c9-9155-4048-a462-08565ea55e39 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:37:59.454637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fb66e1c9-9155-4048-a462-08565ea55e39 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:37:59.461893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fb66e1c9-9155-4048-a462-08565ea55e39 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:59.462398 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fb66e1c9-9155-4048-a462-08565ea55e39 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:59.462860 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fb66e1c9-9155-4048-a462-08565ea55e39 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:59.463574 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fb66e1c9-9155-4048-a462-08565ea55e39 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:37:59.464049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fb66e1c9-9155-4048-a462-08565ea55e39 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:37:59.464508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fb66e1c9-9155-4048-a462-08565ea55e39 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:37:59.544916 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fb66e1c9-9155-4048-a462-08565ea55e39 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094538 Sep 17 21:37:59.545866 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3266/6440] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Sep 17 21:37:59 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:38:00.535726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-264412d1-bdc2-4162-a5e4-ce24f1d9564d req-4fba3f6a-394d-42e8-aa43-8340c93e9366 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "143f9113-e598-4087-bc18-939d798adbb1", "tag": "a1924e9b-c9d2-47bd-9482-7a8f06f58e1a"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:38:00.540730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:38:00.547641 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-264412d1-bdc2-4162-a5e4-ce24f1d9564d req-4fba3f6a-394d-42e8-aa43-8340c93e9366 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:00.548119 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-264412d1-bdc2-4162-a5e4-ce24f1d9564d req-4fba3f6a-394d-42e8-aa43-8340c93e9366 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:00.548549 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-264412d1-bdc2-4162-a5e4-ce24f1d9564d req-4fba3f6a-394d-42e8-aa43-8340c93e9366 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:00.559730 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-264412d1-bdc2-4162-a5e4-ce24f1d9564d req-4fba3f6a-394d-42e8-aa43-8340c93e9366 service nova] Creating event network-changed:a1924e9b-c9d2-47bd-9482-7a8f06f58e1a for instance 143f9113-e598-4087-bc18-939d798adbb1 on nch2-master-1 Sep 17 21:38:00.564909 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-264412d1-bdc2-4162-a5e4-ce24f1d9564d req-4fba3f6a-394d-42e8-aa43-8340c93e9366 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032840 Sep 17 21:38:00.565929 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3175/6441] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:38:33.427015 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:38:33.428122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=6 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:38:33.430609 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=7 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:38:33.431420 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=37 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:38:33.436868 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cc331886-cc7e-4013-b836-918dea831998 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:38:33.446805 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc331886-cc7e-4013-b836-918dea831998 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:33.447440 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc331886-cc7e-4013-b836-918dea831998 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:33.448024 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc331886-cc7e-4013-b836-918dea831998 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:33.473641 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cc331886-cc7e-4013-b836-918dea831998 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Going to try to stop instance {{(pid=140524) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 17 21:38:33.521106 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cc331886-cc7e-4013-b836-918dea831998 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "POST /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1/action" status: 202 len: 0 microversion: 2.1 time: 0.094834 Sep 17 21:38:33.521765 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3267/6442] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:38:33 2022] POST /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:38:33.528701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=7 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:38:33.530147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=38 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:38:33.534606 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-97d43b16-1823-43ec-bc7d-803b235915ae tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:38:33.535455 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-97d43b16-1823-43ec-bc7d-803b235915ae tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:38:33.543035 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-97d43b16-1823-43ec-bc7d-803b235915ae tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:33.543532 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-97d43b16-1823-43ec-bc7d-803b235915ae tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:33.543982 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-97d43b16-1823-43ec-bc7d-803b235915ae tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:33.544698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-97d43b16-1823-43ec-bc7d-803b235915ae tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:33.545160 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-97d43b16-1823-43ec-bc7d-803b235915ae tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:33.545625 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-97d43b16-1823-43ec-bc7d-803b235915ae tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:33.681098 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-97d43b16-1823-43ec-bc7d-803b235915ae tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:38:33.690880 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-97d43b16-1823-43ec-bc7d-803b235915ae tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1678 microversion: 2.1 time: 0.164262 Sep 17 21:38:33.691505 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3176/6443] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:38:33 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:38:34.722268 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-741c82db-e4fb-4c98-923b-9c2ca64939a8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:38:34.722990 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-741c82db-e4fb-4c98-923b-9c2ca64939a8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:38:34.730031 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-741c82db-e4fb-4c98-923b-9c2ca64939a8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:34.730546 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-741c82db-e4fb-4c98-923b-9c2ca64939a8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:34.731005 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-741c82db-e4fb-4c98-923b-9c2ca64939a8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:34.731730 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-741c82db-e4fb-4c98-923b-9c2ca64939a8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:34.732210 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-741c82db-e4fb-4c98-923b-9c2ca64939a8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:34.732653 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-741c82db-e4fb-4c98-923b-9c2ca64939a8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:34.879724 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-741c82db-e4fb-4c98-923b-9c2ca64939a8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:38:34.892288 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-741c82db-e4fb-4c98-923b-9c2ca64939a8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1678 microversion: 2.1 time: 0.175709 Sep 17 21:38:34.892990 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3268/6444] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:38:34 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:38:35.916694 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6300c820-9328-4d4a-a204-a2ae105ff8f7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:38:35.917313 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6300c820-9328-4d4a-a204-a2ae105ff8f7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:38:35.924707 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6300c820-9328-4d4a-a204-a2ae105ff8f7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:35.925202 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6300c820-9328-4d4a-a204-a2ae105ff8f7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:35.925699 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6300c820-9328-4d4a-a204-a2ae105ff8f7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:35.926408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6300c820-9328-4d4a-a204-a2ae105ff8f7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:35.926871 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6300c820-9328-4d4a-a204-a2ae105ff8f7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:35.927358 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6300c820-9328-4d4a-a204-a2ae105ff8f7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:36.058527 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6300c820-9328-4d4a-a204-a2ae105ff8f7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:38:36.066502 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6300c820-9328-4d4a-a204-a2ae105ff8f7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1678 microversion: 2.1 time: 0.153911 Sep 17 21:38:36.067080 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3177/6445] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:38:35 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:38:37.095391 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fc9044cf-9d68-4002-ab23-8a988e853b43 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:38:37.096266 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fc9044cf-9d68-4002-ab23-8a988e853b43 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:38:37.104913 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc9044cf-9d68-4002-ab23-8a988e853b43 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:37.105428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc9044cf-9d68-4002-ab23-8a988e853b43 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:37.105922 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc9044cf-9d68-4002-ab23-8a988e853b43 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:37.106678 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc9044cf-9d68-4002-ab23-8a988e853b43 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:37.107132 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc9044cf-9d68-4002-ab23-8a988e853b43 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:37.107622 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fc9044cf-9d68-4002-ab23-8a988e853b43 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:37.244063 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fc9044cf-9d68-4002-ab23-8a988e853b43 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:38:37.256949 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fc9044cf-9d68-4002-ab23-8a988e853b43 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1678 microversion: 2.1 time: 0.168737 Sep 17 21:38:37.257940 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3269/6446] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:38:37 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:38:38.291383 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0e12183d-8581-4e6c-864b-3d73006e1d16 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:38:38.292409 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0e12183d-8581-4e6c-864b-3d73006e1d16 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:38:38.304162 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e12183d-8581-4e6c-864b-3d73006e1d16 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:38.304937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e12183d-8581-4e6c-864b-3d73006e1d16 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:38.305739 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e12183d-8581-4e6c-864b-3d73006e1d16 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:38.306919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e12183d-8581-4e6c-864b-3d73006e1d16 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:38.307688 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e12183d-8581-4e6c-864b-3d73006e1d16 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:38.308417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0e12183d-8581-4e6c-864b-3d73006e1d16 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:38.448504 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0e12183d-8581-4e6c-864b-3d73006e1d16 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:38:38.457048 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0e12183d-8581-4e6c-864b-3d73006e1d16 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1678 microversion: 2.1 time: 0.172482 Sep 17 21:38:38.457667 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3178/6447] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:38:38 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:38:39.484915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-507848d9-f2b8-4e5d-9d59-ed3463d9d314 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:38:39.486096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-507848d9-f2b8-4e5d-9d59-ed3463d9d314 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:38:39.495660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-507848d9-f2b8-4e5d-9d59-ed3463d9d314 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:39.496168 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-507848d9-f2b8-4e5d-9d59-ed3463d9d314 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:39.496626 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-507848d9-f2b8-4e5d-9d59-ed3463d9d314 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:39.497342 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-507848d9-f2b8-4e5d-9d59-ed3463d9d314 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:39.497850 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-507848d9-f2b8-4e5d-9d59-ed3463d9d314 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:39.498298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-507848d9-f2b8-4e5d-9d59-ed3463d9d314 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:39.639029 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-507848d9-f2b8-4e5d-9d59-ed3463d9d314 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:38:39.647145 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-507848d9-f2b8-4e5d-9d59-ed3463d9d314 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1678 microversion: 2.1 time: 0.169067 Sep 17 21:38:39.647724 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3270/6448] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:38:39 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:38:40.680643 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0494cc05-953f-4262-8917-760cbb01a1f3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:38:40.681800 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0494cc05-953f-4262-8917-760cbb01a1f3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:38:40.693242 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0494cc05-953f-4262-8917-760cbb01a1f3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:40.694103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0494cc05-953f-4262-8917-760cbb01a1f3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:40.694846 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0494cc05-953f-4262-8917-760cbb01a1f3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:40.696030 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0494cc05-953f-4262-8917-760cbb01a1f3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:40.697522 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0494cc05-953f-4262-8917-760cbb01a1f3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:40.697522 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0494cc05-953f-4262-8917-760cbb01a1f3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:40.837870 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0494cc05-953f-4262-8917-760cbb01a1f3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:38:40.846452 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0494cc05-953f-4262-8917-760cbb01a1f3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1678 microversion: 2.1 time: 0.172331 Sep 17 21:38:40.847044 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3179/6449] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:38:40 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:38:41.870167 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-830a0d7f-8587-46c9-935d-991605273d8c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:38:41.870905 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-830a0d7f-8587-46c9-935d-991605273d8c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:38:41.878134 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-830a0d7f-8587-46c9-935d-991605273d8c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:41.878634 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-830a0d7f-8587-46c9-935d-991605273d8c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:41.879090 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-830a0d7f-8587-46c9-935d-991605273d8c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:41.879910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-830a0d7f-8587-46c9-935d-991605273d8c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:41.880381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-830a0d7f-8587-46c9-935d-991605273d8c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:41.880824 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-830a0d7f-8587-46c9-935d-991605273d8c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:42.027246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-830a0d7f-8587-46c9-935d-991605273d8c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:38:42.035421 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-830a0d7f-8587-46c9-935d-991605273d8c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1678 microversion: 2.1 time: 0.169616 Sep 17 21:38:42.036010 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3271/6450] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:38:41 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:38:43.059896 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1a919292-4120-42f0-a0f2-076f88641ba9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:38:43.060475 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1a919292-4120-42f0-a0f2-076f88641ba9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:38:43.067938 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a919292-4120-42f0-a0f2-076f88641ba9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:43.068436 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a919292-4120-42f0-a0f2-076f88641ba9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:43.068888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a919292-4120-42f0-a0f2-076f88641ba9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:43.069621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a919292-4120-42f0-a0f2-076f88641ba9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:43.070113 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a919292-4120-42f0-a0f2-076f88641ba9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:43.070551 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a919292-4120-42f0-a0f2-076f88641ba9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:43.212676 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1a919292-4120-42f0-a0f2-076f88641ba9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:38:43.221595 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1a919292-4120-42f0-a0f2-076f88641ba9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1678 microversion: 2.1 time: 0.165937 Sep 17 21:38:43.222164 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3180/6451] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:38:43 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:38:44.247357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2b20100b-4d52-4454-bf91-5528604aaad0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:38:44.248192 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2b20100b-4d52-4454-bf91-5528604aaad0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:38:44.258077 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b20100b-4d52-4454-bf91-5528604aaad0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:44.258749 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b20100b-4d52-4454-bf91-5528604aaad0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:44.259399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b20100b-4d52-4454-bf91-5528604aaad0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:44.260118 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b20100b-4d52-4454-bf91-5528604aaad0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:44.260591 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b20100b-4d52-4454-bf91-5528604aaad0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:44.261032 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2b20100b-4d52-4454-bf91-5528604aaad0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:44.392550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2b20100b-4d52-4454-bf91-5528604aaad0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:38:44.400666 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2b20100b-4d52-4454-bf91-5528604aaad0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1655 microversion: 2.1 time: 0.158591 Sep 17 21:38:44.401244 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3272/6452] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:38:44 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1655 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:38:44.423791 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d0c1d8b6-2ff5-43e8-9cb5-d84700d8bfb5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:38:44.426132 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d0c1d8b6-2ff5-43e8-9cb5-d84700d8bfb5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:38:44.433939 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d0c1d8b6-2ff5-43e8-9cb5-d84700d8bfb5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:44.434442 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d0c1d8b6-2ff5-43e8-9cb5-d84700d8bfb5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:44.434889 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d0c1d8b6-2ff5-43e8-9cb5-d84700d8bfb5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:44.435606 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d0c1d8b6-2ff5-43e8-9cb5-d84700d8bfb5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:44.436071 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d0c1d8b6-2ff5-43e8-9cb5-d84700d8bfb5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:44.436506 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d0c1d8b6-2ff5-43e8-9cb5-d84700d8bfb5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:44.464985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d0c1d8b6-2ff5-43e8-9cb5-d84700d8bfb5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:38:44.472268 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d0c1d8b6-2ff5-43e8-9cb5-d84700d8bfb5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Old instance type m1.heat2, new instance type m1.heat {{(pid=140523) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 17 21:38:44.481328 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-d0c1d8b6-2ff5-43e8-9cb5-d84700d8bfb5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:38:44.481799 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-d0c1d8b6-2ff5-43e8-9cb5-d84700d8bfb5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:38:44.482285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-d0c1d8b6-2ff5-43e8-9cb5-d84700d8bfb5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:38:44.482704 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-d0c1d8b6-2ff5-43e8-9cb5-d84700d8bfb5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:38:44.483153 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-d0c1d8b6-2ff5-43e8-9cb5-d84700d8bfb5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:38:44.562038 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d0c1d8b6-2ff5-43e8-9cb5-d84700d8bfb5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "POST /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1/action" status: 202 len: 0 microversion: 2.1 time: 0.142236 Sep 17 21:38:44.562659 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3181/6453] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:38:44 2022] POST /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:38:44.572576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5c0bbbf8-7c58-4db1-a7c8-c2977c35ad56 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:38:44.573220 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5c0bbbf8-7c58-4db1-a7c8-c2977c35ad56 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:38:44.579491 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c0bbbf8-7c58-4db1-a7c8-c2977c35ad56 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:44.580000 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c0bbbf8-7c58-4db1-a7c8-c2977c35ad56 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:44.580481 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c0bbbf8-7c58-4db1-a7c8-c2977c35ad56 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:44.581200 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c0bbbf8-7c58-4db1-a7c8-c2977c35ad56 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:44.581707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c0bbbf8-7c58-4db1-a7c8-c2977c35ad56 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:44.582182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c0bbbf8-7c58-4db1-a7c8-c2977c35ad56 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:44.747588 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5c0bbbf8-7c58-4db1-a7c8-c2977c35ad56 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:38:44.756086 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5c0bbbf8-7c58-4db1-a7c8-c2977c35ad56 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1678 microversion: 2.1 time: 0.188685 Sep 17 21:38:44.756764 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3273/6454] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:38:44 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1678 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:38:45.782559 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-964bd04c-bf3c-4181-af72-76263ee416db tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:38:45.783297 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-964bd04c-bf3c-4181-af72-76263ee416db tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:38:45.789707 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-964bd04c-bf3c-4181-af72-76263ee416db tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:45.790213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-964bd04c-bf3c-4181-af72-76263ee416db tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:45.791015 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-964bd04c-bf3c-4181-af72-76263ee416db tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:45.791758 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-964bd04c-bf3c-4181-af72-76263ee416db tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:45.792211 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-964bd04c-bf3c-4181-af72-76263ee416db tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:45.792657 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-964bd04c-bf3c-4181-af72-76263ee416db tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:45.927257 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-964bd04c-bf3c-4181-af72-76263ee416db tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:38:45.935552 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-964bd04c-bf3c-4181-af72-76263ee416db tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1678 microversion: 2.1 time: 0.158126 Sep 17 21:38:45.936133 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3182/6455] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:38:45 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:38:46.964157 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-610697bf-d8b6-447f-9184-185ce7945e3d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:38:46.964783 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-610697bf-d8b6-447f-9184-185ce7945e3d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:38:46.972232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-610697bf-d8b6-447f-9184-185ce7945e3d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:46.972735 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-610697bf-d8b6-447f-9184-185ce7945e3d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:46.973191 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-610697bf-d8b6-447f-9184-185ce7945e3d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:46.973935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-610697bf-d8b6-447f-9184-185ce7945e3d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:46.974409 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-610697bf-d8b6-447f-9184-185ce7945e3d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:46.974844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-610697bf-d8b6-447f-9184-185ce7945e3d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:47.119944 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-610697bf-d8b6-447f-9184-185ce7945e3d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:38:47.128009 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-610697bf-d8b6-447f-9184-185ce7945e3d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1683 microversion: 2.1 time: 0.169729 Sep 17 21:38:47.128600 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3274/6456] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:38:46 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:38:48.152884 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1a0277c4-70bb-450d-8b0e-089d8c61cac4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:38:48.153650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1a0277c4-70bb-450d-8b0e-089d8c61cac4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:38:48.161988 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a0277c4-70bb-450d-8b0e-089d8c61cac4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:48.162535 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a0277c4-70bb-450d-8b0e-089d8c61cac4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:48.163022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a0277c4-70bb-450d-8b0e-089d8c61cac4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:48.163800 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a0277c4-70bb-450d-8b0e-089d8c61cac4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:48.164321 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a0277c4-70bb-450d-8b0e-089d8c61cac4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:48.164802 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a0277c4-70bb-450d-8b0e-089d8c61cac4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:48.320341 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1a0277c4-70bb-450d-8b0e-089d8c61cac4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:38:48.328430 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1a0277c4-70bb-450d-8b0e-089d8c61cac4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1683 microversion: 2.1 time: 0.179958 Sep 17 21:38:48.329020 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3183/6457] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:38:48 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1683 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:38:48.971737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-99b10e9a-dd41-45c2-b4b4-2afe982d9f86 req-d119b531-8b26-4b6f-9fc5-5f9fa3eb25e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "143f9113-e598-4087-bc18-939d798adbb1", "name": "network-vif-unplugged", "status": "completed", "tag": "a1924e9b-c9d2-47bd-9482-7a8f06f58e1a"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:38:48.981583 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-99b10e9a-dd41-45c2-b4b4-2afe982d9f86 req-d119b531-8b26-4b6f-9fc5-5f9fa3eb25e2 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:48.982064 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-99b10e9a-dd41-45c2-b4b4-2afe982d9f86 req-d119b531-8b26-4b6f-9fc5-5f9fa3eb25e2 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:48.982508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-99b10e9a-dd41-45c2-b4b4-2afe982d9f86 req-d119b531-8b26-4b6f-9fc5-5f9fa3eb25e2 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:48.994932 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-99b10e9a-dd41-45c2-b4b4-2afe982d9f86 req-d119b531-8b26-4b6f-9fc5-5f9fa3eb25e2 service nova] Creating event network-vif-unplugged:a1924e9b-c9d2-47bd-9482-7a8f06f58e1a for instance 143f9113-e598-4087-bc18-939d798adbb1 on nch1-master-1 Sep 17 21:38:49.000955 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [req-99b10e9a-dd41-45c2-b4b4-2afe982d9f86 req-d119b531-8b26-4b6f-9fc5-5f9fa3eb25e2 service nova] Instance 143f9113-e598-4087-bc18-939d798adbb1 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140524) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 21:38:49.012426 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-99b10e9a-dd41-45c2-b4b4-2afe982d9f86 req-d119b531-8b26-4b6f-9fc5-5f9fa3eb25e2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109673 Sep 17 21:38:49.013543 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3275/6458] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:38:49.353150 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7c348c1b-08ad-44bc-8cfe-2ec70f2b6326 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:38:49.353678 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7c348c1b-08ad-44bc-8cfe-2ec70f2b6326 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:38:49.361957 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c348c1b-08ad-44bc-8cfe-2ec70f2b6326 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:49.362523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c348c1b-08ad-44bc-8cfe-2ec70f2b6326 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:49.363652 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c348c1b-08ad-44bc-8cfe-2ec70f2b6326 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:49.364534 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c348c1b-08ad-44bc-8cfe-2ec70f2b6326 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:49.365007 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c348c1b-08ad-44bc-8cfe-2ec70f2b6326 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:49.365451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7c348c1b-08ad-44bc-8cfe-2ec70f2b6326 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:49.511732 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7c348c1b-08ad-44bc-8cfe-2ec70f2b6326 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:38:49.519805 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7c348c1b-08ad-44bc-8cfe-2ec70f2b6326 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1682 microversion: 2.1 time: 0.171139 Sep 17 21:38:49.520386 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3184/6459] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:38:49 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:38:50.550095 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-695ea6a5-14c9-4a77-8ff7-b85d7979ba28 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:38:50.551267 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-695ea6a5-14c9-4a77-8ff7-b85d7979ba28 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:38:50.560069 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-695ea6a5-14c9-4a77-8ff7-b85d7979ba28 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:50.560575 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-695ea6a5-14c9-4a77-8ff7-b85d7979ba28 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:50.561029 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-695ea6a5-14c9-4a77-8ff7-b85d7979ba28 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:50.561780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-695ea6a5-14c9-4a77-8ff7-b85d7979ba28 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:50.562253 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-695ea6a5-14c9-4a77-8ff7-b85d7979ba28 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:50.562694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-695ea6a5-14c9-4a77-8ff7-b85d7979ba28 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:50.698756 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-695ea6a5-14c9-4a77-8ff7-b85d7979ba28 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:38:50.707125 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-695ea6a5-14c9-4a77-8ff7-b85d7979ba28 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1680 microversion: 2.1 time: 0.165629 Sep 17 21:38:50.707670 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3276/6460] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:38:50 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:38:51.043291 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-8a5554ac-d75d-46a9-8f90-ca8e32923451 req-4c639563-2db8-4a59-a89d-ff246a771622 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "143f9113-e598-4087-bc18-939d798adbb1", "tag": "a1924e9b-c9d2-47bd-9482-7a8f06f58e1a"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:38:51.055146 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8a5554ac-d75d-46a9-8f90-ca8e32923451 req-4c639563-2db8-4a59-a89d-ff246a771622 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:51.055630 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8a5554ac-d75d-46a9-8f90-ca8e32923451 req-4c639563-2db8-4a59-a89d-ff246a771622 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:51.056073 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8a5554ac-d75d-46a9-8f90-ca8e32923451 req-4c639563-2db8-4a59-a89d-ff246a771622 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:51.068367 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-8a5554ac-d75d-46a9-8f90-ca8e32923451 req-4c639563-2db8-4a59-a89d-ff246a771622 service nova] Creating event network-changed:a1924e9b-c9d2-47bd-9482-7a8f06f58e1a for instance 143f9113-e598-4087-bc18-939d798adbb1 on nch1-master-1 Sep 17 21:38:51.074209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [req-8a5554ac-d75d-46a9-8f90-ca8e32923451 req-4c639563-2db8-4a59-a89d-ff246a771622 service nova] Instance 143f9113-e598-4087-bc18-939d798adbb1 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140523) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 21:38:51.086620 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-8a5554ac-d75d-46a9-8f90-ca8e32923451 req-4c639563-2db8-4a59-a89d-ff246a771622 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048334 Sep 17 21:38:51.087362 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3185/6461] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:38:51.731714 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-58b5c384-0b99-4679-b0f2-ec4a489a371a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:38:51.732340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-58b5c384-0b99-4679-b0f2-ec4a489a371a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:38:51.739586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58b5c384-0b99-4679-b0f2-ec4a489a371a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:51.740085 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58b5c384-0b99-4679-b0f2-ec4a489a371a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:51.740534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58b5c384-0b99-4679-b0f2-ec4a489a371a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:51.741244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58b5c384-0b99-4679-b0f2-ec4a489a371a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:51.741740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58b5c384-0b99-4679-b0f2-ec4a489a371a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:51.742184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-58b5c384-0b99-4679-b0f2-ec4a489a371a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:51.886325 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-58b5c384-0b99-4679-b0f2-ec4a489a371a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:38:51.896864 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-58b5c384-0b99-4679-b0f2-ec4a489a371a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1676 microversion: 2.1 time: 0.168898 Sep 17 21:38:51.897771 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3277/6462] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:38:51 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:38:51.927489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e7930651-a0bc-4baf-88fd-54b7fa00af4c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:38:51.928203 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e7930651-a0bc-4baf-88fd-54b7fa00af4c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:38:51.934737 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7930651-a0bc-4baf-88fd-54b7fa00af4c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:51.935222 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7930651-a0bc-4baf-88fd-54b7fa00af4c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:51.935667 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7930651-a0bc-4baf-88fd-54b7fa00af4c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:51.936368 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7930651-a0bc-4baf-88fd-54b7fa00af4c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:51.936839 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7930651-a0bc-4baf-88fd-54b7fa00af4c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:51.937269 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e7930651-a0bc-4baf-88fd-54b7fa00af4c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:52.002340 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e7930651-a0bc-4baf-88fd-54b7fa00af4c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "POST /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1/action" status: 204 len: 0 microversion: 2.1 time: 0.079016 Sep 17 21:38:52.003102 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3186/6463] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:38:51 2022] POST /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:38:52.013182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c48283bd-684f-4f22-8e4d-c6c8d3611e7c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:38:52.013949 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c48283bd-684f-4f22-8e4d-c6c8d3611e7c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:38:52.020776 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c48283bd-684f-4f22-8e4d-c6c8d3611e7c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:52.021608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c48283bd-684f-4f22-8e4d-c6c8d3611e7c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:52.022198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c48283bd-684f-4f22-8e4d-c6c8d3611e7c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:52.023072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c48283bd-684f-4f22-8e4d-c6c8d3611e7c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:52.023570 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c48283bd-684f-4f22-8e4d-c6c8d3611e7c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:52.024015 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c48283bd-684f-4f22-8e4d-c6c8d3611e7c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:52.235494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c48283bd-684f-4f22-8e4d-c6c8d3611e7c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:38:52.243791 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c48283bd-684f-4f22-8e4d-c6c8d3611e7c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1676 microversion: 2.1 time: 0.234521 Sep 17 21:38:52.244373 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3278/6464] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:38:52 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1676 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:38:53.271555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-667f50fa-d970-4810-9b33-6770af6a85fa tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:38:53.272493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-667f50fa-d970-4810-9b33-6770af6a85fa tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:38:53.279013 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-667f50fa-d970-4810-9b33-6770af6a85fa tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:53.279566 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-667f50fa-d970-4810-9b33-6770af6a85fa tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:53.280006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-667f50fa-d970-4810-9b33-6770af6a85fa tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:53.280754 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-667f50fa-d970-4810-9b33-6770af6a85fa tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:53.281185 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-667f50fa-d970-4810-9b33-6770af6a85fa tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:53.281680 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-667f50fa-d970-4810-9b33-6770af6a85fa tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:53.436448 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-667f50fa-d970-4810-9b33-6770af6a85fa tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:38:53.446302 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-667f50fa-d970-4810-9b33-6770af6a85fa tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1655 microversion: 2.1 time: 0.180187 Sep 17 21:38:53.447869 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3187/6465] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:38:53 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1655 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:38:53.474131 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-109b93a4-2261-493a-a82e-65c49054f5c7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:38:53.474772 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-109b93a4-2261-493a-a82e-65c49054f5c7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:38:53.481814 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-109b93a4-2261-493a-a82e-65c49054f5c7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:53.482326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-109b93a4-2261-493a-a82e-65c49054f5c7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:53.482782 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-109b93a4-2261-493a-a82e-65c49054f5c7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:53.483504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-109b93a4-2261-493a-a82e-65c49054f5c7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:53.483978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-109b93a4-2261-493a-a82e-65c49054f5c7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:53.484425 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-109b93a4-2261-493a-a82e-65c49054f5c7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:53.622845 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-109b93a4-2261-493a-a82e-65c49054f5c7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:38:53.631516 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-109b93a4-2261-493a-a82e-65c49054f5c7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1655 microversion: 2.1 time: 0.162047 Sep 17 21:38:53.632107 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3279/6466] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:38:53 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1655 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:38:53.655286 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6430c8b6-b86b-4e7c-ab0b-f2871e4dc035 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:38:53.661782 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6430c8b6-b86b-4e7c-ab0b-f2871e4dc035 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:53.662284 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6430c8b6-b86b-4e7c-ab0b-f2871e4dc035 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:53.662768 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6430c8b6-b86b-4e7c-ab0b-f2871e4dc035 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:53.689689 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6430c8b6-b86b-4e7c-ab0b-f2871e4dc035 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Going to try to start instance {{(pid=140523) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 17 21:38:53.736151 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6430c8b6-b86b-4e7c-ab0b-f2871e4dc035 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "POST /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1/action" status: 202 len: 0 microversion: 2.1 time: 0.084669 Sep 17 21:38:53.736775 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3188/6467] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:38:53 2022] POST /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:38:53.745391 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7a277f57-8055-4062-b09d-82f22b238ac1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:38:53.746403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7a277f57-8055-4062-b09d-82f22b238ac1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:38:53.752631 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a277f57-8055-4062-b09d-82f22b238ac1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:53.753449 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a277f57-8055-4062-b09d-82f22b238ac1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:53.754226 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a277f57-8055-4062-b09d-82f22b238ac1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:53.755283 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a277f57-8055-4062-b09d-82f22b238ac1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:53.755942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a277f57-8055-4062-b09d-82f22b238ac1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:53.756614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7a277f57-8055-4062-b09d-82f22b238ac1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:53.896524 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7a277f57-8055-4062-b09d-82f22b238ac1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:38:53.905257 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7a277f57-8055-4062-b09d-82f22b238ac1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1664 microversion: 2.1 time: 0.163872 Sep 17 21:38:53.905879 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3280/6468] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:38:53 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1664 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:38:54.931797 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cb3a0275-689e-40bd-a6da-701474cd16e3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:38:54.932502 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cb3a0275-689e-40bd-a6da-701474cd16e3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:38:54.939014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb3a0275-689e-40bd-a6da-701474cd16e3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:54.939509 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb3a0275-689e-40bd-a6da-701474cd16e3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:54.939950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb3a0275-689e-40bd-a6da-701474cd16e3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:54.940650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb3a0275-689e-40bd-a6da-701474cd16e3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:54.941102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb3a0275-689e-40bd-a6da-701474cd16e3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:54.941559 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb3a0275-689e-40bd-a6da-701474cd16e3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:54.956844 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:38:55.077698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cb3a0275-689e-40bd-a6da-701474cd16e3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:38:55.085813 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cb3a0275-689e-40bd-a6da-701474cd16e3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1668 microversion: 2.1 time: 0.159395 Sep 17 21:38:55.086393 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3189/6469] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:38:54 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:38:55.109179 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1720d39d-a795-4ff5-bb4b-d62d01e9acf6 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:38:55.109734 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1720d39d-a795-4ff5-bb4b-d62d01e9acf6 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:38:55.117125 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1720d39d-a795-4ff5-bb4b-d62d01e9acf6 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:55.117657 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1720d39d-a795-4ff5-bb4b-d62d01e9acf6 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:55.118110 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1720d39d-a795-4ff5-bb4b-d62d01e9acf6 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:55.118823 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1720d39d-a795-4ff5-bb4b-d62d01e9acf6 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:55.119291 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1720d39d-a795-4ff5-bb4b-d62d01e9acf6 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:55.119760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1720d39d-a795-4ff5-bb4b-d62d01e9acf6 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:55.146156 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1720d39d-a795-4ff5-bb4b-d62d01e9acf6 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:38:55.180535 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:38:55.231466 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1720d39d-a795-4ff5-bb4b-d62d01e9acf6 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "DELETE /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 204 len: 0 microversion: 2.1 time: 0.125894 Sep 17 21:38:55.232264 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3281/6470] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:38:55 2022] DELETE /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:38:55.241226 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e6c17a45-512d-43a9-90db-33c9f43f8c50 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:38:55.241888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e6c17a45-512d-43a9-90db-33c9f43f8c50 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:38:55.248192 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6c17a45-512d-43a9-90db-33c9f43f8c50 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:55.248685 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6c17a45-512d-43a9-90db-33c9f43f8c50 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:55.249122 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6c17a45-512d-43a9-90db-33c9f43f8c50 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:55.249869 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6c17a45-512d-43a9-90db-33c9f43f8c50 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:55.250330 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6c17a45-512d-43a9-90db-33c9f43f8c50 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:55.250761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e6c17a45-512d-43a9-90db-33c9f43f8c50 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:55.389033 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e6c17a45-512d-43a9-90db-33c9f43f8c50 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:38:55.396982 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e6c17a45-512d-43a9-90db-33c9f43f8c50 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1674 microversion: 2.1 time: 0.159940 Sep 17 21:38:55.397574 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3190/6471] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:38:55 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:38:55.549980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-4c17377d-6d72-4188-a180-f98ad5b63e95 req-6496de75-8ca2-424e-9f6b-563cab04fd09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "143f9113-e598-4087-bc18-939d798adbb1", "name": "network-vif-plugged", "status": "completed", "tag": "a1924e9b-c9d2-47bd-9482-7a8f06f58e1a"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:38:55.559988 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4c17377d-6d72-4188-a180-f98ad5b63e95 req-6496de75-8ca2-424e-9f6b-563cab04fd09 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:55.560486 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4c17377d-6d72-4188-a180-f98ad5b63e95 req-6496de75-8ca2-424e-9f6b-563cab04fd09 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:55.560941 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4c17377d-6d72-4188-a180-f98ad5b63e95 req-6496de75-8ca2-424e-9f6b-563cab04fd09 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:55.572599 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-4c17377d-6d72-4188-a180-f98ad5b63e95 req-6496de75-8ca2-424e-9f6b-563cab04fd09 service nova] Creating event network-vif-plugged:a1924e9b-c9d2-47bd-9482-7a8f06f58e1a for instance 143f9113-e598-4087-bc18-939d798adbb1 on nch1-master-1 Sep 17 21:38:55.577726 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-4c17377d-6d72-4188-a180-f98ad5b63e95 req-6496de75-8ca2-424e-9f6b-563cab04fd09 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107019 Sep 17 21:38:55.578319 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3282/6472] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:38:56.423630 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-773cb3f4-b4ef-48e1-826c-ac64fa7c1e95 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:38:56.424393 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-773cb3f4-b4ef-48e1-826c-ac64fa7c1e95 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:38:56.435974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-773cb3f4-b4ef-48e1-826c-ac64fa7c1e95 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:56.436684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-773cb3f4-b4ef-48e1-826c-ac64fa7c1e95 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:56.437332 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-773cb3f4-b4ef-48e1-826c-ac64fa7c1e95 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:56.438371 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-773cb3f4-b4ef-48e1-826c-ac64fa7c1e95 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:56.439043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-773cb3f4-b4ef-48e1-826c-ac64fa7c1e95 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:56.439656 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-773cb3f4-b4ef-48e1-826c-ac64fa7c1e95 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:56.591662 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-773cb3f4-b4ef-48e1-826c-ac64fa7c1e95 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:38:56.600443 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-773cb3f4-b4ef-48e1-826c-ac64fa7c1e95 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1674 microversion: 2.1 time: 0.183124 Sep 17 21:38:56.601034 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3191/6473] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:38:56 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1674 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:38:57.415642 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-0f899b7a-1bb3-4a45-9a08-1e6a078d58d8 req-dc540894-1c81-4c5e-9e8b-9e3c6e6945d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "143f9113-e598-4087-bc18-939d798adbb1", "name": "network-vif-deleted", "tag": "a1924e9b-c9d2-47bd-9482-7a8f06f58e1a"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:38:57.425809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-0f899b7a-1bb3-4a45-9a08-1e6a078d58d8 req-dc540894-1c81-4c5e-9e8b-9e3c6e6945d9 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:57.426310 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-0f899b7a-1bb3-4a45-9a08-1e6a078d58d8 req-dc540894-1c81-4c5e-9e8b-9e3c6e6945d9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:57.426759 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-0f899b7a-1bb3-4a45-9a08-1e6a078d58d8 req-dc540894-1c81-4c5e-9e8b-9e3c6e6945d9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:57.438501 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-0f899b7a-1bb3-4a45-9a08-1e6a078d58d8 req-dc540894-1c81-4c5e-9e8b-9e3c6e6945d9 service nova] Creating event network-vif-deleted:a1924e9b-c9d2-47bd-9482-7a8f06f58e1a for instance 143f9113-e598-4087-bc18-939d798adbb1 on nch1-master-1 Sep 17 21:38:57.444417 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-0f899b7a-1bb3-4a45-9a08-1e6a078d58d8 req-dc540894-1c81-4c5e-9e8b-9e3c6e6945d9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033810 Sep 17 21:38:57.445407 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3283/6474] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:38:57.625886 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a150bde5-bd58-435f-8b7f-d4b10c5452d9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:38:57.626630 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a150bde5-bd58-435f-8b7f-d4b10c5452d9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:38:57.634979 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a150bde5-bd58-435f-8b7f-d4b10c5452d9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:57.635623 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a150bde5-bd58-435f-8b7f-d4b10c5452d9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:57.636560 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a150bde5-bd58-435f-8b7f-d4b10c5452d9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:57.637447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a150bde5-bd58-435f-8b7f-d4b10c5452d9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:57.638043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a150bde5-bd58-435f-8b7f-d4b10c5452d9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:57.638590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a150bde5-bd58-435f-8b7f-d4b10c5452d9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:57.675263 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a150bde5-bd58-435f-8b7f-d4b10c5452d9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:57.676117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a150bde5-bd58-435f-8b7f-d4b10c5452d9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:57.676810 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a150bde5-bd58-435f-8b7f-d4b10c5452d9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:57.677304 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-a150bde5-bd58-435f-8b7f-d4b10c5452d9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lazy-loading 'fault' on Instance uuid 143f9113-e598-4087-bc18-939d798adbb1 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:38:57.721060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a150bde5-bd58-435f-8b7f-d4b10c5452d9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:38:57.728361 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a150bde5-bd58-435f-8b7f-d4b10c5452d9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 200 len: 1328 microversion: 2.1 time: 0.108103 Sep 17 21:38:57.729235 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3192/6475] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:38:57 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 1328 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:38:58.754347 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-711afe05-ae54-4d00-a494-206a2d668d10 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:38:58.755101 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-711afe05-ae54-4d00-a494-206a2d668d10 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:38:58.762090 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-711afe05-ae54-4d00-a494-206a2d668d10 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:58.762597 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-711afe05-ae54-4d00-a494-206a2d668d10 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:58.763083 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-711afe05-ae54-4d00-a494-206a2d668d10 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:58.763799 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-711afe05-ae54-4d00-a494-206a2d668d10 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:58.764273 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-711afe05-ae54-4d00-a494-206a2d668d10 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:58.764714 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-711afe05-ae54-4d00-a494-206a2d668d10 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:58.778604 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-711afe05-ae54-4d00-a494-206a2d668d10 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] HTTP exception thrown: Instance 143f9113-e598-4087-bc18-939d798adbb1 could not be found. Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-711afe05-ae54-4d00-a494-206a2d668d10 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Request method failure captured: Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 HTTP/1.1 Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJj3jwshgKHrmiTh9He2iymPHWHLX-Bt6aPFYMaypjQpla8PjsWm9yR1cr-rMt99yChBYg92ATksUdevYw1cssE35vglYIXszUAp944E84DQ3hBJviVnWeBZQ8d2ZXwzYz00kQH44YjF-EXnR6Tb897kEyxad5Zvgh2DN_v9yxO1e0r8 Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: ad243abc13a14aa08c717d4105e24f4f Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerActionsTestJSON-226995111 Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad243abc13a14aa08c717d4105e24f4f", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerActionsTestJSON-226995111 Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: ad243abc13a14aa08c717d4105e24f4f Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerActionsTestJSON-226995111 Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerActionsTestJSON-226995111-project Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: d20f8598dfec4de7b496a64e023e7a15 Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerActionsTestJSON-226995111-project Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 143f9113-e598-4087-bc18-939d798adbb1 could not be found. Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '143f9113-e598-4087-bc18-939d798adbb1'} Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 143f9113-e598-4087-bc18-939d798adbb1 could not be found. Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 143f9113-e598-4087-bc18-939d798adbb1 could not be found. Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:38:58.780286 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:38:58.785259 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:38:58.785259 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:38:58.785259 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:38:58.785259 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:38:58.785259 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:38:58.785259 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 143f9113-e598-4087-bc18-939d798adbb1 could not be found. Sep 17 21:38:58.785259 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:38:58.785259 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-711afe05-ae54-4d00-a494-206a2d668d10 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Returning 404 to user: Instance 143f9113-e598-4087-bc18-939d798adbb1 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:38:58.785259 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-711afe05-ae54-4d00-a494-206a2d668d10 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 404 len: 111 microversion: 2.1 time: 0.032790 Sep 17 21:38:58.785259 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3284/6476] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:38:58 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:38:58.795292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a42873ef-d561-4295-9022-a19c1c62afea tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:38:58.795915 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a42873ef-d561-4295-9022-a19c1c62afea tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:38:58.803190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a42873ef-d561-4295-9022-a19c1c62afea tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:58.803687 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a42873ef-d561-4295-9022-a19c1c62afea tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:58.804136 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a42873ef-d561-4295-9022-a19c1c62afea tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:58.804819 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a42873ef-d561-4295-9022-a19c1c62afea tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:58.805288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a42873ef-d561-4295-9022-a19c1c62afea tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:58.805740 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a42873ef-d561-4295-9022-a19c1c62afea tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:58.819466 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-a42873ef-d561-4295-9022-a19c1c62afea tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] HTTP exception thrown: Instance 143f9113-e598-4087-bc18-939d798adbb1 could not be found. Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a42873ef-d561-4295-9022-a19c1c62afea tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Request method failure captured: Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 HTTP/1.1 Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJj3jwshgKHrmiTh9He2iymPHWHLX-Bt6aPFYMaypjQpla8PjsWm9yR1cr-rMt99yChBYg92ATksUdevYw1cssE35vglYIXszUAp944E84DQ3hBJviVnWeBZQ8d2ZXwzYz00kQH44YjF-EXnR6Tb897kEyxad5Zvgh2DN_v9yxO1e0r8 Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: ad243abc13a14aa08c717d4105e24f4f Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerActionsTestJSON-226995111 Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad243abc13a14aa08c717d4105e24f4f", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerActionsTestJSON-226995111 Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: ad243abc13a14aa08c717d4105e24f4f Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerActionsTestJSON-226995111 Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerActionsTestJSON-226995111-project Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: d20f8598dfec4de7b496a64e023e7a15 Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerActionsTestJSON-226995111-project Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 143f9113-e598-4087-bc18-939d798adbb1 could not be found. Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '143f9113-e598-4087-bc18-939d798adbb1'} Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 143f9113-e598-4087-bc18-939d798adbb1 could not be found. Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 143f9113-e598-4087-bc18-939d798adbb1 could not be found. Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:38:58.821159 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:38:58.825598 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:38:58.825598 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:38:58.825598 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:38:58.825598 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:38:58.825598 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:38:58.825598 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 143f9113-e598-4087-bc18-939d798adbb1 could not be found. Sep 17 21:38:58.825598 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:38:58.825598 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a42873ef-d561-4295-9022-a19c1c62afea tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Returning 404 to user: Instance 143f9113-e598-4087-bc18-939d798adbb1 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:38:58.825598 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a42873ef-d561-4295-9022-a19c1c62afea tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 404 len: 111 microversion: 2.1 time: 0.031408 Sep 17 21:38:58.825598 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3193/6477] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:38:58 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:38:58.873710 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-aa876d21-574a-4444-b7b5-7e7a5ecf41f8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1560172679", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "595473ed-8f19-4b14-b9d1-04243f9c5e91"}], "security_groups": [{"name": "tempest-securitygroup--262220769"}], "key_name": "tempest-keypair-1377054705", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:38:59.002691 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-aa876d21-574a-4444-b7b5-7e7a5ecf41f8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] validate_networks() for [('595473ed-8f19-4b14-b9d1-04243f9c5e91', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:38:59.497345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-aa876d21-574a-4444-b7b5-7e7a5ecf41f8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:38:59.497811 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-aa876d21-574a-4444-b7b5-7e7a5ecf41f8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:38:59.498301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-aa876d21-574a-4444-b7b5-7e7a5ecf41f8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:38:59.498727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-aa876d21-574a-4444-b7b5-7e7a5ecf41f8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:38:59.499154 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-aa876d21-574a-4444-b7b5-7e7a5ecf41f8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:38:59.508265 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa876d21-574a-4444-b7b5-7e7a5ecf41f8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:59.508692 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa876d21-574a-4444-b7b5-7e7a5ecf41f8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:59.509146 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa876d21-574a-4444-b7b5-7e7a5ecf41f8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:59.509922 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa876d21-574a-4444-b7b5-7e7a5ecf41f8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:38:59.510393 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa876d21-574a-4444-b7b5-7e7a5ecf41f8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:38:59.510833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aa876d21-574a-4444-b7b5-7e7a5ecf41f8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:38:59.528039 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-aa876d21-574a-4444-b7b5-7e7a5ecf41f8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Getting quotas for project ad243abc13a14aa08c717d4105e24f4f. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:38:59.533777 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-aa876d21-574a-4444-b7b5-7e7a5ecf41f8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Getting quotas for user d20f8598dfec4de7b496a64e023e7a15 and project ad243abc13a14aa08c717d4105e24f4f. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:38:59.546917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-aa876d21-574a-4444-b7b5-7e7a5ecf41f8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:38:59.549251 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-aa876d21-574a-4444-b7b5-7e7a5ecf41f8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:38:59.598401 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-aa876d21-574a-4444-b7b5-7e7a5ecf41f8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.728830 Sep 17 21:38:59.599036 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3285/6478] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:38:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:38:59.611001 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-59199a5b-63a3-414e-aa36-5a2eba0f70ba tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:38:59.611656 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-59199a5b-63a3-414e-aa36-5a2eba0f70ba tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:38:59.666266 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-59199a5b-63a3-414e-aa36-5a2eba0f70ba tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:38:59.674093 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-59199a5b-63a3-414e-aa36-5a2eba0f70ba tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1239 microversion: 2.1 time: 0.067036 Sep 17 21:38:59.674917 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3194/6479] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:38:59 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1239 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:39:00.701906 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b05b2397-b215-4e06-8b4d-2831946c4f76 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:39:00.702549 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b05b2397-b215-4e06-8b4d-2831946c4f76 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:39:00.710350 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b05b2397-b215-4e06-8b4d-2831946c4f76 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:00.710868 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b05b2397-b215-4e06-8b4d-2831946c4f76 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:00.711320 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b05b2397-b215-4e06-8b4d-2831946c4f76 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:00.712055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b05b2397-b215-4e06-8b4d-2831946c4f76 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:00.712532 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b05b2397-b215-4e06-8b4d-2831946c4f76 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:00.712978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b05b2397-b215-4e06-8b4d-2831946c4f76 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:00.782638 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b05b2397-b215-4e06-8b4d-2831946c4f76 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:39:00.790688 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b05b2397-b215-4e06-8b4d-2831946c4f76 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1291 microversion: 2.1 time: 0.095191 Sep 17 21:39:00.791248 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3286/6480] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:39:00 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1291 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:39:01.814325 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-95123897-5ed0-4d72-91dc-2218caa8c605 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:39:01.814976 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-95123897-5ed0-4d72-91dc-2218caa8c605 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:39:01.823675 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95123897-5ed0-4d72-91dc-2218caa8c605 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:01.824204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95123897-5ed0-4d72-91dc-2218caa8c605 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:01.824630 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95123897-5ed0-4d72-91dc-2218caa8c605 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:01.825338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95123897-5ed0-4d72-91dc-2218caa8c605 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:01.826012 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95123897-5ed0-4d72-91dc-2218caa8c605 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:01.826641 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95123897-5ed0-4d72-91dc-2218caa8c605 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:02.035498 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-95123897-5ed0-4d72-91dc-2218caa8c605 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:39:02.043662 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-95123897-5ed0-4d72-91dc-2218caa8c605 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1364 microversion: 2.1 time: 0.233333 Sep 17 21:39:02.044231 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3195/6481] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:39:01 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1364 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:39:02.392554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-df8b981a-f380-4cbf-84b2-bc67df634bcc req-99507ce9-b465-41a8-ac18-8a7193923c38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9f570a5-6e67-43f4-acb2-798fbaf1de66", "tag": "548d2a28-a18d-44ca-a4a0-104258606d00"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:39:02.403723 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-df8b981a-f380-4cbf-84b2-bc67df634bcc req-99507ce9-b465-41a8-ac18-8a7193923c38 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:02.404235 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-df8b981a-f380-4cbf-84b2-bc67df634bcc req-99507ce9-b465-41a8-ac18-8a7193923c38 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:02.404685 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-df8b981a-f380-4cbf-84b2-bc67df634bcc req-99507ce9-b465-41a8-ac18-8a7193923c38 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:02.417301 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-df8b981a-f380-4cbf-84b2-bc67df634bcc req-99507ce9-b465-41a8-ac18-8a7193923c38 service nova] Creating event network-changed:548d2a28-a18d-44ca-a4a0-104258606d00 for instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 on nch2-master-1 Sep 17 21:39:02.422493 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-df8b981a-f380-4cbf-84b2-bc67df634bcc req-99507ce9-b465-41a8-ac18-8a7193923c38 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033890 Sep 17 21:39:02.423105 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3287/6482] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:39:03.068646 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-740d9af9-9453-4337-960e-2ed5f82be3ba tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:39:03.069418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-740d9af9-9453-4337-960e-2ed5f82be3ba tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:39:03.077284 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-740d9af9-9453-4337-960e-2ed5f82be3ba tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:03.077590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-740d9af9-9453-4337-960e-2ed5f82be3ba tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:03.078099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-740d9af9-9453-4337-960e-2ed5f82be3ba tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:03.078870 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-740d9af9-9453-4337-960e-2ed5f82be3ba tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:03.079408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-740d9af9-9453-4337-960e-2ed5f82be3ba tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:03.079842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-740d9af9-9453-4337-960e-2ed5f82be3ba tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:03.264101 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-740d9af9-9453-4337-960e-2ed5f82be3ba tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:39:03.272457 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-740d9af9-9453-4337-960e-2ed5f82be3ba tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1364 microversion: 2.1 time: 0.208013 Sep 17 21:39:03.273028 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3196/6483] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:39:03 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1364 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:39:04.298530 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f75b782f-5b4f-4627-987b-ebbbf04dbbc2 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:39:04.299250 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f75b782f-5b4f-4627-987b-ebbbf04dbbc2 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:39:04.301500 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:39:04.306955 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f75b782f-5b4f-4627-987b-ebbbf04dbbc2 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:04.307467 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f75b782f-5b4f-4627-987b-ebbbf04dbbc2 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:04.307921 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f75b782f-5b4f-4627-987b-ebbbf04dbbc2 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:04.308749 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f75b782f-5b4f-4627-987b-ebbbf04dbbc2 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:04.309224 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f75b782f-5b4f-4627-987b-ebbbf04dbbc2 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:04.309766 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f75b782f-5b4f-4627-987b-ebbbf04dbbc2 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:04.524534 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f75b782f-5b4f-4627-987b-ebbbf04dbbc2 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:39:04.532960 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f75b782f-5b4f-4627-987b-ebbbf04dbbc2 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1364 microversion: 2.1 time: 0.240248 Sep 17 21:39:04.533694 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3288/6484] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:39:04 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1364 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:39:05.557498 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e8d20523-231d-4b17-873a-6096c9e30df0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:39:05.558152 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e8d20523-231d-4b17-873a-6096c9e30df0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:39:05.561273 ncdv-master-1 devstack@n-api.service[140523]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 17 21:39:05.561433 ncdv-master-1 devstack@n-api.service[140523]: Sat Sep 17 21:39:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 (ip 10.222.0.26) !!! Sep 17 21:39:05.562893 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=51 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:39:05.570384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8d20523-231d-4b17-873a-6096c9e30df0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:05.570963 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8d20523-231d-4b17-873a-6096c9e30df0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:05.571411 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8d20523-231d-4b17-873a-6096c9e30df0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:05.572128 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8d20523-231d-4b17-873a-6096c9e30df0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:05.572595 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8d20523-231d-4b17-873a-6096c9e30df0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:05.573029 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8d20523-231d-4b17-873a-6096c9e30df0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:05.707292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e8d20523-231d-4b17-873a-6096c9e30df0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:39:05.716598 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e8d20523-231d-4b17-873a-6096c9e30df0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1364 microversion: 2.1 time: 0.163199 Sep 17 21:39:05.717187 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3197/6485] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:39:05 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:39:06.740681 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a5942a1c-8690-44d5-834b-d36d94c12486 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:39:06.741331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a5942a1c-8690-44d5-834b-d36d94c12486 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:39:06.748947 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5942a1c-8690-44d5-834b-d36d94c12486 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:06.749489 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5942a1c-8690-44d5-834b-d36d94c12486 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:06.749953 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5942a1c-8690-44d5-834b-d36d94c12486 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:06.750677 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5942a1c-8690-44d5-834b-d36d94c12486 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:06.751146 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5942a1c-8690-44d5-834b-d36d94c12486 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:06.751595 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a5942a1c-8690-44d5-834b-d36d94c12486 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:06.901204 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a5942a1c-8690-44d5-834b-d36d94c12486 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:39:06.913556 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a5942a1c-8690-44d5-834b-d36d94c12486 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1364 microversion: 2.1 time: 0.176515 Sep 17 21:39:06.914170 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3289/6486] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:39:06 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:39:07.344911 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-abeb9497-b521-4f3d-9eff-ca9fbc01e69b req-67307120-dd83-4651-ac48-ce18b94287ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f570a5-6e67-43f4-acb2-798fbaf1de66", "name": "network-vif-plugged", "status": "completed", "tag": "548d2a28-a18d-44ca-a4a0-104258606d00"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:39:07.355689 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-abeb9497-b521-4f3d-9eff-ca9fbc01e69b req-67307120-dd83-4651-ac48-ce18b94287ad service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:07.356172 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-abeb9497-b521-4f3d-9eff-ca9fbc01e69b req-67307120-dd83-4651-ac48-ce18b94287ad service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:07.356621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-abeb9497-b521-4f3d-9eff-ca9fbc01e69b req-67307120-dd83-4651-ac48-ce18b94287ad service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:07.368639 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-abeb9497-b521-4f3d-9eff-ca9fbc01e69b req-67307120-dd83-4651-ac48-ce18b94287ad service nova] Creating event network-vif-plugged:548d2a28-a18d-44ca-a4a0-104258606d00 for instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 on nch2-master-1 Sep 17 21:39:07.374161 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-abeb9497-b521-4f3d-9eff-ca9fbc01e69b req-67307120-dd83-4651-ac48-ce18b94287ad service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033338 Sep 17 21:39:07.374759 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3198/6487] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:39:07.939048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b124f9dd-048e-446c-a652-6d04be6d5480 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:39:07.939681 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b124f9dd-048e-446c-a652-6d04be6d5480 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:39:07.947120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b124f9dd-048e-446c-a652-6d04be6d5480 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:07.947639 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b124f9dd-048e-446c-a652-6d04be6d5480 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:07.948089 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b124f9dd-048e-446c-a652-6d04be6d5480 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:07.948816 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b124f9dd-048e-446c-a652-6d04be6d5480 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:07.949299 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b124f9dd-048e-446c-a652-6d04be6d5480 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:07.949784 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b124f9dd-048e-446c-a652-6d04be6d5480 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:08.086149 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b124f9dd-048e-446c-a652-6d04be6d5480 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:39:08.095195 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b124f9dd-048e-446c-a652-6d04be6d5480 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1364 microversion: 2.1 time: 0.160555 Sep 17 21:39:08.095758 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3290/6488] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:39:07 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:39:09.125710 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-00ed1040-7dc3-4b32-b2b6-ce4603bdaa75 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:39:09.126883 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-00ed1040-7dc3-4b32-b2b6-ce4603bdaa75 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:39:09.137332 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00ed1040-7dc3-4b32-b2b6-ce4603bdaa75 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:09.137859 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00ed1040-7dc3-4b32-b2b6-ce4603bdaa75 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:09.138307 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00ed1040-7dc3-4b32-b2b6-ce4603bdaa75 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:09.139011 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00ed1040-7dc3-4b32-b2b6-ce4603bdaa75 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:09.139471 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00ed1040-7dc3-4b32-b2b6-ce4603bdaa75 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:09.139899 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-00ed1040-7dc3-4b32-b2b6-ce4603bdaa75 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:09.276195 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-00ed1040-7dc3-4b32-b2b6-ce4603bdaa75 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:39:09.284623 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-00ed1040-7dc3-4b32-b2b6-ce4603bdaa75 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1551 microversion: 2.1 time: 0.167756 Sep 17 21:39:09.285211 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3199/6489] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:39:09 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1551 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:39:09.308357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1e4de884-5ed2-476b-b6b3-e5197553ed10 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:39:09.308895 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1e4de884-5ed2-476b-b6b3-e5197553ed10 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:39:09.316047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e4de884-5ed2-476b-b6b3-e5197553ed10 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:09.316533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e4de884-5ed2-476b-b6b3-e5197553ed10 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:09.317106 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e4de884-5ed2-476b-b6b3-e5197553ed10 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:09.317731 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e4de884-5ed2-476b-b6b3-e5197553ed10 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:09.318204 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e4de884-5ed2-476b-b6b3-e5197553ed10 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:09.318661 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e4de884-5ed2-476b-b6b3-e5197553ed10 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:09.397483 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1e4de884-5ed2-476b-b6b3-e5197553ed10 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093073 Sep 17 21:39:09.398104 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3291/6490] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Sep 17 21:39:09 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:39:10.378051 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-0ee1c5d7-a316-48b0-bf55-e5139adde377 req-e782ac6f-24fe-412b-ba7e-8b591f489469 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9f570a5-6e67-43f4-acb2-798fbaf1de66", "tag": "548d2a28-a18d-44ca-a4a0-104258606d00"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:39:10.382999 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:39:10.390409 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-0ee1c5d7-a316-48b0-bf55-e5139adde377 req-e782ac6f-24fe-412b-ba7e-8b591f489469 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:10.390901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-0ee1c5d7-a316-48b0-bf55-e5139adde377 req-e782ac6f-24fe-412b-ba7e-8b591f489469 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:10.391340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-0ee1c5d7-a316-48b0-bf55-e5139adde377 req-e782ac6f-24fe-412b-ba7e-8b591f489469 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:10.403180 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-0ee1c5d7-a316-48b0-bf55-e5139adde377 req-e782ac6f-24fe-412b-ba7e-8b591f489469 service nova] Creating event network-changed:548d2a28-a18d-44ca-a4a0-104258606d00 for instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 on nch2-master-1 Sep 17 21:39:10.408528 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-0ee1c5d7-a316-48b0-bf55-e5139adde377 req-e782ac6f-24fe-412b-ba7e-8b591f489469 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034261 Sep 17 21:39:10.409514 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3200/6491] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:39:43.310070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:39:43.310882 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=6 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:39:43.312828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=7 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:39:43.313485 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:39:43.318037 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-950ddd20-7c66-407d-88d9-6db4a259e77a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:39:43.320330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-950ddd20-7c66-407d-88d9-6db4a259e77a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:39:43.329266 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-950ddd20-7c66-407d-88d9-6db4a259e77a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:43.329807 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-950ddd20-7c66-407d-88d9-6db4a259e77a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:43.330262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-950ddd20-7c66-407d-88d9-6db4a259e77a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:43.330975 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-950ddd20-7c66-407d-88d9-6db4a259e77a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:43.331454 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-950ddd20-7c66-407d-88d9-6db4a259e77a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:43.331890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-950ddd20-7c66-407d-88d9-6db4a259e77a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:43.413907 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-950ddd20-7c66-407d-88d9-6db4a259e77a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:39:43.420644 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-950ddd20-7c66-407d-88d9-6db4a259e77a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Old instance type m1.heat2, new instance type m1.heat {{(pid=140524) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 17 21:39:43.427631 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-950ddd20-7c66-407d-88d9-6db4a259e77a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:39:43.428070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-950ddd20-7c66-407d-88d9-6db4a259e77a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:39:43.428582 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-950ddd20-7c66-407d-88d9-6db4a259e77a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:39:43.429007 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-950ddd20-7c66-407d-88d9-6db4a259e77a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:39:43.429442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-950ddd20-7c66-407d-88d9-6db4a259e77a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:39:43.546206 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-950ddd20-7c66-407d-88d9-6db4a259e77a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "POST /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66/action" status: 202 len: 0 microversion: 2.1 time: 0.236701 Sep 17 21:39:43.546760 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3292/6492] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:39:43 2022] POST /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:39:43.553495 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=7 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:39:43.554717 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=53 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:39:43.559607 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e43435a2-a1f5-498e-be29-188ba4fde5c1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:39:43.560395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e43435a2-a1f5-498e-be29-188ba4fde5c1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:39:43.567510 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e43435a2-a1f5-498e-be29-188ba4fde5c1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:43.568072 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e43435a2-a1f5-498e-be29-188ba4fde5c1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:43.568678 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e43435a2-a1f5-498e-be29-188ba4fde5c1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:43.569482 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e43435a2-a1f5-498e-be29-188ba4fde5c1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:43.570074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e43435a2-a1f5-498e-be29-188ba4fde5c1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:43.570546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e43435a2-a1f5-498e-be29-188ba4fde5c1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:43.744177 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e43435a2-a1f5-498e-be29-188ba4fde5c1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:39:43.752822 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e43435a2-a1f5-498e-be29-188ba4fde5c1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1678 microversion: 2.1 time: 0.201451 Sep 17 21:39:43.753417 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3201/6493] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:39:43 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1678 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:39:44.780430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4056c33c-46ae-4154-a8f0-5cb114af41c2 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:39:44.781268 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4056c33c-46ae-4154-a8f0-5cb114af41c2 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:39:44.790382 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4056c33c-46ae-4154-a8f0-5cb114af41c2 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:44.791013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4056c33c-46ae-4154-a8f0-5cb114af41c2 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:44.791539 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4056c33c-46ae-4154-a8f0-5cb114af41c2 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:44.792578 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4056c33c-46ae-4154-a8f0-5cb114af41c2 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:44.793144 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4056c33c-46ae-4154-a8f0-5cb114af41c2 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:44.793692 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4056c33c-46ae-4154-a8f0-5cb114af41c2 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:44.933673 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4056c33c-46ae-4154-a8f0-5cb114af41c2 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:39:44.942009 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4056c33c-46ae-4154-a8f0-5cb114af41c2 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1678 microversion: 2.1 time: 0.168139 Sep 17 21:39:44.942978 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3293/6494] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:39:44 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:39:45.969325 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e928d40f-5654-40b9-aee3-f56a5407b66b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:39:45.970284 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e928d40f-5654-40b9-aee3-f56a5407b66b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:39:45.980230 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e928d40f-5654-40b9-aee3-f56a5407b66b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:45.980933 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e928d40f-5654-40b9-aee3-f56a5407b66b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:45.981609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e928d40f-5654-40b9-aee3-f56a5407b66b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:45.982620 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e928d40f-5654-40b9-aee3-f56a5407b66b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:45.983380 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e928d40f-5654-40b9-aee3-f56a5407b66b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:45.984039 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e928d40f-5654-40b9-aee3-f56a5407b66b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:46.131552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e928d40f-5654-40b9-aee3-f56a5407b66b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:39:46.143854 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e928d40f-5654-40b9-aee3-f56a5407b66b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1683 microversion: 2.1 time: 0.180430 Sep 17 21:39:46.144698 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3202/6495] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:39:45 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1683 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:39:47.172484 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f83c1c9d-9324-4bab-b2ac-653549c49e49 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:39:47.173536 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f83c1c9d-9324-4bab-b2ac-653549c49e49 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:39:47.185264 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f83c1c9d-9324-4bab-b2ac-653549c49e49 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:47.186174 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f83c1c9d-9324-4bab-b2ac-653549c49e49 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:47.187489 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f83c1c9d-9324-4bab-b2ac-653549c49e49 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:47.188681 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f83c1c9d-9324-4bab-b2ac-653549c49e49 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:47.189520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f83c1c9d-9324-4bab-b2ac-653549c49e49 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:47.190318 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f83c1c9d-9324-4bab-b2ac-653549c49e49 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:47.333103 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f83c1c9d-9324-4bab-b2ac-653549c49e49 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:39:47.345306 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f83c1c9d-9324-4bab-b2ac-653549c49e49 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1683 microversion: 2.1 time: 0.179271 Sep 17 21:39:47.346238 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3294/6496] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:39:47 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1683 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:39:48.374959 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dbea4ac8-85dd-491a-978c-a9b421d20275 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:39:48.376019 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dbea4ac8-85dd-491a-978c-a9b421d20275 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:39:48.387983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dbea4ac8-85dd-491a-978c-a9b421d20275 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:48.388805 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dbea4ac8-85dd-491a-978c-a9b421d20275 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:48.389537 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dbea4ac8-85dd-491a-978c-a9b421d20275 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:48.390743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dbea4ac8-85dd-491a-978c-a9b421d20275 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:48.391506 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dbea4ac8-85dd-491a-978c-a9b421d20275 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:48.392231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dbea4ac8-85dd-491a-978c-a9b421d20275 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:48.535157 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dbea4ac8-85dd-491a-978c-a9b421d20275 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:39:48.543899 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dbea4ac8-85dd-491a-978c-a9b421d20275 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1683 microversion: 2.1 time: 0.175708 Sep 17 21:39:48.544523 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3203/6497] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:39:48 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1683 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:39:49.571850 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-dd384ff9-793a-477f-aeaf-76a65ae40dbf tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:39:49.572826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-dd384ff9-793a-477f-aeaf-76a65ae40dbf tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:39:49.580627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd384ff9-793a-477f-aeaf-76a65ae40dbf tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:49.581148 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd384ff9-793a-477f-aeaf-76a65ae40dbf tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:49.581646 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd384ff9-793a-477f-aeaf-76a65ae40dbf tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:49.582358 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd384ff9-793a-477f-aeaf-76a65ae40dbf tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:49.582833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd384ff9-793a-477f-aeaf-76a65ae40dbf tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:49.583275 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dd384ff9-793a-477f-aeaf-76a65ae40dbf tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:49.723652 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-dd384ff9-793a-477f-aeaf-76a65ae40dbf tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:39:49.731615 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-dd384ff9-793a-477f-aeaf-76a65ae40dbf tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1683 microversion: 2.1 time: 0.166317 Sep 17 21:39:49.732184 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3295/6498] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:39:49 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:39:50.758715 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-841a4be7-60da-4b08-9c14-85740ed0dc4f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:39:50.759677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-841a4be7-60da-4b08-9c14-85740ed0dc4f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:39:50.770796 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-841a4be7-60da-4b08-9c14-85740ed0dc4f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:50.771546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-841a4be7-60da-4b08-9c14-85740ed0dc4f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:50.772215 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-841a4be7-60da-4b08-9c14-85740ed0dc4f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:50.773310 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-841a4be7-60da-4b08-9c14-85740ed0dc4f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:50.774111 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-841a4be7-60da-4b08-9c14-85740ed0dc4f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:50.774787 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-841a4be7-60da-4b08-9c14-85740ed0dc4f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:50.909739 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-841a4be7-60da-4b08-9c14-85740ed0dc4f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:39:50.917897 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-841a4be7-60da-4b08-9c14-85740ed0dc4f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1683 microversion: 2.1 time: 0.165175 Sep 17 21:39:50.918526 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3204/6499] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:39:50 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:39:51.945980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cf2d25fa-93f2-4d6d-881f-e3c56d82d473 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:39:51.947051 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cf2d25fa-93f2-4d6d-881f-e3c56d82d473 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:39:51.958752 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cf2d25fa-93f2-4d6d-881f-e3c56d82d473 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:51.959596 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cf2d25fa-93f2-4d6d-881f-e3c56d82d473 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:51.960364 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cf2d25fa-93f2-4d6d-881f-e3c56d82d473 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:51.961600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cf2d25fa-93f2-4d6d-881f-e3c56d82d473 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:51.962347 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cf2d25fa-93f2-4d6d-881f-e3c56d82d473 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:51.963140 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cf2d25fa-93f2-4d6d-881f-e3c56d82d473 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:52.101057 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cf2d25fa-93f2-4d6d-881f-e3c56d82d473 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:39:52.109157 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cf2d25fa-93f2-4d6d-881f-e3c56d82d473 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1683 microversion: 2.1 time: 0.169966 Sep 17 21:39:52.109803 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3296/6500] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:39:51 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:39:53.136950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-73c8b26d-179c-4152-b9f3-fd36e3f76016 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:39:53.137970 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-73c8b26d-179c-4152-b9f3-fd36e3f76016 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:39:53.147440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73c8b26d-179c-4152-b9f3-fd36e3f76016 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:53.148034 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73c8b26d-179c-4152-b9f3-fd36e3f76016 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:53.148564 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73c8b26d-179c-4152-b9f3-fd36e3f76016 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:53.149397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73c8b26d-179c-4152-b9f3-fd36e3f76016 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:53.149989 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73c8b26d-179c-4152-b9f3-fd36e3f76016 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:53.150500 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73c8b26d-179c-4152-b9f3-fd36e3f76016 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:53.291099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-73c8b26d-179c-4152-b9f3-fd36e3f76016 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:39:53.299317 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-73c8b26d-179c-4152-b9f3-fd36e3f76016 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1683 microversion: 2.1 time: 0.168967 Sep 17 21:39:53.299903 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3205/6501] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:39:53 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:39:54.327143 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5a298066-2588-4c6d-ba15-47278fd5f797 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:39:54.328118 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5a298066-2588-4c6d-ba15-47278fd5f797 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:39:54.339973 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a298066-2588-4c6d-ba15-47278fd5f797 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:54.340917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a298066-2588-4c6d-ba15-47278fd5f797 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:54.341387 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a298066-2588-4c6d-ba15-47278fd5f797 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:54.342136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a298066-2588-4c6d-ba15-47278fd5f797 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:54.342613 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a298066-2588-4c6d-ba15-47278fd5f797 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:54.343378 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5a298066-2588-4c6d-ba15-47278fd5f797 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:54.475958 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5a298066-2588-4c6d-ba15-47278fd5f797 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:39:54.484367 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5a298066-2588-4c6d-ba15-47278fd5f797 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1683 microversion: 2.1 time: 0.163961 Sep 17 21:39:54.484955 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3297/6502] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:39:54 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:39:55.512572 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b4093d4b-a8c7-42f2-b694-0ec31944a7e5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:39:55.513769 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b4093d4b-a8c7-42f2-b694-0ec31944a7e5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:39:55.521156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b4093d4b-a8c7-42f2-b694-0ec31944a7e5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:55.521682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b4093d4b-a8c7-42f2-b694-0ec31944a7e5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:55.522131 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b4093d4b-a8c7-42f2-b694-0ec31944a7e5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:55.522839 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b4093d4b-a8c7-42f2-b694-0ec31944a7e5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:55.523297 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b4093d4b-a8c7-42f2-b694-0ec31944a7e5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:55.523726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b4093d4b-a8c7-42f2-b694-0ec31944a7e5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:55.656871 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b4093d4b-a8c7-42f2-b694-0ec31944a7e5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:39:55.664821 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b4093d4b-a8c7-42f2-b694-0ec31944a7e5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1683 microversion: 2.1 time: 0.158913 Sep 17 21:39:55.665426 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3206/6503] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:39:55 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:39:56.690007 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-11e59fae-0667-4661-b2ba-2a19a1759ef0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:39:56.690791 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-11e59fae-0667-4661-b2ba-2a19a1759ef0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:39:56.698104 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-11e59fae-0667-4661-b2ba-2a19a1759ef0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:56.698615 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-11e59fae-0667-4661-b2ba-2a19a1759ef0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:56.699093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-11e59fae-0667-4661-b2ba-2a19a1759ef0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:56.699795 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-11e59fae-0667-4661-b2ba-2a19a1759ef0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:56.700266 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-11e59fae-0667-4661-b2ba-2a19a1759ef0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:56.700712 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-11e59fae-0667-4661-b2ba-2a19a1759ef0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:56.837488 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-11e59fae-0667-4661-b2ba-2a19a1759ef0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:39:56.849961 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-11e59fae-0667-4661-b2ba-2a19a1759ef0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1683 microversion: 2.1 time: 0.163527 Sep 17 21:39:56.850701 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3298/6504] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:39:56 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:39:57.876580 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-166d3da7-e0aa-4a5a-82ba-c3d5a4047246 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:39:57.877239 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-166d3da7-e0aa-4a5a-82ba-c3d5a4047246 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:39:57.884509 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-166d3da7-e0aa-4a5a-82ba-c3d5a4047246 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:57.885013 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-166d3da7-e0aa-4a5a-82ba-c3d5a4047246 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:57.885508 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-166d3da7-e0aa-4a5a-82ba-c3d5a4047246 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:57.886297 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-166d3da7-e0aa-4a5a-82ba-c3d5a4047246 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:57.886833 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-166d3da7-e0aa-4a5a-82ba-c3d5a4047246 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:57.887282 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-166d3da7-e0aa-4a5a-82ba-c3d5a4047246 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:58.029077 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-166d3da7-e0aa-4a5a-82ba-c3d5a4047246 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:39:58.037659 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-166d3da7-e0aa-4a5a-82ba-c3d5a4047246 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1683 microversion: 2.1 time: 0.165123 Sep 17 21:39:58.038260 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3207/6505] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:39:57 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:39:59.061737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-92de5b61-c55d-4cb1-8257-37c9fd0d8280 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:39:59.062385 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-92de5b61-c55d-4cb1-8257-37c9fd0d8280 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:39:59.069439 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92de5b61-c55d-4cb1-8257-37c9fd0d8280 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:59.069977 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92de5b61-c55d-4cb1-8257-37c9fd0d8280 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:59.070439 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92de5b61-c55d-4cb1-8257-37c9fd0d8280 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:59.071174 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92de5b61-c55d-4cb1-8257-37c9fd0d8280 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:39:59.071648 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92de5b61-c55d-4cb1-8257-37c9fd0d8280 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:39:59.072091 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-92de5b61-c55d-4cb1-8257-37c9fd0d8280 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:39:59.293188 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-92de5b61-c55d-4cb1-8257-37c9fd0d8280 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:39:59.301575 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-92de5b61-c55d-4cb1-8257-37c9fd0d8280 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1683 microversion: 2.1 time: 0.243886 Sep 17 21:39:59.302291 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3299/6506] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:39:59 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1683 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:40:00.329224 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9cdadcb2-04df-453e-9af9-33e4736ed601 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:40:00.330288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9cdadcb2-04df-453e-9af9-33e4736ed601 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:40:00.341999 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9cdadcb2-04df-453e-9af9-33e4736ed601 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:00.342816 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9cdadcb2-04df-453e-9af9-33e4736ed601 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:00.343807 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9cdadcb2-04df-453e-9af9-33e4736ed601 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:00.344516 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9cdadcb2-04df-453e-9af9-33e4736ed601 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:00.344974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9cdadcb2-04df-453e-9af9-33e4736ed601 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:00.345428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9cdadcb2-04df-453e-9af9-33e4736ed601 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:00.489451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9cdadcb2-04df-453e-9af9-33e4736ed601 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:40:00.501593 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9cdadcb2-04df-453e-9af9-33e4736ed601 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1683 microversion: 2.1 time: 0.178593 Sep 17 21:40:00.502343 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3208/6507] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:40:00 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1683 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:40:01.534113 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-daf21d31-b41b-4930-b610-0dd4c03818fc tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:40:01.535084 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-daf21d31-b41b-4930-b610-0dd4c03818fc tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:40:01.546714 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-daf21d31-b41b-4930-b610-0dd4c03818fc tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:01.547212 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-daf21d31-b41b-4930-b610-0dd4c03818fc tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:01.547664 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-daf21d31-b41b-4930-b610-0dd4c03818fc tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:01.548372 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-daf21d31-b41b-4930-b610-0dd4c03818fc tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:01.548838 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-daf21d31-b41b-4930-b610-0dd4c03818fc tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:01.549274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-daf21d31-b41b-4930-b610-0dd4c03818fc tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:01.691081 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-daf21d31-b41b-4930-b610-0dd4c03818fc tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:40:01.699075 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-daf21d31-b41b-4930-b610-0dd4c03818fc tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1683 microversion: 2.1 time: 0.171623 Sep 17 21:40:01.699654 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3300/6508] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:40:01 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1683 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:40:02.723351 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-26b4b6b5-6257-4af2-ab6e-22022313ccf0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:40:02.723962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-26b4b6b5-6257-4af2-ab6e-22022313ccf0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:40:02.731104 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26b4b6b5-6257-4af2-ab6e-22022313ccf0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:02.731609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26b4b6b5-6257-4af2-ab6e-22022313ccf0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:02.732054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26b4b6b5-6257-4af2-ab6e-22022313ccf0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:02.732769 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26b4b6b5-6257-4af2-ab6e-22022313ccf0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:02.733541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26b4b6b5-6257-4af2-ab6e-22022313ccf0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:02.733685 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-26b4b6b5-6257-4af2-ab6e-22022313ccf0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:02.745082 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-6454844b-da44-43a0-b8c5-95ef29b8ac37 req-ee49f320-fc33-45f3-a4f9-951771061080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f570a5-6e67-43f4-acb2-798fbaf1de66", "name": "network-vif-unplugged", "status": "completed", "tag": "548d2a28-a18d-44ca-a4a0-104258606d00"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:40:02.755659 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6454844b-da44-43a0-b8c5-95ef29b8ac37 req-ee49f320-fc33-45f3-a4f9-951771061080 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:02.756200 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6454844b-da44-43a0-b8c5-95ef29b8ac37 req-ee49f320-fc33-45f3-a4f9-951771061080 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:02.757306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6454844b-da44-43a0-b8c5-95ef29b8ac37 req-ee49f320-fc33-45f3-a4f9-951771061080 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:02.769916 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-6454844b-da44-43a0-b8c5-95ef29b8ac37 req-ee49f320-fc33-45f3-a4f9-951771061080 service nova] Creating event network-vif-unplugged:548d2a28-a18d-44ca-a4a0-104258606d00 for instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 on nch1-master-1 Sep 17 21:40:02.775693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [req-6454844b-da44-43a0-b8c5-95ef29b8ac37 req-ee49f320-fc33-45f3-a4f9-951771061080 service nova] Instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140524) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 21:40:02.788716 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-6454844b-da44-43a0-b8c5-95ef29b8ac37 req-ee49f320-fc33-45f3-a4f9-951771061080 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047401 Sep 17 21:40:02.790118 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3301/6509] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:40:02.877915 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-26b4b6b5-6257-4af2-ab6e-22022313ccf0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:40:02.886063 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-26b4b6b5-6257-4af2-ab6e-22022313ccf0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1682 microversion: 2.1 time: 0.166812 Sep 17 21:40:02.886651 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3209/6510] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:40:02 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:40:03.913017 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3a8af327-a32b-40ad-ba1a-4e816e6db7ec tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:40:03.913700 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3a8af327-a32b-40ad-ba1a-4e816e6db7ec tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:40:03.921037 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a8af327-a32b-40ad-ba1a-4e816e6db7ec tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:03.921578 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a8af327-a32b-40ad-ba1a-4e816e6db7ec tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:03.922038 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a8af327-a32b-40ad-ba1a-4e816e6db7ec tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:03.922807 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a8af327-a32b-40ad-ba1a-4e816e6db7ec tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:03.923517 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a8af327-a32b-40ad-ba1a-4e816e6db7ec tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:03.923720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a8af327-a32b-40ad-ba1a-4e816e6db7ec tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:04.058300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3a8af327-a32b-40ad-ba1a-4e816e6db7ec tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:40:04.067002 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3a8af327-a32b-40ad-ba1a-4e816e6db7ec tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1682 microversion: 2.1 time: 0.159818 Sep 17 21:40:04.067601 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3302/6511] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:40:03 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:40:04.815296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-12970969-1e8e-4f61-b052-d926d26d1abb req-8e7f4677-7b4d-4c20-b622-618b0dda8aca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9f570a5-6e67-43f4-acb2-798fbaf1de66", "tag": "548d2a28-a18d-44ca-a4a0-104258606d00"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:40:04.825847 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-12970969-1e8e-4f61-b052-d926d26d1abb req-8e7f4677-7b4d-4c20-b622-618b0dda8aca service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:04.826329 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-12970969-1e8e-4f61-b052-d926d26d1abb req-8e7f4677-7b4d-4c20-b622-618b0dda8aca service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:04.826762 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-12970969-1e8e-4f61-b052-d926d26d1abb req-8e7f4677-7b4d-4c20-b622-618b0dda8aca service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:04.839296 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-12970969-1e8e-4f61-b052-d926d26d1abb req-8e7f4677-7b4d-4c20-b622-618b0dda8aca service nova] Creating event network-changed:548d2a28-a18d-44ca-a4a0-104258606d00 for instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 on nch1-master-1 Sep 17 21:40:04.845657 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [req-12970969-1e8e-4f61-b052-d926d26d1abb req-8e7f4677-7b4d-4c20-b622-618b0dda8aca service nova] Instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140523) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 21:40:04.856903 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-12970969-1e8e-4f61-b052-d926d26d1abb req-8e7f4677-7b4d-4c20-b622-618b0dda8aca service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047483 Sep 17 21:40:04.857512 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3210/6512] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:40:05.091232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c713b033-d2c8-4eca-9d93-ec1ded57bcc5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:40:05.091822 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c713b033-d2c8-4eca-9d93-ec1ded57bcc5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:40:05.101794 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c713b033-d2c8-4eca-9d93-ec1ded57bcc5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:05.102330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c713b033-d2c8-4eca-9d93-ec1ded57bcc5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:05.102772 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c713b033-d2c8-4eca-9d93-ec1ded57bcc5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:05.103499 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c713b033-d2c8-4eca-9d93-ec1ded57bcc5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:05.103980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c713b033-d2c8-4eca-9d93-ec1ded57bcc5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:05.104427 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c713b033-d2c8-4eca-9d93-ec1ded57bcc5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:05.295688 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c713b033-d2c8-4eca-9d93-ec1ded57bcc5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:40:05.304296 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c713b033-d2c8-4eca-9d93-ec1ded57bcc5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1680 microversion: 2.1 time: 0.217543 Sep 17 21:40:05.304891 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3303/6513] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:40:05 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1680 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:40:06.334977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f8ee6a80-14ee-44a7-91c2-b67c7fe9c2b2 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:40:06.336140 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f8ee6a80-14ee-44a7-91c2-b67c7fe9c2b2 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:40:06.346332 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8ee6a80-14ee-44a7-91c2-b67c7fe9c2b2 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:06.346827 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8ee6a80-14ee-44a7-91c2-b67c7fe9c2b2 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:06.347256 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8ee6a80-14ee-44a7-91c2-b67c7fe9c2b2 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:06.347989 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8ee6a80-14ee-44a7-91c2-b67c7fe9c2b2 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:06.348454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8ee6a80-14ee-44a7-91c2-b67c7fe9c2b2 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:06.348889 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f8ee6a80-14ee-44a7-91c2-b67c7fe9c2b2 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:06.488780 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f8ee6a80-14ee-44a7-91c2-b67c7fe9c2b2 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:40:06.497085 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f8ee6a80-14ee-44a7-91c2-b67c7fe9c2b2 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1677 microversion: 2.1 time: 0.171007 Sep 17 21:40:06.497696 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3211/6514] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:40:06 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:40:06.520477 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-faadc420-078b-4ec1-9275-afc24a97724e tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:40:06.521048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-faadc420-078b-4ec1-9275-afc24a97724e tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:40:06.528307 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-faadc420-078b-4ec1-9275-afc24a97724e tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:06.528809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-faadc420-078b-4ec1-9275-afc24a97724e tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:06.529266 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-faadc420-078b-4ec1-9275-afc24a97724e tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:06.530036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-faadc420-078b-4ec1-9275-afc24a97724e tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:06.530517 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-faadc420-078b-4ec1-9275-afc24a97724e tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:06.530956 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-faadc420-078b-4ec1-9275-afc24a97724e tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:06.568102 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-faadc420-078b-4ec1-9275-afc24a97724e tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:06.568589 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-faadc420-078b-4ec1-9275-afc24a97724e tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:06.569041 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-faadc420-078b-4ec1-9275-afc24a97724e tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:06.569815 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-faadc420-078b-4ec1-9275-afc24a97724e tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:06.570291 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-faadc420-078b-4ec1-9275-afc24a97724e tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:06.570736 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-faadc420-078b-4ec1-9275-afc24a97724e tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:06.591588 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-faadc420-078b-4ec1-9275-afc24a97724e tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Getting quotas for project ad243abc13a14aa08c717d4105e24f4f. Resources: {'cores', 'ram'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:40:06.597664 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-faadc420-078b-4ec1-9275-afc24a97724e tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Getting quotas for user d20f8598dfec4de7b496a64e023e7a15 and project ad243abc13a14aa08c717d4105e24f4f. Resources: {'cores', 'ram'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:40:06.683582 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:40:06.709106 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-faadc420-078b-4ec1-9275-afc24a97724e tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "POST /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66/action" status: 202 len: 0 microversion: 2.1 time: 0.192423 Sep 17 21:40:06.709814 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3304/6515] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:40:06 2022] POST /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 17 21:40:06.719266 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d8bc3167-4f3d-4ed3-97a2-a3a1396d1f4d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:40:06.719884 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d8bc3167-4f3d-4ed3-97a2-a3a1396d1f4d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:40:06.726340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8bc3167-4f3d-4ed3-97a2-a3a1396d1f4d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:06.726887 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8bc3167-4f3d-4ed3-97a2-a3a1396d1f4d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:06.727549 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8bc3167-4f3d-4ed3-97a2-a3a1396d1f4d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:06.728747 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8bc3167-4f3d-4ed3-97a2-a3a1396d1f4d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:06.729350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8bc3167-4f3d-4ed3-97a2-a3a1396d1f4d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:06.729844 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8bc3167-4f3d-4ed3-97a2-a3a1396d1f4d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:06.880862 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d8bc3167-4f3d-4ed3-97a2-a3a1396d1f4d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:40:06.889298 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d8bc3167-4f3d-4ed3-97a2-a3a1396d1f4d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1676 microversion: 2.1 time: 0.175084 Sep 17 21:40:06.890200 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3212/6516] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:40:06 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1676 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:40:07.916033 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0b9cfdb5-171b-4914-83f8-c76ca6c99923 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:40:07.916776 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0b9cfdb5-171b-4914-83f8-c76ca6c99923 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:40:07.924378 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b9cfdb5-171b-4914-83f8-c76ca6c99923 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:07.924891 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b9cfdb5-171b-4914-83f8-c76ca6c99923 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:07.925357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b9cfdb5-171b-4914-83f8-c76ca6c99923 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:07.926109 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b9cfdb5-171b-4914-83f8-c76ca6c99923 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:07.926605 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b9cfdb5-171b-4914-83f8-c76ca6c99923 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:07.927053 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0b9cfdb5-171b-4914-83f8-c76ca6c99923 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:08.060264 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0b9cfdb5-171b-4914-83f8-c76ca6c99923 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:40:08.068218 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0b9cfdb5-171b-4914-83f8-c76ca6c99923 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1676 microversion: 2.1 time: 0.158087 Sep 17 21:40:08.069118 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3305/6517] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:40:07 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:40:09.092328 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b3708bb5-28f6-42d8-aa53-5a3df3004a33 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:40:09.093345 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b3708bb5-28f6-42d8-aa53-5a3df3004a33 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:40:09.101079 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3708bb5-28f6-42d8-aa53-5a3df3004a33 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:09.101638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3708bb5-28f6-42d8-aa53-5a3df3004a33 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:09.102318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3708bb5-28f6-42d8-aa53-5a3df3004a33 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:09.103052 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3708bb5-28f6-42d8-aa53-5a3df3004a33 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:09.103502 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3708bb5-28f6-42d8-aa53-5a3df3004a33 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:09.103937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3708bb5-28f6-42d8-aa53-5a3df3004a33 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:09.245390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b3708bb5-28f6-42d8-aa53-5a3df3004a33 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:40:09.265558 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b3708bb5-28f6-42d8-aa53-5a3df3004a33 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1676 microversion: 2.1 time: 0.176908 Sep 17 21:40:09.271435 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3213/6518] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:40:09 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1676 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:40:09.819252 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-a78ab7eb-5ac8-4bd3-881f-b4c93f6d0007 req-8f98b45c-7e03-4d10-a913-d9e455d77503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f570a5-6e67-43f4-acb2-798fbaf1de66", "name": "network-vif-plugged", "status": "completed", "tag": "548d2a28-a18d-44ca-a4a0-104258606d00"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:40:09.830818 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a78ab7eb-5ac8-4bd3-881f-b4c93f6d0007 req-8f98b45c-7e03-4d10-a913-d9e455d77503 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:09.831508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a78ab7eb-5ac8-4bd3-881f-b4c93f6d0007 req-8f98b45c-7e03-4d10-a913-d9e455d77503 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:09.832058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a78ab7eb-5ac8-4bd3-881f-b4c93f6d0007 req-8f98b45c-7e03-4d10-a913-d9e455d77503 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:09.845693 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-a78ab7eb-5ac8-4bd3-881f-b4c93f6d0007 req-8f98b45c-7e03-4d10-a913-d9e455d77503 service nova] Creating event network-vif-plugged:548d2a28-a18d-44ca-a4a0-104258606d00 for instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 on nch2-master-1 Sep 17 21:40:09.854992 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [req-a78ab7eb-5ac8-4bd3-881f-b4c93f6d0007 req-8f98b45c-7e03-4d10-a913-d9e455d77503 service nova] Instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140524) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 21:40:09.867975 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-a78ab7eb-5ac8-4bd3-881f-b4c93f6d0007 req-8f98b45c-7e03-4d10-a913-d9e455d77503 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052738 Sep 17 21:40:09.869033 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3306/6519] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:40:10.293241 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8e8cb973-832b-43a0-89ee-832f0467cb75 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:40:10.294258 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8e8cb973-832b-43a0-89ee-832f0467cb75 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:40:10.303698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8e8cb973-832b-43a0-89ee-832f0467cb75 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:10.304199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8e8cb973-832b-43a0-89ee-832f0467cb75 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:10.304647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8e8cb973-832b-43a0-89ee-832f0467cb75 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:10.305365 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8e8cb973-832b-43a0-89ee-832f0467cb75 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:10.305867 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8e8cb973-832b-43a0-89ee-832f0467cb75 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:10.306311 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8e8cb973-832b-43a0-89ee-832f0467cb75 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:10.446193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8e8cb973-832b-43a0-89ee-832f0467cb75 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:40:10.454277 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8e8cb973-832b-43a0-89ee-832f0467cb75 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1676 microversion: 2.1 time: 0.167813 Sep 17 21:40:10.454852 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3214/6520] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:40:10 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:40:10.816380 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-85c74194-55ec-4cf5-b8dc-fdbf9e1b4a52 req-c48432eb-3f71-40fe-ad23-ce84d145af7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f570a5-6e67-43f4-acb2-798fbaf1de66", "name": "network-vif-unplugged", "status": "completed", "tag": "548d2a28-a18d-44ca-a4a0-104258606d00"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:40:10.825989 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-85c74194-55ec-4cf5-b8dc-fdbf9e1b4a52 req-c48432eb-3f71-40fe-ad23-ce84d145af7f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:10.826613 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-85c74194-55ec-4cf5-b8dc-fdbf9e1b4a52 req-c48432eb-3f71-40fe-ad23-ce84d145af7f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:10.826921 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-85c74194-55ec-4cf5-b8dc-fdbf9e1b4a52 req-c48432eb-3f71-40fe-ad23-ce84d145af7f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:10.838923 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-85c74194-55ec-4cf5-b8dc-fdbf9e1b4a52 req-c48432eb-3f71-40fe-ad23-ce84d145af7f service nova] Creating event network-vif-unplugged:548d2a28-a18d-44ca-a4a0-104258606d00 for instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 on nch2-master-1 Sep 17 21:40:10.844747 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [req-85c74194-55ec-4cf5-b8dc-fdbf9e1b4a52 req-c48432eb-3f71-40fe-ad23-ce84d145af7f service nova] Instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140524) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 21:40:10.856004 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-85c74194-55ec-4cf5-b8dc-fdbf9e1b4a52 req-c48432eb-3f71-40fe-ad23-ce84d145af7f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044002 Sep 17 21:40:10.856657 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3307/6521] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:40:11.478585 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1c04daa4-b6e6-4566-b621-9031e24030ab tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:40:11.479181 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1c04daa4-b6e6-4566-b621-9031e24030ab tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:40:11.486582 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c04daa4-b6e6-4566-b621-9031e24030ab tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:11.487079 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c04daa4-b6e6-4566-b621-9031e24030ab tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:11.487529 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c04daa4-b6e6-4566-b621-9031e24030ab tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:11.488247 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c04daa4-b6e6-4566-b621-9031e24030ab tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:11.488712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c04daa4-b6e6-4566-b621-9031e24030ab tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:11.489147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c04daa4-b6e6-4566-b621-9031e24030ab tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:11.728162 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1c04daa4-b6e6-4566-b621-9031e24030ab tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:40:11.736301 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1c04daa4-b6e6-4566-b621-9031e24030ab tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1676 microversion: 2.1 time: 0.261732 Sep 17 21:40:11.737057 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3215/6522] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:40:11 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1676 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:40:12.766607 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-64d966c3-42e4-4d6c-9e59-6bfac34118f5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:40:12.767784 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-64d966c3-42e4-4d6c-9e59-6bfac34118f5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:40:12.778894 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64d966c3-42e4-4d6c-9e59-6bfac34118f5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:12.779739 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64d966c3-42e4-4d6c-9e59-6bfac34118f5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:12.780554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64d966c3-42e4-4d6c-9e59-6bfac34118f5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:12.781799 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64d966c3-42e4-4d6c-9e59-6bfac34118f5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:12.782592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64d966c3-42e4-4d6c-9e59-6bfac34118f5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:12.783432 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64d966c3-42e4-4d6c-9e59-6bfac34118f5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:12.895117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-fddbed73-e08e-4018-8d1b-12abaff04655 req-819484d6-786d-48b8-b0b5-d82470a0dfbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9f570a5-6e67-43f4-acb2-798fbaf1de66", "tag": "548d2a28-a18d-44ca-a4a0-104258606d00"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:40:12.906000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-fddbed73-e08e-4018-8d1b-12abaff04655 req-819484d6-786d-48b8-b0b5-d82470a0dfbc service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:12.906477 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-fddbed73-e08e-4018-8d1b-12abaff04655 req-819484d6-786d-48b8-b0b5-d82470a0dfbc service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:12.906917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-fddbed73-e08e-4018-8d1b-12abaff04655 req-819484d6-786d-48b8-b0b5-d82470a0dfbc service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:12.922157 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-fddbed73-e08e-4018-8d1b-12abaff04655 req-819484d6-786d-48b8-b0b5-d82470a0dfbc service nova] Creating event network-changed:548d2a28-a18d-44ca-a4a0-104258606d00 for instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 on nch2-master-1 Sep 17 21:40:12.928111 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [req-fddbed73-e08e-4018-8d1b-12abaff04655 req-819484d6-786d-48b8-b0b5-d82470a0dfbc service nova] Instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140523) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 21:40:12.935684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-64d966c3-42e4-4d6c-9e59-6bfac34118f5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:40:12.939628 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-fddbed73-e08e-4018-8d1b-12abaff04655 req-819484d6-786d-48b8-b0b5-d82470a0dfbc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049825 Sep 17 21:40:12.940645 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3216/6523] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:40:12.949491 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-64d966c3-42e4-4d6c-9e59-6bfac34118f5 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1676 microversion: 2.1 time: 0.191291 Sep 17 21:40:12.958214 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3308/6524] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:40:12 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1676 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:40:13.980417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0c419246-3ecb-4ede-93ce-db205a40ebe8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:40:13.981622 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0c419246-3ecb-4ede-93ce-db205a40ebe8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:40:13.984814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=33 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:40:13.991527 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c419246-3ecb-4ede-93ce-db205a40ebe8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:13.992032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c419246-3ecb-4ede-93ce-db205a40ebe8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:13.992479 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c419246-3ecb-4ede-93ce-db205a40ebe8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:13.993193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c419246-3ecb-4ede-93ce-db205a40ebe8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:13.993688 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c419246-3ecb-4ede-93ce-db205a40ebe8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:13.994145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c419246-3ecb-4ede-93ce-db205a40ebe8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:13.996994 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=93 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:40:14.131724 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0c419246-3ecb-4ede-93ce-db205a40ebe8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:40:14.139801 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0c419246-3ecb-4ede-93ce-db205a40ebe8 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1669 microversion: 2.1 time: 0.168211 Sep 17 21:40:14.140365 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3217/6525] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:40:13 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1669 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:40:14.162193 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a317d26a-f71c-4f42-8bfd-9a290bc31ec7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:40:14.162859 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a317d26a-f71c-4f42-8bfd-9a290bc31ec7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:40:14.165752 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:40:14.171826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a317d26a-f71c-4f42-8bfd-9a290bc31ec7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:14.172397 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a317d26a-f71c-4f42-8bfd-9a290bc31ec7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:14.172856 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a317d26a-f71c-4f42-8bfd-9a290bc31ec7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:14.173604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a317d26a-f71c-4f42-8bfd-9a290bc31ec7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:14.174078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a317d26a-f71c-4f42-8bfd-9a290bc31ec7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:14.174520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a317d26a-f71c-4f42-8bfd-9a290bc31ec7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:14.304551 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a317d26a-f71c-4f42-8bfd-9a290bc31ec7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:40:14.312847 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a317d26a-f71c-4f42-8bfd-9a290bc31ec7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1669 microversion: 2.1 time: 0.154525 Sep 17 21:40:14.313431 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3309/6526] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:40:14 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1669 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:40:14.335903 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-36e65838-32af-4a42-aa40-59ce19755ced tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:40:14.336540 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-36e65838-32af-4a42-aa40-59ce19755ced tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:40:14.343343 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36e65838-32af-4a42-aa40-59ce19755ced tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:14.343836 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36e65838-32af-4a42-aa40-59ce19755ced tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:14.344280 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36e65838-32af-4a42-aa40-59ce19755ced tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:14.344983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36e65838-32af-4a42-aa40-59ce19755ced tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:14.345446 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36e65838-32af-4a42-aa40-59ce19755ced tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:14.345924 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36e65838-32af-4a42-aa40-59ce19755ced tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:14.478837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-36e65838-32af-4a42-aa40-59ce19755ced tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:40:14.489734 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-36e65838-32af-4a42-aa40-59ce19755ced tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1669 microversion: 2.1 time: 0.157568 Sep 17 21:40:14.490581 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3218/6527] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:40:14 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:40:14.517727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-12badefc-8646-437a-84bb-1e651d310816 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:40:14.518244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-12badefc-8646-437a-84bb-1e651d310816 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:40:14.524553 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12badefc-8646-437a-84bb-1e651d310816 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:14.525063 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12badefc-8646-437a-84bb-1e651d310816 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:14.525564 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12badefc-8646-437a-84bb-1e651d310816 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:14.526305 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12badefc-8646-437a-84bb-1e651d310816 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:14.526778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12badefc-8646-437a-84bb-1e651d310816 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:14.527232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12badefc-8646-437a-84bb-1e651d310816 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:14.553081 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-12badefc-8646-437a-84bb-1e651d310816 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:40:14.631989 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-12badefc-8646-437a-84bb-1e651d310816 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 204 len: 0 microversion: 2.1 time: 0.118093 Sep 17 21:40:14.632654 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3310/6528] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:40:14 2022] DELETE /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:40:14.641276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1c454954-ae1f-4b34-a09e-8aabba01c01c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:40:14.641931 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1c454954-ae1f-4b34-a09e-8aabba01c01c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:40:14.648276 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c454954-ae1f-4b34-a09e-8aabba01c01c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:14.648763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c454954-ae1f-4b34-a09e-8aabba01c01c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:14.649212 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c454954-ae1f-4b34-a09e-8aabba01c01c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:14.649957 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c454954-ae1f-4b34-a09e-8aabba01c01c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:14.650418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c454954-ae1f-4b34-a09e-8aabba01c01c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:14.650852 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1c454954-ae1f-4b34-a09e-8aabba01c01c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:14.785192 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1c454954-ae1f-4b34-a09e-8aabba01c01c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:40:14.793186 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1c454954-ae1f-4b34-a09e-8aabba01c01c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1675 microversion: 2.1 time: 0.155847 Sep 17 21:40:14.793810 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3219/6529] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:40:14 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:40:15.786501 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-59c2779e-f20c-45fc-a65a-9cd7b607754c req-e78ca212-c4ce-4f06-9309-cd7ef926fcd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f570a5-6e67-43f4-acb2-798fbaf1de66", "name": "network-vif-plugged", "status": "completed", "tag": "548d2a28-a18d-44ca-a4a0-104258606d00"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:40:15.799202 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-59c2779e-f20c-45fc-a65a-9cd7b607754c req-e78ca212-c4ce-4f06-9309-cd7ef926fcd7 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:15.799703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-59c2779e-f20c-45fc-a65a-9cd7b607754c req-e78ca212-c4ce-4f06-9309-cd7ef926fcd7 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:15.800151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-59c2779e-f20c-45fc-a65a-9cd7b607754c req-e78ca212-c4ce-4f06-9309-cd7ef926fcd7 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:15.811912 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-59c2779e-f20c-45fc-a65a-9cd7b607754c req-e78ca212-c4ce-4f06-9309-cd7ef926fcd7 service nova] Creating event network-vif-plugged:548d2a28-a18d-44ca-a4a0-104258606d00 for instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 on nch2-master-1 Sep 17 21:40:15.816721 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3541e499-e03d-4665-ab0c-59ba5f591527 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:40:15.817235 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-59c2779e-f20c-45fc-a65a-9cd7b607754c req-e78ca212-c4ce-4f06-9309-cd7ef926fcd7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034659 Sep 17 21:40:15.817336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3541e499-e03d-4665-ab0c-59ba5f591527 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:40:15.818210 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3311/6530] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:40:15.825020 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3541e499-e03d-4665-ab0c-59ba5f591527 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:15.825568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3541e499-e03d-4665-ab0c-59ba5f591527 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:15.826070 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3541e499-e03d-4665-ab0c-59ba5f591527 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:15.826793 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3541e499-e03d-4665-ab0c-59ba5f591527 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:15.827254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3541e499-e03d-4665-ab0c-59ba5f591527 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:15.827855 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3541e499-e03d-4665-ab0c-59ba5f591527 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:16.032409 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3541e499-e03d-4665-ab0c-59ba5f591527 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:40:16.041298 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3541e499-e03d-4665-ab0c-59ba5f591527 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1675 microversion: 2.1 time: 0.228689 Sep 17 21:40:16.041933 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3220/6531] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:40:15 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1675 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:40:16.862221 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:40:16.869676 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-2121308e-e116-42bb-a89d-1029071d5513 req-4c22407b-7a93-4839-9289-96f1cb60f033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f570a5-6e67-43f4-acb2-798fbaf1de66", "name": "network-vif-deleted", "tag": "548d2a28-a18d-44ca-a4a0-104258606d00"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:40:16.882551 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-2121308e-e116-42bb-a89d-1029071d5513 req-4c22407b-7a93-4839-9289-96f1cb60f033 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:16.883470 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-2121308e-e116-42bb-a89d-1029071d5513 req-4c22407b-7a93-4839-9289-96f1cb60f033 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:16.884164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-2121308e-e116-42bb-a89d-1029071d5513 req-4c22407b-7a93-4839-9289-96f1cb60f033 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:16.899639 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-2121308e-e116-42bb-a89d-1029071d5513 req-4c22407b-7a93-4839-9289-96f1cb60f033 service nova] Creating event network-vif-deleted:548d2a28-a18d-44ca-a4a0-104258606d00 for instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 on nch2-master-1 Sep 17 21:40:16.906012 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-2121308e-e116-42bb-a89d-1029071d5513 req-4c22407b-7a93-4839-9289-96f1cb60f033 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044719 Sep 17 21:40:16.907329 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3312/6532] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:40:17.064903 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-33ce3a8f-8360-40fe-a473-14323eaf48af tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:40:17.065556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-33ce3a8f-8360-40fe-a473-14323eaf48af tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:40:17.074132 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-33ce3a8f-8360-40fe-a473-14323eaf48af tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:17.074652 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-33ce3a8f-8360-40fe-a473-14323eaf48af tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:17.075254 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-33ce3a8f-8360-40fe-a473-14323eaf48af tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:17.075977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-33ce3a8f-8360-40fe-a473-14323eaf48af tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:17.076406 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-33ce3a8f-8360-40fe-a473-14323eaf48af tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:17.076995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-33ce3a8f-8360-40fe-a473-14323eaf48af tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:17.116461 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-33ce3a8f-8360-40fe-a473-14323eaf48af tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:17.116936 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-33ce3a8f-8360-40fe-a473-14323eaf48af tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:17.117597 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-33ce3a8f-8360-40fe-a473-14323eaf48af tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:17.118319 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-33ce3a8f-8360-40fe-a473-14323eaf48af tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lazy-loading 'fault' on Instance uuid c9f570a5-6e67-43f4-acb2-798fbaf1de66 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:40:17.177126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-33ce3a8f-8360-40fe-a473-14323eaf48af tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:40:17.184547 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-33ce3a8f-8360-40fe-a473-14323eaf48af tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 200 len: 1329 microversion: 2.1 time: 0.123732 Sep 17 21:40:17.185124 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3221/6533] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:40:17 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 1329 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:40:18.211432 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8c58c80c-e26b-4d2e-a7e0-b80cf166fc9d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:40:18.212151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8c58c80c-e26b-4d2e-a7e0-b80cf166fc9d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:40:18.219350 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c58c80c-e26b-4d2e-a7e0-b80cf166fc9d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:18.219862 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c58c80c-e26b-4d2e-a7e0-b80cf166fc9d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:18.220316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c58c80c-e26b-4d2e-a7e0-b80cf166fc9d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:18.221036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c58c80c-e26b-4d2e-a7e0-b80cf166fc9d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:18.221641 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c58c80c-e26b-4d2e-a7e0-b80cf166fc9d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:18.222188 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8c58c80c-e26b-4d2e-a7e0-b80cf166fc9d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:18.236129 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-8c58c80c-e26b-4d2e-a7e0-b80cf166fc9d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] HTTP exception thrown: Instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 could not be found. Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8c58c80c-e26b-4d2e-a7e0-b80cf166fc9d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Request method failure captured: Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 HTTP/1.1 Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJj3jwshgKHrmiTh9He2iymPHWHLX-Bt6aPFYMaypjQpla8PjsWm9yR1cr-rMt99yChBYg92ATksUdevYw1cssE35vglYIXszUAp944E84DQ3hBJviVnWeBZQ8d2ZXwzYz00kQH44YjF-EXnR6Tb897kEyxad5Zvgh2DN_v9yxO1e0r8 Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: ad243abc13a14aa08c717d4105e24f4f Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerActionsTestJSON-226995111 Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad243abc13a14aa08c717d4105e24f4f", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerActionsTestJSON-226995111 Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: ad243abc13a14aa08c717d4105e24f4f Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerActionsTestJSON-226995111 Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerActionsTestJSON-226995111-project Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: d20f8598dfec4de7b496a64e023e7a15 Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerActionsTestJSON-226995111-project Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 could not be found. Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'c9f570a5-6e67-43f4-acb2-798fbaf1de66'} Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 could not be found. Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 could not be found. Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:40:18.237833 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:40:18.242329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:40:18.242329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:40:18.242329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:40:18.242329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:40:18.242329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:40:18.242329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 could not be found. Sep 17 21:40:18.242329 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:40:18.242329 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8c58c80c-e26b-4d2e-a7e0-b80cf166fc9d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Returning 404 to user: Instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:40:18.242329 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8c58c80c-e26b-4d2e-a7e0-b80cf166fc9d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 404 len: 111 microversion: 2.1 time: 0.034526 Sep 17 21:40:18.242329 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3313/6534] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:40:18 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:40:18.257390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c431b023-1d1b-4771-90e4-d68b2fdecbe4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:40:18.258217 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c431b023-1d1b-4771-90e4-d68b2fdecbe4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:40:18.265353 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c431b023-1d1b-4771-90e4-d68b2fdecbe4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:18.265873 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c431b023-1d1b-4771-90e4-d68b2fdecbe4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:18.266311 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c431b023-1d1b-4771-90e4-d68b2fdecbe4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:18.267015 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c431b023-1d1b-4771-90e4-d68b2fdecbe4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:18.267473 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c431b023-1d1b-4771-90e4-d68b2fdecbe4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:18.267904 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c431b023-1d1b-4771-90e4-d68b2fdecbe4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:18.281488 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-c431b023-1d1b-4771-90e4-d68b2fdecbe4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] HTTP exception thrown: Instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 could not be found. Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c431b023-1d1b-4771-90e4-d68b2fdecbe4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Request method failure captured: Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 HTTP/1.1 Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJj3jwshgKHrmiTh9He2iymPHWHLX-Bt6aPFYMaypjQpla8PjsWm9yR1cr-rMt99yChBYg92ATksUdevYw1cssE35vglYIXszUAp944E84DQ3hBJviVnWeBZQ8d2ZXwzYz00kQH44YjF-EXnR6Tb897kEyxad5Zvgh2DN_v9yxO1e0r8 Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: ad243abc13a14aa08c717d4105e24f4f Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerActionsTestJSON-226995111 Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad243abc13a14aa08c717d4105e24f4f", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerActionsTestJSON-226995111 Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: ad243abc13a14aa08c717d4105e24f4f Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerActionsTestJSON-226995111 Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerActionsTestJSON-226995111-project Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: d20f8598dfec4de7b496a64e023e7a15 Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerActionsTestJSON-226995111-project Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 could not be found. Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'c9f570a5-6e67-43f4-acb2-798fbaf1de66'} Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 could not be found. Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 could not be found. Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:40:18.283239 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:40:18.287772 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:40:18.287772 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:40:18.287772 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:40:18.287772 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:40:18.287772 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:40:18.287772 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 could not be found. Sep 17 21:40:18.287772 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:40:18.287772 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c431b023-1d1b-4771-90e4-d68b2fdecbe4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Returning 404 to user: Instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:40:18.287772 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c431b023-1d1b-4771-90e4-d68b2fdecbe4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 404 len: 111 microversion: 2.1 time: 0.031417 Sep 17 21:40:18.287772 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3222/6535] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:40:18 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:40:18.338584 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-678d9b96-0ec2-4bef-961a-2e0300a11f9a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2131497374", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "595473ed-8f19-4b14-b9d1-04243f9c5e91"}], "security_groups": [{"name": "tempest-securitygroup--262220769"}], "key_name": "tempest-keypair-1377054705", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:40:18.447791 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-678d9b96-0ec2-4bef-961a-2e0300a11f9a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] validate_networks() for [('595473ed-8f19-4b14-b9d1-04243f9c5e91', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:40:18.830250 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-678d9b96-0ec2-4bef-961a-2e0300a11f9a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:40:18.830680 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-678d9b96-0ec2-4bef-961a-2e0300a11f9a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:40:18.831175 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-678d9b96-0ec2-4bef-961a-2e0300a11f9a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:40:18.831598 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-678d9b96-0ec2-4bef-961a-2e0300a11f9a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:40:18.832026 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-678d9b96-0ec2-4bef-961a-2e0300a11f9a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:40:18.841192 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-678d9b96-0ec2-4bef-961a-2e0300a11f9a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:18.841730 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-678d9b96-0ec2-4bef-961a-2e0300a11f9a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:18.842182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-678d9b96-0ec2-4bef-961a-2e0300a11f9a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:18.843412 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-678d9b96-0ec2-4bef-961a-2e0300a11f9a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:18.843853 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-678d9b96-0ec2-4bef-961a-2e0300a11f9a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:18.844289 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-678d9b96-0ec2-4bef-961a-2e0300a11f9a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:18.861653 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-678d9b96-0ec2-4bef-961a-2e0300a11f9a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Getting quotas for project ad243abc13a14aa08c717d4105e24f4f. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:40:18.867130 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-678d9b96-0ec2-4bef-961a-2e0300a11f9a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Getting quotas for user d20f8598dfec4de7b496a64e023e7a15 and project ad243abc13a14aa08c717d4105e24f4f. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:40:18.879633 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-678d9b96-0ec2-4bef-961a-2e0300a11f9a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:40:18.882019 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-678d9b96-0ec2-4bef-961a-2e0300a11f9a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:40:18.929976 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-678d9b96-0ec2-4bef-961a-2e0300a11f9a tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.595263 Sep 17 21:40:18.930628 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3314/6536] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:40:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:40:18.942859 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bb8ee3bc-0124-4398-b4e3-75b8aae046e4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:40:18.943476 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bb8ee3bc-0124-4398-b4e3-75b8aae046e4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:40:18.999124 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bb8ee3bc-0124-4398-b4e3-75b8aae046e4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:40:19.006315 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bb8ee3bc-0124-4398-b4e3-75b8aae046e4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1239 microversion: 2.1 time: 0.067968 Sep 17 21:40:19.007117 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3223/6537] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:40:18 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:40:20.030183 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c396b095-5125-4d00-8ed2-519fbb33cf26 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:40:20.030842 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c396b095-5125-4d00-8ed2-519fbb33cf26 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:40:20.037826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c396b095-5125-4d00-8ed2-519fbb33cf26 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:20.038343 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c396b095-5125-4d00-8ed2-519fbb33cf26 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:20.038821 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c396b095-5125-4d00-8ed2-519fbb33cf26 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:20.039538 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c396b095-5125-4d00-8ed2-519fbb33cf26 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:20.040017 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c396b095-5125-4d00-8ed2-519fbb33cf26 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:20.040465 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c396b095-5125-4d00-8ed2-519fbb33cf26 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:20.109221 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c396b095-5125-4d00-8ed2-519fbb33cf26 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:40:20.117401 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c396b095-5125-4d00-8ed2-519fbb33cf26 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1309 microversion: 2.1 time: 0.091288 Sep 17 21:40:20.118029 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3315/6538] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:40:20 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1309 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:40:21.142461 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4cd7bb63-1fcd-42c3-942f-9a95f3b3bfee tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:40:21.143116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4cd7bb63-1fcd-42c3-942f-9a95f3b3bfee tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:40:21.156180 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4cd7bb63-1fcd-42c3-942f-9a95f3b3bfee tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:21.156687 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4cd7bb63-1fcd-42c3-942f-9a95f3b3bfee tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:21.157158 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4cd7bb63-1fcd-42c3-942f-9a95f3b3bfee tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:21.157922 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4cd7bb63-1fcd-42c3-942f-9a95f3b3bfee tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:21.158392 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4cd7bb63-1fcd-42c3-942f-9a95f3b3bfee tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:21.158843 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4cd7bb63-1fcd-42c3-942f-9a95f3b3bfee tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:21.297381 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4cd7bb63-1fcd-42c3-942f-9a95f3b3bfee tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:40:21.305387 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4cd7bb63-1fcd-42c3-942f-9a95f3b3bfee tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1364 microversion: 2.1 time: 0.167150 Sep 17 21:40:21.306007 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3224/6539] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:40:21 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:40:21.375081 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-1bae0e18-a588-4c51-b154-4a8a930b5be4 req-3def4ebf-4cd6-4229-ae51-13230a03df9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acf1e47d-7fca-4cca-a3bc-66445ac0f1cc", "tag": "f32c867c-b0c7-42f0-b58e-d5987e695b36"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:40:21.385877 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-1bae0e18-a588-4c51-b154-4a8a930b5be4 req-3def4ebf-4cd6-4229-ae51-13230a03df9c service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:21.386380 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-1bae0e18-a588-4c51-b154-4a8a930b5be4 req-3def4ebf-4cd6-4229-ae51-13230a03df9c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:21.386823 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-1bae0e18-a588-4c51-b154-4a8a930b5be4 req-3def4ebf-4cd6-4229-ae51-13230a03df9c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:21.398343 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-1bae0e18-a588-4c51-b154-4a8a930b5be4 req-3def4ebf-4cd6-4229-ae51-13230a03df9c service nova] Creating event network-changed:f32c867c-b0c7-42f0-b58e-d5987e695b36 for instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc on nch1-master-1 Sep 17 21:40:21.403365 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-1bae0e18-a588-4c51-b154-4a8a930b5be4 req-3def4ebf-4cd6-4229-ae51-13230a03df9c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032047 Sep 17 21:40:21.404224 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3316/6540] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:40:22.333895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7cfb0633-5c32-4cf9-a3ac-a2338c956789 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:40:22.334594 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7cfb0633-5c32-4cf9-a3ac-a2338c956789 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:40:22.343168 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cfb0633-5c32-4cf9-a3ac-a2338c956789 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:22.343732 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cfb0633-5c32-4cf9-a3ac-a2338c956789 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:22.344238 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cfb0633-5c32-4cf9-a3ac-a2338c956789 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:22.345032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cfb0633-5c32-4cf9-a3ac-a2338c956789 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:22.345590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cfb0633-5c32-4cf9-a3ac-a2338c956789 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:22.346069 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cfb0633-5c32-4cf9-a3ac-a2338c956789 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:22.484002 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7cfb0633-5c32-4cf9-a3ac-a2338c956789 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:40:22.492299 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7cfb0633-5c32-4cf9-a3ac-a2338c956789 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1364 microversion: 2.1 time: 0.164845 Sep 17 21:40:22.492886 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3225/6541] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:40:22 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:40:23.518920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5df33b9f-a3b6-459e-bbc4-434ebbf6b6b0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:40:23.519736 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5df33b9f-a3b6-459e-bbc4-434ebbf6b6b0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:40:23.527338 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5df33b9f-a3b6-459e-bbc4-434ebbf6b6b0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:23.527879 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5df33b9f-a3b6-459e-bbc4-434ebbf6b6b0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:23.528401 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5df33b9f-a3b6-459e-bbc4-434ebbf6b6b0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:23.529201 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5df33b9f-a3b6-459e-bbc4-434ebbf6b6b0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:23.529763 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5df33b9f-a3b6-459e-bbc4-434ebbf6b6b0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:23.530256 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5df33b9f-a3b6-459e-bbc4-434ebbf6b6b0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:23.665360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5df33b9f-a3b6-459e-bbc4-434ebbf6b6b0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:40:23.673352 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5df33b9f-a3b6-459e-bbc4-434ebbf6b6b0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1364 microversion: 2.1 time: 0.160208 Sep 17 21:40:23.674049 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3317/6542] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:40:23 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:40:24.698177 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e76814b9-926e-4db7-a212-dfed58073d95 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:40:24.698855 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e76814b9-926e-4db7-a212-dfed58073d95 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:40:24.709737 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e76814b9-926e-4db7-a212-dfed58073d95 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:24.710360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e76814b9-926e-4db7-a212-dfed58073d95 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:24.710879 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e76814b9-926e-4db7-a212-dfed58073d95 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:24.711932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e76814b9-926e-4db7-a212-dfed58073d95 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:24.712544 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e76814b9-926e-4db7-a212-dfed58073d95 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:24.713131 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e76814b9-926e-4db7-a212-dfed58073d95 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:24.854931 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e76814b9-926e-4db7-a212-dfed58073d95 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:40:24.862965 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e76814b9-926e-4db7-a212-dfed58073d95 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1364 microversion: 2.1 time: 0.169659 Sep 17 21:40:24.863564 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3226/6543] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:40:24 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:40:25.878799 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-c6b3bd2e-7e76-44a7-abd7-aae585c8bfba req-32b43929-73d2-436a-a501-90e09d86c025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acf1e47d-7fca-4cca-a3bc-66445ac0f1cc", "name": "network-vif-plugged", "status": "completed", "tag": "f32c867c-b0c7-42f0-b58e-d5987e695b36"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:40:25.887256 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a4756cb9-1294-488f-9417-beded75232c0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:40:25.887921 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a4756cb9-1294-488f-9417-beded75232c0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:40:25.889264 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c6b3bd2e-7e76-44a7-abd7-aae585c8bfba req-32b43929-73d2-436a-a501-90e09d86c025 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:25.889802 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c6b3bd2e-7e76-44a7-abd7-aae585c8bfba req-32b43929-73d2-436a-a501-90e09d86c025 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:25.890259 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c6b3bd2e-7e76-44a7-abd7-aae585c8bfba req-32b43929-73d2-436a-a501-90e09d86c025 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:25.896086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4756cb9-1294-488f-9417-beded75232c0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:25.896647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4756cb9-1294-488f-9417-beded75232c0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:25.897035 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4756cb9-1294-488f-9417-beded75232c0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:25.897812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4756cb9-1294-488f-9417-beded75232c0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:25.898420 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4756cb9-1294-488f-9417-beded75232c0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:25.898934 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a4756cb9-1294-488f-9417-beded75232c0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:25.903251 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-c6b3bd2e-7e76-44a7-abd7-aae585c8bfba req-32b43929-73d2-436a-a501-90e09d86c025 service nova] Creating event network-vif-plugged:f32c867c-b0c7-42f0-b58e-d5987e695b36 for instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc on nch1-master-1 Sep 17 21:40:25.908377 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-c6b3bd2e-7e76-44a7-abd7-aae585c8bfba req-32b43929-73d2-436a-a501-90e09d86c025 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033319 Sep 17 21:40:25.909213 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3318/6544] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:40:26.035179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a4756cb9-1294-488f-9417-beded75232c0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:40:26.043218 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a4756cb9-1294-488f-9417-beded75232c0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1364 microversion: 2.1 time: 0.160335 Sep 17 21:40:26.044162 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3227/6545] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:40:25 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:40:27.070158 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f8256e00-3666-49ec-a97f-a1edb56029d1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:40:27.071578 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f8256e00-3666-49ec-a97f-a1edb56029d1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:40:27.079267 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8256e00-3666-49ec-a97f-a1edb56029d1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:27.079771 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8256e00-3666-49ec-a97f-a1edb56029d1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:27.080247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8256e00-3666-49ec-a97f-a1edb56029d1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:27.080943 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8256e00-3666-49ec-a97f-a1edb56029d1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:27.081876 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8256e00-3666-49ec-a97f-a1edb56029d1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:27.081876 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f8256e00-3666-49ec-a97f-a1edb56029d1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:27.232855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f8256e00-3666-49ec-a97f-a1edb56029d1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:40:27.240845 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f8256e00-3666-49ec-a97f-a1edb56029d1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1364 microversion: 2.1 time: 0.176463 Sep 17 21:40:27.241432 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3319/6546] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:40:27 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:40:28.268911 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-870dc737-e5e3-4889-802c-bb743a68bdb1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:40:28.270319 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-870dc737-e5e3-4889-802c-bb743a68bdb1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:40:28.278500 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-870dc737-e5e3-4889-802c-bb743a68bdb1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:28.278993 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-870dc737-e5e3-4889-802c-bb743a68bdb1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:28.279436 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-870dc737-e5e3-4889-802c-bb743a68bdb1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:28.280176 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-870dc737-e5e3-4889-802c-bb743a68bdb1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:28.280633 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-870dc737-e5e3-4889-802c-bb743a68bdb1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:28.281060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-870dc737-e5e3-4889-802c-bb743a68bdb1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:28.415079 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-870dc737-e5e3-4889-802c-bb743a68bdb1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:40:28.423231 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-870dc737-e5e3-4889-802c-bb743a68bdb1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1552 microversion: 2.1 time: 0.161274 Sep 17 21:40:28.423780 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3228/6547] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:40:28 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1552 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:40:28.447836 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-87752353-83cc-4664-a373-52ad420b280d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:40:28.448351 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-87752353-83cc-4664-a373-52ad420b280d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:40:28.455465 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87752353-83cc-4664-a373-52ad420b280d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:28.455982 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87752353-83cc-4664-a373-52ad420b280d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:28.456439 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87752353-83cc-4664-a373-52ad420b280d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:28.457155 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87752353-83cc-4664-a373-52ad420b280d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:28.457707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87752353-83cc-4664-a373-52ad420b280d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:28.458175 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87752353-83cc-4664-a373-52ad420b280d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:28.535235 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-87752353-83cc-4664-a373-52ad420b280d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091420 Sep 17 21:40:28.535819 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3320/6548] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Sep 17 21:40:28 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:40:29.843698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-1e6e5424-43a6-4bff-a737-afd6d6c6ec4c req-69f75052-2a8e-45a4-9311-768c0e938c12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acf1e47d-7fca-4cca-a3bc-66445ac0f1cc", "tag": "f32c867c-b0c7-42f0-b58e-d5987e695b36"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:40:29.848606 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:40:29.855718 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-1e6e5424-43a6-4bff-a737-afd6d6c6ec4c req-69f75052-2a8e-45a4-9311-768c0e938c12 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:40:29.856210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-1e6e5424-43a6-4bff-a737-afd6d6c6ec4c req-69f75052-2a8e-45a4-9311-768c0e938c12 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:40:29.856651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-1e6e5424-43a6-4bff-a737-afd6d6c6ec4c req-69f75052-2a8e-45a4-9311-768c0e938c12 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:40:29.868798 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-1e6e5424-43a6-4bff-a737-afd6d6c6ec4c req-69f75052-2a8e-45a4-9311-768c0e938c12 service nova] Creating event network-changed:f32c867c-b0c7-42f0-b58e-d5987e695b36 for instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc on nch1-master-1 Sep 17 21:40:29.874135 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-1e6e5424-43a6-4bff-a737-afd6d6c6ec4c req-69f75052-2a8e-45a4-9311-768c0e938c12 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034562 Sep 17 21:40:29.875077 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3229/6549] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:41:04.480416 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:41:04.481558 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=6 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:41:04.483400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:41:04.484040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:41:04.488669 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b676c22c-8722-405f-8e51-4c8f8d49fe6d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:04.489287 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b676c22c-8722-405f-8e51-4c8f8d49fe6d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:04.498854 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b676c22c-8722-405f-8e51-4c8f8d49fe6d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:04.499352 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b676c22c-8722-405f-8e51-4c8f8d49fe6d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:04.499846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b676c22c-8722-405f-8e51-4c8f8d49fe6d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:04.500517 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b676c22c-8722-405f-8e51-4c8f8d49fe6d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:04.500982 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b676c22c-8722-405f-8e51-4c8f8d49fe6d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:04.501420 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b676c22c-8722-405f-8e51-4c8f8d49fe6d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:04.635088 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b676c22c-8722-405f-8e51-4c8f8d49fe6d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:04.647213 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b676c22c-8722-405f-8e51-4c8f8d49fe6d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1670 microversion: 2.1 time: 0.167379 Sep 17 21:41:04.648221 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3321/6550] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:04 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1670 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:04.671335 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b517934e-fb96-4a9d-b4d7-f500e51a8487 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b39e8a5-9ba7-4ac0-bf9f-2a0c1bcbad0b"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:41:04.673967 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b517934e-fb96-4a9d-b4d7-f500e51a8487 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:04.676479 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=29 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:41:04.677186 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=65 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:41:04.684910 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b517934e-fb96-4a9d-b4d7-f500e51a8487 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:04.685389 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b517934e-fb96-4a9d-b4d7-f500e51a8487 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:04.685881 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b517934e-fb96-4a9d-b4d7-f500e51a8487 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:04.686599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b517934e-fb96-4a9d-b4d7-f500e51a8487 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:04.687052 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b517934e-fb96-4a9d-b4d7-f500e51a8487 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:04.687475 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b517934e-fb96-4a9d-b4d7-f500e51a8487 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:04.939418 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b517934e-fb96-4a9d-b4d7-f500e51a8487 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "POST /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272402 Sep 17 21:41:04.940226 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3230/6551] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 17 21:41:04 2022] POST /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:41:08.269416 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-036f32d1-c1ed-4f73-940f-ffbd2522746f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:41:08.271756 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-036f32d1-c1ed-4f73-940f-ffbd2522746f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:08.280273 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-036f32d1-c1ed-4f73-940f-ffbd2522746f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:08.280783 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-036f32d1-c1ed-4f73-940f-ffbd2522746f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:08.281231 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-036f32d1-c1ed-4f73-940f-ffbd2522746f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:08.281977 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-036f32d1-c1ed-4f73-940f-ffbd2522746f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:08.282450 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-036f32d1-c1ed-4f73-940f-ffbd2522746f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:08.282885 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-036f32d1-c1ed-4f73-940f-ffbd2522746f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:08.311146 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-036f32d1-c1ed-4f73-940f-ffbd2522746f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:08.316769 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-036f32d1-c1ed-4f73-940f-ffbd2522746f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Old instance type m1.heat2, new instance type m1.heat {{(pid=140524) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 17 21:41:08.324082 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-036f32d1-c1ed-4f73-940f-ffbd2522746f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:41:08.324570 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-036f32d1-c1ed-4f73-940f-ffbd2522746f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:41:08.325059 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-036f32d1-c1ed-4f73-940f-ffbd2522746f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:41:08.325504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-036f32d1-c1ed-4f73-940f-ffbd2522746f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:41:08.325948 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-036f32d1-c1ed-4f73-940f-ffbd2522746f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:41:08.401417 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-036f32d1-c1ed-4f73-940f-ffbd2522746f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "POST /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc/action" status: 202 len: 0 microversion: 2.1 time: 0.135934 Sep 17 21:41:08.405441 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3322/6552] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:41:08 2022] POST /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:41:08.412821 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-53d3c4f7-703b-4938-88b6-f0e3a9f05412 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:08.414019 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-53d3c4f7-703b-4938-88b6-f0e3a9f05412 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:08.420635 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53d3c4f7-703b-4938-88b6-f0e3a9f05412 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:08.421111 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53d3c4f7-703b-4938-88b6-f0e3a9f05412 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:08.421596 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53d3c4f7-703b-4938-88b6-f0e3a9f05412 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:08.422302 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53d3c4f7-703b-4938-88b6-f0e3a9f05412 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:08.422764 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53d3c4f7-703b-4938-88b6-f0e3a9f05412 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:08.423234 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53d3c4f7-703b-4938-88b6-f0e3a9f05412 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:08.676202 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-53d3c4f7-703b-4938-88b6-f0e3a9f05412 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:08.686477 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-53d3c4f7-703b-4938-88b6-f0e3a9f05412 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1725 microversion: 2.1 time: 0.279569 Sep 17 21:41:08.687463 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3231/6553] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:08 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1725 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:09.712745 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-87b61588-23be-421e-a8f8-4d3d15bcc89b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:09.713355 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-87b61588-23be-421e-a8f8-4d3d15bcc89b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:09.719941 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87b61588-23be-421e-a8f8-4d3d15bcc89b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:09.720479 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87b61588-23be-421e-a8f8-4d3d15bcc89b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:09.720934 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87b61588-23be-421e-a8f8-4d3d15bcc89b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:09.721683 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87b61588-23be-421e-a8f8-4d3d15bcc89b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:09.722154 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87b61588-23be-421e-a8f8-4d3d15bcc89b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:09.722597 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-87b61588-23be-421e-a8f8-4d3d15bcc89b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:09.910855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-87b61588-23be-421e-a8f8-4d3d15bcc89b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:09.921120 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-87b61588-23be-421e-a8f8-4d3d15bcc89b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1725 microversion: 2.1 time: 0.213175 Sep 17 21:41:09.927192 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3323/6554] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:09 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:10.944989 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7ee0c4d1-1811-4cf7-8592-2545795f3904 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:10.945653 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7ee0c4d1-1811-4cf7-8592-2545795f3904 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:10.953167 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ee0c4d1-1811-4cf7-8592-2545795f3904 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:10.953690 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ee0c4d1-1811-4cf7-8592-2545795f3904 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:10.954133 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ee0c4d1-1811-4cf7-8592-2545795f3904 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:10.954838 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ee0c4d1-1811-4cf7-8592-2545795f3904 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:10.955315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ee0c4d1-1811-4cf7-8592-2545795f3904 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:10.955752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ee0c4d1-1811-4cf7-8592-2545795f3904 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:11.101442 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7ee0c4d1-1811-4cf7-8592-2545795f3904 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:11.114255 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7ee0c4d1-1811-4cf7-8592-2545795f3904 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1730 microversion: 2.1 time: 0.173168 Sep 17 21:41:11.115086 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3232/6555] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:10 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:12.140941 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0f17417a-1da1-4739-acb4-c83fb9333a36 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:12.141614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0f17417a-1da1-4739-acb4-c83fb9333a36 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:12.148984 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f17417a-1da1-4739-acb4-c83fb9333a36 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:12.149550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f17417a-1da1-4739-acb4-c83fb9333a36 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:12.150039 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f17417a-1da1-4739-acb4-c83fb9333a36 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:12.150786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f17417a-1da1-4739-acb4-c83fb9333a36 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:12.151282 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f17417a-1da1-4739-acb4-c83fb9333a36 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:12.151748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f17417a-1da1-4739-acb4-c83fb9333a36 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:12.286954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0f17417a-1da1-4739-acb4-c83fb9333a36 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:12.295500 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0f17417a-1da1-4739-acb4-c83fb9333a36 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1730 microversion: 2.1 time: 0.159275 Sep 17 21:41:12.296084 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3324/6556] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:12 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:13.319190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-50614c83-6262-46f3-a2c9-063e140b3a06 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:13.319790 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-50614c83-6262-46f3-a2c9-063e140b3a06 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:13.327224 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-50614c83-6262-46f3-a2c9-063e140b3a06 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:13.327772 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-50614c83-6262-46f3-a2c9-063e140b3a06 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:13.328245 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-50614c83-6262-46f3-a2c9-063e140b3a06 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:13.328980 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-50614c83-6262-46f3-a2c9-063e140b3a06 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:13.329449 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-50614c83-6262-46f3-a2c9-063e140b3a06 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:13.329925 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-50614c83-6262-46f3-a2c9-063e140b3a06 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:13.471867 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-50614c83-6262-46f3-a2c9-063e140b3a06 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:13.480450 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-50614c83-6262-46f3-a2c9-063e140b3a06 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1730 microversion: 2.1 time: 0.165280 Sep 17 21:41:13.481028 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3233/6557] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:13 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:14.509067 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a05a1303-6880-460a-a3fe-8d94481d1fb3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:14.510154 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a05a1303-6880-460a-a3fe-8d94481d1fb3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:14.518407 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a05a1303-6880-460a-a3fe-8d94481d1fb3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:14.518908 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a05a1303-6880-460a-a3fe-8d94481d1fb3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:14.519369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a05a1303-6880-460a-a3fe-8d94481d1fb3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:14.520102 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a05a1303-6880-460a-a3fe-8d94481d1fb3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:14.520577 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a05a1303-6880-460a-a3fe-8d94481d1fb3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:14.521058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a05a1303-6880-460a-a3fe-8d94481d1fb3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:14.659665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a05a1303-6880-460a-a3fe-8d94481d1fb3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:14.668534 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a05a1303-6880-460a-a3fe-8d94481d1fb3 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1730 microversion: 2.1 time: 0.166161 Sep 17 21:41:14.669105 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3325/6558] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:14 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:15.693686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7d7a1f77-3405-4693-ade7-3273750d6285 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:15.694092 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7d7a1f77-3405-4693-ade7-3273750d6285 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:15.701325 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7d7a1f77-3405-4693-ade7-3273750d6285 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:15.701893 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7d7a1f77-3405-4693-ade7-3273750d6285 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:15.702363 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7d7a1f77-3405-4693-ade7-3273750d6285 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:15.703123 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7d7a1f77-3405-4693-ade7-3273750d6285 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:15.703647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7d7a1f77-3405-4693-ade7-3273750d6285 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:15.704090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7d7a1f77-3405-4693-ade7-3273750d6285 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:15.835172 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7d7a1f77-3405-4693-ade7-3273750d6285 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:15.844456 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7d7a1f77-3405-4693-ade7-3273750d6285 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1730 microversion: 2.1 time: 0.155665 Sep 17 21:41:15.852055 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3234/6559] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:15 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:16.872412 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-aac5293f-5b60-4b7d-bce1-988a42fe0be9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:16.873417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-aac5293f-5b60-4b7d-bce1-988a42fe0be9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:16.885193 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aac5293f-5b60-4b7d-bce1-988a42fe0be9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:16.886086 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aac5293f-5b60-4b7d-bce1-988a42fe0be9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:16.887021 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aac5293f-5b60-4b7d-bce1-988a42fe0be9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:16.887757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aac5293f-5b60-4b7d-bce1-988a42fe0be9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:16.888232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aac5293f-5b60-4b7d-bce1-988a42fe0be9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:16.888679 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aac5293f-5b60-4b7d-bce1-988a42fe0be9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:17.022946 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-aac5293f-5b60-4b7d-bce1-988a42fe0be9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:17.031761 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-aac5293f-5b60-4b7d-bce1-988a42fe0be9 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1730 microversion: 2.1 time: 0.166056 Sep 17 21:41:17.032348 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3326/6560] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:16 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:18.059765 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c17f970d-6032-4751-9027-0c9b98a093eb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:18.060472 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c17f970d-6032-4751-9027-0c9b98a093eb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:18.068965 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c17f970d-6032-4751-9027-0c9b98a093eb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:18.069590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c17f970d-6032-4751-9027-0c9b98a093eb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:18.070116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c17f970d-6032-4751-9027-0c9b98a093eb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:18.070957 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c17f970d-6032-4751-9027-0c9b98a093eb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:18.071505 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c17f970d-6032-4751-9027-0c9b98a093eb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:18.072022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c17f970d-6032-4751-9027-0c9b98a093eb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:18.214630 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c17f970d-6032-4751-9027-0c9b98a093eb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:18.223786 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c17f970d-6032-4751-9027-0c9b98a093eb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1730 microversion: 2.1 time: 0.170637 Sep 17 21:41:18.224376 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3235/6561] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:18 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:19.247845 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8cbaa15f-1faa-4c3b-aaa0-f34ed55dea4b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:19.248410 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8cbaa15f-1faa-4c3b-aaa0-f34ed55dea4b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:19.256011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8cbaa15f-1faa-4c3b-aaa0-f34ed55dea4b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:19.256519 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8cbaa15f-1faa-4c3b-aaa0-f34ed55dea4b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:19.256972 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8cbaa15f-1faa-4c3b-aaa0-f34ed55dea4b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:19.257736 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8cbaa15f-1faa-4c3b-aaa0-f34ed55dea4b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:19.258211 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8cbaa15f-1faa-4c3b-aaa0-f34ed55dea4b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:19.258654 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8cbaa15f-1faa-4c3b-aaa0-f34ed55dea4b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:19.408846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8cbaa15f-1faa-4c3b-aaa0-f34ed55dea4b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:19.417812 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8cbaa15f-1faa-4c3b-aaa0-f34ed55dea4b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1730 microversion: 2.1 time: 0.174034 Sep 17 21:41:19.418393 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3327/6562] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:19 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:20.448293 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-947536e6-bb17-4243-a545-77b69755c712 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:20.449532 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-947536e6-bb17-4243-a545-77b69755c712 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:20.458668 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-947536e6-bb17-4243-a545-77b69755c712 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:20.459170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-947536e6-bb17-4243-a545-77b69755c712 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:20.459751 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-947536e6-bb17-4243-a545-77b69755c712 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:20.460487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-947536e6-bb17-4243-a545-77b69755c712 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:20.460954 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-947536e6-bb17-4243-a545-77b69755c712 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:20.461395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-947536e6-bb17-4243-a545-77b69755c712 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:20.594877 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-947536e6-bb17-4243-a545-77b69755c712 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:20.607523 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-947536e6-bb17-4243-a545-77b69755c712 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1730 microversion: 2.1 time: 0.165759 Sep 17 21:41:20.608358 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3236/6563] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:20 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:21.636185 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a7d8a509-5754-47b7-b7f6-f59d65de1d7b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:21.637615 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a7d8a509-5754-47b7-b7f6-f59d65de1d7b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:21.649780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7d8a509-5754-47b7-b7f6-f59d65de1d7b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:21.650882 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7d8a509-5754-47b7-b7f6-f59d65de1d7b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:21.651730 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7d8a509-5754-47b7-b7f6-f59d65de1d7b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:21.652877 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7d8a509-5754-47b7-b7f6-f59d65de1d7b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:21.653738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7d8a509-5754-47b7-b7f6-f59d65de1d7b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:21.654605 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a7d8a509-5754-47b7-b7f6-f59d65de1d7b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:21.793201 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a7d8a509-5754-47b7-b7f6-f59d65de1d7b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:21.801758 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a7d8a509-5754-47b7-b7f6-f59d65de1d7b tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1730 microversion: 2.1 time: 0.172259 Sep 17 21:41:21.802336 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3328/6564] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:21 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:22.835825 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-382c4c64-faa3-41a1-8751-9895fb39d9a1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:22.836465 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-382c4c64-faa3-41a1-8751-9895fb39d9a1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:22.845105 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-382c4c64-faa3-41a1-8751-9895fb39d9a1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:22.845638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-382c4c64-faa3-41a1-8751-9895fb39d9a1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:22.846095 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-382c4c64-faa3-41a1-8751-9895fb39d9a1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:22.846818 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-382c4c64-faa3-41a1-8751-9895fb39d9a1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:22.847289 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-382c4c64-faa3-41a1-8751-9895fb39d9a1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:22.847728 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-382c4c64-faa3-41a1-8751-9895fb39d9a1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:22.987512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-382c4c64-faa3-41a1-8751-9895fb39d9a1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:22.997129 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-382c4c64-faa3-41a1-8751-9895fb39d9a1 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1730 microversion: 2.1 time: 0.165227 Sep 17 21:41:22.998005 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3237/6565] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:22 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:23.457559 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-05e85426-a4a7-4d7b-a190-cfe621627562 req-9202f9a1-37a8-45a9-8da6-d5a698b046ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acf1e47d-7fca-4cca-a3bc-66445ac0f1cc", "name": "network-vif-unplugged", "status": "completed", "tag": "f32c867c-b0c7-42f0-b58e-d5987e695b36"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:41:23.468844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-05e85426-a4a7-4d7b-a190-cfe621627562 req-9202f9a1-37a8-45a9-8da6-d5a698b046ab service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:23.469340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-05e85426-a4a7-4d7b-a190-cfe621627562 req-9202f9a1-37a8-45a9-8da6-d5a698b046ab service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:23.469812 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-05e85426-a4a7-4d7b-a190-cfe621627562 req-9202f9a1-37a8-45a9-8da6-d5a698b046ab service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:23.481822 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-05e85426-a4a7-4d7b-a190-cfe621627562 req-9202f9a1-37a8-45a9-8da6-d5a698b046ab service nova] Creating event network-vif-unplugged:f32c867c-b0c7-42f0-b58e-d5987e695b36 for instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc on nch2-master-1 Sep 17 21:41:23.487543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [req-05e85426-a4a7-4d7b-a190-cfe621627562 req-9202f9a1-37a8-45a9-8da6-d5a698b046ab service nova] Instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140524) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 21:41:23.499550 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-05e85426-a4a7-4d7b-a190-cfe621627562 req-9202f9a1-37a8-45a9-8da6-d5a698b046ab service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045686 Sep 17 21:41:23.500177 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3329/6566] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:41:24.021345 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0a49155b-d71b-416c-9ca5-2da039458899 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:24.022015 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0a49155b-d71b-416c-9ca5-2da039458899 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:24.029199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0a49155b-d71b-416c-9ca5-2da039458899 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:24.029795 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0a49155b-d71b-416c-9ca5-2da039458899 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:24.030246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0a49155b-d71b-416c-9ca5-2da039458899 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:24.030974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0a49155b-d71b-416c-9ca5-2da039458899 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:24.031433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0a49155b-d71b-416c-9ca5-2da039458899 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:24.031863 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0a49155b-d71b-416c-9ca5-2da039458899 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:24.222959 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0a49155b-d71b-416c-9ca5-2da039458899 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:24.231866 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0a49155b-d71b-416c-9ca5-2da039458899 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1729 microversion: 2.1 time: 0.214492 Sep 17 21:41:24.232459 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3238/6567] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:24 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1729 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:25.258158 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a3c49ba9-3d74-4b2a-9120-64ef25ef6620 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:25.259115 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a3c49ba9-3d74-4b2a-9120-64ef25ef6620 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:25.265673 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a3c49ba9-3d74-4b2a-9120-64ef25ef6620 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:25.266262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a3c49ba9-3d74-4b2a-9120-64ef25ef6620 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:25.266796 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a3c49ba9-3d74-4b2a-9120-64ef25ef6620 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:25.267611 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a3c49ba9-3d74-4b2a-9120-64ef25ef6620 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:25.268165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a3c49ba9-3d74-4b2a-9120-64ef25ef6620 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:25.268689 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a3c49ba9-3d74-4b2a-9120-64ef25ef6620 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:25.402335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a3c49ba9-3d74-4b2a-9120-64ef25ef6620 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:25.411005 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a3c49ba9-3d74-4b2a-9120-64ef25ef6620 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1727 microversion: 2.1 time: 0.158462 Sep 17 21:41:25.411572 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3330/6568] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:25 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:25.542478 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-43dd8cde-86ef-4db6-b6c3-208bbeef3839 req-eac51d13-6c9f-4922-9766-39d66ab4d3a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acf1e47d-7fca-4cca-a3bc-66445ac0f1cc", "tag": "f32c867c-b0c7-42f0-b58e-d5987e695b36"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:41:25.553783 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-43dd8cde-86ef-4db6-b6c3-208bbeef3839 req-eac51d13-6c9f-4922-9766-39d66ab4d3a7 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:25.554265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-43dd8cde-86ef-4db6-b6c3-208bbeef3839 req-eac51d13-6c9f-4922-9766-39d66ab4d3a7 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:25.554703 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-43dd8cde-86ef-4db6-b6c3-208bbeef3839 req-eac51d13-6c9f-4922-9766-39d66ab4d3a7 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:25.567263 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-43dd8cde-86ef-4db6-b6c3-208bbeef3839 req-eac51d13-6c9f-4922-9766-39d66ab4d3a7 service nova] Creating event network-changed:f32c867c-b0c7-42f0-b58e-d5987e695b36 for instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc on nch2-master-1 Sep 17 21:41:25.572713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [req-43dd8cde-86ef-4db6-b6c3-208bbeef3839 req-eac51d13-6c9f-4922-9766-39d66ab4d3a7 service nova] Instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140523) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 21:41:25.583527 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-43dd8cde-86ef-4db6-b6c3-208bbeef3839 req-eac51d13-6c9f-4922-9766-39d66ab4d3a7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044837 Sep 17 21:41:25.584243 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3239/6569] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:41:26.435924 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-be4778c2-e28c-43fe-b4a2-49e809d008ce tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:26.436558 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-be4778c2-e28c-43fe-b4a2-49e809d008ce tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:26.443828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be4778c2-e28c-43fe-b4a2-49e809d008ce tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:26.444329 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be4778c2-e28c-43fe-b4a2-49e809d008ce tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:26.444959 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be4778c2-e28c-43fe-b4a2-49e809d008ce tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:26.446221 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be4778c2-e28c-43fe-b4a2-49e809d008ce tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:26.446974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be4778c2-e28c-43fe-b4a2-49e809d008ce tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:26.447429 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be4778c2-e28c-43fe-b4a2-49e809d008ce tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:26.663374 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-be4778c2-e28c-43fe-b4a2-49e809d008ce tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:26.680352 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-be4778c2-e28c-43fe-b4a2-49e809d008ce tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1727 microversion: 2.1 time: 0.248368 Sep 17 21:41:26.681080 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3331/6570] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:26 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1727 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:27.706278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-41eae42e-6feb-4d78-b16f-98e0121a323d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:27.707003 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-41eae42e-6feb-4d78-b16f-98e0121a323d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:27.713745 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-41eae42e-6feb-4d78-b16f-98e0121a323d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:27.714248 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-41eae42e-6feb-4d78-b16f-98e0121a323d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:27.714702 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-41eae42e-6feb-4d78-b16f-98e0121a323d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:27.715418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-41eae42e-6feb-4d78-b16f-98e0121a323d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:27.715887 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-41eae42e-6feb-4d78-b16f-98e0121a323d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:27.716701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-41eae42e-6feb-4d78-b16f-98e0121a323d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:27.853310 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-41eae42e-6feb-4d78-b16f-98e0121a323d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:27.862076 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-41eae42e-6feb-4d78-b16f-98e0121a323d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1727 microversion: 2.1 time: 0.161313 Sep 17 21:41:27.862623 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3240/6571] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:27 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:28.886355 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ed3d2836-f7d6-4afb-aa3c-98e45bf4ef52 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:28.887716 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ed3d2836-f7d6-4afb-aa3c-98e45bf4ef52 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:28.894651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed3d2836-f7d6-4afb-aa3c-98e45bf4ef52 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:28.895200 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed3d2836-f7d6-4afb-aa3c-98e45bf4ef52 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:28.895724 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed3d2836-f7d6-4afb-aa3c-98e45bf4ef52 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:28.896532 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed3d2836-f7d6-4afb-aa3c-98e45bf4ef52 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:28.897056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed3d2836-f7d6-4afb-aa3c-98e45bf4ef52 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:28.897554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed3d2836-f7d6-4afb-aa3c-98e45bf4ef52 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:29.032991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ed3d2836-f7d6-4afb-aa3c-98e45bf4ef52 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:29.041631 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ed3d2836-f7d6-4afb-aa3c-98e45bf4ef52 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1727 microversion: 2.1 time: 0.159583 Sep 17 21:41:29.042251 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3332/6572] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:28 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:30.066377 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-53debe09-4453-424f-ad19-7b90ee6c812c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:30.067009 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-53debe09-4453-424f-ad19-7b90ee6c812c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:30.074422 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53debe09-4453-424f-ad19-7b90ee6c812c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:30.074895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53debe09-4453-424f-ad19-7b90ee6c812c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:30.075377 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53debe09-4453-424f-ad19-7b90ee6c812c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:30.076121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53debe09-4453-424f-ad19-7b90ee6c812c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:30.076610 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53debe09-4453-424f-ad19-7b90ee6c812c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:30.077074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53debe09-4453-424f-ad19-7b90ee6c812c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:30.221313 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-53debe09-4453-424f-ad19-7b90ee6c812c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:30.231064 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-53debe09-4453-424f-ad19-7b90ee6c812c tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1724 microversion: 2.1 time: 0.168784 Sep 17 21:41:30.231648 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3241/6573] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:30 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:30.254804 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7e293e16-c440-453a-a851-dd561ed8ca58 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:41:30.255391 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7e293e16-c440-453a-a851-dd561ed8ca58 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:30.262879 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e293e16-c440-453a-a851-dd561ed8ca58 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:30.263230 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e293e16-c440-453a-a851-dd561ed8ca58 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:30.263694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e293e16-c440-453a-a851-dd561ed8ca58 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:30.264478 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e293e16-c440-453a-a851-dd561ed8ca58 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:30.265086 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e293e16-c440-453a-a851-dd561ed8ca58 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:30.265885 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e293e16-c440-453a-a851-dd561ed8ca58 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:30.303788 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e293e16-c440-453a-a851-dd561ed8ca58 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:30.304297 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e293e16-c440-453a-a851-dd561ed8ca58 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:30.304757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e293e16-c440-453a-a851-dd561ed8ca58 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:30.305533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e293e16-c440-453a-a851-dd561ed8ca58 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:30.306054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e293e16-c440-453a-a851-dd561ed8ca58 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:30.306546 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7e293e16-c440-453a-a851-dd561ed8ca58 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:30.326911 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-7e293e16-c440-453a-a851-dd561ed8ca58 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Getting quotas for project ad243abc13a14aa08c717d4105e24f4f. Resources: {'cores', 'ram'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:41:30.332373 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-7e293e16-c440-453a-a851-dd561ed8ca58 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Getting quotas for user d20f8598dfec4de7b496a64e023e7a15 and project ad243abc13a14aa08c717d4105e24f4f. Resources: {'cores', 'ram'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:41:30.416931 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:41:30.441497 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7e293e16-c440-453a-a851-dd561ed8ca58 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "POST /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc/action" status: 202 len: 0 microversion: 2.1 time: 0.190532 Sep 17 21:41:30.442275 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3333/6574] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:41:30 2022] POST /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:41:30.451217 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8995d0ea-751f-4e5a-9f46-2d5082068902 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:30.451851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8995d0ea-751f-4e5a-9f46-2d5082068902 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:30.458279 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8995d0ea-751f-4e5a-9f46-2d5082068902 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:30.459026 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8995d0ea-751f-4e5a-9f46-2d5082068902 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:30.459508 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8995d0ea-751f-4e5a-9f46-2d5082068902 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:30.460398 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8995d0ea-751f-4e5a-9f46-2d5082068902 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:30.460977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8995d0ea-751f-4e5a-9f46-2d5082068902 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:30.461373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8995d0ea-751f-4e5a-9f46-2d5082068902 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:30.655735 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8995d0ea-751f-4e5a-9f46-2d5082068902 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:30.664560 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8995d0ea-751f-4e5a-9f46-2d5082068902 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1723 microversion: 2.1 time: 0.218025 Sep 17 21:41:30.665243 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3242/6575] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:30 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:31.691056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2a0ad851-c401-412e-8986-3a45c623d8ff tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:31.691760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2a0ad851-c401-412e-8986-3a45c623d8ff tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:31.702278 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a0ad851-c401-412e-8986-3a45c623d8ff tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:31.702964 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a0ad851-c401-412e-8986-3a45c623d8ff tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:31.703555 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a0ad851-c401-412e-8986-3a45c623d8ff tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:31.704371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a0ad851-c401-412e-8986-3a45c623d8ff tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:31.704837 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a0ad851-c401-412e-8986-3a45c623d8ff tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:31.705274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a0ad851-c401-412e-8986-3a45c623d8ff tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:31.856163 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2a0ad851-c401-412e-8986-3a45c623d8ff tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:31.864930 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2a0ad851-c401-412e-8986-3a45c623d8ff tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1723 microversion: 2.1 time: 0.179231 Sep 17 21:41:31.865706 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3334/6576] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:31 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:32.017221 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-3f98b030-154a-418d-8d7a-69d7c49b7236 req-48ded6d2-68bd-40d8-b776-f2e5f0ae9044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acf1e47d-7fca-4cca-a3bc-66445ac0f1cc", "name": "network-vif-plugged", "status": "completed", "tag": "f32c867c-b0c7-42f0-b58e-d5987e695b36"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:41:32.030993 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-3f98b030-154a-418d-8d7a-69d7c49b7236 req-48ded6d2-68bd-40d8-b776-f2e5f0ae9044 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:32.031627 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-3f98b030-154a-418d-8d7a-69d7c49b7236 req-48ded6d2-68bd-40d8-b776-f2e5f0ae9044 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:32.032347 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-3f98b030-154a-418d-8d7a-69d7c49b7236 req-48ded6d2-68bd-40d8-b776-f2e5f0ae9044 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:32.045329 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-3f98b030-154a-418d-8d7a-69d7c49b7236 req-48ded6d2-68bd-40d8-b776-f2e5f0ae9044 service nova] Creating event network-vif-plugged:f32c867c-b0c7-42f0-b58e-d5987e695b36 for instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc on nch2-master-1 Sep 17 21:41:32.051039 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [req-3f98b030-154a-418d-8d7a-69d7c49b7236 req-48ded6d2-68bd-40d8-b776-f2e5f0ae9044 service nova] Instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140523) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 21:41:32.062210 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-3f98b030-154a-418d-8d7a-69d7c49b7236 req-48ded6d2-68bd-40d8-b776-f2e5f0ae9044 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049581 Sep 17 21:41:32.062805 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3243/6577] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:41:32.889390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ded06469-d096-45d6-8099-7bd13a9095ba tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:32.890081 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ded06469-d096-45d6-8099-7bd13a9095ba tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:32.900537 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ded06469-d096-45d6-8099-7bd13a9095ba tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:32.901336 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ded06469-d096-45d6-8099-7bd13a9095ba tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:32.902219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ded06469-d096-45d6-8099-7bd13a9095ba tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:32.903259 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ded06469-d096-45d6-8099-7bd13a9095ba tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:32.904002 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ded06469-d096-45d6-8099-7bd13a9095ba tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:32.904746 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ded06469-d096-45d6-8099-7bd13a9095ba tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:33.046155 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ded06469-d096-45d6-8099-7bd13a9095ba tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:33.054782 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ded06469-d096-45d6-8099-7bd13a9095ba tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1723 microversion: 2.1 time: 0.169815 Sep 17 21:41:33.055367 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3335/6578] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:32 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:34.080204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-25c20660-7e82-4425-88ae-553d4c5dd120 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:34.096756 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-25c20660-7e82-4425-88ae-553d4c5dd120 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:34.096756 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25c20660-7e82-4425-88ae-553d4c5dd120 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:34.096756 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25c20660-7e82-4425-88ae-553d4c5dd120 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:34.096756 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25c20660-7e82-4425-88ae-553d4c5dd120 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:34.097354 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25c20660-7e82-4425-88ae-553d4c5dd120 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:34.098317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25c20660-7e82-4425-88ae-553d4c5dd120 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:34.098763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25c20660-7e82-4425-88ae-553d4c5dd120 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:34.178803 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-349f8781-120a-4f8e-9e5a-7d1d91699dc9 req-6d877183-f1d4-4f3f-bf79-29bfeb72b9a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acf1e47d-7fca-4cca-a3bc-66445ac0f1cc", "name": "network-vif-unplugged", "status": "completed", "tag": "f32c867c-b0c7-42f0-b58e-d5987e695b36"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:41:34.189530 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-349f8781-120a-4f8e-9e5a-7d1d91699dc9 req-6d877183-f1d4-4f3f-bf79-29bfeb72b9a7 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:34.190156 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-349f8781-120a-4f8e-9e5a-7d1d91699dc9 req-6d877183-f1d4-4f3f-bf79-29bfeb72b9a7 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:34.190609 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-349f8781-120a-4f8e-9e5a-7d1d91699dc9 req-6d877183-f1d4-4f3f-bf79-29bfeb72b9a7 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:34.203089 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-349f8781-120a-4f8e-9e5a-7d1d91699dc9 req-6d877183-f1d4-4f3f-bf79-29bfeb72b9a7 service nova] Creating event network-vif-unplugged:f32c867c-b0c7-42f0-b58e-d5987e695b36 for instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc on nch1-master-1 Sep 17 21:41:34.209833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [req-349f8781-120a-4f8e-9e5a-7d1d91699dc9 req-6d877183-f1d4-4f3f-bf79-29bfeb72b9a7 service nova] Instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140524) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 21:41:34.223103 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-349f8781-120a-4f8e-9e5a-7d1d91699dc9 req-6d877183-f1d4-4f3f-bf79-29bfeb72b9a7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047920 Sep 17 21:41:34.224327 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3336/6579] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:41:34.248283 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-25c20660-7e82-4425-88ae-553d4c5dd120 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:34.257192 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-25c20660-7e82-4425-88ae-553d4c5dd120 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1723 microversion: 2.1 time: 0.182638 Sep 17 21:41:34.257816 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3244/6580] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:34 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:35.340357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-356fdc15-c7a5-442b-b0d9-0eb85f92c850 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:35.341411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-356fdc15-c7a5-442b-b0d9-0eb85f92c850 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:35.343783 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:41:35.349766 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-356fdc15-c7a5-442b-b0d9-0eb85f92c850 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:35.350411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-356fdc15-c7a5-442b-b0d9-0eb85f92c850 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:35.350961 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-356fdc15-c7a5-442b-b0d9-0eb85f92c850 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:35.351752 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-356fdc15-c7a5-442b-b0d9-0eb85f92c850 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:35.352289 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-356fdc15-c7a5-442b-b0d9-0eb85f92c850 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:35.352844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-356fdc15-c7a5-442b-b0d9-0eb85f92c850 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:35.490507 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-356fdc15-c7a5-442b-b0d9-0eb85f92c850 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:35.499303 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-356fdc15-c7a5-442b-b0d9-0eb85f92c850 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1723 microversion: 2.1 time: 0.221985 Sep 17 21:41:35.499936 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3337/6581] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:35 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:36.245293 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-b3396932-9966-4b3b-a672-269b0a1cb9ff req-5ae1b334-d74e-4c9d-9f20-4c671900fdf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acf1e47d-7fca-4cca-a3bc-66445ac0f1cc", "tag": "f32c867c-b0c7-42f0-b58e-d5987e695b36"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:41:36.251904 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=31 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:41:36.257863 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b3396932-9966-4b3b-a672-269b0a1cb9ff req-5ae1b334-d74e-4c9d-9f20-4c671900fdf3 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:36.258357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b3396932-9966-4b3b-a672-269b0a1cb9ff req-5ae1b334-d74e-4c9d-9f20-4c671900fdf3 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:36.258797 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b3396932-9966-4b3b-a672-269b0a1cb9ff req-5ae1b334-d74e-4c9d-9f20-4c671900fdf3 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:36.261936 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:41:36.276719 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-b3396932-9966-4b3b-a672-269b0a1cb9ff req-5ae1b334-d74e-4c9d-9f20-4c671900fdf3 service nova] Creating event network-changed:f32c867c-b0c7-42f0-b58e-d5987e695b36 for instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc on nch1-master-1 Sep 17 21:41:36.283177 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [req-b3396932-9966-4b3b-a672-269b0a1cb9ff req-5ae1b334-d74e-4c9d-9f20-4c671900fdf3 service nova] Instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140523) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 21:41:36.294377 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-b3396932-9966-4b3b-a672-269b0a1cb9ff req-5ae1b334-d74e-4c9d-9f20-4c671900fdf3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052971 Sep 17 21:41:36.295188 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3245/6582] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:41:36.524271 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-15298f8a-7d3b-4adf-becc-3cfa734b26b0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:36.524825 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-15298f8a-7d3b-4adf-becc-3cfa734b26b0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:36.533938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-15298f8a-7d3b-4adf-becc-3cfa734b26b0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:36.534457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-15298f8a-7d3b-4adf-becc-3cfa734b26b0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:36.534918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-15298f8a-7d3b-4adf-becc-3cfa734b26b0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:36.535649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-15298f8a-7d3b-4adf-becc-3cfa734b26b0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:36.536127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-15298f8a-7d3b-4adf-becc-3cfa734b26b0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:36.536589 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-15298f8a-7d3b-4adf-becc-3cfa734b26b0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:36.764177 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-15298f8a-7d3b-4adf-becc-3cfa734b26b0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:36.772903 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-15298f8a-7d3b-4adf-becc-3cfa734b26b0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1723 microversion: 2.1 time: 0.254224 Sep 17 21:41:36.773482 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3338/6583] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:36 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:37.803874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-35a17025-5330-4eac-b44a-d7b6aab30ed4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:37.805040 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-35a17025-5330-4eac-b44a-d7b6aab30ed4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:37.815940 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35a17025-5330-4eac-b44a-d7b6aab30ed4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:37.816761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35a17025-5330-4eac-b44a-d7b6aab30ed4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:37.817528 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35a17025-5330-4eac-b44a-d7b6aab30ed4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:37.818821 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35a17025-5330-4eac-b44a-d7b6aab30ed4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:37.819594 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35a17025-5330-4eac-b44a-d7b6aab30ed4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:37.820320 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35a17025-5330-4eac-b44a-d7b6aab30ed4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:37.964704 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-35a17025-5330-4eac-b44a-d7b6aab30ed4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:37.974440 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-35a17025-5330-4eac-b44a-d7b6aab30ed4 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1723 microversion: 2.1 time: 0.179547 Sep 17 21:41:37.975030 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3246/6584] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:37 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:39.007174 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c09030d9-4971-47b2-a433-ce80fdb78619 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:39.008597 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c09030d9-4971-47b2-a433-ce80fdb78619 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:39.017119 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c09030d9-4971-47b2-a433-ce80fdb78619 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:39.017754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c09030d9-4971-47b2-a433-ce80fdb78619 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:39.018241 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c09030d9-4971-47b2-a433-ce80fdb78619 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:39.019004 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c09030d9-4971-47b2-a433-ce80fdb78619 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:39.019568 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c09030d9-4971-47b2-a433-ce80fdb78619 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:39.021137 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c09030d9-4971-47b2-a433-ce80fdb78619 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:39.160645 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c09030d9-4971-47b2-a433-ce80fdb78619 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:39.169718 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c09030d9-4971-47b2-a433-ce80fdb78619 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1716 microversion: 2.1 time: 0.167294 Sep 17 21:41:39.170304 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3339/6585] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:39 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1716 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:39.192354 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9645719a-63e0-4700-859d-95980bc66258 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:39.192971 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9645719a-63e0-4700-859d-95980bc66258 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:39.200181 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9645719a-63e0-4700-859d-95980bc66258 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:39.200675 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9645719a-63e0-4700-859d-95980bc66258 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:39.201117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9645719a-63e0-4700-859d-95980bc66258 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:39.201850 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9645719a-63e0-4700-859d-95980bc66258 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:39.202345 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9645719a-63e0-4700-859d-95980bc66258 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:39.202773 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9645719a-63e0-4700-859d-95980bc66258 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:39.340440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9645719a-63e0-4700-859d-95980bc66258 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:39.353518 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9645719a-63e0-4700-859d-95980bc66258 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1716 microversion: 2.1 time: 0.164756 Sep 17 21:41:39.354397 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3247/6586] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:39 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1716 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:39.377082 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-56ec8b9d-6e72-4937-9f72-aa4c7dff1134 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:39.377795 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-56ec8b9d-6e72-4937-9f72-aa4c7dff1134 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:39.384172 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56ec8b9d-6e72-4937-9f72-aa4c7dff1134 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:39.384678 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56ec8b9d-6e72-4937-9f72-aa4c7dff1134 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:39.385099 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56ec8b9d-6e72-4937-9f72-aa4c7dff1134 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:39.385926 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56ec8b9d-6e72-4937-9f72-aa4c7dff1134 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:39.386394 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56ec8b9d-6e72-4937-9f72-aa4c7dff1134 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:39.386833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56ec8b9d-6e72-4937-9f72-aa4c7dff1134 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:39.515761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-56ec8b9d-6e72-4937-9f72-aa4c7dff1134 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:39.524256 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-56ec8b9d-6e72-4937-9f72-aa4c7dff1134 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1716 microversion: 2.1 time: 0.151078 Sep 17 21:41:39.524755 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3340/6587] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:39 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1716 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:39.549149 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-996d7b8c-6064-46ea-813c-fb3572e40761 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:39.549698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-996d7b8c-6064-46ea-813c-fb3572e40761 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:39.555922 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-996d7b8c-6064-46ea-813c-fb3572e40761 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:39.556415 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-996d7b8c-6064-46ea-813c-fb3572e40761 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:39.556858 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-996d7b8c-6064-46ea-813c-fb3572e40761 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:39.557584 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-996d7b8c-6064-46ea-813c-fb3572e40761 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:39.558044 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-996d7b8c-6064-46ea-813c-fb3572e40761 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:39.558473 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-996d7b8c-6064-46ea-813c-fb3572e40761 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:39.584139 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-996d7b8c-6064-46ea-813c-fb3572e40761 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:41:39.668883 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-996d7b8c-6064-46ea-813c-fb3572e40761 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "DELETE /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 204 len: 0 microversion: 2.1 time: 0.123395 Sep 17 21:41:39.669768 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3248/6588] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:41:39 2022] DELETE /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:41:39.678416 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-22c9e85f-bc13-4399-9cc5-0d90cac6fef7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:39.679040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-22c9e85f-bc13-4399-9cc5-0d90cac6fef7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:39.685150 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-22c9e85f-bc13-4399-9cc5-0d90cac6fef7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:39.685720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-22c9e85f-bc13-4399-9cc5-0d90cac6fef7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:39.686172 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-22c9e85f-bc13-4399-9cc5-0d90cac6fef7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:39.686884 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-22c9e85f-bc13-4399-9cc5-0d90cac6fef7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:39.687354 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-22c9e85f-bc13-4399-9cc5-0d90cac6fef7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:39.687789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-22c9e85f-bc13-4399-9cc5-0d90cac6fef7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:39.823226 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-22c9e85f-bc13-4399-9cc5-0d90cac6fef7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:39.831871 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-22c9e85f-bc13-4399-9cc5-0d90cac6fef7 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1722 microversion: 2.1 time: 0.157378 Sep 17 21:41:39.832453 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3341/6589] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:39 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:41:40.856845 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d52a9650-2d1c-438d-a2c9-decec97ff774 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:40.857486 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d52a9650-2d1c-438d-a2c9-decec97ff774 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:40.865042 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d52a9650-2d1c-438d-a2c9-decec97ff774 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:40.865571 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d52a9650-2d1c-438d-a2c9-decec97ff774 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:40.866046 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d52a9650-2d1c-438d-a2c9-decec97ff774 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:40.866766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d52a9650-2d1c-438d-a2c9-decec97ff774 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:40.867243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d52a9650-2d1c-438d-a2c9-decec97ff774 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:40.867671 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d52a9650-2d1c-438d-a2c9-decec97ff774 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:41.013629 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d52a9650-2d1c-438d-a2c9-decec97ff774 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:41.026819 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d52a9650-2d1c-438d-a2c9-decec97ff774 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1722 microversion: 2.1 time: 0.174068 Sep 17 21:41:41.027679 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3249/6590] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:40 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:42.050861 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ede0d379-7ee4-45c3-a326-68db8f64a91d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:42.051496 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ede0d379-7ee4-45c3-a326-68db8f64a91d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:42.054256 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:41:42.060827 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ede0d379-7ee4-45c3-a326-68db8f64a91d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:42.061331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ede0d379-7ee4-45c3-a326-68db8f64a91d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:42.061816 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ede0d379-7ee4-45c3-a326-68db8f64a91d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:42.062536 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ede0d379-7ee4-45c3-a326-68db8f64a91d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:42.063035 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ede0d379-7ee4-45c3-a326-68db8f64a91d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:42.063508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ede0d379-7ee4-45c3-a326-68db8f64a91d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:42.139328 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ede0d379-7ee4-45c3-a326-68db8f64a91d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd20f8598dfec4de7b496a64e023e7a15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad243abc13a14aa08c717d4105e24f4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:42.152419 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ede0d379-7ee4-45c3-a326-68db8f64a91d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 200 len: 1655 microversion: 2.1 time: 0.105715 Sep 17 21:41:42.153261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-8eaf0b8c-98fb-4287-977d-afd91767de54 req-2c3e4be0-3220-4cc0-8bae-a89d78cde996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acf1e47d-7fca-4cca-a3bc-66445ac0f1cc", "name": "network-vif-deleted", "tag": "f32c867c-b0c7-42f0-b58e-d5987e695b36"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:41:42.161837 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3342/6591] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:42 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 1655 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:42.165689 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8eaf0b8c-98fb-4287-977d-afd91767de54 req-2c3e4be0-3220-4cc0-8bae-a89d78cde996 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:42.166389 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8eaf0b8c-98fb-4287-977d-afd91767de54 req-2c3e4be0-3220-4cc0-8bae-a89d78cde996 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:42.167032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8eaf0b8c-98fb-4287-977d-afd91767de54 req-2c3e4be0-3220-4cc0-8bae-a89d78cde996 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:42.179594 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-8eaf0b8c-98fb-4287-977d-afd91767de54 req-2c3e4be0-3220-4cc0-8bae-a89d78cde996 service nova] Creating event network-vif-deleted:f32c867c-b0c7-42f0-b58e-d5987e695b36 for instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc on nch1-master-1 Sep 17 21:41:42.184887 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-8eaf0b8c-98fb-4287-977d-afd91767de54 req-2c3e4be0-3220-4cc0-8bae-a89d78cde996 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035644 Sep 17 21:41:42.185690 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3250/6592] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:41:43.177857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e5c5e227-ca0c-4384-a374-787b1a91b00f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:43.178669 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e5c5e227-ca0c-4384-a374-787b1a91b00f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:43.186750 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5c5e227-ca0c-4384-a374-787b1a91b00f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:43.187266 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5c5e227-ca0c-4384-a374-787b1a91b00f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:43.187727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5c5e227-ca0c-4384-a374-787b1a91b00f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:43.188452 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5c5e227-ca0c-4384-a374-787b1a91b00f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:43.188930 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5c5e227-ca0c-4384-a374-787b1a91b00f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:43.189380 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5c5e227-ca0c-4384-a374-787b1a91b00f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:43.203798 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-e5c5e227-ca0c-4384-a374-787b1a91b00f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] HTTP exception thrown: Instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc could not be found. Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e5c5e227-ca0c-4384-a374-787b1a91b00f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Request method failure captured: Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc HTTP/1.1 Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJj3jwshgKHrmiTh9He2iymPHWHLX-Bt6aPFYMaypjQpla8PjsWm9yR1cr-rMt99yChBYg92ATksUdevYw1cssE35vglYIXszUAp944E84DQ3hBJviVnWeBZQ8d2ZXwzYz00kQH44YjF-EXnR6Tb897kEyxad5Zvgh2DN_v9yxO1e0r8 Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: ad243abc13a14aa08c717d4105e24f4f Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerActionsTestJSON-226995111 Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad243abc13a14aa08c717d4105e24f4f", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerActionsTestJSON-226995111 Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: ad243abc13a14aa08c717d4105e24f4f Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerActionsTestJSON-226995111 Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerActionsTestJSON-226995111-project Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: d20f8598dfec4de7b496a64e023e7a15 Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerActionsTestJSON-226995111-project Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc could not be found. Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'acf1e47d-7fca-4cca-a3bc-66445ac0f1cc'} Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc could not be found. Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc could not be found. Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:41:43.205506 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:41:43.210933 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:41:43.210933 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:41:43.210933 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:41:43.210933 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:41:43.210933 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:41:43.210933 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc could not be found. Sep 17 21:41:43.210933 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:41:43.210933 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e5c5e227-ca0c-4384-a374-787b1a91b00f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Returning 404 to user: Instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:41:43.210933 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e5c5e227-ca0c-4384-a374-787b1a91b00f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 404 len: 111 microversion: 2.1 time: 0.033254 Sep 17 21:41:43.210933 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3343/6593] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:43 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:41:43.271700 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-338203fc-a9d1-487d-a53e-fde59a42b4ca tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:43.274023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-338203fc-a9d1-487d-a53e-fde59a42b4ca tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:43.280833 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-338203fc-a9d1-487d-a53e-fde59a42b4ca tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:43.281255 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-338203fc-a9d1-487d-a53e-fde59a42b4ca tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:43.281757 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-338203fc-a9d1-487d-a53e-fde59a42b4ca tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:43.282473 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-338203fc-a9d1-487d-a53e-fde59a42b4ca tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:43.282912 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-338203fc-a9d1-487d-a53e-fde59a42b4ca tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:43.283376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-338203fc-a9d1-487d-a53e-fde59a42b4ca tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:43.296661 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-338203fc-a9d1-487d-a53e-fde59a42b4ca tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] HTTP exception thrown: Instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc could not be found. Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-338203fc-a9d1-487d-a53e-fde59a42b4ca tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Request method failure captured: Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc/os-volume_attachments HTTP/1.1 Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJj3jwshgKHrmiTh9He2iymPHWHLX-Bt6aPFYMaypjQpla8PjsWm9yR1cr-rMt99yChBYg92ATksUdevYw1cssE35vglYIXszUAp944E84DQ3hBJviVnWeBZQ8d2ZXwzYz00kQH44YjF-EXnR6Tb897kEyxad5Zvgh2DN_v9yxO1e0r8 Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: ad243abc13a14aa08c717d4105e24f4f Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerActionsTestJSON-226995111 Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad243abc13a14aa08c717d4105e24f4f", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerActionsTestJSON-226995111 Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: ad243abc13a14aa08c717d4105e24f4f Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerActionsTestJSON-226995111 Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerActionsTestJSON-226995111-project Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: d20f8598dfec4de7b496a64e023e7a15 Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerActionsTestJSON-226995111-project Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc could not be found. Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'server_id': 'acf1e47d-7fca-4cca-a3bc-66445ac0f1cc'} Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc could not be found. Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:41:43.298413 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:41:43.302548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc could not be found. Sep 17 21:41:43.302548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:41:43.302548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:41:43.302548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:41:43.302548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:41:43.302548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:41:43.302548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:41:43.302548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:41:43.302548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:41:43.302548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc could not be found. Sep 17 21:41:43.302548 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:41:43.302548 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-338203fc-a9d1-487d-a53e-fde59a42b4ca tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Returning 404 to user: Instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:41:43.302548 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-338203fc-a9d1-487d-a53e-fde59a42b4ca tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033539 Sep 17 21:41:43.302548 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3251/6594] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 17 21:41:43 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:41:44.524767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4a30db7f-8bcc-40c2-b609-e317a7264523 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:44.525291 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4a30db7f-8bcc-40c2-b609-e317a7264523 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:44.532871 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a30db7f-8bcc-40c2-b609-e317a7264523 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:44.533369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a30db7f-8bcc-40c2-b609-e317a7264523 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:44.533874 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a30db7f-8bcc-40c2-b609-e317a7264523 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:44.534574 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a30db7f-8bcc-40c2-b609-e317a7264523 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:44.535291 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a30db7f-8bcc-40c2-b609-e317a7264523 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:44.535781 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a30db7f-8bcc-40c2-b609-e317a7264523 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:44.550068 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-4a30db7f-8bcc-40c2-b609-e317a7264523 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] HTTP exception thrown: Instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc could not be found. Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4a30db7f-8bcc-40c2-b609-e317a7264523 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Request method failure captured: Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc HTTP/1.1 Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJj3jwshgKHrmiTh9He2iymPHWHLX-Bt6aPFYMaypjQpla8PjsWm9yR1cr-rMt99yChBYg92ATksUdevYw1cssE35vglYIXszUAp944E84DQ3hBJviVnWeBZQ8d2ZXwzYz00kQH44YjF-EXnR6Tb897kEyxad5Zvgh2DN_v9yxO1e0r8 Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: ad243abc13a14aa08c717d4105e24f4f Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerActionsTestJSON-226995111 Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad243abc13a14aa08c717d4105e24f4f", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerActionsTestJSON-226995111 Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: ad243abc13a14aa08c717d4105e24f4f Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerActionsTestJSON-226995111 Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerActionsTestJSON-226995111-project Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: d20f8598dfec4de7b496a64e023e7a15 Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerActionsTestJSON-226995111-project Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc could not be found. Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'acf1e47d-7fca-4cca-a3bc-66445ac0f1cc'} Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc could not be found. Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:41:44.551633 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:41:44.556767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc could not be found. Sep 17 21:41:44.556767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.556767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:41:44.556767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.556767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:41:44.556767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:41:44.556767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:41:44.556767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:41:44.556767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:41:44.556767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc could not be found. Sep 17 21:41:44.556767 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.556767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4a30db7f-8bcc-40c2-b609-e317a7264523 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Returning 404 to user: Instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:41:44.556767 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4a30db7f-8bcc-40c2-b609-e317a7264523 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "DELETE /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 404 len: 111 microversion: 2.1 time: 0.032246 Sep 17 21:41:44.556767 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3344/6595] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:41:44 2022] DELETE /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:41:44.562413 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3c31ee7e-dffa-4028-89a5-59a707944398 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:44.563045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3c31ee7e-dffa-4028-89a5-59a707944398 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: acf1e47d-7fca-4cca-a3bc-66445ac0f1cc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:44.570075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3c31ee7e-dffa-4028-89a5-59a707944398 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:44.570557 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3c31ee7e-dffa-4028-89a5-59a707944398 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:44.570995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3c31ee7e-dffa-4028-89a5-59a707944398 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:44.571694 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3c31ee7e-dffa-4028-89a5-59a707944398 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:44.572156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3c31ee7e-dffa-4028-89a5-59a707944398 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:44.572580 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3c31ee7e-dffa-4028-89a5-59a707944398 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:44.587343 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-3c31ee7e-dffa-4028-89a5-59a707944398 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] HTTP exception thrown: Instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc could not be found. Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3c31ee7e-dffa-4028-89a5-59a707944398 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Request method failure captured: Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc HTTP/1.1 Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJj3jwshgKHrmiTh9He2iymPHWHLX-Bt6aPFYMaypjQpla8PjsWm9yR1cr-rMt99yChBYg92ATksUdevYw1cssE35vglYIXszUAp944E84DQ3hBJviVnWeBZQ8d2ZXwzYz00kQH44YjF-EXnR6Tb897kEyxad5Zvgh2DN_v9yxO1e0r8 Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: ad243abc13a14aa08c717d4105e24f4f Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerActionsTestJSON-226995111 Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad243abc13a14aa08c717d4105e24f4f", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerActionsTestJSON-226995111 Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: ad243abc13a14aa08c717d4105e24f4f Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerActionsTestJSON-226995111 Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerActionsTestJSON-226995111-project Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: d20f8598dfec4de7b496a64e023e7a15 Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerActionsTestJSON-226995111-project Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc could not be found. Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'acf1e47d-7fca-4cca-a3bc-66445ac0f1cc'} Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc could not be found. Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc could not be found. Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:41:44.588890 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.594298 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:41:44.594298 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:41:44.594298 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:41:44.594298 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:41:44.594298 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:41:44.594298 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc could not be found. Sep 17 21:41:44.594298 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.594298 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3c31ee7e-dffa-4028-89a5-59a707944398 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Returning 404 to user: Instance acf1e47d-7fca-4cca-a3bc-66445ac0f1cc could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:41:44.594298 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3c31ee7e-dffa-4028-89a5-59a707944398 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc" status: 404 len: 111 microversion: 2.1 time: 0.032542 Sep 17 21:41:44.594298 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3252/6596] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:44 2022] GET /compute/v2.1/servers/acf1e47d-7fca-4cca-a3bc-66445ac0f1cc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:41:44.600388 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1f3238a4-c0c2-4a13-8ff1-5995418665eb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:44.600906 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1f3238a4-c0c2-4a13-8ff1-5995418665eb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:44.607463 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f3238a4-c0c2-4a13-8ff1-5995418665eb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:44.607974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f3238a4-c0c2-4a13-8ff1-5995418665eb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:44.608501 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f3238a4-c0c2-4a13-8ff1-5995418665eb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:44.609250 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f3238a4-c0c2-4a13-8ff1-5995418665eb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:44.609804 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f3238a4-c0c2-4a13-8ff1-5995418665eb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:44.610246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1f3238a4-c0c2-4a13-8ff1-5995418665eb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:44.628811 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-1f3238a4-c0c2-4a13-8ff1-5995418665eb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] HTTP exception thrown: Instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 could not be found. Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1f3238a4-c0c2-4a13-8ff1-5995418665eb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Request method failure captured: Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 HTTP/1.1 Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJj3jwshgKHrmiTh9He2iymPHWHLX-Bt6aPFYMaypjQpla8PjsWm9yR1cr-rMt99yChBYg92ATksUdevYw1cssE35vglYIXszUAp944E84DQ3hBJviVnWeBZQ8d2ZXwzYz00kQH44YjF-EXnR6Tb897kEyxad5Zvgh2DN_v9yxO1e0r8 Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: ad243abc13a14aa08c717d4105e24f4f Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerActionsTestJSON-226995111 Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad243abc13a14aa08c717d4105e24f4f", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerActionsTestJSON-226995111 Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: ad243abc13a14aa08c717d4105e24f4f Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerActionsTestJSON-226995111 Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerActionsTestJSON-226995111-project Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: d20f8598dfec4de7b496a64e023e7a15 Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerActionsTestJSON-226995111-project Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 could not be found. Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'c9f570a5-6e67-43f4-acb2-798fbaf1de66'} Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 could not be found. Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:41:44.630509 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:41:44.636598 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 could not be found. Sep 17 21:41:44.636598 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.636598 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:41:44.636598 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.636598 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:41:44.636598 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:41:44.636598 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:41:44.636598 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:41:44.636598 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:41:44.636598 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 could not be found. Sep 17 21:41:44.636598 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.636598 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1f3238a4-c0c2-4a13-8ff1-5995418665eb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Returning 404 to user: Instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:41:44.636598 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1f3238a4-c0c2-4a13-8ff1-5995418665eb tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 404 len: 111 microversion: 2.1 time: 0.036016 Sep 17 21:41:44.636598 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3345/6597] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:41:44 2022] DELETE /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:41:44.641188 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9b921fcf-cbbb-4fe9-9d94-78443463ce83 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:44.641845 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9b921fcf-cbbb-4fe9-9d94-78443463ce83 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: c9f570a5-6e67-43f4-acb2-798fbaf1de66] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:44.648207 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b921fcf-cbbb-4fe9-9d94-78443463ce83 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:44.648717 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b921fcf-cbbb-4fe9-9d94-78443463ce83 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:44.649155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b921fcf-cbbb-4fe9-9d94-78443463ce83 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:44.649888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b921fcf-cbbb-4fe9-9d94-78443463ce83 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:44.650332 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b921fcf-cbbb-4fe9-9d94-78443463ce83 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:44.650988 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9b921fcf-cbbb-4fe9-9d94-78443463ce83 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:44.667734 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-9b921fcf-cbbb-4fe9-9d94-78443463ce83 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] HTTP exception thrown: Instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 could not be found. Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9b921fcf-cbbb-4fe9-9d94-78443463ce83 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Request method failure captured: Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 HTTP/1.1 Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJj3jwshgKHrmiTh9He2iymPHWHLX-Bt6aPFYMaypjQpla8PjsWm9yR1cr-rMt99yChBYg92ATksUdevYw1cssE35vglYIXszUAp944E84DQ3hBJviVnWeBZQ8d2ZXwzYz00kQH44YjF-EXnR6Tb897kEyxad5Zvgh2DN_v9yxO1e0r8 Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: ad243abc13a14aa08c717d4105e24f4f Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerActionsTestJSON-226995111 Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad243abc13a14aa08c717d4105e24f4f", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerActionsTestJSON-226995111 Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: ad243abc13a14aa08c717d4105e24f4f Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerActionsTestJSON-226995111 Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerActionsTestJSON-226995111-project Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: d20f8598dfec4de7b496a64e023e7a15 Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerActionsTestJSON-226995111-project Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 could not be found. Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'c9f570a5-6e67-43f4-acb2-798fbaf1de66'} Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 could not be found. Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 could not be found. Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:41:44.669274 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.674113 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:41:44.674113 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:41:44.674113 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:41:44.674113 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:41:44.674113 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:41:44.674113 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 could not be found. Sep 17 21:41:44.674113 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.674113 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9b921fcf-cbbb-4fe9-9d94-78443463ce83 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Returning 404 to user: Instance c9f570a5-6e67-43f4-acb2-798fbaf1de66 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:41:44.674113 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9b921fcf-cbbb-4fe9-9d94-78443463ce83 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66" status: 404 len: 111 microversion: 2.1 time: 0.033500 Sep 17 21:41:44.674113 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3253/6598] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:44 2022] GET /compute/v2.1/servers/c9f570a5-6e67-43f4-acb2-798fbaf1de66 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:41:44.680184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8e114efd-e8a8-4483-beda-bdbb45e33114 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:44.680865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8e114efd-e8a8-4483-beda-bdbb45e33114 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:44.687404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e114efd-e8a8-4483-beda-bdbb45e33114 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:44.687919 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e114efd-e8a8-4483-beda-bdbb45e33114 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:44.688380 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e114efd-e8a8-4483-beda-bdbb45e33114 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:44.689114 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e114efd-e8a8-4483-beda-bdbb45e33114 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:44.689721 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e114efd-e8a8-4483-beda-bdbb45e33114 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:44.690182 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8e114efd-e8a8-4483-beda-bdbb45e33114 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:44.704531 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-8e114efd-e8a8-4483-beda-bdbb45e33114 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] HTTP exception thrown: Instance 143f9113-e598-4087-bc18-939d798adbb1 could not be found. Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8e114efd-e8a8-4483-beda-bdbb45e33114 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Request method failure captured: Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 HTTP/1.1 Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJj3jwshgKHrmiTh9He2iymPHWHLX-Bt6aPFYMaypjQpla8PjsWm9yR1cr-rMt99yChBYg92ATksUdevYw1cssE35vglYIXszUAp944E84DQ3hBJviVnWeBZQ8d2ZXwzYz00kQH44YjF-EXnR6Tb897kEyxad5Zvgh2DN_v9yxO1e0r8 Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: ad243abc13a14aa08c717d4105e24f4f Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerActionsTestJSON-226995111 Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad243abc13a14aa08c717d4105e24f4f", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerActionsTestJSON-226995111 Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: ad243abc13a14aa08c717d4105e24f4f Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerActionsTestJSON-226995111 Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerActionsTestJSON-226995111-project Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: d20f8598dfec4de7b496a64e023e7a15 Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerActionsTestJSON-226995111-project Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 143f9113-e598-4087-bc18-939d798adbb1 could not be found. Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '143f9113-e598-4087-bc18-939d798adbb1'} Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 143f9113-e598-4087-bc18-939d798adbb1 could not be found. Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:41:44.706711 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:41:44.711716 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 143f9113-e598-4087-bc18-939d798adbb1 could not be found. Sep 17 21:41:44.711716 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.711716 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:41:44.711716 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.711716 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:41:44.711716 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:41:44.711716 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:41:44.711716 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:41:44.711716 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:41:44.711716 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 143f9113-e598-4087-bc18-939d798adbb1 could not be found. Sep 17 21:41:44.711716 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.711716 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8e114efd-e8a8-4483-beda-bdbb45e33114 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Returning 404 to user: Instance 143f9113-e598-4087-bc18-939d798adbb1 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:41:44.711716 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8e114efd-e8a8-4483-beda-bdbb45e33114 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "DELETE /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 404 len: 111 microversion: 2.1 time: 0.032126 Sep 17 21:41:44.711716 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3346/6599] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:41:44 2022] DELETE /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:41:44.717408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2f8341a3-16ac-4035-8d44-4b3557a35223 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:44.718072 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2f8341a3-16ac-4035-8d44-4b3557a35223 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: 143f9113-e598-4087-bc18-939d798adbb1] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:44.724491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f8341a3-16ac-4035-8d44-4b3557a35223 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:44.725022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f8341a3-16ac-4035-8d44-4b3557a35223 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:44.725440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f8341a3-16ac-4035-8d44-4b3557a35223 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:44.726192 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f8341a3-16ac-4035-8d44-4b3557a35223 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:44.726659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f8341a3-16ac-4035-8d44-4b3557a35223 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:44.727095 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2f8341a3-16ac-4035-8d44-4b3557a35223 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:44.741265 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-2f8341a3-16ac-4035-8d44-4b3557a35223 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] HTTP exception thrown: Instance 143f9113-e598-4087-bc18-939d798adbb1 could not be found. Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2f8341a3-16ac-4035-8d44-4b3557a35223 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Request method failure captured: Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 HTTP/1.1 Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJj3jwshgKHrmiTh9He2iymPHWHLX-Bt6aPFYMaypjQpla8PjsWm9yR1cr-rMt99yChBYg92ATksUdevYw1cssE35vglYIXszUAp944E84DQ3hBJviVnWeBZQ8d2ZXwzYz00kQH44YjF-EXnR6Tb897kEyxad5Zvgh2DN_v9yxO1e0r8 Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: ad243abc13a14aa08c717d4105e24f4f Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerActionsTestJSON-226995111 Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad243abc13a14aa08c717d4105e24f4f", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerActionsTestJSON-226995111 Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: ad243abc13a14aa08c717d4105e24f4f Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerActionsTestJSON-226995111 Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerActionsTestJSON-226995111-project Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: d20f8598dfec4de7b496a64e023e7a15 Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerActionsTestJSON-226995111-project Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 143f9113-e598-4087-bc18-939d798adbb1 could not be found. Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '143f9113-e598-4087-bc18-939d798adbb1'} Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 143f9113-e598-4087-bc18-939d798adbb1 could not be found. Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 143f9113-e598-4087-bc18-939d798adbb1 could not be found. Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:41:44.742795 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.747227 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:41:44.747227 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:41:44.747227 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:41:44.747227 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:41:44.747227 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:41:44.747227 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 143f9113-e598-4087-bc18-939d798adbb1 could not be found. Sep 17 21:41:44.747227 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.747227 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2f8341a3-16ac-4035-8d44-4b3557a35223 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Returning 404 to user: Instance 143f9113-e598-4087-bc18-939d798adbb1 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:41:44.747227 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2f8341a3-16ac-4035-8d44-4b3557a35223 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1" status: 404 len: 111 microversion: 2.1 time: 0.031186 Sep 17 21:41:44.747227 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3254/6600] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:44 2022] GET /compute/v2.1/servers/143f9113-e598-4087-bc18-939d798adbb1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:41:44.752871 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2a8b8bc6-8108-4821-90a7-973c2ef3fab0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:44.753391 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2a8b8bc6-8108-4821-90a7-973c2ef3fab0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:44.759725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a8b8bc6-8108-4821-90a7-973c2ef3fab0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:44.760231 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a8b8bc6-8108-4821-90a7-973c2ef3fab0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:44.760708 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a8b8bc6-8108-4821-90a7-973c2ef3fab0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:44.761525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a8b8bc6-8108-4821-90a7-973c2ef3fab0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:44.761990 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a8b8bc6-8108-4821-90a7-973c2ef3fab0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:44.762433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2a8b8bc6-8108-4821-90a7-973c2ef3fab0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:44.776143 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-2a8b8bc6-8108-4821-90a7-973c2ef3fab0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] HTTP exception thrown: Instance bb9ed0d4-926d-4875-a885-f6400220fd50 could not be found. Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2a8b8bc6-8108-4821-90a7-973c2ef3fab0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Request method failure captured: Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 HTTP/1.1 Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJj3jwshgKHrmiTh9He2iymPHWHLX-Bt6aPFYMaypjQpla8PjsWm9yR1cr-rMt99yChBYg92ATksUdevYw1cssE35vglYIXszUAp944E84DQ3hBJviVnWeBZQ8d2ZXwzYz00kQH44YjF-EXnR6Tb897kEyxad5Zvgh2DN_v9yxO1e0r8 Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: ad243abc13a14aa08c717d4105e24f4f Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServerActionsTestJSON-226995111 Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad243abc13a14aa08c717d4105e24f4f", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServerActionsTestJSON-226995111 Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: ad243abc13a14aa08c717d4105e24f4f Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServerActionsTestJSON-226995111 Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServerActionsTestJSON-226995111-project Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: d20f8598dfec4de7b496a64e023e7a15 Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServerActionsTestJSON-226995111-project Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance bb9ed0d4-926d-4875-a885-f6400220fd50 could not be found. Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'bb9ed0d4-926d-4875-a885-f6400220fd50'} Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb9ed0d4-926d-4875-a885-f6400220fd50 could not be found. Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:41:44.777743 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:41:44.782911 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb9ed0d4-926d-4875-a885-f6400220fd50 could not be found. Sep 17 21:41:44.782911 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.782911 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:41:44.782911 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.782911 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:41:44.782911 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:41:44.782911 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:41:44.782911 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:41:44.782911 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:41:44.782911 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb9ed0d4-926d-4875-a885-f6400220fd50 could not be found. Sep 17 21:41:44.782911 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.782911 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2a8b8bc6-8108-4821-90a7-973c2ef3fab0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Returning 404 to user: Instance bb9ed0d4-926d-4875-a885-f6400220fd50 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:41:44.782911 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2a8b8bc6-8108-4821-90a7-973c2ef3fab0 tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 404 len: 111 microversion: 2.1 time: 0.030212 Sep 17 21:41:44.782911 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3347/6601] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:41:44 2022] DELETE /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:41:44.788769 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5d0744af-c6f5-4edb-8d6b-deebcaeb917f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:44.789400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5d0744af-c6f5-4edb-8d6b-deebcaeb917f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [instance: bb9ed0d4-926d-4875-a885-f6400220fd50] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:44.795652 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d0744af-c6f5-4edb-8d6b-deebcaeb917f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:44.796149 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d0744af-c6f5-4edb-8d6b-deebcaeb917f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:44.796593 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d0744af-c6f5-4edb-8d6b-deebcaeb917f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:44.797300 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d0744af-c6f5-4edb-8d6b-deebcaeb917f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:44.797783 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d0744af-c6f5-4edb-8d6b-deebcaeb917f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:44.798216 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5d0744af-c6f5-4edb-8d6b-deebcaeb917f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:44.811979 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-5d0744af-c6f5-4edb-8d6b-deebcaeb917f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] HTTP exception thrown: Instance bb9ed0d4-926d-4875-a885-f6400220fd50 could not be found. Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5d0744af-c6f5-4edb-8d6b-deebcaeb917f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Request method failure captured: Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 HTTP/1.1 Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJj3jwshgKHrmiTh9He2iymPHWHLX-Bt6aPFYMaypjQpla8PjsWm9yR1cr-rMt99yChBYg92ATksUdevYw1cssE35vglYIXszUAp944E84DQ3hBJviVnWeBZQ8d2ZXwzYz00kQH44YjF-EXnR6Tb897kEyxad5Zvgh2DN_v9yxO1e0r8 Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: ad243abc13a14aa08c717d4105e24f4f Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServerActionsTestJSON-226995111 Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ad243abc13a14aa08c717d4105e24f4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ad243abc13a14aa08c717d4105e24f4f", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServerActionsTestJSON-226995111 Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: ad243abc13a14aa08c717d4105e24f4f Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServerActionsTestJSON-226995111 Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServerActionsTestJSON-226995111-project Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: d20f8598dfec4de7b496a64e023e7a15 Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServerActionsTestJSON-226995111-project Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance bb9ed0d4-926d-4875-a885-f6400220fd50 could not be found. Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'bb9ed0d4-926d-4875-a885-f6400220fd50'} Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb9ed0d4-926d-4875-a885-f6400220fd50 could not be found. Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb9ed0d4-926d-4875-a885-f6400220fd50 could not be found. Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:41:44.813554 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.818502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:41:44.818502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:41:44.818502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:41:44.818502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:41:44.818502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:41:44.818502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb9ed0d4-926d-4875-a885-f6400220fd50 could not be found. Sep 17 21:41:44.818502 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:41:44.818502 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5d0744af-c6f5-4edb-8d6b-deebcaeb917f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Returning 404 to user: Instance bb9ed0d4-926d-4875-a885-f6400220fd50 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:41:44.818502 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5d0744af-c6f5-4edb-8d6b-deebcaeb917f tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50" status: 404 len: 111 microversion: 2.1 time: 0.030352 Sep 17 21:41:44.818502 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3255/6602] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:44 2022] GET /compute/v2.1/servers/bb9ed0d4-926d-4875-a885-f6400220fd50 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:41:44.823694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ea200232-ee54-4fd1-ba66-a70866ef880d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] Calling method '.version_select at 0x7f259c3dc1f0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:44.828336 ncdv-master-1 devstack@n-api.service[140524]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ea200232-ee54-4fd1-ba66-a70866ef880d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [7114cc1e-c6b3-4781-b959-9e22cb9fe2c9] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 17 21:41:45.836879 ncdv-master-1 devstack@n-api.service[140524]: INFO oslo.messaging._drivers.impl_rabbit [None req-ea200232-ee54-4fd1-ba66-a70866ef880d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] [7114cc1e-c6b3-4781-b959-9e22cb9fe2c9] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 52948. Sep 17 21:41:45.868150 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ea200232-ee54-4fd1-ba66-a70866ef880d tempest-ServerActionsTestJSON-226995111 tempest-ServerActionsTestJSON-226995111-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1377054705" status: 202 len: 0 microversion: 2.1 time: 1.048255 Sep 17 21:41:45.868742 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3348/6603] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Sep 17 21:41:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1377054705 => generated 0 bytes in 1049 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:41:55.575603 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:41:55.576269 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:41:55.703318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f809c1d0-540c-47f6-bb06-669300c00444 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-297867785", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "5c8e0b71-87da-4faf-a538-860122db2835"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:41:55.764745 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-f809c1d0-540c-47f6-bb06-669300c00444 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] validate_networks() for [('5c8e0b71-87da-4faf-a538-860122db2835', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:41:56.208494 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-f809c1d0-540c-47f6-bb06-669300c00444 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:41:56.209315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-f809c1d0-540c-47f6-bb06-669300c00444 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:41:56.210258 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-f809c1d0-540c-47f6-bb06-669300c00444 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:41:56.211062 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-f809c1d0-540c-47f6-bb06-669300c00444 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:41:56.211964 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-f809c1d0-540c-47f6-bb06-669300c00444 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:41:56.225197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f809c1d0-540c-47f6-bb06-669300c00444 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:56.225806 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f809c1d0-540c-47f6-bb06-669300c00444 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:56.226239 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f809c1d0-540c-47f6-bb06-669300c00444 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:56.226983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f809c1d0-540c-47f6-bb06-669300c00444 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:56.227466 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f809c1d0-540c-47f6-bb06-669300c00444 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:56.227986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f809c1d0-540c-47f6-bb06-669300c00444 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:56.246644 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-f809c1d0-540c-47f6-bb06-669300c00444 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Getting quotas for project 41989440d1c94d3590210e79e8e5303a. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:41:56.252217 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-f809c1d0-540c-47f6-bb06-669300c00444 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Getting quotas for user 59b52fba1a3a42338b828c5d0313343e and project 41989440d1c94d3590210e79e8e5303a. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:41:56.265280 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f809c1d0-540c-47f6-bb06-669300c00444 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:41:56.268179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f809c1d0-540c-47f6-bb06-669300c00444 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: 2c61b28f-4dcc-40b2-b082-de549dfc800c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:41:56.318631 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f809c1d0-540c-47f6-bb06-669300c00444 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.748855 Sep 17 21:41:56.320084 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3256/6604] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:41:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:41:56.329298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:41:56.330364 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:41:56.335485 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3c6fdbbc-7de9-448c-bd63-88c2a63b3779 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:56.336287 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3c6fdbbc-7de9-448c-bd63-88c2a63b3779 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: 2c61b28f-4dcc-40b2-b082-de549dfc800c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:56.405708 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3c6fdbbc-7de9-448c-bd63-88c2a63b3779 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b52fba1a3a42338b828c5d0313343e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41989440d1c94d3590210e79e8e5303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:56.413995 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3c6fdbbc-7de9-448c-bd63-88c2a63b3779 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c" status: 200 len: 1216 microversion: 2.1 time: 0.086026 Sep 17 21:41:56.422349 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3349/6605] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:56 2022] GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c => generated 1216 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:57.438562 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a62b158a-8f9b-4ecb-a55c-9ab221e95605 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:57.440069 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a62b158a-8f9b-4ecb-a55c-9ab221e95605 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: 2c61b28f-4dcc-40b2-b082-de549dfc800c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:57.448116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a62b158a-8f9b-4ecb-a55c-9ab221e95605 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:57.448938 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a62b158a-8f9b-4ecb-a55c-9ab221e95605 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:57.449618 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a62b158a-8f9b-4ecb-a55c-9ab221e95605 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:57.450541 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a62b158a-8f9b-4ecb-a55c-9ab221e95605 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:57.451190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a62b158a-8f9b-4ecb-a55c-9ab221e95605 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:57.451808 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a62b158a-8f9b-4ecb-a55c-9ab221e95605 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:57.523745 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a62b158a-8f9b-4ecb-a55c-9ab221e95605 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b52fba1a3a42338b828c5d0313343e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41989440d1c94d3590210e79e8e5303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:57.532577 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a62b158a-8f9b-4ecb-a55c-9ab221e95605 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c" status: 200 len: 1286 microversion: 2.1 time: 0.100023 Sep 17 21:41:57.534068 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3257/6606] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:57 2022] GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c => generated 1286 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:58.556641 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-910d971c-3f3d-4203-8236-d6cf41c778e4 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:58.557548 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-910d971c-3f3d-4203-8236-d6cf41c778e4 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: 2c61b28f-4dcc-40b2-b082-de549dfc800c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:58.566036 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-910d971c-3f3d-4203-8236-d6cf41c778e4 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:58.566562 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-910d971c-3f3d-4203-8236-d6cf41c778e4 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:58.567024 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-910d971c-3f3d-4203-8236-d6cf41c778e4 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:58.568018 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-910d971c-3f3d-4203-8236-d6cf41c778e4 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:58.568495 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-910d971c-3f3d-4203-8236-d6cf41c778e4 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:58.568941 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-910d971c-3f3d-4203-8236-d6cf41c778e4 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:58.721427 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-910d971c-3f3d-4203-8236-d6cf41c778e4 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b52fba1a3a42338b828c5d0313343e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41989440d1c94d3590210e79e8e5303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:58.731784 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-910d971c-3f3d-4203-8236-d6cf41c778e4 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c" status: 200 len: 1316 microversion: 2.1 time: 0.179097 Sep 17 21:41:58.732386 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3350/6607] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:58 2022] GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c => generated 1316 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:41:58.893869 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-b14c606b-7767-43e5-8766-f22658f39a53 req-1240da40-5ffd-4c0f-b5ee-d9ebcf6b4523 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c61b28f-4dcc-40b2-b082-de549dfc800c", "tag": "a579efb9-4d03-4ce2-abba-0c2b61f030d7"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:41:58.908387 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b14c606b-7767-43e5-8766-f22658f39a53 req-1240da40-5ffd-4c0f-b5ee-d9ebcf6b4523 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:58.913109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b14c606b-7767-43e5-8766-f22658f39a53 req-1240da40-5ffd-4c0f-b5ee-d9ebcf6b4523 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:58.913768 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b14c606b-7767-43e5-8766-f22658f39a53 req-1240da40-5ffd-4c0f-b5ee-d9ebcf6b4523 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:58.929989 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-b14c606b-7767-43e5-8766-f22658f39a53 req-1240da40-5ffd-4c0f-b5ee-d9ebcf6b4523 service nova] Creating event network-changed:a579efb9-4d03-4ce2-abba-0c2b61f030d7 for instance 2c61b28f-4dcc-40b2-b082-de549dfc800c on nch1-master-1 Sep 17 21:41:58.936215 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-b14c606b-7767-43e5-8766-f22658f39a53 req-1240da40-5ffd-4c0f-b5ee-d9ebcf6b4523 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046517 Sep 17 21:41:58.937319 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3258/6608] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:41:59.760765 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0bc16d17-6013-43cd-84b8-cc44b5339963 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:41:59.761470 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0bc16d17-6013-43cd-84b8-cc44b5339963 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: 2c61b28f-4dcc-40b2-b082-de549dfc800c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:41:59.768791 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0bc16d17-6013-43cd-84b8-cc44b5339963 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:59.769301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0bc16d17-6013-43cd-84b8-cc44b5339963 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:59.769795 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0bc16d17-6013-43cd-84b8-cc44b5339963 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:59.770546 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0bc16d17-6013-43cd-84b8-cc44b5339963 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:41:59.771012 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0bc16d17-6013-43cd-84b8-cc44b5339963 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:41:59.771471 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0bc16d17-6013-43cd-84b8-cc44b5339963 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:41:59.920219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0bc16d17-6013-43cd-84b8-cc44b5339963 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b52fba1a3a42338b828c5d0313343e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41989440d1c94d3590210e79e8e5303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:41:59.932301 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0bc16d17-6013-43cd-84b8-cc44b5339963 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c" status: 200 len: 1316 microversion: 2.1 time: 0.175312 Sep 17 21:41:59.933192 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3351/6609] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:41:59 2022] GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:42:00.960687 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-92281f6f-e35c-4806-8240-1eee8f522871 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:42:00.961703 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-92281f6f-e35c-4806-8240-1eee8f522871 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: 2c61b28f-4dcc-40b2-b082-de549dfc800c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:42:00.974243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92281f6f-e35c-4806-8240-1eee8f522871 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:00.975210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92281f6f-e35c-4806-8240-1eee8f522871 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:00.975954 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92281f6f-e35c-4806-8240-1eee8f522871 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:00.977114 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92281f6f-e35c-4806-8240-1eee8f522871 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:00.977924 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92281f6f-e35c-4806-8240-1eee8f522871 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:00.978646 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92281f6f-e35c-4806-8240-1eee8f522871 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:01.117734 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-92281f6f-e35c-4806-8240-1eee8f522871 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b52fba1a3a42338b828c5d0313343e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41989440d1c94d3590210e79e8e5303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:42:01.125630 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-92281f6f-e35c-4806-8240-1eee8f522871 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c" status: 200 len: 1316 microversion: 2.1 time: 0.172495 Sep 17 21:42:01.126230 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3259/6610] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:42:00 2022] GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c => generated 1316 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:42:02.151116 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7bbd8970-d74d-4ff1-869b-a62717a8624d tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:42:02.151999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7bbd8970-d74d-4ff1-869b-a62717a8624d tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: 2c61b28f-4dcc-40b2-b082-de549dfc800c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:42:02.160826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7bbd8970-d74d-4ff1-869b-a62717a8624d tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:02.161341 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7bbd8970-d74d-4ff1-869b-a62717a8624d tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:02.161833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7bbd8970-d74d-4ff1-869b-a62717a8624d tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:02.162608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7bbd8970-d74d-4ff1-869b-a62717a8624d tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:02.163093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7bbd8970-d74d-4ff1-869b-a62717a8624d tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:02.163542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7bbd8970-d74d-4ff1-869b-a62717a8624d tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:02.303962 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7bbd8970-d74d-4ff1-869b-a62717a8624d tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b52fba1a3a42338b828c5d0313343e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41989440d1c94d3590210e79e8e5303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:42:02.311999 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7bbd8970-d74d-4ff1-869b-a62717a8624d tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c" status: 200 len: 1316 microversion: 2.1 time: 0.166772 Sep 17 21:42:02.312709 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3352/6611] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:42:02 2022] GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:42:03.338572 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3b714bdf-f555-4d74-954a-c98bd591dafe tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:42:03.339355 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3b714bdf-f555-4d74-954a-c98bd591dafe tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: 2c61b28f-4dcc-40b2-b082-de549dfc800c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:42:03.348778 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3b714bdf-f555-4d74-954a-c98bd591dafe tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:03.349288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3b714bdf-f555-4d74-954a-c98bd591dafe tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:03.349779 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3b714bdf-f555-4d74-954a-c98bd591dafe tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:03.350503 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3b714bdf-f555-4d74-954a-c98bd591dafe tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:03.350970 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3b714bdf-f555-4d74-954a-c98bd591dafe tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:03.351438 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3b714bdf-f555-4d74-954a-c98bd591dafe tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:03.492926 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3b714bdf-f555-4d74-954a-c98bd591dafe tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b52fba1a3a42338b828c5d0313343e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41989440d1c94d3590210e79e8e5303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:42:03.504949 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3b714bdf-f555-4d74-954a-c98bd591dafe tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c" status: 200 len: 1316 microversion: 2.1 time: 0.171981 Sep 17 21:42:03.505554 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3260/6612] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:42:03 2022] GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c => generated 1316 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:42:04.325144 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-a301462c-9371-44dc-a65b-8d7e14e2de47 req-8f44c5a3-099c-478a-af99-a6bda727da58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c61b28f-4dcc-40b2-b082-de549dfc800c", "name": "network-vif-plugged", "status": "completed", "tag": "a579efb9-4d03-4ce2-abba-0c2b61f030d7"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:42:04.336354 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a301462c-9371-44dc-a65b-8d7e14e2de47 req-8f44c5a3-099c-478a-af99-a6bda727da58 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:04.336888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a301462c-9371-44dc-a65b-8d7e14e2de47 req-8f44c5a3-099c-478a-af99-a6bda727da58 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:04.337380 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a301462c-9371-44dc-a65b-8d7e14e2de47 req-8f44c5a3-099c-478a-af99-a6bda727da58 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:04.351419 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-a301462c-9371-44dc-a65b-8d7e14e2de47 req-8f44c5a3-099c-478a-af99-a6bda727da58 service nova] Creating event network-vif-plugged:a579efb9-4d03-4ce2-abba-0c2b61f030d7 for instance 2c61b28f-4dcc-40b2-b082-de549dfc800c on nch1-master-1 Sep 17 21:42:04.356558 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-a301462c-9371-44dc-a65b-8d7e14e2de47 req-8f44c5a3-099c-478a-af99-a6bda727da58 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035238 Sep 17 21:42:04.357231 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3353/6613] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:42:04.528253 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b911110f-0158-4b3a-badc-0729072d4ac5 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:42:04.528844 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b911110f-0158-4b3a-badc-0729072d4ac5 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: 2c61b28f-4dcc-40b2-b082-de549dfc800c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:42:04.536017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b911110f-0158-4b3a-badc-0729072d4ac5 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:04.536499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b911110f-0158-4b3a-badc-0729072d4ac5 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:04.536942 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b911110f-0158-4b3a-badc-0729072d4ac5 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:04.537683 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b911110f-0158-4b3a-badc-0729072d4ac5 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:04.538158 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b911110f-0158-4b3a-badc-0729072d4ac5 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:04.538577 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b911110f-0158-4b3a-badc-0729072d4ac5 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:04.668771 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b911110f-0158-4b3a-badc-0729072d4ac5 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b52fba1a3a42338b828c5d0313343e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41989440d1c94d3590210e79e8e5303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:42:04.677001 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b911110f-0158-4b3a-badc-0729072d4ac5 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c" status: 200 len: 1316 microversion: 2.1 time: 0.152762 Sep 17 21:42:04.677618 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3261/6614] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:42:04 2022] GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:42:05.700702 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1e3be939-03b5-4167-8b90-c88477ae7406 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:42:05.701421 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1e3be939-03b5-4167-8b90-c88477ae7406 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: 2c61b28f-4dcc-40b2-b082-de549dfc800c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:42:05.708172 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e3be939-03b5-4167-8b90-c88477ae7406 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:05.708687 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e3be939-03b5-4167-8b90-c88477ae7406 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:05.709146 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e3be939-03b5-4167-8b90-c88477ae7406 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:05.709906 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e3be939-03b5-4167-8b90-c88477ae7406 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:05.710379 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e3be939-03b5-4167-8b90-c88477ae7406 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:05.710828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1e3be939-03b5-4167-8b90-c88477ae7406 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:05.852942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1e3be939-03b5-4167-8b90-c88477ae7406 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b52fba1a3a42338b828c5d0313343e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41989440d1c94d3590210e79e8e5303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:42:05.865248 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1e3be939-03b5-4167-8b90-c88477ae7406 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c" status: 200 len: 1505 microversion: 2.1 time: 0.169400 Sep 17 21:42:05.866283 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3354/6615] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:42:05 2022] GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c => generated 1505 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:42:05.941449 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e2df43ee-c5b7-4ef3-86b9-1cec26f8d070 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-734773213", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "5c8e0b71-87da-4faf-a538-860122db2835"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:42:06.004731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-e2df43ee-c5b7-4ef3-86b9-1cec26f8d070 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] validate_networks() for [('5c8e0b71-87da-4faf-a538-860122db2835', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:42:06.235121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:42:06.259373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:42:06.405520 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-e2df43ee-c5b7-4ef3-86b9-1cec26f8d070 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:42:06.406196 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-e2df43ee-c5b7-4ef3-86b9-1cec26f8d070 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:42:06.406879 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-e2df43ee-c5b7-4ef3-86b9-1cec26f8d070 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:42:06.407446 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-e2df43ee-c5b7-4ef3-86b9-1cec26f8d070 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:42:06.408022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-e2df43ee-c5b7-4ef3-86b9-1cec26f8d070 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:42:06.418931 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2df43ee-c5b7-4ef3-86b9-1cec26f8d070 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:06.419521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2df43ee-c5b7-4ef3-86b9-1cec26f8d070 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:06.419994 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2df43ee-c5b7-4ef3-86b9-1cec26f8d070 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:06.420730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2df43ee-c5b7-4ef3-86b9-1cec26f8d070 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:06.421211 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2df43ee-c5b7-4ef3-86b9-1cec26f8d070 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:06.421681 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e2df43ee-c5b7-4ef3-86b9-1cec26f8d070 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:06.439828 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-e2df43ee-c5b7-4ef3-86b9-1cec26f8d070 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Getting quotas for project 41989440d1c94d3590210e79e8e5303a. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:42:06.445487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-e2df43ee-c5b7-4ef3-86b9-1cec26f8d070 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Getting quotas for user 59b52fba1a3a42338b828c5d0313343e and project 41989440d1c94d3590210e79e8e5303a. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:42:06.459261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e2df43ee-c5b7-4ef3-86b9-1cec26f8d070 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:42:06.461636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e2df43ee-c5b7-4ef3-86b9-1cec26f8d070 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: c847a07b-75af-47f2-be81-746d5c12fd6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:42:06.511529 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e2df43ee-c5b7-4ef3-86b9-1cec26f8d070 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575327 Sep 17 21:42:06.512159 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3262/6616] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:42:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:42:06.523660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9a5b02fe-9f01-4531-a0df-76ddc0bc8794 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:42:06.524300 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9a5b02fe-9f01-4531-a0df-76ddc0bc8794 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: c847a07b-75af-47f2-be81-746d5c12fd6e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:42:06.526605 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:42:06.580324 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9a5b02fe-9f01-4531-a0df-76ddc0bc8794 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b52fba1a3a42338b828c5d0313343e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41989440d1c94d3590210e79e8e5303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:42:06.587569 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9a5b02fe-9f01-4531-a0df-76ddc0bc8794 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "GET /compute/v2.1/servers/c847a07b-75af-47f2-be81-746d5c12fd6e" status: 200 len: 1216 microversion: 2.1 time: 0.067970 Sep 17 21:42:06.588160 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3355/6617] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:42:06 2022] GET /compute/v2.1/servers/c847a07b-75af-47f2-be81-746d5c12fd6e => generated 1216 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:42:07.614710 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-059e3e2e-e170-4e4c-935b-640fe47524c4 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:42:07.615298 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-059e3e2e-e170-4e4c-935b-640fe47524c4 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: c847a07b-75af-47f2-be81-746d5c12fd6e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:42:07.622804 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-059e3e2e-e170-4e4c-935b-640fe47524c4 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:07.623307 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-059e3e2e-e170-4e4c-935b-640fe47524c4 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:07.623758 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-059e3e2e-e170-4e4c-935b-640fe47524c4 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:07.624473 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-059e3e2e-e170-4e4c-935b-640fe47524c4 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:07.624947 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-059e3e2e-e170-4e4c-935b-640fe47524c4 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:07.625397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-059e3e2e-e170-4e4c-935b-640fe47524c4 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:07.694551 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-059e3e2e-e170-4e4c-935b-640fe47524c4 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b52fba1a3a42338b828c5d0313343e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41989440d1c94d3590210e79e8e5303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:42:07.702891 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-059e3e2e-e170-4e4c-935b-640fe47524c4 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "GET /compute/v2.1/servers/c847a07b-75af-47f2-be81-746d5c12fd6e" status: 200 len: 1268 microversion: 2.1 time: 0.094697 Sep 17 21:42:07.703475 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3263/6618] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:42:07 2022] GET /compute/v2.1/servers/c847a07b-75af-47f2-be81-746d5c12fd6e => generated 1268 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:42:08.726417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ff8e2df8-88b9-41f0-893a-d1ec1b54d1a4 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:42:08.727039 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ff8e2df8-88b9-41f0-893a-d1ec1b54d1a4 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: c847a07b-75af-47f2-be81-746d5c12fd6e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:42:08.735204 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff8e2df8-88b9-41f0-893a-d1ec1b54d1a4 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:08.735691 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff8e2df8-88b9-41f0-893a-d1ec1b54d1a4 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:08.736138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff8e2df8-88b9-41f0-893a-d1ec1b54d1a4 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:08.736851 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff8e2df8-88b9-41f0-893a-d1ec1b54d1a4 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:08.737311 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff8e2df8-88b9-41f0-893a-d1ec1b54d1a4 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:08.737876 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ff8e2df8-88b9-41f0-893a-d1ec1b54d1a4 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:08.937500 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ff8e2df8-88b9-41f0-893a-d1ec1b54d1a4 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b52fba1a3a42338b828c5d0313343e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41989440d1c94d3590210e79e8e5303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:42:08.946055 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ff8e2df8-88b9-41f0-893a-d1ec1b54d1a4 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "GET /compute/v2.1/servers/c847a07b-75af-47f2-be81-746d5c12fd6e" status: 200 len: 1316 microversion: 2.1 time: 0.223465 Sep 17 21:42:08.946434 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3356/6619] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:42:08 2022] GET /compute/v2.1/servers/c847a07b-75af-47f2-be81-746d5c12fd6e => generated 1316 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:42:09.351102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-23087c9e-bc73-4170-9852-e55b88d36f30 req-90652c1a-b6dd-4a9f-a159-e271508d79d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c847a07b-75af-47f2-be81-746d5c12fd6e", "tag": "130966fb-58b0-4ae6-8267-3b1ab6ba461e"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:42:09.361135 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-23087c9e-bc73-4170-9852-e55b88d36f30 req-90652c1a-b6dd-4a9f-a159-e271508d79d0 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:09.361754 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-23087c9e-bc73-4170-9852-e55b88d36f30 req-90652c1a-b6dd-4a9f-a159-e271508d79d0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:09.362193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-23087c9e-bc73-4170-9852-e55b88d36f30 req-90652c1a-b6dd-4a9f-a159-e271508d79d0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:09.373985 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-23087c9e-bc73-4170-9852-e55b88d36f30 req-90652c1a-b6dd-4a9f-a159-e271508d79d0 service nova] Creating event network-changed:130966fb-58b0-4ae6-8267-3b1ab6ba461e for instance c847a07b-75af-47f2-be81-746d5c12fd6e on nch2-master-1 Sep 17 21:42:09.379025 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-23087c9e-bc73-4170-9852-e55b88d36f30 req-90652c1a-b6dd-4a9f-a159-e271508d79d0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119179 Sep 17 21:42:09.379634 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3264/6620] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:42:09.974488 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-31fb0e01-9702-4439-8ded-3baea5de3e5f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:42:09.975381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-31fb0e01-9702-4439-8ded-3baea5de3e5f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: c847a07b-75af-47f2-be81-746d5c12fd6e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:42:09.987229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31fb0e01-9702-4439-8ded-3baea5de3e5f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:09.988043 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31fb0e01-9702-4439-8ded-3baea5de3e5f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:09.988498 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31fb0e01-9702-4439-8ded-3baea5de3e5f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:09.989221 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31fb0e01-9702-4439-8ded-3baea5de3e5f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:09.989739 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31fb0e01-9702-4439-8ded-3baea5de3e5f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:09.990187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-31fb0e01-9702-4439-8ded-3baea5de3e5f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:10.134566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-31fb0e01-9702-4439-8ded-3baea5de3e5f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b52fba1a3a42338b828c5d0313343e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41989440d1c94d3590210e79e8e5303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:42:10.146844 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-31fb0e01-9702-4439-8ded-3baea5de3e5f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "GET /compute/v2.1/servers/c847a07b-75af-47f2-be81-746d5c12fd6e" status: 200 len: 1316 microversion: 2.1 time: 0.178725 Sep 17 21:42:10.147666 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3357/6621] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:42:09 2022] GET /compute/v2.1/servers/c847a07b-75af-47f2-be81-746d5c12fd6e => generated 1316 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:42:11.177317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-279c3bdc-01e2-4f7e-b96d-cc35c48fa178 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:42:11.178060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-279c3bdc-01e2-4f7e-b96d-cc35c48fa178 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: c847a07b-75af-47f2-be81-746d5c12fd6e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:42:11.184592 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-279c3bdc-01e2-4f7e-b96d-cc35c48fa178 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:11.185075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-279c3bdc-01e2-4f7e-b96d-cc35c48fa178 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:11.185551 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-279c3bdc-01e2-4f7e-b96d-cc35c48fa178 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:11.186270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-279c3bdc-01e2-4f7e-b96d-cc35c48fa178 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:11.186731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-279c3bdc-01e2-4f7e-b96d-cc35c48fa178 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:11.187162 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-279c3bdc-01e2-4f7e-b96d-cc35c48fa178 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:11.668410 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-279c3bdc-01e2-4f7e-b96d-cc35c48fa178 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b52fba1a3a42338b828c5d0313343e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41989440d1c94d3590210e79e8e5303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:42:11.676952 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-279c3bdc-01e2-4f7e-b96d-cc35c48fa178 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "GET /compute/v2.1/servers/c847a07b-75af-47f2-be81-746d5c12fd6e" status: 200 len: 1316 microversion: 2.1 time: 0.505001 Sep 17 21:42:11.677547 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3265/6622] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:42:11 2022] GET /compute/v2.1/servers/c847a07b-75af-47f2-be81-746d5c12fd6e => generated 1316 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:42:12.705638 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d248d716-ee43-4010-9651-c9a61cd458a8 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:42:12.706276 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d248d716-ee43-4010-9651-c9a61cd458a8 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: c847a07b-75af-47f2-be81-746d5c12fd6e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:42:12.713682 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d248d716-ee43-4010-9651-c9a61cd458a8 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:12.714209 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d248d716-ee43-4010-9651-c9a61cd458a8 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:12.714664 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d248d716-ee43-4010-9651-c9a61cd458a8 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:12.715722 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d248d716-ee43-4010-9651-c9a61cd458a8 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:12.716223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d248d716-ee43-4010-9651-c9a61cd458a8 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:12.716660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d248d716-ee43-4010-9651-c9a61cd458a8 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:12.851062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d248d716-ee43-4010-9651-c9a61cd458a8 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b52fba1a3a42338b828c5d0313343e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41989440d1c94d3590210e79e8e5303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:42:12.859351 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d248d716-ee43-4010-9651-c9a61cd458a8 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "GET /compute/v2.1/servers/c847a07b-75af-47f2-be81-746d5c12fd6e" status: 200 len: 1316 microversion: 2.1 time: 0.160063 Sep 17 21:42:12.859929 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3358/6623] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:42:12 2022] GET /compute/v2.1/servers/c847a07b-75af-47f2-be81-746d5c12fd6e => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:42:13.885702 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6bd48f17-3914-4a8d-ba29-58b79c9917c2 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:42:13.886461 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6bd48f17-3914-4a8d-ba29-58b79c9917c2 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: c847a07b-75af-47f2-be81-746d5c12fd6e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:42:13.895479 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6bd48f17-3914-4a8d-ba29-58b79c9917c2 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:13.896097 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6bd48f17-3914-4a8d-ba29-58b79c9917c2 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:13.896652 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6bd48f17-3914-4a8d-ba29-58b79c9917c2 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:13.897548 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6bd48f17-3914-4a8d-ba29-58b79c9917c2 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:13.898165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6bd48f17-3914-4a8d-ba29-58b79c9917c2 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:13.898710 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6bd48f17-3914-4a8d-ba29-58b79c9917c2 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:14.038647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6bd48f17-3914-4a8d-ba29-58b79c9917c2 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b52fba1a3a42338b828c5d0313343e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41989440d1c94d3590210e79e8e5303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:42:14.046850 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6bd48f17-3914-4a8d-ba29-58b79c9917c2 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "GET /compute/v2.1/servers/c847a07b-75af-47f2-be81-746d5c12fd6e" status: 200 len: 1316 microversion: 2.1 time: 0.166240 Sep 17 21:42:14.047434 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3266/6624] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:42:13 2022] GET /compute/v2.1/servers/c847a07b-75af-47f2-be81-746d5c12fd6e => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:42:14.195683 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-6b21cffe-1abb-48e0-8d20-160af961f90a req-f4498684-828f-4d38-b176-d2af9d50a05c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c847a07b-75af-47f2-be81-746d5c12fd6e", "name": "network-vif-plugged", "status": "completed", "tag": "130966fb-58b0-4ae6-8267-3b1ab6ba461e"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:42:14.206710 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6b21cffe-1abb-48e0-8d20-160af961f90a req-f4498684-828f-4d38-b176-d2af9d50a05c service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:14.207226 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6b21cffe-1abb-48e0-8d20-160af961f90a req-f4498684-828f-4d38-b176-d2af9d50a05c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:14.207827 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6b21cffe-1abb-48e0-8d20-160af961f90a req-f4498684-828f-4d38-b176-d2af9d50a05c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:14.224831 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-6b21cffe-1abb-48e0-8d20-160af961f90a req-f4498684-828f-4d38-b176-d2af9d50a05c service nova] Creating event network-vif-plugged:130966fb-58b0-4ae6-8267-3b1ab6ba461e for instance c847a07b-75af-47f2-be81-746d5c12fd6e on nch2-master-1 Sep 17 21:42:14.229983 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-6b21cffe-1abb-48e0-8d20-160af961f90a req-f4498684-828f-4d38-b176-d2af9d50a05c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038213 Sep 17 21:42:14.230595 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3359/6625] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:42:15.074739 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4dd4373e-1d53-4de0-b002-38f6fb96caeb tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:42:15.075741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4dd4373e-1d53-4de0-b002-38f6fb96caeb tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: c847a07b-75af-47f2-be81-746d5c12fd6e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:42:15.085937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4dd4373e-1d53-4de0-b002-38f6fb96caeb tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:15.086433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4dd4373e-1d53-4de0-b002-38f6fb96caeb tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:15.086901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4dd4373e-1d53-4de0-b002-38f6fb96caeb tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:15.087602 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4dd4373e-1d53-4de0-b002-38f6fb96caeb tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:15.088060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4dd4373e-1d53-4de0-b002-38f6fb96caeb tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:15.088486 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4dd4373e-1d53-4de0-b002-38f6fb96caeb tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:15.223599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4dd4373e-1d53-4de0-b002-38f6fb96caeb tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b52fba1a3a42338b828c5d0313343e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41989440d1c94d3590210e79e8e5303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:42:15.231734 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4dd4373e-1d53-4de0-b002-38f6fb96caeb tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "GET /compute/v2.1/servers/c847a07b-75af-47f2-be81-746d5c12fd6e" status: 200 len: 1316 microversion: 2.1 time: 0.163933 Sep 17 21:42:15.232313 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3267/6626] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:42:15 2022] GET /compute/v2.1/servers/c847a07b-75af-47f2-be81-746d5c12fd6e => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:42:16.258900 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8a905232-0f2c-44fe-975c-c6eaa3e0da86 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:42:16.259628 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8a905232-0f2c-44fe-975c-c6eaa3e0da86 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: c847a07b-75af-47f2-be81-746d5c12fd6e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:42:16.266809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a905232-0f2c-44fe-975c-c6eaa3e0da86 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:16.267335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a905232-0f2c-44fe-975c-c6eaa3e0da86 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:16.267768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a905232-0f2c-44fe-975c-c6eaa3e0da86 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:16.268479 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a905232-0f2c-44fe-975c-c6eaa3e0da86 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:16.268952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a905232-0f2c-44fe-975c-c6eaa3e0da86 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:16.269397 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a905232-0f2c-44fe-975c-c6eaa3e0da86 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:16.404811 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8a905232-0f2c-44fe-975c-c6eaa3e0da86 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b52fba1a3a42338b828c5d0313343e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41989440d1c94d3590210e79e8e5303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:42:16.412852 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8a905232-0f2c-44fe-975c-c6eaa3e0da86 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "GET /compute/v2.1/servers/c847a07b-75af-47f2-be81-746d5c12fd6e" status: 200 len: 1505 microversion: 2.1 time: 0.159587 Sep 17 21:42:16.413424 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3360/6627] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:42:16 2022] GET /compute/v2.1/servers/c847a07b-75af-47f2-be81-746d5c12fd6e => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:42:16.435574 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0baad504-a0ba-4d75-9d03-25a2c6082b7f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:42:16.436105 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0baad504-a0ba-4d75-9d03-25a2c6082b7f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: c847a07b-75af-47f2-be81-746d5c12fd6e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:42:16.438978 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:42:16.445169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0baad504-a0ba-4d75-9d03-25a2c6082b7f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:16.445714 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0baad504-a0ba-4d75-9d03-25a2c6082b7f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:16.446154 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0baad504-a0ba-4d75-9d03-25a2c6082b7f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:16.446856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0baad504-a0ba-4d75-9d03-25a2c6082b7f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:16.447311 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0baad504-a0ba-4d75-9d03-25a2c6082b7f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:16.447738 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0baad504-a0ba-4d75-9d03-25a2c6082b7f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:16.452055 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:42:16.477837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0baad504-a0ba-4d75-9d03-25a2c6082b7f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: c847a07b-75af-47f2-be81-746d5c12fd6e] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:42:16.560001 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0baad504-a0ba-4d75-9d03-25a2c6082b7f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c847a07b-75af-47f2-be81-746d5c12fd6e" status: 204 len: 0 microversion: 2.1 time: 0.127953 Sep 17 21:42:16.560636 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3268/6628] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:42:16 2022] DELETE /compute/v2.1/servers/c847a07b-75af-47f2-be81-746d5c12fd6e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 17 21:42:16.569389 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-13630d5e-5f4b-4eee-b141-658c001b6ddb tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:42:16.570051 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-13630d5e-5f4b-4eee-b141-658c001b6ddb tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: c847a07b-75af-47f2-be81-746d5c12fd6e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:42:16.576359 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-13630d5e-5f4b-4eee-b141-658c001b6ddb tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:16.576865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-13630d5e-5f4b-4eee-b141-658c001b6ddb tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:16.577320 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-13630d5e-5f4b-4eee-b141-658c001b6ddb tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:16.578063 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-13630d5e-5f4b-4eee-b141-658c001b6ddb tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:16.578535 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-13630d5e-5f4b-4eee-b141-658c001b6ddb tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:16.578980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-13630d5e-5f4b-4eee-b141-658c001b6ddb tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:16.584364 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:42:16.717718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-13630d5e-5f4b-4eee-b141-658c001b6ddb tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b52fba1a3a42338b828c5d0313343e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41989440d1c94d3590210e79e8e5303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:42:16.726000 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-13630d5e-5f4b-4eee-b141-658c001b6ddb tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "GET /compute/v2.1/servers/c847a07b-75af-47f2-be81-746d5c12fd6e" status: 200 len: 1511 microversion: 2.1 time: 0.160635 Sep 17 21:42:16.726584 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3361/6629] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:42:16 2022] GET /compute/v2.1/servers/c847a07b-75af-47f2-be81-746d5c12fd6e => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:42:17.753374 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-64a834df-9f3a-4ac5-bbf9-d9e22f16689f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:42:17.754059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-64a834df-9f3a-4ac5-bbf9-d9e22f16689f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: c847a07b-75af-47f2-be81-746d5c12fd6e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:42:17.762413 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-64a834df-9f3a-4ac5-bbf9-d9e22f16689f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:17.762907 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-64a834df-9f3a-4ac5-bbf9-d9e22f16689f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:17.763355 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-64a834df-9f3a-4ac5-bbf9-d9e22f16689f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:17.764063 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-64a834df-9f3a-4ac5-bbf9-d9e22f16689f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:17.764528 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-64a834df-9f3a-4ac5-bbf9-d9e22f16689f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:17.764969 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-64a834df-9f3a-4ac5-bbf9-d9e22f16689f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:17.968097 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-64a834df-9f3a-4ac5-bbf9-d9e22f16689f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b52fba1a3a42338b828c5d0313343e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41989440d1c94d3590210e79e8e5303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:42:17.976523 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-64a834df-9f3a-4ac5-bbf9-d9e22f16689f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "GET /compute/v2.1/servers/c847a07b-75af-47f2-be81-746d5c12fd6e" status: 200 len: 1511 microversion: 2.1 time: 0.229985 Sep 17 21:42:17.977116 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3269/6630] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:42:17 2022] GET /compute/v2.1/servers/c847a07b-75af-47f2-be81-746d5c12fd6e => generated 1511 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:42:18.366888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-206dbe0b-33f7-47b5-a451-741ccba59ac6 req-90a72fdd-c206-4e42-95e5-15a70ed4bebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c847a07b-75af-47f2-be81-746d5c12fd6e", "name": "network-vif-deleted", "tag": "130966fb-58b0-4ae6-8267-3b1ab6ba461e"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:42:18.386438 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-206dbe0b-33f7-47b5-a451-741ccba59ac6 req-90a72fdd-c206-4e42-95e5-15a70ed4bebf service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:18.387343 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-206dbe0b-33f7-47b5-a451-741ccba59ac6 req-90a72fdd-c206-4e42-95e5-15a70ed4bebf service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:18.387797 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-206dbe0b-33f7-47b5-a451-741ccba59ac6 req-90a72fdd-c206-4e42-95e5-15a70ed4bebf service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:18.403394 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-206dbe0b-33f7-47b5-a451-741ccba59ac6 req-90a72fdd-c206-4e42-95e5-15a70ed4bebf service nova] Creating event network-vif-deleted:130966fb-58b0-4ae6-8267-3b1ab6ba461e for instance c847a07b-75af-47f2-be81-746d5c12fd6e on nch2-master-1 Sep 17 21:42:18.411335 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-206dbe0b-33f7-47b5-a451-741ccba59ac6 req-90a72fdd-c206-4e42-95e5-15a70ed4bebf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047693 Sep 17 21:42:18.412354 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3362/6631] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:42:19.002608 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f87aa061-559f-4deb-a587-69583dc8400b tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:42:19.003383 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f87aa061-559f-4deb-a587-69583dc8400b tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: c847a07b-75af-47f2-be81-746d5c12fd6e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:42:19.011748 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f87aa061-559f-4deb-a587-69583dc8400b tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:19.012245 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f87aa061-559f-4deb-a587-69583dc8400b tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:19.012692 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f87aa061-559f-4deb-a587-69583dc8400b tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:19.013433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f87aa061-559f-4deb-a587-69583dc8400b tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:19.013933 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f87aa061-559f-4deb-a587-69583dc8400b tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:19.014370 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f87aa061-559f-4deb-a587-69583dc8400b tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:19.028244 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-f87aa061-559f-4deb-a587-69583dc8400b tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] HTTP exception thrown: Instance c847a07b-75af-47f2-be81-746d5c12fd6e could not be found. Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f87aa061-559f-4deb-a587-69583dc8400b tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Request method failure captured: Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/c847a07b-75af-47f2-be81-746d5c12fd6e HTTP/1.1 Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJj8jK2EJkA_ANb4NGsJyXC71fTcS-Xa9bCGzRc3xHxamww9imArJL14EBvmI1l2U5ocE77D8GxXLPAsW3Evqj6quycNsiFHAC_qK10Bpkn_bE-o8q2PpVLuyQqNahFkhwCTHlQLMVM6DqBMHTSxgAySf9WPUOQxXdYZtSIetZn4YfAA Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 41989440d1c94d3590210e79e8e5303a Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersNegativeTestJSON-1497830483 Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/41989440d1c94d3590210e79e8e5303a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/41989440d1c94d3590210e79e8e5303a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/41989440d1c94d3590210e79e8e5303a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_41989440d1c94d3590210e79e8e5303a", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersNegativeTestJSON-1497830483 Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 41989440d1c94d3590210e79e8e5303a Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1497830483 Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersNegativeTestJSON-1497830483-project Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 59b52fba1a3a42338b828c5d0313343e Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersNegativeTestJSON-1497830483-project Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance c847a07b-75af-47f2-be81-746d5c12fd6e could not be found. Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'c847a07b-75af-47f2-be81-746d5c12fd6e'} Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c847a07b-75af-47f2-be81-746d5c12fd6e could not be found. Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c847a07b-75af-47f2-be81-746d5c12fd6e could not be found. Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:42:19.030711 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:42:19.035466 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:42:19.035466 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:42:19.035466 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:42:19.035466 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:42:19.035466 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:42:19.035466 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c847a07b-75af-47f2-be81-746d5c12fd6e could not be found. Sep 17 21:42:19.035466 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:42:19.035466 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f87aa061-559f-4deb-a587-69583dc8400b tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Returning 404 to user: Instance c847a07b-75af-47f2-be81-746d5c12fd6e could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:42:19.035466 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f87aa061-559f-4deb-a587-69583dc8400b tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "GET /compute/v2.1/servers/c847a07b-75af-47f2-be81-746d5c12fd6e" status: 404 len: 111 microversion: 2.1 time: 0.035038 Sep 17 21:42:19.035466 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3270/6632] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:42:18 2022] GET /compute/v2.1/servers/c847a07b-75af-47f2-be81-746d5c12fd6e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:42:19.042026 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-38da61a1-f76a-4c21-8c57-5e722342f40c tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:42:19.042753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-38da61a1-f76a-4c21-8c57-5e722342f40c tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: 2c61b28f-4dcc-40b2-b082-de549dfc800c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:42:19.049177 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-38da61a1-f76a-4c21-8c57-5e722342f40c tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:19.049745 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-38da61a1-f76a-4c21-8c57-5e722342f40c tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:19.050176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-38da61a1-f76a-4c21-8c57-5e722342f40c tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:19.050890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-38da61a1-f76a-4c21-8c57-5e722342f40c tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:19.051360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-38da61a1-f76a-4c21-8c57-5e722342f40c tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:19.051803 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-38da61a1-f76a-4c21-8c57-5e722342f40c tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:19.192794 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-38da61a1-f76a-4c21-8c57-5e722342f40c tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b52fba1a3a42338b828c5d0313343e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41989440d1c94d3590210e79e8e5303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:42:19.201309 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-38da61a1-f76a-4c21-8c57-5e722342f40c tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c" status: 200 len: 1505 microversion: 2.1 time: 0.163677 Sep 17 21:42:19.201926 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3363/6633] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:42:19 2022] GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:42:19.224657 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bb47847c-7b71-429a-9294-d51d36c23948 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:42:19.227137 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bb47847c-7b71-429a-9294-d51d36c23948 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: f9478b07-550e-45d6-953f-efb5daa5d34e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:42:19.232941 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-bb47847c-7b71-429a-9294-d51d36c23948 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] HTTP exception thrown: Instance f9478b07-550e-45d6-953f-efb5daa5d34e could not be found. Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bb47847c-7b71-429a-9294-d51d36c23948 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Request method failure captured: Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers/f9478b07-550e-45d6-953f-efb5daa5d34e/action HTTP/1.1 Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 32 Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJj8jK2EJkA_ANb4NGsJyXC71fTcS-Xa9bCGzRc3xHxamww9imArJL14EBvmI1l2U5ocE77D8GxXLPAsW3Evqj6quycNsiFHAC_qK10Bpkn_bE-o8q2PpVLuyQqNahFkhwCTHlQLMVM6DqBMHTSxgAySf9WPUOQxXdYZtSIetZn4YfAA Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 41989440d1c94d3590210e79e8e5303a Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersNegativeTestJSON-1497830483 Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/41989440d1c94d3590210e79e8e5303a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/41989440d1c94d3590210e79e8e5303a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/41989440d1c94d3590210e79e8e5303a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_41989440d1c94d3590210e79e8e5303a", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersNegativeTestJSON-1497830483 Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 41989440d1c94d3590210e79e8e5303a Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1497830483 Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersNegativeTestJSON-1497830483-project Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 59b52fba1a3a42338b828c5d0313343e Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersNegativeTestJSON-1497830483-project Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: {"resize": {"flavorRef": "452"}} Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance f9478b07-550e-45d6-953f-efb5daa5d34e could not be found. Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'f9478b07-550e-45d6-953f-efb5daa5d34e', 'body': {'resize': {'flavorRef': '452'}}} Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9478b07-550e-45d6-953f-efb5daa5d34e could not be found. Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:42:19.234713 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:42:19.239752 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9478b07-550e-45d6-953f-efb5daa5d34e could not be found. Sep 17 21:42:19.239752 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:42:19.239752 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:42:19.239752 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:42:19.239752 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:42:19.239752 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:42:19.239752 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:42:19.239752 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:42:19.239752 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:42:19.239752 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9478b07-550e-45d6-953f-efb5daa5d34e could not be found. Sep 17 21:42:19.239752 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:42:19.239752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bb47847c-7b71-429a-9294-d51d36c23948 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Returning 404 to user: Instance f9478b07-550e-45d6-953f-efb5daa5d34e could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:42:19.239752 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bb47847c-7b71-429a-9294-d51d36c23948 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "POST /compute/v2.1/servers/f9478b07-550e-45d6-953f-efb5daa5d34e/action" status: 404 len: 111 microversion: 2.1 time: 0.015881 Sep 17 21:42:19.239752 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3271/6634] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:42:19 2022] POST /compute/v2.1/servers/f9478b07-550e-45d6-953f-efb5daa5d34e/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:42:19.244890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b94c3ae4-c9ae-455c-84dd-5a52f138774f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:42:19.245558 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b94c3ae4-c9ae-455c-84dd-5a52f138774f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: 2c61b28f-4dcc-40b2-b082-de549dfc800c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:42:19.251742 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b94c3ae4-c9ae-455c-84dd-5a52f138774f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:19.252264 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b94c3ae4-c9ae-455c-84dd-5a52f138774f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:19.252722 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b94c3ae4-c9ae-455c-84dd-5a52f138774f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:19.253431 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b94c3ae4-c9ae-455c-84dd-5a52f138774f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:19.253949 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b94c3ae4-c9ae-455c-84dd-5a52f138774f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:19.254390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b94c3ae4-c9ae-455c-84dd-5a52f138774f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:19.391659 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b94c3ae4-c9ae-455c-84dd-5a52f138774f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b52fba1a3a42338b828c5d0313343e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41989440d1c94d3590210e79e8e5303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:42:19.399947 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b94c3ae4-c9ae-455c-84dd-5a52f138774f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c" status: 200 len: 1505 microversion: 2.1 time: 0.159002 Sep 17 21:42:19.400536 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3364/6635] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:42:19 2022] GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:42:19.423001 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d80943a1-2408-4760-b537-5d291e2a50ff tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:42:19.423624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d80943a1-2408-4760-b537-5d291e2a50ff tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: 2c61b28f-4dcc-40b2-b082-de549dfc800c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:42:19.431022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d80943a1-2408-4760-b537-5d291e2a50ff tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:19.431514 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d80943a1-2408-4760-b537-5d291e2a50ff tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:19.431965 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d80943a1-2408-4760-b537-5d291e2a50ff tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:19.432657 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d80943a1-2408-4760-b537-5d291e2a50ff tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:19.433115 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d80943a1-2408-4760-b537-5d291e2a50ff tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:19.433604 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d80943a1-2408-4760-b537-5d291e2a50ff tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:19.565046 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d80943a1-2408-4760-b537-5d291e2a50ff tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b52fba1a3a42338b828c5d0313343e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41989440d1c94d3590210e79e8e5303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:42:19.573822 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d80943a1-2408-4760-b537-5d291e2a50ff tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c" status: 200 len: 1505 microversion: 2.1 time: 0.154741 Sep 17 21:42:19.574436 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3272/6636] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:42:19 2022] GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:42:19.596715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b6411795-8ab6-4b38-92fe-fe4c7c7cb61f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "485fa481-22e1-4696-b675-7b3584039d83"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:42:19.599022 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b6411795-8ab6-4b38-92fe-fe4c7c7cb61f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: 2c61b28f-4dcc-40b2-b082-de549dfc800c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:42:19.605447 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b6411795-8ab6-4b38-92fe-fe4c7c7cb61f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:19.605987 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b6411795-8ab6-4b38-92fe-fe4c7c7cb61f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:19.606441 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b6411795-8ab6-4b38-92fe-fe4c7c7cb61f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:19.607150 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b6411795-8ab6-4b38-92fe-fe4c7c7cb61f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:19.607621 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b6411795-8ab6-4b38-92fe-fe4c7c7cb61f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:19.608061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b6411795-8ab6-4b38-92fe-fe4c7c7cb61f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:19.635994 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b6411795-8ab6-4b38-92fe-fe4c7c7cb61f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '59b52fba1a3a42338b828c5d0313343e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41989440d1c94d3590210e79e8e5303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:42:19.640768 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-b6411795-8ab6-4b38-92fe-fe4c7c7cb61f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] HTTP exception thrown: Flavor 485fa481-22e1-4696-b675-7b3584039d83 could not be found. Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b6411795-8ab6-4b38-92fe-fe4c7c7cb61f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Request method failure captured: Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: request: POST /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c/action HTTP/1.1 Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 65 Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJj8jK2EJkA_ANb4NGsJyXC71fTcS-Xa9bCGzRc3xHxamww9imArJL14EBvmI1l2U5ocE77D8GxXLPAsW3Evqj6quycNsiFHAC_qK10Bpkn_bE-o8q2PpVLuyQqNahFkhwCTHlQLMVM6DqBMHTSxgAySf9WPUOQxXdYZtSIetZn4YfAA Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 41989440d1c94d3590210e79e8e5303a Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersNegativeTestJSON-1497830483 Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/41989440d1c94d3590210e79e8e5303a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/41989440d1c94d3590210e79e8e5303a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/41989440d1c94d3590210e79e8e5303a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_41989440d1c94d3590210e79e8e5303a", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersNegativeTestJSON-1497830483 Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 41989440d1c94d3590210e79e8e5303a Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1497830483 Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersNegativeTestJSON-1497830483-project Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 59b52fba1a3a42338b828c5d0313343e Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersNegativeTestJSON-1497830483-project Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: {"resize": {"flavorRef": "485fa481-22e1-4696-b675-7b3584039d83"}} Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: exception: Flavor 485fa481-22e1-4696-b675-7b3584039d83 could not be found. Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '2c61b28f-4dcc-40b2-b082-de549dfc800c', 'body': {'resize': {'flavorRef': '485fa481-22e1-4696-b675-7b3584039d83'}}} Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:42:19.642769 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 17 21:42:19.647143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 17 21:42:19.647143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 485fa481-22e1-4696-b675-7b3584039d83 could not be found. Sep 17 21:42:19.647143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:42:19.647143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:42:19.647143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:42:19.647143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:42:19.647143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:42:19.647143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:42:19.647143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:42:19.647143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:42:19.647143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:42:19.647143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:42:19.647143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 17 21:42:19.647143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 17 21:42:19.647143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 17 21:42:19.647143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 17 21:42:19.647143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Sep 17 21:42:19.647143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 17 21:42:19.647143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 485fa481-22e1-4696-b675-7b3584039d83 could not be found. Sep 17 21:42:19.647143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:42:19.647143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:42:19.647143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:42:19.647143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:42:19.647143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:42:19.647143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:42:19.647143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:42:19.647143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:42:19.647143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 485fa481-22e1-4696-b675-7b3584039d83 could not be found. Sep 17 21:42:19.647143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:42:19.647143 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b6411795-8ab6-4b38-92fe-fe4c7c7cb61f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Returning 400 to user: Flavor 485fa481-22e1-4696-b675-7b3584039d83 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:42:19.647143 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b6411795-8ab6-4b38-92fe-fe4c7c7cb61f tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "POST /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c/action" status: 400 len: 107 microversion: 2.1 time: 0.051590 Sep 17 21:42:19.647143 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3365/6637] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:42:19 2022] POST /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c/action => generated 107 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:42:19.653318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5bf0d37e-36ec-4330-bbd4-a5293bc521b8 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:42:19.653973 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5bf0d37e-36ec-4330-bbd4-a5293bc521b8 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: 2c61b28f-4dcc-40b2-b082-de549dfc800c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:42:19.660380 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5bf0d37e-36ec-4330-bbd4-a5293bc521b8 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:19.660877 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5bf0d37e-36ec-4330-bbd4-a5293bc521b8 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:19.661311 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5bf0d37e-36ec-4330-bbd4-a5293bc521b8 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:19.662046 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5bf0d37e-36ec-4330-bbd4-a5293bc521b8 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:19.662502 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5bf0d37e-36ec-4330-bbd4-a5293bc521b8 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:19.662932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5bf0d37e-36ec-4330-bbd4-a5293bc521b8 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:19.801974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5bf0d37e-36ec-4330-bbd4-a5293bc521b8 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b52fba1a3a42338b828c5d0313343e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41989440d1c94d3590210e79e8e5303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:42:19.810457 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5bf0d37e-36ec-4330-bbd4-a5293bc521b8 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c" status: 200 len: 1505 microversion: 2.1 time: 0.161180 Sep 17 21:42:19.811014 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3273/6638] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:42:19 2022] GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:42:19.834031 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-41431f48-ef0c-4fcd-a432-6775cbb68476 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:42:19.834626 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-41431f48-ef0c-4fcd-a432-6775cbb68476 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: 2c61b28f-4dcc-40b2-b082-de549dfc800c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:42:19.841604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-41431f48-ef0c-4fcd-a432-6775cbb68476 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:19.842104 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-41431f48-ef0c-4fcd-a432-6775cbb68476 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:19.842559 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-41431f48-ef0c-4fcd-a432-6775cbb68476 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:19.843273 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-41431f48-ef0c-4fcd-a432-6775cbb68476 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:19.843745 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-41431f48-ef0c-4fcd-a432-6775cbb68476 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:19.844185 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-41431f48-ef0c-4fcd-a432-6775cbb68476 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:19.979702 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-41431f48-ef0c-4fcd-a432-6775cbb68476 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b52fba1a3a42338b828c5d0313343e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41989440d1c94d3590210e79e8e5303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:42:19.987863 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-41431f48-ef0c-4fcd-a432-6775cbb68476 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c" status: 200 len: 1505 microversion: 2.1 time: 0.157798 Sep 17 21:42:19.988437 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3366/6639] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:42:19 2022] GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:42:20.010390 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-eb081c94-9431-468d-b547-078707fb7997 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-eb081c94-9431-468d-b547-078707fb7997 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Request method failure captured: Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: request: POST /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c/action HTTP/1.1 Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 29 Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJj8jK2EJkA_ANb4NGsJyXC71fTcS-Xa9bCGzRc3xHxamww9imArJL14EBvmI1l2U5ocE77D8GxXLPAsW3Evqj6quycNsiFHAC_qK10Bpkn_bE-o8q2PpVLuyQqNahFkhwCTHlQLMVM6DqBMHTSxgAySf9WPUOQxXdYZtSIetZn4YfAA Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 41989440d1c94d3590210e79e8e5303a Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersNegativeTestJSON-1497830483 Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/41989440d1c94d3590210e79e8e5303a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/41989440d1c94d3590210e79e8e5303a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/41989440d1c94d3590210e79e8e5303a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_41989440d1c94d3590210e79e8e5303a", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersNegativeTestJSON-1497830483 Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 41989440d1c94d3590210e79e8e5303a Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1497830483 Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersNegativeTestJSON-1497830483-project Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 59b52fba1a3a42338b828c5d0313343e Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersNegativeTestJSON-1497830483-project Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: {"resize": {"flavorRef": ""}} Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '2c61b28f-4dcc-40b2-b082-de549dfc800c', 'body': {'resize': {'flavorRef': ''}}} Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise error Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi On instance['resize']: Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi '' Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:42:20.014273 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:42:20.019540 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:42:20.019540 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:42:20.019540 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:42:20.019540 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:42:20.019540 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 17 21:42:20.019540 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 17 21:42:20.019540 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 17 21:42:20.019540 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:42:20.019540 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-eb081c94-9431-468d-b547-078707fb7997 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:42:20.019540 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-eb081c94-9431-468d-b547-078707fb7997 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "POST /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c/action" status: 400 len: 113 microversion: 2.1 time: 0.009483 Sep 17 21:42:20.019540 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3274/6640] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:42:20 2022] POST /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 17 21:42:20.023913 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4d3cb39e-1bc4-44e4-b3b3-13b586646d7c tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:42:20.024543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4d3cb39e-1bc4-44e4-b3b3-13b586646d7c tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: 2c61b28f-4dcc-40b2-b082-de549dfc800c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:42:20.030689 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d3cb39e-1bc4-44e4-b3b3-13b586646d7c tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:20.031188 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d3cb39e-1bc4-44e4-b3b3-13b586646d7c tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:20.031648 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d3cb39e-1bc4-44e4-b3b3-13b586646d7c tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:20.032361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d3cb39e-1bc4-44e4-b3b3-13b586646d7c tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:20.032833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d3cb39e-1bc4-44e4-b3b3-13b586646d7c tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:20.033279 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4d3cb39e-1bc4-44e4-b3b3-13b586646d7c tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:20.166693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4d3cb39e-1bc4-44e4-b3b3-13b586646d7c tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b52fba1a3a42338b828c5d0313343e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41989440d1c94d3590210e79e8e5303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:42:20.175009 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4d3cb39e-1bc4-44e4-b3b3-13b586646d7c tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c" status: 200 len: 1505 microversion: 2.1 time: 0.154965 Sep 17 21:42:20.175633 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3367/6641] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:42:20 2022] GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:42:20.204343 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-01fd3365-843e-4672-835a-a2a256523533 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:42:20.204805 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-01fd3365-843e-4672-835a-a2a256523533 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: c847a07b-75af-47f2-be81-746d5c12fd6e] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:42:20.212590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01fd3365-843e-4672-835a-a2a256523533 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:20.213095 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01fd3365-843e-4672-835a-a2a256523533 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:20.213575 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01fd3365-843e-4672-835a-a2a256523533 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:20.214305 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01fd3365-843e-4672-835a-a2a256523533 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:20.214772 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01fd3365-843e-4672-835a-a2a256523533 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:20.215214 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-01fd3365-843e-4672-835a-a2a256523533 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:20.230025 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-01fd3365-843e-4672-835a-a2a256523533 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] HTTP exception thrown: Instance c847a07b-75af-47f2-be81-746d5c12fd6e could not be found. Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-01fd3365-843e-4672-835a-a2a256523533 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Request method failure captured: Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/c847a07b-75af-47f2-be81-746d5c12fd6e HTTP/1.1 Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJj8jK2EJkA_ANb4NGsJyXC71fTcS-Xa9bCGzRc3xHxamww9imArJL14EBvmI1l2U5ocE77D8GxXLPAsW3Evqj6quycNsiFHAC_qK10Bpkn_bE-o8q2PpVLuyQqNahFkhwCTHlQLMVM6DqBMHTSxgAySf9WPUOQxXdYZtSIetZn4YfAA Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 41989440d1c94d3590210e79e8e5303a Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersNegativeTestJSON-1497830483 Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/41989440d1c94d3590210e79e8e5303a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/41989440d1c94d3590210e79e8e5303a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/41989440d1c94d3590210e79e8e5303a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_41989440d1c94d3590210e79e8e5303a", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersNegativeTestJSON-1497830483 Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 41989440d1c94d3590210e79e8e5303a Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1497830483 Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersNegativeTestJSON-1497830483-project Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 59b52fba1a3a42338b828c5d0313343e Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersNegativeTestJSON-1497830483-project Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance c847a07b-75af-47f2-be81-746d5c12fd6e could not be found. Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'c847a07b-75af-47f2-be81-746d5c12fd6e'} Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c847a07b-75af-47f2-be81-746d5c12fd6e could not be found. Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:42:20.231640 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:42:20.236238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c847a07b-75af-47f2-be81-746d5c12fd6e could not be found. Sep 17 21:42:20.236238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:42:20.236238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:42:20.236238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:42:20.236238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:42:20.236238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:42:20.236238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:42:20.236238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:42:20.236238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:42:20.236238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c847a07b-75af-47f2-be81-746d5c12fd6e could not be found. Sep 17 21:42:20.236238 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:42:20.236238 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-01fd3365-843e-4672-835a-a2a256523533 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Returning 404 to user: Instance c847a07b-75af-47f2-be81-746d5c12fd6e could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:42:20.236238 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-01fd3365-843e-4672-835a-a2a256523533 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c847a07b-75af-47f2-be81-746d5c12fd6e" status: 404 len: 111 microversion: 2.1 time: 0.033975 Sep 17 21:42:20.236238 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3275/6642] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:42:20 2022] DELETE /compute/v2.1/servers/c847a07b-75af-47f2-be81-746d5c12fd6e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 17 21:42:20.242258 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a55a7cf1-d99e-4560-a235-5098ee6e5f3c tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:42:20.242902 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a55a7cf1-d99e-4560-a235-5098ee6e5f3c tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: c847a07b-75af-47f2-be81-746d5c12fd6e] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:42:20.249646 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a55a7cf1-d99e-4560-a235-5098ee6e5f3c tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:20.250317 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a55a7cf1-d99e-4560-a235-5098ee6e5f3c tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:20.250793 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a55a7cf1-d99e-4560-a235-5098ee6e5f3c tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:20.251529 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a55a7cf1-d99e-4560-a235-5098ee6e5f3c tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:20.251995 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a55a7cf1-d99e-4560-a235-5098ee6e5f3c tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:20.252431 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a55a7cf1-d99e-4560-a235-5098ee6e5f3c tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:20.270306 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-a55a7cf1-d99e-4560-a235-5098ee6e5f3c tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] HTTP exception thrown: Instance c847a07b-75af-47f2-be81-746d5c12fd6e could not be found. Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a55a7cf1-d99e-4560-a235-5098ee6e5f3c tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Request method failure captured: Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/c847a07b-75af-47f2-be81-746d5c12fd6e HTTP/1.1 Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJj8jK2EJkA_ANb4NGsJyXC71fTcS-Xa9bCGzRc3xHxamww9imArJL14EBvmI1l2U5ocE77D8GxXLPAsW3Evqj6quycNsiFHAC_qK10Bpkn_bE-o8q2PpVLuyQqNahFkhwCTHlQLMVM6DqBMHTSxgAySf9WPUOQxXdYZtSIetZn4YfAA Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 41989440d1c94d3590210e79e8e5303a Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-ServersNegativeTestJSON-1497830483 Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/41989440d1c94d3590210e79e8e5303a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/41989440d1c94d3590210e79e8e5303a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/41989440d1c94d3590210e79e8e5303a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_41989440d1c94d3590210e79e8e5303a", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-ServersNegativeTestJSON-1497830483 Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 41989440d1c94d3590210e79e8e5303a Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1497830483 Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-ServersNegativeTestJSON-1497830483-project Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 59b52fba1a3a42338b828c5d0313343e Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-ServersNegativeTestJSON-1497830483-project Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance c847a07b-75af-47f2-be81-746d5c12fd6e could not be found. Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'c847a07b-75af-47f2-be81-746d5c12fd6e'} Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c847a07b-75af-47f2-be81-746d5c12fd6e could not be found. Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c847a07b-75af-47f2-be81-746d5c12fd6e could not be found. Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:42:20.271879 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:42:20.276563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:42:20.276563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:42:20.276563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:42:20.276563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:42:20.276563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:42:20.276563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c847a07b-75af-47f2-be81-746d5c12fd6e could not be found. Sep 17 21:42:20.276563 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:42:20.276563 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a55a7cf1-d99e-4560-a235-5098ee6e5f3c tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Returning 404 to user: Instance c847a07b-75af-47f2-be81-746d5c12fd6e could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:42:20.276563 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a55a7cf1-d99e-4560-a235-5098ee6e5f3c tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "GET /compute/v2.1/servers/c847a07b-75af-47f2-be81-746d5c12fd6e" status: 404 len: 111 microversion: 2.1 time: 0.035129 Sep 17 21:42:20.276563 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3368/6643] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:42:20 2022] GET /compute/v2.1/servers/c847a07b-75af-47f2-be81-746d5c12fd6e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:42:20.283168 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d98ea7fc-d63a-4e16-b50d-6ecfe7851f65 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:42:20.283771 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d98ea7fc-d63a-4e16-b50d-6ecfe7851f65 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: 2c61b28f-4dcc-40b2-b082-de549dfc800c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:42:20.290447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d98ea7fc-d63a-4e16-b50d-6ecfe7851f65 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:20.291006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d98ea7fc-d63a-4e16-b50d-6ecfe7851f65 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:20.291520 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d98ea7fc-d63a-4e16-b50d-6ecfe7851f65 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:20.292307 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d98ea7fc-d63a-4e16-b50d-6ecfe7851f65 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:20.292843 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d98ea7fc-d63a-4e16-b50d-6ecfe7851f65 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:20.293352 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d98ea7fc-d63a-4e16-b50d-6ecfe7851f65 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:20.320878 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d98ea7fc-d63a-4e16-b50d-6ecfe7851f65 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: 2c61b28f-4dcc-40b2-b082-de549dfc800c] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:42:20.324538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:42:20.405341 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d98ea7fc-d63a-4e16-b50d-6ecfe7851f65 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c" status: 204 len: 0 microversion: 2.1 time: 0.126302 Sep 17 21:42:20.406011 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3276/6644] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:42:20 2022] DELETE /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:42:20.414789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7d730f3b-d49a-49af-9fe9-c054a2ecd623 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:42:20.415516 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7d730f3b-d49a-49af-9fe9-c054a2ecd623 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: 2c61b28f-4dcc-40b2-b082-de549dfc800c] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:42:20.422999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d730f3b-d49a-49af-9fe9-c054a2ecd623 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:20.423517 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d730f3b-d49a-49af-9fe9-c054a2ecd623 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:20.423970 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d730f3b-d49a-49af-9fe9-c054a2ecd623 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:20.424699 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d730f3b-d49a-49af-9fe9-c054a2ecd623 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:20.425164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d730f3b-d49a-49af-9fe9-c054a2ecd623 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:20.425669 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d730f3b-d49a-49af-9fe9-c054a2ecd623 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:20.564784 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7d730f3b-d49a-49af-9fe9-c054a2ecd623 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b52fba1a3a42338b828c5d0313343e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41989440d1c94d3590210e79e8e5303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:42:20.573029 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7d730f3b-d49a-49af-9fe9-c054a2ecd623 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c" status: 200 len: 1511 microversion: 2.1 time: 0.162424 Sep 17 21:42:20.573616 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3369/6645] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:42:20 2022] GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:42:21.600759 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-34f32f21-1d40-464f-8464-6a304cd66a2e tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:42:21.601885 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-34f32f21-1d40-464f-8464-6a304cd66a2e tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: 2c61b28f-4dcc-40b2-b082-de549dfc800c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:42:21.613883 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34f32f21-1d40-464f-8464-6a304cd66a2e tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:21.614473 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34f32f21-1d40-464f-8464-6a304cd66a2e tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:21.614918 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34f32f21-1d40-464f-8464-6a304cd66a2e tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:21.616066 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34f32f21-1d40-464f-8464-6a304cd66a2e tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:21.616794 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34f32f21-1d40-464f-8464-6a304cd66a2e tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:21.617545 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34f32f21-1d40-464f-8464-6a304cd66a2e tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:21.766743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-34f32f21-1d40-464f-8464-6a304cd66a2e tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59b52fba1a3a42338b828c5d0313343e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41989440d1c94d3590210e79e8e5303a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:42:21.774768 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-34f32f21-1d40-464f-8464-6a304cd66a2e tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c" status: 200 len: 1511 microversion: 2.1 time: 0.180778 Sep 17 21:42:21.775468 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3277/6646] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:42:21 2022] GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c => generated 1511 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:42:22.225214 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-48704b73-a01b-4cd4-a66f-f9c0d2e70c6b req-0b90f569-6296-4d16-8c6f-2f693ca2f290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c61b28f-4dcc-40b2-b082-de549dfc800c", "name": "network-vif-deleted", "tag": "a579efb9-4d03-4ce2-abba-0c2b61f030d7"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:42:22.236338 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-48704b73-a01b-4cd4-a66f-f9c0d2e70c6b req-0b90f569-6296-4d16-8c6f-2f693ca2f290 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:22.236868 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-48704b73-a01b-4cd4-a66f-f9c0d2e70c6b req-0b90f569-6296-4d16-8c6f-2f693ca2f290 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:22.237576 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-48704b73-a01b-4cd4-a66f-f9c0d2e70c6b req-0b90f569-6296-4d16-8c6f-2f693ca2f290 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:22.251479 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-48704b73-a01b-4cd4-a66f-f9c0d2e70c6b req-0b90f569-6296-4d16-8c6f-2f693ca2f290 service nova] Creating event network-vif-deleted:a579efb9-4d03-4ce2-abba-0c2b61f030d7 for instance 2c61b28f-4dcc-40b2-b082-de549dfc800c on nch1-master-1 Sep 17 21:42:22.256558 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-48704b73-a01b-4cd4-a66f-f9c0d2e70c6b req-0b90f569-6296-4d16-8c6f-2f693ca2f290 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035329 Sep 17 21:42:22.261007 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3370/6647] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:42:22.800538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c0a70d71-3926-47df-a1b1-ca64b31f1f07 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:42:22.801309 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c0a70d71-3926-47df-a1b1-ca64b31f1f07 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] [instance: 2c61b28f-4dcc-40b2-b082-de549dfc800c] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:42:22.811001 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0a70d71-3926-47df-a1b1-ca64b31f1f07 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:22.811650 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0a70d71-3926-47df-a1b1-ca64b31f1f07 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:22.812241 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0a70d71-3926-47df-a1b1-ca64b31f1f07 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:22.813167 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0a70d71-3926-47df-a1b1-ca64b31f1f07 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:42:22.813847 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0a70d71-3926-47df-a1b1-ca64b31f1f07 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:42:22.814410 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c0a70d71-3926-47df-a1b1-ca64b31f1f07 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:42:22.830740 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-c0a70d71-3926-47df-a1b1-ca64b31f1f07 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] HTTP exception thrown: Instance 2c61b28f-4dcc-40b2-b082-de549dfc800c could not be found. Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c0a70d71-3926-47df-a1b1-ca64b31f1f07 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Request method failure captured: Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c HTTP/1.1 Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJj8jK2EJkA_ANb4NGsJyXC71fTcS-Xa9bCGzRc3xHxamww9imArJL14EBvmI1l2U5ocE77D8GxXLPAsW3Evqj6quycNsiFHAC_qK10Bpkn_bE-o8q2PpVLuyQqNahFkhwCTHlQLMVM6DqBMHTSxgAySf9WPUOQxXdYZtSIetZn4YfAA Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 41989440d1c94d3590210e79e8e5303a Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-ServersNegativeTestJSON-1497830483 Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/41989440d1c94d3590210e79e8e5303a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/41989440d1c94d3590210e79e8e5303a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/41989440d1c94d3590210e79e8e5303a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_41989440d1c94d3590210e79e8e5303a", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-ServersNegativeTestJSON-1497830483 Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 41989440d1c94d3590210e79e8e5303a Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1497830483 Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-ServersNegativeTestJSON-1497830483-project Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 59b52fba1a3a42338b828c5d0313343e Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-ServersNegativeTestJSON-1497830483-project Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 2c61b28f-4dcc-40b2-b082-de549dfc800c could not be found. Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '2c61b28f-4dcc-40b2-b082-de549dfc800c'} Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c61b28f-4dcc-40b2-b082-de549dfc800c could not be found. Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c61b28f-4dcc-40b2-b082-de549dfc800c could not be found. Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:42:22.832424 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:42:22.837287 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:42:22.837287 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:42:22.837287 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:42:22.837287 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:42:22.837287 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:42:22.837287 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c61b28f-4dcc-40b2-b082-de549dfc800c could not be found. Sep 17 21:42:22.837287 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:42:22.837287 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c0a70d71-3926-47df-a1b1-ca64b31f1f07 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] Returning 404 to user: Instance 2c61b28f-4dcc-40b2-b082-de549dfc800c could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:42:22.837287 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c0a70d71-3926-47df-a1b1-ca64b31f1f07 tempest-ServersNegativeTestJSON-1497830483 tempest-ServersNegativeTestJSON-1497830483-project] 10.222.0.26 "GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c" status: 404 len: 111 microversion: 2.1 time: 0.038648 Sep 17 21:42:22.837287 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3278/6648] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:42:22 2022] GET /compute/v2.1/servers/2c61b28f-4dcc-40b2-b082-de549dfc800c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:43:03.932236 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=50 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:43:03.933174 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=98 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:43:03.938263 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6f7ad337-5c3b-4c31-ace2-32d8c2561503 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Action: 'create', calling method: .version_select at 0x7f259c354b80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-127336696", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBMokvr0ptdn9zYU+1O0I1N7VfBvflVsacED2dJROrnVrpo6ffG3O9lp7WTW4yy9UxqNdVUyWlRIuwH1+kUZAbykRAqidgJ5SNf4Qb/UUn8C1kvcbuII8zXuZxEC0SlMAQ=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:43:03.955316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-6f7ad337-5c3b-4c31-ace2-32d8c2561503 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Getting quotas for project e3015a88384447ce8ee07537d685f3a3. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:43:03.960744 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-6f7ad337-5c3b-4c31-ace2-32d8c2561503 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Getting quotas for user 806819c3594d48fe9bf3d0cce5fee164 and project e3015a88384447ce8ee07537d685f3a3. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:43:03.987707 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6f7ad337-5c3b-4c31-ace2-32d8c2561503 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.057771 Sep 17 21:43:03.988311 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3371/6649] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:43:03 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:43:04.041573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7fcc0113-3c70-42f2-9521-cff338986a70 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2093928256", "imageRef": "0cf4bdbc-29e2-4135-9786-4ca6123ac9a7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-127336696", "networks": [{"uuid": "d6e95bbf-06f6-46dc-bc0f-cd72f5a30291"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:43:04.050942 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:43:04.051597 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:43:04.052850 ncdv-master-1 devstack@n-api.service[140523]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 17 21:43:04.053034 ncdv-master-1 devstack@n-api.service[140523]: Sat Sep 17 21:43:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.26) !!! Sep 17 21:43:04.107296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-7fcc0113-3c70-42f2-9521-cff338986a70 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] validate_networks() for [('d6e95bbf-06f6-46dc-bc0f-cd72f5a30291', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:43:04.485493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-7fcc0113-3c70-42f2-9521-cff338986a70 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:43:04.485929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-7fcc0113-3c70-42f2-9521-cff338986a70 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:43:04.486435 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-7fcc0113-3c70-42f2-9521-cff338986a70 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:43:04.486989 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-7fcc0113-3c70-42f2-9521-cff338986a70 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:43:04.487408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-7fcc0113-3c70-42f2-9521-cff338986a70 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:43:04.496974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7fcc0113-3c70-42f2-9521-cff338986a70 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:04.497528 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7fcc0113-3c70-42f2-9521-cff338986a70 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:04.498023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7fcc0113-3c70-42f2-9521-cff338986a70 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:04.498759 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7fcc0113-3c70-42f2-9521-cff338986a70 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:04.499215 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7fcc0113-3c70-42f2-9521-cff338986a70 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:04.499640 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7fcc0113-3c70-42f2-9521-cff338986a70 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:04.517135 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-7fcc0113-3c70-42f2-9521-cff338986a70 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Getting quotas for project e3015a88384447ce8ee07537d685f3a3. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:43:04.523435 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-7fcc0113-3c70-42f2-9521-cff338986a70 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Getting quotas for user 806819c3594d48fe9bf3d0cce5fee164 and project e3015a88384447ce8ee07537d685f3a3. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:43:04.536555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7fcc0113-3c70-42f2-9521-cff338986a70 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:43:04.538866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7fcc0113-3c70-42f2-9521-cff338986a70 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0cf4bdbc-29e2-4135-9786-4ca6123ac9a7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:43:04.586696 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7fcc0113-3c70-42f2-9521-cff338986a70 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.549439 Sep 17 21:43:04.587331 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3279/6650] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:43:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:43:04.599327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0e77029d-6d71-45e1-8498-ce7e67a6835f tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:43:04.600168 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0e77029d-6d71-45e1-8498-ce7e67a6835f tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:43:04.659978 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0e77029d-6d71-45e1-8498-ce7e67a6835f tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:43:04.668921 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0e77029d-6d71-45e1-8498-ce7e67a6835f tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879" status: 200 len: 1258 microversion: 2.1 time: 0.073677 Sep 17 21:43:04.669643 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3372/6651] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:43:04 2022] GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879 => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:43:05.693057 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-84d88e05-6d18-49d3-8fd1-d5f25c893ad8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:43:05.695037 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-84d88e05-6d18-49d3-8fd1-d5f25c893ad8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:43:05.702591 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84d88e05-6d18-49d3-8fd1-d5f25c893ad8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:05.703169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84d88e05-6d18-49d3-8fd1-d5f25c893ad8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:05.703918 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84d88e05-6d18-49d3-8fd1-d5f25c893ad8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:05.704656 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84d88e05-6d18-49d3-8fd1-d5f25c893ad8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:05.705109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84d88e05-6d18-49d3-8fd1-d5f25c893ad8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:05.705811 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-84d88e05-6d18-49d3-8fd1-d5f25c893ad8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:05.774489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-84d88e05-6d18-49d3-8fd1-d5f25c893ad8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:43:05.783340 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-84d88e05-6d18-49d3-8fd1-d5f25c893ad8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879" status: 200 len: 1328 microversion: 2.1 time: 0.095094 Sep 17 21:43:05.783950 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3280/6652] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:43:05 2022] GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879 => generated 1328 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:43:06.807518 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-17dccdfe-546a-40e1-882f-9bbdaea07a60 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:43:06.808793 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-17dccdfe-546a-40e1-882f-9bbdaea07a60 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:43:06.818368 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17dccdfe-546a-40e1-882f-9bbdaea07a60 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:06.819238 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17dccdfe-546a-40e1-882f-9bbdaea07a60 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:06.819870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17dccdfe-546a-40e1-882f-9bbdaea07a60 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:06.820915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17dccdfe-546a-40e1-882f-9bbdaea07a60 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:06.821726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17dccdfe-546a-40e1-882f-9bbdaea07a60 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:06.822394 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-17dccdfe-546a-40e1-882f-9bbdaea07a60 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:06.980897 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-17dccdfe-546a-40e1-882f-9bbdaea07a60 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:43:06.991523 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-17dccdfe-546a-40e1-882f-9bbdaea07a60 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879" status: 200 len: 1358 microversion: 2.1 time: 0.188368 Sep 17 21:43:06.992677 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3373/6653] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:43:06 2022] GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:43:08.015310 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-6dea3c72-3ea4-4bdd-9136-10a4a200f62a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:43:08.015945 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-6dea3c72-3ea4-4bdd-9136-10a4a200f62a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:43:08.023384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6dea3c72-3ea4-4bdd-9136-10a4a200f62a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:08.023881 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6dea3c72-3ea4-4bdd-9136-10a4a200f62a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:08.024327 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6dea3c72-3ea4-4bdd-9136-10a4a200f62a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:08.025055 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6dea3c72-3ea4-4bdd-9136-10a4a200f62a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:08.025523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6dea3c72-3ea4-4bdd-9136-10a4a200f62a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:08.025984 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-6dea3c72-3ea4-4bdd-9136-10a4a200f62a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:08.180710 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-6dea3c72-3ea4-4bdd-9136-10a4a200f62a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:43:08.188975 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-6dea3c72-3ea4-4bdd-9136-10a4a200f62a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879" status: 200 len: 1358 microversion: 2.1 time: 0.177755 Sep 17 21:43:08.189580 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3281/6654] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:43:08 2022] GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:43:09.212302 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-fa067988-5a1e-4f7c-b25e-ee34336bb155 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:43:09.212972 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-fa067988-5a1e-4f7c-b25e-ee34336bb155 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:43:09.220675 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa067988-5a1e-4f7c-b25e-ee34336bb155 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:09.221353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa067988-5a1e-4f7c-b25e-ee34336bb155 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:09.223088 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa067988-5a1e-4f7c-b25e-ee34336bb155 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:09.223867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa067988-5a1e-4f7c-b25e-ee34336bb155 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:09.224409 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa067988-5a1e-4f7c-b25e-ee34336bb155 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:09.224813 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-fa067988-5a1e-4f7c-b25e-ee34336bb155 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:09.376542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-fa067988-5a1e-4f7c-b25e-ee34336bb155 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:43:09.384604 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-fa067988-5a1e-4f7c-b25e-ee34336bb155 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879" status: 200 len: 1358 microversion: 2.1 time: 0.176364 Sep 17 21:43:09.385191 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3374/6655] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:43:09 2022] GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:43:10.410718 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a2bd83e7-38de-47ba-ab1f-dac7ca786b02 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:43:10.411706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a2bd83e7-38de-47ba-ab1f-dac7ca786b02 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:43:10.425447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2bd83e7-38de-47ba-ab1f-dac7ca786b02 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:10.426081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2bd83e7-38de-47ba-ab1f-dac7ca786b02 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:10.426600 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2bd83e7-38de-47ba-ab1f-dac7ca786b02 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:10.427405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2bd83e7-38de-47ba-ab1f-dac7ca786b02 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:10.427945 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2bd83e7-38de-47ba-ab1f-dac7ca786b02 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:10.428452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2bd83e7-38de-47ba-ab1f-dac7ca786b02 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:10.591372 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a2bd83e7-38de-47ba-ab1f-dac7ca786b02 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:43:10.599420 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a2bd83e7-38de-47ba-ab1f-dac7ca786b02 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879" status: 200 len: 1358 microversion: 2.1 time: 0.192831 Sep 17 21:43:10.600009 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3282/6656] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:43:10 2022] GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:43:11.624346 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-eccaacc8-88c7-40bc-9619-a1e1aca31e20 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:43:11.625158 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-eccaacc8-88c7-40bc-9619-a1e1aca31e20 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:43:11.632328 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eccaacc8-88c7-40bc-9619-a1e1aca31e20 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:11.633099 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eccaacc8-88c7-40bc-9619-a1e1aca31e20 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:11.633827 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eccaacc8-88c7-40bc-9619-a1e1aca31e20 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:11.634662 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eccaacc8-88c7-40bc-9619-a1e1aca31e20 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:11.635229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eccaacc8-88c7-40bc-9619-a1e1aca31e20 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:11.635765 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eccaacc8-88c7-40bc-9619-a1e1aca31e20 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:11.778752 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-eccaacc8-88c7-40bc-9619-a1e1aca31e20 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:43:11.786966 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-eccaacc8-88c7-40bc-9619-a1e1aca31e20 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879" status: 200 len: 1358 microversion: 2.1 time: 0.166889 Sep 17 21:43:11.787549 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3375/6657] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:43:11 2022] GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:43:12.810366 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0c49bbc1-ff0a-4301-a8b7-0a52d6c25a1d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:43:12.811099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0c49bbc1-ff0a-4301-a8b7-0a52d6c25a1d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:43:12.818523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c49bbc1-ff0a-4301-a8b7-0a52d6c25a1d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:12.819025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c49bbc1-ff0a-4301-a8b7-0a52d6c25a1d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:12.819468 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c49bbc1-ff0a-4301-a8b7-0a52d6c25a1d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:12.820274 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c49bbc1-ff0a-4301-a8b7-0a52d6c25a1d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:12.820726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c49bbc1-ff0a-4301-a8b7-0a52d6c25a1d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:12.821245 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0c49bbc1-ff0a-4301-a8b7-0a52d6c25a1d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:12.961169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0c49bbc1-ff0a-4301-a8b7-0a52d6c25a1d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:43:12.969570 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0c49bbc1-ff0a-4301-a8b7-0a52d6c25a1d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879" status: 200 len: 1358 microversion: 2.1 time: 0.163415 Sep 17 21:43:12.970176 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3283/6658] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:43:12 2022] GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:43:13.993876 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-aab8b62e-2aa1-45b3-91f9-27d839d68d2b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:43:13.994582 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-aab8b62e-2aa1-45b3-91f9-27d839d68d2b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:43:14.002927 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aab8b62e-2aa1-45b3-91f9-27d839d68d2b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:14.003436 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aab8b62e-2aa1-45b3-91f9-27d839d68d2b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:14.003882 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aab8b62e-2aa1-45b3-91f9-27d839d68d2b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:14.004604 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aab8b62e-2aa1-45b3-91f9-27d839d68d2b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:14.005069 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aab8b62e-2aa1-45b3-91f9-27d839d68d2b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:14.005724 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-aab8b62e-2aa1-45b3-91f9-27d839d68d2b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:14.144874 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-aab8b62e-2aa1-45b3-91f9-27d839d68d2b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:43:14.153075 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-aab8b62e-2aa1-45b3-91f9-27d839d68d2b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879" status: 200 len: 1358 microversion: 2.1 time: 0.163283 Sep 17 21:43:14.153662 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3376/6659] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:43:13 2022] GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:43:15.176920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-82adf25b-48d9-4dde-a670-642fa53d8bf5 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:43:15.177646 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-82adf25b-48d9-4dde-a670-642fa53d8bf5 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:43:15.180085 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:43:15.181045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:43:15.187487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82adf25b-48d9-4dde-a670-642fa53d8bf5 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:15.188058 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82adf25b-48d9-4dde-a670-642fa53d8bf5 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:15.188570 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82adf25b-48d9-4dde-a670-642fa53d8bf5 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:15.189357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82adf25b-48d9-4dde-a670-642fa53d8bf5 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:15.189860 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82adf25b-48d9-4dde-a670-642fa53d8bf5 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:15.190292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82adf25b-48d9-4dde-a670-642fa53d8bf5 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:15.303560 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-f8cc3544-b27a-4369-9fd5-b2e438bc3fe2 req-b0e248c2-bde8-4b86-a19e-e263e3612fca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f44a7f9b-851b-4b0d-9f47-0873006a8879", "tag": "82fe9cd9-9b3b-476e-95a9-0bcd8a27e755"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:43:15.309660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=6 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:43:15.317972 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f8cc3544-b27a-4369-9fd5-b2e438bc3fe2 req-b0e248c2-bde8-4b86-a19e-e263e3612fca service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:15.318832 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f8cc3544-b27a-4369-9fd5-b2e438bc3fe2 req-b0e248c2-bde8-4b86-a19e-e263e3612fca service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:15.319505 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f8cc3544-b27a-4369-9fd5-b2e438bc3fe2 req-b0e248c2-bde8-4b86-a19e-e263e3612fca service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:15.332524 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-f8cc3544-b27a-4369-9fd5-b2e438bc3fe2 req-b0e248c2-bde8-4b86-a19e-e263e3612fca service nova] Creating event network-changed:82fe9cd9-9b3b-476e-95a9-0bcd8a27e755 for instance f44a7f9b-851b-4b0d-9f47-0873006a8879 on nch1-master-1 Sep 17 21:43:15.336671 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-82adf25b-48d9-4dde-a670-642fa53d8bf5 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:43:15.338797 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-f8cc3544-b27a-4369-9fd5-b2e438bc3fe2 req-b0e248c2-bde8-4b86-a19e-e263e3612fca service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039517 Sep 17 21:43:15.339775 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3377/6660] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:43:15.349123 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-82adf25b-48d9-4dde-a670-642fa53d8bf5 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879" status: 200 len: 1358 microversion: 2.1 time: 0.176422 Sep 17 21:43:15.349777 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3284/6661] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:43:15 2022] GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:43:16.376888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ecc46f4f-cf7d-4ae0-93cf-e7651c06f7be tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:43:16.377690 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ecc46f4f-cf7d-4ae0-93cf-e7651c06f7be tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:43:16.385845 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ecc46f4f-cf7d-4ae0-93cf-e7651c06f7be tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:16.386389 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ecc46f4f-cf7d-4ae0-93cf-e7651c06f7be tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:16.386861 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ecc46f4f-cf7d-4ae0-93cf-e7651c06f7be tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:16.387614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ecc46f4f-cf7d-4ae0-93cf-e7651c06f7be tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:16.388106 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ecc46f4f-cf7d-4ae0-93cf-e7651c06f7be tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:16.388580 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ecc46f4f-cf7d-4ae0-93cf-e7651c06f7be tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:16.524877 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ecc46f4f-cf7d-4ae0-93cf-e7651c06f7be tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:43:16.533130 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ecc46f4f-cf7d-4ae0-93cf-e7651c06f7be tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879" status: 200 len: 1358 microversion: 2.1 time: 0.162574 Sep 17 21:43:16.533738 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3378/6662] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:43:16 2022] GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:43:17.560357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5867e179-76da-4f60-93d6-3b95292bef87 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:43:17.561295 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5867e179-76da-4f60-93d6-3b95292bef87 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:43:17.573214 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5867e179-76da-4f60-93d6-3b95292bef87 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:17.574077 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5867e179-76da-4f60-93d6-3b95292bef87 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:17.574810 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5867e179-76da-4f60-93d6-3b95292bef87 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:17.576028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5867e179-76da-4f60-93d6-3b95292bef87 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:17.576798 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5867e179-76da-4f60-93d6-3b95292bef87 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:17.577555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5867e179-76da-4f60-93d6-3b95292bef87 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:17.711812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5867e179-76da-4f60-93d6-3b95292bef87 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:43:17.720347 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5867e179-76da-4f60-93d6-3b95292bef87 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879" status: 200 len: 1358 microversion: 2.1 time: 0.166778 Sep 17 21:43:17.720927 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3285/6663] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:43:17 2022] GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:43:18.743695 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-df97dad0-88f3-44a2-b218-2b821d66d2d9 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:43:18.744318 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-df97dad0-88f3-44a2-b218-2b821d66d2d9 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:43:18.751888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-df97dad0-88f3-44a2-b218-2b821d66d2d9 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:18.752387 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-df97dad0-88f3-44a2-b218-2b821d66d2d9 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:18.752847 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-df97dad0-88f3-44a2-b218-2b821d66d2d9 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:18.753613 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-df97dad0-88f3-44a2-b218-2b821d66d2d9 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:18.754079 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-df97dad0-88f3-44a2-b218-2b821d66d2d9 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:18.754520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-df97dad0-88f3-44a2-b218-2b821d66d2d9 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:18.891875 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-df97dad0-88f3-44a2-b218-2b821d66d2d9 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:43:18.899935 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-df97dad0-88f3-44a2-b218-2b821d66d2d9 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879" status: 200 len: 1358 microversion: 2.1 time: 0.160322 Sep 17 21:43:18.900541 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3379/6664] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:43:18 2022] GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:43:19.928222 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-728064a1-10c6-49d9-ac58-3f2bf77ab8a9 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:43:19.929223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-728064a1-10c6-49d9-ac58-3f2bf77ab8a9 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:43:19.942584 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-728064a1-10c6-49d9-ac58-3f2bf77ab8a9 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:19.943074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-728064a1-10c6-49d9-ac58-3f2bf77ab8a9 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:19.943514 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-728064a1-10c6-49d9-ac58-3f2bf77ab8a9 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:19.944217 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-728064a1-10c6-49d9-ac58-3f2bf77ab8a9 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:19.944737 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-728064a1-10c6-49d9-ac58-3f2bf77ab8a9 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:19.945110 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-728064a1-10c6-49d9-ac58-3f2bf77ab8a9 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:20.080381 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-728064a1-10c6-49d9-ac58-3f2bf77ab8a9 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:43:20.088861 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-728064a1-10c6-49d9-ac58-3f2bf77ab8a9 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879" status: 200 len: 1358 microversion: 2.1 time: 0.167362 Sep 17 21:43:20.089815 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3286/6665] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:43:19 2022] GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:43:20.645741 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-a94a393d-797d-45c3-86bc-8f9721571038 req-1cd152b8-d9fd-4e8e-a2ed-e7c9945dcb0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f44a7f9b-851b-4b0d-9f47-0873006a8879", "name": "network-vif-plugged", "status": "completed", "tag": "82fe9cd9-9b3b-476e-95a9-0bcd8a27e755"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:43:20.656224 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a94a393d-797d-45c3-86bc-8f9721571038 req-1cd152b8-d9fd-4e8e-a2ed-e7c9945dcb0d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:20.656718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a94a393d-797d-45c3-86bc-8f9721571038 req-1cd152b8-d9fd-4e8e-a2ed-e7c9945dcb0d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:20.657179 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a94a393d-797d-45c3-86bc-8f9721571038 req-1cd152b8-d9fd-4e8e-a2ed-e7c9945dcb0d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:20.668738 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-a94a393d-797d-45c3-86bc-8f9721571038 req-1cd152b8-d9fd-4e8e-a2ed-e7c9945dcb0d service nova] Creating event network-vif-plugged:82fe9cd9-9b3b-476e-95a9-0bcd8a27e755 for instance f44a7f9b-851b-4b0d-9f47-0873006a8879 on nch1-master-1 Sep 17 21:43:20.674424 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-a94a393d-797d-45c3-86bc-8f9721571038 req-1cd152b8-d9fd-4e8e-a2ed-e7c9945dcb0d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032477 Sep 17 21:43:20.675227 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3380/6666] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:43:21.116639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f79474a0-9fae-4fa1-9991-ba967ee8914c tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:43:21.117871 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f79474a0-9fae-4fa1-9991-ba967ee8914c tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:43:21.129717 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f79474a0-9fae-4fa1-9991-ba967ee8914c tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:21.130554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f79474a0-9fae-4fa1-9991-ba967ee8914c tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:21.131279 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f79474a0-9fae-4fa1-9991-ba967ee8914c tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:21.132435 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f79474a0-9fae-4fa1-9991-ba967ee8914c tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:21.133188 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f79474a0-9fae-4fa1-9991-ba967ee8914c tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:21.133947 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f79474a0-9fae-4fa1-9991-ba967ee8914c tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:21.269760 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f79474a0-9fae-4fa1-9991-ba967ee8914c tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:43:21.277967 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f79474a0-9fae-4fa1-9991-ba967ee8914c tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879" status: 200 len: 1358 microversion: 2.1 time: 0.168185 Sep 17 21:43:21.278549 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3287/6667] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:43:21 2022] GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:43:22.304098 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-651aab5d-3bad-439c-a4f1-72bd61689f4e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:43:22.305112 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-651aab5d-3bad-439c-a4f1-72bd61689f4e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:43:22.315019 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-651aab5d-3bad-439c-a4f1-72bd61689f4e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:22.315539 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-651aab5d-3bad-439c-a4f1-72bd61689f4e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:22.315990 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-651aab5d-3bad-439c-a4f1-72bd61689f4e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:22.316714 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-651aab5d-3bad-439c-a4f1-72bd61689f4e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:22.317172 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-651aab5d-3bad-439c-a4f1-72bd61689f4e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:22.317635 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-651aab5d-3bad-439c-a4f1-72bd61689f4e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:22.453223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-651aab5d-3bad-439c-a4f1-72bd61689f4e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:43:22.461883 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-651aab5d-3bad-439c-a4f1-72bd61689f4e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879" status: 200 len: 1546 microversion: 2.1 time: 0.164100 Sep 17 21:43:22.462484 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3381/6668] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:43:22 2022] GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879 => generated 1546 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:43:22.493218 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2a99bbf6-9e02-4187-9fed-63af0ed7657a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:43:22.493876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2a99bbf6-9e02-4187-9fed-63af0ed7657a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:43:22.501087 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2a99bbf6-9e02-4187-9fed-63af0ed7657a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:22.501651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2a99bbf6-9e02-4187-9fed-63af0ed7657a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:22.502099 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2a99bbf6-9e02-4187-9fed-63af0ed7657a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:22.502799 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2a99bbf6-9e02-4187-9fed-63af0ed7657a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:22.503260 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2a99bbf6-9e02-4187-9fed-63af0ed7657a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:22.503689 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2a99bbf6-9e02-4187-9fed-63af0ed7657a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:22.640767 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2a99bbf6-9e02-4187-9fed-63af0ed7657a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:43:22.649116 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2a99bbf6-9e02-4187-9fed-63af0ed7657a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879" status: 200 len: 1546 microversion: 2.1 time: 0.160001 Sep 17 21:43:22.649820 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3288/6669] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:43:22 2022] GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879 => generated 1546 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:43:22.673485 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-acfddd49-aed9-40e8-8b64-bf050e79d599 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:43:22.678438 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-acfddd49-aed9-40e8-8b64-bf050e79d599 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:43:22.679224 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-acfddd49-aed9-40e8-8b64-bf050e79d599 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Searching by: {'deleted': False, 'project_id': 'e3015a88384447ce8ee07537d685f3a3'} {{(pid=140524) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:43:22.685093 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-acfddd49-aed9-40e8-8b64-bf050e79d599 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:22.685650 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-acfddd49-aed9-40e8-8b64-bf050e79d599 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:22.686101 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-acfddd49-aed9-40e8-8b64-bf050e79d599 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:22.686850 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-acfddd49-aed9-40e8-8b64-bf050e79d599 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:22.687307 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-acfddd49-aed9-40e8-8b64-bf050e79d599 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:22.687744 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-acfddd49-aed9-40e8-8b64-bf050e79d599 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:22.712552 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.multi_cell_list [None req-acfddd49-aed9-40e8-8b64-bf050e79d599 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140524) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 21:43:22.739857 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-acfddd49-aed9-40e8-8b64-bf050e79d599 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.072089 Sep 17 21:43:22.740445 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3382/6670] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Sep 17 21:43:22 2022] GET /compute/v2.1/servers => generated 343 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:43:22.752891 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a2f411e7-3c1d-4c16-82de-a4ee5b4a0294 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:43:22.753514 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a2f411e7-3c1d-4c16-82de-a4ee5b4a0294 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:43:22.760242 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2f411e7-3c1d-4c16-82de-a4ee5b4a0294 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:22.760733 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2f411e7-3c1d-4c16-82de-a4ee5b4a0294 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:22.761176 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2f411e7-3c1d-4c16-82de-a4ee5b4a0294 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:22.761917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2f411e7-3c1d-4c16-82de-a4ee5b4a0294 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:22.762374 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2f411e7-3c1d-4c16-82de-a4ee5b4a0294 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:22.762813 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a2f411e7-3c1d-4c16-82de-a4ee5b4a0294 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:22.906881 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a2f411e7-3c1d-4c16-82de-a4ee5b4a0294 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:43:22.915906 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a2f411e7-3c1d-4c16-82de-a4ee5b4a0294 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879" status: 200 len: 1546 microversion: 2.1 time: 0.166984 Sep 17 21:43:22.916509 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3289/6671] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:43:22 2022] GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879 => generated 1546 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:43:24.500348 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b60e7023-f841-4976-8364-0f7ca4a0954e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4da1dea-5959-4df8-a95c-887273815e5f"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:43:24.502836 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b60e7023-f841-4976-8364-0f7ca4a0954e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:43:24.509918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b60e7023-f841-4976-8364-0f7ca4a0954e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:24.510413 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b60e7023-f841-4976-8364-0f7ca4a0954e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:24.510864 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b60e7023-f841-4976-8364-0f7ca4a0954e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:24.511562 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b60e7023-f841-4976-8364-0f7ca4a0954e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:24.512024 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b60e7023-f841-4976-8364-0f7ca4a0954e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:24.512458 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b60e7023-f841-4976-8364-0f7ca4a0954e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:24.766604 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b60e7023-f841-4976-8364-0f7ca4a0954e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "POST /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270058 Sep 17 21:43:24.767282 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3383/6672] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 17 21:43:24 2022] POST /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:43:30.430357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7dc21f3c-a7c0-4aaf-b098-e6714421522c tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:43:30.430993 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7dc21f3c-a7c0-4aaf-b098-e6714421522c tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:43:30.438533 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7dc21f3c-a7c0-4aaf-b098-e6714421522c tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:30.439024 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7dc21f3c-a7c0-4aaf-b098-e6714421522c tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:30.439462 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7dc21f3c-a7c0-4aaf-b098-e6714421522c tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:30.440265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7dc21f3c-a7c0-4aaf-b098-e6714421522c tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:30.440753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7dc21f3c-a7c0-4aaf-b098-e6714421522c tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:30.441184 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7dc21f3c-a7c0-4aaf-b098-e6714421522c tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:30.575406 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7dc21f3c-a7c0-4aaf-b098-e6714421522c tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:43:30.588680 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7dc21f3c-a7c0-4aaf-b098-e6714421522c tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879" status: 200 len: 1592 microversion: 2.1 time: 0.161938 Sep 17 21:43:30.589928 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3290/6673] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:43:30 2022] GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879 => generated 1592 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:43:32.363891 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-fe8bbceb-cc5c-43e9-8e7d-1f0ae26e088e req-4d8aed4d-314d-4e8a-885e-3ab6b20916d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f44a7f9b-851b-4b0d-9f47-0873006a8879", "tag": "82fe9cd9-9b3b-476e-95a9-0bcd8a27e755"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:43:32.374521 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-fe8bbceb-cc5c-43e9-8e7d-1f0ae26e088e req-4d8aed4d-314d-4e8a-885e-3ab6b20916d6 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:32.375305 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-fe8bbceb-cc5c-43e9-8e7d-1f0ae26e088e req-4d8aed4d-314d-4e8a-885e-3ab6b20916d6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:32.375746 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-fe8bbceb-cc5c-43e9-8e7d-1f0ae26e088e req-4d8aed4d-314d-4e8a-885e-3ab6b20916d6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:32.387791 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-fe8bbceb-cc5c-43e9-8e7d-1f0ae26e088e req-4d8aed4d-314d-4e8a-885e-3ab6b20916d6 service nova] Creating event network-changed:82fe9cd9-9b3b-476e-95a9-0bcd8a27e755 for instance f44a7f9b-851b-4b0d-9f47-0873006a8879 on nch1-master-1 Sep 17 21:43:32.392805 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-fe8bbceb-cc5c-43e9-8e7d-1f0ae26e088e req-4d8aed4d-314d-4e8a-885e-3ab6b20916d6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033024 Sep 17 21:43:32.393764 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3384/6674] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:43:33.445213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-589c8241-6985-46fb-b1b2-62ed8d05cbc8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1044068112"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:43:33.445913 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-589c8241-6985-46fb-b1b2-62ed8d05cbc8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:43:33.452851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-589c8241-6985-46fb-b1b2-62ed8d05cbc8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:33.453566 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-589c8241-6985-46fb-b1b2-62ed8d05cbc8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:33.453980 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-589c8241-6985-46fb-b1b2-62ed8d05cbc8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:33.454698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-589c8241-6985-46fb-b1b2-62ed8d05cbc8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:33.455181 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-589c8241-6985-46fb-b1b2-62ed8d05cbc8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:33.455604 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-589c8241-6985-46fb-b1b2-62ed8d05cbc8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:33.584035 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.network.security_group_api [None req-589c8241-6985-46fb-b1b2-62ed8d05cbc8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Adding security group 204b99e6-d380-4aa8-b54b-342d85fc8007 to port 82fe9cd9-9b3b-476e-95a9-0bcd8a27e755 Sep 17 21:43:33.907093 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-589c8241-6985-46fb-b1b2-62ed8d05cbc8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "POST /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879/action" status: 202 len: 0 microversion: 2.1 time: 0.466209 Sep 17 21:43:33.907999 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3291/6675] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:43:33 2022] POST /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:43:33.917381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-24d0bc66-eead-4a9e-9748-f9b3643c09ff tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:43:33.918130 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-24d0bc66-eead-4a9e-9748-f9b3643c09ff tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:43:33.920949 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:43:33.927455 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-24d0bc66-eead-4a9e-9748-f9b3643c09ff tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:33.928164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-24d0bc66-eead-4a9e-9748-f9b3643c09ff tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:33.928809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-24d0bc66-eead-4a9e-9748-f9b3643c09ff tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:33.929735 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-24d0bc66-eead-4a9e-9748-f9b3643c09ff tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:33.930204 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-24d0bc66-eead-4a9e-9748-f9b3643c09ff tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:33.930644 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-24d0bc66-eead-4a9e-9748-f9b3643c09ff tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:33.952694 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:43:34.080260 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-24d0bc66-eead-4a9e-9748-f9b3643c09ff tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:43:34.088828 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-24d0bc66-eead-4a9e-9748-f9b3643c09ff tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879" status: 200 len: 1758 microversion: 2.1 time: 0.176200 Sep 17 21:43:34.089808 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3385/6676] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:43:33 2022] GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879 => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:43:34.409171 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-a0df4fd8-916a-496b-9a63-107755bdc381 req-86e53b20-06ef-4961-9cd0-68cb5f257728 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f44a7f9b-851b-4b0d-9f47-0873006a8879", "tag": "82fe9cd9-9b3b-476e-95a9-0bcd8a27e755"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:43:34.415563 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:43:34.420198 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-a0df4fd8-916a-496b-9a63-107755bdc381 req-86e53b20-06ef-4961-9cd0-68cb5f257728 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:43:34.420715 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-a0df4fd8-916a-496b-9a63-107755bdc381 req-86e53b20-06ef-4961-9cd0-68cb5f257728 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:43:34.421096 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-a0df4fd8-916a-496b-9a63-107755bdc381 req-86e53b20-06ef-4961-9cd0-68cb5f257728 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:43:34.424128 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=73 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:43:34.435182 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-a0df4fd8-916a-496b-9a63-107755bdc381 req-86e53b20-06ef-4961-9cd0-68cb5f257728 service nova] Creating event network-changed:82fe9cd9-9b3b-476e-95a9-0bcd8a27e755 for instance f44a7f9b-851b-4b0d-9f47-0873006a8879 on nch1-master-1 Sep 17 21:43:34.440454 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-a0df4fd8-916a-496b-9a63-107755bdc381 req-86e53b20-06ef-4961-9cd0-68cb5f257728 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035213 Sep 17 21:43:34.441483 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3292/6677] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:45:49.233681 ncdv-master-1 devstack@n-api.service[140524]: ERROR oslo.messaging._drivers.impl_rabbit [-] [04285588-4085-42d9-ae87-82f4a29bd916] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 17 21:45:49.234629 ncdv-master-1 devstack@n-api.service[140524]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0c677b88-ed69-4f5f-b874-71db171b23f2] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 17 21:45:49.235116 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:45:49.235926 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=5 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:45:49.237265 ncdv-master-1 devstack@n-api.service[140524]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 17 21:45:49.237394 ncdv-master-1 devstack@n-api.service[140524]: Sat Sep 17 21:45:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879/action (ip 10.222.0.26) !!! Sep 17 21:45:49.238718 ncdv-master-1 devstack@n-api.service[140524]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 17 21:45:49.238877 ncdv-master-1 devstack@n-api.service[140524]: Sat Sep 17 21:45:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879/action (ip 10.222.0.26) !!! Sep 17 21:45:49.240008 ncdv-master-1 devstack@n-api.service[140524]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 17 21:45:49.240185 ncdv-master-1 devstack@n-api.service[140524]: Sat Sep 17 21:45:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879/action (ip 10.222.0.26) !!! Sep 17 21:45:49.244475 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3a9b7e74-a176-4978-8306-a86782f002d2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:45:49.246738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3a9b7e74-a176-4978-8306-a86782f002d2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:45:49.260886 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a9b7e74-a176-4978-8306-a86782f002d2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:45:49.261384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a9b7e74-a176-4978-8306-a86782f002d2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:45:49.261859 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a9b7e74-a176-4978-8306-a86782f002d2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:45:49.262582 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a9b7e74-a176-4978-8306-a86782f002d2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:45:49.263057 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a9b7e74-a176-4978-8306-a86782f002d2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:45:49.263494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a9b7e74-a176-4978-8306-a86782f002d2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:45:49.342596 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3a9b7e74-a176-4978-8306-a86782f002d2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "POST /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879/action" status: 202 len: 0 microversion: 2.1 time: 0.110783 Sep 17 21:45:49.343253 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3386/6678] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:45:49 2022] POST /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:45:49.353882 ncdv-master-1 devstack@n-api.service[140523]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eb955ca7-44ca-4d87-9bde-78c4d0a94e44] AMQP server on 10.222.0.26:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 17 21:45:49.354469 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:45:49.355190 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:45:49.356916 ncdv-master-1 devstack@n-api.service[140523]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 17 21:45:49.357072 ncdv-master-1 devstack@n-api.service[140523]: Sat Sep 17 21:45:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879 (ip 10.222.0.26) !!! Sep 17 21:45:49.364168 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d9e3fa7c-f96f-4b37-a774-81ce1386f1ed tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:45:49.365100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d9e3fa7c-f96f-4b37-a774-81ce1386f1ed tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:45:49.374868 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d9e3fa7c-f96f-4b37-a774-81ce1386f1ed tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:45:49.375382 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d9e3fa7c-f96f-4b37-a774-81ce1386f1ed tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:45:49.375820 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d9e3fa7c-f96f-4b37-a774-81ce1386f1ed tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:45:49.376549 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d9e3fa7c-f96f-4b37-a774-81ce1386f1ed tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:45:49.377101 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d9e3fa7c-f96f-4b37-a774-81ce1386f1ed tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:45:49.377656 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d9e3fa7c-f96f-4b37-a774-81ce1386f1ed tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:45:49.526141 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d9e3fa7c-f96f-4b37-a774-81ce1386f1ed tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:45:49.535098 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d9e3fa7c-f96f-4b37-a774-81ce1386f1ed tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879" status: 200 len: 1760 microversion: 2.1 time: 0.185338 Sep 17 21:45:49.535688 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3293/6679] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:45:49 2022] GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879 => generated 1760 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:45:50.564553 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e21f0bed-0d98-4f48-bb46-35e17a3debad tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:45:50.565493 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e21f0bed-0d98-4f48-bb46-35e17a3debad tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:45:50.573992 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e21f0bed-0d98-4f48-bb46-35e17a3debad tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:45:50.574493 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e21f0bed-0d98-4f48-bb46-35e17a3debad tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:45:50.574949 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e21f0bed-0d98-4f48-bb46-35e17a3debad tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:45:50.575667 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e21f0bed-0d98-4f48-bb46-35e17a3debad tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:45:50.576139 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e21f0bed-0d98-4f48-bb46-35e17a3debad tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:45:50.576579 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e21f0bed-0d98-4f48-bb46-35e17a3debad tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:45:50.581095 ncdv-master-1 devstack@n-api.service[140524]: INFO oslo.messaging._drivers.impl_rabbit [-] [0c677b88-ed69-4f5f-b874-71db171b23f2] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 53832. Sep 17 21:45:50.584183 ncdv-master-1 devstack@n-api.service[140524]: INFO oslo.messaging._drivers.impl_rabbit [-] [04285588-4085-42d9-ae87-82f4a29bd916] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 53830. Sep 17 21:45:50.728809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e21f0bed-0d98-4f48-bb46-35e17a3debad tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:45:50.737810 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e21f0bed-0d98-4f48-bb46-35e17a3debad tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879" status: 200 len: 1758 microversion: 2.1 time: 0.181506 Sep 17 21:45:50.738378 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3387/6680] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:45:50 2022] GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879 => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:47:03.398726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:47:03.399937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:47:03.406979 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-707087d8-e83b-413e-b285-399ee55af884 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1044068112"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:47:03.407842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-707087d8-e83b-413e-b285-399ee55af884 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:47:03.420229 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-707087d8-e83b-413e-b285-399ee55af884 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:03.420706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-707087d8-e83b-413e-b285-399ee55af884 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:03.421143 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-707087d8-e83b-413e-b285-399ee55af884 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:03.421885 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-707087d8-e83b-413e-b285-399ee55af884 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:03.422340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-707087d8-e83b-413e-b285-399ee55af884 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:03.422768 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-707087d8-e83b-413e-b285-399ee55af884 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:03.428016 ncdv-master-1 devstack@n-api.service[140523]: INFO oslo.messaging._drivers.impl_rabbit [-] [eb955ca7-44ca-4d87-9bde-78c4d0a94e44] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 53882. Sep 17 21:47:03.695081 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.network.security_group_api [None req-707087d8-e83b-413e-b285-399ee55af884 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Removing security group 204b99e6-d380-4aa8-b54b-342d85fc8007 from port 82fe9cd9-9b3b-476e-95a9-0bcd8a27e755 Sep 17 21:47:04.007213 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-707087d8-e83b-413e-b285-399ee55af884 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "POST /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879/action" status: 202 len: 0 microversion: 2.1 time: 0.612785 Sep 17 21:47:04.008045 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3294/6681] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:47:03 2022] POST /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879/action => generated 0 bytes in 615 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:47:04.014522 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=4 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:47:04.015712 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:47:04.020491 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-27dc8be7-7ab8-4cd7-8ac9-9e6de6fac0ed req-84604d01-6088-4c21-9442-4c14c4ad4ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f44a7f9b-851b-4b0d-9f47-0873006a8879", "tag": "82fe9cd9-9b3b-476e-95a9-0bcd8a27e755"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:47:04.048800 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-27dc8be7-7ab8-4cd7-8ac9-9e6de6fac0ed req-84604d01-6088-4c21-9442-4c14c4ad4ec6 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:04.049369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-27dc8be7-7ab8-4cd7-8ac9-9e6de6fac0ed req-84604d01-6088-4c21-9442-4c14c4ad4ec6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:04.049852 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-27dc8be7-7ab8-4cd7-8ac9-9e6de6fac0ed req-84604d01-6088-4c21-9442-4c14c4ad4ec6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:04.068688 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-27dc8be7-7ab8-4cd7-8ac9-9e6de6fac0ed req-84604d01-6088-4c21-9442-4c14c4ad4ec6 service nova] Creating event network-changed:82fe9cd9-9b3b-476e-95a9-0bcd8a27e755 for instance f44a7f9b-851b-4b0d-9f47-0873006a8879 on nch1-master-1 Sep 17 21:47:04.084274 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-27dc8be7-7ab8-4cd7-8ac9-9e6de6fac0ed req-84604d01-6088-4c21-9442-4c14c4ad4ec6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071326 Sep 17 21:47:04.089178 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3388/6682] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:47:05.459639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-443a91e7-488b-46b9-80e0-40c9a5fb078d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:47:05.460152 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-443a91e7-488b-46b9-80e0-40c9a5fb078d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:47:05.466708 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-443a91e7-488b-46b9-80e0-40c9a5fb078d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:05.467198 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-443a91e7-488b-46b9-80e0-40c9a5fb078d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:05.467633 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-443a91e7-488b-46b9-80e0-40c9a5fb078d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:05.468340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-443a91e7-488b-46b9-80e0-40c9a5fb078d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:05.468795 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-443a91e7-488b-46b9-80e0-40c9a5fb078d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:05.469230 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-443a91e7-488b-46b9-80e0-40c9a5fb078d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:05.552755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-443a91e7-488b-46b9-80e0-40c9a5fb078d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lazy-loading 'services' on Instance uuid f44a7f9b-851b-4b0d-9f47-0873006a8879 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:47:05.624237 ncdv-master-1 devstack@n-api.service[140523]: ERROR oslo.messaging._drivers.impl_rabbit [None req-443a91e7-488b-46b9-80e0-40c9a5fb078d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [cb98c0ac-a3d9-49ff-824a-b8750245eb88] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 17 21:47:06.101502 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-c1b4159c-bd1e-4014-9a98-7f56d548619c req-0fb3ce69-0c1c-4860-b199-cf06400b625b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f44a7f9b-851b-4b0d-9f47-0873006a8879", "tag": "82fe9cd9-9b3b-476e-95a9-0bcd8a27e755"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:47:06.111301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c1b4159c-bd1e-4014-9a98-7f56d548619c req-0fb3ce69-0c1c-4860-b199-cf06400b625b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:06.111823 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c1b4159c-bd1e-4014-9a98-7f56d548619c req-0fb3ce69-0c1c-4860-b199-cf06400b625b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:06.112260 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c1b4159c-bd1e-4014-9a98-7f56d548619c req-0fb3ce69-0c1c-4860-b199-cf06400b625b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:06.123886 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-c1b4159c-bd1e-4014-9a98-7f56d548619c req-0fb3ce69-0c1c-4860-b199-cf06400b625b service nova] Creating event network-changed:82fe9cd9-9b3b-476e-95a9-0bcd8a27e755 for instance f44a7f9b-851b-4b0d-9f47-0873006a8879 on nch1-master-1 Sep 17 21:47:06.129122 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-c1b4159c-bd1e-4014-9a98-7f56d548619c req-0fb3ce69-0c1c-4860-b199-cf06400b625b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032884 Sep 17 21:47:06.129745 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3389/6683] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:47:06.632930 ncdv-master-1 devstack@n-api.service[140523]: INFO oslo.messaging._drivers.impl_rabbit [None req-443a91e7-488b-46b9-80e0-40c9a5fb078d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [cb98c0ac-a3d9-49ff-824a-b8750245eb88] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 53914. Sep 17 21:47:06.636516 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-443a91e7-488b-46b9-80e0-40c9a5fb078d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879/os-volume_attachments/f4da1dea-5959-4df8-a95c-887273815e5f" status: 202 len: 0 microversion: 2.1 time: 1.181801 Sep 17 21:47:06.637146 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3295/6684] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Sep 17 21:47:05 2022] DELETE /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879/os-volume_attachments/f4da1dea-5959-4df8-a95c-887273815e5f => generated 0 bytes in 1183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:47:06.646343 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-208d3334-3518-4500-bdc6-12496ecb8c15 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:47:06.648726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-208d3334-3518-4500-bdc6-12496ecb8c15 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:47:06.656018 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-208d3334-3518-4500-bdc6-12496ecb8c15 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:06.656639 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-208d3334-3518-4500-bdc6-12496ecb8c15 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:06.657122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-208d3334-3518-4500-bdc6-12496ecb8c15 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:06.657890 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-208d3334-3518-4500-bdc6-12496ecb8c15 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:06.658358 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-208d3334-3518-4500-bdc6-12496ecb8c15 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:06.658825 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-208d3334-3518-4500-bdc6-12496ecb8c15 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:06.694854 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-208d3334-3518-4500-bdc6-12496ecb8c15 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052922 Sep 17 21:47:06.695545 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3390/6685] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 17 21:47:06 2022] GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:47:07.709643 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fda5a109-cb7f-40d4-a780-396aa681018b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:47:07.712490 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fda5a109-cb7f-40d4-a780-396aa681018b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:47:07.720080 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fda5a109-cb7f-40d4-a780-396aa681018b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:07.720582 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fda5a109-cb7f-40d4-a780-396aa681018b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:07.721033 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fda5a109-cb7f-40d4-a780-396aa681018b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:07.721780 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fda5a109-cb7f-40d4-a780-396aa681018b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:07.722248 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fda5a109-cb7f-40d4-a780-396aa681018b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:07.722725 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fda5a109-cb7f-40d4-a780-396aa681018b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:07.752066 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fda5a109-cb7f-40d4-a780-396aa681018b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047842 Sep 17 21:47:07.752636 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3296/6686] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 17 21:47:07 2022] GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:47:07.763812 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-882fea03-13c7-4efc-b01b-706386a756bb tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:47:07.764345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-882fea03-13c7-4efc-b01b-706386a756bb tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:47:07.771635 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-882fea03-13c7-4efc-b01b-706386a756bb tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:07.772219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-882fea03-13c7-4efc-b01b-706386a756bb tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:07.772656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-882fea03-13c7-4efc-b01b-706386a756bb tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:07.773545 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-882fea03-13c7-4efc-b01b-706386a756bb tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:07.774011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-882fea03-13c7-4efc-b01b-706386a756bb tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:07.774451 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-882fea03-13c7-4efc-b01b-706386a756bb tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:08.326701 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-882fea03-13c7-4efc-b01b-706386a756bb tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] HTTP exception thrown: Instance f44a7f9b-851b-4b0d-9f47-0873006a8879 is not attached to volume f4da1dea-5959-4df8-a95c-887273815e5f Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-882fea03-13c7-4efc-b01b-706386a756bb tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Request method failure captured: Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: request: DELETE /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879/os-volume_attachments/f4da1dea-5959-4df8-a95c-887273815e5f HTTP/1.1 Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJj9YhwGEdZ3EeyDD0tngX1YINRibOfWN7YNObQv7IepXkRZ6slkwX5sOG20k0SfZB8Xrx1BM3okYvvW4dKmCPoR_U8RBue165oxYKvn1nYbi0eyWUZXJ-Gl-DDi5QQVKatl6ElLaHFqntQZ4Dtg8fi1ILDC8xiKlStcPEt_RmXjcIg4 Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: e3015a88384447ce8ee07537d685f3a3 Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-TestMinimumBasicScenario-231644504 Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3015a88384447ce8ee07537d685f3a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e3015a88384447ce8ee07537d685f3a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3015a88384447ce8ee07537d685f3a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e3015a88384447ce8ee07537d685f3a3", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-TestMinimumBasicScenario-231644504 Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: e3015a88384447ce8ee07537d685f3a3 Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-TestMinimumBasicScenario-231644504 Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-TestMinimumBasicScenario-231644504-project Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 806819c3594d48fe9bf3d0cce5fee164 Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-TestMinimumBasicScenario-231644504-project Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance f44a7f9b-851b-4b0d-9f47-0873006a8879 is not attached to volume f4da1dea-5959-4df8-a95c-887273815e5f Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'server_id': 'f44a7f9b-851b-4b0d-9f47-0873006a8879', 'id': 'f4da1dea-5959-4df8-a95c-887273815e5f'} Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f4da1dea-5959-4df8-a95c-887273815e5f. Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f44a7f9b-851b-4b0d-9f47-0873006a8879 is not attached to volume f4da1dea-5959-4df8-a95c-887273815e5f Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:47:08.346271 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:47:08.351710 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:47:08.351710 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:47:08.351710 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f44a7f9b-851b-4b0d-9f47-0873006a8879 is not attached to volume f4da1dea-5959-4df8-a95c-887273815e5f Sep 17 21:47:08.351710 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:47:08.351710 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-882fea03-13c7-4efc-b01b-706386a756bb tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Returning 404 to user: Instance f44a7f9b-851b-4b0d-9f47-0873006a8879 is not attached to volume f4da1dea-5959-4df8-a95c-887273815e5f {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:47:08.351710 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-882fea03-13c7-4efc-b01b-706386a756bb tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879/os-volume_attachments/f4da1dea-5959-4df8-a95c-887273815e5f" status: 404 len: 154 microversion: 2.1 time: 0.588104 Sep 17 21:47:08.351710 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3391/6687] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Sep 17 21:47:07 2022] DELETE /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879/os-volume_attachments/f4da1dea-5959-4df8-a95c-887273815e5f => generated 154 bytes in 589 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:47:09.497578 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c2ee5a57-9451-4b4f-931e-c3fe2a0eb09a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:47:09.498117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c2ee5a57-9451-4b4f-931e-c3fe2a0eb09a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:47:09.505822 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c2ee5a57-9451-4b4f-931e-c3fe2a0eb09a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:09.506324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c2ee5a57-9451-4b4f-931e-c3fe2a0eb09a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:09.506772 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c2ee5a57-9451-4b4f-931e-c3fe2a0eb09a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:09.507487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c2ee5a57-9451-4b4f-931e-c3fe2a0eb09a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:09.507972 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c2ee5a57-9451-4b4f-931e-c3fe2a0eb09a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:09.508413 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c2ee5a57-9451-4b4f-931e-c3fe2a0eb09a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:09.536918 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c2ee5a57-9451-4b4f-931e-c3fe2a0eb09a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:47:09.617810 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c2ee5a57-9451-4b4f-931e-c3fe2a0eb09a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879" status: 204 len: 0 microversion: 2.1 time: 0.123998 Sep 17 21:47:09.618514 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3297/6688] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:47:09 2022] DELETE /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:47:09.627388 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bfb3725d-510e-4b3f-b4cf-b2e560da28c9 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:47:09.628032 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bfb3725d-510e-4b3f-b4cf-b2e560da28c9 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:47:09.635739 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bfb3725d-510e-4b3f-b4cf-b2e560da28c9 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:09.636248 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bfb3725d-510e-4b3f-b4cf-b2e560da28c9 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:09.636711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bfb3725d-510e-4b3f-b4cf-b2e560da28c9 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:09.637430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bfb3725d-510e-4b3f-b4cf-b2e560da28c9 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:09.637935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bfb3725d-510e-4b3f-b4cf-b2e560da28c9 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:09.638382 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bfb3725d-510e-4b3f-b4cf-b2e560da28c9 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:09.772186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bfb3725d-510e-4b3f-b4cf-b2e560da28c9 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:47:09.780615 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bfb3725d-510e-4b3f-b4cf-b2e560da28c9 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879" status: 200 len: 1552 microversion: 2.1 time: 0.157420 Sep 17 21:47:09.781182 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3392/6689] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:47:09 2022] GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879 => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:47:10.811005 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-45104fbb-d9a6-44ac-a6d0-bc3ac030a170 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:47:10.812228 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-45104fbb-d9a6-44ac-a6d0-bc3ac030a170 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:47:10.825162 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45104fbb-d9a6-44ac-a6d0-bc3ac030a170 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:10.825879 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45104fbb-d9a6-44ac-a6d0-bc3ac030a170 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:10.826309 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45104fbb-d9a6-44ac-a6d0-bc3ac030a170 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:10.827030 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45104fbb-d9a6-44ac-a6d0-bc3ac030a170 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:10.827494 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45104fbb-d9a6-44ac-a6d0-bc3ac030a170 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:10.827932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-45104fbb-d9a6-44ac-a6d0-bc3ac030a170 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:10.978305 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-45104fbb-d9a6-44ac-a6d0-bc3ac030a170 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:47:10.986773 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-45104fbb-d9a6-44ac-a6d0-bc3ac030a170 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879" status: 200 len: 1552 microversion: 2.1 time: 0.183586 Sep 17 21:47:10.987336 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3298/6690] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:47:10 2022] GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879 => generated 1552 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:47:11.840516 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-5da862a0-73b5-44e9-914a-5c6a089342f7 req-ec160285-8f32-48df-ad44-8cf9790db548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f44a7f9b-851b-4b0d-9f47-0873006a8879", "name": "network-vif-deleted", "tag": "82fe9cd9-9b3b-476e-95a9-0bcd8a27e755"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:47:11.850352 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-5da862a0-73b5-44e9-914a-5c6a089342f7 req-ec160285-8f32-48df-ad44-8cf9790db548 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:11.850845 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-5da862a0-73b5-44e9-914a-5c6a089342f7 req-ec160285-8f32-48df-ad44-8cf9790db548 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:11.851298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-5da862a0-73b5-44e9-914a-5c6a089342f7 req-ec160285-8f32-48df-ad44-8cf9790db548 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:11.864078 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-5da862a0-73b5-44e9-914a-5c6a089342f7 req-ec160285-8f32-48df-ad44-8cf9790db548 service nova] Creating event network-vif-deleted:82fe9cd9-9b3b-476e-95a9-0bcd8a27e755 for instance f44a7f9b-851b-4b0d-9f47-0873006a8879 on nch1-master-1 Sep 17 21:47:11.869624 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-5da862a0-73b5-44e9-914a-5c6a089342f7 req-ec160285-8f32-48df-ad44-8cf9790db548 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105095 Sep 17 21:47:11.870170 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3393/6691] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:47:12.016684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-51846309-c4b7-4483-b63d-621424b09133 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:47:12.017813 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-51846309-c4b7-4483-b63d-621424b09133 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:47:12.028835 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-51846309-c4b7-4483-b63d-621424b09133 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:12.029341 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-51846309-c4b7-4483-b63d-621424b09133 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:12.029818 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-51846309-c4b7-4483-b63d-621424b09133 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:12.030532 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-51846309-c4b7-4483-b63d-621424b09133 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:12.030986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-51846309-c4b7-4483-b63d-621424b09133 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:12.031514 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-51846309-c4b7-4483-b63d-621424b09133 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:12.065503 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-51846309-c4b7-4483-b63d-621424b09133 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:12.066014 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-51846309-c4b7-4483-b63d-621424b09133 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:12.066454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-51846309-c4b7-4483-b63d-621424b09133 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:12.066920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-51846309-c4b7-4483-b63d-621424b09133 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lazy-loading 'fault' on Instance uuid f44a7f9b-851b-4b0d-9f47-0873006a8879 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:47:12.110328 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-51846309-c4b7-4483-b63d-621424b09133 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:47:12.118997 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-51846309-c4b7-4483-b63d-621424b09133 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879" status: 200 len: 1348 microversion: 2.1 time: 0.108687 Sep 17 21:47:12.119637 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3299/6692] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:47:12 2022] GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879 => generated 1348 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:47:13.144173 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cc21e4f6-ee0c-44ec-9c15-cc7f5d3bd7fb tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:47:13.145633 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cc21e4f6-ee0c-44ec-9c15-cc7f5d3bd7fb tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: f44a7f9b-851b-4b0d-9f47-0873006a8879] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:47:13.153324 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc21e4f6-ee0c-44ec-9c15-cc7f5d3bd7fb tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:13.153758 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc21e4f6-ee0c-44ec-9c15-cc7f5d3bd7fb tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:13.155273 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc21e4f6-ee0c-44ec-9c15-cc7f5d3bd7fb tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:13.158051 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc21e4f6-ee0c-44ec-9c15-cc7f5d3bd7fb tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:13.158607 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc21e4f6-ee0c-44ec-9c15-cc7f5d3bd7fb tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:13.159072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc21e4f6-ee0c-44ec-9c15-cc7f5d3bd7fb tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:13.173593 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-cc21e4f6-ee0c-44ec-9c15-cc7f5d3bd7fb tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] HTTP exception thrown: Instance f44a7f9b-851b-4b0d-9f47-0873006a8879 could not be found. Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cc21e4f6-ee0c-44ec-9c15-cc7f5d3bd7fb tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Request method failure captured: Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879 HTTP/1.1 Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJj9YhwGEdZ3EeyDD0tngX1YINRibOfWN7YNObQv7IepXkRZ6slkwX5sOG20k0SfZB8Xrx1BM3okYvvW4dKmCPoR_U8RBue165oxYKvn1nYbi0eyWUZXJ-Gl-DDi5QQVKatl6ElLaHFqntQZ4Dtg8fi1ILDC8xiKlStcPEt_RmXjcIg4 Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: e3015a88384447ce8ee07537d685f3a3 Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-TestMinimumBasicScenario-231644504 Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3015a88384447ce8ee07537d685f3a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e3015a88384447ce8ee07537d685f3a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3015a88384447ce8ee07537d685f3a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e3015a88384447ce8ee07537d685f3a3", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-TestMinimumBasicScenario-231644504 Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: e3015a88384447ce8ee07537d685f3a3 Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-TestMinimumBasicScenario-231644504 Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-TestMinimumBasicScenario-231644504-project Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 806819c3594d48fe9bf3d0cce5fee164 Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-TestMinimumBasicScenario-231644504-project Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance f44a7f9b-851b-4b0d-9f47-0873006a8879 could not be found. Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': 'f44a7f9b-851b-4b0d-9f47-0873006a8879'} Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f44a7f9b-851b-4b0d-9f47-0873006a8879 could not be found. Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f44a7f9b-851b-4b0d-9f47-0873006a8879 could not be found. Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:47:13.175403 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:47:13.181143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:47:13.181143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:47:13.181143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:47:13.181143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:47:13.181143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:47:13.181143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f44a7f9b-851b-4b0d-9f47-0873006a8879 could not be found. Sep 17 21:47:13.181143 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:47:13.181143 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cc21e4f6-ee0c-44ec-9c15-cc7f5d3bd7fb tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Returning 404 to user: Instance f44a7f9b-851b-4b0d-9f47-0873006a8879 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:47:13.181143 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cc21e4f6-ee0c-44ec-9c15-cc7f5d3bd7fb tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879" status: 404 len: 111 microversion: 2.1 time: 0.036925 Sep 17 21:47:13.181143 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3394/6693] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:47:13 2022] GET /compute/v2.1/servers/f44a7f9b-851b-4b0d-9f47-0873006a8879 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:47:13.186054 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-abdb3688-e6ce-425c-9657-51760414552a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '.version_select at 0x7f25a4782d30>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:47:13.190679 ncdv-master-1 devstack@n-api.service[140523]: ERROR oslo.messaging._drivers.impl_rabbit [None req-abdb3688-e6ce-425c-9657-51760414552a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [9efb08ca-d886-44ef-8eb7-b5da91c3f6b6] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 17 21:47:14.205346 ncdv-master-1 devstack@n-api.service[140523]: INFO oslo.messaging._drivers.impl_rabbit [None req-abdb3688-e6ce-425c-9657-51760414552a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [9efb08ca-d886-44ef-8eb7-b5da91c3f6b6] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 53982. Sep 17 21:47:14.236845 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-abdb3688-e6ce-425c-9657-51760414552a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-127336696" status: 202 len: 0 microversion: 2.1 time: 1.052986 Sep 17 21:47:14.237484 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3300/6694] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Sep 17 21:47:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-127336696 => generated 0 bytes in 1056 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:47:23.561152 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9b4ce4dc-1df0-493c-91c3-2b12439a8269 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Action: 'create', calling method: .version_select at 0x7f259c3b81f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-399750370", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdqWGxLs1c3j9T8Ji1bGwohUydz2MwdCdg3JliZqxyj5lwcRcnYhwyNCL9hTR+dnX5jyGKgUQ6g2p320ldJBFHNUMJOxy5lQlYM37FZtVqVUmNuXyKtpmbjWD/x0lZFZg=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:47:23.573047 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=14 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:47:23.573915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=26 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:47:23.587657 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-9b4ce4dc-1df0-493c-91c3-2b12439a8269 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Getting quotas for project e3015a88384447ce8ee07537d685f3a3. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:47:23.593715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-9b4ce4dc-1df0-493c-91c3-2b12439a8269 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Getting quotas for user 806819c3594d48fe9bf3d0cce5fee164 and project e3015a88384447ce8ee07537d685f3a3. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:47:23.622678 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9b4ce4dc-1df0-493c-91c3-2b12439a8269 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.067693 Sep 17 21:47:23.623298 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3395/6695] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:47:23 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:47:23.682024 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:47:23.686570 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4a649a33-2341-43c2-95e0-d898f06d411b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1940560491", "imageRef": "39cc14ed-2add-4956-9838-9d84d90cc480", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-399750370", "networks": [{"uuid": "d6e95bbf-06f6-46dc-bc0f-cd72f5a30291"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:47:23.740893 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-4a649a33-2341-43c2-95e0-d898f06d411b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] validate_networks() for [('d6e95bbf-06f6-46dc-bc0f-cd72f5a30291', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:47:24.189149 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-4a649a33-2341-43c2-95e0-d898f06d411b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:47:24.189901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-4a649a33-2341-43c2-95e0-d898f06d411b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:47:24.190655 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-4a649a33-2341-43c2-95e0-d898f06d411b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:47:24.191230 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-4a649a33-2341-43c2-95e0-d898f06d411b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:47:24.191888 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-4a649a33-2341-43c2-95e0-d898f06d411b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:47:24.203213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a649a33-2341-43c2-95e0-d898f06d411b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:24.203811 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a649a33-2341-43c2-95e0-d898f06d411b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:24.204249 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a649a33-2341-43c2-95e0-d898f06d411b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:24.204982 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a649a33-2341-43c2-95e0-d898f06d411b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:24.205430 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a649a33-2341-43c2-95e0-d898f06d411b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:24.205903 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4a649a33-2341-43c2-95e0-d898f06d411b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:24.223557 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-4a649a33-2341-43c2-95e0-d898f06d411b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Getting quotas for project e3015a88384447ce8ee07537d685f3a3. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:47:24.229124 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-4a649a33-2341-43c2-95e0-d898f06d411b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Getting quotas for user 806819c3594d48fe9bf3d0cce5fee164 and project e3015a88384447ce8ee07537d685f3a3. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:47:24.242121 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4a649a33-2341-43c2-95e0-d898f06d411b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:47:24.244376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4a649a33-2341-43c2-95e0-d898f06d411b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='39cc14ed-2add-4956-9838-9d84d90cc480',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:47:24.300343 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4a649a33-2341-43c2-95e0-d898f06d411b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620210 Sep 17 21:47:24.301262 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3301/6696] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:47:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:47:24.312702 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8487bfae-2acd-4572-94e4-5072af086b0e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:47:24.313331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8487bfae-2acd-4572-94e4-5072af086b0e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:47:24.369829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8487bfae-2acd-4572-94e4-5072af086b0e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:47:24.377089 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8487bfae-2acd-4572-94e4-5072af086b0e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1258 microversion: 2.1 time: 0.068407 Sep 17 21:47:24.377723 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3396/6697] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:47:24 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:47:25.401211 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fd760cf1-b570-4380-9208-f067417de6b1 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:47:25.402353 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fd760cf1-b570-4380-9208-f067417de6b1 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:47:25.409910 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd760cf1-b570-4380-9208-f067417de6b1 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:25.410526 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd760cf1-b570-4380-9208-f067417de6b1 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:25.411062 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd760cf1-b570-4380-9208-f067417de6b1 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:25.411872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd760cf1-b570-4380-9208-f067417de6b1 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:25.412410 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd760cf1-b570-4380-9208-f067417de6b1 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:25.413078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fd760cf1-b570-4380-9208-f067417de6b1 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:25.483932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fd760cf1-b570-4380-9208-f067417de6b1 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:47:25.492628 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fd760cf1-b570-4380-9208-f067417de6b1 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1318 microversion: 2.1 time: 0.095966 Sep 17 21:47:25.493330 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3302/6698] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:47:25 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1318 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:47:26.516500 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-91db4075-3da9-43a3-81ce-a349ac1941fa tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:47:26.517963 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-91db4075-3da9-43a3-81ce-a349ac1941fa tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:47:26.525747 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-91db4075-3da9-43a3-81ce-a349ac1941fa tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:26.526255 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-91db4075-3da9-43a3-81ce-a349ac1941fa tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:26.526927 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-91db4075-3da9-43a3-81ce-a349ac1941fa tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:26.527656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-91db4075-3da9-43a3-81ce-a349ac1941fa tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:26.528122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-91db4075-3da9-43a3-81ce-a349ac1941fa tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:26.528565 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-91db4075-3da9-43a3-81ce-a349ac1941fa tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:26.669558 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-91db4075-3da9-43a3-81ce-a349ac1941fa tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:47:26.677771 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-91db4075-3da9-43a3-81ce-a349ac1941fa tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1358 microversion: 2.1 time: 0.165298 Sep 17 21:47:26.678355 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3397/6699] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:47:26 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:47:27.700451 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-592ac4a0-9558-4636-8e10-87f7f8c1f8a8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:47:27.701075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-592ac4a0-9558-4636-8e10-87f7f8c1f8a8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:47:27.708357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-592ac4a0-9558-4636-8e10-87f7f8c1f8a8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:27.708851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-592ac4a0-9558-4636-8e10-87f7f8c1f8a8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:27.709316 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-592ac4a0-9558-4636-8e10-87f7f8c1f8a8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:27.710062 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-592ac4a0-9558-4636-8e10-87f7f8c1f8a8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:27.710881 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-592ac4a0-9558-4636-8e10-87f7f8c1f8a8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:27.711314 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-592ac4a0-9558-4636-8e10-87f7f8c1f8a8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:27.847352 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-592ac4a0-9558-4636-8e10-87f7f8c1f8a8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:47:27.860206 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-592ac4a0-9558-4636-8e10-87f7f8c1f8a8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1358 microversion: 2.1 time: 0.163562 Sep 17 21:47:27.869868 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3303/6700] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:47:27 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:47:28.892278 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cc09aeba-4b73-4fbb-85ab-a239083f7a76 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:47:28.893696 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cc09aeba-4b73-4fbb-85ab-a239083f7a76 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:47:28.901405 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc09aeba-4b73-4fbb-85ab-a239083f7a76 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:28.901934 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc09aeba-4b73-4fbb-85ab-a239083f7a76 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:28.902404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc09aeba-4b73-4fbb-85ab-a239083f7a76 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:28.903184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc09aeba-4b73-4fbb-85ab-a239083f7a76 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:28.903653 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc09aeba-4b73-4fbb-85ab-a239083f7a76 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:28.904092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc09aeba-4b73-4fbb-85ab-a239083f7a76 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:29.049323 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cc09aeba-4b73-4fbb-85ab-a239083f7a76 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:47:29.057574 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cc09aeba-4b73-4fbb-85ab-a239083f7a76 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1358 microversion: 2.1 time: 0.176994 Sep 17 21:47:29.058150 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3398/6701] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:47:28 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:47:30.081108 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-222ba9fb-5e2b-47f3-8418-b811e2cbc4a2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:47:30.081830 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-222ba9fb-5e2b-47f3-8418-b811e2cbc4a2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:47:30.089920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-222ba9fb-5e2b-47f3-8418-b811e2cbc4a2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:30.090416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-222ba9fb-5e2b-47f3-8418-b811e2cbc4a2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:30.090865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-222ba9fb-5e2b-47f3-8418-b811e2cbc4a2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:30.091561 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-222ba9fb-5e2b-47f3-8418-b811e2cbc4a2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:30.092019 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-222ba9fb-5e2b-47f3-8418-b811e2cbc4a2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:30.092464 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-222ba9fb-5e2b-47f3-8418-b811e2cbc4a2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:30.241572 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-222ba9fb-5e2b-47f3-8418-b811e2cbc4a2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:47:30.250171 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-222ba9fb-5e2b-47f3-8418-b811e2cbc4a2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1358 microversion: 2.1 time: 0.173571 Sep 17 21:47:30.250759 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3304/6702] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:47:30 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:47:31.273763 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9aab49bf-e8d7-447f-890f-d880e6e73712 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:47:31.274520 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9aab49bf-e8d7-447f-890f-d880e6e73712 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:47:31.282928 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9aab49bf-e8d7-447f-890f-d880e6e73712 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:31.284106 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9aab49bf-e8d7-447f-890f-d880e6e73712 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:31.284591 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9aab49bf-e8d7-447f-890f-d880e6e73712 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:31.285351 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9aab49bf-e8d7-447f-890f-d880e6e73712 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:31.285876 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9aab49bf-e8d7-447f-890f-d880e6e73712 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:31.286333 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9aab49bf-e8d7-447f-890f-d880e6e73712 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:31.445760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9aab49bf-e8d7-447f-890f-d880e6e73712 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:47:31.453955 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9aab49bf-e8d7-447f-890f-d880e6e73712 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1358 microversion: 2.1 time: 0.184253 Sep 17 21:47:31.454534 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3399/6703] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:47:31 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:47:32.477741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0f84ba89-e196-4ab2-83c1-2b69d5f0529b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:47:32.478475 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0f84ba89-e196-4ab2-83c1-2b69d5f0529b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:47:32.492312 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0f84ba89-e196-4ab2-83c1-2b69d5f0529b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:32.493975 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0f84ba89-e196-4ab2-83c1-2b69d5f0529b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:32.501170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0f84ba89-e196-4ab2-83c1-2b69d5f0529b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:32.502158 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0f84ba89-e196-4ab2-83c1-2b69d5f0529b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:32.502765 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0f84ba89-e196-4ab2-83c1-2b69d5f0529b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:32.503238 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0f84ba89-e196-4ab2-83c1-2b69d5f0529b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:32.660931 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0f84ba89-e196-4ab2-83c1-2b69d5f0529b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:47:32.670286 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0f84ba89-e196-4ab2-83c1-2b69d5f0529b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1358 microversion: 2.1 time: 0.196334 Sep 17 21:47:32.671328 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3305/6704] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:47:32 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:47:33.694264 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a0f9efb5-728c-4089-9a8e-b26ec1dac38f tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:47:33.694902 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a0f9efb5-728c-4089-9a8e-b26ec1dac38f tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:47:33.702455 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0f9efb5-728c-4089-9a8e-b26ec1dac38f tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:33.702970 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0f9efb5-728c-4089-9a8e-b26ec1dac38f tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:33.703430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0f9efb5-728c-4089-9a8e-b26ec1dac38f tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:33.704155 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0f9efb5-728c-4089-9a8e-b26ec1dac38f tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:33.704636 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0f9efb5-728c-4089-9a8e-b26ec1dac38f tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:33.705090 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a0f9efb5-728c-4089-9a8e-b26ec1dac38f tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:33.836246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a0f9efb5-728c-4089-9a8e-b26ec1dac38f tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:47:33.844502 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a0f9efb5-728c-4089-9a8e-b26ec1dac38f tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1358 microversion: 2.1 time: 0.154239 Sep 17 21:47:33.845085 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3400/6705] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:47:33 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:47:34.360850 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-b58ca1a7-060b-4fda-b45a-fd056fc44c04 req-f7dcc087-0654-40c5-8286-69e3c5b1b5d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "125e9a17-0e91-4ceb-99fb-eca63d8c0e4f", "tag": "13ea79e1-fe44-4520-9735-eaab9daf8b29"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:47:34.367721 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:47:34.368397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:47:34.369010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:47:34.373438 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b58ca1a7-060b-4fda-b45a-fd056fc44c04 req-f7dcc087-0654-40c5-8286-69e3c5b1b5d6 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:34.374143 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b58ca1a7-060b-4fda-b45a-fd056fc44c04 req-f7dcc087-0654-40c5-8286-69e3c5b1b5d6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:34.374564 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b58ca1a7-060b-4fda-b45a-fd056fc44c04 req-f7dcc087-0654-40c5-8286-69e3c5b1b5d6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:34.387778 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-b58ca1a7-060b-4fda-b45a-fd056fc44c04 req-f7dcc087-0654-40c5-8286-69e3c5b1b5d6 service nova] Creating event network-changed:13ea79e1-fe44-4520-9735-eaab9daf8b29 for instance 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f on nch1-master-1 Sep 17 21:47:34.392811 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-b58ca1a7-060b-4fda-b45a-fd056fc44c04 req-f7dcc087-0654-40c5-8286-69e3c5b1b5d6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036186 Sep 17 21:47:34.393682 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3306/6706] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:47:34.872307 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ba84c242-aefb-4002-9abc-3680701867f7 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:47:34.873268 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ba84c242-aefb-4002-9abc-3680701867f7 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:47:34.876368 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=6 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:47:34.886794 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ba84c242-aefb-4002-9abc-3680701867f7 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:34.887626 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ba84c242-aefb-4002-9abc-3680701867f7 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:34.888374 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ba84c242-aefb-4002-9abc-3680701867f7 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:34.889724 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ba84c242-aefb-4002-9abc-3680701867f7 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:34.890353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ba84c242-aefb-4002-9abc-3680701867f7 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:34.890637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ba84c242-aefb-4002-9abc-3680701867f7 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:35.030698 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ba84c242-aefb-4002-9abc-3680701867f7 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:47:35.038735 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ba84c242-aefb-4002-9abc-3680701867f7 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1358 microversion: 2.1 time: 0.173089 Sep 17 21:47:35.039342 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3401/6707] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:47:34 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:47:36.062716 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e5beb7f5-5bb6-4505-a20a-f9747a1a5660 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:47:36.063400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e5beb7f5-5bb6-4505-a20a-f9747a1a5660 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:47:36.072536 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5beb7f5-5bb6-4505-a20a-f9747a1a5660 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:36.073487 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5beb7f5-5bb6-4505-a20a-f9747a1a5660 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:36.073651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5beb7f5-5bb6-4505-a20a-f9747a1a5660 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:36.074297 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5beb7f5-5bb6-4505-a20a-f9747a1a5660 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:36.074756 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5beb7f5-5bb6-4505-a20a-f9747a1a5660 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:36.075196 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e5beb7f5-5bb6-4505-a20a-f9747a1a5660 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:36.208988 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e5beb7f5-5bb6-4505-a20a-f9747a1a5660 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:47:36.217321 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e5beb7f5-5bb6-4505-a20a-f9747a1a5660 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1358 microversion: 2.1 time: 0.158931 Sep 17 21:47:36.218038 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3307/6708] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:47:36 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:47:37.244250 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-abfeab3d-4daf-4698-8502-3bfc88fda985 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:47:37.245219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-abfeab3d-4daf-4698-8502-3bfc88fda985 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:47:37.257057 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abfeab3d-4daf-4698-8502-3bfc88fda985 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:37.258007 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abfeab3d-4daf-4698-8502-3bfc88fda985 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:37.258761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abfeab3d-4daf-4698-8502-3bfc88fda985 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:37.259914 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abfeab3d-4daf-4698-8502-3bfc88fda985 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:37.260710 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abfeab3d-4daf-4698-8502-3bfc88fda985 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:37.261447 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-abfeab3d-4daf-4698-8502-3bfc88fda985 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:37.399272 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-abfeab3d-4daf-4698-8502-3bfc88fda985 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:47:37.412171 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-abfeab3d-4daf-4698-8502-3bfc88fda985 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1358 microversion: 2.1 time: 0.174303 Sep 17 21:47:37.412922 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3402/6709] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:47:37 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:47:38.440329 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fff785d7-0aeb-43f8-a33d-c913d922069e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:47:38.440983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fff785d7-0aeb-43f8-a33d-c913d922069e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:47:38.448849 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fff785d7-0aeb-43f8-a33d-c913d922069e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:38.449363 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fff785d7-0aeb-43f8-a33d-c913d922069e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:38.449863 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fff785d7-0aeb-43f8-a33d-c913d922069e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:38.450598 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fff785d7-0aeb-43f8-a33d-c913d922069e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:38.451078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fff785d7-0aeb-43f8-a33d-c913d922069e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:38.451532 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fff785d7-0aeb-43f8-a33d-c913d922069e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:38.582943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fff785d7-0aeb-43f8-a33d-c913d922069e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:47:38.591240 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fff785d7-0aeb-43f8-a33d-c913d922069e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1358 microversion: 2.1 time: 0.155680 Sep 17 21:47:38.591826 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3308/6710] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:47:38 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:47:39.618788 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f32d0ebd-2a8f-4fb0-aa67-96a85d6ecf2e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:47:39.619763 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f32d0ebd-2a8f-4fb0-aa67-96a85d6ecf2e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:47:39.631684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f32d0ebd-2a8f-4fb0-aa67-96a85d6ecf2e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:39.632566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f32d0ebd-2a8f-4fb0-aa67-96a85d6ecf2e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:39.633374 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f32d0ebd-2a8f-4fb0-aa67-96a85d6ecf2e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:39.634619 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f32d0ebd-2a8f-4fb0-aa67-96a85d6ecf2e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:39.635409 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f32d0ebd-2a8f-4fb0-aa67-96a85d6ecf2e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:39.636150 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f32d0ebd-2a8f-4fb0-aa67-96a85d6ecf2e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:39.774729 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f32d0ebd-2a8f-4fb0-aa67-96a85d6ecf2e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:47:39.783275 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f32d0ebd-2a8f-4fb0-aa67-96a85d6ecf2e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1358 microversion: 2.1 time: 0.171728 Sep 17 21:47:39.783865 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3403/6711] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:47:39 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:47:39.905733 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-ba8706be-e37b-4644-9264-5f904ce4d9c1 req-43b8dad4-b738-4f79-a1c2-f3240a9812d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "125e9a17-0e91-4ceb-99fb-eca63d8c0e4f", "name": "network-vif-plugged", "status": "completed", "tag": "13ea79e1-fe44-4520-9735-eaab9daf8b29"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:47:39.915477 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-ba8706be-e37b-4644-9264-5f904ce4d9c1 req-43b8dad4-b738-4f79-a1c2-f3240a9812d8 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:39.915964 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-ba8706be-e37b-4644-9264-5f904ce4d9c1 req-43b8dad4-b738-4f79-a1c2-f3240a9812d8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:39.916405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-ba8706be-e37b-4644-9264-5f904ce4d9c1 req-43b8dad4-b738-4f79-a1c2-f3240a9812d8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:39.927758 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-ba8706be-e37b-4644-9264-5f904ce4d9c1 req-43b8dad4-b738-4f79-a1c2-f3240a9812d8 service nova] Creating event network-vif-plugged:13ea79e1-fe44-4520-9735-eaab9daf8b29 for instance 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f on nch1-master-1 Sep 17 21:47:39.933105 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-ba8706be-e37b-4644-9264-5f904ce4d9c1 req-43b8dad4-b738-4f79-a1c2-f3240a9812d8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107345 Sep 17 21:47:39.933743 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3309/6712] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:47:40.809665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-07893c05-37e4-48f0-973e-b96dd2502670 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:47:40.810523 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-07893c05-37e4-48f0-973e-b96dd2502670 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:47:40.818637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-07893c05-37e4-48f0-973e-b96dd2502670 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:40.819366 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-07893c05-37e4-48f0-973e-b96dd2502670 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:40.819813 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-07893c05-37e4-48f0-973e-b96dd2502670 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:40.820561 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-07893c05-37e4-48f0-973e-b96dd2502670 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:40.821053 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-07893c05-37e4-48f0-973e-b96dd2502670 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:40.821605 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-07893c05-37e4-48f0-973e-b96dd2502670 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:40.961162 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-07893c05-37e4-48f0-973e-b96dd2502670 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:47:40.969651 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-07893c05-37e4-48f0-973e-b96dd2502670 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1358 microversion: 2.1 time: 0.166571 Sep 17 21:47:40.970265 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3404/6713] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:47:40 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:47:42.004571 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d2dbfd64-ef84-41fb-9bf6-bdc259614ec2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:47:42.005654 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d2dbfd64-ef84-41fb-9bf6-bdc259614ec2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:47:42.015810 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2dbfd64-ef84-41fb-9bf6-bdc259614ec2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:42.016310 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2dbfd64-ef84-41fb-9bf6-bdc259614ec2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:42.016754 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2dbfd64-ef84-41fb-9bf6-bdc259614ec2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:42.017497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2dbfd64-ef84-41fb-9bf6-bdc259614ec2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:42.017960 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2dbfd64-ef84-41fb-9bf6-bdc259614ec2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:42.018395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2dbfd64-ef84-41fb-9bf6-bdc259614ec2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:42.151651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d2dbfd64-ef84-41fb-9bf6-bdc259614ec2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:47:42.159747 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d2dbfd64-ef84-41fb-9bf6-bdc259614ec2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1546 microversion: 2.1 time: 0.163923 Sep 17 21:47:42.160334 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3310/6714] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:47:41 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1546 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:47:42.182616 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2c20cf92-1b44-4584-bc7a-faa793d5062e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:47:42.183330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2c20cf92-1b44-4584-bc7a-faa793d5062e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:47:42.190450 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c20cf92-1b44-4584-bc7a-faa793d5062e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:42.190925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c20cf92-1b44-4584-bc7a-faa793d5062e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:42.191621 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c20cf92-1b44-4584-bc7a-faa793d5062e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:42.192446 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c20cf92-1b44-4584-bc7a-faa793d5062e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:42.192981 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c20cf92-1b44-4584-bc7a-faa793d5062e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:42.193500 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2c20cf92-1b44-4584-bc7a-faa793d5062e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:42.330559 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2c20cf92-1b44-4584-bc7a-faa793d5062e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:47:42.339065 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2c20cf92-1b44-4584-bc7a-faa793d5062e tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1546 microversion: 2.1 time: 0.160473 Sep 17 21:47:42.339643 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3405/6715] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:47:42 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1546 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:47:42.361566 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-013aeec5-1806-4645-954b-98ad23431791 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:47:42.366540 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-013aeec5-1806-4645-954b-98ad23431791 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:47:42.367320 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-013aeec5-1806-4645-954b-98ad23431791 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Searching by: {'deleted': False, 'project_id': 'e3015a88384447ce8ee07537d685f3a3'} {{(pid=140523) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 17 21:47:42.373155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-013aeec5-1806-4645-954b-98ad23431791 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:42.373639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-013aeec5-1806-4645-954b-98ad23431791 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:42.374170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-013aeec5-1806-4645-954b-98ad23431791 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:42.374910 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-013aeec5-1806-4645-954b-98ad23431791 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:42.375372 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-013aeec5-1806-4645-954b-98ad23431791 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:42.375812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-013aeec5-1806-4645-954b-98ad23431791 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:42.403807 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.multi_cell_list [None req-013aeec5-1806-4645-954b-98ad23431791 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=140523) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 17 21:47:42.431525 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-013aeec5-1806-4645-954b-98ad23431791 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.073884 Sep 17 21:47:42.432125 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3311/6716] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Sep 17 21:47:42 2022] GET /compute/v2.1/servers => generated 343 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:47:42.446010 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-23e3f72a-4c01-4903-9de7-bef94b5d9e5d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:47:42.446668 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-23e3f72a-4c01-4903-9de7-bef94b5d9e5d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:47:42.453431 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23e3f72a-4c01-4903-9de7-bef94b5d9e5d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:42.454033 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23e3f72a-4c01-4903-9de7-bef94b5d9e5d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:42.454550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23e3f72a-4c01-4903-9de7-bef94b5d9e5d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:42.455362 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23e3f72a-4c01-4903-9de7-bef94b5d9e5d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:42.455858 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23e3f72a-4c01-4903-9de7-bef94b5d9e5d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:42.456311 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-23e3f72a-4c01-4903-9de7-bef94b5d9e5d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:42.595247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-23e3f72a-4c01-4903-9de7-bef94b5d9e5d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:47:42.603550 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-23e3f72a-4c01-4903-9de7-bef94b5d9e5d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1546 microversion: 2.1 time: 0.161498 Sep 17 21:47:42.604147 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3406/6717] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:47:42 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1546 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:47:44.145930 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-59cc6852-ba0b-4e91-b6fb-da60124001bf tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20302c04-a690-4750-9ebe-75495dc664c0"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:47:44.148366 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-59cc6852-ba0b-4e91-b6fb-da60124001bf tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:47:44.155744 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59cc6852-ba0b-4e91-b6fb-da60124001bf tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:44.156237 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59cc6852-ba0b-4e91-b6fb-da60124001bf tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:44.156680 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59cc6852-ba0b-4e91-b6fb-da60124001bf tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:44.157360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59cc6852-ba0b-4e91-b6fb-da60124001bf tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:44.157855 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59cc6852-ba0b-4e91-b6fb-da60124001bf tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:44.158286 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-59cc6852-ba0b-4e91-b6fb-da60124001bf tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:44.414047 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-59cc6852-ba0b-4e91-b6fb-da60124001bf tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "POST /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271919 Sep 17 21:47:44.414759 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3312/6718] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Sep 17 21:47:44 2022] POST /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:47:47.815146 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-920769c3-ba2c-4ce8-8d49-de1baf0784d5 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:47:47.815900 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-920769c3-ba2c-4ce8-8d49-de1baf0784d5 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:47:47.825985 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-920769c3-ba2c-4ce8-8d49-de1baf0784d5 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:47.826502 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-920769c3-ba2c-4ce8-8d49-de1baf0784d5 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:47.826968 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-920769c3-ba2c-4ce8-8d49-de1baf0784d5 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:47.827689 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-920769c3-ba2c-4ce8-8d49-de1baf0784d5 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:47.828173 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-920769c3-ba2c-4ce8-8d49-de1baf0784d5 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:47.828623 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-920769c3-ba2c-4ce8-8d49-de1baf0784d5 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:47.964039 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-920769c3-ba2c-4ce8-8d49-de1baf0784d5 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:47:47.972780 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-920769c3-ba2c-4ce8-8d49-de1baf0784d5 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1592 microversion: 2.1 time: 0.164035 Sep 17 21:47:47.973375 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3407/6719] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:47:47 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1592 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:47:50.019863 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-c6f980d7-6f2e-4976-a1be-2d0b4a8a6623 req-abbdaf18-574a-44ec-83d9-ff5edfff4e9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "125e9a17-0e91-4ceb-99fb-eca63d8c0e4f", "tag": "13ea79e1-fe44-4520-9735-eaab9daf8b29"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:47:50.030965 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-c6f980d7-6f2e-4976-a1be-2d0b4a8a6623 req-abbdaf18-574a-44ec-83d9-ff5edfff4e9a service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:50.031649 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-c6f980d7-6f2e-4976-a1be-2d0b4a8a6623 req-abbdaf18-574a-44ec-83d9-ff5edfff4e9a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:50.032117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-c6f980d7-6f2e-4976-a1be-2d0b4a8a6623 req-abbdaf18-574a-44ec-83d9-ff5edfff4e9a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:50.044556 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-c6f980d7-6f2e-4976-a1be-2d0b4a8a6623 req-abbdaf18-574a-44ec-83d9-ff5edfff4e9a service nova] Creating event network-changed:13ea79e1-fe44-4520-9735-eaab9daf8b29 for instance 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f on nch1-master-1 Sep 17 21:47:50.050009 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-c6f980d7-6f2e-4976-a1be-2d0b4a8a6623 req-abbdaf18-574a-44ec-83d9-ff5edfff4e9a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102604 Sep 17 21:47:50.050961 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3313/6720] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:47:50.987659 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a380ad63-2537-4a71-9208-038f9f7e18a2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-812967816"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:47:50.988328 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a380ad63-2537-4a71-9208-038f9f7e18a2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:47:50.995164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a380ad63-2537-4a71-9208-038f9f7e18a2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:50.995791 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a380ad63-2537-4a71-9208-038f9f7e18a2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:50.996239 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a380ad63-2537-4a71-9208-038f9f7e18a2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:50.997074 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a380ad63-2537-4a71-9208-038f9f7e18a2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:50.997577 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a380ad63-2537-4a71-9208-038f9f7e18a2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:50.998048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a380ad63-2537-4a71-9208-038f9f7e18a2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:51.131149 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.network.security_group_api [None req-a380ad63-2537-4a71-9208-038f9f7e18a2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Adding security group 83d793fa-f9ee-48f8-ac32-ccc34b4744e5 to port 13ea79e1-fe44-4520-9735-eaab9daf8b29 Sep 17 21:47:51.454330 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a380ad63-2537-4a71-9208-038f9f7e18a2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "POST /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f/action" status: 202 len: 0 microversion: 2.1 time: 0.470986 Sep 17 21:47:51.455535 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3408/6721] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:47:50 2022] POST /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f/action => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:47:51.465620 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b1dbb7f6-1f52-499a-b5ea-a0a1fc8b91bd tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:47:51.466461 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b1dbb7f6-1f52-499a-b5ea-a0a1fc8b91bd tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:47:51.472980 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b1dbb7f6-1f52-499a-b5ea-a0a1fc8b91bd tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:51.473562 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b1dbb7f6-1f52-499a-b5ea-a0a1fc8b91bd tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:51.474078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b1dbb7f6-1f52-499a-b5ea-a0a1fc8b91bd tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:51.474901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b1dbb7f6-1f52-499a-b5ea-a0a1fc8b91bd tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:51.475428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b1dbb7f6-1f52-499a-b5ea-a0a1fc8b91bd tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:51.475998 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b1dbb7f6-1f52-499a-b5ea-a0a1fc8b91bd tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:51.624134 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b1dbb7f6-1f52-499a-b5ea-a0a1fc8b91bd tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:47:51.634297 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b1dbb7f6-1f52-499a-b5ea-a0a1fc8b91bd tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1756 microversion: 2.1 time: 0.174120 Sep 17 21:47:51.634889 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3314/6722] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:47:51 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:47:52.066280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-9b0f578d-7cee-4bb5-815b-491dd4c05786 req-9ca6256e-a59a-48cc-8f22-f8114029c264 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "125e9a17-0e91-4ceb-99fb-eca63d8c0e4f", "tag": "13ea79e1-fe44-4520-9735-eaab9daf8b29"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:47:52.075867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-9b0f578d-7cee-4bb5-815b-491dd4c05786 req-9ca6256e-a59a-48cc-8f22-f8114029c264 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:47:52.076403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-9b0f578d-7cee-4bb5-815b-491dd4c05786 req-9ca6256e-a59a-48cc-8f22-f8114029c264 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:47:52.076860 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-9b0f578d-7cee-4bb5-815b-491dd4c05786 req-9ca6256e-a59a-48cc-8f22-f8114029c264 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:47:52.088926 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-9b0f578d-7cee-4bb5-815b-491dd4c05786 req-9ca6256e-a59a-48cc-8f22-f8114029c264 service nova] Creating event network-changed:13ea79e1-fe44-4520-9735-eaab9daf8b29 for instance 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f on nch1-master-1 Sep 17 21:47:52.094174 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-9b0f578d-7cee-4bb5-815b-491dd4c05786 req-9ca6256e-a59a-48cc-8f22-f8114029c264 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032672 Sep 17 21:47:52.094757 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3409/6723] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:48:13.380022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:48:13.380905 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=17 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:48:13.381554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:48:13.431222 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cba5ef66-4fb0-4a67-a78f-78d6b8c02e40 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:48:13.433628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cba5ef66-4fb0-4a67-a78f-78d6b8c02e40 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:48:13.439964 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cba5ef66-4fb0-4a67-a78f-78d6b8c02e40 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:48:13.440454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cba5ef66-4fb0-4a67-a78f-78d6b8c02e40 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:48:13.440895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cba5ef66-4fb0-4a67-a78f-78d6b8c02e40 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:48:13.441617 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cba5ef66-4fb0-4a67-a78f-78d6b8c02e40 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:48:13.442075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cba5ef66-4fb0-4a67-a78f-78d6b8c02e40 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:48:13.442502 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cba5ef66-4fb0-4a67-a78f-78d6b8c02e40 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:48:13.518714 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cba5ef66-4fb0-4a67-a78f-78d6b8c02e40 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "POST /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f/action" status: 202 len: 0 microversion: 2.1 time: 0.143360 Sep 17 21:48:13.519340 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3315/6724] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:48:13 2022] POST /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:48:13.526231 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:48:13.527010 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=72 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:48:13.531632 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-27ac61a8-19b1-4424-8f9a-46479e2383ab tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:48:13.532400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-27ac61a8-19b1-4424-8f9a-46479e2383ab tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:48:13.540635 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27ac61a8-19b1-4424-8f9a-46479e2383ab tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:48:13.541146 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27ac61a8-19b1-4424-8f9a-46479e2383ab tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:48:13.541656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27ac61a8-19b1-4424-8f9a-46479e2383ab tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:48:13.542393 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27ac61a8-19b1-4424-8f9a-46479e2383ab tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:48:13.542902 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27ac61a8-19b1-4424-8f9a-46479e2383ab tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:48:13.543435 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27ac61a8-19b1-4424-8f9a-46479e2383ab tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:48:13.691232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-27ac61a8-19b1-4424-8f9a-46479e2383ab tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:48:13.699586 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-27ac61a8-19b1-4424-8f9a-46479e2383ab tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1748 microversion: 2.1 time: 0.175492 Sep 17 21:48:13.700438 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3410/6725] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:48:13 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1748 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:48:14.725080 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-74480945-96d0-41cc-9920-00e81ac3738b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:48:14.725856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-74480945-96d0-41cc-9920-00e81ac3738b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:48:14.733266 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74480945-96d0-41cc-9920-00e81ac3738b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:48:14.733848 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74480945-96d0-41cc-9920-00e81ac3738b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:48:14.734159 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74480945-96d0-41cc-9920-00e81ac3738b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:48:14.734863 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74480945-96d0-41cc-9920-00e81ac3738b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:48:14.735339 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74480945-96d0-41cc-9920-00e81ac3738b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:48:14.735767 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-74480945-96d0-41cc-9920-00e81ac3738b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:48:14.894393 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-74480945-96d0-41cc-9920-00e81ac3738b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:48:14.903847 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-74480945-96d0-41cc-9920-00e81ac3738b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1753 microversion: 2.1 time: 0.184322 Sep 17 21:48:14.904665 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3316/6726] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:48:14 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1753 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:48:15.932692 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-351d62ee-643c-4391-ae6e-aec33e52188a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:48:15.933843 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-351d62ee-643c-4391-ae6e-aec33e52188a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:48:15.946060 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-351d62ee-643c-4391-ae6e-aec33e52188a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:48:15.946862 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-351d62ee-643c-4391-ae6e-aec33e52188a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:48:15.947635 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-351d62ee-643c-4391-ae6e-aec33e52188a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:48:15.948898 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-351d62ee-643c-4391-ae6e-aec33e52188a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:48:15.949782 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-351d62ee-643c-4391-ae6e-aec33e52188a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:48:15.950807 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-351d62ee-643c-4391-ae6e-aec33e52188a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:48:16.099644 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-351d62ee-643c-4391-ae6e-aec33e52188a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:48:16.108767 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-351d62ee-643c-4391-ae6e-aec33e52188a tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1753 microversion: 2.1 time: 0.182805 Sep 17 21:48:16.109352 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3411/6727] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:48:15 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1753 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:48:17.132431 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-924b8dd3-2142-4677-8251-d6f8a592ce40 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:48:17.133297 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-924b8dd3-2142-4677-8251-d6f8a592ce40 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:48:17.140626 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-924b8dd3-2142-4677-8251-d6f8a592ce40 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:48:17.141218 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-924b8dd3-2142-4677-8251-d6f8a592ce40 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:48:17.141731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-924b8dd3-2142-4677-8251-d6f8a592ce40 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:48:17.142450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-924b8dd3-2142-4677-8251-d6f8a592ce40 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:48:17.142902 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-924b8dd3-2142-4677-8251-d6f8a592ce40 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:48:17.143341 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-924b8dd3-2142-4677-8251-d6f8a592ce40 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:48:17.292593 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-924b8dd3-2142-4677-8251-d6f8a592ce40 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:48:17.301518 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-924b8dd3-2142-4677-8251-d6f8a592ce40 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1753 microversion: 2.1 time: 0.173043 Sep 17 21:48:17.302195 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3317/6728] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:48:17 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:48:18.329127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c28ba461-3a68-46b6-b801-6e9883b66352 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:48:18.329794 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c28ba461-3a68-46b6-b801-6e9883b66352 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:48:18.337744 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c28ba461-3a68-46b6-b801-6e9883b66352 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:48:18.338252 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c28ba461-3a68-46b6-b801-6e9883b66352 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:48:18.338708 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c28ba461-3a68-46b6-b801-6e9883b66352 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:48:18.339429 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c28ba461-3a68-46b6-b801-6e9883b66352 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:48:18.339905 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c28ba461-3a68-46b6-b801-6e9883b66352 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:48:18.340346 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c28ba461-3a68-46b6-b801-6e9883b66352 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:48:18.491841 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c28ba461-3a68-46b6-b801-6e9883b66352 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:48:18.502428 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c28ba461-3a68-46b6-b801-6e9883b66352 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1753 microversion: 2.1 time: 0.179393 Sep 17 21:48:18.503029 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3412/6729] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:48:18 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:48:19.526216 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bf1a658a-bc2f-4160-b9f1-b6755bd159ff tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:48:19.526812 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bf1a658a-bc2f-4160-b9f1-b6755bd159ff tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:48:19.534299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf1a658a-bc2f-4160-b9f1-b6755bd159ff tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:48:19.534787 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf1a658a-bc2f-4160-b9f1-b6755bd159ff tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:48:19.535231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf1a658a-bc2f-4160-b9f1-b6755bd159ff tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:48:19.535933 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf1a658a-bc2f-4160-b9f1-b6755bd159ff tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:48:19.536388 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf1a658a-bc2f-4160-b9f1-b6755bd159ff tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:48:19.536816 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bf1a658a-bc2f-4160-b9f1-b6755bd159ff tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:48:19.685366 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bf1a658a-bc2f-4160-b9f1-b6755bd159ff tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:48:19.694680 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bf1a658a-bc2f-4160-b9f1-b6755bd159ff tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1753 microversion: 2.1 time: 0.172398 Sep 17 21:48:19.695276 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3318/6730] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:48:19 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:48:20.720859 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3be3a281-e2f9-446b-9100-6d856cc1ef4b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:48:20.721500 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3be3a281-e2f9-446b-9100-6d856cc1ef4b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:48:20.728195 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3be3a281-e2f9-446b-9100-6d856cc1ef4b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:48:20.728705 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3be3a281-e2f9-446b-9100-6d856cc1ef4b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:48:20.729165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3be3a281-e2f9-446b-9100-6d856cc1ef4b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:48:20.729892 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3be3a281-e2f9-446b-9100-6d856cc1ef4b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:48:20.730404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3be3a281-e2f9-446b-9100-6d856cc1ef4b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:48:20.730850 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3be3a281-e2f9-446b-9100-6d856cc1ef4b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:48:20.884495 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3be3a281-e2f9-446b-9100-6d856cc1ef4b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:48:20.898039 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3be3a281-e2f9-446b-9100-6d856cc1ef4b tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1753 microversion: 2.1 time: 0.182616 Sep 17 21:48:20.898896 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3413/6731] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:48:20 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1753 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:48:21.928758 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-008d7534-d1c1-4726-ac88-ba804d4fe8c0 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:48:21.929807 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-008d7534-d1c1-4726-ac88-ba804d4fe8c0 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:48:21.941711 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-008d7534-d1c1-4726-ac88-ba804d4fe8c0 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:48:21.942423 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-008d7534-d1c1-4726-ac88-ba804d4fe8c0 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:48:21.943143 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-008d7534-d1c1-4726-ac88-ba804d4fe8c0 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:48:21.944301 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-008d7534-d1c1-4726-ac88-ba804d4fe8c0 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:48:21.945062 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-008d7534-d1c1-4726-ac88-ba804d4fe8c0 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:48:21.945844 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-008d7534-d1c1-4726-ac88-ba804d4fe8c0 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:48:22.095535 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-008d7534-d1c1-4726-ac88-ba804d4fe8c0 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:48:22.107621 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-008d7534-d1c1-4726-ac88-ba804d4fe8c0 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1753 microversion: 2.1 time: 0.185401 Sep 17 21:48:22.108433 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3319/6732] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:48:21 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1753 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:48:23.133639 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f44ac22a-46b1-43ba-996e-c1800e61b58d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:48:23.134265 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f44ac22a-46b1-43ba-996e-c1800e61b58d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:48:23.141788 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f44ac22a-46b1-43ba-996e-c1800e61b58d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:48:23.142301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f44ac22a-46b1-43ba-996e-c1800e61b58d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:48:23.142757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f44ac22a-46b1-43ba-996e-c1800e61b58d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:48:23.143493 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f44ac22a-46b1-43ba-996e-c1800e61b58d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:48:23.143965 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f44ac22a-46b1-43ba-996e-c1800e61b58d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:48:23.144415 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f44ac22a-46b1-43ba-996e-c1800e61b58d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:48:23.305595 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f44ac22a-46b1-43ba-996e-c1800e61b58d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:48:23.314433 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f44ac22a-46b1-43ba-996e-c1800e61b58d tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1753 microversion: 2.1 time: 0.185756 Sep 17 21:48:23.315210 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3414/6733] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:48:23 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1753 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:48:24.342226 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-73e8b94d-b427-4025-894f-63a77af767d1 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:48:24.343429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-73e8b94d-b427-4025-894f-63a77af767d1 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:48:24.355488 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73e8b94d-b427-4025-894f-63a77af767d1 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:48:24.356299 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73e8b94d-b427-4025-894f-63a77af767d1 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:48:24.357029 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73e8b94d-b427-4025-894f-63a77af767d1 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:48:24.358232 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73e8b94d-b427-4025-894f-63a77af767d1 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:48:24.358997 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73e8b94d-b427-4025-894f-63a77af767d1 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:48:24.359598 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73e8b94d-b427-4025-894f-63a77af767d1 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:48:24.508749 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-73e8b94d-b427-4025-894f-63a77af767d1 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:48:24.517607 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-73e8b94d-b427-4025-894f-63a77af767d1 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1753 microversion: 2.1 time: 0.182004 Sep 17 21:48:24.518193 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3320/6734] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:48:24 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1753 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:48:25.540641 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3a81a019-3bfb-4d0a-85d6-ec6fa36a748f tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:48:25.541264 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3a81a019-3bfb-4d0a-85d6-ec6fa36a748f tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:48:25.549119 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a81a019-3bfb-4d0a-85d6-ec6fa36a748f tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:48:25.549656 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a81a019-3bfb-4d0a-85d6-ec6fa36a748f tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:48:25.550118 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a81a019-3bfb-4d0a-85d6-ec6fa36a748f tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:48:25.550865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a81a019-3bfb-4d0a-85d6-ec6fa36a748f tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:48:25.551318 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a81a019-3bfb-4d0a-85d6-ec6fa36a748f tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:48:25.551766 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3a81a019-3bfb-4d0a-85d6-ec6fa36a748f tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:48:25.700934 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3a81a019-3bfb-4d0a-85d6-ec6fa36a748f tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:48:25.710385 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3a81a019-3bfb-4d0a-85d6-ec6fa36a748f tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1756 microversion: 2.1 time: 0.173768 Sep 17 21:48:25.710947 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3415/6735] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:48:25 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:48:57.920521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2b978b9f-bab8-48c2-88c5-d642d1bd4048 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-812967816"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:48:57.921655 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2b978b9f-bab8-48c2-88c5-d642d1bd4048 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:48:57.925396 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=12 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:48:57.926677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:48:57.934746 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b978b9f-bab8-48c2-88c5-d642d1bd4048 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:48:57.935258 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b978b9f-bab8-48c2-88c5-d642d1bd4048 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:48:57.935705 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b978b9f-bab8-48c2-88c5-d642d1bd4048 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:48:57.936425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b978b9f-bab8-48c2-88c5-d642d1bd4048 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:48:57.936893 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b978b9f-bab8-48c2-88c5-d642d1bd4048 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:48:57.937325 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b978b9f-bab8-48c2-88c5-d642d1bd4048 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:48:58.232524 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.network.security_group_api [None req-2b978b9f-bab8-48c2-88c5-d642d1bd4048 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Removing security group 83d793fa-f9ee-48f8-ac32-ccc34b4744e5 from port 13ea79e1-fe44-4520-9735-eaab9daf8b29 Sep 17 21:48:58.557866 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2b978b9f-bab8-48c2-88c5-d642d1bd4048 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "POST /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f/action" status: 202 len: 0 microversion: 2.1 time: 0.645041 Sep 17 21:48:58.558602 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3321/6736] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:48:57 2022] POST /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f/action => generated 0 bytes in 647 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:48:58.568506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-c9608b56-a978-4d46-be2b-3b32adf86396 req-9ee5c90d-b0e7-44cc-8128-dcd88bc185d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "125e9a17-0e91-4ceb-99fb-eca63d8c0e4f", "tag": "13ea79e1-fe44-4520-9735-eaab9daf8b29"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:48:58.574406 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=12 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:48:58.575188 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=36 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:48:58.581807 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c9608b56-a978-4d46-be2b-3b32adf86396 req-9ee5c90d-b0e7-44cc-8128-dcd88bc185d8 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:48:58.582399 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c9608b56-a978-4d46-be2b-3b32adf86396 req-9ee5c90d-b0e7-44cc-8128-dcd88bc185d8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:48:58.582903 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c9608b56-a978-4d46-be2b-3b32adf86396 req-9ee5c90d-b0e7-44cc-8128-dcd88bc185d8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:48:58.594796 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-c9608b56-a978-4d46-be2b-3b32adf86396 req-9ee5c90d-b0e7-44cc-8128-dcd88bc185d8 service nova] Creating event network-changed:13ea79e1-fe44-4520-9735-eaab9daf8b29 for instance 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f on nch1-master-1 Sep 17 21:48:58.600545 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-c9608b56-a978-4d46-be2b-3b32adf86396 req-9ee5c90d-b0e7-44cc-8128-dcd88bc185d8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036253 Sep 17 21:48:58.601546 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3416/6737] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:48:59.687704 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7661816e-5d81-4eee-91d8-31530d7a6a94 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:48:59.688279 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7661816e-5d81-4eee-91d8-31530d7a6a94 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:48:59.694730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7661816e-5d81-4eee-91d8-31530d7a6a94 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:48:59.695228 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7661816e-5d81-4eee-91d8-31530d7a6a94 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:48:59.695679 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7661816e-5d81-4eee-91d8-31530d7a6a94 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:48:59.696396 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7661816e-5d81-4eee-91d8-31530d7a6a94 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:48:59.696856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7661816e-5d81-4eee-91d8-31530d7a6a94 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:48:59.697301 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7661816e-5d81-4eee-91d8-31530d7a6a94 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:48:59.779680 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-7661816e-5d81-4eee-91d8-31530d7a6a94 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lazy-loading 'services' on Instance uuid 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:48:59.856491 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7661816e-5d81-4eee-91d8-31530d7a6a94 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "DELETE /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f/os-volume_attachments/20302c04-a690-4750-9ebe-75495dc664c0" status: 202 len: 0 microversion: 2.1 time: 0.173469 Sep 17 21:48:59.857109 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3322/6738] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Sep 17 21:48:59 2022] DELETE /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f/os-volume_attachments/20302c04-a690-4750-9ebe-75495dc664c0 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:48:59.868222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e5e8a842-a3f7-4535-a942-eb9789669d55 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:48:59.870624 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e5e8a842-a3f7-4535-a942-eb9789669d55 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:48:59.879126 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5e8a842-a3f7-4535-a942-eb9789669d55 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:48:59.879639 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5e8a842-a3f7-4535-a942-eb9789669d55 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:48:59.880108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5e8a842-a3f7-4535-a942-eb9789669d55 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:48:59.880842 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5e8a842-a3f7-4535-a942-eb9789669d55 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:48:59.881312 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5e8a842-a3f7-4535-a942-eb9789669d55 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:48:59.881850 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e5e8a842-a3f7-4535-a942-eb9789669d55 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:48:59.920969 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e5e8a842-a3f7-4535-a942-eb9789669d55 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058552 Sep 17 21:48:59.922160 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3417/6739] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 17 21:48:59 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:49:00.617231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-9195735f-4ea7-43d1-936b-4a69c49be435 req-b336d2e4-2ea7-4c32-9049-48f3531339a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "125e9a17-0e91-4ceb-99fb-eca63d8c0e4f", "tag": "13ea79e1-fe44-4520-9735-eaab9daf8b29"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:49:00.627669 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-9195735f-4ea7-43d1-936b-4a69c49be435 req-b336d2e4-2ea7-4c32-9049-48f3531339a3 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:00.628155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-9195735f-4ea7-43d1-936b-4a69c49be435 req-b336d2e4-2ea7-4c32-9049-48f3531339a3 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:00.628588 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-9195735f-4ea7-43d1-936b-4a69c49be435 req-b336d2e4-2ea7-4c32-9049-48f3531339a3 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:00.645020 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-9195735f-4ea7-43d1-936b-4a69c49be435 req-b336d2e4-2ea7-4c32-9049-48f3531339a3 service nova] Creating event network-changed:13ea79e1-fe44-4520-9735-eaab9daf8b29 for instance 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f on nch1-master-1 Sep 17 21:49:00.650114 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-9195735f-4ea7-43d1-936b-4a69c49be435 req-b336d2e4-2ea7-4c32-9049-48f3531339a3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037536 Sep 17 21:49:00.651047 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3323/6740] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:49:00.934449 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-67dbd4b5-94f4-4502-995d-2cc7fa61d7d0 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:49:00.937681 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-67dbd4b5-94f4-4502-995d-2cc7fa61d7d0 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:49:00.945541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-67dbd4b5-94f4-4502-995d-2cc7fa61d7d0 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:00.946197 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-67dbd4b5-94f4-4502-995d-2cc7fa61d7d0 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:00.946743 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-67dbd4b5-94f4-4502-995d-2cc7fa61d7d0 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:00.947377 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-67dbd4b5-94f4-4502-995d-2cc7fa61d7d0 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:00.947851 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-67dbd4b5-94f4-4502-995d-2cc7fa61d7d0 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:00.948295 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-67dbd4b5-94f4-4502-995d-2cc7fa61d7d0 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:00.980712 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-67dbd4b5-94f4-4502-995d-2cc7fa61d7d0 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050035 Sep 17 21:49:00.981308 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3418/6741] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Sep 17 21:49:00 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 17 21:49:00.993985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5a709a81-1b73-4e3d-bbc4-5d17ce357ba7 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:49:00.994661 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5a709a81-1b73-4e3d-bbc4-5d17ce357ba7 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:49:01.001141 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5a709a81-1b73-4e3d-bbc4-5d17ce357ba7 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:01.001750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5a709a81-1b73-4e3d-bbc4-5d17ce357ba7 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:01.002263 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5a709a81-1b73-4e3d-bbc4-5d17ce357ba7 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:01.003025 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5a709a81-1b73-4e3d-bbc4-5d17ce357ba7 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:01.003486 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5a709a81-1b73-4e3d-bbc4-5d17ce357ba7 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:01.003919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5a709a81-1b73-4e3d-bbc4-5d17ce357ba7 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:01.084761 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-5a709a81-1b73-4e3d-bbc4-5d17ce357ba7 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] HTTP exception thrown: Instance 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f is not attached to volume 20302c04-a690-4750-9ebe-75495dc664c0 Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5a709a81-1b73-4e3d-bbc4-5d17ce357ba7 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Request method failure captured: Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: request: DELETE /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f/os-volume_attachments/20302c04-a690-4750-9ebe-75495dc664c0 HTTP/1.1 Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJj9YhwGEdZ3EeyDD0tngX1YINRibOfWN7YNObQv7IepXkRZ6slkwX5sOG20k0SfZB8Xrx1BM3okYvvW4dKmCPoR_U8RBue165oxYKvn1nYbi0eyWUZXJ-Gl-DDi5QQVKatl6ElLaHFqntQZ4Dtg8fi1ILDC8xiKlStcPEt_RmXjcIg4 Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: e3015a88384447ce8ee07537d685f3a3 Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-TestMinimumBasicScenario-231644504 Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3015a88384447ce8ee07537d685f3a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e3015a88384447ce8ee07537d685f3a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3015a88384447ce8ee07537d685f3a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e3015a88384447ce8ee07537d685f3a3", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-TestMinimumBasicScenario-231644504 Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: e3015a88384447ce8ee07537d685f3a3 Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-TestMinimumBasicScenario-231644504 Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-TestMinimumBasicScenario-231644504-project Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 806819c3594d48fe9bf3d0cce5fee164 Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-TestMinimumBasicScenario-231644504-project Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f is not attached to volume 20302c04-a690-4750-9ebe-75495dc664c0 Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'server_id': '125e9a17-0e91-4ceb-99fb-eca63d8c0e4f', 'id': '20302c04-a690-4750-9ebe-75495dc664c0'} Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 20302c04-a690-4750-9ebe-75495dc664c0. Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f is not attached to volume 20302c04-a690-4750-9ebe-75495dc664c0 Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:49:01.087141 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:49:01.093120 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:49:01.093120 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:49:01.093120 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f is not attached to volume 20302c04-a690-4750-9ebe-75495dc664c0 Sep 17 21:49:01.093120 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:49:01.094495 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5a709a81-1b73-4e3d-bbc4-5d17ce357ba7 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Returning 404 to user: Instance 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f is not attached to volume 20302c04-a690-4750-9ebe-75495dc664c0 {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:49:01.095375 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5a709a81-1b73-4e3d-bbc4-5d17ce357ba7 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "DELETE /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f/os-volume_attachments/20302c04-a690-4750-9ebe-75495dc664c0" status: 404 len: 154 microversion: 2.1 time: 0.106996 Sep 17 21:49:01.095958 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3324/6742] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Sep 17 21:49:00 2022] DELETE /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f/os-volume_attachments/20302c04-a690-4750-9ebe-75495dc664c0 => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:49:02.253425 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5034818b-2104-445f-bbb2-50d09448d616 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:49:02.254075 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5034818b-2104-445f-bbb2-50d09448d616 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:49:02.261110 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5034818b-2104-445f-bbb2-50d09448d616 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:02.261677 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5034818b-2104-445f-bbb2-50d09448d616 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:02.262137 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5034818b-2104-445f-bbb2-50d09448d616 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:02.262850 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5034818b-2104-445f-bbb2-50d09448d616 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:02.263349 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5034818b-2104-445f-bbb2-50d09448d616 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:02.263770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5034818b-2104-445f-bbb2-50d09448d616 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:02.292712 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5034818b-2104-445f-bbb2-50d09448d616 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:49:02.375133 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5034818b-2104-445f-bbb2-50d09448d616 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "DELETE /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 204 len: 0 microversion: 2.1 time: 0.125428 Sep 17 21:49:02.375901 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3419/6743] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:49:02 2022] DELETE /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:49:02.384526 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7fb63015-50fd-4db5-8568-2f9611e8a5e8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:49:02.385194 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7fb63015-50fd-4db5-8568-2f9611e8a5e8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:49:02.393146 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7fb63015-50fd-4db5-8568-2f9611e8a5e8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:02.393677 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7fb63015-50fd-4db5-8568-2f9611e8a5e8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:02.394123 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7fb63015-50fd-4db5-8568-2f9611e8a5e8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:02.394831 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7fb63015-50fd-4db5-8568-2f9611e8a5e8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:02.395284 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7fb63015-50fd-4db5-8568-2f9611e8a5e8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:02.395712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7fb63015-50fd-4db5-8568-2f9611e8a5e8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:02.531267 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7fb63015-50fd-4db5-8568-2f9611e8a5e8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:49:02.539760 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7fb63015-50fd-4db5-8568-2f9611e8a5e8 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1552 microversion: 2.1 time: 0.159274 Sep 17 21:49:02.540367 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3325/6744] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:49:02 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1552 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:49:03.569090 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3c2d9f51-e177-485e-9023-3113568224aa tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:49:03.570185 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3c2d9f51-e177-485e-9023-3113568224aa tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:49:03.583029 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c2d9f51-e177-485e-9023-3113568224aa tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:03.584263 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c2d9f51-e177-485e-9023-3113568224aa tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:03.585153 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c2d9f51-e177-485e-9023-3113568224aa tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:03.585938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c2d9f51-e177-485e-9023-3113568224aa tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:03.586405 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c2d9f51-e177-485e-9023-3113568224aa tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:03.586853 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c2d9f51-e177-485e-9023-3113568224aa tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:03.845401 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3c2d9f51-e177-485e-9023-3113568224aa tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:49:03.853732 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3c2d9f51-e177-485e-9023-3113568224aa tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1552 microversion: 2.1 time: 0.292097 Sep 17 21:49:03.854306 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3420/6745] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:49:03 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1552 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:49:04.575168 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-16f613e4-0d0e-4f1a-bf27-0c831349dcad req-e7f6d601-fba2-41ce-933e-f0542fa1ab5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "125e9a17-0e91-4ceb-99fb-eca63d8c0e4f", "name": "network-vif-deleted", "tag": "13ea79e1-fe44-4520-9735-eaab9daf8b29"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:49:04.586063 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-16f613e4-0d0e-4f1a-bf27-0c831349dcad req-e7f6d601-fba2-41ce-933e-f0542fa1ab5f service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:04.586543 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-16f613e4-0d0e-4f1a-bf27-0c831349dcad req-e7f6d601-fba2-41ce-933e-f0542fa1ab5f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:04.586977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-16f613e4-0d0e-4f1a-bf27-0c831349dcad req-e7f6d601-fba2-41ce-933e-f0542fa1ab5f service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:04.599098 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-16f613e4-0d0e-4f1a-bf27-0c831349dcad req-e7f6d601-fba2-41ce-933e-f0542fa1ab5f service nova] Creating event network-vif-deleted:13ea79e1-fe44-4520-9735-eaab9daf8b29 for instance 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f on nch1-master-1 Sep 17 21:49:04.604634 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-16f613e4-0d0e-4f1a-bf27-0c831349dcad req-e7f6d601-fba2-41ce-933e-f0542fa1ab5f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087716 Sep 17 21:49:04.605251 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3326/6746] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:49:04.876293 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-94c0c38c-6acc-4fe4-8f5d-50f7bc6b09b2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:49:04.877277 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-94c0c38c-6acc-4fe4-8f5d-50f7bc6b09b2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:49:04.884530 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94c0c38c-6acc-4fe4-8f5d-50f7bc6b09b2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:04.885262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94c0c38c-6acc-4fe4-8f5d-50f7bc6b09b2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:04.885725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94c0c38c-6acc-4fe4-8f5d-50f7bc6b09b2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:04.886693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94c0c38c-6acc-4fe4-8f5d-50f7bc6b09b2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:04.887146 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94c0c38c-6acc-4fe4-8f5d-50f7bc6b09b2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:04.887760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94c0c38c-6acc-4fe4-8f5d-50f7bc6b09b2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:04.926038 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94c0c38c-6acc-4fe4-8f5d-50f7bc6b09b2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:04.926838 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94c0c38c-6acc-4fe4-8f5d-50f7bc6b09b2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:04.927299 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-94c0c38c-6acc-4fe4-8f5d-50f7bc6b09b2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:04.927778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-94c0c38c-6acc-4fe4-8f5d-50f7bc6b09b2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lazy-loading 'fault' on Instance uuid 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:49:04.975489 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-94c0c38c-6acc-4fe4-8f5d-50f7bc6b09b2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '806819c3594d48fe9bf3d0cce5fee164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3015a88384447ce8ee07537d685f3a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:49:04.985199 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-94c0c38c-6acc-4fe4-8f5d-50f7bc6b09b2 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 200 len: 1348 microversion: 2.1 time: 0.112785 Sep 17 21:49:04.985816 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3421/6747] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:49:04 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 1348 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:49:06.010684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c5cd81b3-835a-4a17-9a06-cee01c115dc1 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:49:06.011467 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c5cd81b3-835a-4a17-9a06-cee01c115dc1 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] [instance: 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:49:06.019567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c5cd81b3-835a-4a17-9a06-cee01c115dc1 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:06.020136 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c5cd81b3-835a-4a17-9a06-cee01c115dc1 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:06.020624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c5cd81b3-835a-4a17-9a06-cee01c115dc1 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:06.021403 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c5cd81b3-835a-4a17-9a06-cee01c115dc1 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:06.021946 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c5cd81b3-835a-4a17-9a06-cee01c115dc1 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:06.022418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c5cd81b3-835a-4a17-9a06-cee01c115dc1 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:06.036721 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-c5cd81b3-835a-4a17-9a06-cee01c115dc1 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] HTTP exception thrown: Instance 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f could not be found. Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c5cd81b3-835a-4a17-9a06-cee01c115dc1 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Request method failure captured: Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f HTTP/1.1 Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJj9YhwGEdZ3EeyDD0tngX1YINRibOfWN7YNObQv7IepXkRZ6slkwX5sOG20k0SfZB8Xrx1BM3okYvvW4dKmCPoR_U8RBue165oxYKvn1nYbi0eyWUZXJ-Gl-DDi5QQVKatl6ElLaHFqntQZ4Dtg8fi1ILDC8xiKlStcPEt_RmXjcIg4 Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: e3015a88384447ce8ee07537d685f3a3 Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-TestMinimumBasicScenario-231644504 Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3015a88384447ce8ee07537d685f3a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e3015a88384447ce8ee07537d685f3a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3015a88384447ce8ee07537d685f3a3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e3015a88384447ce8ee07537d685f3a3", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-TestMinimumBasicScenario-231644504 Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: e3015a88384447ce8ee07537d685f3a3 Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-TestMinimumBasicScenario-231644504 Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-TestMinimumBasicScenario-231644504-project Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 806819c3594d48fe9bf3d0cce5fee164 Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-TestMinimumBasicScenario-231644504-project Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f could not be found. Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '125e9a17-0e91-4ceb-99fb-eca63d8c0e4f'} Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f could not be found. Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f could not be found. Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:49:06.038398 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:49:06.043919 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:49:06.043919 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:49:06.043919 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:49:06.043919 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:49:06.043919 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:49:06.043919 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f could not be found. Sep 17 21:49:06.043919 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:49:06.043919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c5cd81b3-835a-4a17-9a06-cee01c115dc1 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Returning 404 to user: Instance 125e9a17-0e91-4ceb-99fb-eca63d8c0e4f could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:49:06.043919 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c5cd81b3-835a-4a17-9a06-cee01c115dc1 tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f" status: 404 len: 111 microversion: 2.1 time: 0.034374 Sep 17 21:49:06.043919 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3327/6748] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:49:06 2022] GET /compute/v2.1/servers/125e9a17-0e91-4ceb-99fb-eca63d8c0e4f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:49:06.048842 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5d75a059-da7d-4416-ba79-458c7396f20c tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] Calling method '.version_select at 0x7f259fcf3e50>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:49:06.071412 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5d75a059-da7d-4416-ba79-458c7396f20c tempest-TestMinimumBasicScenario-231644504 tempest-TestMinimumBasicScenario-231644504-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-399750370" status: 202 len: 0 microversion: 2.1 time: 0.026437 Sep 17 21:49:06.071969 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3422/6749] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Sep 17 21:49:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-399750370 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:49:15.466089 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bf8a5881-d673-447f-a540-777f4f649161 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Action: 'create', calling method: .version_select at 0x7f25a48039d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1673570790", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHOrhJhaVNRtf5/JBGN5DPfb6uP7t3ZEIga9LS3yvjoJpGBHSxyuaDBYSEhh/5bssFW59c+YQzUBBa4nmTh59yCxAzIE97rqxW36VbCLCOxB0xLC1HOeeiOnrrGjWkD1A=="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:49:15.483156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-bf8a5881-d673-447f-a540-777f4f649161 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Getting quotas for project 88a7205c02914d428fd0d43b7fa61fe9. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:49:15.488700 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-bf8a5881-d673-447f-a540-777f4f649161 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Getting quotas for user ac0fa1f4eeca4d5e822b603953471c73 and project 88a7205c02914d428fd0d43b7fa61fe9. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:49:15.515779 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bf8a5881-d673-447f-a540-777f4f649161 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.218771 Sep 17 21:49:15.516381 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3328/6750] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:49:15 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:49:21.376873 ncdv-master-1 devstack@n-api.service[140524]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 17 21:49:21.377377 ncdv-master-1 devstack@n-api.service[140524]: Sat Sep 17 21:49:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.26) !!! Sep 17 21:49:21.379637 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:49:21.380437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:49:21.388315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8a71a139-5734-4cbd-bd3b-4b8e5add0a1f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-938656431", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "c947e355-e668-4255-be00-70560ceedc66"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1673570790", "security_groups": [{"name": "tempest-secgroup-smoke-89264819"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:49:21.516317 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-8a71a139-5734-4cbd-bd3b-4b8e5add0a1f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] validate_networks() for [('c947e355-e668-4255-be00-70560ceedc66', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:49:21.983020 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-8a71a139-5734-4cbd-bd3b-4b8e5add0a1f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:49:21.983462 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-8a71a139-5734-4cbd-bd3b-4b8e5add0a1f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:49:21.983952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-8a71a139-5734-4cbd-bd3b-4b8e5add0a1f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:49:21.984372 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-8a71a139-5734-4cbd-bd3b-4b8e5add0a1f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:49:21.984920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-8a71a139-5734-4cbd-bd3b-4b8e5add0a1f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:49:21.994767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a71a139-5734-4cbd-bd3b-4b8e5add0a1f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:21.995319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a71a139-5734-4cbd-bd3b-4b8e5add0a1f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:21.995772 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a71a139-5734-4cbd-bd3b-4b8e5add0a1f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:21.996527 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a71a139-5734-4cbd-bd3b-4b8e5add0a1f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:21.997001 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a71a139-5734-4cbd-bd3b-4b8e5add0a1f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:21.997438 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8a71a139-5734-4cbd-bd3b-4b8e5add0a1f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:22.015866 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-8a71a139-5734-4cbd-bd3b-4b8e5add0a1f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Getting quotas for project 88a7205c02914d428fd0d43b7fa61fe9. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:49:22.021287 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-8a71a139-5734-4cbd-bd3b-4b8e5add0a1f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Getting quotas for user ac0fa1f4eeca4d5e822b603953471c73 and project 88a7205c02914d428fd0d43b7fa61fe9. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:49:22.034016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8a71a139-5734-4cbd-bd3b-4b8e5add0a1f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:49:22.036513 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8a71a139-5734-4cbd-bd3b-4b8e5add0a1f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ebc75efe-dea4-4f28-aff2-efc82e2fdae6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:49:22.086177 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8a71a139-5734-4cbd-bd3b-4b8e5add0a1f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.711812 Sep 17 21:49:22.087441 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3423/6751] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:49:21 2022] POST /compute/v2.1/servers => generated 404 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:49:22.095986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:49:22.104513 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-24499677-3aec-496e-8a5d-8d6ff75910d3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:49:22.106084 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-24499677-3aec-496e-8a5d-8d6ff75910d3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ebc75efe-dea4-4f28-aff2-efc82e2fdae6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:49:22.172373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-24499677-3aec-496e-8a5d-8d6ff75910d3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:49:22.180976 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-24499677-3aec-496e-8a5d-8d6ff75910d3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6" status: 200 len: 1266 microversion: 2.1 time: 0.086072 Sep 17 21:49:22.181978 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3329/6752] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:49:22 2022] GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:49:23.204689 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-90a4faa5-3608-4b12-94c5-dc8d6ed374ba tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:49:23.205580 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-90a4faa5-3608-4b12-94c5-dc8d6ed374ba tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ebc75efe-dea4-4f28-aff2-efc82e2fdae6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:49:23.213365 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90a4faa5-3608-4b12-94c5-dc8d6ed374ba tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:23.214005 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90a4faa5-3608-4b12-94c5-dc8d6ed374ba tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:23.214460 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90a4faa5-3608-4b12-94c5-dc8d6ed374ba tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:23.215213 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90a4faa5-3608-4b12-94c5-dc8d6ed374ba tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:23.215685 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90a4faa5-3608-4b12-94c5-dc8d6ed374ba tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:23.216202 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-90a4faa5-3608-4b12-94c5-dc8d6ed374ba tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:23.728703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-90a4faa5-3608-4b12-94c5-dc8d6ed374ba tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:49:23.736898 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-90a4faa5-3608-4b12-94c5-dc8d6ed374ba tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6" status: 200 len: 1318 microversion: 2.1 time: 0.537053 Sep 17 21:49:23.737963 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3424/6753] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:49:23 2022] GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6 => generated 1318 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:49:24.760761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7d55f2a6-0db6-4a9f-9890-232d310e51be tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:49:24.761387 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7d55f2a6-0db6-4a9f-9890-232d310e51be tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ebc75efe-dea4-4f28-aff2-efc82e2fdae6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:49:24.769492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7d55f2a6-0db6-4a9f-9890-232d310e51be tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:24.769993 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7d55f2a6-0db6-4a9f-9890-232d310e51be tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:24.770435 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7d55f2a6-0db6-4a9f-9890-232d310e51be tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:24.771148 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7d55f2a6-0db6-4a9f-9890-232d310e51be tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:24.771609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7d55f2a6-0db6-4a9f-9890-232d310e51be tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:24.772041 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7d55f2a6-0db6-4a9f-9890-232d310e51be tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:24.901448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-a56efb73-0a1c-4e65-8d30-9b5d68382b9a req-3924b5fb-f7b1-4cb4-9e22-d2a6023ebf91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebc75efe-dea4-4f28-aff2-efc82e2fdae6", "tag": "27eda2d0-96a0-49e0-b9ae-5c7f578d5869"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:49:24.932720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a56efb73-0a1c-4e65-8d30-9b5d68382b9a req-3924b5fb-f7b1-4cb4-9e22-d2a6023ebf91 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:24.933261 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a56efb73-0a1c-4e65-8d30-9b5d68382b9a req-3924b5fb-f7b1-4cb4-9e22-d2a6023ebf91 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:24.933755 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a56efb73-0a1c-4e65-8d30-9b5d68382b9a req-3924b5fb-f7b1-4cb4-9e22-d2a6023ebf91 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:24.947059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7d55f2a6-0db6-4a9f-9890-232d310e51be tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:49:24.950191 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-a56efb73-0a1c-4e65-8d30-9b5d68382b9a req-3924b5fb-f7b1-4cb4-9e22-d2a6023ebf91 service nova] Creating event network-changed:27eda2d0-96a0-49e0-b9ae-5c7f578d5869 for instance ebc75efe-dea4-4f28-aff2-efc82e2fdae6 on nch1-master-1 Sep 17 21:49:24.955403 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-a56efb73-0a1c-4e65-8d30-9b5d68382b9a req-3924b5fb-f7b1-4cb4-9e22-d2a6023ebf91 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057832 Sep 17 21:49:24.956385 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3425/6754] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:49:24.956993 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7d55f2a6-0db6-4a9f-9890-232d310e51be tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6" status: 200 len: 1390 microversion: 2.1 time: 0.200414 Sep 17 21:49:24.958143 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3330/6755] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:49:24 2022] GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6 => generated 1390 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:49:25.988851 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-12fb027e-85aa-4efb-8e29-4b2603f2b271 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:49:25.990095 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-12fb027e-85aa-4efb-8e29-4b2603f2b271 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ebc75efe-dea4-4f28-aff2-efc82e2fdae6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:49:25.998895 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12fb027e-85aa-4efb-8e29-4b2603f2b271 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:25.999427 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12fb027e-85aa-4efb-8e29-4b2603f2b271 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:25.999908 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12fb027e-85aa-4efb-8e29-4b2603f2b271 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:26.000620 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12fb027e-85aa-4efb-8e29-4b2603f2b271 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:26.001087 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12fb027e-85aa-4efb-8e29-4b2603f2b271 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:26.001592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12fb027e-85aa-4efb-8e29-4b2603f2b271 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:26.142556 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-12fb027e-85aa-4efb-8e29-4b2603f2b271 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:49:26.150708 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-12fb027e-85aa-4efb-8e29-4b2603f2b271 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6" status: 200 len: 1390 microversion: 2.1 time: 0.170743 Sep 17 21:49:26.151294 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3426/6756] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:49:25 2022] GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6 => generated 1390 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:49:27.175032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4ee69453-8c49-483b-9e69-842105a42895 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:49:27.175658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4ee69453-8c49-483b-9e69-842105a42895 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ebc75efe-dea4-4f28-aff2-efc82e2fdae6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:49:27.183405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4ee69453-8c49-483b-9e69-842105a42895 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:27.183901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4ee69453-8c49-483b-9e69-842105a42895 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:27.184348 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4ee69453-8c49-483b-9e69-842105a42895 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:27.185069 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4ee69453-8c49-483b-9e69-842105a42895 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:27.185605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4ee69453-8c49-483b-9e69-842105a42895 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:27.186040 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4ee69453-8c49-483b-9e69-842105a42895 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:27.338485 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4ee69453-8c49-483b-9e69-842105a42895 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:49:27.346686 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4ee69453-8c49-483b-9e69-842105a42895 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6" status: 200 len: 1390 microversion: 2.1 time: 0.175705 Sep 17 21:49:27.347278 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3331/6757] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:49:27 2022] GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6 => generated 1390 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:49:28.369431 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-380b14fd-7f2b-4748-a13e-77545494d564 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:49:28.370091 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-380b14fd-7f2b-4748-a13e-77545494d564 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ebc75efe-dea4-4f28-aff2-efc82e2fdae6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:49:28.377337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-380b14fd-7f2b-4748-a13e-77545494d564 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:28.377896 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-380b14fd-7f2b-4748-a13e-77545494d564 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:28.378358 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-380b14fd-7f2b-4748-a13e-77545494d564 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:28.379378 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-380b14fd-7f2b-4748-a13e-77545494d564 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:28.380035 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-380b14fd-7f2b-4748-a13e-77545494d564 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:28.380489 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-380b14fd-7f2b-4748-a13e-77545494d564 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:28.523167 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-380b14fd-7f2b-4748-a13e-77545494d564 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:49:28.531677 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-380b14fd-7f2b-4748-a13e-77545494d564 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6" status: 200 len: 1390 microversion: 2.1 time: 0.166203 Sep 17 21:49:28.545584 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3427/6758] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:49:28 2022] GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6 => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:49:29.557234 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-574b3dfc-08bb-4f2b-ad33-871135d0c8cc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:49:29.557839 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-574b3dfc-08bb-4f2b-ad33-871135d0c8cc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ebc75efe-dea4-4f28-aff2-efc82e2fdae6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:49:29.560688 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:49:29.566275 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-574b3dfc-08bb-4f2b-ad33-871135d0c8cc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:29.566755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-574b3dfc-08bb-4f2b-ad33-871135d0c8cc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:29.567204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-574b3dfc-08bb-4f2b-ad33-871135d0c8cc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:29.567902 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-574b3dfc-08bb-4f2b-ad33-871135d0c8cc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:29.568345 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-574b3dfc-08bb-4f2b-ad33-871135d0c8cc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:29.568770 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-574b3dfc-08bb-4f2b-ad33-871135d0c8cc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:29.704261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-574b3dfc-08bb-4f2b-ad33-871135d0c8cc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:49:29.713104 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-574b3dfc-08bb-4f2b-ad33-871135d0c8cc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6" status: 200 len: 1390 microversion: 2.1 time: 0.159830 Sep 17 21:49:29.713617 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3332/6759] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:49:29 2022] GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6 => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:49:30.395024 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-c9a3ad13-19b8-4b84-bf7a-ee5d260ed214 req-cc1a586f-3fe6-47c3-b700-383449133a24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebc75efe-dea4-4f28-aff2-efc82e2fdae6", "name": "network-vif-plugged", "status": "completed", "tag": "27eda2d0-96a0-49e0-b9ae-5c7f578d5869"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:49:30.404755 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c9a3ad13-19b8-4b84-bf7a-ee5d260ed214 req-cc1a586f-3fe6-47c3-b700-383449133a24 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:30.405398 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c9a3ad13-19b8-4b84-bf7a-ee5d260ed214 req-cc1a586f-3fe6-47c3-b700-383449133a24 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:30.405859 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c9a3ad13-19b8-4b84-bf7a-ee5d260ed214 req-cc1a586f-3fe6-47c3-b700-383449133a24 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:30.416779 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-c9a3ad13-19b8-4b84-bf7a-ee5d260ed214 req-cc1a586f-3fe6-47c3-b700-383449133a24 service nova] Creating event network-vif-plugged:27eda2d0-96a0-49e0-b9ae-5c7f578d5869 for instance ebc75efe-dea4-4f28-aff2-efc82e2fdae6 on nch1-master-1 Sep 17 21:49:30.422032 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-c9a3ad13-19b8-4b84-bf7a-ee5d260ed214 req-cc1a586f-3fe6-47c3-b700-383449133a24 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086426 Sep 17 21:49:30.422616 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3428/6760] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:49:30.736213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b3c68436-af5c-48a2-84bc-ccd5b85fd8f5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:49:30.736817 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b3c68436-af5c-48a2-84bc-ccd5b85fd8f5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ebc75efe-dea4-4f28-aff2-efc82e2fdae6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:49:30.744279 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3c68436-af5c-48a2-84bc-ccd5b85fd8f5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:30.744773 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3c68436-af5c-48a2-84bc-ccd5b85fd8f5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:30.745222 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3c68436-af5c-48a2-84bc-ccd5b85fd8f5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:30.745969 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3c68436-af5c-48a2-84bc-ccd5b85fd8f5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:30.746430 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3c68436-af5c-48a2-84bc-ccd5b85fd8f5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:30.746868 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3c68436-af5c-48a2-84bc-ccd5b85fd8f5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:30.880212 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b3c68436-af5c-48a2-84bc-ccd5b85fd8f5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:49:30.888340 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b3c68436-af5c-48a2-84bc-ccd5b85fd8f5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6" status: 200 len: 1390 microversion: 2.1 time: 0.156227 Sep 17 21:49:30.888956 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3333/6761] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:49:30 2022] GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6 => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:49:31.918623 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0dafb7f7-9cc1-45a0-b4e7-2cd7009752d1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:49:31.919805 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0dafb7f7-9cc1-45a0-b4e7-2cd7009752d1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ebc75efe-dea4-4f28-aff2-efc82e2fdae6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:49:31.931160 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0dafb7f7-9cc1-45a0-b4e7-2cd7009752d1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:31.932040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0dafb7f7-9cc1-45a0-b4e7-2cd7009752d1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:31.932830 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0dafb7f7-9cc1-45a0-b4e7-2cd7009752d1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:31.934124 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0dafb7f7-9cc1-45a0-b4e7-2cd7009752d1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:31.934940 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0dafb7f7-9cc1-45a0-b4e7-2cd7009752d1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:31.935740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0dafb7f7-9cc1-45a0-b4e7-2cd7009752d1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:32.007699 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:49:32.028913 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=6 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:49:32.078389 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0dafb7f7-9cc1-45a0-b4e7-2cd7009752d1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:49:32.086800 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0dafb7f7-9cc1-45a0-b4e7-2cd7009752d1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6" status: 200 len: 1563 microversion: 2.1 time: 0.176786 Sep 17 21:49:32.087384 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3429/6762] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:49:31 2022] GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6 => generated 1563 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:49:32.109024 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-17d62ec4-836e-4947-a64d-9b10bbfb59a0 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:49:32.109644 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-17d62ec4-836e-4947-a64d-9b10bbfb59a0 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ebc75efe-dea4-4f28-aff2-efc82e2fdae6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:49:32.117017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17d62ec4-836e-4947-a64d-9b10bbfb59a0 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:32.117512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17d62ec4-836e-4947-a64d-9b10bbfb59a0 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:32.118009 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17d62ec4-836e-4947-a64d-9b10bbfb59a0 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:32.118709 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17d62ec4-836e-4947-a64d-9b10bbfb59a0 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:32.119162 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17d62ec4-836e-4947-a64d-9b10bbfb59a0 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:32.119620 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-17d62ec4-836e-4947-a64d-9b10bbfb59a0 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:32.178060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:49:32.254762 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-17d62ec4-836e-4947-a64d-9b10bbfb59a0 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:49:32.263206 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-17d62ec4-836e-4947-a64d-9b10bbfb59a0 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6" status: 200 len: 1563 microversion: 2.1 time: 0.158239 Sep 17 21:49:32.263733 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3334/6763] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:49:32 2022] GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6 => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:49:33.919672 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f887ce5b-a66a-414b-8d24-bd36dfef6593 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:49:33.920307 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f887ce5b-a66a-414b-8d24-bd36dfef6593 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ebc75efe-dea4-4f28-aff2-efc82e2fdae6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:49:33.922584 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-912f6c6e-6a82-459e-8c75-d00aba2e5dad req-8a9041f8-af22-470b-9e84-016a119e4d83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebc75efe-dea4-4f28-aff2-efc82e2fdae6", "tag": "27eda2d0-96a0-49e0-b9ae-5c7f578d5869"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:49:33.927733 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f887ce5b-a66a-414b-8d24-bd36dfef6593 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:33.928442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f887ce5b-a66a-414b-8d24-bd36dfef6593 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:33.929238 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f887ce5b-a66a-414b-8d24-bd36dfef6593 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:33.930186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f887ce5b-a66a-414b-8d24-bd36dfef6593 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:33.930841 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f887ce5b-a66a-414b-8d24-bd36dfef6593 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:33.931295 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f887ce5b-a66a-414b-8d24-bd36dfef6593 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:33.934321 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-912f6c6e-6a82-459e-8c75-d00aba2e5dad req-8a9041f8-af22-470b-9e84-016a119e4d83 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:33.934960 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-912f6c6e-6a82-459e-8c75-d00aba2e5dad req-8a9041f8-af22-470b-9e84-016a119e4d83 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:33.935492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-912f6c6e-6a82-459e-8c75-d00aba2e5dad req-8a9041f8-af22-470b-9e84-016a119e4d83 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:33.947582 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-912f6c6e-6a82-459e-8c75-d00aba2e5dad req-8a9041f8-af22-470b-9e84-016a119e4d83 service nova] Creating event network-changed:27eda2d0-96a0-49e0-b9ae-5c7f578d5869 for instance ebc75efe-dea4-4f28-aff2-efc82e2fdae6 on nch1-master-1 Sep 17 21:49:33.953045 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-912f6c6e-6a82-459e-8c75-d00aba2e5dad req-8a9041f8-af22-470b-9e84-016a119e4d83 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034760 Sep 17 21:49:33.953984 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3335/6764] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:49:34.080446 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f887ce5b-a66a-414b-8d24-bd36dfef6593 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:49:34.089301 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f887ce5b-a66a-414b-8d24-bd36dfef6593 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6" status: 200 len: 1563 microversion: 2.1 time: 0.173668 Sep 17 21:49:34.090225 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3430/6765] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:49:33 2022] GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6 => generated 1563 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:49:57.407057 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d8c3e901-e748-4f69-9e42-2e0a7a016278 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:49:57.410886 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d8c3e901-e748-4f69-9e42-2e0a7a016278 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ebc75efe-dea4-4f28-aff2-efc82e2fdae6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:49:57.414931 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=7 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:49:57.415656 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=32 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:49:57.424238 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8c3e901-e748-4f69-9e42-2e0a7a016278 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:57.424739 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8c3e901-e748-4f69-9e42-2e0a7a016278 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:57.425218 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8c3e901-e748-4f69-9e42-2e0a7a016278 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:57.425966 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8c3e901-e748-4f69-9e42-2e0a7a016278 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:49:57.426428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8c3e901-e748-4f69-9e42-2e0a7a016278 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:49:57.426863 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d8c3e901-e748-4f69-9e42-2e0a7a016278 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:49:57.481375 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d8c3e901-e748-4f69-9e42-2e0a7a016278 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "POST /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6/action" status: 200 len: 24569 microversion: 2.1 time: 0.081471 Sep 17 21:49:57.482038 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3336/6766] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:49:57 2022] POST /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6/action => generated 24569 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:50:03.891403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ed5ab7f0-e2e9-46c6-bf89-4479ec7deeee tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:50:03.892358 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ed5ab7f0-e2e9-46c6-bf89-4479ec7deeee tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ebc75efe-dea4-4f28-aff2-efc82e2fdae6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:50:03.895598 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:50:03.896866 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=36 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:50:03.904189 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed5ab7f0-e2e9-46c6-bf89-4479ec7deeee tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:03.904739 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed5ab7f0-e2e9-46c6-bf89-4479ec7deeee tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:03.905203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed5ab7f0-e2e9-46c6-bf89-4479ec7deeee tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:03.905942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed5ab7f0-e2e9-46c6-bf89-4479ec7deeee tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:03.906410 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed5ab7f0-e2e9-46c6-bf89-4479ec7deeee tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:03.906861 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed5ab7f0-e2e9-46c6-bf89-4479ec7deeee tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:03.980925 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ed5ab7f0-e2e9-46c6-bf89-4479ec7deeee tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "POST /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6/action" status: 202 len: 0 microversion: 2.1 time: 0.096522 Sep 17 21:50:03.981492 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3431/6767] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:50:03 2022] POST /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:50:03.990571 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b6e7fb78-492e-41b0-bf17-7f5a7e633570 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:50:03.991306 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b6e7fb78-492e-41b0-bf17-7f5a7e633570 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ebc75efe-dea4-4f28-aff2-efc82e2fdae6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:50:03.998565 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6e7fb78-492e-41b0-bf17-7f5a7e633570 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:03.999053 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6e7fb78-492e-41b0-bf17-7f5a7e633570 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:03.999518 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6e7fb78-492e-41b0-bf17-7f5a7e633570 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:04.000209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6e7fb78-492e-41b0-bf17-7f5a7e633570 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:04.000674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6e7fb78-492e-41b0-bf17-7f5a7e633570 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:04.001140 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b6e7fb78-492e-41b0-bf17-7f5a7e633570 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:04.147071 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b6e7fb78-492e-41b0-bf17-7f5a7e633570 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:50:04.155280 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b6e7fb78-492e-41b0-bf17-7f5a7e633570 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6" status: 200 len: 1686 microversion: 2.1 time: 0.169267 Sep 17 21:50:04.156107 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3337/6768] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:50:03 2022] GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6 => generated 1686 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:50:05.184354 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6fac4587-810f-4080-a95e-9fc826cfaab9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:50:05.185048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6fac4587-810f-4080-a95e-9fc826cfaab9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ebc75efe-dea4-4f28-aff2-efc82e2fdae6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:50:05.194901 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6fac4587-810f-4080-a95e-9fc826cfaab9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:05.195403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6fac4587-810f-4080-a95e-9fc826cfaab9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:05.195864 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6fac4587-810f-4080-a95e-9fc826cfaab9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:05.196585 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6fac4587-810f-4080-a95e-9fc826cfaab9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:05.197058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6fac4587-810f-4080-a95e-9fc826cfaab9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:05.197508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6fac4587-810f-4080-a95e-9fc826cfaab9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:05.340147 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6fac4587-810f-4080-a95e-9fc826cfaab9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:50:05.352382 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6fac4587-810f-4080-a95e-9fc826cfaab9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6" status: 200 len: 1666 microversion: 2.1 time: 0.174301 Sep 17 21:50:05.353220 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3432/6769] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:50:05 2022] GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6 => generated 1666 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:50:06.464767 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9430f39f-7aa8-4d4a-bb28-f965a12ab96d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:50:06.468357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9430f39f-7aa8-4d4a-bb28-f965a12ab96d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ebc75efe-dea4-4f28-aff2-efc82e2fdae6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:50:06.482993 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9430f39f-7aa8-4d4a-bb28-f965a12ab96d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:06.483489 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9430f39f-7aa8-4d4a-bb28-f965a12ab96d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:06.483933 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9430f39f-7aa8-4d4a-bb28-f965a12ab96d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:06.484645 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9430f39f-7aa8-4d4a-bb28-f965a12ab96d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:06.485109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9430f39f-7aa8-4d4a-bb28-f965a12ab96d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:06.485567 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9430f39f-7aa8-4d4a-bb28-f965a12ab96d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:06.541601 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9430f39f-7aa8-4d4a-bb28-f965a12ab96d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "POST /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6/action" status: 200 len: 32640 microversion: 2.1 time: 0.083870 Sep 17 21:50:06.542248 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3338/6770] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:50:06 2022] POST /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6/action => generated 32640 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:50:06.554621 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-07c93b50-3b66-428f-aa19-8f69542f89c5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:50:06.555178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-07c93b50-3b66-428f-aa19-8f69542f89c5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ebc75efe-dea4-4f28-aff2-efc82e2fdae6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:50:06.562678 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-07c93b50-3b66-428f-aa19-8f69542f89c5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:06.563189 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-07c93b50-3b66-428f-aa19-8f69542f89c5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:06.563648 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-07c93b50-3b66-428f-aa19-8f69542f89c5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:06.564361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-07c93b50-3b66-428f-aa19-8f69542f89c5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:06.564834 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-07c93b50-3b66-428f-aa19-8f69542f89c5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:06.565280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-07c93b50-3b66-428f-aa19-8f69542f89c5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:06.642911 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-07c93b50-3b66-428f-aa19-8f69542f89c5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "POST /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6/action" status: 202 len: 0 microversion: 2.1 time: 0.091676 Sep 17 21:50:06.643794 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3433/6771] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:50:06 2022] POST /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:50:06.653762 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7cd2f5a6-baef-4b7b-bd45-f3bf78a1b22d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:50:06.654466 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7cd2f5a6-baef-4b7b-bd45-f3bf78a1b22d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ebc75efe-dea4-4f28-aff2-efc82e2fdae6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:50:06.662206 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cd2f5a6-baef-4b7b-bd45-f3bf78a1b22d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:06.662702 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cd2f5a6-baef-4b7b-bd45-f3bf78a1b22d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:06.663149 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cd2f5a6-baef-4b7b-bd45-f3bf78a1b22d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:06.663894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cd2f5a6-baef-4b7b-bd45-f3bf78a1b22d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:06.664375 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cd2f5a6-baef-4b7b-bd45-f3bf78a1b22d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:06.665048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7cd2f5a6-baef-4b7b-bd45-f3bf78a1b22d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:06.811842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7cd2f5a6-baef-4b7b-bd45-f3bf78a1b22d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:50:06.820041 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7cd2f5a6-baef-4b7b-bd45-f3bf78a1b22d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6" status: 200 len: 1673 microversion: 2.1 time: 0.170688 Sep 17 21:50:06.820632 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3339/6772] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:50:06 2022] GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6 => generated 1673 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:50:07.854257 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-86f4bfe0-b769-4097-aaed-bc875039f11e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:50:07.855006 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-86f4bfe0-b769-4097-aaed-bc875039f11e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ebc75efe-dea4-4f28-aff2-efc82e2fdae6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:50:07.861490 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-86f4bfe0-b769-4097-aaed-bc875039f11e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:07.862025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-86f4bfe0-b769-4097-aaed-bc875039f11e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:07.862488 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-86f4bfe0-b769-4097-aaed-bc875039f11e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:07.863205 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-86f4bfe0-b769-4097-aaed-bc875039f11e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:07.863677 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-86f4bfe0-b769-4097-aaed-bc875039f11e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:07.864122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-86f4bfe0-b769-4097-aaed-bc875039f11e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:08.006296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-86f4bfe0-b769-4097-aaed-bc875039f11e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:50:08.014428 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-86f4bfe0-b769-4097-aaed-bc875039f11e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6" status: 200 len: 1681 microversion: 2.1 time: 0.167974 Sep 17 21:50:08.014976 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3434/6773] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:50:07 2022] GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:50:08.120974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-73c776fb-9342-4e91-86b7-ba97cc950cde tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:50:08.123324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-73c776fb-9342-4e91-86b7-ba97cc950cde tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ebc75efe-dea4-4f28-aff2-efc82e2fdae6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:50:08.131524 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73c776fb-9342-4e91-86b7-ba97cc950cde tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:08.132018 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73c776fb-9342-4e91-86b7-ba97cc950cde tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:08.132465 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73c776fb-9342-4e91-86b7-ba97cc950cde tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:08.133204 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73c776fb-9342-4e91-86b7-ba97cc950cde tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:08.133830 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73c776fb-9342-4e91-86b7-ba97cc950cde tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:08.134270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-73c776fb-9342-4e91-86b7-ba97cc950cde tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:08.192955 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-73c776fb-9342-4e91-86b7-ba97cc950cde tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "POST /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6/action" status: 200 len: 35356 microversion: 2.1 time: 0.075578 Sep 17 21:50:08.194094 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3340/6774] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:50:08 2022] POST /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6/action => generated 35356 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:50:09.337530 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7926274c-5009-403d-85dc-190eeb155e81 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:50:09.338356 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7926274c-5009-403d-85dc-190eeb155e81 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ebc75efe-dea4-4f28-aff2-efc82e2fdae6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:50:09.341876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-5881be66-8080-4927-90a5-287b71c9a957 req-30b9375f-4268-41a1-a765-3fd3cdf90b4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebc75efe-dea4-4f28-aff2-efc82e2fdae6", "tag": "27eda2d0-96a0-49e0-b9ae-5c7f578d5869"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:50:09.346293 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7926274c-5009-403d-85dc-190eeb155e81 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:09.346850 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7926274c-5009-403d-85dc-190eeb155e81 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:09.347580 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7926274c-5009-403d-85dc-190eeb155e81 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:09.348686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7926274c-5009-403d-85dc-190eeb155e81 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:09.349423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7926274c-5009-403d-85dc-190eeb155e81 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:09.349903 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7926274c-5009-403d-85dc-190eeb155e81 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:09.356069 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-5881be66-8080-4927-90a5-287b71c9a957 req-30b9375f-4268-41a1-a765-3fd3cdf90b4e service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:09.356568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-5881be66-8080-4927-90a5-287b71c9a957 req-30b9375f-4268-41a1-a765-3fd3cdf90b4e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:09.357018 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-5881be66-8080-4927-90a5-287b71c9a957 req-30b9375f-4268-41a1-a765-3fd3cdf90b4e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:09.369114 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-5881be66-8080-4927-90a5-287b71c9a957 req-30b9375f-4268-41a1-a765-3fd3cdf90b4e service nova] Creating event network-changed:27eda2d0-96a0-49e0-b9ae-5c7f578d5869 for instance ebc75efe-dea4-4f28-aff2-efc82e2fdae6 on nch1-master-1 Sep 17 21:50:09.374798 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-5881be66-8080-4927-90a5-287b71c9a957 req-30b9375f-4268-41a1-a765-3fd3cdf90b4e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037585 Sep 17 21:50:09.375437 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3341/6775] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:50:09.381390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7926274c-5009-403d-85dc-190eeb155e81 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ebc75efe-dea4-4f28-aff2-efc82e2fdae6] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:50:09.474061 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7926274c-5009-403d-85dc-190eeb155e81 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6" status: 204 len: 0 microversion: 2.1 time: 0.140507 Sep 17 21:50:09.474784 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3435/6776] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:50:09 2022] DELETE /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:50:09.484770 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4c1831ed-9065-4a15-9679-7451993c97e9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:50:09.485632 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4c1831ed-9065-4a15-9679-7451993c97e9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ebc75efe-dea4-4f28-aff2-efc82e2fdae6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:50:09.493036 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c1831ed-9065-4a15-9679-7451993c97e9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:09.493679 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c1831ed-9065-4a15-9679-7451993c97e9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:09.494249 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c1831ed-9065-4a15-9679-7451993c97e9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:09.495091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c1831ed-9065-4a15-9679-7451993c97e9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:09.495620 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c1831ed-9065-4a15-9679-7451993c97e9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:09.496155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4c1831ed-9065-4a15-9679-7451993c97e9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:09.637077 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4c1831ed-9065-4a15-9679-7451993c97e9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:50:09.645546 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4c1831ed-9065-4a15-9679-7451993c97e9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6" status: 200 len: 1687 microversion: 2.1 time: 0.165795 Sep 17 21:50:09.646135 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3342/6777] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:50:09 2022] GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6 => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:50:10.675127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3d957ea4-1d5b-4794-86ee-8a97150b2259 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:50:10.676355 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3d957ea4-1d5b-4794-86ee-8a97150b2259 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ebc75efe-dea4-4f28-aff2-efc82e2fdae6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:50:10.685644 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d957ea4-1d5b-4794-86ee-8a97150b2259 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:10.686176 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d957ea4-1d5b-4794-86ee-8a97150b2259 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:10.687162 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d957ea4-1d5b-4794-86ee-8a97150b2259 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:10.687936 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d957ea4-1d5b-4794-86ee-8a97150b2259 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:10.688421 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d957ea4-1d5b-4794-86ee-8a97150b2259 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:10.688878 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3d957ea4-1d5b-4794-86ee-8a97150b2259 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:10.839727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3d957ea4-1d5b-4794-86ee-8a97150b2259 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:50:10.848047 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3d957ea4-1d5b-4794-86ee-8a97150b2259 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6" status: 200 len: 1687 microversion: 2.1 time: 0.180258 Sep 17 21:50:10.848661 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3436/6778] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:50:10 2022] GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6 => generated 1687 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:50:11.872124 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4817d8c2-e386-4bf1-9edd-397d9d36577b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:50:11.872743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4817d8c2-e386-4bf1-9edd-397d9d36577b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ebc75efe-dea4-4f28-aff2-efc82e2fdae6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:50:11.881906 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4817d8c2-e386-4bf1-9edd-397d9d36577b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:11.882310 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4817d8c2-e386-4bf1-9edd-397d9d36577b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:11.882752 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4817d8c2-e386-4bf1-9edd-397d9d36577b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:11.884368 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4817d8c2-e386-4bf1-9edd-397d9d36577b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:11.884368 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4817d8c2-e386-4bf1-9edd-397d9d36577b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:11.884678 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4817d8c2-e386-4bf1-9edd-397d9d36577b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:11.951753 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-1ec71725-4053-450f-81e7-ca191412a089 req-5b0b34ae-9882-4c9e-a027-b828193ba1cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebc75efe-dea4-4f28-aff2-efc82e2fdae6", "name": "network-vif-deleted", "tag": "27eda2d0-96a0-49e0-b9ae-5c7f578d5869"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:50:11.968925 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4817d8c2-e386-4bf1-9edd-397d9d36577b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:50:11.973880 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-1ec71725-4053-450f-81e7-ca191412a089 req-5b0b34ae-9882-4c9e-a027-b828193ba1cf service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:11.974627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-1ec71725-4053-450f-81e7-ca191412a089 req-5b0b34ae-9882-4c9e-a027-b828193ba1cf service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:11.975325 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-1ec71725-4053-450f-81e7-ca191412a089 req-5b0b34ae-9882-4c9e-a027-b828193ba1cf service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:11.977894 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4817d8c2-e386-4bf1-9edd-397d9d36577b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6" status: 200 len: 1503 microversion: 2.1 time: 0.109970 Sep 17 21:50:11.978490 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3343/6779] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:50:11 2022] GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6 => generated 1503 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:50:11.989145 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-1ec71725-4053-450f-81e7-ca191412a089 req-5b0b34ae-9882-4c9e-a027-b828193ba1cf service nova] Creating event network-vif-deleted:27eda2d0-96a0-49e0-b9ae-5c7f578d5869 for instance ebc75efe-dea4-4f28-aff2-efc82e2fdae6 on nch1-master-1 Sep 17 21:50:11.994080 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-1ec71725-4053-450f-81e7-ca191412a089 req-5b0b34ae-9882-4c9e-a027-b828193ba1cf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046097 Sep 17 21:50:11.994922 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3437/6780] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:50:13.004416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c15df916-079e-4020-afbb-97ce1d9f28fc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:50:13.005006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c15df916-079e-4020-afbb-97ce1d9f28fc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ebc75efe-dea4-4f28-aff2-efc82e2fdae6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:50:13.012461 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c15df916-079e-4020-afbb-97ce1d9f28fc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:13.012980 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c15df916-079e-4020-afbb-97ce1d9f28fc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:13.013428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c15df916-079e-4020-afbb-97ce1d9f28fc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:13.014178 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c15df916-079e-4020-afbb-97ce1d9f28fc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:13.014643 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c15df916-079e-4020-afbb-97ce1d9f28fc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:13.015079 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c15df916-079e-4020-afbb-97ce1d9f28fc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:13.029575 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-c15df916-079e-4020-afbb-97ce1d9f28fc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] HTTP exception thrown: Instance ebc75efe-dea4-4f28-aff2-efc82e2fdae6 could not be found. Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c15df916-079e-4020-afbb-97ce1d9f28fc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Request method failure captured: Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6 HTTP/1.1 Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJkDaqrUqQ4R3Jc50dHjJrzHY0H6R9FbsHaifiKAhdbafUbvetKkTsAeXQ-XLllwkBW4TMkyFoTdjx6sRrhd61AW2D-lOJ5jM-lciJMsVlu69fHeXBQVZJqH7yfr66d0yPaxTtnH5N_36Tfpt2dvCfwMBCGXmn8-CxBhA65JgC1h0P9o Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 88a7205c02914d428fd0d43b7fa61fe9 Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1937454944 Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/88a7205c02914d428fd0d43b7fa61fe9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/88a7205c02914d428fd0d43b7fa61fe9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/88a7205c02914d428fd0d43b7fa61fe9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_88a7205c02914d428fd0d43b7fa61fe9", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1937454944 Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 88a7205c02914d428fd0d43b7fa61fe9 Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1937454944 Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-TestNetworkAdvancedServerOps-1937454944-project Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: ac0fa1f4eeca4d5e822b603953471c73 Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1937454944-project Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance ebc75efe-dea4-4f28-aff2-efc82e2fdae6 could not be found. Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'ebc75efe-dea4-4f28-aff2-efc82e2fdae6'} Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebc75efe-dea4-4f28-aff2-efc82e2fdae6 could not be found. Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebc75efe-dea4-4f28-aff2-efc82e2fdae6 could not be found. Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:50:13.031245 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:50:13.037182 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:50:13.037182 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:50:13.037182 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:50:13.037182 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:50:13.037182 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:50:13.037182 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:50:13.037182 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebc75efe-dea4-4f28-aff2-efc82e2fdae6 could not be found. Sep 17 21:50:13.037182 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:50:13.037182 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c15df916-079e-4020-afbb-97ce1d9f28fc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Returning 404 to user: Instance ebc75efe-dea4-4f28-aff2-efc82e2fdae6 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:50:13.037182 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c15df916-079e-4020-afbb-97ce1d9f28fc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6" status: 404 len: 111 microversion: 2.1 time: 0.032233 Sep 17 21:50:13.037182 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3344/6781] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:50:12 2022] GET /compute/v2.1/servers/ebc75efe-dea4-4f28-aff2-efc82e2fdae6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:50:16.466057 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2578d6b4-5c6b-418f-89a2-a45e19de843d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '.version_select at 0x7f259c371a60>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:50:16.498056 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2578d6b4-5c6b-418f-89a2-a45e19de843d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1673570790" status: 202 len: 0 microversion: 2.1 time: 0.036643 Sep 17 21:50:16.498989 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3438/6782] 10.222.0.26 () {58 vars in 1284 bytes} [Sat Sep 17 21:50:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1673570790 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:50:16.527247 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-edc11837-607d-44e6-ad14-3a030efaa7fa tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Action: 'create', calling method: .version_select at 0x7f25a4849af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-314654811", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImFh3dUOArOWuO/w6hoh4o9NabCaFwo1KYWt1gmAFzClxyNHro7+pSfFQapLNKecbd6VBzUjTZCm01FK9HRJBChp3kRG6IVDm4YYwnVc9mrt5BzlIDyc6LlOk8Xgpd7Lw=="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:50:16.550337 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-edc11837-607d-44e6-ad14-3a030efaa7fa tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Getting quotas for project 88a7205c02914d428fd0d43b7fa61fe9. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:50:16.555801 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-edc11837-607d-44e6-ad14-3a030efaa7fa tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Getting quotas for user ac0fa1f4eeca4d5e822b603953471c73 and project 88a7205c02914d428fd0d43b7fa61fe9. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:50:16.590666 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-edc11837-607d-44e6-ad14-3a030efaa7fa tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.067453 Sep 17 21:50:16.591294 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3345/6783] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:50:16 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:50:21.949076 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f4d09c16-b4e8-4e1d-98c6-a1e6c409f919 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-899319563", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "6c63edf3-58a3-4271-a94c-4917bde3a363"}], "key_name": "tempest-TestNetworkAdvancedServerOps-314654811", "security_groups": [{"name": "tempest-secgroup-smoke-1319954566"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:50:21.980824 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:50:22.438783 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-f4d09c16-b4e8-4e1d-98c6-a1e6c409f919 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] validate_networks() for [('6c63edf3-58a3-4271-a94c-4917bde3a363', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:50:22.905760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-f4d09c16-b4e8-4e1d-98c6-a1e6c409f919 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:50:22.906654 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-f4d09c16-b4e8-4e1d-98c6-a1e6c409f919 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:50:22.907639 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-f4d09c16-b4e8-4e1d-98c6-a1e6c409f919 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:50:22.908310 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-f4d09c16-b4e8-4e1d-98c6-a1e6c409f919 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:50:22.908989 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-f4d09c16-b4e8-4e1d-98c6-a1e6c409f919 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:50:22.924374 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4d09c16-b4e8-4e1d-98c6-a1e6c409f919 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:22.924976 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4d09c16-b4e8-4e1d-98c6-a1e6c409f919 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:22.925709 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4d09c16-b4e8-4e1d-98c6-a1e6c409f919 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:22.926558 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4d09c16-b4e8-4e1d-98c6-a1e6c409f919 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:22.927235 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4d09c16-b4e8-4e1d-98c6-a1e6c409f919 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:22.928284 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f4d09c16-b4e8-4e1d-98c6-a1e6c409f919 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:22.956084 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-f4d09c16-b4e8-4e1d-98c6-a1e6c409f919 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Getting quotas for project 88a7205c02914d428fd0d43b7fa61fe9. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:50:22.963105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-f4d09c16-b4e8-4e1d-98c6-a1e6c409f919 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Getting quotas for user ac0fa1f4eeca4d5e822b603953471c73 and project 88a7205c02914d428fd0d43b7fa61fe9. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:50:22.980103 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f4d09c16-b4e8-4e1d-98c6-a1e6c409f919 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:50:22.983381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f4d09c16-b4e8-4e1d-98c6-a1e6c409f919 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:50:23.043189 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f4d09c16-b4e8-4e1d-98c6-a1e6c409f919 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.099097 Sep 17 21:50:23.044032 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3439/6784] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:50:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 1101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:50:23.057991 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5b1e18cd-d4d0-4da1-998f-c981104df782 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:50:23.059422 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5b1e18cd-d4d0-4da1-998f-c981104df782 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:50:23.067155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=40 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:50:23.127313 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5b1e18cd-d4d0-4da1-998f-c981104df782 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:50:23.134926 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5b1e18cd-d4d0-4da1-998f-c981104df782 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 200 len: 1265 microversion: 2.1 time: 0.082453 Sep 17 21:50:23.135522 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3346/6785] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:50:23 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 1265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:50:24.161324 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b4b3e30e-585d-4461-8eee-1900f4fec61e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:50:24.161988 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b4b3e30e-585d-4461-8eee-1900f4fec61e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:50:24.234877 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b4b3e30e-585d-4461-8eee-1900f4fec61e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:50:24.242635 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b4b3e30e-585d-4461-8eee-1900f4fec61e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 200 len: 1265 microversion: 2.1 time: 0.086550 Sep 17 21:50:24.243319 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3440/6786] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:50:24 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:50:25.266459 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5a3c5988-c91a-4d75-9247-346da4e63f23 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:50:25.267056 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5a3c5988-c91a-4d75-9247-346da4e63f23 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:50:25.325895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5a3c5988-c91a-4d75-9247-346da4e63f23 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:50:25.334369 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5a3c5988-c91a-4d75-9247-346da4e63f23 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 200 len: 1265 microversion: 2.1 time: 0.072451 Sep 17 21:50:25.335281 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3347/6787] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:50:25 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 1265 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:50:26.361754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-eba19fd1-f075-4895-a4f5-4032773bc78d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:50:26.362791 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-eba19fd1-f075-4895-a4f5-4032773bc78d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:50:26.421354 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-eba19fd1-f075-4895-a4f5-4032773bc78d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:50:26.428776 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-eba19fd1-f075-4895-a4f5-4032773bc78d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 200 len: 1265 microversion: 2.1 time: 0.073581 Sep 17 21:50:26.429385 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3441/6788] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:50:26 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 1265 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:50:27.456934 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b7bae211-078b-45d2-a569-420486164655 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:50:27.458395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b7bae211-078b-45d2-a569-420486164655 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:50:27.462773 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:50:27.471843 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b7bae211-078b-45d2-a569-420486164655 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:27.472658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b7bae211-078b-45d2-a569-420486164655 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:27.473392 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b7bae211-078b-45d2-a569-420486164655 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:27.474624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b7bae211-078b-45d2-a569-420486164655 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:27.475383 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b7bae211-078b-45d2-a569-420486164655 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:27.476138 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b7bae211-078b-45d2-a569-420486164655 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:27.542176 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b7bae211-078b-45d2-a569-420486164655 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:50:27.550422 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b7bae211-078b-45d2-a569-420486164655 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 200 len: 1269 microversion: 2.1 time: 0.100154 Sep 17 21:50:27.551002 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3348/6789] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:50:27 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 1269 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:50:28.574563 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-861c550a-5265-495f-944e-9bc0beabab13 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:50:28.575975 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-861c550a-5265-495f-944e-9bc0beabab13 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:50:28.585323 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-861c550a-5265-495f-944e-9bc0beabab13 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:28.585897 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-861c550a-5265-495f-944e-9bc0beabab13 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:28.586416 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-861c550a-5265-495f-944e-9bc0beabab13 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:28.587206 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-861c550a-5265-495f-944e-9bc0beabab13 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:28.587862 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-861c550a-5265-495f-944e-9bc0beabab13 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:28.588310 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-861c550a-5265-495f-944e-9bc0beabab13 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:28.650566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-861c550a-5265-495f-944e-9bc0beabab13 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:50:28.658790 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-861c550a-5265-495f-944e-9bc0beabab13 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 200 len: 1323 microversion: 2.1 time: 0.089144 Sep 17 21:50:28.659606 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3442/6790] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:50:28 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 1323 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:50:29.571865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-f19eb422-52be-4424-aa2e-afe680c09c0e req-fc2ffdca-7d6b-4bb0-89da-5462cefdf61d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad243c97-8e6a-41c8-8f52-44e324651c34", "tag": "1aa97e84-41de-4ff3-9699-2dcf150c3dba"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:50:29.584682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f19eb422-52be-4424-aa2e-afe680c09c0e req-fc2ffdca-7d6b-4bb0-89da-5462cefdf61d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:29.585285 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f19eb422-52be-4424-aa2e-afe680c09c0e req-fc2ffdca-7d6b-4bb0-89da-5462cefdf61d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:29.585846 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f19eb422-52be-4424-aa2e-afe680c09c0e req-fc2ffdca-7d6b-4bb0-89da-5462cefdf61d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:29.597610 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-f19eb422-52be-4424-aa2e-afe680c09c0e req-fc2ffdca-7d6b-4bb0-89da-5462cefdf61d service nova] Creating event network-changed:1aa97e84-41de-4ff3-9699-2dcf150c3dba for instance ad243c97-8e6a-41c8-8f52-44e324651c34 on nch1-master-1 Sep 17 21:50:29.602865 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-f19eb422-52be-4424-aa2e-afe680c09c0e req-fc2ffdca-7d6b-4bb0-89da-5462cefdf61d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035635 Sep 17 21:50:29.603742 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3349/6791] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:50:29.682430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e4004cc5-65dd-4922-a5b7-d67735e33949 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:50:29.683115 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e4004cc5-65dd-4922-a5b7-d67735e33949 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:50:29.690539 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e4004cc5-65dd-4922-a5b7-d67735e33949 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:29.691301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e4004cc5-65dd-4922-a5b7-d67735e33949 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:29.692015 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e4004cc5-65dd-4922-a5b7-d67735e33949 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:29.693373 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e4004cc5-65dd-4922-a5b7-d67735e33949 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:29.693373 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e4004cc5-65dd-4922-a5b7-d67735e33949 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:29.693857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e4004cc5-65dd-4922-a5b7-d67735e33949 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:29.836737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e4004cc5-65dd-4922-a5b7-d67735e33949 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:50:29.844838 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e4004cc5-65dd-4922-a5b7-d67735e33949 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 200 len: 1391 microversion: 2.1 time: 0.166516 Sep 17 21:50:29.845481 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3443/6792] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:50:29 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:50:30.873438 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3df657da-ca9d-4e5a-927b-49403b7694cc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:50:30.874284 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3df657da-ca9d-4e5a-927b-49403b7694cc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:50:30.885607 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3df657da-ca9d-4e5a-927b-49403b7694cc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:30.886192 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3df657da-ca9d-4e5a-927b-49403b7694cc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:30.886708 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3df657da-ca9d-4e5a-927b-49403b7694cc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:30.887529 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3df657da-ca9d-4e5a-927b-49403b7694cc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:30.888063 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3df657da-ca9d-4e5a-927b-49403b7694cc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:30.888562 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3df657da-ca9d-4e5a-927b-49403b7694cc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:31.028444 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-3df657da-ca9d-4e5a-927b-49403b7694cc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:50:31.037074 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3df657da-ca9d-4e5a-927b-49403b7694cc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 200 len: 1391 microversion: 2.1 time: 0.171200 Sep 17 21:50:31.037697 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3350/6793] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:50:30 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:50:32.064721 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9746f5e2-6995-4f09-8c32-568b48909499 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:50:32.066044 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9746f5e2-6995-4f09-8c32-568b48909499 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:50:32.079250 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9746f5e2-6995-4f09-8c32-568b48909499 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:32.079770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9746f5e2-6995-4f09-8c32-568b48909499 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:32.080235 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9746f5e2-6995-4f09-8c32-568b48909499 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:32.080965 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9746f5e2-6995-4f09-8c32-568b48909499 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:32.081442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9746f5e2-6995-4f09-8c32-568b48909499 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:32.081929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9746f5e2-6995-4f09-8c32-568b48909499 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:32.223651 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9746f5e2-6995-4f09-8c32-568b48909499 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:50:32.231691 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9746f5e2-6995-4f09-8c32-568b48909499 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 200 len: 1391 microversion: 2.1 time: 0.173818 Sep 17 21:50:32.232293 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3444/6794] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:50:32 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:50:33.259563 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-82c44cd7-e541-4649-b2a2-c5a59c6c3c74 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:50:33.260579 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-82c44cd7-e541-4649-b2a2-c5a59c6c3c74 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:50:33.271170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82c44cd7-e541-4649-b2a2-c5a59c6c3c74 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:33.271671 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82c44cd7-e541-4649-b2a2-c5a59c6c3c74 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:33.272120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82c44cd7-e541-4649-b2a2-c5a59c6c3c74 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:33.272833 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82c44cd7-e541-4649-b2a2-c5a59c6c3c74 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:33.273298 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82c44cd7-e541-4649-b2a2-c5a59c6c3c74 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:33.273767 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-82c44cd7-e541-4649-b2a2-c5a59c6c3c74 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:33.404819 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-82c44cd7-e541-4649-b2a2-c5a59c6c3c74 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:50:33.412839 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-82c44cd7-e541-4649-b2a2-c5a59c6c3c74 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 200 len: 1391 microversion: 2.1 time: 0.159967 Sep 17 21:50:33.413419 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3351/6795] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:50:33 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:50:34.439126 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-56519b1b-da95-41c7-841a-334c064803ac tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:50:34.439917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-56519b1b-da95-41c7-841a-334c064803ac tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:50:34.442305 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:50:34.448525 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:50:34.455526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56519b1b-da95-41c7-841a-334c064803ac tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:34.456170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56519b1b-da95-41c7-841a-334c064803ac tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:34.456740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56519b1b-da95-41c7-841a-334c064803ac tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:34.458028 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56519b1b-da95-41c7-841a-334c064803ac tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:34.458624 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56519b1b-da95-41c7-841a-334c064803ac tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:34.459184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-56519b1b-da95-41c7-841a-334c064803ac tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:34.603494 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-56519b1b-da95-41c7-841a-334c064803ac tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:50:34.609542 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-8f49f597-4646-4e02-92bd-462033c70df5 req-0d7d3daa-b87f-4d0b-a095-45623518fc11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad243c97-8e6a-41c8-8f52-44e324651c34", "name": "network-vif-plugged", "status": "completed", "tag": "1aa97e84-41de-4ff3-9699-2dcf150c3dba"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:50:34.613078 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-56519b1b-da95-41c7-841a-334c064803ac tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 200 len: 1391 microversion: 2.1 time: 0.179227 Sep 17 21:50:34.613815 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3445/6796] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:50:34 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 1391 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:50:34.621051 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8f49f597-4646-4e02-92bd-462033c70df5 req-0d7d3daa-b87f-4d0b-a095-45623518fc11 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:34.621870 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8f49f597-4646-4e02-92bd-462033c70df5 req-0d7d3daa-b87f-4d0b-a095-45623518fc11 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:34.622494 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8f49f597-4646-4e02-92bd-462033c70df5 req-0d7d3daa-b87f-4d0b-a095-45623518fc11 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:34.634342 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-8f49f597-4646-4e02-92bd-462033c70df5 req-0d7d3daa-b87f-4d0b-a095-45623518fc11 service nova] Creating event network-vif-plugged:1aa97e84-41de-4ff3-9699-2dcf150c3dba for instance ad243c97-8e6a-41c8-8f52-44e324651c34 on nch1-master-1 Sep 17 21:50:34.639345 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-8f49f597-4646-4e02-92bd-462033c70df5 req-0d7d3daa-b87f-4d0b-a095-45623518fc11 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033955 Sep 17 21:50:34.639980 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3352/6797] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:50:35.640578 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-60b1f8eb-4bbb-4a35-912b-dfcbb936b63f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:50:35.641863 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-60b1f8eb-4bbb-4a35-912b-dfcbb936b63f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:50:35.653746 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-60b1f8eb-4bbb-4a35-912b-dfcbb936b63f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:35.654623 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-60b1f8eb-4bbb-4a35-912b-dfcbb936b63f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:35.655387 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-60b1f8eb-4bbb-4a35-912b-dfcbb936b63f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:35.656583 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-60b1f8eb-4bbb-4a35-912b-dfcbb936b63f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:35.657379 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-60b1f8eb-4bbb-4a35-912b-dfcbb936b63f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:35.658218 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-60b1f8eb-4bbb-4a35-912b-dfcbb936b63f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:35.806006 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-60b1f8eb-4bbb-4a35-912b-dfcbb936b63f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:50:35.814550 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-60b1f8eb-4bbb-4a35-912b-dfcbb936b63f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 200 len: 1391 microversion: 2.1 time: 0.180931 Sep 17 21:50:35.815158 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3446/6798] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:50:35 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 1391 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:50:36.838027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=8 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:50:36.843399 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7ec545c3-550d-463f-9a39-724bb794a23a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:50:36.844116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7ec545c3-550d-463f-9a39-724bb794a23a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:50:36.850941 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ec545c3-550d-463f-9a39-724bb794a23a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:36.851442 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ec545c3-550d-463f-9a39-724bb794a23a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:36.851897 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ec545c3-550d-463f-9a39-724bb794a23a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:36.852603 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ec545c3-550d-463f-9a39-724bb794a23a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:36.853070 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ec545c3-550d-463f-9a39-724bb794a23a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:36.853510 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7ec545c3-550d-463f-9a39-724bb794a23a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:36.995029 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-7ec545c3-550d-463f-9a39-724bb794a23a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:50:37.003507 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7ec545c3-550d-463f-9a39-724bb794a23a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 200 len: 1562 microversion: 2.1 time: 0.166551 Sep 17 21:50:37.004098 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3353/6799] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:50:36 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:50:37.026370 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3195c3d6-de3f-41dd-918c-13d9e6b883f8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:50:37.027042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3195c3d6-de3f-41dd-918c-13d9e6b883f8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:50:37.029039 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=10 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:50:37.035299 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3195c3d6-de3f-41dd-918c-13d9e6b883f8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:37.035777 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3195c3d6-de3f-41dd-918c-13d9e6b883f8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:37.036233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3195c3d6-de3f-41dd-918c-13d9e6b883f8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:37.036950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3195c3d6-de3f-41dd-918c-13d9e6b883f8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:37.037423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3195c3d6-de3f-41dd-918c-13d9e6b883f8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:37.037908 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3195c3d6-de3f-41dd-918c-13d9e6b883f8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:37.183148 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3195c3d6-de3f-41dd-918c-13d9e6b883f8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:50:37.191592 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3195c3d6-de3f-41dd-918c-13d9e6b883f8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 200 len: 1562 microversion: 2.1 time: 0.169181 Sep 17 21:50:37.192193 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3447/6800] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:50:37 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 1562 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:50:38.836707 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-194b0def-56c2-4836-8a2b-895fb333933c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:50:38.838032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-194b0def-56c2-4836-8a2b-895fb333933c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:50:38.847051 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-194b0def-56c2-4836-8a2b-895fb333933c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:38.847913 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-194b0def-56c2-4836-8a2b-895fb333933c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:38.848829 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-194b0def-56c2-4836-8a2b-895fb333933c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:38.850532 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-194b0def-56c2-4836-8a2b-895fb333933c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:38.851448 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-194b0def-56c2-4836-8a2b-895fb333933c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:38.851956 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-194b0def-56c2-4836-8a2b-895fb333933c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:38.946215 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-1b349761-c033-4958-8617-1e3ac77dcf89 req-3fc0a30b-7d43-4687-8a00-0b6a3c3146fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad243c97-8e6a-41c8-8f52-44e324651c34", "tag": "1aa97e84-41de-4ff3-9699-2dcf150c3dba"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:50:38.956459 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-1b349761-c033-4958-8617-1e3ac77dcf89 req-3fc0a30b-7d43-4687-8a00-0b6a3c3146fd service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:50:38.956954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-1b349761-c033-4958-8617-1e3ac77dcf89 req-3fc0a30b-7d43-4687-8a00-0b6a3c3146fd service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:50:38.957799 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-1b349761-c033-4958-8617-1e3ac77dcf89 req-3fc0a30b-7d43-4687-8a00-0b6a3c3146fd service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:50:38.971240 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-1b349761-c033-4958-8617-1e3ac77dcf89 req-3fc0a30b-7d43-4687-8a00-0b6a3c3146fd service nova] Creating event network-changed:1aa97e84-41de-4ff3-9699-2dcf150c3dba for instance ad243c97-8e6a-41c8-8f52-44e324651c34 on nch1-master-1 Sep 17 21:50:38.978128 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-1b349761-c033-4958-8617-1e3ac77dcf89 req-3fc0a30b-7d43-4687-8a00-0b6a3c3146fd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095200 Sep 17 21:50:38.979563 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3448/6801] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:50:39.009686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-194b0def-56c2-4836-8a2b-895fb333933c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:50:39.017791 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-194b0def-56c2-4836-8a2b-895fb333933c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 200 len: 1562 microversion: 2.1 time: 0.186777 Sep 17 21:50:39.018552 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3354/6802] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:50:38 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 1562 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:51:00.295524 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=7 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:51:00.296841 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=40 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:51:00.302330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a8dd7135-83cf-441c-b7c9-44659371f599 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:51:00.304659 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a8dd7135-83cf-441c-b7c9-44659371f599 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:51:00.311526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8dd7135-83cf-441c-b7c9-44659371f599 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:00.312014 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8dd7135-83cf-441c-b7c9-44659371f599 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:00.312472 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8dd7135-83cf-441c-b7c9-44659371f599 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:00.313184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8dd7135-83cf-441c-b7c9-44659371f599 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:00.313686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8dd7135-83cf-441c-b7c9-44659371f599 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:00.314130 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a8dd7135-83cf-441c-b7c9-44659371f599 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:00.371287 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a8dd7135-83cf-441c-b7c9-44659371f599 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "POST /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34/action" status: 200 len: 24570 microversion: 2.1 time: 0.079246 Sep 17 21:51:00.371935 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3449/6803] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:51:00 2022] POST /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34/action => generated 24570 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:51:11.452226 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-7a8e165b-9cc3-4c0a-9a08-bb9a1edfb352 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:51:11.456504 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-7a8e165b-9cc3-4c0a-9a08-bb9a1edfb352 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:51:11.459041 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=13 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:51:11.459700 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=34 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:51:11.466457 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a8e165b-9cc3-4c0a-9a08-bb9a1edfb352 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:11.466930 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a8e165b-9cc3-4c0a-9a08-bb9a1edfb352 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:11.467373 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a8e165b-9cc3-4c0a-9a08-bb9a1edfb352 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:11.468085 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a8e165b-9cc3-4c0a-9a08-bb9a1edfb352 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:11.468538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a8e165b-9cc3-4c0a-9a08-bb9a1edfb352 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:11.468967 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-7a8e165b-9cc3-4c0a-9a08-bb9a1edfb352 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:11.552814 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-7a8e165b-9cc3-4c0a-9a08-bb9a1edfb352 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "POST /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34/action" status: 202 len: 0 microversion: 2.1 time: 0.107724 Sep 17 21:51:11.553498 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3355/6804] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:51:11 2022] POST /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:51:11.563172 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e872dfb0-35ba-4eba-a874-3949c9bd6f12 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:51:11.563893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e872dfb0-35ba-4eba-a874-3949c9bd6f12 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:51:11.567543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:51:11.568299 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=4 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:51:11.580933 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e872dfb0-35ba-4eba-a874-3949c9bd6f12 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:11.582321 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e872dfb0-35ba-4eba-a874-3949c9bd6f12 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:11.582786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e872dfb0-35ba-4eba-a874-3949c9bd6f12 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:11.583512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e872dfb0-35ba-4eba-a874-3949c9bd6f12 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:11.583988 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e872dfb0-35ba-4eba-a874-3949c9bd6f12 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:11.584432 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e872dfb0-35ba-4eba-a874-3949c9bd6f12 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:11.727269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e872dfb0-35ba-4eba-a874-3949c9bd6f12 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:51:11.735711 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e872dfb0-35ba-4eba-a874-3949c9bd6f12 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 200 len: 1673 microversion: 2.1 time: 0.177576 Sep 17 21:51:11.736306 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3450/6805] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:51:11 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 1673 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:51:12.766608 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d474f633-dda6-4021-8b85-e3ed67d08edf tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:51:12.767711 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d474f633-dda6-4021-8b85-e3ed67d08edf tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:51:12.778452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d474f633-dda6-4021-8b85-e3ed67d08edf tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:12.779256 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d474f633-dda6-4021-8b85-e3ed67d08edf tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:12.780000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d474f633-dda6-4021-8b85-e3ed67d08edf tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:12.781189 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d474f633-dda6-4021-8b85-e3ed67d08edf tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:12.782004 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d474f633-dda6-4021-8b85-e3ed67d08edf tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:12.782698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d474f633-dda6-4021-8b85-e3ed67d08edf tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:12.931741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d474f633-dda6-4021-8b85-e3ed67d08edf tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:51:12.940983 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d474f633-dda6-4021-8b85-e3ed67d08edf tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 200 len: 1678 microversion: 2.1 time: 0.183540 Sep 17 21:51:12.941599 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3356/6806] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:51:12 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 1678 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:51:13.971256 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4c0f9d1f-d3f4-4ac0-aaf0-eaf1089133d9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:51:13.972401 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4c0f9d1f-d3f4-4ac0-aaf0-eaf1089133d9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:51:13.980778 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c0f9d1f-d3f4-4ac0-aaf0-eaf1089133d9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:13.981292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c0f9d1f-d3f4-4ac0-aaf0-eaf1089133d9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:13.981857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c0f9d1f-d3f4-4ac0-aaf0-eaf1089133d9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:13.982610 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c0f9d1f-d3f4-4ac0-aaf0-eaf1089133d9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:13.983090 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c0f9d1f-d3f4-4ac0-aaf0-eaf1089133d9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:13.983541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4c0f9d1f-d3f4-4ac0-aaf0-eaf1089133d9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:14.123203 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4c0f9d1f-d3f4-4ac0-aaf0-eaf1089133d9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:51:14.131824 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4c0f9d1f-d3f4-4ac0-aaf0-eaf1089133d9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 200 len: 1678 microversion: 2.1 time: 0.167518 Sep 17 21:51:14.132412 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3451/6807] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:51:13 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:51:15.163731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2780dd2f-432f-4114-8ab0-622d985fff84 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:51:15.164868 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2780dd2f-432f-4114-8ab0-622d985fff84 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:51:15.177868 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2780dd2f-432f-4114-8ab0-622d985fff84 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:15.178797 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2780dd2f-432f-4114-8ab0-622d985fff84 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:15.180212 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2780dd2f-432f-4114-8ab0-622d985fff84 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:15.180956 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2780dd2f-432f-4114-8ab0-622d985fff84 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:15.181422 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2780dd2f-432f-4114-8ab0-622d985fff84 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:15.182034 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2780dd2f-432f-4114-8ab0-622d985fff84 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:15.322760 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2780dd2f-432f-4114-8ab0-622d985fff84 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:51:15.330783 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2780dd2f-432f-4114-8ab0-622d985fff84 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 200 len: 1678 microversion: 2.1 time: 0.174832 Sep 17 21:51:15.331367 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3357/6808] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:51:15 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:51:16.359423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0f8c4520-47b8-4e15-81c7-d7fb0e61c047 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:51:16.360315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0f8c4520-47b8-4e15-81c7-d7fb0e61c047 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:51:16.372028 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f8c4520-47b8-4e15-81c7-d7fb0e61c047 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:16.372877 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f8c4520-47b8-4e15-81c7-d7fb0e61c047 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:16.373692 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f8c4520-47b8-4e15-81c7-d7fb0e61c047 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:16.374876 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f8c4520-47b8-4e15-81c7-d7fb0e61c047 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:16.375669 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f8c4520-47b8-4e15-81c7-d7fb0e61c047 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:16.376407 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0f8c4520-47b8-4e15-81c7-d7fb0e61c047 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:16.516519 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0f8c4520-47b8-4e15-81c7-d7fb0e61c047 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:51:16.524744 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0f8c4520-47b8-4e15-81c7-d7fb0e61c047 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 200 len: 1678 microversion: 2.1 time: 0.172136 Sep 17 21:51:16.525347 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3452/6809] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:51:16 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:51:17.548626 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c227d603-7036-4cef-8299-c17b8ea93dcf tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:51:17.549282 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c227d603-7036-4cef-8299-c17b8ea93dcf tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:51:17.556608 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c227d603-7036-4cef-8299-c17b8ea93dcf tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:17.557117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c227d603-7036-4cef-8299-c17b8ea93dcf tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:17.557591 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c227d603-7036-4cef-8299-c17b8ea93dcf tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:17.558304 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c227d603-7036-4cef-8299-c17b8ea93dcf tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:17.558768 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c227d603-7036-4cef-8299-c17b8ea93dcf tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:17.559202 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c227d603-7036-4cef-8299-c17b8ea93dcf tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:17.697571 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c227d603-7036-4cef-8299-c17b8ea93dcf tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:51:17.705958 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c227d603-7036-4cef-8299-c17b8ea93dcf tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 200 len: 1678 microversion: 2.1 time: 0.161357 Sep 17 21:51:17.706512 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3358/6810] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:51:17 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:51:18.730566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e048125a-f181-4b33-83b2-e4dc95001aa8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:51:18.731246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e048125a-f181-4b33-83b2-e4dc95001aa8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:51:18.738732 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e048125a-f181-4b33-83b2-e4dc95001aa8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:18.739241 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e048125a-f181-4b33-83b2-e4dc95001aa8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:18.739702 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e048125a-f181-4b33-83b2-e4dc95001aa8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:18.740420 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e048125a-f181-4b33-83b2-e4dc95001aa8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:18.740898 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e048125a-f181-4b33-83b2-e4dc95001aa8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:18.741345 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e048125a-f181-4b33-83b2-e4dc95001aa8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:18.882242 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e048125a-f181-4b33-83b2-e4dc95001aa8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:51:18.890540 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e048125a-f181-4b33-83b2-e4dc95001aa8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 200 len: 1678 microversion: 2.1 time: 0.164040 Sep 17 21:51:18.891120 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3453/6811] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:51:18 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:51:19.918563 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ab8d1dfd-3704-4591-895c-63121b1371c6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:51:19.919185 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ab8d1dfd-3704-4591-895c-63121b1371c6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:51:19.926175 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab8d1dfd-3704-4591-895c-63121b1371c6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:19.926679 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab8d1dfd-3704-4591-895c-63121b1371c6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:19.927129 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab8d1dfd-3704-4591-895c-63121b1371c6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:19.927857 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab8d1dfd-3704-4591-895c-63121b1371c6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:19.928324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab8d1dfd-3704-4591-895c-63121b1371c6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:19.928764 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ab8d1dfd-3704-4591-895c-63121b1371c6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:20.062837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ab8d1dfd-3704-4591-895c-63121b1371c6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:51:20.070692 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ab8d1dfd-3704-4591-895c-63121b1371c6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 200 len: 1678 microversion: 2.1 time: 0.157864 Sep 17 21:51:20.071641 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3359/6812] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:51:19 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:51:21.100164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-be5876d6-9e08-4e6e-8a9b-fb554fa0eccc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:51:21.101248 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-be5876d6-9e08-4e6e-8a9b-fb554fa0eccc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:51:21.112308 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be5876d6-9e08-4e6e-8a9b-fb554fa0eccc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:21.113175 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be5876d6-9e08-4e6e-8a9b-fb554fa0eccc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:21.114091 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be5876d6-9e08-4e6e-8a9b-fb554fa0eccc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:21.115288 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be5876d6-9e08-4e6e-8a9b-fb554fa0eccc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:21.116082 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be5876d6-9e08-4e6e-8a9b-fb554fa0eccc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:21.116828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-be5876d6-9e08-4e6e-8a9b-fb554fa0eccc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:21.259950 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-be5876d6-9e08-4e6e-8a9b-fb554fa0eccc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:51:21.267925 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-be5876d6-9e08-4e6e-8a9b-fb554fa0eccc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 200 len: 1678 microversion: 2.1 time: 0.174847 Sep 17 21:51:21.268532 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3454/6813] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:51:21 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:51:22.299931 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-60d68406-ce26-42f5-bebf-efaf3ddf48a5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:51:22.300609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-60d68406-ce26-42f5-bebf-efaf3ddf48a5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:51:22.308832 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60d68406-ce26-42f5-bebf-efaf3ddf48a5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:22.309568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60d68406-ce26-42f5-bebf-efaf3ddf48a5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:22.310172 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60d68406-ce26-42f5-bebf-efaf3ddf48a5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:22.311163 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60d68406-ce26-42f5-bebf-efaf3ddf48a5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:22.311839 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60d68406-ce26-42f5-bebf-efaf3ddf48a5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:22.312485 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-60d68406-ce26-42f5-bebf-efaf3ddf48a5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:22.470192 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-60d68406-ce26-42f5-bebf-efaf3ddf48a5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:51:22.478391 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-60d68406-ce26-42f5-bebf-efaf3ddf48a5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 200 len: 1678 microversion: 2.1 time: 0.182536 Sep 17 21:51:22.478976 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3360/6814] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:51:22 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 1678 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:51:23.506442 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-63d494be-513c-4c7d-9200-c93e64e60c0b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:51:23.507490 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-63d494be-513c-4c7d-9200-c93e64e60c0b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:51:23.515741 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-63d494be-513c-4c7d-9200-c93e64e60c0b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:23.516248 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-63d494be-513c-4c7d-9200-c93e64e60c0b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:23.516706 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-63d494be-513c-4c7d-9200-c93e64e60c0b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:23.517423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-63d494be-513c-4c7d-9200-c93e64e60c0b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:23.517938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-63d494be-513c-4c7d-9200-c93e64e60c0b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:23.518382 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-63d494be-513c-4c7d-9200-c93e64e60c0b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:23.661058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-63d494be-513c-4c7d-9200-c93e64e60c0b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:51:23.669614 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-63d494be-513c-4c7d-9200-c93e64e60c0b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 200 len: 1678 microversion: 2.1 time: 0.169739 Sep 17 21:51:23.670212 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3455/6815] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:51:23 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:51:24.698081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0be71e1e-6580-44c4-920f-122dcf92f3cd tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:51:24.698771 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0be71e1e-6580-44c4-920f-122dcf92f3cd tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:51:24.707561 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0be71e1e-6580-44c4-920f-122dcf92f3cd tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:24.708106 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0be71e1e-6580-44c4-920f-122dcf92f3cd tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:24.708597 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0be71e1e-6580-44c4-920f-122dcf92f3cd tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:24.709411 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0be71e1e-6580-44c4-920f-122dcf92f3cd tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:24.709933 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0be71e1e-6580-44c4-920f-122dcf92f3cd tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:24.710418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0be71e1e-6580-44c4-920f-122dcf92f3cd tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:24.852087 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0be71e1e-6580-44c4-920f-122dcf92f3cd tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:51:24.860412 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0be71e1e-6580-44c4-920f-122dcf92f3cd tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 200 len: 1678 microversion: 2.1 time: 0.166786 Sep 17 21:51:24.860945 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3361/6816] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:51:24 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:51:25.888283 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-22f8a788-9102-4cc5-9302-c8ef2c0e2cc5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:51:25.888898 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-22f8a788-9102-4cc5-9302-c8ef2c0e2cc5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:51:25.896792 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-22f8a788-9102-4cc5-9302-c8ef2c0e2cc5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:25.897283 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-22f8a788-9102-4cc5-9302-c8ef2c0e2cc5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:25.897775 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-22f8a788-9102-4cc5-9302-c8ef2c0e2cc5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:25.898523 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-22f8a788-9102-4cc5-9302-c8ef2c0e2cc5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:25.898974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-22f8a788-9102-4cc5-9302-c8ef2c0e2cc5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:25.899419 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-22f8a788-9102-4cc5-9302-c8ef2c0e2cc5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:26.030329 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-22f8a788-9102-4cc5-9302-c8ef2c0e2cc5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:51:26.038661 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-22f8a788-9102-4cc5-9302-c8ef2c0e2cc5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 200 len: 1678 microversion: 2.1 time: 0.156344 Sep 17 21:51:26.039251 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3456/6817] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:51:25 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:51:27.066883 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-35119f57-9a52-4dac-9cbf-b0a61129111d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:51:27.067898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-35119f57-9a52-4dac-9cbf-b0a61129111d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:51:27.079526 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35119f57-9a52-4dac-9cbf-b0a61129111d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:27.080345 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35119f57-9a52-4dac-9cbf-b0a61129111d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:27.081123 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35119f57-9a52-4dac-9cbf-b0a61129111d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:27.082718 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35119f57-9a52-4dac-9cbf-b0a61129111d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:27.083473 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35119f57-9a52-4dac-9cbf-b0a61129111d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:27.084187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-35119f57-9a52-4dac-9cbf-b0a61129111d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:27.225598 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-35119f57-9a52-4dac-9cbf-b0a61129111d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:51:27.234150 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-35119f57-9a52-4dac-9cbf-b0a61129111d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 200 len: 1678 microversion: 2.1 time: 0.174113 Sep 17 21:51:27.234728 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3362/6818] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:51:27 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:51:28.260561 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4db5d1f1-fa89-4cae-886a-f480cbcb429c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:51:28.261251 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4db5d1f1-fa89-4cae-886a-f480cbcb429c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:51:28.268708 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4db5d1f1-fa89-4cae-886a-f480cbcb429c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:28.269223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4db5d1f1-fa89-4cae-886a-f480cbcb429c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:28.269738 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4db5d1f1-fa89-4cae-886a-f480cbcb429c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:28.270472 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4db5d1f1-fa89-4cae-886a-f480cbcb429c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:28.270947 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4db5d1f1-fa89-4cae-886a-f480cbcb429c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:28.271405 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4db5d1f1-fa89-4cae-886a-f480cbcb429c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:28.407698 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4db5d1f1-fa89-4cae-886a-f480cbcb429c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:51:28.419442 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4db5d1f1-fa89-4cae-886a-f480cbcb429c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 200 len: 1681 microversion: 2.1 time: 0.162755 Sep 17 21:51:28.420269 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3457/6819] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:51:28 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:51:52.659116 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5dfc4d4d-6c6c-40e5-a74c-b412aebe1537 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:51:52.661584 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5dfc4d4d-6c6c-40e5-a74c-b412aebe1537 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:51:52.664098 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=16 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:51:52.664778 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:51:52.670857 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5dfc4d4d-6c6c-40e5-a74c-b412aebe1537 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:52.671356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5dfc4d4d-6c6c-40e5-a74c-b412aebe1537 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:52.671806 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5dfc4d4d-6c6c-40e5-a74c-b412aebe1537 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:52.672590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5dfc4d4d-6c6c-40e5-a74c-b412aebe1537 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:52.673195 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5dfc4d4d-6c6c-40e5-a74c-b412aebe1537 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:52.673721 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5dfc4d4d-6c6c-40e5-a74c-b412aebe1537 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:52.731595 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5dfc4d4d-6c6c-40e5-a74c-b412aebe1537 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "POST /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34/action" status: 200 len: 69214 microversion: 2.1 time: 0.076537 Sep 17 21:51:52.732269 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3363/6820] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:51:52 2022] POST /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34/action => generated 69214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:51:59.898502 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d7049938-cf4f-44ac-94a1-b86f7720c928 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:51:59.899069 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d7049938-cf4f-44ac-94a1-b86f7720c928 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:51:59.901086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-1436e672-109d-4997-a92f-861d2d728a46 req-b9cd84a4-e9e2-44e7-9424-b355035941dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad243c97-8e6a-41c8-8f52-44e324651c34", "tag": "1aa97e84-41de-4ff3-9699-2dcf150c3dba"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:51:59.901571 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=16 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:51:59.902542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=48 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:51:59.909238 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d7049938-cf4f-44ac-94a1-b86f7720c928 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:59.910048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d7049938-cf4f-44ac-94a1-b86f7720c928 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:59.910730 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d7049938-cf4f-44ac-94a1-b86f7720c928 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:59.911681 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d7049938-cf4f-44ac-94a1-b86f7720c928 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:59.912713 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d7049938-cf4f-44ac-94a1-b86f7720c928 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:59.913364 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d7049938-cf4f-44ac-94a1-b86f7720c928 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:59.913921 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-1436e672-109d-4997-a92f-861d2d728a46 req-b9cd84a4-e9e2-44e7-9424-b355035941dd service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:51:59.914413 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-1436e672-109d-4997-a92f-861d2d728a46 req-b9cd84a4-e9e2-44e7-9424-b355035941dd service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:51:59.915026 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-1436e672-109d-4997-a92f-861d2d728a46 req-b9cd84a4-e9e2-44e7-9424-b355035941dd service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:51:59.927627 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-1436e672-109d-4997-a92f-861d2d728a46 req-b9cd84a4-e9e2-44e7-9424-b355035941dd service nova] Creating event network-changed:1aa97e84-41de-4ff3-9699-2dcf150c3dba for instance ad243c97-8e6a-41c8-8f52-44e324651c34 on nch1-master-1 Sep 17 21:51:59.933785 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-1436e672-109d-4997-a92f-861d2d728a46 req-b9cd84a4-e9e2-44e7-9424-b355035941dd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036879 Sep 17 21:51:59.934658 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3364/6821] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:51:59.944196 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d7049938-cf4f-44ac-94a1-b86f7720c928 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:52:00.039342 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d7049938-cf4f-44ac-94a1-b86f7720c928 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 204 len: 0 microversion: 2.1 time: 0.144867 Sep 17 21:52:00.040447 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3458/6822] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:51:59 2022] DELETE /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:52:00.050504 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-91142f73-091b-48ec-bdb9-ea576765f41a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:52:00.051725 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-91142f73-091b-48ec-bdb9-ea576765f41a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:52:00.060118 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-91142f73-091b-48ec-bdb9-ea576765f41a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:00.060715 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-91142f73-091b-48ec-bdb9-ea576765f41a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:00.061240 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-91142f73-091b-48ec-bdb9-ea576765f41a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:00.062073 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-91142f73-091b-48ec-bdb9-ea576765f41a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:00.062640 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-91142f73-091b-48ec-bdb9-ea576765f41a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:00.063140 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-91142f73-091b-48ec-bdb9-ea576765f41a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:00.207370 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-91142f73-091b-48ec-bdb9-ea576765f41a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:52:00.215530 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-91142f73-091b-48ec-bdb9-ea576765f41a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 200 len: 1687 microversion: 2.1 time: 0.170202 Sep 17 21:52:00.216209 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3365/6823] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:52:00 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:52:01.243192 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-84227e05-a903-4478-b858-6ded15900685 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:52:01.243923 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-84227e05-a903-4478-b858-6ded15900685 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:52:01.251403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84227e05-a903-4478-b858-6ded15900685 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:01.251914 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84227e05-a903-4478-b858-6ded15900685 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:01.252376 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84227e05-a903-4478-b858-6ded15900685 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:01.253129 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84227e05-a903-4478-b858-6ded15900685 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:01.253648 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84227e05-a903-4478-b858-6ded15900685 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:01.254081 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84227e05-a903-4478-b858-6ded15900685 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:01.392834 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-84227e05-a903-4478-b858-6ded15900685 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:52:01.401311 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-84227e05-a903-4478-b858-6ded15900685 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 200 len: 1687 microversion: 2.1 time: 0.163662 Sep 17 21:52:01.402039 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3459/6824] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:52:01 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:52:02.053178 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-f9ea76d7-f295-4dcb-9a99-b2a321130e58 req-69ebb4b9-bc94-4b01-bb07-7b2229b0d3df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad243c97-8e6a-41c8-8f52-44e324651c34", "name": "network-vif-deleted", "tag": "1aa97e84-41de-4ff3-9699-2dcf150c3dba"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:52:02.067902 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f9ea76d7-f295-4dcb-9a99-b2a321130e58 req-69ebb4b9-bc94-4b01-bb07-7b2229b0d3df service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:02.068167 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f9ea76d7-f295-4dcb-9a99-b2a321130e58 req-69ebb4b9-bc94-4b01-bb07-7b2229b0d3df service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:02.068470 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-f9ea76d7-f295-4dcb-9a99-b2a321130e58 req-69ebb4b9-bc94-4b01-bb07-7b2229b0d3df service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:02.081301 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-f9ea76d7-f295-4dcb-9a99-b2a321130e58 req-69ebb4b9-bc94-4b01-bb07-7b2229b0d3df service nova] Creating event network-vif-deleted:1aa97e84-41de-4ff3-9699-2dcf150c3dba for instance ad243c97-8e6a-41c8-8f52-44e324651c34 on nch1-master-1 Sep 17 21:52:02.086809 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-f9ea76d7-f295-4dcb-9a99-b2a321130e58 req-69ebb4b9-bc94-4b01-bb07-7b2229b0d3df service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037693 Sep 17 21:52:02.087462 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3366/6825] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:52:02.425577 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-861fccc3-dd6a-4458-b767-d0192218cb33 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:52:02.426893 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-861fccc3-dd6a-4458-b767-d0192218cb33 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:52:02.434718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-861fccc3-dd6a-4458-b767-d0192218cb33 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:02.435244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-861fccc3-dd6a-4458-b767-d0192218cb33 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:02.435708 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-861fccc3-dd6a-4458-b767-d0192218cb33 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:02.436452 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-861fccc3-dd6a-4458-b767-d0192218cb33 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:02.436932 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-861fccc3-dd6a-4458-b767-d0192218cb33 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:02.438512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-861fccc3-dd6a-4458-b767-d0192218cb33 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:02.482808 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-861fccc3-dd6a-4458-b767-d0192218cb33 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:02.483251 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-861fccc3-dd6a-4458-b767-d0192218cb33 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:02.483721 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-861fccc3-dd6a-4458-b767-d0192218cb33 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:02.484201 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-861fccc3-dd6a-4458-b767-d0192218cb33 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lazy-loading 'fault' on Instance uuid ad243c97-8e6a-41c8-8f52-44e324651c34 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:52:02.533045 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-861fccc3-dd6a-4458-b767-d0192218cb33 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:52:02.541969 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-861fccc3-dd6a-4458-b767-d0192218cb33 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 200 len: 1355 microversion: 2.1 time: 0.120262 Sep 17 21:52:02.555120 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3460/6826] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:52:02 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 1355 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:52:03.575525 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-46d5432a-f971-4bab-9397-16c5064ee9a5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:52:03.576643 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-46d5432a-f971-4bab-9397-16c5064ee9a5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: ad243c97-8e6a-41c8-8f52-44e324651c34] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:52:03.584656 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46d5432a-f971-4bab-9397-16c5064ee9a5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:03.585151 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46d5432a-f971-4bab-9397-16c5064ee9a5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:03.585624 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46d5432a-f971-4bab-9397-16c5064ee9a5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:03.586335 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46d5432a-f971-4bab-9397-16c5064ee9a5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:03.586800 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46d5432a-f971-4bab-9397-16c5064ee9a5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:03.587244 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-46d5432a-f971-4bab-9397-16c5064ee9a5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:03.601578 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-46d5432a-f971-4bab-9397-16c5064ee9a5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] HTTP exception thrown: Instance ad243c97-8e6a-41c8-8f52-44e324651c34 could not be found. Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-46d5432a-f971-4bab-9397-16c5064ee9a5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Request method failure captured: Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 HTTP/1.1 Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJkDaqrUqQ4R3Jc50dHjJrzHY0H6R9FbsHaifiKAhdbafUbvetKkTsAeXQ-XLllwkBW4TMkyFoTdjx6sRrhd61AW2D-lOJ5jM-lciJMsVlu69fHeXBQVZJqH7yfr66d0yPaxTtnH5N_36Tfpt2dvCfwMBCGXmn8-CxBhA65JgC1h0P9o Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 88a7205c02914d428fd0d43b7fa61fe9 Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1937454944 Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/88a7205c02914d428fd0d43b7fa61fe9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/88a7205c02914d428fd0d43b7fa61fe9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/88a7205c02914d428fd0d43b7fa61fe9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_88a7205c02914d428fd0d43b7fa61fe9", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1937454944 Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 88a7205c02914d428fd0d43b7fa61fe9 Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1937454944 Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-TestNetworkAdvancedServerOps-1937454944-project Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: ac0fa1f4eeca4d5e822b603953471c73 Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1937454944-project Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance ad243c97-8e6a-41c8-8f52-44e324651c34 could not be found. Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'ad243c97-8e6a-41c8-8f52-44e324651c34'} Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad243c97-8e6a-41c8-8f52-44e324651c34 could not be found. Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad243c97-8e6a-41c8-8f52-44e324651c34 could not be found. Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:52:03.603344 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:52:03.608605 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:52:03.608605 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:52:03.608605 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:52:03.608605 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:52:03.608605 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:52:03.608605 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:52:03.608605 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad243c97-8e6a-41c8-8f52-44e324651c34 could not be found. Sep 17 21:52:03.608605 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:52:03.608605 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-46d5432a-f971-4bab-9397-16c5064ee9a5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Returning 404 to user: Instance ad243c97-8e6a-41c8-8f52-44e324651c34 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:52:03.608605 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-46d5432a-f971-4bab-9397-16c5064ee9a5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34" status: 404 len: 111 microversion: 2.1 time: 0.036155 Sep 17 21:52:03.608605 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3367/6827] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:52:03 2022] GET /compute/v2.1/servers/ad243c97-8e6a-41c8-8f52-44e324651c34 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:52:06.996274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-822435da-3fe9-47b7-8cc7-24be50c27c8d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '.version_select at 0x7f259fee6af0>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:52:07.019323 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-822435da-3fe9-47b7-8cc7-24be50c27c8d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-314654811" status: 202 len: 0 microversion: 2.1 time: 0.027017 Sep 17 21:52:07.020093 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3461/6828] 10.222.0.26 () {58 vars in 1281 bytes} [Sat Sep 17 21:52:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-314654811 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:52:07.049135 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2218c72b-bb34-4147-ab1f-3945c1c9756f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Action: 'create', calling method: .version_select at 0x7f25a49de8b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-343753316", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLO59UsjPWbqUV3x+gk52FBFuAXhcAddqMwarXj38ShfSKLshkGqxOmtkLdF/Hi+OY4aFr0Ycx1gwrAiVoGUeKlTmGh+WeM3NK2AwtlfwUdXiiuyygBitHP6e0jlkOl0eQ=="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:52:07.067407 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-2218c72b-bb34-4147-ab1f-3945c1c9756f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Getting quotas for project 88a7205c02914d428fd0d43b7fa61fe9. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:52:07.073407 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-2218c72b-bb34-4147-ab1f-3945c1c9756f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Getting quotas for user ac0fa1f4eeca4d5e822b603953471c73 and project 88a7205c02914d428fd0d43b7fa61fe9. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:52:07.099681 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2218c72b-bb34-4147-ab1f-3945c1c9756f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.054508 Sep 17 21:52:07.100345 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3368/6829] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:52:07 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:52:13.090498 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:52:13.095736 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7ca268ab-65c4-4d41-89f9-c08e25699b2d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2124125813", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "16ca1165-3d07-41b6-bd27-bdd7958ca27b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-343753316", "security_groups": [{"name": "tempest-secgroup-smoke-1192429009"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:52:13.219436 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-7ca268ab-65c4-4d41-89f9-c08e25699b2d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] validate_networks() for [('16ca1165-3d07-41b6-bd27-bdd7958ca27b', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:52:13.729548 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-7ca268ab-65c4-4d41-89f9-c08e25699b2d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:52:13.729997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-7ca268ab-65c4-4d41-89f9-c08e25699b2d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:52:13.730488 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-7ca268ab-65c4-4d41-89f9-c08e25699b2d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:52:13.730962 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-7ca268ab-65c4-4d41-89f9-c08e25699b2d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:52:13.731394 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-7ca268ab-65c4-4d41-89f9-c08e25699b2d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:52:13.741907 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7ca268ab-65c4-4d41-89f9-c08e25699b2d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:13.742408 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7ca268ab-65c4-4d41-89f9-c08e25699b2d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:13.742865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7ca268ab-65c4-4d41-89f9-c08e25699b2d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:13.743617 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7ca268ab-65c4-4d41-89f9-c08e25699b2d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:13.744320 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7ca268ab-65c4-4d41-89f9-c08e25699b2d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:13.744765 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7ca268ab-65c4-4d41-89f9-c08e25699b2d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:13.763543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-7ca268ab-65c4-4d41-89f9-c08e25699b2d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Getting quotas for project 88a7205c02914d428fd0d43b7fa61fe9. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:52:13.769184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-7ca268ab-65c4-4d41-89f9-c08e25699b2d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Getting quotas for user ac0fa1f4eeca4d5e822b603953471c73 and project 88a7205c02914d428fd0d43b7fa61fe9. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:52:13.782078 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7ca268ab-65c4-4d41-89f9-c08e25699b2d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:52:13.784463 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7ca268ab-65c4-4d41-89f9-c08e25699b2d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:52:13.834681 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7ca268ab-65c4-4d41-89f9-c08e25699b2d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.746393 Sep 17 21:52:13.836036 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3462/6830] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:52:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:52:13.847705 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-01cf6324-ce8e-4837-95b9-5ae36af4e097 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:52:13.849191 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-01cf6324-ce8e-4837-95b9-5ae36af4e097 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:52:13.856199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=16 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:52:13.907174 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-01cf6324-ce8e-4837-95b9-5ae36af4e097 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:52:13.914487 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-01cf6324-ce8e-4837-95b9-5ae36af4e097 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1266 microversion: 2.1 time: 0.070733 Sep 17 21:52:13.915068 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3369/6831] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:52:13 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1266 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:52:14.941775 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2cb514b3-4609-4b3d-bf62-13f4f3c31228 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:52:14.943049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2cb514b3-4609-4b3d-bf62-13f4f3c31228 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:52:15.054636 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2cb514b3-4609-4b3d-bf62-13f4f3c31228 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:52:15.063068 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2cb514b3-4609-4b3d-bf62-13f4f3c31228 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1266 microversion: 2.1 time: 0.128432 Sep 17 21:52:15.063646 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3463/6832] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:52:14 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1266 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:52:16.088687 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-59f91d3c-bd7b-4cef-9f73-b256053ddbbd tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:52:16.089298 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-59f91d3c-bd7b-4cef-9f73-b256053ddbbd tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:52:16.149680 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-59f91d3c-bd7b-4cef-9f73-b256053ddbbd tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:52:16.157059 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-59f91d3c-bd7b-4cef-9f73-b256053ddbbd tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1266 microversion: 2.1 time: 0.072535 Sep 17 21:52:16.158042 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3370/6833] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:52:16 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1266 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:52:17.184814 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8790719f-d5d3-475a-a8c5-61236d77dd53 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:52:17.185908 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8790719f-d5d3-475a-a8c5-61236d77dd53 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:52:17.196968 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8790719f-d5d3-475a-a8c5-61236d77dd53 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:17.197403 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8790719f-d5d3-475a-a8c5-61236d77dd53 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:17.197896 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8790719f-d5d3-475a-a8c5-61236d77dd53 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:17.198618 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8790719f-d5d3-475a-a8c5-61236d77dd53 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:17.199091 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8790719f-d5d3-475a-a8c5-61236d77dd53 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:17.199539 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8790719f-d5d3-475a-a8c5-61236d77dd53 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:17.266681 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8790719f-d5d3-475a-a8c5-61236d77dd53 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:52:17.275215 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8790719f-d5d3-475a-a8c5-61236d77dd53 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1270 microversion: 2.1 time: 0.097032 Sep 17 21:52:17.275778 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3464/6834] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:52:17 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:52:18.298732 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-358685d1-0e75-4e0b-b1da-57ee61429ccc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:52:18.299386 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-358685d1-0e75-4e0b-b1da-57ee61429ccc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:52:18.306543 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-358685d1-0e75-4e0b-b1da-57ee61429ccc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:18.307042 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-358685d1-0e75-4e0b-b1da-57ee61429ccc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:18.307471 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-358685d1-0e75-4e0b-b1da-57ee61429ccc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:18.308188 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-358685d1-0e75-4e0b-b1da-57ee61429ccc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:18.308648 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-358685d1-0e75-4e0b-b1da-57ee61429ccc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:18.309082 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-358685d1-0e75-4e0b-b1da-57ee61429ccc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:18.398199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-358685d1-0e75-4e0b-b1da-57ee61429ccc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:52:18.406507 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-358685d1-0e75-4e0b-b1da-57ee61429ccc tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1324 microversion: 2.1 time: 0.111857 Sep 17 21:52:18.407331 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3371/6835] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:52:18 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1324 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:52:19.430335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cc027eb4-374a-4295-bded-f45a85712c35 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:52:19.431008 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cc027eb4-374a-4295-bded-f45a85712c35 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:52:19.438318 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc027eb4-374a-4295-bded-f45a85712c35 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:19.438914 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc027eb4-374a-4295-bded-f45a85712c35 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:19.439375 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc027eb4-374a-4295-bded-f45a85712c35 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:19.440105 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc027eb4-374a-4295-bded-f45a85712c35 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:19.440581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc027eb4-374a-4295-bded-f45a85712c35 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:19.441027 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc027eb4-374a-4295-bded-f45a85712c35 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:19.493385 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-e6e27256-2711-4028-99f4-03a062dba868 req-7d75edf9-c1fe-45d0-b862-71ba275c4b05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6da97855-d04e-4631-a020-40fe0d64bebc", "tag": "5507e9f4-f216-480c-a772-abfda9e3cf80"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:52:19.524000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-e6e27256-2711-4028-99f4-03a062dba868 req-7d75edf9-c1fe-45d0-b862-71ba275c4b05 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:19.524763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-e6e27256-2711-4028-99f4-03a062dba868 req-7d75edf9-c1fe-45d0-b862-71ba275c4b05 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:19.524907 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-e6e27256-2711-4028-99f4-03a062dba868 req-7d75edf9-c1fe-45d0-b862-71ba275c4b05 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:19.542995 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-e6e27256-2711-4028-99f4-03a062dba868 req-7d75edf9-c1fe-45d0-b862-71ba275c4b05 service nova] Creating event network-changed:5507e9f4-f216-480c-a772-abfda9e3cf80 for instance 6da97855-d04e-4631-a020-40fe0d64bebc on nch2-master-1 Sep 17 21:52:19.548679 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-e6e27256-2711-4028-99f4-03a062dba868 req-7d75edf9-c1fe-45d0-b862-71ba275c4b05 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059228 Sep 17 21:52:19.549298 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3372/6836] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:52:19.733726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cc027eb4-374a-4295-bded-f45a85712c35 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:52:19.742149 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cc027eb4-374a-4295-bded-f45a85712c35 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1392 microversion: 2.1 time: 0.315966 Sep 17 21:52:19.742750 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3465/6837] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:52:19 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1392 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:52:20.772464 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a531e250-f727-4755-8468-4143910b5c6b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:52:20.773426 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a531e250-f727-4755-8468-4143910b5c6b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:52:20.781021 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a531e250-f727-4755-8468-4143910b5c6b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:20.781579 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a531e250-f727-4755-8468-4143910b5c6b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:20.782028 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a531e250-f727-4755-8468-4143910b5c6b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:20.782745 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a531e250-f727-4755-8468-4143910b5c6b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:20.783206 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a531e250-f727-4755-8468-4143910b5c6b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:20.783643 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a531e250-f727-4755-8468-4143910b5c6b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:21.018344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a531e250-f727-4755-8468-4143910b5c6b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:52:21.027168 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a531e250-f727-4755-8468-4143910b5c6b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1392 microversion: 2.1 time: 0.262722 Sep 17 21:52:21.028452 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3373/6838] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:52:20 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1392 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:52:22.055324 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8bff6ade-4d62-40d4-9f6d-0930b84c15b5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:52:22.055877 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8bff6ade-4d62-40d4-9f6d-0930b84c15b5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:52:22.062745 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bff6ade-4d62-40d4-9f6d-0930b84c15b5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:22.063272 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bff6ade-4d62-40d4-9f6d-0930b84c15b5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:22.063741 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bff6ade-4d62-40d4-9f6d-0930b84c15b5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:22.064478 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bff6ade-4d62-40d4-9f6d-0930b84c15b5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:22.064967 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bff6ade-4d62-40d4-9f6d-0930b84c15b5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:22.065420 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8bff6ade-4d62-40d4-9f6d-0930b84c15b5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:22.207265 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8bff6ade-4d62-40d4-9f6d-0930b84c15b5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:52:22.215670 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8bff6ade-4d62-40d4-9f6d-0930b84c15b5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1392 microversion: 2.1 time: 0.167361 Sep 17 21:52:22.216626 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3466/6839] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:52:22 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:52:23.239977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-37a9f68b-cd36-4059-b997-d5f99cfba103 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:52:23.240600 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-37a9f68b-cd36-4059-b997-d5f99cfba103 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:52:23.243519 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:52:23.249194 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-37a9f68b-cd36-4059-b997-d5f99cfba103 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:23.249715 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-37a9f68b-cd36-4059-b997-d5f99cfba103 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:23.250158 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-37a9f68b-cd36-4059-b997-d5f99cfba103 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:23.250882 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-37a9f68b-cd36-4059-b997-d5f99cfba103 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:23.251327 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-37a9f68b-cd36-4059-b997-d5f99cfba103 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:23.251768 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-37a9f68b-cd36-4059-b997-d5f99cfba103 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:23.393482 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-37a9f68b-cd36-4059-b997-d5f99cfba103 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:52:23.402595 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-37a9f68b-cd36-4059-b997-d5f99cfba103 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1392 microversion: 2.1 time: 0.166512 Sep 17 21:52:23.406670 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3374/6840] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:52:23 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:52:24.430245 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c9cc9182-32d1-4822-9dc0-e45a39f3f466 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:52:24.430966 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c9cc9182-32d1-4822-9dc0-e45a39f3f466 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:52:24.434214 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:52:24.440737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9cc9182-32d1-4822-9dc0-e45a39f3f466 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:24.441335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9cc9182-32d1-4822-9dc0-e45a39f3f466 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:24.441897 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9cc9182-32d1-4822-9dc0-e45a39f3f466 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:24.442747 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9cc9182-32d1-4822-9dc0-e45a39f3f466 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:24.443303 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9cc9182-32d1-4822-9dc0-e45a39f3f466 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:24.443824 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c9cc9182-32d1-4822-9dc0-e45a39f3f466 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:24.579916 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c9cc9182-32d1-4822-9dc0-e45a39f3f466 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:52:24.588816 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c9cc9182-32d1-4822-9dc0-e45a39f3f466 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1392 microversion: 2.1 time: 0.165517 Sep 17 21:52:24.589377 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3467/6841] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:52:24 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:52:25.210243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-85f4bebe-fc27-43af-b6da-247211588dfe req-a27b7295-b79b-400b-b7fa-1149f5049ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6da97855-d04e-4631-a020-40fe0d64bebc", "name": "network-vif-plugged", "status": "completed", "tag": "5507e9f4-f216-480c-a772-abfda9e3cf80"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:52:25.221327 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-85f4bebe-fc27-43af-b6da-247211588dfe req-a27b7295-b79b-400b-b7fa-1149f5049ac8 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:25.221864 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-85f4bebe-fc27-43af-b6da-247211588dfe req-a27b7295-b79b-400b-b7fa-1149f5049ac8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:25.222386 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-85f4bebe-fc27-43af-b6da-247211588dfe req-a27b7295-b79b-400b-b7fa-1149f5049ac8 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:25.235193 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-85f4bebe-fc27-43af-b6da-247211588dfe req-a27b7295-b79b-400b-b7fa-1149f5049ac8 service nova] Creating event network-vif-plugged:5507e9f4-f216-480c-a772-abfda9e3cf80 for instance 6da97855-d04e-4631-a020-40fe0d64bebc on nch2-master-1 Sep 17 21:52:25.240478 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-85f4bebe-fc27-43af-b6da-247211588dfe req-a27b7295-b79b-400b-b7fa-1149f5049ac8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035585 Sep 17 21:52:25.241080 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3375/6842] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:52:25.612889 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-070f2a4d-36c6-4f7a-811e-be102adf1d12 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:52:25.613516 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-070f2a4d-36c6-4f7a-811e-be102adf1d12 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:52:25.615482 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=8 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:52:25.622351 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-070f2a4d-36c6-4f7a-811e-be102adf1d12 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:25.622872 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-070f2a4d-36c6-4f7a-811e-be102adf1d12 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:25.623335 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-070f2a4d-36c6-4f7a-811e-be102adf1d12 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:25.624117 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-070f2a4d-36c6-4f7a-811e-be102adf1d12 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:25.624595 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-070f2a4d-36c6-4f7a-811e-be102adf1d12 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:25.625042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-070f2a4d-36c6-4f7a-811e-be102adf1d12 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:25.766232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-070f2a4d-36c6-4f7a-811e-be102adf1d12 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:52:25.776919 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-070f2a4d-36c6-4f7a-811e-be102adf1d12 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1392 microversion: 2.1 time: 0.168265 Sep 17 21:52:25.777604 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3468/6843] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:52:25 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:52:26.799818 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=8 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:52:26.807172 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8d13d701-73cd-4093-8fc4-e434dee65f0a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:52:26.807933 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8d13d701-73cd-4093-8fc4-e434dee65f0a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:52:26.814634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8d13d701-73cd-4093-8fc4-e434dee65f0a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:26.815122 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8d13d701-73cd-4093-8fc4-e434dee65f0a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:26.815563 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8d13d701-73cd-4093-8fc4-e434dee65f0a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:26.816271 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8d13d701-73cd-4093-8fc4-e434dee65f0a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:26.816725 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8d13d701-73cd-4093-8fc4-e434dee65f0a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:26.817155 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8d13d701-73cd-4093-8fc4-e434dee65f0a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:26.957515 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8d13d701-73cd-4093-8fc4-e434dee65f0a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:52:26.966103 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8d13d701-73cd-4093-8fc4-e434dee65f0a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1565 microversion: 2.1 time: 0.167971 Sep 17 21:52:26.966651 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3376/6844] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:52:26 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:52:26.992031 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b24ebe3a-9472-4da8-a26d-b2c51bf8c995 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:52:26.992636 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b24ebe3a-9472-4da8-a26d-b2c51bf8c995 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:52:27.000200 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b24ebe3a-9472-4da8-a26d-b2c51bf8c995 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:27.000730 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b24ebe3a-9472-4da8-a26d-b2c51bf8c995 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:27.001168 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b24ebe3a-9472-4da8-a26d-b2c51bf8c995 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:27.001925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b24ebe3a-9472-4da8-a26d-b2c51bf8c995 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:27.002400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b24ebe3a-9472-4da8-a26d-b2c51bf8c995 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:27.002844 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b24ebe3a-9472-4da8-a26d-b2c51bf8c995 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:27.142899 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b24ebe3a-9472-4da8-a26d-b2c51bf8c995 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:52:27.151306 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b24ebe3a-9472-4da8-a26d-b2c51bf8c995 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1565 microversion: 2.1 time: 0.163193 Sep 17 21:52:27.151818 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3469/6845] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:52:26 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:52:29.180820 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-02c26ce2-cbc5-429a-9fe8-a980855313b0 req-d7dbfb65-3750-4ee4-8fbf-e37acfc6b9ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6da97855-d04e-4631-a020-40fe0d64bebc", "tag": "5507e9f4-f216-480c-a772-abfda9e3cf80"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:52:29.182393 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-110edbbf-be48-40d6-9d76-ae14d3cbe501 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:52:29.183143 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-110edbbf-be48-40d6-9d76-ae14d3cbe501 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:52:29.190720 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-110edbbf-be48-40d6-9d76-ae14d3cbe501 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:29.191213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-110edbbf-be48-40d6-9d76-ae14d3cbe501 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:29.191657 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-110edbbf-be48-40d6-9d76-ae14d3cbe501 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:29.192382 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-110edbbf-be48-40d6-9d76-ae14d3cbe501 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:29.192844 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-110edbbf-be48-40d6-9d76-ae14d3cbe501 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:29.193277 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-110edbbf-be48-40d6-9d76-ae14d3cbe501 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:29.195144 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-02c26ce2-cbc5-429a-9fe8-a980855313b0 req-d7dbfb65-3750-4ee4-8fbf-e37acfc6b9ff service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:29.195805 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-02c26ce2-cbc5-429a-9fe8-a980855313b0 req-d7dbfb65-3750-4ee4-8fbf-e37acfc6b9ff service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:29.196478 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-02c26ce2-cbc5-429a-9fe8-a980855313b0 req-d7dbfb65-3750-4ee4-8fbf-e37acfc6b9ff service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:29.208477 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-02c26ce2-cbc5-429a-9fe8-a980855313b0 req-d7dbfb65-3750-4ee4-8fbf-e37acfc6b9ff service nova] Creating event network-changed:5507e9f4-f216-480c-a772-abfda9e3cf80 for instance 6da97855-d04e-4631-a020-40fe0d64bebc on nch2-master-1 Sep 17 21:52:29.214291 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-02c26ce2-cbc5-429a-9fe8-a980855313b0 req-d7dbfb65-3750-4ee4-8fbf-e37acfc6b9ff service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037313 Sep 17 21:52:29.215023 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3470/6846] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:52:29.416984 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-110edbbf-be48-40d6-9d76-ae14d3cbe501 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:52:29.425992 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-110edbbf-be48-40d6-9d76-ae14d3cbe501 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1565 microversion: 2.1 time: 0.247928 Sep 17 21:52:29.426814 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3377/6847] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:52:29 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1565 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:52:52.715122 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:52:52.715904 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=40 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:52:52.720877 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7275e22b-70f2-40eb-b700-018cf0e67920 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:52:52.723293 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7275e22b-70f2-40eb-b700-018cf0e67920 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:52:52.730960 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7275e22b-70f2-40eb-b700-018cf0e67920 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:52.731457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7275e22b-70f2-40eb-b700-018cf0e67920 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:52.731910 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7275e22b-70f2-40eb-b700-018cf0e67920 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:52.732630 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7275e22b-70f2-40eb-b700-018cf0e67920 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:52.733099 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7275e22b-70f2-40eb-b700-018cf0e67920 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:52.733562 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7275e22b-70f2-40eb-b700-018cf0e67920 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:52.790451 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7275e22b-70f2-40eb-b700-018cf0e67920 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "POST /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc/action" status: 200 len: 24567 microversion: 2.1 time: 0.076896 Sep 17 21:52:52.791158 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3471/6848] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:52:52 2022] POST /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc/action => generated 24567 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:52:59.245583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a00edcf2-1f2f-48a1-98e4-ecf2a7a401f8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:52:59.249080 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a00edcf2-1f2f-48a1-98e4-ecf2a7a401f8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:52:59.252886 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=7 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:52:59.253990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=34 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:52:59.255796 ncdv-master-1 devstack@n-api.service[140523]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 17 21:52:59.256068 ncdv-master-1 devstack@n-api.service[140523]: Sat Sep 17 21:52:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc/action (ip 10.222.0.26) !!! Sep 17 21:52:59.267861 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a00edcf2-1f2f-48a1-98e4-ecf2a7a401f8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:59.268350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a00edcf2-1f2f-48a1-98e4-ecf2a7a401f8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:59.268785 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a00edcf2-1f2f-48a1-98e4-ecf2a7a401f8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:59.269486 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a00edcf2-1f2f-48a1-98e4-ecf2a7a401f8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:59.269964 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a00edcf2-1f2f-48a1-98e4-ecf2a7a401f8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:59.270403 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a00edcf2-1f2f-48a1-98e4-ecf2a7a401f8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:59.389031 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a00edcf2-1f2f-48a1-98e4-ecf2a7a401f8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:52:59.398102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a00edcf2-1f2f-48a1-98e4-ecf2a7a401f8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Old instance type m1.heat2, new instance type m1.heat {{(pid=140523) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 17 21:52:59.407920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a00edcf2-1f2f-48a1-98e4-ecf2a7a401f8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:52:59.408349 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a00edcf2-1f2f-48a1-98e4-ecf2a7a401f8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:52:59.408852 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a00edcf2-1f2f-48a1-98e4-ecf2a7a401f8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:52:59.409249 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a00edcf2-1f2f-48a1-98e4-ecf2a7a401f8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:52:59.409718 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a00edcf2-1f2f-48a1-98e4-ecf2a7a401f8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:52:59.482032 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a00edcf2-1f2f-48a1-98e4-ecf2a7a401f8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "POST /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc/action" status: 202 len: 0 microversion: 2.1 time: 0.243270 Sep 17 21:52:59.482625 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3378/6849] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:52:59 2022] POST /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:52:59.491660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-12061036-9745-4caa-8e2e-63db99c6f4a9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:52:59.492385 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-12061036-9745-4caa-8e2e-63db99c6f4a9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:52:59.499721 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12061036-9745-4caa-8e2e-63db99c6f4a9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:59.500237 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12061036-9745-4caa-8e2e-63db99c6f4a9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:59.500720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12061036-9745-4caa-8e2e-63db99c6f4a9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:59.501433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12061036-9745-4caa-8e2e-63db99c6f4a9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:52:59.501912 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12061036-9745-4caa-8e2e-63db99c6f4a9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:52:59.502363 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-12061036-9745-4caa-8e2e-63db99c6f4a9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:52:59.672386 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-12061036-9745-4caa-8e2e-63db99c6f4a9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:52:59.681092 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-12061036-9745-4caa-8e2e-63db99c6f4a9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1693 microversion: 2.1 time: 0.193733 Sep 17 21:52:59.681756 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3472/6850] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:52:59 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1693 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:53:00.708826 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9ea5533f-ef80-4b67-afbf-5fd810ca4634 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:53:00.709598 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9ea5533f-ef80-4b67-afbf-5fd810ca4634 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:53:00.718332 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9ea5533f-ef80-4b67-afbf-5fd810ca4634 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:00.719036 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9ea5533f-ef80-4b67-afbf-5fd810ca4634 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:00.719568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9ea5533f-ef80-4b67-afbf-5fd810ca4634 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:00.720691 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9ea5533f-ef80-4b67-afbf-5fd810ca4634 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:00.721448 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9ea5533f-ef80-4b67-afbf-5fd810ca4634 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:00.722202 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9ea5533f-ef80-4b67-afbf-5fd810ca4634 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:00.860539 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9ea5533f-ef80-4b67-afbf-5fd810ca4634 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:53:00.868916 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9ea5533f-ef80-4b67-afbf-5fd810ca4634 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1693 microversion: 2.1 time: 0.166435 Sep 17 21:53:00.869562 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3379/6851] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:53:00 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1693 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:53:01.897631 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d0ce6ac8-2d7f-4b1f-99d2-0b776ee0bd05 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:53:01.898675 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d0ce6ac8-2d7f-4b1f-99d2-0b776ee0bd05 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:53:01.910134 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d0ce6ac8-2d7f-4b1f-99d2-0b776ee0bd05 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:01.910644 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d0ce6ac8-2d7f-4b1f-99d2-0b776ee0bd05 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:01.911107 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d0ce6ac8-2d7f-4b1f-99d2-0b776ee0bd05 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:01.911823 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d0ce6ac8-2d7f-4b1f-99d2-0b776ee0bd05 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:01.912296 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d0ce6ac8-2d7f-4b1f-99d2-0b776ee0bd05 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:01.912743 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d0ce6ac8-2d7f-4b1f-99d2-0b776ee0bd05 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:02.057420 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d0ce6ac8-2d7f-4b1f-99d2-0b776ee0bd05 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:53:02.070471 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d0ce6ac8-2d7f-4b1f-99d2-0b776ee0bd05 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1698 microversion: 2.1 time: 0.179312 Sep 17 21:53:02.071277 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3473/6852] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:53:01 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1698 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:53:03.102963 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2d922fc8-c3aa-4315-9253-86c67681f3a3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:53:03.103898 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2d922fc8-c3aa-4315-9253-86c67681f3a3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:53:03.115771 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d922fc8-c3aa-4315-9253-86c67681f3a3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:03.116591 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d922fc8-c3aa-4315-9253-86c67681f3a3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:03.117338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d922fc8-c3aa-4315-9253-86c67681f3a3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:03.118579 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d922fc8-c3aa-4315-9253-86c67681f3a3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:03.119360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d922fc8-c3aa-4315-9253-86c67681f3a3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:03.120084 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2d922fc8-c3aa-4315-9253-86c67681f3a3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:03.269102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2d922fc8-c3aa-4315-9253-86c67681f3a3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:53:03.281328 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2d922fc8-c3aa-4315-9253-86c67681f3a3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1698 microversion: 2.1 time: 0.184987 Sep 17 21:53:03.282111 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3380/6853] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:53:03 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1698 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:53:04.309319 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-0aa5b810-ca95-47cb-9318-b84854084b75 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:53:04.310444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-0aa5b810-ca95-47cb-9318-b84854084b75 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:53:04.322395 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0aa5b810-ca95-47cb-9318-b84854084b75 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:04.323233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0aa5b810-ca95-47cb-9318-b84854084b75 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:04.324000 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0aa5b810-ca95-47cb-9318-b84854084b75 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:04.325200 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0aa5b810-ca95-47cb-9318-b84854084b75 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:04.326043 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0aa5b810-ca95-47cb-9318-b84854084b75 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:04.326787 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-0aa5b810-ca95-47cb-9318-b84854084b75 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:04.463288 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-0aa5b810-ca95-47cb-9318-b84854084b75 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:53:04.471634 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-0aa5b810-ca95-47cb-9318-b84854084b75 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1698 microversion: 2.1 time: 0.168991 Sep 17 21:53:04.472226 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3474/6854] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:53:04 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1698 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:53:05.495564 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fc27d978-d125-4113-b409-54937bc73cb3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:53:05.496182 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fc27d978-d125-4113-b409-54937bc73cb3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:53:05.503100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc27d978-d125-4113-b409-54937bc73cb3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:05.503599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc27d978-d125-4113-b409-54937bc73cb3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:05.504040 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc27d978-d125-4113-b409-54937bc73cb3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:05.504773 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc27d978-d125-4113-b409-54937bc73cb3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:05.505229 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc27d978-d125-4113-b409-54937bc73cb3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:05.505702 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc27d978-d125-4113-b409-54937bc73cb3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:05.645187 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fc27d978-d125-4113-b409-54937bc73cb3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:53:05.656759 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fc27d978-d125-4113-b409-54937bc73cb3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1698 microversion: 2.1 time: 0.165194 Sep 17 21:53:05.657550 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3381/6855] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:53:05 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1698 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:53:06.680714 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-760ab222-a7ec-4b5d-b0cb-721b1b4da157 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:53:06.681365 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-760ab222-a7ec-4b5d-b0cb-721b1b4da157 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:53:06.688804 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-760ab222-a7ec-4b5d-b0cb-721b1b4da157 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:06.689324 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-760ab222-a7ec-4b5d-b0cb-721b1b4da157 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:06.689822 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-760ab222-a7ec-4b5d-b0cb-721b1b4da157 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:06.690552 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-760ab222-a7ec-4b5d-b0cb-721b1b4da157 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:06.691004 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-760ab222-a7ec-4b5d-b0cb-721b1b4da157 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:06.691480 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-760ab222-a7ec-4b5d-b0cb-721b1b4da157 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:06.840801 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-760ab222-a7ec-4b5d-b0cb-721b1b4da157 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:53:06.850382 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-760ab222-a7ec-4b5d-b0cb-721b1b4da157 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1698 microversion: 2.1 time: 0.173777 Sep 17 21:53:06.850984 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3475/6856] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:53:06 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1698 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:53:07.878148 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4594332c-931c-4c68-98b5-df077f590538 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:53:07.878787 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4594332c-931c-4c68-98b5-df077f590538 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:53:07.888579 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4594332c-931c-4c68-98b5-df077f590538 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:07.889075 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4594332c-931c-4c68-98b5-df077f590538 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:07.889560 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4594332c-931c-4c68-98b5-df077f590538 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:07.890260 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4594332c-931c-4c68-98b5-df077f590538 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:07.890713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4594332c-931c-4c68-98b5-df077f590538 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:07.891135 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4594332c-931c-4c68-98b5-df077f590538 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:08.038588 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4594332c-931c-4c68-98b5-df077f590538 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:53:08.046791 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4594332c-931c-4c68-98b5-df077f590538 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1698 microversion: 2.1 time: 0.175025 Sep 17 21:53:08.047382 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3382/6857] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:53:07 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1698 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:53:09.071866 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c8be5edd-0124-419b-aa75-5ce1a198f73a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:53:09.072573 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c8be5edd-0124-419b-aa75-5ce1a198f73a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:53:09.082018 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8be5edd-0124-419b-aa75-5ce1a198f73a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:09.082796 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8be5edd-0124-419b-aa75-5ce1a198f73a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:09.083371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8be5edd-0124-419b-aa75-5ce1a198f73a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:09.084266 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8be5edd-0124-419b-aa75-5ce1a198f73a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:09.084894 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8be5edd-0124-419b-aa75-5ce1a198f73a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:09.085449 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c8be5edd-0124-419b-aa75-5ce1a198f73a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:09.224623 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c8be5edd-0124-419b-aa75-5ce1a198f73a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:53:09.232851 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c8be5edd-0124-419b-aa75-5ce1a198f73a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1698 microversion: 2.1 time: 0.166144 Sep 17 21:53:09.233434 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3476/6858] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:53:09 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1698 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:53:10.257894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1ced2758-2d47-4076-9030-4fcb6cfd318b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:53:10.258738 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1ced2758-2d47-4076-9030-4fcb6cfd318b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:53:10.266952 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ced2758-2d47-4076-9030-4fcb6cfd318b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:10.267454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ced2758-2d47-4076-9030-4fcb6cfd318b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:10.267905 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ced2758-2d47-4076-9030-4fcb6cfd318b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:10.268596 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ced2758-2d47-4076-9030-4fcb6cfd318b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:10.269086 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ced2758-2d47-4076-9030-4fcb6cfd318b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:10.269809 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1ced2758-2d47-4076-9030-4fcb6cfd318b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:10.406639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1ced2758-2d47-4076-9030-4fcb6cfd318b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:53:10.418175 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1ced2758-2d47-4076-9030-4fcb6cfd318b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1698 microversion: 2.1 time: 0.164595 Sep 17 21:53:10.419026 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3383/6859] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:53:10 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1698 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:53:11.446598 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-83faaa59-2fbc-432e-bd44-a634a8d064c3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:53:11.447702 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-83faaa59-2fbc-432e-bd44-a634a8d064c3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:53:11.459817 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-83faaa59-2fbc-432e-bd44-a634a8d064c3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:11.460680 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-83faaa59-2fbc-432e-bd44-a634a8d064c3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:11.461499 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-83faaa59-2fbc-432e-bd44-a634a8d064c3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:11.462711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-83faaa59-2fbc-432e-bd44-a634a8d064c3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:11.463514 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-83faaa59-2fbc-432e-bd44-a634a8d064c3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:11.464246 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-83faaa59-2fbc-432e-bd44-a634a8d064c3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:11.614083 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-83faaa59-2fbc-432e-bd44-a634a8d064c3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:53:11.622648 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-83faaa59-2fbc-432e-bd44-a634a8d064c3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1698 microversion: 2.1 time: 0.182733 Sep 17 21:53:11.623235 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3477/6860] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:53:11 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1698 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:53:12.650623 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8f6e5c4f-ebb3-4eaf-8100-f784308ce3ad tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:53:12.651691 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8f6e5c4f-ebb3-4eaf-8100-f784308ce3ad tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:53:12.663646 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8f6e5c4f-ebb3-4eaf-8100-f784308ce3ad tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:12.664509 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8f6e5c4f-ebb3-4eaf-8100-f784308ce3ad tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:12.665238 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8f6e5c4f-ebb3-4eaf-8100-f784308ce3ad tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:12.666601 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8f6e5c4f-ebb3-4eaf-8100-f784308ce3ad tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:12.667476 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8f6e5c4f-ebb3-4eaf-8100-f784308ce3ad tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:12.668249 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8f6e5c4f-ebb3-4eaf-8100-f784308ce3ad tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:12.808113 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8f6e5c4f-ebb3-4eaf-8100-f784308ce3ad tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:53:12.816230 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8f6e5c4f-ebb3-4eaf-8100-f784308ce3ad tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1698 microversion: 2.1 time: 0.172348 Sep 17 21:53:12.816814 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3384/6861] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:53:12 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1698 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:53:13.840760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-391bd346-42db-4016-992c-13f0253ad14e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:53:13.841706 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-391bd346-42db-4016-992c-13f0253ad14e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:53:13.849175 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-391bd346-42db-4016-992c-13f0253ad14e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:13.849723 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-391bd346-42db-4016-992c-13f0253ad14e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:13.850189 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-391bd346-42db-4016-992c-13f0253ad14e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:13.850929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-391bd346-42db-4016-992c-13f0253ad14e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:13.851415 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-391bd346-42db-4016-992c-13f0253ad14e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:13.851869 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-391bd346-42db-4016-992c-13f0253ad14e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:13.933043 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-77b2f044-90db-4a2d-b635-875522bced99 req-b6e16794-ddc5-4da7-ad64-dddb142d6690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6da97855-d04e-4631-a020-40fe0d64bebc", "name": "network-vif-unplugged", "status": "completed", "tag": "5507e9f4-f216-480c-a772-abfda9e3cf80"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:53:13.944245 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-77b2f044-90db-4a2d-b635-875522bced99 req-b6e16794-ddc5-4da7-ad64-dddb142d6690 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:13.944729 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-77b2f044-90db-4a2d-b635-875522bced99 req-b6e16794-ddc5-4da7-ad64-dddb142d6690 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:13.945162 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-77b2f044-90db-4a2d-b635-875522bced99 req-b6e16794-ddc5-4da7-ad64-dddb142d6690 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:13.958688 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-77b2f044-90db-4a2d-b635-875522bced99 req-b6e16794-ddc5-4da7-ad64-dddb142d6690 service nova] Creating event network-vif-unplugged:5507e9f4-f216-480c-a772-abfda9e3cf80 for instance 6da97855-d04e-4631-a020-40fe0d64bebc on nch1-master-1 Sep 17 21:53:13.964882 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [req-77b2f044-90db-4a2d-b635-875522bced99 req-b6e16794-ddc5-4da7-ad64-dddb142d6690 service nova] Instance 6da97855-d04e-4631-a020-40fe0d64bebc is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140523) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 21:53:13.976824 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-77b2f044-90db-4a2d-b635-875522bced99 req-b6e16794-ddc5-4da7-ad64-dddb142d6690 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047978 Sep 17 21:53:13.977652 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3385/6862] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:53:13.996243 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-391bd346-42db-4016-992c-13f0253ad14e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:53:14.004913 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-391bd346-42db-4016-992c-13f0253ad14e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1697 microversion: 2.1 time: 0.168341 Sep 17 21:53:14.005553 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3478/6863] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:53:13 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1697 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:53:15.031634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-70d3c468-a80b-46a5-ab3f-0a06058eb64b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:53:15.032383 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-70d3c468-a80b-46a5-ab3f-0a06058eb64b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:53:15.039500 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-70d3c468-a80b-46a5-ab3f-0a06058eb64b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:15.039994 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-70d3c468-a80b-46a5-ab3f-0a06058eb64b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:15.040636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-70d3c468-a80b-46a5-ab3f-0a06058eb64b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:15.041418 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-70d3c468-a80b-46a5-ab3f-0a06058eb64b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:15.041924 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-70d3c468-a80b-46a5-ab3f-0a06058eb64b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:15.042348 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-70d3c468-a80b-46a5-ab3f-0a06058eb64b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:15.178194 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-70d3c468-a80b-46a5-ab3f-0a06058eb64b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:53:15.186531 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-70d3c468-a80b-46a5-ab3f-0a06058eb64b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1697 microversion: 2.1 time: 0.160355 Sep 17 21:53:15.187116 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3386/6864] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:53:15 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:53:16.000725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-33d98d53-8c49-4bc1-9a5d-17011e5f17ad req-c26a84f8-a52f-4119-828d-57bbbd902272 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6da97855-d04e-4631-a020-40fe0d64bebc", "tag": "5507e9f4-f216-480c-a772-abfda9e3cf80"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:53:16.013092 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-33d98d53-8c49-4bc1-9a5d-17011e5f17ad req-c26a84f8-a52f-4119-828d-57bbbd902272 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:16.013611 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-33d98d53-8c49-4bc1-9a5d-17011e5f17ad req-c26a84f8-a52f-4119-828d-57bbbd902272 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:16.014064 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-33d98d53-8c49-4bc1-9a5d-17011e5f17ad req-c26a84f8-a52f-4119-828d-57bbbd902272 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:16.026962 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-33d98d53-8c49-4bc1-9a5d-17011e5f17ad req-c26a84f8-a52f-4119-828d-57bbbd902272 service nova] Creating event network-changed:5507e9f4-f216-480c-a772-abfda9e3cf80 for instance 6da97855-d04e-4631-a020-40fe0d64bebc on nch1-master-1 Sep 17 21:53:16.032680 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [req-33d98d53-8c49-4bc1-9a5d-17011e5f17ad req-c26a84f8-a52f-4119-828d-57bbbd902272 service nova] Instance 6da97855-d04e-4631-a020-40fe0d64bebc is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=140524) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 17 21:53:16.043842 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-33d98d53-8c49-4bc1-9a5d-17011e5f17ad req-c26a84f8-a52f-4119-828d-57bbbd902272 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049892 Sep 17 21:53:16.044456 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3479/6865] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:53:16.210971 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-87482fa3-0011-4983-b8ed-21a954572d46 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:53:16.211934 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-87482fa3-0011-4983-b8ed-21a954572d46 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:53:16.219017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87482fa3-0011-4983-b8ed-21a954572d46 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:16.219581 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87482fa3-0011-4983-b8ed-21a954572d46 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:16.220112 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87482fa3-0011-4983-b8ed-21a954572d46 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:16.220878 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87482fa3-0011-4983-b8ed-21a954572d46 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:16.221607 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87482fa3-0011-4983-b8ed-21a954572d46 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:16.222203 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87482fa3-0011-4983-b8ed-21a954572d46 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:16.421229 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-87482fa3-0011-4983-b8ed-21a954572d46 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:53:16.434551 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-87482fa3-0011-4983-b8ed-21a954572d46 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1695 microversion: 2.1 time: 0.227299 Sep 17 21:53:16.435163 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3387/6866] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:53:16 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1695 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:53:17.461417 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3c722bfc-584c-4007-ab96-eb74ac36feef tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:53:17.462175 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3c722bfc-584c-4007-ab96-eb74ac36feef tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:53:17.468974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c722bfc-584c-4007-ab96-eb74ac36feef tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:17.469510 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c722bfc-584c-4007-ab96-eb74ac36feef tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:17.469982 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c722bfc-584c-4007-ab96-eb74ac36feef tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:17.470707 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c722bfc-584c-4007-ab96-eb74ac36feef tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:17.471192 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c722bfc-584c-4007-ab96-eb74ac36feef tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:17.471641 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3c722bfc-584c-4007-ab96-eb74ac36feef tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:17.607054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3c722bfc-584c-4007-ab96-eb74ac36feef tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:53:17.615383 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3c722bfc-584c-4007-ab96-eb74ac36feef tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1692 microversion: 2.1 time: 0.159333 Sep 17 21:53:17.615976 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3480/6867] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:53:17 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:53:17.638275 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d2b2c67f-2459-46bf-a21e-09f854ef8201 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:53:17.638864 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d2b2c67f-2459-46bf-a21e-09f854ef8201 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:53:17.646024 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2b2c67f-2459-46bf-a21e-09f854ef8201 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:17.646557 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2b2c67f-2459-46bf-a21e-09f854ef8201 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:17.646989 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2b2c67f-2459-46bf-a21e-09f854ef8201 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:17.647712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2b2c67f-2459-46bf-a21e-09f854ef8201 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:17.648169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2b2c67f-2459-46bf-a21e-09f854ef8201 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:17.648599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d2b2c67f-2459-46bf-a21e-09f854ef8201 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:17.709024 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d2b2c67f-2459-46bf-a21e-09f854ef8201 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "POST /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc/action" status: 204 len: 0 microversion: 2.1 time: 0.074407 Sep 17 21:53:17.709720 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3388/6868] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:53:17 2022] POST /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:53:17.718864 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ceffdc9a-7626-4840-a4a6-f8a4dac43cad tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:53:17.719581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ceffdc9a-7626-4840-a4a6-f8a4dac43cad tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:53:17.726303 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ceffdc9a-7626-4840-a4a6-f8a4dac43cad tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:17.726788 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ceffdc9a-7626-4840-a4a6-f8a4dac43cad tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:17.727280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ceffdc9a-7626-4840-a4a6-f8a4dac43cad tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:17.728161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ceffdc9a-7626-4840-a4a6-f8a4dac43cad tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:17.728638 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ceffdc9a-7626-4840-a4a6-f8a4dac43cad tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:17.729770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ceffdc9a-7626-4840-a4a6-f8a4dac43cad tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:17.947979 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ceffdc9a-7626-4840-a4a6-f8a4dac43cad tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:53:17.959087 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ceffdc9a-7626-4840-a4a6-f8a4dac43cad tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1692 microversion: 2.1 time: 0.244726 Sep 17 21:53:17.959810 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3481/6869] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:53:17 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1692 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:53:17.983333 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dee877f1-9dd8-4b53-a46c-bff501d6ab7c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:53:17.984041 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dee877f1-9dd8-4b53-a46c-bff501d6ab7c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:53:17.991661 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dee877f1-9dd8-4b53-a46c-bff501d6ab7c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:17.992484 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dee877f1-9dd8-4b53-a46c-bff501d6ab7c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:17.993137 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dee877f1-9dd8-4b53-a46c-bff501d6ab7c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:17.994433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dee877f1-9dd8-4b53-a46c-bff501d6ab7c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:17.994900 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dee877f1-9dd8-4b53-a46c-bff501d6ab7c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:17.995350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dee877f1-9dd8-4b53-a46c-bff501d6ab7c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:18.199403 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dee877f1-9dd8-4b53-a46c-bff501d6ab7c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:53:18.207927 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dee877f1-9dd8-4b53-a46c-bff501d6ab7c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1692 microversion: 2.1 time: 0.228989 Sep 17 21:53:18.208510 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3389/6870] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:53:17 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1692 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:53:19.210842 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-1dabff45-96c3-4371-9341-77db5eb5b46c req-51ae1dfd-b038-4957-9a83-99f9038ff609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6da97855-d04e-4631-a020-40fe0d64bebc", "name": "network-vif-plugged", "status": "completed", "tag": "5507e9f4-f216-480c-a772-abfda9e3cf80"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:53:19.221747 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-1dabff45-96c3-4371-9341-77db5eb5b46c req-51ae1dfd-b038-4957-9a83-99f9038ff609 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:19.222819 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-1dabff45-96c3-4371-9341-77db5eb5b46c req-51ae1dfd-b038-4957-9a83-99f9038ff609 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:19.223280 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-1dabff45-96c3-4371-9341-77db5eb5b46c req-51ae1dfd-b038-4957-9a83-99f9038ff609 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:19.231906 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-67cea060-316f-4a1e-9fb1-d287997499f7 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:53:19.232617 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-67cea060-316f-4a1e-9fb1-d287997499f7 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:53:19.235192 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-1dabff45-96c3-4371-9341-77db5eb5b46c req-51ae1dfd-b038-4957-9a83-99f9038ff609 service nova] Creating event network-vif-plugged:5507e9f4-f216-480c-a772-abfda9e3cf80 for instance 6da97855-d04e-4631-a020-40fe0d64bebc on nch1-master-1 Sep 17 21:53:19.240639 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-1dabff45-96c3-4371-9341-77db5eb5b46c req-51ae1dfd-b038-4957-9a83-99f9038ff609 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035172 Sep 17 21:53:19.240830 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67cea060-316f-4a1e-9fb1-d287997499f7 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:19.241318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67cea060-316f-4a1e-9fb1-d287997499f7 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:19.241747 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3482/6871] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:53:19.241974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67cea060-316f-4a1e-9fb1-d287997499f7 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:19.242753 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67cea060-316f-4a1e-9fb1-d287997499f7 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:19.243222 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67cea060-316f-4a1e-9fb1-d287997499f7 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:19.243702 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-67cea060-316f-4a1e-9fb1-d287997499f7 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:19.388715 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-67cea060-316f-4a1e-9fb1-d287997499f7 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:53:19.396881 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-67cea060-316f-4a1e-9fb1-d287997499f7 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1684 microversion: 2.1 time: 0.168967 Sep 17 21:53:19.397515 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3390/6872] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:53:19 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:53:41.631705 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=24 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:53:41.632647 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=64 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:53:41.637350 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2bbae659-0c27-4724-9f44-f59c69abfb36 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:53:41.639735 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2bbae659-0c27-4724-9f44-f59c69abfb36 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:53:41.647086 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2bbae659-0c27-4724-9f44-f59c69abfb36 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:41.647602 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2bbae659-0c27-4724-9f44-f59c69abfb36 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:41.648067 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2bbae659-0c27-4724-9f44-f59c69abfb36 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:41.648763 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2bbae659-0c27-4724-9f44-f59c69abfb36 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:41.649277 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2bbae659-0c27-4724-9f44-f59c69abfb36 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:41.649773 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2bbae659-0c27-4724-9f44-f59c69abfb36 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:41.702818 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2bbae659-0c27-4724-9f44-f59c69abfb36 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "POST /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc/action" status: 200 len: 24579 microversion: 2.1 time: 0.074392 Sep 17 21:53:41.703858 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3483/6873] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:53:41 2022] POST /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc/action => generated 24579 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:53:49.039757 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cb7b781b-c2fe-4922-92ea-ef480c74c283 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:53:49.040362 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cb7b781b-c2fe-4922-92ea-ef480c74c283 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:53:49.046238 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-178a36ff-43e4-4e47-85c4-40949aa4f39e req-27db1169-9b20-413e-81db-a5d0cb743c7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6da97855-d04e-4631-a020-40fe0d64bebc", "tag": "5507e9f4-f216-480c-a772-abfda9e3cf80"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:53:49.053160 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=30 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:53:49.053968 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:53:49.058376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb7b781b-c2fe-4922-92ea-ef480c74c283 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:49.058880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb7b781b-c2fe-4922-92ea-ef480c74c283 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:49.059349 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb7b781b-c2fe-4922-92ea-ef480c74c283 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:49.059703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-178a36ff-43e4-4e47-85c4-40949aa4f39e req-27db1169-9b20-413e-81db-a5d0cb743c7c service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:49.060217 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-178a36ff-43e4-4e47-85c4-40949aa4f39e req-27db1169-9b20-413e-81db-a5d0cb743c7c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:49.060357 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb7b781b-c2fe-4922-92ea-ef480c74c283 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:49.060674 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-178a36ff-43e4-4e47-85c4-40949aa4f39e req-27db1169-9b20-413e-81db-a5d0cb743c7c service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:49.060800 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb7b781b-c2fe-4922-92ea-ef480c74c283 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:49.061152 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cb7b781b-c2fe-4922-92ea-ef480c74c283 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:49.074816 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-178a36ff-43e4-4e47-85c4-40949aa4f39e req-27db1169-9b20-413e-81db-a5d0cb743c7c service nova] Creating event network-changed:5507e9f4-f216-480c-a772-abfda9e3cf80 for instance 6da97855-d04e-4631-a020-40fe0d64bebc on nch1-master-1 Sep 17 21:53:49.080403 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-178a36ff-43e4-4e47-85c4-40949aa4f39e req-27db1169-9b20-413e-81db-a5d0cb743c7c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038297 Sep 17 21:53:49.081030 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3484/6874] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:53:49.092863 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cb7b781b-c2fe-4922-92ea-ef480c74c283 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:53:49.181287 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cb7b781b-c2fe-4922-92ea-ef480c74c283 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 204 len: 0 microversion: 2.1 time: 0.145397 Sep 17 21:53:49.182265 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3391/6875] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:53:49 2022] DELETE /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 17 21:53:49.193386 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ef14397f-18b2-45a9-8f5a-6d9317ea6c7d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:53:49.194999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ef14397f-18b2-45a9-8f5a-6d9317ea6c7d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:53:49.203622 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef14397f-18b2-45a9-8f5a-6d9317ea6c7d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:49.205235 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef14397f-18b2-45a9-8f5a-6d9317ea6c7d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:49.205839 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef14397f-18b2-45a9-8f5a-6d9317ea6c7d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:49.206912 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef14397f-18b2-45a9-8f5a-6d9317ea6c7d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:49.208119 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef14397f-18b2-45a9-8f5a-6d9317ea6c7d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:49.208828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef14397f-18b2-45a9-8f5a-6d9317ea6c7d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:49.358357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ef14397f-18b2-45a9-8f5a-6d9317ea6c7d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:53:49.366970 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ef14397f-18b2-45a9-8f5a-6d9317ea6c7d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1690 microversion: 2.1 time: 0.179626 Sep 17 21:53:49.367672 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3485/6876] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:53:49 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1690 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:53:50.392294 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e8838aa6-b40e-4937-a49c-96c204e7a4d8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:53:50.393002 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e8838aa6-b40e-4937-a49c-96c204e7a4d8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:53:50.400388 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8838aa6-b40e-4937-a49c-96c204e7a4d8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:50.400887 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8838aa6-b40e-4937-a49c-96c204e7a4d8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:50.401321 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8838aa6-b40e-4937-a49c-96c204e7a4d8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:50.402065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8838aa6-b40e-4937-a49c-96c204e7a4d8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:50.402518 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8838aa6-b40e-4937-a49c-96c204e7a4d8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:50.402949 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e8838aa6-b40e-4937-a49c-96c204e7a4d8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:50.538256 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e8838aa6-b40e-4937-a49c-96c204e7a4d8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:53:50.547129 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e8838aa6-b40e-4937-a49c-96c204e7a4d8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1690 microversion: 2.1 time: 0.159178 Sep 17 21:53:50.547728 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3392/6877] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:53:50 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:53:51.118483 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-f76bfce7-6404-463e-8051-e89a643cb8f4 req-e16afc92-58e7-4143-90c9-458c1c02d31e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6da97855-d04e-4631-a020-40fe0d64bebc", "name": "network-vif-deleted", "tag": "5507e9f4-f216-480c-a772-abfda9e3cf80"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:53:51.129129 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f76bfce7-6404-463e-8051-e89a643cb8f4 req-e16afc92-58e7-4143-90c9-458c1c02d31e service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:51.129757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f76bfce7-6404-463e-8051-e89a643cb8f4 req-e16afc92-58e7-4143-90c9-458c1c02d31e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:51.130211 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f76bfce7-6404-463e-8051-e89a643cb8f4 req-e16afc92-58e7-4143-90c9-458c1c02d31e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:51.142457 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-f76bfce7-6404-463e-8051-e89a643cb8f4 req-e16afc92-58e7-4143-90c9-458c1c02d31e service nova] Creating event network-vif-deleted:5507e9f4-f216-480c-a772-abfda9e3cf80 for instance 6da97855-d04e-4631-a020-40fe0d64bebc on nch1-master-1 Sep 17 21:53:51.147498 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-f76bfce7-6404-463e-8051-e89a643cb8f4 req-e16afc92-58e7-4143-90c9-458c1c02d31e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033044 Sep 17 21:53:51.148207 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3486/6878] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:53:51.572647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-375f0ee3-d737-4f77-a990-e3b812cfd4f9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:53:51.573251 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-375f0ee3-d737-4f77-a990-e3b812cfd4f9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:53:51.581019 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-375f0ee3-d737-4f77-a990-e3b812cfd4f9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:51.581523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-375f0ee3-d737-4f77-a990-e3b812cfd4f9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:51.581983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-375f0ee3-d737-4f77-a990-e3b812cfd4f9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:51.582691 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-375f0ee3-d737-4f77-a990-e3b812cfd4f9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:51.583179 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-375f0ee3-d737-4f77-a990-e3b812cfd4f9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:51.583596 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-375f0ee3-d737-4f77-a990-e3b812cfd4f9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:51.617178 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-375f0ee3-d737-4f77-a990-e3b812cfd4f9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:51.617714 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-375f0ee3-d737-4f77-a990-e3b812cfd4f9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:51.618149 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-375f0ee3-d737-4f77-a990-e3b812cfd4f9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:51.618632 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-375f0ee3-d737-4f77-a990-e3b812cfd4f9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lazy-loading 'fault' on Instance uuid 6da97855-d04e-4631-a020-40fe0d64bebc {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:53:51.666602 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-375f0ee3-d737-4f77-a990-e3b812cfd4f9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:53:51.674525 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-375f0ee3-d737-4f77-a990-e3b812cfd4f9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 200 len: 1356 microversion: 2.1 time: 0.105901 Sep 17 21:53:51.675120 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3393/6879] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:53:51 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 1356 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:53:52.702017 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d544d342-46b8-4336-b1dd-eb2caf225866 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:53:52.702816 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d544d342-46b8-4336-b1dd-eb2caf225866 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 6da97855-d04e-4631-a020-40fe0d64bebc] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:53:52.710697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d544d342-46b8-4336-b1dd-eb2caf225866 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:52.711211 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d544d342-46b8-4336-b1dd-eb2caf225866 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:52.711673 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d544d342-46b8-4336-b1dd-eb2caf225866 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:52.712400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d544d342-46b8-4336-b1dd-eb2caf225866 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:53:52.712881 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d544d342-46b8-4336-b1dd-eb2caf225866 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:53:52.713330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d544d342-46b8-4336-b1dd-eb2caf225866 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:53:52.727606 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-d544d342-46b8-4336-b1dd-eb2caf225866 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] HTTP exception thrown: Instance 6da97855-d04e-4631-a020-40fe0d64bebc could not be found. Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d544d342-46b8-4336-b1dd-eb2caf225866 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Request method failure captured: Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc HTTP/1.1 Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJkDaqrUqQ4R3Jc50dHjJrzHY0H6R9FbsHaifiKAhdbafUbvetKkTsAeXQ-XLllwkBW4TMkyFoTdjx6sRrhd61AW2D-lOJ5jM-lciJMsVlu69fHeXBQVZJqH7yfr66d0yPaxTtnH5N_36Tfpt2dvCfwMBCGXmn8-CxBhA65JgC1h0P9o Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 88a7205c02914d428fd0d43b7fa61fe9 Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1937454944 Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/88a7205c02914d428fd0d43b7fa61fe9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/88a7205c02914d428fd0d43b7fa61fe9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/88a7205c02914d428fd0d43b7fa61fe9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_88a7205c02914d428fd0d43b7fa61fe9", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1937454944 Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 88a7205c02914d428fd0d43b7fa61fe9 Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1937454944 Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-TestNetworkAdvancedServerOps-1937454944-project Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: ac0fa1f4eeca4d5e822b603953471c73 Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1937454944-project Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 6da97855-d04e-4631-a020-40fe0d64bebc could not be found. Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '6da97855-d04e-4631-a020-40fe0d64bebc'} Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6da97855-d04e-4631-a020-40fe0d64bebc could not be found. Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6da97855-d04e-4631-a020-40fe0d64bebc could not be found. Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:53:52.729337 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:53:52.735019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:53:52.735019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:53:52.735019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:53:52.735019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:53:52.735019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:53:52.735019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:53:52.735019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6da97855-d04e-4631-a020-40fe0d64bebc could not be found. Sep 17 21:53:52.735019 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 21:53:52.735019 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d544d342-46b8-4336-b1dd-eb2caf225866 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Returning 404 to user: Instance 6da97855-d04e-4631-a020-40fe0d64bebc could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:53:52.735019 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d544d342-46b8-4336-b1dd-eb2caf225866 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc" status: 404 len: 111 microversion: 2.1 time: 0.034860 Sep 17 21:53:52.735019 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3487/6880] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:53:52 2022] GET /compute/v2.1/servers/6da97855-d04e-4631-a020-40fe0d64bebc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:53:56.114768 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4d6c9f62-4abe-4abe-bbb5-296efc4ffaac tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '.version_select at 0x7f25a5773dc0>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:53:56.138792 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4d6c9f62-4abe-4abe-bbb5-296efc4ffaac tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-343753316" status: 202 len: 0 microversion: 2.1 time: 0.027760 Sep 17 21:53:56.139735 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3394/6881] 10.222.0.26 () {58 vars in 1281 bytes} [Sat Sep 17 21:53:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-343753316 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:53:56.167830 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9b61ab90-4da0-4362-9529-fd71904c0f3c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Action: 'create', calling method: .version_select at 0x7f259fea41f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2045594078", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5HV6e3nzlnfbn/o5Fin9QlRpDESsEoHe1Me/if1VSrvWUXzexZDgrjqCTvykahEUKhtrIHtgvE/NA5r9uCUmosaobgMWNkwYtxP/8xINFweBYCbhbQUowCledkLMw0bQ=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:53:56.185649 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-9b61ab90-4da0-4362-9529-fd71904c0f3c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Getting quotas for project 88a7205c02914d428fd0d43b7fa61fe9. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:53:56.190911 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-9b61ab90-4da0-4362-9529-fd71904c0f3c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Getting quotas for user ac0fa1f4eeca4d5e822b603953471c73 and project 88a7205c02914d428fd0d43b7fa61fe9. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:53:56.218502 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9b61ab90-4da0-4362-9529-fd71904c0f3c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.054587 Sep 17 21:53:56.219215 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3488/6882] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:53:56 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:54:01.935350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:54:01.940416 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0dd7c56f-97fa-42b1-9b30-f2d483e30292 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-960367090", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "a57a2f78-7e67-4405-8bf8-9c5683a2bd98"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2045594078", "security_groups": [{"name": "tempest-secgroup-smoke-385363968"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:54:02.232010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-0dd7c56f-97fa-42b1-9b30-f2d483e30292 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] validate_networks() for [('a57a2f78-7e67-4405-8bf8-9c5683a2bd98', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:54:03.007491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-0dd7c56f-97fa-42b1-9b30-f2d483e30292 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:54:03.008141 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-0dd7c56f-97fa-42b1-9b30-f2d483e30292 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:54:03.008644 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-0dd7c56f-97fa-42b1-9b30-f2d483e30292 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:54:03.009117 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-0dd7c56f-97fa-42b1-9b30-f2d483e30292 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:54:03.009843 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-0dd7c56f-97fa-42b1-9b30-f2d483e30292 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:54:03.020905 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0dd7c56f-97fa-42b1-9b30-f2d483e30292 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:03.021800 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0dd7c56f-97fa-42b1-9b30-f2d483e30292 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:03.022559 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0dd7c56f-97fa-42b1-9b30-f2d483e30292 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:03.023620 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0dd7c56f-97fa-42b1-9b30-f2d483e30292 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:03.024209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0dd7c56f-97fa-42b1-9b30-f2d483e30292 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:03.024763 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0dd7c56f-97fa-42b1-9b30-f2d483e30292 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:03.048165 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-0dd7c56f-97fa-42b1-9b30-f2d483e30292 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Getting quotas for project 88a7205c02914d428fd0d43b7fa61fe9. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:54:03.053943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-0dd7c56f-97fa-42b1-9b30-f2d483e30292 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Getting quotas for user ac0fa1f4eeca4d5e822b603953471c73 and project 88a7205c02914d428fd0d43b7fa61fe9. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:54:03.068170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0dd7c56f-97fa-42b1-9b30-f2d483e30292 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:54:03.070682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0dd7c56f-97fa-42b1-9b30-f2d483e30292 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:54:03.133878 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0dd7c56f-97fa-42b1-9b30-f2d483e30292 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.195310 Sep 17 21:54:03.135910 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3395/6883] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:54:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 1202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:54:03.147776 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-531f3367-fc16-4aec-b763-f2d74c7ca9f6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:54:03.150056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-531f3367-fc16-4aec-b763-f2d74c7ca9f6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:54:03.154316 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=16 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:54:03.274714 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-531f3367-fc16-4aec-b763-f2d74c7ca9f6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:54:03.282681 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-531f3367-fc16-4aec-b763-f2d74c7ca9f6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be" status: 200 len: 1266 microversion: 2.1 time: 0.139629 Sep 17 21:54:03.283410 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3489/6884] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:54:03 2022] GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:54:04.307547 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-55dd5cbb-31e5-46a3-833d-4adae37584d8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:54:04.308426 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-55dd5cbb-31e5-46a3-833d-4adae37584d8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:54:04.320679 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55dd5cbb-31e5-46a3-833d-4adae37584d8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:04.322298 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55dd5cbb-31e5-46a3-833d-4adae37584d8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:04.322662 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55dd5cbb-31e5-46a3-833d-4adae37584d8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:04.323401 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55dd5cbb-31e5-46a3-833d-4adae37584d8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:04.323882 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55dd5cbb-31e5-46a3-833d-4adae37584d8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:04.324431 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-55dd5cbb-31e5-46a3-833d-4adae37584d8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:04.414350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-55dd5cbb-31e5-46a3-833d-4adae37584d8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:54:04.423170 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-55dd5cbb-31e5-46a3-833d-4adae37584d8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be" status: 200 len: 1336 microversion: 2.1 time: 0.120720 Sep 17 21:54:04.424127 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3396/6885] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:54:04 2022] GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be => generated 1336 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:54:05.456982 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-713c4c77-3df7-4440-a47a-a06687ba628c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:54:05.457631 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-713c4c77-3df7-4440-a47a-a06687ba628c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:54:05.466248 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-713c4c77-3df7-4440-a47a-a06687ba628c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:05.466786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-713c4c77-3df7-4440-a47a-a06687ba628c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:05.467253 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-713c4c77-3df7-4440-a47a-a06687ba628c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:05.468018 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-713c4c77-3df7-4440-a47a-a06687ba628c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:05.468500 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-713c4c77-3df7-4440-a47a-a06687ba628c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:05.468954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-713c4c77-3df7-4440-a47a-a06687ba628c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:05.702666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-713c4c77-3df7-4440-a47a-a06687ba628c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:54:05.711402 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-713c4c77-3df7-4440-a47a-a06687ba628c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be" status: 200 len: 1391 microversion: 2.1 time: 0.258855 Sep 17 21:54:05.712009 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3490/6886] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:54:05 2022] GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be => generated 1391 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:54:05.852439 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-2e73fbee-6d8c-4235-9168-38728c01a3f7 req-0860e2c8-8745-4502-8e8d-4291318a4088 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99c50af6-5fce-4e3f-b912-433e8673a5be", "tag": "79f29670-6842-44f9-8496-b611dcec74c7"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:54:05.865647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2e73fbee-6d8c-4235-9168-38728c01a3f7 req-0860e2c8-8745-4502-8e8d-4291318a4088 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:05.866252 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2e73fbee-6d8c-4235-9168-38728c01a3f7 req-0860e2c8-8745-4502-8e8d-4291318a4088 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:05.866749 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-2e73fbee-6d8c-4235-9168-38728c01a3f7 req-0860e2c8-8745-4502-8e8d-4291318a4088 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:05.883837 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-2e73fbee-6d8c-4235-9168-38728c01a3f7 req-0860e2c8-8745-4502-8e8d-4291318a4088 service nova] Creating event network-changed:79f29670-6842-44f9-8496-b611dcec74c7 for instance 99c50af6-5fce-4e3f-b912-433e8673a5be on nch2-master-1 Sep 17 21:54:05.891279 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-2e73fbee-6d8c-4235-9168-38728c01a3f7 req-0860e2c8-8745-4502-8e8d-4291318a4088 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042706 Sep 17 21:54:05.892837 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3397/6887] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:54:06.736603 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-146c12d1-38c3-475b-91de-0ea0c576a937 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:54:06.737376 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-146c12d1-38c3-475b-91de-0ea0c576a937 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:54:06.744923 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-146c12d1-38c3-475b-91de-0ea0c576a937 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:06.745434 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-146c12d1-38c3-475b-91de-0ea0c576a937 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:06.745928 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-146c12d1-38c3-475b-91de-0ea0c576a937 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:06.746655 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-146c12d1-38c3-475b-91de-0ea0c576a937 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:06.747129 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-146c12d1-38c3-475b-91de-0ea0c576a937 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:06.747580 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-146c12d1-38c3-475b-91de-0ea0c576a937 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:06.890896 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-146c12d1-38c3-475b-91de-0ea0c576a937 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:54:06.899100 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-146c12d1-38c3-475b-91de-0ea0c576a937 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be" status: 200 len: 1391 microversion: 2.1 time: 0.166675 Sep 17 21:54:06.899708 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3491/6888] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:54:06 2022] GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:54:07.923776 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-aa560fb0-fe99-47de-aae9-ad8f0312a634 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:54:07.924497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-aa560fb0-fe99-47de-aae9-ad8f0312a634 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:54:07.931681 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa560fb0-fe99-47de-aae9-ad8f0312a634 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:07.932177 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa560fb0-fe99-47de-aae9-ad8f0312a634 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:07.932629 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa560fb0-fe99-47de-aae9-ad8f0312a634 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:07.933334 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa560fb0-fe99-47de-aae9-ad8f0312a634 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:07.933854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa560fb0-fe99-47de-aae9-ad8f0312a634 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:07.934292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aa560fb0-fe99-47de-aae9-ad8f0312a634 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:08.073696 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-aa560fb0-fe99-47de-aae9-ad8f0312a634 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:54:08.082147 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-aa560fb0-fe99-47de-aae9-ad8f0312a634 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be" status: 200 len: 1391 microversion: 2.1 time: 0.164078 Sep 17 21:54:08.082740 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3398/6889] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:54:07 2022] GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:54:09.105828 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-21f6e46e-efb5-4e35-989e-746a3fb4e1a0 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:54:09.106422 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-21f6e46e-efb5-4e35-989e-746a3fb4e1a0 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:54:09.114477 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-21f6e46e-efb5-4e35-989e-746a3fb4e1a0 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:09.114988 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-21f6e46e-efb5-4e35-989e-746a3fb4e1a0 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:09.115448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-21f6e46e-efb5-4e35-989e-746a3fb4e1a0 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:09.116384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-21f6e46e-efb5-4e35-989e-746a3fb4e1a0 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:09.116862 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-21f6e46e-efb5-4e35-989e-746a3fb4e1a0 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:09.117323 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-21f6e46e-efb5-4e35-989e-746a3fb4e1a0 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:09.270755 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-21f6e46e-efb5-4e35-989e-746a3fb4e1a0 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:54:09.280415 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-21f6e46e-efb5-4e35-989e-746a3fb4e1a0 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be" status: 200 len: 1391 microversion: 2.1 time: 0.178668 Sep 17 21:54:09.281118 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3492/6890] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:54:09 2022] GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be => generated 1391 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:54:10.307764 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d128dcb8-db23-4dc1-962d-436e6da6c52a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:54:10.308774 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d128dcb8-db23-4dc1-962d-436e6da6c52a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:54:10.320249 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d128dcb8-db23-4dc1-962d-436e6da6c52a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:10.320669 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d128dcb8-db23-4dc1-962d-436e6da6c52a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:10.321132 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d128dcb8-db23-4dc1-962d-436e6da6c52a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:10.321836 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d128dcb8-db23-4dc1-962d-436e6da6c52a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:10.322292 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d128dcb8-db23-4dc1-962d-436e6da6c52a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:10.322720 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d128dcb8-db23-4dc1-962d-436e6da6c52a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:10.468427 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d128dcb8-db23-4dc1-962d-436e6da6c52a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:54:10.478320 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d128dcb8-db23-4dc1-962d-436e6da6c52a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be" status: 200 len: 1391 microversion: 2.1 time: 0.177278 Sep 17 21:54:10.478905 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3399/6891] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:54:10 2022] GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be => generated 1391 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:54:11.505735 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-85eb23da-7824-4acd-98d8-ef531bc67a34 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:54:11.506798 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-85eb23da-7824-4acd-98d8-ef531bc67a34 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:54:11.518646 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85eb23da-7824-4acd-98d8-ef531bc67a34 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:11.519516 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85eb23da-7824-4acd-98d8-ef531bc67a34 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:11.520233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85eb23da-7824-4acd-98d8-ef531bc67a34 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:11.521394 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85eb23da-7824-4acd-98d8-ef531bc67a34 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:11.522422 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85eb23da-7824-4acd-98d8-ef531bc67a34 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:11.522913 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-85eb23da-7824-4acd-98d8-ef531bc67a34 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:11.661987 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-85eb23da-7824-4acd-98d8-ef531bc67a34 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:54:11.670320 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-85eb23da-7824-4acd-98d8-ef531bc67a34 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be" status: 200 len: 1391 microversion: 2.1 time: 0.171252 Sep 17 21:54:11.671085 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3493/6892] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:54:11 2022] GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:54:11.711951 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-209ed35c-9067-4b5d-bb25-aa56e9653a06 req-d9c992f1-8579-4f01-84f3-294362fb7b5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c50af6-5fce-4e3f-b912-433e8673a5be", "name": "network-vif-plugged", "status": "completed", "tag": "79f29670-6842-44f9-8496-b611dcec74c7"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:54:11.722599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-209ed35c-9067-4b5d-bb25-aa56e9653a06 req-d9c992f1-8579-4f01-84f3-294362fb7b5d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:11.723102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-209ed35c-9067-4b5d-bb25-aa56e9653a06 req-d9c992f1-8579-4f01-84f3-294362fb7b5d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:11.723546 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-209ed35c-9067-4b5d-bb25-aa56e9653a06 req-d9c992f1-8579-4f01-84f3-294362fb7b5d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:11.736432 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-209ed35c-9067-4b5d-bb25-aa56e9653a06 req-d9c992f1-8579-4f01-84f3-294362fb7b5d service nova] Creating event network-vif-plugged:79f29670-6842-44f9-8496-b611dcec74c7 for instance 99c50af6-5fce-4e3f-b912-433e8673a5be on nch2-master-1 Sep 17 21:54:11.742374 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-209ed35c-9067-4b5d-bb25-aa56e9653a06 req-d9c992f1-8579-4f01-84f3-294362fb7b5d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034668 Sep 17 21:54:11.743007 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3400/6893] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:54:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:54:12.694601 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6c90583f-c8f3-4e5c-a54e-420fb274d016 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:54:12.695324 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6c90583f-c8f3-4e5c-a54e-420fb274d016 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:54:12.698389 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:54:12.705022 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6c90583f-c8f3-4e5c-a54e-420fb274d016 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:12.705658 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6c90583f-c8f3-4e5c-a54e-420fb274d016 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:12.706171 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6c90583f-c8f3-4e5c-a54e-420fb274d016 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:12.706998 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6c90583f-c8f3-4e5c-a54e-420fb274d016 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:12.707569 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6c90583f-c8f3-4e5c-a54e-420fb274d016 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:12.708068 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6c90583f-c8f3-4e5c-a54e-420fb274d016 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:12.856457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6c90583f-c8f3-4e5c-a54e-420fb274d016 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:54:12.865096 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6c90583f-c8f3-4e5c-a54e-420fb274d016 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be" status: 200 len: 1391 microversion: 2.1 time: 0.174950 Sep 17 21:54:12.865903 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3494/6894] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:54:12 2022] GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:54:13.891153 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:54:13.892846 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:54:13.899113 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-daf25e5c-ed72-46c2-9341-40c43decd4d9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:54:13.900286 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-daf25e5c-ed72-46c2-9341-40c43decd4d9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:54:13.912040 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-daf25e5c-ed72-46c2-9341-40c43decd4d9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:13.912826 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-daf25e5c-ed72-46c2-9341-40c43decd4d9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:13.913633 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-daf25e5c-ed72-46c2-9341-40c43decd4d9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:13.914750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-daf25e5c-ed72-46c2-9341-40c43decd4d9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:13.915211 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-daf25e5c-ed72-46c2-9341-40c43decd4d9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:13.915720 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-daf25e5c-ed72-46c2-9341-40c43decd4d9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:14.049896 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-daf25e5c-ed72-46c2-9341-40c43decd4d9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:54:14.058435 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-daf25e5c-ed72-46c2-9341-40c43decd4d9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be" status: 200 len: 1562 microversion: 2.1 time: 0.170631 Sep 17 21:54:14.058993 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3401/6895] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:54:13 2022] GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be => generated 1562 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:54:14.081254 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6908405e-5d27-4c34-80f8-b291ee3e786e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:54:14.081902 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6908405e-5d27-4c34-80f8-b291ee3e786e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:54:14.083919 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=6 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:54:14.090227 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6908405e-5d27-4c34-80f8-b291ee3e786e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:14.090736 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6908405e-5d27-4c34-80f8-b291ee3e786e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:14.091198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6908405e-5d27-4c34-80f8-b291ee3e786e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:14.091926 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6908405e-5d27-4c34-80f8-b291ee3e786e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:14.092401 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6908405e-5d27-4c34-80f8-b291ee3e786e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:14.092865 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6908405e-5d27-4c34-80f8-b291ee3e786e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:14.227503 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-6908405e-5d27-4c34-80f8-b291ee3e786e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:54:14.235773 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6908405e-5d27-4c34-80f8-b291ee3e786e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be" status: 200 len: 1562 microversion: 2.1 time: 0.158865 Sep 17 21:54:14.236365 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3495/6896] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:54:14 2022] GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:54:15.986413 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1a194dbf-dcb8-488c-840e-ce50a8e85351 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:54:15.987046 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1a194dbf-dcb8-488c-840e-ce50a8e85351 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:54:15.993803 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a194dbf-dcb8-488c-840e-ce50a8e85351 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:15.994273 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a194dbf-dcb8-488c-840e-ce50a8e85351 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:15.994934 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a194dbf-dcb8-488c-840e-ce50a8e85351 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:15.995654 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a194dbf-dcb8-488c-840e-ce50a8e85351 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:15.996249 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a194dbf-dcb8-488c-840e-ce50a8e85351 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:15.996877 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1a194dbf-dcb8-488c-840e-ce50a8e85351 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:15.998178 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-a4860f4b-ef0d-4eef-a17e-9e4b1cef7360 req-07f0dad4-1000-4ac9-8d63-641f854ec89e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99c50af6-5fce-4e3f-b912-433e8673a5be", "tag": "79f29670-6842-44f9-8496-b611dcec74c7"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:54:16.011118 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a4860f4b-ef0d-4eef-a17e-9e4b1cef7360 req-07f0dad4-1000-4ac9-8d63-641f854ec89e service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:16.012432 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a4860f4b-ef0d-4eef-a17e-9e4b1cef7360 req-07f0dad4-1000-4ac9-8d63-641f854ec89e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:16.013096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-a4860f4b-ef0d-4eef-a17e-9e4b1cef7360 req-07f0dad4-1000-4ac9-8d63-641f854ec89e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:16.027331 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-a4860f4b-ef0d-4eef-a17e-9e4b1cef7360 req-07f0dad4-1000-4ac9-8d63-641f854ec89e service nova] Creating event network-changed:79f29670-6842-44f9-8496-b611dcec74c7 for instance 99c50af6-5fce-4e3f-b912-433e8673a5be on nch2-master-1 Sep 17 21:54:16.032681 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-a4860f4b-ef0d-4eef-a17e-9e4b1cef7360 req-07f0dad4-1000-4ac9-8d63-641f854ec89e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099010 Sep 17 21:54:16.033322 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3496/6897] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:54:16.236448 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1a194dbf-dcb8-488c-840e-ce50a8e85351 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:54:16.249250 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1a194dbf-dcb8-488c-840e-ce50a8e85351 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be" status: 200 len: 1562 microversion: 2.1 time: 0.317641 Sep 17 21:54:16.250189 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3402/6898] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:54:15 2022] GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be => generated 1562 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:54:37.541106 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=5 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:54:37.541904 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=38 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:54:37.543035 ncdv-master-1 devstack@n-api.service[140524]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 17 21:54:37.543201 ncdv-master-1 devstack@n-api.service[140524]: Sat Sep 17 21:54:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be/action (ip 10.222.0.26) !!! Sep 17 21:54:37.547731 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-6e5512a2-f022-460c-b304-55669a21ef80 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:54:37.550165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-6e5512a2-f022-460c-b304-55669a21ef80 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:54:37.559434 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6e5512a2-f022-460c-b304-55669a21ef80 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:37.559942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6e5512a2-f022-460c-b304-55669a21ef80 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:37.560402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6e5512a2-f022-460c-b304-55669a21ef80 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:37.561127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6e5512a2-f022-460c-b304-55669a21ef80 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:37.561657 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6e5512a2-f022-460c-b304-55669a21ef80 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:37.562110 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-6e5512a2-f022-460c-b304-55669a21ef80 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:37.615098 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-6e5512a2-f022-460c-b304-55669a21ef80 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "POST /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be/action" status: 200 len: 24573 microversion: 2.1 time: 0.075875 Sep 17 21:54:37.615776 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3497/6899] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:54:37 2022] POST /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be/action => generated 24573 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:54:48.680995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d5cfedf3-a54c-464a-8ad6-5e55d9f67640 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:54:48.684088 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:54:48.684965 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=36 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:54:48.694333 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5cfedf3-a54c-464a-8ad6-5e55d9f67640 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:48.695044 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5cfedf3-a54c-464a-8ad6-5e55d9f67640 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:48.695646 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d5cfedf3-a54c-464a-8ad6-5e55d9f67640 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:48.720701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d5cfedf3-a54c-464a-8ad6-5e55d9f67640 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Going to try to stop instance {{(pid=140523) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 17 21:54:48.768538 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d5cfedf3-a54c-464a-8ad6-5e55d9f67640 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "POST /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be/action" status: 202 len: 0 microversion: 2.1 time: 0.093027 Sep 17 21:54:48.769168 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3403/6900] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:54:48 2022] POST /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:54:48.779401 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cb87adcc-71ea-4909-a9fe-cdb43de0f63c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:54:48.780138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cb87adcc-71ea-4909-a9fe-cdb43de0f63c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:54:48.783191 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:54:48.783942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=4 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:54:48.791466 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb87adcc-71ea-4909-a9fe-cdb43de0f63c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:48.791985 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb87adcc-71ea-4909-a9fe-cdb43de0f63c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:48.792585 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb87adcc-71ea-4909-a9fe-cdb43de0f63c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:48.793317 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb87adcc-71ea-4909-a9fe-cdb43de0f63c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:48.793832 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb87adcc-71ea-4909-a9fe-cdb43de0f63c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:48.794271 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb87adcc-71ea-4909-a9fe-cdb43de0f63c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:48.935389 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cb87adcc-71ea-4909-a9fe-cdb43de0f63c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:54:48.943689 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cb87adcc-71ea-4909-a9fe-cdb43de0f63c tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be" status: 200 len: 1689 microversion: 2.1 time: 0.168907 Sep 17 21:54:48.944293 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3498/6901] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:54:48 2022] GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:54:49.978658 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-47e30427-1d87-4ce3-85ce-b48c6ac1653a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:54:49.979594 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-47e30427-1d87-4ce3-85ce-b48c6ac1653a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:54:49.990384 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47e30427-1d87-4ce3-85ce-b48c6ac1653a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:49.991185 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47e30427-1d87-4ce3-85ce-b48c6ac1653a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:49.991914 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47e30427-1d87-4ce3-85ce-b48c6ac1653a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:49.993193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47e30427-1d87-4ce3-85ce-b48c6ac1653a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:49.993995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47e30427-1d87-4ce3-85ce-b48c6ac1653a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:49.994706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-47e30427-1d87-4ce3-85ce-b48c6ac1653a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:50.147877 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-47e30427-1d87-4ce3-85ce-b48c6ac1653a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:54:50.156724 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-47e30427-1d87-4ce3-85ce-b48c6ac1653a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be" status: 200 len: 1689 microversion: 2.1 time: 0.186924 Sep 17 21:54:50.157342 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3404/6902] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:54:49 2022] GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be => generated 1689 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:54:51.184191 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b95a1924-2e58-491d-8cda-30d9a3976dc5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:54:51.185333 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b95a1924-2e58-491d-8cda-30d9a3976dc5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:54:51.193209 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b95a1924-2e58-491d-8cda-30d9a3976dc5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:51.193780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b95a1924-2e58-491d-8cda-30d9a3976dc5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:51.194269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b95a1924-2e58-491d-8cda-30d9a3976dc5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:51.195031 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b95a1924-2e58-491d-8cda-30d9a3976dc5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:51.195573 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b95a1924-2e58-491d-8cda-30d9a3976dc5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:51.196050 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b95a1924-2e58-491d-8cda-30d9a3976dc5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:51.334315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b95a1924-2e58-491d-8cda-30d9a3976dc5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:54:51.342592 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b95a1924-2e58-491d-8cda-30d9a3976dc5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be" status: 200 len: 1689 microversion: 2.1 time: 0.165253 Sep 17 21:54:51.343161 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3499/6903] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:54:51 2022] GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:54:52.370728 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9302463c-79d2-4aea-a3b8-096d8d8b0d8b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:54:52.371743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9302463c-79d2-4aea-a3b8-096d8d8b0d8b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:54:52.383620 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9302463c-79d2-4aea-a3b8-096d8d8b0d8b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:52.384446 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9302463c-79d2-4aea-a3b8-096d8d8b0d8b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:52.385193 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9302463c-79d2-4aea-a3b8-096d8d8b0d8b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:52.386415 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9302463c-79d2-4aea-a3b8-096d8d8b0d8b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:52.387195 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9302463c-79d2-4aea-a3b8-096d8d8b0d8b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:52.387927 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9302463c-79d2-4aea-a3b8-096d8d8b0d8b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:52.537288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9302463c-79d2-4aea-a3b8-096d8d8b0d8b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:54:52.545643 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9302463c-79d2-4aea-a3b8-096d8d8b0d8b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be" status: 200 len: 1689 microversion: 2.1 time: 0.181758 Sep 17 21:54:52.546318 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3405/6904] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:54:52 2022] GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be => generated 1689 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:54:53.570095 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ca8172c3-905b-4590-a33f-7d3212e0d599 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:54:53.570775 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ca8172c3-905b-4590-a33f-7d3212e0d599 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:54:53.579098 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca8172c3-905b-4590-a33f-7d3212e0d599 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:53.579648 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca8172c3-905b-4590-a33f-7d3212e0d599 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:53.580136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca8172c3-905b-4590-a33f-7d3212e0d599 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:53.580938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca8172c3-905b-4590-a33f-7d3212e0d599 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:53.581490 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca8172c3-905b-4590-a33f-7d3212e0d599 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:53.581982 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca8172c3-905b-4590-a33f-7d3212e0d599 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:53.726692 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ca8172c3-905b-4590-a33f-7d3212e0d599 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:54:53.735276 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ca8172c3-905b-4590-a33f-7d3212e0d599 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be" status: 200 len: 1689 microversion: 2.1 time: 0.169464 Sep 17 21:54:53.735866 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3500/6905] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:54:53 2022] GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:54:54.758695 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2e079f8b-8d7f-409c-adbb-2ddcd73b43b2 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:54:54.759316 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2e079f8b-8d7f-409c-adbb-2ddcd73b43b2 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:54:54.766759 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e079f8b-8d7f-409c-adbb-2ddcd73b43b2 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:54.767247 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e079f8b-8d7f-409c-adbb-2ddcd73b43b2 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:54.767692 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e079f8b-8d7f-409c-adbb-2ddcd73b43b2 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:54.768397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e079f8b-8d7f-409c-adbb-2ddcd73b43b2 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:54.768851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e079f8b-8d7f-409c-adbb-2ddcd73b43b2 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:54.769284 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2e079f8b-8d7f-409c-adbb-2ddcd73b43b2 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:54.905536 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2e079f8b-8d7f-409c-adbb-2ddcd73b43b2 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:54:54.913657 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2e079f8b-8d7f-409c-adbb-2ddcd73b43b2 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be" status: 200 len: 1689 microversion: 2.1 time: 0.158966 Sep 17 21:54:54.914249 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3406/6906] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:54:54 2022] GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:54:55.939294 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e11af7db-5344-4a9b-917e-5cbe0723f431 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:54:55.939931 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e11af7db-5344-4a9b-917e-5cbe0723f431 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:54:55.947170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e11af7db-5344-4a9b-917e-5cbe0723f431 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:55.947617 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e11af7db-5344-4a9b-917e-5cbe0723f431 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:55.948084 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e11af7db-5344-4a9b-917e-5cbe0723f431 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:55.948811 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e11af7db-5344-4a9b-917e-5cbe0723f431 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:55.949292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e11af7db-5344-4a9b-917e-5cbe0723f431 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:55.949770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e11af7db-5344-4a9b-917e-5cbe0723f431 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:56.092175 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e11af7db-5344-4a9b-917e-5cbe0723f431 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:54:56.100229 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e11af7db-5344-4a9b-917e-5cbe0723f431 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be" status: 200 len: 1689 microversion: 2.1 time: 0.166148 Sep 17 21:54:56.100828 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3501/6907] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:54:55 2022] GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:54:57.127180 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f70ccf6d-62ec-4875-bee7-270ebd24a63b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:54:57.127914 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f70ccf6d-62ec-4875-bee7-270ebd24a63b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:54:57.135345 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f70ccf6d-62ec-4875-bee7-270ebd24a63b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:57.135849 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f70ccf6d-62ec-4875-bee7-270ebd24a63b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:57.136301 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f70ccf6d-62ec-4875-bee7-270ebd24a63b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:57.137022 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f70ccf6d-62ec-4875-bee7-270ebd24a63b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:57.137503 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f70ccf6d-62ec-4875-bee7-270ebd24a63b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:57.137967 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f70ccf6d-62ec-4875-bee7-270ebd24a63b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:57.278587 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f70ccf6d-62ec-4875-bee7-270ebd24a63b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:54:57.286826 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f70ccf6d-62ec-4875-bee7-270ebd24a63b tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be" status: 200 len: 1689 microversion: 2.1 time: 0.164669 Sep 17 21:54:57.287419 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3407/6908] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:54:57 2022] GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:54:58.322079 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-32cdd371-fd91-4e78-8fb6-e6ae90a7ace5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:54:58.323183 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-32cdd371-fd91-4e78-8fb6-e6ae90a7ace5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:54:58.333001 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32cdd371-fd91-4e78-8fb6-e6ae90a7ace5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:58.333501 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32cdd371-fd91-4e78-8fb6-e6ae90a7ace5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:58.333998 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32cdd371-fd91-4e78-8fb6-e6ae90a7ace5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:58.334722 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32cdd371-fd91-4e78-8fb6-e6ae90a7ace5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:58.335200 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32cdd371-fd91-4e78-8fb6-e6ae90a7ace5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:58.335653 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-32cdd371-fd91-4e78-8fb6-e6ae90a7ace5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:58.479456 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-32cdd371-fd91-4e78-8fb6-e6ae90a7ace5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:54:58.487974 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-32cdd371-fd91-4e78-8fb6-e6ae90a7ace5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be" status: 200 len: 1689 microversion: 2.1 time: 0.172733 Sep 17 21:54:58.488564 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3502/6909] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:54:58 2022] GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:54:59.512261 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5e401256-1053-4c26-bd1b-6421f0a16fed tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:54:59.512908 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5e401256-1053-4c26-bd1b-6421f0a16fed tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:54:59.520420 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e401256-1053-4c26-bd1b-6421f0a16fed tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:59.520912 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e401256-1053-4c26-bd1b-6421f0a16fed tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:59.521324 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e401256-1053-4c26-bd1b-6421f0a16fed tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:59.522090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e401256-1053-4c26-bd1b-6421f0a16fed tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:54:59.522548 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e401256-1053-4c26-bd1b-6421f0a16fed tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:54:59.522979 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e401256-1053-4c26-bd1b-6421f0a16fed tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:54:59.662156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5e401256-1053-4c26-bd1b-6421f0a16fed tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:54:59.671991 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5e401256-1053-4c26-bd1b-6421f0a16fed tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be" status: 200 len: 1666 microversion: 2.1 time: 0.163707 Sep 17 21:54:59.672601 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3408/6910] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:54:59 2022] GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be => generated 1666 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:55:00.772479 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1d74600d-a3c7-40ab-aa98-999965970fe6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:55:00.775034 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1d74600d-a3c7-40ab-aa98-999965970fe6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:55:00.782963 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d74600d-a3c7-40ab-aa98-999965970fe6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:00.783485 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d74600d-a3c7-40ab-aa98-999965970fe6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:00.783974 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d74600d-a3c7-40ab-aa98-999965970fe6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:00.784744 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d74600d-a3c7-40ab-aa98-999965970fe6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:00.785252 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d74600d-a3c7-40ab-aa98-999965970fe6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:00.785772 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d74600d-a3c7-40ab-aa98-999965970fe6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:00.837974 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1d74600d-a3c7-40ab-aa98-999965970fe6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "POST /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be/action" status: 200 len: 38424 microversion: 2.1 time: 0.069539 Sep 17 21:55:00.838631 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3503/6911] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:55:00 2022] POST /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be/action => generated 38424 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:55:00.851010 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-3d16a655-bf0e-4830-8902-3133ee021e96 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:55:00.858551 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3d16a655-bf0e-4830-8902-3133ee021e96 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:00.859044 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3d16a655-bf0e-4830-8902-3133ee021e96 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:00.859484 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-3d16a655-bf0e-4830-8902-3133ee021e96 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:00.882147 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-3d16a655-bf0e-4830-8902-3133ee021e96 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Going to try to start instance {{(pid=140523) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 17 21:55:00.927910 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-3d16a655-bf0e-4830-8902-3133ee021e96 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "POST /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be/action" status: 202 len: 0 microversion: 2.1 time: 0.080724 Sep 17 21:55:00.928515 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3409/6912] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:55:00 2022] POST /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:55:00.939058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5df4498f-6ca7-4e48-81fd-ea4016102979 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:55:00.939786 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5df4498f-6ca7-4e48-81fd-ea4016102979 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:55:00.948411 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5df4498f-6ca7-4e48-81fd-ea4016102979 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:00.948859 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5df4498f-6ca7-4e48-81fd-ea4016102979 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:00.949337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5df4498f-6ca7-4e48-81fd-ea4016102979 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:00.950184 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5df4498f-6ca7-4e48-81fd-ea4016102979 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:00.950665 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5df4498f-6ca7-4e48-81fd-ea4016102979 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:00.951119 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5df4498f-6ca7-4e48-81fd-ea4016102979 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:01.180829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5df4498f-6ca7-4e48-81fd-ea4016102979 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:55:01.190205 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5df4498f-6ca7-4e48-81fd-ea4016102979 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be" status: 200 len: 1675 microversion: 2.1 time: 0.255330 Sep 17 21:55:01.190792 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3504/6913] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:55:00 2022] GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be => generated 1675 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:55:02.222278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ef69c855-1e5a-4627-bfa0-b40f5de29352 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:55:02.223445 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ef69c855-1e5a-4627-bfa0-b40f5de29352 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:55:02.233891 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef69c855-1e5a-4627-bfa0-b40f5de29352 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:02.234704 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef69c855-1e5a-4627-bfa0-b40f5de29352 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:02.235476 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef69c855-1e5a-4627-bfa0-b40f5de29352 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:02.236385 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef69c855-1e5a-4627-bfa0-b40f5de29352 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:02.236852 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef69c855-1e5a-4627-bfa0-b40f5de29352 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:02.237275 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef69c855-1e5a-4627-bfa0-b40f5de29352 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:02.384674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ef69c855-1e5a-4627-bfa0-b40f5de29352 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:55:02.392890 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ef69c855-1e5a-4627-bfa0-b40f5de29352 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be" status: 200 len: 1679 microversion: 2.1 time: 0.179447 Sep 17 21:55:02.393492 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3410/6914] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:55:02 2022] GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:55:26.641883 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-60daf8f0-0712-4adc-b791-531261c67b0a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:55:26.644390 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-60daf8f0-0712-4adc-b791-531261c67b0a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:55:26.647533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=14 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:55:26.648289 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=40 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:55:26.654762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-60daf8f0-0712-4adc-b791-531261c67b0a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:26.655332 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-60daf8f0-0712-4adc-b791-531261c67b0a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:26.655859 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-60daf8f0-0712-4adc-b791-531261c67b0a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:26.656793 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-60daf8f0-0712-4adc-b791-531261c67b0a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:26.657271 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-60daf8f0-0712-4adc-b791-531261c67b0a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:26.657768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-60daf8f0-0712-4adc-b791-531261c67b0a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:26.718459 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-60daf8f0-0712-4adc-b791-531261c67b0a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "POST /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be/action" status: 200 len: 62987 microversion: 2.1 time: 0.080862 Sep 17 21:55:26.719148 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3505/6915] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:55:26 2022] POST /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be/action => generated 62987 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:55:33.731270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ef9fbab0-0e47-4236-a62c-90a88ee037fb tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:55:33.731825 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ef9fbab0-0e47-4236-a62c-90a88ee037fb tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:55:33.734311 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=16 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:55:33.734971 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:55:33.740019 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-9f542039-48c7-461a-828a-487d29cf5784 req-b175f448-cf52-4ac8-8739-bbbea325e1e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99c50af6-5fce-4e3f-b912-433e8673a5be", "tag": "79f29670-6842-44f9-8496-b611dcec74c7"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:55:33.740974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef9fbab0-0e47-4236-a62c-90a88ee037fb tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:33.741496 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef9fbab0-0e47-4236-a62c-90a88ee037fb tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:33.741962 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef9fbab0-0e47-4236-a62c-90a88ee037fb tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:33.742676 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef9fbab0-0e47-4236-a62c-90a88ee037fb tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:33.743130 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef9fbab0-0e47-4236-a62c-90a88ee037fb tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:33.743556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ef9fbab0-0e47-4236-a62c-90a88ee037fb tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:33.752273 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-9f542039-48c7-461a-828a-487d29cf5784 req-b175f448-cf52-4ac8-8739-bbbea325e1e9 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:33.753249 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-9f542039-48c7-461a-828a-487d29cf5784 req-b175f448-cf52-4ac8-8739-bbbea325e1e9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:33.753813 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-9f542039-48c7-461a-828a-487d29cf5784 req-b175f448-cf52-4ac8-8739-bbbea325e1e9 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:33.767295 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-9f542039-48c7-461a-828a-487d29cf5784 req-b175f448-cf52-4ac8-8739-bbbea325e1e9 service nova] Creating event network-changed:79f29670-6842-44f9-8496-b611dcec74c7 for instance 99c50af6-5fce-4e3f-b912-433e8673a5be on nch2-master-1 Sep 17 21:55:33.773089 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ef9fbab0-0e47-4236-a62c-90a88ee037fb tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:55:33.773873 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-9f542039-48c7-461a-828a-487d29cf5784 req-b175f448-cf52-4ac8-8739-bbbea325e1e9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038738 Sep 17 21:55:33.774721 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3506/6916] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:55:33.872292 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ef9fbab0-0e47-4236-a62c-90a88ee037fb tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "DELETE /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be" status: 204 len: 0 microversion: 2.1 time: 0.145085 Sep 17 21:55:33.876414 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3411/6917] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:55:33 2022] DELETE /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:55:33.883991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f6f4c10e-908d-46dc-9546-5a086ceb41b5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:55:33.884741 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f6f4c10e-908d-46dc-9546-5a086ceb41b5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:55:33.892324 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6f4c10e-908d-46dc-9546-5a086ceb41b5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:33.892848 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6f4c10e-908d-46dc-9546-5a086ceb41b5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:33.893568 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6f4c10e-908d-46dc-9546-5a086ceb41b5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:33.894162 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6f4c10e-908d-46dc-9546-5a086ceb41b5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:33.894686 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6f4c10e-908d-46dc-9546-5a086ceb41b5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:33.895192 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f6f4c10e-908d-46dc-9546-5a086ceb41b5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:34.053736 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f6f4c10e-908d-46dc-9546-5a086ceb41b5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:55:34.062046 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f6f4c10e-908d-46dc-9546-5a086ceb41b5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be" status: 200 len: 1685 microversion: 2.1 time: 0.183856 Sep 17 21:55:34.062636 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3507/6918] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:55:33 2022] GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be => generated 1685 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:55:35.088504 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1b38c9fc-d4d3-4ef7-848f-a7ddb1e04830 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:55:35.089214 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1b38c9fc-d4d3-4ef7-848f-a7ddb1e04830 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:55:35.096944 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b38c9fc-d4d3-4ef7-848f-a7ddb1e04830 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:35.097476 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b38c9fc-d4d3-4ef7-848f-a7ddb1e04830 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:35.097932 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b38c9fc-d4d3-4ef7-848f-a7ddb1e04830 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:35.098646 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b38c9fc-d4d3-4ef7-848f-a7ddb1e04830 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:35.099111 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b38c9fc-d4d3-4ef7-848f-a7ddb1e04830 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:35.099540 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b38c9fc-d4d3-4ef7-848f-a7ddb1e04830 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:35.618863 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1b38c9fc-d4d3-4ef7-848f-a7ddb1e04830 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:55:35.627516 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1b38c9fc-d4d3-4ef7-848f-a7ddb1e04830 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be" status: 200 len: 1685 microversion: 2.1 time: 0.543658 Sep 17 21:55:35.628308 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3412/6919] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:55:35 2022] GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be => generated 1685 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:55:35.832387 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-f3165fab-b808-4bdf-8e0a-47ae59762a38 req-fe7b267f-2d22-479f-8a84-ff2aae31e628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99c50af6-5fce-4e3f-b912-433e8673a5be", "name": "network-vif-deleted", "tag": "79f29670-6842-44f9-8496-b611dcec74c7"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:55:35.849926 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f3165fab-b808-4bdf-8e0a-47ae59762a38 req-fe7b267f-2d22-479f-8a84-ff2aae31e628 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:35.850361 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f3165fab-b808-4bdf-8e0a-47ae59762a38 req-fe7b267f-2d22-479f-8a84-ff2aae31e628 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:35.850825 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f3165fab-b808-4bdf-8e0a-47ae59762a38 req-fe7b267f-2d22-479f-8a84-ff2aae31e628 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:35.863305 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-f3165fab-b808-4bdf-8e0a-47ae59762a38 req-fe7b267f-2d22-479f-8a84-ff2aae31e628 service nova] Creating event network-vif-deleted:79f29670-6842-44f9-8496-b611dcec74c7 for instance 99c50af6-5fce-4e3f-b912-433e8673a5be on nch2-master-1 Sep 17 21:55:35.868154 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-f3165fab-b808-4bdf-8e0a-47ae59762a38 req-fe7b267f-2d22-479f-8a84-ff2aae31e628 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040067 Sep 17 21:55:35.868768 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3508/6920] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:55:36.656223 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-558fff78-821f-4bbb-b68b-cb36e5ce8b54 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:55:36.657512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-558fff78-821f-4bbb-b68b-cb36e5ce8b54 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 99c50af6-5fce-4e3f-b912-433e8673a5be] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:55:36.665732 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-558fff78-821f-4bbb-b68b-cb36e5ce8b54 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:36.666236 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-558fff78-821f-4bbb-b68b-cb36e5ce8b54 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:36.666722 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-558fff78-821f-4bbb-b68b-cb36e5ce8b54 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:36.667428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-558fff78-821f-4bbb-b68b-cb36e5ce8b54 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:36.667925 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-558fff78-821f-4bbb-b68b-cb36e5ce8b54 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:36.668404 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-558fff78-821f-4bbb-b68b-cb36e5ce8b54 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:36.682787 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-558fff78-821f-4bbb-b68b-cb36e5ce8b54 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] HTTP exception thrown: Instance 99c50af6-5fce-4e3f-b912-433e8673a5be could not be found. Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-558fff78-821f-4bbb-b68b-cb36e5ce8b54 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Request method failure captured: Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be HTTP/1.1 Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJkDaqrUqQ4R3Jc50dHjJrzHY0H6R9FbsHaifiKAhdbafUbvetKkTsAeXQ-XLllwkBW4TMkyFoTdjx6sRrhd61AW2D-lOJ5jM-lciJMsVlu69fHeXBQVZJqH7yfr66d0yPaxTtnH5N_36Tfpt2dvCfwMBCGXmn8-CxBhA65JgC1h0P9o Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 88a7205c02914d428fd0d43b7fa61fe9 Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1937454944 Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/88a7205c02914d428fd0d43b7fa61fe9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/88a7205c02914d428fd0d43b7fa61fe9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/88a7205c02914d428fd0d43b7fa61fe9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_88a7205c02914d428fd0d43b7fa61fe9", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1937454944 Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 88a7205c02914d428fd0d43b7fa61fe9 Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1937454944 Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-TestNetworkAdvancedServerOps-1937454944-project Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: ac0fa1f4eeca4d5e822b603953471c73 Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1937454944-project Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 99c50af6-5fce-4e3f-b912-433e8673a5be could not be found. Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '99c50af6-5fce-4e3f-b912-433e8673a5be'} Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99c50af6-5fce-4e3f-b912-433e8673a5be could not be found. Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99c50af6-5fce-4e3f-b912-433e8673a5be could not be found. Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:55:36.684493 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:55:36.689830 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:55:36.689830 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:55:36.689830 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:55:36.689830 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:55:36.689830 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:55:36.689830 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:55:36.689830 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99c50af6-5fce-4e3f-b912-433e8673a5be could not be found. Sep 17 21:55:36.689830 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:55:36.689830 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-558fff78-821f-4bbb-b68b-cb36e5ce8b54 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Returning 404 to user: Instance 99c50af6-5fce-4e3f-b912-433e8673a5be could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:55:36.689830 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-558fff78-821f-4bbb-b68b-cb36e5ce8b54 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be" status: 404 len: 111 microversion: 2.1 time: 0.036551 Sep 17 21:55:36.689830 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3413/6921] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:55:36 2022] GET /compute/v2.1/servers/99c50af6-5fce-4e3f-b912-433e8673a5be => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:55:39.745084 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-da1498c5-361b-4e78-9a49-5a72a40cf35e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '.version_select at 0x7f259c3dc670>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:55:39.770820 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-da1498c5-361b-4e78-9a49-5a72a40cf35e tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2045594078" status: 202 len: 0 microversion: 2.1 time: 0.030472 Sep 17 21:55:39.771718 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3509/6922] 10.222.0.26 () {58 vars in 1284 bytes} [Sat Sep 17 21:55:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2045594078 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:55:39.801515 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-917f41d2-752a-41c6-8138-56015e68011a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Action: 'create', calling method: .version_select at 0x7f25a5045ca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1585853388", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0805VDWFwSUv/JOGGOq0sH+FWWFzHJlEQbb6LFYwFfjr2olDmdx8CP1ObWfxuN0BQ06Kuy69HWitySIuFwi+NaR9pPembPmGQ/BMqnuMJe0RSV1VqnCi8sfxYJ7ASK0w=="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:55:39.819137 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-917f41d2-752a-41c6-8138-56015e68011a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Getting quotas for project 88a7205c02914d428fd0d43b7fa61fe9. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:55:39.826278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-917f41d2-752a-41c6-8138-56015e68011a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Getting quotas for user ac0fa1f4eeca4d5e822b603953471c73 and project 88a7205c02914d428fd0d43b7fa61fe9. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:55:39.857182 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-917f41d2-752a-41c6-8138-56015e68011a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.059933 Sep 17 21:55:39.857856 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3414/6923] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:55:39 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:55:45.572053 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f2d698e5-b98c-4235-ac75-223aff0973fd tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1030862043", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "networks": [{"uuid": "94466a1a-5943-4a25-b075-cf12ba843df5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1585853388", "security_groups": [{"name": "tempest-secgroup-smoke-1414045679"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:55:45.716232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-f2d698e5-b98c-4235-ac75-223aff0973fd tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] validate_networks() for [('94466a1a-5943-4a25-b075-cf12ba843df5', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:55:45.856734 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=14 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:55:46.124720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-f2d698e5-b98c-4235-ac75-223aff0973fd tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:55:46.125170 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-f2d698e5-b98c-4235-ac75-223aff0973fd tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:55:46.125699 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-f2d698e5-b98c-4235-ac75-223aff0973fd tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:55:46.126130 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-f2d698e5-b98c-4235-ac75-223aff0973fd tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:55:46.126561 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-f2d698e5-b98c-4235-ac75-223aff0973fd tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:55:46.138629 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f2d698e5-b98c-4235-ac75-223aff0973fd tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:46.139433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f2d698e5-b98c-4235-ac75-223aff0973fd tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:46.140070 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f2d698e5-b98c-4235-ac75-223aff0973fd tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:46.141010 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f2d698e5-b98c-4235-ac75-223aff0973fd tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:46.141835 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f2d698e5-b98c-4235-ac75-223aff0973fd tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:46.142462 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f2d698e5-b98c-4235-ac75-223aff0973fd tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:46.162266 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-f2d698e5-b98c-4235-ac75-223aff0973fd tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Getting quotas for project 88a7205c02914d428fd0d43b7fa61fe9. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:55:46.167911 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-f2d698e5-b98c-4235-ac75-223aff0973fd tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Getting quotas for user ac0fa1f4eeca4d5e822b603953471c73 and project 88a7205c02914d428fd0d43b7fa61fe9. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:55:46.181136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f2d698e5-b98c-4235-ac75-223aff0973fd tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:55:46.183653 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f2d698e5-b98c-4235-ac75-223aff0973fd tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 635d8eb8-c234-4149-aff9-87e5d63dbb10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:55:46.238364 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f2d698e5-b98c-4235-ac75-223aff0973fd tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.671126 Sep 17 21:55:46.239044 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3510/6924] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:55:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:55:46.251454 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b316c7e0-df29-4fa1-a150-124acb71f634 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:55:46.252027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b316c7e0-df29-4fa1-a150-124acb71f634 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 635d8eb8-c234-4149-aff9-87e5d63dbb10] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:55:46.318651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b316c7e0-df29-4fa1-a150-124acb71f634 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:55:46.333033 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b316c7e0-df29-4fa1-a150-124acb71f634 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10" status: 200 len: 1267 microversion: 2.1 time: 0.086457 Sep 17 21:55:46.333598 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3415/6925] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:55:46 2022] GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10 => generated 1267 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:55:47.357779 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-f83b2658-6020-4898-818b-19950cf7240d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:55:47.359169 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-f83b2658-6020-4898-818b-19950cf7240d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 635d8eb8-c234-4149-aff9-87e5d63dbb10] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:55:47.368004 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f83b2658-6020-4898-818b-19950cf7240d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:47.368777 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f83b2658-6020-4898-818b-19950cf7240d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:47.369504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f83b2658-6020-4898-818b-19950cf7240d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:47.370723 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f83b2658-6020-4898-818b-19950cf7240d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:47.371529 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f83b2658-6020-4898-818b-19950cf7240d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:47.372366 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-f83b2658-6020-4898-818b-19950cf7240d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:47.451989 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-f83b2658-6020-4898-818b-19950cf7240d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:55:47.466371 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-f83b2658-6020-4898-818b-19950cf7240d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10" status: 200 len: 1327 microversion: 2.1 time: 0.113452 Sep 17 21:55:47.467733 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3511/6926] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:55:47 2022] GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10 => generated 1327 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:55:48.491910 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f243498d-27b2-4b79-bf95-41a98284aef3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:55:48.493213 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f243498d-27b2-4b79-bf95-41a98284aef3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 635d8eb8-c234-4149-aff9-87e5d63dbb10] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:55:48.495450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:55:48.503329 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f243498d-27b2-4b79-bf95-41a98284aef3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:48.503840 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f243498d-27b2-4b79-bf95-41a98284aef3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:48.504293 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f243498d-27b2-4b79-bf95-41a98284aef3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:48.505023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f243498d-27b2-4b79-bf95-41a98284aef3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:48.505499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f243498d-27b2-4b79-bf95-41a98284aef3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:48.506172 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f243498d-27b2-4b79-bf95-41a98284aef3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:48.655562 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f243498d-27b2-4b79-bf95-41a98284aef3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:55:48.667410 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f243498d-27b2-4b79-bf95-41a98284aef3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10" status: 200 len: 1393 microversion: 2.1 time: 0.179788 Sep 17 21:55:48.677502 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3416/6927] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:55:48 2022] GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10 => generated 1393 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:55:48.939434 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-cff75c06-f67b-4bf1-ad46-26821ee736cc req-99161403-2fc3-4d58-adf8-dc7e7bd6886a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "635d8eb8-c234-4149-aff9-87e5d63dbb10", "tag": "8ed06fbe-512a-4d9b-ae24-dc677b4ef029"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:55:48.952179 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-cff75c06-f67b-4bf1-ad46-26821ee736cc req-99161403-2fc3-4d58-adf8-dc7e7bd6886a service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:48.952629 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-cff75c06-f67b-4bf1-ad46-26821ee736cc req-99161403-2fc3-4d58-adf8-dc7e7bd6886a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:48.953437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-cff75c06-f67b-4bf1-ad46-26821ee736cc req-99161403-2fc3-4d58-adf8-dc7e7bd6886a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:48.978467 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-cff75c06-f67b-4bf1-ad46-26821ee736cc req-99161403-2fc3-4d58-adf8-dc7e7bd6886a service nova] Creating event network-changed:8ed06fbe-512a-4d9b-ae24-dc677b4ef029 for instance 635d8eb8-c234-4149-aff9-87e5d63dbb10 on nch1-master-1 Sep 17 21:55:48.983517 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-cff75c06-f67b-4bf1-ad46-26821ee736cc req-99161403-2fc3-4d58-adf8-dc7e7bd6886a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050066 Sep 17 21:55:48.984556 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3512/6928] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:55:49.693060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-07a54f4d-55d7-45b0-9c4f-c35fe9e5b4e7 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:55:49.693823 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-07a54f4d-55d7-45b0-9c4f-c35fe9e5b4e7 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 635d8eb8-c234-4149-aff9-87e5d63dbb10] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:55:49.703343 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-07a54f4d-55d7-45b0-9c4f-c35fe9e5b4e7 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:49.703948 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-07a54f4d-55d7-45b0-9c4f-c35fe9e5b4e7 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:49.704498 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-07a54f4d-55d7-45b0-9c4f-c35fe9e5b4e7 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:49.705369 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-07a54f4d-55d7-45b0-9c4f-c35fe9e5b4e7 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:49.706124 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-07a54f4d-55d7-45b0-9c4f-c35fe9e5b4e7 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:49.706550 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-07a54f4d-55d7-45b0-9c4f-c35fe9e5b4e7 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:49.843126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-07a54f4d-55d7-45b0-9c4f-c35fe9e5b4e7 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:55:49.855341 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-07a54f4d-55d7-45b0-9c4f-c35fe9e5b4e7 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10" status: 200 len: 1393 microversion: 2.1 time: 0.166915 Sep 17 21:55:49.856070 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3417/6929] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:55:49 2022] GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10 => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:55:50.884504 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5c7078a8-ce20-4015-adfd-084fcc7d7a9d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:55:50.885745 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5c7078a8-ce20-4015-adfd-084fcc7d7a9d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 635d8eb8-c234-4149-aff9-87e5d63dbb10] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:55:50.897410 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c7078a8-ce20-4015-adfd-084fcc7d7a9d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:50.898697 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c7078a8-ce20-4015-adfd-084fcc7d7a9d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:50.899474 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c7078a8-ce20-4015-adfd-084fcc7d7a9d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:50.900670 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c7078a8-ce20-4015-adfd-084fcc7d7a9d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:50.901512 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c7078a8-ce20-4015-adfd-084fcc7d7a9d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:50.902269 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c7078a8-ce20-4015-adfd-084fcc7d7a9d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:51.063592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5c7078a8-ce20-4015-adfd-084fcc7d7a9d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:55:51.076119 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5c7078a8-ce20-4015-adfd-084fcc7d7a9d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10" status: 200 len: 1393 microversion: 2.1 time: 0.198937 Sep 17 21:55:51.076995 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3513/6930] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:55:50 2022] GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10 => generated 1393 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:55:52.100211 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-da54e258-2071-4545-9322-f75cd0460675 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:55:52.101004 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-da54e258-2071-4545-9322-f75cd0460675 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 635d8eb8-c234-4149-aff9-87e5d63dbb10] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:55:52.108431 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da54e258-2071-4545-9322-f75cd0460675 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:52.108923 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da54e258-2071-4545-9322-f75cd0460675 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:52.109368 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da54e258-2071-4545-9322-f75cd0460675 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:52.110111 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da54e258-2071-4545-9322-f75cd0460675 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:52.110571 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da54e258-2071-4545-9322-f75cd0460675 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:52.111007 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-da54e258-2071-4545-9322-f75cd0460675 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:52.258200 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-da54e258-2071-4545-9322-f75cd0460675 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:55:52.266429 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-da54e258-2071-4545-9322-f75cd0460675 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10" status: 200 len: 1393 microversion: 2.1 time: 0.170301 Sep 17 21:55:52.267239 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3418/6931] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:55:52 2022] GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10 => generated 1393 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:55:53.291916 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-86084439-af98-4817-b4ff-71c4014601c9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:55:53.292943 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-86084439-af98-4817-b4ff-71c4014601c9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 635d8eb8-c234-4149-aff9-87e5d63dbb10] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:55:53.302599 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-86084439-af98-4817-b4ff-71c4014601c9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:53.303114 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-86084439-af98-4817-b4ff-71c4014601c9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:53.303605 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-86084439-af98-4817-b4ff-71c4014601c9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:53.304333 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-86084439-af98-4817-b4ff-71c4014601c9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:53.304813 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-86084439-af98-4817-b4ff-71c4014601c9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:53.305259 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-86084439-af98-4817-b4ff-71c4014601c9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:53.439302 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-86084439-af98-4817-b4ff-71c4014601c9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:55:53.451271 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-86084439-af98-4817-b4ff-71c4014601c9 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10" status: 200 len: 1393 microversion: 2.1 time: 0.165331 Sep 17 21:55:53.452066 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3514/6932] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:55:53 2022] GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10 => generated 1393 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:55:53.945270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-58b36f5b-d977-4474-88c2-d9e440fdd1cc req-3a3f0364-c798-4a22-b363-66ed853aa35e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635d8eb8-c234-4149-aff9-87e5d63dbb10", "name": "network-vif-plugged", "status": "completed", "tag": "8ed06fbe-512a-4d9b-ae24-dc677b4ef029"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:55:53.957638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-58b36f5b-d977-4474-88c2-d9e440fdd1cc req-3a3f0364-c798-4a22-b363-66ed853aa35e service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:53.958126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-58b36f5b-d977-4474-88c2-d9e440fdd1cc req-3a3f0364-c798-4a22-b363-66ed853aa35e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:53.958559 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-58b36f5b-d977-4474-88c2-d9e440fdd1cc req-3a3f0364-c798-4a22-b363-66ed853aa35e service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:53.970772 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-58b36f5b-d977-4474-88c2-d9e440fdd1cc req-3a3f0364-c798-4a22-b363-66ed853aa35e service nova] Creating event network-vif-plugged:8ed06fbe-512a-4d9b-ae24-dc677b4ef029 for instance 635d8eb8-c234-4149-aff9-87e5d63dbb10 on nch1-master-1 Sep 17 21:55:53.976094 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-58b36f5b-d977-4474-88c2-d9e440fdd1cc req-3a3f0364-c798-4a22-b363-66ed853aa35e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086498 Sep 17 21:55:53.976709 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3419/6933] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:55:54.479795 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4fe9c42f-952c-4da7-b30b-2a5b14cd6857 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:55:54.480851 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4fe9c42f-952c-4da7-b30b-2a5b14cd6857 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 635d8eb8-c234-4149-aff9-87e5d63dbb10] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:55:54.492683 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4fe9c42f-952c-4da7-b30b-2a5b14cd6857 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:54.493528 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4fe9c42f-952c-4da7-b30b-2a5b14cd6857 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:54.494363 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4fe9c42f-952c-4da7-b30b-2a5b14cd6857 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:54.495566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4fe9c42f-952c-4da7-b30b-2a5b14cd6857 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:54.496383 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4fe9c42f-952c-4da7-b30b-2a5b14cd6857 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:54.497146 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4fe9c42f-952c-4da7-b30b-2a5b14cd6857 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:54.643498 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4fe9c42f-952c-4da7-b30b-2a5b14cd6857 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:55:54.656223 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4fe9c42f-952c-4da7-b30b-2a5b14cd6857 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10" status: 200 len: 1393 microversion: 2.1 time: 0.182995 Sep 17 21:55:54.657132 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3515/6934] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:55:54 2022] GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10 => generated 1393 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:55:55.683112 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8287dbdd-797a-4772-b486-929e564049c6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:55:55.688406 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8287dbdd-797a-4772-b486-929e564049c6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 635d8eb8-c234-4149-aff9-87e5d63dbb10] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:55:55.696410 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8287dbdd-797a-4772-b486-929e564049c6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:55.697006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8287dbdd-797a-4772-b486-929e564049c6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:55.697500 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8287dbdd-797a-4772-b486-929e564049c6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:55.698229 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8287dbdd-797a-4772-b486-929e564049c6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:55.698712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8287dbdd-797a-4772-b486-929e564049c6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:55.699122 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8287dbdd-797a-4772-b486-929e564049c6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:55.835186 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8287dbdd-797a-4772-b486-929e564049c6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:55:55.843483 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8287dbdd-797a-4772-b486-929e564049c6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10" status: 200 len: 1566 microversion: 2.1 time: 0.166489 Sep 17 21:55:55.844071 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3420/6935] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:55:55 2022] GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:55:55.866622 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d3bceb38-06dc-4fe9-aaaa-cc7fb99a84f1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:55:55.867262 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d3bceb38-06dc-4fe9-aaaa-cc7fb99a84f1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 635d8eb8-c234-4149-aff9-87e5d63dbb10] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:55:55.874867 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3bceb38-06dc-4fe9-aaaa-cc7fb99a84f1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:55.875383 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3bceb38-06dc-4fe9-aaaa-cc7fb99a84f1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:55.875843 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3bceb38-06dc-4fe9-aaaa-cc7fb99a84f1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:55.876571 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3bceb38-06dc-4fe9-aaaa-cc7fb99a84f1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:55.877048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3bceb38-06dc-4fe9-aaaa-cc7fb99a84f1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:55.877497 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d3bceb38-06dc-4fe9-aaaa-cc7fb99a84f1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:56.149599 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:55:56.175476 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=6 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:55:56.382409 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d3bceb38-06dc-4fe9-aaaa-cc7fb99a84f1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:55:56.390591 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d3bceb38-06dc-4fe9-aaaa-cc7fb99a84f1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10" status: 200 len: 1566 microversion: 2.1 time: 0.528208 Sep 17 21:55:56.391203 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3516/6936] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:55:55 2022] GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10 => generated 1566 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:55:58.310740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-c4916eb3-d950-4ebc-8fcf-8807a77d60ba req-511ecc53-c2a6-4642-bb34-d681af15a221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "635d8eb8-c234-4149-aff9-87e5d63dbb10", "tag": "8ed06fbe-512a-4d9b-ae24-dc677b4ef029"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:55:58.316659 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:55:58.320669 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a0efeaa4-9289-4c93-9dfa-38e5121af3c7 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:55:58.321296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a0efeaa4-9289-4c93-9dfa-38e5121af3c7 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 635d8eb8-c234-4149-aff9-87e5d63dbb10] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:55:58.324431 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:55:58.334465 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0efeaa4-9289-4c93-9dfa-38e5121af3c7 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:58.334961 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0efeaa4-9289-4c93-9dfa-38e5121af3c7 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:58.335400 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0efeaa4-9289-4c93-9dfa-38e5121af3c7 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:58.336112 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0efeaa4-9289-4c93-9dfa-38e5121af3c7 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:58.336767 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0efeaa4-9289-4c93-9dfa-38e5121af3c7 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:58.337201 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a0efeaa4-9289-4c93-9dfa-38e5121af3c7 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:58.343255 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c4916eb3-d950-4ebc-8fcf-8807a77d60ba req-511ecc53-c2a6-4642-bb34-d681af15a221 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:55:58.343766 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c4916eb3-d950-4ebc-8fcf-8807a77d60ba req-511ecc53-c2a6-4642-bb34-d681af15a221 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:55:58.344217 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-c4916eb3-d950-4ebc-8fcf-8807a77d60ba req-511ecc53-c2a6-4642-bb34-d681af15a221 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:55:58.357640 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-c4916eb3-d950-4ebc-8fcf-8807a77d60ba req-511ecc53-c2a6-4642-bb34-d681af15a221 service nova] Creating event network-changed:8ed06fbe-512a-4d9b-ae24-dc677b4ef029 for instance 635d8eb8-c234-4149-aff9-87e5d63dbb10 on nch1-master-1 Sep 17 21:55:58.363404 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-c4916eb3-d950-4ebc-8fcf-8807a77d60ba req-511ecc53-c2a6-4642-bb34-d681af15a221 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056164 Sep 17 21:55:58.364071 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3517/6937] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:55:58.478346 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a0efeaa4-9289-4c93-9dfa-38e5121af3c7 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:55:58.486489 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a0efeaa4-9289-4c93-9dfa-38e5121af3c7 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10" status: 200 len: 1566 microversion: 2.1 time: 0.182369 Sep 17 21:55:58.487291 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3421/6938] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:55:58 2022] GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10 => generated 1566 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:56:19.771214 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9294e0ec-b891-4499-bb9f-45f084f270e1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:56:19.774770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9294e0ec-b891-4499-bb9f-45f084f270e1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 635d8eb8-c234-4149-aff9-87e5d63dbb10] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:56:19.777868 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=36 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:56:19.778524 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:56:19.785700 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9294e0ec-b891-4499-bb9f-45f084f270e1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:19.786207 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9294e0ec-b891-4499-bb9f-45f084f270e1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:19.786664 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9294e0ec-b891-4499-bb9f-45f084f270e1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:19.787422 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9294e0ec-b891-4499-bb9f-45f084f270e1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:19.787930 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9294e0ec-b891-4499-bb9f-45f084f270e1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:19.788376 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9294e0ec-b891-4499-bb9f-45f084f270e1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:19.839377 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9294e0ec-b891-4499-bb9f-45f084f270e1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "POST /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10/action" status: 200 len: 24568 microversion: 2.1 time: 0.075972 Sep 17 21:56:19.840047 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3518/6939] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:56:19 2022] POST /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10/action => generated 24568 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:56:26.167771 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0d921441-7fdf-48fe-af24-8384d384af4d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:56:26.168712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0d921441-7fdf-48fe-af24-8384d384af4d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 635d8eb8-c234-4149-aff9-87e5d63dbb10] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:56:26.171864 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:56:26.173280 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=32 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:56:26.182815 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d921441-7fdf-48fe-af24-8384d384af4d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:26.183303 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d921441-7fdf-48fe-af24-8384d384af4d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:26.183778 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d921441-7fdf-48fe-af24-8384d384af4d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:26.184488 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d921441-7fdf-48fe-af24-8384d384af4d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:26.184948 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d921441-7fdf-48fe-af24-8384d384af4d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:26.185397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0d921441-7fdf-48fe-af24-8384d384af4d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:26.210858 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-0d921441-7fdf-48fe-af24-8384d384af4d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lazy-loading 'flavor' on Instance uuid 635d8eb8-c234-4149-aff9-87e5d63dbb10 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:56:26.280776 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0d921441-7fdf-48fe-af24-8384d384af4d tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "POST /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10/action" status: 202 len: 0 microversion: 2.1 time: 0.120078 Sep 17 21:56:26.281363 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3422/6940] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:56:26 2022] POST /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:56:26.290480 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-27fe3008-15fb-4549-93ee-3713bad23a83 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:56:26.291328 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-27fe3008-15fb-4549-93ee-3713bad23a83 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 635d8eb8-c234-4149-aff9-87e5d63dbb10] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:56:26.299055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27fe3008-15fb-4549-93ee-3713bad23a83 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:26.299589 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27fe3008-15fb-4549-93ee-3713bad23a83 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:26.300024 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27fe3008-15fb-4549-93ee-3713bad23a83 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:26.300752 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27fe3008-15fb-4549-93ee-3713bad23a83 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:26.301225 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27fe3008-15fb-4549-93ee-3713bad23a83 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:26.301703 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-27fe3008-15fb-4549-93ee-3713bad23a83 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:26.451715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-27fe3008-15fb-4549-93ee-3713bad23a83 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:56:26.463004 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-27fe3008-15fb-4549-93ee-3713bad23a83 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10" status: 200 len: 1693 microversion: 2.1 time: 0.176953 Sep 17 21:56:26.463701 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3519/6941] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:56:26 2022] GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10 => generated 1693 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:56:27.490194 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5e475438-ba4a-4729-9e4c-e95d125b74b6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:56:27.491013 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5e475438-ba4a-4729-9e4c-e95d125b74b6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 635d8eb8-c234-4149-aff9-87e5d63dbb10] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:56:27.498953 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e475438-ba4a-4729-9e4c-e95d125b74b6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:27.499533 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e475438-ba4a-4729-9e4c-e95d125b74b6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:27.500055 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e475438-ba4a-4729-9e4c-e95d125b74b6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:27.500880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e475438-ba4a-4729-9e4c-e95d125b74b6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:27.501428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e475438-ba4a-4729-9e4c-e95d125b74b6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:27.501971 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5e475438-ba4a-4729-9e4c-e95d125b74b6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:27.643062 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5e475438-ba4a-4729-9e4c-e95d125b74b6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:56:27.651747 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5e475438-ba4a-4729-9e4c-e95d125b74b6 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10" status: 200 len: 1676 microversion: 2.1 time: 0.167764 Sep 17 21:56:27.652325 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3423/6942] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:56:27 2022] GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:56:28.748847 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ee104273-59ba-435b-b32c-ea264515eba3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:56:28.751151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ee104273-59ba-435b-b32c-ea264515eba3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 635d8eb8-c234-4149-aff9-87e5d63dbb10] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:56:28.759536 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee104273-59ba-435b-b32c-ea264515eba3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:28.760049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee104273-59ba-435b-b32c-ea264515eba3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:28.760511 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee104273-59ba-435b-b32c-ea264515eba3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:28.761230 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee104273-59ba-435b-b32c-ea264515eba3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:28.761755 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee104273-59ba-435b-b32c-ea264515eba3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:28.762205 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee104273-59ba-435b-b32c-ea264515eba3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:28.813078 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ee104273-59ba-435b-b32c-ea264515eba3 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "POST /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10/action" status: 200 len: 35218 microversion: 2.1 time: 0.068251 Sep 17 21:56:28.813769 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3520/6943] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:56:28 2022] POST /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10/action => generated 35218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:56:28.826170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-aff27c13-2770-4dae-a4b5-f21fb29a4633 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:56:28.826706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-aff27c13-2770-4dae-a4b5-f21fb29a4633 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 635d8eb8-c234-4149-aff9-87e5d63dbb10] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:56:28.835161 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aff27c13-2770-4dae-a4b5-f21fb29a4633 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:28.835657 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aff27c13-2770-4dae-a4b5-f21fb29a4633 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:28.836100 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aff27c13-2770-4dae-a4b5-f21fb29a4633 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:28.836806 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aff27c13-2770-4dae-a4b5-f21fb29a4633 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:28.837265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aff27c13-2770-4dae-a4b5-f21fb29a4633 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:28.837730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-aff27c13-2770-4dae-a4b5-f21fb29a4633 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:28.911428 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-aff27c13-2770-4dae-a4b5-f21fb29a4633 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "POST /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10/action" status: 202 len: 0 microversion: 2.1 time: 0.089119 Sep 17 21:56:28.915370 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3424/6944] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:56:28 2022] POST /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:56:28.921711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ef4aee9f-f307-4da7-84d3-952ad133adce tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:56:28.922420 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ef4aee9f-f307-4da7-84d3-952ad133adce tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 635d8eb8-c234-4149-aff9-87e5d63dbb10] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:56:28.930415 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef4aee9f-f307-4da7-84d3-952ad133adce tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:28.930863 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef4aee9f-f307-4da7-84d3-952ad133adce tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:28.931485 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef4aee9f-f307-4da7-84d3-952ad133adce tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:28.932946 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef4aee9f-f307-4da7-84d3-952ad133adce tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:28.933433 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef4aee9f-f307-4da7-84d3-952ad133adce tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:28.933922 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ef4aee9f-f307-4da7-84d3-952ad133adce tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:29.081001 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ef4aee9f-f307-4da7-84d3-952ad133adce tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:56:29.090435 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ef4aee9f-f307-4da7-84d3-952ad133adce tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10" status: 200 len: 1682 microversion: 2.1 time: 0.173147 Sep 17 21:56:29.091062 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3521/6945] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:56:28 2022] GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:56:30.120726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d89dc931-1cac-46e6-8b8a-3f253a124af8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:56:30.121563 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d89dc931-1cac-46e6-8b8a-3f253a124af8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 635d8eb8-c234-4149-aff9-87e5d63dbb10] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:56:30.129082 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d89dc931-1cac-46e6-8b8a-3f253a124af8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:30.129674 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d89dc931-1cac-46e6-8b8a-3f253a124af8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:30.130174 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d89dc931-1cac-46e6-8b8a-3f253a124af8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:30.130958 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d89dc931-1cac-46e6-8b8a-3f253a124af8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:30.131466 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d89dc931-1cac-46e6-8b8a-3f253a124af8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:30.131949 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d89dc931-1cac-46e6-8b8a-3f253a124af8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:30.275047 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d89dc931-1cac-46e6-8b8a-3f253a124af8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:56:30.288740 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d89dc931-1cac-46e6-8b8a-3f253a124af8 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10" status: 200 len: 1682 microversion: 2.1 time: 0.175202 Sep 17 21:56:30.289687 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3425/6946] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:56:30 2022] GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10 => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:56:31.317759 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-444a7ecd-fd7f-42a9-ab7d-e9b4bed48579 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:56:31.318780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-444a7ecd-fd7f-42a9-ab7d-e9b4bed48579 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 635d8eb8-c234-4149-aff9-87e5d63dbb10] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:56:31.327942 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-444a7ecd-fd7f-42a9-ab7d-e9b4bed48579 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:31.328455 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-444a7ecd-fd7f-42a9-ab7d-e9b4bed48579 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:31.328921 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-444a7ecd-fd7f-42a9-ab7d-e9b4bed48579 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:31.329700 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-444a7ecd-fd7f-42a9-ab7d-e9b4bed48579 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:31.330160 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-444a7ecd-fd7f-42a9-ab7d-e9b4bed48579 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:31.330607 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-444a7ecd-fd7f-42a9-ab7d-e9b4bed48579 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:31.475579 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-444a7ecd-fd7f-42a9-ab7d-e9b4bed48579 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:56:31.483997 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-444a7ecd-fd7f-42a9-ab7d-e9b4bed48579 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10" status: 200 len: 1685 microversion: 2.1 time: 0.173039 Sep 17 21:56:31.484590 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3522/6947] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:56:31 2022] GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10 => generated 1685 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:56:31.594012 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4d840027-1367-48c8-bd94-44331becd4d2 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:56:31.596237 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4d840027-1367-48c8-bd94-44331becd4d2 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 635d8eb8-c234-4149-aff9-87e5d63dbb10] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:56:31.603483 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d840027-1367-48c8-bd94-44331becd4d2 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:31.603971 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d840027-1367-48c8-bd94-44331becd4d2 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:31.604411 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d840027-1367-48c8-bd94-44331becd4d2 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:31.605109 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d840027-1367-48c8-bd94-44331becd4d2 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:31.605632 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d840027-1367-48c8-bd94-44331becd4d2 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:31.606062 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4d840027-1367-48c8-bd94-44331becd4d2 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:31.650244 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4d840027-1367-48c8-bd94-44331becd4d2 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "POST /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10/action" status: 200 len: 35218 microversion: 2.1 time: 0.059963 Sep 17 21:56:31.650887 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3426/6948] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:56:31 2022] POST /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10/action => generated 35218 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 17 21:56:32.723191 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8258a61f-2545-4a1c-a5e0-2b6c3978b7b1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:56:32.723720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8258a61f-2545-4a1c-a5e0-2b6c3978b7b1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 635d8eb8-c234-4149-aff9-87e5d63dbb10] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:56:32.731845 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8258a61f-2545-4a1c-a5e0-2b6c3978b7b1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:32.732430 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8258a61f-2545-4a1c-a5e0-2b6c3978b7b1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:32.732944 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8258a61f-2545-4a1c-a5e0-2b6c3978b7b1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:32.733744 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8258a61f-2545-4a1c-a5e0-2b6c3978b7b1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:32.734239 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8258a61f-2545-4a1c-a5e0-2b6c3978b7b1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:32.734700 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8258a61f-2545-4a1c-a5e0-2b6c3978b7b1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:32.765425 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8258a61f-2545-4a1c-a5e0-2b6c3978b7b1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 635d8eb8-c234-4149-aff9-87e5d63dbb10] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 21:56:32.783939 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-5b9c2c89-348d-4bf1-af76-58cc866957df req-fd8cc98d-791a-4087-977d-7c3420dd9998 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "635d8eb8-c234-4149-aff9-87e5d63dbb10", "tag": "8ed06fbe-512a-4d9b-ae24-dc677b4ef029"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:56:32.807907 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-5b9c2c89-348d-4bf1-af76-58cc866957df req-fd8cc98d-791a-4087-977d-7c3420dd9998 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:32.808378 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-5b9c2c89-348d-4bf1-af76-58cc866957df req-fd8cc98d-791a-4087-977d-7c3420dd9998 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:32.809521 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-5b9c2c89-348d-4bf1-af76-58cc866957df req-fd8cc98d-791a-4087-977d-7c3420dd9998 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:32.820928 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-5b9c2c89-348d-4bf1-af76-58cc866957df req-fd8cc98d-791a-4087-977d-7c3420dd9998 service nova] Creating event network-changed:8ed06fbe-512a-4d9b-ae24-dc677b4ef029 for instance 635d8eb8-c234-4149-aff9-87e5d63dbb10 on nch1-master-1 Sep 17 21:56:32.826013 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-5b9c2c89-348d-4bf1-af76-58cc866957df req-fd8cc98d-791a-4087-977d-7c3420dd9998 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104229 Sep 17 21:56:32.826614 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3427/6949] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:56:32.851183 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8258a61f-2545-4a1c-a5e0-2b6c3978b7b1 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "DELETE /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10" status: 204 len: 0 microversion: 2.1 time: 0.131778 Sep 17 21:56:32.852020 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3523/6950] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 21:56:32 2022] DELETE /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 21:56:32.861636 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a52db5c4-7863-48b2-9716-56d640c4bafe tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:56:32.862697 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a52db5c4-7863-48b2-9716-56d640c4bafe tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 635d8eb8-c234-4149-aff9-87e5d63dbb10] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:56:32.870039 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a52db5c4-7863-48b2-9716-56d640c4bafe tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:32.870789 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a52db5c4-7863-48b2-9716-56d640c4bafe tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:32.871428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a52db5c4-7863-48b2-9716-56d640c4bafe tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:32.872360 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a52db5c4-7863-48b2-9716-56d640c4bafe tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:32.872851 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a52db5c4-7863-48b2-9716-56d640c4bafe tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:32.873270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a52db5c4-7863-48b2-9716-56d640c4bafe tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:33.009044 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a52db5c4-7863-48b2-9716-56d640c4bafe tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:56:33.017508 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a52db5c4-7863-48b2-9716-56d640c4bafe tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10" status: 200 len: 1691 microversion: 2.1 time: 0.160632 Sep 17 21:56:33.018100 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3428/6951] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:56:32 2022] GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10 => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:56:34.043286 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ee5335cf-79d8-467f-8d3c-b451e1ccd6e5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:56:34.043894 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ee5335cf-79d8-467f-8d3c-b451e1ccd6e5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 635d8eb8-c234-4149-aff9-87e5d63dbb10] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:56:34.051337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee5335cf-79d8-467f-8d3c-b451e1ccd6e5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:34.051885 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee5335cf-79d8-467f-8d3c-b451e1ccd6e5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:34.052387 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee5335cf-79d8-467f-8d3c-b451e1ccd6e5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:34.053145 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee5335cf-79d8-467f-8d3c-b451e1ccd6e5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:34.053683 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee5335cf-79d8-467f-8d3c-b451e1ccd6e5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:34.054137 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ee5335cf-79d8-467f-8d3c-b451e1ccd6e5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:34.197562 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ee5335cf-79d8-467f-8d3c-b451e1ccd6e5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:56:34.206257 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ee5335cf-79d8-467f-8d3c-b451e1ccd6e5 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10" status: 200 len: 1691 microversion: 2.1 time: 0.168012 Sep 17 21:56:34.206999 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3524/6952] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:56:34 2022] GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10 => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:56:35.084639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-8594fe7f-b23d-4713-b433-3ea917d197fe req-f402fd1a-1fb7-4f35-83db-92ae88fd597a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635d8eb8-c234-4149-aff9-87e5d63dbb10", "name": "network-vif-deleted", "tag": "8ed06fbe-512a-4d9b-ae24-dc677b4ef029"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:56:35.095743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8594fe7f-b23d-4713-b433-3ea917d197fe req-f402fd1a-1fb7-4f35-83db-92ae88fd597a service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:35.096443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8594fe7f-b23d-4713-b433-3ea917d197fe req-f402fd1a-1fb7-4f35-83db-92ae88fd597a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:35.096679 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8594fe7f-b23d-4713-b433-3ea917d197fe req-f402fd1a-1fb7-4f35-83db-92ae88fd597a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:35.109371 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-8594fe7f-b23d-4713-b433-3ea917d197fe req-f402fd1a-1fb7-4f35-83db-92ae88fd597a service nova] Creating event network-vif-deleted:8ed06fbe-512a-4d9b-ae24-dc677b4ef029 for instance 635d8eb8-c234-4149-aff9-87e5d63dbb10 on nch1-master-1 Sep 17 21:56:35.114571 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-8594fe7f-b23d-4713-b433-3ea917d197fe req-f402fd1a-1fb7-4f35-83db-92ae88fd597a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033779 Sep 17 21:56:35.115191 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3429/6953] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:56:35.229616 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b3e98867-51b9-4e29-a3d9-135bcca3b25a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:56:35.230271 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b3e98867-51b9-4e29-a3d9-135bcca3b25a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 635d8eb8-c234-4149-aff9-87e5d63dbb10] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:56:35.237446 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3e98867-51b9-4e29-a3d9-135bcca3b25a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:35.238005 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3e98867-51b9-4e29-a3d9-135bcca3b25a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:35.238581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3e98867-51b9-4e29-a3d9-135bcca3b25a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:35.239398 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3e98867-51b9-4e29-a3d9-135bcca3b25a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:35.239872 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3e98867-51b9-4e29-a3d9-135bcca3b25a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:35.240402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3e98867-51b9-4e29-a3d9-135bcca3b25a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:35.276451 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3e98867-51b9-4e29-a3d9-135bcca3b25a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:35.276960 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3e98867-51b9-4e29-a3d9-135bcca3b25a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:35.277418 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b3e98867-51b9-4e29-a3d9-135bcca3b25a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:35.277915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-b3e98867-51b9-4e29-a3d9-135bcca3b25a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lazy-loading 'fault' on Instance uuid 635d8eb8-c234-4149-aff9-87e5d63dbb10 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:56:35.324146 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b3e98867-51b9-4e29-a3d9-135bcca3b25a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0fa1f4eeca4d5e822b603953471c73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88a7205c02914d428fd0d43b7fa61fe9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:56:35.332511 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b3e98867-51b9-4e29-a3d9-135bcca3b25a tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10" status: 200 len: 1357 microversion: 2.1 time: 0.106983 Sep 17 21:56:35.333078 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3525/6954] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:56:35 2022] GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10 => generated 1357 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:56:36.356960 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-588642be-0b73-4b83-9b09-2a62fe4e1b26 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:56:36.357751 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-588642be-0b73-4b83-9b09-2a62fe4e1b26 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] [instance: 635d8eb8-c234-4149-aff9-87e5d63dbb10] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:56:36.365366 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-588642be-0b73-4b83-9b09-2a62fe4e1b26 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:36.365891 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-588642be-0b73-4b83-9b09-2a62fe4e1b26 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:36.366340 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-588642be-0b73-4b83-9b09-2a62fe4e1b26 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:36.367040 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-588642be-0b73-4b83-9b09-2a62fe4e1b26 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:36.367499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-588642be-0b73-4b83-9b09-2a62fe4e1b26 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:36.367929 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-588642be-0b73-4b83-9b09-2a62fe4e1b26 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:36.381714 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-588642be-0b73-4b83-9b09-2a62fe4e1b26 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] HTTP exception thrown: Instance 635d8eb8-c234-4149-aff9-87e5d63dbb10 could not be found. Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-588642be-0b73-4b83-9b09-2a62fe4e1b26 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Request method failure captured: Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10 HTTP/1.1 Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJkDaqrUqQ4R3Jc50dHjJrzHY0H6R9FbsHaifiKAhdbafUbvetKkTsAeXQ-XLllwkBW4TMkyFoTdjx6sRrhd61AW2D-lOJ5jM-lciJMsVlu69fHeXBQVZJqH7yfr66d0yPaxTtnH5N_36Tfpt2dvCfwMBCGXmn8-CxBhA65JgC1h0P9o Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 88a7205c02914d428fd0d43b7fa61fe9 Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1937454944 Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/88a7205c02914d428fd0d43b7fa61fe9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/88a7205c02914d428fd0d43b7fa61fe9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/88a7205c02914d428fd0d43b7fa61fe9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_88a7205c02914d428fd0d43b7fa61fe9", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1937454944 Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 88a7205c02914d428fd0d43b7fa61fe9 Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1937454944 Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-TestNetworkAdvancedServerOps-1937454944-project Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: ac0fa1f4eeca4d5e822b603953471c73 Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1937454944-project Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 635d8eb8-c234-4149-aff9-87e5d63dbb10 could not be found. Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '635d8eb8-c234-4149-aff9-87e5d63dbb10'} Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 635d8eb8-c234-4149-aff9-87e5d63dbb10 could not be found. Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 635d8eb8-c234-4149-aff9-87e5d63dbb10 could not be found. Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:56:36.383364 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 21:56:36.389272 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:56:36.389272 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 21:56:36.389272 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 21:56:36.389272 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 21:56:36.389272 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 21:56:36.389272 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 21:56:36.389272 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 635d8eb8-c234-4149-aff9-87e5d63dbb10 could not be found. Sep 17 21:56:36.389272 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 21:56:36.389272 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-588642be-0b73-4b83-9b09-2a62fe4e1b26 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Returning 404 to user: Instance 635d8eb8-c234-4149-aff9-87e5d63dbb10 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 21:56:36.389272 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-588642be-0b73-4b83-9b09-2a62fe4e1b26 tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10" status: 404 len: 111 microversion: 2.1 time: 0.032229 Sep 17 21:56:36.389272 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3430/6955] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:56:36 2022] GET /compute/v2.1/servers/635d8eb8-c234-4149-aff9-87e5d63dbb10 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 21:56:39.775797 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7d924d5a-634d-4aff-8bb4-45fedbeea20f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] Calling method '.version_select at 0x7f259ffc5670>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:56:39.809956 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7d924d5a-634d-4aff-8bb4-45fedbeea20f tempest-TestNetworkAdvancedServerOps-1937454944 tempest-TestNetworkAdvancedServerOps-1937454944-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1585853388" status: 202 len: 0 microversion: 2.1 time: 0.038764 Sep 17 21:56:39.810996 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3526/6956] 10.222.0.26 () {58 vars in 1284 bytes} [Sat Sep 17 21:56:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1585853388 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:56:51.150515 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=18 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:56:51.151670 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:56:51.349275 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b3446290-9b44-415f-8e1e-eb77b677012c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Action: 'create', calling method: .version_select at 0x7f25a47e2dc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-561521312", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElEQ4HBwJz/3DUyorZy/v7WgF0QKRA7z31UyVOYfIVTcci8tlkqfUnve6dm5CiSE/92nS4DEmFkx03u6NdKrpqH1reZiZ0UX885boqVUeVm0tJUQN+cjZkU7eyGb5007A=="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:56:51.366710 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-b3446290-9b44-415f-8e1e-eb77b677012c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Getting quotas for project 015ec23d11f64d56844d28795ccba61a. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:56:51.373169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-b3446290-9b44-415f-8e1e-eb77b677012c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Getting quotas for user 3d3bf2dacad34c0aa465968f1c273cf9 and project 015ec23d11f64d56844d28795ccba61a. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:56:51.403169 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b3446290-9b44-415f-8e1e-eb77b677012c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.258653 Sep 17 21:56:51.403883 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3431/6957] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 21:56:51 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:56:52.405997 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:56:52.406768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:56:52.410925 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2759ea62-b25d-4f5b-af69-129748e9dcb4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-445558658", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-561521312", "security_groups": [{"name": "tempest-secgroup-smoke-480323788"}], "networks": [{"uuid": "019de3bc-5d47-42c6-964c-03f1135179d6"}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:56:52.520191 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-2759ea62-b25d-4f5b-af69-129748e9dcb4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] validate_networks() for [('019de3bc-5d47-42c6-964c-03f1135179d6', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 21:56:52.938547 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-2759ea62-b25d-4f5b-af69-129748e9dcb4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 21:56:52.939267 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-2759ea62-b25d-4f5b-af69-129748e9dcb4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 21:56:52.939877 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-2759ea62-b25d-4f5b-af69-129748e9dcb4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 21:56:52.940378 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-2759ea62-b25d-4f5b-af69-129748e9dcb4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 21:56:52.941009 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-2759ea62-b25d-4f5b-af69-129748e9dcb4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 21:56:52.950630 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2759ea62-b25d-4f5b-af69-129748e9dcb4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:52.951395 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2759ea62-b25d-4f5b-af69-129748e9dcb4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:52.952400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2759ea62-b25d-4f5b-af69-129748e9dcb4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:52.953331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2759ea62-b25d-4f5b-af69-129748e9dcb4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:52.954016 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2759ea62-b25d-4f5b-af69-129748e9dcb4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:52.954462 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2759ea62-b25d-4f5b-af69-129748e9dcb4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:52.972549 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-2759ea62-b25d-4f5b-af69-129748e9dcb4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Getting quotas for project 015ec23d11f64d56844d28795ccba61a. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 21:56:52.978646 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-2759ea62-b25d-4f5b-af69-129748e9dcb4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Getting quotas for user 3d3bf2dacad34c0aa465968f1c273cf9 and project 015ec23d11f64d56844d28795ccba61a. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 21:56:52.992126 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2759ea62-b25d-4f5b-af69-129748e9dcb4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 21:56:52.994731 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2759ea62-b25d-4f5b-af69-129748e9dcb4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 21:56:53.046681 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2759ea62-b25d-4f5b-af69-129748e9dcb4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.642527 Sep 17 21:56:53.054110 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3527/6958] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 21:56:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 21:56:53.060957 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-898f9cac-3eab-4fc6-b2ff-47a53cce0e1c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:56:53.062278 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-898f9cac-3eab-4fc6-b2ff-47a53cce0e1c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:56:53.128448 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-898f9cac-3eab-4fc6-b2ff-47a53cce0e1c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:56:53.135914 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-898f9cac-3eab-4fc6-b2ff-47a53cce0e1c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1245 microversion: 2.1 time: 0.080068 Sep 17 21:56:53.136793 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3432/6959] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:56:53 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:56:54.160306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ab3da8f5-24a5-4486-ba8a-97e8e2da2518 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:56:54.161097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ab3da8f5-24a5-4486-ba8a-97e8e2da2518 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:56:54.220618 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ab3da8f5-24a5-4486-ba8a-97e8e2da2518 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:56:54.229396 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ab3da8f5-24a5-4486-ba8a-97e8e2da2518 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1245 microversion: 2.1 time: 0.073850 Sep 17 21:56:54.230121 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3528/6960] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:56:54 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1245 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:56:55.254018 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-85f3cc56-ace8-4219-bdb5-92c2a3d8d9f9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:56:55.255318 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-85f3cc56-ace8-4219-bdb5-92c2a3d8d9f9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:56:55.318199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-85f3cc56-ace8-4219-bdb5-92c2a3d8d9f9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:56:55.328227 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-85f3cc56-ace8-4219-bdb5-92c2a3d8d9f9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1245 microversion: 2.1 time: 0.077966 Sep 17 21:56:55.329820 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3433/6961] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:56:55 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:56:56.351825 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5f589b40-0f59-4d5f-b086-6ba2addc8cdb tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:56:56.352444 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5f589b40-0f59-4d5f-b086-6ba2addc8cdb tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:56:56.407570 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-5f589b40-0f59-4d5f-b086-6ba2addc8cdb tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:56:56.415085 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5f589b40-0f59-4d5f-b086-6ba2addc8cdb tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1245 microversion: 2.1 time: 0.067307 Sep 17 21:56:56.415679 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3529/6962] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:56:56 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1245 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:56:57.441668 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-32b62871-03d4-4c30-be2d-a4f92a303959 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:56:57.442717 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-32b62871-03d4-4c30-be2d-a4f92a303959 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:56:57.452206 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32b62871-03d4-4c30-be2d-a4f92a303959 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:57.452700 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32b62871-03d4-4c30-be2d-a4f92a303959 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:57.453149 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32b62871-03d4-4c30-be2d-a4f92a303959 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:57.453889 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32b62871-03d4-4c30-be2d-a4f92a303959 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:57.454375 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32b62871-03d4-4c30-be2d-a4f92a303959 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:57.454778 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-32b62871-03d4-4c30-be2d-a4f92a303959 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:57.517397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-32b62871-03d4-4c30-be2d-a4f92a303959 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:56:57.525498 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-32b62871-03d4-4c30-be2d-a4f92a303959 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1249 microversion: 2.1 time: 0.090438 Sep 17 21:56:57.526116 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3434/6963] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:56:57 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1249 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:56:58.548754 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cd285519-c51f-48bb-96e0-d7db5f64a042 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:56:58.549422 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cd285519-c51f-48bb-96e0-d7db5f64a042 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:56:58.559888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd285519-c51f-48bb-96e0-d7db5f64a042 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:58.560469 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd285519-c51f-48bb-96e0-d7db5f64a042 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:58.561044 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd285519-c51f-48bb-96e0-d7db5f64a042 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:58.561903 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd285519-c51f-48bb-96e0-d7db5f64a042 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:58.562826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd285519-c51f-48bb-96e0-d7db5f64a042 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:58.563684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cd285519-c51f-48bb-96e0-d7db5f64a042 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:58.626674 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cd285519-c51f-48bb-96e0-d7db5f64a042 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:56:58.635021 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cd285519-c51f-48bb-96e0-d7db5f64a042 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1303 microversion: 2.1 time: 0.090475 Sep 17 21:56:58.635609 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3530/6964] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:56:58 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1303 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:56:59.659434 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-c23d8f54-06d4-4aff-8d51-56c6f76998eb tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:56:59.660029 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-c23d8f54-06d4-4aff-8d51-56c6f76998eb tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:56:59.668056 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c23d8f54-06d4-4aff-8d51-56c6f76998eb tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:59.668558 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c23d8f54-06d4-4aff-8d51-56c6f76998eb tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:59.668972 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c23d8f54-06d4-4aff-8d51-56c6f76998eb tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:59.669727 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c23d8f54-06d4-4aff-8d51-56c6f76998eb tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:59.670459 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c23d8f54-06d4-4aff-8d51-56c6f76998eb tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:59.670853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-c23d8f54-06d4-4aff-8d51-56c6f76998eb tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:59.780464 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-f62712df-743a-412a-b6eb-87df394f63cf req-a05019f9-b7d0-4fe4-b671-faae051d3c18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc977f3b-964f-40cc-bc18-1e8751a9ce58", "tag": "daef4943-1770-46f5-bc94-44d1cf23daa4"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:56:59.824354 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-c23d8f54-06d4-4aff-8d51-56c6f76998eb tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:56:59.829785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f62712df-743a-412a-b6eb-87df394f63cf req-a05019f9-b7d0-4fe4-b671-faae051d3c18 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:56:59.830387 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f62712df-743a-412a-b6eb-87df394f63cf req-a05019f9-b7d0-4fe4-b671-faae051d3c18 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:56:59.833350 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-c23d8f54-06d4-4aff-8d51-56c6f76998eb tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1370 microversion: 2.1 time: 0.177994 Sep 17 21:56:59.834072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f62712df-743a-412a-b6eb-87df394f63cf req-a05019f9-b7d0-4fe4-b671-faae051d3c18 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:56:59.834669 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3435/6965] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:56:59 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:56:59.851911 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-f62712df-743a-412a-b6eb-87df394f63cf req-a05019f9-b7d0-4fe4-b671-faae051d3c18 service nova] Creating event network-changed:daef4943-1770-46f5-bc94-44d1cf23daa4 for instance cc977f3b-964f-40cc-bc18-1e8751a9ce58 on nch2-master-1 Sep 17 21:56:59.857225 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-f62712df-743a-412a-b6eb-87df394f63cf req-a05019f9-b7d0-4fe4-b671-faae051d3c18 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082073 Sep 17 21:56:59.857973 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3531/6966] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:57:00.856667 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-95d3686e-e3ab-464c-a3d2-b259f6f73138 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:57:00.857294 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-95d3686e-e3ab-464c-a3d2-b259f6f73138 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:57:00.864760 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95d3686e-e3ab-464c-a3d2-b259f6f73138 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:57:00.865257 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95d3686e-e3ab-464c-a3d2-b259f6f73138 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:57:00.865750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95d3686e-e3ab-464c-a3d2-b259f6f73138 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:57:00.866457 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95d3686e-e3ab-464c-a3d2-b259f6f73138 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:57:00.866920 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95d3686e-e3ab-464c-a3d2-b259f6f73138 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:57:00.867356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-95d3686e-e3ab-464c-a3d2-b259f6f73138 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:57:01.008771 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-95d3686e-e3ab-464c-a3d2-b259f6f73138 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:57:01.017220 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-95d3686e-e3ab-464c-a3d2-b259f6f73138 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1370 microversion: 2.1 time: 0.164571 Sep 17 21:57:01.017827 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3436/6967] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:57:00 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:57:02.044780 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d32eb303-6297-405b-ab51-e8ae93ce42d6 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:57:02.045560 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d32eb303-6297-405b-ab51-e8ae93ce42d6 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:57:02.052375 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d32eb303-6297-405b-ab51-e8ae93ce42d6 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:57:02.052912 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d32eb303-6297-405b-ab51-e8ae93ce42d6 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:57:02.053371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d32eb303-6297-405b-ab51-e8ae93ce42d6 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:57:02.054132 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d32eb303-6297-405b-ab51-e8ae93ce42d6 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:57:02.054611 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d32eb303-6297-405b-ab51-e8ae93ce42d6 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:57:02.055112 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d32eb303-6297-405b-ab51-e8ae93ce42d6 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:57:02.196666 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d32eb303-6297-405b-ab51-e8ae93ce42d6 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:57:02.205036 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d32eb303-6297-405b-ab51-e8ae93ce42d6 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1370 microversion: 2.1 time: 0.166600 Sep 17 21:57:02.205652 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3532/6968] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:57:02 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:57:03.232556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8e4c985b-ed09-4bca-b41a-9cbb6ad90c90 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:57:03.233479 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8e4c985b-ed09-4bca-b41a-9cbb6ad90c90 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:57:03.244621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8e4c985b-ed09-4bca-b41a-9cbb6ad90c90 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:57:03.245150 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8e4c985b-ed09-4bca-b41a-9cbb6ad90c90 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:57:03.245628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8e4c985b-ed09-4bca-b41a-9cbb6ad90c90 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:57:03.246331 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8e4c985b-ed09-4bca-b41a-9cbb6ad90c90 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:57:03.246783 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8e4c985b-ed09-4bca-b41a-9cbb6ad90c90 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:57:03.247210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8e4c985b-ed09-4bca-b41a-9cbb6ad90c90 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:57:03.387568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8e4c985b-ed09-4bca-b41a-9cbb6ad90c90 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:57:03.395476 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8e4c985b-ed09-4bca-b41a-9cbb6ad90c90 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1370 microversion: 2.1 time: 0.169689 Sep 17 21:57:03.396053 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3437/6969] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:57:03 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:57:04.288689 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-4a758671-1393-4ca1-b045-8726575b5197 req-c44390bb-3885-4956-a061-ea1259fb969b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc977f3b-964f-40cc-bc18-1e8751a9ce58", "name": "network-vif-plugged", "status": "completed", "tag": "daef4943-1770-46f5-bc94-44d1cf23daa4"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:57:04.296360 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:57:04.303601 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4a758671-1393-4ca1-b045-8726575b5197 req-c44390bb-3885-4956-a061-ea1259fb969b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:57:04.304109 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4a758671-1393-4ca1-b045-8726575b5197 req-c44390bb-3885-4956-a061-ea1259fb969b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:57:04.304566 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-4a758671-1393-4ca1-b045-8726575b5197 req-c44390bb-3885-4956-a061-ea1259fb969b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:57:04.317608 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-4a758671-1393-4ca1-b045-8726575b5197 req-c44390bb-3885-4956-a061-ea1259fb969b service nova] Creating event network-vif-plugged:daef4943-1770-46f5-bc94-44d1cf23daa4 for instance cc977f3b-964f-40cc-bc18-1e8751a9ce58 on nch2-master-1 Sep 17 21:57:04.322762 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-4a758671-1393-4ca1-b045-8726575b5197 req-c44390bb-3885-4956-a061-ea1259fb969b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038819 Sep 17 21:57:04.323555 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3533/6970] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:57:04.419449 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9e6314f9-86db-4217-b90b-87ddfc1909cc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:57:04.420059 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9e6314f9-86db-4217-b90b-87ddfc1909cc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:57:04.427084 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e6314f9-86db-4217-b90b-87ddfc1909cc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:57:04.427585 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e6314f9-86db-4217-b90b-87ddfc1909cc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:57:04.428032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e6314f9-86db-4217-b90b-87ddfc1909cc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:57:04.428749 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e6314f9-86db-4217-b90b-87ddfc1909cc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:57:04.429214 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e6314f9-86db-4217-b90b-87ddfc1909cc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:57:04.429701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e6314f9-86db-4217-b90b-87ddfc1909cc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:57:04.560350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9e6314f9-86db-4217-b90b-87ddfc1909cc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:57:04.568761 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9e6314f9-86db-4217-b90b-87ddfc1909cc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1370 microversion: 2.1 time: 0.153882 Sep 17 21:57:04.569366 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3438/6971] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:57:04 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:57:05.595676 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-eebe51f0-a435-43fb-910f-6aeab26d3c3e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:57:05.596323 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-eebe51f0-a435-43fb-910f-6aeab26d3c3e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:57:05.602906 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eebe51f0-a435-43fb-910f-6aeab26d3c3e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:57:05.603416 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eebe51f0-a435-43fb-910f-6aeab26d3c3e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:57:05.603870 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eebe51f0-a435-43fb-910f-6aeab26d3c3e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:57:05.604587 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eebe51f0-a435-43fb-910f-6aeab26d3c3e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:57:05.605058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eebe51f0-a435-43fb-910f-6aeab26d3c3e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:57:05.605521 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-eebe51f0-a435-43fb-910f-6aeab26d3c3e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:57:05.755377 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-eebe51f0-a435-43fb-910f-6aeab26d3c3e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:57:05.764403 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-eebe51f0-a435-43fb-910f-6aeab26d3c3e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1555 microversion: 2.1 time: 0.175541 Sep 17 21:57:05.764974 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3534/6972] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:57:05 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1555 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:57:05.804493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1b1bf03a-a5ec-4664-b1fb-7c00ec5f1abf tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:57:05.805093 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1b1bf03a-a5ec-4664-b1fb-7c00ec5f1abf tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:57:05.807133 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=8 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:57:05.813943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b1bf03a-a5ec-4664-b1fb-7c00ec5f1abf tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:57:05.814431 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b1bf03a-a5ec-4664-b1fb-7c00ec5f1abf tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:57:05.814872 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b1bf03a-a5ec-4664-b1fb-7c00ec5f1abf tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:57:05.815581 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b1bf03a-a5ec-4664-b1fb-7c00ec5f1abf tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:57:05.816033 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b1bf03a-a5ec-4664-b1fb-7c00ec5f1abf tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:57:05.816458 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1b1bf03a-a5ec-4664-b1fb-7c00ec5f1abf tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:57:05.957367 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1b1bf03a-a5ec-4664-b1fb-7c00ec5f1abf tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:57:05.966176 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1b1bf03a-a5ec-4664-b1fb-7c00ec5f1abf tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1555 microversion: 2.1 time: 0.165668 Sep 17 21:57:05.966755 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3439/6973] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:57:05 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:57:07.721862 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-b8a4902f-917e-42a4-a586-d70758bb7453 req-9d50049c-8878-4c0b-bea5-cdf427d2da46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc977f3b-964f-40cc-bc18-1e8751a9ce58", "tag": "daef4943-1770-46f5-bc94-44d1cf23daa4"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:57:07.726822 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=10 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:57:07.733671 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b8a4902f-917e-42a4-a586-d70758bb7453 req-9d50049c-8878-4c0b-bea5-cdf427d2da46 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:57:07.734164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b8a4902f-917e-42a4-a586-d70758bb7453 req-9d50049c-8878-4c0b-bea5-cdf427d2da46 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:57:07.734615 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-b8a4902f-917e-42a4-a586-d70758bb7453 req-9d50049c-8878-4c0b-bea5-cdf427d2da46 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:57:07.749450 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-b8a4902f-917e-42a4-a586-d70758bb7453 req-9d50049c-8878-4c0b-bea5-cdf427d2da46 service nova] Creating event network-changed:daef4943-1770-46f5-bc94-44d1cf23daa4 for instance cc977f3b-964f-40cc-bc18-1e8751a9ce58 on nch2-master-1 Sep 17 21:57:07.754774 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-b8a4902f-917e-42a4-a586-d70758bb7453 req-9d50049c-8878-4c0b-bea5-cdf427d2da46 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036747 Sep 17 21:57:07.755497 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3535/6974] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:57:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:59:04.899698 ncdv-master-1 devstack@n-api.service[140523]: ERROR oslo.messaging._drivers.impl_rabbit [-] [43af6626-5086-4256-806a-0090082f769c] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 17 21:59:04.900719 ncdv-master-1 devstack@n-api.service[140523]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eb955ca7-44ca-4d87-9bde-78c4d0a94e44] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 17 21:59:04.901673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:59:04.902572 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=36 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:59:04.904460 ncdv-master-1 devstack@n-api.service[140523]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 17 21:59:04.904674 ncdv-master-1 devstack@n-api.service[140523]: Sat Sep 17 21:59:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58/action (ip 10.222.0.26) !!! Sep 17 21:59:04.909816 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0bd02f16-a4a5-43b1-80a6-932aca529335 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:59:04.910408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0bd02f16-a4a5-43b1-80a6-932aca529335 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:04.923132 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0bd02f16-a4a5-43b1-80a6-932aca529335 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:04.923628 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0bd02f16-a4a5-43b1-80a6-932aca529335 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:04.924069 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0bd02f16-a4a5-43b1-80a6-932aca529335 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:04.924766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0bd02f16-a4a5-43b1-80a6-932aca529335 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:04.925218 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0bd02f16-a4a5-43b1-80a6-932aca529335 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:04.925711 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0bd02f16-a4a5-43b1-80a6-932aca529335 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:04.949899 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-0bd02f16-a4a5-43b1-80a6-932aca529335 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lazy-loading 'flavor' on Instance uuid cc977f3b-964f-40cc-bc18-1e8751a9ce58 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 21:59:05.253004 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0bd02f16-a4a5-43b1-80a6-932aca529335 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "POST /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58/action" status: 202 len: 0 microversion: 2.1 time: 0.355074 Sep 17 21:59:05.253685 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3440/6975] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:59:04 2022] POST /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:59:05.260853 ncdv-master-1 devstack@n-api.service[140524]: ERROR oslo.messaging._drivers.impl_rabbit [-] [04285588-4085-42d9-ae87-82f4a29bd916] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 17 21:59:05.261704 ncdv-master-1 devstack@n-api.service[140524]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0c677b88-ed69-4f5f-b874-71db171b23f2] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 17 21:59:05.262264 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:59:05.263082 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=26 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:59:05.264336 ncdv-master-1 devstack@n-api.service[140524]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 17 21:59:05.264551 ncdv-master-1 devstack@n-api.service[140524]: Sat Sep 17 21:59:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 (ip 10.222.0.26) !!! Sep 17 21:59:05.271201 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1bdb6f57-dfe3-46f8-95d3-8b73b85e43e8 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:05.271938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1bdb6f57-dfe3-46f8-95d3-8b73b85e43e8 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:05.281274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1bdb6f57-dfe3-46f8-95d3-8b73b85e43e8 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:05.281808 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1bdb6f57-dfe3-46f8-95d3-8b73b85e43e8 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:05.282274 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1bdb6f57-dfe3-46f8-95d3-8b73b85e43e8 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:05.283061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1bdb6f57-dfe3-46f8-95d3-8b73b85e43e8 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:05.283631 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1bdb6f57-dfe3-46f8-95d3-8b73b85e43e8 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:05.284112 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1bdb6f57-dfe3-46f8-95d3-8b73b85e43e8 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:05.476769 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1bdb6f57-dfe3-46f8-95d3-8b73b85e43e8 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:05.485217 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1bdb6f57-dfe3-46f8-95d3-8b73b85e43e8 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1679 microversion: 2.1 time: 0.226351 Sep 17 21:59:05.485849 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3536/6976] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:05 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1679 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:06.519124 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-081d9064-2bb9-4b25-837d-f7b09a1502c4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:06.520281 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-081d9064-2bb9-4b25-837d-f7b09a1502c4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:06.534844 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-081d9064-2bb9-4b25-837d-f7b09a1502c4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:06.535350 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-081d9064-2bb9-4b25-837d-f7b09a1502c4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:06.535795 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-081d9064-2bb9-4b25-837d-f7b09a1502c4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:06.536511 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-081d9064-2bb9-4b25-837d-f7b09a1502c4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:06.537013 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-081d9064-2bb9-4b25-837d-f7b09a1502c4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:06.537613 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-081d9064-2bb9-4b25-837d-f7b09a1502c4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:06.542223 ncdv-master-1 devstack@n-api.service[140523]: INFO oslo.messaging._drivers.impl_rabbit [-] [43af6626-5086-4256-806a-0090082f769c] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 56012. Sep 17 21:59:06.544450 ncdv-master-1 devstack@n-api.service[140523]: INFO oslo.messaging._drivers.impl_rabbit [-] [eb955ca7-44ca-4d87-9bde-78c4d0a94e44] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 56014. Sep 17 21:59:06.674462 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-081d9064-2bb9-4b25-837d-f7b09a1502c4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:06.682715 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-081d9064-2bb9-4b25-837d-f7b09a1502c4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1679 microversion: 2.1 time: 0.176250 Sep 17 21:59:06.683309 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3441/6977] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:06 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:07.707965 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9bbc044a-6d29-4c1f-8597-fd59f5fb2681 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:07.708602 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9bbc044a-6d29-4c1f-8597-fd59f5fb2681 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:07.718809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9bbc044a-6d29-4c1f-8597-fd59f5fb2681 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:07.719324 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9bbc044a-6d29-4c1f-8597-fd59f5fb2681 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:07.719782 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9bbc044a-6d29-4c1f-8597-fd59f5fb2681 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:07.720542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9bbc044a-6d29-4c1f-8597-fd59f5fb2681 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:07.721023 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9bbc044a-6d29-4c1f-8597-fd59f5fb2681 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:07.721499 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9bbc044a-6d29-4c1f-8597-fd59f5fb2681 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:07.729276 ncdv-master-1 devstack@n-api.service[140524]: INFO oslo.messaging._drivers.impl_rabbit [-] [0c677b88-ed69-4f5f-b874-71db171b23f2] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 56020. Sep 17 21:59:07.740237 ncdv-master-1 devstack@n-api.service[140524]: INFO oslo.messaging._drivers.impl_rabbit [-] [04285588-4085-42d9-ae87-82f4a29bd916] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 56018. Sep 17 21:59:07.865762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9bbc044a-6d29-4c1f-8597-fd59f5fb2681 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:07.873909 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9bbc044a-6d29-4c1f-8597-fd59f5fb2681 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1679 microversion: 2.1 time: 0.170010 Sep 17 21:59:07.874500 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3537/6978] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:07 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:08.901901 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b50e4cbc-969f-4c6d-af9a-28a2615c593f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:08.902979 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b50e4cbc-969f-4c6d-af9a-28a2615c593f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:08.911006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b50e4cbc-969f-4c6d-af9a-28a2615c593f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:08.911499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b50e4cbc-969f-4c6d-af9a-28a2615c593f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:08.911943 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b50e4cbc-969f-4c6d-af9a-28a2615c593f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:08.912652 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b50e4cbc-969f-4c6d-af9a-28a2615c593f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:08.913115 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b50e4cbc-969f-4c6d-af9a-28a2615c593f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:08.913578 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b50e4cbc-969f-4c6d-af9a-28a2615c593f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:09.049549 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b50e4cbc-969f-4c6d-af9a-28a2615c593f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:09.057772 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b50e4cbc-969f-4c6d-af9a-28a2615c593f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1679 microversion: 2.1 time: 0.162489 Sep 17 21:59:09.058503 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3442/6979] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:08 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:10.083276 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4b833824-09df-43ec-aa53-aa5fc30f9d6c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:10.083853 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4b833824-09df-43ec-aa53-aa5fc30f9d6c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:10.091354 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b833824-09df-43ec-aa53-aa5fc30f9d6c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:10.091859 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b833824-09df-43ec-aa53-aa5fc30f9d6c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:10.092318 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b833824-09df-43ec-aa53-aa5fc30f9d6c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:10.093040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b833824-09df-43ec-aa53-aa5fc30f9d6c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:10.093586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b833824-09df-43ec-aa53-aa5fc30f9d6c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:10.094029 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4b833824-09df-43ec-aa53-aa5fc30f9d6c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:10.229436 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4b833824-09df-43ec-aa53-aa5fc30f9d6c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:10.237710 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4b833824-09df-43ec-aa53-aa5fc30f9d6c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1679 microversion: 2.1 time: 0.158603 Sep 17 21:59:10.238299 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3538/6980] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:10 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:11.270680 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b5752004-7ba2-4e53-987e-c30fa1224efe tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:11.271635 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b5752004-7ba2-4e53-987e-c30fa1224efe tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:11.282119 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b5752004-7ba2-4e53-987e-c30fa1224efe tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:11.282613 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b5752004-7ba2-4e53-987e-c30fa1224efe tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:11.283053 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b5752004-7ba2-4e53-987e-c30fa1224efe tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:11.283761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b5752004-7ba2-4e53-987e-c30fa1224efe tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:11.284219 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b5752004-7ba2-4e53-987e-c30fa1224efe tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:11.284657 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b5752004-7ba2-4e53-987e-c30fa1224efe tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:11.424409 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b5752004-7ba2-4e53-987e-c30fa1224efe tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:11.436855 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b5752004-7ba2-4e53-987e-c30fa1224efe tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1679 microversion: 2.1 time: 0.171994 Sep 17 21:59:11.437797 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3443/6981] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:11 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:12.467887 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1683e961-6696-4759-b02c-5b4af008640f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:12.468635 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1683e961-6696-4759-b02c-5b4af008640f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:12.476327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1683e961-6696-4759-b02c-5b4af008640f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:12.476879 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1683e961-6696-4759-b02c-5b4af008640f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:12.477332 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1683e961-6696-4759-b02c-5b4af008640f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:12.478161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1683e961-6696-4759-b02c-5b4af008640f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:12.478632 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1683e961-6696-4759-b02c-5b4af008640f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:12.479073 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1683e961-6696-4759-b02c-5b4af008640f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:12.620461 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1683e961-6696-4759-b02c-5b4af008640f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:12.629003 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1683e961-6696-4759-b02c-5b4af008640f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1679 microversion: 2.1 time: 0.166116 Sep 17 21:59:12.629586 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3539/6982] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:12 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:13.652732 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0a1e60f1-8faa-4dc0-afd9-82d266ceda6d tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:13.653363 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0a1e60f1-8faa-4dc0-afd9-82d266ceda6d tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:13.660992 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0a1e60f1-8faa-4dc0-afd9-82d266ceda6d tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:13.661575 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0a1e60f1-8faa-4dc0-afd9-82d266ceda6d tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:13.662038 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0a1e60f1-8faa-4dc0-afd9-82d266ceda6d tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:13.662750 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0a1e60f1-8faa-4dc0-afd9-82d266ceda6d tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:13.663203 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0a1e60f1-8faa-4dc0-afd9-82d266ceda6d tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:13.663631 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0a1e60f1-8faa-4dc0-afd9-82d266ceda6d tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:13.804585 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0a1e60f1-8faa-4dc0-afd9-82d266ceda6d tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:13.812694 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0a1e60f1-8faa-4dc0-afd9-82d266ceda6d tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1679 microversion: 2.1 time: 0.164082 Sep 17 21:59:13.813246 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3444/6983] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:13 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:14.839438 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d51a263f-a90f-4c52-b241-9cc5141a159c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:14.840205 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d51a263f-a90f-4c52-b241-9cc5141a159c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:14.848497 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d51a263f-a90f-4c52-b241-9cc5141a159c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:14.849009 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d51a263f-a90f-4c52-b241-9cc5141a159c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:14.849496 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d51a263f-a90f-4c52-b241-9cc5141a159c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:14.850219 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d51a263f-a90f-4c52-b241-9cc5141a159c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:14.850695 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d51a263f-a90f-4c52-b241-9cc5141a159c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:14.851139 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d51a263f-a90f-4c52-b241-9cc5141a159c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:14.988883 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d51a263f-a90f-4c52-b241-9cc5141a159c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:15.001273 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d51a263f-a90f-4c52-b241-9cc5141a159c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1679 microversion: 2.1 time: 0.167488 Sep 17 21:59:15.001898 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3540/6984] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:14 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:16.025336 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e182eedf-f45d-4de8-bac7-98be46f25bfc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:16.026242 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e182eedf-f45d-4de8-bac7-98be46f25bfc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:16.034287 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e182eedf-f45d-4de8-bac7-98be46f25bfc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:16.034791 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e182eedf-f45d-4de8-bac7-98be46f25bfc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:16.035236 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e182eedf-f45d-4de8-bac7-98be46f25bfc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:16.035945 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e182eedf-f45d-4de8-bac7-98be46f25bfc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:16.036406 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e182eedf-f45d-4de8-bac7-98be46f25bfc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:16.036841 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e182eedf-f45d-4de8-bac7-98be46f25bfc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:16.189857 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e182eedf-f45d-4de8-bac7-98be46f25bfc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:16.198306 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e182eedf-f45d-4de8-bac7-98be46f25bfc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1700 microversion: 2.1 time: 0.177255 Sep 17 21:59:16.198897 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3445/6985] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:16 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1700 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:17.222976 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-119d4f5d-0fb9-49ec-aaf7-6f0dfa117453 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:17.223570 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-119d4f5d-0fb9-49ec-aaf7-6f0dfa117453 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:17.231056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-119d4f5d-0fb9-49ec-aaf7-6f0dfa117453 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:17.231567 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-119d4f5d-0fb9-49ec-aaf7-6f0dfa117453 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:17.232007 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-119d4f5d-0fb9-49ec-aaf7-6f0dfa117453 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:17.232760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-119d4f5d-0fb9-49ec-aaf7-6f0dfa117453 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:17.233239 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-119d4f5d-0fb9-49ec-aaf7-6f0dfa117453 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:17.233714 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-119d4f5d-0fb9-49ec-aaf7-6f0dfa117453 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:17.391450 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-119d4f5d-0fb9-49ec-aaf7-6f0dfa117453 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:17.399797 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-119d4f5d-0fb9-49ec-aaf7-6f0dfa117453 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1700 microversion: 2.1 time: 0.181178 Sep 17 21:59:17.400389 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3541/6986] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:17 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1700 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:18.431985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9e0a65dc-fc7d-49aa-8569-0dffe64789cc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:18.432883 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9e0a65dc-fc7d-49aa-8569-0dffe64789cc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:18.440231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e0a65dc-fc7d-49aa-8569-0dffe64789cc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:18.440711 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e0a65dc-fc7d-49aa-8569-0dffe64789cc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:18.441362 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e0a65dc-fc7d-49aa-8569-0dffe64789cc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:18.442098 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e0a65dc-fc7d-49aa-8569-0dffe64789cc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:18.442587 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e0a65dc-fc7d-49aa-8569-0dffe64789cc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:18.443181 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9e0a65dc-fc7d-49aa-8569-0dffe64789cc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:18.604841 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9e0a65dc-fc7d-49aa-8569-0dffe64789cc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:18.613814 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9e0a65dc-fc7d-49aa-8569-0dffe64789cc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1695 microversion: 2.1 time: 0.185726 Sep 17 21:59:18.629494 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3446/6987] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:18 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1695 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:18.907966 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-87609b88-5187-45b5-bfa1-4a6d5029818b req-4158e276-3fa4-4d11-8f6c-df1af60c1bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc977f3b-964f-40cc-bc18-1e8751a9ce58", "name": "network-vif-plugged", "status": "completed", "tag": "daef4943-1770-46f5-bc94-44d1cf23daa4"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:59:18.933962 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-87609b88-5187-45b5-bfa1-4a6d5029818b req-4158e276-3fa4-4d11-8f6c-df1af60c1bf1 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:18.934472 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-87609b88-5187-45b5-bfa1-4a6d5029818b req-4158e276-3fa4-4d11-8f6c-df1af60c1bf1 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:18.934916 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-87609b88-5187-45b5-bfa1-4a6d5029818b req-4158e276-3fa4-4d11-8f6c-df1af60c1bf1 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:18.956181 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-87609b88-5187-45b5-bfa1-4a6d5029818b req-4158e276-3fa4-4d11-8f6c-df1af60c1bf1 service nova] Creating event network-vif-plugged:daef4943-1770-46f5-bc94-44d1cf23daa4 for instance cc977f3b-964f-40cc-bc18-1e8751a9ce58 on nch2-master-1 Sep 17 21:59:18.963911 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-87609b88-5187-45b5-bfa1-4a6d5029818b req-4158e276-3fa4-4d11-8f6c-df1af60c1bf1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059549 Sep 17 21:59:18.966295 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3542/6988] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:59:19.638323 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-83989b0d-9236-40ee-bf81-77e83bd9df9b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:19.639065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-83989b0d-9236-40ee-bf81-77e83bd9df9b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:19.647145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-83989b0d-9236-40ee-bf81-77e83bd9df9b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:19.647672 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-83989b0d-9236-40ee-bf81-77e83bd9df9b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:19.648114 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-83989b0d-9236-40ee-bf81-77e83bd9df9b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:19.648957 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-83989b0d-9236-40ee-bf81-77e83bd9df9b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:19.649555 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-83989b0d-9236-40ee-bf81-77e83bd9df9b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:19.649973 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-83989b0d-9236-40ee-bf81-77e83bd9df9b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:19.808843 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-83989b0d-9236-40ee-bf81-77e83bd9df9b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:19.818366 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-83989b0d-9236-40ee-bf81-77e83bd9df9b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1695 microversion: 2.1 time: 0.183956 Sep 17 21:59:19.819546 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3447/6989] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:19 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1695 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:20.845055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e9479d37-4909-4daf-9f5e-25796bd62172 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:20.845903 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e9479d37-4909-4daf-9f5e-25796bd62172 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:20.853586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9479d37-4909-4daf-9f5e-25796bd62172 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:20.854090 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9479d37-4909-4daf-9f5e-25796bd62172 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:20.854561 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9479d37-4909-4daf-9f5e-25796bd62172 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:20.855339 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9479d37-4909-4daf-9f5e-25796bd62172 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:20.856592 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9479d37-4909-4daf-9f5e-25796bd62172 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:20.857058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e9479d37-4909-4daf-9f5e-25796bd62172 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:21.024939 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e9479d37-4909-4daf-9f5e-25796bd62172 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:21.034841 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e9479d37-4909-4daf-9f5e-25796bd62172 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1695 microversion: 2.1 time: 0.195589 Sep 17 21:59:21.035431 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3543/6990] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:20 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1695 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:22.058609 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f655022d-160e-4a63-a09a-826704f5f353 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:22.059231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f655022d-160e-4a63-a09a-826704f5f353 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:22.071679 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f655022d-160e-4a63-a09a-826704f5f353 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:22.072319 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f655022d-160e-4a63-a09a-826704f5f353 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:22.073322 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f655022d-160e-4a63-a09a-826704f5f353 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:22.074448 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f655022d-160e-4a63-a09a-826704f5f353 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:22.075271 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f655022d-160e-4a63-a09a-826704f5f353 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:22.075703 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f655022d-160e-4a63-a09a-826704f5f353 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:22.249376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f655022d-160e-4a63-a09a-826704f5f353 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:22.259323 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f655022d-160e-4a63-a09a-826704f5f353 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1695 microversion: 2.1 time: 0.204609 Sep 17 21:59:22.259918 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3448/6991] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:22 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1695 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:23.283948 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-61adaa95-10a1-45fe-bc4c-243658b0b4f0 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:23.285451 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-61adaa95-10a1-45fe-bc4c-243658b0b4f0 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:23.293002 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-61adaa95-10a1-45fe-bc4c-243658b0b4f0 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:23.293850 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-61adaa95-10a1-45fe-bc4c-243658b0b4f0 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:23.294365 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-61adaa95-10a1-45fe-bc4c-243658b0b4f0 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:23.295369 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-61adaa95-10a1-45fe-bc4c-243658b0b4f0 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:23.295902 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-61adaa95-10a1-45fe-bc4c-243658b0b4f0 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:23.296737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-61adaa95-10a1-45fe-bc4c-243658b0b4f0 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:23.452678 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-61adaa95-10a1-45fe-bc4c-243658b0b4f0 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:23.462007 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-61adaa95-10a1-45fe-bc4c-243658b0b4f0 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1695 microversion: 2.1 time: 0.182269 Sep 17 21:59:23.471163 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3544/6992] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:23 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1695 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:24.486087 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8d44e4f4-b73e-47ce-bf25-b2684e858767 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:24.486696 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8d44e4f4-b73e-47ce-bf25-b2684e858767 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:24.494259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8d44e4f4-b73e-47ce-bf25-b2684e858767 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:24.494856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8d44e4f4-b73e-47ce-bf25-b2684e858767 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:24.495356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8d44e4f4-b73e-47ce-bf25-b2684e858767 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:24.496138 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8d44e4f4-b73e-47ce-bf25-b2684e858767 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:24.496606 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8d44e4f4-b73e-47ce-bf25-b2684e858767 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:24.497058 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8d44e4f4-b73e-47ce-bf25-b2684e858767 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:24.647939 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8d44e4f4-b73e-47ce-bf25-b2684e858767 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:24.656450 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8d44e4f4-b73e-47ce-bf25-b2684e858767 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1695 microversion: 2.1 time: 0.174684 Sep 17 21:59:24.657856 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3449/6993] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:24 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1695 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:25.680888 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4e314f25-9c02-48f7-be74-f4a17bf5030b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:25.683533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4e314f25-9c02-48f7-be74-f4a17bf5030b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:25.689196 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e314f25-9c02-48f7-be74-f4a17bf5030b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:25.690027 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e314f25-9c02-48f7-be74-f4a17bf5030b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:25.690573 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e314f25-9c02-48f7-be74-f4a17bf5030b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:25.691384 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e314f25-9c02-48f7-be74-f4a17bf5030b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:25.691952 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e314f25-9c02-48f7-be74-f4a17bf5030b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:25.692479 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4e314f25-9c02-48f7-be74-f4a17bf5030b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:25.845366 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4e314f25-9c02-48f7-be74-f4a17bf5030b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:25.854587 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4e314f25-9c02-48f7-be74-f4a17bf5030b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1695 microversion: 2.1 time: 0.178044 Sep 17 21:59:25.855422 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3545/6994] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:25 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1695 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:26.877714 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-53ea7b99-7d45-4c0d-bbda-2c1a214bffa2 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:26.878332 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-53ea7b99-7d45-4c0d-bbda-2c1a214bffa2 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:26.886367 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53ea7b99-7d45-4c0d-bbda-2c1a214bffa2 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:26.887219 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53ea7b99-7d45-4c0d-bbda-2c1a214bffa2 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:26.887869 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53ea7b99-7d45-4c0d-bbda-2c1a214bffa2 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:26.888956 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53ea7b99-7d45-4c0d-bbda-2c1a214bffa2 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:26.889412 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53ea7b99-7d45-4c0d-bbda-2c1a214bffa2 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:26.889865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-53ea7b99-7d45-4c0d-bbda-2c1a214bffa2 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:27.040860 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-53ea7b99-7d45-4c0d-bbda-2c1a214bffa2 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:27.049565 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-53ea7b99-7d45-4c0d-bbda-2c1a214bffa2 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1695 microversion: 2.1 time: 0.175918 Sep 17 21:59:27.065828 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3450/6995] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:26 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1695 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:28.074135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cc774867-d9e2-43c7-999a-6ce54065c665 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:28.075145 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cc774867-d9e2-43c7-999a-6ce54065c665 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:28.082627 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc774867-d9e2-43c7-999a-6ce54065c665 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:28.083141 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc774867-d9e2-43c7-999a-6ce54065c665 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:28.083573 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc774867-d9e2-43c7-999a-6ce54065c665 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:28.084308 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc774867-d9e2-43c7-999a-6ce54065c665 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:28.084785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc774867-d9e2-43c7-999a-6ce54065c665 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:28.085232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cc774867-d9e2-43c7-999a-6ce54065c665 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:28.231271 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cc774867-d9e2-43c7-999a-6ce54065c665 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:28.240102 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cc774867-d9e2-43c7-999a-6ce54065c665 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1677 microversion: 2.1 time: 0.169887 Sep 17 21:59:28.240692 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3546/6996] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:28 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:29.269246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-50f000ce-c94f-4173-8f1d-ca176068d64c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:29.270196 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-50f000ce-c94f-4173-8f1d-ca176068d64c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:29.282096 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-50f000ce-c94f-4173-8f1d-ca176068d64c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:29.282960 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-50f000ce-c94f-4173-8f1d-ca176068d64c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:29.283733 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-50f000ce-c94f-4173-8f1d-ca176068d64c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:29.284893 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-50f000ce-c94f-4173-8f1d-ca176068d64c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:29.285706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-50f000ce-c94f-4173-8f1d-ca176068d64c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:29.286405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-50f000ce-c94f-4173-8f1d-ca176068d64c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:29.439700 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-50f000ce-c94f-4173-8f1d-ca176068d64c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:29.447848 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-50f000ce-c94f-4173-8f1d-ca176068d64c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1677 microversion: 2.1 time: 0.185413 Sep 17 21:59:29.448445 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3451/6997] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:29 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1677 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:30.475146 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-39b308a3-1e9f-4368-a10c-a1d4149c3e47 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:30.475718 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-39b308a3-1e9f-4368-a10c-a1d4149c3e47 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:30.483110 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39b308a3-1e9f-4368-a10c-a1d4149c3e47 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:30.483628 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39b308a3-1e9f-4368-a10c-a1d4149c3e47 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:30.484097 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39b308a3-1e9f-4368-a10c-a1d4149c3e47 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:30.484824 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39b308a3-1e9f-4368-a10c-a1d4149c3e47 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:30.485311 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39b308a3-1e9f-4368-a10c-a1d4149c3e47 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:30.485792 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-39b308a3-1e9f-4368-a10c-a1d4149c3e47 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:30.618616 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-39b308a3-1e9f-4368-a10c-a1d4149c3e47 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:30.626624 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-39b308a3-1e9f-4368-a10c-a1d4149c3e47 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1680 microversion: 2.1 time: 0.157382 Sep 17 21:59:30.627213 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3547/6998] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:30 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:30.650634 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ad90e628-9055-44ef-9973-99dcf66607b0 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:59:30.651308 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ad90e628-9055-44ef-9973-99dcf66607b0 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:30.659471 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad90e628-9055-44ef-9973-99dcf66607b0 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:30.659957 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad90e628-9055-44ef-9973-99dcf66607b0 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:30.660523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad90e628-9055-44ef-9973-99dcf66607b0 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:30.661552 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad90e628-9055-44ef-9973-99dcf66607b0 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:30.662023 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad90e628-9055-44ef-9973-99dcf66607b0 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:30.662462 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ad90e628-9055-44ef-9973-99dcf66607b0 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:30.751703 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ad90e628-9055-44ef-9973-99dcf66607b0 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=140523) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 17 21:59:30.842743 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ad90e628-9055-44ef-9973-99dcf66607b0 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "POST /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58/action" status: 202 len: 0 microversion: 2.1 time: 0.196271 Sep 17 21:59:30.843409 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3452/6999] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 21:59:30 2022] POST /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 21:59:30.851756 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-75a90724-0b32-4219-a026-81c3d7883d4f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:30.852538 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-75a90724-0b32-4219-a026-81c3d7883d4f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:30.859017 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75a90724-0b32-4219-a026-81c3d7883d4f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:30.859621 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75a90724-0b32-4219-a026-81c3d7883d4f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:30.860171 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75a90724-0b32-4219-a026-81c3d7883d4f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:30.861007 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75a90724-0b32-4219-a026-81c3d7883d4f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:30.861601 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75a90724-0b32-4219-a026-81c3d7883d4f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:30.862055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-75a90724-0b32-4219-a026-81c3d7883d4f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:31.004531 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-75a90724-0b32-4219-a026-81c3d7883d4f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:31.012415 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-75a90724-0b32-4219-a026-81c3d7883d4f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1628 microversion: 2.1 time: 0.164635 Sep 17 21:59:31.013005 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3548/7000] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:30 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1628 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 17 21:59:32.041027 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2efd7b5f-5c8c-466d-8f7c-aed6125b6d7a tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:32.041778 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2efd7b5f-5c8c-466d-8f7c-aed6125b6d7a tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:32.048497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2efd7b5f-5c8c-466d-8f7c-aed6125b6d7a tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:32.048990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2efd7b5f-5c8c-466d-8f7c-aed6125b6d7a tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:32.049433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2efd7b5f-5c8c-466d-8f7c-aed6125b6d7a tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:32.050169 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2efd7b5f-5c8c-466d-8f7c-aed6125b6d7a tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:32.050632 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2efd7b5f-5c8c-466d-8f7c-aed6125b6d7a tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:32.051088 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2efd7b5f-5c8c-466d-8f7c-aed6125b6d7a tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:32.071406 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:59:32.193067 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2efd7b5f-5c8c-466d-8f7c-aed6125b6d7a tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:32.202268 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2efd7b5f-5c8c-466d-8f7c-aed6125b6d7a tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1686 microversion: 2.1 time: 0.168054 Sep 17 21:59:32.202853 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3453/7001] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:32 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:32.608531 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-bfaf96fe-ca70-4eb7-9601-f5471f105b20 req-b02e09f9-c7cb-4ba4-b297-80c39b7eb5f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc977f3b-964f-40cc-bc18-1e8751a9ce58", "name": "network-vif-unplugged", "status": "completed", "tag": "daef4943-1770-46f5-bc94-44d1cf23daa4"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:59:32.618809 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-bfaf96fe-ca70-4eb7-9601-f5471f105b20 req-b02e09f9-c7cb-4ba4-b297-80c39b7eb5f5 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:32.619880 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-bfaf96fe-ca70-4eb7-9601-f5471f105b20 req-b02e09f9-c7cb-4ba4-b297-80c39b7eb5f5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:32.620244 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-bfaf96fe-ca70-4eb7-9601-f5471f105b20 req-b02e09f9-c7cb-4ba4-b297-80c39b7eb5f5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:32.633124 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-bfaf96fe-ca70-4eb7-9601-f5471f105b20 req-b02e09f9-c7cb-4ba4-b297-80c39b7eb5f5 service nova] Creating event network-vif-unplugged:daef4943-1770-46f5-bc94-44d1cf23daa4 for instance cc977f3b-964f-40cc-bc18-1e8751a9ce58 on nch1-master-1 Sep 17 21:59:32.638408 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-bfaf96fe-ca70-4eb7-9601-f5471f105b20 req-b02e09f9-c7cb-4ba4-b297-80c39b7eb5f5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092902 Sep 17 21:59:32.639036 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3549/7002] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:59:33.226307 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9341dcad-0beb-4641-a392-551ffe96be2f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:33.226979 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9341dcad-0beb-4641-a392-551ffe96be2f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:33.234152 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9341dcad-0beb-4641-a392-551ffe96be2f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:33.234647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9341dcad-0beb-4641-a392-551ffe96be2f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:33.235091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9341dcad-0beb-4641-a392-551ffe96be2f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:33.235802 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9341dcad-0beb-4641-a392-551ffe96be2f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:33.236304 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9341dcad-0beb-4641-a392-551ffe96be2f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:33.236735 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9341dcad-0beb-4641-a392-551ffe96be2f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:33.374093 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9341dcad-0beb-4641-a392-551ffe96be2f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:33.382721 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9341dcad-0beb-4641-a392-551ffe96be2f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1686 microversion: 2.1 time: 0.160385 Sep 17 21:59:33.383307 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3454/7003] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:33 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1686 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:34.407661 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9045d807-35c2-407c-98b1-dda293e72741 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:34.409232 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9045d807-35c2-407c-98b1-dda293e72741 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:34.416744 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9045d807-35c2-407c-98b1-dda293e72741 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:34.417729 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9045d807-35c2-407c-98b1-dda293e72741 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:34.418505 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9045d807-35c2-407c-98b1-dda293e72741 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:34.419506 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9045d807-35c2-407c-98b1-dda293e72741 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:34.420215 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9045d807-35c2-407c-98b1-dda293e72741 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:34.420897 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9045d807-35c2-407c-98b1-dda293e72741 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:34.570478 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9045d807-35c2-407c-98b1-dda293e72741 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:34.579732 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9045d807-35c2-407c-98b1-dda293e72741 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1686 microversion: 2.1 time: 0.177206 Sep 17 21:59:34.581041 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3550/7004] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:34 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1686 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:34.654034 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-661741a6-1f38-4255-8ed3-670ad6b0cb80 req-b1d97489-c252-4ed1-970c-5f7433607645 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc977f3b-964f-40cc-bc18-1e8751a9ce58", "tag": "daef4943-1770-46f5-bc94-44d1cf23daa4"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:59:34.665101 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-661741a6-1f38-4255-8ed3-670ad6b0cb80 req-b1d97489-c252-4ed1-970c-5f7433607645 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:34.665558 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-661741a6-1f38-4255-8ed3-670ad6b0cb80 req-b1d97489-c252-4ed1-970c-5f7433607645 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:34.665995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-661741a6-1f38-4255-8ed3-670ad6b0cb80 req-b1d97489-c252-4ed1-970c-5f7433607645 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:34.678796 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-661741a6-1f38-4255-8ed3-670ad6b0cb80 req-b1d97489-c252-4ed1-970c-5f7433607645 service nova] Creating event network-changed:daef4943-1770-46f5-bc94-44d1cf23daa4 for instance cc977f3b-964f-40cc-bc18-1e8751a9ce58 on nch1-master-1 Sep 17 21:59:34.684692 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-661741a6-1f38-4255-8ed3-670ad6b0cb80 req-b1d97489-c252-4ed1-970c-5f7433607645 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034396 Sep 17 21:59:34.686886 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3455/7005] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 21:59:35.604766 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a3dfee16-5833-4c29-8230-4434bc1395e3 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:35.605419 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a3dfee16-5833-4c29-8230-4434bc1395e3 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:35.608331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=31 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:59:35.613771 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a3dfee16-5833-4c29-8230-4434bc1395e3 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:35.614281 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a3dfee16-5833-4c29-8230-4434bc1395e3 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:35.614737 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a3dfee16-5833-4c29-8230-4434bc1395e3 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:35.615453 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a3dfee16-5833-4c29-8230-4434bc1395e3 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:35.615954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a3dfee16-5833-4c29-8230-4434bc1395e3 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:35.616376 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a3dfee16-5833-4c29-8230-4434bc1395e3 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:35.619453 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=83 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:59:35.789377 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a3dfee16-5833-4c29-8230-4434bc1395e3 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:35.800049 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a3dfee16-5833-4c29-8230-4434bc1395e3 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1686 microversion: 2.1 time: 0.199113 Sep 17 21:59:35.811694 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3551/7006] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:35 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1686 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:36.825645 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b71b72dc-4cec-4658-beab-dd1400d2b158 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:36.826349 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b71b72dc-4cec-4658-beab-dd1400d2b158 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:36.828341 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 21:59:36.834156 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b71b72dc-4cec-4658-beab-dd1400d2b158 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:36.834655 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b71b72dc-4cec-4658-beab-dd1400d2b158 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:36.835107 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b71b72dc-4cec-4658-beab-dd1400d2b158 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:36.835827 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b71b72dc-4cec-4658-beab-dd1400d2b158 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:36.836295 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b71b72dc-4cec-4658-beab-dd1400d2b158 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:36.836737 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b71b72dc-4cec-4658-beab-dd1400d2b158 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:36.996315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-b71b72dc-4cec-4658-beab-dd1400d2b158 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:37.006071 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b71b72dc-4cec-4658-beab-dd1400d2b158 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1686 microversion: 2.1 time: 0.186068 Sep 17 21:59:37.007887 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3456/7007] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:36 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1686 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:38.035487 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d5cf795c-f291-4b7e-b262-dd223315c07b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:38.036207 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d5cf795c-f291-4b7e-b262-dd223315c07b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:38.042785 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5cf795c-f291-4b7e-b262-dd223315c07b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:38.043295 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5cf795c-f291-4b7e-b262-dd223315c07b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:38.043761 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5cf795c-f291-4b7e-b262-dd223315c07b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:38.044490 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5cf795c-f291-4b7e-b262-dd223315c07b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:38.044966 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5cf795c-f291-4b7e-b262-dd223315c07b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:38.045445 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d5cf795c-f291-4b7e-b262-dd223315c07b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:38.189189 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d5cf795c-f291-4b7e-b262-dd223315c07b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:38.198263 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d5cf795c-f291-4b7e-b262-dd223315c07b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1686 microversion: 2.1 time: 0.169111 Sep 17 21:59:38.199072 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3552/7008] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:38 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1686 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:39.222515 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-09a93b5a-d4ef-4726-ad45-4ff0df2ab26d tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:39.223239 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-09a93b5a-d4ef-4726-ad45-4ff0df2ab26d tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:39.230837 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09a93b5a-d4ef-4726-ad45-4ff0df2ab26d tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:39.231334 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09a93b5a-d4ef-4726-ad45-4ff0df2ab26d tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:39.231775 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09a93b5a-d4ef-4726-ad45-4ff0df2ab26d tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:39.232492 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09a93b5a-d4ef-4726-ad45-4ff0df2ab26d tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:39.232948 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09a93b5a-d4ef-4726-ad45-4ff0df2ab26d tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:39.233381 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-09a93b5a-d4ef-4726-ad45-4ff0df2ab26d tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:39.396417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-09a93b5a-d4ef-4726-ad45-4ff0df2ab26d tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:39.404963 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-09a93b5a-d4ef-4726-ad45-4ff0df2ab26d tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1686 microversion: 2.1 time: 0.186313 Sep 17 21:59:39.405775 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3457/7009] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:39 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1686 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:40.431819 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-b8c13e5d-c097-41a3-bd42-a1b59173a5e3 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:40.431819 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-b8c13e5d-c097-41a3-bd42-a1b59173a5e3 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:40.438968 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b8c13e5d-c097-41a3-bd42-a1b59173a5e3 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:40.439600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b8c13e5d-c097-41a3-bd42-a1b59173a5e3 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:40.440148 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b8c13e5d-c097-41a3-bd42-a1b59173a5e3 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:40.443259 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b8c13e5d-c097-41a3-bd42-a1b59173a5e3 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:40.443846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b8c13e5d-c097-41a3-bd42-a1b59173a5e3 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:40.444387 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-b8c13e5d-c097-41a3-bd42-a1b59173a5e3 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:40.583474 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-b8c13e5d-c097-41a3-bd42-a1b59173a5e3 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:40.592303 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-b8c13e5d-c097-41a3-bd42-a1b59173a5e3 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1686 microversion: 2.1 time: 0.165758 Sep 17 21:59:40.593110 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3553/7010] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:40 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1686 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:41.619238 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-adfe058a-61f7-48c9-a6b3-8b41694695df tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:41.620394 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-adfe058a-61f7-48c9-a6b3-8b41694695df tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:41.631194 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-adfe058a-61f7-48c9-a6b3-8b41694695df tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:41.631688 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-adfe058a-61f7-48c9-a6b3-8b41694695df tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:41.632141 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-adfe058a-61f7-48c9-a6b3-8b41694695df tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:41.632854 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-adfe058a-61f7-48c9-a6b3-8b41694695df tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:41.633321 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-adfe058a-61f7-48c9-a6b3-8b41694695df tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:41.633787 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-adfe058a-61f7-48c9-a6b3-8b41694695df tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:41.772690 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-adfe058a-61f7-48c9-a6b3-8b41694695df tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:41.780826 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-adfe058a-61f7-48c9-a6b3-8b41694695df tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1686 microversion: 2.1 time: 0.168157 Sep 17 21:59:41.781423 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3458/7011] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:41 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:42.804681 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e8c95498-9912-4c50-b124-fd1fd9fbe73e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:42.805352 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e8c95498-9912-4c50-b124-fd1fd9fbe73e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:42.812159 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8c95498-9912-4c50-b124-fd1fd9fbe73e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:42.812680 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8c95498-9912-4c50-b124-fd1fd9fbe73e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:42.813134 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8c95498-9912-4c50-b124-fd1fd9fbe73e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:42.814542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8c95498-9912-4c50-b124-fd1fd9fbe73e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:42.814542 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8c95498-9912-4c50-b124-fd1fd9fbe73e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:42.814881 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e8c95498-9912-4c50-b124-fd1fd9fbe73e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:42.954428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e8c95498-9912-4c50-b124-fd1fd9fbe73e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:42.962572 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e8c95498-9912-4c50-b124-fd1fd9fbe73e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1686 microversion: 2.1 time: 0.162029 Sep 17 21:59:42.963399 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3554/7012] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:42 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1686 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:43.991280 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1d879096-2050-47c6-813f-b28a6505496d tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:43.992188 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1d879096-2050-47c6-813f-b28a6505496d tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:44.004091 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1d879096-2050-47c6-813f-b28a6505496d tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:44.004777 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1d879096-2050-47c6-813f-b28a6505496d tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:44.005225 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1d879096-2050-47c6-813f-b28a6505496d tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:44.005989 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1d879096-2050-47c6-813f-b28a6505496d tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:44.006455 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1d879096-2050-47c6-813f-b28a6505496d tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:44.006893 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1d879096-2050-47c6-813f-b28a6505496d tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:44.145080 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-1d879096-2050-47c6-813f-b28a6505496d tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:44.156792 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1d879096-2050-47c6-813f-b28a6505496d tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1686 microversion: 2.1 time: 0.172030 Sep 17 21:59:44.157661 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3459/7013] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:43 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1686 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:44.985792 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-15c32262-55f0-43f9-a8ca-a4a66bec98f0 req-4dea489e-9a6c-4e73-9f00-d6e0413af5f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc977f3b-964f-40cc-bc18-1e8751a9ce58", "name": "network-vif-plugged", "status": "completed", "tag": "daef4943-1770-46f5-bc94-44d1cf23daa4"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 21:59:44.998299 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-15c32262-55f0-43f9-a8ca-a4a66bec98f0 req-4dea489e-9a6c-4e73-9f00-d6e0413af5f4 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:44.998808 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-15c32262-55f0-43f9-a8ca-a4a66bec98f0 req-4dea489e-9a6c-4e73-9f00-d6e0413af5f4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:44.999258 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-15c32262-55f0-43f9-a8ca-a4a66bec98f0 req-4dea489e-9a6c-4e73-9f00-d6e0413af5f4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:45.013813 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-15c32262-55f0-43f9-a8ca-a4a66bec98f0 req-4dea489e-9a6c-4e73-9f00-d6e0413af5f4 service nova] Creating event network-vif-plugged:daef4943-1770-46f5-bc94-44d1cf23daa4 for instance cc977f3b-964f-40cc-bc18-1e8751a9ce58 on nch1-master-1 Sep 17 21:59:45.019091 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-15c32262-55f0-43f9-a8ca-a4a66bec98f0 req-4dea489e-9a6c-4e73-9f00-d6e0413af5f4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037794 Sep 17 21:59:45.020663 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3555/7014] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 21:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 21:59:45.180830 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-dfe167a4-4d0c-4468-81bb-97b607810454 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:45.181870 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-dfe167a4-4d0c-4468-81bb-97b607810454 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:45.189226 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfe167a4-4d0c-4468-81bb-97b607810454 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:45.189764 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfe167a4-4d0c-4468-81bb-97b607810454 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:45.190218 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfe167a4-4d0c-4468-81bb-97b607810454 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:45.190950 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfe167a4-4d0c-4468-81bb-97b607810454 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:45.191397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfe167a4-4d0c-4468-81bb-97b607810454 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:45.191986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-dfe167a4-4d0c-4468-81bb-97b607810454 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:45.329123 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-dfe167a4-4d0c-4468-81bb-97b607810454 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:45.337106 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-dfe167a4-4d0c-4468-81bb-97b607810454 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1686 microversion: 2.1 time: 0.160554 Sep 17 21:59:45.337749 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3460/7015] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:45 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1686 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:46.362423 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4fb23e8e-7742-46d7-b23e-d27cb0b0aeb5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:46.363147 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4fb23e8e-7742-46d7-b23e-d27cb0b0aeb5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:46.370211 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4fb23e8e-7742-46d7-b23e-d27cb0b0aeb5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:46.370771 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4fb23e8e-7742-46d7-b23e-d27cb0b0aeb5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:46.371323 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4fb23e8e-7742-46d7-b23e-d27cb0b0aeb5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:46.372154 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4fb23e8e-7742-46d7-b23e-d27cb0b0aeb5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:46.372762 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4fb23e8e-7742-46d7-b23e-d27cb0b0aeb5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:46.373207 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4fb23e8e-7742-46d7-b23e-d27cb0b0aeb5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:46.516330 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4fb23e8e-7742-46d7-b23e-d27cb0b0aeb5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:46.524680 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4fb23e8e-7742-46d7-b23e-d27cb0b0aeb5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1686 microversion: 2.1 time: 0.167511 Sep 17 21:59:46.525452 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3556/7016] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:46 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1686 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 21:59:47.552504 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4bb27c16-54b4-4443-a9fe-ad99b28f4df4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 21:59:47.553692 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4bb27c16-54b4-4443-a9fe-ad99b28f4df4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 21:59:47.565330 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bb27c16-54b4-4443-a9fe-ad99b28f4df4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:47.566180 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bb27c16-54b4-4443-a9fe-ad99b28f4df4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:47.566884 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bb27c16-54b4-4443-a9fe-ad99b28f4df4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:47.567985 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bb27c16-54b4-4443-a9fe-ad99b28f4df4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 21:59:47.568679 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bb27c16-54b4-4443-a9fe-ad99b28f4df4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 21:59:47.569122 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4bb27c16-54b4-4443-a9fe-ad99b28f4df4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 21:59:47.713310 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4bb27c16-54b4-4443-a9fe-ad99b28f4df4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 21:59:47.721764 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4bb27c16-54b4-4443-a9fe-ad99b28f4df4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1673 microversion: 2.1 time: 0.175976 Sep 17 21:59:47.722352 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3461/7017] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 21:59:47 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1673 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:00:57.163163 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=11 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:00:57.164554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=31 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:00:57.166136 ncdv-master-1 devstack@n-api.service[140524]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 17 22:00:57.166327 ncdv-master-1 devstack@n-api.service[140524]: Sat Sep 17 22:00:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 (ip 10.222.0.26) !!! Sep 17 22:00:57.168693 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-4c99a6cf-68b7-43d2-b742-95f7a5a3cec9 req-f6e17f35-740e-4f27-a5f1-d3e96d6f32ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc977f3b-964f-40cc-bc18-1e8751a9ce58", "tag": "daef4943-1770-46f5-bc94-44d1cf23daa4"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 22:00:57.173771 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c819acdc-1966-400f-898b-e321d5e5d986 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:00:57.174292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c819acdc-1966-400f-898b-e321d5e5d986 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:00:57.176133 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=11 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:00:57.176966 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=46 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:00:57.178058 ncdv-master-1 devstack@n-api.service[140523]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 17 22:00:57.178925 ncdv-master-1 devstack@n-api.service[140523]: Sat Sep 17 22:00:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Sep 17 22:00:57.189770 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c819acdc-1966-400f-898b-e321d5e5d986 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:00:57.190327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c819acdc-1966-400f-898b-e321d5e5d986 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:00:57.191045 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c819acdc-1966-400f-898b-e321d5e5d986 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:00:57.191891 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c819acdc-1966-400f-898b-e321d5e5d986 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:00:57.192389 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c819acdc-1966-400f-898b-e321d5e5d986 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:00:57.192832 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c819acdc-1966-400f-898b-e321d5e5d986 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:00:57.194885 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-4c99a6cf-68b7-43d2-b742-95f7a5a3cec9 req-f6e17f35-740e-4f27-a5f1-d3e96d6f32ad service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:00:57.195461 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-4c99a6cf-68b7-43d2-b742-95f7a5a3cec9 req-f6e17f35-740e-4f27-a5f1-d3e96d6f32ad service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:00:57.196097 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-4c99a6cf-68b7-43d2-b742-95f7a5a3cec9 req-f6e17f35-740e-4f27-a5f1-d3e96d6f32ad service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:00:57.208800 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-4c99a6cf-68b7-43d2-b742-95f7a5a3cec9 req-f6e17f35-740e-4f27-a5f1-d3e96d6f32ad service nova] Creating event network-changed:daef4943-1770-46f5-bc94-44d1cf23daa4 for instance cc977f3b-964f-40cc-bc18-1e8751a9ce58 on nch1-master-1 Sep 17 22:00:57.214410 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-4c99a6cf-68b7-43d2-b742-95f7a5a3cec9 req-f6e17f35-740e-4f27-a5f1-d3e96d6f32ad service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050780 Sep 17 22:00:57.215305 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3462/7018] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 22:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 22:00:57.222404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c819acdc-1966-400f-898b-e321d5e5d986 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 22:00:57.316159 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c819acdc-1966-400f-898b-e321d5e5d986 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 204 len: 0 microversion: 2.1 time: 0.154547 Sep 17 22:00:57.316974 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3557/7019] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 22:00:57 2022] DELETE /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 22:00:57.326695 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-af2b0a95-004b-4e68-86e1-52e26c077d57 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:00:57.327774 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-af2b0a95-004b-4e68-86e1-52e26c077d57 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:00:57.336243 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af2b0a95-004b-4e68-86e1-52e26c077d57 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:00:57.336815 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af2b0a95-004b-4e68-86e1-52e26c077d57 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:00:57.337265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af2b0a95-004b-4e68-86e1-52e26c077d57 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:00:57.338018 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af2b0a95-004b-4e68-86e1-52e26c077d57 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:00:57.338483 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af2b0a95-004b-4e68-86e1-52e26c077d57 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:00:57.338970 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-af2b0a95-004b-4e68-86e1-52e26c077d57 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:00:57.473452 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-af2b0a95-004b-4e68-86e1-52e26c077d57 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:00:57.481414 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-af2b0a95-004b-4e68-86e1-52e26c077d57 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1679 microversion: 2.1 time: 0.159992 Sep 17 22:00:57.482015 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3463/7020] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:00:57 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:00:58.507061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-066e780e-1a46-45a1-b55f-b8faa7218c48 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:00:58.507812 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-066e780e-1a46-45a1-b55f-b8faa7218c48 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:00:58.515863 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-066e780e-1a46-45a1-b55f-b8faa7218c48 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:00:58.516375 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-066e780e-1a46-45a1-b55f-b8faa7218c48 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:00:58.516833 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-066e780e-1a46-45a1-b55f-b8faa7218c48 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:00:58.517821 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-066e780e-1a46-45a1-b55f-b8faa7218c48 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:00:58.518298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-066e780e-1a46-45a1-b55f-b8faa7218c48 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:00:58.518742 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-066e780e-1a46-45a1-b55f-b8faa7218c48 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:00:58.658530 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-066e780e-1a46-45a1-b55f-b8faa7218c48 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:00:58.667393 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-066e780e-1a46-45a1-b55f-b8faa7218c48 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1679 microversion: 2.1 time: 0.164443 Sep 17 22:00:58.668007 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3558/7021] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:00:58 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:00:59.504078 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-592cf985-0301-4d2f-acff-99d0deb3b084 req-3d3a13f0-ab19-419a-a6d5-21b9efe95754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc977f3b-964f-40cc-bc18-1e8751a9ce58", "name": "network-vif-deleted", "tag": "daef4943-1770-46f5-bc94-44d1cf23daa4"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 22:00:59.517957 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-592cf985-0301-4d2f-acff-99d0deb3b084 req-3d3a13f0-ab19-419a-a6d5-21b9efe95754 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:00:59.518810 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-592cf985-0301-4d2f-acff-99d0deb3b084 req-3d3a13f0-ab19-419a-a6d5-21b9efe95754 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:00:59.519503 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-592cf985-0301-4d2f-acff-99d0deb3b084 req-3d3a13f0-ab19-419a-a6d5-21b9efe95754 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:00:59.532129 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-592cf985-0301-4d2f-acff-99d0deb3b084 req-3d3a13f0-ab19-419a-a6d5-21b9efe95754 service nova] Creating event network-vif-deleted:daef4943-1770-46f5-bc94-44d1cf23daa4 for instance cc977f3b-964f-40cc-bc18-1e8751a9ce58 on nch1-master-1 Sep 17 22:00:59.542907 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-592cf985-0301-4d2f-acff-99d0deb3b084 req-3d3a13f0-ab19-419a-a6d5-21b9efe95754 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042343 Sep 17 22:00:59.543732 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3464/7022] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 22:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 22:00:59.690859 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2510ad95-23d1-4bf7-8a60-f3142218661b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:00:59.692270 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2510ad95-23d1-4bf7-8a60-f3142218661b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:00:59.699896 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2510ad95-23d1-4bf7-8a60-f3142218661b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:00:59.700420 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2510ad95-23d1-4bf7-8a60-f3142218661b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:00:59.700876 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2510ad95-23d1-4bf7-8a60-f3142218661b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:00:59.701644 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2510ad95-23d1-4bf7-8a60-f3142218661b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:00:59.702243 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2510ad95-23d1-4bf7-8a60-f3142218661b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:00:59.702700 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2510ad95-23d1-4bf7-8a60-f3142218661b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:00:59.735107 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2510ad95-23d1-4bf7-8a60-f3142218661b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:00:59.735514 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2510ad95-23d1-4bf7-8a60-f3142218661b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:00:59.735979 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2510ad95-23d1-4bf7-8a60-f3142218661b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:00:59.736435 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-2510ad95-23d1-4bf7-8a60-f3142218661b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lazy-loading 'fault' on Instance uuid cc977f3b-964f-40cc-bc18-1e8751a9ce58 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 22:00:59.786543 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2510ad95-23d1-4bf7-8a60-f3142218661b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:00:59.794629 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2510ad95-23d1-4bf7-8a60-f3142218661b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 200 len: 1335 microversion: 2.1 time: 0.107737 Sep 17 22:00:59.795213 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3559/7023] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:00:59 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 1335 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:01:00.824573 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a31d8b44-a86a-4d36-8b22-aecc2be5ae44 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:01:00.825512 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a31d8b44-a86a-4d36-8b22-aecc2be5ae44 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: cc977f3b-964f-40cc-bc18-1e8751a9ce58] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:01:00.832172 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a31d8b44-a86a-4d36-8b22-aecc2be5ae44 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:01:00.832673 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a31d8b44-a86a-4d36-8b22-aecc2be5ae44 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:01:00.833108 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a31d8b44-a86a-4d36-8b22-aecc2be5ae44 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:01:00.833852 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a31d8b44-a86a-4d36-8b22-aecc2be5ae44 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:01:00.834314 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a31d8b44-a86a-4d36-8b22-aecc2be5ae44 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:01:00.834745 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a31d8b44-a86a-4d36-8b22-aecc2be5ae44 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:01:00.851508 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-a31d8b44-a86a-4d36-8b22-aecc2be5ae44 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] HTTP exception thrown: Instance cc977f3b-964f-40cc-bc18-1e8751a9ce58 could not be found. Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a31d8b44-a86a-4d36-8b22-aecc2be5ae44 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Request method failure captured: Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 HTTP/1.1 Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJkKdxd9phFNeDcOC71uAaS1cpdQ5aZX-kmBuFl0eoODrxGhDnzg0JeIKC9fGWI2bLsC5AbBZU3uv4L74UF98Zj8jmy0mS2hpV93I70Ybbj_WWBIEoUKWF68OSOkoN3AsozMwuGY8VZhzF8LSDJS9FuI9ln_l8I2H3cLCwbM4V1b7gA0 Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 015ec23d11f64d56844d28795ccba61a Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-TestShelveInstance-1018269517 Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/015ec23d11f64d56844d28795ccba61a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/015ec23d11f64d56844d28795ccba61a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/015ec23d11f64d56844d28795ccba61a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_015ec23d11f64d56844d28795ccba61a", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-TestShelveInstance-1018269517 Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 015ec23d11f64d56844d28795ccba61a Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-TestShelveInstance-1018269517 Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-TestShelveInstance-1018269517-project Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: 3d3bf2dacad34c0aa465968f1c273cf9 Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-TestShelveInstance-1018269517-project Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance cc977f3b-964f-40cc-bc18-1e8751a9ce58 could not be found. Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'cc977f3b-964f-40cc-bc18-1e8751a9ce58'} Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc977f3b-964f-40cc-bc18-1e8751a9ce58 could not be found. Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc977f3b-964f-40cc-bc18-1e8751a9ce58 could not be found. Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 22:01:00.853158 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 22:01:00.859773 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 22:01:00.859773 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 22:01:00.859773 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 22:01:00.859773 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 22:01:00.859773 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 22:01:00.859773 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc977f3b-964f-40cc-bc18-1e8751a9ce58 could not be found. Sep 17 22:01:00.859773 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 22:01:00.859773 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a31d8b44-a86a-4d36-8b22-aecc2be5ae44 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Returning 404 to user: Instance cc977f3b-964f-40cc-bc18-1e8751a9ce58 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 22:01:00.859773 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a31d8b44-a86a-4d36-8b22-aecc2be5ae44 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58" status: 404 len: 111 microversion: 2.1 time: 0.038494 Sep 17 22:01:00.859773 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3465/7024] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:01:00 2022] GET /compute/v2.1/servers/cc977f3b-964f-40cc-bc18-1e8751a9ce58 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 22:01:01.016372 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-844de9a5-4008-41da-a361-a460adcfd658 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '.version_select at 0x7f259ff3b160>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:01:01.045332 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-844de9a5-4008-41da-a361-a460adcfd658 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-561521312" status: 202 len: 0 microversion: 2.1 time: 0.033626 Sep 17 22:01:01.046272 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3560/7025] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Sep 17 22:01:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-561521312 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 22:01:01.070188 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f1dacd86-1f05-4cf3-8b20-30fb8ddb8d07 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Action: 'create', calling method: .version_select at 0x7f25a4516940>, body: {"keypair": {"name": "tempest-TestShelveInstance-1591368172", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOh9eLruRmKflbpBIcWwlcF7HXR130AhcdM28XY01wbUsoRuuMGLtB5uqr6KDTt2KVLB/rBN/ch7ExWvHgvbnFlPW7SJ27xO5+r4DUBbBHYYqZXE/CreUho1g0AjdlwZgg=="}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 22:01:01.087288 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-f1dacd86-1f05-4cf3-8b20-30fb8ddb8d07 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Getting quotas for project 015ec23d11f64d56844d28795ccba61a. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 22:01:01.092974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-f1dacd86-1f05-4cf3-8b20-30fb8ddb8d07 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Getting quotas for user 3d3bf2dacad34c0aa465968f1c273cf9 and project 015ec23d11f64d56844d28795ccba61a. Resources: {'key_pairs'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 22:01:01.121964 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f1dacd86-1f05-4cf3-8b20-30fb8ddb8d07 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.055822 Sep 17 22:01:01.123127 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3466/7026] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 22:01:01 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 22:01:03.613895 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a1b7630b-ebe7-4de5-ae06-680c87a4d469 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-343795608", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1591368172", "security_groups": [{"name": "tempest-secgroup-smoke-1183730170"}], "networks": [{"uuid": "019de3bc-5d47-42c6-964c-03f1135179d6"}], "block_device_mapping_v2": [{"uuid": "7f79dedc-7a7c-44ae-8f34-f9ddfb2ddb43", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 22:01:03.734292 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.network.neutron [None req-a1b7630b-ebe7-4de5-ae06-680c87a4d469 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] validate_networks() for [('019de3bc-5d47-42c6-964c-03f1135179d6', None, None, None, None, None)] {{(pid=140524) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 22:01:04.188613 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-a1b7630b-ebe7-4de5-ae06-680c87a4d469 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Flavor limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 22:01:04.189061 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-a1b7630b-ebe7-4de5-ae06-680c87a4d469 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Image limits 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 22:01:04.189586 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-a1b7630b-ebe7-4de5-ae06-680c87a4d469 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Flavor pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 22:01:04.190046 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-a1b7630b-ebe7-4de5-ae06-680c87a4d469 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Image pref 0:0:0 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 22:01:04.190459 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.virt.hardware [None req-a1b7630b-ebe7-4de5-ae06-680c87a4d469 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140524) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 22:01:04.200889 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a1b7630b-ebe7-4de5-ae06-680c87a4d469 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:01:04.201391 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a1b7630b-ebe7-4de5-ae06-680c87a4d469 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:01:04.201875 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a1b7630b-ebe7-4de5-ae06-680c87a4d469 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:01:04.202623 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a1b7630b-ebe7-4de5-ae06-680c87a4d469 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:01:04.203096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a1b7630b-ebe7-4de5-ae06-680c87a4d469 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:01:04.203538 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a1b7630b-ebe7-4de5-ae06-680c87a4d469 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:01:04.221830 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-a1b7630b-ebe7-4de5-ae06-680c87a4d469 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Getting quotas for project 015ec23d11f64d56844d28795ccba61a. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 22:01:04.227485 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-a1b7630b-ebe7-4de5-ae06-680c87a4d469 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Getting quotas for user 3d3bf2dacad34c0aa465968f1c273cf9 and project 015ec23d11f64d56844d28795ccba61a. Resources: {'cores', 'ram', 'instances'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 22:01:04.288428 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a1b7630b-ebe7-4de5-ae06-680c87a4d469 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Going to run 1 instances... {{(pid=140524) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 22:01:04.291437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a1b7630b-ebe7-4de5-ae06-680c87a4d469 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7f79dedc-7a7c-44ae-8f34-f9ddfb2ddb43',volume_size=None,volume_type=None)] {{(pid=140524) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 22:01:04.428302 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a1b7630b-ebe7-4de5-ae06-680c87a4d469 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.819359 Sep 17 22:01:04.428960 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3561/7027] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 22:01:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 22:01:04.441433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d0974e43-940f-41dc-9859-2bae1f8d0946 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:01:04.442755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d0974e43-940f-41dc-9859-2bae1f8d0946 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:01:04.504197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d0974e43-940f-41dc-9859-2bae1f8d0946 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:01:04.511270 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d0974e43-940f-41dc-9859-2bae1f8d0946 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1088 microversion: 2.1 time: 0.074806 Sep 17 22:01:04.511901 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3467/7028] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:01:04 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1088 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:01:05.539183 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d0a3e129-d55d-4ab6-b668-8a746ef05535 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:01:05.540109 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d0a3e129-d55d-4ab6-b668-8a746ef05535 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:01:05.604187 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d0a3e129-d55d-4ab6-b668-8a746ef05535 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:01:05.611324 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d0a3e129-d55d-4ab6-b668-8a746ef05535 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1088 microversion: 2.1 time: 0.079861 Sep 17 22:01:05.611891 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3562/7029] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:01:05 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1088 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:01:06.639214 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-936b4483-e95f-4038-8294-f0626571ed34 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:01:06.639865 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-936b4483-e95f-4038-8294-f0626571ed34 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:01:06.646761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-936b4483-e95f-4038-8294-f0626571ed34 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:01:06.647296 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-936b4483-e95f-4038-8294-f0626571ed34 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:01:06.647764 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-936b4483-e95f-4038-8294-f0626571ed34 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:01:06.648499 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-936b4483-e95f-4038-8294-f0626571ed34 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:01:06.648980 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-936b4483-e95f-4038-8294-f0626571ed34 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:01:06.649443 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-936b4483-e95f-4038-8294-f0626571ed34 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:01:06.712589 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-936b4483-e95f-4038-8294-f0626571ed34 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:01:06.720692 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-936b4483-e95f-4038-8294-f0626571ed34 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1138 microversion: 2.1 time: 0.088625 Sep 17 22:01:06.721277 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3468/7030] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:01:06 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1138 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:01:07.744161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4cc33424-87a3-47ca-85bd-bd5492d0f2eb tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:01:07.745362 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4cc33424-87a3-47ca-85bd-bd5492d0f2eb tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:01:07.752980 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4cc33424-87a3-47ca-85bd-bd5492d0f2eb tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:01:07.753794 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4cc33424-87a3-47ca-85bd-bd5492d0f2eb tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:01:07.754508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4cc33424-87a3-47ca-85bd-bd5492d0f2eb tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:01:07.755462 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4cc33424-87a3-47ca-85bd-bd5492d0f2eb tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:01:07.756143 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4cc33424-87a3-47ca-85bd-bd5492d0f2eb tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:01:07.756954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4cc33424-87a3-47ca-85bd-bd5492d0f2eb tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:01:07.819912 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4cc33424-87a3-47ca-85bd-bd5492d0f2eb tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:01:07.828452 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4cc33424-87a3-47ca-85bd-bd5492d0f2eb tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1204 microversion: 2.1 time: 0.088181 Sep 17 22:01:07.829049 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3563/7031] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:01:07 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1204 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:01:08.852900 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-4b62431d-a3eb-40cf-af6f-4cbf70f1ddcc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:01:08.853727 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-4b62431d-a3eb-40cf-af6f-4cbf70f1ddcc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:01:08.868428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b62431d-a3eb-40cf-af6f-4cbf70f1ddcc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:01:08.869369 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b62431d-a3eb-40cf-af6f-4cbf70f1ddcc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:01:08.870056 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b62431d-a3eb-40cf-af6f-4cbf70f1ddcc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:01:08.870790 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b62431d-a3eb-40cf-af6f-4cbf70f1ddcc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:01:08.871397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b62431d-a3eb-40cf-af6f-4cbf70f1ddcc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:01:08.872217 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-4b62431d-a3eb-40cf-af6f-4cbf70f1ddcc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:01:08.878248 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-2877d276-6179-4387-a7c0-222e2e90bbf4 req-fede34a6-ef61-4ff9-a6b0-d89cebeeb4fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "020679f9-06a5-4385-af5b-adbb87ad6fa7", "tag": "c2a86933-0e0e-4a31-bd20-e04591563b54"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 22:01:08.891237 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-2877d276-6179-4387-a7c0-222e2e90bbf4 req-fede34a6-ef61-4ff9-a6b0-d89cebeeb4fe service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:01:08.891733 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-2877d276-6179-4387-a7c0-222e2e90bbf4 req-fede34a6-ef61-4ff9-a6b0-d89cebeeb4fe service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:01:08.892743 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-2877d276-6179-4387-a7c0-222e2e90bbf4 req-fede34a6-ef61-4ff9-a6b0-d89cebeeb4fe service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:01:08.910099 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-2877d276-6179-4387-a7c0-222e2e90bbf4 req-fede34a6-ef61-4ff9-a6b0-d89cebeeb4fe service nova] Creating event network-changed:c2a86933-0e0e-4a31-bd20-e04591563b54 for instance 020679f9-06a5-4385-af5b-adbb87ad6fa7 on nch2-master-1 Sep 17 22:01:08.915542 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-2877d276-6179-4387-a7c0-222e2e90bbf4 req-fede34a6-ef61-4ff9-a6b0-d89cebeeb4fe service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042144 Sep 17 22:01:08.916177 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3564/7032] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 22:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 22:01:09.029401 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-4b62431d-a3eb-40cf-af6f-4cbf70f1ddcc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:01:09.037754 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-4b62431d-a3eb-40cf-af6f-4cbf70f1ddcc tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1260 microversion: 2.1 time: 0.189024 Sep 17 22:01:09.038356 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3469/7033] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:01:08 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:01:10.062048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-84a0510b-abb0-4540-9c63-f422f9841ab9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:01:10.062845 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-84a0510b-abb0-4540-9c63-f422f9841ab9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:01:10.069628 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84a0510b-abb0-4540-9c63-f422f9841ab9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:01:10.070138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84a0510b-abb0-4540-9c63-f422f9841ab9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:01:10.070597 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84a0510b-abb0-4540-9c63-f422f9841ab9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:01:10.071311 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84a0510b-abb0-4540-9c63-f422f9841ab9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:01:10.071799 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84a0510b-abb0-4540-9c63-f422f9841ab9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:01:10.072247 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84a0510b-abb0-4540-9c63-f422f9841ab9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:01:10.208498 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-84a0510b-abb0-4540-9c63-f422f9841ab9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:01:10.217852 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-84a0510b-abb0-4540-9c63-f422f9841ab9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1260 microversion: 2.1 time: 0.161039 Sep 17 22:01:10.218700 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3565/7034] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:01:10 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:01:11.246306 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a622a19b-341c-4d3a-a1a9-34f7522a7d6e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:01:11.247194 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a622a19b-341c-4d3a-a1a9-34f7522a7d6e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:01:11.259098 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a622a19b-341c-4d3a-a1a9-34f7522a7d6e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:01:11.259903 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a622a19b-341c-4d3a-a1a9-34f7522a7d6e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:01:11.260648 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a622a19b-341c-4d3a-a1a9-34f7522a7d6e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:01:11.261825 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a622a19b-341c-4d3a-a1a9-34f7522a7d6e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:01:11.262618 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a622a19b-341c-4d3a-a1a9-34f7522a7d6e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:01:11.263334 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a622a19b-341c-4d3a-a1a9-34f7522a7d6e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:01:11.402068 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a622a19b-341c-4d3a-a1a9-34f7522a7d6e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:01:11.411962 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a622a19b-341c-4d3a-a1a9-34f7522a7d6e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1260 microversion: 2.1 time: 0.172533 Sep 17 22:01:11.412783 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3470/7035] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:01:11 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:01:12.437065 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-4a5ec310-b5a0-433d-a663-834f02396b88 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:01:12.438135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-4a5ec310-b5a0-433d-a663-834f02396b88 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:01:12.445720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a5ec310-b5a0-433d-a663-834f02396b88 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:01:12.446229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a5ec310-b5a0-433d-a663-834f02396b88 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:01:12.446693 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a5ec310-b5a0-433d-a663-834f02396b88 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:01:12.447453 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a5ec310-b5a0-433d-a663-834f02396b88 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:01:12.447935 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a5ec310-b5a0-433d-a663-834f02396b88 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:01:12.448757 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-4a5ec310-b5a0-433d-a663-834f02396b88 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:01:12.584398 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-4a5ec310-b5a0-433d-a663-834f02396b88 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:01:12.592691 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-4a5ec310-b5a0-433d-a663-834f02396b88 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1260 microversion: 2.1 time: 0.160745 Sep 17 22:01:12.593283 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3566/7036] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:01:12 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:01:13.618758 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9bf3db6c-6086-42b9-bf52-60a8552bd086 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:01:13.619665 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-9bf3db6c-6086-42b9-bf52-60a8552bd086 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:01:13.628965 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9bf3db6c-6086-42b9-bf52-60a8552bd086 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:01:13.629490 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9bf3db6c-6086-42b9-bf52-60a8552bd086 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:01:13.629931 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9bf3db6c-6086-42b9-bf52-60a8552bd086 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:01:13.630639 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9bf3db6c-6086-42b9-bf52-60a8552bd086 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:01:13.631104 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9bf3db6c-6086-42b9-bf52-60a8552bd086 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:01:13.631536 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-9bf3db6c-6086-42b9-bf52-60a8552bd086 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:01:13.768537 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-9bf3db6c-6086-42b9-bf52-60a8552bd086 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:01:13.777694 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9bf3db6c-6086-42b9-bf52-60a8552bd086 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1260 microversion: 2.1 time: 0.165192 Sep 17 22:01:13.778282 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3471/7037] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:01:13 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:01:14.802608 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-757bb13d-cf6c-45f2-be40-b5ae983782ed tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:01:14.803398 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-757bb13d-cf6c-45f2-be40-b5ae983782ed tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:01:14.807164 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:01:14.815381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-757bb13d-cf6c-45f2-be40-b5ae983782ed tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:01:14.815957 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-757bb13d-cf6c-45f2-be40-b5ae983782ed tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:01:14.816550 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-757bb13d-cf6c-45f2-be40-b5ae983782ed tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:01:14.817514 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-757bb13d-cf6c-45f2-be40-b5ae983782ed tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:01:14.818181 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-757bb13d-cf6c-45f2-be40-b5ae983782ed tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:01:14.818765 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-757bb13d-cf6c-45f2-be40-b5ae983782ed tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:01:14.964959 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-757bb13d-cf6c-45f2-be40-b5ae983782ed tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:01:14.973384 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-757bb13d-cf6c-45f2-be40-b5ae983782ed tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1260 microversion: 2.1 time: 0.176141 Sep 17 22:01:14.974045 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3567/7038] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:01:14 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:01:15.462574 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:01:15.529876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-07bc1522-0592-4023-9c1a-83eed823498d req-4d606c84-0911-44db-825b-0122f9a3e860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "020679f9-06a5-4385-af5b-adbb87ad6fa7", "name": "network-vif-plugged", "status": "completed", "tag": "c2a86933-0e0e-4a31-bd20-e04591563b54"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 22:01:15.539792 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-07bc1522-0592-4023-9c1a-83eed823498d req-4d606c84-0911-44db-825b-0122f9a3e860 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:01:15.540209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-07bc1522-0592-4023-9c1a-83eed823498d req-4d606c84-0911-44db-825b-0122f9a3e860 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:01:15.540648 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-07bc1522-0592-4023-9c1a-83eed823498d req-4d606c84-0911-44db-825b-0122f9a3e860 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:01:15.552032 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-07bc1522-0592-4023-9c1a-83eed823498d req-4d606c84-0911-44db-825b-0122f9a3e860 service nova] Creating event network-vif-plugged:c2a86933-0e0e-4a31-bd20-e04591563b54 for instance 020679f9-06a5-4385-af5b-adbb87ad6fa7 on nch2-master-1 Sep 17 22:01:15.557261 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-07bc1522-0592-4023-9c1a-83eed823498d req-4d606c84-0911-44db-825b-0122f9a3e860 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099354 Sep 17 22:01:15.557945 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3472/7039] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 22:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 22:01:16.000634 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9ad38337-6dd1-423d-8f56-d3a5d588f684 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:01:16.001829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9ad38337-6dd1-423d-8f56-d3a5d588f684 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:01:16.005159 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=8 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:01:16.015652 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ad38337-6dd1-423d-8f56-d3a5d588f684 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:01:16.016625 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ad38337-6dd1-423d-8f56-d3a5d588f684 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:01:16.017087 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ad38337-6dd1-423d-8f56-d3a5d588f684 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:01:16.017796 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ad38337-6dd1-423d-8f56-d3a5d588f684 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:01:16.018301 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ad38337-6dd1-423d-8f56-d3a5d588f684 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:01:16.018781 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9ad38337-6dd1-423d-8f56-d3a5d588f684 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:01:16.170341 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9ad38337-6dd1-423d-8f56-d3a5d588f684 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:01:16.178683 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9ad38337-6dd1-423d-8f56-d3a5d588f684 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1260 microversion: 2.1 time: 0.184804 Sep 17 22:01:16.179265 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3568/7040] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:01:15 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:01:17.204060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-33b2870c-160f-4f5d-836a-515fc27dfd9e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:01:17.204772 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-33b2870c-160f-4f5d-836a-515fc27dfd9e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:01:17.211659 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-33b2870c-160f-4f5d-836a-515fc27dfd9e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:01:17.212157 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-33b2870c-160f-4f5d-836a-515fc27dfd9e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:01:17.212604 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-33b2870c-160f-4f5d-836a-515fc27dfd9e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:01:17.213320 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-33b2870c-160f-4f5d-836a-515fc27dfd9e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:01:17.213822 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-33b2870c-160f-4f5d-836a-515fc27dfd9e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:01:17.214262 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-33b2870c-160f-4f5d-836a-515fc27dfd9e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:01:17.348942 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-33b2870c-160f-4f5d-836a-515fc27dfd9e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:01:17.357634 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-33b2870c-160f-4f5d-836a-515fc27dfd9e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1445 microversion: 2.1 time: 0.159248 Sep 17 22:01:17.358219 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3473/7041] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:01:17 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1445 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:01:17.380108 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-02ea9cac-3ac5-4041-bf41-5f34f7bc2952 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:01:17.380745 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-02ea9cac-3ac5-4041-bf41-5f34f7bc2952 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:01:17.389582 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02ea9cac-3ac5-4041-bf41-5f34f7bc2952 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:01:17.390304 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02ea9cac-3ac5-4041-bf41-5f34f7bc2952 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:01:17.390944 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02ea9cac-3ac5-4041-bf41-5f34f7bc2952 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:01:17.392114 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02ea9cac-3ac5-4041-bf41-5f34f7bc2952 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:01:17.392600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02ea9cac-3ac5-4041-bf41-5f34f7bc2952 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:01:17.393048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-02ea9cac-3ac5-4041-bf41-5f34f7bc2952 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:01:17.535533 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-02ea9cac-3ac5-4041-bf41-5f34f7bc2952 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:01:17.543782 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-02ea9cac-3ac5-4041-bf41-5f34f7bc2952 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1445 microversion: 2.1 time: 0.167616 Sep 17 22:01:17.544377 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3569/7042] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:01:17 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1445 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:01:19.787711 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-b7eede00-9e23-407a-b456-b74536a33e26 req-eb54ed70-9bb9-4efa-acee-e05c0a107cdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "020679f9-06a5-4385-af5b-adbb87ad6fa7", "tag": "c2a86933-0e0e-4a31-bd20-e04591563b54"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 22:01:19.799478 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b7eede00-9e23-407a-b456-b74536a33e26 req-eb54ed70-9bb9-4efa-acee-e05c0a107cdb service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:01:19.800074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b7eede00-9e23-407a-b456-b74536a33e26 req-eb54ed70-9bb9-4efa-acee-e05c0a107cdb service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:01:19.800569 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-b7eede00-9e23-407a-b456-b74536a33e26 req-eb54ed70-9bb9-4efa-acee-e05c0a107cdb service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:01:19.816959 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-b7eede00-9e23-407a-b456-b74536a33e26 req-eb54ed70-9bb9-4efa-acee-e05c0a107cdb service nova] Creating event network-changed:c2a86933-0e0e-4a31-bd20-e04591563b54 for instance 020679f9-06a5-4385-af5b-adbb87ad6fa7 on nch2-master-1 Sep 17 22:01:19.822901 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-b7eede00-9e23-407a-b456-b74536a33e26 req-eb54ed70-9bb9-4efa-acee-e05c0a107cdb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038868 Sep 17 22:01:19.824506 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3474/7043] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 22:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 22:03:25.125061 ncdv-master-1 devstack@n-api.service[140524]: ERROR oslo.messaging._drivers.impl_rabbit [-] [04285588-4085-42d9-ae87-82f4a29bd916] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 17 22:03:25.126289 ncdv-master-1 devstack@n-api.service[140524]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0c677b88-ed69-4f5f-b874-71db171b23f2] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 17 22:03:25.126928 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:03:25.127816 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:03:25.129184 ncdv-master-1 devstack@n-api.service[140524]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 17 22:03:25.129376 ncdv-master-1 devstack@n-api.service[140524]: Sat Sep 17 22:03:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7/action (ip 10.222.0.26) !!! Sep 17 22:03:25.196235 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-84d2ce87-c3f3-41b7-a802-0f90c0fcf8ca tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 22:03:25.197160 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-84d2ce87-c3f3-41b7-a802-0f90c0fcf8ca tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:03:25.203926 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84d2ce87-c3f3-41b7-a802-0f90c0fcf8ca tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:25.204488 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84d2ce87-c3f3-41b7-a802-0f90c0fcf8ca tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:25.204948 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84d2ce87-c3f3-41b7-a802-0f90c0fcf8ca tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:25.205730 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84d2ce87-c3f3-41b7-a802-0f90c0fcf8ca tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:25.206229 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84d2ce87-c3f3-41b7-a802-0f90c0fcf8ca tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:25.206674 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-84d2ce87-c3f3-41b7-a802-0f90c0fcf8ca tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:25.230938 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-84d2ce87-c3f3-41b7-a802-0f90c0fcf8ca tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lazy-loading 'flavor' on Instance uuid 020679f9-06a5-4385-af5b-adbb87ad6fa7 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 22:03:25.317970 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-84d2ce87-c3f3-41b7-a802-0f90c0fcf8ca tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "POST /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7/action" status: 202 len: 0 microversion: 2.1 time: 0.194461 Sep 17 22:03:25.318508 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3570/7044] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 22:03:25 2022] POST /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 22:03:25.325557 ncdv-master-1 devstack@n-api.service[140523]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eb955ca7-44ca-4d87-9bde-78c4d0a94e44] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 17 22:03:25.326370 ncdv-master-1 devstack@n-api.service[140523]: ERROR oslo.messaging._drivers.impl_rabbit [-] [43af6626-5086-4256-806a-0090082f769c] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 17 22:03:25.326960 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:03:25.327799 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=46 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:03:25.329295 ncdv-master-1 devstack@n-api.service[140523]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 17 22:03:25.329486 ncdv-master-1 devstack@n-api.service[140523]: Sat Sep 17 22:03:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 (ip 10.222.0.26) !!! Sep 17 22:03:25.340488 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-34a3605d-3ea5-4d37-822f-575182e5107e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:03:25.341245 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-34a3605d-3ea5-4d37-822f-575182e5107e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:03:25.350428 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34a3605d-3ea5-4d37-822f-575182e5107e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:25.350903 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34a3605d-3ea5-4d37-822f-575182e5107e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:25.351343 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34a3605d-3ea5-4d37-822f-575182e5107e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:25.352048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34a3605d-3ea5-4d37-822f-575182e5107e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:25.352505 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34a3605d-3ea5-4d37-822f-575182e5107e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:25.352933 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-34a3605d-3ea5-4d37-822f-575182e5107e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:25.498317 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-34a3605d-3ea5-4d37-822f-575182e5107e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:03:25.506580 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-34a3605d-3ea5-4d37-822f-575182e5107e tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1569 microversion: 2.1 time: 0.183029 Sep 17 22:03:25.507160 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3475/7045] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:03:25 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:03:26.535517 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-092ce87d-b37a-41f4-a2ac-f4dfe5a3b2ad tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:03:26.536328 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-092ce87d-b37a-41f4-a2ac-f4dfe5a3b2ad tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:03:26.547371 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-092ce87d-b37a-41f4-a2ac-f4dfe5a3b2ad tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:26.548018 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-092ce87d-b37a-41f4-a2ac-f4dfe5a3b2ad tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:26.548593 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-092ce87d-b37a-41f4-a2ac-f4dfe5a3b2ad tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:26.549526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-092ce87d-b37a-41f4-a2ac-f4dfe5a3b2ad tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:26.550135 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-092ce87d-b37a-41f4-a2ac-f4dfe5a3b2ad tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:26.550729 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-092ce87d-b37a-41f4-a2ac-f4dfe5a3b2ad tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:26.556682 ncdv-master-1 devstack@n-api.service[140524]: INFO oslo.messaging._drivers.impl_rabbit [-] [0c677b88-ed69-4f5f-b874-71db171b23f2] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 56570. Sep 17 22:03:26.560240 ncdv-master-1 devstack@n-api.service[140524]: INFO oslo.messaging._drivers.impl_rabbit [-] [04285588-4085-42d9-ae87-82f4a29bd916] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 56568. Sep 17 22:03:26.691025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-092ce87d-b37a-41f4-a2ac-f4dfe5a3b2ad tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:03:26.701983 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-092ce87d-b37a-41f4-a2ac-f4dfe5a3b2ad tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1569 microversion: 2.1 time: 0.173219 Sep 17 22:03:26.702758 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3571/7046] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:03:26 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:03:27.730160 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-706ba8c9-fe61-40f1-ac8f-e66cd18acfc9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:03:27.730787 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-706ba8c9-fe61-40f1-ac8f-e66cd18acfc9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:03:27.741488 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-706ba8c9-fe61-40f1-ac8f-e66cd18acfc9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:27.741989 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-706ba8c9-fe61-40f1-ac8f-e66cd18acfc9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:27.742433 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-706ba8c9-fe61-40f1-ac8f-e66cd18acfc9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:27.743133 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-706ba8c9-fe61-40f1-ac8f-e66cd18acfc9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:27.743587 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-706ba8c9-fe61-40f1-ac8f-e66cd18acfc9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:27.744019 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-706ba8c9-fe61-40f1-ac8f-e66cd18acfc9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:27.748345 ncdv-master-1 devstack@n-api.service[140523]: INFO oslo.messaging._drivers.impl_rabbit [-] [43af6626-5086-4256-806a-0090082f769c] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 56576. Sep 17 22:03:27.750619 ncdv-master-1 devstack@n-api.service[140523]: INFO oslo.messaging._drivers.impl_rabbit [-] [eb955ca7-44ca-4d87-9bde-78c4d0a94e44] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 56574. Sep 17 22:03:27.881856 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-706ba8c9-fe61-40f1-ac8f-e66cd18acfc9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:03:27.890155 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-706ba8c9-fe61-40f1-ac8f-e66cd18acfc9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1569 microversion: 2.1 time: 0.164147 Sep 17 22:03:27.890718 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3476/7047] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:03:27 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:03:28.918568 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-04a9c35a-546b-479b-b483-f328b9640fa5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:03:28.919869 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-04a9c35a-546b-479b-b483-f328b9640fa5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:03:28.931805 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-04a9c35a-546b-479b-b483-f328b9640fa5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:28.932643 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-04a9c35a-546b-479b-b483-f328b9640fa5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:28.933402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-04a9c35a-546b-479b-b483-f328b9640fa5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:28.934366 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-04a9c35a-546b-479b-b483-f328b9640fa5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:28.934838 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-04a9c35a-546b-479b-b483-f328b9640fa5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:28.935285 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-04a9c35a-546b-479b-b483-f328b9640fa5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:29.077979 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-04a9c35a-546b-479b-b483-f328b9640fa5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:03:29.086051 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-04a9c35a-546b-479b-b483-f328b9640fa5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1569 microversion: 2.1 time: 0.174382 Sep 17 22:03:29.086635 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3572/7048] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:03:28 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:03:30.109944 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-03d1b7bc-5fd5-4011-965c-ad07a9ea963b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:03:30.110594 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-03d1b7bc-5fd5-4011-965c-ad07a9ea963b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:03:30.117963 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-03d1b7bc-5fd5-4011-965c-ad07a9ea963b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:30.118456 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-03d1b7bc-5fd5-4011-965c-ad07a9ea963b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:30.118899 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-03d1b7bc-5fd5-4011-965c-ad07a9ea963b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:30.119630 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-03d1b7bc-5fd5-4011-965c-ad07a9ea963b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:30.120087 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-03d1b7bc-5fd5-4011-965c-ad07a9ea963b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:30.120519 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-03d1b7bc-5fd5-4011-965c-ad07a9ea963b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:30.257883 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-03d1b7bc-5fd5-4011-965c-ad07a9ea963b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:03:30.266472 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-03d1b7bc-5fd5-4011-965c-ad07a9ea963b tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1569 microversion: 2.1 time: 0.160858 Sep 17 22:03:30.267090 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3477/7049] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:03:30 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:03:31.294700 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-936c2c87-44d8-4089-be1f-52a3c069f73f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:03:31.295337 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-936c2c87-44d8-4089-be1f-52a3c069f73f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:03:31.303194 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-936c2c87-44d8-4089-be1f-52a3c069f73f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:31.303720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-936c2c87-44d8-4089-be1f-52a3c069f73f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:31.304175 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-936c2c87-44d8-4089-be1f-52a3c069f73f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:31.304909 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-936c2c87-44d8-4089-be1f-52a3c069f73f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:31.305389 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-936c2c87-44d8-4089-be1f-52a3c069f73f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:31.305920 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-936c2c87-44d8-4089-be1f-52a3c069f73f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:31.447402 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-936c2c87-44d8-4089-be1f-52a3c069f73f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:03:31.456100 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-936c2c87-44d8-4089-be1f-52a3c069f73f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1569 microversion: 2.1 time: 0.165461 Sep 17 22:03:31.456687 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3573/7050] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:03:31 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:03:32.483809 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-87c6934f-ac09-4c49-98df-673ab0b94ee5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:03:32.484755 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-87c6934f-ac09-4c49-98df-673ab0b94ee5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:03:32.496507 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87c6934f-ac09-4c49-98df-673ab0b94ee5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:32.497396 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87c6934f-ac09-4c49-98df-673ab0b94ee5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:32.497876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87c6934f-ac09-4c49-98df-673ab0b94ee5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:32.498579 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87c6934f-ac09-4c49-98df-673ab0b94ee5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:32.499035 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87c6934f-ac09-4c49-98df-673ab0b94ee5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:32.499465 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-87c6934f-ac09-4c49-98df-673ab0b94ee5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:32.636017 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-87c6934f-ac09-4c49-98df-673ab0b94ee5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:03:32.644130 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-87c6934f-ac09-4c49-98df-673ab0b94ee5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1569 microversion: 2.1 time: 0.167171 Sep 17 22:03:32.644689 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3478/7051] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:03:32 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:03:33.670953 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2261f10a-9bbc-43bf-9459-b7a6665450ad tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:03:33.671711 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2261f10a-9bbc-43bf-9459-b7a6665450ad tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:03:33.679228 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2261f10a-9bbc-43bf-9459-b7a6665450ad tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:33.679733 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2261f10a-9bbc-43bf-9459-b7a6665450ad tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:33.680188 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2261f10a-9bbc-43bf-9459-b7a6665450ad tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:33.680913 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2261f10a-9bbc-43bf-9459-b7a6665450ad tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:33.681379 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2261f10a-9bbc-43bf-9459-b7a6665450ad tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:33.681876 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2261f10a-9bbc-43bf-9459-b7a6665450ad tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:34.168546 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-2261f10a-9bbc-43bf-9459-b7a6665450ad tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:03:34.180133 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2261f10a-9bbc-43bf-9459-b7a6665450ad tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1569 microversion: 2.1 time: 0.514721 Sep 17 22:03:34.180903 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3574/7052] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:03:33 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1569 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:03:35.204141 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0ef00bcc-bc8a-42fc-8311-f8e5af8a7da9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:03:35.204771 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0ef00bcc-bc8a-42fc-8311-f8e5af8a7da9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:03:35.212235 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ef00bcc-bc8a-42fc-8311-f8e5af8a7da9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:35.212761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ef00bcc-bc8a-42fc-8311-f8e5af8a7da9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:35.213211 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ef00bcc-bc8a-42fc-8311-f8e5af8a7da9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:35.213989 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ef00bcc-bc8a-42fc-8311-f8e5af8a7da9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:35.214458 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ef00bcc-bc8a-42fc-8311-f8e5af8a7da9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:35.214895 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0ef00bcc-bc8a-42fc-8311-f8e5af8a7da9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:35.344583 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0ef00bcc-bc8a-42fc-8311-f8e5af8a7da9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:03:35.352617 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0ef00bcc-bc8a-42fc-8311-f8e5af8a7da9 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1569 microversion: 2.1 time: 0.152510 Sep 17 22:03:35.353203 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3479/7053] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:03:35 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:03:36.380478 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-dc04d826-4dea-49d3-86e6-f0b7fca27fd8 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:03:36.381658 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-dc04d826-4dea-49d3-86e6-f0b7fca27fd8 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:03:36.392313 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dc04d826-4dea-49d3-86e6-f0b7fca27fd8 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:36.392826 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dc04d826-4dea-49d3-86e6-f0b7fca27fd8 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:36.393291 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dc04d826-4dea-49d3-86e6-f0b7fca27fd8 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:36.394048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dc04d826-4dea-49d3-86e6-f0b7fca27fd8 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:36.394521 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dc04d826-4dea-49d3-86e6-f0b7fca27fd8 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:36.394999 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-dc04d826-4dea-49d3-86e6-f0b7fca27fd8 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:36.543031 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-dc04d826-4dea-49d3-86e6-f0b7fca27fd8 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:03:36.553363 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-dc04d826-4dea-49d3-86e6-f0b7fca27fd8 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1569 microversion: 2.1 time: 0.179624 Sep 17 22:03:36.554015 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3575/7054] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:03:36 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:03:37.577731 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d17fa98b-7cbb-4d38-88f6-fa0fe2153c6f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:03:37.578453 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d17fa98b-7cbb-4d38-88f6-fa0fe2153c6f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:03:37.584727 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d17fa98b-7cbb-4d38-88f6-fa0fe2153c6f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:37.585236 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d17fa98b-7cbb-4d38-88f6-fa0fe2153c6f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:37.585710 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d17fa98b-7cbb-4d38-88f6-fa0fe2153c6f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:37.586406 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d17fa98b-7cbb-4d38-88f6-fa0fe2153c6f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:37.586853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d17fa98b-7cbb-4d38-88f6-fa0fe2153c6f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:37.587283 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d17fa98b-7cbb-4d38-88f6-fa0fe2153c6f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:37.734549 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d17fa98b-7cbb-4d38-88f6-fa0fe2153c6f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:03:37.743014 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d17fa98b-7cbb-4d38-88f6-fa0fe2153c6f tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1569 microversion: 2.1 time: 0.170281 Sep 17 22:03:37.743727 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3480/7055] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:03:37 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:03:38.771431 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-69dcb822-c7d3-4a02-a1b4-8cf7138dcbdd tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:03:38.772527 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-69dcb822-c7d3-4a02-a1b4-8cf7138dcbdd tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:03:38.784529 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69dcb822-c7d3-4a02-a1b4-8cf7138dcbdd tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:38.785042 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69dcb822-c7d3-4a02-a1b4-8cf7138dcbdd tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:38.785508 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69dcb822-c7d3-4a02-a1b4-8cf7138dcbdd tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:38.786252 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69dcb822-c7d3-4a02-a1b4-8cf7138dcbdd tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:38.786726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69dcb822-c7d3-4a02-a1b4-8cf7138dcbdd tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:38.787147 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-69dcb822-c7d3-4a02-a1b4-8cf7138dcbdd tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:38.928040 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-69dcb822-c7d3-4a02-a1b4-8cf7138dcbdd tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:03:38.936369 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-69dcb822-c7d3-4a02-a1b4-8cf7138dcbdd tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1510 microversion: 2.1 time: 0.171587 Sep 17 22:03:38.936946 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3576/7056] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:03:38 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:03:38.959662 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-1021df92-b3ef-453a-8279-168a324d9a83 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 22:03:38.960202 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1021df92-b3ef-453a-8279-168a324d9a83 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:03:38.967376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1021df92-b3ef-453a-8279-168a324d9a83 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:38.967891 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1021df92-b3ef-453a-8279-168a324d9a83 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:38.968337 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1021df92-b3ef-453a-8279-168a324d9a83 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:38.969041 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1021df92-b3ef-453a-8279-168a324d9a83 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:38.969493 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1021df92-b3ef-453a-8279-168a324d9a83 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:38.970048 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-1021df92-b3ef-453a-8279-168a324d9a83 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:38.999381 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-1021df92-b3ef-453a-8279-168a324d9a83 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=140523) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 17 22:03:39.076666 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-1021df92-b3ef-453a-8279-168a324d9a83 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "POST /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7/action" status: 202 len: 0 microversion: 2.1 time: 0.121091 Sep 17 22:03:39.077312 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3481/7057] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 22:03:38 2022] POST /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 17 22:03:39.085971 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-cb8ebd0d-1e42-4fcb-889b-4ca0b12a56f7 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:03:39.086640 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-cb8ebd0d-1e42-4fcb-889b-4ca0b12a56f7 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:03:39.092640 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb8ebd0d-1e42-4fcb-889b-4ca0b12a56f7 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:39.093151 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb8ebd0d-1e42-4fcb-889b-4ca0b12a56f7 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:39.093674 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb8ebd0d-1e42-4fcb-889b-4ca0b12a56f7 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:39.094435 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb8ebd0d-1e42-4fcb-889b-4ca0b12a56f7 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:39.094909 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb8ebd0d-1e42-4fcb-889b-4ca0b12a56f7 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:39.095404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-cb8ebd0d-1e42-4fcb-889b-4ca0b12a56f7 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:39.252058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-cb8ebd0d-1e42-4fcb-889b-4ca0b12a56f7 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:03:39.260469 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-cb8ebd0d-1e42-4fcb-889b-4ca0b12a56f7 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1518 microversion: 2.1 time: 0.178583 Sep 17 22:03:39.261149 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3577/7058] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:03:39 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1518 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:03:40.130714 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-35b1c222-9caf-4593-b64c-0bf3a57fcc87 req-4f68847b-2169-4d7d-9477-757437ef9400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "020679f9-06a5-4385-af5b-adbb87ad6fa7", "name": "network-vif-unplugged", "status": "completed", "tag": "c2a86933-0e0e-4a31-bd20-e04591563b54"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 22:03:40.145613 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-35b1c222-9caf-4593-b64c-0bf3a57fcc87 req-4f68847b-2169-4d7d-9477-757437ef9400 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:40.146231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-35b1c222-9caf-4593-b64c-0bf3a57fcc87 req-4f68847b-2169-4d7d-9477-757437ef9400 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:40.146764 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-35b1c222-9caf-4593-b64c-0bf3a57fcc87 req-4f68847b-2169-4d7d-9477-757437ef9400 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:40.157627 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.compute.server_external_events [req-35b1c222-9caf-4593-b64c-0bf3a57fcc87 req-4f68847b-2169-4d7d-9477-757437ef9400 service nova] Unable to find a host for instance 020679f9-06a5-4385-af5b-adbb87ad6fa7. Dropping event network-vif-unplugged {{(pid=140523) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 17 22:03:40.158639 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-35b1c222-9caf-4593-b64c-0bf3a57fcc87 req-4f68847b-2169-4d7d-9477-757437ef9400 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033190 Sep 17 22:03:40.159415 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3482/7059] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 22:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 17 22:03:40.284528 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ca789c60-2af6-4c8f-9642-d72cc3f94cf4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:03:40.285168 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ca789c60-2af6-4c8f-9642-d72cc3f94cf4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:03:40.292437 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca789c60-2af6-4c8f-9642-d72cc3f94cf4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:40.292946 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca789c60-2af6-4c8f-9642-d72cc3f94cf4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:40.293392 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca789c60-2af6-4c8f-9642-d72cc3f94cf4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:40.294161 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca789c60-2af6-4c8f-9642-d72cc3f94cf4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:40.294641 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca789c60-2af6-4c8f-9642-d72cc3f94cf4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:40.295085 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ca789c60-2af6-4c8f-9642-d72cc3f94cf4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:40.431315 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ca789c60-2af6-4c8f-9642-d72cc3f94cf4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:03:40.439752 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ca789c60-2af6-4c8f-9642-d72cc3f94cf4 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1520 microversion: 2.1 time: 0.159397 Sep 17 22:03:40.440714 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3578/7060] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:03:40 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:03:41.464713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a54602ae-ac35-461f-a060-ade295f35b27 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:03:41.465344 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a54602ae-ac35-461f-a060-ade295f35b27 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:03:41.472476 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a54602ae-ac35-461f-a060-ade295f35b27 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:41.473004 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a54602ae-ac35-461f-a060-ade295f35b27 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:41.473447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a54602ae-ac35-461f-a060-ade295f35b27 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:41.474217 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a54602ae-ac35-461f-a060-ade295f35b27 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:41.474647 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a54602ae-ac35-461f-a060-ade295f35b27 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:41.475081 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a54602ae-ac35-461f-a060-ade295f35b27 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:41.607814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a54602ae-ac35-461f-a060-ade295f35b27 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:03:41.615713 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a54602ae-ac35-461f-a060-ade295f35b27 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1576 microversion: 2.1 time: 0.155008 Sep 17 22:03:41.625552 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3483/7061] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:03:41 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:03:41.999503 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-f60b8472-4a36-4736-b462-89672fc49e57 req-52132d93-5134-47dd-ac0c-e3ae786c3465 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "020679f9-06a5-4385-af5b-adbb87ad6fa7", "tag": "c2a86933-0e0e-4a31-bd20-e04591563b54"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 22:03:42.010917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f60b8472-4a36-4736-b462-89672fc49e57 req-52132d93-5134-47dd-ac0c-e3ae786c3465 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:42.011420 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f60b8472-4a36-4736-b462-89672fc49e57 req-52132d93-5134-47dd-ac0c-e3ae786c3465 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:42.012331 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f60b8472-4a36-4736-b462-89672fc49e57 req-52132d93-5134-47dd-ac0c-e3ae786c3465 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:42.023795 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-f60b8472-4a36-4736-b462-89672fc49e57 req-52132d93-5134-47dd-ac0c-e3ae786c3465 service nova] Creating event network-changed:c2a86933-0e0e-4a31-bd20-e04591563b54 for instance 020679f9-06a5-4385-af5b-adbb87ad6fa7 on nch1-master-1 Sep 17 22:03:42.029444 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-f60b8472-4a36-4736-b462-89672fc49e57 req-52132d93-5134-47dd-ac0c-e3ae786c3465 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033728 Sep 17 22:03:42.030288 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3579/7062] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 22:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 22:03:42.644329 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-2b2c67cf-7e99-426f-968a-9e745ecf48f1 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:03:42.645277 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-2b2c67cf-7e99-426f-968a-9e745ecf48f1 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:03:42.657305 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b2c67cf-7e99-426f-968a-9e745ecf48f1 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:42.658177 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b2c67cf-7e99-426f-968a-9e745ecf48f1 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:42.659209 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b2c67cf-7e99-426f-968a-9e745ecf48f1 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:42.659909 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b2c67cf-7e99-426f-968a-9e745ecf48f1 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:42.660364 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b2c67cf-7e99-426f-968a-9e745ecf48f1 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:42.660793 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-2b2c67cf-7e99-426f-968a-9e745ecf48f1 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:42.797938 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-2b2c67cf-7e99-426f-968a-9e745ecf48f1 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:03:42.806664 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-2b2c67cf-7e99-426f-968a-9e745ecf48f1 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1576 microversion: 2.1 time: 0.168947 Sep 17 22:03:42.807247 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3484/7063] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:03:42 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:03:43.836450 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3ab6e8b8-5acb-4bc0-9b7f-19a7e511a59c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:03:43.837777 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3ab6e8b8-5acb-4bc0-9b7f-19a7e511a59c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:03:43.850083 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ab6e8b8-5acb-4bc0-9b7f-19a7e511a59c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:43.850932 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ab6e8b8-5acb-4bc0-9b7f-19a7e511a59c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:43.851706 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ab6e8b8-5acb-4bc0-9b7f-19a7e511a59c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:43.852900 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ab6e8b8-5acb-4bc0-9b7f-19a7e511a59c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:43.853748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ab6e8b8-5acb-4bc0-9b7f-19a7e511a59c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:43.854496 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3ab6e8b8-5acb-4bc0-9b7f-19a7e511a59c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:43.994002 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3ab6e8b8-5acb-4bc0-9b7f-19a7e511a59c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:03:44.002294 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3ab6e8b8-5acb-4bc0-9b7f-19a7e511a59c tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1576 microversion: 2.1 time: 0.173501 Sep 17 22:03:44.002985 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3580/7064] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:03:43 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:03:45.030006 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-5457d91a-c6b5-463a-8280-74580817ee72 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:03:45.030876 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-5457d91a-c6b5-463a-8280-74580817ee72 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:03:45.042728 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5457d91a-c6b5-463a-8280-74580817ee72 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:45.043542 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5457d91a-c6b5-463a-8280-74580817ee72 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:45.044271 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5457d91a-c6b5-463a-8280-74580817ee72 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:45.045425 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5457d91a-c6b5-463a-8280-74580817ee72 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:45.046231 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5457d91a-c6b5-463a-8280-74580817ee72 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:45.046947 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-5457d91a-c6b5-463a-8280-74580817ee72 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:45.181065 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-5457d91a-c6b5-463a-8280-74580817ee72 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:03:45.192779 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-5457d91a-c6b5-463a-8280-74580817ee72 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1576 microversion: 2.1 time: 0.169311 Sep 17 22:03:45.193551 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3485/7065] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:03:45 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:03:46.217768 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-674b0e9a-b4ae-406d-baab-f79104ec4b86 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:03:46.218365 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-674b0e9a-b4ae-406d-baab-f79104ec4b86 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:03:46.225991 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-674b0e9a-b4ae-406d-baab-f79104ec4b86 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:46.226500 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-674b0e9a-b4ae-406d-baab-f79104ec4b86 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:46.226954 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-674b0e9a-b4ae-406d-baab-f79104ec4b86 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:46.227748 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-674b0e9a-b4ae-406d-baab-f79104ec4b86 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:46.228224 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-674b0e9a-b4ae-406d-baab-f79104ec4b86 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:46.228672 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-674b0e9a-b4ae-406d-baab-f79104ec4b86 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:46.376191 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-674b0e9a-b4ae-406d-baab-f79104ec4b86 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:03:46.385571 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-674b0e9a-b4ae-406d-baab-f79104ec4b86 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1576 microversion: 2.1 time: 0.171889 Sep 17 22:03:46.386168 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3581/7066] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:03:46 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:03:47.412983 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-cf2de7b4-be48-4745-b68e-0658c39fb9ef tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:03:47.414057 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-cf2de7b4-be48-4745-b68e-0658c39fb9ef tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:03:47.426041 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf2de7b4-be48-4745-b68e-0658c39fb9ef tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:47.426538 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf2de7b4-be48-4745-b68e-0658c39fb9ef tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:47.426987 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf2de7b4-be48-4745-b68e-0658c39fb9ef tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:47.427680 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf2de7b4-be48-4745-b68e-0658c39fb9ef tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:47.428178 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf2de7b4-be48-4745-b68e-0658c39fb9ef tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:47.428613 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-cf2de7b4-be48-4745-b68e-0658c39fb9ef tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:47.559320 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-cf2de7b4-be48-4745-b68e-0658c39fb9ef tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:03:47.567469 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-cf2de7b4-be48-4745-b68e-0658c39fb9ef tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1576 microversion: 2.1 time: 0.161044 Sep 17 22:03:47.568093 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3486/7067] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:03:47 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:03:48.592747 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-c4b11f3b-e999-4631-b3b1-218492339b18 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:03:48.593482 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-c4b11f3b-e999-4631-b3b1-218492339b18 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:03:48.602049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4b11f3b-e999-4631-b3b1-218492339b18 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:48.602563 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4b11f3b-e999-4631-b3b1-218492339b18 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:48.603013 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4b11f3b-e999-4631-b3b1-218492339b18 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:48.603734 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4b11f3b-e999-4631-b3b1-218492339b18 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:48.604204 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4b11f3b-e999-4631-b3b1-218492339b18 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:48.604643 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-c4b11f3b-e999-4631-b3b1-218492339b18 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:48.745239 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-c4b11f3b-e999-4631-b3b1-218492339b18 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:03:48.753363 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-c4b11f3b-e999-4631-b3b1-218492339b18 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1576 microversion: 2.1 time: 0.165291 Sep 17 22:03:48.754003 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3582/7068] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:03:48 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:03:49.780726 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-92779b71-4879-4d78-b99c-d2a7def73466 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:03:49.781919 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-92779b71-4879-4d78-b99c-d2a7def73466 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:03:49.794557 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92779b71-4879-4d78-b99c-d2a7def73466 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:49.795369 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92779b71-4879-4d78-b99c-d2a7def73466 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:49.796097 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92779b71-4879-4d78-b99c-d2a7def73466 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:49.797266 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92779b71-4879-4d78-b99c-d2a7def73466 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:49.798073 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92779b71-4879-4d78-b99c-d2a7def73466 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:49.798789 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-92779b71-4879-4d78-b99c-d2a7def73466 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:49.946761 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-92779b71-4879-4d78-b99c-d2a7def73466 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:03:49.958971 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-92779b71-4879-4d78-b99c-d2a7def73466 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1576 microversion: 2.1 time: 0.184496 Sep 17 22:03:49.959789 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3487/7069] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:03:49 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1576 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:03:50.370021 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-9ab0c975-7034-46ca-aed0-4dcead8aa5fe req-d31c052a-9d97-4fa8-8bf1-4b61279bb067 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "020679f9-06a5-4385-af5b-adbb87ad6fa7", "name": "network-vif-plugged", "status": "completed", "tag": "c2a86933-0e0e-4a31-bd20-e04591563b54"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 22:03:50.380727 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-9ab0c975-7034-46ca-aed0-4dcead8aa5fe req-d31c052a-9d97-4fa8-8bf1-4b61279bb067 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:50.381230 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-9ab0c975-7034-46ca-aed0-4dcead8aa5fe req-d31c052a-9d97-4fa8-8bf1-4b61279bb067 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:50.381708 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-9ab0c975-7034-46ca-aed0-4dcead8aa5fe req-d31c052a-9d97-4fa8-8bf1-4b61279bb067 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:50.393596 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-9ab0c975-7034-46ca-aed0-4dcead8aa5fe req-d31c052a-9d97-4fa8-8bf1-4b61279bb067 service nova] Creating event network-vif-plugged:c2a86933-0e0e-4a31-bd20-e04591563b54 for instance 020679f9-06a5-4385-af5b-adbb87ad6fa7 on nch1-master-1 Sep 17 22:03:50.398989 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-9ab0c975-7034-46ca-aed0-4dcead8aa5fe req-d31c052a-9d97-4fa8-8bf1-4b61279bb067 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032762 Sep 17 22:03:50.399592 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3583/7070] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 22:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 22:03:50.990664 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d02ffa74-d5ac-44ce-b487-6e061a5e7457 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:03:50.991282 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d02ffa74-d5ac-44ce-b487-6e061a5e7457 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:03:50.998682 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d02ffa74-d5ac-44ce-b487-6e061a5e7457 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:50.999181 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d02ffa74-d5ac-44ce-b487-6e061a5e7457 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:50.999629 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d02ffa74-d5ac-44ce-b487-6e061a5e7457 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:51.000352 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d02ffa74-d5ac-44ce-b487-6e061a5e7457 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:51.000833 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d02ffa74-d5ac-44ce-b487-6e061a5e7457 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:51.001273 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d02ffa74-d5ac-44ce-b487-6e061a5e7457 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:51.143113 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d02ffa74-d5ac-44ce-b487-6e061a5e7457 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:03:51.151987 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d02ffa74-d5ac-44ce-b487-6e061a5e7457 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1576 microversion: 2.1 time: 0.167139 Sep 17 22:03:51.152510 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3488/7071] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:03:50 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:03:52.185977 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8dd0cf22-1b7e-41a6-8fe4-9fe6a76cadbe tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:03:52.186709 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8dd0cf22-1b7e-41a6-8fe4-9fe6a76cadbe tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:03:52.193840 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8dd0cf22-1b7e-41a6-8fe4-9fe6a76cadbe tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:52.194352 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8dd0cf22-1b7e-41a6-8fe4-9fe6a76cadbe tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:52.194804 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8dd0cf22-1b7e-41a6-8fe4-9fe6a76cadbe tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:52.195521 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8dd0cf22-1b7e-41a6-8fe4-9fe6a76cadbe tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:03:52.195993 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8dd0cf22-1b7e-41a6-8fe4-9fe6a76cadbe tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:03:52.196800 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8dd0cf22-1b7e-41a6-8fe4-9fe6a76cadbe tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:03:52.344327 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8dd0cf22-1b7e-41a6-8fe4-9fe6a76cadbe tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:03:52.352765 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8dd0cf22-1b7e-41a6-8fe4-9fe6a76cadbe tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1563 microversion: 2.1 time: 0.172080 Sep 17 22:03:52.353364 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3584/7072] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:03:52 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1563 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:05:17.402671 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:05:17.403517 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:05:17.404557 ncdv-master-1 devstack@n-api.service[140523]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 17 22:05:17.404707 ncdv-master-1 devstack@n-api.service[140523]: Sat Sep 17 22:05:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 (ip 10.222.0.26) !!! Sep 17 22:05:17.405986 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=30 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:05:17.406425 ncdv-master-1 devstack@n-api.service[140523]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 17 22:05:17.406425 ncdv-master-1 devstack@n-api.service[140523]: Sat Sep 17 22:05:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 (ip 10.222.0.26) !!! Sep 17 22:05:17.406600 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:05:17.407687 ncdv-master-1 devstack@n-api.service[140524]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 17 22:05:17.407816 ncdv-master-1 devstack@n-api.service[140524]: Sat Sep 17 22:05:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Sep 17 22:05:17.412259 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-25db84db-ee9b-41ff-bb5d-6af54f412398 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:05:17.412859 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-25db84db-ee9b-41ff-bb5d-6af54f412398 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:05:17.430857 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25db84db-ee9b-41ff-bb5d-6af54f412398 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:17.431611 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25db84db-ee9b-41ff-bb5d-6af54f412398 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:17.432136 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25db84db-ee9b-41ff-bb5d-6af54f412398 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:17.432974 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25db84db-ee9b-41ff-bb5d-6af54f412398 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:17.433576 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25db84db-ee9b-41ff-bb5d-6af54f412398 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:17.434084 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-25db84db-ee9b-41ff-bb5d-6af54f412398 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:17.463772 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-25db84db-ee9b-41ff-bb5d-6af54f412398 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Going to try to terminate instance {{(pid=140523) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 22:05:17.473741 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-6246b869-53a9-4c97-a061-8b5598f5f1a1 req-172db432-9ec9-42a4-8808-8f91e64057bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "020679f9-06a5-4385-af5b-adbb87ad6fa7", "tag": "c2a86933-0e0e-4a31-bd20-e04591563b54"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 22:05:17.483480 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6246b869-53a9-4c97-a061-8b5598f5f1a1 req-172db432-9ec9-42a4-8808-8f91e64057bb service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:17.484531 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6246b869-53a9-4c97-a061-8b5598f5f1a1 req-172db432-9ec9-42a4-8808-8f91e64057bb service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:17.484531 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6246b869-53a9-4c97-a061-8b5598f5f1a1 req-172db432-9ec9-42a4-8808-8f91e64057bb service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:17.496200 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-6246b869-53a9-4c97-a061-8b5598f5f1a1 req-172db432-9ec9-42a4-8808-8f91e64057bb service nova] Creating event network-changed:c2a86933-0e0e-4a31-bd20-e04591563b54 for instance 020679f9-06a5-4385-af5b-adbb87ad6fa7 on nch1-master-1 Sep 17 22:05:17.501672 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-6246b869-53a9-4c97-a061-8b5598f5f1a1 req-172db432-9ec9-42a4-8808-8f91e64057bb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098337 Sep 17 22:05:17.502789 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3585/7073] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 22:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 22:05:17.553681 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-25db84db-ee9b-41ff-bb5d-6af54f412398 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "DELETE /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 204 len: 0 microversion: 2.1 time: 0.152729 Sep 17 22:05:17.557568 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3489/7074] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 22:05:17 2022] DELETE /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 22:05:17.564589 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1d2a8127-5e36-4ef1-849f-acef9f202378 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:05:17.565334 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1d2a8127-5e36-4ef1-849f-acef9f202378 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:05:17.572618 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d2a8127-5e36-4ef1-849f-acef9f202378 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:17.573136 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d2a8127-5e36-4ef1-849f-acef9f202378 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:17.573628 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d2a8127-5e36-4ef1-849f-acef9f202378 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:17.574613 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d2a8127-5e36-4ef1-849f-acef9f202378 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:17.575096 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d2a8127-5e36-4ef1-849f-acef9f202378 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:17.575540 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1d2a8127-5e36-4ef1-849f-acef9f202378 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:17.771294 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1d2a8127-5e36-4ef1-849f-acef9f202378 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:05:17.779625 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1d2a8127-5e36-4ef1-849f-acef9f202378 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1569 microversion: 2.1 time: 0.219720 Sep 17 22:05:17.780212 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3586/7075] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:05:17 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1569 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:05:18.805441 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-36533f4f-a483-4ebe-a477-fb248c795058 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:05:18.806166 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-36533f4f-a483-4ebe-a477-fb248c795058 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:05:18.813608 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36533f4f-a483-4ebe-a477-fb248c795058 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:18.814103 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36533f4f-a483-4ebe-a477-fb248c795058 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:18.814547 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36533f4f-a483-4ebe-a477-fb248c795058 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:18.815246 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36533f4f-a483-4ebe-a477-fb248c795058 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:18.815698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36533f4f-a483-4ebe-a477-fb248c795058 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:18.816126 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-36533f4f-a483-4ebe-a477-fb248c795058 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:19.000633 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-36533f4f-a483-4ebe-a477-fb248c795058 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:05:19.008940 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-36533f4f-a483-4ebe-a477-fb248c795058 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1569 microversion: 2.1 time: 0.207975 Sep 17 22:05:19.009485 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3490/7076] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:05:18 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:05:19.557481 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-6bef8ee5-4f09-4324-95e0-fc0d0214b4d1 req-015b298c-7ea8-46c0-87a2-ac4b666615f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "020679f9-06a5-4385-af5b-adbb87ad6fa7", "name": "network-vif-deleted", "tag": "c2a86933-0e0e-4a31-bd20-e04591563b54"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 22:05:19.572725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6bef8ee5-4f09-4324-95e0-fc0d0214b4d1 req-015b298c-7ea8-46c0-87a2-ac4b666615f5 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:19.573633 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6bef8ee5-4f09-4324-95e0-fc0d0214b4d1 req-015b298c-7ea8-46c0-87a2-ac4b666615f5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:19.574134 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-6bef8ee5-4f09-4324-95e0-fc0d0214b4d1 req-015b298c-7ea8-46c0-87a2-ac4b666615f5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:19.587893 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-6bef8ee5-4f09-4324-95e0-fc0d0214b4d1 req-015b298c-7ea8-46c0-87a2-ac4b666615f5 service nova] Creating event network-vif-deleted:c2a86933-0e0e-4a31-bd20-e04591563b54 for instance 020679f9-06a5-4385-af5b-adbb87ad6fa7 on nch1-master-1 Sep 17 22:05:19.592953 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-6bef8ee5-4f09-4324-95e0-fc0d0214b4d1 req-015b298c-7ea8-46c0-87a2-ac4b666615f5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039290 Sep 17 22:05:19.594134 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3587/7077] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 22:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 22:05:20.034867 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-527789c1-0e3a-40ef-964c-a0325a48dc24 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:05:20.035741 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-527789c1-0e3a-40ef-964c-a0325a48dc24 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:05:20.043356 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-527789c1-0e3a-40ef-964c-a0325a48dc24 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:20.043978 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-527789c1-0e3a-40ef-964c-a0325a48dc24 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:20.044516 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-527789c1-0e3a-40ef-964c-a0325a48dc24 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:20.045515 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-527789c1-0e3a-40ef-964c-a0325a48dc24 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:20.045977 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-527789c1-0e3a-40ef-964c-a0325a48dc24 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:20.046457 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-527789c1-0e3a-40ef-964c-a0325a48dc24 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:20.082097 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-527789c1-0e3a-40ef-964c-a0325a48dc24 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:20.082623 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-527789c1-0e3a-40ef-964c-a0325a48dc24 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:20.083080 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-527789c1-0e3a-40ef-964c-a0325a48dc24 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:20.083593 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.objects.instance [None req-527789c1-0e3a-40ef-964c-a0325a48dc24 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lazy-loading 'fault' on Instance uuid 020679f9-06a5-4385-af5b-adbb87ad6fa7 {{(pid=140523) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 22:05:20.128189 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-527789c1-0e3a-40ef-964c-a0325a48dc24 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3bf2dacad34c0aa465968f1c273cf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '015ec23d11f64d56844d28795ccba61a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:05:20.142554 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-527789c1-0e3a-40ef-964c-a0325a48dc24 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 200 len: 1224 microversion: 2.1 time: 0.113884 Sep 17 22:05:20.143264 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3491/7078] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:05:20 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 1224 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:05:21.171771 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2aacd7f0-3516-4fc6-8389-4017057c68f5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:05:21.172505 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-2aacd7f0-3516-4fc6-8389-4017057c68f5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] [instance: 020679f9-06a5-4385-af5b-adbb87ad6fa7] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:05:21.179669 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2aacd7f0-3516-4fc6-8389-4017057c68f5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:21.180189 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2aacd7f0-3516-4fc6-8389-4017057c68f5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:21.180655 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2aacd7f0-3516-4fc6-8389-4017057c68f5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:21.182015 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2aacd7f0-3516-4fc6-8389-4017057c68f5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:21.182015 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2aacd7f0-3516-4fc6-8389-4017057c68f5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:21.182336 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-2aacd7f0-3516-4fc6-8389-4017057c68f5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:21.197158 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.wsgi [None req-2aacd7f0-3516-4fc6-8389-4017057c68f5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] HTTP exception thrown: Instance 020679f9-06a5-4385-af5b-adbb87ad6fa7 could not be found. Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2aacd7f0-3516-4fc6-8389-4017057c68f5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Request method failure captured: Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: request: GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 HTTP/1.1 Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: Accept: application/json Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: Accept-Encoding: identity Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: Connection: close Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: Content-Length: 0 Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: Content-Type: application/json Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: Host: 10.222.0.26 Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: Openstack-System-Scope: None Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: User-Agent: python-urllib3/1.26.12 Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: X-Auth-Token: gAAAAABjJkKdxd9phFNeDcOC71uAaS1cpdQ5aZX-kmBuFl0eoODrxGhDnzg0JeIKC9fGWI2bLsC5AbBZU3uv4L74UF98Zj8jmy0mS2hpV93I70Ybbj_WWBIEoUKWF68OSOkoN3AsozMwuGY8VZhzF8LSDJS9FuI9ln_l8I2H3cLCwbM4V1b7gA0 Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Id: None Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: X-Domain-Name: None Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: X-Identity-Status: Confirmed Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: X-Is-Admin-Project: True Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Id: default Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Domain-Name: Default Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Id: 015ec23d11f64d56844d28795ccba61a Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: X-Project-Name: tempest-TestShelveInstance-1018269517 Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: X-Role: member,reader Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: X-Roles: member,reader Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/015ec23d11f64d56844d28795ccba61a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/015ec23d11f64d56844d28795ccba61a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/015ec23d11f64d56844d28795ccba61a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_015ec23d11f64d56844d28795ccba61a", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant: tempest-TestShelveInstance-1018269517 Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Id: 015ec23d11f64d56844d28795ccba61a Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: X-Tenant-Name: tempest-TestShelveInstance-1018269517 Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: X-User: tempest-TestShelveInstance-1018269517-project Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Id: default Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: X-User-Domain-Name: Default Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: X-User-Id: 3d3bf2dacad34c0aa465968f1c273cf9 Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: X-User-Name: tempest-TestShelveInstance-1018269517-project Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: method: > Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: exception: Instance 020679f9-06a5-4385-af5b-adbb87ad6fa7 could not be found. Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: action_args: {'id': '020679f9-06a5-4385-af5b-adbb87ad6fa7'} Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 020679f9-06a5-4385-af5b-adbb87ad6fa7 could not be found. Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 020679f9-06a5-4385-af5b-adbb87ad6fa7 could not be found. Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 22:05:21.198829 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 22:05:21.204591 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 22:05:21.204591 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 22:05:21.204591 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 22:05:21.204591 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 22:05:21.204591 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 22:05:21.204591 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 020679f9-06a5-4385-af5b-adbb87ad6fa7 could not be found. Sep 17 22:05:21.204591 ncdv-master-1 devstack@n-api.service[140524]: ERROR nova.api.openstack.wsgi Sep 17 22:05:21.204591 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-2aacd7f0-3516-4fc6-8389-4017057c68f5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Returning 404 to user: Instance 020679f9-06a5-4385-af5b-adbb87ad6fa7 could not be found. {{(pid=140524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 22:05:21.204591 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-2aacd7f0-3516-4fc6-8389-4017057c68f5 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7" status: 404 len: 111 microversion: 2.1 time: 0.035537 Sep 17 22:05:21.204591 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3588/7079] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:05:21 2022] GET /compute/v2.1/servers/020679f9-06a5-4385-af5b-adbb87ad6fa7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 22:05:21.379554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-9c6eee6c-15be-4866-ace9-48baaa0b4c66 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] Calling method '.version_select at 0x7f25a4dcc310>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:05:21.414578 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-9c6eee6c-15be-4866-ace9-48baaa0b4c66 tempest-TestShelveInstance-1018269517 tempest-TestShelveInstance-1018269517-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1591368172" status: 202 len: 0 microversion: 2.1 time: 0.040223 Sep 17 22:05:21.415183 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3492/7080] 10.222.0.26 () {58 vars in 1254 bytes} [Sat Sep 17 22:05:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1591368172 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 17 22:05:38.799863 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=8 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:05:38.800635 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=12 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:05:39.006298 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-98cc4009-99ae-4b6e-8330-69d1115a880d tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Action: 'create', calling method: .version_select at 0x7f259c3c2af0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-185310524", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDW5gLuvmGhnCKWgtsaaEc13B6IqPHmMIS0EA4dOzzZmFdMdzmlHd5g4HBxCBYAo1uiUOShaiWXr59xaPEm/iA6I7RxDT2ISbdMWDTK7foCcexuv5acQfUSkuETGLCSGnQ=="}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 22:05:39.023407 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-98cc4009-99ae-4b6e-8330-69d1115a880d tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Getting quotas for project 3881a625eb9c4ad9bc95e1a8033a5b3d. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 22:05:39.029233 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.quota [None req-98cc4009-99ae-4b6e-8330-69d1115a880d tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Getting quotas for user d46ef9b682704558999055a3b8f71f25 and project 3881a625eb9c4ad9bc95e1a8033a5b3d. Resources: {'key_pairs'} {{(pid=140524) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 22:05:39.062084 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-98cc4009-99ae-4b6e-8330-69d1115a880d tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.267301 Sep 17 22:05:39.062782 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3589/7081] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Sep 17 22:05:38 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 22:05:40.142447 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:05:40.143808 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:05:40.148220 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a3bab21e-2f8d-44f2-aa8c-d644fee698a0 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-175173223", "imageRef": "1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-185310524", "security_groups": [{"name": "tempest-secgroup-smoke-2060359336"}], "networks": [{"uuid": "64057aaf-73b4-4e45-9a07-e7e6f5a773d1"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 22:05:40.259462 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-a3bab21e-2f8d-44f2-aa8c-d644fee698a0 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] validate_networks() for [('64057aaf-73b4-4e45-9a07-e7e6f5a773d1', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 22:05:40.762220 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a3bab21e-2f8d-44f2-aa8c-d644fee698a0 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 22:05:40.762648 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a3bab21e-2f8d-44f2-aa8c-d644fee698a0 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 22:05:40.763462 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a3bab21e-2f8d-44f2-aa8c-d644fee698a0 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 22:05:40.763881 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a3bab21e-2f8d-44f2-aa8c-d644fee698a0 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 22:05:40.764408 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-a3bab21e-2f8d-44f2-aa8c-d644fee698a0 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 22:05:40.774067 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3bab21e-2f8d-44f2-aa8c-d644fee698a0 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:40.774554 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3bab21e-2f8d-44f2-aa8c-d644fee698a0 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:40.774997 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3bab21e-2f8d-44f2-aa8c-d644fee698a0 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:40.775730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3bab21e-2f8d-44f2-aa8c-d644fee698a0 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:40.776185 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3bab21e-2f8d-44f2-aa8c-d644fee698a0 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:40.776599 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3bab21e-2f8d-44f2-aa8c-d644fee698a0 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:40.796062 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-a3bab21e-2f8d-44f2-aa8c-d644fee698a0 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Getting quotas for project 3881a625eb9c4ad9bc95e1a8033a5b3d. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 22:05:40.801995 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-a3bab21e-2f8d-44f2-aa8c-d644fee698a0 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Getting quotas for user d46ef9b682704558999055a3b8f71f25 and project 3881a625eb9c4ad9bc95e1a8033a5b3d. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 22:05:40.819717 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a3bab21e-2f8d-44f2-aa8c-d644fee698a0 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 22:05:40.823910 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a3bab21e-2f8d-44f2-aa8c-d644fee698a0 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: b16edd7f-875f-4ba9-920b-30f297d20de6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1d08c0bf-f5b9-44bb-9eaf-23051e1d70a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 22:05:40.880982 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a3bab21e-2f8d-44f2-aa8c-d644fee698a0 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.741035 Sep 17 22:05:40.881651 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3493/7082] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 22:05:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 17 22:05:40.895008 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-24f82df5-d3d4-4015-8b93-f0a6e43079d1 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:05:40.895652 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-24f82df5-d3d4-4015-8b93-f0a6e43079d1 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: b16edd7f-875f-4ba9-920b-30f297d20de6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:05:40.963284 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-24f82df5-d3d4-4015-8b93-f0a6e43079d1 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:05:40.971421 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-24f82df5-d3d4-4015-8b93-f0a6e43079d1 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/b16edd7f-875f-4ba9-920b-30f297d20de6" status: 200 len: 1247 microversion: 2.1 time: 0.081840 Sep 17 22:05:40.972232 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3590/7083] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:05:40 2022] GET /compute/v2.1/servers/b16edd7f-875f-4ba9-920b-30f297d20de6 => generated 1247 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:05:41.996978 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f753a474-02e4-48a4-b91b-ccf78fdad465 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:05:41.997631 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f753a474-02e4-48a4-b91b-ccf78fdad465 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: b16edd7f-875f-4ba9-920b-30f297d20de6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:05:42.004836 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f753a474-02e4-48a4-b91b-ccf78fdad465 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:42.005337 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f753a474-02e4-48a4-b91b-ccf78fdad465 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:42.005966 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f753a474-02e4-48a4-b91b-ccf78fdad465 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:42.006684 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f753a474-02e4-48a4-b91b-ccf78fdad465 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:42.007153 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f753a474-02e4-48a4-b91b-ccf78fdad465 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:42.007590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f753a474-02e4-48a4-b91b-ccf78fdad465 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:42.083000 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f753a474-02e4-48a4-b91b-ccf78fdad465 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:05:42.092644 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f753a474-02e4-48a4-b91b-ccf78fdad465 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/b16edd7f-875f-4ba9-920b-30f297d20de6" status: 200 len: 1299 microversion: 2.1 time: 0.100936 Sep 17 22:05:42.093242 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3494/7084] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:05:41 2022] GET /compute/v2.1/servers/b16edd7f-875f-4ba9-920b-30f297d20de6 => generated 1299 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:05:43.116544 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3683b23b-5806-49dc-a4bc-f888411d05c3 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:05:43.117179 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3683b23b-5806-49dc-a4bc-f888411d05c3 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: b16edd7f-875f-4ba9-920b-30f297d20de6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:05:43.124823 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3683b23b-5806-49dc-a4bc-f888411d05c3 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:43.125353 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3683b23b-5806-49dc-a4bc-f888411d05c3 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:43.125855 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3683b23b-5806-49dc-a4bc-f888411d05c3 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:43.127306 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3683b23b-5806-49dc-a4bc-f888411d05c3 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:43.127794 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3683b23b-5806-49dc-a4bc-f888411d05c3 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:43.128255 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3683b23b-5806-49dc-a4bc-f888411d05c3 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:43.304069 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3683b23b-5806-49dc-a4bc-f888411d05c3 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:05:43.313244 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3683b23b-5806-49dc-a4bc-f888411d05c3 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/b16edd7f-875f-4ba9-920b-30f297d20de6" status: 200 len: 1373 microversion: 2.1 time: 0.200629 Sep 17 22:05:43.314557 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3591/7085] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:05:43 2022] GET /compute/v2.1/servers/b16edd7f-875f-4ba9-920b-30f297d20de6 => generated 1373 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:05:43.617716 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-6c8c85c1-3237-4862-b182-1fe540327dc0 req-32f1fda2-92e1-40e5-9ce6-fb3763ecedd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b16edd7f-875f-4ba9-920b-30f297d20de6", "tag": "528a58cf-25ef-4838-b8d9-85b4fd5ea68a"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 22:05:43.639839 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-6c8c85c1-3237-4862-b182-1fe540327dc0 req-32f1fda2-92e1-40e5-9ce6-fb3763ecedd0 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:43.643918 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-6c8c85c1-3237-4862-b182-1fe540327dc0 req-32f1fda2-92e1-40e5-9ce6-fb3763ecedd0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:43.644578 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-6c8c85c1-3237-4862-b182-1fe540327dc0 req-32f1fda2-92e1-40e5-9ce6-fb3763ecedd0 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:43.657962 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-6c8c85c1-3237-4862-b182-1fe540327dc0 req-32f1fda2-92e1-40e5-9ce6-fb3763ecedd0 service nova] Creating event network-changed:528a58cf-25ef-4838-b8d9-85b4fd5ea68a for instance b16edd7f-875f-4ba9-920b-30f297d20de6 on nch2-master-1 Sep 17 22:05:43.663314 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-6c8c85c1-3237-4862-b182-1fe540327dc0 req-32f1fda2-92e1-40e5-9ce6-fb3763ecedd0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049461 Sep 17 22:05:43.664619 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3495/7086] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 22:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 17 22:05:44.343574 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-ed189953-0155-44c3-99f2-e51bbf8e6973 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:05:44.344636 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-ed189953-0155-44c3-99f2-e51bbf8e6973 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: b16edd7f-875f-4ba9-920b-30f297d20de6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:05:44.356479 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed189953-0155-44c3-99f2-e51bbf8e6973 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:44.356983 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed189953-0155-44c3-99f2-e51bbf8e6973 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:44.357448 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed189953-0155-44c3-99f2-e51bbf8e6973 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:44.358200 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed189953-0155-44c3-99f2-e51bbf8e6973 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:44.358674 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed189953-0155-44c3-99f2-e51bbf8e6973 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:44.359118 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-ed189953-0155-44c3-99f2-e51bbf8e6973 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:44.509824 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-ed189953-0155-44c3-99f2-e51bbf8e6973 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:05:44.518086 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-ed189953-0155-44c3-99f2-e51bbf8e6973 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/b16edd7f-875f-4ba9-920b-30f297d20de6" status: 200 len: 1373 microversion: 2.1 time: 0.181218 Sep 17 22:05:44.518688 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3592/7087] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:05:44 2022] GET /compute/v2.1/servers/b16edd7f-875f-4ba9-920b-30f297d20de6 => generated 1373 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:05:45.542450 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f4c0ac6b-752c-4e3c-86a8-1aad98d1b4a4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:05:45.543124 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f4c0ac6b-752c-4e3c-86a8-1aad98d1b4a4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: b16edd7f-875f-4ba9-920b-30f297d20de6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:05:45.550159 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f4c0ac6b-752c-4e3c-86a8-1aad98d1b4a4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:45.550651 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f4c0ac6b-752c-4e3c-86a8-1aad98d1b4a4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:45.551097 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f4c0ac6b-752c-4e3c-86a8-1aad98d1b4a4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:45.551814 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f4c0ac6b-752c-4e3c-86a8-1aad98d1b4a4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:45.552271 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f4c0ac6b-752c-4e3c-86a8-1aad98d1b4a4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:45.552704 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f4c0ac6b-752c-4e3c-86a8-1aad98d1b4a4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:45.695367 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f4c0ac6b-752c-4e3c-86a8-1aad98d1b4a4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:05:45.703993 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f4c0ac6b-752c-4e3c-86a8-1aad98d1b4a4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/b16edd7f-875f-4ba9-920b-30f297d20de6" status: 200 len: 1373 microversion: 2.1 time: 0.166711 Sep 17 22:05:45.704662 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3496/7088] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:05:45 2022] GET /compute/v2.1/servers/b16edd7f-875f-4ba9-920b-30f297d20de6 => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:05:46.729048 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7cf675e5-0174-46e8-9f03-4e794f95718a tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:05:46.729720 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7cf675e5-0174-46e8-9f03-4e794f95718a tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: b16edd7f-875f-4ba9-920b-30f297d20de6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:05:46.740073 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7cf675e5-0174-46e8-9f03-4e794f95718a tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:46.740794 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7cf675e5-0174-46e8-9f03-4e794f95718a tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:46.741404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7cf675e5-0174-46e8-9f03-4e794f95718a tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:46.742484 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7cf675e5-0174-46e8-9f03-4e794f95718a tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:46.743045 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7cf675e5-0174-46e8-9f03-4e794f95718a tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:46.743650 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7cf675e5-0174-46e8-9f03-4e794f95718a tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:46.882696 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7cf675e5-0174-46e8-9f03-4e794f95718a tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:05:46.890945 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7cf675e5-0174-46e8-9f03-4e794f95718a tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/b16edd7f-875f-4ba9-920b-30f297d20de6" status: 200 len: 1373 microversion: 2.1 time: 0.166934 Sep 17 22:05:46.891554 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3593/7089] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:05:46 2022] GET /compute/v2.1/servers/b16edd7f-875f-4ba9-920b-30f297d20de6 => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:05:47.918248 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-d06d2983-c2a8-4f91-b679-5506280159b1 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:05:47.919314 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-d06d2983-c2a8-4f91-b679-5506280159b1 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: b16edd7f-875f-4ba9-920b-30f297d20de6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:05:47.926843 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d06d2983-c2a8-4f91-b679-5506280159b1 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:47.927335 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d06d2983-c2a8-4f91-b679-5506280159b1 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:47.927780 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d06d2983-c2a8-4f91-b679-5506280159b1 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:47.928484 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d06d2983-c2a8-4f91-b679-5506280159b1 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:47.928946 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d06d2983-c2a8-4f91-b679-5506280159b1 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:47.929379 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-d06d2983-c2a8-4f91-b679-5506280159b1 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:48.063894 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-d06d2983-c2a8-4f91-b679-5506280159b1 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:05:48.072274 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-d06d2983-c2a8-4f91-b679-5506280159b1 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/b16edd7f-875f-4ba9-920b-30f297d20de6" status: 200 len: 1373 microversion: 2.1 time: 0.160640 Sep 17 22:05:48.072864 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3497/7090] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:05:47 2022] GET /compute/v2.1/servers/b16edd7f-875f-4ba9-920b-30f297d20de6 => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:05:48.944684 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-547f8aff-5357-4dd6-b231-b521ce9f93c4 req-7ca82124-9d17-4533-bf3b-74b92264177d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b16edd7f-875f-4ba9-920b-30f297d20de6", "name": "network-vif-plugged", "status": "completed", "tag": "528a58cf-25ef-4838-b8d9-85b4fd5ea68a"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 22:05:48.955944 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-547f8aff-5357-4dd6-b231-b521ce9f93c4 req-7ca82124-9d17-4533-bf3b-74b92264177d service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:48.956446 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-547f8aff-5357-4dd6-b231-b521ce9f93c4 req-7ca82124-9d17-4533-bf3b-74b92264177d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:48.956922 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-547f8aff-5357-4dd6-b231-b521ce9f93c4 req-7ca82124-9d17-4533-bf3b-74b92264177d service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:48.968402 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-547f8aff-5357-4dd6-b231-b521ce9f93c4 req-7ca82124-9d17-4533-bf3b-74b92264177d service nova] Creating event network-vif-plugged:528a58cf-25ef-4838-b8d9-85b4fd5ea68a for instance b16edd7f-875f-4ba9-920b-30f297d20de6 on nch2-master-1 Sep 17 22:05:48.973556 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-547f8aff-5357-4dd6-b231-b521ce9f93c4 req-7ca82124-9d17-4533-bf3b-74b92264177d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032710 Sep 17 22:05:48.974139 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3594/7091] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 22:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 22:05:49.096192 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-bc213a63-9b04-4336-8349-34751dbb82f5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:05:49.096880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-bc213a63-9b04-4336-8349-34751dbb82f5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: b16edd7f-875f-4ba9-920b-30f297d20de6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:05:49.103997 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bc213a63-9b04-4336-8349-34751dbb82f5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:49.104491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bc213a63-9b04-4336-8349-34751dbb82f5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:49.104937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bc213a63-9b04-4336-8349-34751dbb82f5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:49.105683 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bc213a63-9b04-4336-8349-34751dbb82f5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:49.106148 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bc213a63-9b04-4336-8349-34751dbb82f5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:49.106578 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-bc213a63-9b04-4336-8349-34751dbb82f5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:49.247969 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-bc213a63-9b04-4336-8349-34751dbb82f5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:05:49.256250 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-bc213a63-9b04-4336-8349-34751dbb82f5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/b16edd7f-875f-4ba9-920b-30f297d20de6" status: 200 len: 1373 microversion: 2.1 time: 0.164120 Sep 17 22:05:49.256845 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3498/7092] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:05:49 2022] GET /compute/v2.1/servers/b16edd7f-875f-4ba9-920b-30f297d20de6 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:05:50.280993 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-a165de3c-7673-420e-b696-49e3b6901ee5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:05:50.281739 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-a165de3c-7673-420e-b696-49e3b6901ee5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: b16edd7f-875f-4ba9-920b-30f297d20de6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:05:50.288760 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a165de3c-7673-420e-b696-49e3b6901ee5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:50.289267 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a165de3c-7673-420e-b696-49e3b6901ee5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:50.289767 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a165de3c-7673-420e-b696-49e3b6901ee5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:50.290519 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a165de3c-7673-420e-b696-49e3b6901ee5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:50.290998 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a165de3c-7673-420e-b696-49e3b6901ee5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:50.291440 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-a165de3c-7673-420e-b696-49e3b6901ee5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:50.427578 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-a165de3c-7673-420e-b696-49e3b6901ee5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:05:50.436129 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-a165de3c-7673-420e-b696-49e3b6901ee5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/b16edd7f-875f-4ba9-920b-30f297d20de6" status: 200 len: 1557 microversion: 2.1 time: 0.160354 Sep 17 22:05:50.436713 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3595/7093] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:05:50 2022] GET /compute/v2.1/servers/b16edd7f-875f-4ba9-920b-30f297d20de6 => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:05:50.458909 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-69ae7ea8-7ec1-40b9-9e25-d1dd5606275e tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:05:50.459421 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-69ae7ea8-7ec1-40b9-9e25-d1dd5606275e tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: b16edd7f-875f-4ba9-920b-30f297d20de6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:05:50.467008 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69ae7ea8-7ec1-40b9-9e25-d1dd5606275e tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:50.467509 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69ae7ea8-7ec1-40b9-9e25-d1dd5606275e tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:50.467990 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69ae7ea8-7ec1-40b9-9e25-d1dd5606275e tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:50.468707 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69ae7ea8-7ec1-40b9-9e25-d1dd5606275e tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:50.469270 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69ae7ea8-7ec1-40b9-9e25-d1dd5606275e tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:50.469734 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-69ae7ea8-7ec1-40b9-9e25-d1dd5606275e tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:50.607921 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-69ae7ea8-7ec1-40b9-9e25-d1dd5606275e tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:05:50.619735 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-69ae7ea8-7ec1-40b9-9e25-d1dd5606275e tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/b16edd7f-875f-4ba9-920b-30f297d20de6" status: 200 len: 1557 microversion: 2.1 time: 0.164651 Sep 17 22:05:50.620519 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3499/7094] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:05:50 2022] GET /compute/v2.1/servers/b16edd7f-875f-4ba9-920b-30f297d20de6 => generated 1557 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:05:52.662373 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=6 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:05:52.730532 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-f60d7238-1603-452c-a847-6df1ada1119e req-0545beac-5bc3-40e2-8ad8-d674142bb915 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b16edd7f-875f-4ba9-920b-30f297d20de6", "tag": "528a58cf-25ef-4838-b8d9-85b4fd5ea68a"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 22:05:52.740585 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f60d7238-1603-452c-a847-6df1ada1119e req-0545beac-5bc3-40e2-8ad8-d674142bb915 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:05:52.741555 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f60d7238-1603-452c-a847-6df1ada1119e req-0545beac-5bc3-40e2-8ad8-d674142bb915 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:05:52.742011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-f60d7238-1603-452c-a847-6df1ada1119e req-0545beac-5bc3-40e2-8ad8-d674142bb915 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:05:52.753688 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-f60d7238-1603-452c-a847-6df1ada1119e req-0545beac-5bc3-40e2-8ad8-d674142bb915 service nova] Creating event network-changed:528a58cf-25ef-4838-b8d9-85b4fd5ea68a for instance b16edd7f-875f-4ba9-920b-30f297d20de6 on nch2-master-1 Sep 17 22:05:52.759107 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-f60d7238-1603-452c-a847-6df1ada1119e req-0545beac-5bc3-40e2-8ad8-d674142bb915 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101536 Sep 17 22:05:52.760092 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3596/7095] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 22:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 22:07:50.063269 ncdv-master-1 devstack@n-api.service[140523]: ERROR oslo.messaging._drivers.impl_rabbit [-] [43af6626-5086-4256-806a-0090082f769c] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 17 22:07:50.064768 ncdv-master-1 devstack@n-api.service[140523]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eb955ca7-44ca-4d87-9bde-78c4d0a94e44] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 17 22:07:50.065860 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:07:50.067146 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:07:50.068094 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:07:50.069199 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=34 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:07:50.075316 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a7172bee-8883-45ef-82f6-4884da53f49c tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-990886331"}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 22:07:50.077840 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a7172bee-8883-45ef-82f6-4884da53f49c tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: b16edd7f-875f-4ba9-920b-30f297d20de6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:07:50.086730 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a7172bee-8883-45ef-82f6-4884da53f49c tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:07:50.087265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a7172bee-8883-45ef-82f6-4884da53f49c tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:07:50.087720 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a7172bee-8883-45ef-82f6-4884da53f49c tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:07:50.088638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a7172bee-8883-45ef-82f6-4884da53f49c tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:07:50.089102 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a7172bee-8883-45ef-82f6-4884da53f49c tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:07:50.089568 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a7172bee-8883-45ef-82f6-4884da53f49c tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:07:50.309523 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a7172bee-8883-45ef-82f6-4884da53f49c tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "POST /compute/v2.1/servers/b16edd7f-875f-4ba9-920b-30f297d20de6/action" status: 202 len: 0 microversion: 2.1 time: 0.249503 Sep 17 22:07:50.310193 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3500/7096] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 22:07:50 2022] POST /compute/v2.1/servers/b16edd7f-875f-4ba9-920b-30f297d20de6/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 17 22:07:55.488117 ncdv-master-1 devstack@n-api.service[140524]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0c677b88-ed69-4f5f-b874-71db171b23f2] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 17 22:07:55.489668 ncdv-master-1 devstack@n-api.service[140524]: ERROR oslo.messaging._drivers.impl_rabbit [-] [04285588-4085-42d9-ae87-82f4a29bd916] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 17 22:07:55.490725 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:07:55.492209 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=28 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:07:55.567917 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-49e9a3a7-5bdf-4c96-a029-a3ad90bfd45b req-3c75e120-238f-4693-b51b-90574880c154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b16edd7f-875f-4ba9-920b-30f297d20de6", "name": "network-vif-plugged", "status": "completed", "tag": "528a58cf-25ef-4838-b8d9-85b4fd5ea68a"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 22:07:55.590937 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-49e9a3a7-5bdf-4c96-a029-a3ad90bfd45b req-3c75e120-238f-4693-b51b-90574880c154 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:07:55.591739 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-49e9a3a7-5bdf-4c96-a029-a3ad90bfd45b req-3c75e120-238f-4693-b51b-90574880c154 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:07:55.592410 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-49e9a3a7-5bdf-4c96-a029-a3ad90bfd45b req-3c75e120-238f-4693-b51b-90574880c154 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:07:55.610255 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-49e9a3a7-5bdf-4c96-a029-a3ad90bfd45b req-3c75e120-238f-4693-b51b-90574880c154 service nova] Creating event network-vif-plugged:528a58cf-25ef-4838-b8d9-85b4fd5ea68a for instance b16edd7f-875f-4ba9-920b-30f297d20de6 on nch2-master-1 Sep 17 22:07:55.616296 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-49e9a3a7-5bdf-4c96-a029-a3ad90bfd45b req-3c75e120-238f-4693-b51b-90574880c154 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130563 Sep 17 22:07:55.617020 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3597/7097] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 22:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 22:08:03.895635 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:08:03.896434 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:08:03.900704 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ae04f0d2-ac9a-4add-9d22-85749ac23268 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1983576891", "imageRef": "dc3aa9e8-92c1-4ff2-b69a-1bdc33ac3877", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-185310524", "security_groups": [{"name": "tempest-secgroup-smoke-2060359336"}], "networks": [{"uuid": "64057aaf-73b4-4e45-9a07-e7e6f5a773d1"}]}} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 22:08:03.926472 ncdv-master-1 devstack@n-api.service[140523]: INFO oslo.messaging._drivers.impl_rabbit [-] [43af6626-5086-4256-806a-0090082f769c] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 57160. Sep 17 22:08:03.927208 ncdv-master-1 devstack@n-api.service[140523]: INFO oslo.messaging._drivers.impl_rabbit [-] [eb955ca7-44ca-4d87-9bde-78c4d0a94e44] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 57162. Sep 17 22:08:04.030736 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.network.neutron [None req-ae04f0d2-ac9a-4add-9d22-85749ac23268 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] validate_networks() for [('64057aaf-73b4-4e45-9a07-e7e6f5a773d1', None, None, None, None, None)] {{(pid=140523) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 17 22:08:04.417896 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-ae04f0d2-ac9a-4add-9d22-85749ac23268 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Flavor limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 17 22:08:04.418458 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-ae04f0d2-ac9a-4add-9d22-85749ac23268 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Image limits 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 17 22:08:04.419184 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-ae04f0d2-ac9a-4add-9d22-85749ac23268 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Flavor pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 17 22:08:04.419712 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-ae04f0d2-ac9a-4add-9d22-85749ac23268 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Image pref 0:0:0 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 17 22:08:04.420188 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.virt.hardware [None req-ae04f0d2-ac9a-4add-9d22-85749ac23268 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=140523) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 17 22:08:04.433853 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ae04f0d2-ac9a-4add-9d22-85749ac23268 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:04.434533 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ae04f0d2-ac9a-4add-9d22-85749ac23268 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:04.435184 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ae04f0d2-ac9a-4add-9d22-85749ac23268 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:04.436265 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ae04f0d2-ac9a-4add-9d22-85749ac23268 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:04.436941 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ae04f0d2-ac9a-4add-9d22-85749ac23268 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:04.437566 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ae04f0d2-ac9a-4add-9d22-85749ac23268 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:04.456871 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-ae04f0d2-ac9a-4add-9d22-85749ac23268 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Getting quotas for project 3881a625eb9c4ad9bc95e1a8033a5b3d. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 17 22:08:04.462195 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.quota [None req-ae04f0d2-ac9a-4add-9d22-85749ac23268 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Getting quotas for user d46ef9b682704558999055a3b8f71f25 and project 3881a625eb9c4ad9bc95e1a8033a5b3d. Resources: {'cores', 'ram', 'instances'} {{(pid=140523) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 17 22:08:04.474918 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ae04f0d2-ac9a-4add-9d22-85749ac23268 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Going to run 1 instances... {{(pid=140523) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 17 22:08:04.477440 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ae04f0d2-ac9a-4add-9d22-85749ac23268 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: 3b3b12e9-a732-453b-8e91-9e1ab78dad49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dc3aa9e8-92c1-4ff2-b69a-1bdc33ac3877',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=140523) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 17 22:08:04.537122 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ae04f0d2-ac9a-4add-9d22-85749ac23268 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.643620 Sep 17 22:08:04.537921 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3501/7098] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Sep 17 22:08:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 17 22:08:04.551806 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-80b096c4-0b8d-42cb-b094-0c14e7ff6fa5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:08:04.552640 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-80b096c4-0b8d-42cb-b094-0c14e7ff6fa5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: 3b3b12e9-a732-453b-8e91-9e1ab78dad49] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:08:04.580003 ncdv-master-1 devstack@n-api.service[140524]: INFO oslo.messaging._drivers.impl_rabbit [-] [04285588-4085-42d9-ae87-82f4a29bd916] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 57178. Sep 17 22:08:04.581271 ncdv-master-1 devstack@n-api.service[140524]: INFO oslo.messaging._drivers.impl_rabbit [-] [0c677b88-ed69-4f5f-b874-71db171b23f2] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 57176. Sep 17 22:08:04.614222 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-80b096c4-0b8d-42cb-b094-0c14e7ff6fa5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:08:04.622017 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-80b096c4-0b8d-42cb-b094-0c14e7ff6fa5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49" status: 200 len: 1248 microversion: 2.1 time: 0.076030 Sep 17 22:08:04.622598 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3598/7099] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:08:04 2022] GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49 => generated 1248 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:08:05.646257 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-ee54dd44-53ac-4872-941e-d39ac4b01b73 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:08:05.647558 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-ee54dd44-53ac-4872-941e-d39ac4b01b73 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: 3b3b12e9-a732-453b-8e91-9e1ab78dad49] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:08:05.655819 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee54dd44-53ac-4872-941e-d39ac4b01b73 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:05.656497 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee54dd44-53ac-4872-941e-d39ac4b01b73 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:05.657120 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee54dd44-53ac-4872-941e-d39ac4b01b73 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:05.657866 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee54dd44-53ac-4872-941e-d39ac4b01b73 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:05.658484 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee54dd44-53ac-4872-941e-d39ac4b01b73 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:05.658917 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-ee54dd44-53ac-4872-941e-d39ac4b01b73 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:05.724526 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-ee54dd44-53ac-4872-941e-d39ac4b01b73 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:08:05.732557 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-ee54dd44-53ac-4872-941e-d39ac4b01b73 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49" status: 200 len: 1308 microversion: 2.1 time: 0.090970 Sep 17 22:08:05.733395 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3502/7100] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:08:05 2022] GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49 => generated 1308 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:08:06.756110 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7b55a7b0-eca9-4179-b57e-6a4c614639c7 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:08:06.756842 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7b55a7b0-eca9-4179-b57e-6a4c614639c7 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: 3b3b12e9-a732-453b-8e91-9e1ab78dad49] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:08:06.759882 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:08:06.768918 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7b55a7b0-eca9-4179-b57e-6a4c614639c7 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:06.769839 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7b55a7b0-eca9-4179-b57e-6a4c614639c7 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:06.770554 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7b55a7b0-eca9-4179-b57e-6a4c614639c7 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:06.771503 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7b55a7b0-eca9-4179-b57e-6a4c614639c7 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:06.772165 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7b55a7b0-eca9-4179-b57e-6a4c614639c7 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:06.772795 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7b55a7b0-eca9-4179-b57e-6a4c614639c7 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:06.937334 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7b55a7b0-eca9-4179-b57e-6a4c614639c7 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:08:06.946588 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7b55a7b0-eca9-4179-b57e-6a4c614639c7 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49" status: 200 len: 1374 microversion: 2.1 time: 0.193995 Sep 17 22:08:06.956116 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3599/7101] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:08:06 2022] GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49 => generated 1374 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:08:07.734032 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-84f793f6-1be3-4bc4-b6d5-cd8081cdef41 req-afbc6028-f8e0-4c50-9179-764b981cd44b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b16edd7f-875f-4ba9-920b-30f297d20de6", "name": "network-vif-unplugged", "status": "completed", "tag": "528a58cf-25ef-4838-b8d9-85b4fd5ea68a"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 22:08:07.746585 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-84f793f6-1be3-4bc4-b6d5-cd8081cdef41 req-afbc6028-f8e0-4c50-9179-764b981cd44b service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:07.747379 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-84f793f6-1be3-4bc4-b6d5-cd8081cdef41 req-afbc6028-f8e0-4c50-9179-764b981cd44b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:07.748558 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-84f793f6-1be3-4bc4-b6d5-cd8081cdef41 req-afbc6028-f8e0-4c50-9179-764b981cd44b service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:07.771072 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-84f793f6-1be3-4bc4-b6d5-cd8081cdef41 req-afbc6028-f8e0-4c50-9179-764b981cd44b service nova] Creating event network-vif-unplugged:528a58cf-25ef-4838-b8d9-85b4fd5ea68a for instance b16edd7f-875f-4ba9-920b-30f297d20de6 on nch2-master-1 Sep 17 22:08:07.784174 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-84f793f6-1be3-4bc4-b6d5-cd8081cdef41 req-afbc6028-f8e0-4c50-9179-764b981cd44b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054688 Sep 17 22:08:07.787504 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3503/7102] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 22:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 22:08:07.970376 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-64608fee-698d-4339-8f6d-836c0509d2d4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:08:07.970971 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-64608fee-698d-4339-8f6d-836c0509d2d4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: 3b3b12e9-a732-453b-8e91-9e1ab78dad49] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:08:07.978482 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64608fee-698d-4339-8f6d-836c0509d2d4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:07.979001 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64608fee-698d-4339-8f6d-836c0509d2d4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:07.979457 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64608fee-698d-4339-8f6d-836c0509d2d4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:07.980198 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64608fee-698d-4339-8f6d-836c0509d2d4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:07.980685 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64608fee-698d-4339-8f6d-836c0509d2d4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:07.981127 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-64608fee-698d-4339-8f6d-836c0509d2d4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:08.127958 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-64608fee-698d-4339-8f6d-836c0509d2d4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:08:08.137063 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-64608fee-698d-4339-8f6d-836c0509d2d4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49" status: 200 len: 1374 microversion: 2.1 time: 0.170749 Sep 17 22:08:08.137971 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3600/7103] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:08:07 2022] GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49 => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:08:09.161620 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-0dfae288-ffd7-4a46-9e6b-930c463a19bf tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:08:09.162334 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-0dfae288-ffd7-4a46-9e6b-930c463a19bf tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: 3b3b12e9-a732-453b-8e91-9e1ab78dad49] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:08:09.170210 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0dfae288-ffd7-4a46-9e6b-930c463a19bf tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:09.170710 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0dfae288-ffd7-4a46-9e6b-930c463a19bf tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:09.171157 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0dfae288-ffd7-4a46-9e6b-930c463a19bf tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:09.171880 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0dfae288-ffd7-4a46-9e6b-930c463a19bf tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:09.172342 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0dfae288-ffd7-4a46-9e6b-930c463a19bf tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:09.172782 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-0dfae288-ffd7-4a46-9e6b-930c463a19bf tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:09.327862 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-0dfae288-ffd7-4a46-9e6b-930c463a19bf tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:08:09.336730 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-0dfae288-ffd7-4a46-9e6b-930c463a19bf tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49" status: 200 len: 1374 microversion: 2.1 time: 0.179487 Sep 17 22:08:09.337654 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3504/7104] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:08:09 2022] GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49 => generated 1374 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:08:10.360497 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-9109a41b-60ba-49d9-84c9-dd3a7bd840a2 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:08:10.361237 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-9109a41b-60ba-49d9-84c9-dd3a7bd840a2 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: 3b3b12e9-a732-453b-8e91-9e1ab78dad49] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:08:10.368537 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9109a41b-60ba-49d9-84c9-dd3a7bd840a2 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:10.369058 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9109a41b-60ba-49d9-84c9-dd3a7bd840a2 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:10.369811 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9109a41b-60ba-49d9-84c9-dd3a7bd840a2 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:10.370266 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9109a41b-60ba-49d9-84c9-dd3a7bd840a2 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:10.370726 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9109a41b-60ba-49d9-84c9-dd3a7bd840a2 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:10.371186 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-9109a41b-60ba-49d9-84c9-dd3a7bd840a2 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:10.526775 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-9109a41b-60ba-49d9-84c9-dd3a7bd840a2 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:08:10.535426 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-9109a41b-60ba-49d9-84c9-dd3a7bd840a2 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49" status: 200 len: 1374 microversion: 2.1 time: 0.178839 Sep 17 22:08:10.536172 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3601/7105] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:08:10 2022] GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49 => generated 1374 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:08:11.589397 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-110a4b67-da22-4496-9096-f45413f6c2dc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:08:11.590064 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-110a4b67-da22-4496-9096-f45413f6c2dc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: 3b3b12e9-a732-453b-8e91-9e1ab78dad49] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:08:11.597519 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-110a4b67-da22-4496-9096-f45413f6c2dc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:11.598008 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-110a4b67-da22-4496-9096-f45413f6c2dc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:11.598688 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-110a4b67-da22-4496-9096-f45413f6c2dc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:11.599405 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-110a4b67-da22-4496-9096-f45413f6c2dc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:11.599874 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-110a4b67-da22-4496-9096-f45413f6c2dc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:11.600343 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-110a4b67-da22-4496-9096-f45413f6c2dc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:11.765479 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-110a4b67-da22-4496-9096-f45413f6c2dc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:08:11.773555 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-110a4b67-da22-4496-9096-f45413f6c2dc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49" status: 200 len: 1374 microversion: 2.1 time: 0.189605 Sep 17 22:08:11.774152 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3505/7106] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:08:11 2022] GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49 => generated 1374 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:08:12.796891 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-8cdfd7ed-b679-470a-98c4-e24335385acc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:08:12.797706 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-8cdfd7ed-b679-470a-98c4-e24335385acc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: 3b3b12e9-a732-453b-8e91-9e1ab78dad49] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:08:12.805025 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8cdfd7ed-b679-470a-98c4-e24335385acc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:12.805589 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8cdfd7ed-b679-470a-98c4-e24335385acc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:12.806054 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8cdfd7ed-b679-470a-98c4-e24335385acc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:12.806801 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8cdfd7ed-b679-470a-98c4-e24335385acc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:12.807276 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8cdfd7ed-b679-470a-98c4-e24335385acc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:12.807763 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-8cdfd7ed-b679-470a-98c4-e24335385acc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:12.956121 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-8cdfd7ed-b679-470a-98c4-e24335385acc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:08:12.964890 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-8cdfd7ed-b679-470a-98c4-e24335385acc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49" status: 200 len: 1374 microversion: 2.1 time: 0.172067 Sep 17 22:08:12.965514 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3602/7107] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:08:12 2022] GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49 => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:08:13.993648 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a3483d14-f0dc-45e1-ab3c-5b2b94213e8b tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:08:13.994612 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a3483d14-f0dc-45e1-ab3c-5b2b94213e8b tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: 3b3b12e9-a732-453b-8e91-9e1ab78dad49] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:08:14.007197 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3483d14-f0dc-45e1-ab3c-5b2b94213e8b tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:14.007828 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3483d14-f0dc-45e1-ab3c-5b2b94213e8b tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:14.009061 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3483d14-f0dc-45e1-ab3c-5b2b94213e8b tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:14.010139 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3483d14-f0dc-45e1-ab3c-5b2b94213e8b tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:14.010842 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3483d14-f0dc-45e1-ab3c-5b2b94213e8b tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:14.011376 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a3483d14-f0dc-45e1-ab3c-5b2b94213e8b tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:14.157980 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a3483d14-f0dc-45e1-ab3c-5b2b94213e8b tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:08:14.166349 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a3483d14-f0dc-45e1-ab3c-5b2b94213e8b tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49" status: 200 len: 1374 microversion: 2.1 time: 0.180906 Sep 17 22:08:14.166939 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3506/7108] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:08:13 2022] GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49 => generated 1374 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:08:15.141141 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [req-45efe7c0-f357-4d7c-8c0a-674c70ffdc65 req-82248ccd-1790-40cf-88be-c93cde33dec2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b3b12e9-a732-453b-8e91-9e1ab78dad49", "tag": "9c6166c9-b2a7-4b15-96df-0cbb1a100b16"}]} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 22:08:15.149505 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell0:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:08:15.154849 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-45efe7c0-f357-4d7c-8c0a-674c70ffdc65 req-82248ccd-1790-40cf-88be-c93cde33dec2 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:15.155357 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-45efe7c0-f357-4d7c-8c0a-674c70ffdc65 req-82248ccd-1790-40cf-88be-c93cde33dec2 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:15.155806 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [req-45efe7c0-f357-4d7c-8c0a-674c70ffdc65 req-82248ccd-1790-40cf-88be-c93cde33dec2 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:15.168787 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.compute.server_external_events [req-45efe7c0-f357-4d7c-8c0a-674c70ffdc65 req-82248ccd-1790-40cf-88be-c93cde33dec2 service nova] Creating event network-changed:9c6166c9-b2a7-4b15-96df-0cbb1a100b16 for instance 3b3b12e9-a732-453b-8e91-9e1ab78dad49 on nch1-master-1 Sep 17 22:08:15.176209 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [req-45efe7c0-f357-4d7c-8c0a-674c70ffdc65 req-82248ccd-1790-40cf-88be-c93cde33dec2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038891 Sep 17 22:08:15.176874 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3603/7109] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 22:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 22:08:15.188743 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-8079649f-0d68-4bbb-92ad-da502d2bbf9a tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:08:15.189958 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-8079649f-0d68-4bbb-92ad-da502d2bbf9a tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: 3b3b12e9-a732-453b-8e91-9e1ab78dad49] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:08:15.192037 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=2 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:08:15.192710 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell0:SELECT=6 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:08:15.199823 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8079649f-0d68-4bbb-92ad-da502d2bbf9a tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:15.200503 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8079649f-0d68-4bbb-92ad-da502d2bbf9a tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:15.200946 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8079649f-0d68-4bbb-92ad-da502d2bbf9a tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:15.201686 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8079649f-0d68-4bbb-92ad-da502d2bbf9a tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:15.202143 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8079649f-0d68-4bbb-92ad-da502d2bbf9a tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:15.202566 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-8079649f-0d68-4bbb-92ad-da502d2bbf9a tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:15.344341 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-8079649f-0d68-4bbb-92ad-da502d2bbf9a tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:08:15.352343 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-8079649f-0d68-4bbb-92ad-da502d2bbf9a tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49" status: 200 len: 1374 microversion: 2.1 time: 0.167627 Sep 17 22:08:15.361926 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3507/7110] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:08:15 2022] GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49 => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:08:16.381998 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-965bb8f3-ef25-40c9-8063-0b12578749bc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:08:16.382971 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-965bb8f3-ef25-40c9-8063-0b12578749bc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: 3b3b12e9-a732-453b-8e91-9e1ab78dad49] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:08:16.390618 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-965bb8f3-ef25-40c9-8063-0b12578749bc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:16.391120 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-965bb8f3-ef25-40c9-8063-0b12578749bc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:16.391614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-965bb8f3-ef25-40c9-8063-0b12578749bc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:16.392340 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-965bb8f3-ef25-40c9-8063-0b12578749bc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:16.392820 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-965bb8f3-ef25-40c9-8063-0b12578749bc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:16.393253 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-965bb8f3-ef25-40c9-8063-0b12578749bc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:16.528349 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-965bb8f3-ef25-40c9-8063-0b12578749bc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:08:16.536564 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-965bb8f3-ef25-40c9-8063-0b12578749bc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49" status: 200 len: 1374 microversion: 2.1 time: 0.162985 Sep 17 22:08:16.537158 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3604/7111] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:08:16 2022] GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:08:17.564548 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-31f8cf98-708f-4b37-94a7-bf47ae7b1ccc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:08:17.565501 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-31f8cf98-708f-4b37-94a7-bf47ae7b1ccc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: 3b3b12e9-a732-453b-8e91-9e1ab78dad49] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:08:17.577942 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-31f8cf98-708f-4b37-94a7-bf47ae7b1ccc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:17.578754 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-31f8cf98-708f-4b37-94a7-bf47ae7b1ccc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:17.579481 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-31f8cf98-708f-4b37-94a7-bf47ae7b1ccc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:17.580626 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-31f8cf98-708f-4b37-94a7-bf47ae7b1ccc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:17.581391 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-31f8cf98-708f-4b37-94a7-bf47ae7b1ccc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:17.582166 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-31f8cf98-708f-4b37-94a7-bf47ae7b1ccc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:17.717614 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-31f8cf98-708f-4b37-94a7-bf47ae7b1ccc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:08:17.725945 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-31f8cf98-708f-4b37-94a7-bf47ae7b1ccc tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49" status: 200 len: 1374 microversion: 2.1 time: 0.168247 Sep 17 22:08:17.726531 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3508/7112] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:08:17 2022] GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49 => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:08:18.752764 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-1ef94058-5c29-4fb1-8bd7-157c31ac28c5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:08:18.753742 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-1ef94058-5c29-4fb1-8bd7-157c31ac28c5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: 3b3b12e9-a732-453b-8e91-9e1ab78dad49] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:08:18.761436 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1ef94058-5c29-4fb1-8bd7-157c31ac28c5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:18.762007 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1ef94058-5c29-4fb1-8bd7-157c31ac28c5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:18.762467 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1ef94058-5c29-4fb1-8bd7-157c31ac28c5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:18.763197 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1ef94058-5c29-4fb1-8bd7-157c31ac28c5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:18.763677 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1ef94058-5c29-4fb1-8bd7-157c31ac28c5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:18.764128 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-1ef94058-5c29-4fb1-8bd7-157c31ac28c5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:18.901674 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-1ef94058-5c29-4fb1-8bd7-157c31ac28c5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:08:18.909948 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-1ef94058-5c29-4fb1-8bd7-157c31ac28c5 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49" status: 200 len: 1374 microversion: 2.1 time: 0.163608 Sep 17 22:08:18.910546 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3605/7113] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:08:18 2022] GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:08:19.932614 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-e9265df1-726b-4410-b06b-c1f2ac0c4c6b tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:08:19.933232 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-e9265df1-726b-4410-b06b-c1f2ac0c4c6b tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: 3b3b12e9-a732-453b-8e91-9e1ab78dad49] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:08:19.940713 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9265df1-726b-4410-b06b-c1f2ac0c4c6b tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:19.941250 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9265df1-726b-4410-b06b-c1f2ac0c4c6b tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:19.941698 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9265df1-726b-4410-b06b-c1f2ac0c4c6b tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:19.942484 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9265df1-726b-4410-b06b-c1f2ac0c4c6b tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:19.942937 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9265df1-726b-4410-b06b-c1f2ac0c4c6b tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:19.943720 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-e9265df1-726b-4410-b06b-c1f2ac0c4c6b tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:20.078784 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-e9265df1-726b-4410-b06b-c1f2ac0c4c6b tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:08:20.086997 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-e9265df1-726b-4410-b06b-c1f2ac0c4c6b tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49" status: 200 len: 1374 microversion: 2.1 time: 0.158421 Sep 17 22:08:20.087630 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3509/7114] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:08:19 2022] GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:08:21.118215 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-28b26b03-f3c0-4093-b39d-1a1c9010f96d tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:08:21.119281 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-28b26b03-f3c0-4093-b39d-1a1c9010f96d tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: 3b3b12e9-a732-453b-8e91-9e1ab78dad49] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:08:21.131002 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28b26b03-f3c0-4093-b39d-1a1c9010f96d tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:21.131846 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28b26b03-f3c0-4093-b39d-1a1c9010f96d tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:21.132614 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28b26b03-f3c0-4093-b39d-1a1c9010f96d tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:21.133915 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28b26b03-f3c0-4093-b39d-1a1c9010f96d tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:21.134733 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28b26b03-f3c0-4093-b39d-1a1c9010f96d tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:21.135435 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-28b26b03-f3c0-4093-b39d-1a1c9010f96d tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:21.278984 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-28b26b03-f3c0-4093-b39d-1a1c9010f96d tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:08:21.287041 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-28b26b03-f3c0-4093-b39d-1a1c9010f96d tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49" status: 200 len: 1374 microversion: 2.1 time: 0.175714 Sep 17 22:08:21.287661 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3606/7115] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:08:21 2022] GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49 => generated 1374 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:08:21.496145 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-fc3a50a7-2e90-4731-8b55-1e62a0ccbf36 req-f91ef6d9-e831-4f0a-93c7-29ede933b10a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b3b12e9-a732-453b-8e91-9e1ab78dad49", "name": "network-vif-plugged", "status": "completed", "tag": "9c6166c9-b2a7-4b15-96df-0cbb1a100b16"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 22:08:21.507506 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-fc3a50a7-2e90-4731-8b55-1e62a0ccbf36 req-f91ef6d9-e831-4f0a-93c7-29ede933b10a service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:21.507999 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-fc3a50a7-2e90-4731-8b55-1e62a0ccbf36 req-f91ef6d9-e831-4f0a-93c7-29ede933b10a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:21.508429 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-fc3a50a7-2e90-4731-8b55-1e62a0ccbf36 req-f91ef6d9-e831-4f0a-93c7-29ede933b10a service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:21.520164 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-fc3a50a7-2e90-4731-8b55-1e62a0ccbf36 req-f91ef6d9-e831-4f0a-93c7-29ede933b10a service nova] Creating event network-vif-plugged:9c6166c9-b2a7-4b15-96df-0cbb1a100b16 for instance 3b3b12e9-a732-453b-8e91-9e1ab78dad49 on nch1-master-1 Sep 17 22:08:21.525236 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-fc3a50a7-2e90-4731-8b55-1e62a0ccbf36 req-f91ef6d9-e831-4f0a-93c7-29ede933b10a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032952 Sep 17 22:08:21.526095 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3510/7116] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 22:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 22:08:22.310571 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-d750cfb4-1210-4dc0-a25f-da4f528719fe tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:08:22.311223 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-d750cfb4-1210-4dc0-a25f-da4f528719fe tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: 3b3b12e9-a732-453b-8e91-9e1ab78dad49] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:08:22.318819 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d750cfb4-1210-4dc0-a25f-da4f528719fe tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:22.319334 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d750cfb4-1210-4dc0-a25f-da4f528719fe tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:22.319806 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d750cfb4-1210-4dc0-a25f-da4f528719fe tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:22.320526 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d750cfb4-1210-4dc0-a25f-da4f528719fe tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:22.321011 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d750cfb4-1210-4dc0-a25f-da4f528719fe tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:22.321488 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-d750cfb4-1210-4dc0-a25f-da4f528719fe tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:22.466378 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-d750cfb4-1210-4dc0-a25f-da4f528719fe tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:08:22.474860 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-d750cfb4-1210-4dc0-a25f-da4f528719fe tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49" status: 200 len: 1374 microversion: 2.1 time: 0.168582 Sep 17 22:08:22.475437 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3607/7117] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:08:22 2022] GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49 => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:08:23.504283 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-f40f930a-4d7e-4de6-9826-a9d19d74d75a tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:08:23.505090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-f40f930a-4d7e-4de6-9826-a9d19d74d75a tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: 3b3b12e9-a732-453b-8e91-9e1ab78dad49] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:08:23.515516 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f40f930a-4d7e-4de6-9826-a9d19d74d75a tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:23.516060 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f40f930a-4d7e-4de6-9826-a9d19d74d75a tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:23.516706 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f40f930a-4d7e-4de6-9826-a9d19d74d75a tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:23.517840 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f40f930a-4d7e-4de6-9826-a9d19d74d75a tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:23.518430 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f40f930a-4d7e-4de6-9826-a9d19d74d75a tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:23.519074 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-f40f930a-4d7e-4de6-9826-a9d19d74d75a tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:23.666202 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-f40f930a-4d7e-4de6-9826-a9d19d74d75a tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:08:23.677074 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-f40f930a-4d7e-4de6-9826-a9d19d74d75a tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49" status: 200 len: 1559 microversion: 2.1 time: 0.180840 Sep 17 22:08:23.677701 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3511/7118] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:08:23 2022] GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49 => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:08:23.701030 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-7d58a35b-79fa-4c57-b08f-108cdc1dbd01 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:08:23.701709 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-7d58a35b-79fa-4c57-b08f-108cdc1dbd01 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: 3b3b12e9-a732-453b-8e91-9e1ab78dad49] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:08:23.709220 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d58a35b-79fa-4c57-b08f-108cdc1dbd01 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:23.709789 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d58a35b-79fa-4c57-b08f-108cdc1dbd01 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:23.710258 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d58a35b-79fa-4c57-b08f-108cdc1dbd01 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:23.710985 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d58a35b-79fa-4c57-b08f-108cdc1dbd01 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:23.711462 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d58a35b-79fa-4c57-b08f-108cdc1dbd01 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:23.711914 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-7d58a35b-79fa-4c57-b08f-108cdc1dbd01 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:23.872005 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-7d58a35b-79fa-4c57-b08f-108cdc1dbd01 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:08:23.880645 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-7d58a35b-79fa-4c57-b08f-108cdc1dbd01 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49" status: 200 len: 1559 microversion: 2.1 time: 0.183627 Sep 17 22:08:23.881237 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3608/7119] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:08:23 2022] GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:08:25.540490 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-9820d8e6-54c1-4f62-ab80-9f7edfd56c21 req-fbb0f281-1fda-4c98-b2fc-a0da5d710825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b3b12e9-a732-453b-8e91-9e1ab78dad49", "tag": "9c6166c9-b2a7-4b15-96df-0cbb1a100b16"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 22:08:25.551494 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-9820d8e6-54c1-4f62-ab80-9f7edfd56c21 req-fbb0f281-1fda-4c98-b2fc-a0da5d710825 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:08:25.552113 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-9820d8e6-54c1-4f62-ab80-9f7edfd56c21 req-fbb0f281-1fda-4c98-b2fc-a0da5d710825 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:08:25.552553 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-9820d8e6-54c1-4f62-ab80-9f7edfd56c21 req-fbb0f281-1fda-4c98-b2fc-a0da5d710825 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:08:25.564028 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-9820d8e6-54c1-4f62-ab80-9f7edfd56c21 req-fbb0f281-1fda-4c98-b2fc-a0da5d710825 service nova] Creating event network-changed:9c6166c9-b2a7-4b15-96df-0cbb1a100b16 for instance 3b3b12e9-a732-453b-8e91-9e1ab78dad49 on nch1-master-1 Sep 17 22:08:25.569556 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-9820d8e6-54c1-4f62-ab80-9f7edfd56c21 req-fbb0f281-1fda-4c98-b2fc-a0da5d710825 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032856 Sep 17 22:08:25.570388 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3512/7120] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 22:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 22:09:53.622583 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=26 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:09:53.623462 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=56 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:09:53.624660 ncdv-master-1 devstack@n-api.service[140524]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 17 22:09:53.624819 ncdv-master-1 devstack@n-api.service[140524]: Sat Sep 17 22:09:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49/action (ip 10.222.0.26) !!! Sep 17 22:09:53.625923 ncdv-master-1 devstack@n-api.service[140524]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 17 22:09:53.626103 ncdv-master-1 devstack@n-api.service[140524]: Sat Sep 17 22:09:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49/action (ip 10.222.0.26) !!! Sep 17 22:09:53.630654 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5ba4f353-f85b-44de-a1a6-34e9853d15a9 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-586630041"}} {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 22:09:53.633259 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5ba4f353-f85b-44de-a1a6-34e9853d15a9 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: 3b3b12e9-a732-453b-8e91-9e1ab78dad49] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:09:53.644252 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5ba4f353-f85b-44de-a1a6-34e9853d15a9 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:09:53.644808 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5ba4f353-f85b-44de-a1a6-34e9853d15a9 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:09:53.645312 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5ba4f353-f85b-44de-a1a6-34e9853d15a9 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:09:53.646138 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5ba4f353-f85b-44de-a1a6-34e9853d15a9 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:09:53.646660 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5ba4f353-f85b-44de-a1a6-34e9853d15a9 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:09:53.647143 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5ba4f353-f85b-44de-a1a6-34e9853d15a9 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:09:53.861010 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5ba4f353-f85b-44de-a1a6-34e9853d15a9 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "POST /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49/action" status: 202 len: 0 microversion: 2.1 time: 0.240545 Sep 17 22:09:53.861701 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3609/7121] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Sep 17 22:09:53 2022] POST /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 17 22:10:00.061090 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-9c1840d0-27b6-44df-8975-f642f5401b21 req-b3ec7fad-c299-4da1-87fa-bf340b866ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b3b12e9-a732-453b-8e91-9e1ab78dad49", "name": "network-vif-plugged", "status": "completed", "tag": "9c6166c9-b2a7-4b15-96df-0cbb1a100b16"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 22:10:00.073897 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:10:00.075540 ncdv-master-1 devstack@n-api.service[140523]: DEBUG dbcounter [-] [140523] Writing DB stats nova_cell1:SELECT=56 {{(pid=140523) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:10:00.078154 ncdv-master-1 devstack@n-api.service[140523]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 17 22:10:00.078562 ncdv-master-1 devstack@n-api.service[140523]: Sat Sep 17 22:10:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Sep 17 22:10:00.081788 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-9c1840d0-27b6-44df-8975-f642f5401b21 req-b3ec7fad-c299-4da1-87fa-bf340b866ff4 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:10:00.082537 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-9c1840d0-27b6-44df-8975-f642f5401b21 req-b3ec7fad-c299-4da1-87fa-bf340b866ff4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:10:00.083395 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-9c1840d0-27b6-44df-8975-f642f5401b21 req-b3ec7fad-c299-4da1-87fa-bf340b866ff4 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:10:00.099459 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-9c1840d0-27b6-44df-8975-f642f5401b21 req-b3ec7fad-c299-4da1-87fa-bf340b866ff4 service nova] Creating event network-vif-plugged:9c6166c9-b2a7-4b15-96df-0cbb1a100b16 for instance 3b3b12e9-a732-453b-8e91-9e1ab78dad49 on nch1-master-1 Sep 17 22:10:00.105595 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-9c1840d0-27b6-44df-8975-f642f5401b21 req-b3ec7fad-c299-4da1-87fa-bf340b866ff4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052779 Sep 17 22:10:00.106597 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3513/7122] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 22:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 22:10:07.568535 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-5c62995f-b9ae-4fd9-9750-895e97008f2e tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:10:07.569408 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5c62995f-b9ae-4fd9-9750-895e97008f2e tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: 3b3b12e9-a732-453b-8e91-9e1ab78dad49] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:10:07.572951 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_api:SELECT=2 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:10:07.573687 ncdv-master-1 devstack@n-api.service[140524]: DEBUG dbcounter [-] [140524] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=140524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 22:10:07.574491 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-6b8aeb96-2e5a-434b-adc3-ce5f308da421 req-1e6f63ca-8594-4591-9999-420a5c6e6dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b3b12e9-a732-453b-8e91-9e1ab78dad49", "tag": "9c6166c9-b2a7-4b15-96df-0cbb1a100b16"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 22:10:07.580413 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c62995f-b9ae-4fd9-9750-895e97008f2e tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:10:07.580934 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c62995f-b9ae-4fd9-9750-895e97008f2e tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:10:07.581631 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c62995f-b9ae-4fd9-9750-895e97008f2e tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:10:07.582169 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c62995f-b9ae-4fd9-9750-895e97008f2e tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:10:07.582650 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c62995f-b9ae-4fd9-9750-895e97008f2e tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:10:07.583091 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-5c62995f-b9ae-4fd9-9750-895e97008f2e tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:10:07.586476 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-6b8aeb96-2e5a-434b-adc3-ce5f308da421 req-1e6f63ca-8594-4591-9999-420a5c6e6dd5 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:10:07.586971 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-6b8aeb96-2e5a-434b-adc3-ce5f308da421 req-1e6f63ca-8594-4591-9999-420a5c6e6dd5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:10:07.587417 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-6b8aeb96-2e5a-434b-adc3-ce5f308da421 req-1e6f63ca-8594-4591-9999-420a5c6e6dd5 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:10:07.599383 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-6b8aeb96-2e5a-434b-adc3-ce5f308da421 req-1e6f63ca-8594-4591-9999-420a5c6e6dd5 service nova] Creating event network-changed:9c6166c9-b2a7-4b15-96df-0cbb1a100b16 for instance 3b3b12e9-a732-453b-8e91-9e1ab78dad49 on nch1-master-1 Sep 17 22:10:07.604621 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-6b8aeb96-2e5a-434b-adc3-ce5f308da421 req-1e6f63ca-8594-4591-9999-420a5c6e6dd5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038777 Sep 17 22:10:07.605237 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3514/7123] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 22:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 22:10:07.613405 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-5c62995f-b9ae-4fd9-9750-895e97008f2e tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: 3b3b12e9-a732-453b-8e91-9e1ab78dad49] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 22:10:07.714188 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-5c62995f-b9ae-4fd9-9750-895e97008f2e tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49" status: 204 len: 0 microversion: 2.1 time: 0.149998 Sep 17 22:10:07.718358 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3610/7124] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 22:10:07 2022] DELETE /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 22:10:07.725033 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-a1f94e8e-79e7-4fd2-9c4c-61f441ffe26f tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:10:07.725883 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-a1f94e8e-79e7-4fd2-9c4c-61f441ffe26f tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: 3b3b12e9-a732-453b-8e91-9e1ab78dad49] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:10:07.739638 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1f94e8e-79e7-4fd2-9c4c-61f441ffe26f tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:10:07.743194 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1f94e8e-79e7-4fd2-9c4c-61f441ffe26f tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:10:07.743194 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1f94e8e-79e7-4fd2-9c4c-61f441ffe26f tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:10:07.743194 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1f94e8e-79e7-4fd2-9c4c-61f441ffe26f tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:10:07.743194 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1f94e8e-79e7-4fd2-9c4c-61f441ffe26f tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:10:07.743194 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-a1f94e8e-79e7-4fd2-9c4c-61f441ffe26f tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:10:07.893498 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-a1f94e8e-79e7-4fd2-9c4c-61f441ffe26f tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:10:07.904920 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-a1f94e8e-79e7-4fd2-9c4c-61f441ffe26f tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49" status: 200 len: 1683 microversion: 2.1 time: 0.184261 Sep 17 22:10:07.905660 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3515/7125] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:10:07 2022] GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49 => generated 1683 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:10:08.931131 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-3261b427-2b13-4dba-8eac-ea37ff841348 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:10:08.931912 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-3261b427-2b13-4dba-8eac-ea37ff841348 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: 3b3b12e9-a732-453b-8e91-9e1ab78dad49] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:10:08.939062 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3261b427-2b13-4dba-8eac-ea37ff841348 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:10:08.939581 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3261b427-2b13-4dba-8eac-ea37ff841348 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:10:08.940049 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3261b427-2b13-4dba-8eac-ea37ff841348 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:10:08.940830 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3261b427-2b13-4dba-8eac-ea37ff841348 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:10:08.941326 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3261b427-2b13-4dba-8eac-ea37ff841348 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:10:08.941813 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-3261b427-2b13-4dba-8eac-ea37ff841348 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:10:09.085431 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-3261b427-2b13-4dba-8eac-ea37ff841348 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:10:09.093855 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-3261b427-2b13-4dba-8eac-ea37ff841348 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49" status: 200 len: 1683 microversion: 2.1 time: 0.167084 Sep 17 22:10:09.094458 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3611/7126] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:10:08 2022] GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:10:09.757556 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-71fa4503-74d3-4bf9-b616-7fb33613d5cf req-078c0039-9dc6-4ae5-b133-3b063289bf62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b3b12e9-a732-453b-8e91-9e1ab78dad49", "name": "network-vif-deleted", "tag": "9c6166c9-b2a7-4b15-96df-0cbb1a100b16"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 22:10:09.776077 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-71fa4503-74d3-4bf9-b616-7fb33613d5cf req-078c0039-9dc6-4ae5-b133-3b063289bf62 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:10:09.776963 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-71fa4503-74d3-4bf9-b616-7fb33613d5cf req-078c0039-9dc6-4ae5-b133-3b063289bf62 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:10:09.777701 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-71fa4503-74d3-4bf9-b616-7fb33613d5cf req-078c0039-9dc6-4ae5-b133-3b063289bf62 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:10:09.794847 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-71fa4503-74d3-4bf9-b616-7fb33613d5cf req-078c0039-9dc6-4ae5-b133-3b063289bf62 service nova] Creating event network-vif-deleted:9c6166c9-b2a7-4b15-96df-0cbb1a100b16 for instance 3b3b12e9-a732-453b-8e91-9e1ab78dad49 on nch1-master-1 Sep 17 22:10:09.800073 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-71fa4503-74d3-4bf9-b616-7fb33613d5cf req-078c0039-9dc6-4ae5-b133-3b063289bf62 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046543 Sep 17 22:10:09.800705 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3516/7127] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 22:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 22:10:10.119091 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-526305ce-7153-49aa-9138-2e2baddc62b9 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:10:10.119839 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-526305ce-7153-49aa-9138-2e2baddc62b9 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: 3b3b12e9-a732-453b-8e91-9e1ab78dad49] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:10:10.127715 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-526305ce-7153-49aa-9138-2e2baddc62b9 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:10:10.128557 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-526305ce-7153-49aa-9138-2e2baddc62b9 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:10:10.129022 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-526305ce-7153-49aa-9138-2e2baddc62b9 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:10:10.129807 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-526305ce-7153-49aa-9138-2e2baddc62b9 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:10:10.130287 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-526305ce-7153-49aa-9138-2e2baddc62b9 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:10:10.130776 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-526305ce-7153-49aa-9138-2e2baddc62b9 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:10:10.167400 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-526305ce-7153-49aa-9138-2e2baddc62b9 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:10:10.167921 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-526305ce-7153-49aa-9138-2e2baddc62b9 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:10:10.168381 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-526305ce-7153-49aa-9138-2e2baddc62b9 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:10:10.168857 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-526305ce-7153-49aa-9138-2e2baddc62b9 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lazy-loading 'fault' on Instance uuid 3b3b12e9-a732-453b-8e91-9e1ab78dad49 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 22:10:10.215559 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-526305ce-7153-49aa-9138-2e2baddc62b9 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:10:10.223590 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-526305ce-7153-49aa-9138-2e2baddc62b9 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49" status: 200 len: 1338 microversion: 2.1 time: 0.108513 Sep 17 22:10:10.224361 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3612/7128] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:10:10 2022] GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49 => generated 1338 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:10:11.249315 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b3a16fec-d384-47e9-b4bb-c4fe5d8387f4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:10:11.250045 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-b3a16fec-d384-47e9-b4bb-c4fe5d8387f4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: 3b3b12e9-a732-453b-8e91-9e1ab78dad49] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:10:11.260151 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3a16fec-d384-47e9-b4bb-c4fe5d8387f4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:10:11.260766 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3a16fec-d384-47e9-b4bb-c4fe5d8387f4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:10:11.261708 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3a16fec-d384-47e9-b4bb-c4fe5d8387f4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:10:11.262523 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3a16fec-d384-47e9-b4bb-c4fe5d8387f4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:10:11.262986 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3a16fec-d384-47e9-b4bb-c4fe5d8387f4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:10:11.263420 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-b3a16fec-d384-47e9-b4bb-c4fe5d8387f4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:10:11.279703 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-b3a16fec-d384-47e9-b4bb-c4fe5d8387f4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] HTTP exception thrown: Instance 3b3b12e9-a732-453b-8e91-9e1ab78dad49 could not be found. Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b3a16fec-d384-47e9-b4bb-c4fe5d8387f4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Request method failure captured: Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49 HTTP/1.1 Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJkStgWXjrVwRfpPNYXFJUjTYtbGLYc8wosIxefNOknoctRiVOhLMT4ceIUmj_VZIBkbWuwQyD-rNdm2a3si2l2Dmeym-RFbnMfDw85MwUqysMcO0XGe3XeGJ0SCd0BOFDF6rVO2pDsWuNWDNSOK2_JWbA2KJZNg8BFyd1-q2LXalK60 Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 3881a625eb9c4ad9bc95e1a8033a5b3d Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-TestSnapshotPattern-1362498901 Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3881a625eb9c4ad9bc95e1a8033a5b3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3881a625eb9c4ad9bc95e1a8033a5b3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3881a625eb9c4ad9bc95e1a8033a5b3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3881a625eb9c4ad9bc95e1a8033a5b3d", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-TestSnapshotPattern-1362498901 Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 3881a625eb9c4ad9bc95e1a8033a5b3d Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-TestSnapshotPattern-1362498901 Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-TestSnapshotPattern-1362498901-project Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: d46ef9b682704558999055a3b8f71f25 Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-TestSnapshotPattern-1362498901-project Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance 3b3b12e9-a732-453b-8e91-9e1ab78dad49 could not be found. Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': '3b3b12e9-a732-453b-8e91-9e1ab78dad49'} Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b3b12e9-a732-453b-8e91-9e1ab78dad49 could not be found. Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b3b12e9-a732-453b-8e91-9e1ab78dad49 could not be found. Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 22:10:11.281381 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 22:10:11.286110 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 22:10:11.286110 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 22:10:11.286110 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 22:10:11.286110 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 22:10:11.286110 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 22:10:11.286110 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b3b12e9-a732-453b-8e91-9e1ab78dad49 could not be found. Sep 17 22:10:11.286110 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 22:10:11.286110 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-b3a16fec-d384-47e9-b4bb-c4fe5d8387f4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Returning 404 to user: Instance 3b3b12e9-a732-453b-8e91-9e1ab78dad49 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 22:10:11.286110 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-b3a16fec-d384-47e9-b4bb-c4fe5d8387f4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49" status: 404 len: 111 microversion: 2.1 time: 0.038975 Sep 17 22:10:11.286110 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3517/7129] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:10:11 2022] GET /compute/v2.1/servers/3b3b12e9-a732-453b-8e91-9e1ab78dad49 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 22:10:12.699840 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-157805f0-e564-401d-a7e8-f7960b1acd06 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:10:12.700362 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-157805f0-e564-401d-a7e8-f7960b1acd06 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: b16edd7f-875f-4ba9-920b-30f297d20de6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:10:12.702267 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-0646bcee-8368-435e-aedf-1733d180c53f req-0b5be7d6-3c6c-4269-bc60-017562bd2b31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b16edd7f-875f-4ba9-920b-30f297d20de6", "tag": "528a58cf-25ef-4838-b8d9-85b4fd5ea68a"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 22:10:12.707626 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-157805f0-e564-401d-a7e8-f7960b1acd06 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:10:12.708139 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-157805f0-e564-401d-a7e8-f7960b1acd06 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:10:12.708598 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-157805f0-e564-401d-a7e8-f7960b1acd06 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:10:12.709329 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-157805f0-e564-401d-a7e8-f7960b1acd06 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:10:12.710056 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-157805f0-e564-401d-a7e8-f7960b1acd06 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:10:12.710572 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-157805f0-e564-401d-a7e8-f7960b1acd06 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:10:12.712959 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-0646bcee-8368-435e-aedf-1733d180c53f req-0b5be7d6-3c6c-4269-bc60-017562bd2b31 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:10:12.713687 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-0646bcee-8368-435e-aedf-1733d180c53f req-0b5be7d6-3c6c-4269-bc60-017562bd2b31 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:10:12.714122 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-0646bcee-8368-435e-aedf-1733d180c53f req-0b5be7d6-3c6c-4269-bc60-017562bd2b31 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:10:12.731126 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-0646bcee-8368-435e-aedf-1733d180c53f req-0b5be7d6-3c6c-4269-bc60-017562bd2b31 service nova] Creating event network-changed:528a58cf-25ef-4838-b8d9-85b4fd5ea68a for instance b16edd7f-875f-4ba9-920b-30f297d20de6 on nch2-master-1 Sep 17 22:10:12.738141 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-0646bcee-8368-435e-aedf-1733d180c53f req-0b5be7d6-3c6c-4269-bc60-017562bd2b31 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039327 Sep 17 22:10:12.738944 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3518/7130] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 22:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 22:10:12.739810 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-157805f0-e564-401d-a7e8-f7960b1acd06 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: b16edd7f-875f-4ba9-920b-30f297d20de6] Going to try to terminate instance {{(pid=140524) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 17 22:10:12.836011 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-157805f0-e564-401d-a7e8-f7960b1acd06 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b16edd7f-875f-4ba9-920b-30f297d20de6" status: 204 len: 0 microversion: 2.1 time: 0.139879 Sep 17 22:10:12.837068 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3613/7131] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Sep 17 22:10:12 2022] DELETE /compute/v2.1/servers/b16edd7f-875f-4ba9-920b-30f297d20de6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 17 22:10:12.846914 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-fc6f0e3d-226e-4e43-bf6a-df6d352e0aa3 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:10:12.847732 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-fc6f0e3d-226e-4e43-bf6a-df6d352e0aa3 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: b16edd7f-875f-4ba9-920b-30f297d20de6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:10:12.854229 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc6f0e3d-226e-4e43-bf6a-df6d352e0aa3 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:10:12.854786 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc6f0e3d-226e-4e43-bf6a-df6d352e0aa3 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:10:12.855462 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc6f0e3d-226e-4e43-bf6a-df6d352e0aa3 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:10:12.856338 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc6f0e3d-226e-4e43-bf6a-df6d352e0aa3 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:10:12.856938 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc6f0e3d-226e-4e43-bf6a-df6d352e0aa3 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:10:12.857534 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-fc6f0e3d-226e-4e43-bf6a-df6d352e0aa3 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:10:12.998464 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.policy [None req-fc6f0e3d-226e-4e43-bf6a-df6d352e0aa3 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140523) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:10:13.006473 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-fc6f0e3d-226e-4e43-bf6a-df6d352e0aa3 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/b16edd7f-875f-4ba9-920b-30f297d20de6" status: 200 len: 1682 microversion: 2.1 time: 0.163928 Sep 17 22:10:13.007266 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3519/7132] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:10:12 2022] GET /compute/v2.1/servers/b16edd7f-875f-4ba9-920b-30f297d20de6 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:10:14.036571 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-e881f1d6-7624-467f-a4d3-4d1ee2a2456d tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:10:14.037638 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-e881f1d6-7624-467f-a4d3-4d1ee2a2456d tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: b16edd7f-875f-4ba9-920b-30f297d20de6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:10:14.049404 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e881f1d6-7624-467f-a4d3-4d1ee2a2456d tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:10:14.050297 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e881f1d6-7624-467f-a4d3-4d1ee2a2456d tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:10:14.051055 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e881f1d6-7624-467f-a4d3-4d1ee2a2456d tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:10:14.052243 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e881f1d6-7624-467f-a4d3-4d1ee2a2456d tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:10:14.053017 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e881f1d6-7624-467f-a4d3-4d1ee2a2456d tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:10:14.053831 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-e881f1d6-7624-467f-a4d3-4d1ee2a2456d tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:10:14.209541 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-e881f1d6-7624-467f-a4d3-4d1ee2a2456d tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:10:14.220701 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-e881f1d6-7624-467f-a4d3-4d1ee2a2456d tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/b16edd7f-875f-4ba9-920b-30f297d20de6" status: 200 len: 1682 microversion: 2.1 time: 0.191284 Sep 17 22:10:14.221513 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3614/7133] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:10:14 2022] GET /compute/v2.1/servers/b16edd7f-875f-4ba9-920b-30f297d20de6 => generated 1682 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:10:14.856468 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [req-8a7ce11d-ae88-40fa-a666-68ce80a8edd2 req-e6083dcd-100c-46dc-a29e-01acf059eaa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b16edd7f-875f-4ba9-920b-30f297d20de6", "name": "network-vif-deleted", "tag": "528a58cf-25ef-4838-b8d9-85b4fd5ea68a"}]} {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 17 22:10:14.867359 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8a7ce11d-ae88-40fa-a666-68ce80a8edd2 req-e6083dcd-100c-46dc-a29e-01acf059eaa6 service nova] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:10:14.867834 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8a7ce11d-ae88-40fa-a666-68ce80a8edd2 req-e6083dcd-100c-46dc-a29e-01acf059eaa6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:10:14.868305 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [req-8a7ce11d-ae88-40fa-a666-68ce80a8edd2 req-e6083dcd-100c-46dc-a29e-01acf059eaa6 service nova] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:10:14.880094 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.compute.server_external_events [req-8a7ce11d-ae88-40fa-a666-68ce80a8edd2 req-e6083dcd-100c-46dc-a29e-01acf059eaa6 service nova] Creating event network-vif-deleted:528a58cf-25ef-4838-b8d9-85b4fd5ea68a for instance b16edd7f-875f-4ba9-920b-30f297d20de6 on nch2-master-1 Sep 17 22:10:14.885258 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [req-8a7ce11d-ae88-40fa-a666-68ce80a8edd2 req-e6083dcd-100c-46dc-a29e-01acf059eaa6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032709 Sep 17 22:10:14.885900 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3520/7134] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Sep 17 22:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 17 22:10:15.247095 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-bc050256-5a6a-4a87-8300-510704043cec tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:10:15.247740 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.compute.api [None req-bc050256-5a6a-4a87-8300-510704043cec tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: b16edd7f-875f-4ba9-920b-30f297d20de6] Fetching instance by UUID {{(pid=140524) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:10:15.255409 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc050256-5a6a-4a87-8300-510704043cec tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:10:15.255926 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc050256-5a6a-4a87-8300-510704043cec tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:10:15.256355 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc050256-5a6a-4a87-8300-510704043cec tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:10:15.258453 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc050256-5a6a-4a87-8300-510704043cec tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:10:15.258453 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc050256-5a6a-4a87-8300-510704043cec tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:10:15.258453 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc050256-5a6a-4a87-8300-510704043cec tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:10:15.298072 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc050256-5a6a-4a87-8300-510704043cec tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:10:15.298588 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc050256-5a6a-4a87-8300-510704043cec tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:10:15.299065 ncdv-master-1 devstack@n-api.service[140524]: DEBUG oslo_concurrency.lockutils [None req-bc050256-5a6a-4a87-8300-510704043cec tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:10:15.299532 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.objects.instance [None req-bc050256-5a6a-4a87-8300-510704043cec tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lazy-loading 'fault' on Instance uuid b16edd7f-875f-4ba9-920b-30f297d20de6 {{(pid=140524) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 17 22:10:15.347929 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.policy [None req-bc050256-5a6a-4a87-8300-510704043cec tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd46ef9b682704558999055a3b8f71f25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3881a625eb9c4ad9bc95e1a8033a5b3d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=140524) authorize /opt/stack/nova/nova/policy.py:199}} Sep 17 22:10:15.355708 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-bc050256-5a6a-4a87-8300-510704043cec tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/b16edd7f-875f-4ba9-920b-30f297d20de6" status: 200 len: 1337 microversion: 2.1 time: 0.112742 Sep 17 22:10:15.356298 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3615/7135] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:10:15 2022] GET /compute/v2.1/servers/b16edd7f-875f-4ba9-920b-30f297d20de6 => generated 1337 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 17 22:10:16.385590 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-12c8cc47-78a0-4edf-8ce0-8c9fe51c94cb tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '>' {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:10:16.386760 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.compute.api [None req-12c8cc47-78a0-4edf-8ce0-8c9fe51c94cb tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] [instance: b16edd7f-875f-4ba9-920b-30f297d20de6] Fetching instance by UUID {{(pid=140523) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 17 22:10:16.394553 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12c8cc47-78a0-4edf-8ce0-8c9fe51c94cb tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:10:16.395170 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12c8cc47-78a0-4edf-8ce0-8c9fe51c94cb tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:10:16.395621 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12c8cc47-78a0-4edf-8ce0-8c9fe51c94cb tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:10:16.396339 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12c8cc47-78a0-4edf-8ce0-8c9fe51c94cb tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Acquiring lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 17 22:10:16.396801 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12c8cc47-78a0-4edf-8ce0-8c9fe51c94cb tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 17 22:10:16.397238 ncdv-master-1 devstack@n-api.service[140523]: DEBUG oslo_concurrency.lockutils [None req-12c8cc47-78a0-4edf-8ce0-8c9fe51c94cb tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Lock "056db90a-cdd9-42b2-a8c3-cd5ab36662a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=140523) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 17 22:10:16.411546 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.wsgi [None req-12c8cc47-78a0-4edf-8ce0-8c9fe51c94cb tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] HTTP exception thrown: Instance b16edd7f-875f-4ba9-920b-30f297d20de6 could not be found. Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-12c8cc47-78a0-4edf-8ce0-8c9fe51c94cb tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Request method failure captured: Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: request: GET /compute/v2.1/servers/b16edd7f-875f-4ba9-920b-30f297d20de6 HTTP/1.1 Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: Accept: application/json Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: Accept-Encoding: identity Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: Connection: close Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: Content-Length: 0 Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: Content-Type: application/json Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: Host: 10.222.0.26 Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: Openstack-System-Scope: None Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: User-Agent: python-urllib3/1.26.12 Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: X-Auth-Token: gAAAAABjJkStgWXjrVwRfpPNYXFJUjTYtbGLYc8wosIxefNOknoctRiVOhLMT4ceIUmj_VZIBkbWuwQyD-rNdm2a3si2l2Dmeym-RFbnMfDw85MwUqysMcO0XGe3XeGJ0SCd0BOFDF6rVO2pDsWuNWDNSOK2_JWbA2KJZNg8BFyd1-q2LXalK60 Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Id: None Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: X-Domain-Name: None Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: X-Identity-Status: Confirmed Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: X-Is-Admin-Project: True Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Id: default Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Domain-Name: Default Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Id: 3881a625eb9c4ad9bc95e1a8033a5b3d Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: X-Project-Name: tempest-TestSnapshotPattern-1362498901 Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: X-Role: member,reader Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: X-Roles: member,reader Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3881a625eb9c4ad9bc95e1a8033a5b3d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3881a625eb9c4ad9bc95e1a8033a5b3d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3881a625eb9c4ad9bc95e1a8033a5b3d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3881a625eb9c4ad9bc95e1a8033a5b3d", "adminURL": "http://10.222.0.26:8080"}]}] Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant: tempest-TestSnapshotPattern-1362498901 Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Id: 3881a625eb9c4ad9bc95e1a8033a5b3d Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: X-Tenant-Name: tempest-TestSnapshotPattern-1362498901 Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: X-User: tempest-TestSnapshotPattern-1362498901-project Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Id: default Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: X-User-Domain-Name: Default Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: X-User-Id: d46ef9b682704558999055a3b8f71f25 Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: X-User-Name: tempest-TestSnapshotPattern-1362498901-project Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: method: > Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: exception: Instance b16edd7f-875f-4ba9-920b-30f297d20de6 could not be found. Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: action_args: {'id': 'b16edd7f-875f-4ba9-920b-30f297d20de6'} Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: {{(pid=140523) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b16edd7f-875f-4ba9-920b-30f297d20de6 could not be found. Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b16edd7f-875f-4ba9-920b-30f297d20de6 could not be found. Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 17 22:10:16.413214 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 22:10:16.417168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 17 22:10:16.417168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 17 22:10:16.417168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 17 22:10:16.417168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 17 22:10:16.417168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 17 22:10:16.417168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b16edd7f-875f-4ba9-920b-30f297d20de6 could not be found. Sep 17 22:10:16.417168 ncdv-master-1 devstack@n-api.service[140523]: ERROR nova.api.openstack.wsgi Sep 17 22:10:16.417168 ncdv-master-1 devstack@n-api.service[140523]: DEBUG nova.api.openstack.wsgi [None req-12c8cc47-78a0-4edf-8ce0-8c9fe51c94cb tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Returning 404 to user: Instance b16edd7f-875f-4ba9-920b-30f297d20de6 could not be found. {{(pid=140523) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 17 22:10:16.417168 ncdv-master-1 devstack@n-api.service[140523]: INFO nova.api.openstack.requestlog [None req-12c8cc47-78a0-4edf-8ce0-8c9fe51c94cb tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "GET /compute/v2.1/servers/b16edd7f-875f-4ba9-920b-30f297d20de6" status: 404 len: 111 microversion: 2.1 time: 0.037863 Sep 17 22:10:16.417168 ncdv-master-1 devstack@n-api.service[140523]: [pid: 140523|app: 0|req: 3521/7136] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Sep 17 22:10:16 2022] GET /compute/v2.1/servers/b16edd7f-875f-4ba9-920b-30f297d20de6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 17 22:10:16.590794 ncdv-master-1 devstack@n-api.service[140524]: DEBUG nova.api.openstack.wsgi [None req-73ada5a1-3fa5-417a-b0b1-a862b06ca6e4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] Calling method '.version_select at 0x7f25a411fb80>' {{(pid=140524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 17 22:10:16.617933 ncdv-master-1 devstack@n-api.service[140524]: INFO nova.api.openstack.requestlog [None req-73ada5a1-3fa5-417a-b0b1-a862b06ca6e4 tempest-TestSnapshotPattern-1362498901 tempest-TestSnapshotPattern-1362498901-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-185310524" status: 202 len: 0 microversion: 2.1 time: 0.030859 Sep 17 22:10:16.618615 ncdv-master-1 devstack@n-api.service[140524]: [pid: 140524|app: 0|req: 3616/7137] 10.222.0.26 () {58 vars in 1254 bytes} [Sat Sep 17 22:10:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-185310524 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)